Systematic evaluation of implementation fidelity of complex interventions in health and social care

PubMed Central

2010-01-01

Background Evaluation of an implementation process and its fidelity can give insight into the 'black box' of interventions. However, a lack of standardized methods for studying fidelity and implementation process have been reported, which might be one reason for the fact that few prior studies in the field of health service research have systematically evaluated interventions' implementation processes. The aim of this project is to systematically evaluate implementation fidelity and possible factors influencing fidelity of complex interventions in health and social care. Methods A modified version of The Conceptual Framework for Implementation Fidelity will be used as a conceptual model for the evaluation. The modification implies two additional moderating factors: context and recruitment. A systematic evaluation process was developed. Multiple case study method is used to investigate implementation of three complex health service interventions. Each case will be investigated in depth and longitudinally, using both quantitative and qualitative methods. Discussion This study is the first attempt to empirically test The Conceptual Framework for Implementation Fidelity. The study can highlight mechanism and factors of importance when implementing complex interventions. Especially the role of the moderating factors on implementation fidelity can be clarified. Trial Registration Supported Employment, SE, among people with severe mental illness -- a randomized controlled trial: NCT00960024. PMID:20815872

Advancing Empirical Scholarship to Further Develop Evaluation Theory and Practice

ERIC Educational Resources Information Center

Christie, Christina A.

2011-01-01

Good theory development is grounded in empirical inquiry. In the context of educational evaluation, the development of empirically grounded theory has important benefits for the field and the practitioner. In particular, a shift to empirically derived theory will assist in advancing more systematic and contextually relevant evaluation practice, as…

Health economic evaluations in orthodontics: a systematic review

PubMed Central

Petrén, Sofia; Björnsson, Liselotte; Norlund, Anders; Bondemark, Lars

2016-01-01

Summary Background: Economic evaluation is assuming increasing importance as an integral component of health services research. Aim: To conduct a systematic review of the literature and assess the evidence from studies presenting orthodontic treatment outcomes and the related costs. Materials/methods: The literature review was conducted in four steps, according to Goodman’s model, in order to identify all studies evaluating economic aspects of orthodontic interventions. The search covered the databases Medline, Cinahl, Cochrane, Embase, Google Scholar, National Health Service Economic Evaluation Database, and SCOPUS, for the period from 1966 to September 2014. The inclusion criteria were as follows: randomized controlled trials or controlled clinical trials comparing at least two different orthodontic interventions, evaluation of both economic and orthodontic outcomes, and study populations of all ages. The quality of each included study was assessed as limited, moderate, or high. The overall evidence was assessed according to the GRADE system (The Grading of Recommendations Assessment, Development and Evaluation). Results: The applied terms for searches yielded 1838 studies, of which 989 were excluded as duplicates. Application of the inclusion and exclusion criteria identified 26 eligible studies for which the full-text versions were retrieved and scrutinized. At the final analysis, eight studies remained. Three studies were based on cost-effectiveness analyses and the other five on cost-minimization analysis. Two of the cost-minimization studies included a societal perspective, i.e. the sum of direct and indirect costs. The aims of most of the studies varied widely and of studies comparing equivalent treatment methods, few were of sufficiently high study quality. Thus, the literature to date provides an inadequate evidence base for economic aspects of orthodontic treatment. Conclusion: This systematic review disclosed that few orthodontic studies have

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature

PubMed Central

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R.; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature.

PubMed

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general

Systematic evaluation of atmospheric chemistry-transport model CHIMERE

NASA Astrophysics Data System (ADS)

Khvorostyanov, Dmitry; Menut, Laurent; Mailler, Sylvain; Siour, Guillaume; Couvidat, Florian; Bessagnet, Bertrand; Turquety, Solene

2017-04-01

Regional-scale atmospheric chemistry-transport models (CTM) are used to develop air quality regulatory measures, to support environmentally sensitive decisions in the industry, and to address variety of scientific questions involving the atmospheric composition. Model performance evaluation with measurement data is critical to understand their limits and the degree of confidence in model results. CHIMERE CTM (http://www.lmd.polytechnique.fr/chimere/) is a French national tool for operational forecast and decision support and is widely used in the international research community in various areas of atmospheric chemistry and physics, climate, and environment (http://www.lmd.polytechnique.fr/chimere/CW-articles.php). This work presents the model evaluation framework applied systematically to the new CHIMERE CTM versions in the course of the continuous model development. The framework uses three of the four CTM evaluation types identified by the Environmental Protection Agency (EPA) and the American Meteorological Society (AMS): operational, diagnostic, and dynamic. It allows to compare the overall model performance in subsequent model versions (operational evaluation), identify specific processes and/or model inputs that could be improved (diagnostic evaluation), and test the model sensitivity to the changes in air quality, such as emission reductions and meteorological events (dynamic evaluation). The observation datasets currently used for the evaluation are: EMEP (surface concentrations), AERONET (optical depths), and WOUDC (ozone sounding profiles). The framework is implemented as an automated processing chain and allows interactive exploration of the results via a web interface.

Systematic Dissemination of Research and Development Program Improvement Efforts.

ERIC Educational Resources Information Center

Sanders, Carol S.

A systematic approach to disseminaton of vocational education research and development program improvement efforts is comprehensive, effective, and efficient. Systematic dissemination is a prerequisite link to assessing impact of research and development--for program improvement to occur, successful dissemination is crucial. A systematic approach…

The Evaluation of Hospital Performance in Iran: A Systematic Review Article

PubMed Central

BAHADORI, Mohammadkarim; IZADI, Ahmad Reza; GHARDASHI, Fatemeh; RAVANGARD, Ramin; HOSSEINI, Seyed Mojtaba

2016-01-01

Background: This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. Methods: In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. Results: The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Conclusion: Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them. PMID:27516991

The Evaluation of Hospital Performance in Iran: A Systematic Review Article.

PubMed

Bahadori, Mohammadkarim; Izadi, Ahmad Reza; Ghardashi, Fatemeh; Ravangard, Ramin; Hosseini, Seyed Mojtaba

2016-07-01

This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them.

Systematic Review of Health Economic Impact Evaluations of Risk Prediction Models: Stop Developing, Start Evaluating.

PubMed

van Giessen, Anoukh; Peters, Jaime; Wilcher, Britni; Hyde, Chris; Moons, Carl; de Wit, Ardine; Koffijberg, Erik

2017-04-01

Although health economic evaluations (HEEs) are increasingly common for therapeutic interventions, they appear to be rare for the use of risk prediction models (PMs). To evaluate the current state of HEEs of PMs by performing a comprehensive systematic review. Four databases were searched for HEEs of PM-based strategies. Two reviewers independently selected eligible articles. A checklist was compiled to score items focusing on general characteristics of HEEs of PMs, model characteristics and quality of HEEs, evidence on PMs typically used in the HEEs, and the specific challenges in performing HEEs of PMs. After screening 791 abstracts, 171 full texts, and reference checking, 40 eligible HEEs evaluating 60 PMs were identified. In these HEEs, PM strategies were compared with current practice (n = 32; 80%), to other stratification methods for patient management (n = 19; 48%), to an extended PM (n = 9; 23%), or to alternative PMs (n = 5; 13%). The PMs guided decisions on treatment (n = 42; 70%), further testing (n = 18; 30%), or treatment prioritization (n = 4; 7%). For 36 (60%) PMs, only a single decision threshold was evaluated. Costs of risk prediction were ignored for 28 (46%) PMs. Uncertainty in outcomes was assessed using probabilistic sensitivity analyses in 22 (55%) HEEs. Despite the huge number of PMs in the medical literature, HEE of PMs remains rare. In addition, we observed great variety in their quality and methodology, which may complicate interpretation of HEE results and implementation of PMs in practice. Guidance on HEE of PMs could encourage and standardize their application and enhance methodological quality, thereby improving adequate use of PM strategies. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Development and Evaluation of ‘Briefing Notes’ as a Novel Knowledge Translation Tool to Aid the Implementation of Sex/Gender Analysis in Systematic Reviews: A Pilot Study

PubMed Central

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E.; Shea, Beverley; O’Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

Background There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly ‘briefing note’ format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Methods Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Results Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group’s focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Conclusions Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

Alternative Modes of Evaluation and Their Application to Rural Development.

ERIC Educational Resources Information Center

Wetherill, G. Richard; Buttram, Joan L.

In order to "cut through the jargon of the multifaceted field of evaluative research", 21 evaluation models representing a range of possibilities were identified (via literature review) and compared in terms of purpose and five basic phases applicable to rural development. Evaluation was defined as "the systematic examination of a…

Developing core economic outcome sets for asthma studies: a protocol for a systematic review.

PubMed

Hounsome, Natalia; Fitzsimmons, Deborah; Phillips, Ceri; Patel, Anita

2017-08-11

Core outcome sets are standardised lists of outcomes, which should be measured and reported in all clinical studies of a specific condition. This study aims to develop core outcome sets for economic evaluations in asthma studies. Economic outcomes include items such as costs, resource use or quality-adjusted life years. The starting point in developing core outcome sets will be conducting a systematic literature review to establish a preliminary list of reporting items to be considered for inclusion in the core outcome set. We will conduct literature searches of peer-reviewed studies published from January 1990 to January 2017. These will include any comparative or observational studies (including economic models) and systematic reviews reporting economic outcomes. All identified economic outcomes will be tabulated together with the major study characteristics, such as population, study design, the nature and intensity of the intervention, mode of data collection and instrument(s) used to derive an outcome. We will undertake a 'realist synthesis review' to analyse the identified economic outcomes. The outcomes will be summarised in the context of evaluation perspectives, types of economic evaluation and methodological approaches. Parallel to undertaking a systematic review, we will conduct semistructured interviews with stakeholders (including people with personal experience of asthma, health professionals, researchers and decision makers) in order to explore additional outcomes which have not been considered, or used, in published studies. The list of outcomes generated from the systematic review and interviews with stakeholders will form the basis of a Delphi survey to refine the identified outcomes into a core outcome set. The review will not involve access to individual-level data. Findings from our systematic review will be communicated to a broad range of stakeholders including clinical guideline developers, research funders, trial registries, ethics

Developing an evidence base for interdisciplinary learning: a systematic review.

PubMed

Cooper, H; Carlisle, C; Gibbs, T; Watkins, C

2001-07-01

The overall aim of the study was to explore the feasibility of introducing interdisciplinary education within undergraduate health professional programmes. This paper reports on the first stage of the study in which a systematic review was conducted to summarize the evidence for interdisciplinary education of undergraduate health professional students. Systematic reviews integrate valid information providing a basis for rational decision making about health care which should be based on empirical and not anecdotal evidence. The accepted principles for systematic reviews were adapted in order to allow integration of the literature to produce recommendations for educational practice and guidelines for future research. The literature on interdisciplinary education was found to be diverse, including relatively small amounts of research data and much larger amounts of evaluation literature. Methodological rating schemes were used to test for confounding influences in the research studies. The number of studies found was 141 but only 30 (21%) were included in the analysis because of lack of methodological rigour in the research and poorly developed outcome measures. Student health professionals were found to benefit from interdisciplinary education with outcome effects primarily relating to changes in knowledge, skills, attitudes and beliefs. Effects upon professional practice were not discernible and educational and psychological theories were rarely used to guide the development of the educational interventions.

Evaluation of Role of Myofibroblasts in Oral Cancer: A Systematic Review.

PubMed

Sekhon, Harjeet K; Sircar, Keya; Kaur, Gurbani; Marwah, Muneet

2016-01-01

To conduct a systematic review on the role of myofibroblasts in progression of oral cancer. The myofibroblast is essential for the integrity of the mammalian body by virtue of its role in wound healing, but it also plays a negative role due to their role in promoting tumor development. Systematic review. Bibliographic searches were conducted in several electronic databases using all publications in PubMed, PubMed central, EMBASE, CancerLit, Google scholar, and Cochrane CCTR between 1990 and June 2015. The search of all publications from various electronic databases revealed 1,371 citations. The total number of studies considered for systematic review was 43. The total number of patients included in the studies was 990. Myofibroblasts are a significant component in stroma of oral cancer cases, though not identified in all cases. This systematic review shows that clinical, pathological, and immunohistochemistry tests have correlated the presence of high myofibroblast count in oral cancer cell stroma. Myofibroblasts play a significant role in oral cancer invasion and progression. Various studies have demonstrated their association with oral cancer. This review tends to highlight their role in the pathogenesis of oral cancer over the decade. Sekhon HK, Sircar K, Kaur G, Marwah M. Evaluation of Role of Myofibroblasts in Oral Cancer: A Systematic Review. Int J Clin Pediatr Dent 2016;9(3):233-239.

Health economic evaluations in orthodontics: a systematic review.

PubMed

Sollenius, Ola; Petrén, Sofia; Björnsson, Liselotte; Norlund, Anders; Bondemark, Lars

2016-06-01

Economic evaluation is assuming increasing importance as an integral component of health services research. To conduct a systematic review of the literature and assess the evidence from studies presenting orthodontic treatment outcomes and the related costs. The literature review was conducted in four steps, according to Goodman's model, in order to identify all studies evaluating economic aspects of orthodontic interventions. The search covered the databases Medline, Cinahl, Cochrane, Embase, Google Scholar, National Health Service Economic Evaluation Database, and SCOPUS, for the period from 1966 to September 2014. The inclusion criteria were as follows: randomized controlled trials or controlled clinical trials comparing at least two different orthodontic interventions, evaluation of both economic and orthodontic outcomes, and study populations of all ages. The quality of each included study was assessed as limited, moderate, or high. The overall evidence was assessed according to the GRADE system (The Grading of Recommendations Assessment, Development and Evaluation). The applied terms for searches yielded 1838 studies, of which 989 were excluded as duplicates. Application of the inclusion and exclusion criteria identified 26 eligible studies for which the full-text versions were retrieved and scrutinized. At the final analysis, eight studies remained. Three studies were based on cost-effectiveness analyses and the other five on cost-minimization analysis. Two of the cost-minimization studies included a societal perspective, i.e. the sum of direct and indirect costs. The aims of most of the studies varied widely and of studies comparing equivalent treatment methods, few were of sufficiently high study quality. Thus, the literature to date provides an inadequate evidence base for economic aspects of orthodontic treatment. This systematic review disclosed that few orthodontic studies have presented both economic and clinical outcomes. There is currently

How healthcare systems evaluate their advance care planning initiatives: Results from a systematic review.

PubMed

Biondo, Patricia D; Lee, Lydia D; Davison, Sara N; Simon, Jessica E

2016-09-01

Advance care planning initiatives are being implemented across healthcare systems around the world, but how best to evaluate their implementation is unknown. To identify gaps and/or redundancies in current evaluative strategies to help healthcare systems develop future evaluative frameworks for ACP. Systematic review. Peer-reviewed and gray literature searches were conducted till February 2015 to answer: "What methods have healthcare systems used to evaluate implementation of advance care planning initiatives?" A PICOS framework was developed to identify articles describing the implementation and evaluation of a health system-level advance care planning initiative. Outcome measures were mapped onto a conceptual quality indicator framework based on the Institute of Medicine and Donabedian models of healthcare quality. A total of 46 studies met inclusion criteria for analysis. Most articles reported on single parts of a healthcare system (e.g. continuing care). The most common outcome measures pertained to document completion, followed by healthcare resource use. Patient-, family-, or healthcare provider-reported outcomes were less commonly measured. Concordance measures (e.g. dying in place of choice) were reported by only 26% of studies. The conceptual quality indicator framework identified gaps and redundancies in measurement and is presented as a potential foundation from which to develop a comprehensive advance care planning evaluation framework. Document completion is frequently used to evaluate advance care planning program implementation; capturing the quality of care appears to be more difficult. This systematic review provides health system administrators with a comprehensive summary of measures used to evaluate advance care planning and may identify gaps in evaluation within their local context. © The Author(s) 2016.

Guidelines for performing systematic reviews in the development of toxicity factors.

PubMed

Schaefer, Heather R; Myers, Jessica L

2017-12-01

The Texas Commission on Environmental Quality (TCEQ) developed guidance on conducting systematic reviews during the development of chemical-specific toxicity factors. Using elements from publicly available frameworks, the TCEQ systematic review process was developed in order to supplement the existing TCEQ Guidelines for developing toxicity factors (TCEQ Regulatory Guidance 442). The TCEQ systematic review process includes six steps: 1) Problem Formulation; 2) Systematic Literature Review and Study Selection; 3) Data Extraction; 4) Study Quality and Risk of Bias Assessment; 5) Evidence Integration and Endpoint Determination; and 6) Confidence Rating. This document provides guidance on conducting a systematic literature review and integrating evidence from different data streams when developing chemical-specific reference values (ReVs) and unit risk factors (URFs). However, this process can also be modified or expanded to address other questions that would benefit from systematic review practices. The systematic review and evidence integration framework can improve regulatory decision-making processes, increase transparency, minimize bias, improve consistency between different risk assessments, and further improve confidence in toxicity factor development. Copyright © 2017 The Author(s). Published by Elsevier Inc. All rights reserved.

Systematic Review of Educational Interventions for Looked-After Children and Young People: Recommendations for Intervention Development and Evaluation

ERIC Educational Resources Information Center

Evans, Rhiannon; Brown, Rachel; Rees, Gwyther; Smith, Philip

2017-01-01

Looked-after children and young people (LACYP) are educationally disadvantaged compared to the general population. A systematic review was conducted of randomised controlled trials evaluating interventions aimed at LACYP aged =18 years. Restrictions were not placed on delivery setting or delivery agent. Intervention outcomes were: academic skills;…

Evaluating information skills training in health libraries: a systematic review.

PubMed

Brettle, Alison

2007-12-01

Systematic reviews have shown that there is limited evidence to demonstrate that the information literacy training health librarians provide is effective in improving clinicians' information skills or has an impact on patient care. Studies lack measures which demonstrate validity and reliability in evaluating the impact of training. To determine what measures have been used; the extent to which they are valid and reliable; to provide guidance for health librarians who wish to evaluate the impact of their information skills training. Systematic review methodology involved searching seven databases, and personal files. Studies were included if they were about information skills training, used an objective measure to assess outcomes, and occurred in a health setting. Fifty-four studies were included in the review. Most outcome measures used in the studies were not tested for the key criteria of validity and reliability. Three tested for validity and reliability are described in more detail. Selecting an appropriate measure to evaluate the impact of training is a key factor in carrying out any evaluation. This systematic review provides guidance to health librarians by highlighting measures used in various circumstances, and those that demonstrate validity and reliability.

Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise

PubMed Central

Schünemann, Holger J.; Wiercioch, Wojtek; Etxeandia, Itziar; Falavigna, Maicon; Santesso, Nancy; Mustafa, Reem; Ventresca, Matthew; Brignardello-Petersen, Romina; Laisaar, Kaja-Triin; Kowalski, Sérgio; Baldeh, Tejan; Zhang, Yuan; Raid, Ulla; Neumann, Ignacio; Norris, Susan L.; Thornton, Judith; Harbour, Robin; Treweek, Shaun; Guyatt, Gordon; Alonso-Coello, Pablo; Reinap, Marge; Brožek, Jan; Oxman, Andrew; Akl, Elie A.

2014-01-01

Background: Although several tools to evaluate the credibility of health care guidelines exist, guidance on practical steps for developing guidelines is lacking. We systematically compiled a comprehensive checklist of items linked to relevant resources and tools that guideline developers could consider, without the expectation that every guideline would address each item. Methods: We searched data sources, including manuals of international guideline developers, literature on guidelines for guidelines (with a focus on methodology reports from international and national agencies, and professional societies) and recent articles providing systematic guidance. We reviewed these sources in duplicate, extracted items for the checklist using a sensitive approach and developed overarching topics relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions and suggestions for items to be added. Results: We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers. The topics and included items cover all stages of the guideline enterprise, from the planning and formulation of guidelines, to their implementation and evaluation. The final checklist includes links to training materials as well as resources with suggested methodology for applying the items. Interpretation: The checklist will serve as a resource for guideline developers. Consideration of items on the checklist will support the development, implementation and evaluation of guidelines. We will use crowdsourcing to revise the checklist and keep it up to date. PMID:24344144

Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise.

PubMed

Schünemann, Holger J; Wiercioch, Wojtek; Etxeandia, Itziar; Falavigna, Maicon; Santesso, Nancy; Mustafa, Reem; Ventresca, Matthew; Brignardello-Petersen, Romina; Laisaar, Kaja-Triin; Kowalski, Sérgio; Baldeh, Tejan; Zhang, Yuan; Raid, Ulla; Neumann, Ignacio; Norris, Susan L; Thornton, Judith; Harbour, Robin; Treweek, Shaun; Guyatt, Gordon; Alonso-Coello, Pablo; Reinap, Marge; Brozek, Jan; Oxman, Andrew; Akl, Elie A

2014-02-18

Although several tools to evaluate the credibility of health care guidelines exist, guidance on practical steps for developing guidelines is lacking. We systematically compiled a comprehensive checklist of items linked to relevant resources and tools that guideline developers could consider, without the expectation that every guideline would address each item. We searched data sources, including manuals of international guideline developers, literature on guidelines for guidelines (with a focus on methodology reports from international and national agencies, and professional societies) and recent articles providing systematic guidance. We reviewed these sources in duplicate, extracted items for the checklist using a sensitive approach and developed overarching topics relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions and suggestions for items to be added. We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers. The topics and included items cover all stages of the guideline enterprise, from the planning and formulation of guidelines, to their implementation and evaluation. The final checklist includes links to training materials as well as resources with suggested methodology for applying the items. The checklist will serve as a resource for guideline developers. Consideration of items on the checklist will support the development, implementation and evaluation of guidelines. We will use crowdsourcing to revise the checklist and keep it up to date.

Study Sensitivity: Evaluating the Ability to Detect Effects in Systematic Reviews of Chemical Exposures

PubMed Central

Cooper, Glinda S.; Lunn, Ruth M.; Ågerstrand, Marlene; Glenn, Barbara S.; Kraft, Andrew D.; Luke, April M.; Ratcliffe, Jennifer M.

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as “sensitivity”, is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and

Study sensitivity: Evaluating the ability to detect effects in systematic reviews of chemical exposures.

PubMed

Cooper, Glinda S; Lunn, Ruth M; Ågerstrand, Marlene; Glenn, Barbara S; Kraft, Andrew D; Luke, April M; Ratcliffe, Jennifer M

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as "sensitivity", is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and

[Principles for the evaluation of telemedicine applications: Results of a systematic review and consensus process].

PubMed

Arnold, Katrin; Scheibe, Madlen; Müller, Olaf; Schmitt, Jochen

2016-11-01

The limited number of telemedicine applications being transferred to standard medical care in Germany may to some extent be explained by deficits in the current evaluation practice. Effectiveness and cost effectiveness can only be demonstrated to decision makers and potential users with methodologically sound and fully published evaluations. There is a lack of well-founded and mandatory standards for adequate, comparable evaluations of telemedicine applications. As part of the project CCS Telehealth Eastern Saxony (CCS THOS), a systematic review on evaluation concepts for telemedicine applications (search period until September 2014, databases Medline, Embase, HTA-Database, DARE, NHS EED) as well as an additional selective literature search were conducted. Suggestions for evaluation fundamentals were derived from the results. These suggestions were subjected to a formal consensus process (nominal group process) with relevant stakeholder groups (healthcare payers, healthcare providers, health policy representatives, researchers). 19 papers were included in the systematic review. In accordance with the predefined inclusion criteria, each presented an evaluation concept for telemedicine applications that was based upon a systematic review and/or a consensus process. Via a formal consensus process, the suggestions for evaluation principles derived from the review and the selective literature search (23 papers) resulted in ten agreed evaluation principles. Eight of them were unanimously agreed upon, two were arrived at with one abstention each. The principles enclose criteria for the planning, conduct and reporting of telemedicine evaluations. Adherence to them is obligatory for users of the telemedical infrastructure provided by CCS THOS. Furthermore, right from the beginning the intention was very much for these principles to be seized upon by other projects and initiatives. The agreed evaluation principles for telemedicine applications are the first in Germany to be

[Function of the present systematic evaluation in establishment of guidance for clinical practice].

PubMed

Yang, Jin-Hong; Hu, Jing; Yang, Feng-Chun; Zhang, Ning; Wang, Bing; Li, Xin

2012-07-01

Treatment of insomnia with acupuncture is taken as an example to explore the significance and problems existed in the present systematic evaluation in establishment of guidance for clinical practice. Fifteen articles on systematic evaluation of both English and Chinese were retrieved and studied carefully, their basic information was analyzed. Through study on the establishing process of the guidance of clinical practice, researches were focused on the possible significance of the articles to the guidance as well as the notes in the reuse of those articles since problem still existed. It is held that the systematic evaluation has great significance on the establishment of the guidance from the aspects of applicable people, recommended standards of diagnosis and therapeutic evaluation, extended recommendation and methodology. Great importance should also be attached to the direct application of the research result and understanding of the evaluation result. The data should be rechecked when necessary. Great guiding function can be found on the systematic evaluation of articles to the guidance. Moreover, if information needed to be taken into a full play, specific analysis should also be done on the concrete research targets.

User Experience Evaluation Methods in Product Development (UXEM'09)

NASA Astrophysics Data System (ADS)

Roto, Virpi; Väänänen-Vainio-Mattila, Kaisa; Law, Effie; Vermeeren, Arnold

High quality user experience (UX) has become a central competitive factor of product development in mature consumer markets [1]. Although the term UX originated from industry and is a widely used term also in academia, the tools for managing UX in product development are still inadequate. A prerequisite for designing delightful UX in an industrial setting is to understand both the requirements tied to the pragmatic level of functionality and interaction and the requirements pertaining to the hedonic level of personal human needs, which motivate product use [2]. Understanding these requirements helps managers set UX targets for product development. The next phase in a good user-centered design process is to iteratively design and evaluate prototypes [3]. Evaluation is critical for systematically improving UX. In many approaches to UX, evaluation basically needs to be postponed until the product is fully or at least almost fully functional. However, in an industrial setting, it is very expensive to find the UX failures only at this phase of product development. Thus, product development managers and developers have a strong need to conduct UX evaluation as early as possible, well before all the parts affecting the holistic experience are available. Different types of products require evaluation on different granularity and maturity levels of a prototype. For example, due to its multi-user characteristic, a community service or an enterprise resource planning system requires a broader scope of UX evaluation than a microwave oven or a word processor that is meant for a single user at a time. Before systematic UX evaluation can be taken into practice, practical, lightweight UX evaluation methods suitable for different types of products and different phases of product readiness are needed. A considerable amount of UX research is still about the conceptual frameworks and models for user experience [4]. Besides, applying existing usability evaluation methods (UEMs) without

Systematic Product Development of Control and Diagnosis Functionalities

NASA Astrophysics Data System (ADS)

Stetter, R.; Simundsson, A.

2017-01-01

In the scientific field of systematic product development a wide range of helpful methods, guidelines and tools were generated and published in recent years. Until now little special attention was given to design guidelines aiming at supporting product development engineers to design products that allow and support control or diagnosis functions. The general trend to ubiquitous computing and the first development steps towards cognitive systems as well as a general trend toward higher product safety, reliability and reduced total cost of ownership (TCO) in many engineering fields lead to a higher importance of control and diagnosis. In this paper a first attempt is made to formulate general valid guidelines how products can be developed in order to allow and to achieve effective and efficient control and diagnosis. The guidelines are elucidated on the example of an automated guided vehicle. One main concern of this paper is the integration of control and diagnosis functionalities into the development of complete systems which include mechanical, electrical and electronic subsystems. For the development of such systems the strategies, methods and tools of systematic product development have attracted significant attention during the last decades. Today, the functionality and safety of most products is to a large degree dependent on control and diagnosis functionalities. Still, there is comparatively little research concentrating on the integration of the development of these functionalities into the overall product development processes. The paper starts with a background describing Systematic Product Development. The second section deals with the product development of the sample product. The third part clarifies the notions monitoring, control and diagnosis. The following parts summarize some insights and formulate first hypotheses concerning control and diagnosis in Systematic Product Development.

Consensus Recommendations for Systematic Evaluation of Drug-Drug Interaction Evidence for Clinical Decision Support

PubMed Central

Scheife, Richard T.; Hines, Lisa E.; Boyce, Richard D.; Chung, Sophie P.; Momper, Jeremiah; Sommer, Christine D.; Abernethy, Darrell R.; Horn, John; Sklar, Stephen J.; Wong, Samantha K.; Jones, Gretchen; Brown, Mary; Grizzle, Amy J.; Comes, Susan; Wilkins, Tricia Lee; Borst, Clarissa; Wittie, Michael A.; Rich, Alissa; Malone, Daniel C.

2015-01-01

Background Healthcare organizations, compendia, and drug knowledgebase vendors use varying methods to evaluate and synthesize evidence on drug-drug interactions (DDIs). This situation has a negative effect on electronic prescribing and medication information systems that warn clinicians of potentially harmful medication combinations. Objective To provide recommendations for systematic evaluation of evidence from the scientific literature, drug product labeling, and regulatory documents with respect to DDIs for clinical decision support. Methods A conference series was conducted to develop a structured process to improve the quality of DDI alerting systems. Three expert workgroups were assembled to address the goals of the conference. The Evidence Workgroup consisted of 15 individuals with expertise in pharmacology, drug information, biomedical informatics, and clinical decision support. Workgroup members met via webinar from January 2013 to February 2014. Two in-person meetings were conducted in May and September 2013 to reach consensus on recommendations. Results We developed expert-consensus answers to three key questions: 1) What is the best approach to evaluate DDI evidence?; 2) What evidence is required for a DDI to be applicable to an entire class of drugs?; and 3) How should a structured evaluation process be vetted and validated? Conclusion Evidence-based decision support for DDIs requires consistent application of transparent and systematic methods to evaluate the evidence. Drug information systems that implement these recommendations should be able to provide higher quality information about DDIs in drug compendia and clinical decision support tools. PMID:25556085

Systematic Evaluation of Professional Performance: Legally Supported Procedure and Process.

ERIC Educational Resources Information Center

Kerl, Stella Beatriz; Garcia, John L.; McCullough, C. Sue; Maxwell, Melissa Elaine

2002-01-01

Legal challenges to counseling students' dismissal that are based on interpersonal or clinical incompetence require sound systematic academic evaluation and adherence to procedural and substantive due process. Presents an examination of professional competency from counselor education and legal perspectives, an evaluation procedure and process,…

Evaluation Influence: The Evaluation Event and Capital Flow in International Development.

PubMed

Bell, David A

2017-12-01

Assessing program effectiveness in human development is central to informing foreign aid policy-making and organizational learning. Foreign aid effectiveness discussions have increasingly given attention to the devaluing effects of aid flow volatility. This study reveals that the external evaluation event influences actor behavior, serving as a volatility-constraining tool. A case study of a multidonor aid development mechanism served examining the influence of an evaluation event when considering anticipatory effects. The qualitative component used text and focus group data combined with individual interview data (organizations n = 10, including 26 individuals). Quantitative data included financial information on all 75 capital investments. The integrated theory of influence and model of alternative mechanisms used these components to identify the linkage between the evaluation event and capital flow volatility. Aid approved in the year of the midterm evaluation was disbursed by the mechanism with low capital volatility. Anticipating the evaluation event influenced behavior resulting in an empirical record that program outcomes were enhanced and the mechanism was an improved organization. Formative evaluations in a development program can trigger activity as an interim process. That activity provides for a more robust assessment of ultimate consequence of interest. Anticipating an evaluation can stimulate donor reality testing. The findings inform and strengthen future research on the influence of anticipating an evaluation. Closely examining activities before, during, and shortly after the evaluation event can aid development of other systematic methods to improve understanding this phenomenon, as well as improve donor effectiveness strategies.

Early economic evaluation of emerging health technologies: protocol of a systematic review

PubMed Central

2014-01-01

Background The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. Methods/design This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to

Early economic evaluation of emerging health technologies: protocol of a systematic review.

PubMed

Pham, Ba'; Tu, Hong Anh Thi; Han, Dolly; Pechlivanoglou, Petros; Miller, Fiona; Rac, Valeria; Chin, Warren; Tricco, Andrea C; Paulden, Mike; Bielecki, Joanna; Krahn, Murray

2014-07-23

The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the

A Systematic Review of Economic Evaluations of Treatments for Borderline Personality Disorder

PubMed Central

Brettschneider, Christian; Riedel-Heller, Steffi; König, Hans-Helmut

2014-01-01

Purpose The borderline personality disorder is a common mental disorder. It is frequently associated with various mental co-morbidities and a fundamental loss of functioning. The borderline personality disorder causes high costs to society. The aim of this study was to perform a systematic literature review of existing economic evaluations of treatments for borderline personality disorder. Materials and Methods We performed a systematic literature search in MEDLINE, EMBASE, PsycINFO and NHSEED for partial and full economic evaluations regarding borderline personality disorder. Reported cost data were inflated to the year 2012 and converted into US-$ using purchasing power parities to allow for comparability. Quality assessment of the studies was performed by means of the Consensus on Health Economic Criteria checklist, a checklist developed by a Delphi method in cooperation with 23 international experts. Results We identified 6 partial and 9 full economic evaluations. The methodical quality was moderate (fulfilled quality criteria: 79.2% [SD: 15.4%] in partial economic evaluations, 77.3% [SD: 8.5%] in full economic evaluations). Most evaluations analysed psychotherapeutic interventions. Although ambiguous, most evidence exists on dialectical-behavioural therapy. Cognitive behavioural therapy and schema-focused therapy are cost-saving. Evidence on other interventions is scarce. Conclusion The economic evidence is not sufficient to draw robust conclusions for all treatments. It is possible that some treatments are cost-effective. Most evidence exists on dialectical-behavioural therapy. Yet, it is ambiguous. Further research concerning the cost-effectiveness of treatments is necessary as well as the identification of relevant cost categories and the validation of effect measures. PMID:25265185

Consumer evaluation of food with nutritional benefits: a systematic review and narrative synthesis.

PubMed

Mogendi, Joseph Birundu; De Steur, Hans; Gellynck, Xavier; Makokha, Anselimo

2016-06-01

As a consequence of the growing interest in, and development of, various types of food with nutritional benefits, the modern consumer views their kitchen cabinet more and more as a medicine cabinet. Given that consumer evaluation of food is considered key to the successful production, marketing and finally consumption of food, a procedure commonly used in medical fields was employed to systematically review and summarize evidence of consumer evaluation studies on nutritious foods. The focus is primarily on consumer understanding of nutritious food and the underlying determinants of consumer evaluation. Our results highlight four groups of key determinants: (1) nutrition knowledge and information; (2) attitudes, beliefs, perceptions and behavioural determinants; (3) price, process and product characteristics; and (4) socio-demographics. The findings also point to the importance of understanding consumer acceptance as one many concepts in the consumer evaluation process, and provide support for developing appropriate strategies for improving health and well-being of consumers.

Systematic methods for knowledge acquisition and expert system development

NASA Technical Reports Server (NTRS)

Belkin, Brenda L.; Stengel, Robert F.

1991-01-01

Nine cooperating rule-based systems, collectively called AUTOCREW, were designed to automate functions and decisions associated with a combat aircraft's subsystem. The organization of tasks within each system is described; performance metrics were developed to evaluate the workload of each rule base, and to assess the cooperation between the rule-bases. Each AUTOCREW subsystem is composed of several expert systems that perform specific tasks. AUTOCREW's NAVIGATOR was analyzed in detail to understand the difficulties involved in designing the system and to identify tools and methodologies that ease development. The NAVIGATOR determines optimal navigation strategies from a set of available sensors. A Navigation Sensor Management (NSM) expert system was systematically designed from Kalman filter covariance data; four ground-based, a satellite-based, and two on-board INS-aiding sensors were modeled and simulated to aid an INS. The NSM Expert was developed using the Analysis of Variance (ANOVA) and the ID3 algorithm. Navigation strategy selection is based on an RSS position error decision metric, which is computed from the covariance data. Results show that the NSM Expert predicts position error correctly between 45 and 100 percent of the time for a specified navaid configuration and aircraft trajectory. The NSM Expert adapts to new situations, and provides reasonable estimates of hybrid performance. The systematic nature of the ANOVA/ID3 method makes it broadly applicable to expert system design when experimental or simulation data is available.

Development and pilot test of a process to identify research needs from a systematic review.

PubMed

Saldanha, Ian J; Wilson, Lisa M; Bennett, Wendy L; Nicholson, Wanda K; Robinson, Karen A

2013-05-01

To ensure appropriate allocation of research funds, we need methods for identifying high-priority research needs. We developed and pilot tested a process to identify needs for primary clinical research using a systematic review in gestational diabetes mellitus. We conducted eight steps: abstract research gaps from a systematic review using the Population, Intervention, Comparison, Outcomes, and Settings (PICOS) framework; solicit feedback from the review authors; translate gaps into researchable questions using the PICOS framework; solicit feedback from multidisciplinary stakeholders at our institution; establish consensus among multidisciplinary external stakeholders on the importance of the research questions using the Delphi method; prioritize outcomes; develop conceptual models to highlight research needs; and evaluate the process. We identified 19 research questions. During the Delphi method, external stakeholders established consensus for 16 of these 19 questions (15 with "high" and 1 with "medium" clinical benefit/importance). We pilot tested an eight-step process to identify clinically important research needs. Before wider application of this process, it should be tested using systematic reviews of other diseases. Further evaluation should include assessment of the usefulness of the research needs generated using this process for primary researchers and funders. Copyright © 2013 Elsevier Inc. All rights reserved.

"Learning to Play with New Friends": Systematic Quality Development Work in a Leisure-Time Centre

ERIC Educational Resources Information Center

Lager, Karin

2016-01-01

This article explores the recontextualisation of systematic quality development work (Sqdw) in a leisure-time centre. Two teachers' processes of planning, organisation, documentation and evaluation were investigated, the aim being to explore the recontextualisation of Sqdw in practice. The study is thus a case study of these teachers' practice…

What do we know about developing patient portals? a systematic literature review

PubMed Central

de Bont, Antoinette; Rundall, Thomas G; van de Klundert, Joris

2016-01-01

Objective Numerous articles have reported on the development of patient portals, including development problems and solutions. We review these articles to inform future patient portal development efforts and to provide a summary of the evidence base that can guide future research. Materials and Methods We performed a systematic review of relevant literature to answer 5 questions: (1) What categories of problems related to patient portal development have been defined? (2) What causal factors have been identified by problem analysis and diagnosis? (3) What solutions have been proposed to ameliorate these causal factors? (4) Which proposed solutions have been implemented and in which organizational contexts? (5) Have implemented solutions been evaluated and what learning has been generated? Through searches on PubMed, ScienceDirect and LISTA, we included 109 articles. Results We identified 5 main problem categories: achieving patient engagement, provider engagement, appropriate data governance, security and interoperability, and a sustainable business model. Further, we identified key factors contributing to these problems as well as solutions proposed to ameliorate them. While about half (45) of the 109 articles proposed solutions, fewer than half of these solutions (18) were implemented, and even fewer (5) were evaluated to generate learning about their effects. Discussion Few studies systematically report on the patient portal development processes. As a result, the review does not provide an evidence base for portal development. Conclusion Our findings support a set of recommendations for advancement of the evidence base: future research should build on existing evidence, draw on principles from design sciences conveyed in the problem-solving cycle, and seek to produce evidence within various different organizational contexts. PMID:26335985

Systematic modelling and design evaluation of unperturbed tumour dynamics in xenografts.

PubMed

Parra Guillen, Zinnia P Patricia; Mangas Sanjuan, Victor; Garcia-Cremades, Maria; Troconiz, Inaki F; Mo, Gary; Pitou, Celine; Iversen, Philip W; Wallin, Johan E

2018-04-24

Xenograft mice are largely used to evaluate the efficacy of oncological drugs during preclinical phases of drug discovery and development. Mathematical models provide a useful tool to quantitatively characterise tumour growth dynamics and also optimise upcoming experiments. To the best of our knowledge, this is the first report where unperturbed growth of a large set of tumour cell lines (n=28) has been systematically analysed using the model proposed by Simeoni in the context of non-linear mixed effect (NLME). Exponential growth was identified as the governing mechanism in the majority of the cell lines, with constant rate values ranging from 0.0204 to 0.203 day -1 No common patterns could be observed across tumour types, highlighting the importance of combining information from different cell lines when evaluating drug activity. Overall, typical model parameters were precisely estimated using designs where tumour size measurements were taken every two days. Moreover, reducing the number of measurement to twice per week, or even once per week for cell lines with low growth rates, showed little impact on parameter precision. However, in order to accurately characterise parameter variability (i.e. relative standard errors below 50%), a sample size of at least 50 mice is needed. This work illustrates the feasibility to systematically apply NLME models to characterise tumour growth in drug discovery and development, and constitutes a valuable source of data to optimise experimental designs by providing an a priori sampling window and minimising the number of samples required. The American Society for Pharmacology and Experimental Therapeutics.

Systematic review of methods for evaluating healthcare research economic impact

PubMed Central

2010-01-01

Background The economic benefits of healthcare research require study so that appropriate resources can be allocated to this research, particularly in developing countries. As a first step, we performed a systematic review to identify the methods used to assess the economic impact of healthcare research, and the outcomes. Method An electronic search was conducted in relevant databases using a combination of specific keywords. In addition, 21 relevant Web sites were identified. Results The initial search yielded 8,416 articles. After studying titles, abstracts, and full texts, 18 articles were included in the analysis. Eleven other reports were found on Web sites. We found that the outcomes assessed as healthcare research payback included direct cost-savings, cost reductions in healthcare delivery systems, benefits from commercial advancement, and outcomes associated with improved health status. Two methods were used to study healthcare research payback: macro-economic studies, which examine the relationship between research studies and economic outcome at the aggregated level, and case studies, which examine specific research projects to assess economic impact. Conclusions Our study shows that different methods and outcomes can be used to assess the economic impacts of healthcare research. There is no unique methodological approach for the economic evaluation of such research. In our systematic search we found no research that had evaluated the economic return of research in low and middle income countries. We therefore recommend a consensus on practical guidelines at international level on the basis of more comprehensive methodologies (such as Canadian Academic of Health Science and payback frameworks) in order to build capacity, arrange for necessary informative infrastructures and promote necessary skills for economic evaluation studies. PMID:20196839

Evaluating clinical ethics support in mental healthcare: a systematic literature review.

PubMed

Hem, Marit Helene; Pedersen, Reidar; Norvoll, Reidun; Molewijk, Bert

2015-06-01

A systematic literature review on evaluation of clinical ethics support services in mental healthcare is presented and discussed. The focus was on (a) forms of clinical ethics support services, (b) evaluation of clinical ethics support services, (c) contexts and participants and (d) results. Five studies were included. The ethics support activities described were moral case deliberations and ethics rounds. Different qualitative and quantitative research methods were utilized. The results show that (a) participants felt that they gained an increased insight into moral issues through systematic reflection; (b) there was improved cooperation among multidisciplinary team members; (c) it was uncertain whether clinical ethics support services led to better patient care; (d) the issue of patient and client participation is complex; and (e) the implementation process is challenging. Clinical ethics support services have mainly been studied through the experiences of the participating facilitators and healthcare professionals. Hence, there is limited knowledge of whether and how various types of clinical ethics support services influence the quality of care and how patients and relatives may evaluate clinical ethics support services. Based on the six excluded 'grey zone articles', in which there was an implicit focus on ethics reflection, other ways of working with ethical reflection in practice are discussed. Implementing and evaluating clinical ethics support services as approaches to clinical ethics support that are more integrated into the development of good practice are in focus. In order to meet some of the shortcomings of the field of clinical ethics support services, a research project that aims to strengthen ethics support in the mental health services, including patients' and caregivers' views on ethical challenges, is presented. © The Author(s) 2014.

Systematically evaluating interfaces for RNA-seq analysis from a life scientist perspective.

PubMed

Poplawski, Alicia; Marini, Federico; Hess, Moritz; Zeller, Tanja; Mazur, Johanna; Binder, Harald

2016-03-01

RNA-sequencing (RNA-seq) has become an established way for measuring gene expression in model organisms and humans. While methods development for refining the corresponding data processing and analysis pipeline is ongoing, protocols for typical steps have been proposed and are widely used. Several user interfaces have been developed for making such analysis steps accessible to life scientists without extensive knowledge of command line tools. We performed a systematic search and evaluation of such interfaces to investigate to what extent these can indeed facilitate RNA-seq data analysis. We found a total of 29 open source interfaces, and six of the more widely used interfaces were evaluated in detail. Central criteria for evaluation were ease of configuration, documentation, usability, computational demand and reporting. No interface scored best in all of these criteria, indicating that the final choice will depend on the specific perspective of users and the corresponding weighting of criteria. Considerable technical hurdles had to be overcome in our evaluation. For many users, this will diminish potential benefits compared with command line tools, leaving room for future improvement of interfaces. © The Author 2015. Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Environmental scan and evaluation of best practices for online systematic review resources

PubMed Central

Parker, Robin M. N.; Boulos, Leah M.; Visintini, Sarah; Ritchie, Krista; Hayden, Jill

2018-01-01

Objective Online training for systematic review methodology is an attractive option due to flexibility and limited availability of in-person instruction. Librarians often direct new reviewers to these online resources, so they should be knowledgeable about the variety of available resources. The objective for this project was to conduct an environmental scan of online systematic review training resources and evaluate those identified resources. Methods The authors systematically searched for electronic learning resources pertaining to systematic review methods. After screening for inclusion, we collected data about characteristics of training resources and assigned scores in the domains of (1) content, (2) design, (3) interactivity, and (4) usability by applying a previously published evaluation rubric for online instruction modules. We described the characteristics and scores for each training resource and compared performance across the domains. Results Twenty training resources were evaluated. Average overall score of online instructional resources was 61%. Online courses (n=7) averaged 73%, web modules (n=5) 64%, and videos (n=8) 48%. The top 5 highest scoring resources were in course or web module format, featured high interactivity, and required a longer (>5hrs) time commitment from users. Conclusion This study revealed that resources include appropriate content but are less likely to adhere to principles of online training design and interactivity. Awareness of these resources will allow librarians to make informed recommendations for training based on patrons’ needs. Future online systematic review training resources should use established best practices for e-learning to provide high-quality resources, regardless of format or user time commitment. PMID:29632443

Environmental scan and evaluation of best practices for online systematic review resources.

PubMed

Parker, Robin M N; Boulos, Leah M; Visintini, Sarah; Ritchie, Krista; Hayden, Jill

2018-04-01

Online training for systematic review methodology is an attractive option due to flexibility and limited availability of in-person instruction. Librarians often direct new reviewers to these online resources, so they should be knowledgeable about the variety of available resources. The objective for this project was to conduct an environmental scan of online systematic review training resources and evaluate those identified resources. The authors systematically searched for electronic learning resources pertaining to systematic review methods. After screening for inclusion, we collected data about characteristics of training resources and assigned scores in the domains of (1) content, (2) design, (3) interactivity, and (4) usability by applying a previously published evaluation rubric for online instruction modules. We described the characteristics and scores for each training resource and compared performance across the domains. Twenty training resources were evaluated. Average overall score of online instructional resources was 61%. Online courses (n=7) averaged 73%, web modules (n=5) 64%, and videos (n=8) 48%. The top 5 highest scoring resources were in course or web module format, featured high interactivity, and required a longer (>5hrs) time commitment from users. This study revealed that resources include appropriate content but are less likely to adhere to principles of online training design and interactivity. Awareness of these resources will allow librarians to make informed recommendations for training based on patrons' needs. Future online systematic review training resources should use established best practices for e-learning to provide high-quality resources, regardless of format or user time commitment.

What do we know about developing patient portals? a systematic literature review.

PubMed

Otte-Trojel, Terese; de Bont, Antoinette; Rundall, Thomas G; van de Klundert, Joris

2016-04-01

Numerous articles have reported on the development of patient portals, including development problems and solutions. We review these articles to inform future patient portal development efforts and to provide a summary of the evidence base that can guide future research. We performed a systematic review of relevant literature to answer 5 questions: (1) What categories of problems related to patient portal development have been defined? (2) What causal factors have been identified by problem analysis and diagnosis? (3) What solutions have been proposed to ameliorate these causal factors? (4) Which proposed solutions have been implemented and in which organizational contexts? (5) Have implemented solutions been evaluated and what learning has been generated? Through searches on PubMed, ScienceDirect and LISTA, we included 109 articles. We identified 5 main problem categories: achieving patient engagement, provider engagement, appropriate data governance, security and interoperability, and a sustainable business model. Further, we identified key factors contributing to these problems as well as solutions proposed to ameliorate them. While about half (45) of the 109 articles proposed solutions, fewer than half of these solutions (18) were implemented, and even fewer (5) were evaluated to generate learning about their effects. Few studies systematically report on the patient portal development processes. As a result, the review does not provide an evidence base for portal development. Our findings support a set of recommendations for advancement of the evidence base: future research should build on existing evidence, draw on principles from design sciences conveyed in the problem-solving cycle, and seek to produce evidence within various different organizational contexts. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

An overview of systematic review.

PubMed

Baker, Kathy A; Weeks, Susan Mace

2014-12-01

Systematic review is an invaluable tool for the practicing clinician. A well-designed systematic review represents the latest and most complete information available on a particular topic or intervention. This article highlights the key elements of systematic review, what it is and is not, and provides an overview of several reputable organizations supporting the methodological development and conduct of systematic review. Important aspects for evaluating the quality of a systematic review are also included. Copyright © 2014 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

What is the clinical effectiveness and cost-effectiveness of conservative interventions for tendinopathy? An overview of systematic reviews of clinical effectiveness and systematic review of economic evaluations.

PubMed

Long, Linda; Briscoe, Simon; Cooper, Chris; Hyde, Chris; Crathorne, Louise

2015-01-01

Lateral elbow tendinopathy (LET) is a common complaint causing characteristic pain in the lateral elbow and upper forearm, and tenderness of the forearm extensor muscles. It is thought to be an overuse injury and can have a major impact on the patient's social and professional life. The condition is challenging to treat and prone to recurrent episodes. The average duration of a typical episode ranges from 6 to 24 months, with most (89%) reporting recovery by 1 year. This systematic review aims to summarise the evidence concerning the clinical effectiveness and cost-effectiveness of conservative interventions for LET. A comprehensive search was conducted from database inception to 2012 in a range of databases including MEDLINE, EMBASE and Cochrane Databases. We conducted an overview of systematic reviews to summarise the current evidence concerning the clinical effectiveness and a systematic review for the cost-effectiveness of conservative interventions for LET. We identified additional randomised controlled trials (RCTs) that could contribute further evidence to existing systematic reviews. We searched MEDLINE, EMBASE, Allied and Complementary Medicine Database, Cumulative Index to Nursing and Allied Health Literature, Web of Science, The Cochrane Library and other important databases from inception to January 2013. A total of 29 systematic reviews published since 2003 matched our inclusion criteria. These were quality appraised using the Assessment of Multiple Systematic Reviews (AMSTAR) checklist; five were considered high quality and evaluated using a Grading of Recommendations, Assessment, Development and Evaluation approach. A total of 36 RCTs were identified that were not included in a systematic review and 29 RCTs were identified that had only been evaluated in an included systematic review of intermediate/low quality. These were then mapped to existing systematic reviews where further evidence could provide updates. Two economic evaluations were identified

Supporting adherence and healthy lifestyles in leg ulcer patients: systematic development of the Lively Legs program for dermatology outpatient clinics.

PubMed

Heinen, Maud M; Bartholomew, L Kay; Wensing, Michel; van de Kerkhof, Peter; van Achterberg, Theo

2006-05-01

The objective of our project was to develop a lifestyle program for leg ulcer patients at outpatient clinics for dermatology. We used the intervention-mapping (IM) framework for systematically developing theory and evidence based health promotion programs. We started with a needs-assessment. A multidisciplinary project group of health care workers and patients was involved in all five IM steps; formulating proximal program objectives, selecting methods and strategies, producing program components, planning for adoption and implementation and planning for evaluation. Several systematic literature reviews and original studies were performed to support this process. Social Cognitive Theory was selected as the main theory behind the program 'Lively Legs' and was combined with elements of Goal-Setting Theory, the precaution adoption model and motivational interviewing. The program is conducted through health counseling by dermatology nurses and was successfully pre-tested. Also, an implementation and evaluation plan were made. Intervention mapping helped us to succeed in developing a lifestyle program with clear goals and methods, operational strategies and materials and clear procedures. Coaching leg ulcer patients towards adherence with compression therapy and healthy lifestyles should be taken on without delay. Systematic development of lifestyle programs for other patient groups should be encouraged.

Constant-Murley Score: systematic review and standardized evaluation in different shoulder pathologies.

PubMed

Vrotsou, Kalliopi; Ávila, Mónica; Machón, Mónica; Mateo-Abad, Maider; Pardo, Yolanda; Garin, Olatz; Zaror, Carlos; González, Nerea; Escobar, Antonio; Cuéllar, Ricardo

2018-05-10

The objective of this study was to evaluate the psychometric properties of the Constant-Murley Score (CMS) in various shoulder pathologies, based on a systematic review and expert standardized evaluations. A systematic review was performed in MEDLINE and EMBASE databases. Titles and abstracts were reviewed and finally the included articles were grouped according to patients' pathologies. Two expert evaluators independently assessed the CMS properties of reliability, validity, responsiveness to change, interpretability and burden score in each group, using the EMPRO (Evaluating Measures of Patient Reported Outcomes) tool. The CMS properties were assessed per attribute and overall for each considered group. Only the concept and measurement model was assessed globally. Five individual pathologies (i.e. subacromial, fractures, arthritis, instability and frozen shoulder) and two additional groups (i.e. various pathologies and healthy subjects) were considered. Overall EMPRO scores ranged from 58.6 for subacromial to 30.6 points for instability. Responsiveness to change was the only quality to obtain at least 50 points across all groups, but for frozen shoulder. Insufficient information was obtained in relation to the concept and measurement model and great variability was seen in the other evaluated attributes. The current evidence does not support the CMS as a gold standard in shoulder evaluation. Its use is advisable for subacromial pathology; but data are inconclusive for other shoulder conditions. Prospective studies exploring the psychometric properties of the scale, particularly for fractures, arthritis, instability and frozen shoulder are needed. Systematic review.

Mapping the absolute magnetic field and evaluating the quadratic Zeeman-effect-induced systematic error in an atom interferometer gravimeter

NASA Astrophysics Data System (ADS)

Hu, Qing-Qing; Freier, Christian; Leykauf, Bastian; Schkolnik, Vladimir; Yang, Jun; Krutzik, Markus; Peters, Achim

2017-09-01

Precisely evaluating the systematic error induced by the quadratic Zeeman effect is important for developing atom interferometer gravimeters aiming at an accuracy in the μ Gal regime (1 μ Gal =10-8m /s2 ≈10-9g ). This paper reports on the experimental investigation of Raman spectroscopy-based magnetic field measurements and the evaluation of the systematic error in the gravimetric atom interferometer (GAIN) due to quadratic Zeeman effect. We discuss Raman duration and frequency step-size-dependent magnetic field measurement uncertainty, present vector light shift and tensor light shift induced magnetic field measurement offset, and map the absolute magnetic field inside the interferometer chamber of GAIN with an uncertainty of 0.72 nT and a spatial resolution of 12.8 mm. We evaluate the quadratic Zeeman-effect-induced gravity measurement error in GAIN as 2.04 μ Gal . The methods shown in this paper are important for precisely mapping the absolute magnetic field in vacuum and reducing the quadratic Zeeman-effect-induced systematic error in Raman transition-based precision measurements, such as atomic interferometer gravimeters.

How is genetic testing evaluated? A systematic review of the literature.

PubMed

Pitini, Erica; De Vito, Corrado; Marzuillo, Carolina; D'Andrea, Elvira; Rosso, Annalisa; Federici, Antonio; Di Maria, Emilio; Villari, Paolo

2018-05-01

Given the rapid development of genetic tests, an assessment of their benefits, risks, and limitations is crucial for public health practice. We performed a systematic review aimed at identifying and comparing the existing evaluation frameworks for genetic tests. We searched PUBMED, SCOPUS, ISI Web of Knowledge, Google Scholar, Google, and gray literature sources for any documents describing such frameworks. We identified 29 evaluation frameworks published between 2000 and 2017, mostly based on the ACCE Framework (n = 13 models), or on the HTA process (n = 6), or both (n = 2). Others refer to the Wilson and Jungner screening criteria (n = 3) or to a mixture of different criteria (n = 5). Due to the widespread use of the ACCE Framework, the most frequently used evaluation criteria are analytic and clinical validity, clinical utility and ethical, legal and social implications. Less attention is given to the context of implementation. An economic dimension is always considered, but not in great detail. Consideration of delivery models, organizational aspects, and consumer viewpoint is often lacking. A deeper analysis of such context-related evaluation dimensions may strengthen a comprehensive evaluation of genetic tests and support the decision-making process.

A systematic review and overview of health economic evaluations of emergency laparotomy.

PubMed

Bampoe, Sohail; Odor, Peter M; Ramani Moonesinghe, S; Dickinson, Matthew

2017-01-01

Little is known about the economic impact of emergency laparotomy (EL) surgery in healthcare systems around the world. The aim of this systematic review is to describe the primary resource utilisation, healthcare economic and societal costs of EL in adults in different countries. MEDLINE, EMBASE, ISI Web of Knowledge, Cochrane Central Register Controlled Trials, Cochrane Database of Systematic Reviews and CINAHL were searched for full and partial economic analyses of EL published between 1 January 1991 and 31 December 2015. Quality of studies was assessed using the Consensus on Health Economic Criteria (CHEC) checklist. Sixteen studies were included from a range of countries. One study was a full economic analysis. Fifteen studies were partial economic evaluations. These studies revealed that emergency abdominal surgery is expensive compared to similar elective surgery when comparing primary resource utilisation costs, with an important societal impact. Most contemporaneous studies indicate that in-hospital costs for EL are in excess of US$10,000 per patient episode, rising substantially when societal costs are considered. EL is a high-risk and costly procedure with a disproportionate financial burden for healthcare providers, relative to national funding provisions and wider societal cost impact. There is substantial heterogeneity in the methodologies and quality of published economic evaluations of EL; therefore, the true economic costs of EL are yet to be fully defined. Future research should focus on developing strategies to embed health economic evaluations within national programmes aiming to improve EL care, including developing the required measures and infrastructure. Emergency laparotomy is expensive, with a significant cost burden to healthcare and systems and society worldwide. Novel strategies for reducing this econmic burden should urgently be explored if greater access to this type of surgery is to be pursued as a global health target. PROSPERO

[Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise].

PubMed

Morgano, Gian Paolo; Davoli, Marina; Moja, Lorenzo; Amato, Laura; Ferroni, Eliana; Tirani, Marcello

2015-06-01

Guideline developers worldwide are struggling with the lack of guidance for the practical steps in the guideline enterprise. Our objective was to systematically compile a comprehensive checklist of items linked to relevant resources and tools that guideline developers would consider for development and support of implementation. Data sources included manuals of international guideline developers, literature on guidelines for guidelines with a focus on international and national guideline agencies, professional societies, and recent systematic guidance articles. We reviewed these sources in duplicate, extracted items using a sensitive approach and developed overarching topics that are relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions. We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers (http://cebgrade.mcmaster.ca/guidecheck.html). The topics and items included cover all stages of the guideline enterprise, from planning to formulating recommendations, to dissemination and evaluation. The final itemized guideline development checklist (GDC) includes links to training material and resources for methodology. The GDC will serve as a resource for those involved in guideline development and we will use crowdsourcing to keep the checklist up to date and enhance it.

Arginine for gestating sows and foetal development: A systematic review.

PubMed

Palencia, J Y P; Lemes, M A G; Garbossa, C A P; Abreu, M L T; Pereira, L J; Zangeronimo, M G

2018-02-01

The use of functional amino acids during pregnancy has been linked to improved reproduction in mammals. In this context, arginine is a precursor in the synthesis of numerous molecules, such as nitric oxide and polyamines, which play an important role during reproduction. However, contradictory studies are found in the literature, particularly regarding the amount of supplementation and the period of pregnancy in which it is used. The objective of this study was to evaluate the effects of dietary arginine supplementation for pregnant sows on foetal development via a systematic review. The search for papers was performed during the month of December 2015, in the databases ISI Web of Science, Science Direct, Scopus, and SciELO. From a total of 5675 returned studies, only 13 papers were selected after applying selection criteria. Most (47%) of the studies that evaluated the effects of dietary arginine supplementation on foetal development in pigs used 1% arginine. Supplementation was initiated in the first third of pregnancy in 47% of tests, including in both primiparous and multiparous sows. These studies showed positive results for embryo survival and foetal development, evidenced by the increase in placental weight and the number and weight of piglets born alive. Of all evaluated studies, 53% showed benefits on foetal development. It is concluded that supplementing dietary arginine in gestating sows can benefit embryo survival and foetal development. However, to establish a supplementation plan with this amino acid, aspects related to the period of pregnancy, supplementation levels, and source of arginine must be well defined. © 2017 Blackwell Verlag GmbH.

Economic evaluation of vaccines in Canada: A systematic review

PubMed Central

Chit, Ayman; Lee, Jason K. H.; Shim, Minsup; Nguyen, Van Hai; Grootendorst, Paul; Wu, Jianhong; Van Exan, Robert; Langley, Joanne M.

2016-01-01

ABSTRACT Background: Economic evaluations should form part of the basis for public health decision making on new vaccine programs. While Canada's national immunization advisory committee does not systematically include economic evaluations in immunization decision making, there is increasing interest in adopting them. We therefore sought to examine the extent and quality of economic evaluations of vaccines in Canada. Objective: We conducted a systematic review of economic evaluations of vaccines in Canada to determine and summarize: comprehensiveness across jurisdictions, studied vaccines, funding sources, study designs, research quality, and changes over time. Methods: Searches in multiple databases were conducted using the terms “vaccine,” “economics” and “Canada.” Descriptive data from eligible manuscripts was abstracted and three authors independently evaluated manuscript quality using a 7-point Likert-type scale scoring tool based on criteria from the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Results: 42/175 articles met the search criteria. Of these, Canada-wide studies were most common (25/42), while provincial studies largely focused on the three populous provinces of Ontario, Quebec and British Columbia. The most common funding source was industry (17/42), followed by government (7/42). 38 studies used mathematical models estimating expected economic benefit while 4 studies examined post-hoc data on established programs. Studies covered 10 diseases, with 28/42 addressing pediatric vaccines. Many studies considered cost-utility (22/42) and the majority of these studies reported favorable economic results (16/22). The mean quality score was 5.9/7 and was consistent over publication date, funding sources, and disease areas. Conclusions: We observed diverse approaches to evaluate vaccine economics in Canada. Given the increased complexity of economic studies evaluating vaccines and the impact of results on public

Economic evaluation of vaccines in Canada: A systematic review.

PubMed

Chit, Ayman; Lee, Jason K H; Shim, Minsup; Nguyen, Van Hai; Grootendorst, Paul; Wu, Jianhong; Van Exan, Robert; Langley, Joanne M

2016-05-03

Economic evaluations should form part of the basis for public health decision making on new vaccine programs. While Canada's national immunization advisory committee does not systematically include economic evaluations in immunization decision making, there is increasing interest in adopting them. We therefore sought to examine the extent and quality of economic evaluations of vaccines in Canada. We conducted a systematic review of economic evaluations of vaccines in Canada to determine and summarize: comprehensiveness across jurisdictions, studied vaccines, funding sources, study designs, research quality, and changes over time. Searches in multiple databases were conducted using the terms "vaccine," "economics" and "Canada." Descriptive data from eligible manuscripts was abstracted and three authors independently evaluated manuscript quality using a 7-point Likert-type scale scoring tool based on criteria from the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). 42/175 articles met the search criteria. Of these, Canada-wide studies were most common (25/42), while provincial studies largely focused on the three populous provinces of Ontario, Quebec and British Columbia. The most common funding source was industry (17/42), followed by government (7/42). 38 studies used mathematical models estimating expected economic benefit while 4 studies examined post-hoc data on established programs. Studies covered 10 diseases, with 28/42 addressing pediatric vaccines. Many studies considered cost-utility (22/42) and the majority of these studies reported favorable economic results (16/22). The mean quality score was 5.9/7 and was consistent over publication date, funding sources, and disease areas. We observed diverse approaches to evaluate vaccine economics in Canada. Given the increased complexity of economic studies evaluating vaccines and the impact of results on public health practice, Canada needs improved, transparent and consistent processes

Systematic, theoretically-grounded development and feasibility testing of an innovative, preventive web-based game for children exposed to acute trauma

PubMed Central

Marsac, Meghan L.; Winston, Flaura K.; Hildenbrand, Aimee K.; Kohser, Kristen L.; March, Sonja; Kenardy, Justin; Kassam-Adams, Nancy

2015-01-01

Background Millions of children are affected by acute medical events annually, creating need for resources to promote recovery. While web-based interventions promise wide reach and low cost for users, development can be time- and cost-intensive. A systematic approach to intervention development can help to minimize costs and increase likelihood of effectiveness. Using a systematic approach, our team integrated evidence on the etiology of traumatic stress, an explicit program theory, and a user-centered design process to intervention development. Objective To describe evidence and the program theory model applied to the Coping Coach intervention and present pilot data evaluating intervention feasibility and acceptability. Method Informed by empirical evidence on traumatic stress prevention, an overarching program theory model was articulated to delineate pathways from a) specific intervention content to b) program targets and proximal outcomes to c) key longer-term health outcomes. Systematic user-testing with children ages 8–12 (N = 42) exposed to an acute medical event and their parents was conducted throughout intervention development. Results Functionality challenges in early prototypes necessitated revisions. Child engagement was positive throughout revisions to the Coping Coach intervention. Final pilot-testing demonstrated promising feasibility and high user-engagement and satisfaction. Conclusion Applying a systematic approach to the development of Coping Coach led to the creation of a functional intervention that is accepted by children and parents. Development of new e-health interventions may benefit from a similar approach. Future research should evaluate the efficacy of Coping Coach in achieving targeted outcomes of reduced trauma symptoms and improved health-related quality of life. PMID:25844276

The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration

PubMed Central

Liberati, Alessandro; Altman, Douglas G; Tetzlaff, Jennifer; Mulrow, Cynthia; Gøtzsche, Peter C; Ioannidis, John P A; Clarke, Mike; Devereaux, P J; Kleijnen, Jos; Moher, David

2009-01-01

Systematic reviews and meta-analyses are essential to summarise evidence relating to efficacy and safety of healthcare interventions accurately and reliably. The clarity and transparency of these reports, however, are not optimal. Poor reporting of systematic reviews diminishes their value to clinicians, policy makers, and other users. Since the development of the QUOROM (quality of reporting of meta-analysis) statement—a reporting guideline published in 1999—there have been several conceptual, methodological, and practical advances regarding the conduct and reporting of systematic reviews and meta-analyses. Also, reviews of published systematic reviews have found that key information about these studies is often poorly reported. Realising these issues, an international group that included experienced authors and methodologists developed PRISMA (preferred reporting items for systematic reviews and meta-analyses) as an evolution of the original QUOROM guideline for systematic reviews and meta-analyses of evaluations of health care interventions. The PRISMA statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. In this explanation and elaboration document, we explain the meaning and rationale for each checklist item. For each item, we include an example of good reporting and, where possible, references to relevant empirical studies and methodological literature. The PRISMA statement, this document, and the associated website (www.prisma-statement.org/) should be helpful resources to improve reporting of systematic reviews and meta-analyses. PMID:19622552

A Systematic Literature Review on Evaluation of Digital Tools for Authoring Evidence-Based Clinical Guidelines.

PubMed

Khodambashi, Soudabeh; Nytrø, Øystein

2017-01-01

To facilitate the clinical guideline (GL) development process, different groups of researchers have proposed tools that enable computer-supported tools for authoring and publishing GLs. In a previous study we interviewed GL authors in different Norwegian institutions and identified tool shortcomings. In this follow-up study our goal is to explore to what extent GL authoring tools have been evaluated by researchers, guideline organisations, or GL authors. This article presents results from a systematic literature review of evaluation (including usability) of GL authoring tools. A controlled database search and backward snow-balling were used to identify relevant articles. From the 12692 abstracts found, 188 papers were fully reviewed and 26 papers were identified as relevant. The GRADEPro tool has attracted some evaluation, however popular tools and platforms such as DECIDE, Doctor Evidence, JBI-SUMARI, G-I-N library have not been subject to specific evaluation from an authoring perspective. Therefore, we found that little attention was paid to the evaluation of the tools in general. We could not find any evaluation relevant to how tools integrate and support the complex GL development workflow. The results of this paper are highly relevant to GL authors, tool developers and GL publishing organisations in order to improve and control the GL development and maintenance process.

What are the barriers and facilitators for third sector organisations (non-profits) to evaluate their services? A systematic review.

PubMed

Bach-Mortensen, Anders Malthe; Montgomery, Paul

2018-01-22

The third sector is becoming a more common provider of social and health services, but little is known about how third sector organisations (TSOs) evaluate their activities. Past research has reported that the third sector is under increasing pressure to evaluate its impact and performance by government and other commissioning bodies. However, in responding to this increased pressure to undertake evaluation, research suggests that many TSOs struggle to evaluate their activities following the principles of evidence-based practice (EBP). Yet, there has been no systematic effort to investigate why the third sector is struggling to provide good quality evidence of its effects. This systematic review is reported following the PRISMA guidelines. Ten interdisciplinary databases were searched using a search string developed following best practice and in consultation with an information systems expert. Included studies were primary research of any research design investigating barriers to and facilitators of the evaluation process of TSOs as identified by practitioners. All studies were quality appraised, and the results were synthesised as a thematic summary. Twenty-four studies were included, which mainly investigated TSOs working within health and social services. The thematic summary identified the main barriers for TSOs to undertake evaluation to be related to the (1) lack of financial resources, (2) lack of technical capability and evaluation literacy and (3) challenges around identifying relevant evaluation systems and outcome indicators. Key facilitating factors involved (1) getting the appropriate support, (2) having an organisational culture that supports evaluation and (3) the motivation to be accountable to stakeholders. These findings were robust to study quality. This review constitutes the first systematic effort to synthesise existing literature on factors supporting and preventing evaluation by TSOs. The prevalence of factors revolving around the lack of

Development of a Comprehensive Hospital-Based Elder Abuse Intervention: An Initial Systematic Scoping Review

PubMed Central

Du Mont, Janice; Macdonald, Sheila; Kosa, Daisy; Elliot, Shannon; Spencer, Charmaine; Yaffe, Mark

2015-01-01

Introduction Elder abuse, a universal human rights problem, is associated with many negative consequences. In most jurisdictions, however, there are no comprehensive hospital-based interventions for elder abuse that address the totality of needs of abused older adults: psychological, physical, legal, and social. As the first step towards the development of such an intervention, we undertook a systematic scoping review. Objectives Our primary objective was to systematically extract and synthesize actionable and applicable recommendations for components of a multidisciplinary intersectoral hospital-based elder abuse intervention. A secondary objective was to summarize the characteristics of the responses reviewed, including methods of development and validation. Methods The grey and scholarly literatures were systematically searched, with two independent reviewers conducting the title, abstract and full text screening. Documents were considered eligible for inclusion if they: 1) addressed a response (e.g., an intervention) to elder abuse, 2) contained recommendations for responding to abused older adults with potential relevance to a multidisciplinary and intersectoral hospital-based elder abuse intervention; and 3) were available in English. Analysis The extracted recommendations for care were collated, coded, categorized into themes, and further reviewed for relevancy to a comprehensive hospital-based response. Characteristics of the responses were summarized using descriptive statistics. Results 649 recommendations were extracted from 68 distinct elder abuse responses, 149 of which were deemed relevant and were categorized into 5 themes: Initial contact; Capacity and consent; Interview with older adult, caregiver, collateral contacts, and/or suspected abuser; Assessment: physical/forensic, mental, psychosocial, and environmental/functional; and care plan. Only 6 responses had been evaluated, suggesting a significant gap between development and implementation of

Napping, development and health from 0 to 5 years: a systematic review.

PubMed

Thorpe, Karen; Staton, Sally; Sawyer, Emily; Pattinson, Cassandra; Haden, Catherine; Smith, Simon

2015-07-01

Duration and quality of sleep affect child development and health. Encouragement of napping in preschool children has been suggested as a health-promoting strategy. The aim of this study is to assess evidence regarding the effects of napping on measures of child development and health. This study is a systematic review of published, original research articles of any design. Children aged 0-5 years. Electronic database search was performed following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and assessment of research quality was carried out following a Grading of Recommendations, Assessment, Development and Evaluations (GRADE) protocol. Twenty-six articles met inclusion criteria. These were of heterogeneous quality; all had observational designs (GRADE-low). Development and health outcomes included salivary cortisol, night sleep, cognition, behaviour, obesity and accidents. The findings regarding cognition, behaviour and health impacts were inconsistent, probably because of variation in age and habitual napping status of the samples. The most consistent finding was an association between napping and later onset, shorter duration and poorer quality of night sleep, with evidence strongest beyond the age of 2 years. Studies were not randomised. Most did not obtain data on the children's habitual napping status or the context of napping. Many were reliant on parent report rather than direct observation or physiological measurement of sleep behaviour. The evidence indicates that beyond the age of 2 years napping is associated with later night sleep onset and both reduced sleep quality and duration. The evidence regarding behaviour, health and cognition is less certain. There is a need for more systematic studies that use stronger designs. In preschool children presenting with sleep problems clinicians should investigate napping patterns. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted

A systematic review of economic evaluations of health and health-related interventions in Bangladesh

PubMed Central

2011-01-01

Background Economic evaluation is used for effective resource allocation in health sector. Accumulated knowledge about economic evaluation of health programs in Bangladesh is not currently available. While a number of economic evaluation studies have been performed in Bangladesh, no systematic investigation of the studies has been done to our knowledge. The aim of this current study is to systematically review the published articles in peer-reviewed journals on economic evaluation of health and health-related interventions in Bangladesh. Methods Literature searches was carried out during November-December 2008 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface. The first specific interest was mapping the articles considering the areas of exploration by economic evaluation and the second interest was to scrutiny the methodological quality of studies. The methodological quality of economic evaluation of all articles has been scrutinized against the checklist developed by Evers Silvia and associates. Result Of 1784 potential articles 12 were accepted for inclusion. Ten studies described the competing alternatives clearly and only two articles stated the perspective of their articles clearly. All studies included direct cost, incurred by the providers. Only one study included the cost of community donated resources and volunteer costs. Two studies calculated the incremental cost effectiveness ratio (ICER). Six of the studies applied some sort of sensitivity analysis. Two of the studies discussed financial affordability of expected implementers and four studies discussed the issue of generalizability for application in different context. Conclusion Very few economic evaluation studies in Bangladesh are found in different areas of health and health-related interventions, which does not provide a strong basis of knowledge in the area. The

Gastroenteritis Therapies in Developed Countries: Systematic Review and Meta-Analysis.

PubMed

Freedman, Stephen B; Pasichnyk, Dion; Black, Karen J L; Fitzpatrick, Eleanor; Gouin, Serge; Milne, Andrea; Hartling, Lisa

2015-01-01

Gastroenteritis remains a leading cause of childhood morbidity. Because prior reviews have focused on isolated symptoms and studies conducted in developing countries, this study focused on interventions commonly considered for use in developed countries. Intervention specific, patient-centered outcomes were selected. MEDLINE, EMBASE, the Cochrane Database of Systematic Reviews, trial registries, grey literature, and scientific meetings. Randomized controlled trials, conducted in developed countries, of children aged <18 years, with gastroenteritis, performed in emergency department or outpatient settings which evaluated oral rehydration therapy (ORT), antiemetics, probiotics or intravenous fluid administration rate. The study was conducted in accordance with the Cochrane Handbook for Systematic Reviews of Interventions and the PRISMA guidelines. Data were independently extracted by multiple investigators. Analyses employed random effects models. 31 trials (4,444 patients) were included. ORT: Compared with intravenous rehydration, hospitalization (RR 0.80, 95%CI 0.24, 2.71) and emergency department return visits (RR 0.86, 95%CI 0.39, 1.89) were similar. Antiemetics: Fewer children administered an antiemetic required intravenous rehydration (RR 0.40, 95%CI 0.26, 0.60) While the data could not be meta-analyzed, three studies reported that ondansetron administration does increase the frequency of diarrhea. Probiotics: No studies reported on the primary outcome, three studies evaluated hospitalization within 7 days (RR 0.87, 95%CI 0.25, 2.98). Rehydration: No difference in length of stay was identified for rapid vs. standard intravenous or nasogastric rehydration. A single study found that 5% dextrose in normal saline reduced hospitalizations compared with normal saline alone (RR 0.70, 95% CI 0.53, 0.92). There is a paucity of patient-centered outcome evidence to support many interventions. Since ORT is a low-cost, non-invasive intervention, it should continue to be

Evaluation of the CORDEX-Africa multi-RCM hindcast: systematic model errors

NASA Astrophysics Data System (ADS)

Kim, J.; Waliser, Duane E.; Mattmann, Chris A.; Goodale, Cameron E.; Hart, Andrew F.; Zimdars, Paul A.; Crichton, Daniel J.; Jones, Colin; Nikulin, Grigory; Hewitson, Bruce; Jack, Chris; Lennard, Christopher; Favre, Alice

2014-03-01

Monthly-mean precipitation, mean (TAVG), maximum (TMAX) and minimum (TMIN) surface air temperatures, and cloudiness from the CORDEX-Africa regional climate model (RCM) hindcast experiment are evaluated for model skill and systematic biases. All RCMs simulate basic climatological features of these variables reasonably, but systematic biases also occur across these models. All RCMs show higher fidelity in simulating precipitation for the west part of Africa than for the east part, and for the tropics than for northern Sahara. Interannual variation in the wet season rainfall is better simulated for the western Sahel than for the Ethiopian Highlands. RCM skill is higher for TAVG and TMAX than for TMIN, and regionally, for the subtropics than for the tropics. RCM skill in simulating cloudiness is generally lower than for precipitation or temperatures. For all variables, multi-model ensemble (ENS) generally outperforms individual models included in ENS. An overarching conclusion in this study is that some model biases vary systematically for regions, variables, and metrics, posing difficulties in defining a single representative index to measure model fidelity, especially for constructing ENS. This is an important concern in climate change impact assessment studies because most assessment models are run for specific regions/sectors with forcing data derived from model outputs. Thus, model evaluation and ENS construction must be performed separately for regions, variables, and metrics as required by specific analysis and/or assessments. Evaluations using multiple reference datasets reveal that cross-examination, quality control, and uncertainty estimates of reference data are crucial in model evaluations.

Acknowledging patient heterogeneity in economic evaluation : a systematic literature review.

PubMed

Grutters, Janneke P C; Sculpher, Mark; Briggs, Andrew H; Severens, Johan L; Candel, Math J; Stahl, James E; De Ruysscher, Dirk; Boer, Albert; Ramaekers, Bram L T; Joore, Manuela A

2013-02-01

Patient heterogeneity is the part of variability that can be explained by certain patient characteristics (e.g. age, disease stage). Population reimbursement decisions that acknowledge patient heterogeneity could potentially save money and increase population health. To date, however, economic evaluations pay only limited attention to patient heterogeneity. The objective of the present paper is to provide a comprehensive overview of the current knowledge regarding patient heterogeneity within economic evaluation of healthcare programmes. A systematic literature review was performed to identify methodological papers on the topic of patient heterogeneity in economic evaluation. Data were obtained using a keyword search of the PubMed database and manual searches. Handbooks were also included. Relevant data were extracted regarding potential sources of patient heterogeneity, in which of the input parameters of an economic evaluation these occur, methods to acknowledge patient heterogeneity and specific concerns associated with this acknowledgement. A total of 20 articles and five handbooks were included. The relevant sources of patient heterogeneity (demographics, preferences and clinical characteristics) and the input parameters where they occurred (baseline risk, treatment effect, health state utility and resource utilization) were combined in a framework. Methods were derived for the design, analysis and presentation phases of an economic evaluation. Concerns related mainly to the danger of false-positive results and equity issues. By systematically reviewing current knowledge regarding patient heterogeneity within economic evaluations of healthcare programmes, we provide guidance for future economic evaluations. Guidance is provided on which sources of patient heterogeneity to consider, how to acknowledge them in economic evaluation and potential concerns. The improved acknowledgement of patient heterogeneity in future economic evaluations may well improve the

Guideline for Performing Systematic Approach to Evaluate and Qualify Legacy Documents that Support Advanced Reactor Technology Activity

DOE Office of Scientific and Technical Information (OSTI.GOV)

Honma, George

The establishment of a systematic process for the evaluation of historic technology information for use in advanced reactor licensing is described. Efforts are underway to recover and preserve Experimental Breeder Reactor II and Fast Flux Test Facility historical data. These efforts have generally emphasized preserving information from data-acquisition systems and hard-copy reports and entering it into modern electronic formats suitable for data retrieval and examination. The guidance contained in this document has been developed to facilitate consistent and systematic evaluation processes relating to quality attributes of historic technical information (with focus on sodium-cooled fast reactor (SFR) technology) that will bemore » used to eventually support licensing of advanced reactor designs. The historical information may include, but is not limited to, design documents for SFRs, research-and-development (R&D) data and associated documents, test plans and associated protocols, operations and test data, international research data, technical reports, and information associated with past U.S. Nuclear Regulatory Commission (NRC) reviews of SFR designs. The evaluation process is prescribed in terms of SFR technology, but the process can be used to evaluate historical information for any type of advanced reactor technology. An appendix provides a discussion of typical issues that should be considered when evaluating and qualifying historical information for advanced reactor technology fuel and source terms, based on current light water reactor (LWR) requirements and recent experience gained from Next Generation Nuclear Plant (NGNP).« less

Assisting allied health in performance evaluation: a systematic review.

PubMed

Lizarondo, Lucylynn; Grimmer, Karen; Kumar, Saravana

2014-11-14

Performance evaluation raises several challenges to allied health practitioners and there is no agreed approach to measuring or monitoring allied health service performance. The aim of this review was to examine the literature on performance evaluation in healthcare to assist in the establishment of a framework that can guide the measurement and evaluation of allied health clinical service performance. This review determined the core elements of a performance evaluation system, tools for evaluating performance, and barriers to the implementation of performance evaluation. A systematic review of the literature was undertaken. Five electronic databases were used to search for relevant articles: MEDLINE, Embase, CINAHL, PsychInfo, and Academic Search Premier. Articles which focussed on any allied health performance evaluation or those which examined performance in health care in general were considered in the review. Content analysis was used to synthesise the findings from individual articles. A total of 37 articles were included in the review. The literature suggests there are core elements involved in performance evaluation which include prioritising clinical areas for measurement, setting goals, selecting performance measures, identifying sources of feedback, undertaking performance measurement, and reporting the results to relevant stakeholders. The literature describes performance evaluation as multi-dimensional, requiring information or data from more than one perspective to provide a rich assessment of performance. A range of tools or instruments are available to capture various perspectives and gather a comprehensive picture of health care quality. Every allied health care delivery system has different performance needs and will therefore require different approaches. However, there are core processes that can be used as a framework to evaluate allied health performance. A careful examination of barriers to performance evaluation and subsequent tailoring of

The Estimation and Inclusion of Presenteeism Costs in Applied Economic Evaluation: A Systematic Review.

PubMed

Kigozi, Jesse; Jowett, Sue; Lewis, Martyn; Barton, Pelham; Coast, Joanna

2017-03-01

Given the significant costs of reduced productivity (presenteeism) in comparison to absenteeism, and overall societal costs, presenteeism has a potentially important role to play in economic evaluations. However, these costs are often excluded. The objective of this study is to review applied cost of illness studies and economic evaluations to identify valuation methods used for, and impact of including presenteeism costs in practice. A structured systematic review was carried out to explore (i) the extent to which presenteeism has been applied in cost of illness studies and economic evaluations and (ii) the overall impact of including presenteeism on overall costs and outcomes. Potential articles were identified by searching Medline, PsycINFO and NHS EED databases. A standard template was developed and used to extract information from economic evaluations and cost of illness studies incorporating presenteeism costs. A total of 28 studies were included in the systematic review which also demonstrated that presenteeism costs are rarely included in full economic evaluations. Estimation and monetisation methods differed between the instruments. The impact of disease on presenteeism whilst in paid work is high. The potential impact of presenteeism costs needs to be highlighted and greater consideration should be given to including these in economic evaluations and cost of illness studies. The importance of including presenteeism costs when conducting economic evaluation from a societal perspective should be emphasised in national economic guidelines and more methodological work is required to improve the practical application of presenteeism instruments to generate productivity cost estimates. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Allelopathic potential and systematic evaluation of organic extracts from Canavalia ensiformis leaves (Jack beans).

PubMed

Santos, Sonia; de Moraes, Maria de Lourdes Leite; da Silva Souza Filho, Antonio Pedro; Rezende, Maria Olímpia Oliveira

2005-01-01

This article describes the assessment of possible allelopathic potential of organic extracts obtained from leaves of Canavalia ensiformis under laboratory conditions. Furthermore, a systematic evaluation of these extracts was carried out using specific protocols developed in capillary electrophoresis (CE) to determine some groups of secondary metabolites. After the identification and quantification of compounds, the effects of compounds on germination of some common weeds was investigated, which are becoming a real problem in pastures in the state of Pará, Brazil.

Test selection, adaptation, and evaluation: a systematic approach to assess nutritional influences on child development in developing countries.

PubMed

Prado, Elizabeth L; Hartini, Sri; Rahmawati, Atik; Ismayani, Elfa; Hidayati, Astri; Hikmah, Nurul; Muadz, Husni; Apriatni, Mandri S; Ullman, Michael T; Shankar, Anuraj H; Alcock, Katherine J

2010-03-01

Evaluating the impact of nutrition interventions on developmental outcomes in developing countries can be challenging since most assessment tests have been produced in and for developed country settings. Such tests may not be valid measures of children's abilities when used in a new context. We present several principles for the selection, adaptation, and evaluation of tests assessing the developmental outcomes of nutrition interventions in developing countries where standard assessment tests do not exist. We then report the application of these principles for a nutrition trial on the Indonesian island of Lombok. Three hundred children age 22-55 months in Lombok participated in a series of pilot tests for the purpose of test adaptation and evaluation. Four hundred and eighty-seven 42-month-old children in Lombok were tested on the finalized test battery. The developmental assessment tests were adapted to the local context and evaluated for a number of psychometric properties, including convergent and discriminant validity, which were measured based on multiple regression models with maternal education, depression, and age predicting each test score. The adapted tests demonstrated satisfactory psychometric properties and the expected pattern of relationships with the three maternal variables. Maternal education significantly predicted all scores but one, maternal depression predicted socio-emotional competence, socio-emotional problems, and vocabulary, while maternal age predicted socio-emotional competence only. Following the methodological principles we present resulted in tests that were appropriate for children in Lombok and informative for evaluating the developmental outcomes of nutritional supplementation in the research context. Following this approach in future studies will help to determine which interventions most effectively improve child development in developing countries.

How does feedback from patients impact upon healthcare student clinical skill development and learning? A systematic review.

PubMed

Finch, Emma; Lethlean, Jennifer; Rose, Tanya; Fleming, Jennifer; Theodoros, Deborah; Cameron, Ashley; Coleman, Adele; Copland, David; McPhail, Steven M

2018-03-01

A key feature of health professionals' training, irrespective of discipline, is the acquisition and application of clinical and communication skills. Despite this, little is known about the potential role of patient feedback on this process. This systematic review aimed to answer the question: How does feedback from patients impact upon healthcare student clinical skill development and learning? Systematic review of published literature. Electronic databases were searched for studies that explored the effects of patient feedback on student learning and were published before March 2016. Eligible articles underwent methodological evaluation using the McMaster University Critical Evaluation Forms and data extraction. A total of 237 articles were retrieved following searches of electronic databases and hand searches of reference lists. Twelve (7 quantitative, 2 qualitative, 3 mixed methods) studies met the inclusion criteria. Eleven studies reported that patient feedback improved students' clinical skills. Minimal research has explored the impact of patient feedback on student learning. The research to date suggests that direct feedback from patients may be beneficial for the development of students' communication and clinical skills; however, the wide variety of evaluation methods and the lack of validated tools for patients to provide feedback suggest that further exploration is warranted.

Comprehensive evaluation on low-carbon development of coal enterprise groups.

PubMed

Wang, Bang-Jun; Wu, Yan-Fang; Zhao, Jia-Lu

2017-12-19

Scientifically evaluating the level of low-carbon development in terms of theoretical and practical significance is extremely important to coal enterprise groups for implementing national energy-related systems. This assessment can assist in building institutional mechanisms that are conducive for the economic development of coal business cycle and energy conservation as well as promoting the healthy development of coal enterprises to realize coal scientific development and resource utilization. First, by adopting systematic analysis method, this study builds low-carbon development evaluation index system for coal enterprise groups. Second, to determine the weight serving as guideline and criteria of the index, analytic hierarchy process (AHP) is applied using integrated linear weighted sum method to evaluate the level of low-carbon development of coal enterprise groups. Evaluation is also performed by coal enterprise groups, and the process comprises field analysis and evaluation. Finally, industrial policies are proposed regarding the development of low-carbon coal conglomerate strategies and measures. This study aims mainly to guide the low-carbon development of coal enterprise groups, solve the problem of coal mining and the destruction of ecological environment, support the conservation of raw materials and various resources, and achieve the sustainable development of the coal industry.

The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration

PubMed Central

Liberati, Alessandro; Altman, Douglas G.; Tetzlaff, Jennifer; Mulrow, Cynthia; Gøtzsche, Peter C.; Ioannidis, John P. A.; Clarke, Mike; Devereaux, P. J.; Kleijnen, Jos; Moher, David

2009-01-01

Systematic reviews and meta-analyses are essential to summarize evidence relating to efficacy and safety of health care interventions accurately and reliably. The clarity and transparency of these reports, however, is not optimal. Poor reporting of systematic reviews diminishes their value to clinicians, policy makers, and other users. Since the development of the QUOROM (QUality Of Reporting Of Meta-analysis) Statement—a reporting guideline published in 1999—there have been several conceptual, methodological, and practical advances regarding the conduct and reporting of systematic reviews and meta-analyses. Also, reviews of published systematic reviews have found that key information about these studies is often poorly reported. Realizing these issues, an international group that included experienced authors and methodologists developed PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) as an evolution of the original QUOROM guideline for systematic reviews and meta-analyses of evaluations of health care interventions. The PRISMA Statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. In this Explanation and Elaboration document, we explain the meaning and rationale for each checklist item. For each item, we include an example of good reporting and, where possible, references to relevant empirical studies and methodological literature. The PRISMA Statement, this document, and the associated Web site (http://www.prisma-statement.org/) should be helpful resources to improve reporting of systematic reviews and meta-analyses. PMID:19621070

Developing a Systematic Patent Search Training Program

ERIC Educational Resources Information Center

Zhang, Li

2009-01-01

This study aims to develop a systematic patent training program using patent analysis and citation analysis techniques applied to patents held by the University of Saskatchewan. The results indicate that the target audience will be researchers in life sciences, and aggregated patent database searching and advanced search techniques should be…

Leadership development programs for physicians: a systematic review.

PubMed

Frich, Jan C; Brewster, Amanda L; Cherlin, Emily J; Bradley, Elizabeth H

2015-05-01

Physician leadership development programs typically aim to strengthen physicians' leadership competencies and improve organizational performance. We conducted a systematic review of medical literature on physician leadership development programs in order to characterize the setting, educational content, teaching methods, and learning outcomes achieved. Articles were identified through a search in Ovid MEDLINE from 1950 through November 2013. We included articles that described programs designed to expose physicians to leadership concepts, outlined teaching methods, and reported evaluation outcomes. A thematic analysis was conducted using a structured data entry form with categories for setting/target group, educational content, format, type of evaluation and outcomes. We identified 45 studies that met eligibility criteria, of which 35 reported on programs exclusively targeting physicians. The majority of programs focused on skills training and technical and conceptual knowledge, while fewer programs focused on personal growth and awareness. Half of the studies used pre/post intervention designs, and four studies used a comparison group. Positive outcomes were reported in all studies, although the majority of studies relied on learner satisfaction scores and self-assessed knowledge or behavioral change. Only six studies documented favorable organizational outcomes, such as improvement in quality indicators for disease management. The leadership programs examined in these studies were characterized by the use of multiple learning methods, including lectures, seminars, group work, and action learning projects in multidisciplinary teams. Physician leadership development programs are associated with increased self-assessed knowledge and expertise; however, few studies have examined outcomes at a system level. Our synthesis of the literature suggests important gaps, including a lack of programs that integrate non-physician and physician professionals, limited use of more

A systematic review of economic evaluations of CHW interventions aimed at improving child health outcomes.

PubMed

Nkonki, L; Tugendhaft, A; Hofman, K

2017-02-28

Evidence of the cost-effectiveness of community health worker interventions is pertinent for decision-makers and programme planners who are turning to community services in order to strengthen health systems in the context of the momentum generated by strategies to support universal health care, the post-2015 Sustainable Development Goal agenda.We conducted a systematic review of published economic evaluation studies of community health worker interventions aimed at improving child health outcomes. Four public health and economic evaluation databases were searched for studies that met the inclusion criteria: National Health Service Economic Evaluation Database (NHS EED), Cochrane, Paediatric Economic Evaluation Database (PEED), and PubMed. The search strategy was tailored to each database.The 19 studies that met the inclusion criteria were conducted in either high income countries (HIC), low- income countries (LIC) and/or middle-income countries (MIC). The economic evaluations covered a wide range of interventions. Studies were grouped together by intended outcome or objective of each study. The data varied in quality. We found evidence of cost-effectiveness of community health worker (CHW) interventions in reducing malaria and asthma, decreasing mortality of neonates and children, improving maternal health, increasing exclusive breastfeeding and improving malnutrition, and positively impacting physical health and psychomotor development amongst children.Studies measured varied outcomes, due to the heterogeneous nature of studies included; a meta-analysis was not conducted. Outcomes included disease- or condition -specific outcomes, morbidity, mortality, and generic measures (e.g. disability-adjusted life years (DALYs)). Nonetheless, all 19 interventions were found to be either cost-effective or highly cost-effective at a threshold specific to their respective countries.There is a growing body of economic evaluation literature on cost-effectiveness of CHW

Global development and diffusion of outcome evaluation research for interpersonal and self-directed violence prevention from 2007 to 2013: A systematic review

PubMed Central

Hughes, Karen; Bellis, Mark A.; Hardcastle, Katherine A.; Butchart, Alexander; Dahlberg, Linda L.; Mercy, James A.; Mikton, Christopher

2018-01-01

Through a global review, we identified gaps in the geographical distribution of violence prevention evidence outcome evaluation studies and the types of violence addressed. Systematic literature searches identified 355 articles published between 2007 and 2013 that evaluated programs to prevent interpersonal or self-directed violence; focused on universal or selected populations; and reported outcomes measuring violence or closely related risk factors. The number of studies identified increased annually from 2008 (n = 37), reaching 64 in 2013. Over half (n = 203) of all studies focused on youth violence yet only one on elder maltreatment. Study characteristics varied by year and violence type. Only 9.3% of all studies had been conducted in LMICs. These studies were less likely than those in high income countries (HICs) to have tested established interventions yet more likely to involve international collaboration. Evaluation studies successfully established in LMIC had often capitalized on other major regional priorities (e.g. HIV). Relationships between violence and social determinants, communicable and non-communicable diseases, and even economic prosperity should be explored as mechanisms to increase the global reach of violence prevention research. Results should inform future research strategies and provide a baseline for measuring progress in developing the violence prevention evidence-base, especially in LMICs. PMID:29725241

Global development and diffusion of outcome evaluation research for interpersonal and self-directed violence prevention from 2007 to 2013: A systematic review.

PubMed

Hughes, Karen; Bellis, Mark A; Hardcastle, Katherine A; Butchart, Alexander; Dahlberg, Linda L; Mercy, James A; Mikton, Christopher

2014-01-01

Through a global review, we identified gaps in the geographical distribution of violence prevention evidence outcome evaluation studies and the types of violence addressed. Systematic literature searches identified 355 articles published between 2007 and 2013 that evaluated programs to prevent interpersonal or self-directed violence; focused on universal or selected populations; and reported outcomes measuring violence or closely related risk factors. The number of studies identified increased annually from 2008 (n = 37), reaching 64 in 2013. Over half (n = 203) of all studies focused on youth violence yet only one on elder maltreatment. Study characteristics varied by year and violence type. Only 9.3% of all studies had been conducted in LMICs. These studies were less likely than those in high income countries (HICs) to have tested established interventions yet more likely to involve international collaboration. Evaluation studies successfully established in LMIC had often capitalized on other major regional priorities (e.g. HIV). Relationships between violence and social determinants, communicable and non-communicable diseases, and even economic prosperity should be explored as mechanisms to increase the global reach of violence prevention research. Results should inform future research strategies and provide a baseline for measuring progress in developing the violence prevention evidence-base, especially in LMICs.

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review.

PubMed

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; "simulation," "practice," "drill," "exercise," "instrument," "tool," "questionnaire," " measurement," "checklist," "scale," "test," "inventory," "battery," "evaluation," "assessment," "appraisal," "emergency," "disaster," "cricise," "hazard," "catastrophe,: "hospital", "prehospital," "health centers," "treatment centers," were used in combination with Boolean operators OR and AND. The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages.

Economic Evaluation alongside Multinational Studies: A Systematic Review of Empirical Studies

PubMed Central

Oppong, Raymond; Jowett, Sue; Roberts, Tracy E.

2015-01-01

Purpose of the study This study seeks to explore methods for conducting economic evaluations alongside multinational trials by conducting a systematic review of the methods used in practice and the challenges that are typically faced by the researchers who conducted the economic evaluations. Methods A review was conducted for the period 2002 to 2012, with potentially relevant articles identified by searching the Medline, Embase and NHS EED databases. Studies were included if they were full economic evaluations conducted alongside a multinational trial. Results A total of 44 studies out of a possible 2667 met the inclusion criteria. Methods used for the analyses varied between studies, indicating a lack of consensus on how economic evaluation alongside multinational studies should be carried out. The most common challenge appeared to be related to addressing differences between countries, which potentially hinders the generalisability and transferability of results. Other challenges reported included inadequate sample sizes and choosing cost-effectiveness thresholds. Conclusions It is recommended that additional guidelines be developed to aid researchers in this area and that these be based on an understanding of the challenges associated with multinational trials and the strengths and limitations of alternative approaches. Guidelines should focus on ensuring that results will aid decision makers in their individual countries. PMID:26121465

A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews☆

PubMed Central

Matjasko, Jennifer L.; Vivolo-Kantor, Alana M.; Massetti, Greta M.; Holland, Kristin M.; Holt, Melissa K.; Cruz, Jason Dela

2018-01-01

Violence among youth is a pervasive public health problem. In order to make progress in reducing the burden of injury and mortality that result from youth violence, it is imperative to identify evidence-based programs and strategies that have a significant impact on violence. There have been many rigorous evaluations of youth violence prevention programs. However, the literature is large, and it is difficult to draw conclusions about what works across evaluations from different disciplines, contexts, and types of programs. The current study reviews the meta-analyses and systematic reviews published prior to 2009 that synthesize evaluations of youth violence prevention programs. This meta-review reports the findings from 37 meta-analyses and 15 systematic reviews; the included reviews were coded on measures of the social ecology, prevention approach, program type, and study design. A majority of the meta-analyses and systematic reviews were found to demonstrate moderate program effects. Meta-analyses yielded marginally smaller effect sizes compared to systematic reviews, and those that included programs targeting family factors showed marginally larger effects than those that did not. In addition, there are a wide range of individual/family, program, and study moderators of program effect sizes. Implications of these findings and suggestions for future research are discussed. PMID:29503594

Gastroenteritis Therapies in Developed Countries: Systematic Review and Meta-Analysis

PubMed Central

Freedman, Stephen B.; Pasichnyk, Dion; Black, Karen J. L.; Fitzpatrick, Eleanor; Gouin, Serge; Milne, Andrea; Hartling, Lisa

2015-01-01

Context Gastroenteritis remains a leading cause of childhood morbidity. Objective Because prior reviews have focused on isolated symptoms and studies conducted in developing countries, this study focused on interventions commonly considered for use in developed countries. Intervention specific, patient-centered outcomes were selected. Data Sources MEDLINE, EMBASE, the Cochrane Database of Systematic Reviews, trial registries, grey literature, and scientific meetings. Study Selection Randomized controlled trials, conducted in developed countries, of children aged <18 years, with gastroenteritis, performed in emergency department or outpatient settings which evaluated oral rehydration therapy (ORT), antiemetics, probiotics or intravenous fluid administration rate. Data Extraction The study was conducted in accordance with the Cochrane Handbook for Systematic Reviews of Interventions and the PRISMA guidelines. Data were independently extracted by multiple investigators. Analyses employed random effects models. Results 31 trials (4,444 patients) were included. ORT: Compared with intravenous rehydration, hospitalization (RR 0.80, 95%CI 0.24, 2.71) and emergency department return visits (RR 0.86, 95%CI 0.39, 1.89) were similar. Antiemetics: Fewer children administered an antiemetic required intravenous rehydration (RR 0.40, 95%CI 0.26, 0.60) While the data could not be meta-analyzed, three studies reported that ondansetron administration does increase the frequency of diarrhea. Probiotics: No studies reported on the primary outcome, three studies evaluated hospitalization within 7 days (RR 0.87, 95%CI 0.25, 2.98). Rehydration: No difference in length of stay was identified for rapid vs. standard intravenous or nasogastric rehydration. A single study found that 5% dextrose in normal saline reduced hospitalizations compared with normal saline alone (RR 0.70, 95% CI 0.53, 0.92). Conclusions There is a paucity of patient-centered outcome evidence to support many

The new United Nations approach to sustainable development post-2015: Findings from four overviews of systematic reviews on interventions for sustainable development and health.

PubMed

Galvão, Luiz A C; Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Câmara, Volney Magalhães; Luiz, Ronir Raggio; Becerra-Posada, Francisco

2016-03-01

Objective To identify reported interventions that facilitate sustainable development and have had a positive impact on health in four areas: sustainable food production; sustainable energy use; sustainable jobs ("decent work"); and prevention of toxic exposure to chemicals. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations. A comprehensive search was conducted of at least 14 databases and 8 websites for each of the four overviews, using pre-defined protocols, including clear inclusion criteria. To qualify as "sustainable," interventions needed to aim (explicitly or implicitly) to positively impact at least two dimensions of the integrated framework for sustainable development and had to include measures of health impact. Results In total, 47 systematic reviews and 10 economic evaluations met the inclusion criteria. The most promising interventions, such as agricultural policies, were identified for each of the four topics. While the evidence for the interventions is not strong because of the limited number of studies, there is no evidence of a definite negative impact on health. The only possible exception is that of taxes and subsidies-though this intervention also has the potential to be pro-equity with higher relative impacts for lower income groups. Conclusions The evidence found for effective interventions is useful for guiding countries toward the best options for non-health sector interventions that can positively impact health. This overviews shows that intersectoral work benefits every sector involved.

Development of a systematic career coaching program for medical students.

PubMed

Hur, Yera; Cho, A Ra; Kwon, Mihye

2018-03-01

This study aimed to develop a systematic career-coaching program (SCCP) that can be used by medical teaching schools to address a growing need for career-coaching. The program objectives were to help students (1) develop a comprehensive self-understanding of their aptitudes, interests, and personality traits; (2) explore possible career choices and decide on a career path; and (3) develop the competencies needed to prepare for their future careers. The SCCP was based on the ADDIE (analysis, design, development, implementation, and evaluation) model and decision-making questioning model. Medical professionals, medical education and career counseling experts, and students participated in designing the program. The SCCP describes coaching content, tools, operational methods, and appropriate timing, and identifies the professionals and specialists who can offer their expertise in the different coaching phases. It is designed to allow medical schools to offer the program in segments or in its entirety, depending on the curriculum and environment. The SCCP represents a viable career-coaching program for medical students that can be applied in part or in its entirety, depending on a medical school's curriculum and educational environment.

Development of a systematic career coaching program for medical students

PubMed Central

2018-01-01

Purpose This study aimed to develop a systematic career-coaching program (SCCP) that can be used by medical teaching schools to address a growing need for career-coaching. The program objectives were to help students (1) develop a comprehensive self-understanding of their aptitudes, interests, and personality traits; (2) explore possible career choices and decide on a career path; and (3) develop the competencies needed to prepare for their future careers. Methods The SCCP was based on the ADDIE (analysis, design, development, implementation, and evaluation) model and decision-making questioning model. Medical professionals, medical education and career counseling experts, and students participated in designing the program. Results The SCCP describes coaching content, tools, operational methods, and appropriate timing, and identifies the professionals and specialists who can offer their expertise in the different coaching phases. It is designed to allow medical schools to offer the program in segments or in its entirety, depending on the curriculum and environment. Conclusion The SCCP represents a viable career-coaching program for medical students that can be applied in part or in its entirety, depending on a medical school’s curriculum and educational environment. PMID:29510607

Developing evidence-based dentistry skills: how to interpret randomized clinical trials and systematic reviews.

PubMed

Kiriakou, Juliana; Pandis, Nikolaos; Madianos, Phoebus; Polychronopoulou, Argy

2014-10-30

Decision-making based on reliable evidence is more likely to lead to effective and efficient treatments. Evidence-based dentistry was developed, similarly to evidence-based medicine, to help clinicians apply current and valid research findings into their own clinical practice. Interpreting and appraising the literature is fundamental and involves the development of evidence-based dentistry (EBD) skills. Systematic reviews (SRs) of randomized controlled trials (RCTs) are considered to be evidence of the highest level in evaluating the effectiveness of interventions. Furthermore, the assessment of the report of a RCT, as well as a SR, can lead to an estimation of how the study was designed and conducted.

[Systematic evaluation of retention behavior of carbohydrates in hydrophilic interaction liquid chromatography].

PubMed

Fu, Qing; Wang, Jun; Liang, Tu; Xu, Xiaoyong; Jin, Yu

2013-11-01

A systematic evaluation of retention behavior of carbohydrates in hydrophilic interaction liquid chromatography (HILIC) was performed. The influences of mobile phase, stationary phase and buffer salt on the retention of carbohydrates were investigated. According to the results, the retention time of carbohydrates decreased as the proportion of acetonitrile in mobile phase decreased. Increased time of carbohydrates was observed as the concentration of buffer salt in mobile phase increased. The retention behavior of carbohydrates was also affected by organic solvent and HILIC stationary phase. Furthermore, an appropriate retention equation was used in HILIC mode. The retention equation lnk = a + blnC(B) + cC(B) could quantitatively describe the retention factors of carbohydrates of plant origin with good accuracy: the relative error of the predicted time to actual time was less than 0.3%. The evaluation results could provide guidance for carbohydrates to optimize the experimental conditions in HILIC method development especially for carbohydrate separation

Systematic iteration between model and methodology: A proposed approach to evaluating unintended consequences.

PubMed

Morell, Jonathan A

2018-06-01

This article argues that evaluators could better deal with unintended consequences if they improved their methods of systematically and methodically combining empirical data collection and model building over the life cycle of an evaluation. This process would be helpful because it can increase the timespan from when the need for a change in methodology is first suspected to the time when the new element of the methodology is operational. The article begins with an explanation of why logic models are so important in evaluation, and why the utility of models is limited if they are not continually revised based on empirical evaluation data. It sets the argument within the larger context of the value and limitations of models in the scientific enterprise. Following will be a discussion of various issues that are relevant to model development and revision. What is the relevance of complex system behavior for understanding predictable and unpredictable unintended consequences, and the methods needed to deal with them? How might understanding of unintended consequences be improved with an appreciation of generic patterns of change that are independent of any particular program or change effort? What are the social and organizational dynamics that make it rational and adaptive to design programs around single-outcome solutions to multi-dimensional problems? How does cognitive bias affect our ability to identify likely program outcomes? Why is it hard to discern change as a result of programs being embedded in multi-component, continually fluctuating, settings? The last part of the paper outlines a process for actualizing systematic iteration between model and methodology, and concludes with a set of research questions that speak to how the model/data process can be made efficient and effective. Copyright © 2017 Elsevier Ltd. All rights reserved.

Current trends in systematic program evaluation of online graduate nursing education: an integrative literature review.

PubMed

Horne, Eva M; Sandmann, Lorilee R

2012-10-01

Over the past decade, the Internet's e3 ect has transformed nursing education, particularly at the graduate level. Schools of nursing have embraced Internet-based course delivery technology to broaden students' access to academic degrees. However, the rush to stay competitive in online education raises questions. What is the quality of these online programs? To what extent are schools of nursing systematically evaluating the programs beyond the course level? What evaluation tools are used? What are the findings? How are the evaluation data used? By answering these questions, nurse educators can develop strategies for evaluating the quality and worth of online learning, thus improving instruction and learning outcomes. This integrative review of nursing and adult education literature identified as the current trends in program evaluation of online nursing education at the graduate level. Research articles were analyzed and perspectives were synthesized from a research agenda viewpoint. Recommendations and needs for future research are discussed. Copyright 2012, SLACK Incorporated.

Higher Education for Sustainable Development: A Systematic Review

ERIC Educational Resources Information Center

Wu, Yen-Chun Jim; Shen, Ju-Peng

2016-01-01

Purpose: This study aims to provide a complete understanding of academic research into higher education for sustainable development (HESD). Design/methodology/approach: This study utilizes a systematic review of four scientific literature databases to outline topics of research during the UN's Decade of Education for Sustainable Development…

Economic evaluations of eHealth technologies: A systematic review.

PubMed

Sanyal, Chiranjeev; Stolee, Paul; Juzwishin, Don; Husereau, Don

2018-01-01

Innovations in eHealth technologies have the potential to help older adults live independently, maintain their quality of life, and to reduce their health system dependency and health care expenditure. The objective of this study was to systematically review and appraise the quality of cost-effectiveness or utility studies assessing eHealth technologies in study populations involving older adults. We systematically searched multiple databases (MEDLINE, EMBASE, CINAHL, NHS EED, and PsycINFO) for peer-reviewed studies published in English from 2000 to 2016 that examined cost-effectiveness (or utility) of eHealth technologies. The reporting quality of included studies was appraised using the Consolidated Health Economic Evaluation Reporting Standards statement. Eleven full text articles met the inclusion criteria representing public and private health care systems. eHealth technologies evaluated by these studies includes computerized decision support system, a web-based physical activity intervention, internet-delivered cognitive behavioral therapy, telecare, and telehealth. Overall, the reporting quality of the studies included in the review was varied. Most studies demonstrated efficacy and cost-effectiveness of an intervention using a randomized control trial and statistical modeling, respectively. This review found limited information on the feasibility of adopting these technologies based on economic and organizational factors. This review identified few economic evaluations of eHealth technologies that included older adults. The quality of the current evidence is limited and further research is warranted to clearly demonstrate the long-term cost-effectiveness of eHealth technologies from the health care system and societal perspectives.

Automatic Evaluations and Exercising: Systematic Review and Implications for Future Research.

PubMed

Schinkoeth, Michaela; Antoniewicz, Franziska

2017-01-01

The general purpose of this systematic review was to summarize, structure and evaluate the findings on automatic evaluations of exercising. Studies were eligible for inclusion if they reported measuring automatic evaluations of exercising with an implicit measure and assessed some kind of exercise variable. Fourteen nonexperimental and six experimental studies (out of a total N = 1,928) were identified and rated by two independent reviewers. The main study characteristics were extracted and the grade of evidence for each study evaluated. First, results revealed a large heterogeneity in the applied measures to assess automatic evaluations of exercising and the exercise variables. Generally, small to large-sized significant relations between automatic evaluations of exercising and exercise variables were identified in the vast majority of studies. The review offers a systematization of the various examined exercise variables and prompts to differentiate more carefully between actually observed exercise behavior (proximal exercise indicator) and associated physiological or psychological variables (distal exercise indicator). Second, a lack of transparent reported reflections on the differing theoretical basis leading to the use of specific implicit measures was observed. Implicit measures should be applied purposefully, taking into consideration the individual advantages or disadvantages of the measures. Third, 12 studies were rated as providing first-grade evidence (lowest grade of evidence), five represent second-grade and three were rated as third-grade evidence. There is a dramatic lack of experimental studies, which are essential for illustrating the cause-effect relation between automatic evaluations of exercising and exercise and investigating under which conditions automatic evaluations of exercising influence behavior. Conclusions about the necessity of exercise interventions targeted at the alteration of automatic evaluations of exercising should therefore

Automatic Evaluations and Exercising: Systematic Review and Implications for Future Research

PubMed Central

Schinkoeth, Michaela; Antoniewicz, Franziska

2017-01-01

The general purpose of this systematic review was to summarize, structure and evaluate the findings on automatic evaluations of exercising. Studies were eligible for inclusion if they reported measuring automatic evaluations of exercising with an implicit measure and assessed some kind of exercise variable. Fourteen nonexperimental and six experimental studies (out of a total N = 1,928) were identified and rated by two independent reviewers. The main study characteristics were extracted and the grade of evidence for each study evaluated. First, results revealed a large heterogeneity in the applied measures to assess automatic evaluations of exercising and the exercise variables. Generally, small to large-sized significant relations between automatic evaluations of exercising and exercise variables were identified in the vast majority of studies. The review offers a systematization of the various examined exercise variables and prompts to differentiate more carefully between actually observed exercise behavior (proximal exercise indicator) and associated physiological or psychological variables (distal exercise indicator). Second, a lack of transparent reported reflections on the differing theoretical basis leading to the use of specific implicit measures was observed. Implicit measures should be applied purposefully, taking into consideration the individual advantages or disadvantages of the measures. Third, 12 studies were rated as providing first-grade evidence (lowest grade of evidence), five represent second-grade and three were rated as third-grade evidence. There is a dramatic lack of experimental studies, which are essential for illustrating the cause-effect relation between automatic evaluations of exercising and exercise and investigating under which conditions automatic evaluations of exercising influence behavior. Conclusions about the necessity of exercise interventions targeted at the alteration of automatic evaluations of exercising should therefore

The use of concept mapping for scale development and validation in evaluation.

PubMed

Rosas, Scott R; Camphausen, Lauren C

2007-05-01

Evaluators often make key decisions about what content to include when designing new scales. However, without clear conceptual grounding, there is a risk these decisions may compromise the scale's validity. Techniques such as concept mapping are available to evaluators for the specification of conceptual frameworks, but have not been used as a fully integrated part of scale development. As part of a multi-site evaluation of family support programs, we integrated concept mapping with traditional scale-development processes to strengthen the creation of a scale for inclusion in an evaluation instrument. Using concept mapping, we engaged staff and managers in the development of a framework of intended benefits of program participation and used the information to systematically select the scale's content. The psychometric characteristics of the scale were then formally assessed using a sample of program participants. The implications of the approach for supporting construct validity, inclusion of staff and managers, and theory-driven evaluation are discussed.

Test Selection, Adaptation, and Evaluation: A Systematic Approach to Assess Nutritional Influences on Child Development in Developing Countries

ERIC Educational Resources Information Center

Prado, Elizabeth L.; Hartini, Sri; Rahmawati, Atik; Ismayani, Elfa; Hidayati, Astri; Hikmah, Nurul; Muadz, Husni; Apriatni, Mandri S.; Ullman, Michael T.; Shankar, Anuraj H.; Alcock, Katherine J.

2010-01-01

Background: Evaluating the impact of nutrition interventions on developmental outcomes in developing countries can be challenging since most assessment tests have been produced in and for developed country settings. Such tests may not be valid measures of children's abilities when used in a new context. Aims: We present several principles for the…

User Experience Evaluations in Rehabilitation Video Games for Children: A Systematic Mapping of the Literature.

PubMed

Rico-Olarte, Carolina; López, Diego M; Blobel, Bernd; Kepplinger, Sara

2017-01-01

In recent years, the interest in user experience (UX) evaluation methods for assessing technology solutions, especially in health systems for children with special needs like cognitive disabilities, has increased. Conduct a systematic mapping study to provide an overview in the field of UX evaluations in rehabilitation video games for children. The definition of research questions, the search for primary studies and the extraction of those studies by inclusion and exclusion criteria lead to the mapping of primary papers according to a classification scheme. Main findings from this study include the detection of the target population of the selected studies, the recognition of two different ways of evaluating UX: (i) user evaluation and (ii) system evaluation, and UX measurements and devices used. This systematic mapping specifies the research gaps identified for future research works in the area.

Diagnosing Alzheimer's disease: a systematic review of economic evaluations.

PubMed

Handels, Ron L H; Wolfs, Claire A G; Aalten, Pauline; Joore, Manuela A; Verhey, Frans R J; Severens, Johan L

2014-03-01

The objective of this study is to systematically review the literature on economic evaluations of interventions for the early diagnosis of Alzheimer's disease (AD) and related disorders and to describe their general and methodological characteristics. We focused on the diagnostic aspects of the decision models to assess the applicability of existing decision models for the evaluation of the recently revised diagnostic research criteria for AD. PubMed and the National Institute for Health Research Economic Evaluation database were searched for English-language publications related to economic evaluations on diagnostic technologies. Trial-based economic evaluations were assessed using the Consensus on Health Economic Criteria list. Modeling studies were assessed using the framework for quality assessment of decision-analytic models. The search retrieved 2109 items, from which eight decision-analytic modeling studies and one trial-based economic evaluation met all eligibility criteria. Diversity among the study objective and characteristics was considerable and, despite considerable methodological quality, several flaws were indicated. Recommendations were focused on diagnostic aspects and the applicability of existing models for the evaluation of recently revised diagnostic research criteria for AD. Copyright © 2014 The Alzheimer's Association. Published by Elsevier Inc. All rights reserved.

Prevention of nosocomial infections in developing countries, a systematic review.

PubMed

Murni, Indah; Duke, Trevor; Triasih, Rina; Kinney, Sharon; Daley, Andrew J; Soenarto, Yati

2013-05-01

Prevention of nosocomial infection is key to providing good quality, safe healthcare. Infection control programmes (hand-hygiene campaigns and antibiotic stewardship) are effective in reducing nosocomial infections in developed countries. However, the effectiveness of these programmes in developing countries is uncertain. To evaluate the effectiveness of interventions for preventing nosocomial infections in developing countries. A systematic search for studies which evaluated interventions to prevent nosocomial infection in both adults and children in developing countries was undertaken using PubMed. Only intervention trials with a randomized controlled, quasi-experimental or sequential design were included. Where there was adequate homogeneity, a meta-analysis of specific interventions was performed using the Mantel-Haenzel fixed effects method to estimate the pooled risk difference. Thirty-four studies were found. Most studies were from South America and Asia. Most were before-and-after intervention studies from tertiary urban hospitals. Hand-hygiene campaigns that were a major component of multifaceted interventions (18 studies) showed the strongest effectiveness for reducing nosocomial infection rates (median effect 49%, effect range 12.7-100%). Hand-hygiene campaigns alone and studies of antibiotic stewardship to improve rational antibiotic use reduced nosocomial infection rates in three studies [risk difference (RD) of -0.09 (95%CI -0.12 to -0.07) and RD of -0.02 (95% CI -0.02 to -0.01), respectively]. Multifaceted interventions including hand-hygiene campaigns, antibiotic stewardship and other elementary infection control practices are effective in developing countries. The modest effect size of hand-hygiene campaigns alone and negligible effect size of antibiotic stewardship reflect the limited number of studies with sufficient homogeneity to conduct meta-analyses.

Evaluation of multi-level social learning for sustainable landscapes: perspective of a development initiative in Bergslagen, Sweden.

PubMed

Axelsson, Robert; Angelstam, Per; Myhrman, Lennart; Sädbom, Stefan; Ivarsson, Milis; Elbakidze, Marine; Andersson, Kenneth; Cupa, Petr; Diry, Christian; Doyon, Frederic; Drotz, Marcus K; Hjorth, Arne; Hermansson, Jan Olof; Kullberg, Thomas; Lickers, F Henry; McTaggart, Johanna; Olsson, Anders; Pautov, Yurij; Svensson, Lennart; Törnblom, Johan

2013-03-01

To implement policies about sustainable landscapes and rural development necessitates social learning about states and trends of sustainability indicators, norms that define sustainability, and adaptive multi-level governance. We evaluate the extent to which social learning at multiple governance levels for sustainable landscapes occur in 18 local development initiatives in the network of Sustainable Bergslagen in Sweden. We mapped activities over time, and interviewed key actors in the network about social learning. While activities resulted in exchange of experiences and some local solutions, a major challenge was to secure systematic social learning and make new knowledge explicit at multiple levels. None of the development initiatives used a systematic approach to secure social learning, and sustainability assessments were not made systematically. We discuss how social learning can be improved, and how a learning network of development initiatives could be realized.

Evaluation of Follow-Up Effects of the International Child Development Programme on Caregivers in Mozambique

ERIC Educational Resources Information Center

Skar, Ane-Marthe Solheim; Sherr, Lorraine; Clucas, Claudine; von Tetzchner, Stephen

2014-01-01

Parenting programs have been used to good effect in many settings, yet few are systematically introduced and evaluated in developing countries. This study explores the relative long-term effect of participation in the International Child Development Programme (ICDP) in a group of caregivers in Mozambique. A quasi-experimental design was used to…

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

PubMed Central

Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A. Metin

2015-01-01

Background Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. Objectives To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. Methods A systematic review was completed for the period 2000–2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Results Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Conclusions Over the past decade a wide range of tools have been developed

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards.

PubMed

Kågesten, Anna; Tunçalp, Ӧzge; Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A Metin

2015-01-01

Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. A systematic review was completed for the period 2000-2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Over the past decade a wide range of tools have been developed to improve the reporting of health research

Systematic development of technical textiles

NASA Astrophysics Data System (ADS)

Beer, M.; Schrank, V.; Gloy, Y.-S.; Gries, T.

2016-07-01

Technical textiles are used in various fields of applications, ranging from small scale (e.g. medical applications) to large scale products (e.g. aerospace applications). The development of new products is often complex and time consuming, due to multiple interacting parameters. These interacting parameters are production process related and also a result of the textile structure and used material. A huge number of iteration steps are necessary to adjust the process parameter to finalize the new fabric structure. A design method is developed to support the systematic development of technical textiles and to reduce iteration steps. The design method is subdivided into six steps, starting from the identification of the requirements. The fabric characteristics vary depending on the field of application. If possible, benchmarks are tested. A suitable fabric production technology needs to be selected. The aim of the method is to support a development team within the technology selection without restricting the textile developer. After a suitable technology is selected, the transformation and correlation between input and output parameters follows. This generates the information for the production of the structure. Afterwards, the first prototype can be produced and tested. The resulting characteristics are compared with the initial product requirements.

Economic evaluation of HIV pre-exposure prophylaxis strategies: protocol for a methodological systematic review and quantitative synthesis.

PubMed

Thavorn, Kednapa; Kugathasan, Howsikan; Tan, Darrell H S; Moqueet, Nasheed; Baral, Stefan D; Skidmore, Becky; MacFadden, Derek; Simkin, Anna; Mishra, Sharmistha

2018-03-15

Pre-exposure prophylaxis (PrEP) with antiretrovirals is an efficacious and effective intervention to decrease the risk of HIV (human immunodeficiency virus) acquisition. Yet drug and delivery costs prohibit access in many jurisdictions. In the absence of guidelines for the synthesis of economic evaluations, we developed a protocol for a systematic review of economic evaluation studies for PrEP by drawing on best practices in systematic reviews and the conduct and reporting of economic evaluations. We aim to estimate the incremental cost per health outcome of PrEP compared with placebo, no PrEP, or other HIV prevention strategies; assess the methodological variability in, and quality of, economic evaluations of PrEP; estimate the incremental cost per health outcome of different PrEP implementation strategies; and quantify the potential sources of heterogeneity in outcomes. We will systematically search electronic databases (MEDLINE, Embase) and the gray literature. We will include economic evaluation studies that assess both costs and health outcomes of PrEP in HIV-uninfected individuals, without restricting language or year of publication. Two reviewers will independently screen studies using predefined inclusion criteria, extract data, and assess methodological quality using the Philips checklist, Second Panel on the Cost-effectiveness of Health and Medicines, and the International Society for Pharmacoeconomics and Outcomes Research recommendations. Outcomes of interest include incremental costs and outcomes in natural units or utilities, cost-effectiveness ratios, and net monetary benefit. We will perform descriptive and quantitative syntheses using sensitivity analyses of outcomes by population subgroups, HIV epidemic settings, study designs, baseline intervention contexts, key parameter inputs and assumptions, type of outcomes, economic perspectives, and willingness to pay values. Findings will guide future economic evaluation of PrEP strategies in terms of

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

PubMed

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that

Using systematic review in occupational safety and health.

PubMed

Howard, John; Piacentino, John; MacMahon, Kathleen; Schulte, Paul

2017-11-01

Evaluation of scientific evidence is critical in developing recommendations to reduce risk. Healthcare was the first scientific field to employ a systematic review approach for synthesizing research findings to support evidence-based decision-making and it is still the largest producer and consumer of systematic reviews. Systematic reviews in the field of occupational safety and health are being conducted, but more widespread use and adoption would strengthen assessments. In 2016, NIOSH asked RAND to develop a framework for applying the traditional systematic review elements to the field of occupational safety and health. This paper describes how essential systematic review elements can be adapted for use in occupational systematic reviews to enhance their scientific quality, objectivity, transparency, reliability, utility, and acceptability. Published 2017. This article is a U.S. Government work and is in the public domain in the USA.

Evaluating the Validity of Systematic Reviews to Identify Empirically Supported Treatments

ERIC Educational Resources Information Center

Slocum, Timothy A.; Detrich, Ronnie; Spencer, Trina D.

2012-01-01

The "best available evidence" is one of the three basic inputs into evidence-based practice. This paper sets out a framework for evaluating the quality of systematic reviews that are intended to identify empirically supported interventions as a way of summarizing the best available evidence. The premise of this paper is that the process of…

Evaluation of background parenchymal enhancement on breast MRI: a systematic review

PubMed Central

Signori, Alessio; Valdora, Francesca; Rossi, Federica; Calabrese, Massimo; Durando, Manuela; Mariscotto, Giovanna; Tagliafico, Alberto

2017-01-01

Objective: To perform a systematic review of the methods used for background parenchymal enhancement (BPE) evaluation on breast MRI. Methods: Studies dealing with BPE assessment on breast MRI were retrieved from major medical libraries independently by four reviewers up to 6 October 2015. The keywords used for database searching are “background parenchymal enhancement”, “parenchymal enhancement”, “MRI” and “breast”. The studies were included if qualitative and/or quantitative methods for BPE assessment were described. Results: Of the 420 studies identified, a total of 52 articles were included in the systematic review. 28 studies performed only a qualitative assessment of BPE, 13 studies performed only a quantitative assessment and 11 studies performed both qualitative and quantitative assessments. A wide heterogeneity was found in the MRI sequences and in the quantitative methods used for BPE assessment. Conclusion: A wide variability exists in the quantitative evaluation of BPE on breast MRI. More studies focused on a reliable and comparable method for quantitative BPE assessment are needed. Advances in knowledge: More studies focused on a quantitative BPE assessment are needed. PMID:27925480

Improving patient safety through the systematic evaluation of patient outcomes

PubMed Central

Forster, Alan J.; Dervin, Geoff; Martin, Claude; Papp, Steven

2012-01-01

Despite increased advocacy for patient safety and several large-scale programs designed to reduce preventable harm, most notably surgical checklists, recent data evaluating entire health systems suggests that we are no further ahead in improving patient safety and that hospital complications are no less frequent now than in the 1990s. We suggest that the failure to systematically measure patient safety is the reason for our limited progress. In addition to defining patient safety outcomes and describing their financial and clinical impact, we argue why the failure to implement patient safety measurement systems has compromised the ability to move the agenda forward. We also present an overview of how patient safety can be assessed and the strengths and weaknesses of each method and comment on some of the consequences created by the absence of a systematic measurement system. PMID:23177520

Systematic approach to developing empirical interatomic potentials for III-N semiconductors

NASA Astrophysics Data System (ADS)

Ito, Tomonori; Akiyama, Toru; Nakamura, Kohji

2016-05-01

A systematic approach to the derivation of empirical interatomic potentials is developed for III-N semiconductors with the aid of ab initio calculations. The parameter values of empirical potential based on bond order potential are determined by reproducing the cohesive energy differences among 3-fold coordinated hexagonal, 4-fold coordinated zinc blende, wurtzite, and 6-fold coordinated rocksalt structures in BN, AlN, GaN, and InN. The bond order p is successfully introduced as a function of the coordination number Z in the form of p = a exp(-bZn ) if Z ≤ 4 and p = (4/Z)α if Z ≥ 4 in empirical interatomic potential. Moreover, the energy difference between wurtzite and zinc blende structures can be successfully evaluated by considering interaction beyond the second-nearest neighbors as a function of ionicity. This approach is feasible for developing empirical interatomic potentials applicable to a system consisting of poorly coordinated atoms at surfaces and interfaces including nanostructures.

An experimental apparatus to simulate body-powered prosthetic usage: Development and preliminary evaluation.

PubMed

Gao, Fan; Rodriguez, Johanan; Kapp, Susan

2016-06-01

Harness fitting in the body-powered prosthesis remains more art than science due to a lack of consistent and quantitative evaluation. The aim of this study was to develop a mechanical, human-body-shaped apparatus to simulate body-powered upper limb prosthetic usage and evaluate its capability of quantitative examination of harness configuration. The apparatus was built upon a torso of a wooden mannequin and integrated major mechanical joints to simulate terminal device operation. Sensors were used to register cable tension, cable excursion, and grip force simultaneously. The apparatus allowed the scapula to move up to 127 mm laterally and the load cell can measure the cable tension up to 445 N. Our preliminary evaluation highlighted the needs and importance of investigating harness configurations in a systematic and controllable manner. The apparatus allows objective, systematic, and quantitative evaluation of effects of realistic harness configurations and will provide insightful and working knowledge on harness fitting in upper limb amputees using body-powered prosthesis. © The International Society for Prosthetics and Orthotics 2015.

Association between Prenatal and Postnatal Psychological Distress and Toddler Cognitive Development: A Systematic Review

PubMed Central

2015-01-01

Purpose Maternal psychological distress is one of the most common perinatal complications, affecting up to 25% of pregnant and postpartum women. Research exploring the association between prenatal and postnatal distress and toddler cognitive development has not been systematically compiled. The objective of this systematic review was to determine the association between prenatal and postnatal psychological distress and toddler cognitive development. Methods Articles were included if: a) they were observational studies published in English; b) the exposure was prenatal or postnatal psychological distress; c) cognitive development was assessed from 13 to 36 months; d) the sample was recruited in developed countries; and e) exposed and unexposed women were included. A university-based librarian conducted a search of electronic databases (Embase, CINAHL, Eric, PsycInfo, Medline) (January, 1990-March, 2014). We searched gray literature, reference lists, and relevant journals. Two reviewers independently evaluated titles/abstracts for inclusion, and quality using the Scottish Intercollegiate Guideline Network appraisal tool for observational studies. One reviewer extracted data using a standardized form. Results Thirteen of 2448 studies were included. There is evidence of an association between prenatal and postnatal distress and cognitive development. While variable effect sizes were reported for postnatal associations, most studies reported medium effect sizes for the association between prenatal psychological distress and cognitive development. Too few studies were available to determine the influence of the timing of prenatal exposure on cognitive outcomes. Conclusion Findings support the need for early identification and treatment of perinatal mental health problems as a potential strategy for optimizing toddler cognitive development. PMID:25996151

Association between Prenatal and Postnatal Psychological Distress and Toddler Cognitive Development: A Systematic Review.

PubMed

Kingston, Dawn; McDonald, Sheila; Austin, Marie-Paule; Tough, Suzanne

2015-01-01

Maternal psychological distress is one of the most common perinatal complications, affecting up to 25% of pregnant and postpartum women. Research exploring the association between prenatal and postnatal distress and toddler cognitive development has not been systematically compiled. The objective of this systematic review was to determine the association between prenatal and postnatal psychological distress and toddler cognitive development. Articles were included if: a) they were observational studies published in English; b) the exposure was prenatal or postnatal psychological distress; c) cognitive development was assessed from 13 to 36 months; d) the sample was recruited in developed countries; and e) exposed and unexposed women were included. A university-based librarian conducted a search of electronic databases (Embase, CINAHL, Eric, PsycInfo, Medline) (January, 1990-March, 2014). We searched gray literature, reference lists, and relevant journals. Two reviewers independently evaluated titles/abstracts for inclusion, and quality using the Scottish Intercollegiate Guideline Network appraisal tool for observational studies. One reviewer extracted data using a standardized form. Thirteen of 2448 studies were included. There is evidence of an association between prenatal and postnatal distress and cognitive development. While variable effect sizes were reported for postnatal associations, most studies reported medium effect sizes for the association between prenatal psychological distress and cognitive development. Too few studies were available to determine the influence of the timing of prenatal exposure on cognitive outcomes. Findings support the need for early identification and treatment of perinatal mental health problems as a potential strategy for optimizing toddler cognitive development.

Parent report measures of infant and toddler social-emotional development: a systematic review.

PubMed

Pontoppidan, Maiken; Niss, Nete K; Pejtersen, Jan H; Julian, Megan M; Væver, Mette S

2017-04-01

Identifying young children at risk for socio-emotional developmental problems at an early stage, to prevent serious problems later in life, is crucial. Therefore, we need high quality measures to identify those children at risk for social-emotional problems who require further evaluation and intervention. To systematically identify parent report measures of infant and toddler (0-24 months) social-emotional development for use in primary care settings. We conducted a systematic review applying a narrative synthesis approach. We searched Medline, PsychInfo, Embase and SocIndex for articles published from 2008 through September 2015 to identify parent-report measures of infant and toddler social-emotional development. Data on the characteristics of the measures, including psychometric data, were collected. Based on 3310 screened articles, we located 242 measures that were screened for eligibility. In all 18 measures of infant and toddler social-emotional development were included. Ten of the measures were developed specifically for measuring social-emotional development, and eight were measures including subscales of social-emotional development. The measures varied with respect to, e.g. the time of publication, number of items, age span, cost and amount of psychometric data available. Several measures of infant and toddler social-emotional development have been developed within the last decade. The majority of psychometric data are available through manuals, not peer-reviewed journals. Although all measures show acceptable reliability, the most comprehensive and psychometrically sound measures are the Ages and Stages Questionnaires: Social-Emotional-2, Infant-Toddler Social and Emotional Assessment, Brief Infant-Toddler Social and Emotional Assessment and Child Behaviour Checklist 1½-5. © The Author 2017. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A systematic review of recent clinical practice guidelines and best practice statements for the evaluation of the infertile male.

PubMed

Esteves, Sandro C; Chan, Peter

2015-09-01

We systematically identified and reviewed the methods and consistency of recommendations of recently developed clinical practice guidelines (CPG) and best practice statements (BPS) on the evaluation of the infertile male. MEDLINE and related engines as well as guidelines' Web sites were searched for CPG and BPS written in English on the general evaluation of male infertility published between January 2008 and April 2015. Four guidelines were identified, all of which reported to have been recently updated. Systematic review was not consistently used in the BPS despite being reported in the CPG. Only one of them reported having a patient representative in its development team. The CPG issued by the European Association of Urology (EAU) graded some recommendations and related that to levels (but not quality) of evidence. Overall, the BPS issued respectively by the American Urological Association and American Society for Reproductive Medicine concurred with each other, but both differed from the EAU guidelines with regard to methods of collection, extraction and interpretation of data. None of the guidelines incorporated health economics. Important specific limitations of conventional semen analysis results were ignored by all guidelines. Besides variation in the methodological quality, implementation strategies were not reported in two out of four guidelines. While the various panels of experts who contributed to the development of the CPG and BPS reviewed should be commended on their tremendous efforts aiming to establish a clinical standard in both the evaluation and management of male infertility, we recognized inconsistencies in the methodology of their synthesis and in the contents of their final recommendations. These discrepancies pose a barrier in the general implementation of these guidelines and may limit their utility in standardizing clinical practice or improving health-related outcomes. Continuous efforts are needed to generate high-quality evidence to

A systematic review on how to conduct evaluations in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2014-01-01

Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have

A systematic review on how to conduct evaluations in community-based rehabilitation

PubMed Central

Hébert, Michèle; Thibeault, Rachel

2014-01-01

Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review

PubMed Central

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

OBJECTIVE: Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. METHODS: This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; “simulation,” “practice,” “drill,” “exercise,” “instrument,” “tool,” “questionnaire,” “ measurement,” “checklist,” “scale,” “test,” “inventory,” “battery,” “evaluation,” “assessment,” “appraisal,” “emergency,” “disaster,” “cricise,” “hazard,” “catastrophe,: “hospital”, “prehospital,” “health centers,” “treatment centers,” were used in combination with Boolean operators OR and AND. RESULTS: The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. CONCLUSION: Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest

Evidence used in model-based economic evaluations for evaluating pharmacogenetic and pharmacogenomic tests: a systematic review protocol

PubMed Central

Peters, Jaime L; Cooper, Chris; Buchanan, James

2015-01-01

Introduction Decision models can be used to conduct economic evaluations of new pharmacogenetic and pharmacogenomic tests to ensure they offer value for money to healthcare systems. These models require a great deal of evidence, yet research suggests the evidence used is diverse and of uncertain quality. By conducting a systematic review, we aim to investigate the test-related evidence used to inform decision models developed for the economic evaluation of genetic tests. Methods and analysis We will search electronic databases including MEDLINE, EMBASE and NHS EEDs to identify model-based economic evaluations of pharmacogenetic and pharmacogenomic tests. The search will not be limited by language or date. Title and abstract screening will be conducted independently by 2 reviewers, with screening of full texts and data extraction conducted by 1 reviewer, and checked by another. Characteristics of the decision problem, the decision model and the test evidence used to inform the model will be extracted. Specifically, we will identify the reported evidence sources for the test-related evidence used, describe the study design and how the evidence was identified. A checklist developed specifically for decision analytic models will be used to critically appraise the models described in these studies. Variations in the test evidence used in the decision models will be explored across the included studies, and we will identify gaps in the evidence in terms of both quantity and quality. Dissemination The findings of this work will be disseminated via a peer-reviewed journal publication and at national and international conferences. PMID:26560056

Global economic evaluations of rotavirus vaccines: A systematic review.

PubMed

Kotirum, Surachai; Vutipongsatorn, Naaon; Kongpakwattana, Khachen; Hutubessy, Raymond; Chaiyakunapruk, Nathorn

2017-06-08

World Health Organization (WHO) recommends Rotavirus vaccines to prevent and control rotavirus infections. Economic evaluations (EE) have been considered to support decision making of national policy. Summarizing global experience of the economic value of rotavirus vaccines is crucial in order to encourage global WHO recommendations for vaccine uptake. Therefore, a systematic review of economic evaluations of rotavirus vaccine was conducted. We searched Medline, Embase, NHS EED, EconLit, CEA Registry, SciELO, LILACS, CABI-Global Health Database, Popline, World Bank - e-Library, and WHOLIS. Full economic evaluations studies, published from inception to November 2015, evaluating Rotavirus vaccines preventing Rotavirus infections were included. The methods, assumptions, results and conclusions of the included studies were extracted and appraised using WHO guide for standardization of EE of immunization programs. 104 relevant studies were included. The majority of studies were conducted in high-income countries. Cost-utility analysis was mostly reported in many studies using incremental cost-effectiveness ratio per DALY averted or QALY gained. Incremental cost per QALY gained was used in many studies from high-income countries. Mass routine vaccination against rotavirus provided the ICERs ranging from cost-saving to highly cost-effective in comparison to no vaccination among low-income countries. Among middle-income countries, vaccination offered the ICERs ranging from cost-saving to cost-effective. Due to low- or no subsidized price of rotavirus vaccines from external funders, being not cost-effective was reported in some high-income settings. Mass vaccination against rotavirus was generally found to be cost-effective, particularly in low- and middle-income settings according to the external subsidization of vaccine price. On the other hand, it may not be a cost-effective intervention at market price in some high-income settings. This systematic review provides

An evaluation of psychometric properties of caregiver burden outcome measures used in caregivers of children with cerebral palsy: a systematic review protocol.

PubMed

Dambi, Jermaine M; Jelsma, Jennifer; Mlambo, Tecla; Chiwaridzo, Matthew; Dangarembizi-Munambah, Nyaradzai; Corten, Lieselotte

2016-03-09

Cerebral palsy (CP) is the most common, life-long paediatric disability. Taking care of a child with CP often results in caregiver burden/strain in the long run. As caregivers play an essential role in the rehabilitation of these children, it is therefore important to routinely screen for health outcomes in informal caregivers. Consequently, a plethora of caregiver burden outcome measures have been developed; however, there is a dearth of evidence of the most psychometrically sound tools. Therefore, the broad objective of this systematic review is to evaluate the psychometrical properties and clinical utility of tools used to measure caregiver burden in caregivers of children with CP. This is a systematic review for the evaluation of the psychometric properties of caregiver burden outcome tools. Two independent and blinded reviewers will search articles on PubMed, Scopus, Web of Science, CINAHL, PsychINFO and Africa-Wide Google Scholar. Information will be analysed using predefined criteria. Thereafter, three independent reviewers will then screen the retrieved articles. The methodological quality of studies on the development and validation of the identified tools will be evaluated using the four point COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Finally, the psychometric properties of the tools which were developed and validated from methodological sound studies will then be analysed using predefined criteria. The proposed systematic review will give an extensive review of the psychometrical properties of tools used to measure caregiver burden in caregivers of children with CP. We hope to identify tools that can be used to accurately screen for caregiver burden both in clinical setting and for research purposes. PROSPERO CRD42015028026.

Systematic reviews and meta-analyses on treatment of asthma: critical evaluation

PubMed Central

Jadad, Alejandro R; Moher, Michael; Browman, George P; Booker, Lynda; Sigouin, Christopher; Fuentes, Mario; Stevens, Robert

2000-01-01

Objective To evaluate the clinical, methodological, and reporting aspects of systematic reviews and meta-analyses on the treatment of asthma and to compare those published by the Cochrane Collaboration with those published in paper based journals. Design Analysis of studies identified from Medline, CINAHL, HealthSTAR, EMBASE, Cochrane Library, personal collections, and reference lists. Studies Articles describing a systematic review or a meta-analysis of the treatment of asthma that were published as a full report, in any language or format, in a peer reviewed journal or the Cochrane Library. Main outcome measures General characteristics of studies reviewed and methodological characteristics (sources of articles; language restrictions; format, design, and publication status of studies included; type of data synthesis; and methodological quality). Results 50 systematic reviews and meta-analyses were included. More than half were published in the past two years. Twelve reviews were published in the Cochrane Library and 38 were published in 22 peer reviewed journals. Forced expiratory volume in one second was the most frequently used outcome, but few reviews evaluated the effect of treatment on costs or patient preferences. Forty reviews were judged to have serious or extensive flaws. All six reviews associated with industry were in this group. Seven of the 10 most rigorous reviews were published in the Cochrane Library. Conclusions Most reviews published in peer reviewed journals or funded by industry have serious methodological flaws that limit their value to guide decisions. Cochrane reviews are more rigorous and better reported than those published in peer reviewed journals. PMID:10688558

Integrating Early Child Development and Violence Prevention Programs: A Systematic Review

ERIC Educational Resources Information Center

Efevbera, Yvette; McCoy, Dana C.; Wuermli, Alice J.; Betancourt, Theresa S.

2018-01-01

Limited evidence describes promoting development and reducing violence in low- and middle-income countries (LMICs), a missed opportunity to protect children and promote development and human capital. This study presents a systematic literature review of integrated early childhood development plus violence prevention (ECD+VP) interventions in…

A systematic evaluation of prevalence and diagnostic accuracy of sacroiliac joint interventions.

PubMed

Simopoulos, Thomas T; Manchikanti, Laxmaiah; Singh, Vijay; Gupta, Sanjeeva; Hameed, Haroon; Diwan, Sudhir; Cohen, Steven P

2012-01-01

The contributions of the sacroiliac joint to low back and lower extremity pain have been a subject of considerable debate and research. It is generally accepted that 10% to 25% of patients with persistent mechanical low back pain below L5 have pain secondary to sacroiliac joint pathology. However, no single historical, physical exam, or radiological feature can definitively establish a diagnosis of sacroiliac joint pain. Based on present knowledge, a proper diagnosis can only be made using controlled diagnostic blocks. The diagnosis and treatment of sacroiliac joint pain continue to be characterized by wide variability and a paucity of the literature. To evaluate the accuracy of diagnostic sacroiliac joint interventions. A systematic review of diagnostic sacroiliac joint interventions. Methodological quality assessment of included studies was performed using Quality Appraisal of Reliability Studies (QAREL). Only diagnostic accuracy studies meeting at least 50% of the designated inclusion criteria were utilized for analysis. Studies scoring less than 50% are presented descriptively and analyzed critically. The level of evidence was classified as good, fair, or poor based on the quality of evidence developed by the United States Preventive Services Task Force (USPSTF). Data sources included relevant literature identified through searches of PubMed and EMBASE from 1966 to December 2011, and manual searches of the bibliographies of known primary and review articles. In this evaluation we utilized controlled local anesthetic blocks using at least 50% pain relief as the reference standard. The evidence is good for the diagnosis of sacroiliac joint pain utilizing controlled comparative local anesthetic blocks. The prevalence of sacroiliac joint pain is estimated to range between 10% and 62% based on the setting; however, the majority of analyzed studies suggest a point prevalence of around 25%, with a false-positive rate for uncontrolled blocks of approximately 20%. The

A systematic approach for evaluating and scoring human data.

PubMed

Money, Chris D; Tomenson, John A; Penman, Michael G; Boogaard, Peter J; Jeffrey Lewis, R

2013-07-01

An approach is described for how the quality of human data can be systematically assessed and categorised. The approach mirrors the animal data quality considerations set out by Klimisch et al., in order that human data quality can be addressed in a complementary manner and to help facilitate transparent (and repeatable) weight of evidence comparisons. Definitions are proposed for the quality and adequacy of data. Quality is differentiated into four categories. A description of how the scheme can be used for evaluating data reliability, especially for use when contributing entries to the IUCLID database, is shown. A discussion of how the criteria might also be used when determining overall data relevance is included. The approach is intended to help harmonise human data evaluation processes worldwide. Copyright © 2013 Elsevier Inc. All rights reserved.

The effect of docetaxel on developing oedema in patients with breast cancer: a systematic review.

PubMed

Hugenholtz-Wamsteker, W; Robbeson, C; Nijs, J; Hoelen, W; Meeus, M

2016-03-01

Docetaxel is extensively used in chemotherapy for the treatment of breast cancer. Little attention has been given to oedema as a possible side effect of docetaxel-containing therapies. Until now, no review was conducted to evaluate docetaxel-containing therapies versus docetaxel-free therapies on the magnitude of the risk of developing oedema. In this systematic review, we investigated the risk of developing oedema in patients being treated for breast cancer with or without docetaxel. In this systematic literature review, we searched PubMed and Web of Knowledge for studies on breast cancer patients treated with chemotherapy containing docetaxel. We included clinical trials comparing docetaxel versus docetaxel-free chemotherapy. Oedema had to be reported and measured as a key outcome or an adverse effect. Methodological checklists were used to assess the risk of bias within the selected studies. Seven randomised clinical trials were included. Six trials were of moderate methodological quality. All trials showed an increased rate of oedema in the docetaxel-treatment arm. The trial of weakest methodological quality reported the highest incidence of oedema. The results moderately suggest that adjuvant chemotherapy containing docetaxel is related to a significantly increased risk of developing oedema, compared with docetaxel-free chemotherapy. © 2014 John Wiley & Sons Ltd.

Development of a framework to identify research gaps from systematic reviews.

PubMed

Robinson, Karen A; Saldanha, Ian J; McKoy, Naomi A

2011-12-01

Our objective was to develop a framework to identify research gaps from systematic reviews. We reviewed the practices of (1) evidence-based practice centers (EPCs), and (2) other organizations that conduct evidence syntheses. We developed and pilot tested a framework for identifying research gaps. Four (33%) EPCs and three (8%) other organizations reported using an explicit framework to determine research gaps. Variations of the PICO (population, intervention, comparison, outcomes) framework were most common. We developed a framework incorporating both the characterization of the gap using PICOS elements (also including setting) and the identification of the reason(s) why the gap exists as (1) insufficient or imprecise information, (2) biased information, (3) inconsistency or unknown consistency, and (4) not the right information. We mapped each of these reasons to concepts from three common evidence-grading systems. Our framework determines from systematic reviews where the current evidence falls short and why or how the evidence falls short. This explicit identification of research gaps will allow systematic reviews to maximally inform the types of questions that need to be addressed and the types of studies needed to address the research gaps. Copyright © 2011 Elsevier Inc. All rights reserved.

VIP in construction: systematic development and evaluation of a multifaceted health programme aiming to improve physical activity levels and dietary patterns among construction workers

PubMed Central

2012-01-01

Background The prevalence of both overweight and musculoskeletal disorders (MSD) in the construction industry is high. Many interventions in the occupational setting aim at the prevention and reduction of these health problems, but it is still unclear how these programmes should be designed. To determine the effectiveness of interventions on these health outcomes randomised controlled trials (RCTs) are needed. The aim of this study is to systematically develop a tailored intervention for prevention and reduction of overweight and MSD among construction workers and to describe the evaluation study regarding its (cost-)effectiveness. Methods/Design The Intervention Mapping (IM) protocol was applied to develop and implement a tailored programme aimed at the prevention and reduction of overweight and MSD. The (cost-) effectiveness of the intervention programme will be evaluated using an RCT. Furthermore, a process evaluation will be conducted. The research population will consist of blue collar workers of a large construction company in the Netherlands. Intervention The intervention programme will be aimed at improving (vigorous) physical activity levels and healthy dietary behaviour and will consist of tailored information, face-to-face and telephone counselling, training instruction (a fitness "card" to be used for exercises), and materials designed for the intervention (overview of the company health promoting facilities, waist circumference measuring tape, pedometer, BMI card, calorie guide, recipes, and knowledge test). Main study parameters/endpoints The intervention effect on body weight and waist circumference (primary outcome measures), as well as on lifestyle behaviour, MSD, fitness, CVD risk indicators, and work-related outcomes (i.e. productivity, sick leave) (secondary outcome measures) will be assessed. Discussion The development of the VIP in construction intervention led to a health programme tailored to the needs of construction workers. This programme

USDA Nutrition Evidence Library: methodology used to identify topics and develop systematic review questions for the birth-to-24-mo population.

PubMed

Obbagy, Julie E; Blum-Kemelor, Donna M; Essery, Eve V; Lyon, Joan M G; Spahn, Joanne M

2014-03-01

The USDA's Nutrition Evidence Library (NEL) specializes in conducting food- and nutrition-related systematic reviews that are used to inform federal government decision making. To ensure the utility of NEL systematic reviews, the most relevant topics must be addressed, questions must be clearly focused and appropriate in scope, and review frameworks must reflect the state of the science. Identifying the optimal topics and questions requires input from a variety of stakeholders, including scientists with technical expertise, as well as government policy and program leaders. The objective of this article is to describe the rationale and NEL methodology for identifying topics and developing systematic review questions implemented as part of the "Evaluating the evidence base to support the inclusion of infants and children from birth to 24 months of age in the Dietary Guidelines for Americans--the B-24 Project." This is the first phase of a larger project designed to develop dietary guidance for the birth to 24-mo population in the United States.

Systematic development of a communication skills training course for physicians performing work disability assessments: from evidence to practice

PubMed Central

2011-01-01

Background Physicians require specific communication skills, because the face-to-face contact with their patients is an important source of information. Although physicians who perform work disability assessments attend some communication-related training courses during their professional education, no specialised and evidence-based communication skills training course is available for them. Therefore, the objectives of this study were: 1) to systematically develop a training course aimed at improving the communication skills of physicians during work disability assessment interviews with disability claimants, and 2) to plan an evaluation of the training course. Methods A physician-tailored communication skills training course was developed, according to the six steps of the Intervention Mapping protocol. Data were collected from questionnaire studies among physicians and claimants, a focus group study among physicians, a systematic review of the literature, and meetings with various experts. Determinants and performance objectives were formulated. A concept version of the training course was discussed with several experts before the final training course programme was established. The evaluation plan was developed by consulting experts, social insurance physicians, researchers, and policy-makers, and discussing with them the options for evaluation. Results A two-day post-graduate communication skills training course was developed, aimed at improving professional communication during work disability assessment interviews. Special focus was on active teaching strategies, such as practising the skills in role-play. An adoption and implementation plan was formulated, in which the infrastructure of the educational department of the institute that employs the physicians was utilised. Improvement in the skills and knowledge of the physicians who will participate in the training course will be evaluated in a randomised controlled trial. Conclusions The feasibility and

Systematic development of a communication skills training course for physicians performing work disability assessments: from evidence to practice.

PubMed

van Rijssen, H Jolanda; Schellart, Antonius J M; Anema, Johannes R; de Boer, Wout E L; van der Beek, Allard J

2011-06-03

Physicians require specific communication skills, because the face-to-face contact with their patients is an important source of information. Although physicians who perform work disability assessments attend some communication-related training courses during their professional education, no specialised and evidence-based communication skills training course is available for them. Therefore, the objectives of this study were: 1) to systematically develop a training course aimed at improving the communication skills of physicians during work disability assessment interviews with disability claimants, and 2) to plan an evaluation of the training course. A physician-tailored communication skills training course was developed, according to the six steps of the Intervention Mapping protocol. Data were collected from questionnaire studies among physicians and claimants, a focus group study among physicians, a systematic review of the literature, and meetings with various experts. Determinants and performance objectives were formulated. A concept version of the training course was discussed with several experts before the final training course programme was established. The evaluation plan was developed by consulting experts, social insurance physicians, researchers, and policy-makers, and discussing with them the options for evaluation. A two-day post-graduate communication skills training course was developed, aimed at improving professional communication during work disability assessment interviews. Special focus was on active teaching strategies, such as practising the skills in role-play. An adoption and implementation plan was formulated, in which the infrastructure of the educational department of the institute that employs the physicians was utilised. Improvement in the skills and knowledge of the physicians who will participate in the training course will be evaluated in a randomised controlled trial. The feasibility and practical relevance of the communication

A Systematic Review of Methods for Evaluating Rating Quality in Language Assessment

ERIC Educational Resources Information Center

Wind, Stefanie A.; Peterson, Meghan E.

2018-01-01

The use of assessments that require rater judgment (i.e., rater-mediated assessments) has become increasingly popular in high-stakes language assessments worldwide. Using a systematic literature review, the purpose of this study is to identify and explore the dominant methods for evaluating rating quality within the context of research on…

The Design, Implementation, and Evaluation of Online Credit Nutrition Courses: A Systematic Review

ERIC Educational Resources Information Center

Cohen, Nancy L.; Carbone, Elena T.; Beffa-Negrini, Patricia A.

2011-01-01

Objective: To assess how postsecondary online nutrition education courses (ONEC) are delivered, determine ONEC effectiveness, identify theoretical models used, and identify future research needs. Design: Systematic search of database literature. Setting: Postsecondary education. Participants: Nine research articles evaluating postsecondary ONEC.…

Using a Systematic Conceptual Model for a Process Evaluation of a Middle School Obesity Risk-Reduction Nutrition Curriculum Intervention: Choice, Control & Change

PubMed Central

Lee, Heewon; Contento, Isobel R.; Koch, Pamela

2012-01-01

Objective To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. Design A process evaluation study based on a systematic conceptual model. Setting Five middle schools in New York City. Participants 562 students in 20 classes and their science teachers (n=8). Main Outcome Measures Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers’ curriculum evaluation, and satisfaction with teaching the curriculum. Analysis Descriptive statistics and Spearman’s Rho Correlation for quantitative analysis and content analysis for qualitative data were used. Results Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teachers’ satisfaction with teaching the curriculum was highly correlated with students’ satisfaction (p <.05). Teachers’ perception of amount of student work was negatively correlated with implementation and with student satisfaction (p<.05). Conclusions and implications Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. PMID:23321021

Using a systematic conceptual model for a process evaluation of a middle school obesity risk-reduction nutrition curriculum intervention: choice, control & change.

PubMed

Lee, Heewon; Contento, Isobel R; Koch, Pamela

2013-03-01

To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. A process evaluation study based on a systematic conceptual model. Five middle schools in New York City. Five hundred sixty-two students in 20 classes and their science teachers (n = 8). Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers' curriculum evaluation, and satisfaction with teaching the curriculum. Descriptive statistics and Spearman ρ correlation for quantitative analysis and content analysis for qualitative data were used. Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and the student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teacher satisfaction with teaching the curriculum was highly correlated with student satisfaction (P < .05). Teacher perception of amount of student work was negatively correlated with implementation and with student satisfaction (P < .05). Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. Copyright © 2013 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Evaluation Studies of Robotic Rollators by the User Perspective: A Systematic Review.

PubMed

Werner, Christian; Ullrich, Phoebe; Geravand, Milad; Peer, Angelika; Hauer, Klaus

2016-01-01

Robotic rollators enhance the basic functions of established devices by technically advanced physical, cognitive, or sensory support to increase autonomy in persons with severe impairment. In the evaluation of such ambient assisted living solutions, both the technical and user perspectives are important to prove usability, effectiveness and safety, and to ensure adequate device application. The aim of this systematic review is to summarize the methodology of studies evaluating robotic rollators with focus on the user perspective and to give recommendations for future evaluation studies. A systematic literature search up to December 31, 2014, was conducted based on the Cochrane Review methodology using the electronic databases PubMed and IEEE Xplore. Articles were selected according to the following inclusion criteria: evaluation studies of robotic rollators documenting human-robot interaction, no case reports, published in English language. Twenty-eight studies were identified that met the predefined inclusion criteria. Large heterogeneity in the definitions of the target user group, study populations, study designs and assessment methods was found across the included studies. No generic methodology to evaluate robotic rollators could be identified. We found major methodological shortcomings related to insufficient sample descriptions and sample sizes, and lack of appropriate, standardized and validated assessment methods. Long-term use in habitual environment was also not evaluated. Apart from the heterogeneity, methodological deficits in most of the identified studies became apparent. Recommendations for future evaluation studies include: clear definition of target user group, adequate selection of subjects, inclusion of other assistive mobility devices for comparison, evaluation of the habitual use of advanced prototypes, adequate assessment strategy with established, standardized and validated methods, and statistical analysis of study results. Assessment

Systematic Review of Economic Evaluations of Units Dedicated to Acute Coronary Syndromes.

PubMed

Azeredo-Da-Silva, André Luis Ferreira; Perini, Silvana; Rigotti Soares, Pedro Henrique; Polaczyk, Carisi Anne

2016-01-01

Dedicated units for the care of acute coronary syndrome (ACS) have been submitted to economic evaluations; however, the results have not been systematically presented. To identify and summarize economic outcomes of studies on hospital units dedicated to the initial care of patients with suspected or confirmed ACS. A systematic review of literature to identify economic evaluations of chest pain unit (CPU), coronary care unit (CCU), or equivalent units was done. Two search strategies were used: the first one to identify economic evaluations irrespective of study design, and the second one to identify randomized clinical trials that reported economic outcomes. The following databases were searched: MEDLINE, EMBASE, CENTRAL, and National Health Service (NHS)Economic Evaluation Database. Data extraction was performed by two independent reviewers. Costs were inflated to 2012 values. Search strategies retrieved five partial economic evaluations based on observational studies, six randomized clinical trials that reported economic outcomes, and five model-based economic evaluations. Overall, cost estimates based on observational studies and randomized clinical trials reported statistically significant cost savings of more than 50% with the adoption of CPU care instead of routine hospitalization or CCU care for suspected low-to-intermediate risk patients with ACS (median per-patient cost US $1,969.89; range US $1,002.12-13,799.15). Model-based economic evaluations reported incremental cost-effectiveness ratios below US $ 50,000/quality-adjusted life-year for all comparisons between intermediate care unit, CPU, or CCU with routine hospital admissions. This finding was sensible to myocardial infarction probability. Published economic evaluations indicate that more intensive care is likely to be cost-effective in comparison to routine hospital admission for patients with suspected ACS. Copyright © 2016. Published by Elsevier Inc.

A systematic evaluation of chemicals in hydraulic-fracturing fluids and wastewater for reproductive and developmental toxicity.

PubMed

Elliott, Elise G; Ettinger, Adrienne S; Leaderer, Brian P; Bracken, Michael B; Deziel, Nicole C

2017-01-01

Hydraulic-fracturing fluids and wastewater from unconventional oil and natural gas development contain hundreds of substances with the potential to contaminate drinking water. Challenges to conducting well-designed human exposure and health studies include limited information about likely etiologic agents. We systematically evaluated 1021 chemicals identified in hydraulic-fracturing fluids (n=925), wastewater (n=132), or both (n=36) for potential reproductive and developmental toxicity to triage those with potential for human health impact. We searched the REPROTOX database using Chemical Abstract Service registry numbers for chemicals with available data and evaluated the evidence for adverse reproductive and developmental effects. Next, we determined which chemicals linked to reproductive or developmental toxicity had water quality standards or guidelines. Toxicity information was lacking for 781 (76%) chemicals. Of the remaining 240 substances, evidence suggested reproductive toxicity for 103 (43%), developmental toxicity for 95 (40%), and both for 41 (17%). Of these 157 chemicals, 67 had or were proposed for a federal water quality standard or guideline. Our systematic screening approach identified a list of 67 hydraulic fracturing-related candidate analytes based on known or suspected toxicity. Incorporation of data on potency, physicochemical properties, and environmental concentrations could further prioritize these substances for future drinking water exposure assessments or reproductive and developmental health studies.

An appraisal of published usability evaluations of electronic health records via systematic review.

PubMed

Ellsworth, Marc A; Dziadzko, Mikhail; O'Horo, John C; Farrell, Ann M; Zhang, Jiajie; Herasevich, Vitaly

2017-01-01

In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs). A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting. A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion. A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Systematic Review of Model-Based Economic Evaluations of Treatments for Alzheimer's Disease.

PubMed

Hernandez, Luis; Ozen, Asli; DosSantos, Rodrigo; Getsios, Denis

2016-07-01

Numerous economic evaluations using decision-analytic models have assessed the cost effectiveness of treatments for Alzheimer's disease (AD) in the last two decades. It is important to understand the methods used in the existing models of AD and how they could impact results, as they could inform new model-based economic evaluations of treatments for AD. The aim of this systematic review was to provide a detailed description on the relevant aspects and components of existing decision-analytic models of AD, identifying areas for improvement and future development, and to conduct a quality assessment of the included studies. We performed a systematic and comprehensive review of cost-effectiveness studies of pharmacological treatments for AD published in the last decade (January 2005 to February 2015) that used decision-analytic models, also including studies considering patients with mild cognitive impairment (MCI). The background information of the included studies and specific information on the decision-analytic models, including their approach and components, assumptions, data sources, analyses, and results, were obtained from each study. A description of how the modeling approaches and assumptions differ across studies, identifying areas for improvement and future development, is provided. At the end, we present our own view of the potential future directions of decision-analytic models of AD and the challenges they might face. The included studies present a variety of different approaches, assumptions, and scope of decision-analytic models used in the economic evaluation of pharmacological treatments of AD. The major areas for improvement in future models of AD are to include domains of cognition, function, and behavior, rather than cognition alone; include a detailed description of how data used to model the natural course of disease progression were derived; state and justify the economic model selected and structural assumptions and limitations; provide a

General Platform for Systematic Quantitative Evaluation of Small-Molecule Permeability in Bacteria

PubMed Central

2015-01-01

The chemical features that impact small-molecule permeability across bacterial membranes are poorly understood, and the resulting lack of tools to predict permeability presents a major obstacle to the discovery and development of novel antibiotics. Antibacterials are known to have vastly different structural and physicochemical properties compared to nonantiinfective drugs, as illustrated herein by principal component analysis (PCA). To understand how these properties influence bacterial permeability, we have developed a systematic approach to evaluate the penetration of diverse compounds into bacteria with distinct cellular envelopes. Intracellular compound accumulation is quantitated using LC-MS/MS, then PCA and Pearson pairwise correlations are used to identify structural and physicochemical parameters that correlate with accumulation. An initial study using 10 sulfonyladenosines in Escherichia coli, Bacillus subtilis, and Mycobacterium smegmatis has identified nonobvious correlations between chemical structure and permeability that differ among the various bacteria. Effects of cotreatment with efflux pump inhibitors were also investigated. This sets the stage for use of this platform in larger prospective analyses of diverse chemotypes to identify global relationships between chemical structure and bacterial permeability that would enable the development of predictive tools to accelerate antibiotic drug discovery. PMID:25198656

Centers for Professional Development and Technology (CPDT) State-Wide Evaluation Study. Final Summary Report.

ERIC Educational Resources Information Center

Macy Research Associates, Wills Point, TX.

The Texas Centers for Professional Development and Technology (CPDT) study gathered evaluative data about the progress and contribution of the centers toward their goal of systematic change in teacher preparation and student learning during four years of funding (1992-93 through 1995-96). The 21 centers in the sample included 35 universities, 15…

User-centered design and the development of patient decision aids: protocol for a systematic review.

PubMed

Witteman, Holly O; Dansokho, Selma Chipenda; Colquhoun, Heather; Coulter, Angela; Dugas, Michèle; Fagerlin, Angela; Giguere, Anik Mc; Glouberman, Sholom; Haslett, Lynne; Hoffman, Aubri; Ivers, Noah; Légaré, France; Légaré, Jean; Levin, Carrie; Lopez, Karli; Montori, Victor M; Provencher, Thierry; Renaud, Jean-Sébastien; Sparling, Kerri; Stacey, Dawn; Vaisson, Gratianne; Volk, Robert J; Witteman, William

2015-01-26

Providing patient-centered care requires that patients partner in their personal health-care decisions to the full extent desired. Patient decision aids facilitate processes of shared decision-making between patients and their clinicians by presenting relevant scientific information in balanced, understandable ways, helping clarify patients' goals, and guiding decision-making processes. Although international standards stipulate that patients and clinicians should be involved in decision aid development, little is known about how such involvement currently occurs, let alone best practices. This systematic review consisting of three interlinked subreviews seeks to describe current practices of user involvement in the development of patient decision aids, compare these to practices of user-centered design, and identify promising strategies. A research team that includes patient and clinician representatives, decision aid developers, and systematic review method experts will guide this review according to the Cochrane Handbook and PRISMA reporting guidelines. A medical librarian will hand search key references and use a peer-reviewed search strategy to search MEDLINE, EMBASE, PubMed, Web of Science, the Cochrane Library, the ACM library, IEEE Xplore, and Google Scholar. We will identify articles across all languages and years describing the development or evaluation of a patient decision aid, or the application of user-centered design or human-centered design to tools intended for patient use. Two independent reviewers will assess article eligibility and extract data into a matrix using a structured pilot-tested form based on a conceptual framework of user-centered design. We will synthesize evidence to describe how research teams have included users in their development process and compare these practices to user-centered design methods. If data permit, we will develop a measure of the user-centeredness of development processes and identify practices that are likely

Evaluation of Different Scoring Rules for a Noncognitive Test in Development. Research Report. ETS RR-16-03

ERIC Educational Resources Information Center

Guo, Hongwen; Zu, Jiyun; Kyllonen, Patrick; Schmitt, Neal

2016-01-01

In this report, systematic applications of statistical and psychometric methods are used to develop and evaluate scoring rules in terms of test reliability. Data collected from a situational judgment test are used to facilitate the comparison. For a well-developed item with appropriate keys (i.e., the correct answers), agreement among various…

What is positive youth development and how might it reduce substance use and violence? A systematic review and synthesis of theoretical literature.

PubMed

Bonell, Chris; Hinds, Kate; Dickson, Kelly; Thomas, James; Fletcher, Adam; Murphy, Simon; Melendez-Torres, G J; Bonell, Carys; Campbell, Rona

2016-02-10

Preventing adolescent substance use and youth violence are public health priorities. Positive youth development interventions are widely deployed often with the aim of preventing both. However, the theorised mechanisms by which PYD is intended to reduce substance use and violence are not clear and existing evaluated interventions are under-theorised. Using innovative methods, we systematically searched for and synthesised published theoretical literature describing what is meant by positive youth development and how it might reduce substance use and violence, as part of a broader systematic review examining process and outcomes of PYD interventions. We searched 19 electronic databases, review topic websites, and contacted experts between October 2013 and January 2014. We included studies written in English, published since 1985 that reported a theory of change for positive youth development focused on prevention of smoking, alcohol consumption, drug use or violence in out-of-school settings. Studies were independently coded and quality-assessed by two reviewers. We identified 16 studies that met our inclusion criteria. Our synthesis suggests that positive youth development aims to provide youth with affective relationships and diverse experiences which enable their development of intentional self-regulation and multiple positive assets. These in turn buffer against or compensate for involvement in substance use and violence. Existing literature is not clear on how intentional self-regulation is developed and which specific positive assets buffer against substance use or violence. Our synthesis provides: an example of a rigorous systematic synthesis of theory literature innovatively applying methods of qualitative synthesis to theoretical literature; a clearer understanding of how PYD might reduce substance use and violence to inform future interventions and empirical evaluations.

A systematic evaluation of the therapeutic effectiveness of sacroiliac joint interventions.

PubMed

Hansen, Hans; Manchikanti, Laxmaiah; Simopoulos, Thomas T; Christo, Paul J; Gupta, Sanjeeva; Smith, Howard S; Hameed, Haroon; Cohen, Steven P

2012-01-01

The contribution of the sacroiliac joint to low back and lower extremity pain has been a subject of debate with extensive research. It is generally accepted that approximately 10% to 25% of patients with persistent low back pain may have pain arising from the sacroiliac joints. In spite of this, there are currently no definite conservative, interventional, or surgical management options for managing sacroiliac joint pain. In addition, there continue to be significant variations in the application of various techniques as well as a paucity of literature. A systematic review of therapeutic sacroiliac joint interventions. To evaluate the accuracy of therapeutic sacroiliac joint interventions. The available literature on therapeutic sacroiliac joint interventions in managing chronic low back and lower extremity pain was reviewed. The quality assessment and clinical relevance criteria utilized were the Cochrane Musculoskeletal Review Group criteria for randomized trials of interventional techniques and the criteria developed by the Newcastle-Ottawa Scale for observational studies. The level of evidence was classified as good, fair, or poor based on the quality of evidence developed by the U.S. Preventive Services Task Force (USPSTF). Data sources included relevant literature published from 1966 through December 2011 that was identified through searches of PubMed and EMBASE, and manual searches of the bibliographies of known primary and review articles. The primary outcome measure was pain relief (short-term relief = up to 6 months and long-term > 6 months). Secondary outcome measures were improvement in functional status, psychological status, return to work, and reduction in opioid intake. For this systematic review, 56 studies were considered for inclusion. Of these, 45 studies were excluded and a total of 11 studies met inclusion criteria for methodological quality assessment with 6 randomized trials and 5 non-randomized studies. The evidence for cooled

Economic evaluations in gastroenterology in Brazil: A systematic review.

PubMed

de Paiva Haddad, Luciana Bertocco; Decimoni, Tassia Cristina; Turri, Jose Antonio; Leandro, Roseli; de Soárez, Patrícia Coelho

2016-02-06

To systematically review economic evaluations in gastroenterology, relating to Brazil, published between 1980 and 2013. We selected full and partial economic evaluations from among those retrieved by searching the following databases: MEDLINE (PubMed); Excerpta Medica; the Latin American and Caribbean Health Sciences Literature database; the Scientific Electronic Library Online; the database of the Centre for Reviews and Dissemination; the National Health Service (NHS) Economic Evaluation Database; the NHS Health Technology Assessment database; the Health Economics database of the Brazilian Virtual Library of Health; Scopus; Web of Science; and the Brazilian Network for the Evaluation of Health Technologies. Two researchers, working independently, selected the studies and extracted the data. We identified 535 health economic evaluations relating to Brazil and published in the 1980-2013 period. Of those 535 articles, only 40 dealt with gastroenterology. Full and partial economic evaluations respectively accounted for 23 (57.5%) and 17 (42.5%) of the 40 studies included. Among the 23 full economic evaluations, there were 11 cost-utility analyses, seven cost-effectiveness analyses, four cost-consequence analyses, and one cost-minimization analysis. Of the 40 studies, 25 (62.5%) evaluated medications; 7 (17.5%) evaluated procedures; and 3 (7.5%) evaluated equipment. Most (55%) of the studies were related to viral hepatitis, and most (63.4%) were published after 2010. Other topics included gastrointestinal cancer, liver transplantation, digestive diseases and hernias. Over the 33-year period examined, the number of such economic evaluations relating to Brazil, especially of those evaluating medications for the treatment of hepatitis, increased considerably. Further studies are needed in order to ensure that expenditures on health care in Brazil are made as fairly and efficiently as possible.

Economic evaluation of medical tests at the early phases of development: a systematic review of empirical studies.

PubMed

Frempong, Samuel N; Sutton, Andrew J; Davenport, Clare; Barton, Pelham

2018-02-01

There is little specific guidance on the implementation of cost-effectiveness modelling at the early stage of test development. The aim of this study was to review the literature in this field to examine the methodologies and tools that have been employed to date. Areas Covered: A systematic review to identify relevant studies in established literature databases. Five studies were identified and included for narrative synthesis. These studies revealed that there is no consistent approach in this growing field. The perspective of patients and the potential for value of information (VOI) to provide information on the value of future research is often overlooked. Test accuracy is an essential consideration, with most studies having described and included all possible test results in their analysis, and conducted extensive sensitivity analyses on important parameters. Headroom analysis was considered in some instances but at the early development stage (not the concept stage). Expert commentary: The techniques available to modellers that can demonstrate the value of conducting further research and product development (i.e. VOI analysis, headroom analysis) should be better utilized. There is the need for concerted efforts to develop rigorous methodology in this growing field to maximize the value and quality of such analysis.

Factors that affect the development of nurses' competencies: a systematic review.

PubMed

Rizany, Ichsan; Hariyati, Rr Tutik Sri; Handayani, Hanny

2018-02-01

To investigate factors affecting the development of nursing competency based on a review of the literature. A systematic review was utilized. The articles were taken from the databases of Pro-Quest, ScienceDirect, SpringerLink, and Scopus. They were retrieved using the following keywords: nursing competence, nurse competencies and clinical competence. Twenty-one papers were selected. Competence development is a continuous process of improving knowledge, attitudes and skills, and is influenced by a myriad of factors. Six factors were identified that affected the development of nursing competence in our systematic review: (1) work experience, (2) type of nursing environment, (3) educational level achieved, (4) adherence to professionalism, (5) critical thinking, and (6) personal factors. Work experience and education were shown to significantly influence the development of competency of nurses. Nurse managers need to support staffing competence through ongoing education, mentoring-preceptorship training, and case-reflection-discussion teaching programs. Copyright © 2018 Elsevier España, S.L.U. All rights reserved.

Design, Development, and Initial Evaluation of a Terminology for Clinical Decision Support and Electronic Clinical Quality Measurement.

PubMed

Lin, Yanhua; Staes, Catherine J; Shields, David E; Kandula, Vijay; Welch, Brandon M; Kawamoto, Kensaku

2015-01-01

When coupled with a common information model, a common terminology for clinical decision support (CDS) and electronic clinical quality measurement (eCQM) could greatly facilitate the distributed development and sharing of CDS and eCQM knowledge resources. To enable such scalable knowledge authoring and sharing, we systematically developed an extensible and standards-based terminology for CDS and eCQM in the context of the HL7 Virtual Medical Record (vMR) information model. The development of this terminology entailed three steps: (1) systematic, physician-curated concept identification from sources such as the Health Information Technology Standards Panel (HITSP) and the SNOMED-CT CORE problem list; (2) concept de-duplication leveraging the Unified Medical Language System (UMLS) MetaMap and Metathesaurus; and (3) systematic concept naming using standard terminologies and heuristic algorithms. This process generated 3,046 concepts spanning 68 domains. Evaluation against representative CDS and eCQM resources revealed approximately 50-70% concept coverage, indicating the need for continued expansion of the terminology.

Design, Development, and Initial Evaluation of a Terminology for Clinical Decision Support and Electronic Clinical Quality Measurement

PubMed Central

Lin, Yanhua; Staes, Catherine J; Shields, David E; Kandula, Vijay; Welch, Brandon M; Kawamoto, Kensaku

2015-01-01

When coupled with a common information model, a common terminology for clinical decision support (CDS) and electronic clinical quality measurement (eCQM) could greatly facilitate the distributed development and sharing of CDS and eCQM knowledge resources. To enable such scalable knowledge authoring and sharing, we systematically developed an extensible and standards-based terminology for CDS and eCQM in the context of the HL7 Virtual Medical Record (vMR) information model. The development of this terminology entailed three steps: (1) systematic, physician-curated concept identification from sources such as the Health Information Technology Standards Panel (HITSP) and the SNOMED-CT CORE problem list; (2) concept de-duplication leveraging the Unified Medical Language System (UMLS) MetaMap and Metathesaurus; and (3) systematic concept naming using standard terminologies and heuristic algorithms. This process generated 3,046 concepts spanning 68 domains. Evaluation against representative CDS and eCQM resources revealed approximately 50–70% concept coverage, indicating the need for continued expansion of the terminology. PMID:26958220

Development of a researcher codebook for use in evaluating social networking site profiles.

PubMed

Moreno, Megan A; Egan, Katie G; Brockman, Libby

2011-07-01

Social networking sites (SNSs) are immensely popular and allow for the display of personal information, including references to health behaviors. Evaluating displayed content on an SNS for research purposes requires a systematic approach and a precise data collection instrument. The purpose of this article is to describe one approach to the development of a research codebook so that others may develop and test their own codebooks for use in SNS research. Our SNS research codebook began on the basis of health behavior theory and clinical criteria. Key elements in the codebook developmental process included an iterative team approach and an emphasis on confidentiality. Codebook successes include consistently high inter-rater reliability. Challenges include time investment in coder training and SNS server changes. We hope that this article will provide detailed information about one systematic approach to codebook development so that other researchers may use this structure to develop and test their own codebooks for use in SNS research. Copyright © 2011 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

Development and evaluation of a study design typology for human research.

PubMed

Carini, Simona; Pollock, Brad H; Lehmann, Harold P; Bakken, Suzanne; Barbour, Edward M; Gabriel, Davera; Hagler, Herbert K; Harper, Caryn R; Mollah, Shamim A; Nahm, Meredith; Nguyen, Hien H; Scheuermann, Richard H; Sim, Ida

2009-11-14

A systematic classification of study designs would be useful for researchers, systematic reviewers, readers, and research administrators, among others. As part of the Human Studies Database Project, we developed the Study Design Typology to standardize the classification of study designs in human research. We then performed a multiple observer masked evaluation of active research protocols in four institutions according to a standardized protocol. Thirty-five protocols were classified by three reviewers each into one of nine high-level study designs for interventional and observational research (e.g., N-of-1, Parallel Group, Case Crossover). Rater classification agreement was moderately high for the 35 protocols (Fleiss' kappa = 0.442) and higher still for the 23 quantitative studies (Fleiss' kappa = 0.463). We conclude that our typology shows initial promise for reliably distinguishing study design types for quantitative human research.

Influenza vaccines in low and middle income countries: a systematic review of economic evaluations.

PubMed

Ott, Jördis J; Klein Breteler, Janna; Tam, John S; Hutubessy, Raymond C W; Jit, Mark; de Boer, Michiel R

2013-07-01

Economic evaluations on influenza vaccination from low resource settings are scarce and have not been evaluated using a systematic approach. Our objective was to conduct a systematic review on the value for money of influenza vaccination in low- and middle-income countries. PubMed and EMBASE were searched for economic evaluations published in any language between 1960 and 2011. Main outcome measures were costs per influenza outcome averted, costs per quality-adjusted life years gained or disability-adjusted life years averted, costs per benefit in monetary units or cost-benefit ratios. Nine economic evaluations on seasonal influenza vaccine met the inclusion criteria. These were model- or randomized-controlled-trial (RCT)-based economic evaluations from middle-income countries. Influenza vaccination provided value for money for elderly, infants, adults and children with high-risk conditions. Vaccination was cost-effective and cost-saving for chronic obstructive pulmonary disease patients and in elderly above 65 y from model-based evaluations, but conclusions from RCTs on elderly varied. Economic evaluations from middle income regions differed in population studied, outcomes and definitions used. Most findings are in line with evidence from high-income countries highlighting that influenza vaccine is likely to provide value for money. However, serious methodological limitations do not allow drawing conclusions on cost-effectiveness of influenza vaccination in middle income countries. Evidence on cost-effectiveness from low-income countries is lacking altogether, and more information is needed from full economic evaluations that are conducted in a standardized manner.

Development and Evaluation of a Doctoral-Level Public Health Pedagogy Course for Graduate Student Instructors

ERIC Educational Resources Information Center

Lederer, Alyssa M.; Sherwood-Laughlin, Catherine M.; Kearns, Katherine D.; O'Loughlin, Valerie D.

2016-01-01

This article describes the development, implementation, and systematic evaluation of a public health pedagogy course for first-time graduate student instructors in a Health Behavior doctoral program at a Midwestern School of Public Health. The pedagogy course focused on intensive pedagogical training in the first 8 weeks of a 16-week semester and…

American Evaluation Association: Guiding Principles for Evaluators

ERIC Educational Resources Information Center

American Journal of Evaluation, 2009

2009-01-01

The American Evaluation Association (AEA) strives to promote ethical practice in the evaluation of programs, products, personnel, and policy. This article presents the list of principles which AEA developed to guide evaluators in their professional practice. These principles are: (1) Systematic Inquiry; (2) Competence; (3) Integrity/Honesty; (4)…

Systematic review of character development and childhood chronic illness.

PubMed

Maslow, Gary R; Hill, Sherika N

2016-05-08

To review empirical evidence on character development among youth with chronic illnesses. A systematic literature review was conducted using PubMed and PSYCHINFO from inception until November 2013 to find quantitative studies that measured character strengths among youth with chronic illnesses. Inclusion criteria were limited to English language studies examining constructs of character development among adolescents or young adults aged 13-24 years with a childhood-onset chronic medical condition. A librarian at Duke University Medical Center Library assisted with the development of the mesh search term. Two researchers independently reviewed relevant titles (n = 549), then abstracts (n = 45), and finally manuscripts (n = 3). There is a lack of empirical research on character development and childhood-onset chronic medical conditions. Three studies were identified that used different measures of character based on moral themes. One study examined moral reasoning among deaf adolescents using Kohlberg's Moral Judgement Instrument; another, investigated moral values of adolescent cancer survivors with the Values In Action Classification of Strengths. A third study evaluated moral behavior among young adult survivors of burn injury utilizing the Tennessee Self-Concept, 2(nd) edition. The studies observed that youth with chronic conditions reasoned at less advanced stages and had a lower moral self-concept compared to referent populations, but that they did differ on character virtues and strengths when matched with healthy peers for age, sex, and race/ethnicity. Yet, generalizations could not be drawn regarding character development of youth with chronic medical conditions because the studies were too divergent from each other and biased from study design limitations. Future empirical studies should learn from the strengths and weaknesses of the existing literature on character development among youth with chronic medical conditions.

Systematic review of character development and childhood chronic illness

PubMed Central

Maslow, Gary R; Hill, Sherika N

2016-01-01

AIM: To review empirical evidence on character development among youth with chronic illnesses. METHODS: A systematic literature review was conducted using PubMed and PSYCHINFO from inception until November 2013 to find quantitative studies that measured character strengths among youth with chronic illnesses. Inclusion criteria were limited to English language studies examining constructs of character development among adolescents or young adults aged 13-24 years with a childhood-onset chronic medical condition. A librarian at Duke University Medical Center Library assisted with the development of the mesh search term. Two researchers independently reviewed relevant titles (n = 549), then abstracts (n = 45), and finally manuscripts (n = 3). RESULTS: There is a lack of empirical research on character development and childhood-onset chronic medical conditions. Three studies were identified that used different measures of character based on moral themes. One study examined moral reasoning among deaf adolescents using Kohlberg’s Moral Judgement Instrument; another, investigated moral values of adolescent cancer survivors with the Values In Action Classification of Strengths. A third study evaluated moral behavior among young adult survivors of burn injury utilizing the Tennessee Self-Concept, 2nd edition. The studies observed that youth with chronic conditions reasoned at less advanced stages and had a lower moral self-concept compared to referent populations, but that they did differ on character virtues and strengths when matched with healthy peers for age, sex, and race/ethnicity. Yet, generalizations could not be drawn regarding character development of youth with chronic medical conditions because the studies were too divergent from each other and biased from study design limitations. CONCLUSION: Future empirical studies should learn from the strengths and weaknesses of the existing literature on character development among youth with chronic medical conditions

Patient-Reported Outcome Measures in Dysphagia: A Systematic Review of Instrument Development and Validation

PubMed Central

Patel, Dhyanesh A.; Sharda, Rohit; Hovis, Kristen L.; Nichols, Erin E.; Sathe, Nila; Penson, David F.; Feurer, Irene D.; McPheeters, Melissa L.; Vaezi, Michael F.; Francis, David O.

2017-01-01

Objective Patient-reported outcome (PRO) measures are commonly used to capture patient experience with dysphagia and to evaluate treatment effectiveness. Inappropriate application can lead to distorted results in clinical studies. A systematic review of the literature on dysphagia-related PRO measures was performed to 1) identify all currently available measures and 2) to evaluate each for the presence of important measurement properties that would affect their applicability. Design MEDLINE via the PubMed interface, the Cumulative Index of Nursing and Allied Health Literature, and the Health and Psychosocial Instrument database were searched using relevant vocabulary terms and key terms related to PRO measures and dysphagia. Three independent investigators performed abstract and full text reviews. Each study meeting criteria was evaluated using an 18-item checklist developed a priori that assessed multiple domains: 1) conceptual model, 2) content validity, 3) reliability, 4) construct validity, 6) scoring and interpretation, and 7) burden and presentation. Results Of 4950 abstracts reviewed, a total of 34 dysphagia-related PRO measures (publication year 1987 – 2014) met criteria for extraction and analysis. Several PRO measures were of high quality (MADS for achalasia, SWAL-QOL and SSQ for oropharyngeal dysphagia, PROMIS-GI for general dysphagia, EORTC-QLQ-OG25 for esophageal cancer, ROMP-swallowing for Parkinson’s disease, DSQ-EoE for eosinophilic esophagitis, and SOAL for total laryngectomy-related dysphagia). In all, 17 met at least one criterion per domain. Thematic deficiencies in current measures were evident including: 1) direct patient involvement in content development, 2) empirically justified dimensionality, 3) demonstrable responsiveness to change, 4) plan for interpreting missing responses, and 5) literacy level assessment. Conclusion This is the first comprehensive systematic review assessing developmental properties of all available dysphagia

Evaluating Patient Reported Outcome Measures (PROMs) for bladder cancer: a systematic review using the COSMIN checklist.

PubMed

Mason, Samantha J; Catto, James Wf; Downing, Amy; Bottomley, Sarah E; Glaser, Adam W; Wright, Penny

2018-05-03

Patient Reported Outcome Measures (PROMs) are important tools used to understand patient focused outcomes from care. Various PROMs have been developed for patients with Bladder Cancer (BC), although the disease's heterogeneity makes selection difficult. Accurate measurement of Health Related Quality of Life (HRQL) can only be achieved if the PROM chosen is 'fit for purpose' (i.e. psychometrically sound). Systematic reviews of psychometric properties are useful for selecting the best PROM for a specific purpose. The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) developed a checklist to improve the selection of health measurement instruments as part of a review process. Our aims were to undertake a systematic review, using the COSMIN criteria, to assess the quality of studies that report the psychometric properties of PROMs used with people with BC and determine the psychometric quality of these PROMs. An electronic search of seven databases including PubMed, MEDLINE and EMBASE (PROSPERO reference CRD42016051974) was undertaken to identify English language publications, published between January 1990 and September 2017 that evaluated psychometric properties of PROMs used in BC research. Two researchers independently screened abstracts and selected full text papers. Studies were rated on methodological quality using the COSMIN checklist. Overall, 4,663 records were screened and 23 studies, reporting outcomes in 3,568 patients, were evaluated using the COSMIN checklist. Most PROMs had limited information reported about their psychometric properties. Studies reporting on the Bladder Cancer Index (BCI) and Functional Assessment of Cancer Therapy Vanderbilt Cystectomy Index (FACT-VCI) provided the most detail and these PROMs could be evaluated on the most COSMIN properties. Based on the available evidence, no existing PROM stands out as the most appropriate to measure HRQL in BC populations. This is due to two factors; (i) the

Evaluating mobile phone applications for health behaviour change: A systematic review.

PubMed

McKay, Fiona H; Cheng, Christina; Wright, Annemarie; Shill, Jane; Stephens, Hugh; Uccellini, Mary

2018-01-01

Introduction Increasing smartphones access has allowed for increasing development and use of smart phone applications (apps). Mobile health interventions have previously relied on voice or text-based short message services (SMS), however, the increasing availability and ease of use of apps has allowed for significant growth of smartphone apps that can be used for health behaviour change. This review considers the current body of knowledge relating to the evaluation of apps for health behaviour change. The aim of this review is to investigate approaches to the evaluation of health apps to identify any current best practice approaches. Method A systematic review was conducted. Data were collected and analysed in September 2016. Thirty-eight articles were identified and have been included in this review. Results Articles were published between 2011- 2016, and 36 were reviews or evaluations of apps related to one or more health conditions, the remaining two reported on an investigation of the usability of health apps. Studies investigated apps relating to the following areas: alcohol, asthma, breastfeeding, cancer, depression, diabetes, general health and fitness, headaches, heart disease, HIV, hypertension, iron deficiency/anaemia, low vision, mindfulness, obesity, pain, physical activity, smoking, weight management and women's health. Conclusion In order to harness the potential of mobile health apps for behaviour change and health, we need better ways to assess the quality and effectiveness of apps. This review is unable to suggest a single best practice approach to evaluate mobile health apps. Few measures identified in this review included sufficient information or evaluation, leading to potentially incomplete and inaccurate information for consumers seeking the best app for their situation. This is further complicated by a lack of regulation in health promotion generally.

Research on Sustainable Development Level Evaluation of Resource-based Cities Based on Shapely Entropy and Chouqet Integral

NASA Astrophysics Data System (ADS)

Zhao, Hui; Qu, Weilu; Qiu, Weiting

2018-03-01

In order to evaluate sustainable development level of resource-based cities, an evaluation method with Shapely entropy and Choquet integral is proposed. First of all, a systematic index system is constructed, the importance of each attribute is calculated based on the maximum Shapely entropy principle, and then the Choquet integral is introduced to calculate the comprehensive evaluation value of each city from the bottom up, finally apply this method to 10 typical resource-based cities in China. The empirical results show that the evaluation method is scientific and reasonable, which provides theoretical support for the sustainable development path and reform direction of resource-based cities.

Economic evaluations in gastroenterology in Brazil: A systematic review

PubMed Central

de Paiva Haddad, Luciana Bertocco; Decimoni, Tassia Cristina; Turri, Jose Antonio; Leandro, Roseli; de Soárez, Patrícia Coelho

2016-01-01

AIM: To systematically review economic evaluations in gastroenterology, relating to Brazil, published between 1980 and 2013. METHODS: We selected full and partial economic evaluations from among those retrieved by searching the following databases: MEDLINE (PubMed); Excerpta Medica; the Latin American and Caribbean Health Sciences Literature database; the Scientific Electronic Library Online; the database of the Centre for Reviews and Dissemination; the National Health Service (NHS) Economic Evaluation Database; the NHS Health Technology Assessment database; the Health Economics database of the Brazilian Virtual Library of Health; Scopus; Web of Science; and the Brazilian Network for the Evaluation of Health Technologies. Two researchers, working independently, selected the studies and extracted the data. RESULTS: We identified 535 health economic evaluations relating to Brazil and published in the 1980-2013 period. Of those 535 articles, only 40 dealt with gastroenterology. Full and partial economic evaluations respectively accounted for 23 (57.5%) and 17 (42.5%) of the 40 studies included. Among the 23 full economic evaluations, there were 11 cost-utility analyses, seven cost-effectiveness analyses, four cost-consequence analyses, and one cost-minimization analysis. Of the 40 studies, 25 (62.5%) evaluated medications; 7 (17.5%) evaluated procedures; and 3 (7.5%) evaluated equipment. Most (55%) of the studies were related to viral hepatitis, and most (63.4%) were published after 2010. Other topics included gastrointestinal cancer, liver transplantation, digestive diseases and hernias. Over the 33-year period examined, the number of such economic evaluations relating to Brazil, especially of those evaluating medications for the treatment of hepatitis, increased considerably. CONCLUSION: Further studies are needed in order to ensure that expenditures on health care in Brazil are made as fairly and efficiently as possible. PMID:26855823

Systematic Evaluation of Desmopressin Applied to the Patients with Aneurysmal Subarachnoid Haemorrhage in the light of the Literature.

PubMed

Karaarslan, Numan; Yilmaz, Ibrahim; Akgun, Feride Sinem; Caliskan, Tezcan; Ozbek, Hanefi; Ates, Ozkan

2018-04-09

This study discusses the management of patients with the syndrome of inappropriate antidiuretic hormone secretion (SIADH), developed after subarachnoid hemorrhage, in a comparative manner in light of the literature. Without country or language restrictions, articles with high evidential value found in electronic databases were compared to our patients' data. After the literature review, three articles were included for systematic evaluation. Desmopressin was applied to the patients for the treatment of hyponatremia, volume contraction, and negative sodium balance caused by SIADH. However, it was not used for preventing re-bleeding. To prevent the development of this complication (SIADH), the use of desmopressin, an analogue of vasopressin, is important in routine clinical practice.

Usability evaluation techniques in mobile commerce applications: A systematic review

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error

Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach.

PubMed

Aromataris, Edoardo; Fernandez, Ritin; Godfrey, Christina M; Holly, Cheryl; Khalil, Hanan; Tungpunkom, Patraporn

2015-09-01

With the increase in the number of systematic reviews available, a logical next step to provide decision makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews. Syntheses of existing systematic reviews are referred to by many different names, one of which is an umbrella review. An umbrella review allows the findings of reviews relevant to a review question to be compared and contrasted. An umbrella review's most characteristic feature is that this type of evidence synthesis only considers for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses. A methodology working group was formed by the Joanna Briggs Institute to develop methodological guidance for the conduct of an umbrella review, including diverse types of evidence, both quantitative and qualitative. The aim of this study is to describe the development and guidance for the conduct of an umbrella review. Discussion and testing of the elements of methods for the conduct of an umbrella review were held over a 6-month period by members of a methodology working group. The working group comprised six participants who corresponded via teleconference, e-mail and face-to-face meeting during this development period. In October 2013, the methodology was presented in a workshop at the Joanna Briggs Institute Convention. Workshop participants, review authors and methodologists provided further testing, critique and feedback on the proposed methodology. This study describes the methodology and methods developed for the conduct of an umbrella review that includes published systematic reviews and meta-analyses as the analytical unit of the review. Details are provided regarding the essential elements of an umbrella review, including presentation of the review question in a Population, Intervention, Comparator, Outcome format, nuances of the inclusion criteria and search strategy. A critical appraisal tool with 10 questions to

[A systematic evaluation of application of the web-based cancer database].

PubMed

Huang, Tingting; Liu, Jialin; Li, Yong; Zhang, Rui

2013-10-01

In order to support the theory and practice of the web-based cancer database development in China, we applied a systematic evaluation to assess the development condition of the web-based cancer databases at home and abroad. We performed computer-based retrieval of the Ovid-MEDLINE, Springerlink, EBSCOhost, Wiley Online Library and CNKI databases, the papers of which were published between Jan. 1995 and Dec. 2011, and retrieved the references of these papers by hand. We selected qualified papers according to the pre-established inclusion and exclusion criteria, and carried out information extraction and analysis of the papers. Eventually, searching the online database, we obtained 1244 papers, and checking the reference lists, we found other 19 articles. Thirty-one articles met the inclusion and exclusion criteria and we extracted the proofs and assessed them. Analyzing these evidences showed that the U.S.A. counted for 26% in the first place. Thirty-nine percent of these web-based cancer databases are comprehensive cancer databases. As for single cancer databases, breast cancer and prostatic cancer are on the top, both counting for 10% respectively. Thirty-two percent of the cancer database are associated with cancer gene information. For the technical applications, MySQL and PHP applied most widely, nearly 23% each.

Systematic literature reviews and meta-analyses: part 6 of a series on evaluation of scientific publications.

PubMed

Ressing, Meike; Blettner, Maria; Klug, Stefanie J

2009-07-01

Because of the rising number of scientific publications, it is important to have a means of jointly summarizing and assessing different studies on a single topic. Systematic literature reviews, meta-analyses of published data, and meta-analyses of individual data (pooled reanalyses) are now being published with increasing frequency. We here describe the essential features of these methods and discuss their strengths and weaknesses. This article is based on a selective literature search. The different types of review and meta-analysis are described, the methods used in each are outlined so that they can be evaluated, and a checklist is given for the assessment of reviews and meta-analyses of scientific articles. Systematic literature reviews provide an overview of the state of research on a given topic and enable an assessment of the quality of individual studies. They also allow the results of different studies to be evaluated together when these are inconsistent. Meta-analyses additionally allow calculation of pooled estimates of an effect. The different types of review and meta-analysis are discussed with examples from the literature on one particular topic. Systematic literature reviews and meta-analyses enable the research findings and treatment effects obtained in different individual studies to be summed up and evaluated.

Promoting Early Child Development With Interventions in Health and Nutrition: A Systematic Review.

PubMed

Vaivada, Tyler; Gaffey, Michelle F; Bhutta, Zulfiqar A

2017-08-01

Although effective health and nutrition interventions for reducing child mortality and morbidity exist, direct evidence of effects on cognitive, motor, and psychosocial development is lacking. To review existing evidence for health and nutrition interventions affecting direct measures of (and pathways to) early child development. Reviews and recent overviews of interventions across the continuum of care and component studies. We selected systematic reviews detailing the effectiveness of health or nutrition interventions that have plausible links to child development and/or contain direct measures of cognitive, motor, and psychosocial development. A team of reviewers independently extracted data and assessed their quality. Sixty systematic reviews contained the outcomes of interest. Various interventions reduced morbidity and improved child growth, but few had direct measures of child development. Of particular benefit were food and micronutrient supplementation for mothers to reduce the risk of small for gestational age and iodine deficiency, strategies to reduce iron deficiency anemia in infancy, and early neonatal care (appropriate resuscitation, delayed cord clamping, and Kangaroo Mother Care). Neuroprotective interventions for imminent preterm birth showed the largest effect sizes (antenatal corticosteroids for developmental delay: risk ratio 0.49, 95% confidence interval 0.24 to 1.00; magnesium sulfate for gross motor dysfunction: risk ratio 0.61, 95% confidence interval 0.44 to 0.85). Given the focus on high-quality studies captured in leading systematic reviews, only effects reported within studies included in systematic reviews were captured. These findings should guide the prioritization and scale-up of interventions within critical periods of early infancy and childhood, and encourage research into their implementation at scale. Copyright © 2017 by the American Academy of Pediatrics.

A systematic review comparing open-book and closed-book examinations: Evaluating effects on development of critical thinking skills.

PubMed

Johanns, Beth; Dinkens, Amber; Moore, Jill

2017-11-01

The advantages of using traditional closed-book examinations are closely compared to the advantages of using open-book examinations for the development of critical thinking skills in nursing students. The use of critical thinking skills is vital among nurses to assess patient needs and modify standard approaches to individualize care for better patient outcomes. The following areas are compared and contrasted for both closed-book and open-book examinations: examination preparation, rote memorization versus active learning, intellectual engagement, simulation of working environment, higher order thinking skills, anxiety reduction and student satisfaction. During investigation of closed-book examinations and open-book examinations, the use of collaborative testing was unveiled. Collaborative testing combines areas from both closed-book and open-book examinations. Based on the systematic review of literature, the recommendation is to use a mixed method of examination types throughout the course of the nursing program. Each type of examination helps develop different skill sets in the nursing student. Copyright © 2017 Elsevier Ltd. All rights reserved.

A systematic review of systematic reviews on interventions for caregivers of people with chronic conditions.

PubMed

Corry, Margarita; While, Alison; Neenan, Kathleen; Smith, Valerie

2015-04-01

To evaluate the effectiveness of interventions to support caregivers of people with selected chronic conditions. Informal caregivers provide millions of care hours each week contributing to significant healthcare savings. Despite much research evaluating a range of interventions for caregivers, their impact remains unclear. A systematic review of systematic reviews of interventions to support caregivers of people with selected chronic conditions. The electronic databases of PubMed, CINAHL, British Nursing Index, PsycINFO, Social Science Index (January 1990-May 2014) and The Cochrane Library (Issue 6, June 2014), were searched using Medical Subject Heading and index term combinations of the keywords caregiver, systematic review, intervention and named chronic conditions. Papers were included if they reported a systematic review of interventions for caregivers of people with chronic conditions. The methodological quality of the included reviews was independently assessed by two reviewers using R-AMSTAR. Data were independently extracted by two reviewers using a pre-designed data extraction form. Narrative synthesis of review findings was used to present the results. Eight systematic reviews were included. There was evidence that education and support programme interventions improved caregiver quality of life. Information-giving interventions improved caregiver knowledge for stroke caregivers. Education, support and information-giving interventions warrant further investigation across caregiver groups. A large-scale funded programme for caregiver research is required to ensure that studies are of high quality to inform service development across settings. © 2014 John Wiley & Sons Ltd.

Systematic Review: the use of vouchers for reproductive health services in developing countries: systematic review.

PubMed

Bellows, Nicole M; Bellows, Ben W; Warren, Charlotte

2011-01-01

To identify where vouchers have been used for reproductive health (RH) services, to what extent RH voucher programmes have been evaluated, and whether the programmes have been effective. A systematic search of the peer review and grey literature was conducted to identify RH voucher programmes and evaluation findings. Experts were consulted to verify RH voucher programme information and identify further programmes and studies not found in the literature search. Studies were examined for outcomes regarding targeting, costs, knowledge, utilization, quality, and population health impact. Included studies used cross-sectional, before-and-after and quasi-experimental designs. Thirteen RH voucher programmes fitting established criteria were identified. RH voucher programmes were located in Bangladesh, Cambodia, China, Kenya (2), Korea, India, Indonesia, Nicaragua (3), Taiwan, and Uganda. Among RH voucher programmes, 7 were quantitatively evaluated in 15 studies. All evaluations reported some positive findings, indicating that RH voucher programmes increased utilization of RH services, improved quality of care, and improved population health outcomes. The potential for RH voucher programmes appears positive; however, more research is needed to examine programme effectiveness using strong study designs. In particular, it is important to see stronger evidence on cost-effectiveness and population health impacts, where the findings can best direct governments and external funders. © 2010 Blackwell Publishing Ltd.

Evaluating barriers to adopting telemedicine worldwide: A systematic review.

PubMed

Scott Kruse, Clemens; Karem, Priyanka; Shifflett, Kelli; Vegi, Lokesh; Ravi, Karuna; Brooks, Matthew

2018-01-01

Introduction and objective Studies on telemedicine have shown success in reducing the geographical and time obstacles incurred in the receipt of care in traditional modalities with the same or greater effectiveness; however, there are several barriers that need to be addressed in order for telemedicine technology to spread. The aim of this review is to evaluate barriers to adopting telemedicine worldwide through the analysis of published work. Methods The authors conducted a systematic literature review by extracting the data from the Cumulative Index of Nursing and Allied Health Literature (CINAHL) and PubMed (MEDLINE) research databases. The reviewers in this study analysed 30 articles (nine from CINAHL and 21 from Medline) and identified barriers found in the literature. This review followed the checklist from Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2009. The reviewers organized the results into one table and five figures that depict the data in different ways, organized by: barrier, country-specific barriers, organization-specific barriers, patient-specific barriers, and medical-staff and programmer-specific barriers. Results The reviewers identified 33 barriers with a frequency of 100 occurrences through the 30 articles. The study identified the issues with technically challenged staff (11%), followed by resistance to change (8%), cost (8%), reimbursement (5%), age of patient (5%), and level of education of patient (5%). All other barriers occurred at or less than 4% of the time. Discussion and conclusions Telemedicine is not yet ubiquitous, and barriers vary widely. The top barriers are technology-specific and could be overcome through training, change-management techniques, and alternating delivery by telemedicine and personal patient-to-provider interaction. The results of this study identify several barriers that could be eliminated by focused policy. Future work should evaluate policy to identify which one to lever to

A Systematic Review of Psychometric Evaluation of Motivational Interviewing Integrity Measures

ERIC Educational Resources Information Center

Wallace, Lloyd; Turner, Fiona

2009-01-01

The Motivational Interviewing Skills Code (MISC) has been developed to measure motivational interviewing skill, but a need has been identified for more economical instruments. This study expands on a previous systematic review by Madson and Campbell (2006) and examines the extent to which motivational interviewing integrity measures other than the…

Prevention of cervical cancer in HIV-seropositive women from developing countries: a systematic review protocol.

PubMed

Mapanga, Witness; Elhakeem, Ahmed; Feresu, Shingairai A; Maseko, Fresier; Chipato, Tsungai

2017-04-24

Over 85% of cervical cancer cases and deaths occur in developing countries. HIV-seropositive women are more likely to develop precancerous lesions that lead to cervical cancer than HIV-negative women. However, the literature on cervical cancer prevention in seropositive women in developing countries has not been reviewed. The aim of this study is to systematically review cervical cancer prevention modalities available for HIV-seropositive women in developing countries. This protocol was developed by following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) statement, and the systematic review will be reported in accordance with the PRISMA guidelines. Embase, MEDLINE, PubMed, CINAHL and Cochrane Library will be searched from inception up to date of final search, and additional studies will be located through citation and reference list tracking. Eligible studies will be randomised controlled trials, prospective and retrospective cohort studies, case-control and cross-sectional studies carried out in developing countries. Studies will be included if they are published in English and examine cervical cancer prevention modalities in HIV-seropositive women. Results will be summarised in tables and, where appropriate, combined using meta-analysis. This review will address the gap in evidence by systematically reviewing the published literature on the different prevention modalities being used to prevent cervical cancer in HIV-seropositive women in developing countries. The findings may be used to inform evidence-based guidelines for prevention of cervical cancer in seropositive women as well as future research. PROSPERO CRD42017054678 .

Evidence-based development and evaluation of mobile cognitive support apps for people on the autism spectrum: methodological conclusions from two R+D projects.

PubMed

Gyori, Miklos; Stefanik, Krisztina; Kanizsai-Nagy, Ildikó

2015-01-01

A growing body of evidence confirms that mobile digital devices have key potentials as assistive/educational tools for people with autism spectrum disorders. The aim of this paper is to outline key aspects of development and evaluation methodologies that build on, and provide systematic evidence on effects of using such apps. We rely on the results of two R+D projects, both using quantitative and qualitative methods to support development and to evaluate developed apps (n=54 and n=22). Analyzing methodological conclusions from these studies we outline some guidelines for an 'ideal' R+D methodology but we also point to important trade-offs between the need for best systematic evidence and the limitations on development time and costs. We see these trade-offs as a key issue to be resolved in this field.

Enhancing the incorporation of the patient's voice in drug development and evaluation.

PubMed

Chalasani, Meghana; Vaidya, Pujita; Mullin, Theresa

2018-01-01

People living with a condition are uniquely positioned to inform the understanding of the therapeutic context for drug development and evaluation. In 2012, the U.S. Food and Drug Administration (FDA) established the Patient-Focused Drug Development (PFDD) initiative to more systematically obtain the patient perspective on specific diseases and their currently available treatments. PFDD meetings are unique among FDA public meetings, with a format designed to engage patients and elicit their perspectives on two topic areas: (1) the most significant symptoms of their condition and the impact of the condition on daily life; and, (2) their current approaches to treatment. FDA has conducted 24 disease-specific PFDD meetings to date. The lessons learned from PFDD meetings range from experiences common across rare diseases to more disease specific experiences that matter most to patients. FDA recognizes that FDA-led PFDD meetings alone cannot address the gaps in information on the patient perspective. Patient-focused drug development is an ongoing effort and FDA looks forward to the next steps in advancing the science and the utilization of patient input throughout drug development and evaluation. The U.S. Food and Drug Administration (FDA) has multiple mechanisms for its regulators and staff to interact with patients -- but none quite like its novel Patient-Focused Drug Development (PFDD) initiative. FDA established the PFDD initiative to more systematically obtain the patient perspective on specific diseases and their currently available treatments. Since the initiative's inception in 2012, FDA has held 24 PFDD meetings, covering a range of disease areas and hearing directly from thousands of patients and caregivers. FDA's PFDD meetings have also provided key stakeholders, including patient advocates, researchers, drug developers, healthcare providers, and other government officials, an opportunity to hear the patient's voice. The lessons learned include but are not

Systematic overview of economic evaluations of health-related rehabilitation.

PubMed

Howard-Wilsher, Stephanie; Irvine, Lisa; Fan, Hong; Shakespeare, Tom; Suhrcke, Marc; Horton, Simon; Poland, Fiona; Hooper, Lee; Song, Fujian

2016-01-01

Health related rehabilitation is instrumental in improving functioning and promoting participation by people with disabilities. To make clinical and policy decisions about health-related rehabilitation, resource allocation and cost issues need to be considered. To provide an overview of systematic reviews (SRs) on economic evaluations of health-related rehabilitation. We searched multiple databases to identify relevant SRs of economic evaluations of health-related rehabilitation. Review quality was assessed by AMSTAR checklist. We included 64 SRs, most of which included economic evaluations alongside randomized controlled trials (RCTs). The review quality was low to moderate (AMSTAR score 5-8) in 35, and high (score 9-11) in 29 of the included SRs. The included SRs addressed various health conditions, including spinal or other pain conditions (n = 14), age-related problems (11), stroke (7), musculoskeletal disorders (6), heart diseases (4), pulmonary (3), mental health problems (3), and injury (3). Physiotherapy was the most commonly evaluated rehabilitation intervention in the included SRs (n = 24). Other commonly evaluated interventions included multidisciplinary programmes (14); behavioral, educational or psychological interventions (11); home-based interventions (11); complementary therapy (6); self-management (6); and occupational therapy (4). Although the available evidence is often described as limited, inconsistent or inconclusive, some rehabilitation interventions were cost-effective or showed cost-saving in a variety of disability conditions. Available evidence comes predominantly from high income countries, therefore economic evaluations of health-related rehabilitation are urgently required in less resourced settings. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Systematic Evaluation Program (SEP) at Rocky Flats Plant: An overview of practical management issues for evaluation of natural phenomena hazards

DOE Office of Scientific and Technical Information (OSTI.GOV)

Badwan, F.M.; Herring, K.S.

1993-08-01

Many of the buildings at the Rocky Flats Plant were designed and built before modern standards were developed, including standards for protection against extreme natural phenomenon such as tornadoes, earthquakes, and floods. The purpose of the SEP is to establish an integrated approach to assessing the design adequacy of specific high and moderate hazard Rocky Flats facilities from a safety perspective and to establish a basis for defining any needed facility improvements. The SEP is to be carried out in three Phases. In Phase 1, topics to be evaluated and an evaluation plan for each topic were developed. Any differencesmore » between Current Design Requirements (CDR) or acceptance criteria and the design of existing facilities, will be identified during Phase 2 and assessed using an integrated systematic approach during Phase 3. The integrated assessment performed during Phase 3 provides a process for evaluating the differences between existing facility design and CDRs so that decisions on corrective actions can be made on the basis of relative risk reduction and cost effectiveness. These efforts will ensure that a balanced and integrated level of safety is achieved for long-term operation of these buildings. Through appropriate selection of topics and identification of the structures, systems, and components to be evaluated, the SEP will address outstanding design issues related to the prevention and mitigation of design basis accidents, including those arising from natural phenomena. The objective of the SEP is not to bring these buildings into strict compliance with current requirements, but rather to ensure that an adequate level of safety is achieved in an economical fashion.« less

A Systematic Review of Economic Evaluations of Pharmacogenetic Testing for Prevention of Adverse Drug Reactions.

PubMed

Plumpton, Catrin O; Roberts, Daniel; Pirmohamed, Munir; Hughes, Dyfrig A

2016-08-01

Pharmacogenetics offers the potential to improve health outcomes by identifying individuals who are at greater risk of harm from certain medicines. Routine adoption of pharmacogenetic tests requires evidence of their cost effectiveness. The present review aims to systematically review published economic evaluations of pharmacogenetic tests that aim to prevent or reduce the incidence of ADRs. We conducted a systematic literature review of economic evaluations of pharmacogenetic tests aimed to reduce the incidence of adverse drug reactions. Literature was searched using Embase, MEDLINE and the NHS Economic Evaluation Database with search terms relating to pharmacogenetic testing, adverse drug reactions, economic evaluations and pharmaceuticals. Titles were screened independently by two reviewers. Articles deemed to meet the inclusion criteria were screened independently on abstract, and full texts reviewed. We identified 852 articles, of which 47 met the inclusion criteria. There was evidence supporting the cost effectiveness of testing for HLA-B*57:01 (prior to abacavir), HLA-B*15:02 and HLA-A*31:01 (prior to carbamazepine), HLA-B*58:01 (prior to allopurinol) and CYP2C19 (prior to clopidogrel treatment). Economic evidence was inconclusive with respect to TPMT (prior to 6-mercaptoputine, azathioprine and cisplatin therapy), CYP2C9 and VKORC1 (to inform genotype-guided dosing of coumarin derivatives), MTHFR (prior to methotrexate treatment) and factor V Leiden testing (prior to oral contraception). Testing for A1555G is not cost effective before prescribing aminoglycosides. Our systematic review identified robust evidence of the cost effectiveness of genotyping prior to treatment with a number of common drugs. However, further analyses and (or) availability of robust clinical evidence is necessary to make recommendations for others.

Motor Rehabilitation Using Kinect: A Systematic Review.

PubMed

Da Gama, Alana; Fallavollita, Pascal; Teichrieb, Veronica; Navab, Nassir

2015-04-01

Interactive systems are being developed with the intention to help in the engagement of patients on various therapies. Amid the recent technological advances, Kinect™ from Microsoft (Redmond, WA) has helped pave the way on how user interaction technology facilitates and complements many clinical applications. In order to examine the actual status of Kinect developments for rehabilitation, this article presents a systematic review of articles that involve interactive, evaluative, and technical advances related to motor rehabilitation. Systematic research was performed in the IEEE Xplore and PubMed databases using the key word combination "Kinect AND rehabilitation" with the following inclusion criteria: (1) English language, (2) page number >4, (3) Kinect system for assistive interaction or clinical evaluation, or (4) Kinect system for improvement or evaluation of the sensor tracking or movement recognition. Quality assessment was performed by QualSyst standards. In total, 109 articles were found in the database research, from which 31 were included in the review: 13 were focused on the development of assistive systems for rehabilitation, 3 in evaluation, 3 in the applicability category, 7 on validation of Kinect anatomic and clinical evaluation, and 5 on improvement techniques. Quality analysis of all included articles is also presented with their respective QualSyst checklist scores. Research and development possibilities and future works with the Kinect for rehabilitation application are extensive. Methodological improvements when performing studies on this area need to be further investigated.

Modeling Systematicity and Individuality in Nonlinear Second Language Development: The Case of English Grammatical Morphemes

ERIC Educational Resources Information Center

Murakami, Akira

2016-01-01

This article introduces two sophisticated statistical modeling techniques that allow researchers to analyze systematicity, individual variation, and nonlinearity in second language (L2) development. Generalized linear mixed-effects models can be used to quantify individual variation and examine systematic effects simultaneously, and generalized…

Systematic Quality Development Work in a Swedish Leisure-Time Centre

ERIC Educational Resources Information Center

Lager, Karin; Sheridan, Sonja; Gustafsson, Jan

2016-01-01

There is increasing activity in the area of quality issues in education in Europe. Diverse discourses of policy for quality are encountered in daily practice. This article explores systematic quality development work in a Swedish educational setting: the leisure-time centre. By following 2 teachers' enactments of policy in planning, organising,…

Systematic review of serum steroid reference intervals developed using mass spectrometry.

PubMed

Tavita, Nevada; Greaves, Ronda F

2017-12-01

The aim of this study was to perform a systematic review of the published literature to determine the available serum/plasma steroid reference intervals generated by mass spectrometry (MS) methods across all age groups in healthy subjects and to suggest recommendations to achieve common MS based reference intervals for serum steroids. MEDLINE, EMBASE and PubMed databases were used to conduct a comprehensive search for English language, MS-based reference interval studies for serum/plasma steroids. Selection of steroids to include was based on those listed in the Royal College of Pathologists of Australasia Quality Assurance Programs, Chemical Pathology, Endocrine Program. This methodology has been registered onto the PROSPERO International prospective register of systematic reviews (ID number: CRD42015029637). After accounting for duplicates, a total of 60 manuscripts were identified through the search strategy. Following critical evaluation, a total of 16 studies were selected. Of the 16 studies, 12 reported reference intervals for testosterone, 11 for 17 hydroxy-progesterone, nine for androstenedione, six for cortisol, three for progesterone, two for dihydrotestosterone and only one for aldosterone and dehydroepiandrosterone sulphate. No studies established MS-based reference intervals for oestradiol. As far as we are aware, this report provides the first comparison of the peer reviewed literature for serum/plasma steroid reference intervals generated by MS-based methods. The reference intervals based on these published studies can be used to inform the process to develop common reference intervals, and agreed reporting units for mass spectrometry based steroid methods. Copyright © 2017 The Canadian Society of Clinical Chemists. Published by Elsevier Inc. All rights reserved.

Standardizing the evaluation criteria on treatment outcomes of mandibular implant overdentures: a systematic review

PubMed Central

Kim, Ha-Young; Shin, Sang-Wan

2014-01-01

PURPOSE The aim of this review was to analyze the evaluation criteria on mandibular implant overdentures through a systematic review and suggest standardized evaluation criteria. MATERIALS AND METHODS A systematic literature search was conducted by PubMed search strategy and hand-searching of relevant journals from included studies considering inclusion and exclusion criteria. Randomized clinical trials (RCT) and clinical trial studies comparing attachment systems on mandibular implant overdentures until December, 2011 were selected. Twenty nine studies were finally selected and the data about evaluation methods were collected. RESULTS Evaluation criteria could be classified into 4 groups (implant survival, peri-implant tissue evaluation, prosthetic evaluation, and patient satisfaction). Among 29 studies, 21 studies presented implant survival rate, while any studies reporting implant failure did not present cumulative implant survival rate. Seventeen studies evaluating peri-implant tissue status presented following items as evaluation criteria; marginal bone level (14), plaque Index (13), probing depth (8), bleeding index (8), attachment gingiva level (8), gingival index (6), amount of keratinized gingiva (1). Eighteen studies evaluating prosthetic maintenance and complication also presented following items as evaluation criteria; loose matrix (17), female detachment (15), denture fracture (15), denture relining (14), abutment fracture (14), abutment screw loosening (11), and occlusal adjustment (9). Atypical questionnaire (9), Visual analog scales (VAS) (4), and Oral Health Impact Profile (OHIP) (1) were used as the format of criteria to evaluate patients satisfaction in 14 studies. CONCLUSION For evaluation of implant overdenture, it is necessary to include cumulative survival rate for implant evaluation. It is suggested that peri-implant tissue evaluation criteria include marginal bone level, plaque index, bleeding index, probing depth, and attached gingiva

Systematic review of positive youth development programs for adolescents with chronic illness.

PubMed

Maslow, Gary R; Chung, Richard J

2013-05-01

The Positive Youth Development (PYD) framework has been successfully used to support at-risk youth. However, its effectiveness in fostering positive outcomes for adolescents with chronic illness has not been established. We performed a systematic review of PYD-consistent programs for adolescents with chronic illness. Data sources included PubMed, CINAHL, and PsychINFO. Guided by an analytic framework, we searched for studies of PYD-consistent programs serving adolescents and young adults aged 13 through 24 with chronic illness. References were screened iteratively with increasing depth until a focused cohort was obtained and reviewed in full. The authors separately reviewed the studies using structured analysis forms. Relevant study details were abstracted during the review process. Fifteen studies describing 14 programs were included in the analysis. Three comprehensive programs included all 3 core components of a PYD program, including opportunities for youth leadership, skill building, and sustained connections between youth and adults. Four programs were primarily mentoring programs, and 7 others focused on youth leadership. Programs served youth with a variety of chronic illnesses. The quality and type of evaluation varied considerably, with most reporting psychosocial outcomes but only a few including medical outcomes. The PYD-consistent programs identified in this review can serve as models for the development of youth development programs for adolescents with chronic illness. Additional study is needed to evaluate such programs rigorously with respect to both psychosocial and health-related outcomes. PYD-consistent programs have the potential to reach youth with chronic illness and promote positive adult outcomes broadly.

A systematic review of health economic evaluations of vaccines in Brazil.

PubMed

Sartori, Ana Marli Christovam; Rozman, Luciana Martins; Decimoni, Tassia Cristina; Leandro, Roseli; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2017-06-03

In Brazil, since 2005, the Ministry of Health requires Health Economic Evaluation (HEE) of vaccines for introduction into the National Immunization Program. To describe and analyze the full HEE on vaccines conducted in Brazil from 1980 to 2013. Systematic review of the literature. We searched multiple databases. Two researchers independently selected the studies and extracted the data. The methodological quality of individual studies was evaluated using CHEERS items. Twenty studies were reviewed. The most evaluated vaccines were pneumococcal (25%) and HPV (15%). The most used types of HEE were cost-effectiveness analysis (45%) and cost-utility analysis (20%). The research question and compared strategies were stated in all 20 studies and the target population was clear in 95%. Nevertheless, many studies did not inform the perspective of analysis or data sources. HEE of vaccines in Brazil has increased since 2008. However, the studies still have methodological deficiencies.

The human placental perfusion model: a systematic review and development of a model to predict in vivo transfer of therapeutic drugs.

PubMed

Hutson, J R; Garcia-Bournissen, F; Davis, A; Koren, G

2011-07-01

Dual perfusion of a single placental lobule is the only experimental model to study human placental transfer of substances in organized placental tissue. To date, there has not been any attempt at a systematic evaluation of this model. The aim of this study was to systematically evaluate the perfusion model in predicting placental drug transfer and to develop a pharmacokinetic model to account for nonplacental pharmacokinetic parameters in the perfusion results. In general, the fetal-to-maternal drug concentration ratios matched well between placental perfusion experiments and in vivo samples taken at the time of delivery of the infant. After modeling for differences in maternal and fetal/neonatal protein binding and blood pH, the perfusion results were able to accurately predict in vivo transfer at steady state (R² = 0.85, P < 0.0001). Placental perfusion experiments can be used to predict placental drug transfer when adjusting for extra parameters and can be useful for assessing drug therapy risks and benefits in pregnancy.

Scientific Evaluation and Review of Claims in Health Care (SEaRCH): A Streamlined, Systematic, Phased Approach for Determining "What Works" in Healthcare.

PubMed

Jonas, Wayne B; Crawford, Cindy; Hilton, Lara; Elfenbaum, Pamela

2017-01-01

Answering the question of "what works" in healthcare can be complex and requires the careful design and sequential application of systematic methodologies. Over the last decade, the Samueli Institute has, along with multiple partners, developed a streamlined, systematic, phased approach to this process called the Scientific Evaluation and Review of Claims in Health Care (SEaRCH™). The SEaRCH process provides an approach for rigorously, efficiently, and transparently making evidence-based decisions about healthcare claims in research and practice with minimal bias. SEaRCH uses three methods combined in a coordinated fashion to help determine what works in healthcare. The first, the Claims Assessment Profile (CAP), seeks to clarify the healthcare claim and question, and its ability to be evaluated in the context of its delivery. The second method, the Rapid Evidence Assessment of the Literature (REAL © ), is a streamlined, systematic review process conducted to determine the quantity, quality, and strength of evidence and risk/benefit for the treatment. The third method involves the structured use of expert panels (EPs). There are several types of EPs, depending on the purpose and need. Together, these three methods-CAP, REAL, and EP-can be integrated into a strategic approach to help answer the question "what works in healthcare?" and what it means in a comprehensive way. SEaRCH is a systematic, rigorous approach for evaluating healthcare claims of therapies, practices, programs, or products in an efficient and stepwise fashion. It provides an iterative, protocol-driven process that is customized to the intervention, consumer, and context. Multiple communities, including those involved in health service and policy, can benefit from this organized framework, assuring that evidence-based principles determine which healthcare practices with the greatest promise are used for improving the public's health and wellness.

Independent Evaluation of Middle School-Based Drug Prevention Curricula: A Systematic Review.

PubMed

Flynn, Anna B; Falco, Mathea; Hocini, Sophia

2015-11-01

Lack of robust program evaluation has hindered the effectiveness of school-based drug abuse prevention curricula overall. Independently evaluated randomized controlled trials (RCTs) of universal, middle school-based drug abuse prevention curricula are the most useful indicators of whether such programs are effective or ineffective. To conduct a systematic review identifying independently evaluated RCTs of universal, middle school-based drug abuse prevention curricula; extract data on study quality and substance use outcomes; and assess evidence of program effectiveness. PsycInfo, Educational Resources Information Center, Science Citation Index, Social Science Citation Index, Cumulative Index to Nursing and Allied Health Literature, MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews were searched between January 1, 1984, and March 15, 2015. Search terms included variations of drug, alcohol, tobacco, and marijuana use, as well as school, prevention, and effectiveness. Studies included in the review were RCTs carried out by independent evaluators of universal school-based drug prevention curricula available for dissemination in the United States that reported alcohol, tobacco, marijuana, or other drug use outcomes. Two researchers extracted data on study quality and outcomes independently using a data extraction form and met to resolve disagreements. A total of 5071 publications were reviewed, with 13 articles meeting final inclusion criteria. Of the 13 articles, 6 RCTs of 4 distinct school-based curricula were identified for inclusion. Outcomes were reported for 42 single-drug measures in the independent RCTs, with just 3 presenting statistically significant (P < .05) differences between the intervention group and the control group. One program revealed statistically significant positive effects at final follow-up (Lions-Quest Skills for Adolescence). The results of our review demonstrate the dearth of independent research that appropriately

Maternal pre-pregnancy obesity and childhood physical and cognitive development of children: a systematic review.

PubMed

Adane, A A; Mishra, G D; Tooth, L R

2016-11-01

Maternal obesity, usually associated with the adverse birth outcomes, has been a serious public health concern. Studies examining its effect on the physical and cognitive development of children have only recently emerged and the findings are inconsistent. This review aimed to systematically examine the role of maternal obesity on children's physical and cognitive development using the available evidence. The CINAHL, EMBASE, PSYCINFO, PUBMED and SCOPUS databases were searched. Studies addressing children's (⩽12 years) physical and cognitive development as outcome and maternal pre-pregnancy body mass index as an exposure were included. Data were extracted and evaluated for quality by two independent reviewers. A total of 17 articles were eligible for this systematic review; 10 of them were birth cohorts from the USA. Nine of the 14 studies supported an adverse association between maternal pre-pregnancy obesity and childhood cognitive development. A few studies also demonstrated a negative association between the maternal obesity and gross motor function in children (5 of 10), but not with fine motor function (none out of five studies). Whether the observed negative association between the maternal obesity and children's cognitive and gross motor abilities is casual or due to residual confounding effects is unclear. The current evidence is based on a limited number of studies with heterogeneous measurement scales and obesity definition. From the available evidence, it seems that exposure to maternal pre-pregnancy obesity in the intrauterine environment has a detrimental effect on children's cognitive development. However, evidence of the association between the maternal obesity and physical development of children is too scarce to offer a conclusion. More research work is required to delineate the intrauterine effect of the maternal obesity from the residual confounding effects.

Systematic Development of Intelligent Systems for Public Road Transport.

PubMed

García, Carmelo R; Quesada-Arencibia, Alexis; Cristóbal, Teresa; Padrón, Gabino; Alayón, Francisco

2016-07-16

This paper presents an architecture model for the development of intelligent systems for public passenger transport by road. The main objective of our proposal is to provide a framework for the systematic development and deployment of telematics systems to improve various aspects of this type of transport, such as efficiency, accessibility and safety. The architecture model presented herein is based on international standards on intelligent transport system architectures, ubiquitous computing and service-oriented architecture for distributed systems. To illustrate the utility of the model, we also present a use case of a monitoring system for stops on a public passenger road transport network.

Systematic monitoring and evaluation of M7 scanner performance and data quality

NASA Technical Reports Server (NTRS)

Stewart, S.; Christenson, D.; Larsen, L.

1974-01-01

An investigation was conducted to provide the information required to maintain data quality of the Michigan M7 Multispectral scanner by systematic checks on specific system performance characteristics. Data processing techniques which use calibration data gathered routinely every mission have been developed to assess current data quality. Significant changes from past data quality are thus identified and attempts made to discover their causes. Procedures for systematic monitoring of scanner data quality are discussed. In the solar reflective region, calculations of Noise Equivalent Change in Radiance on a permission basis are compared to theoretical tape-recorder limits to provide an estimate of overall scanner performance. M7 signal/noise characteristics are examined.

Can economic evaluation in telemedicine be trusted? A systematic review of the literature

PubMed Central

Bergmo, Trine S

2009-01-01

Background Telemedicine has been advocated as an effective means to provide health care services over a distance. Systematic information on costs and consequences has been called for to support decision-making in this field. This paper provides a review of the quality, validity and generalisability of economic evaluations in telemedicine. Methods A systematic literature search in all relevant databases was conducted and forms the basis for addressing these issues. Only articles published in peer-reviewed journals and written in English in the period from 1990 to 2007 were analysed. The literature search identified 33 economic evaluations where both costs (resource use) and outcomes (non-resource consequences) were measured. Results This review shows that economic evaluations in telemedicine are highly diverse in terms of both the study context and the methods applied. The articles covered several medical specialities ranging from cardiology and dermatology to psychiatry. The studies analysed telemedicine in home care, and in primary and secondary care settings using a variety of different technologies including videoconferencing, still-images and monitoring (store-and-forward telemedicine). Most studies used multiple outcome measures and analysed the effects using disaggregated cost-consequence frameworks. Objectives, study design, and choice of comparators were mostly well reported. The majority of the studies lacked information on perspective and costing method, few used general statistics and sensitivity analysis to assess validity, and even fewer used marginal analysis. Conclusion As this paper demonstrates, the majority of the economic evaluations reviewed were not in accordance with standard evaluation techniques. Further research is needed to explore the reasons for this and to address how economic evaluation in telemedicine best can take advantage of local constraints and at the same time produce valid and generalisable results. PMID:19852828

The design, implementation, and evaluation of online credit nutrition courses: a systematic review.

PubMed

Cohen, Nancy L; Carbone, Elena T; Beffa-Negrini, Patricia A

2011-01-01

To assess how postsecondary online nutrition education courses (ONEC) are delivered, determine ONEC effectiveness, identify theoretical models used, and identify future research needs. Systematic search of database literature. Postsecondary education. Nine research articles evaluating postsecondary ONEC. Knowledge/performance outcomes and student satisfaction, motivation, or perceptions. Systematic search of 922 articles and review of 9 articles meeting search criteria. Little research regarding ONEC marketing/management existed. Studies primarily evaluated introductory courses using email/websites (before 2000), or course management systems (after 2002). None used true experimental designs; just 3 addressed validity or reliability of measures or pilot-tested instruments. Three articles used theoretical models in course design; few used theories to guide evaluations. Four quasi-experimental studies indicated no differences in nutrition knowledge/performance between online and face-to-face learners. Results were inconclusive regarding student satisfaction, motivation, or perceptions. Students can gain knowledge in online as well as in face-to-face nutrition courses, but satisfaction was mixed. More up-to-date investigations on effective practices are warranted, using theories to identify factors that enhance student outcomes, addressing emerging technologies, and documenting ONEC marketing, management, and delivery. Adequate training/support for faculty is needed to improve student experiences and faculty time management. Copyright © 2011 Society for Nutrition Education. Published by Elsevier Inc. All rights reserved.

Prototypical Content Development and Evaluation of the Cognitive English Vocabulary-Learning Program for Korean University Students

ERIC Educational Resources Information Center

Kim, Inseok

2014-01-01

Many EFL learners seem to believe that they can come to grips with the problem of vocabulary learning with a 'hit-or-miss' approach. However, a growing number of recent research reports indicate that they need to learn a repertoire of vocabulary in a systematic way for effective communication. This paper explores the development and evaluation of…

Systematic Correlation Matrix Evaluation (SCoMaE) - a bottom-up, science-led approach to identifying indicators

NASA Astrophysics Data System (ADS)

Mengis, Nadine; Keller, David P.; Oschlies, Andreas

2018-01-01

This study introduces the Systematic Correlation Matrix Evaluation (SCoMaE) method, a bottom-up approach which combines expert judgment and statistical information to systematically select transparent, nonredundant indicators for a comprehensive assessment of the state of the Earth system. The methods consists of two basic steps: (1) the calculation of a correlation matrix among variables relevant for a given research question and (2) the systematic evaluation of the matrix, to identify clusters of variables with similar behavior and respective mutually independent indicators. Optional further analysis steps include (3) the interpretation of the identified clusters, enabling a learning effect from the selection of indicators, (4) testing the robustness of identified clusters with respect to changes in forcing or boundary conditions, (5) enabling a comparative assessment of varying scenarios by constructing and evaluating a common correlation matrix, and (6) the inclusion of expert judgment, for example, to prescribe indicators, to allow for considerations other than statistical consistency. The example application of the SCoMaE method to Earth system model output forced by different CO2 emission scenarios reveals the necessity of reevaluating indicators identified in a historical scenario simulation for an accurate assessment of an intermediate-high, as well as a business-as-usual, climate change scenario simulation. This necessity arises from changes in prevailing correlations in the Earth system under varying climate forcing. For a comparative assessment of the three climate change scenarios, we construct and evaluate a common correlation matrix, in which we identify robust correlations between variables across the three considered scenarios.

A systematic review of economic evaluation in pancreatic ductal adenocarcinoma.

PubMed

Gérard, Claire; Fagnoni, Philippe; Vienot, Angélique; Borg, Christophe; Limat, Samuel; Daval, Franck; Calais, François; Vardanega, Julie; Jary, Marine; Nerich, Virginie

2017-11-01

The economic evaluation (EE) of healthcare interventions has become a necessity. However, high quality needs to be ensured in order to achieve validated results and help making informed decisions. Thus, the objective of the present study was to systematically identify and review published pancreatic ductal adenocarcinoma-related EEs and to assess their quality. Systematic literature research was conducted in PubMed and Cochrane to identify published EEs between 2000 and 2015. The quality of each selected EE was assessed by two independent reviewers, using the Drummond's checklist. Our systematic review was based on 32 EEs and showed a wide variety of methodological approaches, including different perspectives, time horizon, and cost effectiveness analyses. Nearly two-thirds of EEs are full EEs (n = 21), and about one-third of EEs had a Drummond score ≥7, synonymous with 'high quality'. Close to 50% of full EEs had a Drummond score ≥7, whereas all of partial EEs had a Drummond score <7 (n = 11). Over the past 15 years, a lot of interest has been evinced over the EE of pancreatic ductal adenocarcinoma (PDAC) and its direct impact on therapeutic advances in PDAC. To provide a framework for health care decision-making, to facilitate transferability and to lend credibility to health EEs, their quality must be improved. For the last 4 years, a tendency towards a quality improvement of these studies has been observed, probably coupled with a context of rational decision-making in health care, a better and wider spread of recommendations and thus, medical practitioners' full endorsement. Copyright © 2017 Elsevier Ltd. All rights reserved.

Quality of systematic reviews in pediatric oncology--a systematic review.

PubMed

Lundh, Andreas; Knijnenburg, Sebastiaan L; Jørgensen, Anders W; van Dalen, Elvira C; Kremer, Leontien C M

2009-12-01

To ensure evidence-based decision making in pediatric oncology systematic reviews are necessary. The objective of our study was to evaluate the methodological quality of all currently existing systematic reviews in pediatric oncology. We identified eligible systematic reviews through a systematic search of the literature. Data on clinical and methodological characteristics of the included systematic reviews were extracted. The methodological quality of the included systematic reviews was assessed using the overview quality assessment questionnaire, a validated 10-item quality assessment tool. We compared the methodological quality of systematic reviews published in regular journals with that of Cochrane systematic reviews. We included 117 systematic reviews, 99 systematic reviews published in regular journals and 18 Cochrane systematic reviews. The average methodological quality of systematic reviews was low for all ten items, but the quality of Cochrane systematic reviews was significantly higher than systematic reviews published in regular journals. On a 1-7 scale, the median overall quality score for all systematic reviews was 2 (range 1-7), with a score of 1 (range 1-7) for systematic reviews in regular journals compared to 6 (range 3-7) in Cochrane systematic reviews (p<0.001). Most systematic reviews in the field of pediatric oncology seem to have serious methodological flaws leading to a high risk of bias. While Cochrane systematic reviews were of higher methodological quality than systematic reviews in regular journals, some of them also had methodological problems. Therefore, the methodology of each individual systematic review should be scrutinized before accepting its results.

Patient-reported outcome measures in dysphagia: a systematic review of instrument development and validation.

PubMed

Patel, D A; Sharda, R; Hovis, K L; Nichols, E E; Sathe, N; Penson, D F; Feurer, I D; McPheeters, M L; Vaezi, M F; Francis, David O

2017-05-01

Patient-reported outcome (PRO) measures are commonly used to capture patient experience with dysphagia and to evaluate treatment effectiveness. Inappropriate application can lead to distorted results in clinical studies. A systematic review of the literature on dysphagia-related PRO measures was performed to (1) identify all currently available measures and (2) to evaluate each for the presence of important measurement properties that would affect their applicability. MEDLINE via the PubMed interface, the Cumulative Index of Nursing and Allied Health Literature, and the Health and Psychosocial Instrument database were searched using relevant vocabulary terms and key terms related to PRO measures and dysphagia. Three independent investigators performed abstract and full text reviews. Each study meeting criteria was evaluated using an 18-item checklist developed a priori that assessed multiple domains: (1) conceptual model, (2) content validity, (3) reliability, (4) construct validity, (6) scoring and interpretation, and (7) burden and presentation. Of 4950 abstracts reviewed, a total of 34 dysphagia-related PRO measures (publication year 1987-2014) met criteria for extraction and analysis. Several PRO measures were of high quality (MADS for achalasia, SWAL-QOL and SSQ for oropharyngeal dysphagia, PROMIS-GI for general dysphagia, EORTC-QLQ-OG25 for esophageal cancer, ROMP-swallowing for Parkinson's Disease, DSQ-EoE for eosinophilic esophagitis, and SOAL for total laryngectomy-related dysphagia). In all, 17 met at least one criterion per domain. Thematic deficiencies in current measures were evident including: (1) direct patient involvement in content development, (2) empirically justified dimensionality, (3) demonstrable responsiveness to change, (4) plan for interpreting missing responses, and (5) literacy level assessment. This is the first comprehensive systematic review assessing developmental properties of all available dysphagia-related PRO measures. We

Systematic review of publications on economic evaluations of caries prevention programs.

PubMed

Mariño, R J; Khan, A R; Morgan, M

2013-01-01

The aim of this study was to perform a systematic review of economic evaluations (EEs) of dental caries prevention programs to objectively retrieve, synthesize and describe available information on the field. Several strategies were combined to search for literature published between January 1975 and April 2012. MEDLINE, EconoLit and ISI formed the basis of the literature search. The study selection was done using predefined inclusion and exclusion criteria. Bibliographic listings of all retrieved articles were hand-searched. The search identified 206 references. An evaluative framework was developed based on the Centre for Reviews and Dissemination's 'Guidance for undertaking reviews in health care' (York University, 2009). Background information included publication vehicle, year of publication, geographic focus, type of preventive program and type of economic analysis. 63 studies were included in the review. The most common preventive strategies evaluated were dental sealants (n = 13), water fluoridation (n = 12) and mixed interventions (n = 12). By type of EE undertaken, 30 were cost-effectiveness analyses, 22 were cost-benefit analyses, and 5 presented both cost-effectiveness and cost-benefit analyses. Few studies were cost-utility analyses (n = 5) or cost minimization analyses (n = 2). By year of publication, most were published after 2003. The review revealed that, although the number of publications reporting EEs has increased significantly in recent years, the quality of the reporting needs to be improved. The main methodological problems identified in the review were the limited information provided on adjustments for discounting in addition to inadequate sensitivity analyses. Attention also needs to be given to the analysis and interpretation of the results of the EEs. Copyright © 2013 S. Karger AG, Basel.

5 CFR 412.202 - Systematic training and development of supervisors, managers, and executives.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 5 Administrative Personnel 1 2010-01-01 2010-01-01 false Systematic training and development of supervisors, managers, and executives. 412.202 Section 412.202 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS SUPERVISORY, MANAGEMENT, AND EXECUTIVE DEVELOPMENT Succession Planning...

Evaluation of Health Economics in Radiation Oncology: A Systematic Review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nguyen, Timothy K.; Goodman, Chris D.; Boldt, R. Gabriel

Purpose: Despite the rising costs in radiation oncology, the impact of health economics research on radiation therapy practice analysis patterns is unclear. We performed a systematic review of cost-effectiveness analyses (CEAs) and cost-utility analyses (CUAs) to identify trends in reporting quality in the radiation oncology literature over time. Methods and Materials: A systematic review of radiation oncology economic evaluations up to 2014 was performed, using MEDLINE and EMBASE databases. The Consolidated Health Economic Evaluation Reporting Standards guideline informed data abstraction variables including study demographics, economic parameters, and methodological details. Tufts Medical Center CEA registry quality scores provided a basis formore » qualitative assessment of included studies. Studies were stratified by 3 time periods (1995-2004, 2005-2009, and 2010-2014). The Cochran-Armitage trend test and linear trend test were used to identify trends over time. Results: In total, 102 articles were selected for final review. Most studies were in the context of a model (61%) or clinical trial (28%). Many studies lacked a conflict of interest (COI) statement (67%), a sponsorship statement (48%), a reported study time horizon (35%), and the use of discounting (29%). There was a significant increase over time in the reporting of a COI statement (P<.001), health care payer perspective (P=.019), sensitivity analyses using multivariate (P=.043) or probabilistic methods (P=.011), incremental cost-effectiveness threshold (P<.001), secondary source utility weights (P=.010), and cost effectiveness acceptability curves (P=.049). There was a trend toward improvement in Tuft scores over time (P=.065). Conclusions: Recent reports demonstrate improved reporting rates in economic evaluations; however, there remains significant room for improvement as reporting rates are still suboptimal. As fiscal pressures rise, we will rely on economic assessments to guide our practice

Evaluation of Health Economics in Radiation Oncology: A Systematic Review.

PubMed

Nguyen, Timothy K; Goodman, Chris D; Boldt, R Gabriel; Warner, Andrew; Palma, David A; Rodrigues, George B; Lock, Michael I; Mishra, Mark V; Zaric, Gregory S; Louie, Alexander V

2016-04-01

Despite the rising costs in radiation oncology, the impact of health economics research on radiation therapy practice analysis patterns is unclear. We performed a systematic review of cost-effectiveness analyses (CEAs) and cost-utility analyses (CUAs) to identify trends in reporting quality in the radiation oncology literature over time. A systematic review of radiation oncology economic evaluations up to 2014 was performed, using MEDLINE and EMBASE databases. The Consolidated Health Economic Evaluation Reporting Standards guideline informed data abstraction variables including study demographics, economic parameters, and methodological details. Tufts Medical Center CEA registry quality scores provided a basis for qualitative assessment of included studies. Studies were stratified by 3 time periods (1995-2004, 2005-2009, and 2010-2014). The Cochran-Armitage trend test and linear trend test were used to identify trends over time. In total, 102 articles were selected for final review. Most studies were in the context of a model (61%) or clinical trial (28%). Many studies lacked a conflict of interest (COI) statement (67%), a sponsorship statement (48%), a reported study time horizon (35%), and the use of discounting (29%). There was a significant increase over time in the reporting of a COI statement (P<.001), health care payer perspective (P=.019), sensitivity analyses using multivariate (P=.043) or probabilistic methods (P=.011), incremental cost-effectiveness threshold (P<.001), secondary source utility weights (P=.010), and cost effectiveness acceptability curves (P=.049). There was a trend toward improvement in Tuft scores over time (P=.065). Recent reports demonstrate improved reporting rates in economic evaluations; however, there remains significant room for improvement as reporting rates are still suboptimal. As fiscal pressures rise, we will rely on economic assessments to guide our practice decisions and policies. We recommend improved adherence to

Systematic evaluation of a 171Yb optical clock by synchronous comparison between two lattice systems.

PubMed

Gao, Qi; Zhou, Min; Han, Chengyin; Li, Shangyan; Zhang, Shuang; Yao, Yuan; Li, Bo; Qiao, Hao; Ai, Di; Lou, Ge; Zhang, Mengya; Jiang, Yanyi; Bi, Zhiyi; Ma, Longsheng; Xu, Xinye

2018-05-22

Optical clocks are the most precise measurement devices. Here we experimentally characterize one such clock based on the 1 S 0 - 3 P 0 transition of neutral 171 Yb atoms confined in an optical lattice. Given that the systematic evaluation using an interleaved stabilization scheme is unable to avoid noise from the clock laser, synchronous comparisons against a second 171 Yb lattice system were implemented to accelerate the evaluation. The fractional instability of one clock falls below 4 × 10 -17 after an averaging over a time of 5,000 seconds. The systematic frequency shifts were corrected with a total uncertainty of 1.7 × 10 -16 . The lattice polarizability shift currently contributes the largest source. This work paves the way to measuring the absolute clock transition frequency relative to the primary Cs standard or against the International System of Units (SI) second.

Evaluation and impact of cardiotocography training programmes: a systematic review.

PubMed

Pehrson, C; Sorensen, J L; Amer-Wåhlin, I

2011-07-01

The interpretation and management of cardiotocography (CTG) tracings are often criticised in obstetric malpractice cases. As a consequence, regular CTG training has been recommended, even though little is known about the effect of CTG training. To perform a systematic review of the existing literature on studies on CTG training in order to assess educational strategies, evaluation of training programmes, and impact of training programmes. The Medline database was searched to identify studies describing and/or evaluating CTG training programmes. The literature search resulted in 409 citations. Twenty studies describing and evaluating CTG training programmes were included. There was no restriction on study design. Data regarding study design, study quality, educational strategies used for training in CTG interpretation and decision making, target groups, number of participants, methods used for evaluation, quality of evaluation, level of evaluation and results of training was extracted from 20 articles, and analysed using Kirkpatrick's four-level model for the evaluation of education. Training was associated with improvements on all Kirkpatrick levels, resulting in increased CTG knowledge and interpretive skills, higher interobserver agreement, better management of intrapartum CTG, and improved quality of care. Computer-based training (CBT) might be less time-consuming than classroom teaching. Clinical skills seem to decrease faster than theoretical knowledge. Training can improve CTG competence and clinical practise. Further research on CBT, test-enhanced learning and long-term retention, evaluation of training and impact on clinical outcomes is recommended. © 2011 The Authors BJOG An International Journal of Obstetrics and Gynaecology © 2011 RCOG.

Voice-Related Patient-Reported Outcome Measures: A Systematic Review of Instrument Development and Validation

PubMed Central

Daniero, James J.; Hovis, Kristen L.; Sathe, Nila; Jacobson, Barbara; Penson, David F.; Feurer, Irene D.; McPheeters, Melissa L.

2017-01-01

Purpose The purpose of this study was to perform a comprehensive systematic review of the literature on voice-related patient-reported outcome (PRO) measures in adults and to evaluate each instrument for the presence of important measurement properties. Method MEDLINE, the Cumulative Index of Nursing and Allied Health Literature, and the Health and Psychosocial Instrument databases were searched using relevant vocabulary terms and key terms related to PRO measures and voice. Inclusion and exclusion criteria were developed in consultation with an expert panel. Three independent investigators assessed study methodology using criteria developed a priori. Measurement properties were examined and entered into evidence tables. Results A total of 3,744 studies assessing voice-related constructs were identified. This list was narrowed to 32 PRO measures on the basis of predetermined inclusion and exclusion criteria. Questionnaire measurement properties varied widely. Important thematic deficiencies were apparent: (a) lack of patient involvement in the item development process, (b) lack of robust construct validity, and (c) lack of clear interpretability and scaling. Conclusions PRO measures are a principal means of evaluating treatment effectiveness in voice-related conditions. Despite their prominence, available PRO measures have disparate methodological rigor. Care must be taken to understand the psychometric and measurement properties and the applicability of PRO measures before advocating for their use in clinical or research applications. PMID:28030869

Photogrammetry as a tool for the postural evaluation of the spine: A systematic review.

PubMed

Furlanetto, Tássia Silveira; Sedrez, Juliana Adami; Candotti, Cláudia Tarragô; Loss, Jefferson Fagundes

2016-02-18

To evaluate the use of photogrammetry and identify the mathematical procedures applied when evaluating spinal posture. A systematic search using keywords was conducted in the PubMed, EMBASE, Scopus, Science and Medicine(®) databases. The following inclusion criteria adopted were: (1) the use of photogrammetry as a method to evaluate spinal posture; (2) evaluations of spinal curvature in the sagittal and/or frontal plane; (3) studies published within the last three decades; and (4) written entirely in English. The exclusion criteria were: (1) studies which objective involved the verification of some aspect of validation of instruments; (2) studies published as abstracts and those published in scientific events; and (3) studies using evaluation of the anteriorization of the head to determine the angular positioning of the cervical spine. The articles in this review were included and evaluated for their methodological quality, based on the Downs and Black scale, by two independent reviewers. Initially, 1758 articles were found, 76 of which were included upon reading the full texts and 29 were included in accordance with the predetermined criteria. In addition, after analyzing the references in those articles, a further six articles were selected, so that 35 articles were included in this review. This systematic review revealed that the photogrammetry has been using in observational studies. Furthermore, it was also found that, although the data collection methodologies are similar across the studies, in relation to aspects of data analysis, the methodologies are very different, especially regarding the mathematical routines employed to support different postural evaluation software. With photogrammetry, the aim of the assessment, whether it is for clinical, research or collective health purposes, must be considered when choosing which protocol to use to evaluate spinal posture.

Photogrammetry as a tool for the postural evaluation of the spine: A systematic review

PubMed Central

Furlanetto, Tássia Silveira; Sedrez, Juliana Adami; Candotti, Cláudia Tarragô; Loss, Jefferson Fagundes

2016-01-01

AIM: To evaluate the use of photogrammetry and identify the mathematical procedures applied when evaluating spinal posture. METHODS: A systematic search using keywords was conducted in the PubMed, EMBASE, Scopus, Science and Medicine® databases. The following inclusion criteria adopted were: (1) the use of photogrammetry as a method to evaluate spinal posture; (2) evaluations of spinal curvature in the sagittal and/or frontal plane; (3) studies published within the last three decades; and (4) written entirely in English. The exclusion criteria were: (1) studies which objective involved the verification of some aspect of validation of instruments; (2) studies published as abstracts and those published in scientific events; and (3) studies using evaluation of the anteriorization of the head to determine the angular positioning of the cervical spine. The articles in this review were included and evaluated for their methodological quality, based on the Downs and Black scale, by two independent reviewers. RESULTS: Initially, 1758 articles were found, 76 of which were included upon reading the full texts and 29 were included in accordance with the predetermined criteria. In addition, after analyzing the references in those articles, a further six articles were selected, so that 35 articles were included in this review. This systematic review revealed that the photogrammetry has been using in observational studies. Furthermore, it was also found that, although the data collection methodologies are similar across the studies, in relation to aspects of data analysis, the methodologies are very different, especially regarding the mathematical routines employed to support different postural evaluation software. CONCLUSION: With photogrammetry, the aim of the assessment, whether it is for clinical, research or collective health purposes, must be considered when choosing which protocol to use to evaluate spinal posture. PMID:26925386

A systematic review of health economic evaluations of vaccines in Brazil

PubMed Central

2017-01-01

ABSTRACT Background: In Brazil, since 2005, the Ministry of Health requires Health Economic Evaluation (HEE) of vaccines for introduction into the National Immunization Program. Objectives: To describe and analyze the full HEE on vaccines conducted in Brazil from 1980 to 2013. Methods: Systematic review of the literature. We searched multiple databases. Two researchers independently selected the studies and extracted the data. The methodological quality of individual studies was evaluated using CHEERS items. Results: Twenty studies were reviewed. The most evaluated vaccines were pneumococcal (25%) and HPV (15%). The most used types of HEE were cost-effectiveness analysis (45%) and cost-utility analysis (20%). The research question and compared strategies were stated in all 20 studies and the target population was clear in 95%. Nevertheless, many studies did not inform the perspective of analysis or data sources. Conclusions: HEE of vaccines in Brazil has increased since 2008. However, the studies still have methodological deficiencies. PMID:28129026

Economic Evaluation of Interventions for Prevention of Hospital Acquired Infections: A Systematic Review.

PubMed

Arefian, Habibollah; Vogel, Monique; Kwetkat, Anja; Hartmann, Michael

2016-01-01

This systematic review sought to assess the costs and benefits of interventions preventing hospital-acquired infections and to evaluate methodological and reporting quality. We systematically searched Medline via PubMed and the National Health Service Economic Evaluation Database from 2009 to 2014. We included quasi-experimental and randomized trails published in English or German evaluating the economic impact of interventions preventing the four most frequent hospital-acquired infections (urinary tract infections, surgical wound infections, pneumonia, and primary bloodstream infections). Characteristics and results of the included articles were extracted using a standardized data collection form. Study and reporting quality were evaluated using SIGN and CHEERS checklists. All costs were adjusted to 2013 US$. Savings-to-cost ratios and difference values with interquartile ranges (IQRs) per month were calculated, and the effects of study characteristics on the cost-benefit results were analyzed. Our search returned 2067 articles, of which 27 met the inclusion criteria. The median savings-to-cost ratio across all studies reporting both costs and savings values was US $7.0 (IQR 4.2-30.9), and the median net global saving was US $13,179 (IQR 5,106-65,850) per month. The studies' reporting quality was low. Only 14 articles reported more than half of CHEERS items appropriately. Similarly, an assessment of methodological quality found that only four studies (14.8%) were considered high quality. Prevention programs for hospital acquired infections have very positive cost-benefit ratios. Improved reporting quality in health economics publications is required.

Economic Evaluation of Interventions for Prevention of Hospital Acquired Infections: A Systematic Review

PubMed Central

Kwetkat, Anja

2016-01-01

Objective This systematic review sought to assess the costs and benefits of interventions preventing hospital-acquired infections and to evaluate methodological and reporting quality. Methods We systematically searched Medline via PubMed and the National Health Service Economic Evaluation Database from 2009 to 2014. We included quasi-experimental and randomized trails published in English or German evaluating the economic impact of interventions preventing the four most frequent hospital-acquired infections (urinary tract infections, surgical wound infections, pneumonia, and primary bloodstream infections). Characteristics and results of the included articles were extracted using a standardized data collection form. Study and reporting quality were evaluated using SIGN and CHEERS checklists. All costs were adjusted to 2013 US$. Savings-to-cost ratios and difference values with interquartile ranges (IQRs) per month were calculated, and the effects of study characteristics on the cost-benefit results were analyzed. Results Our search returned 2067 articles, of which 27 met the inclusion criteria. The median savings-to-cost ratio across all studies reporting both costs and savings values was US $7.0 (IQR 4.2–30.9), and the median net global saving was US $13,179 (IQR 5,106–65,850) per month. The studies’ reporting quality was low. Only 14 articles reported more than half of CHEERS items appropriately. Similarly, an assessment of methodological quality found that only four studies (14.8%) were considered high quality. Conclusions Prevention programs for hospital acquired infections have very positive cost-benefit ratios. Improved reporting quality in health economics publications is required. PMID:26731736

Economic evaluation and cost of interventions for cerebral palsy: a systematic review.

PubMed

Shih, Sophy T F; Tonmukayakul, Utsana; Imms, Christine; Reddihough, Dinah; Graham, H Kerr; Cox, Liz; Carter, Rob

2018-06-01

Economic appraisal can help guide policy-making for purchasing decisions, and treatment and management algorithms for health interventions. We conducted a systematic review of economic studies in cerebral palsy (CP) to inform future research. Economic studies published since 1970 were identified from seven databases. Two reviewers independently screened abstracts and extracted data following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Any discrepancies were resolved by discussion. Of 980 identified references, 115 were included for full-text assessment. Thirteen articles met standard criteria for a full economic evaluation, two as partial economic evaluations, and 18 as cost studies. Six were full economic evaluations alongside clinical studies or randomized controlled trials, whereas seven involved modelling simulations. The economic case for administration of magnesium sulfate for imminent preterm birth is compelling, achieving both health gain and cost savings. Current literature suggests intrathecal baclofen therapy and botulinum toxin injection are cost-effective, but stronger evidence for long-term effects is needed. Lifestyle and web-based interventions are inexpensive, but broader measurement of outcomes is required. Prevention of CP would avoid significant economic burden. Some treatments and interventions have been shown to be cost-effective, although stronger evidence of clinical effectiveness is needed. What this paper adds Cost-effectiveness evidence shows prevention is the most significant strategy. Some treatments are cost-effective, but stronger evidence for long-term effectiveness is required. Comparison of treatment costs is challenging owing to variations in methodologies and varying clinical indications. © 2018 Mac Keith Press.

A systematic review evaluating the psychometric properties of measures of social inclusion.

PubMed

Cordier, Reinie; Milbourn, Ben; Martin, Robyn; Buchanan, Angus; Chung, Donna; Speyer, Renée

2017-01-01

Improving social inclusion opportunities for population health has been identified as a priority area for international policy. There is a need to comprehensively examine and evaluate the quality of psychometric properties of measures of social inclusion that are used to guide social policy and outcomes. To conduct a systematic review of the literature on all current measures of social inclusion for any population group, to evaluate the quality of the psychometric properties of identified measures, and to evaluate if they capture the construct of social inclusion. A systematic search was performed using five electronic databases: CINAHL, PsycINFO, Embase, ERIC and Pubmed and grey literature were sourced to identify measures of social inclusion. The psychometric properties of the social inclusion measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Of the 109 measures identified, twenty-five measures, involving twenty-five studies and one manual met the inclusion criteria. The overall quality of the reviewed measures was variable, with the Social and Community Opportunities Profile-Short, Social Connectedness Scale and the Social Inclusion Scale demonstrating the strongest evidence for sound psychometric quality. The most common domain included in the measures was connectedness (21), followed by participation (19); the domain of citizenship was covered by the least number of measures (10). No single instrument measured all aspects within the three domains of social inclusion. Of the measures with sound psychometric evidence, the Social and Community Opportunities Profile-Short captured the construct of social inclusion best. The overall quality of the psychometric properties demonstrate that the current suite of available instruments for the measurement of social inclusion are promising but need further refinement. There is a need for a universal working definition of social inclusion as an overarching

A systematic review of clinical supervision evaluation studies in nursing.

PubMed

Cutcliffe, John R; Sloan, Graham; Bashaw, Marie

2018-02-15

According to the international, extant literature published during the last 20 years or so, clinical supervision (CS) in nursing is now a reasonably common phenomenon. Nevertheless, what appears to be noticeably 'thin on the ground' in this body of literature are empirical evaluations of CS, especially those pertaining to client outcomes. Accordingly, the authors undertook a systematic review of empirical evaluations of CS in nursing to determine the state of the science. Adopting the approach documented by Stroup et al. (JAMA, 283, 2000, 2008), the authors searched for reports of evaluation studies of CS in nursing - published during the years 1995 to 2015. Keywords for the search were 'clinical supervision', 'evaluation', 'efficacy', 'nursing', and combinations of these keywords. Electronic databases used were CINAHL, MEDLINE, PsychLIT, and the British Nursing Index. The research evidence from twenty-eight (28) studies reviewed is presented, outlining the main findings with an overview of each study presented. The following broad themes were identified and are each discussed in the study: narrative/anecdotal accounts of positive outcomes for clinical supervision, narrative/anecdotal accounts of negative outcomes for clinical supervision, empirical positive outcomes reported by supervisee, and empirical findings showing no effect by supervisee. © 2018 Australian College of Mental Health Nurses Inc.

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR).

PubMed

Beller, Elaine; Clark, Justin; Tsafnat, Guy; Adams, Clive; Diehl, Heinz; Lund, Hans; Ouzzani, Mourad; Thayer, Kristina; Thomas, James; Turner, Tari; Xia, Jun; Robinson, Karen; Glasziou, Paul

2018-05-19

Systematic reviews (SR) are vital to health care, but have become complicated and time-consuming, due to the rapid expansion of evidence to be synthesised. Fortunately, many tasks of systematic reviews have the potential to be automated or may be assisted by automation. Recent advances in natural language processing, text mining and machine learning have produced new algorithms that can accurately mimic human endeavour in systematic review activity, faster and more cheaply. Automation tools need to be able to work together, to exchange data and results. Therefore, we initiated the International Collaboration for the Automation of Systematic Reviews (ICASR), to successfully put all the parts of automation of systematic review production together. The first meeting was held in Vienna in October 2015. We established a set of principles to enable tools to be developed and integrated into toolkits.This paper sets out the principles devised at that meeting, which cover the need for improvement in efficiency of SR tasks, automation across the spectrum of SR tasks, continuous improvement, adherence to high quality standards, flexibility of use and combining components, the need for a collaboration and varied skills, the desire for open source, shared code and evaluation, and a requirement for replicability through rigorous and open evaluation.Automation has a great potential to improve the speed of systematic reviews. Considerable work is already being done on many of the steps involved in a review. The 'Vienna Principles' set out in this paper aim to guide a more coordinated effort which will allow the integration of work by separate teams and build on the experience, code and evaluations done by the many teams working across the globe.

Evaluating investment in quality improvement capacity building: a systematic review.

PubMed

Mery, Gustavo; Dobrow, Mark J; Baker, G Ross; Im, Jennifer; Brown, Adalsteinn

2017-02-20

Leading health systems have invested in substantial quality improvement (QI) capacity building, but little is known about the aggregate effect of these investments at the health system level. We conducted a systematic review to identify key steps and elements that should be considered for system-level evaluations of investment in QI capacity building. We searched for evaluations of QI capacity building and evaluations of QI training programmes. We included the most relevant indexed databases in the field and a strategic search of the grey literature. The latter included direct electronic scanning of 85 relevant government and institutional websites internationally. Data were extracted regarding evaluation design and common assessment themes and components. 48 articles met the inclusion criteria. 46 articles described initiative-level non-economic evaluations of QI capacity building/training, while 2 studies included economic evaluations of QI capacity building/training, also at the initiative level. No system-level QI capacity building/training evaluations were found. We identified 17 evaluation components that fit within 5 overarching dimensions (characteristics of QI training; characteristics of QI activity; individual capacity; organisational capacity and impact) that should be considered in evaluations of QI capacity building. 8 key steps in return-on-investment (ROI) assessments in QI capacity building were identified: (1) planning-stakeholder perspective; (2) planning-temporal perspective; (3) identifying costs; (4) identifying benefits; (5) identifying intangible benefits that will not be included in the ROI estimation; (6) discerning attribution; (7) ROI calculations; (8) sensitivity analysis. The literature on QI capacity building evaluation is limited in the number and scope of studies. Our findings, summarised in a Framework to Guide Evaluations of QI Capacity Building , can be used to start closing this knowledge gap. Published by the BMJ Publishing

Evaluating investment in quality improvement capacity building: a systematic review

PubMed Central

Mery, Gustavo; Dobrow, Mark J; Baker, G Ross; Im, Jennifer; Brown, Adalsteinn

2017-01-01

Purpose Leading health systems have invested in substantial quality improvement (QI) capacity building, but little is known about the aggregate effect of these investments at the health system level. We conducted a systematic review to identify key steps and elements that should be considered for system-level evaluations of investment in QI capacity building. Methods We searched for evaluations of QI capacity building and evaluations of QI training programmes. We included the most relevant indexed databases in the field and a strategic search of the grey literature. The latter included direct electronic scanning of 85 relevant government and institutional websites internationally. Data were extracted regarding evaluation design and common assessment themes and components. Results 48 articles met the inclusion criteria. 46 articles described initiative-level non-economic evaluations of QI capacity building/training, while 2 studies included economic evaluations of QI capacity building/training, also at the initiative level. No system-level QI capacity building/training evaluations were found. We identified 17 evaluation components that fit within 5 overarching dimensions (characteristics of QI training; characteristics of QI activity; individual capacity; organisational capacity and impact) that should be considered in evaluations of QI capacity building. 8 key steps in return-on-investment (ROI) assessments in QI capacity building were identified: (1) planning—stakeholder perspective; (2) planning—temporal perspective; (3) identifying costs; (4) identifying benefits; (5) identifying intangible benefits that will not be included in the ROI estimation; (6) discerning attribution; (7) ROI calculations; (8) sensitivity analysis. Conclusions The literature on QI capacity building evaluation is limited in the number and scope of studies. Our findings, summarised in a Framework to Guide Evaluations of QI Capacity Building, can be used to start closing this knowledge

A systematic review of model-based economic evaluations of diagnostic and therapeutic strategies for lower extremity artery disease.

PubMed

Vaidya, Anil; Joore, Manuela A; ten Cate-Hoek, Arina J; Kleinegris, Marie-Claire; ten Cate, Hugo; Severens, Johan L

2014-01-01

Lower extremity artery disease (LEAD) is a sign of wide spread atherosclerosis also affecting coronary, cerebral and renal arteries and is associated with increased risk of cardiovascular events. Many economic evaluations have been published for LEAD due to its clinical, social and economic importance. The aim of this systematic review was to assess modelling methods used in published economic evaluations in the field of LEAD. Our review appraised and compared the general characteristics, model structure and methodological quality of published models. Electronic databases MEDLINE and EMBASE were searched until February 2013 via OVID interface. Cochrane database of systematic reviews, Health Technology Assessment database hosted by National Institute for Health research and National Health Services Economic Evaluation Database (NHSEED) were also searched. The methodological quality of the included studies was assessed by using the Philips' checklist. Sixteen model-based economic evaluations were identified and included. Eleven models compared therapeutic health technologies; three models compared diagnostic tests and two models compared a combination of diagnostic and therapeutic options for LEAD. Results of this systematic review revealed an acceptable to low methodological quality of the included studies. Methodological diversity and insufficient information posed a challenge for valid comparison of the included studies. In conclusion, there is a need for transparent, methodologically comparable and scientifically credible model-based economic evaluations in the field of LEAD. Future modelling studies should include clinically and economically important cardiovascular outcomes to reflect the wider impact of LEAD on individual patients and on the society.

Pediatric Tuina for promoting growth and development of preterm infants: A protocol for the systematic review of randomized controlled trail.

PubMed

Zhang, Xinghe; Guo, Taipin; Zhu, Bowen; Gao, Qing; Wang, Hourong; Tai, Xiantao; Jing, Fujie

2018-05-01

Preterm infants are babies born alive before 37 weeks. Many survived infants concomitant with defects of growth and development, a lifetime of disability usually as following when insufficient intervention. In early intervention of preterm infants, pediatric Tuina shows good effect in many Chinese and some English clinical trials. This systematic review is aimed to evaluate the efficacy and safety of pediatric Tuina for promoting growth and development of preterm infants. The electronic databases of Cochrane Library, MEDLINE, EBASE, Web of Science, Springer, World Health Organization International Clinical Trials Registry Platform, China National Knowledge Infrastructure, Chinese Biomedical Literature Database, Wan-fang database, Chinese Scientific Journal Database, and other databases will be searched from establishment to April 1, 2018. All published randomized controlled trials (RCTs) about this topic will be included. Two independent researchers will operate article retrieval, screening, quality evaluation, and data analyses by Review Manager (V.5.3.5). Meta-analyses, subgroup analysis, and/or descriptive analysis will be performed based on included data conditions. High-quality synthesis and/or descriptive analysis of current evidence will be provided from weight increase, motor development, neuropsychological development, length of stay, days of weight recovery to birthweight, days on supplemental oxygen, daily sleep duration, and side effects. This study will provide the evidence of whether pediatric Tuina is an effective early intervention for preterm infants. There is no requirement of ethical approval and informed consent, and it will be in print or published by electronic copies. This systematic review protocol has been registered in the PROSPERO network (No. CRD42018090563).

Systematic Development of Intelligent Systems for Public Road Transport

PubMed Central

García, Carmelo R.; Quesada-Arencibia, Alexis; Cristóbal, Teresa; Padrón, Gabino; Alayón, Francisco

2016-01-01

This paper presents an architecture model for the development of intelligent systems for public passenger transport by road. The main objective of our proposal is to provide a framework for the systematic development and deployment of telematics systems to improve various aspects of this type of transport, such as efficiency, accessibility and safety. The architecture model presented herein is based on international standards on intelligent transport system architectures, ubiquitous computing and service-oriented architecture for distributed systems. To illustrate the utility of the model, we also present a use case of a monitoring system for stops on a public passenger road transport network. PMID:27438836

Clinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature

PubMed Central

Bot, S; Terwee, C; van der Windt, D A W M; Bouter, L; Dekker, J; de Vet, H C W

2004-01-01

Methods: Systematic literature searches were performed to identify self administered shoulder disability questionnaires. A checklist was developed to evaluate and compare the clinimetric quality of the instruments. Results: Two reviewers identified and evaluated 16 questionnaires by our checklist. Most studies were found for the Disability of the Arm, Shoulder, and Hand scale (DASH), the Shoulder Pain and Disability Index (SPADI), and the American Shoulder and Elbow Surgeons Standardised Shoulder Assessment Form (ASES). None of the questionnaires demonstrated satisfactory results for all properties. Most questionnaires claim to measure several domains (for example, pain, physical, emotional, and social functioning), yet dimensionality was studied in only three instruments. The internal consistency was calculated for seven questionnaires and only one received an adequate rating. Twelve questionnaires received positive ratings for construct validity, although depending on the population studied, four of these questionnaires received poor ratings too. Seven questionnaires were shown to have adequate test-retest reliability (ICC >0.70), but five questionnaires were tested inadequately. In most clinimetric studies only small sample sizes (n<43) were used. Nearly all publications lacked information on the interpretation of scores. Conclusion: The DASH, SPADI, and ASES have been studied most extensively, and yet even published validation studies of these instruments have limitations in study design, sample sizes, or evidence for dimensionality. Overall, the DASH received the best ratings for its clinimetric properties. PMID:15020324

Community-Based Financing of Family Planning in Developing Countries: A Systematic Review.

PubMed

Karra, Mahesh; Canning, David; Hu, Janice; Ali, Moazzam; Lissner, Craig

2016-12-01

In this systematic review, we gather evidence on community financing schemes and insurance programs for family planning in developing countries, and we assess the impact of these programs on primary outcomes related to contraceptive use. To identify and evaluate the research findings, we adopt a four-stage review process that employs a weight-of-evidence and risk-of-bias analytic approach. Out of 19,138 references that were identified, only four studies were included in our final analysis, and only one study was determined to be of high quality. In the four studies, the evidence on the impact of community-based financing on family planning and fertility outcomes is inconclusive. These limited and mixed findings suggest that either: 1) more high-quality evidence on community-based financing for family planning is needed before any conclusions can be made; or 2) community-based financing for family planning may, in fact, have little or no effect on family planning outcomes. © 2016 The Population Council, Inc.

Inadequate safety reporting in pre-eclampsia trials: a systematic evaluation.

PubMed

Duffy, Jmn; Hirsch, M; Pealing, L; Showell, M; Khan, K S; Ziebland, S; McManus, R J

2018-06-01

Randomised trials and their syntheses in meta-analyses offer a unique opportunity to assess the frequency and severity of adverse reactions. To assess safety reporting in pre-eclampsia trials. Systematic search using bibliographic databases, including Cochrane Central Register of Controlled Trials, Embase, and MEDLINE, from inception to August 2017. Randomised trials evaluating anticonvulsant or antihypertensive medication for pre-eclampsia. Descriptive statistics appraising the adequacy of adverse reaction and toxicity reporting. We included 60 randomised trials. Six trials (10%) were registered with the International Clinical Trials Registry Platform, two registry records referred to adverse reactions, stating 'safety and toleration' and 'possible side effects' would be collected. Twenty-six trials (43%) stated the frequency of withdrawals within each study arm, and five trials (8%) adequately reported these withdrawals. Adverse reactions were inconsistently reported across eligible trials: 24 (40%) reported no serious adverse reactions and 36 (60%) reported no mild adverse reactions. The methods of definition or measurement of adverse reactions were infrequently reported within published trial reports. Pre-eclampsia trials regularly omit critical information related to safety. Despite the paucity of reporting, randomised trials collect an enormous amount of safety data. Developing and implementing a minimum data set could help to improve safety reporting, permitting a more balanced assessment of interventions by considering the trade-off between the benefits and harms. National Institute for Health Research (DRF-2014-07-051), UK; Maternity Forum, Royal Society of Medicine, UK. Developing @coreoutcomes could help to improve safety reporting in #preeclampsia trials. @NIHR_DC. © 2017 Royal College of Obstetricians and Gynaecologists.

Assessing Technical Competence in Surgical Trainees: A Systematic Review.

PubMed

Szasz, Peter; Louridas, Marisa; Harris, Kenneth A; Aggarwal, Rajesh; Grantcharov, Teodor P

2015-06-01

To systematically examine the literature describing the methods by which technical competence is assessed in surgical trainees. The last decade has witnessed an evolution away from time-based surgical education. In response, governing bodies worldwide have implemented competency-based education paradigms. The definition of competence, however, remains elusive, and the impact of these education initiatives in terms of assessment methods remains unclear. A systematic review examining the methods by which technical competence is assessed was conducted by searching MEDLINE, EMBASE, PsychINFO, and the Cochrane database of systematic reviews. Abstracts of retrieved studies were reviewed and those meeting inclusion criteria were selected for full review. Data were retrieved in a systematic manner, the validity and reliability of the assessment methods was evaluated, and quality was assessed using the Grading of Recommendations Assessment, Development and Evaluation classification. Of the 6814 studies identified, 85 studies involving 2369 surgical residents were included in this review. The methods used to assess technical competence were categorized into 5 groups; Likert scales (37), benchmarks (31), binary outcomes (11), novel tools (4), and surrogate outcomes (2). Their validity and reliability were mostly previously established. The overall Grading of Recommendations Assessment, Development and Evaluation for randomized controlled trials was high and low for the observational studies. The definition of technical competence continues to be debated within the medical literature. The methods used to evaluate technical competence predominantly include instruments that were originally created to assess technical skill. Very few studies identify standard setting approaches that differentiate competent versus noncompetent performers; subsequently, this has been identified as an area with great research potential.

Impacts on prenatal development of the human cerebellum: a systematic review.

PubMed

Koning, Irene V; Tielemans, Myrte J; Hoebeek, Freek E; Ecury-Goossen, Ginette M; Reiss, Irwin K M; Steegers-Theunissen, Regine P M; Dudink, Jeroen

2017-10-01

The cerebellum is essential for normal neurodevelopment and is particularly susceptible for intra-uterine disruptions. Although some causal prenatal exposures have been identified, the origin of neurodevelopmental disorders remains mostly unclear. Therefore, a systematic literature search was conducted to provide an overview of parental environmental exposures and intrinsic factors influencing prenatal cerebellar growth and development in humans. The literature search was limited to human studies in the English language and was conducted in Embase, Medline, Cochrane, Web of Science, Pubmed and GoogleScholar. Eligible studies were selected by three independent reviewers and study quality was scored by two independent reviewers. The search yielded 3872 articles. We found 15 eligible studies reporting associations between cerebellar development and maternal smoking (4), use of alcohol (3), in vitro fertilization mediums (1), mercury (1), mifepristone (2), aminopropionitriles (1), ethnicity (2) and cortisol levels (1). No studies reported on paternal factors. Current literature on associations between parental environmental exposures, intrinsic factors and human cerebellar development is scarce. Yet, this systematic review provided an essential overview of human studies demonstrating the vulnerability of the cerebellum to the intra-uterine environment.

Systematic reviews need systematic searchers

PubMed Central

McGowan, Jessie; Sampson, Margaret

2005-01-01

Purpose: This paper will provide a description of the methods, skills, and knowledge of expert searchers working on systematic review teams. Brief Description: Systematic reviews and meta-analyses are very important to health care practitioners, who need to keep abreast of the medical literature and make informed decisions. Searching is a critical part of conducting these systematic reviews, as errors made in the search process potentially result in a biased or otherwise incomplete evidence base for the review. Searches for systematic reviews need to be constructed to maximize recall and deal effectively with a number of potentially biasing factors. Librarians who conduct the searches for systematic reviews must be experts. Discussion/Conclusion: Expert searchers need to understand the specifics about data structure and functions of bibliographic and specialized databases, as well as the technical and methodological issues of searching. Search methodology must be based on research about retrieval practices, and it is vital that expert searchers keep informed about, advocate for, and, moreover, conduct research in information retrieval. Expert searchers are an important part of the systematic review team, crucial throughout the review process—from the development of the proposal and research question to publication. PMID:15685278

Measuring Health Literacy in Individuals with Diabetes: A Systematic Review and Evaluation of Available Measures

ERIC Educational Resources Information Center

Al Sayah, Fatima; Williams, Beverly; Johnson, Jeffrey A.

2013-01-01

Objective: To identify instruments used to measure health literacy and numeracy in people with diabetes; evaluate their use, measurement scope, and properties; discuss their strengths and weaknesses; and propose the most useful, reliable, and applicable measure for use in research and practice settings. Methods" A systematic literature review…

Low health literacy and evaluation of online health information: a systematic review of the literature.

PubMed

Diviani, Nicola; van den Putte, Bas; Giani, Stefano; van Weert, Julia Cm

2015-05-07

Recent years have witnessed a dramatic increase in consumer online health information seeking. The quality of online health information, however, remains questionable. The issue of information evaluation has become a hot topic, leading to the development of guidelines and checklists to design high-quality online health information. However, little attention has been devoted to how consumers, in particular people with low health literacy, evaluate online health information. The main aim of this study was to review existing evidence on the association between low health literacy and (1) people's ability to evaluate online health information, (2) perceived quality of online health information, (3) trust in online health information, and (4) use of evaluation criteria for online health information. Five academic databases (MEDLINE, PsycINFO, Web of Science, CINAHL, and Communication and Mass-media Complete) were systematically searched. We included peer-reviewed publications investigating differences in the evaluation of online information between people with different health literacy levels. After abstract and full-text screening, 38 articles were included in the review. Only four studies investigated the specific role of low health literacy in the evaluation of online health information. The other studies examined the association between educational level or other skills-based proxies for health literacy, such as general literacy, and outcomes. Results indicate that low health literacy (and related skills) are negatively related to the ability to evaluate online health information and trust in online health information. Evidence on the association with perceived quality of online health information and use of evaluation criteria is inconclusive. The findings indicate that low health literacy (and related skills) play a role in the evaluation of online health information. This topic is therefore worth more scholarly attention. Based on the results of this review

Low Health Literacy and Evaluation of Online Health Information: A Systematic Review of the Literature

PubMed Central

van den Putte, Bas; Giani, Stefano; van Weert, Julia CM

2015-01-01

Background Recent years have witnessed a dramatic increase in consumer online health information seeking. The quality of online health information, however, remains questionable. The issue of information evaluation has become a hot topic, leading to the development of guidelines and checklists to design high-quality online health information. However, little attention has been devoted to how consumers, in particular people with low health literacy, evaluate online health information. Objective The main aim of this study was to review existing evidence on the association between low health literacy and (1) people’s ability to evaluate online health information, (2) perceived quality of online health information, (3) trust in online health information, and (4) use of evaluation criteria for online health information. Methods Five academic databases (MEDLINE, PsycINFO, Web of Science, CINAHL, and Communication and Mass-media Complete) were systematically searched. We included peer-reviewed publications investigating differences in the evaluation of online information between people with different health literacy levels. Results After abstract and full-text screening, 38 articles were included in the review. Only four studies investigated the specific role of low health literacy in the evaluation of online health information. The other studies examined the association between educational level or other skills-based proxies for health literacy, such as general literacy, and outcomes. Results indicate that low health literacy (and related skills) are negatively related to the ability to evaluate online health information and trust in online health information. Evidence on the association with perceived quality of online health information and use of evaluation criteria is inconclusive. Conclusions The findings indicate that low health literacy (and related skills) play a role in the evaluation of online health information. This topic is therefore worth more scholarly

Economic evaluations of trastuzumab in HER2-positive metastatic breast cancer: a systematic review and critique.

PubMed

Parkinson, Bonny; Pearson, Sallie-Anne; Viney, Rosalie

2014-01-01

Published economic evaluations of trastuzumab for the treatment of HER2-positive metastatic breast cancer have arrived at different conclusions regarding the cost-effectiveness of trastuzumab, despite comparative efficacy being demonstrated by a small set of randomised controlled trials (RCTs). This article aims to provide insight into the quality of the evaluations and explore the possible drivers of the conflicting conclusions. A systematic literature review was conducted to identify all published economic evaluations that compared the incremental costs and outcomes of trastuzumab versus a comparator. Fifteen economic evaluations were identified. In the evaluations that estimated efficacy using an RCT, the key drivers of the conclusions regarding cost-effectiveness were: the approach used to estimate overall survival in the control group given crossover to trastuzumab following progression in the trials; the inclusion of treatment beyond progression; inclusion of wastage due to unused vial portions, adverse events, and the cost of HER2 testing. Four evaluations used non-randomised approaches to estimate efficacy, thus introducing the potential for confounding. As a result these evaluations reported relatively optimistic estimates of comparative effectiveness. Finally the evaluations used different thresholds to determine whether treatment with trastuzumab was cost-effective. There were numerous drivers of the different conclusions regarding the cost-effectiveness of trastuzumab, many of which are due to judgements made by the authors when translating data from RCTs. Many of the potential drivers were not identified by the published systematic reviews of economic evaluations and perhaps more remain unidentified because of inconsistent and limited reporting.

[Report quality evaluation of systematic review or Meta-analysis published in China Journal of Chinese Materia Medica].

PubMed

Zhang, Yan; Yu, Dan-Dan; Cui, De-Hua; Liao, Xing; Guo, Hua

2018-03-01

To evaluate the report quality of intervention-related systematic reviews or Meta-analysis published in China Journal of Chinese Materia Medica, we searched CNKI and China Journal of Chinese Materia Medica webpages to collect intervention-related systematic reviews or Meta-analysis since the first issue of the magazine. A total of 40 systematic reviews or Meta-analysis reports were included, including one network Meta-analysis. According to the PRISMA statement published in 2009, the report quality of the systematic reviews or Meta-analysis was evaluated. According to the results, 3 had the low quality, 30 had the medium quality, and 7 had the high quality. The average score for all of items was 30 points (21-30.5 points for the medium quality). The 17 high-quality (31-40 points) report items were title, rationale, objectives, information sources, study selection, data collection process, data items, risk of bias in individual studies, summary measures, risk of bias across studies, study selection, study characteristics, risk of bias within studies, results of individual studies, synthesis of results, risk of bias across studies and funding; the 4 medium-quality (21-30.5 points) reporting items were eligibility criteria, search, limitations and conclusions; and the 6 low-quality (<=20.5 points) reporting items were structured summary, protocol and registration, synthesis of results, additional analysis (No.16), additional analysis (No.23) and summary of evidence. Through the analysis, it is found that the report quality of intervention-related systematic reviews or Meta-analysis published in China Journal of Chinese Materia Medica is medium, and it is necessary to improve the quality standard of the report. Copyright© by the Chinese Pharmaceutical Association.

ROBIS: A new tool to assess risk of bias in systematic reviews was developed.

PubMed

Whiting, Penny; Savović, Jelena; Higgins, Julian P T; Caldwell, Deborah M; Reeves, Barnaby C; Shea, Beverley; Davies, Philippa; Kleijnen, Jos; Churchill, Rachel

2016-01-01

To develop ROBIS, a new tool for assessing the risk of bias in systematic reviews (rather than in primary studies). We used four-stage approach to develop ROBIS: define the scope, review the evidence base, hold a face-to-face meeting, and refine the tool through piloting. ROBIS is currently aimed at four broad categories of reviews mainly within health care settings: interventions, diagnosis, prognosis, and etiology. The target audience of ROBIS is primarily guideline developers, authors of overviews of systematic reviews ("reviews of reviews"), and review authors who might want to assess or avoid risk of bias in their reviews. The tool is completed in three phases: (1) assess relevance (optional), (2) identify concerns with the review process, and (3) judge risk of bias. Phase 2 covers four domains through which bias may be introduced into a systematic review: study eligibility criteria; identification and selection of studies; data collection and study appraisal; and synthesis and findings. Phase 3 assesses the overall risk of bias in the interpretation of review findings and whether this considered limitations identified in any of the phase 2 domains. Signaling questions are included to help judge concerns with the review process (phase 2) and the overall risk of bias in the review (phase 3); these questions flag aspects of review design related to the potential for bias and aim to help assessors judge risk of bias in the review process, results, and conclusions. ROBIS is the first rigorously developed tool designed specifically to assess the risk of bias in systematic reviews. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

ROBIS: A new tool to assess risk of bias in systematic reviews was developed

PubMed Central

Whiting, Penny; Savović, Jelena; Higgins, Julian P.T.; Caldwell, Deborah M.; Reeves, Barnaby C.; Shea, Beverley; Davies, Philippa; Kleijnen, Jos; Churchill, Rachel

2016-01-01

Objective To develop ROBIS, a new tool for assessing the risk of bias in systematic reviews (rather than in primary studies). Study Design and Setting We used four-stage approach to develop ROBIS: define the scope, review the evidence base, hold a face-to-face meeting, and refine the tool through piloting. Results ROBIS is currently aimed at four broad categories of reviews mainly within health care settings: interventions, diagnosis, prognosis, and etiology. The target audience of ROBIS is primarily guideline developers, authors of overviews of systematic reviews (“reviews of reviews”), and review authors who might want to assess or avoid risk of bias in their reviews. The tool is completed in three phases: (1) assess relevance (optional), (2) identify concerns with the review process, and (3) judge risk of bias. Phase 2 covers four domains through which bias may be introduced into a systematic review: study eligibility criteria; identification and selection of studies; data collection and study appraisal; and synthesis and findings. Phase 3 assesses the overall risk of bias in the interpretation of review findings and whether this considered limitations identified in any of the phase 2 domains. Signaling questions are included to help judge concerns with the review process (phase 2) and the overall risk of bias in the review (phase 3); these questions flag aspects of review design related to the potential for bias and aim to help assessors judge risk of bias in the review process, results, and conclusions. Conclusions ROBIS is the first rigorously developed tool designed specifically to assess the risk of bias in systematic reviews. PMID:26092286

The systematic review as a research process in music therapy.

PubMed

Hanson-Abromeit, Deanna; Sena Moore, Kimberly

2014-01-01

Music therapists are challenged to present evidence on the efficacy of music therapy treatment and incorporate the best available research evidence to make informed healthcare and treatment decisions. Higher standards of evidence can come from a variety of sources including systematic reviews. To define and describe a range of research review methods using examples from music therapy and related literature, with emphasis on the systematic review. In addition, the authors provide a detailed overview of methodological processes for conducting and reporting systematic reviews in music therapy. The systematic review process is described in five steps. Step 1 identifies the research plan and operationalized research question(s). Step 2 illustrates the identification and organization of the existing literature related to the question(s). Step 3 details coding of data extracted from the literature. Step 4 explains the synthesis of coded findings and analysis to answer the research question(s). Step 5 describes the strength of evidence evaluation and results presentation for practice recommendations. Music therapists are encouraged to develop and conduct systematic reviews. This methodology contributes to review outcome credibility and can determine how information is interpreted and used by clinicians, clients or patients, and policy makers. A systematic review is a methodologically rigorous research method used to organize and evaluate extant literature related to a clinical problem. Systematic reviews can assist music therapists in managing the ever-increasing literature, making well-informed evidence based practice and research decisions, and translating existing music-based and nonmusic based literature to clinical practice and research development. © the American Music Therapy Association 2014. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

A Systematic Review of Reviews Evaluating Technology-Enabled Diabetes Self-Management Education and Support.

PubMed

Greenwood, Deborah A; Gee, Perry M; Fatkin, Kathy J; Peeples, Malinda

2017-09-01

Since the introduction of mobile phones, technology has been increasingly used to enable diabetes self-management education and support. This timely systematic review summarizes how currently available technology impacts outcomes for people living with diabetes. A systematic review of high quality review articles and meta analyses focused on utilizing technology in diabetes self-management education and support services was conducted. Articles were included if published between January 2013 and January 2017. Twenty-five studies were included for analysis. The majority evaluated the use of mobile phones and secure messaging. Most studies described healthy eating, being active and metabolic monitoring as the predominant self-care behaviors evaluated. Eighteen of 25 reviews reported significant reduction in A1c as an outcome measure. Four key elements emerged as essential for improved A1c: (1) communication, (2) patient-generated health data, (3) education, and (4) feedback. Technology-enabled diabetes self-management solutions significantly improve A1c. The most effective interventions incorporated all the components of a technology-enabled self-management feedback loop that connected people with diabetes and their health care team using 2-way communication, analyzed patient-generated health data, tailored education, and individualized feedback. The evidence from this systematic review indicates that organizations, policy makers and payers should consider integrating these solutions in the design of diabetes self-management education and support services for population health and value-based care models. With the widespread adoption of mobile phones, digital health solutions that incorporate evidence-based, behaviorally designed interventions can improve the reach and access to diabetes self-management education and ongoing support.

Systematic development and implementation of interventions to OPtimise Health Literacy and Access (Ophelia).

PubMed

Beauchamp, Alison; Batterham, Roy W; Dodson, Sarity; Astbury, Brad; Elsworth, Gerald R; McPhee, Crystal; Jacobson, Jeanine; Buchbinder, Rachelle; Osborne, Richard H

2017-03-03

The need for healthcare strengthening to enhance equity is critical, requiring systematic approaches that focus on those experiencing lesser access and outcomes. This project developed and tested the Ophelia (OPtimising HEalth LIteracy and Access) approach for co-design of interventions to improve health literacy and equity of access. Eight principles guided this development: Outcomes focused; Equity driven, Needs diagnosis, Co-design, Driven by local wisdom, Sustainable, Responsive and Systematically applied. We report the application of the Ophelia process where proof-of-concept was defined as successful application of the principles. Nine sites were briefed on the aims of the project around health literacy, co-design and quality improvement. The sites were rural/metropolitan, small/large hospitals, community health centres or municipalities. Each site identified their own priorities for improvement; collected health literacy data using the Health Literacy Questionnaire (HLQ) within the identified priority groups; engaged staff in co-design workshops to generate ideas for improvement; developed program-logic models; and implemented their projects using Plan-Do-Study-Act (PDSA) cycles. Evaluation included assessment of impacts on organisations, practitioners and service users, and whether the principles were applied. Sites undertook co-design workshops involving discussion of service user needs informed by HLQ (n = 813) and interview data. Sites generated between 21 and 78 intervention ideas and then planned their selected interventions through program-logic models. Sites successfully implemented interventions and refined them progressively with PDSA cycles. Interventions generally involved one of four pathways: development of clinician skills and resources for health literacy, engagement of community volunteers to disseminate health promotion messages, direct impact on consumers' health literacy, and redesign of existing services. Evidence of application of

Systematic Review: Concept and Tool Development with Application in the Integrated Risk Information System (IRIS) Assessment Process

EPA Science Inventory

Systematic Review: Concept and tool development with application to the National Toxicology Program (NTP) and the Integrated Risk Information System (IRIS) Assessment Processes. There is growing interest within the environmental health community to incorporate systematic review m...

Systematic Professional Development Training and Its Impact on Teachers' Attitudes toward ELLs: SIOP and Guided Coaching

ERIC Educational Resources Information Center

Song, Kim Hyunsook

2016-01-01

This study examined systematic professional development (PD) training and its impact on teachers' roles for and attitudes toward English language learners (ELLs). Systematic PD should compensate for theories and pedagogies not obtained during teacher education programs yet needed for content teachers with ELLs. A study was conducted to examine…

Gender counts: A systematic review of evaluations of gender-integrated health interventions in low- and middle-income countries.

PubMed

Schriver, Brittany; Mandal, Mahua; Muralidharan, Arundati; Nwosu, Anthony; Dayal, Radhika; Das, Madhumita; Fehringer, Jessica

2017-11-01

As a result of new global priorities, there is a growing need for high-quality evaluations of gender-integrated health programmes. This systematic review examined 99 peer-reviewed articles on evaluations of gender-integrated (accommodating and transformative) health programmes with regard to their theory of change (ToC), study design, gender integration in data collection, analysis, and gender measures used. Half of the evaluations explicitly described a ToC or conceptual framework (n = 50) that guided strategies for their interventions. Over half (61%) of the evaluations used quantitative methods exclusively; 11% used qualitative methods exclusively; and 28% used mixed methods. Qualitative methods were not commonly detailed. Evaluations of transformative interventions were less likely than those of accommodating interventions to employ randomised control trials. Two-thirds of the reviewed evaluations reported including at least one specific gender-related outcome (n = 18 accommodating, n = 44 transformative). To strengthen evaluations of gender-integrated programmes, we recommend use of ToCs, explicitly including gender in the ToC, use of gender-sensitive measures, mixed-method designs, in-depth descriptions of qualitative methods, and attention to gender-related factors in data collection logistics. We also recommend further research to develop valid and reliable gender measures that are globally relevant.

Psychometric evaluation of commonly used game-specific skills tests in rugby: A systematic review

PubMed Central

Oorschot, Sander; Chiwaridzo, Matthew; CM Smits-Engelsman, Bouwien

2017-01-01

Objectives To (1) give an overview of commonly used game-specific skills tests in rugby and (2) evaluate available psychometric information of these tests. Methods The databases PubMed, MEDLINE CINAHL and Africa Wide information were systematically searched for articles published between January 1995 and March 2017. First, commonly used game-specific skills tests were identified. Second, the available psychometrics of these tests were evaluated and the methodological quality of the studies assessed using the Consensus-based Standards for the selection of health Measurement Instruments checklist. Studies included in the first step had to report detailed information on the construct and testing procedure of at least one game-specific skill, and studies included in the second step had additionally to report at least one psychometric property evaluating reliability, validity or responsiveness. Results 287 articles were identified in the first step, of which 30 articles met the inclusion criteria and 64 articles were identified in the second step of which 10 articles were included. Reactive agility, tackling and simulated rugby games were the most commonly used tests. All 10 studies reporting psychometrics reported reliability outcomes, revealing mainly strong evidence. However, all studies scored poor or fair on methodological quality. Four studies reported validity outcomes in which mainly moderate evidence was indicated, but all articles had fair methodological quality. Conclusion Game-specific skills tests indicated mainly high reliability and validity evidence, but the studies lacked methodological quality. Reactive agility seems to be a promising domain, but the specific tests need further development. Future high methodological quality studies are required in order to develop valid and reliable test batteries for rugby talent identification. Trial registration number PROSPERO CRD42015029747. PMID:29259812

Using systematic reviews for hazard and risk assessment of endocrine disrupting chemicals

PubMed Central

Beronius, Anna; Vandenberg, Laura N.

2016-01-01

The possibility that endocrine disrupting chemicals (EDCs) in our environment contribute to hormonally related effects and diseases observed in human and wildlife populations has caused concern among decision makers and researchers alike. EDCs challenge principles traditionally applied in chemical risk assessment and the identification and assessment of these compounds has been a much debated topic during the last decade. State of the science reports and risk assessments of potential EDCs have been criticized for not using systematic and transparent approaches in the evaluation of evidence. In the fields of medicine and health care, systematic review methodologies have been developed and used to enable objectivity and transparency in the evaluation of scientific evidence for decision making. Lately, such approaches have also been promoted for use in the environmental health sciences and risk assessment of chemicals. Systematic review approaches could provide a tool for improving the evaluation of evidence for decision making regarding EDCs, e.g. by enabling systematic and transparent use of academic research data in this process. In this review we discuss the advantages and challenges of applying systematic review methodology in the identification and assessment of EDCs. PMID:26847432

Using systematic reviews for hazard and risk assessment of endocrine disrupting chemicals.

PubMed

Beronius, Anna; Vandenberg, Laura N

2015-12-01

The possibility that endocrine disrupting chemicals (EDCs) in our environment contribute to hormonally related effects and diseases observed in human and wildlife populations has caused concern among decision makers and researchers alike. EDCs challenge principles traditionally applied in chemical risk assessment and the identification and assessment of these compounds has been a much debated topic during the last decade. State of the science reports and risk assessments of potential EDCs have been criticized for not using systematic and transparent approaches in the evaluation of evidence. In the fields of medicine and health care, systematic review methodologies have been developed and used to enable objectivity and transparency in the evaluation of scientific evidence for decision making. Lately, such approaches have also been promoted for use in the environmental health sciences and risk assessment of chemicals. Systematic review approaches could provide a tool for improving the evaluation of evidence for decision making regarding EDCs, e.g. by enabling systematic and transparent use of academic research data in this process. In this review we discuss the advantages and challenges of applying systematic review methodology in the identification and assessment of EDCs.

Evidence synthesis in international development: a critique of systematic reviews and a pragmatist alternative

PubMed Central

Cornish, Flora

2015-01-01

Systematic reviews are an instrument of Evidence-Based Policy designed to produce comprehensive, unbiased, transparent and clear assessments of interventions’ effectiveness. From their origins in medical fields, systematic reviews have recently been promoted as offering important advances in a range of applied social science fields, including international development. Drawing on a case study of a systematic review of the effectiveness of community mobilisation as an intervention to tackle HIV/AIDS, this article problematises the use of systematic reviews to summarise complex and context-specific bodies of evidence. Social development interventions, such as ‘community mobilisation’ often take different forms in different interventions; are made successful by their situation in particular contexts, rather than being successful or unsuccessful universally; and have a rhetorical value that leads to the over-application of positively valued terms (e.g. ‘community mobilisation’), invalidating the keyword search process of a systematic review. The article suggests that the policy interest in definitive summary statements of ‘the evidence’ is at odds with academic assessments that evidence takes multiple, contradictory and complex forms, and with practitioner experience of the variability of practice in context. A pragmatist philosophy of evidence is explored as an alternative. Taking this approach implies expanding the definition of forms of research considered to be ‘useful evidence’ for evidence-based policy-making; decentralising decisions about ‘what works’ to allow for the use of local practical wisdom; and prioritising the establishment of good processes for the critical use of evidence, rather than producing context-insensitive summaries of ‘the evidence’. PMID:26426502

Evidence synthesis in international development: a critique of systematic reviews and a pragmatist alternative.

PubMed

Cornish, Flora

2015-12-01

Systematic reviews are an instrument of Evidence-Based Policy designed to produce comprehensive, unbiased, transparent and clear assessments of interventions' effectiveness. From their origins in medical fields, systematic reviews have recently been promoted as offering important advances in a range of applied social science fields, including international development. Drawing on a case study of a systematic review of the effectiveness of community mobilisation as an intervention to tackle HIV/AIDS, this article problematises the use of systematic reviews to summarise complex and context-specific bodies of evidence. Social development interventions, such as 'community mobilisation' often take different forms in different interventions; are made successful by their situation in particular contexts, rather than being successful or unsuccessful universally; and have a rhetorical value that leads to the over-application of positively valued terms (e.g. 'community mobilisation'), invalidating the keyword search process of a systematic review. The article suggests that the policy interest in definitive summary statements of 'the evidence' is at odds with academic assessments that evidence takes multiple, contradictory and complex forms, and with practitioner experience of the variability of practice in context. A pragmatist philosophy of evidence is explored as an alternative. Taking this approach implies expanding the definition of forms of research considered to be 'useful evidence' for evidence-based policy-making; decentralising decisions about 'what works' to allow for the use of local practical wisdom; and prioritising the establishment of good processes for the critical use of evidence, rather than producing context-insensitive summaries of 'the evidence'.

The effect of a geriatric evaluation on treatment decisions for older cancer patients--a systematic review.

PubMed

Hamaker, Marije E; Schiphorst, Anandi H; ten Bokkel Huinink, Daan; Schaar, Cees; van Munster, Barbara C

2014-03-01

The aim of this systematic review is to summarise all available data on the effect of a geriatric evaluation on the multidisciplinary treatment of older cancer patients, focussing on oncologic treatment decisions and the implementation of non-oncologic interventions. A systematic search in MEDLINE and EMBASE for studies on the effect of a geriatric evaluation on oncologic and non-oncologic treatment for older cancer patients. Literature search identified 1654 reports (624 from Medline and 1030 from Embase), of which 10 studies were included in the review. Three studies used a geriatric consultation while seven used a geriatric assessment performed by a cancer specialist, healthcare worker or (research) nurse. Six studies addressed a change in oncologic treatment, the initial treatment plan was modified in a median of 39% of patients after geriatric evaluation, of which two thirds resulted in less intensive treatment. Seven studies focused on the implementation of non-oncologic interventions based on the results of the geriatric evaluation; all but one reported that interventions were suggested for over 70% of patients, even in studies that did not focus specifically on frail older patients. In the other study, implementation of non-oncologic interventions was left to the cancer specialist's discretion. A geriatric evaluation has significant impact on oncologic and non-oncologic treatment decisions in older cancer patients and deserves consideration in the oncologic work-up for these patients.

Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM).

PubMed

Strand, Pia; Sjöborg, Karolina; Stalmeijer, Renée; Wichmann-Hansen, Gitte; Jakobsson, Ulf; Edgren, Gudrun

2013-12-01

There is a paucity of instruments designed to evaluate the multiple dimensions of the workplace as an educational environment for undergraduate medical students. The aim was to develop and psychometrically evaluate an instrument to measure how undergraduate medical students perceive the clinical workplace environment, based on workplace learning theories and empirical findings. Development of the instrument relied on established standards including theoretical and empirical grounding, systematic item development and expert review at various stages to ensure content validity. Qualitative and quantitative methods were employed using a series of steps from conceptualization through psychometric analysis of scores in a Swedish medical student population. The final result was a 25-item instrument with two overarching dimensions, experiential learning and social participation, and four subscales that coincided well with theory and empirical findings: Opportunities to learn in and through work & quality of supervision; Preparedness for student entry; Workplace interaction patterns & student inclusion; and Equal treatment. Evidence from various sources supported content validity, construct validity and reliability of the instrument. The Undergraduate Clinical Education Environment Measure represents a valid, reliable and feasible multidimensional instrument for evaluation of the clinical workplace as a learning environment for undergraduate medical students. Further validation in different populations using various psychometric methods is needed.

How to Grow Project Scientists: A Systematic Approach to Developing Project Scientists

NASA Technical Reports Server (NTRS)

Kea, Howard

2011-01-01

The Project Manager is one of the key individuals that can determine the success or failure of a project. NASA is fully committed to the training and development of Project Managers across the agency to ensure that highly capable individuals are equipped with the competencies and experience to successfully lead a project. An equally critical position is that of the Project Scientist. The Project Scientist provides the scientific leadership necessary for the scientific success of a project by insuring that the mission meets or exceeds the scientific requirements. Traditionally, NASA Goddard project scientists were appointed and approved by the Center Science Director based on their knowledge, experience, and other qualifications. However the process to obtain the necessary knowledge, skills and abilities was not documented or done in a systematic way. NASA Goddard's current Science Director, Nicholas White saw the need to create a pipeline for developing new projects scientists, and appointed a team to develop a process for training potential project scientists. The team members were Dr. Harley Thronson, Chair, Dr. Howard Kea, Mr. Mark Goldman, DACUM facilitator and the late Dr. Michael VanSteenberg. The DACUM process, an occupational analysis and evaluation system, was used to produce a picture of the project scientist's duties, tasks, knowledge, and skills. The output resulted in a 3-Day introductory course detailing all the required knowledge, skills and abilities a scientist must develop over time to be qualified for selections as a Project Scientist.

Voice-Related Patient-Reported Outcome Measures: A Systematic Review of Instrument Development and Validation

ERIC Educational Resources Information Center

Francis, David O.; Daniero, James J.; Hovis, Kristen L.; Sathe, Nila; Jacobson, Barbara; Penson, David F.; Feurer, Irene D.; McPheeters, Melissa L.

2017-01-01

Purpose: The purpose of this study was to perform a comprehensive systematic review of the literature on voice-related patient-reported outcome (PRO) measures in adults and to evaluate each instrument for the presence of important measurement properties. Method: MEDLINE, the Cumulative Index of Nursing and Allied Health Literature, and the Health…

Indices for the assessment of nutritional quality of meals: a systematic review.

PubMed

Gorgulho, B M; Pot, G K; Sarti, F M; Marchioni, D M

2016-06-01

This systematic review aimed to synthesise information on indices developed to evaluate nutritional quality of meals. A strategy for systematic search of the literature was developed using keywords related to assessment of meal quality. Databases searched included ScienceDirect, PubMed, Lilacs, SciELO, Scopus, Cochrane, Embase and Google Scholar. The literature search resulted in seven different meal quality indices. Each article was analysed in order to identify the following items: authors, country, year, study design, population characteristics, type of meal evaluated, dietary assessment method, characteristics evaluated (nutrients or food items), score range, index components, nutritional references, correlations performed, validation and relationship with an outcome (if existing). Two studies developed instruments to assess the quality of breakfast, three analysed lunch, one evaluated dinner and one was applied to all types of meals and snacks. All meal quality indices reviewed were based on the evaluation of presence or absence of food groups and relative contributions of nutrients, according to food-based guidelines or nutrient references, adapting the daily dietary recommendations to one specific meal. Most of the indices included three items as components for meal quality assessment: (I) total fat or some specific type of fat, (II) fruits and vegetables and (III) cereals or whole grains. This systematic review indicates aspects that need further research, particularly the numerous approaches to assessing meals considering different foods and nutrients, and the need for validation studies of meal indices.

Methods to Evaluate the Effects of Internet-Based Digital Health Interventions for Citizens: Systematic Review of Reviews.

PubMed

Zanaboni, Paolo; Ngangue, Patrice; Mbemba, Gisele Irène Claudine; Schopf, Thomas Roger; Bergmo, Trine Strand; Gagnon, Marie-Pierre

2018-06-07

Digital health can empower citizens to manage their health and address health care system problems including poor access, uncoordinated care and increasing costs. Digital health interventions are typically complex interventions. Therefore, evaluations present methodological challenges. The objective of this study was to provide a systematic overview of the methods used to evaluate the effects of internet-based digital health interventions for citizens. Three research questions were addressed to explore methods regarding approaches (study design), effects and indicators. We conducted a systematic review of reviews of the methods used to measure the effects of internet-based digital health interventions for citizens. The protocol was developed a priori according to Preferred Reporting Items for Systematic review and Meta-Analysis Protocols and the Cochrane Collaboration methodology for overviews of reviews. Qualitative, mixed-method, and quantitative reviews published in English or French from January 2010 to October 2016 were included. We searched for published reviews in PubMed, EMBASE, The Cochrane Database of Systematic Reviews, CINHAL and Epistemonikos. We categorized the findings based on a thematic analysis of the reviews structured around study designs, indicators, types of interventions, effects and perspectives. A total of 20 unique reviews were included. The most common digital health interventions for citizens were patient portals and patients' access to electronic health records, covered by 10/20 (50%) and 6/20 (30%) reviews, respectively. Quantitative approaches to study design included observational study (15/20 reviews, 75%), randomized controlled trial (13/20 reviews, 65%), quasi-experimental design (9/20 reviews, 45%), and pre-post studies (6/20 reviews, 30%). Qualitative studies or mixed methods were reported in 13/20 (65%) reviews. Five main categories of effects were identified: (1) health and clinical outcomes, (2) psychological and behavioral

A systematic review evaluating the psychometric properties of measures of social inclusion

PubMed Central

Milbourn, Ben; Martin, Robyn; Buchanan, Angus; Chung, Donna; Speyer, Renée

2017-01-01

Introduction Improving social inclusion opportunities for population health has been identified as a priority area for international policy. There is a need to comprehensively examine and evaluate the quality of psychometric properties of measures of social inclusion that are used to guide social policy and outcomes. Objective To conduct a systematic review of the literature on all current measures of social inclusion for any population group, to evaluate the quality of the psychometric properties of identified measures, and to evaluate if they capture the construct of social inclusion. Methods A systematic search was performed using five electronic databases: CINAHL, PsycINFO, Embase, ERIC and Pubmed and grey literature were sourced to identify measures of social inclusion. The psychometric properties of the social inclusion measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Of the 109 measures identified, twenty-five measures, involving twenty-five studies and one manual met the inclusion criteria. The overall quality of the reviewed measures was variable, with the Social and Community Opportunities Profile-Short, Social Connectedness Scale and the Social Inclusion Scale demonstrating the strongest evidence for sound psychometric quality. The most common domain included in the measures was connectedness (21), followed by participation (19); the domain of citizenship was covered by the least number of measures (10). No single instrument measured all aspects within the three domains of social inclusion. Of the measures with sound psychometric evidence, the Social and Community Opportunities Profile-Short captured the construct of social inclusion best. Conclusions The overall quality of the psychometric properties demonstrate that the current suite of available instruments for the measurement of social inclusion are promising but need further refinement. There is a need for a universal working

An optimal search filter for retrieving systematic reviews and meta-analyses

PubMed Central

2012-01-01

Background Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters. Methods This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter. Results Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened. Conclusions The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity. PMID:22512835

Economic Evaluation and Transferability of Physical Activity Programmes in Primary Prevention: A Systematic Review

PubMed Central

Wolfenstetter, Silke B.; Wenig, Christina M.

2010-01-01

This systematic review aims to assess the characteristics of, and the clinical and economic evidence provided by, economic evaluations of primary preventive physical exercise interventions, and to analyse their transferability to Germany using recommended checklists. Fifteen economic evaluations from seven different countries met eligibility criteria, with seven of the fifteen providing high economic evidence in the special country context. Most of the identified studies conclude that the investigated intervention provide good value for money compared with alternatives. However, this review shows a high variability of the costing methods between the studies, which limits comparability, generalisability and transferability of the results. PMID:20617050

Economic evaluations on centralisation of specialised healthcare services: a systematic review of methods

PubMed Central

Bhattarai, Nawaraj; McMeekin, Peter; Price, Christopher; Vale, Luke

2016-01-01

Objective To systematically review and appraise the quality of economic evaluations assessing centralisation of specialised healthcare services. Methods A systematic review to identify economic evaluations on centralisation of any specialised healthcare service. Full economic evaluations comparing costs and consequences of centralisation of any specialised healthcare service were eligible for inclusion. Methodological characteristics of included studies were appraised using checklists adapted from recommended guidelines. Results A total of 64 full-text articles met the inclusion criteria. Two studies were conducted in the UK. Most of the studies used volume of activity as a proxy measure of centralisation. The methods used to assess centralisation were heterogeneous. Studies differed in terms of study design used and aspect of centralisation they considered. There were major limitations in studies. Only 12 studies reported the study perspective. Charges which are not true representation of costs were used by 17 studies to assess cost outcomes. Only 10 reported the detailed breakdown of the cost components used in their analysis. Discounting was necessary in 14 studies but was reported only in 7 studies. Sensitivity analyses were included by less than one-third of the studies. The applicability of the identified studies to a setting other than the one they were conducted in is questionable, given variations in the organisation of services and healthcare costs. Centralisation as a concept has also been variably and narrowly defined as activity of specific services which may not reflect the wider aspects of centralisation. Conclusions Confounded and biased information coming from studies without standardised methods may mislead decision-makers towards making wrong decisions on centralisation. It is important to improve the methodology and reporting of economic evaluations in order to provide more robust and transferable evidence. Wider aspects of healthcare

A Systematic Review of Life Skill Development through Sports Programs Serving Socially Vulnerable Youth

ERIC Educational Resources Information Center

Hermens, Niels; Super, Sabina; Verkooijen, Kirsten T.; Koelen, Maria A.

2017-01-01

Purpose: Despite the strong belief in sports programs as a setting in which socially vulnerable youth can develop life skills, no overview exists of life skill development in sports programs serving this youth group. Therefore, the present systematic review provides an overview of the evidence on life skill development in sports programs serving…

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review

PubMed Central

Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Introduction Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. Objective To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. Methods A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. Conclusions The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments. PMID:26151362

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review.

PubMed

Cordier, Reinie; Speyer, Renée; Chen, Yu-Wei; Wilkes-Gillan, Sarah; Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments.

Applying the Analytic Hierarchy Process in healthcare research: A systematic literature review and evaluation of reporting.

PubMed

Schmidt, Katharina; Aumann, Ines; Hollander, Ines; Damm, Kathrin; von der Schulenburg, J-Matthias Graf

2015-12-24

The Analytic Hierarchy Process (AHP), developed by Saaty in the late 1970s, is one of the methods for multi-criteria decision making. The AHP disaggregates a complex decision problem into different hierarchical levels. The weight for each criterion and alternative are judged in pairwise comparisons and priorities are calculated by the Eigenvector method. The slowly increasing application of the AHP was the motivation for this study to explore the current state of its methodology in the healthcare context. A systematic literature review was conducted by searching the Pubmed and Web of Science databases for articles with the following keywords in their titles or abstracts: "Analytic Hierarchy Process," "Analytical Hierarchy Process," "multi-criteria decision analysis," "multiple criteria decision," "stated preference," and "pairwise comparison." In addition, we developed reporting criteria to indicate whether the authors reported important aspects and evaluated the resulting studies' reporting. The systematic review resulted in 121 articles. The number of studies applying AHP has increased since 2005. Most studies were from Asia (almost 30%), followed by the US (25.6%). On average, the studies used 19.64 criteria throughout their hierarchical levels. Furthermore, we restricted a detailed analysis to those articles published within the last 5 years (n = 69). The mean of participants in these studies were 109, whereas we identified major differences in how the surveys were conducted. The evaluation of reporting showed that the mean of reported elements was about 6.75 out of 10. Thus, 12 out of 69 studies reported less than half of the criteria. The AHP has been applied inconsistently in healthcare research. A minority of studies described all the relevant aspects. Thus, the statements in this review may be biased, as they are restricted to the information available in the papers. Hence, further research is required to discover who should be interviewed and how, how

Systematic development of a text-driven and a video-driven web-based computer-tailored obesity prevention intervention

PubMed Central

2013-01-01

Background This paper describes the systematic development of a text-driven and a video-driven web-based computer-tailored intervention aimed to prevent obesity among normal weight and overweight adults. We hypothesize that the video-driven intervention will be more effective and appealing for individuals with a low level of education. Methods and Design The Intervention Mapping protocol was used to develop the interventions, which have exactly the same educational content but differ in the format in which the information is delivered. One intervention is fully text-based, while in the other intervention in addition to text-based feedback, the core messages are provided by means of videos. The aim of the interventions is to prevent weight gain or achieve modest weight loss by making small changes in dietary intake or physical activity. The content of the interventions is based on the I-Change Model and self-regulation theories and includes behavior change methods such as consciousness raising, tailored feedback on behavior and cognitions, goal setting, action and coping planning, and evaluation of goal pursuit. The interventions consist of six sessions. In the first two sessions, participants will set weight and behavioral change goals and form plans for specific actions to achieve the desired goals. In the remaining four sessions, participants’ will evaluate their progress toward achievement of the behavioral and weight goals. They will also receive personalized feedback on how to deal with difficulties they may encounter, including the opportunity to make coping plans and the possibility to learn from experiences of others. The efficacy and appreciation of the interventions will be examined by means of a three-group randomized controlled trial using a waiting list control group. Measurements will take place at baseline and six and twelve months after baseline. Primary outcome measures are body mass index, physical activity, and dietary intake. Discussion The

Application of systematic review methodology to the field of nutrition.

PubMed

Lichtenstein, Alice H; Yetley, Elizabeth A; Lau, Joseph

2008-12-01

Systematic reviews represent a rigorous and transparent approach to synthesizing scientific evidence that minimizes bias. They evolved within the medical community to support development of clinical and public health practice guidelines, set research agendas, and formulate scientific consensus statements. The use of systematic reviews for nutrition-related topics is more recent. Systematic reviews provide independently conducted comprehensive and objective assessments of available information addressing precise questions. This approach to summarizing available data is a useful tool for identifying the state of science including knowledge gaps and associated research needs, supporting development of science-based recommendations and guidelines, and serving as the foundation for updates as new data emerge. Our objective is to describe the steps for performing systematic reviews and highlight areas unique to the discipline of nutrition that are important to consider in data assessment. The steps involved in generating systematic reviews include identifying staffing and planning for outside expert input, forming a research team, developing an analytic framework, developing and refining research questions, defining eligibility criteria, identifying search terms, screening abstracts according to eligibility criteria, retrieving articles for evaluation, constructing evidence and summary tables, assessing methodological quality and applicability, and synthesizing results including performing meta-analysis, if appropriate. Unique and at times challenging, nutrition-related considerations include baseline nutrient exposure, nutrient status, bioequivalence of bioactive compounds, bioavailability, multiple and interrelated biological functions, undefined nature of some interventions, and uncertainties in intake assessment. Systematic reviews are a valuable and independent component of decision-making processes by groups responsible for developing science-based recommendations

Economic Evaluations of Opioid Use Disorder Interventions: A Systematic Review

PubMed Central

Murphy, Sean M.; Polsky, Daniel

2017-01-01

Background The economic costs associated with opioid misuse are immense. Effective interventions for opioid use disorders are available; however, given the scarce resources faced by substance-use treatment providers and payers of all kinds, evidence of effectiveness is not always sufficient to encourage the adoption of a given therapy, nor should it be. Economic evaluations can provide evidence that will help stakeholders efficiently allocate their resources. Objective The purpose of this study was to review the literature on economic evaluations of opioid use disorder interventions. Methods We performed a systematic review of the major electronic databases from inception until present (August 2015). A sensitive approach was used to ensure a comprehensive list of relevant articles. Given the quality of existing reviews, we narrowed our search to studies published since 2007. The Drummond checklist was used to evaluate and categorize economic-evaluation studies according to their quality. Results A total of 98 articles were identified as potentially relevant to the current study. Of these 98 articles, half (n=49) were included in this study. Six of the included articles were review in nature. The remaining 43 articles performed an economic evaluation of an intervention for opioid use disorders. In general, the evidence on methadone-maintenance therapy (MMT) supports previous findings that MMT is an economically advantageous opioid-use-disorder therapy. The economic literature comparing MMT to other opioid-use-disorder pharmacotherapies is limited, as is the literature on other forms of therapy. Conclusions With the possible exception of MMT, additional high-quality economic evaluations are needed in order to assess the relative value of existing opioid-use-disorder interventions. PMID:27002518

Development and application of a new grey dynamic hierarchy analysis system (GDHAS) for evaluating urban ecological security.

PubMed

Shao, Chaofeng; Tian, Xiaogang; Guan, Yang; Ju, Meiting; Xie, Qiang

2013-05-21

Selecting indicators based on the characteristics and development trends of a given study area is essential for building a framework for assessing urban ecological security. However, few studies have focused on how to select the representative indicators systematically, and quantitative research is lacking. We developed an innovative quantitative modeling approach called the grey dynamic hierarchy analytic system (GDHAS) for both the procedures of indicator selection and quantitative assessment of urban ecological security. Next, a systematic methodology based on the GDHAS is developed to assess urban ecological security comprehensively and dynamically. This assessment includes indicator selection, driving force-pressure-state-impact-response (DPSIR) framework building, and quantitative evaluation. We applied this systematic methodology to assess the urban ecological security of Tianjin, which is a typical coastal super megalopolis and the industry base in China. This case study highlights the key features of our approach. First, 39 representative indicators are selected for the evaluation index system from 62 alternative ones available through the GDHAS. Second, the DPSIR framework is established based on the indicators selected, and the quantitative assessment of the eco-security of Tianjin is conducted. The results illustrate the following: urban ecological security of Tianjin in 2008 was in alert level but not very stable; the driving force and pressure subsystems were in good condition, but the eco-security levels of the remainder of the subsystems were relatively low; the pressure subsystem was the key to urban ecological security; and 10 indicators are defined as the key indicators for five subsystems. These results can be used as the basis for urban eco-environmental management.

Development and Application of a New Grey Dynamic Hierarchy Analysis System (GDHAS) for Evaluating Urban Ecological Security

PubMed Central

Shao, Chaofeng; Tian, Xiaogang; Guan, Yang; Ju, Meiting; Xie, Qiang

2013-01-01

Selecting indicators based on the characteristics and development trends of a given study area is essential for building a framework for assessing urban ecological security. However, few studies have focused on how to select the representative indicators systematically, and quantitative research is lacking. We developed an innovative quantitative modeling approach called the grey dynamic hierarchy analytic system (GDHAS) for both the procedures of indicator selection and quantitative assessment of urban ecological security. Next, a systematic methodology based on the GDHAS is developed to assess urban ecological security comprehensively and dynamically. This assessment includes indicator selection, driving force-pressure-state-impact-response (DPSIR) framework building, and quantitative evaluation. We applied this systematic methodology to assess the urban ecological security of Tianjin, which is a typical coastal super megalopolis and the industry base in China. This case study highlights the key features of our approach. First, 39 representative indicators are selected for the evaluation index system from 62 alternative ones available through the GDHAS. Second, the DPSIR framework is established based on the indicators selected, and the quantitative assessment of the eco-security of Tianjin is conducted. The results illustrate the following: urban ecological security of Tianjin in 2008 was in alert level but not very stable; the driving force and pressure subsystems were in good condition, but the eco-security levels of the remainder of the subsystems were relatively low; the pressure subsystem was the key to urban ecological security; and 10 indicators are defined as the key indicators for five subsystems. These results can be used as the basis for urban eco-environmental management. PMID:23698700

Cross-cultural validity of standardized motor development screening and assessment tools: a systematic review.

PubMed

Mendonça, Bianca; Sargent, Barbara; Fetters, Linda

2016-12-01

To investigate whether standardized motor development screening and assessment tools that are used to evaluate motor abilities of children aged 0 to 2 years are valid in cultures other than those in which the normative sample was established. This was a systematic review in which six databases were searched. Studies were selected based on inclusion/exclusion criteria and appraised for evidence level and quality. Study variables were extracted. Twenty-three studies representing six motor development screening and assessment tools in 16 cultural contexts met the inclusion criteria: Alberta Infant Motor Scale (n=7), Ages and Stages Questionnaire, 3rd edition (n=2), Bayley Scales of Infant and Toddler Development, 3rd edition (n=8), Denver Developmental Screening Test, 2nd edition (n=4), Harris Infant Neuromotor Test (n=1), and Peabody Developmental Motor Scales, 2nd edition (n=1). Thirteen studies found significant differences between the cultural context and normative sample. Two studies established reliability and/or validity of standardized motor development assessments in high-risk infants from different cultural contexts. Five studies established new population norms. Eight studies described the cross-cultural adaptation of a standardized motor development assessment. Standardized motor development assessments have limited validity in cultures other than that in which the normative sample was established. Their use can result in under- or over-referral for services. © 2016 Mac Keith Press.

What is the quality of economic evaluations of non-drug therapies? A systematic review and critical appraisal of economic evaluations of radiotherapy for cancer.

PubMed

Barbieri, M; Weatherly, H L A; Ara, R; Basarir, H; Sculpher, M; Adams, R; Ahmed, H; Coles, C; Guerrero-Urbano, T; Nutting, C; Powell, M

2014-10-01

Breast, cervical and colorectal cancers are the three most frequent cancers in women, while lung, prostate and colorectal cancers are the most frequent in men. Much attention has been given to the economic evaluation of pharmaceuticals for treatment of cancer by the National Institute for Health and Care Excellence (NICE) in the UK and similar authorities internationally, while economic analysis developed for other types of anti-cancer interventions, including radiotherapy and surgery, are less common. Our objective was to review methods used in published cost-effectiveness studies evaluating radiotherapy for breast, cervical, colorectal, head and neck and prostate cancer, and to compare the economic evaluation methods applied with those defined in the guidelines used by the NICE technology appraisal programme. A systematic search of seven databases (MEDLINE, EMBASE, CDSR, NHSEED, HTA, DARE, EconLit) as well as research registers, the NICE website and conference proceedings was conducted in July 2012. Only economic evaluations of radiotherapy interventions in individuals diagnosed with cancer that included quality-adjusted life-years (QALYs) or life-years (LYs) were included. Included studies were appraised on the basis of satisfying essential, preferred and UK-specific methods requirements, building on the NICE Reference Case for economic evaluations and on other methods guidelines. A total of 29 studies satisfied the inclusion criteria (breast 14, colorectal 2, prostate 10, cervical 0, head and neck 3). Only two studies were conducted in the UK (13 in the USA). Among essential methods criteria, the main issue was that only three (10%) of the studies used clinical-effectiveness estimates identified through systematic review of the literature. Similarly, only eight (28%) studies sourced health-related quality-of-life data directly from patients with the condition of interest. Other essential criteria (e.g. clear description of comparators, patient group indication

A protocol for a systematic review of non-randomised evaluations of strategies to improve participant recruitment to randomised controlled trials.

PubMed

Gardner, Heidi R; Fraser, Cynthia; MacLennan, Graeme; Treweek, Shaun

2016-08-02

Randomised controlled trials guard against selection bias and therefore offer the fairest way of evaluating healthcare interventions such as medicinal products, devices and services. Recruitment to trials can be extremely difficult, and poor recruitment can lead to extensions to both time and budget and may result in an underpowered study which does not satisfactorily answer the original research question. In the worst cases, a trial may be abandoned, causing huge waste. The evidence to support the choice of recruitment interventions is currently weak. Non-randomised evaluations of recruitment interventions are currently rejected on grounds of poor methodological quality, but systematic evaluation and assessment of this substantial body of work (using Grading of Recommendations Assessment, Development and Evaluation (GRADE) where possible) may provide useful information to support and inform the recruitment decisions of trialists and the research priorities of methodology researchers. The following databases will be searched for relevant studies: Cochrane Methodology Register, MEDLINE, EMBASE, CINAHL and PsycINFO. Any non-randomised study that includes a comparison of two or more interventions to improve recruitment to randomised controlled trials will be included. We will not apply any restrictions on publication date, language or journal. The primary outcome will be the number of individuals or centres recruited into a randomised controlled trial. The secondary outcome will be cost per recruit. Two reviewers will independently screen abstracts for eligible studies, and then, full texts of potentially relevant records will be reviewed. Disagreements will be resolved through discussion. The methodological quality of studies will be assessed using the Cochrane risk of bias tool for non-randomised studies, and the GRADE system will be used if studies are pooled. This review aims to summarise the evidence on methods used to improve recruitment to randomised controlled

Dental Students' Use of AMSTAR to Critically Appraise Systematic Reviews.

PubMed

Teich, Sorin T; Heima, Masahiro; Lang, Lisa

2015-09-01

The idea of basing clinical procedures upon evidence gathered by observation is less than 200 years old, with the first set of evidence-based position papers dating back only to the early 1970s. The relationship between evidence-based education and health outcomes is difficult to test and may be indirect, but teaching critical appraisal skills may be beneficial in developing knowledge. Systematic reviews have a central role in the process of clinical decision making in practice and therefore should be of high quality, following a rigorous protocol that can be evaluated with validated tools. The aim of this study was to assess how dental students utilized the Assessment of Multiple Systematic Reviews (AMSTAR) appraisal tool to evaluate systematic reviews in the context of a treatment planning course. During the in-class final exam, students were required to appraise the quality of a systematic review and to justify their answers. Of the 74 third-year students who took the exam, 100% answered all questions on the AMSTAR form. The mean number of correct answers was nine (SD=1.047, Min=6, Max=10), with no student providing all 11 correct answers. The fact that nearly 90% of the students provided eight or more correct answers suggests that AMSTAR can be used by students to evaluate the methodological quality of systematic reviews. It also was evident that although the AMSTAR tool requires less than 15 minutes to complete an evaluation, using it requires extensive training and repetition to achieve consistent and reliable results.

The use of concept mapping in measurement development and evaluation: Application and future directions.

PubMed

Rosas, Scott R; Ridings, John W

2017-02-01

The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Degradable ketal-based block copolymer nanoparticles for anticancer drug delivery: a systematic evaluation.

PubMed

Louage, Benoit; Zhang, Qilu; Vanparijs, Nane; Voorhaar, Lenny; Vande Casteele, Sofie; Shi, Yang; Hennink, Wim E; Van Bocxlaer, Jan; Hoogenboom, Richard; De Geest, Bruno G

2015-01-12

Low solubility of potent (anticancer) drugs is a major driving force for the development of noncytotoxic, stimuli-responsive nanocarriers, including systems based on amphiphilic block copolymers. In this regard, we investigated the potential of block copolymers based on 2-hydroxyethyl acrylate (HEA) and the acid-sensitive ketal-containing monomer (2,2-dimethyl-1,3-dioxolane-4-yl)methyl acrylate (DMDMA) to form responsive drug nanocarriers. Block copolymers were successfully synthesized by sequential reversible addition-fragmentation chain transfer (RAFT) polymerization, in which we combined a hydrophilic poly(HEA)x block with a (responsive) hydrophobic poly(HEAm-co-DMDMAn)y copolymer block. The DMDMA content of the hydrophobic block was systematically varied to investigate the influence of polymer design on physicochemical properties and in vitro biological performance. We found that a DMDMA content higher than 11 mol % is required for self-assembly behavior in aqueous medium. All particles showed colloidal stability in PBS at 37 °C for at least 4 days, with sizes ranging from 23 to 338 nm, proportional to the block copolymer DMDMA content. Under acidic conditions, the nanoparticles decomposed into soluble unimers, of which the decomposition rate was inversely proportional to the block copolymer DMDMA content. Flow cytometry and confocal microscopy showed dose-dependent, active in vitro cellular uptake of the particles loaded with hydrophobic octadecyl rhodamine B chloride (R18). The block copolymers showed no intrinsic in vitro cytotoxicity, while loaded with paclitaxel (PTX), a significant decrease in cell viability was observed comparable or better than the two commercial PTX nanoformulations Abraxane and Genexol-PM at equal PTX dose. This systematic approach evaluated and showed the potential of these block copolymers as nanocarriers for hydrophobic drugs.

The cost of drug development: a systematic review.

PubMed

Morgan, Steve; Grootendorst, Paul; Lexchin, Joel; Cunningham, Colleen; Greyson, Devon

2011-04-01

We aimed to systematically review and assess published estimates of the cost of developing new drugs. We sought English language research articles containing original estimates of the cost of drug development that were published from 1980 to 2009, inclusive. We searched seven databases and used citation tracing and expert referral to identify studies. We abstracted qualifying studies for information about methods, data sources, study samples, and key results. Thirteen articles were found to meet our inclusion criteria. Estimates of the cost of drug development ranged more than 9-fold, from USD$92 million cash (USD$161 million capitalized) to USD$883.6 million cash (USD$1.8 billion capitalized). Differences in methods, data sources, and time periods explain some of the variation in estimates. Lack of transparency limits many studies. Confidential information provided by unnamed companies about unspecified products forms all or part of the data underlying 10 of the 13 studies. Despite three decades of research in this area, no published estimate of the cost of developing a drug can be considered a gold standard. Studies on this topic should be subjected to reasonable audit and disclosure of - at the very least - the drugs which authors purport to provide development cost estimates for. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Systematic review of measurement properties of self-reported instruments for evaluating self-care in adults.

PubMed

Matarese, Maria; Lommi, Marzia; De Marinis, Maria Grazia

2017-06-01

The aims of this study were as follows: to identify instruments developed to assess self-care in healthy adults; to determine the theory on which they were based; their validity and reliability properties and to synthesize the evidence on their measurement properties. Many instruments have been developed to assess self-care in many different populations and conditions. Clinicians and researchers should select the most appropriate self-care instrument based on the knowledge of their measurement properties. Systematic review of measurement instruments according to the protocol recommended by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. PubMed, Embase, PsycINFO, Scopus and CINAHL databases were searched from inception to December 2015. Studies testing measurement properties of self-report instruments assessing self-care in healthy adults, published in the English language and in peer review journals were selected. Two reviewers independently appraised the methodological quality of the studies with the COSMIN checklist and the quality of results using specific quality criteria. Twenty-six articles were included in the review testing the measurement properties of nine instruments. Seven instruments were based on Orem's Self-care theory. Not all the measurement properties were evaluated for the identified instruments. No self-care instrument showed strong evidence supporting the evaluated measurement properties. Despite the development of several instruments to assess self-care in the adult population, no instrument can be fully recommended to clinical nurses and researchers. Further studies of high methodological quality are needed to confirm the measurement properties of these instruments. © 2016 John Wiley & Sons Ltd.

SYSTEMATIC SCANNING ELECTRON MICROSCOPY TECHNIQUE FOR EVALUATING COMBINED BIOLOIGCAL/GRANULAR ACTIVATED CARBON TREATMENT PROCESSES

EPA Science Inventory

A systematic scanning election microscope analytical technique has been developed to examine granular activated carbon used a a medium for biomass attachment in liquid waste treatment. The procedure allows for the objective monitoring, comparing, and trouble shooting of combined ...

The Active plus protocol: systematic development of two theory- and evidence-based tailored physical activity interventions for the over-fifties.

PubMed

van Stralen, Maartje M; Kok, Gerjo; de Vries, Hein; Mudde, Aart N; Bolman, Catherine; Lechner, Lilian

2008-12-04

Limited data are available on the development, implementation and evaluation processes of physical activity promotion programmes among older adults. More integrative insights into interventions describing the planned systematic development, implementation and evaluation are needed. The purpose of this study is to give an integrative insight into the development of the Active plus programme applying the six-step Intervention Mapping protocol. The Active plus programme consisted of two theory- and evidence-based tailored physical activity promotion interventions, both comprising three tailored letters delivered over four months and aimed at raising awareness of insufficient physical activity, and stimulating physical activity initiation and maintenance among the over-fifties. The first intervention, the basic tailored intervention, provided tailored letters that intervened on the psychosocial determinants of physical activity. The second intervention, the intervention plus, provided the same tailored information but additionally provided tailored information about physical activity opportunities in the specific environment in which the older adults lived. This environment-based component also provided access to a forum and e-buddy system on a website. A plan for implementation and evaluation is also described. The planned development of the Active plus programme resulted in two theory- and evidence-based tailored physical activity interventions targeted at the over-fifties. Dutch Trial Register NTR 920.

What is actually measured in process evaluations for worksite health promotion programs: a systematic review

PubMed Central

2013-01-01

Background Numerous worksite health promotion program (WHPPs) have been implemented the past years to improve employees’ health and lifestyle (i.e., physical activity, nutrition, smoking, alcohol use and relaxation). Research primarily focused on the effectiveness of these WHPPs. Whereas process evaluations provide essential information necessary to improve large scale implementation across other settings. Therefore, this review aims to: (1) further our understanding of the quality of process evaluations alongside effect evaluations for WHPPs, (2) identify barriers/facilitators affecting implementation, and (3) explore the relationship between effectiveness and the implementation process. Methods Pubmed, EMBASE, PsycINFO, and Cochrane (controlled trials) were searched from 2000 to July 2012 for peer-reviewed (randomized) controlled trials published in English reporting on both the effectiveness and the implementation process of a WHPP focusing on physical activity, smoking cessation, alcohol use, healthy diet and/or relaxation at work, targeting employees aged 18-65 years. Results Of the 307 effect evaluations identified, twenty-two (7.2%) published an additional process evaluation and were included in this review. The results showed that eight of those studies based their process evaluation on a theoretical framework. The methodological quality of nine process evaluations was good. The most frequently reported process components were dose delivered and dose received. Over 50 different implementation barriers/facilitators were identified. The most frequently reported facilitator was strong management support. Lack of resources was the most frequently reported barrier. Seven studies examined the link between implementation and effectiveness. In general a positive association was found between fidelity, dose and the primary outcome of the program. Conclusions Process evaluations are not systematically performed alongside effectiveness studies for WHPPs. The quality

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE

Using a Systematic Approach to Develop a Chemistry Course Introducing Students to Instrumental Analysis

ERIC Educational Resources Information Center

Shen, Hao-Yu; Shen, Bo; Hardacre, Christopher

2013-01-01

A systematic approach to develop the teaching of instrumental analytical chemistry is discussed, as well as a conceptual framework for organizing and executing lectures and a laboratory course. Three main components are used in this course: theoretical knowledge developed in the classroom, simulations via a virtual laboratory, and practical…

Formative Evaluation of Lectures; An Application of Stake's Evaluation Framework.

ERIC Educational Resources Information Center

Westphal, Walter W.; And Others

The problem of major concern to the Physics Education Evaluation Project (P.E.E.P.) involved the improvement of university physics teaching and learning. The present paper describes instruments and procedures developed for systematic formative evaluation of physics lectures. The data was drawn from two sections of a first year university physics…

Economic evaluation of therapeutic cancer vaccines and immunotherapy: A systematic review

PubMed Central

Geynisman, Daniel M; Chien, Chun-Ru; Smieliauskas, Fabrice; Shen, Chan; Tina Shih, Ya-Chen

2014-01-01

Cancer immunotherapy is a rapidly growing field in oncology. One attractive feature of cancer immunotherapy is the purported combination of minimal toxicity and durable responses. However such treatments are often very expensive. Given the wide-spread concern over rising health care costs, it is important for all stakeholders to be well-informed on the cost and cost-effectiveness of cancer immunotherapies. We performed a comprehensive literature review of cost and cost-effectiveness research on therapeutic cancer vaccines and monoclonal antibodies, to better understand the economic impacts of these treatments. We summarized our literature searches into three tables by types of papers: systematic review of economic studies of a specific agent, cost and cost-effectiveness analysis. Our review showed that out of the sixteen immunotherapy agents approved, nine had relevant published economic studies. Five out of the nine studied immunotherapy agents had been covered in systematic reviews. Among those, only one (rituximab for non-Hodgkin lymphoma) was found to be cost-effective. Of the four immunotherapy drugs not covered in systematic reviews (alemtuzumab, ipilimumab, sipuleucel-T, ofatumumab), high incremental cost-effectiveness ratio (ICER) was reported for each. Many immunotherapies have not had economic evaluations, and those that have been studied show high ICERs or frank lack of cost-effectiveness. One major hurdle in improving the cost-effectiveness of cancer immunotherapies is to identify predictive biomarkers for selecting appropriate patients as recipients of these expensive therapies. We discuss the implications surrounding the economic factors involved in cancer immunotherapies and suggest that further research on cost and cost-effectiveness of newer cancer vaccines and immunotherapies are warranted as this is a rapidly growing field with many new drugs on the horizon. PMID:25483656

Economic evaluation in chronic pain: a systematic review and de novo flexible economic model.

PubMed

Sullivan, W; Hirst, M; Beard, S; Gladwell, D; Fagnani, F; López Bastida, J; Phillips, C; Dunlop, W C N

2016-07-01

There is unmet need in patients suffering from chronic pain, yet innovation may be impeded by the difficulty of justifying economic value in a field beset by data limitations and methodological variability. A systematic review was conducted to identify and summarise the key areas of variability and limitations in modelling approaches in the economic evaluation of treatments for chronic pain. The results of the literature review were then used to support the development of a fully flexible open-source economic model structure, designed to test structural and data assumptions and act as a reference for future modelling practice. The key model design themes identified from the systematic review included: time horizon; titration and stabilisation; number of treatment lines; choice/ordering of treatment; and the impact of parameter uncertainty (given reliance on expert opinion). Exploratory analyses using the model to compare a hypothetical novel therapy versus morphine as first-line treatments showed cost-effectiveness results to be sensitive to structural and data assumptions. Assumptions about the treatment pathway and choice of time horizon were key model drivers. Our results suggest structural model design and data assumptions may have driven previous cost-effectiveness results and ultimately decisions based on economic value. We therefore conclude that it is vital that future economic models in chronic pain are designed to be fully transparent and hope our open-source code is useful in order to aspire to a common approach to modelling pain that includes robust sensitivity analyses to test structural and parameter uncertainty.

Research Questions and Priorities for Tuberculosis: A Survey of Published Systematic Reviews and Meta-Analyses

PubMed Central

Nicolau, Ioana; Ling, Daphne; Tian, Lulu; Lienhardt, Christian; Pai, Madhukar

2012-01-01

Background Systematic reviews are increasingly informing policies in tuberculosis (TB) care and control. They may also be a source of questions for future research. As part of the process of developing the International Roadmap for TB Research, we did a systematic review of published systematic reviews on TB, to identify research priorities that are most frequently suggested in reviews. Methodology/Principal Findings We searched EMBASE, MEDLINE, Web of Science, and the Cochrane Library for systematic reviews and meta-analyses on any aspect of TB published between 2005 and 2010. One reviewer extracted data and a second reviewer independently extracted data from a random subset of included studies. In total, 137 systematic reviews, with 141 research questions, were included in this review. We used the UK Health Research Classification System (HRCS) to help us classify the research questions and priorities. The three most common research topics were in the area of detection, screening and diagnosis of TB (32.6%), development and evaluation of treatments and therapeutic interventions (23.4%), and TB aetiology and risk factors (19.9%). The research priorities determined were mainly focused on the discovery and evaluation of bacteriological TB tests and drug-resistant TB tests and immunological tests. Other important topics of future research were genetic susceptibility linked to TB and disease determinants attributed to HIV/TB. Evaluation of drug treatments for TB, drug-resistant TB and HIV/TB were also frequently proposed research topics. Conclusions Systematic reviews are a good source of key research priorities. Findings from our survey have informed the development of the International Roadmap for TB Research by the TB Research Movement. PMID:22848764

Microenterprise Development Interventions for Sexual Risk Reduction: A Systematic Review

PubMed Central

Lee, Ramon; Thirumurthy, Harsha; Muessig, Kathryn E.; Tucker, Joseph D.

2013-01-01

Comprehensive interventions that address both individual and structural determinants associated with HIV/STI risk are gaining increasing attention over the past decade. Microenterprise development offers an appealing model for HIV prevention by addressing poverty and gender equality. This study systematically reviewed the effects of microenterprise development interventions on HIV/STI incidence and sexual risk behaviors. Microenterprise development was defined as developing small business capacity among individuals to alleviate poverty. Seven eligible research studies representing five interventions were identified and included in this review. All of the studies targeted women, and three focused on sex workers. None measured biomarker outcomes. All three sex worker studies showed significant reduction in sexual risk behaviors when compared to the control group. Non-sex worker studies showed limited changes in sexual risk behavior. This review indicates the potential utility of microenterprise development in HIV risk reduction programs. More research is needed to determine how microenterprise development can be effectively incorporated in comprehensive HIV control strategies. PMID:23963497

Microenterprise development interventions for sexual risk reduction: a systematic review.

PubMed

Cui, Rosa R; Lee, Ramon; Thirumurthy, Harsha; Muessig, Kathryn E; Tucker, Joseph D

2013-11-01

Comprehensive interventions that address both individual and structural determinants associated with HIV/STI risk are gaining increasing attention over the past decade. Microenterprise development offers an appealing model for HIV prevention by addressing poverty and gender equality. This study systematically reviewed the effects of microenterprise development interventions on HIV/STI incidence and sexual risk behaviors. Microenterprise development was defined as developing small business capacity among individuals to alleviate poverty. Seven eligible research studies representing five interventions were identified and included in this review. All of the studies targeted women, and three focused on sex workers. None measured biomarker outcomes. All three sex worker studies showed significant reduction in sexual risk behaviors when compared to the control group. Non-sex worker studies showed limited changes in sexual risk behavior. This review indicates the potential utility of microenterprise development in HIV risk reduction programs. More research is needed to determine how microenterprise development can be effectively incorporated in comprehensive HIV control strategies.

Systematic profiling of spatiotemporal tissue and cellular stiffness in the developing brain.

PubMed

Iwashita, Misato; Kataoka, Noriyuki; Toida, Kazunori; Kosodo, Yoichi

2014-10-01

Accumulating evidence implicates the significance of the physical properties of the niche in influencing the behavior, growth and differentiation of stem cells. Among the physical properties, extracellular stiffness has been shown to have direct effects on fate determination in several cell types in vitro. However, little evidence exists concerning whether shifts in stiffness occur in vivo during tissue development. To address this question, we present a systematic strategy to evaluate the shift in stiffness in a developing tissue using the mouse embryonic cerebral cortex as an experimental model. We combined atomic force microscopy measurements of tissue and cellular stiffness with immunostaining of specific markers of neural differentiation to correlate the value of stiffness with the characteristic features of tissues and cells in the developing brain. We found that the stiffness of the ventricular and subventricular zones increases gradually during development. Furthermore, a peak in tissue stiffness appeared in the intermediate zone at E16.5. The stiffness of the cortical plate showed an initial increase but decreased at E18.5, although the cellular stiffness of neurons monotonically increased in association with the maturation of the microtubule cytoskeleton. These results indicate that tissue stiffness cannot be solely determined by the stiffness of the cells that constitute the tissue. Taken together, our method profiles the stiffness of living tissue and cells with defined characteristics and can therefore be utilized to further understand the role of stiffness as a physical factor that determines cell fate during the formation of the cerebral cortex and other tissues. © 2014. Published by The Company of Biologists Ltd.

Methods for the evaluation of hospital cooperation activities (Systematic review protocol).

PubMed

Rotter, Thomas; Popa, Daniela; Riley, Beatrice; Ellermann, Tim; Ryll, Ulrike; Burazeri, Genc; Daemen, Piet; Peeters, Guy; Brand, Helmut

2012-02-10

Hospital partnerships, mergers and cooperatives are arrangements frequently seen as a means of improving health service delivery. Many of the assumptions used in planning hospital cooperatives are not stated clearly and are often based on limited or poor scientific evidence. This is a protocol for a systematic review, following the Cochrane EPOC methodology. The review aims to document, catalogue and synthesize the existing literature on the reported methods for the evaluation of hospital cooperation activities as well as methods of hospital cooperation. We will search the Database of Abstracts of Reviews of Effectiveness, the Effective Practice and Organisation of Care Register, the Cochrane Central Register of Controlled Trials and bibliographic databases including PubMed (via NLM), Web of Science, NHS EED, Business Source Premier (via EBSCO) and Global Health for publications that report on methods for evaluating hospital cooperatives, strategic partnerships, mergers, alliances, networks and related activities and methods used for such partnerships. The method proposed by the Cochrane EPOC group regarding randomized study designs, controlled clinical trials, controlled before and after studies, and interrupted time series will be followed. In addition, we will also include cohort, case-control studies, and relevant non-comparative publications such as case reports. We will categorize and analyze the review findings according to the study design employed, the study quality (low versus high quality studies) and the method reported in the primary studies. We will present the results of studies in tabular form. Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin hospital cooperation activities as defined in this protocol. As a result, the review will provide an evidence base for partnerships, alliances or other fields of cooperation in a hospital setting. PROSPERO registration number: CRD42011001579.

Text mining for search term development in systematic reviewing: A discussion of some methods and challenges.

PubMed

Stansfield, Claire; O'Mara-Eves, Alison; Thomas, James

2017-09-01

Using text mining to aid the development of database search strings for topics described by diverse terminology has potential benefits for systematic reviews; however, methods and tools for accomplishing this are poorly covered in the research methods literature. We briefly review the literature on applications of text mining for search term development for systematic reviewing. We found that the tools can be used in 5 overarching ways: improving the precision of searches; identifying search terms to improve search sensitivity; aiding the translation of search strategies across databases; searching and screening within an integrated system; and developing objectively derived search strategies. Using a case study and selected examples, we then reflect on the utility of certain technologies (term frequency-inverse document frequency and Termine, term frequency, and clustering) in improving the precision and sensitivity of searches. Challenges in using these tools are discussed. The utility of these tools is influenced by the different capabilities of the tools, the way the tools are used, and the text that is analysed. Increased awareness of how the tools perform facilitates the further development of methods for their use in systematic reviews. Copyright © 2017 John Wiley & Sons, Ltd.

A parent advice package for family shopping trips: development and evaluation1

PubMed Central

Clark, Hewitt B.; Greene, Brandon F.; Macrae, John W.; McNees, M. Patrick; Davis, Jerry L.; Risley, Todd R.

1977-01-01

This article reports on the primary steps in the development of parent advice for popular dissemination: (a) developing advice for one specific problem situation, family shopping trips; (b) testing the advice program for benefit to children and convenience to adults; and (c) packaging the advice so it can be used successfully by interested parents. Systematic observation of 12 families using the written advice package on shopping trips revealed its effectiveness in reducing child disruptions and increasing positive interactions between parents and children. These findings, along with interview information from families, showed that the package is usable, effective, and popular with both parents and children, and thus is ready for dissemination to a wide audience of parents—a step that in itself should involve research and evaluation. PMID:16795570

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review.

PubMed

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti

2016-10-04

Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review

PubMed Central

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; De Marchi, Ana Carolina Bertoletti

2016-01-01

Background Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. Objective This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. Methods The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. Results In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user’s age and limitations. Conclusions Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for

The use of GRADE approach in systematic reviews of animal studies.

PubMed

Wei, Dang; Tang, Kun; Wang, Qi; Estill, Janne; Yao, Liang; Wang, Xiaoqin; Chen, Yaolong; Yang, Kehu

2016-03-15

The application of GRADE (Grading of Recommendations Assessment, Development and Evaluation) in SR of animal studies can promote the translation from bench to bedside. We aim to explore the use of GRADE in systematic reviews of animal studies. We used a theoretical analysis method to explore the use of GRADE in SR of animal studies and applied in a SR of animal studies. Meanwhile, we presented and discussed our results in two international conferences. Five downgrade factors were considered as follows in systematic reviews of animal studies: 1) Risk of bias: the SYRCLE tool can be used for assessing the risk of bias of animal studies. 2) Indirectness: we can assess indirectness in systematic reviews of animal studies from the PICO. 3) Inconsistency: similarity of point estimates, extent of overlap of confidence intervals and statistical heterogeneity are also suitable to evaluate inconsistency of evidence from animal studies. 4) Imprecision: optimal information size (OIS) and 95% confidence intervals (CIs) are also suitable for systematic reviews of animal studies, like those of clinical trials. 5) Publication bias: we need to consider publication bias comprehensively through the qualitative and quantitative methods. The methods about the use of GRADE in systematic review of animal studies are explicit. However, the principle about GRADE in developing the policy based on the evidence from animal studies when there is an emergency of public health. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Measurement properties of instruments evaluating self-care and related concepts in people with chronic obstructive pulmonary disease: A systematic review.

PubMed

Clari, Marco; Matarese, Maria; Alvaro, Rosaria; Piredda, Michela; De Marinis, Maria Grazia

2016-01-01

The use of valid and reliable instruments for assessing self-care is crucial for the evaluation of chronic obstructive pulmonary disease (COPD) management programs. The aim of this review is to evaluate the measurement properties and theoretical foundations of instruments for assessing self-care and related concepts in people with COPD. A systematic review was conducted of articles describing the development and validation of self-care instruments. The methodological quality of the measurement properties was assessed using the COSMIN checklist. Ten studies were included evaluating five instruments: three for assessing self-care and self-management and two for assessing self-efficacy. The COPD Self-Efficacy Scale was the most studied instrument, but due to poor study methodological quality, evidence about its measurement properties is inconclusive. Evidence from the COPD Self-Management Scale is more promising, but only one study tested its properties. Due to inconclusive evidence of their measurement properties, no instrument can be recommended for clinical use. Copyright © 2016 Elsevier Inc. All rights reserved.

A systematic review of studies evaluating diffusion and dissemination of selected cancer control interventions.

PubMed

Ellis, Peter; Robinson, Paula; Ciliska, Donna; Armour, Tanya; Brouwers, Melissa; O'Brien, Mary Ann; Sussman, Jonathan; Raina, Parminder

2005-09-01

With this review, the authors sought to determine what strategies have been evaluated (including the outcomes assessed) to disseminate cancer control interventions that promote the uptake of behavior change. Five topic areas along the cancer care continuum (smoking cessation, healthy diet, mammography, cervical cancer screening, and control of cancer pain) were selected to be representative. A systematic review was conducted of primary studies evaluating dissemination of a cancer control intervention. Thirty-one studies were identified that evaluated dissemination strategies in the 5 topic areas. No strong evidence currently exists to recommend any one dissemination strategy as effective in promoting the uptake of cancer control interventions. The authors conclude that there is a strong need for more research into dissemination of cancer control interventions. Future research should consider methodological issues such as the most appropriate study design and outcomes to be evaluated. (c) 2005 APA, all rights reserved

An evaluation of methods used to teach quality improvement to undergraduate healthcare students to inform curriculum development within preregistration nurse education: a protocol for systematic review and narrative synthesis.

PubMed

Armstrong, Lorraine; Lauder, William; Shepherd, Ashley

2015-01-14

Despite criticism, quality improvement (QI) continues to drive political and educational priorities within health care. Until recently, QI educational interventions have varied, targeting mainly postgraduates, middle management and the medical profession. However, there is now consensus within the UK, USA and beyond to integrate QI explicitly into nurse education, and faculties may require redesign of their QI curriculum to achieve this. Whilst growth in QI preregistration nurse education is emerging, little empirical evidence exists to determine such effects. Furthermore, previous healthcare studies evaluating QI educational interventions lend little in the way of support and have instead been subject to criticism. They reveal methodological weakness such as no reporting of theoretical underpinnings, insufficient intervention description, poor evaluation methods, little clinical or patient impact and lack of sustainability. This study aims therefore to identify, evaluate and synthesise teaching methods used within the undergraduate population to aid development of QI curriculum within preregistration nurse education. A systematic review of the literature will be conducted. Electronic databases, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Psychological Information (PsychINFO), Education Resources Information Centre (ERIC), Medical Literature Analysis and Retrieval System Online (MEDLINE) and Applied Social Sciences Index and Abstracts (ASSIA), will be searched alongside reference list scanning and a grey literature search. Peer-reviewed studies from 2000-2014 will be identified using key terms quality improvement, education, curriculum, training, undergraduate, teaching methods, students and evaluation. Studies describing a QI themed educational intervention aimed at undergraduate healthcare students will be included and data extracted using a modified version of the Reporting of Primary Studies in Education (REPOSE) Guidelines. Studies will

Approaches to health-care provider education and professional development in perinatal depression: a systematic review.

PubMed

Legere, Laura E; Wallace, Katherine; Bowen, Angela; McQueen, Karen; Montgomery, Phyllis; Evans, Marilyn

2017-07-24

Perinatal depression is the most common mental illness experienced by pregnant and postpartum women, yet it is often under-detected and under-treated. Some researchers suggest this may be partly influenced by a lack of education and professional development on perinatal depression among health-care providers, which can negatively affect care and contribute to stigmatization of women experiencing altered mood. Therefore, the aim of this systematic review is to provide a synthesis of educational and professional development needs and strategies for health-care providers in perinatal depression. A systematic search of the literature was conducted in seven academic health databases using selected keywords. The search was limited to primary studies and reviews published in English between January 2006 and May/June 2015, with a focus on perinatal depression education and professional development for health-care providers. Studies were screened for inclusion by two reviewers and tie-broken by a third. Studies that met inclusion criteria were quality appraised and data extracted. Results from the studies are reported through narrative synthesis. Two thousand one hundred five studies were returned from the search, with 1790 remaining after duplicate removal. Ultimately, 12 studies of moderate and weak quality met inclusion criteria. The studies encompassed quantitative (n = 11) and qualitative (n = 1) designs, none of which were reviews, and addressed educational needs identified by health-care providers (n = 5) and strategies for professional development in perinatal mental health (n = 7). Consistently, providers identified a lack of formal education in perinatal mental health and the need for further professional development. Although the professional development interventions were diverse, the majority focused on promoting identification of perinatal depression and demonstrated modest effectiveness in improving various outcomes. This systematic review reveals a

Strengthening Evaluation for Development

ERIC Educational Resources Information Center

Ofir, Zenda

2013-01-01

Although some argue that distinctions between "evaluation" and "development evaluation" are increasingly superfluous, it is important to recognize that some distinctions still matter. The severe vulnerabilities and power asymmetries inherent in most developing country systems and societies make the task of evaluation…

A systematic narrative review of consumer-directed care for older people: implications for model development.

PubMed

Ottmann, Goetz; Allen, Jacqui; Feldman, Peter

2013-11-01

Consumer-directed care is increasingly becoming a mainstream option in community-based aged care. However, a systematic review describing how the current evaluation research translates into practise has not been published to date. This review aimed to systematically establish an evidence base of user preferences for and satisfaction with services associated with consumer-directed care programmes for older people. Twelve databases were searched, including MedLine, BioMed Central, Cinahl, Expanded Academic ASAP, PsychInfo, ProQuest, Age Line, Science Direct, Social Citation Index, Sociological Abstracts, Web of Science and the Cochrane Library. Google Scholar and Google were also searched. Eligible studies were those reporting on choice, user preferences and service satisfaction outcomes regarding a programme or model of home-based care in the United States or United Kingdom. This systematic narrative review retrieved literature published from January 1992 to August 2011. A total of 277 references were identified. Of these 17 met the selection criteria and were reviewed. Findings indicate that older people report varying preferences for consumer-directed care with some demonstrating limited interest. Clients and carers reported good service satisfaction. However, research comparing user preferences across countries or investigating how ecological factors shape user preferences has received limited attention. Policy-makers and practitioners need to carefully consider the diverse contexts, needs and preferences of older adults in adopting consumer-directed care approaches in community aged care. The review calls for the development of consumer-directed care programmes offering a broad range of options that allow for personalisation and greater control over services without necessarily transferring the responsibility for administrative responsibilities to service users. Review findings suggest that consumer-directed care approaches have the potential to empower older

Moving toward the automation of the systematic review process: a summary of discussions at the second meeting of International Collaboration for the Automation of Systematic Reviews (ICASR).

PubMed

O'Connor, Annette M; Tsafnat, Guy; Gilbert, Stephen B; Thayer, Kristina A; Wolfe, Mary S

2018-01-09

The second meeting of the International Collaboration for Automation of Systematic Reviews (ICASR) was held 3-4 October 2016 in Philadelphia, Pennsylvania, USA. ICASR is an interdisciplinary group whose aim is to maximize the use of technology for conducting rapid, accurate, and efficient systematic reviews of scientific evidence. Having automated tools for systematic review should enable more transparent and timely review, maximizing the potential for identifying and translating research findings to practical application. The meeting brought together multiple stakeholder groups including users of summarized research, methodologists who explore production processes and systematic review quality, and technologists such as software developers, statisticians, and vendors. This diversity of participants was intended to ensure effective communication with numerous stakeholders about progress toward automation of systematic reviews and stimulate discussion about potential solutions to identified challenges. The meeting highlighted challenges, both simple and complex, and raised awareness among participants about ongoing efforts by various stakeholders. An outcome of this forum was to identify several short-term projects that participants felt would advance the automation of tasks in the systematic review workflow including (1) fostering better understanding about available tools, (2) developing validated datasets for testing new tools, (3) determining a standard method to facilitate interoperability of tools such as through an application programming interface or API, and (4) establishing criteria to evaluate the quality of tools' output. ICASR 2016 provided a beneficial forum to foster focused discussion about tool development and resources and reconfirm ICASR members' commitment toward systematic reviews' automation.

Social determinants of mental disorders and the Sustainable Development Goals: a systematic review of reviews.

PubMed

Lund, Crick; Brooke-Sumner, Carrie; Baingana, Florence; Baron, Emily Claire; Breuer, Erica; Chandra, Prabha; Haushofer, Johannes; Herrman, Helen; Jordans, Mark; Kieling, Christian; Medina-Mora, Maria Elena; Morgan, Ellen; Omigbodun, Olayinka; Tol, Wietse; Patel, Vikram; Saxena, Shekhar

2018-04-01

Mental health has been included in the UN Sustainable Development Goals. However, uncertainty exists about the extent to which the major social determinants of mental disorders are addressed by these goals. The aim of this study was to develop a conceptual framework for the social determinants of mental disorders that is aligned with the Sustainable Development Goals, to use this framework to systematically review evidence regarding these social determinants, and to identify potential mechanisms and targets for interventions. We did a systematic review of reviews using a conceptual framework comprising demographic, economic, neighbourhood, environmental events, and social and culture domains. We included 289 articles in the final Review. This study sheds new light on how the Sustainable Development Goals are relevant for addressing the social determinants of mental disorders, and how these goals could be optimised to prevent mental disorders. Copyright © 2018 Elsevier Ltd. All rights reserved.

Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review

PubMed Central

MacRury, Sandra; van Woerden, Hugo C; Smyth, Keith

2018-01-01

Background Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. Objective We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. Methods This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. Results The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge

Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review.

PubMed

Nicoll, Pam; MacRury, Sandra; van Woerden, Hugo C; Smyth, Keith

2018-04-11

Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner

The development and psychometrical evaluation of a set of instruments to evaluate the effectiveness of diabetes patient education.

PubMed

Duprez, Veerle; De Pover, Marleen; De Spiegelaere, Marc; Beeckman, Dimitri

2014-02-01

To develop a set of psychometrically sound instruments to assess knowledge, self-management and self-efficacy of diabetic patients. Furthermore, a survey to evaluate the satisfaction about diabetes education for patients was developed and tested. Treatment and secondary prevention of diabetes require a complex combination of care components. Patients' education has been accepted to improve diabetes knowledge, self-management and self-efficacy. Psychometrically sound instruments are needed to measure these patient-centred outcomes. Psychometric instrument validation. The first phase included a systematic literature review to develop the instruments. Content validity was evaluated using a two-round Delphi procedure involving diabetes experts. The content validity of the instruments was excellent. In a second phase, a convenience sample of 188 diabetic patients in two hospitals in one specific care region in Belgium participated in the psychometric evaluation. The criterion-related validity and internal consistency reliability were evaluated. The study produced a 21-item knowledge instrument, reflecting knowledge about 'glycemic control' and 'medico-social management aspects'. The self-management instrument included 32 statements, reflecting 'treatment and compliance' and 'general lifestyle'. The self-efficacy instrument included 30 items, reflecting 'nutrition', 'treatment' and 'regimen'. The patient satisfaction survey included 36 items, reflecting satisfaction about the relationship among the diabetes specialist, the diabetes educator, podiatrist and dietician. An instrument set with sound psychometric characteristics was developed to assess knowledge, self-management and self-efficacy of diabetic patients. Future studies should focus on the association between the instrument outcomes and clinical patient outcomes. The current instrument can support the design of educational interventions and training programmes and reduce inconsistencies in the information that

Clinical guidelines in the European Union: mapping the regulatory basis, development, quality control, implementation and evaluation across member states.

PubMed

Legido-Quigley, Helena; Panteli, Dimitra; Brusamento, Serena; Knai, Cécile; Saliba, Vanessa; Turk, Eva; Solé, Meritxell; Augustin, Uta; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

Clinical guidelines are advocated to improve the quality of care, especially for chronic diseases. However, the regulatory basis of clinical guidelines, their development, quality control, implementation and use as well as evaluation within countries across the European Union is not systematically known. Using information collected from key informants in each country by means of a structured questionnaire, this mapping exercise illustrates the varied status of guideline production in European Union countries. Most European Union countries have an established national, regional or local clinical guideline programme, and a substantial proportion have developed guidelines on the prevention and management of chronic diseases. Several countries have mechanisms in place to ensure the quality of scientific evidence used for the development of guidelines is high and that the process is consistent and transparent. Others are only now taking an interest in guideline development and are taking the first steps towards establishing ways of implementing them. The majority of countries have no legal basis for the development of guidelines and those that have well established systems mostly implement them on a voluntary basis. The process of guideline development varies in its degrees of decentralisation across countries with many different types of organisations taking on this responsibility. There is general acceptance of the value of the instrument developed by the AGREE collaboration for evaluating the methodological robustness of guidelines. However, the extent to which guidelines are implemented in Europe is unknown, as there is no systematic data collection and, in most countries, no structure to enable it. There are few examples of formal evaluations of the development, quality, implementation and use of guidelines. Our findings call for renewed efforts to respond to the severe lack of standardized guideline terminology and accessibility as well as rigorous studies to

The SPARK Tool to prioritise questions for systematic reviews in health policy and systems research: development and initial validation.

PubMed

Akl, Elie A; Fadlallah, Racha; Ghandour, Lilian; Kdouh, Ola; Langlois, Etienne; Lavis, John N; Schünemann, Holger; El-Jardali, Fadi

2017-09-04

Groups or institutions funding or conducting systematic reviews in health policy and systems research (HPSR) should prioritise topics according to the needs of policymakers and stakeholders. The aim of this study was to develop and validate a tool to prioritise questions for systematic reviews in HPSR. We developed the tool following a four-step approach consisting of (1) the definition of the purpose and scope of tool, (2) item generation and reduction, (3) testing for content and face validity, (4) and pilot testing of the tool. The research team involved international experts in HPSR, systematic review methodology and tool development, led by the Center for Systematic Reviews on Health Policy and Systems Research (SPARK). We followed an inclusive approach in determining the final selection of items to allow customisation to the user's needs. The purpose of the SPARK tool was to prioritise questions in HPSR in order to address them in systematic reviews. In the item generation and reduction phase, an extensive literature search yielded 40 relevant articles, which were reviewed by the research team to create a preliminary list of 19 candidate items for inclusion in the tool. As part of testing for content and face validity, input from international experts led to the refining, changing, merging and addition of new items, and to organisation of the tool into two modules. Following pilot testing, we finalised the tool, with 22 items organised in two modules - the first module including 13 items to be rated by policymakers and stakeholders, and the second including 9 items to be rated by systematic review teams. Users can customise the tool to their needs, by omitting items that may not be applicable to their settings. We also developed a user manual that provides guidance on how to use the SPARK tool, along with signaling questions. We have developed and conducted initial validation of the SPARK tool to prioritise questions for systematic reviews in HPSR, along with

Evaluation of Game Engines for Cross-Platform Development of Mobile Serious Games for Health.

PubMed

Kleinschmidt, Carina; Haag, Martin

2016-01-01

Studies have shown that serious games for health can improve patient compliance and help to increase the quality of medical education. Due to a growing availability of mobile devices, especially the development of cross-platform mobile apps is helpful for improving healthcare. As the development can be highly time-consuming and expensive, an alternative development process is needed. Game engines are expected to simplify this process. Therefore, this article examines the question whether using game engines for cross-platform serious games for health can simplify the development compared to the development of a plain HTML5 app. At first, a systematic review of the literature was conducted in different databases (MEDLINE, ACM and IEEE). Afterwards three different game engines were chosen, evaluated in different categories and compared to the development of a HTML5 app. This was realized by implementing a prototypical application in the different engines and conducting a utility analysis. The evaluation shows that the Marmalade engine is the best choice for development in this scenario. Furthermore, it is obvious that the game engines have great benefits against plain HTML5 development as they provide components for graphics, physics, sounds, etc. The authors recommend to use the Marmalade Engine for a cross-platform mobile Serious Game for Health.

Development and evaluation of an audiovisual information resource to promote self-management of chemotherapy side-effects.

PubMed

Carey, Mariko; Jefford, Michael; Schofield, Penelope; Kelly, Siobhan; Krishnasamy, Meinir; Aranda, Sanchia

2006-04-01

Based on a theoretical framework, we developed an audiovisual resource to promote self-management of eight common chemotherapy side-effects. A patient needs analysis identified content domains, best evidence for preparing patients for threatening medical procedures and a systematic review of effective self-care strategies informed script content. Patients and health professionals were invited to complete a written evaluation of the video. A 25-min video was produced. Fifty health professionals and 37 patients completed the evaluation. All considered the video informative and easy to understand. The majority believed the video would reduce anxiety and help patients prepare for chemotherapy. Underpinned by a robust theoretical framework, we have developed an evidence-based resource that is perceived by both patients and health professionals as likely to enhance preparedness for chemotherapy.

Measuring treatment outcomes in gambling disorders: a systematic review.

PubMed

Pickering, Dylan; Keen, Brittany; Entwistle, Gavin; Blaszczynski, Alex

2018-03-01

Considerable variation of outcome variables used to measure recovery in the gambling treatment literature has precluded effective cross-study evaluations and hindered the development of best-practice treatment methodologies. The aim of this systematic review was to describe current diffuse concepts of recovery in the gambling field by mapping the range of outcomes and measurement strategies used to evaluate treatments, and to identify more commonly accepted indices of recovery. A systematic search of six academic databases for studies evaluating treatments (psychological and pharmacological) for gambling disorders with a minimum 6-month follow-up. Data from eligible studies were tabulated and analysis conducted using a narrative approach. Guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) were adhered to. Thirty-four studies were reviewed systematically (RCTs = 17, comparative designs = 17). Sixty-three different outcome measures were identified: 25 (39.7%) assessed gambling-specific constructs, 36 (57.1%) assessed non-gambling specific constructs, and two instruments were used across both categories (3.2%). Self-report instruments ranged from psychometrically validated to ad-hoc author-designed questionnaires. Units of measurement were inconsistent, particularly in the assessment of gambling behaviour. All studies assessed indices of gambling behaviour and/or symptoms of gambling disorder. Almost all studies (n = 30; 88.2%) included secondary measures relating to psychiatric comorbidities, psychological processes linked to treatment approach, or global functioning and wellbeing. In research on gambling disorders, the incorporation of broader outcome domains that extend beyond disorder-specific symptoms and behaviours suggests a multi-dimensional conceptualization of recovery. Development of a single comprehensive scale to measure all aspects of gambling recovery could help to facilitate uniform reporting practices

NatHER: protocol for systematic evaluation of trends in survival among patients with HER2-positive advanced breast cancer.

PubMed

Korner, Eli J; Morris, Anne; Allen, Isabel Elaine; Hurvitz, Sara; Beattie, Mary S; Kalesan, Bindu

2015-10-01

Human epidermal growth factor receptor 2 (HER2)-positive metastatic breast cancer (MBC) is an aggressive form of breast cancer and is historically associated with poor outcomes compared with HER2-negative MBC. Since 1998, four drugs have been globally approved for the targeted treatment of HER2-positive MBC. Additional advances in patient care-such as improved breast cancer screening, HER2 testing, and supportive care-have also occurred. The objective of this systematic review and meta-analysis is to determine whether there has been a cumulative change in survival over time in patients with HER2-positive advanced breast cancer based on results from interventional clinical trials (ICTs) and observational studies and to compare outcomes across these types of studies. A systematic search of Medline, EMBASE, and the Cochrane Central Register of Controlled Trials will be performed. Two investigators will independently assess each abstract for inclusion. English language reports of ICTs and observational studies that include patients with HER2-positive advanced breast cancer from 1987 onwards will be considered. The primary outcome of interest is overall survival; secondary outcomes include progression-free survival and safety. Data on clinical outcomes, as well as on study design, study population, treatment/intervention, methodological quality, and outcomes, will be extracted using a structured codebook developed by the authors for this study. Standard and cumulative random effects meta-analysis will be performed to derive pooled risk estimates, both overall and by study design, controlling for covariates such as aggregate demographic and clinical characteristics of patients, treatment/intervention, and study characteristics. Heterogeneity of studies will be evaluated using the I(2) statistic. Differences in risk estimates by quality characteristics will be performed using meta-regression. This study will evaluate current and evolving trends in survival associated with

Methodological quality evaluation of systematic reviews or meta-analyses on ERCC1 in non-small cell lung cancer: a systematic review.

PubMed

Tao, Huan; Zhang, Yueyuan; Li, Qian; Chen, Jin

2017-11-01

To assess the methodological quality of systematic reviews (SRs) or meta-analysis concerning the predictive value of ERCC1 in platinum chemotherapy of non-small cell lung cancer. We searched the PubMed, EMbase, Cochrane library, international prospective register of systematic reviews, Chinese BioMedical Literature Database, China National Knowledge Infrastructure, Wan Fang and VIP database for SRs or meta-analysis. The methodological quality of included literatures was evaluated by risk of bias in systematic review (ROBIS) scale. Nineteen eligible SRs/meta-analysis were included. The most frequently searched databases were EMbase (74%), PubMed, Medline and CNKI. Fifteen SRs did additional retrieval manually, but none of them retrieved the registration platform. 47% described the two-reviewers model in the screening for eligible original articles, and seven SRs described the two reviewers to extract data. In methodological quality assessment, inter-rater reliability Kappa was 0.87 between two reviewers. Research question were well related to all SRs in phase 1 and the eligibility criteria was suitable for each SR, and rated as 'low' risk bias. But the 'high' risk bias existed in all the SRs regarding methods used to identify and/or select studies, and data collection and study appraisal. More than two-third of SRs or meta-analysis were finished with high risk of bias in the synthesis, findings and the final phase. The study demonstrated poor methodological quality of SRs/meta-analysis assessing the predictive value of ERCC1 in chemotherapy among the NSCLC patients, especially the high performance bias. Registration or publishing the protocol is recommended in future research.

Diverse approaches to the health economic evaluation of bariatric surgery: a comprehensive systematic review.

PubMed

Campbell, J A; Venn, A; Neil, A; Hensher, M; Sharman, M; Palmer, A J

2016-09-01

Health economic evaluations inform healthcare resource allocation decisions for treatment options for obesity including bariatric/metabolic surgery. As an important advance on existing systematic reviews, we aimed to capture, summarize and synthesize a diverse range of economic evaluations on bariatric surgery. Studies were identified by electronic screening of all major biomedical/economic databases. Studies included if they reported any quantified health economic cost and/or consequence with a measure of effect for any type of bariatric surgery from 1995 to September 2015. Study screening, data extraction and synthesis followed international guidelines for systematic reviews. Six thousand one hundred eighty-seven studies were initially identified. After two levels of screening, 77 studies representing 17 countries (56% USA) were included. Despite study heterogeneity, common themes emerged, and important gaps were identified. Most studies adopted the healthcare system/third-party payer perspective; reported costs were generally healthcare resource use (inpatient/shorter-term outpatient). Out-of-pocket costs to individuals, family members (travel time, caregiving) and indirect costs due to lost productivity were largely ignored. Costs due to reoperations/complications were not included in one-third of studies. Body-contouring surgery included in only 14%. One study evaluated long-term waitlisted patients. Surgery was cost-effective/cost-saving for severely obese with type 2 diabetes mellitus. Study quality was inconsistent. There is a need for studies that assume a broader societal perspective (including out-of-pocket costs, costs to family and productivity losses) and longer-term costs (capture reoperations/complications, waiting, body contouring), and consequences (health-related quality-of-life). Full economic evaluation underpinned by reporting standards should inform prioritization of patients (e.g. type 2 diabetes mellitus with body mass index 30 to 34.9�

Underrepresented minority faculty in academic medicine: a systematic review of URM faculty development.

PubMed

Rodriguez, José E; Campbell, Kendall M; Fogarty, John P; Williams, Roxann L

2014-02-01

Retention and recruitment of minority faculty members continues to be a concern of medical schools because there is higher attrition and talent loss among this group. While much has been written, there has not been a systematic review published on this topic. This is the first study to use evidence-based medicine (EBM) criteria and apply it to this issue. We searched MEDLINE, Web of Knowledge, ProQuest, and Google Scholar for papers relating to the recruitment and retention of minority faculty. We then graded the evidence using the EBM criteria as defined by the American Academy of Family Physicians. The same criteria were applied to extract evidence-based observations of problems in recruitment and retention for minority faculty. Of the 548 studies identified and reviewed, 11 met inclusion criteria for this literature review. This article presents the data from the reviewed papers that described or evaluated minority faculty development programs. Faculty development programs in 15 different institutions showed mentoring and faculty development for minority faculty could increase retention, academic productivity, and promotion rates for this group. For medical schools to be successful in retention and recruitment of minority medical school faculty, specific programs need to be in place. Overall evidence is strong that faculty development programs and mentoring programs increase retention, productivity, and promotion for this group of medical faculty. This paper is a call to action for more faculty development and mentorship programs to reduce the disparities that exist between minority faculty and all other faculty members.

An integrated approach for the systematic evaluation of polymeric nanoparticles in healthy and diseased organisms

NASA Astrophysics Data System (ADS)

Sitia, Leopoldo; Paolella, Katia; Romano, Michela; Violatto, Martina Bruna; Ferrari, Raffaele; Fumagalli, Stefano; Colombo, Laura; Bello, Ezia; De Simoni, Maria Grazia; D'Incalci, Maurizio; Morbidelli, Massimo; Erba, Eugenio; Salmona, Mario; Moscatelli, Davide; Bigini, Paolo

2014-07-01

Innovative strategies that utilize nanoparticles (NPs) for a better delivery of drugs and to improve their therapeutic efficacy have been widely studied in many clinical fields, including oncology. To develop safe and reliable devices able to reach their therapeutic target, a hierarchical characterization of NP interactions with biological fluids, cells, and whole organisms is fundamental. Unfortunately, this aspect is often neglected and the development of standardized characterization methods would be of fundamental help to better elucidate the potentials of nanomaterials, even before the loading of the drugs. Here, we propose a multimodal in vitro/in vivo/ex vivo platform aimed at evaluating these interactions for the selection of the most promising NPs among a wide series of materials. To set the system, we used non-degradable fluorescent poly(methyl-methacrylate) NPs of different sizes (50, 100, and 200 nm) and surface charges (positive and negative). First we studied NP stability in biological fluids. Then, we evaluated NP interaction with two cell lines of triple-negative breast cancer (TNBC), 4T1, and MDA-MB231.1833, respectively. We found that NPs internalize in TNBC cells depending on their physico-chemical properties without toxic effects. Finally, we studied NP biodistribution in terms of tissue migration and progressive clearance in breast-cancer bearing mice. The use of highly stable poly(methyl-methacrylate) NPs enabled us to track them for a long time in cells and animals. The application of this platform to other nanomaterials could provide innovative suggestions for the development of a systematic method of characterization to select the most reliable nanodrug candidates for biomedical applications.

Development and evaluation of the INSPIRE measure of staff support for personal recovery.

PubMed

Williams, Julie; Leamy, Mary; Bird, Victoria; Le Boutillier, Clair; Norton, Sam; Pesola, Francesca; Slade, Mike

2015-05-01

No individualised standardised measure of staff support for mental health recovery exists. To develop and evaluate a measure of staff support for recovery. initial draft of measure based on systematic review of recovery processes; consultation (n = 61); and piloting (n = 20). Psychometric evaluation: three rounds of data collection from mental health service users (n = 92). INSPIRE has two sub-scales. The 20-item Support sub-scale has convergent validity (0.60) and adequate sensitivity to change. Exploratory factor analysis (variance 71.4-85.1 %, Kaiser-Meyer-Olkin 0.65-0.78) and internal consistency (range 0.82-0.85) indicate each recovery domain is adequately assessed. The 7-item Relationship sub-scale has convergent validity 0.69, test-retest reliability 0.75, internal consistency 0.89, a one-factor solution (variance 70.5 %, KMO 0.84) and adequate sensitivity to change. A 5-item Brief INSPIRE was also evaluated. INSPIRE and Brief INSPIRE demonstrate adequate psychometric properties, and can be recommended for research and clinical use.

Agriculture, food, and nutrition interventions that facilitate sustainable food production and impact health: an overview of systematic reviews.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Galvão, Luiz A C

2016-08-01

Objectives To identify the agriculture, food, and nutrition security interventions that facilitate sustainable food production and have a positive impact on health. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations through a comprehensive search of 17 databases and 10 websites. The search employed a pre-defined protocol with clear inclusion criteria. Both grey and peer-reviewed literature published in English, Spanish, and Portuguese between 1 January 1997 and November 2013 were included. To classify as "sustainable," interventions needed to aim to positively impact at least two dimensions of the integrated framework for sustainable development and include measures of health impact. Results Fifteen systematic reviews and seven economic evaluations met the inclusion criteria. All interventions had some impact on health or on risk factors for health outcomes, except those related to genetically modified foods. Impact on health inequalities was rarely measured. All interventions with economic evaluations were very cost-effective, had cost savings, or net benefits. In addition to impacting health (inclusive social development), all interventions had the potential to impact on inclusive economic development, and some, on environmental sustainability, though these effects were rarely assessed. Conclusions What is needed now is careful implementation of interventions with expected positive health impacts but with concurrent, rigorous evaluation. Possible impact on health inequalities needs to be considered and measured by future primary studies and systematic reviews, as does impact of interventions on all dimensions of sustainable development.

A research project to develop and evaluate a technical education component on materials technology for orientation to space-age technology

NASA Technical Reports Server (NTRS)

Jacobs, J. A.

1976-01-01

A project was initiated to develop, implement, and evaluate a prototype component for self-pacing, individualized instruction on basic materials science. Results of this project indicate that systematically developed, self-paced instruction provides an effective means for orienting nontraditional college students and secondary students, especially minorities, to both engineering technology and basic materials science. In addition, students using such a system gain greater chances for mastering subject matter than with conventional modes of instruction.

Clostridium difficile infection in low- and middle-human development index countries: a systematic review.

PubMed

Forrester, Joseph D; Cai, Lawrence Z; Mbanje, Chenesa; Rinderknecht, Tanya N; Wren, Sherry M

2017-10-01

To describe the impact and epidemiology of Clostridium difficile infection (CDI) in low- and middle-human development index (LMHDI) countries. Prospectively registered, systematic literature review of existing literature in the PubMed, Ovid and Web of Science databases describing the epidemiology and management of C. difficile in LMHDI countries. Risk factors were compared between studies when available. Of the 218 abstracts identified after applying search criteria, 25 studies were reviewed in detail. The weighted pooled infection rate among symptomatic non-immunosuppressed inpatients was 15.8% (95% CI 12.1-19.5%) and was 10.1% (95% CI 3.0-17.2%) among symptomatic outpatients. Subgroup analysis of immunosuppressed patient populations revealed pooled infection rates similar to non-immunosuppressed patient populations. Risk factor analysis was infrequently performed. While the percentages of patients with CDI in LMHDI countries among the reviewed studies are lower than expected, there remains a paucity of epidemiologic data evaluating burden of C. difficile infection in these settings. © 2017 John Wiley & Sons Ltd.

Developing a systematic evaluation approach for training programs within a train-the-trainer model for youth cognitive behavior therapy.

PubMed

Nakamura, Brad J; Selbo-Bruns, Alexandra; Okamura, Kelsie; Chang, Jaime; Slavin, Lesley; Shimabukuro, Scott

2014-02-01

The purpose of this small pilot study was three-fold: (a) to begin development of a coding scheme for supervisor and therapist skill acquisition, (b) to preliminarily investigate a pilot train-the-trainer paradigm for skill development, and (c) to evaluate self-reported versus observed indicators of skill mastery in that pilot program. Participants included four supervisor-therapist dyads (N = 8) working with public mental health sector youth. Master trainers taught cognitive-behavioral therapy techniques to supervisors, who in turn trained therapists on these techniques. Supervisor and therapist skill acquisition and supervisor use of teaching strategies were repeatedly assessed through coding of scripted role-plays with a multiple-baseline across participants and behaviors design. The coding system, the Practice Element Train the Trainer - Supervisor/Therapist Versions of the Therapy Process Observational Coding System for Child Psychotherapy, was developed and evaluated though the course of the investigation. The coding scheme demonstrated excellent reliability (ICCs [1,2] = 0.81-0.91) across 168 video recordings. As calculated through within-subject effect sizes, supervisor and therapist participants, respectively, evidenced skill improvements related to teaching and performing therapy techniques. Self-reported indicators of skill mastery were inflated in comparison to observed skill mastery. Findings lend initial support for further developing an evaluative approach for a train-the-trainer effort focused on disseminating evidence-based practices. Published by Elsevier Ltd.

Multitask protocols to evaluate activities of daily living performance in people with COPD: a systematic review.

PubMed

Paes, Thaís; Machado, Felipe Vilaça Cavallari; Cavalheri, Vinícius; Pitta, Fabio; Hernandes, Nidia Aparecida

2017-07-01

People with chronic obstructive pulmonary disease (COPD) present symptoms such as dyspnea and fatigue, which hinder their performance in activities of daily living (ADL). A few multitask protocols have been developed to assess ADL performance in this population, although measurement properties of such protocols were not yet systematically reviewed. Areas covered: Studies were included if an assessment of the ability to perform ADL was conducted in people with COPD using a (objective) performance-based protocol. The search was conducted in the following databases: Pubmed, EMBASE, Cochrane Library, PEDro, CINAHL and LILACS. Furthermore, hand searches were conducted. Expert commentary: Up to this moment, only three protocols had measurement properties described: the Glittre ADL Test, the Monitored Functional Task Evaluation and the Londrina ADL Protocol were shown to be valid and reliable whereas only the Glittre ADL Test was shown to be responsive to change after pulmonary rehabilitation. These protocols can be used in laboratory settings and clinical practice to evaluate ADL performance in people with COPD, although there is need for more in-depth information on their validity, reliability and especially responsiveness due to the growing interest in the accurate assessment of ADL performance in this population.

Development and evaluation of an off-the-slide genotyping technique for identifying Giardia cysts and Cryptosporidium oocysts directly from US EPA Method 1623 slides

EPA Science Inventory

ABSTRACT Aims This study developed and systematically evaluated performance and limit of detection of an off-the-slide genotyping procedure for both Cryptosporidium oocysts and Giardia cysts. Methods and Results Slide standards containing flow sorted (oo)cysts were used to e...

Algorithms for network-based identification of differential regulators from transcriptome data: a systematic evaluation

PubMed Central

Hui, YU; Ramkrishna, MITRA; Jing, YANG; YuanYuan, LI; ZhongMing, ZHAO

2016-01-01

Identification of differential regulators is critical to understand the dynamics of cellular systems and molecular mechanisms of diseases. Several computational algorithms have recently been developed for this purpose by using transcriptome and network data. However, it remains largely unclear which algorithm performs better under a specific condition. Such knowledge is important for both appropriate application and future enhancement of these algorithms. Here, we systematically evaluated seven main algorithms (TED, TDD, TFactS, RIF1, RIF2, dCSA_t2t, and dCSA_r2t), using both simulated and real datasets. In our simulation evaluation, we artificially inactivated either a single regulator or multiple regulators and examined how well each algorithm detected known gold standard regulators. We found that all these algorithms could effectively discern signals arising from regulatory network differences, indicating the validity of our simulation schema. Among the seven tested algorithms, TED and TFactS were placed first and second when both discrimination accuracy and robustness against data variation were considered. When applied to two independent lung cancer datasets, both TED and TFactS replicated a substantial fraction of their respective differential regulators. Since TED and TFactS rely on two distinct features of transcriptome data, namely differential co-expression and differential expression, both may be applied as mutual references during practical application. PMID:25326829

Calculation of the detection limit in radiation measurements with systematic uncertainties

NASA Astrophysics Data System (ADS)

Kirkpatrick, J. M.; Russ, W.; Venkataraman, R.; Young, B. M.

2015-06-01

The detection limit (LD) or Minimum Detectable Activity (MDA) is an a priori evaluation of assay sensitivity intended to quantify the suitability of an instrument or measurement arrangement for the needs of a given application. Traditional approaches as pioneered by Currie rely on Gaussian approximations to yield simple, closed-form solutions, and neglect the effects of systematic uncertainties in the instrument calibration. These approximations are applicable over a wide range of applications, but are of limited use in low-count applications, when high confidence values are required, or when systematic uncertainties are significant. One proposed modification to the Currie formulation attempts account for systematic uncertainties within a Gaussian framework. We have previously shown that this approach results in an approximation formula that works best only for small values of the relative systematic uncertainty, for which the modification of Currie's method is the least necessary, and that it significantly overestimates the detection limit or gives infinite or otherwise non-physical results for larger systematic uncertainties where such a correction would be the most useful. We have developed an alternative approach for calculating detection limits based on realistic statistical modeling of the counting distributions which accurately represents statistical and systematic uncertainties. Instead of a closed form solution, numerical and iterative methods are used to evaluate the result. Accurate detection limits can be obtained by this method for the general case.

Systematic evaluation of sericin protein as a substitute for fetal bovine serum in cell culture.

PubMed

Liu, Liyuan; Wang, Jinhuan; Duan, Shengchang; Chen, Lei; Xiang, Hui; Dong, Yang; Wang, Wen

2016-08-17

Fetal bovine serum (FBS) shows obvious deficiencies in cell culture, such as low batch to batch consistency, adventitious biological contaminant risk, and high cost, which severely limit the development of the cell culture industry. Sericin protein derived from the silkworm cocoon has become increasingly popular due to its diverse and beneficial cell culture characteristics. However, systematic evaluation of sericin as a substitute for FBS in cell culture medium remains limited. In this study, we conducted cellular morphological, physiological, and transcriptomic evaluation on three widely used mammalian cells. Compared with cells cultured in the control, those cultured in sericin-substitute medium showed similar cellular morphology, similar or higher cellular overall survival, lower population doubling time (PDT), and a higher percentage of S-phase with similar G2/G1 ratio, indicating comparable or better cell growth and proliferation. At the transcriptomic level, differentially expressed genes between cells in the two media were mainly enriched in function and biological processes related to cell growth and proliferation, reflecting that genes were activated to facilitate cell growth and proliferation. The results of this study suggest that cells cultured in sericin-substituted medium perform as well as, or even better than, those cultured in FBS-containing medium.

Systematic evaluation of sericin protein as a substitute for fetal bovine serum in cell culture

PubMed Central

Liu, Liyuan; Wang, Jinhuan; Duan, Shengchang; Chen, Lei; Xiang, Hui; Dong, Yang; Wang, Wen

2016-01-01

Fetal bovine serum (FBS) shows obvious deficiencies in cell culture, such as low batch to batch consistency, adventitious biological contaminant risk, and high cost, which severely limit the development of the cell culture industry. Sericin protein derived from the silkworm cocoon has become increasingly popular due to its diverse and beneficial cell culture characteristics. However, systematic evaluation of sericin as a substitute for FBS in cell culture medium remains limited. In this study, we conducted cellular morphological, physiological, and transcriptomic evaluation on three widely used mammalian cells. Compared with cells cultured in the control, those cultured in sericin-substitute medium showed similar cellular morphology, similar or higher cellular overall survival, lower population doubling time (PDT), and a higher percentage of S-phase with similar G2/G1 ratio, indicating comparable or better cell growth and proliferation. At the transcriptomic level, differentially expressed genes between cells in the two media were mainly enriched in function and biological processes related to cell growth and proliferation, reflecting that genes were activated to facilitate cell growth and proliferation. The results of this study suggest that cells cultured in sericin-substituted medium perform as well as, or even better than, those cultured in FBS-containing medium. PMID:27531556

[The use of systematic review to develop a self-management program for CKD].

PubMed

Lee, Yu-Chin; Wu, Shu-Fang Vivienne; Lee, Mei-Chen; Chen, Fu-An; Yao, Yen-Hong; Wang, Chin-Ling

2014-12-01

Chronic kidney disease (CKD) has become a public health issue of international concern due to its high prevalence. The concept of self-management has been comprehensively applied in education programs that address chronic diseases. In recent years, many studies have used self-management programs in CKD interventions and have investigated the pre- and post-intervention physiological and psychological effectiveness of this approach. However, a complete clinical application program in the self-management model has yet to be developed for use in clinical renal care settings. A systematic review is used to develop a self-management program for CKD. Three implementation steps were used in this study. These steps include: (1) A systematic literature search and review using databases including CEPS (Chinese Electronic Periodical Services) of Airiti, National Digital Library of Theses and Dissertations in Taiwan, CINAHL, Pubmed, Medline, Cochrane Library, and Joanna Briggs Institute. A total of 22 studies were identified as valid and submitted to rigorous analysis. Of these, 4 were systematic literature reviews, 10 were randomized experimental studies, and 8 were non-randomized experimental studies. (2) Empirical evidence then was used to draft relevant guidelines on clinical application. (3) Finally, expert panels tested the validity of the draft to ensure the final version was valid for application in practice. This study designed a self-management program for CKD based on the findings of empirical studies. The content of this program included: design principles, categories, elements, and the intervention measures used in the self-management program. This program and then was assessed using the content validity index (CVI) and a four-point Liker's scale. The content validity score was .98. The guideline of self-management program to CKD was thus developed. This study developed a self-management program applicable to local care of CKD. It is hoped that the guidelines

New developments for determination of uncertainty in phase evaluation

NASA Astrophysics Data System (ADS)

Liu, Sheng

Phase evaluation exists mostly in, but not limited to, interferometric applications that utilize coherent multidimensional signals to modulate the physical quantity of interest into a nonlinear form, represented by repeating the phase modulo of 271 radians. In order to estimate the underlying physical quantity, the wrapped phase has to be unwrapped by an evaluation procedure which is usually called phase unwrapping. The procedure of phase unwrapping will obviously face the challenge of inconsistent phase, which could bring errors in phase evaluation. The main objectives of this research include addressing the problem of inconsistent phase in phase unwrapping and applications in modern optical techniques. In this research, a new phase unwrapping algorithm is developed. The creative idea of doing phase unwrapping between regions has an advantage over conventional pixel-to-pixel unwrapping methods because the unwrapping result is more consistent by using a voting mechanism based on all Zit-discontinuities hints. Furthermore, a systematic sequence of regional unwrapping is constructed in order to achieve a global consistent result. An implementation of the idea is illustrated in dct.il with step-by-step pseudo codes. The performance of the algorithm is demonstrated on real world applications. In order to solve a phase unwrapping problem which is caused by depth discontinuities in 3D shape measurement, a new absolute phase coding strategy is developed. The algorithm presented has two merits: effectively extends the coding range and preserves the measurement sensitivity. The performance of the proposed absolute coding strategy is proved by results of 3D shape measurement for objects with surface discontinuities. As a powerful tool for real world applications a universal software package, Optical Measurement and Evaluation Software (OMES), is designed for the purposes of automatic measurement and quantitative evaluation in 3D shape measurement and laser interferometry

Validation of virtual learning object to support the teaching of nursing care systematization.

PubMed

Salvador, Pétala Tuani Candido de Oliveira; Mariz, Camila Maria Dos Santos; Vítor, Allyne Fortes; Ferreira Júnior, Marcos Antônio; Fernandes, Maria Isabel Domingues; Martins, José Carlos Amado; Santos, Viviane Euzébia Pereira

2018-01-01

to describe the content validation process of a Virtual Learning Object to support the teaching of nursing care systematization to nursing professionals. methodological study, with quantitative approach, developed according to the methodological reference of Pasquali's psychometry and conducted from March to July 2016, from two-stage Delphi procedure. in the Delphi 1 stage, eight judges evaluated the Virtual Object; in Delphi 2 stage, seven judges evaluated it. The seven screens of the Virtual Object were analyzed as to the suitability of its contents. The Virtual Learning Object to support the teaching of nursing care systematization was considered valid in its content, with a Total Content Validity Coefficient of 0.96. it is expected that the Virtual Object can support the teaching of nursing care systematization in light of appropriate and effective pedagogical approaches.

Developing a systematic approach to safer medication use during pregnancy: summary of a Centers for Disease Control and Prevention--convened meeting.

PubMed

Broussard, Cheryl S; Frey, Meghan T; Hernandez-Diaz, Sonia; Greene, Michael F; Chambers, Christina D; Sahin, Leyla; Collins Sharp, Beth A; Honein, Margaret A

2014-09-01

To address information gaps that limit informed clinical decisions on medication use in pregnancy, the Centers for Disease Control and Prevention (CDC) solicited expert input on a draft prototype outlining a systematic approach to evaluating the quality and strength of existing evidence for associated risks. The draft prototype outlined a process for the systematic review of available evidence and deliberations by a panel of experts to inform clinical decision making for managing health conditions in pregnancy. At an expert meeting convened by the CDC in January 2013, participants divided into working groups discussed decision points within the prototype. This report summarizes their discussions of best practices for formulating an expert review process, developing evidence summaries and treatment guidance, and disseminating information. There is clear recognition of current knowledge gaps and a strong collaboration of federal partners, academic experts, and professional organizations willing to work together toward safer medication use during pregnancy. Published by Elsevier Inc.

Developing a systematic approach to safer medication use during pregnancy: summary of a Centers for Disease Control and Prevention—convened meeting

PubMed Central

Broussard, Cheryl S.; Frey, Meghan T.; Hernandez-Diaz, Sonia; Greene, Michael F.; Chambers, Christina D.; Sahin, Leyla; Collins Sharp, Beth A.; Honein, Margaret A.

2015-01-01

To address information gaps that limit informed clinical decisions on medication use in pregnancy, the Centers for Disease Control and Prevention (CDC) solicited expert input on a draft prototype outlining a systematic approach to evaluating the quality and strength of existing evidence for associated risks. The draft prototype outlined a process for the systematic review of available evidence and deliberations by a panel of experts to inform clinical decision making for managing health conditions in pregnancy. At an expert meeting convened by the CDC in January 2013, participants divided into working groups discussed decision points within the prototype. This report summarizes their discussions of best practices for formulating an expert review process, developing evidence summaries and treatment guidance, and disseminating information. There is clear recognition of current knowledge gaps and a strong collaboration of federal partners, academic experts, and professional organizations willing to work together toward safer medication use during pregnancy. PMID:24881821

Globalization of continuing professional development by journal clubs via microblogging: a systematic review.

PubMed

Roberts, Matthew John; Perera, Marlon; Lawrentschuk, Nathan; Romanic, Diana; Papa, Nathan; Bolton, Damien

2015-04-23

Journal clubs are an essential tool in promoting clinical evidence-based medical education to all medical and allied health professionals. Twitter represents a public, microblogging forum that can facilitate traditional journal club requirements, while also reaching a global audience, and participation for discussion with study authors and colleagues. The aim of the current study was to evaluate the current state of social media-facilitated journal clubs, specifically Twitter, as an example of continuing professional development. A systematic review of literature databases (Medline, Embase, CINAHL, Web of Science, ERIC via ProQuest) was performed according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A systematic search of Twitter, the followers of identified journal clubs, and Symplur was also performed. Demographic and monthly tweet data were extracted from Twitter and Symplur. All manuscripts related to Twitter-based journal clubs were included. Statistical analyses were performed in MS Excel and STATA. From a total of 469 citations, 11 manuscripts were included and referred to five Twitter-based journal clubs (#ALiEMJC, #BlueJC, #ebnjc, #urojc, #meded). A Twitter-based journal club search yielded 34 potential hashtags/accounts, of which 24 were included in the final analysis. The median duration of activity was 11.75 (interquartile range [IQR] 19.9, SD 10.9) months, with 7 now inactive. The median number of followers and participants was 374 (IQR 574) and 157 (IQR 272), respectively. An overall increasing establishment of active Twitter-based journal clubs was observed, resulting in an exponential increase in total cumulative tweets (R(2)=.98), and tweets per month (R(2)=.72). Cumulative tweets for specific journal clubs increased linearly, with @ADC_JC, @EBNursingBMJ, @igsjc, @iurojc, and @NephJC, and showing greatest rate of change, as well as total impressions per month since establishment. An average of two

The effect of a geriatric evaluation on treatment decisions and outcome for older cancer patients - A systematic review.

PubMed

Hamaker, Marije E; Te Molder, Marthe; Thielen, Noortje; van Munster, Barbara C; Schiphorst, Anandi H; van Huis, Lieke H

2018-04-06

The aim of this systematic review is to summarise all available data on the effect of a geriatric evaluation on the multidisciplinary treatment of older cancer patients, focussing on oncologic treatment decisions, the implementation of non-oncologic interventions and the impact on treatment outcome. A systematic search in MEDLINE and EMBASE for studies on the effect of a geriatric evaluation on oncologic and non-oncologic treatment decisions and outcome for older cancer patients. 36 publications from 35 studies were included. After a geriatric evaluation, the oncologic treatment plan was altered in a median of 28% of patients (range 8-54%), primarily to a less intensive treatment option. Non-oncologic interventions were recommended in a median of 72% of patients (range 26-100%), most commonly involving social issues (39%), nutritional status (32%) and polypharmacy (31%). Effect on treatment outcome was varying, with a trend towards a positive effect on treatment completion (positive effect in 75% of studies) and treatment-related toxicity/ complications (55% of studies). A geriatric evaluation affects oncologic and non-oncologic treatment and appears to improve treatment tolerance and completion for older cancer patients. Fine-tuning the decision-making process for this growing patient population will require more specific and robust data on the effect of a geriatric evaluation on relevant oncologic and non-oncologic outcomes such as survival and quality of life. Copyright © 2017. Published by Elsevier Ltd.

Evaluating outcomes of palliative photodynamic therapy: instrument development and preliminary results

NASA Astrophysics Data System (ADS)

Goodell, Teresa T.; Bargo, Paulo R.; Jacques, Steven L.

2002-06-01

Background: Subjective measures are considered the gold standard in palliative care evaluation, but no studies have evaluated palliative photodynamic therapy (PDT) subjectively. If PDT is to be accepted as a palliative therapy for later-stage obstructing esophageal and lung cancer, evidence of its effectiveness and acceptability to patients must be made known. Study Design/Materials and Methods: This ongoing study's major aim is to evaluate subjective outcomes of PDT in patients with obstructing esophageal and lung cancer. Existing measures of health status, dysphagia and performance status were supplemented with an instrument developed to evaluate PDT symptom relief and side effect burden, the PDT Side Effects Survey (PSES). Results: PDT patients treated with porfimer sodium (Photofrin) and 630-nm light experienced reduced dysphagia grade and stable performance status for at least one month after PDT (N= 10-17), but these effects did not necessarily persist at three months. Fatigue, appetite and quality of life may be the most burdensome issues for these patients. Conclusions: Preliminary data suggest that the PSES is an acceptable and valid tool for measuring subjective outcomes of palliative PDT. This study is the first attempt to systematically evaluate subjective outcomes of palliative PDT. Multi-center outcomes research is needed to draw generalizable conclusions that will establish PDT's effectiveness in actual clinical practice and enhance the wider adoption of PDT as a cancer symptom relief modality.

Do active video games benefit the motor skill development of non-typically developing children and adolescents: A systematic review.

PubMed

Page, Zoey E; Barrington, Stephanie; Edwards, Jacqueline; Barnett, Lisa M

2017-12-01

The use of interactive video gaming, known as 'exergames' or 'active video games (AVG)' may provide an opportunity for motor skill development. Youth with non-typical patterns of development may have deficits in gross motor skill capacities and are therefore an intervention target. The aim was to determine the effectiveness of AVG use on motor skill development in non-typically developing children and adolescents. Review article. The PRISMA protocol was used to conduct a systematic review of EBSCOhost, Embase, Gale Cengage, Informit, Ovid, ProQuest, PubMed, Scopus and Web of Science databases. A total of 19 articles met inclusion criteria (non-typically developing participants such as those with a learning or developmental delay aged 3-18, use of an AVG console, assessed one or more gross motor skills). Studies were excluded if gross motor skill outcomes encompassed fine motor skills or reflected mobility related to daily living. Interventions included children and adolescents with eight different conditions. The Nintendo Wii was the most utilised gaming platform (14/19 studies). Studies examined a combination of skills, with most examining balance (15/19), five studies examining ball skills, and other gross motor skills such as coordination (3 studies), running (3 studies) and jumping (3 studies). There was strong evidence that AVG's improved balance. AVG's also appeared to benefit participants with Cerebral Palsy. AVG's could be a valuable tool to improve gross motor skills of non-typically developing children. There is scope for further exploration, particularly of ball, coordination and locomotor skills and varying platforms to draw more conclusive evaluations. Copyright © 2017 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Economic evaluation of emergency obstetric care training: a systematic review.

PubMed

Banke-Thomas, Aduragbemi; Wilson-Jones, Megan; Madaj, Barbara; van den Broek, Nynke

2017-12-04

Training healthcare providers in Emergency Obstetric Care (EmOC) has been shown to be effective in improving their capacity to provide this critical care package for mothers and babies. However, little is known about the costs and cost-effectiveness of such training. Understanding costs and cost-effectiveness is essential in guaranteeing value-for-money in healthcare spending. This study systematically reviewed the available literature on cost and cost-effectiveness of EmOC trainings. Peer-reviewed and grey literature was searched for relevant papers published after 1990. Studies were included if they described an economic evaluation of EmOC training and the training cost data were available. Two reviewers independently searched, screened, and selected studies that met the inclusion criteria, with disagreements resolved by a third reviewer. Quality of studies was assessed using the Consolidated Health Economic Evaluation Reporting Standards statement. For comparability, all costs in local currency were converted to International dollar (I$) equivalents using purchasing power parity conversion factors. The cost per training per participant was calculated. Narrative synthesis was used to summarise the available evidence on cost effectiveness. Fourteen studies (five full and nine partial economic evaluations) met the inclusion criteria. All five and two of the nine partial economic evaluations were of high quality. The majority of studies (13/14) were from low- and middle-income countries. Training equipment, per diems and resource person allowance were the most expensive components. Cost of training per person per day ranged from I$33 to I$90 when accommodation was required and from I$5 to I$21 when training was facility-based. Cost-effectiveness of training was assessed in 5 studies with differing measures of effectiveness (knowledge, skills, procedure cost and lives saved) making comparison difficult. Economic evaluations of EmOC training are limited. There is a

Systematic CRISPR-Cas9-Mediated Modifications of Plasmodium yoelii ApiAP2 Genes Reveal Functional Insights into Parasite Development

PubMed Central

Zhang, Cui; Li, Zhenkui; Cui, Huiting; Jiang, Yuanyuan; Yang, Zhenke; Wang, Xu; Gao, Han; Liu, Cong; Zhang, Shujia

2017-01-01

ABSTRACT Malaria parasites have a complex life cycle with multiple developmental stages in mosquito and vertebrate hosts, and different developmental stages express unique sets of genes. Unexpectedly, many transcription factors (TFs) commonly found in eukaryotic organisms are absent in malaria parasites; instead, a family of genes encoding proteins similar to the plant Apetala2 (ApiAP2) transcription factors is expanded in the parasites. Several malaria ApiAP2 genes have been shown to play a critical role in parasite development; however, the functions of the majority of the ApiAP2 genes remain to be elucidated. In particular, no study on the Plasmodium yoelii ApiAP2 (PyApiAP2) gene family has been reported so far. This study systematically investigated the functional roles of PyApiAP2 genes in parasite development. Twenty-four of the 26 PyApiAP2 genes were selected for disruption, and 12 were successfully knocked out using the clustered regularly interspaced short palindromic repeat–CRISPR-associated protein 9 (CRISPR-Cas9) method. The effects of gene knockout (KO) on parasite development in mouse and mosquito stages were evaluated. Ten of 12 successfully disrupted genes, including two genes that have not been functionally characterized in any Plasmodium species previously, were shown to be critical for P. yoelii development of sexual and mosquito stages. Additionally, seven of the genes were labeled for protein expression analysis, revealing important information supporting their functions. This study represents the first systematic functional characterization of the P. yoelii ApiAP2 gene family and discovers important insights on the roles of the ApiAP2 genes in parasite development. PMID:29233900

Assessing the complexity of interventions within systematic reviews: development, content and use of a new tool (iCAT_SR).

PubMed

Lewin, Simon; Hendry, Maggie; Chandler, Jackie; Oxman, Andrew D; Michie, Susan; Shepperd, Sasha; Reeves, Barnaby C; Tugwell, Peter; Hannes, Karin; Rehfuess, Eva A; Welch, Vivien; Mckenzie, Joanne E; Burford, Belinda; Petkovic, Jennifer; Anderson, Laurie M; Harris, Janet; Noyes, Jane

2017-04-26

Health interventions fall along a spectrum from simple to more complex. There is wide interest in methods for reviewing 'complex interventions', but few transparent approaches for assessing intervention complexity in systematic reviews. Such assessments may assist review authors in, for example, systematically describing interventions and developing logic models. This paper describes the development and application of the intervention Complexity Assessment Tool for Systematic Reviews (iCAT_SR), a new tool to assess and categorise levels of intervention complexity in systematic reviews. We developed the iCAT_SR by adapting and extending an existing complexity assessment tool for randomized trials. We undertook this adaptation using a consensus approach in which possible complexity dimensions were circulated for feedback to a panel of methodologists with expertise in complex interventions and systematic reviews. Based on these inputs, we developed a draft version of the tool. We then invited a second round of feedback from the panel and a wider group of systematic reviewers. This informed further refinement of the tool. The tool comprises ten dimensions: (1) the number of active components in the intervention; (2) the number of behaviours of recipients to which the intervention is directed; (3) the range and number of organizational levels targeted by the intervention; (4) the degree of tailoring intended or flexibility permitted across sites or individuals in applying or implementing the intervention; (5) the level of skill required by those delivering the intervention; (6) the level of skill required by those receiving the intervention; (7) the degree of interaction between intervention components; (8) the degree to which the effects of the intervention are context dependent; (9) the degree to which the effects of the interventions are changed by recipient or provider factors; (10) and the nature of the causal pathway between intervention and outcome. Dimensions 1

Systematic review protocol of interventions to improve the psychological well-being of general practitioners.

PubMed

Murray, Marylou; Murray, Lois; Donnelly, Michael

2015-09-22

The challenges and complexities faced by general practitioners are increasing, and there are concerns about their well-being. Consequently, attention has been directed towards developing and evaluating interventions and strategies to improve general practitioner well-being and their capacity to cope with workplace challenges. This systematic review aims to evaluate research evidence regarding the effectiveness of interventions designed to improve general practitioner well-being. Eligible studies will include programmes developed to improve psychological well-being that have assessed outcomes using validated tools pertaining to well-being and related outcomes. Only programmes that have been evaluated using controlled study designs will be reviewed. An appropriately developed search strategy will be applied to six electronic databases: the Cochrane Database of Systematic Reviews, MEDLINE, Embase, CINAHL, PsycINFO and Web of Science. Studies will be screened in two stages by two independent reviewers. A third reviewer will arbitrate when required. Pre-specified inclusion and exclusion criteria will be assessed during a pilot phase early on in the review process. The Cochrane data extraction form will be adapted and applied to each eligible study by two independent reviewers, and each study will be appraised critically using standardised checklists from the Cochrane Handbook. Methodological quality will be taken into account in the analysis of the data and the synthesis of results. A narrative synthesis will be undertaken if data is unsuited to a meta-analysis. The systematic review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidance. This will be the first systematic review on this topic, and the evidence synthesis will aid decision-making by general practitioners, policy makers and planners regarding ways in which to improve GP well-being. Findings will be disseminated at general practitioner meetings

Development Research of a Teachers' Educational Performance Support System: The Practices of Design, Development, and Evaluation

ERIC Educational Resources Information Center

Hung, Wei-Chen; Smith, Thomas J.; Harris, Marian S.; Lockard, James

2010-01-01

This study adopted design and development research methodology (Richey & Klein, "Design and development research: Methods, strategies, and issues," 2007) to systematically investigate the process of applying instructional design principles, human-computer interaction, and software engineering to a performance support system (PSS) for behavior…

Calcium Isotope Systematics During Development of the Domestic Chicken (Gallus gallus)

NASA Astrophysics Data System (ADS)

Wheatley, P. V.

2003-12-01

Calcium isotope distributions have been recognized as showing systematic and predictable fractionation in nature. However, most of the observed calcium isotope fractionation to date is due to biological processes. The presence of abundant amounts of calcium in mineralized tissues makes the isotopic system of calcium particularly valuable in biological and paleobiological questions involving biomineralization. In order to apply calcium isotope systematics to paleobiological questions the changes in the calcium isotope signatures of mineralized tissue in modern animals should be studied. My study observed the domestic chicken (Gallus gallus) through embryologic ontogeny. This was accomplished by obtaining fertilized eggs staged in a growth series from day 12 to day 20. The eggs were dissected and shell, embryonic bone, albumen, and yolk were analyzed in order to characterize the calcium isotopic composition of the individual components over the course of the growth series. Several systematic changes in the isotopic signatures of various tissues were observed during the course of the development of the embryos. In general, mineralization in biological systems preferentially partitions the lighter isotopes of calcium into hard parts. As a result of this fractionation during mineralization, partitioning of light isotopes of calcium into the mineralized tissues may result in residual tissues being enriched in the heavier isotopes as ontogeny progresses. Better understanding of the behavior of calcium in modern biological systems will improve its application to fossils and expand the number of paleobiological and evolutionary questions that can be addressed using calcium isotopic data.

Systematic review of economic evaluations of preparedness strategies and interventions against influenza pandemics.

PubMed

Pérez Velasco, Román; Praditsitthikorn, Naiyana; Wichmann, Kamonthip; Mohara, Adun; Kotirum, Surachai; Tantivess, Sripen; Vallenas, Constanza; Harmanci, Hande; Teerawattananon, Yot

2012-01-01

Although public health guidelines have implications for resource allocation, these issues were not explicitly considered in previous WHO pandemic preparedness and response guidance. In order to ensure a thorough and informed revision of this guidance following the H1N1 2009 pandemic, a systematic review of published and unpublished economic evaluations of preparedness strategies and interventions against influenza pandemics was conducted. The search was performed in September 2011 using 10 electronic databases, 2 internet search engines, reference list screening, cited reference searching, and direct communication with relevant authors. Full and partial economic evaluations considering both costs and outcomes were included. Conversely, reviews, editorials, and studies on economic impact or complications were excluded. Studies were selected by 2 independent reviewers. 44 studies were included. Although most complied with the cost effectiveness guidelines, the quality of evidence was limited. However, the data sources used were of higher quality in economic evaluations conducted after the 2009 H1N1 pandemic. Vaccination and drug regimens were varied. Pharmaceutical plus non-pharmaceutical interventions are relatively cost effective in comparison to vaccines and/or antivirals alone. Pharmaceutical interventions vary from cost saving to high cost effectiveness ratios. According to ceiling thresholds (Gross National Income per capita), the reduction of non-essential contacts and the use of pharmaceutical prophylaxis plus the closure of schools are amongst the cost effective strategies for all countries. However, quarantine for household contacts is not cost effective even for low and middle income countries. The available evidence is generally inconclusive regarding the cost effectiveness of preparedness strategies and interventions against influenza pandemics. Studies on their effectiveness and cost effectiveness should be readily implemented in forthcoming events that

Systematic Review of Economic Evaluations of Preparedness Strategies and Interventions against Influenza Pandemics

PubMed Central

Pérez Velasco, Román; Praditsitthikorn, Naiyana; Wichmann, Kamonthip; Mohara, Adun; Kotirum, Surachai; Tantivess, Sripen; Vallenas, Constanza; Harmanci, Hande; Teerawattananon, Yot

2012-01-01

Background Although public health guidelines have implications for resource allocation, these issues were not explicitly considered in previous WHO pandemic preparedness and response guidance. In order to ensure a thorough and informed revision of this guidance following the H1N1 2009 pandemic, a systematic review of published and unpublished economic evaluations of preparedness strategies and interventions against influenza pandemics was conducted. Methods The search was performed in September 2011 using 10 electronic databases, 2 internet search engines, reference list screening, cited reference searching, and direct communication with relevant authors. Full and partial economic evaluations considering both costs and outcomes were included. Conversely, reviews, editorials, and studies on economic impact or complications were excluded. Studies were selected by 2 independent reviewers. Results 44 studies were included. Although most complied with the cost effectiveness guidelines, the quality of evidence was limited. However, the data sources used were of higher quality in economic evaluations conducted after the 2009 H1N1 pandemic. Vaccination and drug regimens were varied. Pharmaceutical plus non-pharmaceutical interventions are relatively cost effective in comparison to vaccines and/or antivirals alone. Pharmaceutical interventions vary from cost saving to high cost effectiveness ratios. According to ceiling thresholds (Gross National Income per capita), the reduction of non-essential contacts and the use of pharmaceutical prophylaxis plus the closure of schools are amongst the cost effective strategies for all countries. However, quarantine for household contacts is not cost effective even for low and middle income countries. Conclusion The available evidence is generally inconclusive regarding the cost effectiveness of preparedness strategies and interventions against influenza pandemics. Studies on their effectiveness and cost effectiveness should be readily

A Systematic Literature Review of Funding for Higher Education Institutions in Developed Countries

ERIC Educational Resources Information Center

Zhang, Qilong; Ning, Kang; Barnes, Ruth

2016-01-01

Resource allocation and funding in higher education is crucial to the success of reform and transformation of our higher education system. With a view to identifying trends and best practices in the area, utilizing a method of systematic literature review, we have critically reviewed relevant theories and practices from developed counties that are…

The Discrepancy Evaluation Model: A Systematic Approach for the Evaluation of Career Planning and Placement Programs.

ERIC Educational Resources Information Center

Buttram, Joan L.; Covert, Robert W.

The Discrepancy Evaluation Model (DEM), developed in 1966 by Malcolm Provus, provides information for program assessment and program improvement. Under the DEM, evaluation is defined as the comparison of an actual performance to a desired standard. The DEM embodies five stages of evaluation based upon a program's natural development: program…

Systematic review of parenting interventions in European countries aiming to reduce social inequalities in children's health and development.

PubMed

Morrison, Joana; Pikhart, Hynek; Ruiz, Milagros; Goldblatt, Peter

2014-10-06

Early child development influences many aspects of wellbeing, health, competence in literacy and numeracy, criminality, and social and economic participation throughout the life course. Children from disadvantaged groups have less possibilities of achieving full development. By providing a positive start for all children across the social gradient, improved developmental outcomes will be seen during later childhood and throughout their lives. The objective of this systematic review was to identify interventions during early childhood in countries from the World Health Organisation European Region in 1999-2013 which reduced inequalities in children's health and development. A systematic review was carried out adhering to the PRISMA guidelines. The review examined universal, targeted and proportionate universalism interventions, programs and services using an electronic search strategy in PubMed and the International Bibliography of the Social Sciences [IBSS] databases. A further search was performed in the grey literature. Interventions were included only if they were aimed at children or their parents and had been evaluated. We identified 23 interventions in total: 6 in the PubMed data base, 5 in IBSS and 12 in grey literature. All but 1 intervention-delivered in Sweden-were carried out in the United Kingdom and the Republic of Ireland. These aimed to improve parenting abilities, however, some had additional components such as: day-care provision, improving housing conditions and speech or psychological therapies. Programmes offering intensive support, information and home visits using a psycho-educational approach and aimed at developing parent's and children's skills showed more favourable outcomes. These were parenting behaviours, overall children's health and higher level of fine motor skills and cognitive functioning. Child injuries and abuse were also reduced. Two interventions were universally proportionate and all others were aimed at a specific target

Developing a Framework for Evaluating Ethical Outcomes of Good Participatory Practices in TB Clinical Drug Trials.

PubMed

MacQueen, Kathleen M; Eley, Natalie T; Frick, Mike; Mingote, Laia Ruiz; Chou, Alicia; Seidel, Stephanie S; Hannah, Stacey; Hamilton, Carol

2016-07-01

Good Participatory Practice Guidelines for TB Drug Trials (GPP-TB) were issued in 2012, based on similar guidelines for HIV prevention and reflecting growing acceptance of the importance of community engagement and participatory strategies in clinical research. Though the need for such strategies is clear, evaluation of the benefits and burdens are needed. Working with a diverse group of global TB stakeholders including advocates, scientists, and ethicists, we used a Theory of Change approach to develop an evaluation framework for GPP-TB that includes a clearly defined ethical goal, a set of powerful strategies derived from GPP-TB practices for achieving the goal, and outcomes connecting strategies to goal. The framework is a first step in systematically evaluating participatory research in clinical trials. © The Author(s) 2016.

Methods for a Rapid Systematic Review and Metaanalysis in Evaluating Selective Serotonin Reuptake Inhibitors for Premature Ejaculation

ERIC Educational Resources Information Center

Martyn-St. James, Marrissa; Cooper, Katy; Kaltenthaler, Eva

2017-01-01

The aim of this study was to evaluate a rapid systematic review method in which randomised controlled trial (RCT) data was extracted from existing reviews and subsequent RCTs. The method enabled: identification of RCTs not included by existing reviews; cross-checking RCT data for consistency where there was more than one review; double data…

Economic evaluations of comprehensive geriatric assessment in surgical patients: a systematic review.

PubMed

Eamer, Gilgamesh; Saravana-Bawan, Bianka; van der Westhuizen, Brenden; Chambers, Thane; Ohinmaa, Arto; Khadaroo, Rachel G

2017-10-01

Seniors presenting with surgical disease face increased risk of postoperative morbidity and mortality and have increased treatment costs. Comprehensive Geriatric Assessment (CGA) is proposed to reduce morbidity, mortality, and the cost after surgery. A systematic review of CGA in emergency surgical patients was conducted. The primary outcome was cost-effectiveness; secondary outcomes were length of stay, return of function, and mortality. Inclusion and exclusion criteria were predefined. Systematic searches of MEDLINE, Embase, Cochrane, and National Health Service Economic Evaluation Database were performed. Text screening, bias assessment, and data extraction were performed by two authors. There were 560 articles identified; abstract review excluded 499 articles and full-text review excluded 53 articles. Eight studies were included; one nonorthopedic trauma and seven orthopedic trauma studies. Bias assessment revealed moderate to high risk of bias for all studies. Economic evaluation assessment identified two high-quality studies and six moderate or low quality studies. Pooled analysis from four studies assessed loss of function; loss of function decreased in the experimental arm (odds ratio 0.92, 95% confidence interval [CI]: 0.88-0.97). Pooled results for length of stay from five studies found a significant decrease (mean difference: -1.17, 95% CI: -1.63 to -0.71) after excluding the nonorthopedic trauma study. Pooled mortality was significantly decreased in seven studies (risk ratio: 0.78, 95% CI: 0.67-0.90). All studies decreased cost and improved health outcomes in a cost-effective manner. CGA improved return of function and mortality with reduced cost or improved utility. Our review suggests that CGA is economically dominant and the most cost-effective care model for orthogeriatric patients. Further research should examine other surgical fields. Copyright © 2017 Elsevier Inc. All rights reserved.

Talent Identification and Development in Male Football: A Systematic Review.

PubMed

Sarmento, Hugo; Anguera, M Teresa; Pereira, Antonino; Araújo, Duarte

2018-04-01

Expertise has been extensively studied in several sports over recent years. The specificities of how excellence is achieved in Association Football, a sport practiced worldwide, are being repeatedly investigated by many researchers through a variety of approaches and scientific disciplines. The aim of this review was to identify and synthesise the most significant literature addressing talent identification and development in football. We identified the most frequently researched topics and characterised their methodologies. A systematic review of Web of Science™ Core Collection and Scopus databases was performed according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. The following keywords were used: "football" and "soccer". Each word was associated with the terms "talent", "expert*", "elite", "elite athlete", "identification", "career transition" or "career progression". The selection was for the original articles in English containing relevant data about talent development/identification on male footballers. The search returned 2944 records. After screening against set criteria, a total of 70 manuscripts were fully reviewed. The quality of the evidence reviewed was generally excellent. The most common topics of analysis were (1) task constraints: (a) specificity and volume of practice; (2) performers' constraints: (a) psychological factors; (b) technical and tactical skills; (c) anthropometric and physiological factors; (3) environmental constraints: (a) relative age effect; (b) socio-cultural influences; and (4) multidimensional analysis. Results indicate that the most successful players present technical, tactical, anthropometric, physiological and psychological advantages that change non-linearly with age, maturational status and playing positions. These findings should be carefully considered by those involved in the identification and development of football players. This review highlights the need for coaches

The New Environment for Development Evaluation

ERIC Educational Resources Information Center

Picciotto, Robert

2007-01-01

The millennium development goals have created new challenges for development evaluation. The main unit of account has shifted to the country level. Evaluation ownership must move from donor agencies to developing countries. The recognition that rich countries have development obligations is opening up evaluation frontiers beyond aid. A…

Methodological developments in searching for studies for systematic reviews: past, present and future?

PubMed

Lefebvre, Carol; Glanville, Julie; Wieland, L Susan; Coles, Bernadette; Weightman, Alison L

2013-09-25

The Cochrane Collaboration was established in 1993, following the opening of the UK Cochrane Centre in 1992, at a time when searching for studies for inclusion in systematic reviews was not well-developed. Review authors largely conducted their own searches or depended on medical librarians, who often possessed limited awareness and experience of systematic reviews. Guidance on the conduct and reporting of searches was limited. When work began to identify reports of randomized controlled trials (RCTs) for inclusion in Cochrane Reviews in 1992, there were only approximately 20,000 reports indexed as RCTs in MEDLINE and none indexed as RCTs in Embase. No search filters had been developed with the aim of identifying all RCTs in MEDLINE or other major databases. This presented The Cochrane Collaboration with a considerable challenge in identifying relevant studies.Over time, the number of studies indexed as RCTs in the major databases has grown considerably and the Cochrane Central Register of Controlled Trials (CENTRAL) has become the best single source of published controlled trials, with approximately 700,000 records, including records identified by the Collaboration from Embase and MEDLINE. Search filters for various study types, including systematic reviews and the Cochrane Highly Sensitive Search Strategies for RCTs, have been developed. There have been considerable advances in the evidence base for methodological aspects of information retrieval. The Cochrane Handbook for Systematic Reviews of Interventions now provides detailed guidance on the conduct and reporting of searches. Initiatives across The Cochrane Collaboration to improve the quality inter alia of information retrieval include: the recently introduced Methodological Expectations for Cochrane Intervention Reviews (MECIR) programme, which stipulates 'mandatory' and 'highly desirable' standards for various aspects of review conduct and reporting including searching, the development of Standard Training

Methodological developments in searching for studies for systematic reviews: past, present and future?

PubMed Central

2013-01-01

The Cochrane Collaboration was established in 1993, following the opening of the UK Cochrane Centre in 1992, at a time when searching for studies for inclusion in systematic reviews was not well-developed. Review authors largely conducted their own searches or depended on medical librarians, who often possessed limited awareness and experience of systematic reviews. Guidance on the conduct and reporting of searches was limited. When work began to identify reports of randomized controlled trials (RCTs) for inclusion in Cochrane Reviews in 1992, there were only approximately 20,000 reports indexed as RCTs in MEDLINE and none indexed as RCTs in Embase. No search filters had been developed with the aim of identifying all RCTs in MEDLINE or other major databases. This presented The Cochrane Collaboration with a considerable challenge in identifying relevant studies. Over time, the number of studies indexed as RCTs in the major databases has grown considerably and the Cochrane Central Register of Controlled Trials (CENTRAL) has become the best single source of published controlled trials, with approximately 700,000 records, including records identified by the Collaboration from Embase and MEDLINE. Search filters for various study types, including systematic reviews and the Cochrane Highly Sensitive Search Strategies for RCTs, have been developed. There have been considerable advances in the evidence base for methodological aspects of information retrieval. The Cochrane Handbook for Systematic Reviews of Interventions now provides detailed guidance on the conduct and reporting of searches. Initiatives across The Cochrane Collaboration to improve the quality inter alia of information retrieval include: the recently introduced Methodological Expectations for Cochrane Intervention Reviews (MECIR) programme, which stipulates 'mandatory’ and 'highly desirable’ standards for various aspects of review conduct and reporting including searching, the development of Standard

Patient-Reported Outcome Instruments for Surgical and Traumatic Scars: A Systematic Review of their Development, Content, and Psychometric Validation.

PubMed

Mundy, Lily R; Miller, H Catherine; Klassen, Anne F; Cano, Stefan J; Pusic, Andrea L

2016-10-01

Patient-reported outcomes (PROs) are of growing importance in research and clinical care and may be used as primary outcomes or as compliments to traditional surgical outcomes. In assessing the impact of surgical and traumatic scars, PROs are often the most meaningful. To assess outcomes from the patient perspective, rigorously developed and validated PRO instruments are essential. The authors conducted a systematic literature review to identify PRO instruments developed and/or validated for patients with surgical and/or non-burn traumatic scars. Identified instruments were assessed for content, development process, and validation under recommended guidelines for PRO instrument development. The systematic review identified 6534 articles. After review, we identified four PRO instruments meeting inclusion criteria: patient and observer scar assessment scale (POSAS), bock quality of life questionnaire for patients with keloid and hypertrophic scarring (Bock), patient scar assessment questionnaire (PSAQ), and patient-reported impact of scars measure (PRISM). Common concepts measured were symptoms and psychosocial well-being. Only PSAQ had a dedicated appearance domain. Qualitative data were used to inform content for the PSAQ and PRISM, and a modern psychometric approach (Rasch Measurement Theory) was used to develop PRISM and to test POSAS. Overall, PRISM demonstrated the most rigorous design and validation process, however, was limited by the lack of a dedicated appearance domain. PRO instruments to evaluate outcomes in scars exist but vary in terms of concepts measured and psychometric soundness. This review discusses the strengths and weaknesses of existing instruments, highlighting the need for future scar-focused PRO instrument development. This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to Table of Contents or the online Instructions to Authors www

Developing Learning Objectives for a Model Course to Prepare Adults for the Assessment of Prior, Non-Sponsored Learning by Portfolio Evaluation.

ERIC Educational Resources Information Center

Stevens, Mary A.

A study was conducted in order to develop a systematic method for the evaluation of students' prior, non-sponsored learning for the award of college credit at Blackhawk College (Illinois). It was determined that a course designed to prepare the student for assessment of prior learning was the best way for the institution to provide assistance to…

Development and initial evaluation of an instrument to assess physiotherapists' clinical reasoning focused on clients' behavior change.

PubMed

Elvén, Maria; Hochwälder, Jacek; Dean, Elizabeth; Söderlund, Anne

2018-05-01

A systematically developed and evaluated instrument is needed to support investigations of physiotherapists' clinical reasoning integrated with the process of clients' behavior change. This study's aim was to develop an instrument to assess physiotherapy students' and physiotherapists' clinical reasoning focused on clients' activity-related behavior and behavior change, and initiate its evaluation, including feasibility and content validity. The study was conducted in three phases: 1) determination of instrument structure and item generation, based on a model, guidelines for assessing clinical reasoning, and existing measures; 2) cognitive interviews with five physiotherapy students to evaluate item understanding and feasibility; and 3) a Delphi process with 18 experts to evaluate content relevance. Phase 1 resulted in an instrument with four domains: Physiotherapist; Input from client; Functional behavioral analysis; and Strategies for behavior change. The instrument consists of case scenarios followed by items in which key features are identified, prioritized, or interpreted. Phase 2 resulted in revisions of problems and approval of feasibility. Phase 3 demonstrated high level of consensus regarding the instrument's content relevance. This feasible and content-validated instrument shows potential for use in investigations of physiotherapy students' and physiotherapists' clinical reasoning, however continued development and testing are needed.

Using Multiple Types of Studies in Systematic Reviews of Health Care Interventions – A Systematic Review

PubMed Central

Peinemann, Frank; Tushabe, Doreen Allen; Kleijnen, Jos

2013-01-01

Background A systematic review may evaluate different aspects of a health care intervention. To accommodate the evaluation of various research questions, the inclusion of more than one study design may be necessary. One aim of this study is to find and describe articles on methodological issues concerning the incorporation of multiple types of study designs in systematic reviews on health care interventions. Another aim is to evaluate methods studies that have assessed whether reported effects differ by study types. Methods and Findings We searched PubMed, the Cochrane Database of Systematic Reviews, and the Cochrane Methodology Register on 31 March 2012 and identified 42 articles that reported on the integration of single or multiple study designs in systematic reviews. We summarized the contents of the articles qualitatively and assessed theoretical and empirical evidence. We found that many examples of reviews incorporating multiple types of studies exist and that every study design can serve a specific purpose. The clinical questions of a systematic review determine the types of design that are necessary or sufficient to provide the best possible answers. In a second independent search, we identified 49 studies, 31 systematic reviews and 18 trials that compared the effect sizes between randomized and nonrandomized controlled trials, which were statistically different in 35%, and not different in 53%. Twelve percent of studies reported both, different and non-different effect sizes. Conclusions Different study designs addressing the same question yielded varying results, with differences in about half of all examples. The risk of presenting uncertain results without knowing for sure the direction and magnitude of the effect holds true for both nonrandomized and randomized controlled trials. The integration of multiple study designs in systematic reviews is required if patients should be informed on the many facets of patient relevant issues of health care

Evaluation Systems, Ethics, and Development Evaluation

ERIC Educational Resources Information Center

Thomas, Vinod

2010-01-01

After some 65 years of international development assistance, it is still difficult to show the effectiveness of aid in ways that are fully convincing. In part, this reflects inadequacies in the evaluation systems of the bilateral, multilateral, and global organizations that provide official development aid. Underlying these weaknesses often are a…

Young Children and Tablets: A Systematic Review of Effects on Learning and Development

ERIC Educational Resources Information Center

Herodotou, C.

2018-01-01

Mobile applications are popular among young children, yet there is a dearth of studies examining their impact on learning and development. A systematic review identified 19 studies reporting learning effects on children 2 to 5 years old. The number of children participating in experimental, quasi-experimental, or mixed-method studies was 862 and…

Evaluation Methods for Assessing Users’ Psychological Experiences of Web-Based Psychosocial Interventions: A Systematic Review

PubMed Central

Howson, Moira; Ritchie, Linda; Carter, Philip D; Parry, David Tudor; Koziol-McLain, Jane

2016-01-01

Background The use of Web-based interventions to deliver mental health and behavior change programs is increasingly popular. They are cost-effective, accessible, and generally effective. Often these interventions concern psychologically sensitive and challenging issues, such as depression or anxiety. The process by which a person receives and experiences therapy is important to understanding therapeutic process and outcomes. While the experience of the patient or client in traditional face-to-face therapy has been evaluated in a number of ways, there appeared to be a gap in the evaluation of patient experiences of therapeutic interventions delivered online. Evaluation of Web-based artifacts has focused either on evaluation of experience from a computer Web-design perspective through usability testing or on evaluation of treatment effectiveness. Neither of these methods focuses on the psychological experience of the person while engaged in the therapeutic process. Objective This study aimed to investigate what methods, if any, have been used to evaluate the in situ psychological experience of users of Web-based self-help psychosocial interventions. Methods A systematic literature review was undertaken of interdisciplinary databases with a focus on health and computer sciences. Studies that met a predetermined search protocol were included. Results Among 21 studies identified that examined psychological experience of the user, only 1 study collected user experience in situ. The most common method of understanding users’ experience was through semistructured interviews conducted posttreatment or questionnaires administrated at the end of an intervention session. The questionnaires were usually based on standardized tools used to assess user experience with traditional face-to-face treatment. Conclusions There is a lack of methods specified in the literature to evaluate the interface between Web-based mental health or behavior change artifacts and users. Main

Evaluations of reproductive health programs in humanitarian settings: a systematic review

PubMed Central

2015-01-01

Provision of reproductive health (RH) services is a minimum standard of health care in humanitarian settings; however access to these services is often limited. This systematic review, one component of a global evaluation of RH in humanitarian settings, sought to explore the evidence regarding RH services provided in humanitarian settings and to determine if programs are being evaluated. In addition, the review explored which RH services receive more attention based on program evaluations and descriptive data. Peer-reviewed papers published between 2004 and 2013 were identified via the Ovid MEDLINE database, followed by a PubMed search. Papers on quantitative evaluations of RH programs, including experimental and non-experimental designs that reported outcome data, implemented in conflict and natural disaster settings, were included. Of 5,669 papers identified in the initial search, 36 papers describing 30 programs met inclusion criteria. Twenty-five papers described programs in sub-Saharan Africa, six in Asia, two in Haiti and three reported data from multiple countries. Some RH technical areas were better represented than others: seven papers reported on maternal and newborn health (including two that also covered family planning), six on family planning, three on sexual violence, 20 on HIV and other sexually transmitted infections and two on general RH topics. In comparison to the program evaluation papers identified, three times as many papers were found that reported RH descriptive or prevalence data in humanitarian settings. While data demonstrating the magnitude of the problem are crucial and were previously lacking, the need for RH services and for evaluations to measure their effectiveness is clear. Program evaluation and implementation science should be incorporated into more programs to determine the best ways to serve the RH needs of people affected by conflict or natural disaster. Standard program design should include rigorous program evaluation, and

Wear of ceramic and antagonist--a systematic evaluation of influencing factors in vitro.

PubMed

Heintze, S D; Cavalleri, A; Forjanic, M; Zellweger, G; Rousson, V

2008-04-01

(1) To systematically review the existing literature on in vitro assessments of antagonist wear of ceramic materials; (2) To systematically evaluate possible influencing factors on material and antagonist wear of ceramic specimens. The database MEDLINE was searched with the terms "enamel," "wear" and "antagonist." The selected studies were analyzed with regard to wear parameters, type of antagonist and outcome. In the laboratory study, three ceramic materials were selected with different compositions and physical properties: IPS d.SIGN low-fusing metal ceramic, IPS Empress leucite ceramic, e.max Press lithium disilicate ceramic. These materials were subjected to the Ivoclar wear method (Willytec chewing simulator, 120,000cycles, 5kg weight) by systematically modifying the following variables which resulted in 36 tests with 8 specimens in each group: (1) configuration (flat, crown specimen), (2) surface treatment (polish, glaze), (3) type of antagonist (ceramic, two types of enamel stylus). Furthermore, the enamel styluses were cut to measure the enamel thickness and cusp width. Wear of both the material and the antagonist was quantified by scanning plaster replicas of the specimens with a laser scanner (etkon es1) and matching baseline and follow-up data with the Match 3D software (Willytec). The data were log-transformed to stabilize the variance and achieve near normality. To test the influence of specific test parameters, a four-way ANOVA with post hoc tests and Bonferroni correction was applied. The systematic review revealed 20 in vitro studies in which a material and the antagonist wear of the same material was examined. However, the results were inconsistent mainly due to the fact that the test parameters differed widely. Most studies used prepared enamel from extracted molars as the antagonist and flat polished ceramic specimens. The test chamber was filled with water and some sort of sliding movement was integrated in the wear generating process. However

Barriers to the Uptake of Eye Care Services in Developing Countries: A Systematic Review of Interventions

ERIC Educational Resources Information Center

Abdullah, Khadija Nowaira; Al-Sharqi, Omar Zayan; Abdullah, Muhammad Tanweer

2013-01-01

Objective: This research identifies effective and ineffective interventions for reducing barriers to the uptake of eye care services in developing countries. Design: Systematic literature review. Setting: Only research studies done in developing countries were included. Method: The review is restricted to English-language articles published…

Evaluator Training Needs and Competencies: A Gap Analysis

ERIC Educational Resources Information Center

Galport, Nicole; Azzam, Tarek

2017-01-01

The systematic identification of evaluator competency training needs is crucial for the development of evaluators and the establishment of evaluation as a profession. Insight into essential competencies could help align training programs with field-specific needs, therefore clarifying expectations between evaluators, educators, and employers. This…

Spacelab user implementation assessment study. Volume 1: Concept development and evaluation

NASA Technical Reports Server (NTRS)

1975-01-01

The total matrix of alternate Spacelab processing concepts and the rejection rationale utilized to reduce the matrix of 243 alternates to the final candidate processing concepts are developed. The work breakdown structure used for the systematic estimation and compilation of integration and checkout resources is presented along with descriptors of each element. Program models are provided of the space transportation system, the Spacelab, the orbiter, and the ATL that were used as the basis for the study trades, analyses, and optimizations. Resource requirements for all processing concepts are summarized along with the optimizations of the processing concepts. Concept evaluations including flight-rate sensitivities of the GSE, facilities, Spacelab hardware elements, and personnel are delineated. An analysis is presented of the applicability of the candidate concepts to potential spacelab users. The impact of the use of the western test range as an orbiter/spacelab launch site on the candidate processing concepts is evaluated. An assessment of the geographical co-location of experiment, Spacelab, and orbiter-cargo integration is included. Ownership options of the support module/system igloo are discussed.

Economic evaluations of clinical pharmacist interventions on hospital inpatients: a systematic review of recent literature.

PubMed

Gallagher, James; McCarthy, Suzanne; Byrne, Stephen

2014-12-01

Clinical and cost-effectiveness evidence are needed to justify the existence or extension of routine clinical pharmacy services in hospital settings. Previous reviews have indicated that clinical pharmacist interventions are likely to have a positive economic impact on hospital budgets but highlighted issues relating to the quality of studies. The primary aim of this review was to feature economic evaluations of clinical pharmacy services which targeted hospital inpatients. The review focused on the current cost-effectiveness status of different services, in addition to evaluating the quality of individual studies. Results of this systematic review were compared with cost-effectiveness and quality related findings of reviews which considered earlier time frames and alternative settings. A systematic review of the literature included a review of the following databases: Academic Search Complete, Cochrane Library, EconLit, Embase Elsevier, NHS Economic Evaluation Database and PubMed. Only studies with an economic assessment of a clinical pharmacy service provided in a hospital setting were included. Data relating to the cost-effectiveness was extracted from eligible studies. Methodologies employed and overall quality of the studies was also reviewed. A grading system was applied to determine the quality of studies. Consolidated Health Economic Evaluation Reporting Standards statement was employed to determine which aspects of a high quality health economic study were employed. Twenty studies were deemed eligible for inclusion. Overall, pharmacist interventions had a positive impact on hospital budgets. Only three studies (15 %) were deemed to be "good-quality" studies. No 'novel'clinical pharmacist intervention was identified during the course of this review. Clinical pharmacy interventions continue to provide cost savings. However, the standard of studies published has stagnated or even deteriorated in comparison with those included in previous reviews. Utilisation

Schistosomiasis and water resources development: systematic review, meta-analysis, and estimates of people at risk.

PubMed

Steinmann, Peter; Keiser, Jennifer; Bos, Robert; Tanner, Marcel; Utzinger, Jürg

2006-07-01

An estimated 779 million people are at risk of schistosomiasis, of whom 106 million (13.6%) live in irrigation schemes or in close proximity to large dam reservoirs. We identified 58 studies that examined the relation between water resources development projects and schistosomiasis, primarily in African settings. We present a systematic literature review and meta-analysis with the following objectives: (1) to update at-risk populations of schistosomiasis and number of people infected in endemic countries, and (2) to quantify the risk of water resources development and management on schistosomiasis. Using 35 datasets from 24 African studies, our meta-analysis showed pooled random risk ratios of 2.4 and 2.6 for urinary and intestinal schistosomiasis, respectively, among people living adjacent to dam reservoirs. The risk ratio estimate for studies evaluating the effect of irrigation on urinary schistosomiasis was in the range 0.02-7.3 (summary estimate 1.1) and that on intestinal schistosomiasis in the range 0.49-23.0 (summary estimate 4.7). Geographic stratification showed important spatial differences, idiosyncratic to the type of water resources development. We conclude that the development and management of water resources is an important risk factor for schistosomiasis, and hence strategies to mitigate negative effects should become integral parts in the planning, implementation, and operation of future water projects.

Systematic review and economic evaluation of Helicobacter pylori eradication treatment for non-ulcer dyspepsia

PubMed Central

Moayyedi, Paul; Soo, Shelly; Deeks, Jonathan; Forman, David; Mason, James; Innes, Michael; Delaney, Brendan

2000-01-01

Objectives To evaluate efficacy and cost effectiveness of Helicobacter pylori eradication treatment in patients with non-ulcer dyspepsia infected with H pylori. Design Systematic review of randomised controlled trials comparing H pylori eradication with placebo or another drug treatment. Results were incorporated into a Markov model comparing health service costs and benefits of H pylori eradication with antacid treatment over one year. Data sources Six electronic databases were searched for randomised controlled trials from January 1966 to May 2000. Experts in the field, pharmaceutical companies, and journals were contacted for information on any unpublished trials. Trial reports were reviewed according to predefined eligibility and quality criteria. Main outcome measures Relative risk reduction for remaining dyspeptic symptoms (the same or worse) at 3-12 months. Cost per dyspepsia-free month estimated from Markov model based on estimated relative risk reduction. Results Twelve trials were included in the systematic review, nine of which evaluated dyspepsia at 3-12 months in 2541 patients. H pylori eradication treatment was significantly superior to placebo in treating non-ulcer dyspepsia (relative risk reduction 9% (95% confidence interval 4% to 14%)), one case of dyspepsia being cured for every 15 people treated. H pylori eradication cost £56 per dyspepsia-free month during first year after treatment. Conclusion H pylori eradication may be cost effective treatment for non-ulcer dyspepsia in infected patients but further evidence is needed on decision makers' willingness to pay for relief of dyspepsia. PMID:10987767

The development, implementation and evaluation of clinical practice guidelines in Gulf Cooperation Council (GCC) countries: a systematic review of literature.

PubMed

Koornneef, Erik; Robben, Paul; Hajat, Cother; Ali, Azhar

2015-12-01

Our aim was to examine and describe the current situation in Gulf Cooperation Council (GCC) member countries regarding the development, implementation and evaluation of clinical practice guidelines (CPG). The objectives were to describe from where the studies originated, what the clinical focus was of each study and examine the methodology and the status of each study (i.e. development, dissemination, implementation and evaluation). Review of literature - two stages: stage 1: screening through an abstract review, followed by independent adjudicator; stage 2: detailed assessment and classification. Considering the widespread acceptance that CPG's are useful and effective tools for quality improvement in health care, it is worth noting that relatively few studies have been conducted in the GCC region that examine CPG. Furthermore, the reviewers found that the quality of the research methods used could be improved. The majority of the studies that were conducted evaluated the effects of guidelines and focused on the 'lifestyle diseases', in particular diabetes and cardiovascular diseases. It is also worth noting that there has been a steady increase in the number of publications over the 10 years period. More attention needs to be given to developing, disseminating, implementing and evaluating CPG's in the GCC region in order to improve the quality and safety of health care. © 2015 John Wiley & Sons, Ltd.

Systematic review automation technologies

PubMed Central

2014-01-01

Systematic reviews, a cornerstone of evidence-based medicine, are not produced quickly enough to support clinical practice. The cost of production, availability of the requisite expertise and timeliness are often quoted as major contributors for the delay. This detailed survey of the state of the art of information systems designed to support or automate individual tasks in the systematic review, and in particular systematic reviews of randomized controlled clinical trials, reveals trends that see the convergence of several parallel research projects. We surveyed literature describing informatics systems that support or automate the processes of systematic review or each of the tasks of the systematic review. Several projects focus on automating, simplifying and/or streamlining specific tasks of the systematic review. Some tasks are already fully automated while others are still largely manual. In this review, we describe each task and the effect that its automation would have on the entire systematic review process, summarize the existing information system support for each task, and highlight where further research is needed for realizing automation for the task. Integration of the systems that automate systematic review tasks may lead to a revised systematic review workflow. We envisage the optimized workflow will lead to system in which each systematic review is described as a computer program that automatically retrieves relevant trials, appraises them, extracts and synthesizes data, evaluates the risk of bias, performs meta-analysis calculations, and produces a report in real time. PMID:25005128

Systematic review of guidelines for management of intermediate hepatocellular carcinoma using the Appraisal of Guidelines Research and Evaluation II instrument.

PubMed

Holvoet, Tom; Raevens, Sarah; Vandewynckel, Yves-Paul; Van Biesen, Wim; Geboes, Karen; Van Vlierberghe, Hans

2015-10-01

Hepatocellular carcinoma is the second leading cause of cancer-related mortality worldwide. Multiple guidelines have been developed to assist clinicians in its management. We aimed to explore methodological quality of these guidelines focusing on treatment of intermediate hepatocellular carcinoma by transarterial chemoembolization. A systematic search was performed for Clinical Practice Guidelines and Consensus statements for hepatocellular carcinoma management. Guideline quality was appraised using the Appraisal of Guidelines Research and Evaluation II instrument, which rates guideline development processes across 6 domains: 'Scope and purpose', 'Stakeholder involvement', 'Rigour of development', 'Clarity of presentation', 'Applicability' and 'Editorial independence'. Thematic analysis of guidelines was performed to map differences in recommendations. Quality of 21 included guidelines varied widely, but was overall poor with only one guideline passing the 50% mark on all domains. Key recommendations as (contra)indications and technical aspects were inconsistent between guidelines. Aspects on side effects and health economics were mainly neglected. Methodological quality of guidelines on transarterial chemoembolization in hepatocellular carcinoma management is poor. This results in important discrepancies between guideline recommendations, creating confusion in clinical practice. Incorporation of the Appraisal of Guidelines Research and Evaluation II instrument in guideline development may improve quality of future guidelines by increasing focus on methodological aspects. Copyright © 2015 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

Integration of care for hypertension and diabetes: a scoping review assessing the evidence from systematic reviews and evaluating reporting.

PubMed

Yiu, Kristy C; Rohwer, Anke; Young, Taryn

2018-06-20

With the rise in pre-mature mortality rate from non-communicable disease (NCD), there is a need for evidence-based interventions. We evaluated existing systematic reviews on effectiveness of integration of healthcare services, in particular with focus on delivery of care designed to improve health and process outcomes in people with multi-morbidity, where at least one of the conditions was diabetes or hypertension. We searched MEDLINE, EMBASE, Cochrane Library, and Health Evidence to November 8, 2016 and consulted experts. One review author screened titles, abstracts and two review authors independently screened short listed full-texts and selected reviews for inclusion. We considered systematic reviews evaluating integration of care, compared to usual care, for people with multi-morbidity. One review author extracted data and another author verified it. Two review authors independently evaluated risk of bias using ROBIS and AMSTAR. Inter-rater reliability was analysed for ROBIS and AMSTAR using Cohen's kappa and percent agreement. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist was used to assess reporting. We identified five systematic reviews on integration of care. Four reviews focused on comorbid diabetes and depression and two covered hypertension and comorbidities of cardiovascular disease, depression, or diabetes. Interventions were poorly described. The health outcomes evaluated included risk of all-cause mortality, measures of depression, cholesterol levels, HbA1c levels, effect of depression on HbA1c levels, symptom improvement, systolic blood pressure, and hypertension control. Process outcomes included access and utilisation of healthcare services, costs, and quality of care. Overall, three reviews had a low and medium risk of bias according to ROBIS and AMSTAR respectively, while two reviews had high risk of bias as judged by both ROBIS and AMSTAR. Findings have demonstrated that collaborative care in general

Muscle Oximetry in Sports Science: A Systematic Review.

PubMed

Perrey, Stephane; Ferrari, Marco

2018-03-01

Since the introduction (in 2006) of commercially available portable wireless muscle oximeters, the use of muscle near-infrared spectroscopy (NIRS) technology is gaining in popularity as an application to observe changes in muscle metabolism and muscle oxygenation during and after exercise or training interventions in both laboratory and applied sports settings. The objectives of this systematic review were to highlight the application of muscle oximetry in evaluating oxidative skeletal muscle performance to sport activities and emphasize how this technology has been applied to exercise and training. Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed in a systematic fashion to search, assess and synthesize existing literature on this topic. The Scopus and MEDLINE/PubMed electronic databases were searched to 1 March 2017. Potential inclusions were screened against eligibility criteria relating to recreationally trained to elite athletes, with or without training programs, who must have assessed physiological variables monitored by commercial oximeters or NIRS instrumentation. Of the 14,609 identified records, only 57 studies met the eligibility criteria. This systematic review highlighted a number of key findings in 16 sporting activities. Overall, NIRS information can be used as a marker of skeletal muscle oxidative capacity and for analyzing muscle performance factors. Although NIRS instrumentation is promising in evaluating oxidative skeletal muscle performance when used in sport settings, there is still the need for further instrumental development and randomized/longitudinal trials to support the detailed advantages of muscle oximetry utilization in sports science.

The effectiveness of concept mapping on development of critical thinking in nursing education: A systematic review and meta-analysis.