Flexible methods for segmentation evaluation: results from CT-based luggage screening.

PubMed

Karimi, Seemeen; Jiang, Xiaoqian; Cosman, Pamela; Martz, Harry

2014-01-01

Imaging systems used in aviation security include segmentation algorithms in an automatic threat recognition pipeline. The segmentation algorithms evolve in response to emerging threats and changing performance requirements. Analysis of segmentation algorithms' behavior, including the nature of errors and feature recovery, facilitates their development. However, evaluation methods from the literature provide limited characterization of the segmentation algorithms. To develop segmentation evaluation methods that measure systematic errors such as oversegmentation and undersegmentation, outliers, and overall errors. The methods must measure feature recovery and allow us to prioritize segments. We developed two complementary evaluation methods using statistical techniques and information theory. We also created a semi-automatic method to define ground truth from 3D images. We applied our methods to evaluate five segmentation algorithms developed for CT luggage screening. We validated our methods with synthetic problems and an observer evaluation. Both methods selected the same best segmentation algorithm. Human evaluation confirmed the findings. The measurement of systematic errors and prioritization helped in understanding the behavior of each segmentation algorithm. Our evaluation methods allow us to measure and explain the accuracy of segmentation algorithms.

"Learning to Play with New Friends": Systematic Quality Development Work in a Leisure-Time Centre

ERIC Educational Resources Information Center

Lager, Karin

2016-01-01

This article explores the recontextualisation of systematic quality development work (Sqdw) in a leisure-time centre. Two teachers' processes of planning, organisation, documentation and evaluation were investigated, the aim being to explore the recontextualisation of Sqdw in practice. The study is thus a case study of these teachers' practice…

Development and evaluation of 'briefing notes' as a novel knowledge translation tool to aid the implementation of sex/gender analysis in systematic reviews: a pilot study.

PubMed

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E; Shea, Beverley; O'Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly 'briefing note' format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group's focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can assist systematic reviewers in ensuring the applicability of research evidence, with the goal of improved health outcomes for diverse populations.

Motor Rehabilitation Using Kinect: A Systematic Review.

PubMed

Da Gama, Alana; Fallavollita, Pascal; Teichrieb, Veronica; Navab, Nassir

2015-04-01

Interactive systems are being developed with the intention to help in the engagement of patients on various therapies. Amid the recent technological advances, Kinect™ from Microsoft (Redmond, WA) has helped pave the way on how user interaction technology facilitates and complements many clinical applications. In order to examine the actual status of Kinect developments for rehabilitation, this article presents a systematic review of articles that involve interactive, evaluative, and technical advances related to motor rehabilitation. Systematic research was performed in the IEEE Xplore and PubMed databases using the key word combination "Kinect AND rehabilitation" with the following inclusion criteria: (1) English language, (2) page number >4, (3) Kinect system for assistive interaction or clinical evaluation, or (4) Kinect system for improvement or evaluation of the sensor tracking or movement recognition. Quality assessment was performed by QualSyst standards. In total, 109 articles were found in the database research, from which 31 were included in the review: 13 were focused on the development of assistive systems for rehabilitation, 3 in evaluation, 3 in the applicability category, 7 on validation of Kinect anatomic and clinical evaluation, and 5 on improvement techniques. Quality analysis of all included articles is also presented with their respective QualSyst checklist scores. Research and development possibilities and future works with the Kinect for rehabilitation application are extensive. Methodological improvements when performing studies on this area need to be further investigated.

Evidence-based development and evaluation of mobile cognitive support apps for people on the autism spectrum: methodological conclusions from two R+D projects.

PubMed

Gyori, Miklos; Stefanik, Krisztina; Kanizsai-Nagy, Ildikó

2015-01-01

A growing body of evidence confirms that mobile digital devices have key potentials as assistive/educational tools for people with autism spectrum disorders. The aim of this paper is to outline key aspects of development and evaluation methodologies that build on, and provide systematic evidence on effects of using such apps. We rely on the results of two R+D projects, both using quantitative and qualitative methods to support development and to evaluate developed apps (n=54 and n=22). Analyzing methodological conclusions from these studies we outline some guidelines for an 'ideal' R+D methodology but we also point to important trade-offs between the need for best systematic evidence and the limitations on development time and costs. We see these trade-offs as a key issue to be resolved in this field.

Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments.

PubMed

Vessey, Judith; Strout, Tania D; DiFazio, Rachel L; Walker, Allison

2014-12-01

Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified psychometric papers evaluating youth bullying measures. A systematic review of the literature was conducted using 4 electronic databases. Data extraction and appraisal of identified instruments were completed using a standardized method and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Thirty-one articles describing 27 self-report instruments were evaluated in our analysis. Quality assessments ranged from 18% to 91%, with 6 papers reaching or exceeding a quality score of 75%. Limited evidence supporting the reliability, validity, and responsiveness of existing youth bullying measures was identified. Evidence supporting the psychometric soundness of the instruments identified was limited. Many measures were in early development and additional evaluation is necessary to validate their psychometric properties. A pool of instruments possesses acceptable initial psychometric dependability for selected assessment purposes. These findings have significant implications for assessing youth bullying and designing and evaluating school-based interventions. © 2014, American School Health Association.

The Regional Climate Model Evaluation System: A Systematic Evaluation Of CORDEX Simulations Using Obs4MIPs

NASA Astrophysics Data System (ADS)

Goodman, A.; Lee, H.; Waliser, D. E.; Guttowski, W.

2017-12-01

Observation-based evaluations of global climate models (GCMs) have been a key element for identifying systematic model biases that can be targeted for model improvements and for establishing uncertainty associated with projections of global climate change. However, GCMs are limited in their ability to represent physical phenomena which occur on smaller, regional scales, including many types of extreme weather events. In order to help facilitate projections in changes of such phenomena, simulations from regional climate models (RCMs) for 14 different domains around the world are being provided by the Coordinated Regional Climate Downscaling Experiment (CORDEX; www.cordex.org). However, although CORDEX specifies standard simulation and archiving protocols, these simulations are conducted independently by individual research and modeling groups representing each of these domains often with different output requirements and data archiving and exchange capabilities. Thus, with respect to similar efforts using GCMs (e.g., the Coupled Model Intercomparison Project, CMIP), it is more difficult to achieve a standardized, systematic evaluation of the RCMs for each domain and across all the CORDEX domains. Using the Regional Climate Model Evaluation System (RCMES; rcmes.jpl.nasa.gov) developed at JPL, we are developing easy to use templates for performing systematic evaluations of CORDEX simulations. Results from the application of a number of evaluation metrics (e.g., biases, centered RMS, and pattern correlations) will be shown for a variety of physical quantities and CORDEX domains. These evaluations are performed using products from obs4MIPs, an activity initiated by DOE and NASA, and now shepherded by the World Climate Research Program's Data Advisory Council.

The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration

PubMed Central

Liberati, Alessandro; Altman, Douglas G; Tetzlaff, Jennifer; Mulrow, Cynthia; Gøtzsche, Peter C; Ioannidis, John P A; Clarke, Mike; Devereaux, P J; Kleijnen, Jos; Moher, David

2009-01-01

Systematic reviews and meta-analyses are essential to summarise evidence relating to efficacy and safety of healthcare interventions accurately and reliably. The clarity and transparency of these reports, however, are not optimal. Poor reporting of systematic reviews diminishes their value to clinicians, policy makers, and other users. Since the development of the QUOROM (quality of reporting of meta-analysis) statement—a reporting guideline published in 1999—there have been several conceptual, methodological, and practical advances regarding the conduct and reporting of systematic reviews and meta-analyses. Also, reviews of published systematic reviews have found that key information about these studies is often poorly reported. Realising these issues, an international group that included experienced authors and methodologists developed PRISMA (preferred reporting items for systematic reviews and meta-analyses) as an evolution of the original QUOROM guideline for systematic reviews and meta-analyses of evaluations of health care interventions. The PRISMA statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. In this explanation and elaboration document, we explain the meaning and rationale for each checklist item. For each item, we include an example of good reporting and, where possible, references to relevant empirical studies and methodological literature. The PRISMA statement, this document, and the associated website (www.prisma-statement.org/) should be helpful resources to improve reporting of systematic reviews and meta-analyses. PMID:19622552

TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: content analysis and systematic review

PubMed Central

Dall, PM; Coulter, EH; Fitzsimons, CF; Skelton, DA; Chastin, SFM

2017-01-01

Objective Sedentary behaviour (SB) has distinct deleterious health outcomes, yet there is no consensus on best practice for measurement. This study aimed to identify the optimal self-report tool for population surveillance of SB, using a systematic framework. Design A framework, TAxonomy of Self-reported Sedentary behaviour Tools (TASST), consisting of four domains (type of assessment, recall period, temporal unit and assessment period), was developed based on a systematic inventory of existing tools. The inventory was achieved through a systematic review of studies reporting SB and tracing back to the original description. A systematic review of the accuracy and sensitivity to change of these tools was then mapped against TASST domains. Data sources Systematic searches were conducted via EBSCO, reference lists and expert opinion. Eligibility criteria for selecting studies The inventory included tools measuring SB in adults that could be self-completed at one sitting, and excluded tools measuring SB in specific populations or contexts. The systematic review included studies reporting on the accuracy against an objective measure of SB and/or sensitivity to change of a tool in the inventory. Results The systematic review initially identified 32 distinct tools (141 questions), which were used to develop the TASST framework. Twenty-two studies evaluated accuracy and/or sensitivity to change representing only eight taxa. Assessing SB as a sum of behaviours and using a previous day recall were the most promising features of existing tools. Accuracy was poor for all existing tools, with underestimation and overestimation of SB. There was a lack of evidence about sensitivity to change. Conclusions Despite the limited evidence, mapping existing SB tools onto the TASST framework has enabled informed recommendations to be made about the most promising features for a surveillance tool, identified aspects on which future research and development of SB surveillance tools should focus. Trial registration number International prospective register of systematic reviews (PROPSPERO)/CRD42014009851. PMID:28391233

Design, Development, and Initial Evaluation of a Terminology for Clinical Decision Support and Electronic Clinical Quality Measurement.

PubMed

Lin, Yanhua; Staes, Catherine J; Shields, David E; Kandula, Vijay; Welch, Brandon M; Kawamoto, Kensaku

2015-01-01

When coupled with a common information model, a common terminology for clinical decision support (CDS) and electronic clinical quality measurement (eCQM) could greatly facilitate the distributed development and sharing of CDS and eCQM knowledge resources. To enable such scalable knowledge authoring and sharing, we systematically developed an extensible and standards-based terminology for CDS and eCQM in the context of the HL7 Virtual Medical Record (vMR) information model. The development of this terminology entailed three steps: (1) systematic, physician-curated concept identification from sources such as the Health Information Technology Standards Panel (HITSP) and the SNOMED-CT CORE problem list; (2) concept de-duplication leveraging the Unified Medical Language System (UMLS) MetaMap and Metathesaurus; and (3) systematic concept naming using standard terminologies and heuristic algorithms. This process generated 3,046 concepts spanning 68 domains. Evaluation against representative CDS and eCQM resources revealed approximately 50-70% concept coverage, indicating the need for continued expansion of the terminology.

Design, Development, and Initial Evaluation of a Terminology for Clinical Decision Support and Electronic Clinical Quality Measurement

PubMed Central

Lin, Yanhua; Staes, Catherine J; Shields, David E; Kandula, Vijay; Welch, Brandon M; Kawamoto, Kensaku

2015-01-01

When coupled with a common information model, a common terminology for clinical decision support (CDS) and electronic clinical quality measurement (eCQM) could greatly facilitate the distributed development and sharing of CDS and eCQM knowledge resources. To enable such scalable knowledge authoring and sharing, we systematically developed an extensible and standards-based terminology for CDS and eCQM in the context of the HL7 Virtual Medical Record (vMR) information model. The development of this terminology entailed three steps: (1) systematic, physician-curated concept identification from sources such as the Health Information Technology Standards Panel (HITSP) and the SNOMED-CT CORE problem list; (2) concept de-duplication leveraging the Unified Medical Language System (UMLS) MetaMap and Metathesaurus; and (3) systematic concept naming using standard terminologies and heuristic algorithms. This process generated 3,046 concepts spanning 68 domains. Evaluation against representative CDS and eCQM resources revealed approximately 50–70% concept coverage, indicating the need for continued expansion of the terminology. PMID:26958220

Supporting adherence and healthy lifestyles in leg ulcer patients: systematic development of the Lively Legs program for dermatology outpatient clinics.

PubMed

Heinen, Maud M; Bartholomew, L Kay; Wensing, Michel; van de Kerkhof, Peter; van Achterberg, Theo

2006-05-01

The objective of our project was to develop a lifestyle program for leg ulcer patients at outpatient clinics for dermatology. We used the intervention-mapping (IM) framework for systematically developing theory and evidence based health promotion programs. We started with a needs-assessment. A multidisciplinary project group of health care workers and patients was involved in all five IM steps; formulating proximal program objectives, selecting methods and strategies, producing program components, planning for adoption and implementation and planning for evaluation. Several systematic literature reviews and original studies were performed to support this process. Social Cognitive Theory was selected as the main theory behind the program 'Lively Legs' and was combined with elements of Goal-Setting Theory, the precaution adoption model and motivational interviewing. The program is conducted through health counseling by dermatology nurses and was successfully pre-tested. Also, an implementation and evaluation plan were made. Intervention mapping helped us to succeed in developing a lifestyle program with clear goals and methods, operational strategies and materials and clear procedures. Coaching leg ulcer patients towards adherence with compression therapy and healthy lifestyles should be taken on without delay. Systematic development of lifestyle programs for other patient groups should be encouraged.

Evaluator Training Needs and Competencies: A Gap Analysis

ERIC Educational Resources Information Center

Galport, Nicole; Azzam, Tarek

2017-01-01

The systematic identification of evaluator competency training needs is crucial for the development of evaluators and the establishment of evaluation as a profession. Insight into essential competencies could help align training programs with field-specific needs, therefore clarifying expectations between evaluators, educators, and employers. This…

How healthcare systems evaluate their advance care planning initiatives: Results from a systematic review.

PubMed

Biondo, Patricia D; Lee, Lydia D; Davison, Sara N; Simon, Jessica E

2016-09-01

Advance care planning initiatives are being implemented across healthcare systems around the world, but how best to evaluate their implementation is unknown. To identify gaps and/or redundancies in current evaluative strategies to help healthcare systems develop future evaluative frameworks for ACP. Systematic review. Peer-reviewed and gray literature searches were conducted till February 2015 to answer: "What methods have healthcare systems used to evaluate implementation of advance care planning initiatives?" A PICOS framework was developed to identify articles describing the implementation and evaluation of a health system-level advance care planning initiative. Outcome measures were mapped onto a conceptual quality indicator framework based on the Institute of Medicine and Donabedian models of healthcare quality. A total of 46 studies met inclusion criteria for analysis. Most articles reported on single parts of a healthcare system (e.g. continuing care). The most common outcome measures pertained to document completion, followed by healthcare resource use. Patient-, family-, or healthcare provider-reported outcomes were less commonly measured. Concordance measures (e.g. dying in place of choice) were reported by only 26% of studies. The conceptual quality indicator framework identified gaps and redundancies in measurement and is presented as a potential foundation from which to develop a comprehensive advance care planning evaluation framework. Document completion is frequently used to evaluate advance care planning program implementation; capturing the quality of care appears to be more difficult. This systematic review provides health system administrators with a comprehensive summary of measures used to evaluate advance care planning and may identify gaps in evaluation within their local context. © The Author(s) 2016.

23 CFR 630.1008 - State-level processes and procedures.

Code of Federal Regulations, 2011 CFR

2011-04-01

..., data and information resources, training, and periodic evaluation enable a systematic approach for... management procedures. States should develop and implement systematic procedures to assess work zone impacts... practices and State processes and procedures. (e) Process review. In order to assess the effectiveness of...

SYSTEMATIC SCANNING ELECTRON MICROSCOPY TECHNIQUE FOR EVALUATING COMBINED BIOLOIGCAL/GRANULAR ACTIVATED CARBON TREATMENT PROCESSES

EPA Science Inventory

A systematic scanning election microscope analytical technique has been developed to examine granular activated carbon used a a medium for biomass attachment in liquid waste treatment. The procedure allows for the objective monitoring, comparing, and trouble shooting of combined ...

Recommended guide for next generation of transportation design build procurement and contracting in the state of Georgia.

DOT National Transportation Integrated Search

2012-09-01

The overall objective of this research project is to develop a systematic approach that evaluates the appropriateness of Design Build Project Delivery System for a transportation project. State DOTs can benefit from this systematic assessment approac...

Flexible methods for segmentation evaluation: Results from CT-based luggage screening

PubMed Central

Karimi, Seemeen; Jiang, Xiaoqian; Cosman, Pamela; Martz, Harry

2017-01-01

BACKGROUND Imaging systems used in aviation security include segmentation algorithms in an automatic threat recognition pipeline. The segmentation algorithms evolve in response to emerging threats and changing performance requirements. Analysis of segmentation algorithms’ behavior, including the nature of errors and feature recovery, facilitates their development. However, evaluation methods from the literature provide limited characterization of the segmentation algorithms. OBJECTIVE To develop segmentation evaluation methods that measure systematic errors such as oversegmentation and undersegmentation, outliers, and overall errors. The methods must measure feature recovery and allow us to prioritize segments. METHODS We developed two complementary evaluation methods using statistical techniques and information theory. We also created a semi-automatic method to define ground truth from 3D images. We applied our methods to evaluate five segmentation algorithms developed for CT luggage screening. We validated our methods with synthetic problems and an observer evaluation. RESULTS Both methods selected the same best segmentation algorithm. Human evaluation confirmed the findings. The measurement of systematic errors and prioritization helped in understanding the behavior of each segmentation algorithm. CONCLUSIONS Our evaluation methods allow us to measure and explain the accuracy of segmentation algorithms. PMID:24699346

Patient- and Caregiver-Reported Assessment Tools for Palliative Care: Summary of the 2017 Agency for Healthcare Research and Quality Technical Brief.

PubMed

Aslakson, Rebecca A; Dy, Sydney M; Wilson, Renee F; Waldfogel, Julie; Zhang, Allen; Isenberg, Sarina R; Blair, Alex; Sixon, Joshua; Lorenz, Karl A; Robinson, Karen A

2017-12-01

Assessment tools are data collection instruments that are completed by or with patients or caregivers and which collect data at the individual patient or caregiver level. The objectives of this study are to 1) summarize palliative care assessment tools completed by or with patients or caregivers and 2) identify needs for future tool development and evaluation. We completed 1) a systematic review of systematic reviews; 2) a supplemental search of previous reviews and Web sites, and/or 3) a targeted search for primary articles when no tools existed in a domain. Paired investigators screened search results, assessed risk of bias, and abstracted data. We organized tools by domains from the National Consensus Project Clinical Practice Guidelines for Palliative Care and selected the most relevant, recent, and highest quality systematic review for each domain. We included 10 systematic reviews and identified 152 tools (97 from systematic reviews and 55 from supplemental sources). Key gaps included no systematic review for pain and few tools assessing structural, cultural, spiritual, or ethical/legal domains, or patient-reported experience with end-of-life care. Psychometric information was available for many tools, but few studies evaluated responsiveness (sensitivity to change) and no studies compared tools. Few to no tools address the spiritual, ethical, or cultural domains or patient-reported experience with end-of-life care. While some data exist on psychometric properties of tools, the responsiveness of different tools to change and/or comparisons between tools have not been evaluated. Future research should focus on developing or testing tools that address domains for which few tools exist, evaluating responsiveness, and comparing tools. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review.

PubMed

Patterson, P Daniel; Weaver, Matthew D; Fabio, Anthony; Teasley, Ellen M; Renn, Megan L; Curtis, Brett R; Matthews, Margaret E; Kroemer, Andrew J; Xun, Xiaoshuang; Bizhanova, Zhadyra; Weiss, Patricia M; Sequeira, Denisse J; Coppler, Patrick J; Lang, Eddy S; Higgins, J Stephen

2018-02-15

This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. A systematic review study design was used and searched six databases, including one website. The research question guiding the search was developed a priori and registered with the PROSPERO database of systematic reviews: "Are there reliable and valid instruments for measuring fatigue among EMS personnel?" (2016:CRD42016040097). The primary outcome of interest was criterion-related validity. Important outcomes of interest included reliability (e.g., internal consistency), and indicators of sensitivity and specificity. Members of the research team independently screened records from the databases. Full-text articles were evaluated by adapting the Bolster and Rourke system for categorizing findings of systematic reviews, and the rated data abstracted from the body of literature as favorable, unfavorable, mixed/inconclusive, or no impact. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology was used to evaluate the quality of evidence. The search strategy yielded 1,257 unique records. Thirty-four unique experimental and non-experimental studies were determined relevant following full-text review. Nineteen studies reported on the reliability and/or validity of ten different fatigue survey instruments. Eighteen different studies evaluated the reliability and/or validity of four different sleepiness survey instruments. None of the retained studies reported sensitivity or specificity. Evidence quality was rated as very low across all outcomes. In this systematic review, limited evidence of the reliability and validity of 14 different survey instruments to assess the fatigue and/or sleepiness status of EMS personnel and related shift worker groups was identified.

Anorexia nervosa and cancer: a protocol for a systematic review and meta-analysis of observational studies.

PubMed

Catalá-López, Ferrán; Hutton, Brian; Driver, Jane A; Ridao, Manuel; Valderas, José M; Gènova-Maleras, Ricard; Forés-Martos, Jaume; Alonso-Arroyo, Adolfo; Saint-Gerons, Diego Macías; Vieta, Eduard; Valencia, Alfonso; Tabarés-Seisdedos, Rafael

2017-07-11

Anorexia nervosa is characterized by a severe restriction of caloric intake, low body weight, fear of gaining weight or of becoming fat, and disturbance of body image. Pathogenesis of the disorder may include genetic predisposition, hormonal changes and a combination of environmental, psychosocial, and cultural factors. Cancer is the second leading cause of death worldwide. At present, no systematic reviews and meta-analyses have evaluated the risk of cancer in people with anorexia nervosa. The objective of this study will be to evaluate the association between anorexia nervosa and the risk of developing or dying from cancer. This study protocol is part of a systematic collection and assessment of multiple systematic reviews and meta-analyses (umbrella review) evaluating the association of cancer and multiple central nervous system disorders. We designed a specific protocol for a new systematic review and meta-analysis of observational studies of anorexia nervosa with risk of developing or dying from any cancer. Data sources will be PubMed, Embase, Scopus, Web of Science, and manual screening of references. Observational studies (case-control and cohort) in humans that examined the association between anorexia nervosa and risk of developing or dying from cancer will be sought. The primary outcomes will be cancer incidence and cancer mortality in association with anorexia nervosa. Secondary outcomes will be site-specific cancer incidence and mortality, respectively. Screening of abstracts and full texts, and data abstraction will be performed by two team members independently. Conflicts at all levels of screening and abstraction will be resolved through discussion. The quality of studies will be assessed by using the Ottawa-Newcastle scale by two team members independently. Random effects models will be conducted where appropriate. Subgroup and additional analyses will be conducted to explore the potential sources of heterogeneity. The World Cancer Research Fund (WCRF)/American Institute for Cancer Research (AICR) criteria and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach will be used for determining the quality of evidence for cancer outcomes. Findings from this systematic review will inform an ongoing umbrella review on cancer and central nervous system disorders. Our systematic review and meta-analysis of observational studies will establish the extent of the epidemiological evidence underlying the association between anorexia nervosa and cancer. PROSPERO CRD42017067462.

Developing core economic outcome sets for asthma studies: a protocol for a systematic review.

PubMed

Hounsome, Natalia; Fitzsimmons, Deborah; Phillips, Ceri; Patel, Anita

2017-08-11

Core outcome sets are standardised lists of outcomes, which should be measured and reported in all clinical studies of a specific condition. This study aims to develop core outcome sets for economic evaluations in asthma studies. Economic outcomes include items such as costs, resource use or quality-adjusted life years. The starting point in developing core outcome sets will be conducting a systematic literature review to establish a preliminary list of reporting items to be considered for inclusion in the core outcome set. We will conduct literature searches of peer-reviewed studies published from January 1990 to January 2017. These will include any comparative or observational studies (including economic models) and systematic reviews reporting economic outcomes. All identified economic outcomes will be tabulated together with the major study characteristics, such as population, study design, the nature and intensity of the intervention, mode of data collection and instrument(s) used to derive an outcome. We will undertake a 'realist synthesis review' to analyse the identified economic outcomes. The outcomes will be summarised in the context of evaluation perspectives, types of economic evaluation and methodological approaches. Parallel to undertaking a systematic review, we will conduct semistructured interviews with stakeholders (including people with personal experience of asthma, health professionals, researchers and decision makers) in order to explore additional outcomes which have not been considered, or used, in published studies. The list of outcomes generated from the systematic review and interviews with stakeholders will form the basis of a Delphi survey to refine the identified outcomes into a core outcome set. The review will not involve access to individual-level data. Findings from our systematic review will be communicated to a broad range of stakeholders including clinical guideline developers, research funders, trial registries, ethics committees and other regulators. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Developing and refining the methods for a 'one-stop shop' for research evidence about health systems.

PubMed

Lavis, John N; Wilson, Michael G; Moat, Kaelan A; Hammill, Amanda C; Boyko, Jennifer A; Grimshaw, Jeremy M; Flottorp, Signe

2015-02-25

Policymakers, stakeholders and researchers have not been able to find research evidence about health systems using an easily understood taxonomy of topics, know when they have conducted a comprehensive search of the many types of research evidence relevant to them, or rapidly identify decision-relevant information in their search results. To address these gaps, we developed an approach to building a 'one-stop shop' for research evidence about health systems. We developed a taxonomy of health system topics and iteratively refined it by drawing on existing categorization schemes and by using it to categorize progressively larger bundles of research evidence. We identified systematic reviews, systematic review protocols, and review-derived products through searches of Medline, hand searches of several databases indexing systematic reviews, hand searches of journals, and continuous scanning of listservs and websites. We developed an approach to providing 'added value' to existing content (e.g., coding systematic reviews according to the countries in which included studies were conducted) and to expanding the types of evidence eligible for inclusion (e.g., economic evaluations and health system descriptions). Lastly, we developed an approach to continuously updating the online one-stop shop in seven supported languages. The taxonomy is organized by governance, financial, and delivery arrangements and by implementation strategies. The 'one-stop shop', called Health Systems Evidence, contains a comprehensive inventory of evidence briefs, overviews of systematic reviews, systematic reviews, systematic review protocols, registered systematic review titles, economic evaluations and costing studies, health reform descriptions and health system descriptions, and many types of added-value coding. It is continuously updated and new content is regularly translated into Arabic, Chinese, English, French, Portuguese, Russian, and Spanish. Policymakers and stakeholders can now easily access and use a wide variety of types of research evidence about health systems to inform decision-making and advocacy. Researchers and research funding agencies can use Health Systems Evidence to identify gaps in the current stock of research evidence and domains that could benefit from primary research, systematic reviews, and review overviews.

Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise.

PubMed

Schünemann, Holger J; Wiercioch, Wojtek; Etxeandia, Itziar; Falavigna, Maicon; Santesso, Nancy; Mustafa, Reem; Ventresca, Matthew; Brignardello-Petersen, Romina; Laisaar, Kaja-Triin; Kowalski, Sérgio; Baldeh, Tejan; Zhang, Yuan; Raid, Ulla; Neumann, Ignacio; Norris, Susan L; Thornton, Judith; Harbour, Robin; Treweek, Shaun; Guyatt, Gordon; Alonso-Coello, Pablo; Reinap, Marge; Brozek, Jan; Oxman, Andrew; Akl, Elie A

2014-02-18

Although several tools to evaluate the credibility of health care guidelines exist, guidance on practical steps for developing guidelines is lacking. We systematically compiled a comprehensive checklist of items linked to relevant resources and tools that guideline developers could consider, without the expectation that every guideline would address each item. We searched data sources, including manuals of international guideline developers, literature on guidelines for guidelines (with a focus on methodology reports from international and national agencies, and professional societies) and recent articles providing systematic guidance. We reviewed these sources in duplicate, extracted items for the checklist using a sensitive approach and developed overarching topics relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions and suggestions for items to be added. We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers. The topics and included items cover all stages of the guideline enterprise, from the planning and formulation of guidelines, to their implementation and evaluation. The final checklist includes links to training materials as well as resources with suggested methodology for applying the items. The checklist will serve as a resource for guideline developers. Consideration of items on the checklist will support the development, implementation and evaluation of guidelines. We will use crowdsourcing to revise the checklist and keep it up to date.

Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise

PubMed Central

Schünemann, Holger J.; Wiercioch, Wojtek; Etxeandia, Itziar; Falavigna, Maicon; Santesso, Nancy; Mustafa, Reem; Ventresca, Matthew; Brignardello-Petersen, Romina; Laisaar, Kaja-Triin; Kowalski, Sérgio; Baldeh, Tejan; Zhang, Yuan; Raid, Ulla; Neumann, Ignacio; Norris, Susan L.; Thornton, Judith; Harbour, Robin; Treweek, Shaun; Guyatt, Gordon; Alonso-Coello, Pablo; Reinap, Marge; Brožek, Jan; Oxman, Andrew; Akl, Elie A.

2014-01-01

Background: Although several tools to evaluate the credibility of health care guidelines exist, guidance on practical steps for developing guidelines is lacking. We systematically compiled a comprehensive checklist of items linked to relevant resources and tools that guideline developers could consider, without the expectation that every guideline would address each item. Methods: We searched data sources, including manuals of international guideline developers, literature on guidelines for guidelines (with a focus on methodology reports from international and national agencies, and professional societies) and recent articles providing systematic guidance. We reviewed these sources in duplicate, extracted items for the checklist using a sensitive approach and developed overarching topics relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions and suggestions for items to be added. Results: We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers. The topics and included items cover all stages of the guideline enterprise, from the planning and formulation of guidelines, to their implementation and evaluation. The final checklist includes links to training materials as well as resources with suggested methodology for applying the items. Interpretation: The checklist will serve as a resource for guideline developers. Consideration of items on the checklist will support the development, implementation and evaluation of guidelines. We will use crowdsourcing to revise the checklist and keep it up to date. PMID:24344144

Using systematic reviews for hazard and risk assessment of endocrine disrupting chemicals

PubMed Central

Beronius, Anna; Vandenberg, Laura N.

2016-01-01

The possibility that endocrine disrupting chemicals (EDCs) in our environment contribute to hormonally related effects and diseases observed in human and wildlife populations has caused concern among decision makers and researchers alike. EDCs challenge principles traditionally applied in chemical risk assessment and the identification and assessment of these compounds has been a much debated topic during the last decade. State of the science reports and risk assessments of potential EDCs have been criticized for not using systematic and transparent approaches in the evaluation of evidence. In the fields of medicine and health care, systematic review methodologies have been developed and used to enable objectivity and transparency in the evaluation of scientific evidence for decision making. Lately, such approaches have also been promoted for use in the environmental health sciences and risk assessment of chemicals. Systematic review approaches could provide a tool for improving the evaluation of evidence for decision making regarding EDCs, e.g. by enabling systematic and transparent use of academic research data in this process. In this review we discuss the advantages and challenges of applying systematic review methodology in the identification and assessment of EDCs. PMID:26847432

Using systematic reviews for hazard and risk assessment of endocrine disrupting chemicals.

PubMed

Beronius, Anna; Vandenberg, Laura N

2015-12-01

The possibility that endocrine disrupting chemicals (EDCs) in our environment contribute to hormonally related effects and diseases observed in human and wildlife populations has caused concern among decision makers and researchers alike. EDCs challenge principles traditionally applied in chemical risk assessment and the identification and assessment of these compounds has been a much debated topic during the last decade. State of the science reports and risk assessments of potential EDCs have been criticized for not using systematic and transparent approaches in the evaluation of evidence. In the fields of medicine and health care, systematic review methodologies have been developed and used to enable objectivity and transparency in the evaluation of scientific evidence for decision making. Lately, such approaches have also been promoted for use in the environmental health sciences and risk assessment of chemicals. Systematic review approaches could provide a tool for improving the evaluation of evidence for decision making regarding EDCs, e.g. by enabling systematic and transparent use of academic research data in this process. In this review we discuss the advantages and challenges of applying systematic review methodology in the identification and assessment of EDCs.

Protocol: a systematic review of studies developing and/or evaluating search strategies to identify prognosis studies.

PubMed

Corp, Nadia; Jordan, Joanne L; Hayden, Jill A; Irvin, Emma; Parker, Robin; Smith, Andrea; van der Windt, Danielle A

2017-04-20

Prognosis research is on the rise, its importance recognised because chronic health conditions and diseases are increasingly common and costly. Prognosis systematic reviews are needed to collate and synthesise these research findings, especially to help inform effective clinical decision-making and healthcare policy. A detailed, comprehensive search strategy is central to any systematic review. However, within prognosis research, this is challenging due to poor reporting and inconsistent use of available indexing terms in electronic databases. Whilst many published search filters exist for finding clinical trials, this is not the case for prognosis studies. This systematic review aims to identify and compare existing methodological filters developed and evaluated to identify prognosis studies of any of the three main types: overall prognosis, prognostic factors, and prognostic [risk prediction] models. Primary studies reporting the development and/or evaluation of methodological search filters to retrieve any type of prognosis study will be included in this systematic review. Multiple electronic bibliographic databases will be searched, grey literature will be sought from relevant organisations and websites, experts will be contacted, and citation tracking of key papers and reference list checking of all included papers will be undertaken. Titles will be screened by one person, and abstracts and full articles will be reviewed for inclusion independently by two reviewers. Data extraction and quality assessment will also be undertaken independently by two reviewers with disagreements resolved by discussion or by a third reviewer if necessary. Filters' characteristics and performance metrics reported in the included studies will be extracted and tabulated. To enable comparisons, filters will be grouped according to database, platform, type of prognosis study, and type of filter for which it was intended. This systematic review will identify all existing validated prognosis search filters and synthesise evidence about their applicability and performance. These findings will identify if current filters provide a proficient means of searching electronic bibliographic databases or if further prognosis filters are needed and can feasibly be developed for systematic searches of prognosis studies.

Developing an evidence-based Guide to Community Preventive Services--methods. The Task Force on Community Preventive Services.

PubMed

Briss, P A; Zaza, S; Pappaioanou, M; Fielding, J; Wright-De Agüero, L; Truman, B I; Hopkins, D P; Mullen, P D; Thompson, R S; Woolf, S H; Carande-Kulis, V G; Anderson, L; Hinman, A R; McQueen, D V; Teutsch, S M; Harris, J R

2000-01-01

Systematic reviews and evidence-based recommendations are increasingly important for decision making in health and medicine. Over the past 20 years, information on the science of synthesizing research results has exploded. However, some approaches to systematic reviews of the effectiveness of clinical preventive services and medical care may be less appropriate for evaluating population-based interventions. Furthermore, methods for linking evidence to recommendations are less well developed than methods for synthesizing evidence. The Guide to Community Preventive Services: Systematic Reviews and Evidence-Based Recommendations (the Guide) will evaluate and make recommendations on population-based and public health interventions. This paper provides an overview of the Guide's process to systematically review evidence and translate that evidence into recommendations. The Guide reviews evidence on effectiveness, the applicability of effectiveness data, (i.e., the extent to which available effectiveness data is thought to apply to additional populations and settings), the intervention's other effects (i.e., important side effects), economic impact, and barriers to implementation of interventions. The steps for obtaining and evaluating evidence into recommendations involve: (1) forming multidisciplinary chapter development teams, (2) developing a conceptual approach to organizing, grouping, selecting and evaluating the interventions in each chapter; (3) selecting interventions to be evaluated; (4) searching for and retrieving evidence; (5) assessing the quality of and summarizing the body of evidence of effectiveness; (6) translating the body of evidence of effectiveness into recommendations; (7) considering information on evidence other than effectiveness; and (8) identifying and summarizing research gaps. Systematic reviews of and evidence-based recommendations for population-health interventions are challenging and methods will continue to evolve. However, using an evidence-based approach to identify and recommend effective interventions directed at specific public health goals may reduce errors in how information is collected and interpreted, identify important gaps in current knowledge thus guiding further research, and enhance the Guide users' ability to assess whether recommendations are valid and prudent from their own perspectives. Over time, all of these advantages could help to increase agreement regarding appropriate community health strategies and help to increase their implementation.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

PubMed

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

An optimal search filter for retrieving systematic reviews and meta-analyses

PubMed Central

2012-01-01

Background Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters. Methods This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter. Results Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened. Conclusions The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity. PMID:22512835

The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration

PubMed Central

Liberati, Alessandro; Altman, Douglas G.; Tetzlaff, Jennifer; Mulrow, Cynthia; Gøtzsche, Peter C.; Ioannidis, John P. A.; Clarke, Mike; Devereaux, P. J.; Kleijnen, Jos; Moher, David

2009-01-01

Systematic reviews and meta-analyses are essential to summarize evidence relating to efficacy and safety of health care interventions accurately and reliably. The clarity and transparency of these reports, however, is not optimal. Poor reporting of systematic reviews diminishes their value to clinicians, policy makers, and other users. Since the development of the QUOROM (QUality Of Reporting Of Meta-analysis) Statement—a reporting guideline published in 1999—there have been several conceptual, methodological, and practical advances regarding the conduct and reporting of systematic reviews and meta-analyses. Also, reviews of published systematic reviews have found that key information about these studies is often poorly reported. Realizing these issues, an international group that included experienced authors and methodologists developed PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) as an evolution of the original QUOROM guideline for systematic reviews and meta-analyses of evaluations of health care interventions. The PRISMA Statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. In this Explanation and Elaboration document, we explain the meaning and rationale for each checklist item. For each item, we include an example of good reporting and, where possible, references to relevant empirical studies and methodological literature. The PRISMA Statement, this document, and the associated Web site (http://www.prisma-statement.org/) should be helpful resources to improve reporting of systematic reviews and meta-analyses. PMID:19621070

American Evaluation Association: Guiding Principles for Evaluators

ERIC Educational Resources Information Center

American Journal of Evaluation, 2009

2009-01-01

The American Evaluation Association (AEA) strives to promote ethical practice in the evaluation of programs, products, personnel, and policy. This article presents the list of principles which AEA developed to guide evaluators in their professional practice. These principles are: (1) Systematic Inquiry; (2) Competence; (3) Integrity/Honesty; (4)…

Environmental Scanning in Educational Planning: Establishing a Strategic Trend Information System.

ERIC Educational Resources Information Center

Morrison, James L.

The systematic evaluation of the macroenvironment is sometimes referred to as a strategic trend information system. Strategic trend intelligence systems are highly developed, systematic intelligence programs that focus on trends and events in the external environment and provide institutions with knowledge to reduce areas of uncertainty and with…

Systematic, theoretically-grounded development and feasibility testing of an innovative, preventive web-based game for children exposed to acute trauma

PubMed Central

Marsac, Meghan L.; Winston, Flaura K.; Hildenbrand, Aimee K.; Kohser, Kristen L.; March, Sonja; Kenardy, Justin; Kassam-Adams, Nancy

2015-01-01

Background Millions of children are affected by acute medical events annually, creating need for resources to promote recovery. While web-based interventions promise wide reach and low cost for users, development can be time- and cost-intensive. A systematic approach to intervention development can help to minimize costs and increase likelihood of effectiveness. Using a systematic approach, our team integrated evidence on the etiology of traumatic stress, an explicit program theory, and a user-centered design process to intervention development. Objective To describe evidence and the program theory model applied to the Coping Coach intervention and present pilot data evaluating intervention feasibility and acceptability. Method Informed by empirical evidence on traumatic stress prevention, an overarching program theory model was articulated to delineate pathways from a) specific intervention content to b) program targets and proximal outcomes to c) key longer-term health outcomes. Systematic user-testing with children ages 8–12 (N = 42) exposed to an acute medical event and their parents was conducted throughout intervention development. Results Functionality challenges in early prototypes necessitated revisions. Child engagement was positive throughout revisions to the Coping Coach intervention. Final pilot-testing demonstrated promising feasibility and high user-engagement and satisfaction. Conclusion Applying a systematic approach to the development of Coping Coach led to the creation of a functional intervention that is accepted by children and parents. Development of new e-health interventions may benefit from a similar approach. Future research should evaluate the efficacy of Coping Coach in achieving targeted outcomes of reduced trauma symptoms and improved health-related quality of life. PMID:25844276

Military Personnel: Actions Needed to Address Sexual Assaults of Male Servicemembers

DTIC Science & Technology

2015-03-01

providers we interviewed said that these same traditional gender stereotypes can make it particularly difficult for males to report that they were...develop a plan for using its data to inform program development; systematically evaluate whether male victims have gender - specific medical and...not systematically identified whether male victims have any gender -specific needs. DOD sexual assault policies specify that care be sensitive to gender

Developmental procedures for the clinical practice guidelines for conscious sedation in dentistry for the Korean Academy of Dental Sciences.

PubMed

An, So-Youn; Seo, Kwang-Suk; Kim, Seungoh; Kim, Jongbin; Lee, Deok-Won; Hwang, Kyung-Gyun; Kim, Hyun Jeong

2016-12-01

Evidence-based clinical practice guidelines (CPGs) are defined as "statements that are scientifically reviewed about evidence and systematically developed to assist in the doctors' and patients' decision making in certain clinical situations." This recommendation aims to promote good clinical practice for the provision of safe and effective practices of conscious sedation in dentistry. The development of this clinical practice guideline was conducted by performing a systematic search of the literature for evidence-based CPGs. Existing guidelines, relevant systematic reviews, policy documents, legislation, or other recommendations were reviewed and appraised. To supplement this information, key questions were formulated by the Guideline Development Group and used as the basis for designing systematic literature search strategies to identify literature that may address these questions. Guideline documents were evaluated through a review of domestic and international databases for the development of a renewing of existing conscious sedation guidelines for dentistry. Clinical practice guidelines were critically appraised for their methodologies using Appraisal of guidelines for research and evaluation (AGREE) II. A total of 12 existing CPGs were included and 13 recommendations were made in a range of general, adult, and pediatric areas. The clinical practice guidelines for conscious sedation will be reviewed in 5 years' time for further updates to reflect significant changes in the field.

Governance for public health and health equity: The Tröndelag model for public health work.

PubMed

Lillefjell, Monica; Magnus, Eva; Knudtsen, Margunn SkJei; Wist, Guri; Horghagen, Sissel; Espnes, Geir Arild; Maass, Ruca; Anthun, Kirsti Sarheim

2018-06-01

Multi-sectoral governance of population health is linked to the realization that health is the property of many societal systems. This study aims to contribute knowledge and methods that can strengthen the capacities of municipalities regarding how to work more systematically, knowledge-based and multi-sectoral in promoting health and health equity in the population. Process evaluation was conducted, applying a mixed-methods research design, combining qualitative and quantitative data collection methods. Processes strengthening systematic and multi-sectoral development, implementation and evaluation of research-based measures to promote health, quality of life, and health equity in, for and with municipalities were revealed. A step-by-step model, that emphasizes the promotion of knowledge-based, systematic, multi-sectoral public health work, as well as joint ownership of local resources, initiatives and policies has been developed. Implementation of systematic, knowledge-based and multi-sectoral governance of public health measures in municipalities demand shared understanding of the challenges, updated overview of the population health and impact factors, anchoring in plans, new skills and methods for selection and implementation of measures, as well as development of trust, ownership, shared ethics and goals among those involved.

Development and pilot test of a process to identify research needs from a systematic review.

PubMed

Saldanha, Ian J; Wilson, Lisa M; Bennett, Wendy L; Nicholson, Wanda K; Robinson, Karen A

2013-05-01

To ensure appropriate allocation of research funds, we need methods for identifying high-priority research needs. We developed and pilot tested a process to identify needs for primary clinical research using a systematic review in gestational diabetes mellitus. We conducted eight steps: abstract research gaps from a systematic review using the Population, Intervention, Comparison, Outcomes, and Settings (PICOS) framework; solicit feedback from the review authors; translate gaps into researchable questions using the PICOS framework; solicit feedback from multidisciplinary stakeholders at our institution; establish consensus among multidisciplinary external stakeholders on the importance of the research questions using the Delphi method; prioritize outcomes; develop conceptual models to highlight research needs; and evaluate the process. We identified 19 research questions. During the Delphi method, external stakeholders established consensus for 16 of these 19 questions (15 with "high" and 1 with "medium" clinical benefit/importance). We pilot tested an eight-step process to identify clinically important research needs. Before wider application of this process, it should be tested using systematic reviews of other diseases. Further evaluation should include assessment of the usefulness of the research needs generated using this process for primary researchers and funders. Copyright © 2013 Elsevier Inc. All rights reserved.

Test Selection, Adaptation, and Evaluation: A Systematic Approach to Assess Nutritional Influences on Child Development in Developing Countries

ERIC Educational Resources Information Center

Prado, Elizabeth L.; Hartini, Sri; Rahmawati, Atik; Ismayani, Elfa; Hidayati, Astri; Hikmah, Nurul; Muadz, Husni; Apriatni, Mandri S.; Ullman, Michael T.; Shankar, Anuraj H.; Alcock, Katherine J.

2010-01-01

Background: Evaluating the impact of nutrition interventions on developmental outcomes in developing countries can be challenging since most assessment tests have been produced in and for developed country settings. Such tests may not be valid measures of children's abilities when used in a new context. Aims: We present several principles for the…

Assessing Technical Competence in Surgical Trainees: A Systematic Review.

PubMed

Szasz, Peter; Louridas, Marisa; Harris, Kenneth A; Aggarwal, Rajesh; Grantcharov, Teodor P

2015-06-01

To systematically examine the literature describing the methods by which technical competence is assessed in surgical trainees. The last decade has witnessed an evolution away from time-based surgical education. In response, governing bodies worldwide have implemented competency-based education paradigms. The definition of competence, however, remains elusive, and the impact of these education initiatives in terms of assessment methods remains unclear. A systematic review examining the methods by which technical competence is assessed was conducted by searching MEDLINE, EMBASE, PsychINFO, and the Cochrane database of systematic reviews. Abstracts of retrieved studies were reviewed and those meeting inclusion criteria were selected for full review. Data were retrieved in a systematic manner, the validity and reliability of the assessment methods was evaluated, and quality was assessed using the Grading of Recommendations Assessment, Development and Evaluation classification. Of the 6814 studies identified, 85 studies involving 2369 surgical residents were included in this review. The methods used to assess technical competence were categorized into 5 groups; Likert scales (37), benchmarks (31), binary outcomes (11), novel tools (4), and surrogate outcomes (2). Their validity and reliability were mostly previously established. The overall Grading of Recommendations Assessment, Development and Evaluation for randomized controlled trials was high and low for the observational studies. The definition of technical competence continues to be debated within the medical literature. The methods used to evaluate technical competence predominantly include instruments that were originally created to assess technical skill. Very few studies identify standard setting approaches that differentiate competent versus noncompetent performers; subsequently, this has been identified as an area with great research potential.

Development and Evaluation of ‘Briefing Notes’ as a Novel Knowledge Translation Tool to Aid the Implementation of Sex/Gender Analysis in Systematic Reviews: A Pilot Study

PubMed Central

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E.; Shea, Beverley; O’Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

Background There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly ‘briefing note’ format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Methods Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Results Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group’s focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Conclusions Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can assist systematic reviewers in ensuring the applicability of research evidence, with the goal of improved health outcomes for diverse populations. PMID:25372876

Evaluating Causes of Ecological Impairments in the Estuaries of Ukraine

EPA Science Inventory

Ukrainian estuaries have not undergone a systematic evaluation of the causes of ecological impairments caused by anthropogenic contamination. The objective of this evaluation is to use recently developed diagnostic tools to determine the causes of benthic ecological impairments. ...

Evaluation of Follow-Up Effects of the International Child Development Programme on Caregivers in Mozambique

ERIC Educational Resources Information Center

Skar, Ane-Marthe Solheim; Sherr, Lorraine; Clucas, Claudine; von Tetzchner, Stephen

2014-01-01

Parenting programs have been used to good effect in many settings, yet few are systematically introduced and evaluated in developing countries. This study explores the relative long-term effect of participation in the International Child Development Programme (ICDP) in a group of caregivers in Mozambique. A quasi-experimental design was used to…

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

PubMed Central

Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A. Metin

2015-01-01

Background Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. Objectives To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. Methods A systematic review was completed for the period 2000–2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Results Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Conclusions Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing. PMID:26418859

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards.

PubMed

Kågesten, Anna; Tunçalp, Ӧzge; Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A Metin

2015-01-01

Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. A systematic review was completed for the period 2000-2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing.

Educational Needs of Finnish Polytechnic Librarians.

ERIC Educational Resources Information Center

Viiri, Marjariitta

The polytechnics are the newest part of the Finnish system of higher education. The whole polytechnic system is being developed on the basis of systematic monitoring and evaluation of its activities. Staff development and library and information services were both targets selected for evaluation in this study carried out to identify the…

Mapping the absolute magnetic field and evaluating the quadratic Zeeman-effect-induced systematic error in an atom interferometer gravimeter

NASA Astrophysics Data System (ADS)

Hu, Qing-Qing; Freier, Christian; Leykauf, Bastian; Schkolnik, Vladimir; Yang, Jun; Krutzik, Markus; Peters, Achim

2017-09-01

Precisely evaluating the systematic error induced by the quadratic Zeeman effect is important for developing atom interferometer gravimeters aiming at an accuracy in the μ Gal regime (1 μ Gal =10-8m /s2 ≈10-9g ). This paper reports on the experimental investigation of Raman spectroscopy-based magnetic field measurements and the evaluation of the systematic error in the gravimetric atom interferometer (GAIN) due to quadratic Zeeman effect. We discuss Raman duration and frequency step-size-dependent magnetic field measurement uncertainty, present vector light shift and tensor light shift induced magnetic field measurement offset, and map the absolute magnetic field inside the interferometer chamber of GAIN with an uncertainty of 0.72 nT and a spatial resolution of 12.8 mm. We evaluate the quadratic Zeeman-effect-induced gravity measurement error in GAIN as 2.04 μ Gal . The methods shown in this paper are important for precisely mapping the absolute magnetic field in vacuum and reducing the quadratic Zeeman-effect-induced systematic error in Raman transition-based precision measurements, such as atomic interferometer gravimeters.

Evaluation of evidence-based literature and formulation of recommendations for the clinical preventive guidelines for immigrants and refugees in Canada

PubMed Central

Tugwell, Peter; Pottie, Kevin; Welch, Vivian; Ueffing, Erin; Chambers, Andrea; Feightner, John

2011-01-01

Background: This article describes the evidence review and guideline development method developed for the Clinical Preventive Guidelines for Immigrants and Refugees in Canada by the Canadian Collaboration for Immigrant and Refugee Health Guideline Committee. Methods: The Appraisal of Guidelines for Research and Evaluation (AGREE) best-practice framework was combined with the recently developed Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to produce evidence-based clinical guidelines for immigrants and refugees in Canada. Results: A systematic approach was designed to produce the evidence reviews and apply the GRADE approach, including building on evidence from previous systematic reviews, searching for and comparing evidence between general and specific immigrant populations, and applying the GRADE criteria for making recommendations. This method was used for priority health conditions that had been selected by practitioners caring for immigrants and refugees in Canada. Interpretation: This article outlines the 14-step method that was defined to standardize the guideline development process for each priority health condition. PMID:20573711

A potential role of anti-poverty programs in health promotion

PubMed Central

Silverman, Kenneth; Holtyn, August F.; Jarvis, Brantley

2016-01-01

Poverty is one of the most pervasive risk factors underlying poor health, but is rarely targeted to improve health. Research on the effects of anti-poverty interventions on health has been limited, at least in part because funding for that research has been limited. Anti-poverty programs have been applied on a large scale, frequently by governments, but without systematic development and cumulative programmatic experimental studies. Anti-poverty programs that produce lasting effects on poverty have not been developed. Before evaluating the effect of anti-poverty programs on health, programs must be developed that can reduce poverty consistently. Anti-poverty programs require systematic development and cumulative programmatic scientific evaluation. Research on the therapeutic workplace could provide a model for that research and an adaptation of the therapeutic workplace could serve as a foundation of a comprehensive anti-poverty program. Once effective anti-poverty programs are developed, future research could determine if those programs improve health in addition to increasing income. The potential personal, health and economic benefits of effective anti-poverty programs could be substantial, and could justify the major efforts and expenses that would be required to support systematic research to develop such programs. PMID:27235603

A potential role of anti-poverty programs in health promotion.

PubMed

Silverman, Kenneth; Holtyn, August F; Jarvis, Brantley P

2016-11-01

Poverty is one of the most pervasive risk factors underlying poor health, but is rarely targeted to improve health. Research on the effects of anti-poverty interventions on health has been limited, at least in part because funding for that research has been limited. Anti-poverty programs have been applied on a large scale, frequently by governments, but without systematic development and cumulative programmatic experimental studies. Anti-poverty programs that produce lasting effects on poverty have not been developed. Before evaluating the effect of anti-poverty programs on health, programs must be developed that can reduce poverty consistently. Anti-poverty programs require systematic development and cumulative programmatic scientific evaluation. Research on the therapeutic workplace could provide a model for that research and an adaptation of the therapeutic workplace could serve as a foundation of a comprehensive anti-poverty program. Once effective anti-poverty programs are developed, future research could determine if those programs improve health in addition to increasing income. The potential personal, health and economic benefits of effective anti-poverty programs could be substantial, and could justify the major efforts and expenses that would be required to support systematic research to develop such programs. Copyright © 2016 Elsevier Inc. All rights reserved.

Systematic reviews of health economic evaluations: a protocol for a systematic review of characteristics and methods applied.

PubMed

Luhnen, Miriam; Prediger, Barbara; Neugebauer, Edmund A M; Mathes, Tim

2017-12-02

The number of systematic reviews of economic evaluations is steadily increasing. This is probably related to the continuing pressure on health budgets worldwide which makes an efficient resource allocation increasingly crucial. In particular in recent years, the introduction of several high-cost interventions presents enormous challenges regarding universal accessibility and sustainability of health care systems. An increasing number of health authorities, inter alia, feel the need for analyzing economic evidence. Economic evidence might effectively be generated by means of systematic reviews. Nevertheless, no standard methods seem to exist for their preparation so far. The objective of this study was to analyze the methods applied for systematic reviews of health economic evaluations (SR-HE) with a focus on the identification of common challenges. The planned study is a systematic review of the characteristics and methods actually applied in SR-HE. We will combine validated search filters developed for the retrieval of economic evaluations and systematic reviews to identify relevant studies in MEDLINE (via Ovid, 2015-present). To be eligible for inclusion, studies have to conduct a systematic review of full economic evaluations. Articles focusing exclusively on methodological aspects and secondary publications of health technology assessment (HTA) reports will be excluded. Two reviewers will independently assess titles and abstracts and then full-texts of studies for eligibility. Methodological features will be extracted in a standardized, beforehand piloted data extraction form. Data will be summarized with descriptive statistical measures and systematically analyzed focusing on differences/similarities and methodological weaknesses. The systematic review will provide a detailed overview of characteristics of SR-HE and the applied methods. Differences and methodological shortcomings will be detected and their implications will be discussed. The findings of our study can improve the recommendations on the preparation of SR-HE. This can increase the acceptance and usefulness of systematic reviews in health economics for researchers and medical decision makers. The review will not be registered with PROSPERO as it does not meet the eligibility criterion of dealing with clinical outcomes.

A Scale for Evaluating Practicum Students in Counseling and Supervision

ERIC Educational Resources Information Center

Myrick, Robert D.; Kelly, F. Donald, Jr.

1971-01-01

This article presents an instrument, the Counselor Evaluation Rating Scale, which can be used as an aid in the systematic evaluation of a student counselor in a supervised counseling experience. Development of the CERS and its reliability are discussed. (Author)

Functional Analysis of Problem Behavior: A Systematic Approach for Identifying Idiosyncratic Variables

PubMed Central

Roscoe, Eileen M.; Schlichenmeyer, Kevin J.; Dube, William V.

2015-01-01

When inconclusive functional analysis (FA) outcomes occur, a number of modifications have been made to enhance the putative establishing operation or consequence associated with behavioral maintenance. However, a systematic method for identifying relevant events to test during modified FAs has not been evaluated. The purpose of this study was to develop and evaluate a technology for systematically identifying events to test in a modified FA after an initial FA led to inconclusive outcomes. Six individuals whose initial FA showed little or no responding or high levels only in the control condition participated. An indirect assessment (IA) questionnaire developed for identifying idiosyncratic variables was administered, and a descriptive analysis (DA) was conducted. Results from the IA only or a combination of the IA and DA were used to inform modified FA test and control conditions. Conclusive FA outcomes were obtained with five of the six participants during the modified FA phase. PMID:25930176

Usage-Based Collection Evaluation with a Curricular Focus

ERIC Educational Resources Information Center

Kohn, Karen C.

2013-01-01

Systematic evaluation of a library's collection can be a useful tool for collection development. After reviewing three evaluation methods and their usefulness for our small academic library, I undertook a usage-based evaluation, focusing on narrow segments of our collection that served specific undergraduate courses. For each section, I collected…

TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: content analysis and systematic review.

PubMed

Dall, P M; Coulter, E H; Fitzsimons, C F; Skelton, D A; Chastin, Sfm

2017-04-08

Sedentary behaviour (SB) has distinct deleterious health outcomes, yet there is no consensus on best practice for measurement. This study aimed to identify the optimal self-report tool for population surveillance of SB, using a systematic framework. A framework, TAxonomy of Self-reported Sedentary behaviour Tools (TASST), consisting of four domains (type of assessment, recall period, temporal unit and assessment period), was developed based on a systematic inventory of existing tools. The inventory was achieved through a systematic review of studies reporting SB and tracing back to the original description. A systematic review of the accuracy and sensitivity to change of these tools was then mapped against TASST domains. Systematic searches were conducted via EBSCO, reference lists and expert opinion. The inventory included tools measuring SB in adults that could be self-completed at one sitting, and excluded tools measuring SB in specific populations or contexts. The systematic review included studies reporting on the accuracy against an objective measure of SB and/or sensitivity to change of a tool in the inventory. The systematic review initially identified 32 distinct tools (141 questions), which were used to develop the TASST framework. Twenty-two studies evaluated accuracy and/or sensitivity to change representing only eight taxa. Assessing SB as a sum of behaviours and using a previous day recall were the most promising features of existing tools. Accuracy was poor for all existing tools, with underestimation and overestimation of SB. There was a lack of evidence about sensitivity to change. Despite the limited evidence, mapping existing SB tools onto the TASST framework has enabled informed recommendations to be made about the most promising features for a surveillance tool, identified aspects on which future research and development of SB surveillance tools should focus. International prospective register of systematic reviews (PROPSPERO)/CRD42014009851. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Children's Play in Multifamily Housing

ERIC Educational Resources Information Center

Becker, Franklin D.

1976-01-01

Using formal and informal interviews and systematic and casual observations, children's play facilities in seven multifamily housing developments for moderate and low income families were evaluated. Results of the evaluation for both children and adults are reported. (RH)

The Novel Language-Systematic Aphasia Screening SAPS: Screening-Based Therapy in Combination with Computerised Home Training

ERIC Educational Resources Information Center

Krzok, Franziska; Rieger, Verena; Niemann, Katharina; Nobis-Bosch, Ruth; Radermacher, Irmgard; Huber, Walter; Willmes, Klaus; Abel, Stefanie

2018-01-01

Background: SAPS--'Sprachsystematisches Aphasiescreening'--is a novel language-systematic aphasia screening developed for the German language, which already had been positively evaluated. It offers a fast assessment of modality-specific psycholinguistic components at different levels of complexity and the derivation of impairment-based treatment…

A Systematic Review of Psychometric Evaluation of Motivational Interviewing Integrity Measures

ERIC Educational Resources Information Center

Wallace, Lloyd; Turner, Fiona

2009-01-01

The Motivational Interviewing Skills Code (MISC) has been developed to measure motivational interviewing skill, but a need has been identified for more economical instruments. This study expands on a previous systematic review by Madson and Campbell (2006) and examines the extent to which motivational interviewing integrity measures other than the…

Allelopathic potential and systematic evaluation of organic extracts from Canavalia ensiformis leaves (Jack beans).

PubMed

Santos, Sonia; de Moraes, Maria de Lourdes Leite; da Silva Souza Filho, Antonio Pedro; Rezende, Maria Olímpia Oliveira

2005-01-01

This article describes the assessment of possible allelopathic potential of organic extracts obtained from leaves of Canavalia ensiformis under laboratory conditions. Furthermore, a systematic evaluation of these extracts was carried out using specific protocols developed in capillary electrophoresis (CE) to determine some groups of secondary metabolites. After the identification and quantification of compounds, the effects of compounds on germination of some common weeds was investigated, which are becoming a real problem in pastures in the state of Pará, Brazil.

The current state of cancer family history collection tools in primary care: a systematic review.

PubMed

Qureshi, Nadeem; Carroll, June C; Wilson, Brenda; Santaguida, Pasqualina; Allanson, Judith; Brouwers, Melissa; Raina, Parminder

2009-07-01

Systematic collection of family history is a prerequisite for identifying genetic risk. This study reviewed tools applicable to the primary care assessment of family history of breast, colorectal, ovarian, and prostate cancer. MEDLINE, EMBASE, CINAHL, and Cochrane Central were searched for publications. All primary study designs were included. Characteristics of the studies, the family history collection tools, and the setting were evaluated. Of 40 eligible studies, 18 relevant family history tools were identified, with 11 developed for use in primary care. Most collected information on more than one cancer and on affected relatives used self-administered questionnaires and paper-based formats. Eleven tools had been evaluated relative to current practice, demonstrating 46-78% improvement in data recording over family history recording in patient charts and 75-100% agreement with structured genetic interviews. Few tools have been developed specifically for primary care settings. The few that have been evaluated performed well. The very limited evidence, which depends in part on extrapolation from studies in settings other than primary care, suggests that systematic tools may add significant family health information compared with current primary care practice. The effect of their use on health outcomes has not been evaluated.

Validation of virtual learning object to support the teaching of nursing care systematization.

PubMed

Salvador, Pétala Tuani Candido de Oliveira; Mariz, Camila Maria Dos Santos; Vítor, Allyne Fortes; Ferreira Júnior, Marcos Antônio; Fernandes, Maria Isabel Domingues; Martins, José Carlos Amado; Santos, Viviane Euzébia Pereira

2018-01-01

to describe the content validation process of a Virtual Learning Object to support the teaching of nursing care systematization to nursing professionals. methodological study, with quantitative approach, developed according to the methodological reference of Pasquali's psychometry and conducted from March to July 2016, from two-stage Delphi procedure. in the Delphi 1 stage, eight judges evaluated the Virtual Object; in Delphi 2 stage, seven judges evaluated it. The seven screens of the Virtual Object were analyzed as to the suitability of its contents. The Virtual Learning Object to support the teaching of nursing care systematization was considered valid in its content, with a Total Content Validity Coefficient of 0.96. it is expected that the Virtual Object can support the teaching of nursing care systematization in light of appropriate and effective pedagogical approaches.

Systematic evaluation of implementation fidelity of complex interventions in health and social care

PubMed Central

2010-01-01

Background Evaluation of an implementation process and its fidelity can give insight into the 'black box' of interventions. However, a lack of standardized methods for studying fidelity and implementation process have been reported, which might be one reason for the fact that few prior studies in the field of health service research have systematically evaluated interventions' implementation processes. The aim of this project is to systematically evaluate implementation fidelity and possible factors influencing fidelity of complex interventions in health and social care. Methods A modified version of The Conceptual Framework for Implementation Fidelity will be used as a conceptual model for the evaluation. The modification implies two additional moderating factors: context and recruitment. A systematic evaluation process was developed. Multiple case study method is used to investigate implementation of three complex health service interventions. Each case will be investigated in depth and longitudinally, using both quantitative and qualitative methods. Discussion This study is the first attempt to empirically test The Conceptual Framework for Implementation Fidelity. The study can highlight mechanism and factors of importance when implementing complex interventions. Especially the role of the moderating factors on implementation fidelity can be clarified. Trial Registration Supported Employment, SE, among people with severe mental illness -- a randomized controlled trial: NCT00960024. PMID:20815872

The execution of systematic measurements on plane cascades

NASA Technical Reports Server (NTRS)

Scholz, N.

1978-01-01

The present state of development of the experimental technique regarding the flow through cascades and several points to be specially observed in the design of cascade wind tunnels were discussed. The equations required for the evaluation of the momentum measurements in two dimensional flow through cascades were developed. Regarding the effect of the jet contraction due to the boundary layer along the side walls a simple method for correction was also given in order to obtain two dimensional flow characteristics. Also given were the equations for the evaluation of the pressure distribution measurements. Another contribution was made regarding the presentation of the test results in the form of nondimensional quantities. The results of systematic measurements of cascades with symmetrical aerofoil were reported, and the above suggested method was applied for the evaluation of the measurements.

Evaluation of Different Scoring Rules for a Noncognitive Test in Development. Research Report. ETS RR-16-03

ERIC Educational Resources Information Center

Guo, Hongwen; Zu, Jiyun; Kyllonen, Patrick; Schmitt, Neal

2016-01-01

In this report, systematic applications of statistical and psychometric methods are used to develop and evaluate scoring rules in terms of test reliability. Data collected from a situational judgment test are used to facilitate the comparison. For a well-developed item with appropriate keys (i.e., the correct answers), agreement among various…

Systematic review protocol of interventions to improve the psychological well-being of general practitioners.

PubMed

Murray, Marylou; Murray, Lois; Donnelly, Michael

2015-09-22

The challenges and complexities faced by general practitioners are increasing, and there are concerns about their well-being. Consequently, attention has been directed towards developing and evaluating interventions and strategies to improve general practitioner well-being and their capacity to cope with workplace challenges. This systematic review aims to evaluate research evidence regarding the effectiveness of interventions designed to improve general practitioner well-being. Eligible studies will include programmes developed to improve psychological well-being that have assessed outcomes using validated tools pertaining to well-being and related outcomes. Only programmes that have been evaluated using controlled study designs will be reviewed. An appropriately developed search strategy will be applied to six electronic databases: the Cochrane Database of Systematic Reviews, MEDLINE, Embase, CINAHL, PsycINFO and Web of Science. Studies will be screened in two stages by two independent reviewers. A third reviewer will arbitrate when required. Pre-specified inclusion and exclusion criteria will be assessed during a pilot phase early on in the review process. The Cochrane data extraction form will be adapted and applied to each eligible study by two independent reviewers, and each study will be appraised critically using standardised checklists from the Cochrane Handbook. Methodological quality will be taken into account in the analysis of the data and the synthesis of results. A narrative synthesis will be undertaken if data is unsuited to a meta-analysis. The systematic review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidance. This will be the first systematic review on this topic, and the evidence synthesis will aid decision-making by general practitioners, policy makers and planners regarding ways in which to improve GP well-being. Findings will be disseminated at general practitioner meetings, conferences and in professional and peer-reviewed journals. PROSPERO CRD42015017899.

A Quantitative Evaluation of Service Priorities and Satisfaction of Online University Students

ERIC Educational Resources Information Center

Valle, Danielle Elizabeth

2016-01-01

As online education grows, institutions must develop and evaluate student services to meet the needs of adult online students. The university at which the study was conducted had growing online enrollment, but no systematic examination of services from the students' perspective to drive service development and improvement. This represented a gap…

DEVELOPMENT OF BIOAVAILABILITY AND BIOKINETICS DETERMINATION METHODS FOR ORGANIC POLLUTANTS IN SOIL TO ENHANCE IN-SITU AND ON-SITE BIOREMEDIATION

EPA Science Inventory

Determination of biodegradation rates of organics in soil slurry and compacted soil systems is essential for evaluating the efficacy of bioremediation for treatment of contaminated soils. In this paper, a systematic protocol has been developed for evaluating bioknetic and transp...

A Systematic Literature Review on Evaluation of Digital Tools for Authoring Evidence-Based Clinical Guidelines.

PubMed

Khodambashi, Soudabeh; Nytrø, Øystein

2017-01-01

To facilitate the clinical guideline (GL) development process, different groups of researchers have proposed tools that enable computer-supported tools for authoring and publishing GLs. In a previous study we interviewed GL authors in different Norwegian institutions and identified tool shortcomings. In this follow-up study our goal is to explore to what extent GL authoring tools have been evaluated by researchers, guideline organisations, or GL authors. This article presents results from a systematic literature review of evaluation (including usability) of GL authoring tools. A controlled database search and backward snow-balling were used to identify relevant articles. From the 12692 abstracts found, 188 papers were fully reviewed and 26 papers were identified as relevant. The GRADEPro tool has attracted some evaluation, however popular tools and platforms such as DECIDE, Doctor Evidence, JBI-SUMARI, G-I-N library have not been subject to specific evaluation from an authoring perspective. Therefore, we found that little attention was paid to the evaluation of the tools in general. We could not find any evaluation relevant to how tools integrate and support the complex GL development workflow. The results of this paper are highly relevant to GL authors, tool developers and GL publishing organisations in order to improve and control the GL development and maintenance process.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ohi, J.

Supporting analysis and assessments can provide a sound analytic foundation and focus for program planning, evaluation, and coordination, particularly if issues of hydrogen production, distribution, storage, safety, and infrastructure can be analyzed in a comprehensive and systematic manner. The overall purpose of this activity is to coordinate all key analytic tasks-such as technology and market status, opportunities, and trends; environmental costs and benefits; and regulatory constraints and opportunities-within a long-term and systematic analytic foundation for program planning and evaluation. Within this context, the purpose of the project is to help develop and evaluate programmatic pathway options that incorporate near andmore » mid-term strategies to achieve the long-term goals of the Hydrogen Program. In FY 95, NREL will develop a comprehensive effort with industry, state and local agencies, and other federal agencies to identify and evaluate programmatic pathway options to achieve the long-term goals of the Program. Activity to date is reported.« less

Definitions and validation criteria for biomarkers and surrogate endpoints: development and testing of a quantitative hierarchical levels of evidence schema.

PubMed

Lassere, Marissa N; Johnson, Kent R; Boers, Maarten; Tugwell, Peter; Brooks, Peter; Simon, Lee; Strand, Vibeke; Conaghan, Philip G; Ostergaard, Mikkel; Maksymowych, Walter P; Landewe, Robert; Bresnihan, Barry; Tak, Paul-Peter; Wakefield, Richard; Mease, Philip; Bingham, Clifton O; Hughes, Michael; Altman, Doug; Buyse, Marc; Galbraith, Sally; Wells, George

2007-03-01

There are clear advantages to using biomarkers and surrogate endpoints, but concerns about clinical and statistical validity and systematic methods to evaluate these aspects hinder their efficient application. Our objective was to review the literature on biomarkers and surrogates to develop a hierarchical schema that systematically evaluates and ranks the surrogacy status of biomarkers and surrogates; and to obtain feedback from stakeholders. After a systematic search of Medline and Embase on biomarkers, surrogate (outcomes, endpoints, markers, indicators), intermediate endpoints, and leading indicators, a quantitative surrogate validation schema was developed and subsequently evaluated at a stakeholder workshop. The search identified several classification schema and definitions. Components of these were incorporated into a new quantitative surrogate validation level of evidence schema that evaluates biomarkers along 4 domains: Target, Study Design, Statistical Strength, and Penalties. Scores derived from 3 domains the Target that the marker is being substituted for, the Design of the (best) evidence, and the Statistical strength are additive. Penalties are then applied if there is serious counterevidence. A total score (0 to 15) determines the level of evidence, with Level 1 the strongest and Level 5 the weakest. It was proposed that the term "surrogate" be restricted to markers attaining Levels 1 or 2 only. Most stakeholders agreed that this operationalization of the National Institutes of Health definitions of biomarker, surrogate endpoint, and clinical endpoint was useful. Further development and application of this schema provides incentives and guidance for effective biomarker and surrogate endpoint research, and more efficient drug discovery, development, and approval.

Using a Systematic Conceptual Model for a Process Evaluation of a Middle School Obesity Risk-Reduction Nutrition Curriculum Intervention: Choice, Control & Change

PubMed Central

Lee, Heewon; Contento, Isobel R.; Koch, Pamela

2012-01-01

Objective To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. Design A process evaluation study based on a systematic conceptual model. Setting Five middle schools in New York City. Participants 562 students in 20 classes and their science teachers (n=8). Main Outcome Measures Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers’ curriculum evaluation, and satisfaction with teaching the curriculum. Analysis Descriptive statistics and Spearman’s Rho Correlation for quantitative analysis and content analysis for qualitative data were used. Results Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teachers’ satisfaction with teaching the curriculum was highly correlated with students’ satisfaction (p <.05). Teachers’ perception of amount of student work was negatively correlated with implementation and with student satisfaction (p<.05). Conclusions and implications Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. PMID:23321021

Using a systematic conceptual model for a process evaluation of a middle school obesity risk-reduction nutrition curriculum intervention: choice, control & change.

PubMed

Lee, Heewon; Contento, Isobel R; Koch, Pamela

2013-03-01

To use and review a conceptual model of process evaluation and to examine the implementation of a nutrition education curriculum, Choice, Control & Change, designed to promote dietary and physical activity behaviors that reduce obesity risk. A process evaluation study based on a systematic conceptual model. Five middle schools in New York City. Five hundred sixty-two students in 20 classes and their science teachers (n = 8). Based on the model, teacher professional development, teacher implementation, and student reception were evaluated. Also measured were teacher characteristics, teachers' curriculum evaluation, and satisfaction with teaching the curriculum. Descriptive statistics and Spearman ρ correlation for quantitative analysis and content analysis for qualitative data were used. Mean score of the teacher professional development evaluation was 4.75 on a 5-point scale. Average teacher implementation rate was 73%, and the student reception rate was 69%. Ongoing teacher support was highly valued by teachers. Teacher satisfaction with teaching the curriculum was highly correlated with student satisfaction (P < .05). Teacher perception of amount of student work was negatively correlated with implementation and with student satisfaction (P < .05). Use of a systematic conceptual model and comprehensive process measures improves understanding of the implementation process and helps educators to better implement interventions as designed. Copyright © 2013 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Dental Students' Use of AMSTAR to Critically Appraise Systematic Reviews.

PubMed

Teich, Sorin T; Heima, Masahiro; Lang, Lisa

2015-09-01

The idea of basing clinical procedures upon evidence gathered by observation is less than 200 years old, with the first set of evidence-based position papers dating back only to the early 1970s. The relationship between evidence-based education and health outcomes is difficult to test and may be indirect, but teaching critical appraisal skills may be beneficial in developing knowledge. Systematic reviews have a central role in the process of clinical decision making in practice and therefore should be of high quality, following a rigorous protocol that can be evaluated with validated tools. The aim of this study was to assess how dental students utilized the Assessment of Multiple Systematic Reviews (AMSTAR) appraisal tool to evaluate systematic reviews in the context of a treatment planning course. During the in-class final exam, students were required to appraise the quality of a systematic review and to justify their answers. Of the 74 third-year students who took the exam, 100% answered all questions on the AMSTAR form. The mean number of correct answers was nine (SD=1.047, Min=6, Max=10), with no student providing all 11 correct answers. The fact that nearly 90% of the students provided eight or more correct answers suggests that AMSTAR can be used by students to evaluate the methodological quality of systematic reviews. It also was evident that although the AMSTAR tool requires less than 15 minutes to complete an evaluation, using it requires extensive training and repetition to achieve consistent and reliable results.

AHRQ series on complex intervention systematic reviews-paper 7: PRISMA-CI elaboration and explanation.

PubMed

Guise, Jeanne-Marie; Butler, Mary; Chang, Christine; Viswanathan, Meera; Pigott, Terri; Tugwell, Peter

2017-10-01

Complex interventions are widely used in health care, public health, education, criminology, social work, business, and welfare. They have increasingly become the subject of systematic reviews and are challenging to effectively report. The Complex Interventions Methods Workgroup developed an extension to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Complex Interventions (PRISMA-CI). Following the EQUATOR Network guidance for Preferred Reporting Items for Systematic Reviews and Meta-Analysis extensions, this Explanation and Elaboration (EE) document accompanies the PRISMA-CI checklist to promote consistency in reporting of systematic reviews of complex interventions. The EE document explains the meaning and rationale for each unique PRISMA-CI checklist item and provides examples to assist systematic review authors in operationalizing PRISMA-CI guidance. The Complex Interventions Workgroup developed PRISMA-CI as an important start toward increased consistency in reporting of systematic reviews of complex interventions. Because the field is rapidly expanding, the Complex Interventions Methods Workgroup plans to re-evaluate periodically for the need to add increasing specificity and examples as the field matures. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Formative Evaluation of Lectures; An Application of Stake's Evaluation Framework.

ERIC Educational Resources Information Center

Westphal, Walter W.; And Others

The problem of major concern to the Physics Education Evaluation Project (P.E.E.P.) involved the improvement of university physics teaching and learning. The present paper describes instruments and procedures developed for systematic formative evaluation of physics lectures. The data was drawn from two sections of a first year university physics…

SMART Security Cooperation Objectives: Improving DoD Planning and Guidance

DTIC Science & Technology

2016-01-01

integrate them into a system for assessing, monitoring, and evaluating security cooperation programs and activities. This report evaluates DoD’s...effectiveness in developing SMART security coopera- tion objectives that facilitate assessment, monitoring, and evaluation . It also proposes a systematic...Cooperation Ends, Ways, and Means . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 RAND Evaluation and Revision of Selected

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

An evaluation of psychometric properties of caregiver burden outcome measures used in caregivers of children with cerebral palsy: a systematic review protocol.

PubMed

Dambi, Jermaine M; Jelsma, Jennifer; Mlambo, Tecla; Chiwaridzo, Matthew; Dangarembizi-Munambah, Nyaradzai; Corten, Lieselotte

2016-03-09

Cerebral palsy (CP) is the most common, life-long paediatric disability. Taking care of a child with CP often results in caregiver burden/strain in the long run. As caregivers play an essential role in the rehabilitation of these children, it is therefore important to routinely screen for health outcomes in informal caregivers. Consequently, a plethora of caregiver burden outcome measures have been developed; however, there is a dearth of evidence of the most psychometrically sound tools. Therefore, the broad objective of this systematic review is to evaluate the psychometrical properties and clinical utility of tools used to measure caregiver burden in caregivers of children with CP. This is a systematic review for the evaluation of the psychometric properties of caregiver burden outcome tools. Two independent and blinded reviewers will search articles on PubMed, Scopus, Web of Science, CINAHL, PsychINFO and Africa-Wide Google Scholar. Information will be analysed using predefined criteria. Thereafter, three independent reviewers will then screen the retrieved articles. The methodological quality of studies on the development and validation of the identified tools will be evaluated using the four point COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Finally, the psychometric properties of the tools which were developed and validated from methodological sound studies will then be analysed using predefined criteria. The proposed systematic review will give an extensive review of the psychometrical properties of tools used to measure caregiver burden in caregivers of children with CP. We hope to identify tools that can be used to accurately screen for caregiver burden both in clinical setting and for research purposes. PROSPERO CRD42015028026.

Special Strategies Observation System-Revised: A Useful Tool for Educational Research and Evaluation

ERIC Educational Resources Information Center

Meehan, Merrill L.; Cowley, Kimberly S.; Finch, Nicole L.; Chadwick, Kristine L.; Ermolov, Lisa D.; Riffle, M. Joy S.

2004-01-01

A review of the critical literature provides a brief history of systematic observation of classroom behaviors, long valued as an important data collection method in educational research. Milestones in systematic observation of classrooms are traced back to 1914 and the development and use of the Special Strategies Observation System (SSOS) through…

Voice-Related Patient-Reported Outcome Measures: A Systematic Review of Instrument Development and Validation

ERIC Educational Resources Information Center

Francis, David O.; Daniero, James J.; Hovis, Kristen L.; Sathe, Nila; Jacobson, Barbara; Penson, David F.; Feurer, Irene D.; McPheeters, Melissa L.

2017-01-01

Purpose: The purpose of this study was to perform a comprehensive systematic review of the literature on voice-related patient-reported outcome (PRO) measures in adults and to evaluate each instrument for the presence of important measurement properties. Method: MEDLINE, the Cumulative Index of Nursing and Allied Health Literature, and the Health…

Functional Assessment-Based Interventions for Students with or At-Risk for High-Incidence Disabilities: Field Testing Single-Case Synthesis Methods

ERIC Educational Resources Information Center

Common, Eric Alan; Lane, Kathleen Lynne; Pustejovsky, James E.; Johnson, Austin H.; Johl, Liane Elizabeth

2017-01-01

This systematic review investigated one systematic approach to designing, implementing, and evaluating functional assessment-based interventions (FABI) for use in supporting school-age students with or at-risk for high-incidence disabilities. We field tested several recently developed methods for single-case design syntheses. First, we appraised…

CALIBRATION OF SUBSURFACE BATCH AND REACTIVE-TRANSPORT MODELS INVOLVING COMPLEX BIOGEOCHEMICAL PROCESSES

EPA Science Inventory

In this study, the calibration of subsurface batch and reactive-transport models involving complex biogeochemical processes was systematically evaluated. Two hypothetical nitrate biodegradation scenarios were developed and simulated in numerical experiments to evaluate the perfor...

The Examining Evaluator Feedback Survey. REL 2016-100

ERIC Educational Resources Information Center

Cherasaro, Trudy L.; Brodersen, R. Marc; Yanoski, David C.; Welp, Laura C.; Reale, Marianne L.

2015-01-01

This report presents a survey tool, developed by REL Central at Marzano Research, designed to gather information from teachers about their perceptions of and responses to evaluator feedback. District or state administrators can use this survey to systematically collect teacher perceptions on five key aspects of evaluation feedback: (1) feedback…

Consumer evaluation of food with nutritional benefits: a systematic review and narrative synthesis.

PubMed

Mogendi, Joseph Birundu; De Steur, Hans; Gellynck, Xavier; Makokha, Anselimo

2016-06-01

As a consequence of the growing interest in, and development of, various types of food with nutritional benefits, the modern consumer views their kitchen cabinet more and more as a medicine cabinet. Given that consumer evaluation of food is considered key to the successful production, marketing and finally consumption of food, a procedure commonly used in medical fields was employed to systematically review and summarize evidence of consumer evaluation studies on nutritious foods. The focus is primarily on consumer understanding of nutritious food and the underlying determinants of consumer evaluation. Our results highlight four groups of key determinants: (1) nutrition knowledge and information; (2) attitudes, beliefs, perceptions and behavioural determinants; (3) price, process and product characteristics; and (4) socio-demographics. The findings also point to the importance of understanding consumer acceptance as one many concepts in the consumer evaluation process, and provide support for developing appropriate strategies for improving health and well-being of consumers.

Relation of completeness of reporting of health research to journals’ endorsement of reporting guidelines: systematic review

PubMed Central

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F

2014-01-01

Objective To assess whether the completeness of reporting of health research is related to journals’ endorsement of reporting guidelines. Design Systematic review. Data sources Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed “evaluations”) (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. Study selection English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Data extraction Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals’ websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors’ analysis, a mean summed score. Results 101 reporting guidelines were included. Of 15 249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. Conclusions The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals’ endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals’ endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Systematic review registration Not registered; no known register currently accepts protocols for methodology systematic reviews. PMID:24965222

Development and evaluation of an off-the-slide genotyping technique for identifying Giardia cysts and Cryptosporidium oocysts directly from US EPA Method 1623 slides

EPA Science Inventory

ABSTRACT Aims This study developed and systematically evaluated performance and limit of detection of an off-the-slide genotyping procedure for both Cryptosporidium oocysts and Giardia cysts. Methods and Results Slide standards containing flow sorted (oo)cysts were used to e...

How does feedback from patients impact upon healthcare student clinical skill development and learning? A systematic review.

PubMed

Finch, Emma; Lethlean, Jennifer; Rose, Tanya; Fleming, Jennifer; Theodoros, Deborah; Cameron, Ashley; Coleman, Adele; Copland, David; McPhail, Steven M

2018-03-01

A key feature of health professionals' training, irrespective of discipline, is the acquisition and application of clinical and communication skills. Despite this, little is known about the potential role of patient feedback on this process. This systematic review aimed to answer the question: How does feedback from patients impact upon healthcare student clinical skill development and learning? Systematic review of published literature. Electronic databases were searched for studies that explored the effects of patient feedback on student learning and were published before March 2016. Eligible articles underwent methodological evaluation using the McMaster University Critical Evaluation Forms and data extraction. A total of 237 articles were retrieved following searches of electronic databases and hand searches of reference lists. Twelve (7 quantitative, 2 qualitative, 3 mixed methods) studies met the inclusion criteria. Eleven studies reported that patient feedback improved students' clinical skills. Minimal research has explored the impact of patient feedback on student learning. The research to date suggests that direct feedback from patients may be beneficial for the development of students' communication and clinical skills; however, the wide variety of evaluation methods and the lack of validated tools for patients to provide feedback suggest that further exploration is warranted.

The systematic review as a research process in music therapy.

PubMed

Hanson-Abromeit, Deanna; Sena Moore, Kimberly

2014-01-01

Music therapists are challenged to present evidence on the efficacy of music therapy treatment and incorporate the best available research evidence to make informed healthcare and treatment decisions. Higher standards of evidence can come from a variety of sources including systematic reviews. To define and describe a range of research review methods using examples from music therapy and related literature, with emphasis on the systematic review. In addition, the authors provide a detailed overview of methodological processes for conducting and reporting systematic reviews in music therapy. The systematic review process is described in five steps. Step 1 identifies the research plan and operationalized research question(s). Step 2 illustrates the identification and organization of the existing literature related to the question(s). Step 3 details coding of data extracted from the literature. Step 4 explains the synthesis of coded findings and analysis to answer the research question(s). Step 5 describes the strength of evidence evaluation and results presentation for practice recommendations. Music therapists are encouraged to develop and conduct systematic reviews. This methodology contributes to review outcome credibility and can determine how information is interpreted and used by clinicians, clients or patients, and policy makers. A systematic review is a methodologically rigorous research method used to organize and evaluate extant literature related to a clinical problem. Systematic reviews can assist music therapists in managing the ever-increasing literature, making well-informed evidence based practice and research decisions, and translating existing music-based and nonmusic based literature to clinical practice and research development. © the American Music Therapy Association 2014. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The Biomarker-Surrogacy Evaluation Schema: a review of the biomarker-surrogate literature and a proposal for a criterion-based, quantitative, multidimensional hierarchical levels of evidence schema for evaluating the status of biomarkers as surrogate endpoints.

PubMed

Lassere, Marissa N

2008-06-01

There are clear advantages to using biomarkers and surrogate endpoints, but concerns about clinical and statistical validity and systematic methods to evaluate these aspects hinder their efficient application. Section 2 is a systematic, historical review of the biomarker-surrogate endpoint literature with special reference to the nomenclature, the systems of classification and statistical methods developed for their evaluation. In Section 3 an explicit, criterion-based, quantitative, multidimensional hierarchical levels of evidence schema - Biomarker-Surrogacy Evaluation Schema - is proposed to evaluate and co-ordinate the multiple dimensions (biological, epidemiological, statistical, clinical trial and risk-benefit evidence) of the biomarker clinical endpoint relationships. The schema systematically evaluates and ranks the surrogacy status of biomarkers and surrogate endpoints using defined levels of evidence. The schema incorporates the three independent domains: Study Design, Target Outcome and Statistical Evaluation. Each domain has items ranked from zero to five. An additional category called Penalties incorporates additional considerations of biological plausibility, risk-benefit and generalizability. The total score (0-15) determines the level of evidence, with Level 1 the strongest and Level 5 the weakest. The term ;surrogate' is restricted to markers attaining Levels 1 or 2 only. Surrogacy status of markers can then be directly compared within and across different areas of medicine to guide individual, trial-based or drug-development decisions. This schema would facilitate communication between clinical, researcher, regulatory, industry and consumer participants necessary for evaluation of the biomarker-surrogate-clinical endpoint relationship in their different settings.

Capturing security requirements for software systems.

PubMed

El-Hadary, Hassan; El-Kassas, Sherif

2014-07-01

Security is often an afterthought during software development. Realizing security early, especially in the requirement phase, is important so that security problems can be tackled early enough before going further in the process and avoid rework. A more effective approach for security requirement engineering is needed to provide a more systematic way for eliciting adequate security requirements. This paper proposes a methodology for security requirement elicitation based on problem frames. The methodology aims at early integration of security with software development. The main goal of the methodology is to assist developers elicit adequate security requirements in a more systematic way during the requirement engineering process. A security catalog, based on the problem frames, is constructed in order to help identifying security requirements with the aid of previous security knowledge. Abuse frames are used to model threats while security problem frames are used to model security requirements. We have made use of evaluation criteria to evaluate the resulting security requirements concentrating on conflicts identification among requirements. We have shown that more complete security requirements can be elicited by such methodology in addition to the assistance offered to developers to elicit security requirements in a more systematic way.

Capturing security requirements for software systems

PubMed Central

El-Hadary, Hassan; El-Kassas, Sherif

2014-01-01

Security is often an afterthought during software development. Realizing security early, especially in the requirement phase, is important so that security problems can be tackled early enough before going further in the process and avoid rework. A more effective approach for security requirement engineering is needed to provide a more systematic way for eliciting adequate security requirements. This paper proposes a methodology for security requirement elicitation based on problem frames. The methodology aims at early integration of security with software development. The main goal of the methodology is to assist developers elicit adequate security requirements in a more systematic way during the requirement engineering process. A security catalog, based on the problem frames, is constructed in order to help identifying security requirements with the aid of previous security knowledge. Abuse frames are used to model threats while security problem frames are used to model security requirements. We have made use of evaluation criteria to evaluate the resulting security requirements concentrating on conflicts identification among requirements. We have shown that more complete security requirements can be elicited by such methodology in addition to the assistance offered to developers to elicit security requirements in a more systematic way. PMID:25685514

Herbal medicine for idiopathic central precocious puberty: A protocol for a systematic review of controlled trials.

PubMed

Lee, Hye Lim; Lee, Yoo Been; Choi, Jun-Yong; Lee, Ju Ah

2018-03-01

Herbal medicine is widely used in East Asia to treat idiopathic central precocious puberty (ICPP). Most of the available clinical trials that investigated herbal medicine for ICPP have been included in this review. This systematic review will assess the efficacy and safety of herbal medicine for ICPP. Eleven databases, including Asian databases, will be searched for studies conducted through 2018. We will include randomized controlled trials assessing herbal medicine for ICPP. The risk of bias will be evaluated using the Cochrane risk of bias assessment tool, and confidence in the cumulative evidence will be evaluated using the Grading of Recommendations Assessment, Development, and Evaluation instrument. This systematic review will be published in a peer-reviewed journal and disseminated both electronically and in print. The review will be updated to inform and guide health care practices. PROSPER 2018 CRD42018087988.

What are the barriers and facilitators for third sector organisations (non-profits) to evaluate their services? A systematic review.

PubMed

Bach-Mortensen, Anders Malthe; Montgomery, Paul

2018-01-22

The third sector is becoming a more common provider of social and health services, but little is known about how third sector organisations (TSOs) evaluate their activities. Past research has reported that the third sector is under increasing pressure to evaluate its impact and performance by government and other commissioning bodies. However, in responding to this increased pressure to undertake evaluation, research suggests that many TSOs struggle to evaluate their activities following the principles of evidence-based practice (EBP). Yet, there has been no systematic effort to investigate why the third sector is struggling to provide good quality evidence of its effects. This systematic review is reported following the PRISMA guidelines. Ten interdisciplinary databases were searched using a search string developed following best practice and in consultation with an information systems expert. Included studies were primary research of any research design investigating barriers to and facilitators of the evaluation process of TSOs as identified by practitioners. All studies were quality appraised, and the results were synthesised as a thematic summary. Twenty-four studies were included, which mainly investigated TSOs working within health and social services. The thematic summary identified the main barriers for TSOs to undertake evaluation to be related to the (1) lack of financial resources, (2) lack of technical capability and evaluation literacy and (3) challenges around identifying relevant evaluation systems and outcome indicators. Key facilitating factors involved (1) getting the appropriate support, (2) having an organisational culture that supports evaluation and (3) the motivation to be accountable to stakeholders. These findings were robust to study quality. This review constitutes the first systematic effort to synthesise existing literature on factors supporting and preventing evaluation by TSOs. The prevalence of factors revolving around the lack of support, resources and clarity on appropriate outcome indicators suggests that many of the identified challenges may be met by applying evidence-based and stakeholder-inclusive strategies to develop shared evaluation requirements. Future efforts should address the application of EBP as part of the commissioning process of TSOs.

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

ERIC Educational Resources Information Center

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

The use of GRADE approach in systematic reviews of animal studies.

PubMed

Wei, Dang; Tang, Kun; Wang, Qi; Estill, Janne; Yao, Liang; Wang, Xiaoqin; Chen, Yaolong; Yang, Kehu

2016-03-15

The application of GRADE (Grading of Recommendations Assessment, Development and Evaluation) in SR of animal studies can promote the translation from bench to bedside. We aim to explore the use of GRADE in systematic reviews of animal studies. We used a theoretical analysis method to explore the use of GRADE in SR of animal studies and applied in a SR of animal studies. Meanwhile, we presented and discussed our results in two international conferences. Five downgrade factors were considered as follows in systematic reviews of animal studies: 1) Risk of bias: the SYRCLE tool can be used for assessing the risk of bias of animal studies. 2) Indirectness: we can assess indirectness in systematic reviews of animal studies from the PICO. 3) Inconsistency: similarity of point estimates, extent of overlap of confidence intervals and statistical heterogeneity are also suitable to evaluate inconsistency of evidence from animal studies. 4) Imprecision: optimal information size (OIS) and 95% confidence intervals (CIs) are also suitable for systematic reviews of animal studies, like those of clinical trials. 5) Publication bias: we need to consider publication bias comprehensively through the qualitative and quantitative methods. The methods about the use of GRADE in systematic review of animal studies are explicit. However, the principle about GRADE in developing the policy based on the evidence from animal studies when there is an emergency of public health. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

A Systematic Review and Classification of Interventions for Speech-Sound Disorder in Preschool Children

ERIC Educational Resources Information Center

Wren, Yvonne; Harding, Sam; Goldbart, Juliet; Roulstone, Sue

2018-01-01

Background: Multiple interventions have been developed to address speech sound disorder (SSD) in children. Many of these have been evaluated but the evidence for these has not been considered within a model which categorizes types of intervention. The opportunity to carry out a systematic review of interventions for SSD arose as part of a larger…

Systematic Review of Empirically Evaluated School-Based Gambling Education Programs.

PubMed

Keen, Brittany; Blaszczynski, Alex; Anjoul, Fadi

2017-03-01

Adolescent problem gambling prevalence rates are reportedly five times higher than in the adult population. Several school-based gambling education programs have been developed in an attempt to reduce problem gambling among adolescents; however few have been empirically evaluated. The aim of this review was to report the outcome of studies empirically evaluating gambling education programs across international jurisdictions. A systematic review following guidelines outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement searching five academic databases: PubMed, Scopus, Medline, PsycINFO, and ERIC, was conducted. A total of 20 papers and 19 studies were included after screening and exclusion criteria were applied. All studies reported intervention effects on cognitive outcomes such as knowledge, perceptions, and beliefs. Only nine of the studies attempted to measure intervention effects on behavioural outcomes, and only five of those reported significant changes in gambling behaviour. Of these five, methodological inadequacies were commonly found including brief follow-up periods, lack of control comparison in post hoc analyses, and inconsistencies and misclassifications in the measurement of gambling behaviour, including problem gambling. Based on this review, recommendations are offered for the future development and evaluation of school-based gambling education programs relating to both methodological and content design and delivery considerations.

Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement.

PubMed

McInnes, Matthew D F; Moher, David; Thombs, Brett D; McGrath, Trevor A; Bossuyt, Patrick M; Clifford, Tammy; Cohen, Jérémie F; Deeks, Jonathan J; Gatsonis, Constantine; Hooft, Lotty; Hunt, Harriet A; Hyde, Christopher J; Korevaar, Daniël A; Leeflang, Mariska M G; Macaskill, Petra; Reitsma, Johannes B; Rodin, Rachel; Rutjes, Anne W S; Salameh, Jean-Paul; Stevens, Adrienne; Takwoingi, Yemisi; Tonelli, Marcello; Weeks, Laura; Whiting, Penny; Willis, Brian H

2018-01-23

Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of 1 or more index tests against a reference standard, provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy. To develop the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagnostic test accuracy guideline as a stand-alone extension of the PRISMA statement. Modifications to the PRISMA statement reflect the specific requirements for reporting of systematic reviews and meta-analyses of diagnostic test accuracy studies and the abstracts for these reviews. Established standards from the Enhancing the Quality and Transparency of Health Research (EQUATOR) Network were followed for the development of the guideline. The original PRISMA statement was used as a framework on which to modify and add items. A group of 24 multidisciplinary experts used a systematic review of articles on existing reporting guidelines and methods, a 3-round Delphi process, a consensus meeting, pilot testing, and iterative refinement to develop the PRISMA diagnostic test accuracy guideline. The final version of the PRISMA diagnostic test accuracy guideline checklist was approved by the group. The systematic review (produced 64 items) and the Delphi process (provided feedback on 7 proposed items; 1 item was later split into 2 items) identified 71 potentially relevant items for consideration. The Delphi process reduced these to 60 items that were discussed at the consensus meeting. Following the meeting, pilot testing and iterative feedback were used to generate the 27-item PRISMA diagnostic test accuracy checklist. To reflect specific or optimal contemporary systematic review methods for diagnostic test accuracy, 8 of the 27 original PRISMA items were left unchanged, 17 were modified, 2 were added, and 2 were omitted. The 27-item PRISMA diagnostic test accuracy checklist provides specific guidance for reporting of systematic reviews. The PRISMA diagnostic test accuracy guideline can facilitate the transparent reporting of reviews, and may assist in the evaluation of validity and applicability, enhance replicability of reviews, and make the results from systematic reviews of diagnostic test accuracy studies more useful.

Supporting Evidence-Informed Teaching in Biomedical and Health Professions Education Through Knowledge Translation: An Interdisciplinary Literature Review.

PubMed

Tractenberg, Rochelle E; Gordon, Morris

2017-01-01

Phenomenon: The purpose of "systematic" reviews/reviewers of medical and health professions educational research is to identify best practices. This qualitative article explores the question of whether systematic reviews can support "evidence informed" teaching and contrasts traditional systematic reviewing with a knowledge translation (KT) approach to this objective. Degrees of freedom analysis (DOFA) is used to examine the alignment of systematic review methods with educational research and the pedagogical strategies and approaches that might be considered with a decision-making framework developed to support valid assessment. This method is also used to explore how KT can be used to inform teaching and learning. The nature of educational research is not compatible with most (11/14) methods for systematic review. The inconsistency of systematic reviewing with the nature of educational research impedes both the identification and implementation of "best-evidence" pedagogy and teaching. This is primarily because research questions that do support the purposes of review do not support educational decision making. By contrast to systematic reviews of the literature, both a DOFA and KT are fully compatible with informing teaching using evidence. A DOFA supports the translation of theory to a specific teaching or learning case, so could be considered a type of KT. The DOFA results in a test of alignment of decision options with relevant educational theory, and KT leads to interventions in teaching or learning that can be evaluated. Examples of how to structure evaluable interventions are derived from a KT approach that are simply not available from a systematic review. Insights: Systematic reviewing of current empirical educational research is not suitable for deriving or supporting best practices in education. However, both "evidence-informed" and scholarly approaches to teaching can be supported as KT projects, which are inherently evaluable and can generate actionable evidence about whether the decision or intervention worked for students, instructors, and the institution. A DOFA can also support evidence- and theory-informed teaching to develop an understanding of what works, why, and for whom. Thus KT, but not systematic reviewing, can support decision making around pedagogy (and pedagogical innovation) that can also inform new teaching and learning initiatives; it can also point to new avenues of empirical research in education that are informed by, and can inform, theory.

Correlation, evaluation, and extension of linearized theories for tire motion and wheel shimmy

NASA Technical Reports Server (NTRS)

Smiley, Robert F

1957-01-01

An evaluation is made of the existing theories of a linearized tire motion and wheel shimmy. It is demonstrated that most of the previously published theories represent varying degrees of approximation to a summary theory developed in this report which is a minor modification of the basic theory of Von Schlippe and Dietrich. In most cases where strong differences exist between the previously published theories and summary theory, the previously published theories are shown to possess certain deficiencies. A series of systematic approximations to the summary theory is developed for the treatment of problems too simple to merit the use of the complete summary theory, and procedures are discussed for applying the summary theory and its systematic approximations to the shimmy of more complex landing-gear structures than have previously been considered. Comparisons of the existing experimental data with the predictions of the summary theory and the systematic approximations provide a fair substantiation of the more detailed approximate theories.

[Principles for the evaluation of telemedicine applications: Results of a systematic review and consensus process].

PubMed

Arnold, Katrin; Scheibe, Madlen; Müller, Olaf; Schmitt, Jochen

2016-11-01

The limited number of telemedicine applications being transferred to standard medical care in Germany may to some extent be explained by deficits in the current evaluation practice. Effectiveness and cost effectiveness can only be demonstrated to decision makers and potential users with methodologically sound and fully published evaluations. There is a lack of well-founded and mandatory standards for adequate, comparable evaluations of telemedicine applications. As part of the project CCS Telehealth Eastern Saxony (CCS THOS), a systematic review on evaluation concepts for telemedicine applications (search period until September 2014, databases Medline, Embase, HTA-Database, DARE, NHS EED) as well as an additional selective literature search were conducted. Suggestions for evaluation fundamentals were derived from the results. These suggestions were subjected to a formal consensus process (nominal group process) with relevant stakeholder groups (healthcare payers, healthcare providers, health policy representatives, researchers). 19 papers were included in the systematic review. In accordance with the predefined inclusion criteria, each presented an evaluation concept for telemedicine applications that was based upon a systematic review and/or a consensus process. Via a formal consensus process, the suggestions for evaluation principles derived from the review and the selective literature search (23 papers) resulted in ten agreed evaluation principles. Eight of them were unanimously agreed upon, two were arrived at with one abstention each. The principles enclose criteria for the planning, conduct and reporting of telemedicine evaluations. Adherence to them is obligatory for users of the telemedical infrastructure provided by CCS THOS. Furthermore, right from the beginning the intention was very much for these principles to be seized upon by other projects and initiatives. The agreed evaluation principles for telemedicine applications are the first in Germany to be based both upon evidence and consensus. Due to the methodology of development, they have a strong scientific and health policy legitimation. Therefore, and because of their general applicability, adherence to these principles beyond the context of the telemedicine platform developed within CCS THOS is recommended, namely throughout the German telemedicine scene. Copyright © 2016. Published by Elsevier GmbH.

The Use of Intervention Mapping to Develop a Tailored Web-Based Intervention, Condom-HIM

PubMed Central

2017-01-01

Background Many HIV (human immunodeficiency virus) prevention interventions are currently being implemented and evaluated, with little information published on their development. A framework highlighting the method of development of an intervention can be used by others wanting to replicate interventions or develop similar interventions to suit other contexts and settings. It provides researchers with a comprehensive development process of the intervention. Objective The objective of this paper was to describe how a systematic approach, intervention mapping, was used to develop a tailored Web-based intervention to increase condom use among HIV-positive men who have sex with men. Methods The intervention was developed in consultation with a multidisciplinary team composed of academic researchers, community members, Web designers, and the target population. Intervention mapping involved a systematic process of 6 steps: (1) needs assessment; (2) identification of proximal intervention objectives; (3) selection of theory-based intervention methods and practical strategies; (4) development of intervention components and materials; (5) adoption, implementation, and maintenance; and (6) evaluation planning. Results The application of intervention mapping resulted in the development of a tailored Web-based intervention for HIV-positive men who have sex with men, called Condom-HIM. Conclusions Using intervention mapping as a systematic process to develop interventions is a feasible approach that specifically integrates the use of theory and empirical findings. Outlining the process used to develop a particular intervention provides clarification on the conceptual use of experimental interventions in addition to potentially identifying reasons for intervention failures. PMID:28428162

Development Research of a Teachers' Educational Performance Support System: The Practices of Design, Development, and Evaluation

ERIC Educational Resources Information Center

Hung, Wei-Chen; Smith, Thomas J.; Harris, Marian S.; Lockard, James

2010-01-01

This study adopted design and development research methodology (Richey & Klein, "Design and development research: Methods, strategies, and issues," 2007) to systematically investigate the process of applying instructional design principles, human-computer interaction, and software engineering to a performance support system (PSS) for behavior…

Developing and Implementing a Process for the Review of Nonacademic Units.

ERIC Educational Resources Information Center

Brown, Marilyn K.

1989-01-01

A major research university's recently developed process for systematic evaluation of nonacademic units is described, and the steps in its development and implementation are outlined: review of literature on organizational effectiveness; survey of peer institutions; development of guidelines for review; and implementation in several campus units.…

Report of the Evaluation of the Race/Human Relations Program. Student and Staff Program and Long Range Goals. Baseline Year 1982-83. Evaluation Services Department Report No. 348.

ERIC Educational Resources Information Center

Tomblin, Elizabeth A.; And Others

In response to a 1982 Superior Court order, a centrally developed, sequential program for improving race/human relations in the San Diego City Schools was developed and field tested or implemented during the 1982-83 school year. This systematic evaluation reports on the student program, "Conflict"; the staff program; and baseline data…

A PLAN FOR EVALUATING MAJOR ACTIVITIES IN GREAT CITIES SCHOOL IMPROVEMENT PROGRAM.

ERIC Educational Resources Information Center

MARBURGER, CARL L.; RASSCHAERT, WILLIAM M.

THE GUIDE IS INTENDED TO ASSIST PROJECT DIRECTORS IN THEIR EFFORTS TO DEVELOP MORE SYSTEMATIC AND THOROUGH EVALUATION DESIGNS FOR THE GREAT CITIES SCHOOL IMPROVEMENT PROGRAM. MAJOR DIMENSIONS OF TEACHING-LEARNING, SCHOOL-COMMUNITY, AND PUPIL-PARENT-TEACHER ACTIVITIES ARE LISTED. MAJOR EVALUATION AREAS ARE IN PUPIL ACHIEVEMENT, IMPLEMENTED BY GROUP…

Systematic Evaluation of Desmopressin Applied to the Patients with Aneurysmal Subarachnoid Haemorrhage in the light of the Literature.

PubMed

Karaarslan, Numan; Yilmaz, Ibrahim; Akgun, Feride Sinem; Caliskan, Tezcan; Ozbek, Hanefi; Ates, Ozkan

2018-04-09

This study discusses the management of patients with the syndrome of inappropriate antidiuretic hormone secretion (SIADH), developed after subarachnoid hemorrhage, in a comparative manner in light of the literature. Without country or language restrictions, articles with high evidential value found in electronic databases were compared to our patients' data. After the literature review, three articles were included for systematic evaluation. Desmopressin was applied to the patients for the treatment of hyponatremia, volume contraction, and negative sodium balance caused by SIADH. However, it was not used for preventing re-bleeding. To prevent the development of this complication (SIADH), the use of desmopressin, an analogue of vasopressin, is important in routine clinical practice.

What is positive youth development and how might it reduce substance use and violence? A systematic review and synthesis of theoretical literature.

PubMed

Bonell, Chris; Hinds, Kate; Dickson, Kelly; Thomas, James; Fletcher, Adam; Murphy, Simon; Melendez-Torres, G J; Bonell, Carys; Campbell, Rona

2016-02-10

Preventing adolescent substance use and youth violence are public health priorities. Positive youth development interventions are widely deployed often with the aim of preventing both. However, the theorised mechanisms by which PYD is intended to reduce substance use and violence are not clear and existing evaluated interventions are under-theorised. Using innovative methods, we systematically searched for and synthesised published theoretical literature describing what is meant by positive youth development and how it might reduce substance use and violence, as part of a broader systematic review examining process and outcomes of PYD interventions. We searched 19 electronic databases, review topic websites, and contacted experts between October 2013 and January 2014. We included studies written in English, published since 1985 that reported a theory of change for positive youth development focused on prevention of smoking, alcohol consumption, drug use or violence in out-of-school settings. Studies were independently coded and quality-assessed by two reviewers. We identified 16 studies that met our inclusion criteria. Our synthesis suggests that positive youth development aims to provide youth with affective relationships and diverse experiences which enable their development of intentional self-regulation and multiple positive assets. These in turn buffer against or compensate for involvement in substance use and violence. Existing literature is not clear on how intentional self-regulation is developed and which specific positive assets buffer against substance use or violence. Our synthesis provides: an example of a rigorous systematic synthesis of theory literature innovatively applying methods of qualitative synthesis to theoretical literature; a clearer understanding of how PYD might reduce substance use and violence to inform future interventions and empirical evaluations.

Development and Evaluation of a Doctoral-Level Public Health Pedagogy Course for Graduate Student Instructors

ERIC Educational Resources Information Center

Lederer, Alyssa M.; Sherwood-Laughlin, Catherine M.; Kearns, Katherine D.; O'Loughlin, Valerie D.

2016-01-01

This article describes the development, implementation, and systematic evaluation of a public health pedagogy course for first-time graduate student instructors in a Health Behavior doctoral program at a Midwestern School of Public Health. The pedagogy course focused on intensive pedagogical training in the first 8 weeks of a 16-week semester and…

Centers for Professional Development and Technology (CPDT) State-Wide Evaluation Study. Final Summary Report.

ERIC Educational Resources Information Center

Macy Research Associates, Wills Point, TX.

The Texas Centers for Professional Development and Technology (CPDT) study gathered evaluative data about the progress and contribution of the centers toward their goal of systematic change in teacher preparation and student learning during four years of funding (1992-93 through 1995-96). The 21 centers in the sample included 35 universities, 15…

A Review of Self-Regulated Strategy Development for Writing for Students with EBD

ERIC Educational Resources Information Center

Sreckovic, Melissa A.; Common, Eric A.; Knowles, Meagan M.; Lane, Kathleen Lynne

2014-01-01

In this systematic review, we evaluated the evidence base of self-regulated strategy development (SRSD; Harris & Graham, 1992) for writing with students with and at risk for emotional or behavioral disorders (EBD). First, we evaluated the quality of studies identified (n 5 13) by applying the quality indicators for single case (Horner et al.,…

Application of systematic review methodology to the field of nutrition.

PubMed

Lichtenstein, Alice H; Yetley, Elizabeth A; Lau, Joseph

2008-12-01

Systematic reviews represent a rigorous and transparent approach to synthesizing scientific evidence that minimizes bias. They evolved within the medical community to support development of clinical and public health practice guidelines, set research agendas, and formulate scientific consensus statements. The use of systematic reviews for nutrition-related topics is more recent. Systematic reviews provide independently conducted comprehensive and objective assessments of available information addressing precise questions. This approach to summarizing available data is a useful tool for identifying the state of science including knowledge gaps and associated research needs, supporting development of science-based recommendations and guidelines, and serving as the foundation for updates as new data emerge. Our objective is to describe the steps for performing systematic reviews and highlight areas unique to the discipline of nutrition that are important to consider in data assessment. The steps involved in generating systematic reviews include identifying staffing and planning for outside expert input, forming a research team, developing an analytic framework, developing and refining research questions, defining eligibility criteria, identifying search terms, screening abstracts according to eligibility criteria, retrieving articles for evaluation, constructing evidence and summary tables, assessing methodological quality and applicability, and synthesizing results including performing meta-analysis, if appropriate. Unique and at times challenging, nutrition-related considerations include baseline nutrient exposure, nutrient status, bioequivalence of bioactive compounds, bioavailability, multiple and interrelated biological functions, undefined nature of some interventions, and uncertainties in intake assessment. Systematic reviews are a valuable and independent component of decision-making processes by groups responsible for developing science-based recommendations and policies.

Technical Packages in Injury and Violence Prevention to Move Evidence into Practice: Systematic Reviews and Beyond

PubMed Central

Haegerich, Tamara M.; David-Ferdon, Corinne; Noonan, Rita K.; Manns, Brian J.; Billie, Holly C.

2016-01-01

Injury and violence prevention strategies have greater potential for impact when they are based on scientific evidence. Systematic reviews of the scientific evidence can contribute key information about which policies and programs might have the greatest impact when implemented. However, systematic reviews have limitations, such as lack of implementation guidance and contextual information, that can limit the application of knowledge. “Technical packages,” developed by knowledge brokers such as the federal government, nonprofit agencies, and academic institutions, have the potential to be an efficient mechanism for making information from systematic reviews actionable. Technical packages provide information about specific evidence-based prevention strategies, along with the estimated costs and impacts, and include accompanying implementation and evaluation guidance to facilitate adoption, implementation, and performance measurement. We describe how systematic reviews can inform the development of technical packages for practitioners, provide examples of technical packages in injury and violence prevention, and explain how enhancing review methods and reporting could facilitate the use and applicability of scientific evidence. PMID:27604301

The new United Nations approach to sustainable development post-2015: Findings from four overviews of systematic reviews on interventions for sustainable development and health.

PubMed

Galvão, Luiz A C; Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Câmara, Volney Magalhães; Luiz, Ronir Raggio; Becerra-Posada, Francisco

2016-03-01

Objective To identify reported interventions that facilitate sustainable development and have had a positive impact on health in four areas: sustainable food production; sustainable energy use; sustainable jobs ("decent work"); and prevention of toxic exposure to chemicals. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations. A comprehensive search was conducted of at least 14 databases and 8 websites for each of the four overviews, using pre-defined protocols, including clear inclusion criteria. To qualify as "sustainable," interventions needed to aim (explicitly or implicitly) to positively impact at least two dimensions of the integrated framework for sustainable development and had to include measures of health impact. Results In total, 47 systematic reviews and 10 economic evaluations met the inclusion criteria. The most promising interventions, such as agricultural policies, were identified for each of the four topics. While the evidence for the interventions is not strong because of the limited number of studies, there is no evidence of a definite negative impact on health. The only possible exception is that of taxes and subsidies-though this intervention also has the potential to be pro-equity with higher relative impacts for lower income groups. Conclusions The evidence found for effective interventions is useful for guiding countries toward the best options for non-health sector interventions that can positively impact health. This overviews shows that intersectoral work benefits every sector involved.

Updates on ultrasound research in implant dentistry: a systematic review of potential clinical indications.

PubMed

Bhaskar, Vaishnavi; Chan, Hsun-Liang; MacEachern, Mark; Kripfgans, Oliver D

2018-05-23

Ultrasonography has shown promising diagnostic value in dental implant imaging research; however, exactly how ultrasound was used and at what stage of implant therapy it can be applied has not been systematically evaluated. Therefore, the aim of this review is to investigate potential indications of ultrasound use in the three implant treatment phases, namely planning, intraoperative and postoperative phase. Eligible manuscripts were searched in major databases with a combination of key words related to the use of ultrasound imaging in implant therapy. An initial search yielded 414 articles, after further review, 28 articles were finally included for this systematic review. Ultrasound was found valuable, though at various development stages, for evaluating (1) soft tissues, (2) hard tissues (3) vital structures and (4) implant stability. B-mode, the main function to image anatomical structures of interest, has been evaluated in pre-clinical and clinical studies. Quantitative ultrasound parameters, e.g. sound speed and amplitude, are being developed to evaluate implant-bone stability, mainly in simulation and pre-clinical studies. Ultrasound could be potentially useful in all 3 treatment phases. In the planning phase, ultrasound could evaluate vital structures, tissue biotype, ridge width/density, and cortical bone thickness. During surgery, it can provide feedback by identifying vital structures and bone boundary. At follow-up visits, it could evaluate marginal bone level and implant stability. Understanding the current status of ultrasound imaging research for implant therapy would be extremely beneficial for accelerating translational research and its use in dental clinics.

Consensus Recommendations for Systematic Evaluation of Drug-Drug Interaction Evidence for Clinical Decision Support

PubMed Central

Scheife, Richard T.; Hines, Lisa E.; Boyce, Richard D.; Chung, Sophie P.; Momper, Jeremiah; Sommer, Christine D.; Abernethy, Darrell R.; Horn, John; Sklar, Stephen J.; Wong, Samantha K.; Jones, Gretchen; Brown, Mary; Grizzle, Amy J.; Comes, Susan; Wilkins, Tricia Lee; Borst, Clarissa; Wittie, Michael A.; Rich, Alissa; Malone, Daniel C.

2015-01-01

Background Healthcare organizations, compendia, and drug knowledgebase vendors use varying methods to evaluate and synthesize evidence on drug-drug interactions (DDIs). This situation has a negative effect on electronic prescribing and medication information systems that warn clinicians of potentially harmful medication combinations. Objective To provide recommendations for systematic evaluation of evidence from the scientific literature, drug product labeling, and regulatory documents with respect to DDIs for clinical decision support. Methods A conference series was conducted to develop a structured process to improve the quality of DDI alerting systems. Three expert workgroups were assembled to address the goals of the conference. The Evidence Workgroup consisted of 15 individuals with expertise in pharmacology, drug information, biomedical informatics, and clinical decision support. Workgroup members met via webinar from January 2013 to February 2014. Two in-person meetings were conducted in May and September 2013 to reach consensus on recommendations. Results We developed expert-consensus answers to three key questions: 1) What is the best approach to evaluate DDI evidence?; 2) What evidence is required for a DDI to be applicable to an entire class of drugs?; and 3) How should a structured evaluation process be vetted and validated? Conclusion Evidence-based decision support for DDIs requires consistent application of transparent and systematic methods to evaluate the evidence. Drug information systems that implement these recommendations should be able to provide higher quality information about DDIs in drug compendia and clinical decision support tools. PMID:25556085

Guideline for Performing Systematic Approach to Evaluate and Qualify Legacy Documents that Support Advanced Reactor Technology Activity

DOE Office of Scientific and Technical Information (OSTI.GOV)

Honma, George

The establishment of a systematic process for the evaluation of historic technology information for use in advanced reactor licensing is described. Efforts are underway to recover and preserve Experimental Breeder Reactor II and Fast Flux Test Facility historical data. These efforts have generally emphasized preserving information from data-acquisition systems and hard-copy reports and entering it into modern electronic formats suitable for data retrieval and examination. The guidance contained in this document has been developed to facilitate consistent and systematic evaluation processes relating to quality attributes of historic technical information (with focus on sodium-cooled fast reactor (SFR) technology) that will bemore » used to eventually support licensing of advanced reactor designs. The historical information may include, but is not limited to, design documents for SFRs, research-and-development (R&D) data and associated documents, test plans and associated protocols, operations and test data, international research data, technical reports, and information associated with past U.S. Nuclear Regulatory Commission (NRC) reviews of SFR designs. The evaluation process is prescribed in terms of SFR technology, but the process can be used to evaluate historical information for any type of advanced reactor technology. An appendix provides a discussion of typical issues that should be considered when evaluating and qualifying historical information for advanced reactor technology fuel and source terms, based on current light water reactor (LWR) requirements and recent experience gained from Next Generation Nuclear Plant (NGNP).« less

Measuring organizational and individual factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2012-01-01

Background Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. Study selection: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited. Conclusions Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice. PMID:23241168

dETECT: A Model for the Evaluation of Instructional Units for Teaching Computing in Middle School

ERIC Educational Resources Information Center

von Wangenheim, Christiane G.; Petri, Giani; Zibertti, André W.; Borgatto, Adriano F.; Hauck, Jean C. R.; Pacheco, Fernando S.; Filho, Raul Missfeldt

2017-01-01

The objective of this article is to present the development and evaluation of dETECT (Evaluating TEaching CompuTing), a model for the evaluation of the quality of instructional units for teaching computing in middle school based on the students' perception collected through a measurement instrument. The dETECT model was systematically developed…

Piaget's Theory: A Psychological Critique.

ERIC Educational Resources Information Center

Brown, Geoffrey; Desforges, Charles

The authors offer a detailed and systematic critique of Piaget's theory of cognitive development, examining it in relation to other theories of development. Chapter 1 points out some of the problems in building and evaluating scientific theories and considers contrasting approaches to cognitive development (including those which focus on…

Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR).

PubMed

Beller, Elaine; Clark, Justin; Tsafnat, Guy; Adams, Clive; Diehl, Heinz; Lund, Hans; Ouzzani, Mourad; Thayer, Kristina; Thomas, James; Turner, Tari; Xia, Jun; Robinson, Karen; Glasziou, Paul

2018-05-19

Systematic reviews (SR) are vital to health care, but have become complicated and time-consuming, due to the rapid expansion of evidence to be synthesised. Fortunately, many tasks of systematic reviews have the potential to be automated or may be assisted by automation. Recent advances in natural language processing, text mining and machine learning have produced new algorithms that can accurately mimic human endeavour in systematic review activity, faster and more cheaply. Automation tools need to be able to work together, to exchange data and results. Therefore, we initiated the International Collaboration for the Automation of Systematic Reviews (ICASR), to successfully put all the parts of automation of systematic review production together. The first meeting was held in Vienna in October 2015. We established a set of principles to enable tools to be developed and integrated into toolkits.This paper sets out the principles devised at that meeting, which cover the need for improvement in efficiency of SR tasks, automation across the spectrum of SR tasks, continuous improvement, adherence to high quality standards, flexibility of use and combining components, the need for a collaboration and varied skills, the desire for open source, shared code and evaluation, and a requirement for replicability through rigorous and open evaluation.Automation has a great potential to improve the speed of systematic reviews. Considerable work is already being done on many of the steps involved in a review. The 'Vienna Principles' set out in this paper aim to guide a more coordinated effort which will allow the integration of work by separate teams and build on the experience, code and evaluations done by the many teams working across the globe.

Moving toward the automation of the systematic review process: a summary of discussions at the second meeting of International Collaboration for the Automation of Systematic Reviews (ICASR).

PubMed

O'Connor, Annette M; Tsafnat, Guy; Gilbert, Stephen B; Thayer, Kristina A; Wolfe, Mary S

2018-01-09

The second meeting of the International Collaboration for Automation of Systematic Reviews (ICASR) was held 3-4 October 2016 in Philadelphia, Pennsylvania, USA. ICASR is an interdisciplinary group whose aim is to maximize the use of technology for conducting rapid, accurate, and efficient systematic reviews of scientific evidence. Having automated tools for systematic review should enable more transparent and timely review, maximizing the potential for identifying and translating research findings to practical application. The meeting brought together multiple stakeholder groups including users of summarized research, methodologists who explore production processes and systematic review quality, and technologists such as software developers, statisticians, and vendors. This diversity of participants was intended to ensure effective communication with numerous stakeholders about progress toward automation of systematic reviews and stimulate discussion about potential solutions to identified challenges. The meeting highlighted challenges, both simple and complex, and raised awareness among participants about ongoing efforts by various stakeholders. An outcome of this forum was to identify several short-term projects that participants felt would advance the automation of tasks in the systematic review workflow including (1) fostering better understanding about available tools, (2) developing validated datasets for testing new tools, (3) determining a standard method to facilitate interoperability of tools such as through an application programming interface or API, and (4) establishing criteria to evaluate the quality of tools' output. ICASR 2016 provided a beneficial forum to foster focused discussion about tool development and resources and reconfirm ICASR members' commitment toward systematic reviews' automation.

Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions

PubMed Central

Egan, M; Bambra, C; Petticrew, M; Whitehead, M

2009-01-01

Background: The reporting of intervention implementation in studies included in systematic reviews of organisational-level workplace interventions was appraised. Implementation is taken to include such factors as intervention setting, resources, planning, collaborations, delivery and macro-level socioeconomic contexts. Understanding how implementation affects intervention outcomes may help prevent erroneous conclusions and misleading assumptions about generalisability, but implementation must be adequately reported if it is to be taken into account. Methods: Data on implementation were obtained from four systematic reviews of complex interventions in workplace settings. Implementation was appraised using a specially developed checklist and by means of an unstructured reading of the text. Results: 103 studies were identified and appraised, evaluating four types of organisational-level workplace intervention (employee participation, changing job tasks, shift changes and compressed working weeks). Many studies referred to implementation, but reporting was generally poor and anecdotal in form. This poor quality of reporting did not vary greatly by type or date of publication. A minority of studies described how implementation may have influenced outcomes. These descriptions were more usefully explored through an unstructured reading of the text, rather than by means of the checklist. Conclusions: Evaluations of complex interventions should include more detailed reporting of implementation and consider how to measure quality of implementation. The checklist helped us explore the poor reporting of implementation in a more systematic fashion. In terms of interpreting study findings and their transferability, however, the more qualitative appraisals appeared to offer greater potential for exploring how implementation may influence the findings of specific evaluations. Implementation appraisal techniques for systematic reviews of complex interventions require further development and testing. PMID:18718981

Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions.

PubMed

Egan, M; Bambra, C; Petticrew, M; Whitehead, M

2009-01-01

The reporting of intervention implementation in studies included in systematic reviews of organisational-level workplace interventions was appraised. Implementation is taken to include such factors as intervention setting, resources, planning, collaborations, delivery and macro-level socioeconomic contexts. Understanding how implementation affects intervention outcomes may help prevent erroneous conclusions and misleading assumptions about generalisability, but implementation must be adequately reported if it is to be taken into account. Data on implementation were obtained from four systematic reviews of complex interventions in workplace settings. Implementation was appraised using a specially developed checklist and by means of an unstructured reading of the text. 103 studies were identified and appraised, evaluating four types of organisational-level workplace intervention (employee participation, changing job tasks, shift changes and compressed working weeks). Many studies referred to implementation, but reporting was generally poor and anecdotal in form. This poor quality of reporting did not vary greatly by type or date of publication. A minority of studies described how implementation may have influenced outcomes. These descriptions were more usefully explored through an unstructured reading of the text, rather than by means of the checklist. Evaluations of complex interventions should include more detailed reporting of implementation and consider how to measure quality of implementation. The checklist helped us explore the poor reporting of implementation in a more systematic fashion. In terms of interpreting study findings and their transferability, however, the more qualitative appraisals appeared to offer greater potential for exploring how implementation may influence the findings of specific evaluations. Implementation appraisal techniques for systematic reviews of complex interventions require further development and testing.

Systematic development of a communication skills training course for physicians performing work disability assessments: from evidence to practice

PubMed Central

2011-01-01

Background Physicians require specific communication skills, because the face-to-face contact with their patients is an important source of information. Although physicians who perform work disability assessments attend some communication-related training courses during their professional education, no specialised and evidence-based communication skills training course is available for them. Therefore, the objectives of this study were: 1) to systematically develop a training course aimed at improving the communication skills of physicians during work disability assessment interviews with disability claimants, and 2) to plan an evaluation of the training course. Methods A physician-tailored communication skills training course was developed, according to the six steps of the Intervention Mapping protocol. Data were collected from questionnaire studies among physicians and claimants, a focus group study among physicians, a systematic review of the literature, and meetings with various experts. Determinants and performance objectives were formulated. A concept version of the training course was discussed with several experts before the final training course programme was established. The evaluation plan was developed by consulting experts, social insurance physicians, researchers, and policy-makers, and discussing with them the options for evaluation. Results A two-day post-graduate communication skills training course was developed, aimed at improving professional communication during work disability assessment interviews. Special focus was on active teaching strategies, such as practising the skills in role-play. An adoption and implementation plan was formulated, in which the infrastructure of the educational department of the institute that employs the physicians was utilised. Improvement in the skills and knowledge of the physicians who will participate in the training course will be evaluated in a randomised controlled trial. Conclusions The feasibility and practical relevance of the communication skills training course that was developed seem promising. Such a course may be relevant for physicians in many countries who perform work disability assessments. The development of the first training course of this type represents an important advancement in this field. PMID:21639871

Systematic development of a communication skills training course for physicians performing work disability assessments: from evidence to practice.

PubMed

van Rijssen, H Jolanda; Schellart, Antonius J M; Anema, Johannes R; de Boer, Wout E L; van der Beek, Allard J

2011-06-03

Physicians require specific communication skills, because the face-to-face contact with their patients is an important source of information. Although physicians who perform work disability assessments attend some communication-related training courses during their professional education, no specialised and evidence-based communication skills training course is available for them. Therefore, the objectives of this study were: 1) to systematically develop a training course aimed at improving the communication skills of physicians during work disability assessment interviews with disability claimants, and 2) to plan an evaluation of the training course. A physician-tailored communication skills training course was developed, according to the six steps of the Intervention Mapping protocol. Data were collected from questionnaire studies among physicians and claimants, a focus group study among physicians, a systematic review of the literature, and meetings with various experts. Determinants and performance objectives were formulated. A concept version of the training course was discussed with several experts before the final training course programme was established. The evaluation plan was developed by consulting experts, social insurance physicians, researchers, and policy-makers, and discussing with them the options for evaluation. A two-day post-graduate communication skills training course was developed, aimed at improving professional communication during work disability assessment interviews. Special focus was on active teaching strategies, such as practising the skills in role-play. An adoption and implementation plan was formulated, in which the infrastructure of the educational department of the institute that employs the physicians was utilised. Improvement in the skills and knowledge of the physicians who will participate in the training course will be evaluated in a randomised controlled trial. The feasibility and practical relevance of the communication skills training course that was developed seem promising. Such a course may be relevant for physicians in many countries who perform work disability assessments. The development of the first training course of this type represents an important advancement in this field.

Guidelines "PEP," Peer Evaluation Program. A Systematic Approach for Evaluating Educational Programs, 1973-1974.

ERIC Educational Resources Information Center

Grotsky, Jeffery N.; And Others

The Peer Evaluation Program (PEP) has been instituted by the Division of Special Education, Pennsylvania State Department of Education, to allow intermediate units an opportunity to continuously improve their programs. The advantages of the PEP system are: (1) it is a self-improvememt system of program development; (2) PEP allows local autonomy as…

Prototypical Content Development and Evaluation of the Cognitive English Vocabulary-Learning Program for Korean University Students

ERIC Educational Resources Information Center

Kim, Inseok

2014-01-01

Many EFL learners seem to believe that they can come to grips with the problem of vocabulary learning with a 'hit-or-miss' approach. However, a growing number of recent research reports indicate that they need to learn a repertoire of vocabulary in a systematic way for effective communication. This paper explores the development and evaluation of…

User Experience Evaluation Methods in Product Development (UXEM'09)

NASA Astrophysics Data System (ADS)

Roto, Virpi; Väänänen-Vainio-Mattila, Kaisa; Law, Effie; Vermeeren, Arnold

High quality user experience (UX) has become a central competitive factor of product development in mature consumer markets [1]. Although the term UX originated from industry and is a widely used term also in academia, the tools for managing UX in product development are still inadequate. A prerequisite for designing delightful UX in an industrial setting is to understand both the requirements tied to the pragmatic level of functionality and interaction and the requirements pertaining to the hedonic level of personal human needs, which motivate product use [2]. Understanding these requirements helps managers set UX targets for product development. The next phase in a good user-centered design process is to iteratively design and evaluate prototypes [3]. Evaluation is critical for systematically improving UX. In many approaches to UX, evaluation basically needs to be postponed until the product is fully or at least almost fully functional. However, in an industrial setting, it is very expensive to find the UX failures only at this phase of product development. Thus, product development managers and developers have a strong need to conduct UX evaluation as early as possible, well before all the parts affecting the holistic experience are available. Different types of products require evaluation on different granularity and maturity levels of a prototype. For example, due to its multi-user characteristic, a community service or an enterprise resource planning system requires a broader scope of UX evaluation than a microwave oven or a word processor that is meant for a single user at a time. Before systematic UX evaluation can be taken into practice, practical, lightweight UX evaluation methods suitable for different types of products and different phases of product readiness are needed. A considerable amount of UX research is still about the conceptual frameworks and models for user experience [4]. Besides, applying existing usability evaluation methods (UEMs) without adaptation to evaluate UX may lead to some scoping issues. Consequently, there is a strong need to put UX evaluation from research into practice.

Peer Group Learning in Roche Pharma Development

ERIC Educational Resources Information Center

Boulden, George P.; De Laat, Richard

2005-01-01

Pharma Development has used action learning to help participants in their 360[degrees] feedback programme develop their leadership competencies. The article describes how the programme was designed, supported and run across four sites over a period of 2 years. The programme was systematically evaluated and found to be successful in meeting its…

Prevention and assessment of infectious diseases among children and adult migrants arriving to the European Union/European Economic Association: a protocol for a suite of systematic reviews for public health and health systems

PubMed Central

Mayhew, Alain D; Morton, Rachael L; Greenaway, Christina; Akl, Elie A; Rahman, Prinon; Zenner, Dominik; Pareek, Manish; Tugwell, Peter; Welch, Vivian; Meerpohl, Joerg; Alonso-Coello, Pablo; Hui, Charles; Biggs, Beverley-Ann; Requena-Méndez, Ana; Agbata, Eric; Noori, Teymur; Schünemann, Holger J

2017-01-01

Introduction The European Centre for Disease Prevention and Control is developing evidence-based guidance for voluntary screening, treatment and vaccine prevention of infectious diseases for newly arriving migrants to the European Union/European Economic Area. The objective of this systematic review protocol is to guide the identification, appraisal and synthesis of the best available evidence on prevention and assessment of the following priority infectious diseases: tuberculosis, HIV, hepatitis B, hepatitis C, measles, mumps, rubella, diphtheria, tetanus, pertussis, poliomyelitis (polio), Haemophilus influenza disease, strongyloidiasis and schistosomiasis. Methods and analysis The search strategy will identify evidence from existing systematic reviews and then update the effectiveness and cost-effectiveness evidence using prospective trials, economic evaluations and/or recently published systematic reviews. Interdisciplinary teams have designed logic models to help define study inclusion and exclusion criteria, guiding the search strategy and identifying relevant outcomes. We will assess the certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. Ethics and dissemination There are no ethical or safety issues. We anticipate disseminating the findings through open-access publications, conference abstracts and presentations. We plan to publish technical syntheses as GRADEpro evidence summaries and the systematic reviews as part of a special edition open-access publication on refugee health. We are following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Protocols reporting guideline. This protocol is registered in PROSPERO: CRD42016045798. PMID:28893741

An experimental apparatus to simulate body-powered prosthetic usage: Development and preliminary evaluation.

PubMed

Gao, Fan; Rodriguez, Johanan; Kapp, Susan

2016-06-01

Harness fitting in the body-powered prosthesis remains more art than science due to a lack of consistent and quantitative evaluation. The aim of this study was to develop a mechanical, human-body-shaped apparatus to simulate body-powered upper limb prosthetic usage and evaluate its capability of quantitative examination of harness configuration. The apparatus was built upon a torso of a wooden mannequin and integrated major mechanical joints to simulate terminal device operation. Sensors were used to register cable tension, cable excursion, and grip force simultaneously. The apparatus allowed the scapula to move up to 127 mm laterally and the load cell can measure the cable tension up to 445 N. Our preliminary evaluation highlighted the needs and importance of investigating harness configurations in a systematic and controllable manner. The apparatus allows objective, systematic, and quantitative evaluation of effects of realistic harness configurations and will provide insightful and working knowledge on harness fitting in upper limb amputees using body-powered prosthesis. © The International Society for Prosthetics and Orthotics 2015.

PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research.

PubMed

Kapadia, Mufiza Z; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2016-04-18

Paediatric systematic reviews differ from adult systematic reviews in several key aspects such as considerations of child tailored interventions, justifiable comparators, valid outcomes and child sensitive search strategies. Available guidelines, including PRISMA-P (2015) and PRISMA (2009), do not cover all the complexities associated with reporting systematic reviews in the paediatric population. Using a collaborative, multidisciplinary structure, we aim to develop evidence-based and consensus-based PRISMA-P-C (Protocol for Children) and PRISMA-C (Children) Extensions to guide paediatric systematic review protocol and completed review reporting. This project's methodology follows published recommendations for developing reporting guidelines and involves the following six phases; (1) establishment of a steering committee representing key stakeholder groups; (2) a scoping review to identify potential Extension items; (3) three types of consensus activities including meetings of the steering committee to achieve high-level decisions on the content and methodology of the Extensions, a survey of key stakeholders to generate a list of possible items to include in the Extensions and a formal consensus meeting to select the reporting items to add to, or modify for, the Extension; (4) the preliminary checklist items generated in phase III will be evaluated against the existing evidence and reporting practices in paediatric systematic reviews; (5) extension statements and explanation and elaboration documents will provide detailed advice for each item and examples of good reporting; (6) development and implementation of effective knowledge translation of the extension checklist, and an evaluation of the Extensions by key stakeholders. This protocol was considered a quality improvement project by the Hospital for Sick Children's Ethics Committee and did not require ethical review. The resultant checklists, jointly developed with all relevant stakeholders, will be disseminated through peer-reviewed journals as well as national and international conference presentations. Endorsement of the checklist will be sought simultaneously in multiple journals. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research

PubMed Central

Kapadia, Mufiza Z; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2016-01-01

Introduction Paediatric systematic reviews differ from adult systematic reviews in several key aspects such as considerations of child tailored interventions, justifiable comparators, valid outcomes and child sensitive search strategies. Available guidelines, including PRISMA-P (2015) and PRISMA (2009), do not cover all the complexities associated with reporting systematic reviews in the paediatric population. Using a collaborative, multidisciplinary structure, we aim to develop evidence-based and consensus-based PRISMA-P-C (Protocol for Children) and PRISMA-C (Children) Extensions to guide paediatric systematic review protocol and completed review reporting. Methods and analysis This project's methodology follows published recommendations for developing reporting guidelines and involves the following six phases; (1) establishment of a steering committee representing key stakeholder groups; (2) a scoping review to identify potential Extension items; (3) three types of consensus activities including meetings of the steering committee to achieve high-level decisions on the content and methodology of the Extensions, a survey of key stakeholders to generate a list of possible items to include in the Extensions and a formal consensus meeting to select the reporting items to add to, or modify for, the Extension; (4) the preliminary checklist items generated in phase III will be evaluated against the existing evidence and reporting practices in paediatric systematic reviews; (5) extension statements and explanation and elaboration documents will provide detailed advice for each item and examples of good reporting; (6) development and implementation of effective knowledge translation of the extension checklist, and an evaluation of the Extensions by key stakeholders. Ethics and Dissemination This protocol was considered a quality improvement project by the Hospital for Sick Children's Ethics Committee and did not require ethical review. The resultant checklists, jointly developed with all relevant stakeholders, will be disseminated through peer-reviewed journals as well as national and international conference presentations. Endorsement of the checklist will be sought simultaneously in multiple journals. PMID:27091820

Study Sensitivity: Evaluating the Ability to Detect Effects in Systematic Reviews of Chemical Exposures

PubMed Central

Cooper, Glinda S.; Lunn, Ruth M.; Ågerstrand, Marlene; Glenn, Barbara S.; Kraft, Andrew D.; Luke, April M.; Ratcliffe, Jennifer M.

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as “sensitivity”, is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and sensitivity can be used to identify the most informative studies, to evaluate the confidence of the findings from individual studies and to identify those study elements that may help to explain heterogeneity across the body of literature. PMID:27156196

Liaison psychiatry and bariatric surgery: double standards. What are the possibilities for the systematization of the pre-operative psychiatric assessment in Belgium?

PubMed

Jacques, Denis; Reynaert, Christine; Zdanowicz, Nicolas

2016-09-01

In the context of health care in Belgium, the psychological or psychiatric opinion of a multidisciplinary team is required in the assessment of bariatric surgery candidates. In clinical practice, a wide variety of liaison psychiatry assessment methods exist. On the basis of a post-operative psychiatric comorbidity case report and a literature review on "liaison psychiatry and bariatric surgery" we aim to identify opportunities for the systematization of bariatric pre-surgery psychiatric evaluation. The bariatric pre-surgery evaluation must be rigorous and founded on evidence-based medicine. On this basis, specific psychiatric criteria may be defined and researched in assessments. The issue remains for psychiatric comorbidities that develop after surgery and for which a preventive framework should be sustained in the liaison psychiatry approach. The aim of the research is to support an improved systematization of the psychological assessments of pre-operative bariatric surgery candidates. We believe that systematic evaluation tools should be defined for the identification of possible absolute or relative contra-indications and that a preventive approach to post-operative psychiatric disorders should be included in this assessment.

Whither Sex Education? Excellence in Comprehensive Program Development.

ERIC Educational Resources Information Center

Southern, Stephen

A review of recent sex education literature is presented in an attempt to integrate observations and recommendations related to both program development and innovation acceptance. A Developmental Research and Utilization Model is employed to systematically guide planning, implementation, evaluation, advocacy, and institutionalization. Curriculum…

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

The Use of Intervention Mapping to Develop a Tailored Web-Based Intervention, Condom-HIM.

PubMed

Miranda, Joyal; Côté, José

2017-04-19

Many HIV (human immunodeficiency virus) prevention interventions are currently being implemented and evaluated, with little information published on their development. A framework highlighting the method of development of an intervention can be used by others wanting to replicate interventions or develop similar interventions to suit other contexts and settings. It provides researchers with a comprehensive development process of the intervention. The objective of this paper was to describe how a systematic approach, intervention mapping, was used to develop a tailored Web-based intervention to increase condom use among HIV-positive men who have sex with men. The intervention was developed in consultation with a multidisciplinary team composed of academic researchers, community members, Web designers, and the target population. Intervention mapping involved a systematic process of 6 steps: (1) needs assessment; (2) identification of proximal intervention objectives; (3) selection of theory-based intervention methods and practical strategies; (4) development of intervention components and materials; (5) adoption, implementation, and maintenance; and (6) evaluation planning. The application of intervention mapping resulted in the development of a tailored Web-based intervention for HIV-positive men who have sex with men, called Condom-HIM. Using intervention mapping as a systematic process to develop interventions is a feasible approach that specifically integrates the use of theory and empirical findings. Outlining the process used to develop a particular intervention provides clarification on the conceptual use of experimental interventions in addition to potentially identifying reasons for intervention failures. ©Joyal Miranda, José Côté. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 19.04.2017.

Speech and language interventions for infants aged 0 to 2 years at high risk for cerebral palsy: a systematic review

PubMed Central

Chorna, Olena; Hamm, Ellyn; Cummings, Caitlin; Fetters, Ashley; Maitre, Nathalie L

2017-01-01

Aim We evaluated the level of evidence of speech, language, and communication interventions for infants at high-risk for, or with a diagnosis of, cerebral palsy (CP) from 0 to 2 years old. Method We performed a systematic review of relevant terms. Articles were evaluated based on the level of methodological quality and evidence according to A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidelines. Results The search terms provided 17 publications consisting of speech or language interventions. There were no interventions in the high level of evidence category. The overall level of evidence was very low. Promising interventions included Responsivity and Prelinguistic Milieu Teaching and other parent–infant transaction frameworks. Interpretation There are few evidence-based interventions addressing speech, language, and communication needs of infants and toddlers at high risk for CP, and none for infants diagnosed with CP. Recommendation guidelines include parent–infant transaction programs. PMID:27897320

Qualitative Collection Analysis: The Conspectus Methodology. SPEC Kit 151.

ERIC Educational Resources Information Center

Jakubs, Deborah

The introduction to this Systems and Procedures Exchange Center (SPEC) kit explains the Conspectus method, which was developed in 1980 by the Research Libraries Group (RLG) as a means of systematically and qualitatively evaluating large library collections. The discussion considers advantages and disadvantages of this tool, which evaluates past…

Graduate Attribute Development and Employment Outcomes: Tracking PhD Graduates

ERIC Educational Resources Information Center

Manathunga, Catherine; Pitt, Rachael; Critchley, Christa

2009-01-01

The provision of diversified research training is regarded as one of the most significant contributions made by the Australian Cooperative Research Centres (CRC) programme [Howard Partners 2003, Evaluation of the cooperative research centres programme, Department of Education, Science and Training, Canberra, ACT]. Yet, a systematic evaluation of…

Professionnalisation ou Deprofessionnalisation: Une Base Conceptuelle pour L'evaluation de La Competence en Psychologie.

ERIC Educational Resources Information Center

Perron, Jacques; And Others

1980-01-01

Elements of professionalization--systematic body of theory, social recognition, monopoly, and degree of organization--are presented and applied to the development of professional psychology in Quebec. The concept of deprofessionalization is introduced as an alternative basis for evaluating competence in professional psychology. (Author)

Evaluation of a Group-Based Trauma Recovery Program in Gaza: Students' Subjective Experiences

ERIC Educational Resources Information Center

Barron, Ian; Abdullah, Ghassan

2012-01-01

Internationally, evaluation of group-based trauma recovery programs has relied upon normative outcome measures, with no studies systematically analyzing children's subjective experience for program development. In contrast, the current study explored children's experience of a Gazan recovery program "in their own words." Twenty-four…

A Systematic Approach to Evaluating Career Education Materials at the Local Level.

ERIC Educational Resources Information Center

Peat, Marwick, Mitchell and Co., Washington, DC.

The document contains an assessment instrument, developed by three teams of educators, designed to assist career education practitioners in identifying, classifying, and evaluating career education instructional materials to determine the usefulness of a particular unit of material in a specific local situation. It also contains suggestions of…

Data Credibility: A Perspective from Systematic Reviews in Environmental Management

ERIC Educational Resources Information Center

Pullin, Andrew S.; Knight, Teri M.

2009-01-01

To use environmental program evaluation to increase effectiveness, predictive power, and resource allocation efficiency, evaluators need good data. Data require sufficient credibility in terms of fitness for purpose and quality to develop the necessary evidence base. The authors examine elements of data credibility using experience from critical…

The University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP)

PubMed Central

Moodie, Sheila T.; Malandrino, April C.; Richert, Frances M.; Clench, Debbie A.; Scollie, Susan D.

2011-01-01

This study proposed and evaluated a guideline for outcome evaluation for infants and children with hearing loss who wear hearing aids. The University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP) was developed following a critical review of pediatric outcome evaluation tools and was systematically examined by the Network of Pediatric Audiologists of Canada. It consists of tools to gather clinical process outcomes as well as functional caregiver reports. The UWO PedAMP was administered to a clinical population of infants and children with hearing aids. Sixty-eight children were administered the functional outcome evaluation tools (i.e., caregiver reports) a total of 133 times. Clinical process outcomes of hearing aid verification (e.g., real-ear-to-coupler difference) revealed typical aided audibility (e.g., Speech Intelligibility Index). Results for the LittlEARS® questionnaire revealed that typically developing children with hearing loss who wear hearing aids are meeting auditory development milestones. Children with mild to moderate comorbidities displayed typical auditory development during the 1st year of life after which development began to decline. Children with complex factors related to hearing aid use had lower scores on the LittlEARS, but auditory development was in parallel to norms. Parents’ Evaluation of Aural/Oral Performance (PEACH) results indicated no age effect on scoring for children above 2 years of age; however, the effect of degree of hearing loss was significant. This work provides clinicians with a systematic, evidence-based outcome evaluation protocol to implement as part of a complete pediatric hearing aid fitting. PMID:22194316

Calculation of the detection limit in radiation measurements with systematic uncertainties

NASA Astrophysics Data System (ADS)

Kirkpatrick, J. M.; Russ, W.; Venkataraman, R.; Young, B. M.

2015-06-01

The detection limit (LD) or Minimum Detectable Activity (MDA) is an a priori evaluation of assay sensitivity intended to quantify the suitability of an instrument or measurement arrangement for the needs of a given application. Traditional approaches as pioneered by Currie rely on Gaussian approximations to yield simple, closed-form solutions, and neglect the effects of systematic uncertainties in the instrument calibration. These approximations are applicable over a wide range of applications, but are of limited use in low-count applications, when high confidence values are required, or when systematic uncertainties are significant. One proposed modification to the Currie formulation attempts account for systematic uncertainties within a Gaussian framework. We have previously shown that this approach results in an approximation formula that works best only for small values of the relative systematic uncertainty, for which the modification of Currie's method is the least necessary, and that it significantly overestimates the detection limit or gives infinite or otherwise non-physical results for larger systematic uncertainties where such a correction would be the most useful. We have developed an alternative approach for calculating detection limits based on realistic statistical modeling of the counting distributions which accurately represents statistical and systematic uncertainties. Instead of a closed form solution, numerical and iterative methods are used to evaluate the result. Accurate detection limits can be obtained by this method for the general case.

Assessing oral health-related quality of life in children and adolescents: a systematic review and standardized comparison of available instruments.

PubMed

Zaror, Carlos; Pardo, Yolanda; Espinoza-Espinoza, Gerardo; Pont, Àngels; Muñoz-Millán, Patricia; Martínez-Zapata, María José; Vilagut, Gemma; Forero, Carlos G; Garin, Olatz; Alonso, Jordi; Ferrer, Montse

2018-03-22

To obtain a systematic and standardized evaluation of the current evidence on development process, metric properties, and administration issues of oral health-related quality of life instruments available for children and adolescents. A systematic search until October 2016 was conducted in PubMed, Embase, Lilacs, SciELO, and Cochrane databases. Articles with information regarding the development process, metric properties, and administration issues of pediatric instruments measuring oral health-related quality of life were eligible for inclusion. Two researchers independently evaluated each instrument applying the Evaluating Measures of Patient-Reported Outcomes (EMPRO) tool. An overall and seven attribute-specific EMPRO scores were calculated (range 0-100, worst to best): measurement model, reliability, validity, responsiveness, interpretability, burden, and alternative forms. We identified 18 instruments evaluated in 132 articles. From five instruments designed for preschoolers, the Early Childhood Oral Health Impact Scale (ECOHIS) obtained the highest overall EMPRO score (82.2). Of nine identified for schoolchildren and adolescents, the best rated instrument was the Child Perceptions Questionnaire 11-14 (82.1). Among the four instruments developed for any age, the Family Impact Scale (FIS) obtained the highest scores (80.3). The evidence supports the use of the ECOHIS for preschoolers, while the age is a key factor when choosing among the four recommended instruments for schoolchildren and adolescents. Instruments for specific conditions, symptoms, or treatments need further research on metric properties. Our results facilitate decision-making on the correct oral health-related quality of life instrument selection for any certain study purpose and population during the childhood and adolescence life cycle.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Improved water resource management for a highly complex environment using three-dimensional groundwater modelling

NASA Astrophysics Data System (ADS)

Moeck, Christian; Affolter, Annette; Radny, Dirk; Dressmann, Horst; Auckenthaler, Adrian; Huggenberger, Peter; Schirmer, Mario

2018-02-01

A three-dimensional groundwater model was used to improve water resource management for a study area in north-west Switzerland, where drinking-water production is close to former landfills and industrial areas. To avoid drinking-water contamination, artificial groundwater recharge with surface water is used to create a hydraulic barrier between the contaminated sites and drinking-water extraction wells. The model was used for simulating existing and proposed water management strategies as a tool to ensure the utmost security for drinking water. A systematic evaluation of the flow direction between existing observation points using a developed three-point estimation method for a large number of scenarios was carried out. It is demonstrated that systematically applying the developed methodology helps to identify vulnerable locations which are sensitive to changing boundary conditions such as those arising from changes to artificial groundwater recharge rates. At these locations, additional investigations and protection are required. The presented integrated approach, using the groundwater flow direction between observation points, can be easily transferred to a variety of hydrological settings to systematically evaluate groundwater modelling scenarios.

The human placental perfusion model: a systematic review and development of a model to predict in vivo transfer of therapeutic drugs.

PubMed

Hutson, J R; Garcia-Bournissen, F; Davis, A; Koren, G

2011-07-01

Dual perfusion of a single placental lobule is the only experimental model to study human placental transfer of substances in organized placental tissue. To date, there has not been any attempt at a systematic evaluation of this model. The aim of this study was to systematically evaluate the perfusion model in predicting placental drug transfer and to develop a pharmacokinetic model to account for nonplacental pharmacokinetic parameters in the perfusion results. In general, the fetal-to-maternal drug concentration ratios matched well between placental perfusion experiments and in vivo samples taken at the time of delivery of the infant. After modeling for differences in maternal and fetal/neonatal protein binding and blood pH, the perfusion results were able to accurately predict in vivo transfer at steady state (R² = 0.85, P < 0.0001). Placental perfusion experiments can be used to predict placental drug transfer when adjusting for extra parameters and can be useful for assessing drug therapy risks and benefits in pregnancy.

Development and Evaluation of an ADME-informed High Throughput Exposure Estimation Tool

EPA Science Inventory

EPA’s Chemical Safety for Sustainability (CSS) research program has been developing new ways to prioritize chemicals used in consumer products and articles. Using a risk-based methodology to account for both toxicity and exposure offers a comprehensive and systematic approa...

Developing Learning Objectives for a Model Course to Prepare Adults for the Assessment of Prior, Non-Sponsored Learning by Portfolio Evaluation.

ERIC Educational Resources Information Center

Stevens, Mary A.

A study was conducted in order to develop a systematic method for the evaluation of students' prior, non-sponsored learning for the award of college credit at Blackhawk College (Illinois). It was determined that a course designed to prepare the student for assessment of prior learning was the best way for the institution to provide assistance to…

New Developments in the Technology Readiness Assessment Process in US DOE-EM - 13247

DOE Office of Scientific and Technical Information (OSTI.GOV)

Krahn, Steven; Sutter, Herbert; Johnson, Hoyt

2013-07-01

A Technology Readiness Assessment (TRA) is a systematic, metric-based process and accompanying report that evaluates the maturity of the technologies used in systems; it is designed to measure technology maturity using the Technology Readiness Level (TRL) scale pioneered by the National Aeronautics and Space Administration (NASA) in the 1980's. More recently, DoD has adopted and provided systematic guidance for performing TRAs and determining TRLs. In 2007 the GAO recommended that the DOE adopt the NASA/DoD methodology for evaluating technology maturity. Earlier, in 2006-2007, DOE-EM had conducted pilot TRAs on a number of projects at Hanford and Savannah River. In Marchmore » 2008, DOE-EM issued a process guide, which established TRAs as an integral part of DOE-EM's Project Management Critical Decision Process. Since the development of its detailed TRA guidance in 2008, DOE-EM has continued to accumulate experience in the conduct of TRAs and the process for evaluating technology maturity. DOE has developed guidance on TRAs applicable department-wide. DOE-EM's experience with the TRA process, the evaluations that led to recently developed proposed revisions to the DOE-EM TRA/TMP Guide; the content of the proposed changes that incorporate the above lessons learned and insights are described. (authors)« less

Design and Field Testing of a Systematic Procedure for Evaluating Vocational Programs. Final Report.

ERIC Educational Resources Information Center

Portland Public Schools, OR.

The purpose of a project was to design and field-test a system for evaluating the adequacy of the vocational curriculum utilized by the Vocational Village, an alternative school for the training of individuals who have experienced failure in other educational settings. Focus was on the development of an evaluation model which will assess the…

An Application of the PMI Model at the Project Level Evaluation of ESEA Title IV-C Projects.

ERIC Educational Resources Information Center

McBeath, Marcia

All of the papers presented as part of a symposium concerned the application of the Planning, Monitoring, and Implementation Model (PMI) to the evaluation of the District of Columbia Public Schools' programs supported by the Elementary Secondary Education Act (ESEA) Title IV-C. PMI was developed to provide a model for systematic evaluation of…

USDA Nutrition Evidence Library: methodology used to identify topics and develop systematic review questions for the birth-to-24-mo population.

PubMed

Obbagy, Julie E; Blum-Kemelor, Donna M; Essery, Eve V; Lyon, Joan M G; Spahn, Joanne M

2014-03-01

The USDA's Nutrition Evidence Library (NEL) specializes in conducting food- and nutrition-related systematic reviews that are used to inform federal government decision making. To ensure the utility of NEL systematic reviews, the most relevant topics must be addressed, questions must be clearly focused and appropriate in scope, and review frameworks must reflect the state of the science. Identifying the optimal topics and questions requires input from a variety of stakeholders, including scientists with technical expertise, as well as government policy and program leaders. The objective of this article is to describe the rationale and NEL methodology for identifying topics and developing systematic review questions implemented as part of the "Evaluating the evidence base to support the inclusion of infants and children from birth to 24 months of age in the Dietary Guidelines for Americans--the B-24 Project." This is the first phase of a larger project designed to develop dietary guidance for the birth to 24-mo population in the United States.

Technical Packages in Injury and Violence Prevention to Move Evidence Into Practice: Systematic Reviews and Beyond.

PubMed

Haegerich, Tamara M; David-Ferdon, Corinne; Noonan, Rita K; Manns, Brian J; Billie, Holly C

2016-09-07

Injury and violence prevention strategies have greater potential for impact when they are based on scientific evidence. Systematic reviews of the scientific evidence can contribute key information about which policies and programs might have the greatest impact when implemented. However, systematic reviews have limitations, such as lack of implementation guidance and contextual information, that can limit the application of knowledge. "Technical packages," developed by knowledge brokers such as the federal government, nonprofit agencies, and academic institutions, have the potential to be an efficient mechanism for making information from systematic reviews actionable. Technical packages provide information about specific evidence-based prevention strategies, along with the estimated costs and impacts, and include accompanying implementation and evaluation guidance to facilitate adoption, implementation, and performance measurement. We describe how systematic reviews can inform the development of technical packages for practitioners, provide examples of technical packages in injury and violence prevention, and explain how enhancing review methods and reporting could facilitate the use and applicability of scientific evidence. © The Author(s) 2016.

Research on Sustainable Development Level Evaluation of Resource-based Cities Based on Shapely Entropy and Chouqet Integral

NASA Astrophysics Data System (ADS)

Zhao, Hui; Qu, Weilu; Qiu, Weiting

2018-03-01

In order to evaluate sustainable development level of resource-based cities, an evaluation method with Shapely entropy and Choquet integral is proposed. First of all, a systematic index system is constructed, the importance of each attribute is calculated based on the maximum Shapely entropy principle, and then the Choquet integral is introduced to calculate the comprehensive evaluation value of each city from the bottom up, finally apply this method to 10 typical resource-based cities in China. The empirical results show that the evaluation method is scientific and reasonable, which provides theoretical support for the sustainable development path and reform direction of resource-based cities.

Mental health training for health workers in Africa: a systematic review.

PubMed

Liu, Germaine; Jack, Helen; Piette, Angharad; Mangezi, Walter; Machando, Debra; Rwafa, Chido; Goldenberg, Matthew; Abas, Melanie

2016-01-01

Commitment to building mental health treatment capacity in Africa is increasing but little agreement exists on strategies to train health workers on mental health or evaluation of training efforts. We systematically reviewed published literature on interventions to train health-care workers in Africa on mental health. 37 studies met our inclusion criteria. Training outcomes focused on changes in knowledge and attitude, with few studies evaluating skill and practice and only two studies measuring clinical outcomes. Quality of study methodology was generally not high, with scarce follow-up data and use of control cohorts. Existing studies provide examples of many training and evaluation strategies, but evidence to draw conclusions about the efficacy of different training techniques is inadequate. Key knowledge gaps include development and testing of innovative educational strategies; development of standardised, competency-based learning objectives and outcome measures; and training that facilitates implementation of integrated mental health systems. African institutions need to be empowered to do research in these areas to encourage the development of best practices for the continent. Copyright © 2016 Elsevier Ltd. All rights reserved.

Experimental quiet engine program

NASA Technical Reports Server (NTRS)

Cornell, W. G.

1975-01-01

Full-scale low-tip-speed fans, a full-scale high-tip-speed fan, scale model versions of fans, and two full-scale high-bypass-ratio turbofan engines, were designed, fabricated, tested, and evaluated. Turbine noise suppression was investigated. Preliminary design studies of flight propulsion system concepts were used in application studies to determine acoustic-economic tradeoffs. Salient results are as follows: tradeoff evaluation of fan tip speed and blade loading; systematic data on source noise characteristics and suppression effectiveness; documentation of high- and low-fan-speed aerodynamic and acoustic technology; aerodynamic and acoustic evaluation of acoustic treatment configurations, casing tip bleed, serrated and variable pitch rotor blades, leaned outlet guide vanes, slotted tip casings, rotor blade shape modifications, and inlet noise suppression; systematic evaluation of aerodynamic and acoustic effects; flyover noise projections of engine test data; turbine noise suppression technology development; and tradeoff evaluation of preliminary design high-fan-speed and low-fan-speed flight engines.

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review.

PubMed

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F; Moher, David

2014-06-25

To assess whether the completeness of reporting of health research is related to journals' endorsement of reporting guidelines. Systematic review. Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed "evaluations") (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals' websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors' analysis, a mean summed score. 101 reporting guidelines were included. Of 15,249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals' endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals' endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Not registered; no known register currently accepts protocols for methodology systematic reviews. © Stevens et al 2014.

Core Professionalism Education in Surgery: A Systematic Review.

PubMed

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-03-15

Professionalism education is one of the major elements of surgical residency education. To evaluate the studies on core professionalism education programs in surgical professionalism education. Systematic review. This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

A research project to develop and evaluate a technical education component on materials technology for orientation to space-age technology

NASA Technical Reports Server (NTRS)

Jacobs, J. A.

1976-01-01

A project was initiated to develop, implement, and evaluate a prototype component for self-pacing, individualized instruction on basic materials science. Results of this project indicate that systematically developed, self-paced instruction provides an effective means for orienting nontraditional college students and secondary students, especially minorities, to both engineering technology and basic materials science. In addition, students using such a system gain greater chances for mastering subject matter than with conventional modes of instruction.

A systematic review of recent clinical practice guidelines and best practice statements for the evaluation of the infertile male.

PubMed

Esteves, Sandro C; Chan, Peter

2015-09-01

We systematically identified and reviewed the methods and consistency of recommendations of recently developed clinical practice guidelines (CPG) and best practice statements (BPS) on the evaluation of the infertile male. MEDLINE and related engines as well as guidelines' Web sites were searched for CPG and BPS written in English on the general evaluation of male infertility published between January 2008 and April 2015. Four guidelines were identified, all of which reported to have been recently updated. Systematic review was not consistently used in the BPS despite being reported in the CPG. Only one of them reported having a patient representative in its development team. The CPG issued by the European Association of Urology (EAU) graded some recommendations and related that to levels (but not quality) of evidence. Overall, the BPS issued respectively by the American Urological Association and American Society for Reproductive Medicine concurred with each other, but both differed from the EAU guidelines with regard to methods of collection, extraction and interpretation of data. None of the guidelines incorporated health economics. Important specific limitations of conventional semen analysis results were ignored by all guidelines. Besides variation in the methodological quality, implementation strategies were not reported in two out of four guidelines. While the various panels of experts who contributed to the development of the CPG and BPS reviewed should be commended on their tremendous efforts aiming to establish a clinical standard in both the evaluation and management of male infertility, we recognized inconsistencies in the methodology of their synthesis and in the contents of their final recommendations. These discrepancies pose a barrier in the general implementation of these guidelines and may limit their utility in standardizing clinical practice or improving health-related outcomes. Continuous efforts are needed to generate high-quality evidence to allow further development of these important guidelines for the evaluation and management of males suffering from infertility.

Nurse manager succession planning: synthesis of the evidence.

PubMed

Titzer, Jennifer; Phillips, Tracy; Tooley, Stephanie; Hall, Norma; Shirey, Maria

2013-10-01

The literature supporting nurse manager succession planning is reviewed and synthesised to discover best practice for identifying and developing future nurse managers. Healthcare succession planning practices are lacking. Nurse managers are historically selected based on clinical skills and lack formal leadership preparation. A systematic literature search appraises and summarises the current literature supporting nurse manager succession planning. Multiple reviewers were used to increase the reliability and validity of article selection and analysis. New nurse managers require months to adapt to their positions. Deliberate nurse manager succession planning should be integrated in the organisation's strategic plan and provide a proactive method for identifying and developing potential leaders. Organisations that identify and develop internal human capital can improve role transition, reduce nurse manager turnover rates and decrease replacement costs. Despite the clear benefits of succession planning, studies show that resource allocation for proactive, deliberate development of current and future nurse leaders is lacking. Additionally, systematic evaluation of succession planning is limited. Deliberate succession planning efforts and appropriate resource allocation require strategic planning and evaluation methods. Detailed evaluation methods demonstrating a positive return on investment utilising a cost-benefit analysis and empirical outcomes are necessary. © 2013 John Wiley & Sons Ltd.

Energising the WEF nexus to enhance sustainable development at local level.

PubMed

Terrapon-Pfaff, Julia; Ortiz, Willington; Dienst, Carmen; Gröne, Marie-Christine

2018-06-23

The water-energy-food (WEF) nexus is increasingly recognised as a conceptual framework able to support the efficient implementation of the Sustainable Development Goals (SDGs). Despite growing attention paid to the WEF nexus, the role that renewable energies can play in addressing trade-offs and realising synergies has received limited attention. Until now, the focus of WEF nexus discussions and applications has mainly been on national or global levels, macro-level drivers, material flows and large infrastructure developments. This overlooks the fact that major nexus challenges are faced at local level. Aiming to address these knowledge gaps, the authors conduct a systematic analysis of the linkages between small-scale energy projects in developing countries and the food and water aspects of development. The analysis is based on empirical data from continuous process and impact evaluations complemented by secondary data and relevant literature. The study provides initial insights into how to identify interconnections and the potential benefits of integrating the nexus pillars into local level projects in the global south. The study identifies the complex links which exist between sustainable energy projects and the food and water sectors and highlights that these needs are currently not systematically integrated into project design or project evaluation. A more systematic approach, integrating the water and food pillars into energy planning at local level in the global south, is recommended to avoid trade-offs and enhance the development outcomes and impacts of energy projects. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

48 CFR 3452.224-71 - Notice about research activities involving human subjects.

Code of Federal Regulations, 2012 CFR

2012-10-01

... research as “a systematic investigation, including research development, testing and evaluation, designed... deliberate plan designed to develop or contribute to generalizable knowledge, it is research. Research... 48 Federal Acquisition Regulations System 7 2012-10-01 2012-10-01 false Notice about research...

48 CFR 3452.224-71 - Notice about research activities involving human subjects.

Code of Federal Regulations, 2011 CFR

2011-10-01

... research as “a systematic investigation, including research development, testing and evaluation, designed... deliberate plan designed to develop or contribute to generalizable knowledge, it is research. Research... 48 Federal Acquisition Regulations System 7 2011-10-01 2011-10-01 false Notice about research...

48 CFR 3452.224-71 - Notice about research activities involving human subjects.

Code of Federal Regulations, 2013 CFR

2013-10-01

... research as “a systematic investigation, including research development, testing and evaluation, designed... deliberate plan designed to develop or contribute to generalizable knowledge, it is research. Research... 48 Federal Acquisition Regulations System 7 2013-10-01 2012-10-01 true Notice about research...

48 CFR 3452.224-71 - Notice about research activities involving human subjects.

Code of Federal Regulations, 2014 CFR

2014-10-01

... research as “a systematic investigation, including research development, testing and evaluation, designed... deliberate plan designed to develop or contribute to generalizable knowledge, it is research. Research... 48 Federal Acquisition Regulations System 7 2014-10-01 2014-10-01 false Notice about research...

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature.

PubMed

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability.

Prevention and assessment of infectious diseases among children and adult migrants arriving to the European Union/European Economic Association: a protocol for a suite of systematic reviews for public health and health systems.

PubMed

Pottie, Kevin; Mayhew, Alain D; Morton, Rachael L; Greenaway, Christina; Akl, Elie A; Rahman, Prinon; Zenner, Dominik; Pareek, Manish; Tugwell, Peter; Welch, Vivian; Meerpohl, Joerg; Alonso-Coello, Pablo; Hui, Charles; Biggs, Beverley-Ann; Requena-Méndez, Ana; Agbata, Eric; Noori, Teymur; Schünemann, Holger J

2017-09-11

The European Centre for Disease Prevention and Control is developing evidence-based guidance for voluntary screening, treatment and vaccine prevention of infectious diseases for newly arriving migrants to the European Union/European Economic Area. The objective of this systematic review protocol is to guide the identification, appraisal and synthesis of the best available evidence on prevention and assessment of the following priority infectious diseases: tuberculosis, HIV, hepatitis B, hepatitis C, measles, mumps, rubella, diphtheria, tetanus, pertussis, poliomyelitis (polio), Haemophilus influenza disease, strongyloidiasis and schistosomiasis. The search strategy will identify evidence from existing systematic reviews and then update the effectiveness and cost-effectiveness evidence using prospective trials, economic evaluations and/or recently published systematic reviews. Interdisciplinary teams have designed logic models to help define study inclusion and exclusion criteria, guiding the search strategy and identifying relevant outcomes. We will assess the certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. There are no ethical or safety issues. We anticipate disseminating the findings through open-access publications, conference abstracts and presentations. We plan to publish technical syntheses as GRADEpro evidence summaries and the systematic reviews as part of a special edition open-access publication on refugee health. We are following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Protocols reporting guideline. This protocol is registered in PROSPERO: CRD42016045798. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Evaluation of rubblization project in Ohio.

DOT National Transportation Integrated Search

2011-03-01

This study was initiated to systematically analyze the performance characteristics of ODOTs completed rubblization and roll (R/R) projects and to develop guidelines regarding improved specifications. : The study was conducted in three parts namely...

Systematic documentation of new vaccine introduction in selected countries of the Latin American Region.

PubMed

de Oliveira, Lúcia H; Toscano, Cristiana M; Sanwogou, N Jennifer; Ruiz-Matus, Cuauhtémoc; Tambini, Gina; Roses-Periago, Mirta; Andrus, Jon K

2013-07-02

Countries in Latin America were among the first developing countries to introduce new vaccines, particularly rotavirus (RV) and pneumococcal conjugate vaccines (PCVs), into their national immunization schedules. Experiences and lessons learned from these countries are valuable to donors, immunization partners, and policy makers in other countries wishing to make informed decisions on vaccine introduction. In order to enhance knowledge and promote understanding of the process of new vaccine introduction in the Latin American Region, with particular focus on RV and PCV, we conducted a systematic qualitative assessment. We evaluated the decision-making process, documented the structure in place, and reviewed key factors pertaining to new vaccine introduction. These include country morbidity and mortality data available prior to vaccine introduction, funding sources and mechanisms for vaccine introduction, challenges of implementation, and assessment of vaccine impact. From March 2010 to April 2011, we evaluated a subset of countries that had introduced RV and/or PCV in the past five years through interviews with key informants at the country level and through a systematic review of published data, gray literature, official technical documents, and country-specific health indicators. Countries evaluated were Bolivia, Brazil, Nicaragua, Peru, and Venezuela. In all countries, the potential of new vaccines to reduce mortality, as established by Millennium Development Goal 4, was an important consideration leading to vaccine introduction. Several factors-the availability of funds, the existence of sufficient evidence for vaccine introduction, and the feasibility of sustainable financing-were identified as crucial components of the decision-making process in the countries evaluated. The decision making process regarding new vaccine introduction in the countries evaluated does not follow a systematic approach. Nonetheless, existing evidence on efficacy, potential impact, and cost-effectiveness of vaccine introduction, even if not local data, was important in the decision making process for vaccine introduction. Copyright © 2013 Elsevier Ltd. All rights reserved.

Development and evaluation of a study design typology for human research.

PubMed

Carini, Simona; Pollock, Brad H; Lehmann, Harold P; Bakken, Suzanne; Barbour, Edward M; Gabriel, Davera; Hagler, Herbert K; Harper, Caryn R; Mollah, Shamim A; Nahm, Meredith; Nguyen, Hien H; Scheuermann, Richard H; Sim, Ida

2009-11-14

A systematic classification of study designs would be useful for researchers, systematic reviewers, readers, and research administrators, among others. As part of the Human Studies Database Project, we developed the Study Design Typology to standardize the classification of study designs in human research. We then performed a multiple observer masked evaluation of active research protocols in four institutions according to a standardized protocol. Thirty-five protocols were classified by three reviewers each into one of nine high-level study designs for interventional and observational research (e.g., N-of-1, Parallel Group, Case Crossover). Rater classification agreement was moderately high for the 35 protocols (Fleiss' kappa = 0.442) and higher still for the 23 quantitative studies (Fleiss' kappa = 0.463). We conclude that our typology shows initial promise for reliably distinguishing study design types for quantitative human research.

A Census of Prison-Based Drug Treatment Programs: Implications for Programming, Policy, and Evaluation

ERIC Educational Resources Information Center

Welsh, Wayne N.; Zajac, Gary

2004-01-01

Despite a growing realization that unmeasured programmatic differences influence prison-based drug treatment effectiveness, few attempts to systematically measure such differences have been made. To improve program planning and evaluation in this area, we developed a census instrument to collect descriptive information about 118 prison-based drug…

A Computerized Library and Evaluation System for Integral Neutron Experiments.

ERIC Educational Resources Information Center

Hampel, Viktor E.; And Others

A computerized library of references to integral neutron experiments has been developed at the Lawrence Radiation Laboratory at Livermore. This library serves as a data base for the systematic retrieval of documents describing diverse critical and bulk nuclear experiments. The evaluation and reduction of the physical parameters of the experiments…

AATA AOS evaluation : transfer and on-time performance study : before and after AOS implementation, October 1996 - May 1999

DOT National Transportation Integrated Search

1999-01-01

This study develops, using data before AOS in 1996 and 1997 and after AOS in 1998 and 1999, implementation data on AATAs on-time performance and vehicle-to-vehicle timing of transfers at four major transfer location. Systematic evaluation of on-ti...

Measuring the Youth Bullying Experience: A Systematic Review of the Psychometric Properties of Available Instruments

ERIC Educational Resources Information Center

Vessey, Judith; Strout, Tania D.; DiFazio, Rachel L.; Walker, Allison

2014-01-01

Background: Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified…

Interaction of Theory and Practice to Assess External Validity.

PubMed

Leviton, Laura C; Trujillo, Mathew D

2016-01-18

Variations in local context bedevil the assessment of external validity: the ability to generalize about effects of treatments. For evaluation, the challenges of assessing external validity are intimately tied to the translation and spread of evidence-based interventions. This makes external validity a question for decision makers, who need to determine whether to endorse, fund, or adopt interventions that were found to be effective and how to ensure high quality once they spread. To present the rationale for using theory to assess external validity and the value of more systematic interaction of theory and practice. We review advances in external validity, program theory, practitioner expertise, and local adaptation. Examples are provided for program theory, its adaptation to diverse contexts, and generalizing to contexts that have not yet been studied. The often critical role of practitioner experience is illustrated in these examples. Work is described that the Robert Wood Johnson Foundation is supporting to study treatment variation and context more systematically. Researchers and developers generally see a limited range of contexts in which the intervention is implemented. Individual practitioners see a different and often a wider range of contexts, albeit not a systematic sample. Organized and taken together, however, practitioner experiences can inform external validity by challenging the developers and researchers to consider a wider range of contexts. Researchers have developed a variety of ways to adapt interventions in light of such challenges. In systematic programs of inquiry, as opposed to individual studies, the problems of context can be better addressed. Evaluators have advocated an interaction of theory and practice for many years, but the process can be made more systematic and useful. Systematic interaction can set priorities for assessment of external validity by examining the prevalence and importance of context features and treatment variations. Practitioner interaction with researchers and developers can assist in sharpening program theory, reducing uncertainty about treatment variations that are consistent or inconsistent with the theory, inductively ruling out the ones that are harmful or irrelevant, and helping set priorities for more rigorous study of context and treatment variation. © The Author(s) 2016.

Touchless interaction with software in interventional radiology and surgery: a systematic literature review.

PubMed

Mewes, André; Hensen, Bennet; Wacker, Frank; Hansen, Christian

2017-02-01

In this article, we systematically examine the current state of research of systems that focus on touchless human-computer interaction in operating rooms and interventional radiology suites. We further discuss the drawbacks of current solutions and underline promising technologies for future development. A systematic literature search of scientific papers that deal with touchless control of medical software in the immediate environment of the operation room and interventional radiology suite was performed. This includes methods for touchless gesture interaction, voice control and eye tracking. Fifty-five research papers were identified and analyzed in detail including 33 journal publications. Most of the identified literature (62 %) deals with the control of medical image viewers. The others present interaction techniques for laparoscopic assistance (13 %), telerobotic assistance and operating room control (9 % each) as well as for robotic operating room assistance and intraoperative registration (3.5 % each). Only 8 systems (14.5 %) were tested in a real clinical environment, and 7 (12.7 %) were not evaluated at all. In the last 10 years, many advancements have led to robust touchless interaction approaches. However, only a few have been systematically evaluated in real operating room settings. Further research is required to cope with current limitations of touchless software interfaces in clinical environments. The main challenges for future research are the improvement and evaluation of usability and intuitiveness of touchless human-computer interaction and the full integration into productive systems as well as the reduction of necessary interaction steps and further development of hands-free interaction.

PRISM: Priority Symptom Management Project phase I: assessment.

PubMed

Ropka, M E; Spencer-Cisek, P

2001-01-01

To provide an overview of the process, goals, and outcome recommendations from the assessment phase of the Oncology Nursing Society's Priority Symptom Management (PRISM) project and to provide the foundation for a series of evidence-based practice and qualitative systematic review articles generated from the first phase of PRISM. Published articles, abstracts, and books; computerized databases; nonpublished research; personal communications; and proceedings of the PRISM summit meeting. Symptom management is a key component in quality cancer care. The assessment phase of PRISM yielded systematic reviews with an evidence-based framework to evaluate key symptoms, developed a framework for teaching and evaluating other symptoms, and recommended future ONS initiatives. Outcome recommendations from the PRISM summit targeted practice; professional and public education; research; and health policy. These activities provide background for subsequent evidence-based practice and qualitative systematic review articles that will focus on cancer symptom management.

Development of a researcher codebook for use in evaluating social networking site profiles.

PubMed

Moreno, Megan A; Egan, Katie G; Brockman, Libby

2011-07-01

Social networking sites (SNSs) are immensely popular and allow for the display of personal information, including references to health behaviors. Evaluating displayed content on an SNS for research purposes requires a systematic approach and a precise data collection instrument. The purpose of this article is to describe one approach to the development of a research codebook so that others may develop and test their own codebooks for use in SNS research. Our SNS research codebook began on the basis of health behavior theory and clinical criteria. Key elements in the codebook developmental process included an iterative team approach and an emphasis on confidentiality. Codebook successes include consistently high inter-rater reliability. Challenges include time investment in coder training and SNS server changes. We hope that this article will provide detailed information about one systematic approach to codebook development so that other researchers may use this structure to develop and test their own codebooks for use in SNS research. Copyright © 2011 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

Which learning activities enhance physiotherapy practice? A systematic review protocol of quantitative and qualitative studies.

PubMed

Leahy, Edmund; Chipchase, Lucy; Blackstock, Felicity

2017-04-17

Learning activities are fundamental for the development of expertise in physiotherapy practice. Continuing professional development (CPD) encompasses formal and informal learning activities undertaken by physiotherapists. Identifying the most efficient and effective learning activities is essential to enable the profession to assimilate research findings and improve clinical skills to ensure the most efficacious care for clients. To date, systematic reviews on the effectiveness of CPD provide limited guidance on the most efficacious models of professional development for physiotherapists. The aim of this systematic review is to evaluate which learning activities enhance physiotherapy practice. A search of Ovid MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO (Psychological Abstracts), PEDro, Cochrane Library, AMED and Educational Resources and Information Center (ERIC) will be completed. Citation searching and reference list searching will be undertaken to locate additional studies. Quantitative and qualitative studies will be included if they examine the impact of learning activities on clinician's behaviour, attitude, knowledge, beliefs, skills, self-efficacy, work satisfaction and patient outcomes. Risk of bias will be assessed by two independent researchers. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) and Confidence in the Evidence from Reviews of Qualitative research (CERQual) will be used to synthesise results where a meta-analysis is possible. Where a meta-analysis is not possible, a narrative synthesis will be conducted. PROSPERO CRD42016050157.

Developing evidence-based dentistry skills: how to interpret randomized clinical trials and systematic reviews.

PubMed

Kiriakou, Juliana; Pandis, Nikolaos; Madianos, Phoebus; Polychronopoulou, Argy

2014-10-30

Decision-making based on reliable evidence is more likely to lead to effective and efficient treatments. Evidence-based dentistry was developed, similarly to evidence-based medicine, to help clinicians apply current and valid research findings into their own clinical practice. Interpreting and appraising the literature is fundamental and involves the development of evidence-based dentistry (EBD) skills. Systematic reviews (SRs) of randomized controlled trials (RCTs) are considered to be evidence of the highest level in evaluating the effectiveness of interventions. Furthermore, the assessment of the report of a RCT, as well as a SR, can lead to an estimation of how the study was designed and conducted.

In Search of the Elusive ADDIE Model.

ERIC Educational Resources Information Center

Molenda, Michael

2003-01-01

Discusses the origin of the ADDIE model of instructional design and concludes that the term came into use by word of mouth as a label for the whole family of systematic instructional development models. Examines the underlying ideas behind the acronym analysis, design, development, implementation, and evaluation. (Author/LRW)

A Systematic Literature Review of Faculty Development for Teacher Educators

ERIC Educational Resources Information Center

Phuong, Tam T.; Cole, S. Catherine; Zarestky, Jill

2018-01-01

Although ample literature exists regarding the effectiveness of faculty development (FD) activities, there is a gap in the literature synthesizing its outcomes. This review, using a predetermined review protocol, analyzed 22 publications on FD for teacher educators using Kirkpatrick's training evaluation taxonomy. We found that North American…

A Fifteen-Year Forecast of Information-Processing Technology. Final Report.

ERIC Educational Resources Information Center

Bernstein, George B.

This study developed a variation of the DELPHI approach, a polling technique for systematically soliciting opinions from experts, to produce a technological forecast of developments in the information-processing industry. SEER (System for Event Evaluation and Review) combines the more desirable elements of existing techniques: (1) intuitive…

Evaluation of contract time estimation and contracting procedures for louisiana department of transportation and development construction projects : final report : volume I.

DOT National Transportation Integrated Search

1995-09-11

The purpose of the research was to provide the Louisiana Department of Transportation and Development (LaDOTD) with a systematic approach to the determination of contract time and to explore innovative contracting procedures that may prove beneficial...

Mapping Children's Understanding of Mathematical Equivalence

ERIC Educational Resources Information Center

Taylor, Roger S.; Rittle-Johnson, Bethany; Matthews, Percival G.; McEldoon, Katherine L.

2009-01-01

The focus of this research is to develop an initial framework for assessing and interpreting students' level of understanding of mathematical equivalence. Although this topic has been studied for many years, there has been no systematic development or evaluation of a valid measure of equivalence knowledge. A powerful method for accomplishing this…

A New Research Agenda for Pre-College Economic Education.

ERIC Educational Resources Information Center

Brenneke, Judith Staley; Soper, John C.

The Joint Council on Economic Education (JCEE) contracted for the development of this research and evaluation agenda (or blueprint) for its Developmental Economic Education Program (DEEP). DEEP involves local school systems in a formal commitment to develop systematic programs in economic education curriculum using academically sound materials and…

Interventions to improve the use of systematic reviews in decision-making by health system managers, policy makers and clinicians.

PubMed

Murthy, Lakshmi; Shepperd, Sasha; Clarke, Mike J; Garner, Sarah E; Lavis, John N; Perrier, Laure; Roberts, Nia W; Straus, Sharon E

2012-09-12

Systematic reviews provide a transparent and robust summary of existing research. However, health system managers, national and local policy makers and healthcare professionals can face several obstacles when attempting to utilise this evidence. These include constraints operating within the health system, dealing with a large volume of research evidence and difficulties in adapting evidence from systematic reviews so that it is locally relevant. In an attempt to increase the use of systematic review evidence in decision-making a number of interventions have been developed. These include summaries of systematic review evidence that are designed to improve the accessibility of the findings of systematic reviews (often referred to as information products) and changes to organisational structures, such as employing specialist groups to synthesise the evidence to inform local decision-making. To identify and assess the effects of information products based on the findings of systematic review evidence and organisational supports and processes designed to support the uptake of systematic review evidence by health system managers, policy makers and healthcare professionals. We searched The Cochrane Library, MEDLINE, EMBASE, CINAHL, Web of Science, and Health Economic Evaluations Database. We also handsearched two journals (Implementation Science and Evidence and Policy), Cochrane Colloquium abstracts, websites of key organisations and reference lists of studies considered for inclusion. Searches were run from 1992 to March 2011 on all databases, an update search to March 2012 was run on MEDLINE only. Randomised controlled trials (RCTs), interrupted time-series (ITS) and controlled before-after studies (CBA) of interventions designed to aid the use of systematic reviews in healthcare decision-making were considered. Two review authors independently extracted the data and assessed the study quality. We extracted the median value across similar outcomes for each study and reported the range of values for each median value. We calculated the median of the two middlemost values if an even number of outcomes were reported. We included eight studies evaluating the effectiveness of different interventions designed to support the uptake of systematic review evidence. The overall quality of the evidence was very low to moderate.Two cluster RCTs evaluated the effectiveness of multifaceted interventions, which contained access to systematic reviews relevant to reproductive health, to change obstetric care; the high baseline performance in some of the key clinical indicators limited the findings of these studies. There were no statistically significant effects on clinical practice for all but one of the clinical indicators in selected obstetric units in Thailand (median effect size 4.2%, range -11.2% to 18.2%) and none in Mexico (median effect size 3.5%, range 0.1% to 19.0%). In the second cluster RCT there were no statistically significant differences in selected obstetric units in the UK (median effect RR 0.92; range RR 0.57 to RR 1.10). One RCT evaluated the perceived understanding and ease of use of summary of findings tables in Cochrane Reviews. The median effect of the differences in responses for the acceptability of including summary of findings tables in Cochrane Reviews versus not including them was 16%, range 1% to 28%. One RCT evaluated the effect of an analgesic league table, derived from systematic review evidence, and there was no statistically significant effect on self-reported pain. Only one RCT evaluated an organisational intervention (which included a knowledge broker, access to a repository of systematic reviews and provision of tailored messages), and reported no statistically significant difference in evidence informed programme planning.Three interrupted time series studies evaluated the dissemination of printed bulletins based on evidence from systematic reviews. A statistically significant reduction in the rates of surgery for glue ear in children under 10 years (mean annual decline of -10.1%; 95% CI -7.9 to -12.3) and in children under 15 years (quarterly reduction -0.044; 95% CI -0.080 to -0.011) was reported. The distribution to general practitioners of a bulletin on the treatment of depression was associated with a statistically significant lower prescribing rate each quarter than that predicted by the rates of prescribing observed before the distribution of the bulletin (8.2%; P = 0.005). Mass mailing a printed bulletin which summarises systematic review evidence may improve evidence-based practice when there is a single clear message, if the change is relatively simple to accomplish, and there is a growing awareness by users of the evidence that a change in practice is required. If the intention is to develop awareness and knowledge of systematic review evidence, and the skills for implementing this evidence, a multifaceted intervention that addresses each of these aims may be required, though there is insufficient evidence to support this approach.

The Evaluation of Hospital Performance in Iran: A Systematic Review Article

PubMed Central

BAHADORI, Mohammadkarim; IZADI, Ahmad Reza; GHARDASHI, Fatemeh; RAVANGARD, Ramin; HOSSEINI, Seyed Mojtaba

2016-01-01

Background: This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. Methods: In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. Results: The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Conclusion: Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them. PMID:27516991

The Evaluation of Hospital Performance in Iran: A Systematic Review Article.

PubMed

Bahadori, Mohammadkarim; Izadi, Ahmad Reza; Ghardashi, Fatemeh; Ravangard, Ramin; Hosseini, Seyed Mojtaba

2016-07-01

This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them.

The Active plus protocol: systematic development of two theory- and evidence-based tailored physical activity interventions for the over-fifties.

PubMed

van Stralen, Maartje M; Kok, Gerjo; de Vries, Hein; Mudde, Aart N; Bolman, Catherine; Lechner, Lilian

2008-12-04

Limited data are available on the development, implementation and evaluation processes of physical activity promotion programmes among older adults. More integrative insights into interventions describing the planned systematic development, implementation and evaluation are needed. The purpose of this study is to give an integrative insight into the development of the Active plus programme applying the six-step Intervention Mapping protocol. The Active plus programme consisted of two theory- and evidence-based tailored physical activity promotion interventions, both comprising three tailored letters delivered over four months and aimed at raising awareness of insufficient physical activity, and stimulating physical activity initiation and maintenance among the over-fifties. The first intervention, the basic tailored intervention, provided tailored letters that intervened on the psychosocial determinants of physical activity. The second intervention, the intervention plus, provided the same tailored information but additionally provided tailored information about physical activity opportunities in the specific environment in which the older adults lived. This environment-based component also provided access to a forum and e-buddy system on a website. A plan for implementation and evaluation is also described. The planned development of the Active plus programme resulted in two theory- and evidence-based tailored physical activity interventions targeted at the over-fifties. Dutch Trial Register NTR 920.

Using Intervention Mapping to Develop an Oral Health e-Curriculum for Secondary Prevention of Eating Disorders.

PubMed

DeBate, Rita D; Bleck, Jennifer R; Raven, Jessica; Severson, Herb

2017-06-01

Preventing oral-systemic health issues relies on evidence-based interventions across various system-level target groups. Although the use of theory- and evidence-based approaches has been encouraged in developing oral health behavior change programs, the translation of theoretical constructs and principles to behavior change interventions has not been well described. Based on a series of six systematic steps, Intervention Mapping provides a framework for effective decision making with regard to developing, implementing, and evaluating theory- and evidence-informed, system-based behavior change programs. This article describes the application of the Intervention Mapping framework to develop the EAT (evaluating, assessing, and treating) evidence-based intervention with the goal of increasing the capacity of oral health providers to engage in secondary prevention of oral-systemic issues associated with disordered eating behaviors. Examples of data and deliverables for each step are described. In addition, results from evaluation of the intervention via randomized control trial are described, with statistically significant differences observed in behavioral outcomes in the intervention group with effect sizes ranging from r=0.62 to 0.83. These results suggest that intervention mapping, via the six systematic steps, can be useful as a framework for continued development of preventive interventions.

76 FR 26736 - Eunice Kennedy Shriver National Institute of Child Health & Human Development; Notice of Closed...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-09

... National Institute of Child Health & Human Development; Notice of Closed Meeting Pursuant to section 10(d... Institute of Child Health and Human Development Special Emphasis Panel, Systematic Review of Neonatal Medicine. Date: May 23, 2011. Time: 1 p.m. to 3 p.m. Agenda: To review and evaluate grant applications...

Systematically evaluating interfaces for RNA-seq analysis from a life scientist perspective.

PubMed

Poplawski, Alicia; Marini, Federico; Hess, Moritz; Zeller, Tanja; Mazur, Johanna; Binder, Harald

2016-03-01

RNA-sequencing (RNA-seq) has become an established way for measuring gene expression in model organisms and humans. While methods development for refining the corresponding data processing and analysis pipeline is ongoing, protocols for typical steps have been proposed and are widely used. Several user interfaces have been developed for making such analysis steps accessible to life scientists without extensive knowledge of command line tools. We performed a systematic search and evaluation of such interfaces to investigate to what extent these can indeed facilitate RNA-seq data analysis. We found a total of 29 open source interfaces, and six of the more widely used interfaces were evaluated in detail. Central criteria for evaluation were ease of configuration, documentation, usability, computational demand and reporting. No interface scored best in all of these criteria, indicating that the final choice will depend on the specific perspective of users and the corresponding weighting of criteria. Considerable technical hurdles had to be overcome in our evaluation. For many users, this will diminish potential benefits compared with command line tools, leaving room for future improvement of interfaces. © The Author 2015. Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

A systematic review of systematic reviews on interventions for caregivers of people with chronic conditions.

PubMed

Corry, Margarita; While, Alison; Neenan, Kathleen; Smith, Valerie

2015-04-01

To evaluate the effectiveness of interventions to support caregivers of people with selected chronic conditions. Informal caregivers provide millions of care hours each week contributing to significant healthcare savings. Despite much research evaluating a range of interventions for caregivers, their impact remains unclear. A systematic review of systematic reviews of interventions to support caregivers of people with selected chronic conditions. The electronic databases of PubMed, CINAHL, British Nursing Index, PsycINFO, Social Science Index (January 1990-May 2014) and The Cochrane Library (Issue 6, June 2014), were searched using Medical Subject Heading and index term combinations of the keywords caregiver, systematic review, intervention and named chronic conditions. Papers were included if they reported a systematic review of interventions for caregivers of people with chronic conditions. The methodological quality of the included reviews was independently assessed by two reviewers using R-AMSTAR. Data were independently extracted by two reviewers using a pre-designed data extraction form. Narrative synthesis of review findings was used to present the results. Eight systematic reviews were included. There was evidence that education and support programme interventions improved caregiver quality of life. Information-giving interventions improved caregiver knowledge for stroke caregivers. Education, support and information-giving interventions warrant further investigation across caregiver groups. A large-scale funded programme for caregiver research is required to ensure that studies are of high quality to inform service development across settings. © 2014 John Wiley & Sons Ltd.

An approach to addressing subpopulation considerations in systematic reviews: the experience of reviewers supporting the U.S. Preventive Services Task Force.

PubMed

Whitlock, Evelyn P; Eder, Michelle; Thompson, Jamie H; Jonas, Daniel E; Evans, Corinne V; Guirguis-Blake, Janelle M; Lin, Jennifer S

2017-03-02

Guideline developers and other users of systematic reviews need information about whether a medical or preventive intervention is likely to benefit or harm some patients more (or less) than the average in order to make clinical practice recommendations tailored to these populations. However, guidance is lacking on how to include patient subpopulation considerations into the systematic reviews upon which guidelines are often based. In this article, we describe methods developed to consistently consider the evidence for relevant subpopulations in systematic reviews conducted to support primary care clinical preventive service recommendations made by the U.S. Preventive Services Task Force (USPSTF). Our approach is grounded in our experience conducting systematic reviews for the USPSTF and informed by a review of existing guidance on subgroup analysis and subpopulation issues. We developed and refined our approach based on feedback from the Subpopulation Workgroup of the USPSTF and pilot testing on reviews being conducted for the USPSTF. This paper provides processes and tools for incorporating evidence-based identification of important sources of potential heterogeneity of intervention effects into all phases of systematic reviews. Key components of our proposed approach include targeted literature searches and key informant interviews to identify the most important subpopulations a priori during topic scoping, a framework for assessing the credibility of subgroup analyses reported in studies, and structured investigation of sources of heterogeneity of intervention effects. Further testing and evaluation are necessary to refine this proposed approach and demonstrate its utility to the producers and users of systematic reviews beyond the context of the USPSTF. Gaps in the evidence on important subpopulations identified by routinely applying this process in systematic reviews will also inform future research needs.

The systematic assessment of traditional evidence from the premodern Chinese medical literature: a text-mining approach.

PubMed

May, Brian H; Zhang, Anthony; Lu, Yubo; Lu, Chuanjian; Xue, Charlie C L

2014-12-01

This project aimed to develop an approach to evaluating information contained in the premodern Traditional Chinese Medicine (TCM) literature that was (1) comprehensive, systematic, and replicable and (2) able to produce quantifiable output that could be used to answer specific research questions in order to identify natural products for clinical and experimental research. The project involved two stages. In stage 1, 14 TCM collections and compendia were evaluated for suitability as sources for searching; 8 of these were compared in detail. The results were published in the Journal of Alternative and Complementary Medicine. Stage 2 developed a text-mining approach for two of these sources. The text-mining approach was developed for Zhong Hua Yi Dian; Encyclopaedia of Traditional Chinese Medicine, 4th edition) and Zhong Yi Fang Ji Da Ci Dian; Great Compendium of Chinese Medical Formulae). This approach developed procedures for search term selection; methods for screening, classifying, and scoring data; procedures for systematic searching and data extraction; data checking procedures; and approaches for analyzing results. Examples are provided for studies of memory impairment and diabetic nephropathy, and issues relating to data interpretation are discussed. This approach to the analysis of large collections of the premodern TCM literature uses widely available sources and provides a text-mining approach that is systematic, replicable, and adaptable to the requirements of the particular project. Researchers can use these methods to explore changes in the names and conceptions of a disease over time, to identify which therapeutic methods have been more or less frequently used in different eras for particular disorders, and to assist in the selection of natural products for research efforts.

[Development process of Evidence-based "Return-to-work Guidance in Occupational Health 2017"].

PubMed

Kojimahara, Noriko; Fukumoto, Masakatsu; Yoshikawa, Etsuko; Shinada, Kayoko; Tsuiki, Hirokazu

2018-06-05

Objective"Return-to-work Guidance in Occupational Health 2017 (RTW Guidance 2017) " is the first occupational health guide in Japan that evaluates the quality of evidence and offers recommendations based on results of the systematic review of randomized controlled trials. Details of the systematic review of each review question (RQs) will be described separately. This article presents an overview of the method and process of developing the "RTW Guidance 2017."Materials and MethodsThe guidance was developed following the previously-published "Method for developing evidence based occupational health guidance," which included the composition of a highly-transparent guidance developing group as well as the recruitment and selection of RQs. Using the Cochrane Library, PubMed, and Ichushi-Web, a literature search for the six RQs was conducted in January 2016 by partly modifying the search terms of the existing systematic review. Articles were selected according to the inclusion criteria, and the quality of evidence was evaluated using the GRADE approach. Meta-analysis was conducted for RQ2 and RQ4, and a qualitative systematic review was conducted for RQ5, RQ6, and cost-effectiveness. Recommendations were subsequently made after a thorough consideration for feasibility in Japan by examining the costs and available resources.ResultsBased on a comprehensive literature search, eleven RQ2, four RQ4, one RQ5, and three RQ6 were selected. Support program for returning to work, such as "Re-work" for those who are temporarily not working due to musculoskeletal disorders or mental health disorder, was recommended based on moderate evidence (RQ2). For RQ4, the collaboration between occupational health practice and clinical practice was weakly recommended based on low evidence. For RQ5 that evaluated the usefulness of social support, intervention by the manager/co-worker was proposed as a "best practice statement" without indicating it as a recommendation. Work accommodation was weakly recommended based on low evidence in RQ6.Discussion and ConclusionFrom the result of systematic reviews, it was recommended for workers on sick leave more than four weeks regardless of sick leave and sickness absence that interventions during leave would improve work-related outcomes, such as earlier reinstatement. Although there is limited evidence regarding occupational health in Japan, it is important for many occupational health professionals to learn the method of developing guidance and to identify issues for future studies with priority in Japan.

Systematic Review of Chloroprene

EPA Science Inventory

This document was developed in support of EPA's response to Request for Correction (RFC) #17002: Integrated Risk Information System; Toxicological Review of Chloroprene. The document describes the IRIS Program's evaluation of the literature published after the 2010 finalization o...

Study sensitivity: Evaluating the ability to detect effects in systematic reviews of chemical exposures.

PubMed

Cooper, Glinda S; Lunn, Ruth M; Ågerstrand, Marlene; Glenn, Barbara S; Kraft, Andrew D; Luke, April M; Ratcliffe, Jennifer M

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as "sensitivity", is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and sensitivity can be used to identify the most informative studies, to evaluate the confidence of the findings from individual studies and to identify those study elements that may help to explain heterogeneity across the body of literature. Copyright © 2016. Published by Elsevier Ltd.

Current trends in systematic program evaluation of online graduate nursing education: an integrative literature review.

PubMed

Horne, Eva M; Sandmann, Lorilee R

2012-10-01

Over the past decade, the Internet's e3 ect has transformed nursing education, particularly at the graduate level. Schools of nursing have embraced Internet-based course delivery technology to broaden students' access to academic degrees. However, the rush to stay competitive in online education raises questions. What is the quality of these online programs? To what extent are schools of nursing systematically evaluating the programs beyond the course level? What evaluation tools are used? What are the findings? How are the evaluation data used? By answering these questions, nurse educators can develop strategies for evaluating the quality and worth of online learning, thus improving instruction and learning outcomes. This integrative review of nursing and adult education literature identified as the current trends in program evaluation of online nursing education at the graduate level. Research articles were analyzed and perspectives were synthesized from a research agenda viewpoint. Recommendations and needs for future research are discussed. Copyright 2012, SLACK Incorporated.

Geodetic imaging of tectonic deformation with InSAR

NASA Astrophysics Data System (ADS)

Fattahi, Heresh

Precise measurements of ground deformation across the plate boundaries are crucial observations to evaluate the location of strain localization and to understand the pattern of strain accumulation at depth. Such information can be used to evaluate the possible location and magnitude of future earthquakes. Interferometric Synthetic Aperture Radar (InSAR) potentially can deliver small-scale (few mm/yr) ground displacement over long distances (hundreds of kilometers) across the plate boundaries and over continents. However, Given the ground displacement as our signal of interest, the InSAR observations of ground deformation are usually affected by several sources of systematic and random noises. In this dissertation I identify several sources of systematic and random noise, develop new methods to model and mitigate the systematic noise and to evaluate the uncertainty of the ground displacement measured with InSAR. I use the developed approach to characterize the tectonic deformation and evaluate the rate of strain accumulation along the Chaman fault system, the western boundary of the India with Eurasia tectonic plates. I evaluate the bias due to the topographic residuals in the InSAR range-change time-series and develope a new method to estimate the topographic residuals and mitigate the effect from the InSAR range-change time-series (Chapter 2). I develop a new method to evaluate the uncertainty of the InSAR velocity field due to the uncertainty of the satellite orbits (Chapter 3) and a new algorithm to automatically detect and correct the phase unwrapping errors in a dense network of interferograms (Chapter 4). I develop a new approach to evaluate the impact of systematic and stochastic components of the tropospheric delay on the InSAR displacement time-series and its uncertainty (Chapter 5). Using the new InSAR time-series approach developed in the previous chapters, I study the tectonic deformation across the western boundary of the India plate with Eurasia and evaluated the rate of strain accumulation along the Chaman fault system (Chapter 5). I also evaluate the co-seismic and post-seismic displacement of a moderate M5.5 earthquake on the Ghazaband fault (Chapter 6). The developed methods to mitigate the systematic noise from InSAR time-series, significantly improve the accuracy of the InSAR displacement time-series and velocity. The approaches to evaluate the effect of the stochastic components of noise in InSAR displacement time-series enable us to obtain the variance-covariance matrix of the InSAR displacement time-series and to express their uncertainties. The effect of the topographic residuals in the InSAR range-change time-series is proportional to the perpendicular baseline history of the set of SAR acquisitions. The proposed method for topographic residual correction, efficiently corrects the displacement time-series. Evaluation of the uncertainty of velocity due to the orbital errors shows that for modern SAR satellites with precise orbits such as TerraSAR-X and Sentinel-1, the uncertainty of 0.2 mm/yr per 100 km and for older satellites with less accurate orbits such as ERS and Envisat, the uncertainty of 1.5 and 0.5mm/yr per 100 km, respectively are achievable. However, the uncertainty due to the orbital errors depends on the orbital uncertainties, the number and time span of SAR acquisitions. Contribution of the tropospheric delay to the InSAR range-change time-series can be subdivided to systematic (seasonal delay) and stochastic components. The systematic component biases the displacement times-series and velocity field as a function of the acquisition time and the non-seasonal component significantly contributes to the InSAR uncertainty. Both components are spatially correlated and therefore the covariance of noise between pixels should be considered for evaluating the uncertainty due to the random tropospheric delay. The relative velocity uncertainty due to the random tropospheric delay depends on the scatter of the random tropospheric delay, and is inversely proportional to the number of acquisitions, and the total time span covered by the SAR acquisitions. InSAR observations across the Chaman fault system shows that relative motion between India and Eurasia in the western boundary is distributed among different faults. The InSAR velocity field indicates strain localization on the Chaman fault and Ghazaband fault with slip rates of ~8 and ~16 mm/yr, respectively. High rate of strain accumulation on the Ghazaband fault and lack of evidence for rupturing the fault during the 1935 Quetta earthquake indicates that enough strain has been accumulated for large (M>7) earthquake, which threatens Balochistan and the City of Quetta. Chaman fault from latitudes ~29.5 N to ~32.5 N is creeping with a maximum surface creep rate of 8 mm/yr, which indicates that Chaman fault is only partially locked and therefore moderate earthquakes (M<7) similar to what has been recorded in last 100 years are expected.

Evaluation of Role of Myofibroblasts in Oral Cancer: A Systematic Review.

PubMed

Sekhon, Harjeet K; Sircar, Keya; Kaur, Gurbani; Marwah, Muneet

2016-01-01

To conduct a systematic review on the role of myofibroblasts in progression of oral cancer. The myofibroblast is essential for the integrity of the mammalian body by virtue of its role in wound healing, but it also plays a negative role due to their role in promoting tumor development. Systematic review. Bibliographic searches were conducted in several electronic databases using all publications in PubMed, PubMed central, EMBASE, CancerLit, Google scholar, and Cochrane CCTR between 1990 and June 2015. The search of all publications from various electronic databases revealed 1,371 citations. The total number of studies considered for systematic review was 43. The total number of patients included in the studies was 990. Myofibroblasts are a significant component in stroma of oral cancer cases, though not identified in all cases. This systematic review shows that clinical, pathological, and immunohistochemistry tests have correlated the presence of high myofibroblast count in oral cancer cell stroma. Myofibroblasts play a significant role in oral cancer invasion and progression. Various studies have demonstrated their association with oral cancer. This review tends to highlight their role in the pathogenesis of oral cancer over the decade. Sekhon HK, Sircar K, Kaur G, Marwah M. Evaluation of Role of Myofibroblasts in Oral Cancer: A Systematic Review. Int J Clin Pediatr Dent 2016;9(3):233-239.

Cervical spondylotic myelopathy: methodological approaches to evaluate the literature and establish best evidence.

PubMed

Skelly, Andrea C; Hashimoto, Robin E; Norvell, Daniel C; Dettori, Joseph R; Fischer, Dena J; Wilson, Jefferson R; Tetreault, Lindsay A; Fehlings, Michael G

2013-10-15

Review of methods. To provide a detailed description of the methods undertaken in the articles in this focus issue pertaining to cervical spondylotic myelopathy (CSM) and ossification of the posterior longitudinal ligament (OPLL) and to describe the process used to develop summary statements and clinical recommendations regarding factors associated with the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. We present methods used in conducting the systematic, evidence-based reviews and development of expert panel summary statements and clinical recommendations of the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. Our intent is that clinicians will combine the information from these systematic reviews, narrative reviews, and primary research studies with an understanding of their own capacities and experience to better manage patients with CSM or OPLL and consider future research for the diagnosis and treatment of these diseases. For the systematic reviews, which make up the bulk of the studies in this focus issue, a systematic search and critical review of the English language literature was undertaken for articles published on the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. Articles were screened for relevance using a priori criteria and relevant articles were critically reviewed. Whether an article was included for review depended on whether the study question was descriptive, one of therapy, or one of prognosis. The strength of evidence for the overall body of literature in each topic area was determined by 2 independent reviewers considering risk of bias, consistency, directness, and precision of results using a modification of the Grading of Recommendation Assessment, Development and Evaluation criteria. Disagreements were resolved by consensus. Findings from articles meeting inclusion criteria were summarized. From these summaries, summary statements or clinical recommendations were formulated among subject experts through a modified Delphi process using the Grading of Recommendation Assessment, Development and Evaluation approach. Methods for the 2 primary research studies and the narrative reviews are also reviewed. Because of the nature of questions that needed to be addressed, not all studies in this focus issue were amenable to systematic review. As a result, this focus issue consists of several different article types, including 1 research protocol, 2 primary research studies, 2 narrative literature reviews, 7 systematic reviews, and 3 articles that combine a systematic review component with either a narrative section (n = 2) or a provider survey (n = 1). In general, the strength of evidence ratings ranged from insufficient to moderate. Summary statements or clinical recommendations were made according to available evidence and study type: 16 summary statements were made across 8 articles, and 17 clinical recommendations were made across 9 articles. Three articles had both summary statements and clinical recommendations, 5 had summary statements only, 6 had clinical recommendations only, and 1 (the research protocol) was not amenable to either. Systematic reviews, narrative reviews, and primary research studies were undertaken to understand the mechanisms, diagnosis, progression, and treatment of CSM and OPLL and to provide summary statements and clinical recommendations. This article reports the methods used in the studies in this focus issue. SUMMARY STATEMENTS: The objectives of this focus issue were met using a variety of article and study designs, each of which has some unique methodological aspects associated with it. The reader should refer to the full article in this issue for additional details specific to that topic. The methods for systematic review follow accepted standards for rigor and, together with the application of Grading of Recommendation Assessment, Development and Evaluation, are intended to allow for transparency in the process for creating the clinical recommendation.

A systematic review of economic evaluations of CHW interventions aimed at improving child health outcomes.

PubMed

Nkonki, L; Tugendhaft, A; Hofman, K

2017-02-28

Evidence of the cost-effectiveness of community health worker interventions is pertinent for decision-makers and programme planners who are turning to community services in order to strengthen health systems in the context of the momentum generated by strategies to support universal health care, the post-2015 Sustainable Development Goal agenda.We conducted a systematic review of published economic evaluation studies of community health worker interventions aimed at improving child health outcomes. Four public health and economic evaluation databases were searched for studies that met the inclusion criteria: National Health Service Economic Evaluation Database (NHS EED), Cochrane, Paediatric Economic Evaluation Database (PEED), and PubMed. The search strategy was tailored to each database.The 19 studies that met the inclusion criteria were conducted in either high income countries (HIC), low- income countries (LIC) and/or middle-income countries (MIC). The economic evaluations covered a wide range of interventions. Studies were grouped together by intended outcome or objective of each study. The data varied in quality. We found evidence of cost-effectiveness of community health worker (CHW) interventions in reducing malaria and asthma, decreasing mortality of neonates and children, improving maternal health, increasing exclusive breastfeeding and improving malnutrition, and positively impacting physical health and psychomotor development amongst children.Studies measured varied outcomes, due to the heterogeneous nature of studies included; a meta-analysis was not conducted. Outcomes included disease- or condition -specific outcomes, morbidity, mortality, and generic measures (e.g. disability-adjusted life years (DALYs)). Nonetheless, all 19 interventions were found to be either cost-effective or highly cost-effective at a threshold specific to their respective countries.There is a growing body of economic evaluation literature on cost-effectiveness of CHW interventions. However, this is largely for small scale and vertical programmes. There is a need for economic evaluations of larger and integrated CHW programmes in order to achieve the post-2015 Sustainable Development Goal agenda so that appropriate resources can be allocated to this subset of human resources for health. This is the first systematic review to assess the cost-effectiveness of community health workers in delivering child health interventions.

Metrics, The Measure of Your Future: Evaluation Report, 1977.

ERIC Educational Resources Information Center

North Carolina State Dept. of Public Instruction, Raleigh. Div. of Development.

The primary goal of the Metric Education Project was the systematic development of a replicable educational model to facilitate the system-wide conversion to the metric system during the next five to ten years. This document is an evaluation of that project. Three sets of statistical evidence exist to support the fact that the project has been…

Toward Diversity-Responsive Medical Education: Taking an Intersectionality-Based Approach to a Curriculum Evaluation

ERIC Educational Resources Information Center

Muntinga, M. E.; Krajenbrink, V. Q.; Peerdeman, S. M.; Croiset, G.; Verdonk, P.

2016-01-01

Recent years have seen a rise in the efforts to implement diversity topics into medical education, using either a "narrow" or a "broad" definition of culture. These developments urge that outcomes of such efforts are systematically evaluated by mapping the curriculum for diversity-responsive content. This study was aimed at…

Weaknesses of South African Education in the Mirror Image of International Educational Development

ERIC Educational Resources Information Center

Wolhuter, C. C.

2014-01-01

The aim of this article is to present a systematic, holistic evaluation of the South African education system, using international benchmarks as the yardstick. A theoretical model for the evaluation of a national education project is constructed. This consists of three dimensions, namely: a quantitative dimension, a qualitative dimension, and an…

Realist Evaluation in Wraparound: A New Approach in Social Work Evidence-Based Practice

ERIC Educational Resources Information Center

Kazi, Mansoor A. F.; Pagkos, Brian; Milch, Heidi A.

2011-01-01

Objectives: The purpose of this study was to develop a realist evaluation paradigm in social work evidence-based practice. Method: Wraparound (at Gateway-Longview Inc., New York) used a reliable outcome measure and an electronic database to systematically collect and analyze data on the interventions, the client demographics and circumstances, and…

Outcome following phrenic nerve transfer to musculocutaneous nerve in patients with traumatic brachial palsy: a qualitative systematic review.

PubMed

de Mendonça Cardoso, Marcio; Gepp, Ricardo; Correa, José Fernando Guedes

2016-09-01

The phrenic nerve can be transferred to the musculocutaneous nerve in patients with traumatic brachial plexus palsy in order to recover biceps strength, but the results are controversial. There is also a concern about pulmonary function after phrenic nerve transection. In this paper, we performed a qualitative systematic review, evaluating outcomes after this procedure. A systematic review of published studies was undertaken in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement. Data were extracted from the selected papers and related to: publication, study design, outcome (biceps strength in accordance with BMRC and pulmonary function) and population. Study quality was assessed using the "strengthening the reporting of observational studies in epidemiology" (STROBE) standard or the CONSORT checklist, depending on the study design. Seven studies were selected for this systematic review after applying inclusion and exclusion criteria. One hundred twenty-four patients completed follow-up, and most of them were graded M3 or M4 (70.1 %) for biceps strength at the final evaluation. Pulmonary function was analyzed in five studies. It was not possible to perform a statistical comparison between studies because the authors used different parameters for evaluation. Most of the patients exhibited a decrease in pulmonary function tests immediately after surgery, with recovery in the following months. Study quality was determined using STROBE in six articles, and the global score varied from 8 to 21. Phrenic nerve transfer to the musculocutaneous nerve can recover biceps strength ≥M3 (BMRC) in most patients with traumatic brachial plexus injury. Early postoperative findings revealed that the development of pulmonary symptoms is rare, but it cannot be concluded that the procedure is safe because there is no study evaluating pulmonary function in old age.

Measuring treatment outcomes in gambling disorders: a systematic review.

PubMed

Pickering, Dylan; Keen, Brittany; Entwistle, Gavin; Blaszczynski, Alex

2018-03-01

Considerable variation of outcome variables used to measure recovery in the gambling treatment literature has precluded effective cross-study evaluations and hindered the development of best-practice treatment methodologies. The aim of this systematic review was to describe current diffuse concepts of recovery in the gambling field by mapping the range of outcomes and measurement strategies used to evaluate treatments, and to identify more commonly accepted indices of recovery. A systematic search of six academic databases for studies evaluating treatments (psychological and pharmacological) for gambling disorders with a minimum 6-month follow-up. Data from eligible studies were tabulated and analysis conducted using a narrative approach. Guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) were adhered to. Thirty-four studies were reviewed systematically (RCTs = 17, comparative designs = 17). Sixty-three different outcome measures were identified: 25 (39.7%) assessed gambling-specific constructs, 36 (57.1%) assessed non-gambling specific constructs, and two instruments were used across both categories (3.2%). Self-report instruments ranged from psychometrically validated to ad-hoc author-designed questionnaires. Units of measurement were inconsistent, particularly in the assessment of gambling behaviour. All studies assessed indices of gambling behaviour and/or symptoms of gambling disorder. Almost all studies (n = 30; 88.2%) included secondary measures relating to psychiatric comorbidities, psychological processes linked to treatment approach, or global functioning and wellbeing. In research on gambling disorders, the incorporation of broader outcome domains that extend beyond disorder-specific symptoms and behaviours suggests a multi-dimensional conceptualization of recovery. Development of a single comprehensive scale to measure all aspects of gambling recovery could help to facilitate uniform reporting practices across the field. © 2017 The Authors. Addiction published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.

Economics methods in Cochrane systematic reviews of health promotion and public health related interventions.

PubMed

Shemilt, Ian; Mugford, Miranda; Drummond, Michael; Eisenstein, Eric; Mallender, Jacqueline; McDaid, David; Vale, Luke; Walker, Damian

2006-11-15

Provision of evidence on costs alongside evidence on the effects of interventions can enhance the relevance of systematic reviews to decision-making. However, patterns of use of economics methods alongside systematic review remain unclear. Reviews of evidence on the effects of interventions are published by both the Cochrane and Campbell Collaborations. Although it is not a requirement that Cochrane or Campbell Reviews should consider economic aspects of interventions, many do. This study aims to explore and describe approaches to incorporating economics methods in a selection of Cochrane systematic reviews in the area of health promotion and public health, to help inform development of methodological guidance on economics for reviewers. The Cochrane Database of Systematic Reviews was searched using a search strategy for potential economic evaluation studies. We included current Cochrane reviews and review protocols retrieved using the search that are also identified as relevant to health promotion or public health topics. A reviewer extracted data which describe the economics components of included reviews. Extracted data were summarised in tables and analysed qualitatively. Twenty-one completed Cochrane reviews and seven review protocols met inclusion criteria. None incorporate formal economic evaluation methods. Ten completed reviews explicitly aim to incorporate economics studies and data. There is a lack of transparent reporting of methods underpinning the incorporation of economics studies and data. Some reviews are likely to exclude useful economics studies and data due to a failure to incorporate search strategies tailored to the retrieval of such data or use of key specialist databases, and application of inclusion criteria designed for effectiveness studies. There is a need for consistency and transparency in the reporting and conduct of the economics components of Cochrane reviews, as well as regular dialogue between Cochrane reviewers and economists to develop increased capacity for economic analyses alongside such reviews. Use of applicable economics methods in Cochrane reviews can help provide the international context within which economics data can be interpreted and assessed as a preliminary to full economic evaluation.

What is the clinical effectiveness and cost-effectiveness of conservative interventions for tendinopathy? An overview of systematic reviews of clinical effectiveness and systematic review of economic evaluations.

PubMed

Long, Linda; Briscoe, Simon; Cooper, Chris; Hyde, Chris; Crathorne, Louise

2015-01-01

Lateral elbow tendinopathy (LET) is a common complaint causing characteristic pain in the lateral elbow and upper forearm, and tenderness of the forearm extensor muscles. It is thought to be an overuse injury and can have a major impact on the patient's social and professional life. The condition is challenging to treat and prone to recurrent episodes. The average duration of a typical episode ranges from 6 to 24 months, with most (89%) reporting recovery by 1 year. This systematic review aims to summarise the evidence concerning the clinical effectiveness and cost-effectiveness of conservative interventions for LET. A comprehensive search was conducted from database inception to 2012 in a range of databases including MEDLINE, EMBASE and Cochrane Databases. We conducted an overview of systematic reviews to summarise the current evidence concerning the clinical effectiveness and a systematic review for the cost-effectiveness of conservative interventions for LET. We identified additional randomised controlled trials (RCTs) that could contribute further evidence to existing systematic reviews. We searched MEDLINE, EMBASE, Allied and Complementary Medicine Database, Cumulative Index to Nursing and Allied Health Literature, Web of Science, The Cochrane Library and other important databases from inception to January 2013. A total of 29 systematic reviews published since 2003 matched our inclusion criteria. These were quality appraised using the Assessment of Multiple Systematic Reviews (AMSTAR) checklist; five were considered high quality and evaluated using a Grading of Recommendations, Assessment, Development and Evaluation approach. A total of 36 RCTs were identified that were not included in a systematic review and 29 RCTs were identified that had only been evaluated in an included systematic review of intermediate/low quality. These were then mapped to existing systematic reviews where further evidence could provide updates. Two economic evaluations were identified. The summary of findings from the review was based only on high-quality evidence (scoring of > 5 AMSTAR). Other limitations were that identified RCTs were not quality appraised and dichotomous outcomes were also not considered. Economic evaluations took effectiveness estimates from trials that had small sample sizes leading to uncertainty surrounding the effect sizes reported. This, in turn, led to uncertainty of the reported cost-effectiveness and, as such, no robust recommendations could be made in this respect. Clinical effectiveness evidence from the high-quality systematic reviews identified in this overview continues to suggest uncertainty as to the effectiveness of many conservative interventions for the treatment of LET. Although new RCT evidence has been identified with either placebo or active controls, there is uncertainty as to the size of effects reported within them because of the small sample size. Conclusions regarding cost-effectiveness are also unclear. We consider that, although updated or new systematic reviews may also be of value, the primary focus of future work should be on conducting large-scale, good-quality clinical trials using a core set of outcome measures (for defined time points) and appropriate follow-up. Subgroup analysis of existing RCT data may be beneficial to ascertain whether or not certain patient groups are more likely to respond to treatments. This study is registered as PROSPERO CRD42013003593. The National Institute for Health Research Health Technology Assessment programme.

[Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise].

PubMed

Morgano, Gian Paolo; Davoli, Marina; Moja, Lorenzo; Amato, Laura; Ferroni, Eliana; Tirani, Marcello

2015-06-01

Guideline developers worldwide are struggling with the lack of guidance for the practical steps in the guideline enterprise. Our objective was to systematically compile a comprehensive checklist of items linked to relevant resources and tools that guideline developers would consider for development and support of implementation. Data sources included manuals of international guideline developers, literature on guidelines for guidelines with a focus on international and national guideline agencies, professional societies, and recent systematic guidance articles. We reviewed these sources in duplicate, extracted items using a sensitive approach and developed overarching topics that are relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions. We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers (http://cebgrade.mcmaster.ca/guidecheck.html). The topics and items included cover all stages of the guideline enterprise, from planning to formulating recommendations, to dissemination and evaluation. The final itemized guideline development checklist (GDC) includes links to training material and resources for methodology. The GDC will serve as a resource for those involved in guideline development and we will use crowdsourcing to keep the checklist up to date and enhance it.

Developing a Systematic Corrosion Control Evaluation Approach in Flint

EPA Science Inventory

Presentation covers what the projects were that were recommended by the Flint Safe Drinking Water Task Force for corrosion control assessment for Flint, focusing on the sequential sampling project, the pipe rigs, and pipe scale analyses.

48 CFR 1352.235-71 - Protection of human subjects-exemption.

Code of Federal Regulations, 2014 CFR

2014-10-01

... a systematic investigation, including research development, testing and evaluation, designed to...; (2) Documentation of approval for the human subjects research protocol, questionnaires, surveys... contractor modifies a human subjects research protocol, questionnaire, survey, advertisement, or informed...

48 CFR 1352.235-71 - Protection of human subjects-exemption.

Code of Federal Regulations, 2010 CFR

2010-10-01

... a systematic investigation, including research development, testing and evaluation, designed to...; (2) Documentation of approval for the human subjects research protocol, questionnaires, surveys... contractor modifies a human subjects research protocol, questionnaire, survey, advertisement, or informed...

48 CFR 1352.235-71 - Protection of human subjects-exemption.

Code of Federal Regulations, 2013 CFR

2013-10-01

... a systematic investigation, including research development, testing and evaluation, designed to...; (2) Documentation of approval for the human subjects research protocol, questionnaires, surveys... contractor modifies a human subjects research protocol, questionnaire, survey, advertisement, or informed...

48 CFR 1352.235-71 - Protection of human subjects-exemption.

Code of Federal Regulations, 2011 CFR

2011-10-01

... a systematic investigation, including research development, testing and evaluation, designed to...; (2) Documentation of approval for the human subjects research protocol, questionnaires, surveys... contractor modifies a human subjects research protocol, questionnaire, survey, advertisement, or informed...

48 CFR 1352.235-71 - Protection of human subjects-exemption.

Code of Federal Regulations, 2012 CFR

2012-10-01

... a systematic investigation, including research development, testing and evaluation, designed to...; (2) Documentation of approval for the human subjects research protocol, questionnaires, surveys... contractor modifies a human subjects research protocol, questionnaire, survey, advertisement, or informed...

[Master trainer concept "structured specialist further education" : A joint project of the German Professional Associations of Internal Medicine, Surgeons and Orthopedic/Trauma Surgeons].

PubMed

Siebolds, M; Ansorg, J; Dittmar, R; Hennes, N; Radau, T; Ruff, S; Denkinger, M D

2017-10-01

The quality requirements in the practice of postgradual medical further education below the normal level of the further education regulations is a barely developed scientific field in Germany. A systematic use of internationally accepted scientific evidence barely exists. This research and development project was initiated in 2001 in order to be able to implement a practical but evidence-based model compatible with the existing structure of postgradual medical education. This project has been supported since 2013 by the Professional Associations of Internal Medicine (BDI), Surgeons (BDC) and Orthopedic and Trauma surgeons (BVOU). The development phase of this complex intervention was based on three stages involving stakeholder interviews from relevant groups, the identification of a theoretical model for the construction and systematic literature reviews to identify the relevant evidence. The basic model for structured specialist further education developed included the creation and implementation of a simple core curriculum for every department, a tool for systematic feedback within the framework of the annual further education interviews and a simple clinical assessment to evaluate the actual clinical performance of physicians in further education. A pilot test of this model was carried out in 150 specialist departments in Germany and continually developed. The project shows that such a program can be systematically developed and pilot studies can be carried out. The central problems in implementation involve the traditional informal further education culture, which as a rule does not implement a systematic elicitation of the state of learning continuously distributed over the whole period of further education and the practical testing of competence development.

Family relationships as an explanatory variable in childhood dental caries: a systematic review of measures.

PubMed

Duijster, D; O'Malley, L; Elison, S; Van Loveren, C; Marcenes, W; Adair, P M; Pine, C M

2013-01-01

It is widely acknowledged that parental beliefs (self-efficacy) about oral health and parental oral health-related behaviours play a fundamental role in the establishment of preventative behaviours that will mitigate against the development of childhood dental caries. However, little attention has been given to the wider perspective of family functioning and family relationships on child oral health. For oral health researchers, exploration of this association requires the use of reliable, valid and appropriate assessment tools to measure family relationships. In order to promote methodologically sound research in oral health, this systematic review aims to provide a guide on self-report psychometric measures of family functioning that may be suitable to utilize when exploring childhood dental caries. This systematic review has identified 29 self-report measures of family functioning and evaluated them in terms of their psychometric support, constructs measured and potential utility for oral health research. The majority of the measures reported adequate levels of reliability and construct validity. Construct evaluation of the measures identified five core domains of family functioning, namely 'communication', 'cohesion/engagement', 'control', 'involvement' and 'authoritative/rigid parenting style'. The constructs were subsequently evaluated with respect to their potential relevance to child oral health. Herewith this review provides a framework to guide future research to explore family functioning in furthering our understanding of the development of childhood dental caries. © 2013 S. Karger AG, Basel.

Net present biodiversity value and the design of biodiversity offsets.

PubMed

Overton, Jacob McC; Stephens, R T Theo; Ferrier, Simon

2013-02-01

There is an urgent need to develop sound theory and practice for biodiversity offsets to provide a better basis for offset multipliers, to improve accounting for time delays in offset repayments, and to develop a common framework for evaluating in-kind and out-of-kind offsets. Here, we apply concepts and measures from systematic conservation planning and financial accounting to provide a basis for determining equity across type (of biodiversity), space, and time. We introduce net present biodiversity value (NPBV) as a theoretical and practical measure for defining the offset required to achieve no-net-loss. For evaluating equity in type and space we use measures of biodiversity value from systematic conservation planning. Time discount rates are used to address risk of non-repayment, and loss of utility. We illustrate these concepts and measures with two examples of biodiversity impact-offset transactions. Considerable further work is required to understand the characteristics of these approaches.

Development and application of a new grey dynamic hierarchy analysis system (GDHAS) for evaluating urban ecological security.

PubMed

Shao, Chaofeng; Tian, Xiaogang; Guan, Yang; Ju, Meiting; Xie, Qiang

2013-05-21

Selecting indicators based on the characteristics and development trends of a given study area is essential for building a framework for assessing urban ecological security. However, few studies have focused on how to select the representative indicators systematically, and quantitative research is lacking. We developed an innovative quantitative modeling approach called the grey dynamic hierarchy analytic system (GDHAS) for both the procedures of indicator selection and quantitative assessment of urban ecological security. Next, a systematic methodology based on the GDHAS is developed to assess urban ecological security comprehensively and dynamically. This assessment includes indicator selection, driving force-pressure-state-impact-response (DPSIR) framework building, and quantitative evaluation. We applied this systematic methodology to assess the urban ecological security of Tianjin, which is a typical coastal super megalopolis and the industry base in China. This case study highlights the key features of our approach. First, 39 representative indicators are selected for the evaluation index system from 62 alternative ones available through the GDHAS. Second, the DPSIR framework is established based on the indicators selected, and the quantitative assessment of the eco-security of Tianjin is conducted. The results illustrate the following: urban ecological security of Tianjin in 2008 was in alert level but not very stable; the driving force and pressure subsystems were in good condition, but the eco-security levels of the remainder of the subsystems were relatively low; the pressure subsystem was the key to urban ecological security; and 10 indicators are defined as the key indicators for five subsystems. These results can be used as the basis for urban eco-environmental management.

Development and Application of a New Grey Dynamic Hierarchy Analysis System (GDHAS) for Evaluating Urban Ecological Security

PubMed Central

Shao, Chaofeng; Tian, Xiaogang; Guan, Yang; Ju, Meiting; Xie, Qiang

2013-01-01

Selecting indicators based on the characteristics and development trends of a given study area is essential for building a framework for assessing urban ecological security. However, few studies have focused on how to select the representative indicators systematically, and quantitative research is lacking. We developed an innovative quantitative modeling approach called the grey dynamic hierarchy analytic system (GDHAS) for both the procedures of indicator selection and quantitative assessment of urban ecological security. Next, a systematic methodology based on the GDHAS is developed to assess urban ecological security comprehensively and dynamically. This assessment includes indicator selection, driving force-pressure-state-impact-response (DPSIR) framework building, and quantitative evaluation. We applied this systematic methodology to assess the urban ecological security of Tianjin, which is a typical coastal super megalopolis and the industry base in China. This case study highlights the key features of our approach. First, 39 representative indicators are selected for the evaluation index system from 62 alternative ones available through the GDHAS. Second, the DPSIR framework is established based on the indicators selected, and the quantitative assessment of the eco-security of Tianjin is conducted. The results illustrate the following: urban ecological security of Tianjin in 2008 was in alert level but not very stable; the driving force and pressure subsystems were in good condition, but the eco-security levels of the remainder of the subsystems were relatively low; the pressure subsystem was the key to urban ecological security; and 10 indicators are defined as the key indicators for five subsystems. These results can be used as the basis for urban eco-environmental management. PMID:23698700

Novel approaches and application of contemporary sensory evaluation practices in iron fortification programs

NASA Technical Reports Server (NTRS)

Bovell-Benjamin, Adelia C.; Guinard, Jean-Xavier

2003-01-01

Iron deficiency is the leading nutritional deficiency in the U.S. and the rest of the world, with its highest prevalences in the developing world. Iron fortification of food has been proposed as a strategy to reduce the high prevalence of iron deficiency. Poor consumer acceptance, unacceptable taste, and discoloration of the iron-fortified foods have been frequently listed as causes of unsuccessful iron fortification programs. An excellent prospect for improving consumer acceptance of iron-fortified foods is the incorporation of a thorough, organized, and unified approach to sensory evaluation practices into iron fortification programs for product optimization. The information gained from systematic sensory evaluation allows for the manipulation of the sensory attributes, and thus improvement of the sensory properties of the fortified food. However, iron fortification programs have not systematically measured the effect of fortification on the sensory quality of the food. Because sensory evaluation is an important criterion in successful iron fortification, an integrated approach is necessary. Therefore, nutritionists and sensory scientists should work closely with each other to select the most suitable sensory tests and methods. The objectives of this article are to: (1) critically review and discuss some traditional and contemporary approaches and applications of sensory evaluation practices in iron fortification programs, and (2) demonstrate the importance of incorporating a multidisciplinary, systematic sensory evaluation approach in iron fortification programs.

Core Professionalism Education in Surgery: A Systematic Review

PubMed Central

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-01-01

Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable. PMID:29553464

Systematic evaluation of atmospheric chemistry-transport model CHIMERE

NASA Astrophysics Data System (ADS)

Khvorostyanov, Dmitry; Menut, Laurent; Mailler, Sylvain; Siour, Guillaume; Couvidat, Florian; Bessagnet, Bertrand; Turquety, Solene

2017-04-01

Regional-scale atmospheric chemistry-transport models (CTM) are used to develop air quality regulatory measures, to support environmentally sensitive decisions in the industry, and to address variety of scientific questions involving the atmospheric composition. Model performance evaluation with measurement data is critical to understand their limits and the degree of confidence in model results. CHIMERE CTM (http://www.lmd.polytechnique.fr/chimere/) is a French national tool for operational forecast and decision support and is widely used in the international research community in various areas of atmospheric chemistry and physics, climate, and environment (http://www.lmd.polytechnique.fr/chimere/CW-articles.php). This work presents the model evaluation framework applied systematically to the new CHIMERE CTM versions in the course of the continuous model development. The framework uses three of the four CTM evaluation types identified by the Environmental Protection Agency (EPA) and the American Meteorological Society (AMS): operational, diagnostic, and dynamic. It allows to compare the overall model performance in subsequent model versions (operational evaluation), identify specific processes and/or model inputs that could be improved (diagnostic evaluation), and test the model sensitivity to the changes in air quality, such as emission reductions and meteorological events (dynamic evaluation). The observation datasets currently used for the evaluation are: EMEP (surface concentrations), AERONET (optical depths), and WOUDC (ozone sounding profiles). The framework is implemented as an automated processing chain and allows interactive exploration of the results via a web interface.

Culturally Grounded Prevention for Minority Youth Populations: A Systematic Review of the Literature

PubMed Central

Lauricella, Michela; Valdez, Jessica K.; Okamoto, Scott K.; Helm, Susana; Zaremba, Colleen

2016-01-01

Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern U.S. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the “ground up.” This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs. PMID:26733384

Culturally Grounded Prevention for Minority Youth Populations: A Systematic Review of the Literature.

PubMed

Lauricella, Michela; Valdez, Jessica K; Okamoto, Scott K; Helm, Susana; Zaremba, Colleen

2016-02-01

Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican-American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern US. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the "ground up." This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs.

Systematic procedure for designing processes with multiple environmental objectives.

PubMed

Kim, Ki-Joo; Smith, Raymond L

2005-04-01

Evaluation of multiple objectives is very important in designing environmentally benign processes. It requires a systematic procedure for solving multiobjective decision-making problems due to the complex nature of the problems, the need for complex assessments, and the complicated analysis of multidimensional results. In this paper, a novel systematic procedure is presented for designing processes with multiple environmental objectives. This procedure has four steps: initialization, screening, evaluation, and visualization. The first two steps are used for systematic problem formulation based on mass and energy estimation and order of magnitude analysis. In the third step, an efficient parallel multiobjective steady-state genetic algorithm is applied to design environmentally benign and economically viable processes and to provide more accurate and uniform Pareto optimal solutions. In the last step a new visualization technique for illustrating multiple objectives and their design parameters on the same diagram is developed. Through these integrated steps the decision-maker can easily determine design alternatives with respect to his or her preferences. Most importantly, this technique is independent of the number of objectives and design parameters. As a case study, acetic acid recovery from aqueous waste mixtures is investigated by minimizing eight potential environmental impacts and maximizing total profit. After applying the systematic procedure, the most preferred design alternatives and their design parameters are easily identified.

AHRQ series paper 3: identifying, selecting, and refining topics for comparative effectiveness systematic reviews: AHRQ and the effective health-care program.

PubMed

Whitlock, Evelyn P; Lopez, Sarah A; Chang, Stephanie; Helfand, Mark; Eder, Michelle; Floyd, Nicole

2010-05-01

This article discusses the identification, selection, and refinement of topics for comparative effectiveness systematic reviews within the Agency for Healthcare Research and Quality's Effective Health Care (EHC) program. The EHC program seeks to align its research topic selection with the overall goals of the program, impartially and consistently apply predefined criteria to potential topics, involve stakeholders to identify high-priority topics, be transparent and accountable, and continually evaluate and improve processes. A topic prioritization group representing stakeholder and scientific perspectives evaluates topic nominations that fit within the EHC program (are "appropriate") to determine how "important" topics are as considered against seven criteria. The group then judges whether a new comparative effectiveness systematic review would be a duplication of existing research syntheses, and if not duplicative, if there is adequate type and volume of research to conduct a new systematic review. Finally, the group considers the "potential value and impact" of a comparative effectiveness systematic review. As the EHC program develops, ongoing challenges include ensuring the program addresses truly unmet needs for synthesized research because national and international efforts in this arena are uncoordinated, as well as engaging a range of stakeholders in program decisions while also achieving efficiency and timeliness.

Evaluation of a patient centered e-nursing and caring system.

PubMed

Tsai, Lai-Yin; Shan, Huang; Mei-Bei, Lin

2006-01-01

This study aims to develop an electronic nursing and caring system to manage patients' information and provide patients with safe and efficient services. By transmitting data among wireless cards, optical network, and mainframe computer, nursing care will be delivered more systematically and patients' safety centered caring will be delivered more efficiently and effectively. With this system, manual record keeping time was cut down, and relevant nursing and caring information was linked up. With the development of an electronic nursing system, nurses were able to make the best use of the Internet resources, integrate information management systematically and improve quality of nursing and caring service.

The impact of eHealth on the quality and safety of health care: a systematic overview.

PubMed

Black, Ashly D; Car, Josip; Pagliari, Claudia; Anandan, Chantelle; Cresswell, Kathrin; Bokun, Tomislav; McKinstry, Brian; Procter, Rob; Majeed, Azeem; Sheikh, Aziz

2011-01-18

There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care. We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking. There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and "techno-enthusiasts" as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption.

78 FR 47282 - Takes of Marine Mammals Incidental to Specified Activities; Navy Research, Development, Test and...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-05

... Director. Post-mission surveys will be conducted from the surface vessel(s) and aircraft used for pre-test... post-test events. Systematic monitoring of the affected area for marine mammals will be conducted prior... Marine Mammals Incidental to Specified Activities; Navy Research, Development, Test and Evaluation...

Academic Drift in Dutch Non-University Higher Education Evaluated: A Staff Perspective

ERIC Educational Resources Information Center

Griffioen, Didi M. E.; de Jong, Uulkje

2013-01-01

In the context of a European knowledge economy, the Dutch non-university institutions systematically develop research activities at a higher frequency than before. With this development, they have been accused of academic drift, of striving to receive a status comparable to traditional universities. This study considers the perceptions of both…

Advances in Research on Organization Development: Toward a Beginning

ERIC Educational Resources Information Center

Pate, Larry E.; And Others

1977-01-01

This paper examines 38 research studies that were conducted on various aspects of organization development (OD) technology. The studies are compared along eight dimensions. Problems associated with evaluating OD and the limited amount of OD research are discussed. It is argued that more systematic, longitudinal research on OD is needed. (Author)

Using Intervention Mapping for Systematic Development of Two School-Based Interventions Aimed at Increasing Children's Fruit and Vegetable Intake

ERIC Educational Resources Information Center

Reinaerts, E.; De Nooijer, J.; De Vries, N. K.

2008-01-01

Purpose: The purpose of this paper is to show how the intervention mapping (IM) protocol could be applied to the development of two school-based interventions. It provides an extensive description of the development, implementation and evaluation of two interventions which aimed to increase fruit and vegetable (F&V) consumption among primary…

Development and Validation of a Web-Based Module to Teach Metacognitive Learning Strategies to Students in Higher Education

ERIC Educational Resources Information Center

Singh, Oma B.

2009-01-01

This study used a design based-research (DBR) methodology to examine how an Instructional Systematic Design (ISD) process such as ADDIE (Analysis, Design, Development, Implementation, Evaluation) can be employed to develop a web-based module to teach metacognitive learning strategies to students in higher education. The goal of the study was…

[Provision of integrity and reliability in hygienic examination of investment projects for human capital development].

PubMed

Tarkhov, P V; Matsenko, A M; Krugliak, A P; Derkach, Zh V

2012-01-01

To reach normal competitiveness in world division of labour, investment projects should stimulate development of human capital towards advance of modern technologies and organizational development of all types of labour. At present time there are only separate calculations of certain types of people's health damage and completely disparate matters of damage compensation exceptionally for chemical contamination effects. The purpose of the paper is development of algorithms to provide hygienic welfare of human capital in investment projects. For this purpose in investments assessment and hygienic examination it is necessary to apply complete and comprehensive (systematic) evaluation of all factors that influence human capital welfare and practical hygienic and research institutions should be focused on systematic elimination of possible dangers and risks of investment projects.

Pharmacological interventions to treat phlebitis: systematic review.

PubMed

dos Reis, Paula Elaine Diniz; Silveira, Renata Cristina de Campos Pereira; Vasques, Christiane Inocêncio; de Carvalho, Emilia Campos

2009-01-01

This study presents a systematic review for evaluating effective pharmacological actions for the treatment of phlebitis stemming from infusion therapy. The studies reviewed were categorized according to the type of therapeutic approach proposed by the author and by the level of evidence presented. The review found that topical nitroglycerin and notoginseny were more effective in the reduction of the inflammatory process when compared with other proposed alternatives. Nevertheless, the development of research related to possible alternatives for the treatment of phlebitis is important.

Health information systems evaluation frameworks: A systematic review.

PubMed

Eslami Andargoli, Amirhossein; Scheepers, Helana; Rajendran, Diana; Sohal, Amrik

2017-01-01

Evaluation of health information systems (HISs) is complicated because of the complex nature of the health care domain. Various studies have proposed different frameworks to reduce the complexity in the assessment of these systems. The aim of these frameworks is to provide a set of guidelines for the evaluation of the adequacy of health care information systems. This paper aims to analyse studies on the evaluation of HISs by applying a content, context and process (CCP) framework to address the 'who', 'what', 'how', 'when', and 'why' of the evaluation processes used. This will allow for a better understanding of the relative strengths and weaknesses of various HISs evaluation frameworks, and will pave the way for developing a more complete framework for HISs. A systematic literature review on HIS evaluation studies was undertaken to identify the currently available HIS evaluation frameworks. Five academic databases were selected to conduct this systematic literature review. Most of the studies only address some, but not all, of the five main questions, i.e. the who, what, how, when, why, and that there was a lack of consensus in the way these questions were addressed. The critical role of context was also largely neglected in these studies. Evaluation of HISs is complex. The health care domain is highly context sensitive and in order to have a complete assessment of HISs, consideration of contextual factors is necessary. Specifically, to have the right set of criteria to measure the 'what', the answer to the 'who' of the evaluation is necessary. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

ESPGHAN-NASPGHAN Guidelines for the Evaluation and Treatment of Gastrointestinal and Nutritional Complications in Children With Esophageal Atresia-Tracheoesophageal Fistula.

PubMed

Krishnan, Usha; Mousa, Hayat; Dall'Oglio, Luigi; Homaira, Nusrat; Rosen, Rachel; Faure, Christophe; Gottrand, Frédéric

2016-11-01

Esophageal atresia (EA) is one of the most common congenital digestive anomalies. With improvements in surgical techniques and intensive care treatments, the focus of care of these patients has shifted from mortality to morbidity and quality-of-life issues. These children face gastrointestinal (GI) problems not only in early childhood but also through adolescence and adulthood. There is, however, currently a lack of a systematic approach to the care of these patients. The GI working group of International Network on Esophageal Atresia comprises members from ESPGHAN/NASPGHAN and was charged with the task of developing uniform evidence-based guidelines for the management of GI complications in children with EA. Thirty-six clinical questions addressing the diagnosis, treatment, and prognosis of the common GI complications in patients with EA were formulated. Questions on the diagnosis, and treatment of gastroesophageal reflux, management of "cyanotic spells," etiology, investigation and management of dysphagia, feeding difficulties, anastomotic strictures, congenital esophageal stenosis in EA patients were addressed. The importance of excluding eosinophilic esophagitis and associated GI anomalies in symptomatic patients with EA is discussed as is the quality of life of these patients and the importance of a systematic transition of care to adulthood. A systematic literature search was performed from inception to March 2014 using Embase, MEDLINE, the Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Clinical Trials, and PsychInfo databases. The approach of the Grading of Recommendations Assessment, Development and Evaluation was applied to evaluate outcomes. During 2 consensus meetings, all recommendations were discussed and finalized. The group members voted on each recommendation, using the nominal voting technique. Expert opinion was used where no randomized controlled trials were available to support the recommendation.

Frailty in trauma: A systematic review of the surgical literature for clinical assessment tools.

PubMed

McDonald, Victoria S; Thompson, Kimberly A; Lewis, Paul R; Sise, C Beth; Sise, Michael J; Shackford, Steven R

2016-05-01

Elderly trauma patients have outcomes worse than those of similarly injured younger patients. Although patient age and comorbidities explain some of the difference, the contribution of frailty to outcomes is largely unknown because of the lack of assessment tools developed specifically to assess frailty in the trauma population. This systematic review of the surgical literature identifies currently available frailty clinical assessment tools and evaluates the potential of each instrument to assess frailty in elderly patients with trauma. This review was registered with PROSPERO (the international prospective register of systematic reviews, registration number CRD42014015350). Publications in English from January 1995 to October 2014 were identified by a comprehensive search strategy in MEDLINE, EMBASE, and CINAHL, supplemented by manual screening of article bibliographies and subjected to three tiers of review. Forty-two studies reporting on frailty assessment tools were selected for analysis. Criteria for objectivity, feasibility in the trauma setting, and utility to predict trauma outcomes were formulated and used to evaluate the tools, including their subscales and individual items. Thirty-two unique frailty assessment tools were identified. Of those, 4 tools as a whole, 2 subscales, and 29 individual items qualified as objective, feasible, and useful in the clinical assessment of trauma patients. The single existing tool developed specifically to assess frailty in trauma did not meet evaluation criteria. Few frailty assessment tools in the surgical literature qualify as objective, feasible, and useful measures of frailty in the trauma population. However, a number of individual tool items and subscales could be combined to assess frailty in the trauma setting. Research to determine the accuracy of these measures and the magnitude of the contribution of frailty to trauma outcomes is needed. Systematic review, level III.

Thirty Years of Improving the NCEP Global Forecast System

NASA Astrophysics Data System (ADS)

White, G. H.; Manikin, G.; Yang, F.

2014-12-01

Current eight day forecasts by the NCEP Global Forecast System are as accurate as five day forecasts 30 years ago. This revolution in weather forecasting reflects increases in computer power, improvements in the assimilation of observations, especially satellite data, improvements in model physics, improvements in observations and international cooperation and competition. One important component has been and is the diagnosis, evaluation and reduction of systematic errors. The effect of proposed improvements in the GFS on systematic errors is one component of the thorough testing of such improvements by the Global Climate and Weather Modeling Branch. Examples of reductions in systematic errors in zonal mean temperatures and winds and other fields will be presented. One challenge in evaluating systematic errors is uncertainty in what reality is. Model initial states can be regarded as the best overall depiction of the atmosphere, but can be misleading in areas of few observations or for fields not well observed such as humidity or precipitation over the oceans. Verification of model physics is particularly difficult. The Environmental Modeling Center emphasizes the evaluation of systematic biases against observations. Recently EMC has placed greater emphasis on synoptic evaluation and on precipitation, 2-meter temperatures and dew points and 10 meter winds. A weekly EMC map discussion reviews the performance of many models over the United States and has helped diagnose and alleviate significant systematic errors in the GFS, including a near surface summertime evening cold wet bias over the eastern US and a multi-week period when the GFS persistently developed bogus tropical storms off Central America. The GFS exhibits a wet bias for light rain and a dry bias for moderate to heavy rain over the continental United States. Significant changes to the GFS are scheduled to be implemented in the fall of 2014. These include higher resolution, improved physics and improvements to the assimilation. These changes significantly improve the tropospheric flow and reduce a tropical upper tropospheric warm bias. One important error remaining is the failure of the GFS to maintain deep convection over Indonesia and in the tropical west Pacific. This and other current systematic errors will be presented.

Systematic development of a theory-informed multifaceted behavioural intervention to increase physical activity of adults with type 2 diabetes in routine primary care: Movement as Medicine for Type 2 Diabetes.

PubMed

Avery, Leah; Charman, Sarah J; Taylor, Louise; Flynn, Darren; Mosely, Kylie; Speight, Jane; Lievesley, Matthew; Taylor, Roy; Sniehotta, Falko F; Trenell, Michael I

2016-07-19

Despite substantial evidence for physical activity (PA) as a management option for type 2 diabetes, there remains a lack of PA behavioural interventions suitable for delivery in primary care. This paper describes the systematic development of an evidence-informed PA behavioural intervention for use during routine primary care consultations. In accordance with the Medical Research Council Framework for the Development and Evaluation of Complex Interventions, a four-stage systematic development process was undertaken: (1) exploratory work involving interviews and workshop discussions identified training needs of healthcare professionals and support needs of adults with type 2 diabetes; (2) a systematic review with meta- and moderator analyses identified behaviour change techniques and optimal intervention intensity and duration; (3) usability testing identified strategies to increase implementation of the intervention in primary care and (4) an open pilot study in two primary care practices facilitated intervention optimisation. Healthcare professional training needs included knowledge about type, intensity and duration of PA sufficient to improve glycaemic control and acquisition of skills to promote PA behaviour change. Patients lacked knowledge about type 2 diabetes and skills to enable them to make sustainable changes to their level of PA. An accredited online training programme for healthcare professionals and a professional-delivered behavioural intervention for adults with type 2 diabetes were subsequently developed. This multifaceted intervention was informed by the theory of planned behaviour and social cognitive theory and consisted of 15 behaviour change techniques. Intervention intensity and duration were informed by a systematic review. Usability testing resolved technical problems with the online training intervention that facilitated use on practice IT systems. An open pilot study of the intervention with fidelity of delivery assessment informed optimisation and identified mechanisms to enhance implementation of the intervention during routine diabetes consultations. Movement as Medicine for Type 2 diabetes represents an evidence-informed multifaceted behavioural intervention targeting PA for management of type 2 diabetes developed for delivery in primary care. The structured development process undertaken enhances transparency of intervention content, replicability and scalability. Movement as Medicine for Type 2 diabetes is currently undergoing evaluation in a pilot RCT. ISRCTN67997502.

The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes.

PubMed

Woodruff, Tracey J; Sutton, Patrice

2014-10-01

Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. We sought to develop a proof of concept of the "Navigation Guide," a systematic and transparent method of research synthesis in environmental health. The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of "risk of bias," and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a "moderate" quality rating to human observational studies and combining diverse evidence streams. The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm.

Culture and Development: A Systematic Relationship.

PubMed

Keller, Heidi

2017-09-01

This article argues that the relationships between culture and development are differential and systematic. Therefore the presentation of the Western middle-class developmental pathway in textbooks as universal is grossly neglecting the reality and the psychologies of the majority of the world' s population. First, the conception of culture as the representation of environmental conditions is presented. The level of formal education acts as organizer of social milieus that define different learning environments for children. Mainly two developmental pathways are portrayed: the Western middle-class trajectory and the traditional farmer childhood. Different developmental principles are highlighted, demonstrating systematic cultural differences in the development of a conception of the self: developmental dynamics as exemplified in early mother infant interactions, the timing of developmental milestones emphasizing cultural precocities in motor development and self-recognition, developmental gestalts in different attachment relationships and precursors and consequences demonstrating that different, sometimes contradictory behavioral patterns have the same developmental consequences with the examples of empathy development and autobiographical memory. It is argued that evaluating the development in one pathway with the principles and standards of the other is unscientific and unethical. The recognition of different developmental pathways is a necessity for basic science and a moral obligation for the applied fields.

[Nursing care systematization at the intensive care unit (ICU) based on Wanda Horta's theory].

PubMed

Amante, Lúcia Nazareth; Rossetto, Annelise Paula; Schneider, Dulcinéia Ghizoni

2009-03-01

The purpose of this study was to implement the Nursing Care Systematization--Sistematização da Assistência de Enfermagem (SAE)--with Wanda Aguiar Horta's Theory of Basic Human Necessities and the North American Nursing Diagnosis Association's (NANDA) Nursing Diagnosis as its references. The starting point was the evaluation of the knowledge of the nursing team about the SAE, including their participation in this process. This is a qualitative study, performed in the Intensive Care Unit in a hospital in the city of Brusque, Santa Catarina, from October, 2006 to March, 2007. It was observed that the nursing professionals know little about SAE, but they are greatly interested in learning and developing it in their daily practice. In conclusion, it was possible to execute the healthcare systematization in an easy way, with the use of simple brochures that provided all the necessary information for the qualified development of nursing care.

Water conveyance systems in California : historic context development and evaluation procedures

DOT National Transportation Integrated Search

2000-12-01

There is increased awareness that canals and other water conveyance facilities can be historically significant, and that when transportation projects do have the potential to affect them, they need to be studied systematically. However, important wat...

Early economic evaluation of emerging health technologies: protocol of a systematic review

PubMed Central

2014-01-01

Background The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. Methods/design This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status. Discussion This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives. PMID:25055987

Early economic evaluation of emerging health technologies: protocol of a systematic review.

PubMed

Pham, Ba'; Tu, Hong Anh Thi; Han, Dolly; Pechlivanoglou, Petros; Miller, Fiona; Rac, Valeria; Chin, Warren; Tricco, Andrea C; Paulden, Mike; Bielecki, Joanna; Krahn, Murray

2014-07-23

The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status. This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives.

An overview of systematic reviews on the public health consequences of social isolation and loneliness.

PubMed

Leigh-Hunt, N; Bagguley, D; Bash, K; Turner, V; Turnbull, S; Valtorta, N; Caan, W

2017-11-01

Social isolation and loneliness have been associated with ill health and are common in the developed world. A clear understanding of their implications for morbidity and mortality is needed to gauge the extent of the associated public health challenge and the potential benefit of intervention. A systematic review of systematic reviews (systematic overview) was undertaken to determine the wider consequences of social isolation and loneliness, identify any differences between the two, determine differences from findings of non-systematic reviews and to clarify the direction of causality. Eight databases were searched from 1950 to 2016 for English language reviews covering social isolation and loneliness but not solely social support. Suitability for inclusion was determined by two or more reviewers, the methodological quality of included systematic reviews assessed using the a measurement tool to assess systematic reviews (AMSTAR) checklist and the quality of evidence within these reviews using the grading of recommendations, assessment, development and evaluations (GRADE) approach. Non-systematic reviews were sought for a comparison of findings but not included in the primary narrative synthesis. Forty systematic reviews of mainly observational studies were identified, largely from the developed world. Meta-analyses have identified a significant association between social isolation and loneliness with increased all-cause mortality and social isolation with cardiovascular disease. Narrative systematic reviews suggest associations with poorer mental health outcomes, with less strong evidence for behavioural and other physical health outcomes. No reviews were identified for wider socio-economic or developmental outcomes. This systematic overview highlights that there is consistent evidence linking social isolation and loneliness to worse cardiovascular and mental health outcomes. The role of social isolation and loneliness in other conditions and their socio-economic consequences is less clear. More research is needed on associations with cancer, health behaviours, and the impact across the life course and wider socio-economic consequences. Policy makers and health and local government commissioners should consider social isolation and loneliness as important upstream factors impacting on morbidity and mortality due to their effects on cardiovascular and mental health. Prevention strategies should therefore be developed across the public and voluntary sectors, using an asset-based approach. Copyright © 2017 The Royal Society for Public Health. All rights reserved.

Systematic monitoring and evaluation of M7 scanner performance and data quality

NASA Technical Reports Server (NTRS)

Stewart, S.; Christenson, D.; Larsen, L.

1974-01-01

An investigation was conducted to provide the information required to maintain data quality of the Michigan M7 Multispectral scanner by systematic checks on specific system performance characteristics. Data processing techniques which use calibration data gathered routinely every mission have been developed to assess current data quality. Significant changes from past data quality are thus identified and attempts made to discover their causes. Procedures for systematic monitoring of scanner data quality are discussed. In the solar reflective region, calculations of Noise Equivalent Change in Radiance on a permission basis are compared to theoretical tape-recorder limits to provide an estimate of overall scanner performance. M7 signal/noise characteristics are examined.

Evaluating the Quality of Learning Environments and Teaching Practice in Special Schools

ERIC Educational Resources Information Center

Hedegaard-Soerensen, Lotte; Tetler, Susan

2016-01-01

This article reports on findings of a study which objective is the development of an instrument for systematic evaluation and improvement of the quality of teaching in special schools. The article describes the research process which led to the construction of the instrument as well as the way teachers can use the instrument to improve the quality…

Problems with the Use of Student Test Scores to Evaluate Teachers. EPI Briefing Paper #278

ERIC Educational Resources Information Center

Baker, Eva L.; Barton, Paul E.; Darling-Hammond, Linda; Haertel, Edward; Ladd, Helen F.; Linn, Robert L.; Ravitch, Diane; Rothstein, Richard; Shavelson, Richard J.; Shepard, Lorrie A.

2010-01-01

Every classroom should have a well-educated, professional teacher, and school systems should recruit, prepare, and retain teachers who are qualified to do the job. Yet in practice, American public schools generally do a poor job of systematically developing and evaluating teachers. Many policy makers have recently come to believe that this failure…

Methodology for the Development of Antithrombotic Therapy and Prevention of Thrombosis Guidelines

PubMed Central

Norris, Susan L.; Schulman, Sam; Hirsh, Jack; Eckman, Mark H.; Akl, Elie A.; Crowther, Mark; Vandvik, Per Olav; Eikelboom, John W.; McDonagh, Marian S.; Lewis, Sandra Zelman; Gutterman, David D.; Cook, Deborah J.; Schünemann, Holger J.

2012-01-01

Background: To develop the Antithrombotic Therapy and Prevention of Thrombosis, 9th ed: ACCP Evidence-Based Clinical Practice Guidelines (AT9), the American College of Chest Physicians (ACCP) assembled a panel of clinical experts, information scientists, decision scientists, and systematic review and guideline methodologists. Methods: Clinical areas were designated as articles, and a methodologist without important intellectual or financial conflicts of interest led a panel for each article. Only panel members without significant conflicts of interest participated in making recommendations. Panelists specified the population, intervention and alternative, and outcomes for each clinical question and defined criteria for eligible studies. Panelists and an independent evidence-based practice center executed systematic searches for relevant studies and evaluated the evidence, and where resources and evidence permitted, they created standardized tables that present the quality of the evidence and key results in a transparent fashion. Results: One or more recommendations relate to each specific clinical question, and each recommendation is clearly linked to the underlying body of evidence. Judgments regarding the quality of evidence and strength of recommendations were based on approaches developed by the Grades of Recommendations, Assessment, Development, and Evaluation Working Group. Panel members constructed scenarios describing relevant health states and rated the disutility associated with these states based on an additional systematic review of evidence regarding patient values and preferences for antithrombotic therapy. These ratings guided value and preference decisions underlying the recommendations. Each topic panel identified questions in which resource allocation issues were particularly important and, for these issues, experts in economic analysis provided additional searches and guidance. Conclusions: AT9 methodology reflects the current science of evidence-based clinical practice guideline development, with reliance on high-quality systematic reviews, a standardized process for quality assessment of individual studies and the body of evidence, an explicit process for translating the evidence into recommendations, disclosure of financial as well as intellectual conflicts of interest followed by management of disclosed conflicts, and extensive peer review. PMID:22315256

The impact of Cochrane Systematic Reviews: a mixed method evaluation of outputs from Cochrane Review Groups supported by the UK National Institute for Health Research.

PubMed

Bunn, Frances; Trivedi, Daksha; Alderson, Phil; Hamilton, Laura; Martin, Alice; Iliffe, Steve

2014-10-27

There has been a growing emphasis on evidence-informed decision-making in health care. Systematic reviews, such as those produced by the Cochrane Collaboration, have been a key component of this movement. The UK National Institute for Health Research (NIHR) Systematic Review Programme currently supports 20 Cochrane Review Groups (CRGs). The aim of this study was to identify the impacts of Cochrane reviews published by NIHR-funded CRGs during the years 2007-2011. We sent questionnaires to CRGs and review authors, interviewed guideline developers and used bibliometrics and documentary review to get an overview of CRG impact and to evaluate the impact of a sample of 60 Cochrane reviews. We used a framework with four categories (knowledge production, research targeting, informing policy development and impact on practice/services). A total of 1,502 new and updated reviews were produced by the 20 NIHR-funded CRGs between 2007 and 2011. The clearest impacts were on policy with a total of 483 systematic reviews cited in 247 sets of guidance: 62 were international, 175 national (87 from the UK) and 10 local. Review authors and CRGs provided some examples of impact on practice or services, for example, safer use of medication, the identification of new effective drugs or treatments and potential economic benefits through the reduction in the use of unproven or unnecessary procedures. However, such impacts are difficult to objectively document, and the majority of reviewers were unsure if their review had produced specific impacts. Qualitative data suggested that Cochrane reviews often play an instrumental role in informing guidance, although a poor fit with guideline scope or methods, reviews being out of date and a lack of communication between CRGs and guideline developers were barriers to their use. Health and economic impacts of research are generally difficult to measure. We found that to be the case with this evaluation. Impacts on knowledge production and clinical guidance were easier to identify and substantiate than those on clinical practice. Questions remain about how we define and measure impact, and more work is needed to develop suitable methods for impact analysis.

Exploring the development of existing sex education programmes for people with intellectual disabilities: an intervention mapping approach.

PubMed

Schaafsma, Dilana; Stoffelen, Joke M T; Kok, Gerjo; Curfs, Leopold M G

2013-03-01

People with intellectual disabilities face barriers that affect their sexual health. Sex education programmes have been developed by professionals working in the field of intellectual disabilities with the aim to overcome these barriers. The aim of this study was to explore the development of these programmes. Sex education programmes geared to people with intellectual disabilities were examined in the context of the Intervention Mapping protocol. Data were obtained via interviews with the programme developers. All programmes lack specific programme outcomes, do not have a theoretical basis, did not involve members of relevant groups in the development process and lack systematic evaluation. Based on our findings and the literature, we conclude that these programmes are unlikely to be effective. Future programmes should be developed using a more systematic and theory- and evidence-based approach. © 2012 Blackwell Publishing Ltd.

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews

PubMed Central

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-01-01

Objective To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines—for example, in enemas, foot massage and compressing the umbilicus. Design A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. Result We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. Conclusions There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. PMID:28186925

Creating a Culture of Safety Around Bar-Code Medication Administration: An Evidence-Based Evaluation Framework.

PubMed

Kelly, Kandace; Harrington, Linda; Matos, Pat; Turner, Barbara; Johnson, Constance

2016-01-01

Bar-code medication administration (BCMA) effectiveness is contingent upon compliance with best-practice protocols. We developed a 4-phased BCMA evaluation program to evaluate the degree of integration of current evidence into BCMA policies, procedures, and practices; identify barriers to best-practice BCMA use; and modify BCMA practice in concert with changes to the practice environment. This program provides an infrastructure for frontline nurses to partner with hospital leaders to continually evaluate and improve BCMA using a systematic process.

What do we know about developing patient portals? a systematic literature review.

PubMed

Otte-Trojel, Terese; de Bont, Antoinette; Rundall, Thomas G; van de Klundert, Joris

2016-04-01

Numerous articles have reported on the development of patient portals, including development problems and solutions. We review these articles to inform future patient portal development efforts and to provide a summary of the evidence base that can guide future research. We performed a systematic review of relevant literature to answer 5 questions: (1) What categories of problems related to patient portal development have been defined? (2) What causal factors have been identified by problem analysis and diagnosis? (3) What solutions have been proposed to ameliorate these causal factors? (4) Which proposed solutions have been implemented and in which organizational contexts? (5) Have implemented solutions been evaluated and what learning has been generated? Through searches on PubMed, ScienceDirect and LISTA, we included 109 articles. We identified 5 main problem categories: achieving patient engagement, provider engagement, appropriate data governance, security and interoperability, and a sustainable business model. Further, we identified key factors contributing to these problems as well as solutions proposed to ameliorate them. While about half (45) of the 109 articles proposed solutions, fewer than half of these solutions (18) were implemented, and even fewer (5) were evaluated to generate learning about their effects. Few studies systematically report on the patient portal development processes. As a result, the review does not provide an evidence base for portal development. Our findings support a set of recommendations for advancement of the evidence base: future research should build on existing evidence, draw on principles from design sciences conveyed in the problem-solving cycle, and seek to produce evidence within various different organizational contexts. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

What do we know about developing patient portals? a systematic literature review

PubMed Central

de Bont, Antoinette; Rundall, Thomas G; van de Klundert, Joris

2016-01-01

Objective Numerous articles have reported on the development of patient portals, including development problems and solutions. We review these articles to inform future patient portal development efforts and to provide a summary of the evidence base that can guide future research. Materials and Methods We performed a systematic review of relevant literature to answer 5 questions: (1) What categories of problems related to patient portal development have been defined? (2) What causal factors have been identified by problem analysis and diagnosis? (3) What solutions have been proposed to ameliorate these causal factors? (4) Which proposed solutions have been implemented and in which organizational contexts? (5) Have implemented solutions been evaluated and what learning has been generated? Through searches on PubMed, ScienceDirect and LISTA, we included 109 articles. Results We identified 5 main problem categories: achieving patient engagement, provider engagement, appropriate data governance, security and interoperability, and a sustainable business model. Further, we identified key factors contributing to these problems as well as solutions proposed to ameliorate them. While about half (45) of the 109 articles proposed solutions, fewer than half of these solutions (18) were implemented, and even fewer (5) were evaluated to generate learning about their effects. Discussion Few studies systematically report on the patient portal development processes. As a result, the review does not provide an evidence base for portal development. Conclusion Our findings support a set of recommendations for advancement of the evidence base: future research should build on existing evidence, draw on principles from design sciences conveyed in the problem-solving cycle, and seek to produce evidence within various different organizational contexts. PMID:26335985

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Towards improved and more routine Earth system model evaluation in CMIP

DOE PAGES

Eyring, Veronika; Gleckler, Peter J.; Heinze, Christoph; ...

2016-11-01

The Coupled Model Intercomparison Project (CMIP) has successfully provided the climate community with a rich collection of simulation output from Earth system models (ESMs) that can be used to understand past climate changes and make projections and uncertainty estimates of the future. Confidence in ESMs can be gained because the models are based on physical principles and reproduce many important aspects of observed climate. More research is required to identify the processes that are most responsible for systematic biases and the magnitude and uncertainty of future projections so that more relevant performance tests can be developed. At the same time,more » there are many aspects of ESM evaluation that are well established and considered an essential part of systematic evaluation but have been implemented ad hoc with little community coordination. Given the diversity and complexity of ESM analysis, we argue that the CMIP community has reached a critical juncture at which many baseline aspects of model evaluation need to be performed much more efficiently and consistently. We provide a perspective and viewpoint on how a more systematic, open, and rapid performance assessment of the large and diverse number of models that will participate in current and future phases of CMIP can be achieved, and announce our intention to implement such a system for CMIP6. Accomplishing this could also free up valuable resources as many scientists are frequently "re-inventing the wheel" by re-writing analysis routines for well-established analysis methods. A more systematic approach for the community would be to develop and apply evaluation tools that are based on the latest scientific knowledge and observational reference, are well suited for routine use, and provide a wide range of diagnostics and performance metrics that comprehensively characterize model behaviour as soon as the output is published to the Earth System Grid Federation (ESGF). The CMIP infrastructure enforces data standards and conventions for model output and documentation accessible via the ESGF, additionally publishing observations (obs4MIPs) and reanalyses (ana4MIPs) for model intercomparison projects using the same data structure and organization as the ESM output. This largely facilitates routine evaluation of the ESMs, but to be able to process the data automatically alongside the ESGF, the infrastructure needs to be extended with processing capabilities at the ESGF data nodes where the evaluation tools can be executed on a routine basis. Efforts are already underway to develop community-based evaluation tools, and we encourage experts to provide additional diagnostic codes that would enhance this capability for CMIP. And, at the same time, we encourage the community to contribute observations and reanalyses for model evaluation to the obs4MIPs and ana4MIPs archives. The intention is to produce through the ESGF a widely accepted quasi-operational evaluation framework for CMIP6 that would routinely execute a series of standardized evaluation tasks. Over time, as this capability matures, we expect to produce an increasingly systematic characterization of models which, compared with early phases of CMIP, will more quickly and openly identify the strengths and weaknesses of the simulations. This will also reveal whether long-standing model errors remain evident in newer models and will assist modelling groups in improving their models. Finally, this framework will be designed to readily incorporate updates, including new observations and additional diagnostics and metrics as they become available from the research community.« less

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

The economics of medicines optimization: policy developments, remaining challenges and research priorities

PubMed Central

Faria, Rita; Barbieri, Marco; Light, Kate; Elliott, Rachel A.; Sculpher, Mark

2014-01-01

Background This review scopes the evidence on the effectiveness and cost-effectiveness of interventions to improve suboptimal use of medicines in order to determine the evidence gaps and help inform research priorities. Sources of data Systematic searches of the National Health Service (NHS) Economic Evaluation Database, the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects. Areas of agreement The majority of the studies evaluated interventions to improve adherence, inappropriate prescribing and prescribing errors. Areas of controversy Interventions tend to be specific to a particular stage of the pathway and/or to a particular disease and have mostly been evaluated for their effect on intermediate or process outcomes. Growing points Medicines optimization offers an opportunity to improve health outcomes and efficiency of healthcare. Areas timely for developing research The available evidence is insufficient to assess the effectiveness and cost-effectiveness of interventions to address suboptimal medicine use in the UK NHS. Decision modelling, evidence synthesis and elicitation have the potential to address the evidence gaps and help prioritize research. PMID:25190760

A systematic review of economic evaluations of health and health-related interventions in Bangladesh

PubMed Central

2011-01-01

Background Economic evaluation is used for effective resource allocation in health sector. Accumulated knowledge about economic evaluation of health programs in Bangladesh is not currently available. While a number of economic evaluation studies have been performed in Bangladesh, no systematic investigation of the studies has been done to our knowledge. The aim of this current study is to systematically review the published articles in peer-reviewed journals on economic evaluation of health and health-related interventions in Bangladesh. Methods Literature searches was carried out during November-December 2008 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface. The first specific interest was mapping the articles considering the areas of exploration by economic evaluation and the second interest was to scrutiny the methodological quality of studies. The methodological quality of economic evaluation of all articles has been scrutinized against the checklist developed by Evers Silvia and associates. Result Of 1784 potential articles 12 were accepted for inclusion. Ten studies described the competing alternatives clearly and only two articles stated the perspective of their articles clearly. All studies included direct cost, incurred by the providers. Only one study included the cost of community donated resources and volunteer costs. Two studies calculated the incremental cost effectiveness ratio (ICER). Six of the studies applied some sort of sensitivity analysis. Two of the studies discussed financial affordability of expected implementers and four studies discussed the issue of generalizability for application in different context. Conclusion Very few economic evaluation studies in Bangladesh are found in different areas of health and health-related interventions, which does not provide a strong basis of knowledge in the area. The most frequently applied economic evaluation is cost-effectiveness analysis. The majority of the studies did not follow the scientific method of economic evaluation process, which consequently resulted into lack of robustness of the analyses. Capacity building on economic evaluation of health and health-related programs should be enhanced. PMID:21771343

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature

PubMed Central

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R.; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability. PMID:28443022

A systematic review of definitions and classification systems of adjacent segment pathology.

PubMed

Kraemer, Paul; Fehlings, Michael G; Hashimoto, Robin; Lee, Michael J; Anderson, Paul A; Chapman, Jens R; Raich, Annie; Norvell, Daniel C

2012-10-15

Systematic review. To undertake a systematic review to determine how "adjacent segment degeneration," "adjacent segment disease," or clinical pathological processes that serve as surrogates for adjacent segment pathology are classified and defined in the peer-reviewed literature. Adjacent segment degeneration and adjacent segment disease are terms referring to degenerative changes known to occur after reconstructive spine surgery, most commonly at an immediately adjacent functional spinal unit. These can include disc degeneration, instability, spinal stenosis, facet degeneration, and deformity. The true incidence and clinical impact of degenerative changes at the adjacent segment is unclear because there is lack of a universally accepted classification system that rigorously addresses clinical and radiological issues. A systematic review of the English language literature was undertaken and articles were classified using the Grades of Recommendation Assessment, Development, and Evaluation criteria. RESULTS.: Seven classification systems of spinal degeneration, including degeneration at the adjacent segment, were identified. None have been evaluated for reliability or validity specific to patients with degeneration at the adjacent segment. The ways in which terms related to adjacent segment "degeneration" or "disease" are defined in the peer-reviewed literature are highly variable. On the basis of the systematic review presented in this article, no formal classification system for either cervical or thoracolumbar adjacent segment disorders currently exists. No recommendations regarding the use of current classification of degeneration at any segments can be made based on the available literature. A new comprehensive definition for adjacent segment pathology (ASP, the now preferred terminology) has been proposed in this Focus Issue, which reflects the diverse pathology observed at functional spinal units adjacent to previous spinal reconstruction and balances detailed stratification with clinical utility. A comprehensive classification system is being developed through expert opinion and will require validation as well as peer review. Strength of Statement: Strong.

Pediatric Tuina for promoting growth and development of preterm infants: A protocol for the systematic review of randomized controlled trail.

PubMed

Zhang, Xinghe; Guo, Taipin; Zhu, Bowen; Gao, Qing; Wang, Hourong; Tai, Xiantao; Jing, Fujie

2018-05-01

Preterm infants are babies born alive before 37 weeks. Many survived infants concomitant with defects of growth and development, a lifetime of disability usually as following when insufficient intervention. In early intervention of preterm infants, pediatric Tuina shows good effect in many Chinese and some English clinical trials. This systematic review is aimed to evaluate the efficacy and safety of pediatric Tuina for promoting growth and development of preterm infants. The electronic databases of Cochrane Library, MEDLINE, EBASE, Web of Science, Springer, World Health Organization International Clinical Trials Registry Platform, China National Knowledge Infrastructure, Chinese Biomedical Literature Database, Wan-fang database, Chinese Scientific Journal Database, and other databases will be searched from establishment to April 1, 2018. All published randomized controlled trials (RCTs) about this topic will be included. Two independent researchers will operate article retrieval, screening, quality evaluation, and data analyses by Review Manager (V.5.3.5). Meta-analyses, subgroup analysis, and/or descriptive analysis will be performed based on included data conditions. High-quality synthesis and/or descriptive analysis of current evidence will be provided from weight increase, motor development, neuropsychological development, length of stay, days of weight recovery to birthweight, days on supplemental oxygen, daily sleep duration, and side effects. This study will provide the evidence of whether pediatric Tuina is an effective early intervention for preterm infants. There is no requirement of ethical approval and informed consent, and it will be in print or published by electronic copies. This systematic review protocol has been registered in the PROSPERO network (No. CRD42018090563).

Development of Follow-Up Questionnaires for Vocational and Transfer Students at the El Paso Community College and Development of Faculty Motivation Scales. Consulting Report.

ERIC Educational Resources Information Center

Whitmore, Paul G.

The primary purpose of the student follow-up questionnaires was to identify instructional and curricular deficiencies in sufficiently specific terms to provide a basis for correcting the deficiencies. This effort was part of the evaluation component of a program dealing with the systematization of instruction. Two instruments were developed: one…

Banxia Xiexin tang for gastro-oesophageal reflux disease: A protocol for a systematic review of controlled trials.

PubMed

Kang, Bohyung; Lee, Haesol; Choi, Youkyung; Jeon, Chanyong; Lee, Ju Ah

2018-04-01

Gastrooesophageal reflux disease (GORD) is one of the most common gastrointestinal diseases encountered in clinical practice. The aim of the present study is thus to systematically review the literature, including Asian studies, to assess the efficacy and safety of Banxia Xiexin tang (BXT) for the treatment of GORD. Eleven databases will be searched for studies conducted through March 2018. We will include randomized controlled trials (RCTs) of BXT as a treatment for GORD. All RCTs on BXT or related formulations will be included. The risk of bias will be assessed using the Cochrane Risk of Bias Assessment Tool, while confidence in the cumulative evidence will be evaluated using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) tool. This systematic review will be published in a peer-reviewed journal and will also be disseminated electronically and in print. The review will be updated to inform and guide healthcare practices. CRD42018087056.

The efficacy of herbal medicines against Toxoplasma gondii during the last 3 decades: a systematic review.

PubMed

Sharif, Mahdi; Sarvi, Shahabeddin; Pagheh, Abdol Sattar; Asfaram, Shabnam; Rahimi, Mohammad Taghi; Mehrzadi, Saeed; Ahmadpour, Ehsan; Gholami, Shirzad; Daryani, Ahmad

2016-12-01

The objective of the current study was to systematically review papers discussing the efficacy of medicinal herbs against Toxoplasma gondii. Data were systematically collected from published papers about the efficacy of herbs used against T. gondii globally from 1988 to 2015, from PubMed, Google Scholar, ISI Web of Science, EBSCO, Science Direct, and Scopus. Forty-nine papers were included in the current systematic review reporting the evaluation of medicinal plants against T. gondii globally, both in vitro and in vivo. Sixty-one plants were evaluated. Most of the studies were carried out on Artemisia annua. The second highest number of studies were carried out on Glycyrrhiza glabra extracts. RH and ME49 were the predominant parasite strains used. Additionally, Swiss-Webster and BALB/c mice were the major animal models used. Alcoholic and aqueous extracts were used more than other types of extracts. Natural compounds mentioned here may be developed as novel and more effective therapeutic agents that improve the treatment of toxoplasmosis due to their lower side effects, higher availability, and better cultural acceptance compared with those of the chemical drugs that are currently being used.

Safety of ceftriaxone in paediatrics: a systematic review protocol.

PubMed

Zeng, Linan; Choonara, Imti; Zhang, Lingli; Xue, Song; Chen, Zhe; He, Miaomiao

2017-08-21

Ceftriaxone is widely used in children in the treatment of sepsis. However, concerns have been raised about the safety of ceftriaxone, especially in young children. The aim of this review is to systematically evaluate the safety of ceftriaxone in children of all age groups. MEDLINE, PubMed, Cochrane Central Register of Controlled Trials, EMBASE, CINAHL, International Pharmaceutical Abstracts and adverse drug reaction (ADR) monitoring systems will be systematically searched for randomised controlled trials (RCTs), cohort studies, case-control studies, cross-sectional studies, case series and case reports evaluating the safety of ceftriaxone in children. The Cochrane risk of bias tool, Newcastle-Ottawa and quality assessment tools developed by the National Institutes of Health will be used for quality assessment. Meta-analysis of the incidence of ADRs from RCTs and prospective studies will be done. Subgroup analyses will be performed for age and dosage regimen. Formal ethical approval is not required as no primary data are collected. This systematic review will be disseminated through a peer-reviewed publication and at conference meetings. CRD42017055428. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Systematic Review: the use of vouchers for reproductive health services in developing countries: systematic review.

PubMed

Bellows, Nicole M; Bellows, Ben W; Warren, Charlotte

2011-01-01

To identify where vouchers have been used for reproductive health (RH) services, to what extent RH voucher programmes have been evaluated, and whether the programmes have been effective. A systematic search of the peer review and grey literature was conducted to identify RH voucher programmes and evaluation findings. Experts were consulted to verify RH voucher programme information and identify further programmes and studies not found in the literature search. Studies were examined for outcomes regarding targeting, costs, knowledge, utilization, quality, and population health impact. Included studies used cross-sectional, before-and-after and quasi-experimental designs. Thirteen RH voucher programmes fitting established criteria were identified. RH voucher programmes were located in Bangladesh, Cambodia, China, Kenya (2), Korea, India, Indonesia, Nicaragua (3), Taiwan, and Uganda. Among RH voucher programmes, 7 were quantitatively evaluated in 15 studies. All evaluations reported some positive findings, indicating that RH voucher programmes increased utilization of RH services, improved quality of care, and improved population health outcomes. The potential for RH voucher programmes appears positive; however, more research is needed to examine programme effectiveness using strong study designs. In particular, it is important to see stronger evidence on cost-effectiveness and population health impacts, where the findings can best direct governments and external funders. © 2010 Blackwell Publishing Ltd.

Building Community in School.

ERIC Educational Resources Information Center

Schaps, Eric; And Others

1996-01-01

Evaluation studies of the Child Development Project revealed unexpected findings concerning students' sense of classroom community. Teachers should systematically build relationships with students, involve them in planning and problem solving, help them learn classmates' strengths and interests, downplay competition, and involve all children in…

Infusing Diversity Constructs in Preservice Teacher Preparation: The Impact of a Systematic Faculty Development Strategy

ERIC Educational Resources Information Center

Maude, Susan P.; Catlett, Camille; Moore, Susan; Sanchez, Sylvia Y.; Thorp, Eva K.; Corso, Rob

2010-01-01

This article provides an overview and the results of the Crosswalks Intervention, which was developed, implemented, and evaluated to support inclusive early childhood preservice programs to be more reflective of, and responsive to, cultural and linguistic diversity. The Crosswalks Intervention, funded by the US Department of Education, was a…

Social Media and Marketing Education: A Review of Current Practices in Curriculum Development

ERIC Educational Resources Information Center

Brocato, E. Deanne; White, Nathan James; Bartkus, Kenneth; Brocato, Ashley Ann

2015-01-01

Given the presumed importance of social media to marketing, along with the apparent lack of research concerning social media curriculum development, the purpose of this study is to conduct a systematic analysis of social media curriculum through the evaluation of undergraduate course syllabi in the United States. This research is intended to…

Developing Emotional Literacy through Individual Dance Movement Therapy: A Pilot Study

ERIC Educational Resources Information Center

Meekums, Bonnie

2008-01-01

This paper reports a pragmatic mixed methods pilot study of teacher perceptions regarding a school-based Dance Movement therapy (DMT) service for six children aged four to seven in a North of England primary school. No previous studies have systematically evaluated DMT in terms of the development of Emotional Literacy (EL), though theoretical…

Evaluation of animal models of neurobehavioral disorders

PubMed Central

van der Staay, F Josef; Arndt, Saskia S; Nordquist, Rebecca E

2009-01-01

Animal models play a central role in all areas of biomedical research. The process of animal model building, development and evaluation has rarely been addressed systematically, despite the long history of using animal models in the investigation of neuropsychiatric disorders and behavioral dysfunctions. An iterative, multi-stage trajectory for developing animal models and assessing their quality is proposed. The process starts with defining the purpose(s) of the model, preferentially based on hypotheses about brain-behavior relationships. Then, the model is developed and tested. The evaluation of the model takes scientific and ethical criteria into consideration. Model development requires a multidisciplinary approach. Preclinical and clinical experts should establish a set of scientific criteria, which a model must meet. The scientific evaluation consists of assessing the replicability/reliability, predictive, construct and external validity/generalizability, and relevance of the model. We emphasize the role of (systematic and extended) replications in the course of the validation process. One may apply a multiple-tiered 'replication battery' to estimate the reliability/replicability, validity, and generalizability of result. Compromised welfare is inherent in many deficiency models in animals. Unfortunately, 'animal welfare' is a vaguely defined concept, making it difficult to establish exact evaluation criteria. Weighing the animal's welfare and considerations as to whether action is indicated to reduce the discomfort must accompany the scientific evaluation at any stage of the model building and evaluation process. Animal model building should be discontinued if the model does not meet the preset scientific criteria, or when animal welfare is severely compromised. The application of the evaluation procedure is exemplified using the rat with neonatal hippocampal lesion as a proposed model of schizophrenia. In a manner congruent to that for improving animal models, guided by the procedure expounded upon in this paper, the developmental and evaluation procedure itself may be improved by careful definition of the purpose(s) of a model and by defining better evaluation criteria, based on the proposed use of the model. PMID:19243583

Interventions for preventing, delaying the onset, or decreasing the burden of frailty: an overview of systematic reviews.

PubMed

Wilson, Michael G; Béland, François; Julien, Dominic; Gauvin, Lise; Guindon, G Emmanuel; Roy, Denis; Campbell, Kaitryn; Comeau, Donna G; Davidson, Heather; Raina, Parminder; Sattler, Deborah; Vrkljan, Brenda

2015-09-25

Many systematic reviews have evaluated the effectiveness of interventions to prevent, delay, or decrease frailty symptoms, but no effort has been made to identify, map, and synthesize the findings from reviews across the full spectrum of interventions. Our objectives are to (1) synthesize findings from all existing systematic reviews evaluating interventions for preventing, delaying the onset, or decreasing the burden of frailty symptoms; (2) examine different conceptualizations of frailty that have been used in the development and implementation of interventions; and (3) inform policy by convening a stakeholder dialogue with Canadian health-system leaders. We will conduct an overview of systematic reviews to identify and synthesize all of the systematic reviews addressing interventions to preventing, delaying the onset, or decreasing the burden of frailty symptoms. To identify relevant systematic reviews, we will conduct database searches for published and grey literature as well as contact key experts and search reference lists of included reviews. Two reviewers will independently review all search results for inclusion and then conceptually map, extract key findings (including the conceptualization/definition of frailty used) and assess the methodological quality of all included reviews. We will then synthesize the findings by producing a 'gap map' (i.e. mapping reviews in a matrix according to the interventions and outcomes assessed), and narratively synthesize the key messages across reviews related to type of interventions. Following the completion of the synthesis, we will use the findings to develop an evidence brief that mobilizes the best available evidence about the problem related to preventing, delaying the onset, or decreasing the burden of frailty symptoms in older adults, policy and programmatic options to address the problem and implementation considerations. The evidence brief will then be used as the input into a stakeholder dialogue, which will engage 18-22 Canadian health-system leaders (including policymakers, health providers, researchers, and other stakeholders) in 'off-the-record' deliberations to inform future actions and policymaking. PROSPERO CRD42015022082.

Disability Policy Evaluation: Combining Logic Models and Systems Thinking.

PubMed

Claes, Claudia; Ferket, Neelke; Vandevelde, Stijn; Verlet, Dries; De Maeyer, Jessica

2017-07-01

Policy evaluation focuses on the assessment of policy-related personal, family, and societal changes or benefits that follow as a result of the interventions, services, and supports provided to those persons to whom the policy is directed. This article describes a systematic approach to policy evaluation based on an evaluation framework and an evaluation process that combine the use of logic models and systems thinking. The article also includes an example of how the framework and process have recently been used in policy development and evaluation in Flanders (Belgium), as well as four policy evaluation guidelines based on relevant published literature.

The Estimation and Inclusion of Presenteeism Costs in Applied Economic Evaluation: A Systematic Review.

PubMed

Kigozi, Jesse; Jowett, Sue; Lewis, Martyn; Barton, Pelham; Coast, Joanna

2017-03-01

Given the significant costs of reduced productivity (presenteeism) in comparison to absenteeism, and overall societal costs, presenteeism has a potentially important role to play in economic evaluations. However, these costs are often excluded. The objective of this study is to review applied cost of illness studies and economic evaluations to identify valuation methods used for, and impact of including presenteeism costs in practice. A structured systematic review was carried out to explore (i) the extent to which presenteeism has been applied in cost of illness studies and economic evaluations and (ii) the overall impact of including presenteeism on overall costs and outcomes. Potential articles were identified by searching Medline, PsycINFO and NHS EED databases. A standard template was developed and used to extract information from economic evaluations and cost of illness studies incorporating presenteeism costs. A total of 28 studies were included in the systematic review which also demonstrated that presenteeism costs are rarely included in full economic evaluations. Estimation and monetisation methods differed between the instruments. The impact of disease on presenteeism whilst in paid work is high. The potential impact of presenteeism costs needs to be highlighted and greater consideration should be given to including these in economic evaluations and cost of illness studies. The importance of including presenteeism costs when conducting economic evaluation from a societal perspective should be emphasised in national economic guidelines and more methodological work is required to improve the practical application of presenteeism instruments to generate productivity cost estimates. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Interventions to support people with dementia and their caregivers during the transition from home care to nursing home care: A systematic review.

PubMed

Müller, Christian; Lautenschläger, Sindy; Meyer, Gabriele; Stephan, Astrid

2017-06-01

During the transition of people with dementia from home to nursing home family caregivers often feel burdened. We aimed to 1) identify interventions which support people with dementia and their caregivers in the transition from home care to nursing home care, 2) synthesize the evidence for efficacy of these interventions, and 3) examine whether the identified interventions have been systematically developed, evaluated and implemented according to the Medical Research Council guidance on complex interventions. A systematic review of randomised controlled trials was conducted according to the recommendations specified in the Cochrane Handbook for Intervention Reviews. The review protocol was registered in PROSPERO (2015: CRD42015019839). Reporting follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement. MEDLINE, CENTRAL, PsycINFO, CINAHL, OTseeker, and PEDro, were searched. Other sources included Google Scholar, and ALOIS. Two reviewers independently assessed the eligibility of the articles. Data extraction was performed by one reviewer and verified independently by another. The Cochrane Risk of Bias tool was used for critical appraisal. Development and evaluation of the identified interventions were assessed, taking the Medical Research Council guidance into account. Review findings were synthesized narratively. The search yielded 1278 records. Five studies were included, all conducted in the United States (4 RCTs and 1 cRCT with a total of 695 participants). The psychosocial interventions were individual and family counseling via telephone or ad hoc all of which addressed only informal caregivers. The intervention components, content and mode of delivery differed widely with inconsistent results. Significant intervention effects were found for the reduction of caregivers' depressive symptoms, burden, feeling of guilt, emotional distress, overload, and interactions with staff. Other outcomes, i.e. stress, placement adaptation, role overload, and role captivity, were not statistically significantly affected. The assessment for bias risk across studies varied from moderate to low. Only two studies tested the feasibility of the intervention before full scale evaluation, none evaluated the implementation process according to the Medical Research Council framework. We identified only a few studies with heterogeneous outcomes; evidence regarding the effectiveness of psychosocial interventions is thus insufficient. Further research is needed focusing on the development and evaluation of complex psychosocial interventions and more well-designed RCTs with larger sample sizes based on a rigorous methodology. Reporting on feasibility and implementation processes of interventions should be guaranteed, since it is crucial to evaluate transferability across care settings. Copyright © 2017 Elsevier Ltd. All rights reserved.

Economic evaluation of HIV pre-exposure prophylaxis strategies: protocol for a methodological systematic review and quantitative synthesis.

PubMed

Thavorn, Kednapa; Kugathasan, Howsikan; Tan, Darrell H S; Moqueet, Nasheed; Baral, Stefan D; Skidmore, Becky; MacFadden, Derek; Simkin, Anna; Mishra, Sharmistha

2018-03-15

Pre-exposure prophylaxis (PrEP) with antiretrovirals is an efficacious and effective intervention to decrease the risk of HIV (human immunodeficiency virus) acquisition. Yet drug and delivery costs prohibit access in many jurisdictions. In the absence of guidelines for the synthesis of economic evaluations, we developed a protocol for a systematic review of economic evaluation studies for PrEP by drawing on best practices in systematic reviews and the conduct and reporting of economic evaluations. We aim to estimate the incremental cost per health outcome of PrEP compared with placebo, no PrEP, or other HIV prevention strategies; assess the methodological variability in, and quality of, economic evaluations of PrEP; estimate the incremental cost per health outcome of different PrEP implementation strategies; and quantify the potential sources of heterogeneity in outcomes. We will systematically search electronic databases (MEDLINE, Embase) and the gray literature. We will include economic evaluation studies that assess both costs and health outcomes of PrEP in HIV-uninfected individuals, without restricting language or year of publication. Two reviewers will independently screen studies using predefined inclusion criteria, extract data, and assess methodological quality using the Philips checklist, Second Panel on the Cost-effectiveness of Health and Medicines, and the International Society for Pharmacoeconomics and Outcomes Research recommendations. Outcomes of interest include incremental costs and outcomes in natural units or utilities, cost-effectiveness ratios, and net monetary benefit. We will perform descriptive and quantitative syntheses using sensitivity analyses of outcomes by population subgroups, HIV epidemic settings, study designs, baseline intervention contexts, key parameter inputs and assumptions, type of outcomes, economic perspectives, and willingness to pay values. Findings will guide future economic evaluation of PrEP strategies in terms of methodological and knowledge gaps, and will inform decisions on the efficient integration of PrEP into public health programs across epidemiologic and health system contexts. PROSPERO CRD42016038440 .

Space station common module power system network topology and hardware development

NASA Technical Reports Server (NTRS)

Landis, D. M.

1985-01-01

Candidate power system newtork topologies for the space station common module are defined and developed and the necessary hardware for test and evaluation is provided. Martin Marietta's approach to performing the proposed program is presented. Performance of the tasks described will assure systematic development and evaluation of program results, and will provide the necessary management tools, visibility, and control techniques for performance assessment. The plan is submitted in accordance with the data requirements given and includes a comprehensive task logic flow diagram, time phased manpower requirements, a program milestone schedule, and detailed descriptions of each program task.

Effectiveness of wearable defibrillators: systematic review and quality of evidence.

PubMed

Uyei, Jennifer; Braithwaite, R Scott

2014-04-01

The objectives of this systematic literature review were to identify all published literature on wearable defibrillators, assess the wearable defibrillator's efficacy and effectiveness in general and among specific patient groups, including post-myocardial infarction, post coronary artery bypass grafting or percutaneous coronary intervention, non-ischemic cardiomyopathy, and ischemic cardiomyopathy, and to evaluate the quality of evidence. The search and synthesis was informed by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement, and the quality of evidence was evaluated using the Grading of Recommendations Assessment, Development and Evaluation and the Newcastle Ottawa Scale. A total of thirty-six articles and conference abstracts from thirty-three studies were included in the review. It appears that wearable defibrillator use compared with no defibrillator use reduces the chance of ventricular tachycardia and ventricular fibrillation (VT/VF) associated deaths by an absolute risk reduction of approximately 1 percent, achieved by averting approximately 4/5th of all VT/VF associated deaths. The quality of evidence was low to very low quality, such that our confidence in the reported estimates is weak. To validate beneficial results, further investigation using robust study designs conducted by independent researchers is warranted.

[Function of the present systematic evaluation in establishment of guidance for clinical practice].

PubMed

Yang, Jin-Hong; Hu, Jing; Yang, Feng-Chun; Zhang, Ning; Wang, Bing; Li, Xin

2012-07-01

Treatment of insomnia with acupuncture is taken as an example to explore the significance and problems existed in the present systematic evaluation in establishment of guidance for clinical practice. Fifteen articles on systematic evaluation of both English and Chinese were retrieved and studied carefully, their basic information was analyzed. Through study on the establishing process of the guidance of clinical practice, researches were focused on the possible significance of the articles to the guidance as well as the notes in the reuse of those articles since problem still existed. It is held that the systematic evaluation has great significance on the establishment of the guidance from the aspects of applicable people, recommended standards of diagnosis and therapeutic evaluation, extended recommendation and methodology. Great importance should also be attached to the direct application of the research result and understanding of the evaluation result. The data should be rechecked when necessary. Great guiding function can be found on the systematic evaluation of articles to the guidance. Moreover, if information needed to be taken into a full play, specific analysis should also be done on the concrete research targets.

Method for technology-delivered healthcare measures.

PubMed

Kramer-Jackman, Kelli Lee; Popkess-Vawter, Sue

2011-12-01

Current healthcare literature lacks development and evaluation methods for research and practice measures administered by technology. Researchers with varying levels of informatics experience are developing technology-delivered measures because of the numerous advantages they offer. Hasty development of technology-delivered measures can present issues that negatively influence administration and psychometric properties. The Method for Technology-delivered Healthcare Measures is designed to systematically guide the development and evaluation of technology-delivered measures. The five-step Method for Technology-delivered Healthcare Measures includes establishment of content, e-Health literacy, technology delivery, expert usability, and participant usability. Background information and Method for Technology-delivered Healthcare Measures steps are detailed.

A Systematic Review of Serious Games in Training Health Care Professionals.

PubMed

Wang, Ryan; DeMaria, Samuel; Goldberg, Andrew; Katz, Daniel

2016-02-01

Serious games are computer-based games designed for training purposes. They are poised to expand their role in medical education. This systematic review, conducted in accordance with PRISMA guidelines, aimed to synthesize current serious gaming trends in health care training, especially those pertaining to developmental methodologies and game evaluation. PubMed, EMBASE, and Cochrane databases were queried for relevant documents published through December 2014. Of the 3737 publications identified, 48 of them, covering 42 serious games, were included. From 2007 to 2014, they demonstrate a growth from 2 games and 2 genres to 42 games and 8 genres. Overall, study design was heterogeneous and methodological quality by MERQSI score averaged 10.5/18, which is modest. Seventy-nine percent of serious games were evaluated for training outcomes. As the number of serious games for health care training continues to grow, having schemas that organize how educators approach their development and evaluation is essential for their success.

[Systematic evaluation of retention behavior of carbohydrates in hydrophilic interaction liquid chromatography].

PubMed

Fu, Qing; Wang, Jun; Liang, Tu; Xu, Xiaoyong; Jin, Yu

2013-11-01

A systematic evaluation of retention behavior of carbohydrates in hydrophilic interaction liquid chromatography (HILIC) was performed. The influences of mobile phase, stationary phase and buffer salt on the retention of carbohydrates were investigated. According to the results, the retention time of carbohydrates decreased as the proportion of acetonitrile in mobile phase decreased. Increased time of carbohydrates was observed as the concentration of buffer salt in mobile phase increased. The retention behavior of carbohydrates was also affected by organic solvent and HILIC stationary phase. Furthermore, an appropriate retention equation was used in HILIC mode. The retention equation lnk = a + blnC(B) + cC(B) could quantitatively describe the retention factors of carbohydrates of plant origin with good accuracy: the relative error of the predicted time to actual time was less than 0.3%. The evaluation results could provide guidance for carbohydrates to optimize the experimental conditions in HILIC method development especially for carbohydrate separation

[Methodology for construction of a panel of indicators for monitoring and evaluation of unified health system (SUS) management].

PubMed

Tamaki, Edson Mamoru; Tanaka, Oswaldo Yoshimi; Felisberto, Eronildo; Alves, Cinthia Kalyne de Almeida; Drumond Junior, Marcos; Bezerra, Luciana Caroline de Albuquerque; Calvo, Maria Cristina Marino; Miranda, Alcides Silva de

2012-04-01

This study sought to develop methodology for the construction of a Panel for the Monitoring and Evaluation of Management of the Unified Health System (SUS). The participative process used in addition to the systematization conducted made it possible to identify an effective strategy for building management tools in partnership with researchers, academic institutions and managers of the SUS. The final systematization of the Panel selected indicators for the management of the SUS in terms of Demand, Inputs, Processes, Outputs and Outcomes in order to provide a simple, versatile and useful tool for evaluation at any level of management and more transparent and easier communication with all stakeholders in decision-making. Taking the management of the SUS as the scope of these processes and practices in all normative aspects enabled dialog between systemic theories and those which consider the centrality of the social actor in the decision-making process.

Training Feedback Handbook. Research Product 83-7.

ERIC Educational Resources Information Center

Burnside, Billy L.; And Others

This handbook is designed to assist training developers and evaluators in structuring their collection of feedback data. Addressed first are various methods for collecting feedback data, including informal feedback, existing unit performance records, questionnaires, structured interviews, systematic observation, and testing. The next chapter, a…

School-Based Technology Use Planning.

ERIC Educational Resources Information Center

Cradler, John

1994-01-01

Describes how to conduct systematic planning for technology use. The components of an effective technology use plan, derived from a comprehensive study of school-based technology, are given. Planning development, implementation, and evaluation steps are provided. Ten planning resource books are listed. (Contains five references.) (KRN)

Using high-throughput literature mining to support read-across predictions of toxicity (SOT)

EPA Science Inventory

Building scientific confidence in the development and evaluation of read-across remains an ongoing challenge. Approaches include establishing systematic frameworks to identify sources of uncertainty and ways to address them. One source of uncertainty is related to characterizing ...

High-throughput literature mining to support read-across predictions of toxicity (ASCCT meeting)

EPA Science Inventory

Building scientific confidence in the development and evaluation of read-across remains an ongoing challenge. Approaches include establishing systematic frameworks to identify sources of uncertainty and ways to address them. One source of uncertainty is related to characterizing ...

Towards a Pedagogy for Cooperative Education.

ERIC Educational Resources Information Center

Heinemann, Harry N.

1983-01-01

Discusses the need to develop an appropriate pedagogy for cooperative education to integrate the educational outcomes from the work and classroom experience. Suggests that the model should structure, guide, and provide for the systematic evaluation of the learning resulting from the cooperative education assignment. (JOW)

Music and Computing.

ERIC Educational Resources Information Center

Boody, Charles G., Ed.

1986-01-01

Six articles on music and computing address development of computer-based music technology, computer assisted instruction (CAI) in ear training and music fundamentals, a machine-independent data structure for musical pitch relationship representation, touch tablet input device in a melodic dictation CAI game, and systematic evaluation strategies…

Participatory evaluation (I)--sharing lessons from fieldwork in Asia.

PubMed

Crishna, B

2007-05-01

There is a need to study methodologies for evaluating social development projects. Traditional methods of evaluation are often not able to capture or measure the 'spirit of change' in people, which is the very essence of human development. Using participatory methodologies is a positive way to ensure that evaluations encourage an understanding of the value of critical analysis among service providers and other stakeholders. Participatory evaluation provides a systematic process of learning through experiences. Practical experiences of conducting a number of evaluation studies in social development projects have led the author to develop four basic principles of participatory evaluation strategies. This has been further conceptualized through an extensive literature search. The article develops and shares these principles through descriptions of field experiences in Asia. The article illustrates that the role of any evaluation remains a learning process, one which promotes a climate of reflection and self-assessment. It shows how using participatory methods can create this environment of learning. However, one needs to keep in mind that participatory evaluation takes time, and that the role and calibre of the facilitator are crucial. Participatory evaluation methods have been recommended for social development projects to ensure that stakeholders remain in control of their own lives and decisions.

Developing an evidence base for interdisciplinary learning: a systematic review.

PubMed

Cooper, H; Carlisle, C; Gibbs, T; Watkins, C

2001-07-01

The overall aim of the study was to explore the feasibility of introducing interdisciplinary education within undergraduate health professional programmes. This paper reports on the first stage of the study in which a systematic review was conducted to summarize the evidence for interdisciplinary education of undergraduate health professional students. Systematic reviews integrate valid information providing a basis for rational decision making about health care which should be based on empirical and not anecdotal evidence. The accepted principles for systematic reviews were adapted in order to allow integration of the literature to produce recommendations for educational practice and guidelines for future research. The literature on interdisciplinary education was found to be diverse, including relatively small amounts of research data and much larger amounts of evaluation literature. Methodological rating schemes were used to test for confounding influences in the research studies. The number of studies found was 141 but only 30 (21%) were included in the analysis because of lack of methodological rigour in the research and poorly developed outcome measures. Student health professionals were found to benefit from interdisciplinary education with outcome effects primarily relating to changes in knowledge, skills, attitudes and beliefs. Effects upon professional practice were not discernible and educational and psychological theories were rarely used to guide the development of the educational interventions.

The Navigation Guide Systematic Review Methodology: A Rigorous and Transparent Method for Translating Environmental Health Science into Better Health Outcomes

PubMed Central

Sutton, Patrice

2014-01-01

Background: Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. Objectives: We sought to develop a proof of concept of the “Navigation Guide,” a systematic and transparent method of research synthesis in environmental health. Discussion: The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of “risk of bias,” and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a “moderate” quality rating to human observational studies and combining diverse evidence streams. Conclusions: The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm. Citation: Woodruff TJ, Sutton P. 2014. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122:1007–1014; http://dx.doi.org/10.1289/ehp.1307175 PMID:24968373

Influence of organizational factors on safety

DOE Office of Scientific and Technical Information (OSTI.GOV)

Haber, S.B.; Metlay, D.S.; Crouch, D.A.

There is a need for a better understanding of exactly how organizational management factors at a nuclear power plant (NPP) affect plant safety performance, either directly or indirectly, and how these factors might be observed, measured, and evaluated. The purpose of this research project is to respond to that need by developing a general methodology for characterizing these organizational and management factors, systematically collecting information on their status and integrating that information into various types of evaluative activities. Research to date has included the development of the Nuclear Organization and Management Analysis Concept (NOMAC) of a NPP, the identification ofmore » key organizational and management factors, and the identification of the methods for systematically measuring and analyzing the influence of these factors on performance. Most recently, two field studies, one at a fossil fuel plant and the other at a NPP, were conducted using the developed methodology. Results are presented from both studies highlighting the acceptability, practicality, and usefulness of the methods used to assess the influence of various organizational and management factors including culture, communication, decision-making, standardization, and oversight. 6 refs., 3 figs., 1 tab.« less

Evidence-based interventions in pediatric psychology: progress over the decades.

PubMed

Palermo, Tonya M

2014-09-01

This introduction to the special issue on Evidence-Based Interventions in Pediatric Psychology provides background on the process used to develop the special issue, a summary of the key findings from the series of reviews, and discussion of the implications for evidence-based practice. Authors followed a three-phase approach to develop their systematic reviews using rigorous systematic review methodology drawn heavily from the Cochrane Collaboration. The strength of the evidence for each pediatric psychology intervention was evaluated using Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology. The introduction discusses the progress that has been made in the evidence base for pediatric psychology interventions since the first special series published in 1999. Recommendations to stimulate further research and expand and strengthen the quality of the evidence base are described. The introduction concludes with implications from the special issue for pediatric psychology training in evidence-based practice. © The Author 2014. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Academic/State/Federal collaborations and the improvement of practices in disaster mental health services and evaluation.

PubMed

Watson, Patricia J; Ruzek, Josef I

2009-05-01

Academic, state, and federal agencies collaborated over the last 9 years to improve disaster mental health services and evaluation. This process, which included literature reviews, a number of expert panels, and case studies, is described. The products resulting from this process have included the development of a systematic cross-site evaluation of the federally funded crisis counseling program and field guides for interventions aimed at providing services to distressed individuals in the immediate aftermath of disasters and to individuals needing resilience skills training weeks or months after the event. Future improvement of disaster mental health services calls for continued research, evaluation, training, and intervention development.

A systematic approach to the application of Automation, Robotics, and Machine Intelligence Systems /ARAMIS/ to future space projects

NASA Technical Reports Server (NTRS)

Smith, D. B. S.

1982-01-01

The potential applications of Automation, Robotics, and Machine Intelligence Systems (ARAMIS) to space projects are investigated, through a systematic method. In this method selected space projects are broken down into space project tasks, and 69 of these tasks are selected for study. Candidate ARAMIS options are defined for each task. The relative merits of these options are evaluated according to seven indices of performance. Logical sequences of ARAMIS development are also defined. Based on this data, promising applications of ARAMIS are

The use of individualized contract plans as a method of performance evaluation for allied health faculty.

PubMed

Mitcham, M D; Vericella, B J

1985-11-01

Results from a two-year study of the individualized contract plan (ICP) approach to faculty evaluation indicate this is a workable method of performance evaluation for allied health faculty. The ICP was found to be individualized, systematic, flexible, and objective. Faculty members and department chairpersons differed in their perception of the effectiveness of the ICP, but both groups supported its continued use. Five major recommendations were made regarding the continued use of the ICP as a method of faculty performance evaluation: (1) separate evaluation and professional development aspects, (2) link results to the institutional reward structure, (3) administer the ICP uniformly among departments, (4) develop a monitoring mechanism, and (5) foster open communication among all participants in the system.

Development of an integrated surface stimulation device for systematic evaluation of wound electrotherapy.

PubMed

Howe, D S; Dunning, J; Zorman, C; Garverick, S L; Bogie, K M

2015-02-01

Ideally, all chronic wounds would be prevented as they can become life threatening complications. The concept that a wound produces a 'current of injury' due to the discontinuity in the electrical field of intact skin provides the basis for the concept that electrical stimulation (ES) may provide an effective treatment for chronic wounds. The optimal stimulation waveform parameters are unknown, limiting the reliability of achieving a successful clinical therapeutic outcome. In order to gain a more thorough understanding of ES for chronic wound therapy, systematic evaluation using a valid in vivo model is required. The focus of the current paper is development of the flexible modular surface stimulation (MSS) device by our group. This device can be programed to deliver a variety of clinically relevant stimulation paradigms and is essential to facilitate systematic in vivo studies. The MSS version 2.0 for small animal use provides all components of a single-channel, programmable current-controlled ES system within a lightweight, flexible, independently-powered portable device. Benchtop testing and validation indicates that custom electronics and control algorithms support the generation of high-voltage, low duty-cycle current pulses in a power-efficient manner, extending battery life and allowing ES therapy to be delivered for up to 7 days without needing to replace or disturb the wound dressing.

Methods of classification for women undergoing induction of labour: a systematic review and novel classification system.

PubMed

Nippita, T A; Khambalia, A Z; Seeho, S K; Trevena, J A; Patterson, J A; Ford, J B; Morris, J M; Roberts, C L

2015-09-01

A lack of reproducible methods for classifying women having an induction of labour (IOL) has led to controversies regarding IOL and related maternal and perinatal health outcomes. To evaluate articles that classify IOL and to develop a novel IOL classification system. Electronic searches using CINAHL, EMBASE, WEB of KNOWLEDGE, and reference lists. Two reviewers independently assessed studies that classified women having an IOL. For the systematic review, data were extracted on study characteristics, quality, and results. Pre-specified criteria were used for evaluation. A multidisciplinary collaboration developed a new classification system using a clinically logical model and stakeholder feedback, demonstrating applicability in a population cohort of 909 702 maternities in New South Wales, Australia, over the period 2002-2011. All seven studies included in the systematic review categorised women according to the presence or absence of varying medical indications for IOL. Evaluation identified uncertainties or deficiencies across all studies, related to the criteria of total inclusivity, reproducibility, clinical utility, implementability, and data availability. A classification system of ten groups was developed based on parity, previous caesarean, gestational age, number, and presentation of the fetus. Nulliparous and parous women at full term were the largest groups (21.2 and 24.5%, respectively), and accounted for the highest proportion of all IOL (20.7 and 21.5%, respectively). Current methods of classifying women undertaking IOL based on medical indications are inadequate. We propose a classification system that has the attributes of simplicity and clarity, uses information that is readily and reliably collected, and enables the standard characterisation of populations of women having an IOL across and within jurisdictions. © 2015 Royal College of Obstetricians and Gynaecologists.

Searching for evidence or approval? A commentary on database search in systematic reviews and alternative information retrieval methodologies.

PubMed

Delaney, Aogán; Tamás, Peter A

2018-03-01

Despite recognition that database search alone is inadequate even within the health sciences, it appears that reviewers in fields that have adopted systematic review are choosing to rely primarily, or only, on database search for information retrieval. This commentary reminds readers of factors that call into question the appropriateness of default reliance on database searches particularly as systematic review is adapted for use in new and lower consensus fields. It then discusses alternative methods for information retrieval that require development, formalisation, and evaluation. Our goals are to encourage reviewers to reflect critically and transparently on their choice of information retrieval methods and to encourage investment in research on alternatives. Copyright © 2017 John Wiley & Sons, Ltd.

The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview

PubMed Central

Black, Ashly D.; Car, Josip; Pagliari, Claudia; Anandan, Chantelle; Cresswell, Kathrin; Bokun, Tomislav; McKinstry, Brian; Procter, Rob; Majeed, Azeem; Sheikh, Aziz

2011-01-01

Background There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care. Methods and Findings We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking. Conclusions There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and “techno-enthusiasts” as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption. Please see later in the article for the Editors' Summary PMID:21267058

Rational decision-making in mental health: the role of systematic reviews.

PubMed

Gilbody, Simon M.; Petticrew, Mark

1999-09-01

BACKGROUND: "Systematic reviews" have come to be recognized as the most rigorous method of summarizing confusing and often contradictory primary research in a transparent and reproducible manner. Their greatest impact has been in the summarization of epidemiological literature - particularly that relating to clinical effectiveness. Systematic reviews also have a potential to inform rational decision-making in healthcare policy and to form a component of economic evaluation. AIMS OF THE STUDY: This article aims to introduce the rationale behind systematic reviews and, using examples from mental health, to introduce the strengths and limitations of systematic reviews, particularly in informing mental health policy and economic evaluation. METHODS: Examples are selected from recent controversies surrounding the introduction of new psychiatric drugs (anti-depressants and anti-schizophrenia drugs) and methods of delivering psychiatric care in the community (case management and assertive community treatment). The potential for systematic reviews to (i) produce best estimates of clinical efficacy and effectiveness, (ii) aid economic evaluation and policy decision-making and (iii) highlight gaps in the primary research knowledge base are discussed. Lastly examples are selected from outside mental health to show how systematic reviews have a potential to be explicitly used in economic and health policy evaluation. RESULTS: Systematic reviews produce the best estimates of clinical efficacy, which can form an important component of economic evaluation. Importantly, serious methodological flaws and areas of uncertainty in the primary research literature are identified within an explicit framework. Summary indices of clinical effectiveness can be produced, but it is difficult to produce such summary indices of cost effectiveness by pooling economic data from primary studies. Modelling is commonly used in economic and policy evaluation. Here, systematic reviews can provide the best estimates of effectiveness and, importantly, highlight areas of uncertainty that can be used in "sensitivity analysis". DISCUSSION: Systematic reviews are an important recent methodological advance, the potential for which has only begun to be realized in mental health. This use of systematic reviews is probably most advanced in producing critical summaries of clinical effectiveness data. Systematic reviews cannot produce valid and believable conclusions when the primary research literature is of poor quality. An important function of systematic reviews will be in highlighting this poor quality research which is of little use in mental health decision making. IMPLICATIONS FOR HEALTH PROVISION: Health care provision should be both clinically and cost effective. Systematic reviews are a key component in ensuring that this goal is achieved. IMPLICATIONS FOR HEALTH POLICIES: Systematic reviews have potential to inform health policy. Examples presented show that health policy is often made without due consideration of the research evidence. Systematic reviews can provide robust and believable answers, which can help inform rational decision-making. Importantly, systematic reviews can highlight the need for important primary research and can inform the design of this research such that it provides answers that will help in forming healthcare policy. IMPLICATIONS FOR FURTHER RESEARCH: Systematic reviews should precede costly (and often unnecessary) primary research. Many areas of health policy and practice have yet to be evaluated using systematic review methodology. Methods for the summarization of economic data are methodologically complex and deserve further research

A Systematic Review of Economic Evaluations of Treatments for Borderline Personality Disorder

PubMed Central

Brettschneider, Christian; Riedel-Heller, Steffi; König, Hans-Helmut

2014-01-01

Purpose The borderline personality disorder is a common mental disorder. It is frequently associated with various mental co-morbidities and a fundamental loss of functioning. The borderline personality disorder causes high costs to society. The aim of this study was to perform a systematic literature review of existing economic evaluations of treatments for borderline personality disorder. Materials and Methods We performed a systematic literature search in MEDLINE, EMBASE, PsycINFO and NHSEED for partial and full economic evaluations regarding borderline personality disorder. Reported cost data were inflated to the year 2012 and converted into US-$ using purchasing power parities to allow for comparability. Quality assessment of the studies was performed by means of the Consensus on Health Economic Criteria checklist, a checklist developed by a Delphi method in cooperation with 23 international experts. Results We identified 6 partial and 9 full economic evaluations. The methodical quality was moderate (fulfilled quality criteria: 79.2% [SD: 15.4%] in partial economic evaluations, 77.3% [SD: 8.5%] in full economic evaluations). Most evaluations analysed psychotherapeutic interventions. Although ambiguous, most evidence exists on dialectical-behavioural therapy. Cognitive behavioural therapy and schema-focused therapy are cost-saving. Evidence on other interventions is scarce. Conclusion The economic evidence is not sufficient to draw robust conclusions for all treatments. It is possible that some treatments are cost-effective. Most evidence exists on dialectical-behavioural therapy. Yet, it is ambiguous. Further research concerning the cost-effectiveness of treatments is necessary as well as the identification of relevant cost categories and the validation of effect measures. PMID:25265185

The process of collecting and evaluating evidences for the development of Guidelines for the management of rheumatoid arthritis, Japan College of Rheumatology 2014: Utilization of GRADE approach.

PubMed

Kojima, Masayo; Nakayama, Takeo; Kawahito, Yutaka; Kaneko, Yuko; Kishimoto, Mitsumasa; Hirata, Shintaro; Seto, Yohei; Endo, Hirahito; Ito, Hiromu; Kojima, Toshihisa; Nishida, Keiichiro; Matsushita, Isao; Tsutani, Kiichiro; Igarashi, Ataru; Kamatani, Naoyuki; Hasegawa, Mieko; Miyasaka, Nobuyuki; Yamanaka, Hisashi

2016-01-01

To describe the process of collecting and evaluating evidence for treating rheumatoid arthritis (RA) for developing clinical practice guidelines (CPGs) for rheumatologists in Japan. The task force comprised rheumatologists, epidemiologists, health economists, and patients. First, the critical outcomes were determined according to a three-round Delphi method, and eight topics with 88 clinical questions (CQs) were formulated. A systematic review of CQs was conducted using the Cochran Database of Systematic Reviews, MEDLINE, and Japana Centra Revvo Medicina (2003-2012). A questionnaire survey and focus group interview were performed to capture the patients' values and preferences. Data from the National Health Insurance drug price list and product information provided by pharmaceutical companies were collected to evaluate drug cost and safety. The GRADE approach was used to describe the evidence quality and determine the strength of recommendations. Recommendations were developed using a modified Delphi method by a multidisciplinary panel including patients. Eight meetings and frequent e-mail communications were conducted to draft a quality assessment of evidence and recommendations. For 88 CQs, recommendation statements were determined. Using the GRADE approach, new CPGs successfully addressed important clinical issues for treating RA patients. Timely updating of recommendations should be routinely considered.

Overview of systematic reviews of therapeutic ranges: methodologies and recommendations for practice.

PubMed

Cooney, Lewis; Loke, Yoon K; Golder, Su; Kirkham, Jamie; Jorgensen, Andrea; Sinha, Ian; Hawcutt, Daniel

2017-06-02

Many medicines are dosed to achieve a particular therapeutic range, and monitored using therapeutic drug monitoring (TDM). The evidence base for a therapeutic range can be evaluated using systematic reviews, to ensure it continues to reflect current indications, doses, routes and formulations, as well as updated adverse effect data. There is no consensus on the optimal methodology for systematic reviews of therapeutic ranges. An overview of systematic reviews of therapeutic ranges was undertaken. The following databases were used: Cochrane Database of Systematic Reviews (CDSR), Database of Abstracts and Reviews of Effects (DARE) and MEDLINE. The published methodologies used when systematically reviewing the therapeutic range of a drug were analyzed. Step by step recommendations to optimize such systematic reviews are proposed. Ten systematic reviews that investigated the correlation between serum concentrations and clinical outcomes encompassing a variety of medicines and indications were assessed. There were significant variations in the methodologies used (including the search terms used, data extraction methods, assessment of bias, and statistical analyses undertaken). Therapeutic ranges should be population and indication specific and based on clinically relevant outcomes. Recommendations for future systematic reviews based on these findings have been developed. Evidence based therapeutic ranges have the potential to improve TDM practice. Current systematic reviews investigating therapeutic ranges have highly variable methodologies and there is no consensus of best practice when undertaking systematic reviews in this field. These recommendations meet a need not addressed by standard protocols.

Indicator development methodology for volunteer tourism in host communities: creating a low-cost, locally applicable, rapid assessment tool

Treesearch

Christopher A. Lupoli; Wayde C. Morse; Conner Bailey; John Schelhas

2015-01-01

Two prominent critiques of volunteer tourism are that it is a top-down imposed form of development treating host communities as passive recipients of international aid, and that the impacts of volunteer tourism in host communities are not systematically evaluated. To address this we identified a pre-existing participatory methodology for assessing community...

Contribution of L-band SAR to systematic global mangrove monitoring

Treesearch

Richard Lucas; Lias-Maria Rebelo; Lola Fatoyinbo; Ake Rosenqvist; Takuya Itoh; Masanobu Shimada; Marc Simard; Pedro Walfir Souza-Filho; Nathan Thomas; Carl Trettin; Arnon Accad; Joao Carreiras; Lammert Hilarides

2014-01-01

Information on the status of and changes in mangroves is required for national and international policy development, implementation and evaluation. To support these requirements, a component of the Japan Aerospace Exploration Agency’s (JAXA) Kyoto and Carbon (K&C) initiative has been to design and develop capability for a Global Mangrove Watch (GMW) that routinely...

Integrating Non-Mathematical Domains into Mathematical Development: Key Factors to Consider in Constructing Effective Interventions

ERIC Educational Resources Information Center

Purpura, David J.; Ganley, Colleen

2013-01-01

The successful acquisition and development of mathematics skills and concepts is a critical aspect of children's early academic growth. The purpose of this study was to systematically evaluate the unique relations of working memory and language to a range of specific early mathematics skills in a sample of preschool and kindergarten age children.…

A Symposium: Relevant Cue Research, a Program of Systematic Evaluation: Considerations for Sustaining Instructional Design Research Using an Integrated Learning System.

ERIC Educational Resources Information Center

Grabowski, Barbara

An intelligent videodisc system on which comprehensive instructional development research can be conducted has been developed. This integrated learning system combines all other existing media, except objects, using a videodisc, microcomputer, printer, single monitor, hard disc storage with CPU for random access digitized audio, and headphones.…

Public Perception of the Millennium Development Goals on Access to Safe Drinking Water in Cross River State, Nigeria

ERIC Educational Resources Information Center

Eni, David D.; Ojong, William M.

2014-01-01

This study evaluated the public perception of Millennium Development Goals (MDGs) of environmental sustainability with focus on the MDG target which has to do with reducing the proportion of people without access to safe drinking water in Cross River State, Nigeria. The stratified and systematic sampling techniques were adopted for the study,…

Development and Application of a Computer Simulation Program to Enhance the Clinical Problem-Solving Skills of Students.

ERIC Educational Resources Information Center

Boh, Larry E.; And Others

1987-01-01

A project to (1) develop and apply a microcomputer simulation program to enhance clinical medication problem solving in preclerkship and clerkship students and (2) perform an initial formative evaluation of the simulation is described. A systematic instructional design approach was used in applying the simulation to the disease state of rheumatoid…

Development of a Comprehensive Hospital-Based Elder Abuse Intervention: An Initial Systematic Scoping Review

PubMed Central

Du Mont, Janice; Macdonald, Sheila; Kosa, Daisy; Elliot, Shannon; Spencer, Charmaine; Yaffe, Mark

2015-01-01

Introduction Elder abuse, a universal human rights problem, is associated with many negative consequences. In most jurisdictions, however, there are no comprehensive hospital-based interventions for elder abuse that address the totality of needs of abused older adults: psychological, physical, legal, and social. As the first step towards the development of such an intervention, we undertook a systematic scoping review. Objectives Our primary objective was to systematically extract and synthesize actionable and applicable recommendations for components of a multidisciplinary intersectoral hospital-based elder abuse intervention. A secondary objective was to summarize the characteristics of the responses reviewed, including methods of development and validation. Methods The grey and scholarly literatures were systematically searched, with two independent reviewers conducting the title, abstract and full text screening. Documents were considered eligible for inclusion if they: 1) addressed a response (e.g., an intervention) to elder abuse, 2) contained recommendations for responding to abused older adults with potential relevance to a multidisciplinary and intersectoral hospital-based elder abuse intervention; and 3) were available in English. Analysis The extracted recommendations for care were collated, coded, categorized into themes, and further reviewed for relevancy to a comprehensive hospital-based response. Characteristics of the responses were summarized using descriptive statistics. Results 649 recommendations were extracted from 68 distinct elder abuse responses, 149 of which were deemed relevant and were categorized into 5 themes: Initial contact; Capacity and consent; Interview with older adult, caregiver, collateral contacts, and/or suspected abuser; Assessment: physical/forensic, mental, psychosocial, and environmental/functional; and care plan. Only 6 responses had been evaluated, suggesting a significant gap between development and implementation of recommendations. Discussion To address the lack of evidence to support the recommendations extracted in this review, in a future study, a group of experts will formally evaluate each recommendation for its inclusion in a comprehensive hospital-based response. PMID:25938414

The development of search filters for adverse effects of surgical interventions in medline and Embase.

PubMed

Golder, Su; Wright, Kath; Loke, Yoon Kong

2018-06-01

Search filter development for adverse effects has tended to focus on retrieving studies of drug interventions. However, a different approach is required for surgical interventions. To develop and validate search filters for medline and Embase for the adverse effects of surgical interventions. Systematic reviews of surgical interventions where the primary focus was to evaluate adverse effect(s) were sought. The included studies within these reviews were divided randomly into a development set, evaluation set and validation set. Using word frequency analysis we constructed a sensitivity maximising search strategy and this was tested in the evaluation and validation set. Three hundred and fifty eight papers were included from 19 surgical intervention reviews. Three hundred and fifty two papers were available on medline and 348 were available on Embase. Generic adverse effects search strategies in medline and Embase could achieve approximately 90% relative recall. Recall could be further improved with the addition of specific adverse effects terms to the search strategies. We have derived and validated a novel search filter that has reasonable performance for identifying adverse effects of surgical interventions in medline and Embase. However, we appreciate the limitations of our methods, and recommend further research on larger sample sizes and prospective systematic reviews. © 2018 The Authors Health Information and Libraries Journal published by John Wiley & Sons Ltd on behalf of Health Libraries Group.

Systematic review of guidelines for management of intermediate hepatocellular carcinoma using the Appraisal of Guidelines Research and Evaluation II instrument.

PubMed

Holvoet, Tom; Raevens, Sarah; Vandewynckel, Yves-Paul; Van Biesen, Wim; Geboes, Karen; Van Vlierberghe, Hans

2015-10-01

Hepatocellular carcinoma is the second leading cause of cancer-related mortality worldwide. Multiple guidelines have been developed to assist clinicians in its management. We aimed to explore methodological quality of these guidelines focusing on treatment of intermediate hepatocellular carcinoma by transarterial chemoembolization. A systematic search was performed for Clinical Practice Guidelines and Consensus statements for hepatocellular carcinoma management. Guideline quality was appraised using the Appraisal of Guidelines Research and Evaluation II instrument, which rates guideline development processes across 6 domains: 'Scope and purpose', 'Stakeholder involvement', 'Rigour of development', 'Clarity of presentation', 'Applicability' and 'Editorial independence'. Thematic analysis of guidelines was performed to map differences in recommendations. Quality of 21 included guidelines varied widely, but was overall poor with only one guideline passing the 50% mark on all domains. Key recommendations as (contra)indications and technical aspects were inconsistent between guidelines. Aspects on side effects and health economics were mainly neglected. Methodological quality of guidelines on transarterial chemoembolization in hepatocellular carcinoma management is poor. This results in important discrepancies between guideline recommendations, creating confusion in clinical practice. Incorporation of the Appraisal of Guidelines Research and Evaluation II instrument in guideline development may improve quality of future guidelines by increasing focus on methodological aspects. Copyright © 2015 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

EVALUATING PERTUBATIONS AND DEVELOPING RESTORATION STRATEGIES FOR INLAND WETLANDS IN THE GREAT LAKES BASIN

EPA Science Inventory

Wetland coverage and type distributions vary systematically by ecoregion across the Great Lakes Basin. Land use and subsequent changes in wetland type distributions also vary among ecoregions. Incidence of wetland disturbance varies significantly within ecoregions but tends to i...

Adopting Health Behavior Change Theory throughout the Clinical Practice Guideline Process

ERIC Educational Resources Information Center

Ceccato, Natalie E.; Ferris, Lorraine E.; Manuel, Douglas; Grimshaw, Jeremy M.

2007-01-01

Adopting a theoretical framework throughout the clinical practice guideline (CPG) process (development, dissemination, implementation, and evaluation) can be useful in systematically identifying, addressing, and explaining behavioral influences impacting CPG uptake and effectiveness. This article argues that using a theoretical framework should…

High speed ground penetrating radar for road pavement and bridge structural inspection and maintenance : final report.

DOT National Transportation Integrated Search

2016-06-30

The overarching objective of this research is the development of a systematic methodology of employing GPR, including instruments, subsequent data processing and interpretation that can be used regularly as part of a roadway pavement and bridge evalu...

Computers in the Schools: State/Provincial Implications.

ERIC Educational Resources Information Center

Thiessen, S. J.

The Alberta goverment has attempted to systematically address educational computing issues through programs of the provincial (K-12) education department (Alberta Education), which have included the development of computer literacy curricula for elementary, junior, and senior high schools; the Computer Technology Project (CTP); evaluation studies;…

The cellular uptake and transport of zein nanoparticles: Effect of sodium caseinate

USDA-ARS?s Scientific Manuscript database

Cellular evaluation of zein nanoparticles has not been studied systematically due to their poor redispersibility. Caseinate (CAS) stabilized zein nanoparticles have been recently developed with better redispersibility in salt solutions. In this study, zein-CAS nanoparticles were prepared with differ...

The Multiple Component Alternative for Gifted Education.

ERIC Educational Resources Information Center

Swassing, Ray

1984-01-01

The Multiple Component Model (MCM) of gifted education includes instruction which may overlap in literature, history, art, enrichment, languages, science, physics, math, music, and dance. The model rests on multifactored identification and requires systematic development and selection of components with ongoing feedback and evaluation. (CL)

[Distance education in neonatal nursing scenarios: a systematic review].

PubMed

Freire, Laís Machado; Paula, Mariane Andreza de; Duarte, Elysangela Dittz; Bueno, Mariana

2015-06-01

Identify resources that support learning mediated by technology in the field of neonatal nursing. Systematic review with searches conducted in MEDLINE, LILACS and SciELO. Titles and abstracts were independently evaluated by two experts. Of the 2,051 references, 203 full-text articles were analyzed, resulting in the inclusion of nine studies on semiotics and semiology, cardiopulmonary resuscitation, general aspects of neonatal care, diagnostic reasoning and assessment of pain. Only two articles addressed the development of educational strategies and seven papers described the assessment of these strategies by experts and/or users. Distance education is an important resource for education, and its improvement and updating, and it particularly adds advantages for neonatal nursing by approximating teaching and real-life situations and by minimizing the exposure of newborns for teaching purposes. The lack of educational initiatives mediated by technology suggests the need for the development, evaluation and dissemination of educational resources focused on nursing care of newborns and their families.

Reducing healthcare costs facilitated by surgical auditing: a systematic review.

PubMed

Govaert, Johannes Arthuur; van Bommel, Anne Charlotte Madeline; van Dijk, Wouter Antonie; van Leersum, Nicoline Johanneke; Tollenaar, Robertus Alexandre Eduard Mattheus; Wouters, Michael Wilhemus Jacobus Maria

2015-07-01

Surgical auditing has been developed in order to benchmark and to facilitate quality improvement. The aim of this review is to determine if auditing combined with systematic feedback of information on process and outcomes of care results in lower costs of surgical care. A systematic search of published literature before 21-08-2013 was conducted in Pubmed, Embase, Web of Science, and Cochrane Library. Articles were selected if they met the inclusion criteria of describing a surgical audit with cost-evaluation. The systematic search resulted in 3608 papers. Six studies were identified as relevant, all showing a positive effect of surgical auditing on quality of healthcare and therefore cost savings was reported. Cost reductions ranging from $16 to $356 per patient were seen in audits evaluating general or vascular procedures. The highest potential cost reduction was described in a colorectal surgical audit (up to $1,986 per patient). All six identified articles in this review describe a reduction in complications and thereby a reduction in costs due to surgical auditing. Surgical auditing may be of greater value when high-risk procedures are evaluated, since prevention of adverse events in these procedures might be of greater clinical and therefore of greater financial impact. This systematic review shows that surgical auditing can function as a quality instrument and therefore as a tool to reduce costs. Since evidence is scarce so far, further studies should be performed to investigate if surgical auditing has positive effects to turn the rising healthcare costs around. In the future, incorporating (actual) cost analyses and patient-related outcome measures would increase the audits' value and provide a complete overview of the value of healthcare.

Comprehensive evaluation on low-carbon development of coal enterprise groups.

PubMed

Wang, Bang-Jun; Wu, Yan-Fang; Zhao, Jia-Lu

2017-12-19

Scientifically evaluating the level of low-carbon development in terms of theoretical and practical significance is extremely important to coal enterprise groups for implementing national energy-related systems. This assessment can assist in building institutional mechanisms that are conducive for the economic development of coal business cycle and energy conservation as well as promoting the healthy development of coal enterprises to realize coal scientific development and resource utilization. First, by adopting systematic analysis method, this study builds low-carbon development evaluation index system for coal enterprise groups. Second, to determine the weight serving as guideline and criteria of the index, analytic hierarchy process (AHP) is applied using integrated linear weighted sum method to evaluate the level of low-carbon development of coal enterprise groups. Evaluation is also performed by coal enterprise groups, and the process comprises field analysis and evaluation. Finally, industrial policies are proposed regarding the development of low-carbon coal conglomerate strategies and measures. This study aims mainly to guide the low-carbon development of coal enterprise groups, solve the problem of coal mining and the destruction of ecological environment, support the conservation of raw materials and various resources, and achieve the sustainable development of the coal industry.

Feeding the brain - The effects of micronutrient interventions on cognitive performance among school-aged children: A systematic review of randomized controlled trials.

PubMed

Lam, Long Fung; Lawlis, Tanya R

2017-08-01

Micronutrients are essential for brain development with deficiencies in specific nutrients linked to impaired cognitive function. Interventions are shown to be beneficial to children's mental development, particularly in subjects who were micronutrient-deficient at baseline but results on healthy subjects remain inconsistent. This systematic review evaluated the effect of micronutrient inventions on different cognitive domains. Studies conducted in both developing and developed countries, and trials that investigate the effect of both single and multiple micronutrient intervention were reviewed. Systematic searches of Medline, CINAHL Plus and Academic Search database were undertaken to identify trials published after year 2000. Randomized controlled trials (RCTs) that evaluate the effect of micronutrients on cognitive performance or academic performance among children aged 4-18 years were included. 19 trials were identified from 18 articles. The major cognitive outcomes assessed included fluid intelligence, crystallized intelligence, short-term memory, long-term memory, cognitive processing speed, attention and concentration, and school performance. Eight of ten trials assessing fluid intelligence reported significant positive effects of micronutrient supplementation among micronutrient-deficient children, especially those who were iron-deficient or iodine-deficient at baseline. The effects of micronutrient interventions on other domains were inconsistent. Improvement in fluid intelligence among micronutrient-deficient children was consistently reported. Further research is needed to provide more definite evidence on the beneficial effects of micronutrient inventions on other cognitive domains and the effects in healthy subjects. Copyright © 2016 Elsevier Ltd and European Society for Clinical Nutrition and Metabolism. All rights reserved.

A systematic review and overview of health economic evaluations of emergency laparotomy.

PubMed

Bampoe, Sohail; Odor, Peter M; Ramani Moonesinghe, S; Dickinson, Matthew

2017-01-01

Little is known about the economic impact of emergency laparotomy (EL) surgery in healthcare systems around the world. The aim of this systematic review is to describe the primary resource utilisation, healthcare economic and societal costs of EL in adults in different countries. MEDLINE, EMBASE, ISI Web of Knowledge, Cochrane Central Register Controlled Trials, Cochrane Database of Systematic Reviews and CINAHL were searched for full and partial economic analyses of EL published between 1 January 1991 and 31 December 2015. Quality of studies was assessed using the Consensus on Health Economic Criteria (CHEC) checklist. Sixteen studies were included from a range of countries. One study was a full economic analysis. Fifteen studies were partial economic evaluations. These studies revealed that emergency abdominal surgery is expensive compared to similar elective surgery when comparing primary resource utilisation costs, with an important societal impact. Most contemporaneous studies indicate that in-hospital costs for EL are in excess of US$10,000 per patient episode, rising substantially when societal costs are considered. EL is a high-risk and costly procedure with a disproportionate financial burden for healthcare providers, relative to national funding provisions and wider societal cost impact. There is substantial heterogeneity in the methodologies and quality of published economic evaluations of EL; therefore, the true economic costs of EL are yet to be fully defined. Future research should focus on developing strategies to embed health economic evaluations within national programmes aiming to improve EL care, including developing the required measures and infrastructure. Emergency laparotomy is expensive, with a significant cost burden to healthcare and systems and society worldwide. Novel strategies for reducing this econmic burden should urgently be explored if greater access to this type of surgery is to be pursued as a global health target. PROSPERO registration no. 42015027210.

Communication skills assessment in the final postgraduate years to established practice: a systematic review.

PubMed

Gillis, Amy E; Morris, Marie C; Ridgway, Paul F

2015-01-01

Communication breakdown is a factor in the majority of all instances of medical error. Despite the importance, a relative paucity of time is invested in communication skills in postgraduate curricula. Our objective is to systematically review the literature to identify the current tools used to assess communication skills in postgraduate trainees in the latter 2 years of training and in established practice. Two reviewers independently reviewed the literature identifying communication skill assessment tools, for postgraduate trainees in the latter 2 years of training and in established practice following Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, and inclusion/exclusion criteria from January 1990 to 15 August 2014. PubMed/CINAHL/ERIC/EMBASE/PsycInfo/Psyc Articles/Cochrane. 222 articles were identified; after review, 34 articles fulfilled criteria for complete evaluation; the majority (26) had a high level of evidence scoring 3 or greater on the Best Evidence Medical Education guide. 22 articles used objective structured clinical examination/standardised patient (SP)-based formats in an assessment or training capacity. Evaluation tools included author-developed questionnaires and validated tools. Nineteen articles demonstrated an educational initiative. The reviewed literature is heterogeneous for objectives and measurement techniques for communication. Observed interactions, with patients or SPs, is the current favoured method of evaluation using author-developed questionnaires. The role of self-evaluation of skill level is questioned. The need for a validated assessment tool for communication skills is highlighted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Influence of the cranial base flexion on Class I, II and III malocclusions: a systematic review.

PubMed

Almeida, Kélei Cristina Mathias de; Raveli, Taísa Boamorte; Vieira, Camila Ivini Viana; Santos-Pinto, Ary Dos; Raveli, Dirceu Barnabé

2017-01-01

The aim of this study was to perform a systematic review on the morphological characteristics of the skull base (flexion, anterior length and posterior length) and the concomitant development of malocclusions, by comparing differences in dimorphism, ethnicity and age. The articles were selected by means of electronic search on BBO, MEDLINE and LILACS databases from 1966 to 2016. A qualitative evaluation of the methodologies used on the articles was also performed. Although the literature on this topic is abundant, only 16 articles were selected for the present systematic review. The cranial base angle itself does not seem to play a significant role in the development of malocclusions. In fact, the cranial base angle is relatively stable at the ages of 5 to 15 years. A more obtuse angle at the skull base, in association or not with a greater anterior length of the cranial base, can contribute to the development of Class II division 1 malocclusions. On the other hand, a more acute angle at the skull base can contribute to a more anterior positioning of the mandible and to the development of Class III malocclusions.

Influence of the cranial base flexion on Class I, II and III malocclusions: a systematic review

PubMed Central

de Almeida, Kélei Cristina Mathias; Raveli, Taísa Boamorte; Vieira, Camila Ivini Viana; dos Santos-Pinto, Ary; Raveli, Dirceu Barnabé

2017-01-01

ABSTRACT Objective: The aim of this study was to perform a systematic review on the morphological characteristics of the skull base (flexion, anterior length and posterior length) and the concomitant development of malocclusions, by comparing differences in dimorphism, ethnicity and age. Methods: The articles were selected by means of electronic search on BBO, MEDLINE and LILACS databases from 1966 to 2016. A qualitative evaluation of the methodologies used on the articles was also performed. Results: Although the literature on this topic is abundant, only 16 articles were selected for the present systematic review. The cranial base angle itself does not seem to play a significant role in the development of malocclusions. In fact, the cranial base angle is relatively stable at the ages of 5 to 15 years. Conclusions: A more obtuse angle at the skull base, in association or not with a greater anterior length of the cranial base, can contribute to the development of Class II division 1 malocclusions. On the other hand, a more acute angle at the skull base can contribute to a more anterior positioning of the mandible and to the development of Class III malocclusions. PMID:29160345

Economics methods in Cochrane systematic reviews of health promotion and public health related interventions

PubMed Central

Shemilt, Ian; Mugford, Miranda; Drummond, Michael; Eisenstein, Eric; Mallender, Jacqueline; McDaid, David; Vale, Luke; Walker, Damian

2006-01-01

Background Provision of evidence on costs alongside evidence on the effects of interventions can enhance the relevance of systematic reviews to decision-making. However, patterns of use of economics methods alongside systematic review remain unclear. Reviews of evidence on the effects of interventions are published by both the Cochrane and Campbell Collaborations. Although it is not a requirement that Cochrane or Campbell Reviews should consider economic aspects of interventions, many do. This study aims to explore and describe approaches to incorporating economics methods in a selection of Cochrane systematic reviews in the area of health promotion and public health, to help inform development of methodological guidance on economics for reviewers. Methods The Cochrane Database of Systematic Reviews was searched using a search strategy for potential economic evaluation studies. We included current Cochrane reviews and review protocols retrieved using the search that are also identified as relevant to health promotion or public health topics. A reviewer extracted data which describe the economics components of included reviews. Extracted data were summarised in tables and analysed qualitatively. Results Twenty-one completed Cochrane reviews and seven review protocols met inclusion criteria. None incorporate formal economic evaluation methods. Ten completed reviews explicitly aim to incorporate economics studies and data. There is a lack of transparent reporting of methods underpinning the incorporation of economics studies and data. Some reviews are likely to exclude useful economics studies and data due to a failure to incorporate search strategies tailored to the retrieval of such data or use of key specialist databases, and application of inclusion criteria designed for effectiveness studies. Conclusion There is a need for consistency and transparency in the reporting and conduct of the economics components of Cochrane reviews, as well as regular dialogue between Cochrane reviewers and economists to develop increased capacity for economic analyses alongside such reviews. Use of applicable economics methods in Cochrane reviews can help provide the international context within which economics data can be interpreted and assessed as a preliminary to full economic evaluation. PMID:17107612

Scientific Evaluation and Review of Claims in Health Care (SEaRCH): A Streamlined, Systematic, Phased Approach for Determining "What Works" in Healthcare.

PubMed

Jonas, Wayne B; Crawford, Cindy; Hilton, Lara; Elfenbaum, Pamela

2017-01-01

Answering the question of "what works" in healthcare can be complex and requires the careful design and sequential application of systematic methodologies. Over the last decade, the Samueli Institute has, along with multiple partners, developed a streamlined, systematic, phased approach to this process called the Scientific Evaluation and Review of Claims in Health Care (SEaRCH™). The SEaRCH process provides an approach for rigorously, efficiently, and transparently making evidence-based decisions about healthcare claims in research and practice with minimal bias. SEaRCH uses three methods combined in a coordinated fashion to help determine what works in healthcare. The first, the Claims Assessment Profile (CAP), seeks to clarify the healthcare claim and question, and its ability to be evaluated in the context of its delivery. The second method, the Rapid Evidence Assessment of the Literature (REAL © ), is a streamlined, systematic review process conducted to determine the quantity, quality, and strength of evidence and risk/benefit for the treatment. The third method involves the structured use of expert panels (EPs). There are several types of EPs, depending on the purpose and need. Together, these three methods-CAP, REAL, and EP-can be integrated into a strategic approach to help answer the question "what works in healthcare?" and what it means in a comprehensive way. SEaRCH is a systematic, rigorous approach for evaluating healthcare claims of therapies, practices, programs, or products in an efficient and stepwise fashion. It provides an iterative, protocol-driven process that is customized to the intervention, consumer, and context. Multiple communities, including those involved in health service and policy, can benefit from this organized framework, assuring that evidence-based principles determine which healthcare practices with the greatest promise are used for improving the public's health and wellness.

The use of concept mapping for scale development and validation in evaluation.

PubMed

Rosas, Scott R; Camphausen, Lauren C

2007-05-01

Evaluators often make key decisions about what content to include when designing new scales. However, without clear conceptual grounding, there is a risk these decisions may compromise the scale's validity. Techniques such as concept mapping are available to evaluators for the specification of conceptual frameworks, but have not been used as a fully integrated part of scale development. As part of a multi-site evaluation of family support programs, we integrated concept mapping with traditional scale-development processes to strengthen the creation of a scale for inclusion in an evaluation instrument. Using concept mapping, we engaged staff and managers in the development of a framework of intended benefits of program participation and used the information to systematically select the scale's content. The psychometric characteristics of the scale were then formally assessed using a sample of program participants. The implications of the approach for supporting construct validity, inclusion of staff and managers, and theory-driven evaluation are discussed.

Procedure for the systematic orientation of digitised cranial models. Design and validation.

PubMed

Bailo, M; Baena, S; Marín, J J; Arredondo, J M; Auría, J M; Sánchez, B; Tardío, E; Falcón, L

2015-12-01

Comparison of bony pieces requires that they are oriented systematically to ensure that homologous regions are compared. Few orientation methods are highly accurate; this is particularly true for methods applied to three-dimensional models obtained by surface scanning, a technique whose special features make it a powerful tool in forensic contexts. The aim of this study was to develop and evaluate a systematic, assisted orientation method for aligning three-dimensional cranial models relative to the Frankfurt Plane, which would be produce accurate orientations independent of operator and anthropological expertise. The study sample comprised four crania of known age and sex. All the crania were scanned and reconstructed using an Eva Artec™ portable 3D surface scanner and subsequently, the position of certain characteristic landmarks were determined by three different operators using the Rhinoceros 3D surface modelling software. Intra-observer analysis showed a tendency for orientation to be more accurate when using the assisted method than when using conventional manual orientation. Inter-observer analysis showed that experienced evaluators achieve results at least as accurate if not more accurate using the assisted method than those obtained using manual orientation; while inexperienced evaluators achieved more accurate orientation using the assisted method. The method tested is a an innovative system capable of providing very precise, systematic and automatised spatial orientations of virtual cranial models relative to standardised anatomical planes independent of the operator and operator experience. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Goodman, Julie, E-mail: jgoodman@gradientcorp.com

Background: The International Agency for Research on Cancer (IARC) recently developed a framework for evaluating mechanistic evidence that includes a list of 10 key characteristics of carcinogens. This framework is useful for identifying and organizing large bodies of literature on carcinogenic mechanisms, but it lacks sufficient guidance for conducting evaluations that fully integrate mechanistic evidence into hazard assessments. Objectives: We summarize the framework, and suggest approaches to strengthen the evaluation of mechanistic evidence using this framework. Discussion: While the framework is useful for organizing mechanistic evidence, its lack of guidance for implementation limits its utility for understanding human carcinogenic potential.more » Specifically, it does not include explicit guidance for evaluating the biological significance of mechanistic endpoints, inter- and intra-individual variability, or study quality and relevance. It also does not explicitly address how mechanistic evidence should be integrated with other realms of evidence. Because mechanistic evidence is critical to understanding human cancer hazards, we recommend that IARC develop transparent and systematic guidelines for the use of this framework so that mechanistic evidence will be evaluated and integrated in a robust manner, and concurrently with other realms of evidence, to reach a final human cancer hazard conclusion. Conclusions: IARC does not currently provide a standardized approach to evaluating mechanistic evidence. Incorporating the recommendations discussed here will make IARC analyses of mechanistic evidence more transparent, and lead to assessments of cancer hazards that reflect the weight of the scientific evidence and allow for scientifically defensible decision-making. - Highlights: • IARC has a revised framework for evaluating literature on carcinogenic mechanisms. • The framework is based on 10 key characteristics of carcinogens. • IARC should develop transparent and systematic guidelines for using the framework. • It should better address biological significance, study quality, and relevance. • It should better address integrating mechanistic evidence with other evidence.« less

Systematic Uncertainties in High-Energy Hadronic Interaction Models

NASA Astrophysics Data System (ADS)

Zha, M.; Knapp, J.; Ostapchenko, S.

2003-07-01

Hadronic interaction models for cosmic ray energies are uncertain since our knowledge of hadronic interactions is extrap olated from accelerator experiments at much lower energies. At present most high-energy models are based on Grib ov-Regge theory of multi-Pomeron exchange, which provides a theoretical framework to evaluate cross-sections and particle production. While experimental data constrain some of the model parameters, others are not well determined and are therefore a source of systematic uncertainties. In this paper we evaluate the variation of results obtained with the QGSJET model, when modifying parameters relating to three ma jor sources of uncertainty: the form of the parton structure function, the role of diffractive interactions, and the string hadronisation. Results on inelastic cross sections, on secondary particle production and on the air shower development are discussed.

Cost-effectiveness of enhanced recovery in hip and knee replacement: a systematic review protocol.

PubMed

Murphy, Jacqueline; Pritchard, Mark G; Cheng, Lok Yin; Janarthanan, Roshni; Leal, José

2018-03-14

Hip and knee replacement represents a significant burden to the UK healthcare system. 'Enhanced recovery' pathways have been introduced in the National Health Service (NHS) for patients undergoing hip and knee replacement, with the aim of improving outcomes and timely recovery after surgery. To support policymaking, there is a need to evaluate the cost-effectiveness of enhanced recovery pathways across jurisdictions. Our aim is to systematically summarise the published cost-effectiveness evidence on enhanced recovery in hip and knee replacement, both as a whole and for each of the various components of enhanced recovery pathways. A systematic review will be conducted using MEDLINE, EMBASE, Econlit and the National Health Service Economic Evaluations Database. Separate search strategies were developed for each database including terms relating to hip and knee replacement/arthroplasty, economic evaluations, decision modelling and quality of life measures.We will extract peer-reviewed studies published between 2000 and 2017 reporting economic evaluations of preoperative, perioperative or postoperative enhanced recovery interventions within hip or knee replacement. Economic evaluations alongside cohort studies or based on decision models will be included. Only studies with patients undergoing elective replacement surgery of the hip or knee will be included. Data will be extracted using a predefined pro forma following best practice guidelines for economic evaluation, decision modelling and model validation.Our primary outcome will be the cost-effectiveness of enhanced recovery (entire pathway and individual components) in terms of incremental cost per quality-adjusted life year. A narrative synthesis of all studies will be presented, focussing on cost-effectiveness results, study design, quality and validation status. This systematic review is exempted from ethics approval because the work is carried out on published documents. The results of the review will be disseminated in a peer-reviewed academic journal and at conferences. CRD42017059473. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Cost-effectiveness of enhanced recovery in hip and knee replacement: a systematic review protocol

PubMed Central

Pritchard, Mark G; Cheng, Lok Yin; Janarthanan, Roshni

2018-01-01

Introduction Hip and knee replacement represents a significant burden to the UK healthcare system. ‘Enhanced recovery’ pathways have been introduced in the National Health Service (NHS) for patients undergoing hip and knee replacement, with the aim of improving outcomes and timely recovery after surgery. To support policymaking, there is a need to evaluate the cost-effectiveness of enhanced recovery pathways across jurisdictions. Our aim is to systematically summarise the published cost-effectiveness evidence on enhanced recovery in hip and knee replacement, both as a whole and for each of the various components of enhanced recovery pathways. Methods and analysis A systematic review will be conducted using MEDLINE, EMBASE, Econlit and the National Health Service Economic Evaluations Database. Separate search strategies were developed for each database including terms relating to hip and knee replacement/arthroplasty, economic evaluations, decision modelling and quality of life measures. We will extract peer-reviewed studies published between 2000 and 2017 reporting economic evaluations of preoperative, perioperative or postoperative enhanced recovery interventions within hip or knee replacement. Economic evaluations alongside cohort studies or based on decision models will be included. Only studies with patients undergoing elective replacement surgery of the hip or knee will be included. Data will be extracted using a predefined pro forma following best practice guidelines for economic evaluation, decision modelling and model validation. Our primary outcome will be the cost-effectiveness of enhanced recovery (entire pathway and individual components) in terms of incremental cost per quality-adjusted life year. A narrative synthesis of all studies will be presented, focussing on cost-effectiveness results, study design, quality and validation status. Ethics and dissemination This systematic review is exempted from ethics approval because the work is carried out on published documents. The results of the review will be disseminated in a peer-reviewed academic journal and at conferences. PROSPERO registration number CRD42017059473. PMID:29540418

Systematic testing of flood adaptation options in urban areas through simulations

NASA Astrophysics Data System (ADS)

Löwe, Roland; Urich, Christian; Sto. Domingo, Nina; Mark, Ole; Deletic, Ana; Arnbjerg-Nielsen, Karsten

2016-04-01

While models can quantify flood risk in great detail, the results are subject to a number of deep uncertainties. Climate dependent drivers such as sea level and rainfall intensities, population growth and economic development all have a strong influence on future flood risk, but future developments can only be estimated coarsely. In such a situation, robust decision making frameworks call for the systematic evaluation of mitigation measures against ensembles of potential futures. We have coupled the urban development software DAnCE4Water and the 1D-2D hydraulic simulation package MIKE FLOOD to create a framework that allows for such systematic evaluations, considering mitigation measures under a variety of climate futures and urban development scenarios. A wide spectrum of mitigation measures can be considered in this setup, ranging from structural measures such as modifications of the sewer network over local retention of rainwater and the modification of surface flow paths to policy measures such as restrictions on urban development in flood prone areas or master plans that encourage compact development. The setup was tested in a 300 ha residential catchment in Melbourne, Australia. The results clearly demonstrate the importance of considering a range of potential futures in the planning process. For example, local rainwater retention measures strongly reduce flood risk a scenario with moderate increase of rain intensities and moderate urban growth, but their performance strongly varies, yielding very little improvement in situations with pronounced climate change. The systematic testing of adaptation measures further allows for the identification of so-called adaptation tipping points, i.e. levels for the drivers of flood risk where the desired level of flood risk is exceeded despite the implementation of (a combination of) mitigation measures. Assuming a range of development rates for the drivers of flood risk, such tipping points can be translated into anticipated time spans over which a measure will be effective. While the new simulation setup is limited to situations where the planner is able to define realistic ranges for the development of drivers of flood risk, it certainly contributes to an improved consideration of deep uncertainties in the planning process. Future work will particularly focus on the application of the framework in a variety of urban development contexts.

Report of an Urban Education Reform Experiment: Problems and Promises. Section II: Project Evaluation. Supplement to the Final Report of the 5th Cycle Teacher Corps Project.

ERIC Educational Resources Information Center

Rippey, Robert M.

This document recounts the efforts of an urban college of education (the one at the University of Illinois/Chicago Circle) to develop a cooperative program in urban teacher education. It deals with the origin of the project, operational problems encountered, solutions attempted, critical functions of systematic evaluation. Also included are…

Assessment Inventories, Surveys, and Templates for Evaluating Educational Technology Regional and Local Assistance Programs. Phase IV of the Comprehensive Study of Educational Technology Programs Authorized from 1984-1992.

ERIC Educational Resources Information Center

Far West Lab. for Educational Research and Development, San Francisco, CA.

This report on Phase IV, of a four-phase study, provided for the development of evaluation templates and instruments to be used by the California Department of Education to facilitate systematic assessment of state funded educational technology programs and projects. These assessment documents comprised the major data collection sources for the…

Global development and diffusion of outcome evaluation research for interpersonal and self-directed violence prevention from 2007 to 2013: A systematic review

PubMed Central

Hughes, Karen; Bellis, Mark A.; Hardcastle, Katherine A.; Butchart, Alexander; Dahlberg, Linda L.; Mercy, James A.; Mikton, Christopher

2018-01-01

Through a global review, we identified gaps in the geographical distribution of violence prevention evidence outcome evaluation studies and the types of violence addressed. Systematic literature searches identified 355 articles published between 2007 and 2013 that evaluated programs to prevent interpersonal or self-directed violence; focused on universal or selected populations; and reported outcomes measuring violence or closely related risk factors. The number of studies identified increased annually from 2008 (n = 37), reaching 64 in 2013. Over half (n = 203) of all studies focused on youth violence yet only one on elder maltreatment. Study characteristics varied by year and violence type. Only 9.3% of all studies had been conducted in LMICs. These studies were less likely than those in high income countries (HICs) to have tested established interventions yet more likely to involve international collaboration. Evaluation studies successfully established in LMIC had often capitalized on other major regional priorities (e.g. HIV). Relationships between violence and social determinants, communicable and non-communicable diseases, and even economic prosperity should be explored as mechanisms to increase the global reach of violence prevention research. Results should inform future research strategies and provide a baseline for measuring progress in developing the violence prevention evidence-base, especially in LMICs. PMID:29725241

Global development and diffusion of outcome evaluation research for interpersonal and self-directed violence prevention from 2007 to 2013: A systematic review.

PubMed

Hughes, Karen; Bellis, Mark A; Hardcastle, Katherine A; Butchart, Alexander; Dahlberg, Linda L; Mercy, James A; Mikton, Christopher

2014-01-01

Through a global review, we identified gaps in the geographical distribution of violence prevention evidence outcome evaluation studies and the types of violence addressed. Systematic literature searches identified 355 articles published between 2007 and 2013 that evaluated programs to prevent interpersonal or self-directed violence; focused on universal or selected populations; and reported outcomes measuring violence or closely related risk factors. The number of studies identified increased annually from 2008 (n = 37), reaching 64 in 2013. Over half (n = 203) of all studies focused on youth violence yet only one on elder maltreatment. Study characteristics varied by year and violence type. Only 9.3% of all studies had been conducted in LMICs. These studies were less likely than those in high income countries (HICs) to have tested established interventions yet more likely to involve international collaboration. Evaluation studies successfully established in LMIC had often capitalized on other major regional priorities (e.g. HIV). Relationships between violence and social determinants, communicable and non-communicable diseases, and even economic prosperity should be explored as mechanisms to increase the global reach of violence prevention research. Results should inform future research strategies and provide a baseline for measuring progress in developing the violence prevention evidence-base, especially in LMICs.

Developing a systematic approach to safer medication use during pregnancy: summary of a Centers for Disease Control and Prevention--convened meeting.

PubMed

Broussard, Cheryl S; Frey, Meghan T; Hernandez-Diaz, Sonia; Greene, Michael F; Chambers, Christina D; Sahin, Leyla; Collins Sharp, Beth A; Honein, Margaret A

2014-09-01

To address information gaps that limit informed clinical decisions on medication use in pregnancy, the Centers for Disease Control and Prevention (CDC) solicited expert input on a draft prototype outlining a systematic approach to evaluating the quality and strength of existing evidence for associated risks. The draft prototype outlined a process for the systematic review of available evidence and deliberations by a panel of experts to inform clinical decision making for managing health conditions in pregnancy. At an expert meeting convened by the CDC in January 2013, participants divided into working groups discussed decision points within the prototype. This report summarizes their discussions of best practices for formulating an expert review process, developing evidence summaries and treatment guidance, and disseminating information. There is clear recognition of current knowledge gaps and a strong collaboration of federal partners, academic experts, and professional organizations willing to work together toward safer medication use during pregnancy. Published by Elsevier Inc.

Developing a systematic approach to safer medication use during pregnancy: summary of a Centers for Disease Control and Prevention—convened meeting

PubMed Central

Broussard, Cheryl S.; Frey, Meghan T.; Hernandez-Diaz, Sonia; Greene, Michael F.; Chambers, Christina D.; Sahin, Leyla; Collins Sharp, Beth A.; Honein, Margaret A.

2015-01-01

To address information gaps that limit informed clinical decisions on medication use in pregnancy, the Centers for Disease Control and Prevention (CDC) solicited expert input on a draft prototype outlining a systematic approach to evaluating the quality and strength of existing evidence for associated risks. The draft prototype outlined a process for the systematic review of available evidence and deliberations by a panel of experts to inform clinical decision making for managing health conditions in pregnancy. At an expert meeting convened by the CDC in January 2013, participants divided into working groups discussed decision points within the prototype. This report summarizes their discussions of best practices for formulating an expert review process, developing evidence summaries and treatment guidance, and disseminating information. There is clear recognition of current knowledge gaps and a strong collaboration of federal partners, academic experts, and professional organizations willing to work together toward safer medication use during pregnancy. PMID:24881821

Surface electromyography in animals: A systematic review

PubMed Central

Valentin, Stephanie; Zsoldos, Rebeka R.

2017-01-01

The study of muscle activity using surface electromyography (sEMG) is commonly used for investigations of the neuromuscular system in man. Although sEMG has faced methodological challenges, considerable technical advances have been made in the last few decades. Similarly, the field of animal biomechanics, including sEMG, has grown despite being confronted with often complex experimental conditions. In human sEMG research, standardised protocols have been developed, however these are lacking in animal sEMG. Before standards can be proposed in this population group, the existing research in animal sEMG should be collated and evaluated. Therefore the aim of this review is to systematically identify and summarise the literature in animal sEMG focussing on (1) species, breeds, activities and muscles investigated, and (2) electrode placement and normalisation methods used. The databases PubMed, Web of Science, Scopus, and Vetmed Resource were searched systematically for sEMG studies in animals and 38 articles were included in the final review. Data on methodological quality was collected and summarised. The findings from this systematic review indicate the divergence in animal sEMG methodology and as a result, future steps required to develop standardisation in animal sEMG are proposed. PMID:26763600

Surface electromyography in animal biomechanics: A systematic review.

PubMed

Valentin, Stephanie; Zsoldos, Rebeka R

2016-06-01

The study of muscle activity using surface electromyography (sEMG) is commonly used for investigations of the neuromuscular system in man. Although sEMG has faced methodological challenges, considerable technical advances have been made in the last few decades. Similarly, the field of animal biomechanics, including sEMG, has grown despite being confronted with often complex experimental conditions. In human sEMG research, standardised protocols have been developed, however these are lacking in animal sEMG. Before standards can be proposed in this population group, the existing research in animal sEMG should be collated and evaluated. Therefore the aim of this review is to systematically identify and summarise the literature in animal sEMG focussing on (1) species, breeds, activities and muscles investigated, and (2) electrode placement and normalisation methods used. The databases PubMed, Web of Science, Scopus, and Vetmed Resource were searched systematically for sEMG studies in animals and 38 articles were included in the final review. Data on methodological quality was collected and summarised. The findings from this systematic review indicate the divergence in animal sEMG methodology and as a result, future steps required to develop standardisation in animal sEMG are proposed. Copyright © 2015 Elsevier Ltd. All rights reserved.

Management of Ready-to-Use Parenteral Nutrition in Newborns: Systematic Review.

PubMed

Mena, Karen Daniela Romero; Espitia, Olga Lucia Pinzón; Vergara, José Alejandro Daza

2018-04-27

Parenteral support has increased the possibility of neonatal recovery. However, complications associated with its use have been documented. One commercial method developed to decrease the complications of this type of support is the ready-to-use parenteral nutrition (PN), a 3-chamber bag that provides a complete nutrient mix. This systematic review seeks, through the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology, to establish the benefits in newborns. Seven databases and gray literature were used. The search was limited to publications from 2007-2017 and to articles written in English, Spanish, and Portuguese. Articles that did not meet the inclusion criteria and studies with low quality evaluated with the Scottish Intercollegiate Guidelines Network guidelines, which were without information about the study or analytical methods, were excluded. A total of 24,193 articles were obtained, which were initially evaluated by title and abstract according to the inclusion criteria. A total of 24,167 articles were discarded, obtaining 27 eligible for follow-up evaluation. After a detailed evaluation of the full text, 13 articles were selected. It was found that ready-to-use PN has the potential benefit to reduce the risks for infections, provide an adequate supply of nutrients, generate growth within the expected range, provide ease of use, decrease prescription errors, and potentially reduce costs. It is necessary to evaluate the short- and long-term impact of its use. © 2018 American Society for Parenteral and Enteral Nutrition.

Optimizing winter/snow removal operations in MoDOT St. Louis district : includes outcome based evaluation of operations.

DOT National Transportation Integrated Search

2011-10-01

The objective of this project was to develop fleet location, route decision, material selection, and treatment procedures for winter snow removal operations to improve MoDOTs services and lower costs. This work uses a systematic, heuristic-based o...

Evaluating the Psychometric Characteristics of Generated Multiple-Choice Test Items

ERIC Educational Resources Information Center

Gierl, Mark J.; Lai, Hollis; Pugh, Debra; Touchie, Claire; Boulais, André-Philippe; De Champlain, André

2016-01-01

Item development is a time- and resource-intensive process. Automatic item generation integrates cognitive modeling with computer technology to systematically generate test items. To date, however, items generated using cognitive modeling procedures have received limited use in operational testing situations. As a result, the psychometric…

[Work accommodation at the time of Return-to-Work for workers on sick leave: a qualitative systematic review with recommendations for Return-to-work Guidance 2017].

PubMed

Nogawa, Kazuhiro; Kojimahara, Noriko

2018-05-31

We conducted a systematic review to determine whether work accommodation at the time of return-to-work (RTW) following a period of sick leave would improve work-related outcomes. Using a Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach, we developed recommendations applicable to the field of occupational health in Japan. We approached our review question for "Evidence-based Return-to-work Guidance in Occupational Health 2017 (RTW 2017) " using a PICO framework (P: workers on sick leave; I: work accommodation; C: usual care; O: improvement of work-related outcomes, such as shortened sick leave period or lower rate of sick leave recurrence). To identify relevant intervention studies about work accommodation at the time of RTW, for example, modified work or partial RTW, we searched Cochrane Library, PubMed, and ICHUSHI Web using keywords/phrases such as workplace accommodation, partial RTW, rehabilitation, and modified work. Although we found no systematic reviews, we did identify 632 randomized controlled trials and cohort studies. Two researchers screened them independently using selection and exclusion criteria defined by the RTW guidance committee in the scope. For intervention studies, we extracted PICO and evaluated risk of bias using RevMan 5.3. For cohort studies, we applied the Newcastle-Ottawa scale for evaluation of risk of bias. We then evaluated the body of evidence based on risk of bias, indirectness, inconsistency, imprecision, and publication bias using GRADEPro GDT. Finally, we adopted Evidence to Decision from GRADE and developed recommendations based on anonymous panels' votes. We identified three relevant studies, which were one randomized controlled trial and two cohort studies, on Partial RTW or modified work for musculoskeletal disorders. Although we could not conduct a meta-analysis, our qualitative systematic review of these studies led us to conclude that partial RTW could shorten the period of sick leave and modified work could lower the recurrence rates of sick leave. Therefore, "Work accommodation at the time of RTW could be provided for workers on sick leave for musculoskeletal disorders" was weakly recommended on the basis of low evidence. Our recommendation, though plausible, is weak, as it is based on evidence from a small number of studies of foreign occupational health systems. Development of robust recommendations will require accumulation of additional information on diverse factors, such as cost-effectiveness, and on other diseases, for example, mental health disorders or malignant diseases, in Japan.

Psychometric qualities of questionnaires for the assessment of otitis media impact.

PubMed

Timmerman, A A; Meesters, C M G; Speyer, R; Anteunis, L J C

2007-12-01

The assessment of impact and evaluation of treatment effects in chronic otitis media (OM) calls for a much broader approach than just examining the presence of middle ear effusion or hearing loss. It is increasingly recognised that this condition may result in a comprised quality of life. Several studies have used proxy completed questionnaires to objectify the illness experience associated with chronic OM. To review questionnaires which have been developed to describe the effects of chronic OM on the daily functioning of children. Psychometric properties have been evaluated, in addition to discriminative and evaluative qualities. A systematic review of publications pertaining to developed questionnaires related with chronic OM. Systematic literature searches of PubMed (1966-January 2007) and EMBASE (1989-January 2007) were conducted, supplemented by using free text words to identify publications after January 2005. The included 15 questionnaires were developed for children with recurrent or persistent OM, describing functional health status (FHS), while two questionnaires also evaluate the effect of tympanostomy tubes insertion. The questionnaires generally cover six impact areas (physical symptoms, child development, educational performance, emotional/practical burden and general health status) with physical symptoms being the most prominant. The OM8-30, OMO-22 and OM-6 adequately reflect the multidimensional aspects of FHS in chronic OM. The OMO-22 and OM8-30 show the best psychometric properties for the discrimination of impact severity between children, while the OM-6 was found to have the best qualities for the evaluation of clinical change. Clinical applicability is crucial for the assessment of FHS in chronic OM, but requires a trade-off with necessary psychometric properties.

A systematic nurse-led approach to withdrawal risk screening, prevention and treatment among inpatients with an alcohol use disorder in an ear, nose, throat and jaw surgery department-A formative evaluation.

PubMed

Leuenberger, Deborah Linda; Fierz, Katharina; Hinck, Andreas; Bodmer, Daniel; Hasemann, Wolfgang

2017-02-01

Among patients with head and neck cancer comorbid alcohol use disorder is frequent which contributes to higher risk of developing perioperative alcohol withdrawal syndrome/delirium or delirium due to medical conditions. Although guidelines emphasize prevention and treatment of alcohol withdrawal in hospitalized patients, a validated systematic approach for management of these patients is still lacking. Our aim was to formatively evaluate our newly developed systematic approach in view of nurses' adherence to screening patients for regular alcohol consumption and managing their withdrawal symptoms using the Clinical Institute Withdrawal Assessment of Alcohol Scale, Revised. We conducted a formative evaluation to improve the project's design and performance and used a retrospective chart review in a consecutive sample of all adult inpatients with head and neck cancer being assigned for surgery in a university hospital. Our bundle of interventions consisted of nurses' screenings for regular alcohol consumption, withdrawal risk assessment, offering patients a substitution therapy, nurses' assessments of withdrawal symptoms and symptom oriented withdrawal management. Proximate endpoints were analyzed descriptively at each component of the bundle in terms of frequencies and severity of withdrawal symptoms, frequencies of nurses' and doctors' screenings and nurses' assessments performed as required. Between 2013 and 2014, 87 inpatients met inclusion criteria and screenings by doctors/ nurses revealed 49 alcohol consumers, where six screenings were omitted by nurses and six by doctors. Twenty-one consumers were at risk and six of them developed an alcohol withdrawal syndrome. None of the 87 showed an alcohol withdrawal delirium, but five developed a delirium due to medical conditions. Nurses correctly conducted all preventive elements of the intervention bundle in 14 (58%) patients at risk but overall, only performed 50% of the required assessments. Although nurses safely managed patients' symptoms, nurses' adherence to the interventions was suboptimal and requires stronger leadership. Copyright © 2016 Elsevier Inc. All rights reserved.

Development of a CFD code for casting simulation

NASA Technical Reports Server (NTRS)

Murph, Jesse E.

1992-01-01

The task of developing a computational fluid dynamics (CFD) code to accurately model the mold filling phase of a casting operation was accomplished in a systematic manner. First the state-of-the-art was determined through a literature search, a code search, and participation with casting industry personnel involved in consortium startups. From this material and inputs from industry personnel, an evaluation of the currently available codes was made. It was determined that a few of the codes already contained sophisticated CFD algorithms and further validation of one of these codes could preclude the development of a new CFD code for this purpose. With industry concurrence, ProCAST was chosen for further evaluation. Two benchmark cases were used to evaluate the code's performance using a Silicon Graphics Personal Iris system. The results of these limited evaluations (because of machine and time constraints) are presented along with discussions of possible improvements and recommendations for further evaluation.

Systematic Review Methodology for the Fatigue in Emergency Medical Services Project.

PubMed

Patterson, P Daniel; Higgins, J Stephen; Weiss, Patricia M; Lang, Eddy; Martin-Gill, Christian

2018-02-15

Guidance for managing fatigue in the Emergency Medical Services (EMS) setting is limited. The Fatigue in EMS Project sought to complete multiple systematic reviews guided by seven explicit research questions, assemble the best available evidence, and rate the quality of that evidence for purposes of producing an Evidence Based Guideline (EBG) for fatigue risk management in EMS operations. We completed seven systematic reviews that involved searches of six databases for literature relevant to seven research questions. These questions were developed a priori by an expert panel and framed in the Population, Intervention, Comparison, and Outcome (PICO) format and pre-registered with PROSPERO. Our target population was defined as persons 18 years of age and older classified as EMS personnel or similar shift worker groups. A panel of experts selected outcomes for each PICO question as prescribed by the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology. We pooled findings, stratified by study design (experimental vs. observational) and presented results of each systematic review in narrative and quantitative form. We used meta-analyses of select outcomes to generate pooled effects. We used the GRADE methodology and the GRADEpro software to designate a quality of evidence rating for each outcome. We present the results for each systematic review in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA). More than 38,000 records were screened across seven systematic reviews. The median, minimum, and maximum inter-rater agreements (Kappa) between screeners for our seven systematic reviews were 0.66, 0.49, and 0.88, respectively. The median, minimum, and maximum number of records retained for the seven systematic reviews was 13, 1, and 100, respectively. We present key findings in GRADE Evidence Profile Tables in separate publications for each systematic review. We describe a protocol for conducting multiple, simultaneous systematic reviews connected to fatigue with the goal of creating an EBG for fatigue risk management in the EMS setting. Our approach may be informative to others challenged with the creation of EBGs that address multiple, inter-related systematic reviews with overlapping outcomes.

PRECEPT: an evidence assessment framework for infectious disease epidemiology, prevention and control.

PubMed

Harder, Thomas; Takla, Anja; Eckmanns, Tim; Ellis, Simon; Forland, Frode; James, Roberta; Meerpohl, Joerg J; Morgan, Antony; Rehfuess, Eva; Schünemann, Holger; Zuiderent-Jerak, Teun; de Carvalho Gomes, Helena; Wichmann, Ole

2017-10-01

Decisions in public health should be based on the best available evidence, reviewed and appraised using a rigorous and transparent methodology. The Project on a Framework for Rating Evidence in Public Health (PRECEPT) defined a methodology for evaluating and grading evidence in infectious disease epidemiology, prevention and control that takes different domains and question types into consideration. The methodology rates evidence in four domains: disease burden, risk factors, diagnostics and intervention. The framework guiding it has four steps going from overarching questions to an evidence statement. In step 1, approaches for identifying relevant key areas and developing specific questions to guide systematic evidence searches are described. In step 2, methodological guidance for conducting systematic reviews is provided; 15 study quality appraisal tools are proposed and an algorithm is given for matching a given study design with a tool. In step 3, a standardised evidence-grading scheme using the Grading of Recommendations Assessment, Development and Evaluation Working Group (GRADE) methodology is provided, whereby findings are documented in evidence profiles. Step 4 consists of preparing a narrative evidence summary. Users of this framework should be able to evaluate and grade scientific evidence from the four domains in a transparent and reproducible way.

PRECEPT: an evidence assessment framework for infectious disease epidemiology, prevention and control

PubMed Central

Harder, Thomas; Takla, Anja; Eckmanns, Tim; Ellis, Simon; Forland, Frode; James, Roberta; Meerpohl, Joerg J; Morgan, Antony; Rehfuess, Eva; Schünemann, Holger; Zuiderent-Jerak, Teun; de Carvalho Gomes, Helena; Wichmann, Ole

2017-01-01

Decisions in public health should be based on the best available evidence, reviewed and appraised using a rigorous and transparent methodology. The Project on a Framework for Rating Evidence in Public Health (PRECEPT) defined a methodology for evaluating and grading evidence in infectious disease epidemiology, prevention and control that takes different domains and question types into consideration. The methodology rates evidence in four domains: disease burden, risk factors, diagnostics and intervention. The framework guiding it has four steps going from overarching questions to an evidence statement. In step 1, approaches for identifying relevant key areas and developing specific questions to guide systematic evidence searches are described. In step 2, methodological guidance for conducting systematic reviews is provided; 15 study quality appraisal tools are proposed and an algorithm is given for matching a given study design with a tool. In step 3, a standardised evidence-grading scheme using the Grading of Recommendations Assessment, Development and Evaluation Working Group (GRADE) methodology is provided, whereby findings are documented in evidence profiles. Step 4 consists of preparing a narrative evidence summary. Users of this framework should be able to evaluate and grade scientific evidence from the four domains in a transparent and reproducible way. PMID:29019317

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews.

PubMed

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-11-14

To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines-for example, in enemas, foot massage and compressing the umbilicus. A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Change in Function, Pain, and Quality of Life Following Structured Nonoperative Treatment in Patients With Degenerative Cervical Myelopathy: A Systematic Review

PubMed Central

Tetreault, Lindsay A.; Rhee, John; Prather, Heidi; Kwon, Brian K.; Wilson, Jefferson R.; Martin, Allan R.; Andersson, Ian B.; Dembek, Anna H.; Pagarigan, Krystle T.; Dettori, Joseph R.

2017-01-01

Study Design: Systematic review. Objectives: The objective of this study was to conduct a systematic review to determine (1) change in function, pain, and quality of life following structured nonoperative treatment for degenerative cervical myelopathy (DCM); (2) variability of change in function, pain, and quality of life following different types of structured nonoperative treatment; (3) differences in outcomes observed between certain subgroups (eg, baseline severity score, duration of symptoms); and (4) negative outcomes and harms resulting from structured nonoperative treatment. Methods: A systematic search was conducted in Embase, PubMed, and the Cochrane Collaboration for articles published between January 1, 1950, and February 9, 2015. Studies were included if they evaluated outcomes following structured nonoperative treatment, including therapeutic exercise, manual therapy, cervical bracing, and/or traction. The quality of each study was evaluated using the Newcastle-Ottawa Scale, and strength of the overall body of evidence was rated using guidelines outlined by the Grading of Recommendation Assessment, Development and Evaluation Working Group. Results: Of the 570 retrieved citations, 8 met inclusion criteria and were summarized in this review. Based on our results, there is very low evidence to suggest that structured nonoperative treatment for DCM results in either a positive or negative change in function as evaluated by the Japanese Orthopaedic Association score. Conclusion: There is a lack of evidence to determine the role of nonoperative treatment in patients with DCM. However, in the majority of studies, patients did not achieve clinically significant gains in function following structured nonoperative treatment. Furthermore, 23% to 54% of patients managed nonoperatively subsequently underwent surgical treatment. PMID:29164032

Surgical versus injection treatment for injection-confirmed chronic sacroiliac joint pain

PubMed Central

Spiker, William Ryan; Lawrence, Brandon D.; Raich, Annie L.; Skelly, Andrea C.; Brodke, Darrel S.

2012-01-01

Study design: Systematic review. Study rationale: Chronic sacroiliac joint pain (CSJP) is a common clinical entity with highly controversial treatment options. A recent systematic review compared surgery with denervation, but the current systematic review compares outcomes of surgical intervention with therapeutic injection for the treatment of CSJP and serves as the next step for evaluating current evidence on the comparative effectiveness of treatments for non-traumatic sacroiliac joint pain. Objective or clinical question: In adult patients with injection-confirmed CSJP, does surgical treatment lead to better outcomes and fewer complications than injection therapy? Methods: A systematic review of the English-language literature was undertaken for articles published between 1970 and June 2012. Electronic databases and reference lists of key articles were searched to identify studies evaluating surgery or injection treatment for injection-confirmed CSJP. Studies involving traumatic onset or non-injection–confirmed CSJP were excluded. Two independent reviewers assessed the level of evidence quality using the grading of recommendations assessment, development and evaluation (GRADE) system, and disagreements were resolved by consensus. Results: We identified twelve articles (seven surgical and five injection treatment) meeting our inclusion criteria. Regardless of the type of treatment, most studies reported over 40% improvement in pain as measured by Visual Analog Scale or Numeric rating Scale score. Regardless of the type of treatment, most studies reported over 20% improvement in functionality. Most complications were reported in the surgical studies. Conclusion: Surgical fusion and therapeutic injections can likely provide pain relief, improve quality of life, and improve work status. The comparative effectiveness of these interventions cannot be evaluated with the current literature. PMID:23526911

Collection, processing and dissemination of data for the national solar demonstration program

NASA Technical Reports Server (NTRS)

Day, R. E.; Murphy, L. J.; Smok, J. T.

1978-01-01

A national solar data system developed for the DOE by IBM provides for automatic gathering, conversion, transfer, and analysis of demonstration site data. NASA requirements for this system include providing solar site hardware, engineering, data collection, and analysis. The specific tasks include: (1) solar energy system design/integration; (2) developing a site data acquisition subsystem; (3) developing a central data processing system; (4) operating the test facility at Marshall Space Flight Center; (5) collecting and analyzing data. The systematic analysis and evaluation of the data from the National Solar Data System is reflected in a monthly performance report and a solar energy system performance evaluation report.

Impact of ambient temperature on morbidity and mortality: An overview of reviews.

PubMed

Song, Xuping; Wang, Shigong; Hu, Yuling; Yue, Man; Zhang, Tingting; Liu, Yu; Tian, Jinhui; Shang, Kezheng

2017-05-15

The objectives were (i) to conduct an overview of systematic reviews to summarize evidence from and evaluate the methodological quality of systematic reviews assessing the impact of ambient temperature on morbidity and mortality; and (ii) to reanalyse meta-analyses of cold-induced cardiovascular morbidity in different age groups. The registration number is PROSPERO-CRD42016047179. PubMed, Embase, the Cochrane Library, Web of Science, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Global Health were systematically searched to identify systematic reviews. Two reviewers independently selected studies for inclusion, extracted data, and assessed quality. The Assessment of Multiple Systematic Reviews (AMSTAR) checklist was used to assess the methodological quality of included systematic reviews. Estimates of morbidity and mortality risk in association with heat exposure, cold exposure, heatwaves, cold spells and diurnal temperature ranges (DTRs) were the primary outcomes. Twenty-eight systematic reviews were included in the overview of systematic reviews. (i) The median (interquartile range) AMSTAR scores were 7 (1.75) for quantitative reviews and 3.5 (1.75) for qualitative reviews. (ii) Heat exposure was identified to be associated with increased risk of cardiovascular, cerebrovascular and respiratory mortality, but was not found to have an impact on cardiovascular or cerebrovascular morbidity. (iii) Reanalysis of the meta-analyses indicated that cold-induced cardiovascular morbidity increased in youth and middle-age (RR=1.009, 95% CI: 1.004-1.015) as well as the elderly (RR=1.013, 95% CI: 1.007-1.018). (iv) The definitions of temperature exposure adopted by different studies included various temperature indicators and thresholds. In conclusion, heat exposure seemed to have an adverse effect on mortality and cold-induced cardiovascular morbidity increased in the elderly. Developing definitions of temperature exposure at the regional level may contribute to more accurate evaluations of the health effects of temperature. Copyright © 2017 Elsevier B.V. All rights reserved.

TThe role of nitrogen availability in land-atmosphere interactions: a systematic evaluation of carbon-nitrogen coupling in a global land surface model using plot-level nitrogen fertilization experiments

NASA Astrophysics Data System (ADS)

Thomas, R. Q.; Goodale, C. L.; Bonan, G. B.; Mahowald, N. M.; Ricciuto, D. M.; Thornton, P. E.

2010-12-01

Recent research from global land surface models emphasizes the important role of nitrogen cycling on global climate, via its control on the terrestrial carbon balance. Despite the implications of nitrogen cycling on global climate predictions, the research community has not performed a systematic evaluation of nitrogen cycling in global models. Here, we present such an evaluation for one global land model, CLM-CN. In the evaluation we simulated 45 plot-scale nitrogen-fertilization experiments distributed across 33 temperate and boreal forest sites. Model predictions were evaluated against field observations by comparing the vegetation and soil carbon responses to the additional nitrogen. Aggregated across all experiments, the model predicted a larger vegetation carbon response and a smaller soil carbon response than observed; the responses partially offset each other, leading to a slightly larger total ecosystem carbon response than observed. However, the model-observation agreement improved for vegetation carbon when the sites with observed negative carbon responses to nitrogen were excluded, which may be because the model lacks mechanisms whereby nitrogen additions increase tree mortality. Among experiments, younger forests and boreal forests’ vegetation carbon responses were less than predicted and mature forests (> 40 years old) were greater than predicted. Specific to the CLM-CN, this study used a systematic evaluation to identify key areas to focus model development, especially soil carbon- nitrogen interactions and boreal forest nitrogen cycling. Applicable to the modeling community, this study demonstrates a standardized protocol for comparing carbon-nitrogen interactions among global land models.

Using heuristic evaluations to assess the safety of health information systems.

PubMed

Carvalho, Christopher J; Borycki, Elizabeth M; Kushniruk, Andre W

2009-01-01

Health information systems (HISs) are typically seen as a mechanism for reducing medical errors. There is, however, evidence to prove that technology may actually be the cause of errors. As a result, it is crucial to fully test any system prior to its implementation. At present, evidence-based evaluation heuristics do not exist for assessing aspects of interface design that lead to medical errors. A three phase study was conducted to develop evidence-based heuristics for evaluating interfaces. Phase 1 consisted of a systematic review of the literature. In Phase 2 a comprehensive list of 33 evaluation heuristics was developed based on the review that could be used to test for potential technology induced errors. Phase 3 involved applying these healthcare specific heuristics to evaluate a HIS.

A Systematic Review Exploring the Social Cognitive Theory of Self-Regulation as a Framework for Chronic Health Condition Interventions

PubMed Central

Tougas, Michelle E.; Hayden, Jill A.; McGrath, Patrick J.; Huguet, Anna; Rozario, Sharlene

2015-01-01

Background Theory is often recommended as a framework for guiding hypothesized mechanisms of treatment effect. However, there is limited guidance about how to use theory in intervention development. Methods We conducted a systematic review to provide an exemplar review evaluating the extent to which use of theory is identified and incorporated within existing interventions. We searched electronic databases PubMed, PsycINFO, CENTRAL, and EMBASE from inception to May 2014. We searched clinicaltrials.gov for registered protocols, reference lists of relevant systematic reviews and included studies, and conducted a citation search in Web of Science. We included peer-reviewed publications of interventions that referenced the social cognitive theory of self-regulation as a framework for interventions to manage chronic health conditions. Two reviewers independently assessed articles for eligibility. We contacted all authors of included studies for information detailing intervention content. We describe how often theory mechanisms were addressed by interventions, and report intervention characteristics used to address theory. Results Of 202 articles that reported using the social cognitive theory of self-regulation, 52% failed to incorporate self-monitoring, a main theory component, and were therefore excluded. We included 35 interventions that adequately used the theory framework. Intervention characteristics were often poorly reported in peer-reviewed publications, 21 of 35 interventions incorporated characteristics that addressed each of the main theory components. Each intervention addressed, on average, six of eight self-monitoring mechanisms, two of five self-judgement mechanisms, and one of three self-evaluation mechanisms. The self-monitoring mechanisms ‘Feedback’ and ‘Consistency’ were addressed by all interventions, whereas the self-evaluation mechanisms ‘Self-incentives’ and ‘External rewards’ were addressed by six and four interventions, respectively. The present review establishes that systematic review is a feasible method of identifying use of theory as a conceptual framework for existing interventions. We identified the social cognitive theory of self-regulation as a feasible framework to guide intervention development for chronic health conditions. PMID:26252889

Development and use of a content search strategy for retrieving studies on patients' views and preferences.

PubMed

Selva, Anna; Solà, Ivan; Zhang, Yuan; Pardo-Hernandez, Hector; Haynes, R Brian; Martínez García, Laura; Navarro, Tamara; Schünemann, Holger; Alonso-Coello, Pablo

2017-08-30

Identifying scientific literature addressing patients' views and preferences is complex due to the wide range of studies that can be informative and the poor indexing of this evidence. Given the lack of guidance we developed a search strategy to retrieve this type of evidence. We assembled an initial list of terms from several sources, including the revision of the terms and indexing of topic-related studies and, methods research literature, and other relevant projects and systematic reviews. We used the relative recall approach, evaluating the capacity of the designed search strategy for retrieving studies included in relevant systematic reviews for the topic. We implemented in practice the final version of the search strategy for conducting systematic reviews and guidelines, and calculated search's precision and the number of references needed to read (NNR). We assembled an initial version of the search strategy, which had a relative recall of 87.4% (yield of 132/out of 151 studies). We then added some additional terms from the studies not initially identified, and re-tested this improved version against the studies included in a new set of systematic reviews, reaching a relative recall of 85.8% (151/out of 176 studies, 95% CI 79.9 to 90.2). This final version of the strategy includes two sets of terms related with two domains: "Patient Preferences and Decision Making" and "Health State Utilities Values". When we used the search strategy for the development of systematic reviews and clinical guidelines we obtained low precision values (ranging from 2% to 5%), and the NNR from 20 to 50. This search strategy fills an important research gap in this field. It will help systematic reviewers, clinical guideline developers, and policy-makers to retrieve published research on patients' views and preferences. In turn, this will facilitate the inclusion of this critical aspect when formulating heath care decisions, including recommendations.

Interventions for domestic violence among pregnant women in low- and middle-income countries: a systematic review protocol.

PubMed

Sapkota, Diksha; Baird, Kathleen; Saito, Amornrat; Anderson, Debra

2017-12-12

Violence during pregnancy is a global problem, associated with serious health risks for both the mother and baby. Evaluation of interventions targeted for reducing or controlling domestic violence (DV) is still in its infancy, and the majority of findings are primarily from high-income countries (HICs). Therefore, there is an urgent need for generating evidence of DV interventions among pregnant women in low- and middle-income countries (LMICs). Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines will be employed to structure the review. A comprehensive search will be carried out via electronic databases including MEDLINE, CINAHL, Scopus, Embase, Web of Science, PsycINFO, and The Cochrane library. Gray literature will also be scrutinized for potential articles. An optimal search strategy has been developed following consultations with subject-matter experts and librarians. This search strategy will be adapted to the different databases. Experimental studies evaluating DV interventions among pregnant women from LMICs will be included in the review. The review will only include literature written in English. Two reviewers will independently screen and assess studies for inclusion in the review. A third author will resolve any discrepancies between the reviewers. Risk of bias will be assessed based on the Cochrane risk of bias assessment tool, and overall quality of the evidence will be judged using Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) criteria. Findings will be presented with the narrative synthesis, and if applicable, they will be further quantified using random-effects meta-analysis. Effect size, risk ratio for dichotomous variables, and standardized mean differences for continuous variables will be calculated for each outcome using Review Manager 5.3. Systematic reviews to evaluate the efficacy of interventions to address DV within the perinatal context have been limited. Hence, no one intervention has emerged as substantially effective towards addressing perinatal DV and associated health consequences. The evidence generated from this systematic review will inform researchers and policy makers about the effectiveness of existing DV interventions among pregnant women in LMICs and provide recommendations for future research in this area. This in turn will contribute towards violence prevention in LMICs. PROSPERO CRD42017073938.

Researching evaluation influence: a review of the literature.

PubMed

Herbert, James Leslie

2014-10-01

The impact of an evaluation is an important consideration in designing and carrying out evaluations. Evaluation influence is a way of thinking about the effect that an evaluation can have in the broadest possible terms, which its proponents argue will lead to a systematic body of evidence about influential evaluation practices. This literature review sets out to address three research questions: How have researchers defined evaluation influence; how is this reflected in the research; and what does the research suggest about the utility of evaluation influence as a conceptual framework. Drawing on studies that had cited one of the key evaluation influence articles and conducted original research on some aspect of influence this article reviewed the current state of the literature toward the goal of developing a body of evidence about how to practice influential evaluation. Twenty-eight studies were found that have drawn on evaluation influence, which were categorized into (a) descriptive studies, (b) analytical studies, and (c) hypothesis testing. Despite the prominence of evaluation influence in the literature, there is slow progress toward a persuasive body of literature. Many of the studies reviewed offered vague and inconsistent definitions and have applied influence in an unspecified way in the research. It is hoped that this article will stimulate interest in the systematic study of influence mechanisms, leading to improvements in the potential for evaluation to affect positive social change. © The Author(s) 2014.

Helicobacter pylori eradication: gastric cancer prevention.

PubMed

Leontiadis, Grigorios I; Ford, Alexander Charles

2015-12-01

The principal effect of Helicobacter pylori infection is lifelong chronic gastritis, affecting up to 20% of younger adults but 50% to 80% of adults born in resource-rich countries before 1950. We conducted a systematic overview, aiming to answer the following clinical question: What are the effects of H pylori eradication treatment on the risk of developing gastric cancer? We searched: Medline, Embase, The Cochrane Library, and other important databases up to July 2014 (Clinical Evidence reviews are updated periodically; please check our website for the most up-to-date version of this review). At this update, searching of electronic databases retrieved 208 studies. After deduplication and removal of conference abstracts, 166 records were screened for inclusion in the overview. Appraisal of titles and abstracts led to the exclusion of 124 studies and the further review of 42 full publications. Of the 42 full articles evaluated, one systematic review was added at this update. We performed a GRADE evaluation for two PICO combinations. In this systematic overview, we categorised the efficacy for one intervention based on information about the effectiveness and safety of H pylori eradication treatment for the prevention of gastric cancer.

Amateur boxing and risk of chronic traumatic brain injury: systematic review of observational studies

PubMed Central

Knowles, Charles H; Whyte, Greg P

2007-01-01

Objective To evaluate the risk of chronic traumatic brain injury from amateur boxing. Setting Secondary research performed by combination of sport physicians and clinical academics. Design, data sources, and methods Systematic review of observational studies in which chronic traumatic brain injury was defined as any abnormality on clinical neurological examination, psychometric testing, neuroimaging studies, and electroencephalography. Studies were identified through database (1950 to date) and bibliographic searches without language restrictions. Two reviewers extracted study characteristics, quality, and data, with adherence to a protocol developed from a widely recommended method for systematic review of observational studies (MOOSE). Results 36 papers had relevant extractable data (from a detailed evaluation of 93 studies of 943 identified from the initial search). Quality of evidence was generally poor. The best quality studies were those with a cohort design and those that used psychometric tests. These yielded the most negative results: only four of 17 (24%) better quality studies found any indication of chronic traumatic brain injury in a minority of boxers studied. Conclusion There is no strong evidence to associate chronic traumatic brain injury with amateur boxing. PMID:17916811

Amateur boxing and risk of chronic traumatic brain injury: systematic review of observational studies.

PubMed

Loosemore, Mike; Knowles, Charles H; Whyte, Greg P

2007-10-20

To evaluate the risk of chronic traumatic brain injury from amateur boxing. Secondary research performed by combination of sport physicians and clinical academics. DESIGN, DATA SOURCES, AND METHODS: Systematic review of observational studies in which chronic traumatic brain injury was defined as any abnormality on clinical neurological examination, psychometric testing, neuroimaging studies, and electroencephalography. Studies were identified through database (1950 to date) and bibliographic searches without language restrictions. Two reviewers extracted study characteristics, quality, and data, with adherence to a protocol developed from a widely recommended method for systematic review of observational studies (MOOSE). 36 papers had relevant extractable data (from a detailed evaluation of 93 studies of 943 identified from the initial search). Quality of evidence was generally poor. The best quality studies were those with a cohort design and those that used psychometric tests. These yielded the most negative results: only four of 17 (24%) better quality studies found any indication of chronic traumatic brain injury in a minority of boxers studied. There is no strong evidence to associate chronic traumatic brain injury with amateur boxing.

A Systematic Approach for Engagement Analysis Under Multitasking Environments

NASA Technical Reports Server (NTRS)

Zhang, Guangfan; Leddo, John; Xu, Roger; Richey, Carl; Schnell, Tom; McKenzie, Frederick; Li, Jiang

2011-01-01

An overload condition can lead to high stress for an operator and further cause substantial drops in performance. On the other extreme, in automated systems, an operator may become underloaded; in which case, it is difficult for the operator to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, a disengaged operation may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss a systematic approach monitor for extremes of cognitive workload and engagement in multitasking environments. Inferences of cognitive workload ar engagement are based on subjective evaluations, objective performance measures, physiological signals, and task analysis results. The systematic approach developed In this paper aggregates these types of information collected under the multitasking environment and can provide a real-time assessment or engagement.

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Muscle Oximetry in Sports Science: A Systematic Review.

PubMed

Perrey, Stephane; Ferrari, Marco

2018-03-01

Since the introduction (in 2006) of commercially available portable wireless muscle oximeters, the use of muscle near-infrared spectroscopy (NIRS) technology is gaining in popularity as an application to observe changes in muscle metabolism and muscle oxygenation during and after exercise or training interventions in both laboratory and applied sports settings. The objectives of this systematic review were to highlight the application of muscle oximetry in evaluating oxidative skeletal muscle performance to sport activities and emphasize how this technology has been applied to exercise and training. Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed in a systematic fashion to search, assess and synthesize existing literature on this topic. The Scopus and MEDLINE/PubMed electronic databases were searched to 1 March 2017. Potential inclusions were screened against eligibility criteria relating to recreationally trained to elite athletes, with or without training programs, who must have assessed physiological variables monitored by commercial oximeters or NIRS instrumentation. Of the 14,609 identified records, only 57 studies met the eligibility criteria. This systematic review highlighted a number of key findings in 16 sporting activities. Overall, NIRS information can be used as a marker of skeletal muscle oxidative capacity and for analyzing muscle performance factors. Although NIRS instrumentation is promising in evaluating oxidative skeletal muscle performance when used in sport settings, there is still the need for further instrumental development and randomized/longitudinal trials to support the detailed advantages of muscle oximetry utilization in sports science.

Arginine for gestating sows and foetal development: A systematic review.

PubMed

Palencia, J Y P; Lemes, M A G; Garbossa, C A P; Abreu, M L T; Pereira, L J; Zangeronimo, M G

2018-02-01

The use of functional amino acids during pregnancy has been linked to improved reproduction in mammals. In this context, arginine is a precursor in the synthesis of numerous molecules, such as nitric oxide and polyamines, which play an important role during reproduction. However, contradictory studies are found in the literature, particularly regarding the amount of supplementation and the period of pregnancy in which it is used. The objective of this study was to evaluate the effects of dietary arginine supplementation for pregnant sows on foetal development via a systematic review. The search for papers was performed during the month of December 2015, in the databases ISI Web of Science, Science Direct, Scopus, and SciELO. From a total of 5675 returned studies, only 13 papers were selected after applying selection criteria. Most (47%) of the studies that evaluated the effects of dietary arginine supplementation on foetal development in pigs used 1% arginine. Supplementation was initiated in the first third of pregnancy in 47% of tests, including in both primiparous and multiparous sows. These studies showed positive results for embryo survival and foetal development, evidenced by the increase in placental weight and the number and weight of piglets born alive. Of all evaluated studies, 53% showed benefits on foetal development. It is concluded that supplementing dietary arginine in gestating sows can benefit embryo survival and foetal development. However, to establish a supplementation plan with this amino acid, aspects related to the period of pregnancy, supplementation levels, and source of arginine must be well defined. © 2017 Blackwell Verlag GmbH.

Systematic modelling and design evaluation of unperturbed tumour dynamics in xenografts.

PubMed

Parra Guillen, Zinnia P Patricia; Mangas Sanjuan, Victor; Garcia-Cremades, Maria; Troconiz, Inaki F; Mo, Gary; Pitou, Celine; Iversen, Philip W; Wallin, Johan E

2018-04-24

Xenograft mice are largely used to evaluate the efficacy of oncological drugs during preclinical phases of drug discovery and development. Mathematical models provide a useful tool to quantitatively characterise tumour growth dynamics and also optimise upcoming experiments. To the best of our knowledge, this is the first report where unperturbed growth of a large set of tumour cell lines (n=28) has been systematically analysed using the model proposed by Simeoni in the context of non-linear mixed effect (NLME). Exponential growth was identified as the governing mechanism in the majority of the cell lines, with constant rate values ranging from 0.0204 to 0.203 day -1 No common patterns could be observed across tumour types, highlighting the importance of combining information from different cell lines when evaluating drug activity. Overall, typical model parameters were precisely estimated using designs where tumour size measurements were taken every two days. Moreover, reducing the number of measurement to twice per week, or even once per week for cell lines with low growth rates, showed little impact on parameter precision. However, in order to accurately characterise parameter variability (i.e. relative standard errors below 50%), a sample size of at least 50 mice is needed. This work illustrates the feasibility to systematically apply NLME models to characterise tumour growth in drug discovery and development, and constitutes a valuable source of data to optimise experimental designs by providing an a priori sampling window and minimising the number of samples required. The American Society for Pharmacology and Experimental Therapeutics.

Cost-Effectiveness of HBV and HCV Screening Strategies – A Systematic Review of Existing Modelling Techniques

PubMed Central

Geue, Claudia; Wu, Olivia; Xin, Yiqiao; Heggie, Robert; Hutchinson, Sharon; Martin, Natasha K.; Fenwick, Elisabeth; Goldberg, David

2015-01-01

Introduction Studies evaluating the cost-effectiveness of screening for Hepatitis B Virus (HBV) and Hepatitis C Virus (HCV) are generally heterogeneous in terms of risk groups, settings, screening intervention, outcomes and the economic modelling framework. It is therefore difficult to compare cost-effectiveness results between studies. This systematic review aims to summarise and critically assess existing economic models for HBV and HCV in order to identify the main methodological differences in modelling approaches. Methods A structured search strategy was developed and a systematic review carried out. A critical assessment of the decision-analytic models was carried out according to the guidelines and framework developed for assessment of decision-analytic models in Health Technology Assessment of health care interventions. Results The overall approach to analysing the cost-effectiveness of screening strategies was found to be broadly consistent for HBV and HCV. However, modelling parameters and related structure differed between models, producing different results. More recent publications performed better against a performance matrix, evaluating model components and methodology. Conclusion When assessing screening strategies for HBV and HCV infection, the focus should be on more recent studies, which applied the latest treatment regimes, test methods and had better and more complete data on which to base their models. In addition to parameter selection and associated assumptions, careful consideration of dynamic versus static modelling is recommended. Future research may want to focus on these methodological issues. In addition, the ability to evaluate screening strategies for multiple infectious diseases, (HCV and HIV at the same time) might prove important for decision makers. PMID:26689908

Improved nurse-parent communication in neonatal intensive care unit: evaluation and adjustment of an implementation strategy.

PubMed

Weis, Janne; Zoffmann, Vibeke; Egerod, Ingrid

2014-12-01

To evaluate and adjust systematic implementation of guided family-centred care in a neonatal intensive care unit. Family-centred care is valued in neonatal intensive care units internationally, but innovative strategies are needed to realise the principles. Guided family-centred care was developed to facilitate person-centred communication by bridging the gap between theory and practice in family-centred care. Main mechanisms of guided family-centred care are structured dialogue, reflection and person-centred communication. Qualitative and quantitative data were used to monitor participatory implementation of a systematic approach to training and certification of nurses delivering guided family-centred care. Systematic implementation of guided family-centred care included workshops, supervised delivery and certification. Evaluation and adjustment of nurse adherence to guided family-centred care was conducted by monitoring (1) knowledge, (2) delivery, (3) practice uptake and (4) certification. Implementation was improved by the development of a strategic framework and by adjusting the framework according to the real-life context of a busy neonatal care unit. Promoting practice uptake was initially underestimated, but nurse guided family-centred care training was improved by increasing the visibility of the study in the unit, demonstrating intervention progress to the nurses and assuring a sense of ownership among nurse leaders and nonguided-family-centred-care-trained nurses. An adjusted framework for guided family-centred care implementation was successful in overcoming barriers and promoting facilitators. Insights gained from our pioneering work might help nurses in a similar context to reach their goals of improving family-centred care. © 2014 John Wiley & Sons Ltd.

A systematic review of team-building interventions in non-acute healthcare settings.

PubMed

Miller, Christopher J; Kim, Bo; Silverman, Allie; Bauer, Mark S

2018-03-01

Healthcare is increasingly delivered in a team-based format emphasizing interdisciplinary coordination. While recent reviews have investigated team-building interventions primarily in acute healthcare settings (e.g. emergency or surgery departments), we aimed to systematically review the evidence base for team-building interventions in non-acute settings (e.g. primary care or rehabilitation clinics). We conducted a systematic review in PubMed and Embase to identify team-building interventions, and conducted follow-up literature searches to identify articles describing empirical studies of those interventions. This process identified 14 team-building interventions for non-acute healthcare settings, and 25 manuscripts describing empirical studies of these interventions. We evaluated outcomes in four domains: trainee evaluations, teamwork attitudes/knowledge, team functioning, and patient impact. Trainee evaluations for team-building interventions were generally positive, but only one study associated team-building with statistically significant improvement in teamwork attitudes/knowledge. Similarly mixed results emerged for team functioning and patient impact. The evidence base for healthcare team-building interventions in non-acute healthcare settings is much less developed than the parallel literature for short-term team function in acute care settings. Only one intervention we identified has been tested in multiple non-acute settings by distinct research teams. Positive findings regarding the utility of team-building interventions are tempered by a lack of control conditions, inconsistency in outcome measures, and high probability of bias. Considering these results alongside the well-recognized costs of poor healthcare teamwork suggests that additional research is sorely needed to develop the evidence base for team-building in non-acute settings.

Is it worth investing in mental health promotion and prevention of mental illness? A systematic review of the evidence from economic evaluations

PubMed Central

Zechmeister, Ingrid; Kilian, Reinhold; McDaid, David

2008-01-01

Background While evidence on the cost of mental illness is growing, little is known about the cost-effectiveness of programmes in the areas of mental health promotion (MHP) and mental disorder prevention (MDP). The paper aims at identifying and assessing economic evaluations in both these areas to support evidence based prioritisation of resource allocation. Methods A systematic review of health and non health related bibliographic databases, complemented by a hand search of key journals and analysis of grey literature has been carried out. Study characteristics and results were qualitatively summarised. Economic evaluations of programmes that address mental health outcome parameters directly, those that address relevant risk factors of mental illness, as well as suicide prevention interventions were included, while evaluations of drug therapies were excluded. Results 14 studies fulfilled the inclusion criteria. They varied in terms of topic addressed, intervention used and study quality. Robust evidence on cost-effectiveness is still limited to a very small number of interventions with restricted scope for generalisability and transferability. The most favourable results are related to early childhood development programmes. Conclusion Prioritisation between MHP and MDP interventions requires more country and population-specific economic evaluations. There is also scope to retrospectively add economic analyses to existing effectiveness studies. The nature of promotion and prevention suggests that innovative approaches to economic evaluation that augment this with information on the challenges of implementation and uptake of interventions need further development. PMID:18211677

How is genetic testing evaluated? A systematic review of the literature.

PubMed

Pitini, Erica; De Vito, Corrado; Marzuillo, Carolina; D'Andrea, Elvira; Rosso, Annalisa; Federici, Antonio; Di Maria, Emilio; Villari, Paolo

2018-05-01

Given the rapid development of genetic tests, an assessment of their benefits, risks, and limitations is crucial for public health practice. We performed a systematic review aimed at identifying and comparing the existing evaluation frameworks for genetic tests. We searched PUBMED, SCOPUS, ISI Web of Knowledge, Google Scholar, Google, and gray literature sources for any documents describing such frameworks. We identified 29 evaluation frameworks published between 2000 and 2017, mostly based on the ACCE Framework (n = 13 models), or on the HTA process (n = 6), or both (n = 2). Others refer to the Wilson and Jungner screening criteria (n = 3) or to a mixture of different criteria (n = 5). Due to the widespread use of the ACCE Framework, the most frequently used evaluation criteria are analytic and clinical validity, clinical utility and ethical, legal and social implications. Less attention is given to the context of implementation. An economic dimension is always considered, but not in great detail. Consideration of delivery models, organizational aspects, and consumer viewpoint is often lacking. A deeper analysis of such context-related evaluation dimensions may strengthen a comprehensive evaluation of genetic tests and support the decision-making process.

Performance of a computer-based assessment of cognitive function measures in two cohorts of seniors

USDA-ARS?s Scientific Manuscript database

Computer-administered assessment of cognitive function is being increasingly incorporated in clinical trials, however its performance in these settings has not been systematically evaluated. The Seniors Health and Activity Research Program (SHARP) pilot trial (N=73) developed a computer-based tool f...

In Transit...Making the Change to Metrics.

ERIC Educational Resources Information Center

Farnsworth, Briant J.; And Others

1980-01-01

Granite School District (Utah) developed a systematic, effective, and cost-efficient teacher inservice program which provides a basic understanding of metrics, materials and methods for direct classroom use, and evaluation of the learning process, through the use of self-contained, three-phase modules for home or school use. (Author/SB)

Data-Driven Decision Making in Practice: The NCAA Injury Surveillance System

ERIC Educational Resources Information Center

Klossner, David; Corlette, Jill; Agel, Julie; Marshall, Stephen W.

2009-01-01

Putting data-driven decision making into practice requires the use of consistent and reliable data that are easily accessible. The systematic collection and maintenance of accurate information is an important component in developing policy and evaluating outcomes. Since 1982, the National Collegiate Athletic Association (NCAA) has been collecting…

(Computational Toxicology) A systematic evaluation of analogs and automated read-across prediction of estrogenicity: A case study using hindered phenols

EPA Science Inventory

Read-across is an important data gap filling technique used within category and analog approaches for regulatory hazard identification and risk assessment. Although much technical guidance is available that describes how to develop category/analog approaches, practical principles...

Developmental Assessment with Young Children: A Systematic Review of Battelle Studies

ERIC Educational Resources Information Center

Cunha, Ana C. B.; Berkovits, Michelle D.; Albuquerque, Karolina A.

2018-01-01

Developmental assessment scales are important tools for determining developmental delays and planning preventive interventions. One broad assessment scale used to evaluate child development is the Battelle Developmental Inventories (BDIs). The BDI-2 has a standardized version in English with good psychometric properties and a translated version in…

Recent progress and market analysis of anticoagulant drugs

PubMed Central

Fan, Ping; Gao, Yangyang; Zheng, Minglin; Xu, Ting; Schoenhagen, Paul

2018-01-01

This review describes epidemiology of thromboembolic disease in China and abroad, evaluates trends in the development of anticoagulant drugs, and analyzes the market situation based on large amounts of accumulated data. Specifically, we describe advances in clinical application of anticoagulants and analyze the most commonly used anticoagulants in the market systematically.

Quebec: La valse des valeurs (Quebec: The Waltz of Values).

ERIC Educational Resources Information Center

Ueberschlag, Roger

1991-01-01

In recent decades, Quebec has been continuously examining its educational values, addressing in particular the effectiveness of traditional educational methods and curricula, role of institutional culture in academic success, and value placed on ethnic integration. Priority should be given to cognitive development and systematic evaluation but…

Ethics: A Bridge for Studying the Social Contexts of Professional Communication.

ERIC Educational Resources Information Center

Speck, Bruce W.

1989-01-01

Describes a method for helping students evaluate ethical issues in a systematic way, based on Lawrence Kohlberg's stages of moral development. Recommends the case-study approach for creating social constructs in which students face ethical dilemmas, and outlines a case-study ethics unit using Kohlberg's model. (MM)

Increasing scientific confidence in adverse outcome pathways: Application of tailored Bradford-Hill considerations for evaluating weight of evidence

EPA Science Inventory

Systematic consideration of scientific support is a critical element in developing and, ultimately, using adverse outcome pathways (AOPs) for various regulatory applications. Though weight of evidence (WoE) analysis has been proposed as a basis for assessment of the maturity and...

What's a Parent to Do? Coping with Crisis.

ERIC Educational Resources Information Center

Coleman, Trudy; And Others

This instructional packet is one of a series of five modules that emphasize a systematic decision-making model for common problematic situations. The steps of the model are identifying the problem, gathering information, developing and assessing alternatives, implementing a solution, and evaluating and modifying the solution. Aimed at adult basic…

Developing a Standardized Letter of Recommendation

ERIC Educational Resources Information Center

Walters, Alyssa M.; Kyllonen, Patrick C.; Plante, Janice W.

2006-01-01

The Standardized Letter of Recommendation (SLR) is a Web-based admission tool designed to replace traditional, narrative letters of recommendation with a more systematic and equitable source of information about applicants to institutions of higher education. The SLR includes a rating scale and open-ended response space that prompt evaluators to…

Exploring Operational Test and Evaluation of Unmanned Aircraft Systems: A Qualitative Case Study

NASA Astrophysics Data System (ADS)

Saliceti, Jose A.

The purpose of this qualitative case study was to explore and identify strategies that may potentially remedy operational test and evaluation procedures used to evaluate Unmanned Aircraft Systems (UAS) technology. The sample for analysis consisted of organizations testing and evaluating UASs (e.g., U.S. Air Force, U.S. Navy, U.S. Army, U.S. Marine Corps, U.S. Coast Guard, and Customs Border Protection). A purposeful sampling technique was used to select 15 subject matter experts in the field of operational test and evaluation of UASs. A questionnaire was provided to participants to construct a descriptive and robust research. Analysis of responses revealed themes related to each research question. Findings revealed operational testers utilized requirements documents to extrapolate measures for testing UAS technology and develop critical operational issues. The requirements documents were (a) developed without the contribution of stakeholders and operational testers, (b) developed with vague or unrealistic measures, and (c) developed without a systematic method to derive requirements from mission tasks. Four approaches are recommended to develop testable operational requirements and assist operational testers: (a) use a mission task analysis tool to derive requirements for mission essential tasks for the system, (b) exercise collaboration among stakeholders and testers to ensure testable operational requirements based on mission tasks, (c) ensure testable measures are used in requirements documents, and (d) create a repository list of critical operational issues by mission areas. The preparation of operational test and evaluation processes for UAS technology is not uniform across testers. The processes in place are not standardized, thus test plan preparation and reporting are different among participants. A standard method to prepare and report UAS technology should be used when preparing and reporting on UAS technology. Using a systematic process, such as mission-based test design, resonated among participants as an analytical method to link UAS mission tasks and measures of performance to the capabilities of the system under test when developing operational test plans. Further research should examine system engineering designs for system requirements traceability matrix of mission tasks and subtasks while using an analysis tool that adequately evaluates UASs with an acceptable level of confidence in the results.

Knee ultrasound from research to real practice: a systematic literature review of adult knee ultrasound assessment feasibility studies.

PubMed

Peltea, Alexandra; Berghea, Florian; Gudu, Tania; Ionescu, Ruxandra

2016-12-05

To identify and analyse existing data regarding knee ultrasound (US) feasibility in clinical practice. Material and methods: A systematic literature review was performed using the terms: ("knee") AND ("ultrasound" OR "ultrasonography") AND ("feasibility" OR "pilot" OR "proof of concept"). Feasibility studies regarding knee US or US aided maneuver involving knee joint, published during 2005-2015, were selected and evaluated against a complex framework constructed around mandatory key areas for feasibility studies: acceptability, demand, implementation, practicality, adaptation, integration and expansion. One hundred and fifty-nine publications were identified, of which 9 were included in the final analysis: 6 dealt with the development and implementation of novel US scores, while the rest focused on implementing MSUS in clinical practice, evaluating the usefulness of articular cartilage US assessment and the feasibility of sonography for intra-articular knee injections, respectively. Six studies quantified feasibility as time spent for the evaluation, with only two addressing areassuch as acceptability, implementation and practicality, although none of these systematically assessed all feasibility domains. Knee US feasibility is still poorly addressed; the time required for US assessment is the main area addressed. This information gap should be properly addressed in future works, in order to ensure the right place for this technique.

A systematic evaluation of chemicals in hydraulic-fracturing fluids and wastewater for reproductive and developmental toxicity.

PubMed

Elliott, Elise G; Ettinger, Adrienne S; Leaderer, Brian P; Bracken, Michael B; Deziel, Nicole C

2017-01-01

Hydraulic-fracturing fluids and wastewater from unconventional oil and natural gas development contain hundreds of substances with the potential to contaminate drinking water. Challenges to conducting well-designed human exposure and health studies include limited information about likely etiologic agents. We systematically evaluated 1021 chemicals identified in hydraulic-fracturing fluids (n=925), wastewater (n=132), or both (n=36) for potential reproductive and developmental toxicity to triage those with potential for human health impact. We searched the REPROTOX database using Chemical Abstract Service registry numbers for chemicals with available data and evaluated the evidence for adverse reproductive and developmental effects. Next, we determined which chemicals linked to reproductive or developmental toxicity had water quality standards or guidelines. Toxicity information was lacking for 781 (76%) chemicals. Of the remaining 240 substances, evidence suggested reproductive toxicity for 103 (43%), developmental toxicity for 95 (40%), and both for 41 (17%). Of these 157 chemicals, 67 had or were proposed for a federal water quality standard or guideline. Our systematic screening approach identified a list of 67 hydraulic fracturing-related candidate analytes based on known or suspected toxicity. Incorporation of data on potency, physicochemical properties, and environmental concentrations could further prioritize these substances for future drinking water exposure assessments or reproductive and developmental health studies.

Clinical guidelines in the European Union: mapping the regulatory basis, development, quality control, implementation and evaluation across member states.

PubMed

Legido-Quigley, Helena; Panteli, Dimitra; Brusamento, Serena; Knai, Cécile; Saliba, Vanessa; Turk, Eva; Solé, Meritxell; Augustin, Uta; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

Clinical guidelines are advocated to improve the quality of care, especially for chronic diseases. However, the regulatory basis of clinical guidelines, their development, quality control, implementation and use as well as evaluation within countries across the European Union is not systematically known. Using information collected from key informants in each country by means of a structured questionnaire, this mapping exercise illustrates the varied status of guideline production in European Union countries. Most European Union countries have an established national, regional or local clinical guideline programme, and a substantial proportion have developed guidelines on the prevention and management of chronic diseases. Several countries have mechanisms in place to ensure the quality of scientific evidence used for the development of guidelines is high and that the process is consistent and transparent. Others are only now taking an interest in guideline development and are taking the first steps towards establishing ways of implementing them. The majority of countries have no legal basis for the development of guidelines and those that have well established systems mostly implement them on a voluntary basis. The process of guideline development varies in its degrees of decentralisation across countries with many different types of organisations taking on this responsibility. There is general acceptance of the value of the instrument developed by the AGREE collaboration for evaluating the methodological robustness of guidelines. However, the extent to which guidelines are implemented in Europe is unknown, as there is no systematic data collection and, in most countries, no structure to enable it. There are few examples of formal evaluations of the development, quality, implementation and use of guidelines. Our findings call for renewed efforts to respond to the severe lack of standardized guideline terminology and accessibility as well as rigorous studies to evaluate the relationship between different ways to develop guidelines and their methodological quality, between their quality and the actual implementation and usage, and finally between implementation and health outcomes. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Health Care System Reforms in Developing Countries

PubMed Central

Han, Wei

2012-01-01

This article proposes a critical but non-systematic review of recent health care system reforms in developing countries. The literature reports mixed results as to whether reforms improve the financial protection of the poor or not. We discuss the reasons for these differences by comparing three representative countries: Mexico, Vietnam, and China. First, the design of the health care system reform, as well as the summary of its evaluation, is briefly described for each country. Then, the discussion is developed along two lines: policy design and evaluation methodology. The review suggests that i) background differences, such as social development, poverty level, and population health should be considered when taking other countries as a model; ii) although demand-side reforms can be improved, more attention should be paid to supply-side reforms; and iii) the findings of empirical evaluation might be biased due to the evaluation design, the choice of outcome, data quality, and evaluation methodology, which should be borne in mind when designing health care system reforms. PMID:25170464

Computer simulation models of pre-diabetes populations: a systematic review protocol

PubMed Central

Khurshid, Waqar; Pagano, Eva; Feenstra, Talitha

2017-01-01

Introduction Diabetes is a major public health problem and prediabetes (intermediate hyperglycaemia) is associated with a high risk of developing diabetes. With evidence supporting the use of preventive interventions for prediabetes populations and the discovery of novel biomarkers stratifying the risk of progression, there is a need to evaluate their cost-effectiveness across jurisdictions. In diabetes and prediabetes, it is relevant to inform cost-effectiveness analysis using decision models due to their ability to forecast long-term health outcomes and costs beyond the time frame of clinical trials. To support good implementation and reimbursement decisions of interventions in these populations, models should be clinically credible, based on best available evidence, reproducible and validated against clinical data. Our aim is to identify recent studies on computer simulation models and model-based economic evaluations of populations of individuals with prediabetes, qualify them and discuss the knowledge gaps, challenges and opportunities that need to be addressed for future evaluations. Methods and analysis A systematic review will be conducted in MEDLINE, Embase, EconLit and National Health Service Economic Evaluation Database. We will extract peer-reviewed studies published between 2000 and 2016 that describe computer simulation models of the natural history of individuals with prediabetes and/or decision models to evaluate the impact of interventions, risk stratification and/or screening on these populations. Two reviewers will independently assess each study for inclusion. Data will be extracted using a predefined pro forma developed using best practice. Study quality will be assessed using a modelling checklist. A narrative synthesis of all studies will be presented, focussing on model structure, quality of models and input data, and validation status. Ethics and dissemination This systematic review is exempt from ethics approval because the work is carried out on published documents. The findings of the review will be disseminated in a related peer-reviewed journal and presented at conferences. Reviewregistration number CRD42016047228. PMID:28982807

A systematic review of clinical assessment for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Lee, Cindy Ching Siang; Wang, Wenru

2015-02-01

Consolidated clinical practicum prepares pre-registration nursing students to function as beginning practitioners. The clinical competencies of final-year nursing students provide a key indication of professional standards of practice and patient safety. Thus, clinical assessment of nursing students is a crucial issue for educators and administrators. The aim of this systematic review was to explore the clinical competency assessment for undergraduate nursing students. PubMed, CINAHL, ScienceDirect, Web of Science, and EBSCO were systematically searched from January 2000 to December 2013. The systematic review was in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Published quantitative and qualitative studies that examined clinical assessment practices and tools used in clinical nursing education were retrieved. Quality assessment, data extraction, and analysis were completed on all included studies. This review screened 2073 titles, abstracts and full-text records, resulting in 33 included studies. Two reviewers assessed the quality of the included studies. Fourteen quantitative and qualitative studies were identified for this evaluation. The evidence was ordered into emergent themes; the overarching themes were current practices in clinical assessment, issues of learning and assessment, development of assessment tools, and reliability and validity of assessment tools. There is a need to develop a holistic clinical assessment tool with reasonable level of validity and reliability. Clinical assessment is a robust activity and requires collaboration between clinical partners and academia to enhance the clinical experiences of students, the professional development of preceptors, and the clinical credibility of academics. Copyright © 2014 Elsevier Ltd. All rights reserved.

Gender counts: A systematic review of evaluations of gender-integrated health interventions in low- and middle-income countries.

PubMed

Schriver, Brittany; Mandal, Mahua; Muralidharan, Arundati; Nwosu, Anthony; Dayal, Radhika; Das, Madhumita; Fehringer, Jessica

2017-11-01

As a result of new global priorities, there is a growing need for high-quality evaluations of gender-integrated health programmes. This systematic review examined 99 peer-reviewed articles on evaluations of gender-integrated (accommodating and transformative) health programmes with regard to their theory of change (ToC), study design, gender integration in data collection, analysis, and gender measures used. Half of the evaluations explicitly described a ToC or conceptual framework (n = 50) that guided strategies for their interventions. Over half (61%) of the evaluations used quantitative methods exclusively; 11% used qualitative methods exclusively; and 28% used mixed methods. Qualitative methods were not commonly detailed. Evaluations of transformative interventions were less likely than those of accommodating interventions to employ randomised control trials. Two-thirds of the reviewed evaluations reported including at least one specific gender-related outcome (n = 18 accommodating, n = 44 transformative). To strengthen evaluations of gender-integrated programmes, we recommend use of ToCs, explicitly including gender in the ToC, use of gender-sensitive measures, mixed-method designs, in-depth descriptions of qualitative methods, and attention to gender-related factors in data collection logistics. We also recommend further research to develop valid and reliable gender measures that are globally relevant.

Systematic reviews of animal studies; missing link in translational research?

PubMed

van Luijk, Judith; Bakker, Brenda; Rovers, Maroeska M; Ritskes-Hoitinga, Merel; de Vries, Rob B M; Leenaars, Marlies

2014-01-01

The methodological quality of animal studies is an important factor hampering the translation of results from animal studies to a clinical setting. Systematic reviews of animal studies may provide a suitable method to assess and thereby improve their methodological quality. The aims of this study were: 1) to evaluate the risk of bias assessment in animal-based systematic reviews, and 2) to study the internal validity of the primary animal studies included in these systematic reviews. We systematically searched Pubmed and Embase for SRs of preclinical animal studies published between 2005 and 2012. A total of 91 systematic reviews met our inclusion criteria. The risk of bias was assessed in 48 (52.7%) of these 91 systematic reviews. Thirty-three (36.3%) SRs provided sufficient information to evaluate the internal validity of the included studies. Of the evaluated primary studies, 24.6% was randomized, 14.6% reported blinding of the investigator/caretaker, 23.9% blinded the outcome assessment, and 23.1% reported drop-outs. To improve the translation of animal data to clinical practice, systematic reviews of animal studies are worthwhile, but the internal validity of primary animal studies needs to be improved. Furthermore, risk of bias should be assessed by systematic reviews of animal studies to provide insight into the reliability of the available evidence.

The role of short messaging service in supporting the delivery of healthcare: An umbrella systematic review.

PubMed

Househ, Mowafa

2016-06-01

Short messaging service (SMS) messages may present a convenient and cost-effective method to support healthcare interventions. This work assesses the effects of short messaging service on various healthcare interventions found in systematic reviews. The search strategy was based on two key concepts: short messaging service and healthcare delivery. The initial search was conducted in December 2012 and was updated in June 2013. Of the 550 identified references, 13 systematic reviews met the inclusion criteria, of which 8 were published in peer-reviewed journals and 5 were retrieved from the Cochrane library. Data analysis shows that low to moderate research evidence exists on the benefits of short messaging service interventions for appointment reminders, promoting health in developing countries and preventive healthcare. In many interventions, however, there were a few studies that were of high quality, and most of the studies were rated from low to moderate quality or had no rating at all. Healthcare organizations, policy makers, or clinicians using short messaging service messages to support healthcare interventions should (1) implement interventions that have been found to work in healthcare settings, (2) continue evaluating short messaging service interventions that have not been adequately assessed, and (3) improve collaboration between various healthcare entities to develop studies targeted at specific populations to evaluate the long-term impact of short messaging service on healthcare outcomes. © The Author(s) 2014.

An Evaluation of a Management Wargame and the Factors Affecting Game Performance.

DTIC Science & Technology

1987-09-01

in residence. This is not a criticism of the author, but rather a systematic flaw in game development in general. Therefore, TEMPO-AI is an excellent...establish the test procedure used in this thesis. This stage of game development is absolutely vital, if the game is intended for serious academic use...Unfortunately, this important step is sadly neglected in nearly all military game development . While TEMPO-AI was extensively debugged as a computer

A new framework for sustainable hydropower development project

NASA Astrophysics Data System (ADS)

Johan, Kartina; Turan, Faiz Mohd; Gani, Nur Syazwani Abdul

2018-03-01

This project studies on the establishment of a new framework for sustainable hydropower development. A hydropower development is listed as one of the prescribed activities under the Environmental Quality Order 1987. Thus, Environmental Impact Assessment (EIA) guidelines must be referred to comply with the Department of Environment (DoE) requirements. In order to execute EIA, an assessment tool that will be utilized in the final evaluation phase must be determined. The selected assessment tool that will be used is Systematic Sustainability Assessment(SSA) which is a new integrated tool to evaluate the sustainability performance. A pilot run is conducted in five different departments within the Energy Company to validate the efficiency of the SSA tool. The parameters to be evaluated are constructed aligned with the Sustainable Development Goals (SDG) to maintain the sustainability features. Consequently, the performance level of the sustainability with respect to People, Planet and Profit (3P’s) is able to be discovered during evaluation phase in the hydropower development for continuous improvement.

General Platform for Systematic Quantitative Evaluation of Small-Molecule Permeability in Bacteria

PubMed Central

2015-01-01

The chemical features that impact small-molecule permeability across bacterial membranes are poorly understood, and the resulting lack of tools to predict permeability presents a major obstacle to the discovery and development of novel antibiotics. Antibacterials are known to have vastly different structural and physicochemical properties compared to nonantiinfective drugs, as illustrated herein by principal component analysis (PCA). To understand how these properties influence bacterial permeability, we have developed a systematic approach to evaluate the penetration of diverse compounds into bacteria with distinct cellular envelopes. Intracellular compound accumulation is quantitated using LC-MS/MS, then PCA and Pearson pairwise correlations are used to identify structural and physicochemical parameters that correlate with accumulation. An initial study using 10 sulfonyladenosines in Escherichia coli, Bacillus subtilis, and Mycobacterium smegmatis has identified nonobvious correlations between chemical structure and permeability that differ among the various bacteria. Effects of cotreatment with efflux pump inhibitors were also investigated. This sets the stage for use of this platform in larger prospective analyses of diverse chemotypes to identify global relationships between chemical structure and bacterial permeability that would enable the development of predictive tools to accelerate antibiotic drug discovery. PMID:25198656

Comparative evidence on harms in pediatric randomized clinical trials from less developed versus more developed countries is limited.

PubMed

Tedesco, Dario; Farid-Kapadia, Mufiza; Offringa, Martin; Bhutta, Zulfiqar A; Maldonado, Yvonne; Ioannidis, John P A; Contopoulos-Ioannidis, Despina G

2018-03-01

Evaluate comparative harm rates from medical interventions in pediatric randomized clinical trials (RCTs) from more developed (MDCs) and less developed countries (LDCs). Meta-epidemiologic empirical evaluation of Cochrane Database of Systematic Reviews (June 2014) meta-analyses reporting clinically important harm-outcomes (severe adverse events [AEs], discontinuations due to AEs, any AE, and mortality) that included at least one pediatric RCT from MDCs and at least one from LDCs. We estimated relative odds ratios (RORs) for each harm, within each meta-analysis, between RCTs from MDCs and LDCs and calculated random-effects-summary-RORs (sRORs) for each harm across multiple meta-analyses. Only 1% (26/2,363) of meta-analyses with clinically important harm-outcomes in the entire Cochrane Database of Systematic Reviews included pediatric RCTs both from MDCs and LDCs. We analyzed 26 meta-analyses with 244 data sets from pediatric RCTs, 116 from MDCs and 128 from LDCs (64 and 66 unique RCTs respectively). The summary ROR was 0.92 (95% confidence intervals: 0.78-1.08) for severe AEs; 1.13 (0.54-2.34) for discontinuations due to AEs; 1.10 (0.77-1.59) for any AE; and 0.99 (0.61-1.61) for mortality and for the all-harms-combined-end point 0.96 (0.83-1.10). Differences of ROR-point-estimates ≥2-fold between MDCs and LDCs were identified in 35% of meta-analyses. We found no major systematic differences in harm rates in pediatric trials between MDCs and LDCs, but data on harms in children were overall very limited. Copyright © 2017 Elsevier Inc. All rights reserved.

Costing evidence for health care decision-making in Austria: A systematic review.

PubMed

Mayer, Susanne; Kiss, Noemi; Łaszewska, Agata; Simon, Judit

2017-01-01

With rising healthcare costs comes an increasing demand for evidence-informed resource allocation using economic evaluations worldwide. Furthermore, standardization of costing and reporting methods both at international and national levels are imperative to make economic evaluations a valid tool for decision-making. The aim of this review is to assess the availability and consistency of costing evidence that could be used for decision-making in Austria. It describes systematically the current economic evaluation and costing studies landscape focusing on the applied costing methods and their reporting standards. Findings are discussed in terms of their likely impacts on evidence-based decision-making and potential suggestions for areas of development. A systematic literature review of English and German language peer-reviewed as well as grey literature (2004-2015) was conducted to identify Austrian economic analyses. The databases MEDLINE, EMBASE, SSCI, EconLit, NHS EED and Scopus were searched. Publication and study characteristics, costing methods, reporting standards and valuation sources were systematically synthesised and assessed. A total of 93 studies were included. 87% were journal articles, 13% were reports. 41% of all studies were full economic evaluations, mostly cost-effectiveness analyses. Based on relevant standards the most commonly observed limitations were that 60% of the studies did not clearly state an analytical perspective, 25% of the studies did not provide the year of costing, 27% did not comprehensively list all valuation sources, and 38% did not report all applied unit costs. There are substantial inconsistencies in the costing methods and reporting standards in economic analyses in Austria, which may contribute to a low acceptance and lack of interest in economic evaluation-informed decision making. To improve comparability and quality of future studies, national costing guidelines should be updated with more specific methodological guidance and a national reference cost library should be set up to allow harmonisation of valuation methods.

Systematic Review of Health Economic Evaluation Studies Developed in Brazil from 1980 to 2013.

PubMed

Decimoni, Tassia Cristina; Leandro, Roseli; Rozman, Luciana Martins; Craig, Dawn; Iglesias, Cynthia P; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2018-01-01

Brazil has sought to use economic evaluation to support healthcare decision-making processes. While a number of health economic evaluations (HEEs) have been conducted, no study has systematically reviewed the quality of Brazilian HEE. The objective of this systematic review was to provide an overview regarding the state of HEE research and to evaluate the number, characteristics, and quality of reporting of published HEE studies conducted in a Brazilian setting. We systematically searched electronic databases (MEDLINE, EMBASE, Latin American, and Caribbean Literature on Health Sciences Database, Scientific Electronic Library Online, NHS Economic Evaluation Database, health technology assessment Database, Bireme, and Biblioteca Virtual em Saúde Economia da Saúde ); citation indexes (SCOPUS, Web of Science), and Sistema de Informação da Rede Brasileira de Avaliação de Tecnologia em Saúde . Partial and full HEEs published between 1980 and 2013 that referred to a Brazilian setting were considered for inclusion. In total, 535 studies were included in the review, 36.8% of these were considered to be full HEE. The category of healthcare technologies more frequently assessed were procedures (34.8%) and drugs (28.8%) which main objective was treatment (72.1%). Forty-four percent of the studies reported their funding source and 36% reported a conflict of interest. Overall, the full HEE quality of reporting was satisfactory. But some items were generally poorly reported and significant improvement is required: (1) methods used to estimate healthcare resource use quantities and unit costs, (2) methods used to estimate utility values, (3) sources of funding, and (4) conflicts of interest. A steady number of HEE have been published in Brazil since 1980. To improve their contribution to inform national healthcare policy efforts need to be made to enhance the quality of reporting of HEEs and promote improvements in the way HEEs are designed, implemented (i.e., using sound methods for HEEs) and reported.

Costing evidence for health care decision-making in Austria: A systematic review

PubMed Central

Mayer, Susanne; Kiss, Noemi; Łaszewska, Agata

2017-01-01

Background With rising healthcare costs comes an increasing demand for evidence-informed resource allocation using economic evaluations worldwide. Furthermore, standardization of costing and reporting methods both at international and national levels are imperative to make economic evaluations a valid tool for decision-making. The aim of this review is to assess the availability and consistency of costing evidence that could be used for decision-making in Austria. It describes systematically the current economic evaluation and costing studies landscape focusing on the applied costing methods and their reporting standards. Findings are discussed in terms of their likely impacts on evidence-based decision-making and potential suggestions for areas of development. Methods A systematic literature review of English and German language peer-reviewed as well as grey literature (2004–2015) was conducted to identify Austrian economic analyses. The databases MEDLINE, EMBASE, SSCI, EconLit, NHS EED and Scopus were searched. Publication and study characteristics, costing methods, reporting standards and valuation sources were systematically synthesised and assessed. Results A total of 93 studies were included. 87% were journal articles, 13% were reports. 41% of all studies were full economic evaluations, mostly cost-effectiveness analyses. Based on relevant standards the most commonly observed limitations were that 60% of the studies did not clearly state an analytical perspective, 25% of the studies did not provide the year of costing, 27% did not comprehensively list all valuation sources, and 38% did not report all applied unit costs. Conclusion There are substantial inconsistencies in the costing methods and reporting standards in economic analyses in Austria, which may contribute to a low acceptance and lack of interest in economic evaluation-informed decision making. To improve comparability and quality of future studies, national costing guidelines should be updated with more specific methodological guidance and a national reference cost library should be set up to allow harmonisation of valuation methods. PMID:28806728

Systematic review of the empirical investigation of resources to support decision-making regarding BRCA1 and BRCA2 genetic testing in women with breast cancer.

PubMed

Grimmett, Chloe; Pickett, Karen; Shepherd, Jonathan; Welch, Karen; Recio-Saucedo, Alejandra; Streit, Elke; Seers, Helen; Armstrong, Anne; Cutress, Ramsey I; Evans, D Gareth; Copson, Ellen; Meiser, Bettina; Eccles, Diana; Foster, Claire

2018-05-01

Identify existing resources developed and/or evaluated empirically in the published literature designed to support women with breast cancer making decisions regarding genetic testing for BRCA1/2 mutations. Systematic review of seven electronic databases. Studies were included if they described or evaluated resources that were designed to support women with breast cancer in making a decision to have genetic counselling or testing for familial breast cancer. Outcome and process evaluations, using any type of study design, as well as articles reporting the development of decision aids, were eligible for inclusion. Total of 9 publications, describing 6 resources were identified. Resources were effective at increasing knowledge or understanding of hereditary breast cancer. Satisfaction with resources was high. There was no evidence that any resource increased distress, worry or decisional conflict. Few resources included active functionalities for example, values-based exercises, to support decision-making. Tailored resources supporting decision-making may be helpful and valued by patients and increase knowledge of hereditary breast cancer, without causing additional distress. Clinicians should provide supportive written information to patients where it is available. However, there is a need for robustly developed decision tools to support decision-making around genetic testing in women with breast cancer. Copyright © 2017 Elsevier B.V. All rights reserved.

Measurement properties of instruments evaluating self-care and related concepts in people with chronic obstructive pulmonary disease: A systematic review.

PubMed

Clari, Marco; Matarese, Maria; Alvaro, Rosaria; Piredda, Michela; De Marinis, Maria Grazia

2016-01-01

The use of valid and reliable instruments for assessing self-care is crucial for the evaluation of chronic obstructive pulmonary disease (COPD) management programs. The aim of this review is to evaluate the measurement properties and theoretical foundations of instruments for assessing self-care and related concepts in people with COPD. A systematic review was conducted of articles describing the development and validation of self-care instruments. The methodological quality of the measurement properties was assessed using the COSMIN checklist. Ten studies were included evaluating five instruments: three for assessing self-care and self-management and two for assessing self-efficacy. The COPD Self-Efficacy Scale was the most studied instrument, but due to poor study methodological quality, evidence about its measurement properties is inconclusive. Evidence from the COPD Self-Management Scale is more promising, but only one study tested its properties. Due to inconclusive evidence of their measurement properties, no instrument can be recommended for clinical use. Copyright © 2016 Elsevier Inc. All rights reserved.

A new evaluation tool to obtain practice-based evidence of worksite health promotion programs.

PubMed

Dunet, Diane O; Sparling, Phillip B; Hersey, James; Williams-Piehota, Pamela; Hill, Mary D; Hanssen, Carl; Lawrenz, Frances; Reyes, Michele

2008-10-01

The Centers for Disease Control and Prevention developed the Swift Worksite Assessment and Translation (SWAT) evaluation method to identify promising practices in worksite health promotion programs. The new method complements research studies and evaluation studies of evidence-based practices that promote healthy weight in working adults. We used nationally recognized program evaluation standards of utility, feasibility, accuracy, and propriety as the foundation for our 5-step method: 1) site identification and selection, 2) site visit, 3) post-visit evaluation of promising practices, 4) evaluation capacity building, and 5) translation and dissemination. An independent, outside evaluation team conducted process and summative evaluations of SWAT to determine its efficacy in providing accurate, useful information and its compliance with evaluation standards. The SWAT evaluation approach is feasible in small and medium-sized workplace settings. The independent evaluation team judged SWAT favorably as an evaluation method, noting among its strengths its systematic and detailed procedures and service orientation. Experts in worksite health promotion evaluation concluded that the data obtained by using this evaluation method were sufficient to allow them to make judgments about promising practices. SWAT is a useful, business-friendly approach to systematic, yet rapid, evaluation that comports with program evaluation standards. The method provides a new tool to obtain practice-based evidence of worksite health promotion programs that help prevent obesity and, more broadly, may advance public health goals for chronic disease prevention and health promotion.

Application of Multi-level Grey Evaluation on Geological Tourism Resources’ Economic Values of Geopark: A Case Study of Huashan Geopark in Shaanxi Province

NASA Astrophysics Data System (ADS)

Zhang, Yang; Gong, Xianjie

2018-01-01

Geo-park gives priority to geographical relic landscapes. It has not only rich geological touristic resources but also extraordinarily high values for economic development. Taking Huashan Geological Park as an example, the thesis systematically analyzes the characteristics of the geological touristic resources in this park. It applies the method of multilevel grey evaluation to establish the evaluation model for the economic values of the touristic resources in the geological park and presents detailed result of the assessment. The result concludes an excellent grade for the comprehensive evaluation of the economic values of Huashan geological touristic resources, reflecting the outstanding natural advantages of the park in geological resources. Moreover, in the single-item evaluations, the scientific evaluation ranks the highest in score, indicating that the geological touristic resources of the park have extraordinary geologically science-popularizing values as a significant condition for the development of scientific tours. It shows that the park is endowed with excellent prospects for economic development.

Environmental Metals and Cardiovascular Disease in Adults: A Systematic Review beyond Lead and Cadmium

PubMed Central

Nigra, Anne E; Ruiz-Hernandez, Adrian; Redon, Josep; Navas-Acien, Ana; Tellez-Plaza, Maria

2018-01-01

Published systematic reviews concluded that there is moderate to strong evidence to infer a potential role of lead and cadmium, widespread metal exposures, as cardiovascular risk factors. For other non-essential metals, the evidence has not been appraised systematically. Our objective was to systematically review epidemiologic studies on the association between cardiovascular disease in adults and the environmental metals antimony, barium, chromium, nickel, tungsten, uranium, and vanadium. We identified a total of 4 articles on antimony, 1 on barium, 5 on chromium, 1 on nickel, 4 on tungsten, 1 on uranium and 0 on vanadium. We concluded that the current evidence is not sufficient to inform on the cardiovascular role of these metals because the small number of studies. Few experimental studies have also evaluated the role of these metals in cardiovascular outcomes. Additional epidemiologic and experimental studies, including prospective cohort studies, are needed to understand the role of metals, including exposure to metal mixtures, in cardiovascular disease development. PMID:27783356

Development of risk-based nanomaterial groups for occupational exposure control

NASA Astrophysics Data System (ADS)

Kuempel, E. D.; Castranova, V.; Geraci, C. L.; Schulte, P. A.

2012-09-01

Given the almost limitless variety of nanomaterials, it will be virtually impossible to assess the possible occupational health hazard of each nanomaterial individually. The development of science-based hazard and risk categories for nanomaterials is needed for decision-making about exposure control practices in the workplace. A possible strategy would be to select representative (benchmark) materials from various mode of action (MOA) classes, evaluate the hazard and develop risk estimates, and then apply a systematic comparison of new nanomaterials with the benchmark materials in the same MOA class. Poorly soluble particles are used here as an example to illustrate quantitative risk assessment methods for possible benchmark particles and occupational exposure control groups, given mode of action and relative toxicity. Linking such benchmark particles to specific exposure control bands would facilitate the translation of health hazard and quantitative risk information to the development of effective exposure control practices in the workplace. A key challenge is obtaining sufficient dose-response data, based on standard testing, to systematically evaluate the nanomaterials' physical-chemical factors influencing their biological activity. Categorization processes involve both science-based analyses and default assumptions in the absence of substance-specific information. Utilizing data and information from related materials may facilitate initial determinations of exposure control systems for nanomaterials.

Sequencing of hepatitis C virus for detection of resistance to direct-acting antiviral therapy: A systematic review.

PubMed

Bartlett, Sofia R; Grebely, Jason; Eltahla, Auda A; Reeves, Jacqueline D; Howe, Anita Y M; Miller, Veronica; Ceccherini-Silberstein, Francesca; Bull, Rowena A; Douglas, Mark W; Dore, Gregory J; Harrington, Patrick; Lloyd, Andrew R; Jacka, Brendan; Matthews, Gail V; Wang, Gary P; Pawlotsky, Jean-Michel; Feld, Jordan J; Schinkel, Janke; Garcia, Federico; Lennerstrand, Johan; Applegate, Tanya L

2017-07-01

The significance of the clinical impact of direct-acting antiviral (DAA) resistance-associated substitutions (RASs) in hepatitis C virus (HCV) on treatment failure is unclear. No standardized methods or guidelines for detection of DAA RASs in HCV exist. To facilitate further evaluations of the impact of DAA RASs in HCV, we conducted a systematic review of RAS sequencing protocols, compiled a comprehensive public library of sequencing primers, and provided expert guidance on the most appropriate methods to screen and identify RASs. The development of standardized RAS sequencing protocols is complicated due to a high genetic variability and the need for genotype- and subtype-specific protocols for multiple regions. We have identified several limitations of the available methods and have highlighted areas requiring further research and development. The development, validation, and sharing of standardized methods for all genotypes and subtypes should be a priority. ( Hepatology Communications 2017;1:379-390).

Identifying Obstacles and Research Gaps of Telemedicine Projects: Approach for a State-of-the-Art Analysis.

PubMed

Harst, Lorenz; Timpel, Patrick; Otto, Lena; Wollschlaeger, Bastian; Richter, Peggy; Schlieter, Hannes

2018-01-01

This paper presents an approach for an evaluation of finished telemedicine projects using qualitative methods. Telemedicine applications are said to improve the performance of health care systems. While there are countless telemedicine projects, the vast majority never makes the threshold from testing to implementation and diffusion. Projects were collected from German project databases in the area of telemedicine following systematically developed criteria. In a testing phase, ten projects were subject to a qualitative content analysis to identify limitations, need for further research, and lessons learned. Using Mayring's method of inductive category development, six categories of possible future research were derived. Thus, the proposed method is an important contribution to diffusion and translation research regarding telemedicine, as it is applicable to a systematic research of databases.

[Dialectical Behavior Therapy (DBT)--developments and empirical evidence].

PubMed

Burmeister, Kerstin; Höschel, Klaus; von Auer, Anne Kristin; Reiske, Sophie; Schweiger, Ulrich; Sipos, Valerija; Philipsen, Alexandra; Priebe, Kathlen; Bohus, Martin

2014-07-01

Dialectical Behavior Therapy has been initially designed and evaluated as an outpatient-treatment program for chronic suicidal female patients. Within the last years, several adaptations of DBT for specific comorbidities, other settings or other disorders related to emotion dysregulation have been developed. This report reviews conceptual aspects and the scientific evidence of initially designed Dialectical Behavior Therapy and the adaptations. Systematic literature search and systematic review. Recently, two meta-analyses which are based on randomized controlled trials conclude robust and stabile effects of DBT Evidence from further RCTs and other studies show promise for the properties of many DBT adaptations. The current review of the literature suggests a good effectiveness of DBT, especially on complex disorders with deficits in the field of emotion regulation. © Georg Thieme Verlag KG Stuttgart · New York.

Maximizing the Impact of Systematic Reviews in Health Care Decision Making: A Systematic Scoping Review of Knowledge-Translation Resources

PubMed Central

Chambers, Duncan; Wilson, Paul M; Thompson, Carl A; Hanbury, Andria; Farley, Katherine; Light, Kate

2011-01-01

Context: Barriers to the use of systematic reviews by policymakers may be overcome by resources that adapt and present the findings in formats more directly tailored to their needs. We performed a systematic scoping review to identify such knowledge-translation resources and evaluations of them. Methods: Resources were eligible for inclusion in this study if they were based exclusively or primarily on systematic reviews and were aimed at health care policymakers at the national or local level. Resources were identified by screening the websites of health technology assessment agencies and systematic review producers, supplemented by an email survey. Electronic databases and proceedings of the Cochrane Colloquium and HTA International were searched as well for published and unpublished evaluations of knowledge-translation resources. Resources were classified as summaries, overviews, or policy briefs using a previously published classification. Findings: Twenty knowledge-translation resources were identified, of which eleven were classified as summaries, six as overviews, and three as policy briefs. Resources added value to systematic reviews by, for example, evaluating their methodological quality or assessing the reliability of their conclusions or their generalizability to particular settings. The literature search found four published evaluation studies of knowledge-translation resources, and the screening of abstracts and contact with authors found three more unpublished studies. The majority of studies reported on the perceived usefulness of the service, although there were some examples of review-based resources being used to assist actual decision making. Conclusions: Systematic review producers provide a variety of resources to help policymakers, of which focused summaries are the most common. More evaluations of these resources are required to ensure users’ needs are being met, to demonstrate their impact, and to justify their funding. PMID:21418315

Systematic Evaluation of Professional Performance: Legally Supported Procedure and Process.

ERIC Educational Resources Information Center

Kerl, Stella Beatriz; Garcia, John L.; McCullough, C. Sue; Maxwell, Melissa Elaine

2002-01-01

Legal challenges to counseling students' dismissal that are based on interpersonal or clinical incompetence require sound systematic academic evaluation and adherence to procedural and substantive due process. Presents an examination of professional competency from counselor education and legal perspectives, an evaluation procedure and process,…

Reviews and syntheses: Revisiting the boron systematics of aragonite and their application to coral calcification

NASA Astrophysics Data System (ADS)

DeCarlo, Thomas M.; Holcomb, Michael; McCulloch, Malcolm T.

2018-05-01

The isotopic and elemental systematics of boron in aragonitic coral skeletons have recently been developed as a proxy for the carbonate chemistry of the coral extracellular calcifying fluid. With knowledge of the boron isotopic fractionation in seawater and the B/Ca partition coefficient (KD) between aragonite and seawater, measurements of coral skeleton δ11B and B/Ca can potentially constrain the full carbonate system. Two sets of abiogenic aragonite precipitation experiments designed to quantify KD have recently made possible the application of this proxy system. However, while different KD formulations have been proposed, there has not yet been a comprehensive analysis that considers both experimental datasets and explores the implications for interpreting coral skeletons. Here, we evaluate four potential KD formulations: three previously presented in the literature and one newly developed. We assess how well each formulation reconstructs the known fluid carbonate chemistry from the abiogenic experiments, and we evaluate the implications for deriving the carbonate chemistry of coral calcifying fluid. Three of the KD formulations performed similarly when applied to abiogenic aragonites precipitated from seawater and to coral skeletons. Critically, we find that some uncertainty remains in understanding the mechanism of boron elemental partitioning between aragonite and seawater, and addressing this question should be a target of additional abiogenic precipitation experiments. Despite this, boron systematics can already be applied to quantify the coral calcifying fluid carbonate system, although uncertainties associated with the proxy system should be carefully considered for each application. Finally, we present a user-friendly computer code that calculates coral calcifying fluid carbonate chemistry, including propagation of uncertainties, given inputs of boron systematics measured in coral skeleton.

Transition to adult services for young people with mental health needs: A systematic review.

PubMed

Paul, Moli; Street, Cathy; Wheeler, Nicola; Singh, Swaran P

2015-07-01

Young people's transition from child and adolescent (CAMHS) to adult mental health services (AMHS). To systematically review evidence on the effectiveness of different models of CAMHS-AMHS transitional care, service user and staff perspectives, and facilitators of/barriers to effective CAMHS-AMHS transition. A systematic search in May 2012 of Medline, PsycINFO, CINAHL, EMBASE, AMED, Health Business Elite, HMIC, Cochrane Database, Web of Science and ASSIA; ancestral searches; and consultation with experts in the field. Qualitative, quantitative and mixed-methods primary research on the CAMHS-AMHS health-care transition of young people (aged 16-21 years) with mental health problems. Two reviewers independently completed a standardised data extraction form and critically evaluated identified documents using a validated appraisal tool for empirical studies with varied methodologies. A total of 19 studies of variable quality were identified. None were randomised or case-controlled trials. Studies incorporating service user/carer perspectives highlighted the need to tackle stigma and provide accessible, age-appropriate services. Parents/carers wanted more involvement with AMHS. Transitional care provision was considered patchy and often not prioritised within mental health services. There was no clear evidence of superior effectiveness of any particular model. High-quality evidence of transitional care models is lacking. Data broadly support the development of programmes that address the broader transitional care needs of 'emerging adults' and their mental health needs but further evaluation is necessary. Developing robust transitional mental health care will require the policy-practice gap to be addressed and development of accessible, acceptable, responsive, age-appropriate provision. © The Author(s) 2014.

Systematic review of empowerment measures in health promotion.

PubMed

Cyril, Sheila; Smith, Ben J; Renzaho, Andre M N

2016-12-01

Empowerment, a multi-level construct comprising individual, community and organizational domains, is a fundamental value and goal in health promotion. While a range of scales have been developed for the measurement of empowerment, the qualities of these have not been rigorously assessed. The aim of this study was to evaluate the measurement properties of quantitative empowerment scales and their applicability in health promotion programs. A systematic review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was done to evaluate empowerment scales across three dimensions: item development, reliability and validity. This was followed by assessment of measurement properties using a ratings scale with criteria addressing an a priori explicit theoretical framework, assessment of content validity, internal consistency and factor analysis to test structural validity. Of the 20 studies included in this review, only 8 (40%) used literature reviews, expert panels and empirical studies to develop scale items and 9 (45%) of studies fulfilled ≥5 criteria on the ratings scale. Two studies (10%) measured community empowerment and one study measured organizational empowerment, the rest (85%) measured individual empowerment. This review highlights important gaps in the measurement of community and organizational domains of empowerment using quantitative scales. A priority for future empowerment research is to investigate and explore approaches such as mixed methods to enable adequate measurement of empowerment across all three domains. This would help health promotion practitioners to effectively measure empowerment as a driver of change and an outcome in health promotion programs. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

The effect of docetaxel on developing oedema in patients with breast cancer: a systematic review.

PubMed

Hugenholtz-Wamsteker, W; Robbeson, C; Nijs, J; Hoelen, W; Meeus, M

2016-03-01

Docetaxel is extensively used in chemotherapy for the treatment of breast cancer. Little attention has been given to oedema as a possible side effect of docetaxel-containing therapies. Until now, no review was conducted to evaluate docetaxel-containing therapies versus docetaxel-free therapies on the magnitude of the risk of developing oedema. In this systematic review, we investigated the risk of developing oedema in patients being treated for breast cancer with or without docetaxel. In this systematic literature review, we searched PubMed and Web of Knowledge for studies on breast cancer patients treated with chemotherapy containing docetaxel. We included clinical trials comparing docetaxel versus docetaxel-free chemotherapy. Oedema had to be reported and measured as a key outcome or an adverse effect. Methodological checklists were used to assess the risk of bias within the selected studies. Seven randomised clinical trials were included. Six trials were of moderate methodological quality. All trials showed an increased rate of oedema in the docetaxel-treatment arm. The trial of weakest methodological quality reported the highest incidence of oedema. The results moderately suggest that adjuvant chemotherapy containing docetaxel is related to a significantly increased risk of developing oedema, compared with docetaxel-free chemotherapy. © 2014 John Wiley & Sons Ltd.

Short message service (SMS) applications for disease prevention in developing countries.

PubMed

Déglise, Carole; Suggs, L Suzanne; Odermatt, Peter

2012-01-12

The last decade has witnessed unprecedented growth in the number of mobile phones in the developing world, thus linking millions of previously unconnected people. The ubiquity of mobile phones, which allow for short message service (SMS), provides new and innovative opportunities for disease prevention efforts. The aim of this review was to describe the characteristics and outcomes of SMS interventions for disease prevention in developing countries and provide recommendations for future work. A systematic search of peer-reviewed and gray literature was performed for papers published in English, French, and German before May 2011 that describe SMS applications for disease prevention in developing countries. A total of 34 SMS applications were described, among which 5 had findings of an evaluation reported. The majority of SMS applications were pilot projects in various levels of sophistication; nearly all came from gray literature sources. Many applications were initiated by the project with modes of intervention varying between one-way or two-way communication, with or without incentives, and with educative games. Evaluated interventions were well accepted by the beneficiaries. The primary barriers identified were language, timing of messages, mobile network fluctuations, lack of financial incentives, data privacy, and mobile phone turnover. This review illustrates that while many SMS applications for disease prevention exist, few have been evaluated. The dearth of peer-reviewed studies and the limited evidence found in this systematic review highlight the need for high-quality efficacy studies examining behavioral, social, and economic outcomes of SMS applications and mobile phone interventions aimed to promote health in developing country contexts.

Short Message Service (SMS) Applications for Disease Prevention in Developing Countries

PubMed Central

Suggs, L. Suzanne; Odermatt, Peter

2012-01-01

Background The last decade has witnessed unprecedented growth in the number of mobile phones in the developing world, thus linking millions of previously unconnected people. The ubiquity of mobile phones, which allow for short message service (SMS), provides new and innovative opportunities for disease prevention efforts. Objective The aim of this review was to describe the characteristics and outcomes of SMS interventions for disease prevention in developing countries and provide recommendations for future work. Methods A systematic search of peer-reviewed and gray literature was performed for papers published in English, French, and German before May 2011 that describe SMS applications for disease prevention in developing countries. Results A total of 34 SMS applications were described, among which 5 had findings of an evaluation reported. The majority of SMS applications were pilot projects in various levels of sophistication; nearly all came from gray literature sources. Many applications were initiated by the project with modes of intervention varying between one-way or two-way communication, with or without incentives, and with educative games. Evaluated interventions were well accepted by the beneficiaries. The primary barriers identified were language, timing of messages, mobile network fluctuations, lack of financial incentives, data privacy, and mobile phone turnover. Conclusion This review illustrates that while many SMS applications for disease prevention exist, few have been evaluated. The dearth of peer-reviewed studies and the limited evidence found in this systematic review highlight the need for high-quality efficacy studies examining behavioral, social, and economic outcomes of SMS applications and mobile phone interventions aimed to promote health in developing country contexts. PMID:22262730

Integration of subclassification strategies in randomised controlled clinical trials evaluating manual therapy treatment and exercise therapy for non-specific chronic low back pain: a systematic review.

PubMed

Fersum, K V; Dankaerts, W; O'Sullivan, P B; Maes, J; Skouen, J S; Bjordal, J M; Kvåle, A

2010-11-01

There is lack of evidence for specific treatment interventions for patients with non-specific chronic low back pain (NSCLBP) despite the substantial amount of randomised controlled clinical trials evaluating treatment outcome for this disorder. It has been hypothesised that this vacuum of evidence is caused by the lack of subclassification of the heterogeneous population of patients with chronic low back pain for outcome research. A systematic review. A systematic review with a meta-analysis was undertaken to determine the integration of subclassification strategies with matched interventions in randomised controlled clinical trials evaluating manual therapy treatment and exercise therapy for NSCLBP. A structured search for relevant studies in Embase, Cinahl, Medline, PEDro and the Cochrane Trials Register database, followed by hand searching all relevant studies in English up to December 2008. Only 5 of 68 studies (7.4%) subclassified patients beyond applying general inclusion and exclusion criteria. In the few studies where classification and matched interventions have been used, our meta-analysis showed a statistical difference in favour of the classification-based intervention for reductions in pain (p=0.004) and disability (p=0.0005), both for short-term and long-term reduction in pain (p=0.001). Effect sizes ranged from moderate (0.43) for short term to minimal (0.14) for long term. A better integration of subclassification strategies in NSCLBP outcome research is needed. We propose the development of explicit recommendations for the use of subclassification strategies and evaluation of targeted interventions in future research evaluating NSCLBP.

Systematic review of ablative neurosurgical techniques for the treatment of trigeminal neuralgia.

PubMed

Lopez, Benjamin C; Hamlyn, Peter J; Zakrzewska, Joanna M

2004-04-01

There are no randomized controlled trials comparing retrogasserian percutaneous radiofrequency thermocoagulation, glycerol rhizolysis, balloon compression of the gasserian ganglion, and stereotactic radiosurgery, nor are there systematic reviews using predefined quality criteria. The objective of this study was to systematically identify all of the studies reporting outcomes and complications of ablative techniques for treatment of trigeminal neuralgia, from the development of electronic databases, and to evaluate them with predefined quality criteria. Inclusion criteria for the outcome analysis included thorough demographic documentation, defined diagnostic and outcome criteria, a minimum of 30 patients treated and median/mean follow-up times of 12 months, not more than 20% of patients lost to follow-up monitoring, Kaplan-Meier actuarial analysis of individual procedures, less than 10% of patients retreated because of failure or early recurrence, and a minimal dose of 70 Gy for stereotactic radiosurgery. High-quality studies with no actuarial analysis were used for the evaluation of complications. Of 175 studies identified, 9 could be used to evaluate rates of complete pain relief on a yearly basis and 22 could be used to evaluate complications. In mixed series, radiofrequency thermocoagulation offered higher rates of complete pain relief, compared with glycerol rhizolysis and stereotactic radiosurgery, although it demonstrated the greatest number of complications. Radiofrequency thermocoagulation offers the highest rates of complete pain relief, although further data on balloon microcompression are required. It is essential that uniform outcome measures and actuarial methods be universally adopted for the reporting of surgical results. Randomized controlled trials are required to reliably evaluate new surgical techniques.

A systematic review of leadership training for medical students.

PubMed

Lyons, Oscar; Su'a, Bruce; Locke, Michelle; Hill, Andrew

2018-01-19

Leadership is increasingly being recognised as an essential requirement for doctors. Many medical schools are in the process of developing formal leadership training programmes, but it remains to be elucidated what characteristics make such programmes effective, and to what extent current programmes are effective, beyond merely positive learner reactions. This review's objective was to investigate the effectiveness of undergraduate medical leadership curricula and to explore common features of effective curricula. A systematic literature search was conducted. Articles describing and evaluating undergraduate medical leadership curricula were included. Outcomes were stratified and analysed according to a modified Kirkpatrick's model for evaluating educational outcomes. Eleven studies met inclusion criteria. Leadership curricula evaluated were markedly heterogeneous in their duration and composition. The majority of studies utilised pre- and post- intervention questionnaires for evaluation. Two studies described randomised controlled trials with objective measures. Outcomes were broadly positive. Only one study reported neutral outcomes. A wide range of leadership curricula have shown subjective effectiveness, including short interventions. There is limited objective evidence however, and few studies have measured effectiveness at the system and patient levels. Further research is needed investigating objective and downstream outcomes, and use of standard frameworks for evaluation will facilitate effective comparison of initiatives.

Functional foods: health claim-food product compatibility and the impact of health claim framing on consumer evaluation.

PubMed

van Kleef, Ellen; van Trijp, Hans C M; Luning, Pieternel

2005-06-01

Two studies are reported, which aim to strengthen the scientific underpinning of strategic decisions regarding functional food development, as to (1) which health benefits to claim, (2) with which product (category), and (3) in which communication format. The first exploratory study is a secondary analysis of 10 different health claims systematically combined with 10 different food carriers to evaluate their combined suitability for functional food positioning. The results show that consumers tend to prefer functional food concepts that primarily communicate disease-related health benefits in carriers with a healthy image or health positioning history. Study 2 examines health claim format and systematically varies the way in which specific health benefits are being communicated to the consumer. Two physiologically oriented claims (heart disease and osteoporosis) and two psychologically oriented food claims (stress and lack of energy) are expressed in enhanced function format versus disease risk reduction format. Also, it includes the individual difference variable of 'regulatory focus' and the health status of the respondent to explore how these factors impact health claim evaluation. The results show that consumer evaluations primarily differ to the extent that health claims are personally relevant in addressing an experienced disease state. Framing is important, but its effect differs by health benefit. No strong effects for consumers' regulatory focus were found. Underlying mechanisms of these effects and their implications for the development of functional foods are discussed.

How Do Contextual Factors Influence Implementation and Receipt of Positive Youth Development Programs Addressing Substance Use and Violence? A Qualitative Meta-Synthesis of Process Evaluations.

PubMed

Dickson, Kelly; Melendez-Torres, G J; Fletcher, Adam; Hinds, Kate; Thomas, James; Stansfield, Claire; Murphy, Simon; Campbell, Rona; Bonell, Chris

2018-05-01

Positive youth development (PYD) often aims to prevent tobacco, alcohol, and drugs use and violence. We systematically reviewed PYD interventions, synthesizing process, and outcomes evidence. Synthesis of outcomes, published elsewhere, found no overall evidence of reducing substance use or violence but notable variability of fidelity. Our synthesis of process evaluations examined how implementation varied and was influenced by context. Process evaluations of PYD aiming to reduce substance use and violence. Study Inclusion Criteria: Overall review published since 1985; written in English; focused on youth aged 11 to 18 years; focused on interventions addressing multiple positive assets; reported on theory, process, or outcomes; and concerned with reducing substance use or violence. Synthesis of process evaluations examined how implementation varies with or is influenced by context. Two reviewers in parallel. Thematic synthesis. We identified 12 reports. Community engagement enhanced program appeal. Collaboration with other agencies could broaden the activities offered. Calm but authoritative staff increased acceptability. Staff continuity underpinned diverse activities and durable relationships. Empowering participants were sometimes in tension with requiring them to engage in diverse activities. Our systematic review identified factors that might help improve the fidelity and acceptability of PYD interventions. Addressing these might enable PYD to fulfill its potential as a means of promoting health.

Systematic, Cooperative Evaluation.

ERIC Educational Resources Information Center

Nassif, Paula M.

Evaluation procedures based on a systematic evaluation methodology, decision-maker validity, new measurement and design techniques, low cost, and a high level of cooperation on the part of the school staff were used in the assessment of a public school mathematics program for grades 3-8. The mathematics curriculum was organized into Spirals which…

The Development and Implementation of an Inquiry-Based Poster Project on Sustainability in a Large Non-Majors Environmental Science Course

ERIC Educational Resources Information Center

Schmitt-Harsh, Mikaela; Harsh, Joseph A.

2013-01-01

In the past decade, systematic studies have indicated a significant regression in scientific literacy in nonscience students and students across science, technology, engineering, and mathematics disciplines in higher education. Of particular concern, evaluations of introductory lecture-based undergraduate courses have indicated deficiencies in…

A Medical Student Logbook for Streamlining Collection of Clerkship Evaluation Data.

ERIC Educational Resources Information Center

DaRosa, Debra A.; Folse, Roland

A medical student logbook that was developed by the Department of Surgery at Southern Illinois University School of Medicine to improve the clerkship is described. Specific objectives of the logbook were: (1) to reinforce student habits to systematically record relevant data concerning patients for purposes of future recall and reference; (2) to…

Protocols for Teaching Students How to Search for, Discover, and Evaluate Innovations

ERIC Educational Resources Information Center

Norton, William I., Jr.; Hale, Dena H.

2011-01-01

The authors introduce and develop protocols to guide aspiring entrepreneurs' behaviors in searching for and discovering innovative ideas that may have commercial potential. Systematic search has emerged as a theory-based, prescriptive framework to guide innovative behavior. Grounded in Fiet's theory of search and discovery, this article provides…

Teacher Development in First-Year Physical Educators: A Comparison of Effectiveness among Different Physical Education Teacher Education Backgrounds

ERIC Educational Resources Information Center

Ensign, Julene; Woods, Amelia Mays; Kulinna, Pamela Hodges

2017-01-01

Purpose: This study evaluated the teaching effectiveness of six first-year physical educators, three Southwestern and three Midwestern graduates, employing different curricular approaches. Method: Utilizing surveys, interviews, questionnaires, and systematic observations, data were analyzed through a framework of seven essential teaching tasks…

A computer-based tutorial structure for teaching and applying a complex process

Treesearch

Daniel L. Schmoldt; William G Bradshaw

1991-01-01

Economic accountability concerns for wildfire prevention planning have led to the development of an ignition management approach to fire problems. The Fire Loss Prevention Planning Process (FLPPP) systematizes fire problem analyses and concomitantly establishes a means for evaluating prescribed prevention programs. However, new users of the FLPPP have experienced...

The Use of Income Tax Returns in the Needs Analysis Procedure

ERIC Educational Resources Information Center

Rutter, Thomas M.; Wickstrom, Natala

1976-01-01

Various efforts of the University of California at San Diego to systematize and develop useful evaluation formulas for verifying income through use of Federal Income Tax Returns are reviewed. It is recommended that 100 percent collection and analysis of tax returns by the national scholarship services would maximize economy and confidentiality.…

Improvements in safety testing of lithium cells

NASA Astrophysics Data System (ADS)

Stinebring, R. C.; Krehl, P.

1985-07-01

A systematic approach was developed for evaluating the basic safety parameters of high power lithium soluble cathode cells. This approach consists of performing a series of tests on each cell model during the design, prototype and production phases. Abusive testing is performed in a facility where maximum protection is given to test personnel.

Improvements in safety testing of lithium cells

NASA Technical Reports Server (NTRS)

Stinebring, R. C.; Krehl, P.

1985-01-01

A systematic approach was developed for evaluating the basic safety parameters of high power lithium soluble cathode cells. This approach consists of performing a series of tests on each cell model during the design, prototype and production phases. Abusive testing is performed in a facility where maximum protection is given to test personnel.

Applying Information and Communication Technologies to Language Teaching and Research: An Overview

ERIC Educational Resources Information Center

Pareja-Lora, Antonio; Rodríguez-Arancón, Pilar; Calle-Martínez, Cristina

2016-01-01

Currently, there is an international change in education that includes the development of new learning programmes and policies, such as (a) bilingual education programmes, (b) the Bologna process, with an emphasis on a more autonomous way of learning, or (c) the systematic evaluation and assessment of students and educational results. These…

Systematically Retrieving Research: A Case Study Evaluating Seven Databases

ERIC Educational Resources Information Center

Taylor, Brian; Wylie, Emma; Dempster, Martin; Donnelly, Michael

2007-01-01

Objective: Developing the scientific underpinnings of social welfare requires effective and efficient methods of retrieving relevant items from the increasing volume of research. Method: We compared seven databases by running the nearest equivalent search on each. The search topic was chosen for relevance to social work practice with older people.…

Application of IATA - A case study in evaluating the global and local performance of a Bayesian Network model for Skin Sensitization

EPA Science Inventory

Since the publication of the Adverse Outcome Pathway (AOP) for skin sensitization, there have been many efforts to develop systematic approaches to integrate the information generated from different key events for decision making. The types of information characterizing key event...

Advanced Materials Technology

NASA Technical Reports Server (NTRS)

Blankenship, C. P. (Compiler); Teichman, L. A. (Compiler)

1982-01-01

Composites, polymer science, metallic materials (aluminum, titanium, and superalloys), materials processing technology, materials durability in the aerospace environment, ceramics, fatigue and fracture mechanics, tribology, and nondestructive evaluation (NDE) are discussed. Research and development activities are introduced to the nonaerospace industry. In order to provide a convenient means to help transfer aerospace technology to the commercial mainstream in a systematic manner.

Developing Prospective Elementary Teachers' Abilities to Identify Evidence of Student Mathematical Achievement

ERIC Educational Resources Information Center

Spitzer, Sandy M.; Phelps, Christine M.; Beyers, James E. R.; Johnson, Delayne Y.; Sieminski, Elizabeth M.

2011-01-01

This study investigated the effects of a classroom intervention on prospective elementary teachers' ability to evaluate evidence of student achievement of mathematical learning goals. The intervention was informed by a framework for teacher education which aims to provide prospective teachers (PTs) with the skills needed to systematically learn…

Interventions with vitamins B6, B12 and C in pregnancy

USDA-ARS?s Scientific Manuscript database

The water-soluble vitamins B6, B12 and C play important roles in maternal health as well as fetal development and physiology during gestation. This systematic review evaluates the risks and benefits of interventions with vitamins B6, B12 and C during pregnancy on maternal, neonatal and child health ...

An Evaluation Design for the Educational Programs for Pupils Who Are Orthopedically Handicapped.

ERIC Educational Resources Information Center

South Carolina State Dept. of Education, Columbia. Office of Programs for the Handicapped.

The booklet provides forms for the teacher of the orthopedically handicapped to use in systematically collecting data and designing an appropriate educational blueprint for each student. Pupil development assessment sheets include columns for recording assessment date, date of mastery, level of achievement, and comments for each behavioral…

Computer-Based Exercises for Learning to Read and Spell by Deaf Children

ERIC Educational Resources Information Center

Reitsma, Pieter

2009-01-01

There is a surprising lack of systematic research evaluating the effects of reading exercises for young deaf children. Therefore, for this article, two computer-based exercises were developed and learning effects were determined by posttests. One (spelling oriented) exercise was to select the correct word among three orthographically similar…

76 FR 44593 - Identifying the Center for Drug Evaluation and Research's Science and Research Needs...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-26

... . Submit written comments to the Division of Dockets Management (HFA-305), Food and Drug Administration... from CDER's offices were asked to identify: (1) Scientific challenges currently addressed on a case-by-case basis that might benefit from the development of a systematized approach; (2) recurrent science...

Group Cognitive-Behavioral Therapy for Insomnia in a VA Mental Health Clinic

ERIC Educational Resources Information Center

Perlman, Lawrence M.; Arnedt, J. Todd; Earnheart, Kristie L.; Gorman, Ashley A.; Shirley, Katherine G.

2008-01-01

Effective cognitive-behavioral therapies for insomnia have been developed over the past 2 decades, but they have not been systematically evaluated in some clinical settings. While insomnia is common among veterans with mental health problems, the availability of effective treatments is limited. We report on the group application of a…

Performance assessment of 3D surface imaging technique for medical imaging applications

NASA Astrophysics Data System (ADS)

Li, Tuotuo; Geng, Jason; Li, Shidong

2013-03-01

Recent development in optical 3D surface imaging technologies provide better ways to digitalize the 3D surface and its motion in real-time. The non-invasive 3D surface imaging approach has great potential for many medical imaging applications, such as motion monitoring of radiotherapy, pre/post evaluation of plastic surgery and dermatology, to name a few. Various commercial 3D surface imaging systems have appeared on the market with different dimension, speed and accuracy. For clinical applications, the accuracy, reproducibility and robustness across the widely heterogeneous skin color, tone, texture, shape properties, and ambient lighting is very crucial. Till now, a systematic approach for evaluating the performance of different 3D surface imaging systems still yet exist. In this paper, we present a systematic performance assessment approach to 3D surface imaging system assessment for medical applications. We use this assessment approach to exam a new real-time surface imaging system we developed, dubbed "Neo3D Camera", for image-guided radiotherapy (IGRT). The assessments include accuracy, field of view, coverage, repeatability, speed and sensitivity to environment, texture and color.

Learning outcomes associated with patient simulation method in pharmacotherapy education: an integrative review.

PubMed

Aura, Suvi M; Sormunen, Marjorita S T; Jordan, Sue E; Tossavainen, Kerttu A; Turunen, Hannele E

2015-06-01

The aims of this systematic integrative review were to identify evidence for the use of patient simulation teaching methods in pharmacotherapy education and to explore related learning outcomes. A systematic literature search was conducted using 6 databases as follows: CINAHL, PubMed, SCOPUS, ERIC, MEDIC, and the Cochrane Library, using the key words relating to patient simulation and pharmacotherapy. The methodological quality of each study was evaluated. Eighteen articles met the inclusion criteria. The earliest article was published in 2005. The selected research articles were subjected to qualitative content analysis. Patient simulation has been used in pharmacotherapy education for preregistration nursing, dental, medical, and pharmacy students and for the continuing education of nurses. Learning outcomes reported were summarized as follows: (1) commitment to pharmacotherapy learning, (2) development of pharmacotherapy evaluation skills, (3) improvement in pharmacotherapy application skills, and (4) knowledge and understanding of pharmacotherapy. To develop effective teaching methods and ensure health care professionals' competence in medication management, further research is needed to determine the educational and clinical effectiveness of simulation teaching methods.

The failure to fail underperforming trainees in health professions education: A BEME systematic review: BEME Guide No. 42.

PubMed

Yepes-Rios, Monica; Dudek, Nancy; Duboyce, Rita; Curtis, Jerri; Allard, Rhonda J; Varpio, Lara

2016-11-01

Many clinical educators feel unprepared and/or unwilling to report unsatisfactory trainee performance. This systematic review consolidates knowledge from medical, nursing, and dental literature on the experiences and perceptions of evaluators or assessors with this failure to fail phenomenon. We searched the English language literature in CINAHL, EMBASE, and MEDLINE from January 2005 to January 2015. Qualitative and quantitative studies were included. Following our review protocol, registered with BEME, reviewers worked in pairs to identify relevant articles. The investigators participated in thematic analysis of the qualitative data reported in these studies. Through several cycles of analysis, discussion and reflection, the team identified the barriers and enablers to failing a trainee. From 5330 articles, we included 28 publications in the review. The barriers identified were (1) assessor's professional considerations, (2) assessor's personal considerations, (3) trainee related considerations, (4) unsatisfactory evaluator development and evaluation tools, (5) institutional culture and (6) consideration of available remediation for the trainee. The enablers identified were: (1) duty to patients, to society, and to the profession, (2) institutional support such as backing a failing evaluation, support from colleagues, evaluator development, and strong assessment systems, and (3) opportunities for students after failing. The inhibiting and enabling factors to failing an underperforming trainee were common across the professions included in this study, across the 10 years of data, and across the educational continuum. We suggest that these results can inform efforts aimed at addressing the failure to fail problem.

[Characteristics of systematic reviews about the impact of pharmacists].

PubMed

Tanguay, C; Guérin, A; Bussières, J-F

2014-11-01

The pharmacists' role is varied and numerous articles evaluate the outcomes of pharmaceutical interventions. The main objectives of this study were to establish the characteristics of systematic reviews about pharmacists' interventions that were published in the last five years. A literature search was performed on Pubmed for French and English articles published between 01-01-2008 and 31-05-2013. Systematic reviews that presented the role, the interventions and the impact of pharmacists were selected by two research assistants. A total of 46 systematic reviews was identified, amongst which one third (n=15/46, 33 %) were meta-analyses. A quarter of systematic reviews did not evaluate the quality of included articles (n=13/46, 28 %). Twelve themes were identified. A median [min-max] of 16 [2-298] articles was included per systematic review. The most frequent pharmaceutical activities were patient counseling (n=41 systematic reviews), patient chart review (n=29), pharmacotherapy evaluation (n=27) and recommendations (n=26). The least frequent activities were teaching others than patients (n=12) and medical rounds participation (n=7). Many elements can influence the completion of pharmacy practice research projects; however, there exists no link between the presence of systematic reviews and the importance of pharmacists in a given healthcare program. This study presents the characteristics of 46 systematic reviews about pharmacists interventions published since 2008. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

What is the Relationship between Risky Outdoor Play and Health in Children? A Systematic Review

PubMed Central

Brussoni, Mariana; Gibbons, Rebecca; Gray, Casey; Ishikawa, Takuro; Sandseter, Ellen Beate Hansen; Bienenstock, Adam; Chabot, Guylaine; Fuselli, Pamela; Herrington, Susan; Janssen, Ian; Pickett, William; Power, Marlene; Stanger, Nick; Sampson, Margaret; Tremblay, Mark S.

2015-01-01

Risky outdoor play has been associated with promoting children’s health and development, but also with injury and death. Risky outdoor play has diminished over time, concurrent with increasing concerns regarding child safety and emphasis on injury prevention. We sought to conduct a systematic review to examine the relationship between risky outdoor play and health in children, in order to inform the debate regarding its benefits and harms. We identified and evaluated 21 relevant papers for quality using the GRADE framework. Included articles addressed the effect on health indicators and behaviours from three types of risky play, as well as risky play supportive environments. The systematic review revealed overall positive effects of risky outdoor play on a variety of health indicators and behaviours, most commonly physical activity, but also social health and behaviours, injuries, and aggression. The review indicated the need for additional “good quality” studies; however, we note that even in the face of the generally exclusionary systematic review process, our findings support the promotion of risky outdoor play for healthy child development. These positive results with the marked reduction in risky outdoor play opportunities in recent generations indicate the need to encourage action to support children’s risky outdoor play opportunities. Policy and practice precedents and recommendations for action are discussed. PMID:26062038

Views and Experiences of Persons with Chronic Diseases about Strategies that Aim to Integrate and Re-Integrate Them into Work: A Systematic Review of Qualitative Studies.

PubMed

Esteban, Eva; Coenen, Michaela; Ito, Elizabeth; Gruber, Sonja; Scaratti, Chiara; Leonardi, Matilde; Roka, Olga; Vasilou, Evdokia; Muñoz-Murillo, Amalia; Ávila, Carolina C; Kovačič, Dare S; Ivandic, Ivana; Sabariego, Carla

2018-05-18

The effectiveness of strategies targeting professional integration and reintegration strongly depends on the experiences of participants. The aim of this systematic literature review is to synthesize European qualitative studies exploring views and experiences of persons with chronic conditions regarding strategies for integration and reintegration into work. The systematic search was conducted in Medline, PsycINFO, CDR-HTA, CDR-DARE and Cochrane Systematic Reviews. Overall, 24 studies published in English between January 2011 and April 2016 were included. Most studies were carried out in Nordic countries or in the UK, and most participants were persons with either mental or musculoskeletal disorders. Ten themes emerged: individual and holistic approach, clarity of strategy and processes, timing of rehabilitation processes, experience with professionals, at the workplace and with peer groups, changes in the understanding of health and work, active involvement in the process, competencies development and motivating aspects of work. Findings highlight, among others, the need to actively involve participants in the return to work process and to provide timely and clearly structured processes and interventions. This review provides stakeholders key information to develop, plan, implement and evaluate interventions to integrate and re-integrate persons with chronic conditions into work in Europe.

Views and Experiences of Persons with Chronic Diseases about Strategies that Aim to Integrate and Re-Integrate Them into Work: A Systematic Review of Qualitative Studies

PubMed Central

Ito, Elizabeth; Gruber, Sonja; Scaratti, Chiara; Roka, Olga; Vasilou, Evdokia; Muñoz-Murillo, Amalia; Ávila, Carolina C.; Kovačič, Dare S.; Ivandic, Ivana

2018-01-01

The effectiveness of strategies targeting professional integration and reintegration strongly depends on the experiences of participants. The aim of this systematic literature review is to synthesize European qualitative studies exploring views and experiences of persons with chronic conditions regarding strategies for integration and reintegration into work. The systematic search was conducted in Medline, PsycINFO, CDR-HTA, CDR-DARE and Cochrane Systematic Reviews. Overall, 24 studies published in English between January 2011 and April 2016 were included. Most studies were carried out in Nordic countries or in the UK, and most participants were persons with either mental or musculoskeletal disorders. Ten themes emerged: individual and holistic approach, clarity of strategy and processes, timing of rehabilitation processes, experience with professionals, at the workplace and with peer groups, changes in the understanding of health and work, active involvement in the process, competencies development and motivating aspects of work. Findings highlight, among others, the need to actively involve participants in the return to work process and to provide timely and clearly structured processes and interventions. This review provides stakeholders key information to develop, plan, implement and evaluate interventions to integrate and re-integrate persons with chronic conditions into work in Europe. PMID:29783671

A quasi-experimental feasibility study to determine the effect of a systematic treatment programme on the scores of the Nottingham Adjustment Scale of individuals with visual field deficits following stroke.

PubMed

Taylor, Lisa; Poland, Fiona; Harrison, Peter; Stephenson, Richard

2011-01-01

To evaluate a systematic treatment programme developed by the researcher that targeted aspects of visual functioning affected by visual field deficits following stroke. The study design was a non-equivalent control (conventional) group pretest-posttest quasi-experimental feasibility design, using multisite data collection methods at specified stages. The study was undertaken within three acute hospital settings as outpatient follow-up sessions. Individuals who had visual field deficits three months post stroke were studied. A treatment group received routine occupational therapy and an experimental group received, in addition, a systematic treatment programme. The treatment phase of both groups lasted six weeks. The Nottingham Adjustment Scale, a measure developed specifically for visual impairment, was used as the primary outcome measure. The change in Nottingham Adjustment Scale score was compared between the experimental (n = 7) and conventional (n = 8) treatment groups using the Wilcoxon signed ranks test. The result of Z = -2.028 (P = 0.043) showed that there was a statistically significant difference between the change in Nottingham Adjustment Scale score between both groups. The introduction of the systematic treatment programme resulted in a statistically significant change in the scores of the Nottingham Adjustment Scale.

What is the Relationship between Risky Outdoor Play and Health in Children? A Systematic Review.

PubMed

Brussoni, Mariana; Gibbons, Rebecca; Gray, Casey; Ishikawa, Takuro; Sandseter, Ellen Beate Hansen; Bienenstock, Adam; Chabot, Guylaine; Fuselli, Pamela; Herrington, Susan; Janssen, Ian; Pickett, William; Power, Marlene; Stanger, Nick; Sampson, Margaret; Tremblay, Mark S

2015-06-08

Risky outdoor play has been associated with promoting children's health and development, but also with injury and death. Risky outdoor play has diminished over time, concurrent with increasing concerns regarding child safety and emphasis on injury prevention. We sought to conduct a systematic review to examine the relationship between risky outdoor play and health in children, in order to inform the debate regarding its benefits and harms. We identified and evaluated 21 relevant papers for quality using the GRADE framework. Included articles addressed the effect on health indicators and behaviours from three types of risky play, as well as risky play supportive environments. The systematic review revealed overall positive effects of risky outdoor play on a variety of health indicators and behaviours, most commonly physical activity, but also social health and behaviours, injuries, and aggression. The review indicated the need for additional "good quality" studies; however, we note that even in the face of the generally exclusionary systematic review process, our findings support the promotion of risky outdoor play for healthy child development. These positive results with the marked reduction in risky outdoor play opportunities in recent generations indicate the need to encourage action to support children's risky outdoor play opportunities. Policy and practice precedents and recommendations for action are discussed.

Interventions for preventing mother-to-child HIV transmission: protocol of an overview of systematic reviews.

PubMed

Wariki, Windy Mariane Virenia; Ota, Erika; Mori, Rintaro; Wiysonge, Charles S; Horvath, Hacsi; Read, Jennifer S

2017-06-21

Various interventions to prevent mother-to-child-transmission (MTCT) of HIV have been investigated and implemented. A number of systematic reviews assessing the efficacy of interventions for the prevention of MTCT of HIV reported antiretroviral prophylaxis, caesarean section before labour and before ruptured membranes, and complete avoidance of breastfeeding were efficacious for preventing MTCT of HIV. Recent WHO guidelines recommend lifelong antiretroviral therapy for all pregnant women for treatment of the woman's own HIV infection and for prevention of MTCT of HIV. Therefore, the objective of this overview is to evaluate the currently available systematic reviews of interventions for preventing MTCT of HIV, and to identify the current best evidence-based interventions for reducing the risk of MTCT of HIV. We will include only peer-reviewed systematic reviews of randomised or quasi-randomised controlled trials assessing the effects of interventions for preventing MTCT of HIV that target both HIV-infected women and children aged 2 years and younger born to HIV-infected women. We will search the Cochrane Database of Systematic Reviews, the Database of Abstracts of Reviews of Effectiveness, Ovid MEDLINE and EMBASE. We will assess review eligibility, the methodological quality of included systematic reviews using A Measurement Tool to Assess The Systematic Reviews and will extract data, comparing our results and resolving discrepancies by consensus. Finally, we will independently assess the certainty of the evidence using Grades of Recommendation, Assessment, Development and Evaluation. Ethics approval is not required. We will publish the results in a peer-reviewed journal and present at conferences, which will inform future research and will be useful for healthcare managers, administrators and policymakers to guide resource allocation decisions and optimisation of interventions to prevent the MTCT of HIV. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Epidemiology characteristics, reporting characteristics, and methodological quality of systematic reviews and meta-analyses on traditional Chinese medicine nursing interventions published in Chinese journals.

PubMed

Yang, Min; Jiang, Li; Wang, Aihong; Xu, Guihua

2017-02-01

To evaluate the epidemiological characteristics, reporting characteristics, and methodological quality of systematic reviews in the traditional Chinese medicine nursing field published in Chinese journals. The number of systematic reviews in the traditional Chinese medicine nursing field has increased, but their epidemiology, quality, and reporting characteristics have not been assessed completely. We generated an overview of reviews using a narrative approach. Four Chinese databases were searched for systematic reviews from inception to December 2015. The Preferred Reporting Items of Systematic Reviews and Meta-analyses and the Assessment of Multiple Systematic Reviews checklists were adopted to evaluate reporting and methodological quality, respectively. A total of 73 eligible systematic reviews, published from 2005 to 2015, were included. The deficiencies in reporting characteristics mainly lay in the lack of structured abstract or protocol, incomplete reporting of search strategies, study selection, and risk of bias. The deficiencies in methodological quality were reflected in the lack of a priori design and conflict of interest, incomplete literature searches, and assessment of publication bias. The quality of the evaluated reviews was unsatisfactory; attention should be paid to the improvement of reporting and methodological quality in the conduct of systematic reviews. © 2016 John Wiley & Sons Australia, Ltd.

Which instruments can detect submaximal physical and functional capacity in patients with chronic nonspecific back pain? A systematic review.

PubMed

van der Meer, Suzan; Trippolini, Maurizio A; van der Palen, Job; Verhoeven, Jan; Reneman, Michiel F

2013-12-01

Systematic review. To evaluate the validity of instruments that claim to detect submaximal capacity when maximal capacity is requested in patients with chronic nonspecific musculoskeletal pain. Several instruments have been developed to measure capacity in patients with chronic pain. The detection of submaximal capacity can have major implications for patients. The validity of these instruments has never been systematically reviewed. A systematic literature search was performed including the following databases: Web of Knowledge (including PubMed and Cinahl), Scopus, and Cochrane. Two reviewers independently selected the articles based on the title and abstract according to the study selection criteria. Studies were included when they contained original data and when they objectified submaximal physical or functional capacity when maximal physical or functional capacity was requested. Two authors independently extracted data and rated the quality of the articles. The included studies were scored according to the subscales "Criterion Validity" and "Hypothesis Testing" of the COSMIN checklist. A Best Evidence Synthesis was performed. Seven studies were included, 5 of which used a reference standard for submaximal capacity. Three studies were of good methodological quality and validly detected submaximal capacity with specificity rates between 75% and 100%. There is strong evidence that submaximal capacity can be detected in patients with chronic low back pain with a lumbar motion monitor or visual observations accompanying a functional capacity evaluation lifting test.

Diet Quality and Cancer Outcomes in Adults: A Systematic Review of Epidemiological Studies

PubMed Central

Potter, Jennifer; Brown, Leanne; Williams, Rebecca L.; Byles, Julie; Collins, Clare E.

2016-01-01

Dietary patterns influence cancer risk. However, systematic reviews have not evaluated relationships between a priori defined diet quality scores and adult cancer risk and mortality. The aims of this systematic review are to (1) describe diet quality scores used in cohort or cross-sectional research examining cancer outcomes; and (2) describe associations between diet quality scores and cancer risk and mortality. The protocol was registered in Prospero, and a systematic search using six electronic databases was conducted through to December 2014. Records were assessed for inclusion by two independent reviewers, and quality was evaluated using a validated tool. Sixty-four studies met inclusion criteria from which 55 different diet quality scores were identified. Of the 35 studies investigating diet quality and cancer risk, 60% (n = 21) found a positive relationship. Results suggest no relationship between diet quality scores and overall cancer risk. Inverse associations were found for diet quality scores and risk of postmenopausal breast, colorectal, head, and neck cancer. No consistent relationships between diet quality scores and cancer mortality were found. Diet quality appears to be related to site-specific adult cancer risk. The relationship with cancer mortality is less conclusive, suggesting additional factors impact overall cancer survival. Development of a cancer-specific diet quality score for application in prospective epidemiology and in public health is warranted. PMID:27399671

Working group reports: evaluation of the evidence to support practice guidelines for nutritional care of preterm infants-the Pre-B Project.

PubMed

Raiten, Daniel J; Steiber, Alison L; Carlson, Susan E; Griffin, Ian; Anderson, Diane; Hay, William W; Robins, Sandra; Neu, Josef; Georgieff, Michael K; Groh-Wargo, Sharon; Fenton, Tanis R

2016-02-01

The "Evaluation of the Evidence to Support Practice Guidelines for the Nutritional Care of Preterm Infants: The Pre-B Project" is the first phase in a process to present the current state of knowledge and to support the development of evidence-informed guidance for the nutritional care of preterm and high-risk newborn infants. The future systematic reviews that will ultimately provide the underpinning for guideline development will be conducted by the Academy of Nutrition and Dietetics' Evidence Analysis Library (EAL). To accomplish the objectives of this first phase, the Pre-B Project organizers established 4 working groups (WGs) to address the following themes: 1) nutrient specifications for preterm infants, 2) clinical and practical issues in enteral feeding of preterm infants, 3) gastrointestinal and surgical issues, and 4) current standards of infant feeding. Each WG was asked to 1) develop a series of topics relevant to their respective themes, 2) identify questions for which there is sufficient evidence to support a systematic review process conducted by the EAL, and 3) develop a research agenda to address priority gaps in our understanding of the role of nutrition in health and development of preterm/neonatal intensive care unit infants. This article is a summary of the reports from the 4 Pre-B WGs. © 2016 American Society for Nutrition.