Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

Evaluating clinical librarian services: a systematic review.

PubMed

Brettle, Alison; Maden-Jenkins, Michelle; Anderson, Lucy; McNally, Rosalind; Pratchett, Tracey; Tancock, Jenny; Thornton, Debra; Webb, Anne

2011-03-01

  Previous systematic reviews have indicated limited evidence and poor quality evaluations of clinical librarian (CL) services. Rigorous evaluations should demonstrate the value of CL services, but guidance is needed before this can be achieved.   To undertake a systematic review which examines models of CL services, quality, methods and perspectives of clinical librarian service evaluations.   Systematic review methodology and synthesis of evidence, undertaken collaboratively by a group of 8 librarians to develop research and critical appraisal skills.   There are four clear models of clinical library service provision. Clinical librarians are effective in saving health professionals time, providing relevant, useful information and high quality services. Clinical librarians have a positive effect on clinical decision making by contributing to better informed decisions, diagnosis and choice of drug or therapy. The quality of CL studies is improving, but more work is needed on reducing bias and providing evidence of specific impacts on patient care. The Critical Incident Technique as part of a mixed method approach appears to offer a useful approach to demonstrating impact.   This systematic review provides practical guidance regarding the evaluation of CL services. It also provides updated evidence regarding the effectiveness and impact of CL services. The approach used was successful in developing research and critical appraisal skills in a group of librarians. © 2010 The authors. Health Information and Libraries Journal © 2010 Health Libraries Group.

Cost-Effectiveness of Social Work Services in Aging: An Updated Systematic Review

ERIC Educational Resources Information Center

Rizzo, Victoria M.; Rowe, Jeannine M.

2016-01-01

Objectives: This study examines the impact of social work interventions in aging on quality of life (QOL) and cost outcomes in four categories (health, mental health, geriatric evaluation and management, and caregiving). Methods: Systematic review methods are employed. Databases were searched for articles published in English between 2004 and 2012…

The Marketing Audit as a Method of the Evaluation of the Marketing Plan

NASA Astrophysics Data System (ADS)

Vaňa, Kamil; Černá, Ľubica

2012-12-01

The growing complexity of the current market environment needs a more systematic evaluation process of the organizational marketing performance to deal with the dynamic market. This paper deals with marketing audit as a comprehensive assessment of all angles of marketing operation in an organization and also deals with systematic evaluation of plans, objectives, strategies, activities and organizational structure as well as marketing staff.

Calculation of the detection limit in radiation measurements with systematic uncertainties

NASA Astrophysics Data System (ADS)

Kirkpatrick, J. M.; Russ, W.; Venkataraman, R.; Young, B. M.

2015-06-01

The detection limit (LD) or Minimum Detectable Activity (MDA) is an a priori evaluation of assay sensitivity intended to quantify the suitability of an instrument or measurement arrangement for the needs of a given application. Traditional approaches as pioneered by Currie rely on Gaussian approximations to yield simple, closed-form solutions, and neglect the effects of systematic uncertainties in the instrument calibration. These approximations are applicable over a wide range of applications, but are of limited use in low-count applications, when high confidence values are required, or when systematic uncertainties are significant. One proposed modification to the Currie formulation attempts account for systematic uncertainties within a Gaussian framework. We have previously shown that this approach results in an approximation formula that works best only for small values of the relative systematic uncertainty, for which the modification of Currie's method is the least necessary, and that it significantly overestimates the detection limit or gives infinite or otherwise non-physical results for larger systematic uncertainties where such a correction would be the most useful. We have developed an alternative approach for calculating detection limits based on realistic statistical modeling of the counting distributions which accurately represents statistical and systematic uncertainties. Instead of a closed form solution, numerical and iterative methods are used to evaluate the result. Accurate detection limits can be obtained by this method for the general case.

Systematic Evaluation of Aggressive Air Sampling for Bacillus ...

EPA Pesticide Factsheets

Report The primary objectives of this project were to evaluate the Aggressive Air Sampling (AAS) method compared to currently used surface sampling methods and to determine if AAS is a viable option for sampling Bacillus anthracis spores.

Effects of Multidimensional Family Therapy (MDFT) on Nonopioid Drug Abuse: A Systematic Review and Meta-Analysis

ERIC Educational Resources Information Center

Filges, Trine; Andersen, Ditte; Jørgensen, Anne-Marie Klint

2018-01-01

Purpose: This review evaluates the evidence of the effects of multidimensional family therapy (MDFT) on drug use reduction in young people for the treatment of nonopioid drug use. Method: We followed Campbell Collaboration guidelines to conduct a systematic review of randomized and nonrandomized trials. Meta-analytic methods were used to…

Functional Assessment-Based Interventions for Students with or At-Risk for High-Incidence Disabilities: Field Testing Single-Case Synthesis Methods

ERIC Educational Resources Information Center

Common, Eric Alan; Lane, Kathleen Lynne; Pustejovsky, James E.; Johnson, Austin H.; Johl, Liane Elizabeth

2017-01-01

This systematic review investigated one systematic approach to designing, implementing, and evaluating functional assessment-based interventions (FABI) for use in supporting school-age students with or at-risk for high-incidence disabilities. We field tested several recently developed methods for single-case design syntheses. First, we appraised…

Adapting Job Analysis Methodology to Improve Evaluation Practice

ERIC Educational Resources Information Center

Jenkins, Susan M.; Curtin, Patrick

2006-01-01

This article describes how job analysis, a method commonly used in personnel research and organizational psychology, provides a systematic method for documenting program staffing and service delivery that can improve evaluators' knowledge about program operations. Job analysis data can be used to increase evaluators' insight into how staffs…

Cost-effectiveness of lung cancer screening and treatment methods: a systematic review of systematic reviews.

PubMed

Azar, Farbod Ebadifard; Azami-Aghdash, Saber; Pournaghi-Azar, Fatemeh; Mazdaki, Alireza; Rezapour, Aziz; Ebrahimi, Parvin; Yousefzadeh, Negar

2017-06-19

Due to extensive literature in the field of lung cancer and their heterogeneous results, the aim of this study was to systematically review of systematic reviews studies which reviewed the cost-effectiveness of various lung cancer screening and treatment methods. In this systematic review of systematic reviews study, required data were collected searching the following key words which selected from Mesh: "lung cancer", "lung oncology", "lung Carcinoma", "lung neoplasm", "lung tumors", "cost- effectiveness", "systematic review" and "Meta-analysis". The following databases were searched: PubMed, Cochrane Library electronic databases, Google Scholar, and Scopus. Two reviewers (RA and A-AS) evaluated the articles according to the checklist of "assessment of multiple systematic reviews" (AMSTAR) tool. Overall, information of 110 papers was discussed in eight systematic reviews. Authors focused on cost-effectiveness of lung cancer treatments in five systematic reviews. Targeted therapy options (bevacizumab, Erlotinib and Crizotinib) show an acceptable cost-effectiveness. Results of three studies failed to show cost-effectiveness of screening methods. None of the studies had used the meta-analysis method. The Quality of Health Economic Studies (QHES) tool and Drummond checklist were mostly used in assessing the quality of articles. Most perspective was related to the Payer (64 times) and the lowest was related to Social (11times). Most cases referred to Incremental analysis (82%) and also the lowest point of referral was related to Discounting (in 49% of the cases). The average quality score of included studies was calculated 9.2% from 11. Targeted therapy can be an option for the treatment of lung cancer. Evaluation of the cost-effectiveness of computerized tomographic colonography (CTC) in lung cancer screening is recommended. The perspective of the community should be more taken into consideration in studies of cost-effectiveness. Paying more attention to the topic of Discounting will be necessary in the studies.

Costing evidence for health care decision-making in Austria: A systematic review

PubMed Central

Mayer, Susanne; Kiss, Noemi; Łaszewska, Agata

2017-01-01

Background With rising healthcare costs comes an increasing demand for evidence-informed resource allocation using economic evaluations worldwide. Furthermore, standardization of costing and reporting methods both at international and national levels are imperative to make economic evaluations a valid tool for decision-making. The aim of this review is to assess the availability and consistency of costing evidence that could be used for decision-making in Austria. It describes systematically the current economic evaluation and costing studies landscape focusing on the applied costing methods and their reporting standards. Findings are discussed in terms of their likely impacts on evidence-based decision-making and potential suggestions for areas of development. Methods A systematic literature review of English and German language peer-reviewed as well as grey literature (2004–2015) was conducted to identify Austrian economic analyses. The databases MEDLINE, EMBASE, SSCI, EconLit, NHS EED and Scopus were searched. Publication and study characteristics, costing methods, reporting standards and valuation sources were systematically synthesised and assessed. Results A total of 93 studies were included. 87% were journal articles, 13% were reports. 41% of all studies were full economic evaluations, mostly cost-effectiveness analyses. Based on relevant standards the most commonly observed limitations were that 60% of the studies did not clearly state an analytical perspective, 25% of the studies did not provide the year of costing, 27% did not comprehensively list all valuation sources, and 38% did not report all applied unit costs. Conclusion There are substantial inconsistencies in the costing methods and reporting standards in economic analyses in Austria, which may contribute to a low acceptance and lack of interest in economic evaluation-informed decision making. To improve comparability and quality of future studies, national costing guidelines should be updated with more specific methodological guidance and a national reference cost library should be set up to allow harmonisation of valuation methods. PMID:28806728

Gender counts: A systematic review of evaluations of gender-integrated health interventions in low- and middle-income countries.

PubMed

Schriver, Brittany; Mandal, Mahua; Muralidharan, Arundati; Nwosu, Anthony; Dayal, Radhika; Das, Madhumita; Fehringer, Jessica

2017-11-01

As a result of new global priorities, there is a growing need for high-quality evaluations of gender-integrated health programmes. This systematic review examined 99 peer-reviewed articles on evaluations of gender-integrated (accommodating and transformative) health programmes with regard to their theory of change (ToC), study design, gender integration in data collection, analysis, and gender measures used. Half of the evaluations explicitly described a ToC or conceptual framework (n = 50) that guided strategies for their interventions. Over half (61%) of the evaluations used quantitative methods exclusively; 11% used qualitative methods exclusively; and 28% used mixed methods. Qualitative methods were not commonly detailed. Evaluations of transformative interventions were less likely than those of accommodating interventions to employ randomised control trials. Two-thirds of the reviewed evaluations reported including at least one specific gender-related outcome (n = 18 accommodating, n = 44 transformative). To strengthen evaluations of gender-integrated programmes, we recommend use of ToCs, explicitly including gender in the ToC, use of gender-sensitive measures, mixed-method designs, in-depth descriptions of qualitative methods, and attention to gender-related factors in data collection logistics. We also recommend further research to develop valid and reliable gender measures that are globally relevant.

Governance for public health and health equity: The Tröndelag model for public health work.

PubMed

Lillefjell, Monica; Magnus, Eva; Knudtsen, Margunn SkJei; Wist, Guri; Horghagen, Sissel; Espnes, Geir Arild; Maass, Ruca; Anthun, Kirsti Sarheim

2018-06-01

Multi-sectoral governance of population health is linked to the realization that health is the property of many societal systems. This study aims to contribute knowledge and methods that can strengthen the capacities of municipalities regarding how to work more systematically, knowledge-based and multi-sectoral in promoting health and health equity in the population. Process evaluation was conducted, applying a mixed-methods research design, combining qualitative and quantitative data collection methods. Processes strengthening systematic and multi-sectoral development, implementation and evaluation of research-based measures to promote health, quality of life, and health equity in, for and with municipalities were revealed. A step-by-step model, that emphasizes the promotion of knowledge-based, systematic, multi-sectoral public health work, as well as joint ownership of local resources, initiatives and policies has been developed. Implementation of systematic, knowledge-based and multi-sectoral governance of public health measures in municipalities demand shared understanding of the challenges, updated overview of the population health and impact factors, anchoring in plans, new skills and methods for selection and implementation of measures, as well as development of trust, ownership, shared ethics and goals among those involved.

User Experience Evaluations in Rehabilitation Video Games for Children: A Systematic Mapping of the Literature.

PubMed

Rico-Olarte, Carolina; López, Diego M; Blobel, Bernd; Kepplinger, Sara

2017-01-01

In recent years, the interest in user experience (UX) evaluation methods for assessing technology solutions, especially in health systems for children with special needs like cognitive disabilities, has increased. Conduct a systematic mapping study to provide an overview in the field of UX evaluations in rehabilitation video games for children. The definition of research questions, the search for primary studies and the extraction of those studies by inclusion and exclusion criteria lead to the mapping of primary papers according to a classification scheme. Main findings from this study include the detection of the target population of the selected studies, the recognition of two different ways of evaluating UX: (i) user evaluation and (ii) system evaluation, and UX measurements and devices used. This systematic mapping specifies the research gaps identified for future research works in the area.

A new evaluation tool to obtain practice-based evidence of worksite health promotion programs.

PubMed

Dunet, Diane O; Sparling, Phillip B; Hersey, James; Williams-Piehota, Pamela; Hill, Mary D; Hanssen, Carl; Lawrenz, Frances; Reyes, Michele

2008-10-01

The Centers for Disease Control and Prevention developed the Swift Worksite Assessment and Translation (SWAT) evaluation method to identify promising practices in worksite health promotion programs. The new method complements research studies and evaluation studies of evidence-based practices that promote healthy weight in working adults. We used nationally recognized program evaluation standards of utility, feasibility, accuracy, and propriety as the foundation for our 5-step method: 1) site identification and selection, 2) site visit, 3) post-visit evaluation of promising practices, 4) evaluation capacity building, and 5) translation and dissemination. An independent, outside evaluation team conducted process and summative evaluations of SWAT to determine its efficacy in providing accurate, useful information and its compliance with evaluation standards. The SWAT evaluation approach is feasible in small and medium-sized workplace settings. The independent evaluation team judged SWAT favorably as an evaluation method, noting among its strengths its systematic and detailed procedures and service orientation. Experts in worksite health promotion evaluation concluded that the data obtained by using this evaluation method were sufficient to allow them to make judgments about promising practices. SWAT is a useful, business-friendly approach to systematic, yet rapid, evaluation that comports with program evaluation standards. The method provides a new tool to obtain practice-based evidence of worksite health promotion programs that help prevent obesity and, more broadly, may advance public health goals for chronic disease prevention and health promotion.

Environmental scan and evaluation of best practices for online systematic review resources

PubMed Central

Parker, Robin M. N.; Boulos, Leah M.; Visintini, Sarah; Ritchie, Krista; Hayden, Jill

2018-01-01

Objective Online training for systematic review methodology is an attractive option due to flexibility and limited availability of in-person instruction. Librarians often direct new reviewers to these online resources, so they should be knowledgeable about the variety of available resources. The objective for this project was to conduct an environmental scan of online systematic review training resources and evaluate those identified resources. Methods The authors systematically searched for electronic learning resources pertaining to systematic review methods. After screening for inclusion, we collected data about characteristics of training resources and assigned scores in the domains of (1) content, (2) design, (3) interactivity, and (4) usability by applying a previously published evaluation rubric for online instruction modules. We described the characteristics and scores for each training resource and compared performance across the domains. Results Twenty training resources were evaluated. Average overall score of online instructional resources was 61%. Online courses (n=7) averaged 73%, web modules (n=5) 64%, and videos (n=8) 48%. The top 5 highest scoring resources were in course or web module format, featured high interactivity, and required a longer (>5hrs) time commitment from users. Conclusion This study revealed that resources include appropriate content but are less likely to adhere to principles of online training design and interactivity. Awareness of these resources will allow librarians to make informed recommendations for training based on patrons’ needs. Future online systematic review training resources should use established best practices for e-learning to provide high-quality resources, regardless of format or user time commitment. PMID:29632443

[The methods within the evaluation of disease management programmes in control-group designs using the example of diabetes mellitus - a systematic literature review].

PubMed

Drabik, A; Sawicki, P T; Müller, D; Passon, A; Stock, S

2012-08-01

Disease management programmes (DMPs) were implemented in Germany in 2002. Their evaluation is required by law. Beyond the mandatory evaluation, a growing number of published studies evaluate the DMP for diabetes mellitus type 2 in a control-group design. As patients opt into the programme on a voluntary basis it is necessary to adjust the inherent selection bias between groups. The aim of this study is to review published studies which evaluate the diabetes DMP using a control-group design with respect to the methods used. A systematic literature review of electronic databases (PUBMED, Cochrane Library, EMBASE, MEDPILOT) and a hand search of reference lists of the relevant publications was conducted to identify studies evaluating the DMP diabetes mellitus in a control-group design. 8 studies were included in the systematic literature review. 4 studies gathered retrospective claims data from sickness funds, one from physician's records, one study used prospective data from ambulatory care, and 2 studies were based on one patient survey. Methods used for adjustment of selection bias included exact matching, matching using propensity score methods, age-adjusted and sex-separated analysis, and adjustment in a regression model/analysis of covariance. One study did not apply adjustment methods. The intervention period ranged from 1 day to 4 years. Considered outcomes of studies (surrogate parameter, diabetes complications, mortality, quality of life, and claim data) depended on the database. In the evaluation of the DMP diabetes mellitus based on a control-group design neither the database nor the methods used for selection bias adjustment were consistent in the available studies. Effectiveness of DMPs cannot be judged based on this review due to heterogeneity of study designs. To allow for a comprehensive programme evaluation standardised minimum requirements for the evaluation of DMPs in the control group design are required. © Georg Thieme Verlag KG Stuttgart · New York.

Systematic reviews of animal studies; missing link in translational research?

PubMed

van Luijk, Judith; Bakker, Brenda; Rovers, Maroeska M; Ritskes-Hoitinga, Merel; de Vries, Rob B M; Leenaars, Marlies

2014-01-01

The methodological quality of animal studies is an important factor hampering the translation of results from animal studies to a clinical setting. Systematic reviews of animal studies may provide a suitable method to assess and thereby improve their methodological quality. The aims of this study were: 1) to evaluate the risk of bias assessment in animal-based systematic reviews, and 2) to study the internal validity of the primary animal studies included in these systematic reviews. We systematically searched Pubmed and Embase for SRs of preclinical animal studies published between 2005 and 2012. A total of 91 systematic reviews met our inclusion criteria. The risk of bias was assessed in 48 (52.7%) of these 91 systematic reviews. Thirty-three (36.3%) SRs provided sufficient information to evaluate the internal validity of the included studies. Of the evaluated primary studies, 24.6% was randomized, 14.6% reported blinding of the investigator/caretaker, 23.9% blinded the outcome assessment, and 23.1% reported drop-outs. To improve the translation of animal data to clinical practice, systematic reviews of animal studies are worthwhile, but the internal validity of primary animal studies needs to be improved. Furthermore, risk of bias should be assessed by systematic reviews of animal studies to provide insight into the reliability of the available evidence.

Systematic Correlation Matrix Evaluation (SCoMaE) - a bottom-up, science-led approach to identifying indicators

NASA Astrophysics Data System (ADS)

Mengis, Nadine; Keller, David P.; Oschlies, Andreas

2018-01-01

This study introduces the Systematic Correlation Matrix Evaluation (SCoMaE) method, a bottom-up approach which combines expert judgment and statistical information to systematically select transparent, nonredundant indicators for a comprehensive assessment of the state of the Earth system. The methods consists of two basic steps: (1) the calculation of a correlation matrix among variables relevant for a given research question and (2) the systematic evaluation of the matrix, to identify clusters of variables with similar behavior and respective mutually independent indicators. Optional further analysis steps include (3) the interpretation of the identified clusters, enabling a learning effect from the selection of indicators, (4) testing the robustness of identified clusters with respect to changes in forcing or boundary conditions, (5) enabling a comparative assessment of varying scenarios by constructing and evaluating a common correlation matrix, and (6) the inclusion of expert judgment, for example, to prescribe indicators, to allow for considerations other than statistical consistency. The example application of the SCoMaE method to Earth system model output forced by different CO2 emission scenarios reveals the necessity of reevaluating indicators identified in a historical scenario simulation for an accurate assessment of an intermediate-high, as well as a business-as-usual, climate change scenario simulation. This necessity arises from changes in prevailing correlations in the Earth system under varying climate forcing. For a comparative assessment of the three climate change scenarios, we construct and evaluate a common correlation matrix, in which we identify robust correlations between variables across the three considered scenarios.

Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

PubMed

Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

2017-01-01

Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

Economics methods in Cochrane systematic reviews of health promotion and public health related interventions.

PubMed

Shemilt, Ian; Mugford, Miranda; Drummond, Michael; Eisenstein, Eric; Mallender, Jacqueline; McDaid, David; Vale, Luke; Walker, Damian

2006-11-15

Provision of evidence on costs alongside evidence on the effects of interventions can enhance the relevance of systematic reviews to decision-making. However, patterns of use of economics methods alongside systematic review remain unclear. Reviews of evidence on the effects of interventions are published by both the Cochrane and Campbell Collaborations. Although it is not a requirement that Cochrane or Campbell Reviews should consider economic aspects of interventions, many do. This study aims to explore and describe approaches to incorporating economics methods in a selection of Cochrane systematic reviews in the area of health promotion and public health, to help inform development of methodological guidance on economics for reviewers. The Cochrane Database of Systematic Reviews was searched using a search strategy for potential economic evaluation studies. We included current Cochrane reviews and review protocols retrieved using the search that are also identified as relevant to health promotion or public health topics. A reviewer extracted data which describe the economics components of included reviews. Extracted data were summarised in tables and analysed qualitatively. Twenty-one completed Cochrane reviews and seven review protocols met inclusion criteria. None incorporate formal economic evaluation methods. Ten completed reviews explicitly aim to incorporate economics studies and data. There is a lack of transparent reporting of methods underpinning the incorporation of economics studies and data. Some reviews are likely to exclude useful economics studies and data due to a failure to incorporate search strategies tailored to the retrieval of such data or use of key specialist databases, and application of inclusion criteria designed for effectiveness studies. There is a need for consistency and transparency in the reporting and conduct of the economics components of Cochrane reviews, as well as regular dialogue between Cochrane reviewers and economists to develop increased capacity for economic analyses alongside such reviews. Use of applicable economics methods in Cochrane reviews can help provide the international context within which economics data can be interpreted and assessed as a preliminary to full economic evaluation.

Phase shifts in I = 2 ππ-scattering from two lattice approaches

NASA Astrophysics Data System (ADS)

Kurth, T.; Ishii, N.; Doi, T.; Aoki, S.; Hatsuda, T.

2013-12-01

We present a lattice QCD study of the phase shift of I = 2 ππ scattering on the basis of two different approaches: the standard finite volume approach by Lüscher and the recently introduced HAL QCD potential method. Quenched QCD simulations are performed on lattices with extents N s = 16 , 24 , 32 , 48 and N t = 128 as well as lattice spacing a ~ 0 .115 fm and a pion mass of m π ~ 940 MeV. The phase shift and the scattering length are calculated in these two methods. In the potential method, the error is dominated by the systematic uncertainty associated with the violation of rotational symmetry due to finite lattice spacing. In Lüscher's approach, such systematic uncertainty is difficult to be evaluated and thus is not included in this work. A systematic uncertainty attributed to the quenched approximation, however, is not evaluated in both methods. In case of the potential method, the phase shift can be calculated for arbitrary energies below the inelastic threshold. The energy dependence of the phase shift is also obtained from Lüscher's method using different volumes and/or nonrest-frame extension of it. The results are found to agree well with the potential method.

Systematic literature reviews and meta-analyses: part 6 of a series on evaluation of scientific publications.

PubMed

Ressing, Meike; Blettner, Maria; Klug, Stefanie J

2009-07-01

Because of the rising number of scientific publications, it is important to have a means of jointly summarizing and assessing different studies on a single topic. Systematic literature reviews, meta-analyses of published data, and meta-analyses of individual data (pooled reanalyses) are now being published with increasing frequency. We here describe the essential features of these methods and discuss their strengths and weaknesses. This article is based on a selective literature search. The different types of review and meta-analysis are described, the methods used in each are outlined so that they can be evaluated, and a checklist is given for the assessment of reviews and meta-analyses of scientific articles. Systematic literature reviews provide an overview of the state of research on a given topic and enable an assessment of the quality of individual studies. They also allow the results of different studies to be evaluated together when these are inconsistent. Meta-analyses additionally allow calculation of pooled estimates of an effect. The different types of review and meta-analysis are discussed with examples from the literature on one particular topic. Systematic literature reviews and meta-analyses enable the research findings and treatment effects obtained in different individual studies to be summed up and evaluated.

Costing evidence for health care decision-making in Austria: A systematic review.

PubMed

Mayer, Susanne; Kiss, Noemi; Łaszewska, Agata; Simon, Judit

2017-01-01

With rising healthcare costs comes an increasing demand for evidence-informed resource allocation using economic evaluations worldwide. Furthermore, standardization of costing and reporting methods both at international and national levels are imperative to make economic evaluations a valid tool for decision-making. The aim of this review is to assess the availability and consistency of costing evidence that could be used for decision-making in Austria. It describes systematically the current economic evaluation and costing studies landscape focusing on the applied costing methods and their reporting standards. Findings are discussed in terms of their likely impacts on evidence-based decision-making and potential suggestions for areas of development. A systematic literature review of English and German language peer-reviewed as well as grey literature (2004-2015) was conducted to identify Austrian economic analyses. The databases MEDLINE, EMBASE, SSCI, EconLit, NHS EED and Scopus were searched. Publication and study characteristics, costing methods, reporting standards and valuation sources were systematically synthesised and assessed. A total of 93 studies were included. 87% were journal articles, 13% were reports. 41% of all studies were full economic evaluations, mostly cost-effectiveness analyses. Based on relevant standards the most commonly observed limitations were that 60% of the studies did not clearly state an analytical perspective, 25% of the studies did not provide the year of costing, 27% did not comprehensively list all valuation sources, and 38% did not report all applied unit costs. There are substantial inconsistencies in the costing methods and reporting standards in economic analyses in Austria, which may contribute to a low acceptance and lack of interest in economic evaluation-informed decision making. To improve comparability and quality of future studies, national costing guidelines should be updated with more specific methodological guidance and a national reference cost library should be set up to allow harmonisation of valuation methods.

Scientific Evaluation and Review of Claims in Health Care (SEaRCH): A Streamlined, Systematic, Phased Approach for Determining "What Works" in Healthcare.

PubMed

Jonas, Wayne B; Crawford, Cindy; Hilton, Lara; Elfenbaum, Pamela

2017-01-01

Answering the question of "what works" in healthcare can be complex and requires the careful design and sequential application of systematic methodologies. Over the last decade, the Samueli Institute has, along with multiple partners, developed a streamlined, systematic, phased approach to this process called the Scientific Evaluation and Review of Claims in Health Care (SEaRCH™). The SEaRCH process provides an approach for rigorously, efficiently, and transparently making evidence-based decisions about healthcare claims in research and practice with minimal bias. SEaRCH uses three methods combined in a coordinated fashion to help determine what works in healthcare. The first, the Claims Assessment Profile (CAP), seeks to clarify the healthcare claim and question, and its ability to be evaluated in the context of its delivery. The second method, the Rapid Evidence Assessment of the Literature (REAL © ), is a streamlined, systematic review process conducted to determine the quantity, quality, and strength of evidence and risk/benefit for the treatment. The third method involves the structured use of expert panels (EPs). There are several types of EPs, depending on the purpose and need. Together, these three methods-CAP, REAL, and EP-can be integrated into a strategic approach to help answer the question "what works in healthcare?" and what it means in a comprehensive way. SEaRCH is a systematic, rigorous approach for evaluating healthcare claims of therapies, practices, programs, or products in an efficient and stepwise fashion. It provides an iterative, protocol-driven process that is customized to the intervention, consumer, and context. Multiple communities, including those involved in health service and policy, can benefit from this organized framework, assuring that evidence-based principles determine which healthcare practices with the greatest promise are used for improving the public's health and wellness.

Conducting systematic reviews of economic evaluations.

PubMed

Gomersall, Judith Streak; Jadotte, Yuri Tertilus; Xue, Yifan; Lockwood, Suzi; Riddle, Dru; Preda, Alin

2015-09-01

In 2012, a working group was established to review and enhance the Joanna Briggs Institute (JBI) guidance for conducting systematic review of evidence from economic evaluations addressing a question(s) about health intervention cost-effectiveness. The objective is to present the outcomes of the working group. The group conducted three activities to inform the new guidance: review of literature on the utility/futility of systematic reviews of economic evaluations and consideration of its implications for updating the existing methodology; assessment of the critical appraisal tool in the existing guidance against criteria that promotes validity in economic evaluation research and two other commonly used tools; and a workshop. The debate in the literature on the limitations/value of systematic review of economic evidence cautions that systematic reviews of economic evaluation evidence are unlikely to generate one size fits all answers to questions about the cost-effectiveness of interventions and their comparators. Informed by this finding, the working group adjusted the framing of the objectives definition in the existing JBI methodology. The shift is away from defining the objective as to determine one cost-effectiveness measure toward summarizing study estimates of cost-effectiveness and informed by consideration of the included study characteristics (patient, setting, intervention component, etc.), identifying conditions conducive to lowering costs and maximizing health benefits. The existing critical appraisal tool was included in the new guidance. The new guidance includes the recommendation that a tool designed specifically for the purpose of appraising model-based studies be used together with the generic appraisal tool for economic evaluations assessment to evaluate model-based evaluations. The guidance produced by the group offers reviewers guidance for each step of the systematic review process, which are the same steps followed in JBI reviews of other types of evidence. The updated JBI guidance will be useful for researchers wanting to synthesize evidence about economic questions, either as stand-alone reviews or part of comprehensive or mixed method evidence reviews. Although the updated methodology produced by the work of the working group has improved the JBI guidance for systematic reviews of economic evaluations, there are areas where further work is required. These include adjusting the critical appraisal tool to separate out questions addressing intervention cost and effectiveness measurement; providing more explicit guidance for assessing generalizability of findings; and offering a more robust method for evidence synthesis that facilitates achieving the more ambitious review objectives.

Dietary Change Interventions for Undergraduate Populations: Systematic Review and Recommendations

ERIC Educational Resources Information Center

Pember, Sarah E.; Knowlden, Adam P.

2017-01-01

Background: Research demonstrates a decline in healthy eating behaviors during transitional years at university, potentially leading to weight gain and establishing maladaptive dietary habits. Purpose: This systematic review assessed the efficacy of previous nutrition interventions for undergraduates, evaluating design and implementation. Methods:…

Agriculture, food, and nutrition interventions that facilitate sustainable food production and impact health: an overview of systematic reviews.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Galvão, Luiz A C

2016-08-01

Objectives To identify the agriculture, food, and nutrition security interventions that facilitate sustainable food production and have a positive impact on health. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations through a comprehensive search of 17 databases and 10 websites. The search employed a pre-defined protocol with clear inclusion criteria. Both grey and peer-reviewed literature published in English, Spanish, and Portuguese between 1 January 1997 and November 2013 were included. To classify as "sustainable," interventions needed to aim to positively impact at least two dimensions of the integrated framework for sustainable development and include measures of health impact. Results Fifteen systematic reviews and seven economic evaluations met the inclusion criteria. All interventions had some impact on health or on risk factors for health outcomes, except those related to genetically modified foods. Impact on health inequalities was rarely measured. All interventions with economic evaluations were very cost-effective, had cost savings, or net benefits. In addition to impacting health (inclusive social development), all interventions had the potential to impact on inclusive economic development, and some, on environmental sustainability, though these effects were rarely assessed. Conclusions What is needed now is careful implementation of interventions with expected positive health impacts but with concurrent, rigorous evaluation. Possible impact on health inequalities needs to be considered and measured by future primary studies and systematic reviews, as does impact of interventions on all dimensions of sustainable development.

Intelligent process mapping through systematic improvement of heuristics

NASA Technical Reports Server (NTRS)

Ieumwananonthachai, Arthur; Aizawa, Akiko N.; Schwartz, Steven R.; Wah, Benjamin W.; Yan, Jerry C.

1992-01-01

The present system for automatic learning/evaluation of novel heuristic methods applicable to the mapping of communication-process sets on a computer network has its basis in the testing of a population of competing heuristic methods within a fixed time-constraint. The TEACHER 4.1 prototype learning system implemented or learning new postgame analysis heuristic methods iteratively generates and refines the mappings of a set of communicating processes on a computer network. A systematic exploration of the space of possible heuristic methods is shown to promise significant improvement.

Developing an evidence-based Guide to Community Preventive Services--methods. The Task Force on Community Preventive Services.

PubMed

Briss, P A; Zaza, S; Pappaioanou, M; Fielding, J; Wright-De Agüero, L; Truman, B I; Hopkins, D P; Mullen, P D; Thompson, R S; Woolf, S H; Carande-Kulis, V G; Anderson, L; Hinman, A R; McQueen, D V; Teutsch, S M; Harris, J R

2000-01-01

Systematic reviews and evidence-based recommendations are increasingly important for decision making in health and medicine. Over the past 20 years, information on the science of synthesizing research results has exploded. However, some approaches to systematic reviews of the effectiveness of clinical preventive services and medical care may be less appropriate for evaluating population-based interventions. Furthermore, methods for linking evidence to recommendations are less well developed than methods for synthesizing evidence. The Guide to Community Preventive Services: Systematic Reviews and Evidence-Based Recommendations (the Guide) will evaluate and make recommendations on population-based and public health interventions. This paper provides an overview of the Guide's process to systematically review evidence and translate that evidence into recommendations. The Guide reviews evidence on effectiveness, the applicability of effectiveness data, (i.e., the extent to which available effectiveness data is thought to apply to additional populations and settings), the intervention's other effects (i.e., important side effects), economic impact, and barriers to implementation of interventions. The steps for obtaining and evaluating evidence into recommendations involve: (1) forming multidisciplinary chapter development teams, (2) developing a conceptual approach to organizing, grouping, selecting and evaluating the interventions in each chapter; (3) selecting interventions to be evaluated; (4) searching for and retrieving evidence; (5) assessing the quality of and summarizing the body of evidence of effectiveness; (6) translating the body of evidence of effectiveness into recommendations; (7) considering information on evidence other than effectiveness; and (8) identifying and summarizing research gaps. Systematic reviews of and evidence-based recommendations for population-health interventions are challenging and methods will continue to evolve. However, using an evidence-based approach to identify and recommend effective interventions directed at specific public health goals may reduce errors in how information is collected and interpreted, identify important gaps in current knowledge thus guiding further research, and enhance the Guide users' ability to assess whether recommendations are valid and prudent from their own perspectives. Over time, all of these advantages could help to increase agreement regarding appropriate community health strategies and help to increase their implementation.

The use of GRADE approach in systematic reviews of animal studies.

PubMed

Wei, Dang; Tang, Kun; Wang, Qi; Estill, Janne; Yao, Liang; Wang, Xiaoqin; Chen, Yaolong; Yang, Kehu

2016-03-15

The application of GRADE (Grading of Recommendations Assessment, Development and Evaluation) in SR of animal studies can promote the translation from bench to bedside. We aim to explore the use of GRADE in systematic reviews of animal studies. We used a theoretical analysis method to explore the use of GRADE in SR of animal studies and applied in a SR of animal studies. Meanwhile, we presented and discussed our results in two international conferences. Five downgrade factors were considered as follows in systematic reviews of animal studies: 1) Risk of bias: the SYRCLE tool can be used for assessing the risk of bias of animal studies. 2) Indirectness: we can assess indirectness in systematic reviews of animal studies from the PICO. 3) Inconsistency: similarity of point estimates, extent of overlap of confidence intervals and statistical heterogeneity are also suitable to evaluate inconsistency of evidence from animal studies. 4) Imprecision: optimal information size (OIS) and 95% confidence intervals (CIs) are also suitable for systematic reviews of animal studies, like those of clinical trials. 5) Publication bias: we need to consider publication bias comprehensively through the qualitative and quantitative methods. The methods about the use of GRADE in systematic review of animal studies are explicit. However, the principle about GRADE in developing the policy based on the evidence from animal studies when there is an emergency of public health. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Development and pilot test of a process to identify research needs from a systematic review.

PubMed

Saldanha, Ian J; Wilson, Lisa M; Bennett, Wendy L; Nicholson, Wanda K; Robinson, Karen A

2013-05-01

To ensure appropriate allocation of research funds, we need methods for identifying high-priority research needs. We developed and pilot tested a process to identify needs for primary clinical research using a systematic review in gestational diabetes mellitus. We conducted eight steps: abstract research gaps from a systematic review using the Population, Intervention, Comparison, Outcomes, and Settings (PICOS) framework; solicit feedback from the review authors; translate gaps into researchable questions using the PICOS framework; solicit feedback from multidisciplinary stakeholders at our institution; establish consensus among multidisciplinary external stakeholders on the importance of the research questions using the Delphi method; prioritize outcomes; develop conceptual models to highlight research needs; and evaluate the process. We identified 19 research questions. During the Delphi method, external stakeholders established consensus for 16 of these 19 questions (15 with "high" and 1 with "medium" clinical benefit/importance). We pilot tested an eight-step process to identify clinically important research needs. Before wider application of this process, it should be tested using systematic reviews of other diseases. Further evaluation should include assessment of the usefulness of the research needs generated using this process for primary researchers and funders. Copyright © 2013 Elsevier Inc. All rights reserved.

Measuring the impact of medicines regulatory interventions – Systematic review and methodological considerations

PubMed Central

Morales, Daniel R.; Pacurariu, Alexandra; Kurz, Xavier

2017-01-01

Aims Evaluating the public health impact of regulatory interventions is important but there is currently no common methodological approach to guide this evaluation. This systematic review provides a descriptive overview of the analytical methods for impact research. Methods We searched MEDLINE and EMBASE for articles with an empirical analysis evaluating the impact of European Union or non‐European Union regulatory actions to safeguard public health published until March 2017. References from systematic reviews and articles from other known sources were added. Regulatory interventions, data sources, outcomes of interest, methodology and key findings were extracted. Results From 1246 screened articles, 229 were eligible for full‐text review and 153 articles in English language were included in the descriptive analysis. Over a third of articles studied analgesics and antidepressants. Interventions most frequently evaluated are regulatory safety communications (28.8%), black box warnings (23.5%) and direct healthcare professional communications (10.5%); 55% of studies measured changes in drug utilization patterns, 27% evaluated health outcomes, and 18% targeted knowledge, behaviour or changes in clinical practice. Unintended consequences like switching therapies or spill‐over effects were rarely evaluated. Two‐thirds used before–after time series and 15.7% before–after cross‐sectional study designs. Various analytical approaches were applied including interrupted time series regression (31.4%), simple descriptive analysis (28.8%) and descriptive analysis with significance tests (23.5%). Conclusion Whilst impact evaluation of pharmacovigilance and product‐specific regulatory interventions is increasing, the marked heterogeneity in study conduct and reporting highlights the need for scientific guidance to ensure robust methodologies are applied and systematic dissemination of results occurs. PMID:29105853

Promoting Children's Health with Digital Games: A Review of Reviews.

PubMed

Parisod, Heidi; Pakarinen, Anni; Kauhanen, Lotta; Aromaa, Minna; Leppänen, Ville; Liukkonen, Tapani N; Smed, Jouni; Salanterä, Sanna

2014-06-01

Effective, evidence-based, and interesting methods are needed for children's health promotion. Digital games can be such a method, but there is need for a summary of the evidence on the effectiveness of digital games in promoting children's health. The aim of this review of reviews was to evaluate the quality of systematic reviews, to summarize the evidence in systematic reviews and reviews related to the effectiveness of digital games in children's health promotion, and to identify gaps in knowledge. A systematic literature search was conducted in May-August 2013 from relevant databases, and 1178 references were found. In total, 15 systematic reviews and reviews met the inclusion criteria. Most of the systematic reviews were found to be medium quality on the AMSTAR checklist. Most commonly, systematic reviews and reviews evaluated active videogames. According to the results, evidence of the highest level and quality seems to support an increase in physical activity to light to moderate levels and energy expenditure, especially when playing active videogames that require both upper and lower body movements. In addition, sedentary games were shown to have potential in children's health education, especially in supporting changes in asthma- and diabetes-related behavior and in dietary habits. However, there are still several gaps in the knowledge. There is a need for further high-quality systematic reviews and research in the field of health games.

Native American Youth and Culturally Sensitive Interventions: A Systematic Review

ERIC Educational Resources Information Center

Jackson, Kelly F.; Hodge, David R.

2010-01-01

Objective: A systematic evaluation of the effectiveness of culturally sensitive interventions (CSIs) with Native American youth was conducted. Method: Electronic bibliographic databases, Web sites, and manual searches were used to identify 11 outcome studies that examined CSI effectiveness with Native American youth. Results: This review found…

Supporting Evidence-Informed Teaching in Biomedical and Health Professions Education Through Knowledge Translation: An Interdisciplinary Literature Review.

PubMed

Tractenberg, Rochelle E; Gordon, Morris

2017-01-01

Phenomenon: The purpose of "systematic" reviews/reviewers of medical and health professions educational research is to identify best practices. This qualitative article explores the question of whether systematic reviews can support "evidence informed" teaching and contrasts traditional systematic reviewing with a knowledge translation (KT) approach to this objective. Degrees of freedom analysis (DOFA) is used to examine the alignment of systematic review methods with educational research and the pedagogical strategies and approaches that might be considered with a decision-making framework developed to support valid assessment. This method is also used to explore how KT can be used to inform teaching and learning. The nature of educational research is not compatible with most (11/14) methods for systematic review. The inconsistency of systematic reviewing with the nature of educational research impedes both the identification and implementation of "best-evidence" pedagogy and teaching. This is primarily because research questions that do support the purposes of review do not support educational decision making. By contrast to systematic reviews of the literature, both a DOFA and KT are fully compatible with informing teaching using evidence. A DOFA supports the translation of theory to a specific teaching or learning case, so could be considered a type of KT. The DOFA results in a test of alignment of decision options with relevant educational theory, and KT leads to interventions in teaching or learning that can be evaluated. Examples of how to structure evaluable interventions are derived from a KT approach that are simply not available from a systematic review. Insights: Systematic reviewing of current empirical educational research is not suitable for deriving or supporting best practices in education. However, both "evidence-informed" and scholarly approaches to teaching can be supported as KT projects, which are inherently evaluable and can generate actionable evidence about whether the decision or intervention worked for students, instructors, and the institution. A DOFA can also support evidence- and theory-informed teaching to develop an understanding of what works, why, and for whom. Thus KT, but not systematic reviewing, can support decision making around pedagogy (and pedagogical innovation) that can also inform new teaching and learning initiatives; it can also point to new avenues of empirical research in education that are informed by, and can inform, theory.

Economics methods in Cochrane systematic reviews of health promotion and public health related interventions

PubMed Central

Shemilt, Ian; Mugford, Miranda; Drummond, Michael; Eisenstein, Eric; Mallender, Jacqueline; McDaid, David; Vale, Luke; Walker, Damian

2006-01-01

Background Provision of evidence on costs alongside evidence on the effects of interventions can enhance the relevance of systematic reviews to decision-making. However, patterns of use of economics methods alongside systematic review remain unclear. Reviews of evidence on the effects of interventions are published by both the Cochrane and Campbell Collaborations. Although it is not a requirement that Cochrane or Campbell Reviews should consider economic aspects of interventions, many do. This study aims to explore and describe approaches to incorporating economics methods in a selection of Cochrane systematic reviews in the area of health promotion and public health, to help inform development of methodological guidance on economics for reviewers. Methods The Cochrane Database of Systematic Reviews was searched using a search strategy for potential economic evaluation studies. We included current Cochrane reviews and review protocols retrieved using the search that are also identified as relevant to health promotion or public health topics. A reviewer extracted data which describe the economics components of included reviews. Extracted data were summarised in tables and analysed qualitatively. Results Twenty-one completed Cochrane reviews and seven review protocols met inclusion criteria. None incorporate formal economic evaluation methods. Ten completed reviews explicitly aim to incorporate economics studies and data. There is a lack of transparent reporting of methods underpinning the incorporation of economics studies and data. Some reviews are likely to exclude useful economics studies and data due to a failure to incorporate search strategies tailored to the retrieval of such data or use of key specialist databases, and application of inclusion criteria designed for effectiveness studies. Conclusion There is a need for consistency and transparency in the reporting and conduct of the economics components of Cochrane reviews, as well as regular dialogue between Cochrane reviewers and economists to develop increased capacity for economic analyses alongside such reviews. Use of applicable economics methods in Cochrane reviews can help provide the international context within which economics data can be interpreted and assessed as a preliminary to full economic evaluation. PMID:17107612

Comparative Effectiveness of Dental Anatomy Carving Pedagogy: A Systematic Review.

PubMed

de Azevedo, Renato de A; da Rosa, Wellington Luiz de O; da Silva, Adriana F; Correa, Marcos B; Torriani, Marcos A; Lund, Rafael G

2015-08-01

The aim of this study was to review the effectiveness of methods used for teaching dental anatomy carving to dental students in operative dentistry as evaluated in published studies. This systematic review is described in accordance with the PRISMA statement. Two independent reviewers performed a systematic literature search of research published from January 1945 until May 2014. Seven databases were screened: MedLine (PubMed), Lilacs, IBECS, Web of Science, Scopus, SciELO, and The Cochrane Library. After removing duplicates, only studies using dental carving to assess the practical knowledge of anatomy were selected. The tabulated data were organized by title of article, names of authors, number of students assessed, assessment method, material used, groups tested, main results, and conclusions. The methodology quality was assessed according to the Cochrane Handbook for Systematic Reviews of Interventions. Initially, 2,258 studies were identified in all databases. Five articles met the eligibility criteria and were included in this review. According to these studies, the geometric method, teaching step-by-step along with the teacher, and adjuvant methods such as the use of tutors and teaching through digital media with DVDs proved to be effective in improving learning. There is no standard technique that is widely accepted for the teaching of dental carving, nor is there an appropriately validated method of evaluation to verify whether the teaching methods used are effective for the acquisition of skills and expertise in dental anatomy by students.

Consensus Recommendations for Systematic Evaluation of Drug-Drug Interaction Evidence for Clinical Decision Support

PubMed Central

Scheife, Richard T.; Hines, Lisa E.; Boyce, Richard D.; Chung, Sophie P.; Momper, Jeremiah; Sommer, Christine D.; Abernethy, Darrell R.; Horn, John; Sklar, Stephen J.; Wong, Samantha K.; Jones, Gretchen; Brown, Mary; Grizzle, Amy J.; Comes, Susan; Wilkins, Tricia Lee; Borst, Clarissa; Wittie, Michael A.; Rich, Alissa; Malone, Daniel C.

2015-01-01

Background Healthcare organizations, compendia, and drug knowledgebase vendors use varying methods to evaluate and synthesize evidence on drug-drug interactions (DDIs). This situation has a negative effect on electronic prescribing and medication information systems that warn clinicians of potentially harmful medication combinations. Objective To provide recommendations for systematic evaluation of evidence from the scientific literature, drug product labeling, and regulatory documents with respect to DDIs for clinical decision support. Methods A conference series was conducted to develop a structured process to improve the quality of DDI alerting systems. Three expert workgroups were assembled to address the goals of the conference. The Evidence Workgroup consisted of 15 individuals with expertise in pharmacology, drug information, biomedical informatics, and clinical decision support. Workgroup members met via webinar from January 2013 to February 2014. Two in-person meetings were conducted in May and September 2013 to reach consensus on recommendations. Results We developed expert-consensus answers to three key questions: 1) What is the best approach to evaluate DDI evidence?; 2) What evidence is required for a DDI to be applicable to an entire class of drugs?; and 3) How should a structured evaluation process be vetted and validated? Conclusion Evidence-based decision support for DDIs requires consistent application of transparent and systematic methods to evaluate the evidence. Drug information systems that implement these recommendations should be able to provide higher quality information about DDIs in drug compendia and clinical decision support tools. PMID:25556085

Using Multiple Types of Studies in Systematic Reviews of Health Care Interventions – A Systematic Review

PubMed Central

Peinemann, Frank; Tushabe, Doreen Allen; Kleijnen, Jos

2013-01-01

Background A systematic review may evaluate different aspects of a health care intervention. To accommodate the evaluation of various research questions, the inclusion of more than one study design may be necessary. One aim of this study is to find and describe articles on methodological issues concerning the incorporation of multiple types of study designs in systematic reviews on health care interventions. Another aim is to evaluate methods studies that have assessed whether reported effects differ by study types. Methods and Findings We searched PubMed, the Cochrane Database of Systematic Reviews, and the Cochrane Methodology Register on 31 March 2012 and identified 42 articles that reported on the integration of single or multiple study designs in systematic reviews. We summarized the contents of the articles qualitatively and assessed theoretical and empirical evidence. We found that many examples of reviews incorporating multiple types of studies exist and that every study design can serve a specific purpose. The clinical questions of a systematic review determine the types of design that are necessary or sufficient to provide the best possible answers. In a second independent search, we identified 49 studies, 31 systematic reviews and 18 trials that compared the effect sizes between randomized and nonrandomized controlled trials, which were statistically different in 35%, and not different in 53%. Twelve percent of studies reported both, different and non-different effect sizes. Conclusions Different study designs addressing the same question yielded varying results, with differences in about half of all examples. The risk of presenting uncertain results without knowing for sure the direction and magnitude of the effect holds true for both nonrandomized and randomized controlled trials. The integration of multiple study designs in systematic reviews is required if patients should be informed on the many facets of patient relevant issues of health care interventions. PMID:24416098

Energy interventions that facilitate sustainable development and impact health: an overview of systematic reviews.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Galvão, Luiz A C

2016-04-01

Objective To inform policy by providing an overview of systematic reviews on interventions that facilitate sustainable energy use and have a positive impact on health. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations through a comprehensive search of 13 databases and nine websites based on a pre-defined protocol, including clear inclusion criteria. Both grey and peer-reviewed literature published in English, Spanish, and Portuguese during the 17 years from January 1997 - January 2014 was included. To classify as "sustainable," interventions needed to aim to positively impact at least two dimensions of the integrated framework for sustainable development and include measures of health impact. Results Five systematic reviews and one economic evaluation met the inclusion criteria. The most promising interventions that impacted health were electricity for lighting and other uses (developing countries); improved stoves for cooking and health and/or cleaner fuels for cooking (developing countries); and household energy efficiency measures (developed countries). These interventions also had potential environmental and economic impacts. Their cost-effectiveness is not known, nor is their impact on health inequalities. Conclusions What is needed now is careful implementation of interventions where the impacts are likely to be positive but their implementation needs to be rigorously evaluated, including possible adverse impacts. Care needs to be taken not to exacerbate health inequalities and to consider context, human behavior and cultural factors so that the potential health benefits are realized in real-life implementation. Possible impact on health inequalities needs to be considered and measured in future primary studies and systematic reviews.

Evaluation of evidence-based literature and formulation of recommendations for the clinical preventive guidelines for immigrants and refugees in Canada

PubMed Central

Tugwell, Peter; Pottie, Kevin; Welch, Vivian; Ueffing, Erin; Chambers, Andrea; Feightner, John

2011-01-01

Background: This article describes the evidence review and guideline development method developed for the Clinical Preventive Guidelines for Immigrants and Refugees in Canada by the Canadian Collaboration for Immigrant and Refugee Health Guideline Committee. Methods: The Appraisal of Guidelines for Research and Evaluation (AGREE) best-practice framework was combined with the recently developed Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to produce evidence-based clinical guidelines for immigrants and refugees in Canada. Results: A systematic approach was designed to produce the evidence reviews and apply the GRADE approach, including building on evidence from previous systematic reviews, searching for and comparing evidence between general and specific immigrant populations, and applying the GRADE criteria for making recommendations. This method was used for priority health conditions that had been selected by practitioners caring for immigrants and refugees in Canada. Interpretation: This article outlines the 14-step method that was defined to standardize the guideline development process for each priority health condition. PMID:20573711

Maximizing the Impact of Systematic Reviews in Health Care Decision Making: A Systematic Scoping Review of Knowledge-Translation Resources

PubMed Central

Chambers, Duncan; Wilson, Paul M; Thompson, Carl A; Hanbury, Andria; Farley, Katherine; Light, Kate

2011-01-01

Context: Barriers to the use of systematic reviews by policymakers may be overcome by resources that adapt and present the findings in formats more directly tailored to their needs. We performed a systematic scoping review to identify such knowledge-translation resources and evaluations of them. Methods: Resources were eligible for inclusion in this study if they were based exclusively or primarily on systematic reviews and were aimed at health care policymakers at the national or local level. Resources were identified by screening the websites of health technology assessment agencies and systematic review producers, supplemented by an email survey. Electronic databases and proceedings of the Cochrane Colloquium and HTA International were searched as well for published and unpublished evaluations of knowledge-translation resources. Resources were classified as summaries, overviews, or policy briefs using a previously published classification. Findings: Twenty knowledge-translation resources were identified, of which eleven were classified as summaries, six as overviews, and three as policy briefs. Resources added value to systematic reviews by, for example, evaluating their methodological quality or assessing the reliability of their conclusions or their generalizability to particular settings. The literature search found four published evaluation studies of knowledge-translation resources, and the screening of abstracts and contact with authors found three more unpublished studies. The majority of studies reported on the perceived usefulness of the service, although there were some examples of review-based resources being used to assist actual decision making. Conclusions: Systematic review producers provide a variety of resources to help policymakers, of which focused summaries are the most common. More evaluations of these resources are required to ensure users’ needs are being met, to demonstrate their impact, and to justify their funding. PMID:21418315

A Systematic Review of Economic Evaluations of Treatments for Borderline Personality Disorder

PubMed Central

Brettschneider, Christian; Riedel-Heller, Steffi; König, Hans-Helmut

2014-01-01

Purpose The borderline personality disorder is a common mental disorder. It is frequently associated with various mental co-morbidities and a fundamental loss of functioning. The borderline personality disorder causes high costs to society. The aim of this study was to perform a systematic literature review of existing economic evaluations of treatments for borderline personality disorder. Materials and Methods We performed a systematic literature search in MEDLINE, EMBASE, PsycINFO and NHSEED for partial and full economic evaluations regarding borderline personality disorder. Reported cost data were inflated to the year 2012 and converted into US-$ using purchasing power parities to allow for comparability. Quality assessment of the studies was performed by means of the Consensus on Health Economic Criteria checklist, a checklist developed by a Delphi method in cooperation with 23 international experts. Results We identified 6 partial and 9 full economic evaluations. The methodical quality was moderate (fulfilled quality criteria: 79.2% [SD: 15.4%] in partial economic evaluations, 77.3% [SD: 8.5%] in full economic evaluations). Most evaluations analysed psychotherapeutic interventions. Although ambiguous, most evidence exists on dialectical-behavioural therapy. Cognitive behavioural therapy and schema-focused therapy are cost-saving. Evidence on other interventions is scarce. Conclusion The economic evidence is not sufficient to draw robust conclusions for all treatments. It is possible that some treatments are cost-effective. Most evidence exists on dialectical-behavioural therapy. Yet, it is ambiguous. Further research concerning the cost-effectiveness of treatments is necessary as well as the identification of relevant cost categories and the validation of effect measures. PMID:25265185

Evaluation of Models of the Reading Process.

ERIC Educational Resources Information Center

Balajthy, Ernest

A variety of reading process models have been proposed and evaluated in reading research. Traditional approaches to model evaluation specify the workings of a system in a simplified fashion to enable organized, systematic study of the system's components. Following are several statistical methods of model evaluation: (1) empirical research on…

Usage-Based Collection Evaluation with a Curricular Focus

ERIC Educational Resources Information Center

Kohn, Karen C.

2013-01-01

Systematic evaluation of a library's collection can be a useful tool for collection development. After reviewing three evaluation methods and their usefulness for our small academic library, I undertook a usage-based evaluation, focusing on narrow segments of our collection that served specific undergraduate courses. For each section, I collected…

The execution of systematic measurements on plane cascades

NASA Technical Reports Server (NTRS)

Scholz, N.

1978-01-01

The present state of development of the experimental technique regarding the flow through cascades and several points to be specially observed in the design of cascade wind tunnels were discussed. The equations required for the evaluation of the momentum measurements in two dimensional flow through cascades were developed. Regarding the effect of the jet contraction due to the boundary layer along the side walls a simple method for correction was also given in order to obtain two dimensional flow characteristics. Also given were the equations for the evaluation of the pressure distribution measurements. Another contribution was made regarding the presentation of the test results in the form of nondimensional quantities. The results of systematic measurements of cascades with symmetrical aerofoil were reported, and the above suggested method was applied for the evaluation of the measurements.

An Evidence-Based Systematic Review on Cognitive Interventions for Individuals with Dementia

ERIC Educational Resources Information Center

Hopper, Tammy; Bourgeois, Michelle; Pimentel, Jane; Qualls, Constance Dean; Hickey, Ellen; Frymark, Tobi; Schooling, Tracy

2013-01-01

Purpose: To evaluate the current state of research evidence related to cognitive interventions for individuals with Alzheimer's disease or related dementias. Method: A systematic search of the literature was conducted across 27 electronic databases based on a set of a priori questions, inclusion/exclusion criteria, and search parameters. Studies…

School-Based Mentoring for Adolescents: A Systematic Review and Meta-Analysis

ERIC Educational Resources Information Center

Wood, Sarah; Mayo-Wilson, Evan

2012-01-01

Objectives: To evaluate the impact of school-based mentoring for adolescents (11-18 years) on academic performance, attendance, attitudes, behavior, and self-esteem. Method: A systematic review and meta-analysis. The authors searched 12 databases from 1980 to 2011. Eight studies with 6,072 participants were included, 6 were included in…

Auditory Processing Disorder and Auditory/Language Interventions: An Evidence-Based Systematic Review

ERIC Educational Resources Information Center

Fey, Marc E.; Richard, Gail J.; Geffner, Donna; Kamhi, Alan G.; Medwetsky, Larry; Paul, Diane; Ross-Swain, Deborah; Wallach, Geraldine P.; Frymark, Tobi; Schooling, Tracy

2011-01-01

Purpose: In this systematic review, the peer-reviewed literature on the efficacy of interventions for school-age children with auditory processing disorder (APD) is critically evaluated. Method: Searches of 28 electronic databases yielded 25 studies for analysis. These studies were categorized by research phase (e.g., exploratory, efficacy) and…

Search and selection methodology of systematic reviews in orthodontics (2000-2004).

PubMed

Flores-Mir, Carlos; Major, Michael P; Major, Paul W

2006-08-01

More systematic reviews related to orthodontic topics are published each year, although little has been done to evaluate their search and selection methodologies. Systematic reviews related to orthodontics published between January 1, 2000, and December 31, 2004, were searched for their use of multiple electronic databases and secondary searches. The search and selection methods of identified systematic reviews were evaluated against the Cochrane Handbook's guidelines. Sixteen orthodontic systematic reviews were identified in this period. The percentage of reviews documenting and using each criterion of article searching has changed over the last 5 years, with no recognizable directional trend. On average, most systematic reviews documented their electronic search terms (88%) and inclusion-exclusion criteria (100%), and used secondary searching (75%). Many still failed to search more than MEDLINE (56%), failed to document the database names and search dates (37%), failed to document the search strategy (62%), did not use several reviewers for selecting studies (75%), and did not include all languages (81%). The methodology of systematic reviews in orthodontics is still limited, with key methodological components frequently absent or not appropriately described.

The Evaluation of Hospital Performance in Iran: A Systematic Review Article

PubMed Central

BAHADORI, Mohammadkarim; IZADI, Ahmad Reza; GHARDASHI, Fatemeh; RAVANGARD, Ramin; HOSSEINI, Seyed Mojtaba

2016-01-01

Background: This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. Methods: In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. Results: The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Conclusion: Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them. PMID:27516991

[METHODS OF EVALUATION OF MUSCLE MASS: A SYSTEMATIC REVIEW OF RANDOMIZED CONTROLLED TRIALS].

PubMed

Moreira, Osvaldo Costa; de Oliveira, Cláudia Eliza Patrocínio; Candia-Luján, Ramón; Romero-Pérez, Ena Monserrat; de Paz Fernandez, José Antonio

2015-09-01

in recent years, research about muscle mass has gained popularity for their relationship to health. Thus precise measurement of muscle mass may have clinical application once may interfere with the diagnosis and prescription drug or drug treatment. to conduct a systematic review of the methods most used for evaluation of muscle mass in randomized controlled trials, with its advantages and disadvantages. we conducted a search of the data bases Pub- Med, Web of Science and Scopus, with words "muscle mass", "measurement", "assessment" and "evaluation", combined in this way: "muscle mass" AND (assessment OR measurement OR evaluation). 23 studies were recovered and analyzed, all in English. 69.56% only used a method for quantification of muscle mass; 69.57% used dual X-ray absorptiometry (DXA); in 45.46% the type of measure used was the body lean mass; and 51.61% chose the whole body as a site of measurement. in the randomized controlled trials analyzed the majority used just one method of assessment, with the DXA being the method most used, the body lean mass the measurement type most used and total body the most common site of measure. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Comparison of normalization methods for the analysis of metagenomic gene abundance data.

PubMed

Pereira, Mariana Buongermino; Wallroth, Mikael; Jonsson, Viktor; Kristiansson, Erik

2018-04-20

In shotgun metagenomics, microbial communities are studied through direct sequencing of DNA without any prior cultivation. By comparing gene abundances estimated from the generated sequencing reads, functional differences between the communities can be identified. However, gene abundance data is affected by high levels of systematic variability, which can greatly reduce the statistical power and introduce false positives. Normalization, which is the process where systematic variability is identified and removed, is therefore a vital part of the data analysis. A wide range of normalization methods for high-dimensional count data has been proposed but their performance on the analysis of shotgun metagenomic data has not been evaluated. Here, we present a systematic evaluation of nine normalization methods for gene abundance data. The methods were evaluated through resampling of three comprehensive datasets, creating a realistic setting that preserved the unique characteristics of metagenomic data. Performance was measured in terms of the methods ability to identify differentially abundant genes (DAGs), correctly calculate unbiased p-values and control the false discovery rate (FDR). Our results showed that the choice of normalization method has a large impact on the end results. When the DAGs were asymmetrically present between the experimental conditions, many normalization methods had a reduced true positive rate (TPR) and a high false positive rate (FPR). The methods trimmed mean of M-values (TMM) and relative log expression (RLE) had the overall highest performance and are therefore recommended for the analysis of gene abundance data. For larger sample sizes, CSS also showed satisfactory performance. This study emphasizes the importance of selecting a suitable normalization methods in the analysis of data from shotgun metagenomics. Our results also demonstrate that improper methods may result in unacceptably high levels of false positives, which in turn may lead to incorrect or obfuscated biological interpretation.

Mapping the absolute magnetic field and evaluating the quadratic Zeeman-effect-induced systematic error in an atom interferometer gravimeter

NASA Astrophysics Data System (ADS)

Hu, Qing-Qing; Freier, Christian; Leykauf, Bastian; Schkolnik, Vladimir; Yang, Jun; Krutzik, Markus; Peters, Achim

2017-09-01

Precisely evaluating the systematic error induced by the quadratic Zeeman effect is important for developing atom interferometer gravimeters aiming at an accuracy in the μ Gal regime (1 μ Gal =10-8m /s2 ≈10-9g ). This paper reports on the experimental investigation of Raman spectroscopy-based magnetic field measurements and the evaluation of the systematic error in the gravimetric atom interferometer (GAIN) due to quadratic Zeeman effect. We discuss Raman duration and frequency step-size-dependent magnetic field measurement uncertainty, present vector light shift and tensor light shift induced magnetic field measurement offset, and map the absolute magnetic field inside the interferometer chamber of GAIN with an uncertainty of 0.72 nT and a spatial resolution of 12.8 mm. We evaluate the quadratic Zeeman-effect-induced gravity measurement error in GAIN as 2.04 μ Gal . The methods shown in this paper are important for precisely mapping the absolute magnetic field in vacuum and reducing the quadratic Zeeman-effect-induced systematic error in Raman transition-based precision measurements, such as atomic interferometer gravimeters.

Evaluation methods used on health information systems (HISs) in Iran and the effects of HISs on Iranian healthcare: a systematic review.

PubMed

Ahmadian, Leila; Nejad, Simin Salehi; Khajouei, Reza

2015-06-01

The most important goal of a health information system (HIS) is improvement of quality, effectiveness and efficiency of health services. To achieve this goal, health care systems should be evaluated continuously. The aim of this paper was to study the impacts of HISs in Iran and the methods used for their evaluation. We systematically searched all English and Persian papers evaluating health information systems in Iran that were indexed in SID, Magiran, Iran medex, PubMed and Embase databases until June 2013. A data collection form was designed to extract required data such as types of systems evaluated, evaluation methods and tools. In this study, 53 out of 1103 retrieved articles were selected as relevant and reviewed by the authors. This study indicated that 28 studies used questionnaires to evaluate the system and in 27 studies the study instruments were distributed within a research population. In 26 papers the researchers collected the information by means of interviews, observations, heuristic evaluation and the review of documents and records. The main effects of the evaluated systems in health care settings were improving quality of services, reducing time, increasing accessibility to information, reducing costs and decreasing medical errors. Evaluation of health information systems is central to their development and enhancement, and to understanding their effect on health and health services. Despite numerous evaluation methods available, the reviewed studies used a limited number of methods to evaluate HIS. Additionally, the studies mainly discussed the positive effects of HIS on health care services. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Testing For EM Upsets In Aircraft Control Computers

NASA Technical Reports Server (NTRS)

Belcastro, Celeste M.

1994-01-01

Effects of transient electrical signals evaluated in laboratory tests. Method of evaluating nominally fault-tolerant, aircraft-type digital-computer-based control system devised. Provides for evaluation of susceptibility of system to upset and evaluation of integrity of control when system subjected to transient electrical signals like those induced by electromagnetic (EM) source, in this case lightning. Beyond aerospace applications, fault-tolerant control systems becoming more wide-spread in industry; such as in automobiles. Method supports practical, systematic tests for evaluation of designs of fault-tolerant control systems.

Development and evaluation of an off-the-slide genotyping technique for identifying Giardia cysts and Cryptosporidium oocysts directly from US EPA Method 1623 slides

EPA Science Inventory

ABSTRACT Aims This study developed and systematically evaluated performance and limit of detection of an off-the-slide genotyping procedure for both Cryptosporidium oocysts and Giardia cysts. Methods and Results Slide standards containing flow sorted (oo)cysts were used to e...

Prevention and self-management interventions are top priorities for osteoarthritis systematic reviews.

PubMed

Jaramillo, Alejandra; Welch, Vivian A; Ueffing, Erin; Gruen, Russell L; Bragge, Peter; Lyddiatt, Anne; Tugwell, Peter

2013-05-01

To identify high-priority research questions for osteoarthritis systematic reviews with consideration of health equity and the social determinants of health (SDH). We consulted with experts and conducted a literature search to identify a priority-setting method that could be adapted to address the health equity and SDH. We selected the Global Evidence Mapping priority-setting method, and through consultations and consensus, we adapted the method to meet our objectives. This involves developing an evidence map of the existing systematic reviews on osteoarthritis; conducting one face-to-face workshop with patients and another one with clinicians, researchers, and patients; and conducting an online survey of patients to rank the top 10 research questions. We piloted the adapted method with the Cochrane Musculoskeletal Review Group to set research priorities for osteoarthritis. Our focus was on systematic reviews: we identified 34 high-priority research questions for osteoarthritis systematic reviews. Prevention and self-management interventions, mainly diet and exercise, are top priorities for osteoarthritis systematic reviews. Evaluation against our predefined objectives showed that this method did prioritize SDH (50% of the research questions considered SDH). There were marked gaps: no high-priority topics were identified for access to care until patients had advanced disease-lifestyle changes once the disease was diagnosed. This method was felt feasible if conducted annually. We confirmed the utility of an adapted priority-setting method that is feasible and considers SDH. Further testing of this method is needed to assess whether considerations of health equity are prioritized and involve disadvantaged groups of the population. Copyright © 2013 Elsevier Inc. All rights reserved.

AHRQ series on complex intervention systematic reviews-paper 7: PRISMA-CI elaboration and explanation.

PubMed

Guise, Jeanne-Marie; Butler, Mary; Chang, Christine; Viswanathan, Meera; Pigott, Terri; Tugwell, Peter

2017-10-01

Complex interventions are widely used in health care, public health, education, criminology, social work, business, and welfare. They have increasingly become the subject of systematic reviews and are challenging to effectively report. The Complex Interventions Methods Workgroup developed an extension to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Complex Interventions (PRISMA-CI). Following the EQUATOR Network guidance for Preferred Reporting Items for Systematic Reviews and Meta-Analysis extensions, this Explanation and Elaboration (EE) document accompanies the PRISMA-CI checklist to promote consistency in reporting of systematic reviews of complex interventions. The EE document explains the meaning and rationale for each unique PRISMA-CI checklist item and provides examples to assist systematic review authors in operationalizing PRISMA-CI guidance. The Complex Interventions Workgroup developed PRISMA-CI as an important start toward increased consistency in reporting of systematic reviews of complex interventions. Because the field is rapidly expanding, the Complex Interventions Methods Workgroup plans to re-evaluate periodically for the need to add increasing specificity and examples as the field matures. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Methods for detecting, quantifying, and adjusting for dissemination bias in meta-analysis are described.

PubMed

Mueller, Katharina Felicitas; Meerpohl, Joerg J; Briel, Matthias; Antes, Gerd; von Elm, Erik; Lang, Britta; Motschall, Edith; Schwarzer, Guido; Bassler, Dirk

2016-12-01

To systematically review methodological articles which focus on nonpublication of studies and to describe methods of detecting and/or quantifying and/or adjusting for dissemination in meta-analyses. To evaluate whether the methods have been applied to an empirical data set for which one can be reasonably confident that all studies conducted have been included. We systematically searched Medline, the Cochrane Library, and Web of Science, for methodological articles that describe at least one method of detecting and/or quantifying and/or adjusting for dissemination bias in meta-analyses. The literature search retrieved 2,224 records, of which we finally included 150 full-text articles. A great variety of methods to detect, quantify, or adjust for dissemination bias were described. Methods included graphical methods mainly based on funnel plot approaches, statistical methods, such as regression tests, selection models, sensitivity analyses, and a great number of more recent statistical approaches. Only few methods have been validated in empirical evaluations using unpublished studies obtained from regulators (Food and Drug Administration, European Medicines Agency). We present an overview of existing methods to detect, quantify, or adjust for dissemination bias. It remains difficult to advise which method should be used as they are all limited and their validity has rarely been assessed. Therefore, a thorough literature search remains crucial in systematic reviews, and further steps to increase the availability of all research results need to be taken. Copyright © 2016 Elsevier Inc. All rights reserved.

Usability evaluation techniques in mobile commerce applications: A systematic review

NASA Astrophysics Data System (ADS)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Three-dimensional Imaging Methods for Quantitative Analysis of Facial Soft Tissues and Skeletal Morphology in Patients with Orofacial Clefts: A Systematic Review

PubMed Central

Kuijpers, Mette A. R.; Chiu, Yu-Ting; Nada, Rania M.; Carels, Carine E. L.; Fudalej, Piotr S.

2014-01-01

Background Current guidelines for evaluating cleft palate treatments are mostly based on two-dimensional (2D) evaluation, but three-dimensional (3D) imaging methods to assess treatment outcome are steadily rising. Objective To identify 3D imaging methods for quantitative assessment of soft tissue and skeletal morphology in patients with cleft lip and palate. Data sources Literature was searched using PubMed (1948–2012), EMBASE (1980–2012), Scopus (2004–2012), Web of Science (1945–2012), and the Cochrane Library. The last search was performed September 30, 2012. Reference lists were hand searched for potentially eligible studies. There was no language restriction. Study selection We included publications using 3D imaging techniques to assess facial soft tissue or skeletal morphology in patients older than 5 years with a cleft lip with/or without cleft palate. We reviewed studies involving the facial region when at least 10 subjects in the sample size had at least one cleft type. Only primary publications were included. Data extraction Independent extraction of data and quality assessments were performed by two observers. Results Five hundred full text publications were retrieved, 144 met the inclusion criteria, with 63 high quality studies. There were differences in study designs, topics studied, patient characteristics, and success measurements; therefore, only a systematic review could be conducted. Main 3D-techniques that are used in cleft lip and palate patients are CT, CBCT, MRI, stereophotogrammetry, and laser surface scanning. These techniques are mainly used for soft tissue analysis, evaluation of bone grafting, and changes in the craniofacial skeleton. Digital dental casts are used to evaluate treatment and changes over time. Conclusion Available evidence implies that 3D imaging methods can be used for documentation of CLP patients. No data are available yet showing that 3D methods are more informative than conventional 2D methods. Further research is warranted to elucidate it. Systematic review registration International Prospective Register of Systematic Reviews, PROSPERO CRD42012002041 PMID:24710215

Systematic approach to cutoff frequency selection in continuous-wave electron paramagnetic resonance imaging

NASA Astrophysics Data System (ADS)

Hirata, Hiroshi; Itoh, Toshiharu; Hosokawa, Kouichi; Deng, Yuanmu; Susaki, Hitoshi

2005-08-01

This article describes a systematic method for determining the cutoff frequency of the low-pass window function that is used for deconvolution in two-dimensional continuous-wave electron paramagnetic resonance (EPR) imaging. An evaluation function for the criterion used to select the cutoff frequency is proposed, and is the product of the effective width of the point spread function for a localized point signal and the noise amplitude of a resultant EPR image. The present method was applied to EPR imaging for a phantom, and the result of cutoff frequency selection was compared with that based on a previously reported method for the same projection data set. The evaluation function has a global minimum point that gives the appropriate cutoff frequency. Images with reasonably good resolution and noise suppression can be obtained from projections with an automatically selected cutoff frequency based on the present method.

Systematic Review of Kinship Care Effects on Safety, Permanency, and Well-Being Outcomes

ERIC Educational Resources Information Center

Winokur, Marc A.; Holtan, Amy; Batchelder, Keri E.

2018-01-01

Objective: Children in out-of-home placements typically display more educational, behavioral, and psychological problems than do their peers. This systematic review evaluated the effect of kinship care placement compared to foster care placement on the safety, permanency, and well-being of children removed from the home for maltreatment. Methods:…

Special Strategies Observation System-Revised: A Useful Tool for Educational Research and Evaluation

ERIC Educational Resources Information Center

Meehan, Merrill L.; Cowley, Kimberly S.; Finch, Nicole L.; Chadwick, Kristine L.; Ermolov, Lisa D.; Riffle, M. Joy S.

2004-01-01

A review of the critical literature provides a brief history of systematic observation of classroom behaviors, long valued as an important data collection method in educational research. Milestones in systematic observation of classrooms are traced back to 1914 and the development and use of the Special Strategies Observation System (SSOS) through…

A Systematic Review of State Vocational Rehabilitation Agency-Based Literature

ERIC Educational Resources Information Center

Boeltzig-Brown, Heike; Fleming, Allison R.; Heyman, Miriam; Gauthier, Martha; Cully, Julisa; Foley, Susan M.

2017-01-01

Purpose: To conduct a systematic review (SR) of 550 studies produced between 1970 and 2008 that focus on programs and/or services provided by state vocational rehabilitation (VR) agencies believed to impact client and/or program outcomes. Method: Authors used a 5-step SR protocol to evaluate and summarize study content and outcomes, study design,…

Voice-Related Patient-Reported Outcome Measures: A Systematic Review of Instrument Development and Validation

ERIC Educational Resources Information Center

Francis, David O.; Daniero, James J.; Hovis, Kristen L.; Sathe, Nila; Jacobson, Barbara; Penson, David F.; Feurer, Irene D.; McPheeters, Melissa L.

2017-01-01

Purpose: The purpose of this study was to perform a comprehensive systematic review of the literature on voice-related patient-reported outcome (PRO) measures in adults and to evaluate each instrument for the presence of important measurement properties. Method: MEDLINE, the Cumulative Index of Nursing and Allied Health Literature, and the Health…

Building and Solving Odd-One-Out Classification Problems: A Systematic Approach

ERIC Educational Resources Information Center

Ruiz, Philippe E.

2011-01-01

Classification problems ("find the odd-one-out") are frequently used as tests of inductive reasoning to evaluate human or animal intelligence. This paper introduces a systematic method for building the set of all possible classification problems, followed by a simple algorithm for solving the problems of the R-ASCM, a psychometric test derived…

Interventions to Reduce Distress in Adult Victims of Rape and Sexual Violence: A Systematic Review

ERIC Educational Resources Information Center

Regehr, Cheryl; Alaggia, Ramona; Dennis, Jane; Pitts, Annabel; Saini, Michael

2013-01-01

Objectives: This article presents a systematic evaluation of the effectiveness of interventions aimed at reducing distress in adult victims of rape and sexual violence. Method: Studies were eligible for the review if the assignment of study participants to experimental or control groups was by random allocation or parallel cohort design. Results:…

Changing physician behavior: what works?

PubMed

Mostofian, Fargoi; Ruban, Cynthiya; Simunovic, Nicole; Bhandari, Mohit

2015-01-01

There are various interventions for guideline implementation in clinical practice, but the effects of these interventions are generally unclear. We conducted a systematic review to identify effective methods of implementing clinical research findings and clinical guidelines to change physician practice patterns, in surgical and general practice. Systematic review of reviews. We searched electronic databases (MEDLINE, EMBASE, and PubMed) for systematic reviews published in English that evaluated the effectiveness of different implementation methods. Two reviewers independently assessed eligibility for inclusion and methodological quality, and extracted relevant data. Fourteen reviews covering a wide range of interventions were identified. The intervention methods used include: audit and feedback, computerized decision support systems, continuing medical education, financial incentives, local opinion leaders, marketing, passive dissemination of information, patient-mediated interventions, reminders, and multifaceted interventions. Active approaches, such as academic detailing, led to greater effects than traditional passive approaches. According to the findings of 3 reviews, 71% of studies included in these reviews showed positive change in physician behavior when exposed to active educational methods and multifaceted interventions. Active forms of continuing medical education and multifaceted interventions were found to be the most effective methods for implementing guidelines into general practice. Additionally, active approaches to changing physician performance were shown to improve practice to a greater extent than traditional passive methods. Further primary research is necessary to evaluate the effectiveness of these methods in a surgical setting.

An Approach to Integrating Interprofessional Education in Collaborative Mental Health Care

ERIC Educational Resources Information Center

Curran, Vernon; Heath, Olga; Adey, Tanis; Callahan, Terrance; Craig, David; Hearn, Taryn; White, Hubert; Hollett, Ann

2012-01-01

Objective: This article describes an evaluation of a curriculum approach to integrating interprofessional education (IPE) in collaborative mental health practice across the pre- to post-licensure continuum of medical education. Methods: A systematic evaluation of IPE activities was conducted, utilizing a combination of evaluation study designs,…

Can economic evaluation in telemedicine be trusted? A systematic review of the literature

PubMed Central

Bergmo, Trine S

2009-01-01

Background Telemedicine has been advocated as an effective means to provide health care services over a distance. Systematic information on costs and consequences has been called for to support decision-making in this field. This paper provides a review of the quality, validity and generalisability of economic evaluations in telemedicine. Methods A systematic literature search in all relevant databases was conducted and forms the basis for addressing these issues. Only articles published in peer-reviewed journals and written in English in the period from 1990 to 2007 were analysed. The literature search identified 33 economic evaluations where both costs (resource use) and outcomes (non-resource consequences) were measured. Results This review shows that economic evaluations in telemedicine are highly diverse in terms of both the study context and the methods applied. The articles covered several medical specialities ranging from cardiology and dermatology to psychiatry. The studies analysed telemedicine in home care, and in primary and secondary care settings using a variety of different technologies including videoconferencing, still-images and monitoring (store-and-forward telemedicine). Most studies used multiple outcome measures and analysed the effects using disaggregated cost-consequence frameworks. Objectives, study design, and choice of comparators were mostly well reported. The majority of the studies lacked information on perspective and costing method, few used general statistics and sensitivity analysis to assess validity, and even fewer used marginal analysis. Conclusion As this paper demonstrates, the majority of the economic evaluations reviewed were not in accordance with standard evaluation techniques. Further research is needed to explore the reasons for this and to address how economic evaluation in telemedicine best can take advantage of local constraints and at the same time produce valid and generalisable results. PMID:19852828

Systematic reviews identify important methodological flaws in stroke rehabilitation therapy primary studies: review of reviews.

PubMed

Santaguida, Pasqualina; Oremus, Mark; Walker, Kathryn; Wishart, Laurie R; Siegel, Karen Lohmann; Raina, Parminder

2012-04-01

A "review of reviews" was undertaken to assess methodological issues in studies evaluating nondrug rehabilitation interventions in stroke patients. MEDLINE, CINAHL, PsycINFO, and the Cochrane Database of Systematic Reviews were searched from January 2000 to January 2008 within the stroke rehabilitation setting. Electronic searches were supplemented by reviews of reference lists and citations identified by experts. Eligible studies were systematic reviews; excluded citations were narrative reviews or reviews of reviews. Review characteristics and criteria for assessing methodological quality of primary studies within them were extracted. The search yielded 949 English-language citations. We included a final set of 38 systematic reviews. Cochrane reviews, which have a standardized methodology, were generally of higher methodological quality than non-Cochrane reviews. Most systematic reviews used standardized quality assessment criteria for primary studies, but not all were comprehensive. Reviews showed that primary studies had problems with randomization, allocation concealment, and blinding. Baseline comparability, adverse events, and co-intervention or contamination were not consistently assessed. Blinding of patients and providers was often not feasible and was not evaluated as a source of bias. The eligible systematic reviews identified important methodological flaws in the evaluated primary studies, suggesting the need for improvement of research methods and reporting. Copyright © 2012 Elsevier Inc. All rights reserved.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

PubMed Central

Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.

2018-01-01

Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality. PMID:29750807

A systematic review of novel technology for monitoring infant and newborn heart rate.

PubMed

Kevat, Ajay C; Bullen, Denise V R; Davis, Peter G; Kamlin, C Omar F

2017-05-01

Heart rate (HR) is a vital sign for assessing the need for resuscitation. We performed a systematic review of studies assessing novel methods of measuring HR in newborns and infants in the neonatal unit. Two investigators completed independent literature searches. Identified papers were independently evaluated, and relevant data were extracted and analysed. This systematic review identified seven new technologies, including camera-based photoplethysmography, reflectance pulse oximetry, laser Doppler methods, capacitive sensors, piezoelectric sensors, electromyography and a digital stethoscope. Clinicians should be aware of several of these, which may become available for clinical use in the near future. ©2017 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review.

PubMed

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; "simulation," "practice," "drill," "exercise," "instrument," "tool," "questionnaire," " measurement," "checklist," "scale," "test," "inventory," "battery," "evaluation," "assessment," "appraisal," "emergency," "disaster," "cricise," "hazard," "catastrophe,: "hospital", "prehospital," "health centers," "treatment centers," were used in combination with Boolean operators OR and AND. The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages.

A strategy for evaluating pathway analysis methods.

PubMed

Yu, Chenggang; Woo, Hyung Jun; Yu, Xueping; Oyama, Tatsuya; Wallqvist, Anders; Reifman, Jaques

2017-10-13

Researchers have previously developed a multitude of methods designed to identify biological pathways associated with specific clinical or experimental conditions of interest, with the aim of facilitating biological interpretation of high-throughput data. Before practically applying such pathway analysis (PA) methods, we must first evaluate their performance and reliability, using datasets where the pathways perturbed by the conditions of interest have been well characterized in advance. However, such 'ground truths' (or gold standards) are often unavailable. Furthermore, previous evaluation strategies that have focused on defining 'true answers' are unable to systematically and objectively assess PA methods under a wide range of conditions. In this work, we propose a novel strategy for evaluating PA methods independently of any gold standard, either established or assumed. The strategy involves the use of two mutually complementary metrics, recall and discrimination. Recall measures the consistency of the perturbed pathways identified by applying a particular analysis method to an original large dataset and those identified by the same method to a sub-dataset of the original dataset. In contrast, discrimination measures specificity-the degree to which the perturbed pathways identified by a particular method to a dataset from one experiment differ from those identifying by the same method to a dataset from a different experiment. We used these metrics and 24 datasets to evaluate six widely used PA methods. The results highlighted the common challenge in reliably identifying significant pathways from small datasets. Importantly, we confirmed the effectiveness of our proposed dual-metric strategy by showing that previous comparative studies corroborate the performance evaluations of the six methods obtained by our strategy. Unlike any previously proposed strategy for evaluating the performance of PA methods, our dual-metric strategy does not rely on any ground truth, either established or assumed, of the pathways perturbed by a specific clinical or experimental condition. As such, our strategy allows researchers to systematically and objectively evaluate pathway analysis methods by employing any number of datasets for a variety of conditions.

Systematic review of methods for evaluating healthcare research economic impact

PubMed Central

2010-01-01

Background The economic benefits of healthcare research require study so that appropriate resources can be allocated to this research, particularly in developing countries. As a first step, we performed a systematic review to identify the methods used to assess the economic impact of healthcare research, and the outcomes. Method An electronic search was conducted in relevant databases using a combination of specific keywords. In addition, 21 relevant Web sites were identified. Results The initial search yielded 8,416 articles. After studying titles, abstracts, and full texts, 18 articles were included in the analysis. Eleven other reports were found on Web sites. We found that the outcomes assessed as healthcare research payback included direct cost-savings, cost reductions in healthcare delivery systems, benefits from commercial advancement, and outcomes associated with improved health status. Two methods were used to study healthcare research payback: macro-economic studies, which examine the relationship between research studies and economic outcome at the aggregated level, and case studies, which examine specific research projects to assess economic impact. Conclusions Our study shows that different methods and outcomes can be used to assess the economic impacts of healthcare research. There is no unique methodological approach for the economic evaluation of such research. In our systematic search we found no research that had evaluated the economic return of research in low and middle income countries. We therefore recommend a consensus on practical guidelines at international level on the basis of more comprehensive methodologies (such as Canadian Academic of Health Science and payback frameworks) in order to build capacity, arrange for necessary informative infrastructures and promote necessary skills for economic evaluation studies. PMID:20196839

Qualitative fusion technique based on information poor system and its application to factor analysis for vibration of rolling bearings

NASA Astrophysics Data System (ADS)

Xia, Xintao; Wang, Zhongyu

2008-10-01

For some methods of stability analysis of a system using statistics, it is difficult to resolve the problems of unknown probability distribution and small sample. Therefore, a novel method is proposed in this paper to resolve these problems. This method is independent of probability distribution, and is useful for small sample systems. After rearrangement of the original data series, the order difference and two polynomial membership functions are introduced to estimate the true value, the lower bound and the supper bound of the system using fuzzy-set theory. Then empirical distribution function is investigated to ensure confidence level above 95%, and the degree of similarity is presented to evaluate stability of the system. Cases of computer simulation investigate stable systems with various probability distribution, unstable systems with linear systematic errors and periodic systematic errors and some mixed systems. The method of analysis for systematic stability is approved.

Questionnaire design and the recall of pharmacological treatments: a systematic review.

PubMed

Gama, Helena; Correia, Sofia; Lunet, Nuno

2009-03-01

We aimed to review systematically the published evidence regarding the effect of questionnaire design on the recall of pharmacological treatments. The electronic databases Pubmed, EMBASE, and Cochrane Library were searched from inception to October 2007, using the following search terms: drug utilization, pharmaceutical preparations, pharmacoepidemiology, validation studies, methods, epidemiologic methods, interviews, data collection, and questionnaires. Drug utilization studies comparing different types of questionnaire or methods of questionnaire administration were included. Backward and forward citation tracking were also conducted. Eight studies were included in the systematic review, comparing questions asking for specific drugs or indications with open-ended questions (n = 5), evaluating the use of memory aids (n = 1), or studying the influence of response order on recall (n = 2). The studies were heterogeneous, namely regarding the populations evaluated (e.g., pregnant women, hypertensive patients, general population), mode of questionnaire administration (e.g., personal or telephone interview, self-administered), recall period (e.g., current use, 1 week, previous episode of a disease), or drugs evaluated (e.g., analgesics, antimalarials, all medicines). Despite the lack of standardization in presentation of results, the prevalence of drug use may vary between 5 and 40% when drug names and indications or pictures are used as memory aids, or as a result of primacy effects in self-administered questionnaires. The yielding of the questionnaires depended on the pharmacological groups evaluated. Scientific work regarding methods for drug utilization data collection is scarce. The available evidence highlights the importance of knowing the questionnaire characteristics for a proper interpretation of results from drug utilization studies. (c) 2009 John Wiley & Sons, Ltd.

Systematic Review of Health Economic Evaluation Studies Developed in Brazil from 1980 to 2013.

PubMed

Decimoni, Tassia Cristina; Leandro, Roseli; Rozman, Luciana Martins; Craig, Dawn; Iglesias, Cynthia P; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2018-01-01

Brazil has sought to use economic evaluation to support healthcare decision-making processes. While a number of health economic evaluations (HEEs) have been conducted, no study has systematically reviewed the quality of Brazilian HEE. The objective of this systematic review was to provide an overview regarding the state of HEE research and to evaluate the number, characteristics, and quality of reporting of published HEE studies conducted in a Brazilian setting. We systematically searched electronic databases (MEDLINE, EMBASE, Latin American, and Caribbean Literature on Health Sciences Database, Scientific Electronic Library Online, NHS Economic Evaluation Database, health technology assessment Database, Bireme, and Biblioteca Virtual em Saúde Economia da Saúde ); citation indexes (SCOPUS, Web of Science), and Sistema de Informação da Rede Brasileira de Avaliação de Tecnologia em Saúde . Partial and full HEEs published between 1980 and 2013 that referred to a Brazilian setting were considered for inclusion. In total, 535 studies were included in the review, 36.8% of these were considered to be full HEE. The category of healthcare technologies more frequently assessed were procedures (34.8%) and drugs (28.8%) which main objective was treatment (72.1%). Forty-four percent of the studies reported their funding source and 36% reported a conflict of interest. Overall, the full HEE quality of reporting was satisfactory. But some items were generally poorly reported and significant improvement is required: (1) methods used to estimate healthcare resource use quantities and unit costs, (2) methods used to estimate utility values, (3) sources of funding, and (4) conflicts of interest. A steady number of HEE have been published in Brazil since 1980. To improve their contribution to inform national healthcare policy efforts need to be made to enhance the quality of reporting of HEEs and promote improvements in the way HEEs are designed, implemented (i.e., using sound methods for HEEs) and reported.

The systematic review as a research process in music therapy.

PubMed

Hanson-Abromeit, Deanna; Sena Moore, Kimberly

2014-01-01

Music therapists are challenged to present evidence on the efficacy of music therapy treatment and incorporate the best available research evidence to make informed healthcare and treatment decisions. Higher standards of evidence can come from a variety of sources including systematic reviews. To define and describe a range of research review methods using examples from music therapy and related literature, with emphasis on the systematic review. In addition, the authors provide a detailed overview of methodological processes for conducting and reporting systematic reviews in music therapy. The systematic review process is described in five steps. Step 1 identifies the research plan and operationalized research question(s). Step 2 illustrates the identification and organization of the existing literature related to the question(s). Step 3 details coding of data extracted from the literature. Step 4 explains the synthesis of coded findings and analysis to answer the research question(s). Step 5 describes the strength of evidence evaluation and results presentation for practice recommendations. Music therapists are encouraged to develop and conduct systematic reviews. This methodology contributes to review outcome credibility and can determine how information is interpreted and used by clinicians, clients or patients, and policy makers. A systematic review is a methodologically rigorous research method used to organize and evaluate extant literature related to a clinical problem. Systematic reviews can assist music therapists in managing the ever-increasing literature, making well-informed evidence based practice and research decisions, and translating existing music-based and nonmusic based literature to clinical practice and research development. © the American Music Therapy Association 2014. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Economic Evaluation alongside Multinational Studies: A Systematic Review of Empirical Studies

PubMed Central

Oppong, Raymond; Jowett, Sue; Roberts, Tracy E.

2015-01-01

Purpose of the study This study seeks to explore methods for conducting economic evaluations alongside multinational trials by conducting a systematic review of the methods used in practice and the challenges that are typically faced by the researchers who conducted the economic evaluations. Methods A review was conducted for the period 2002 to 2012, with potentially relevant articles identified by searching the Medline, Embase and NHS EED databases. Studies were included if they were full economic evaluations conducted alongside a multinational trial. Results A total of 44 studies out of a possible 2667 met the inclusion criteria. Methods used for the analyses varied between studies, indicating a lack of consensus on how economic evaluation alongside multinational studies should be carried out. The most common challenge appeared to be related to addressing differences between countries, which potentially hinders the generalisability and transferability of results. Other challenges reported included inadequate sample sizes and choosing cost-effectiveness thresholds. Conclusions It is recommended that additional guidelines be developed to aid researchers in this area and that these be based on an understanding of the challenges associated with multinational trials and the strengths and limitations of alternative approaches. Guidelines should focus on ensuring that results will aid decision makers in their individual countries. PMID:26121465

Economic Evaluation and Transferability of Physical Activity Programmes in Primary Prevention: A Systematic Review

PubMed Central

Wolfenstetter, Silke B.; Wenig, Christina M.

2010-01-01

This systematic review aims to assess the characteristics of, and the clinical and economic evidence provided by, economic evaluations of primary preventive physical exercise interventions, and to analyse their transferability to Germany using recommended checklists. Fifteen economic evaluations from seven different countries met eligibility criteria, with seven of the fifteen providing high economic evidence in the special country context. Most of the identified studies conclude that the investigated intervention provide good value for money compared with alternatives. However, this review shows a high variability of the costing methods between the studies, which limits comparability, generalisability and transferability of the results. PMID:20617050

The Biomarker-Surrogacy Evaluation Schema: a review of the biomarker-surrogate literature and a proposal for a criterion-based, quantitative, multidimensional hierarchical levels of evidence schema for evaluating the status of biomarkers as surrogate endpoints.

PubMed

Lassere, Marissa N

2008-06-01

There are clear advantages to using biomarkers and surrogate endpoints, but concerns about clinical and statistical validity and systematic methods to evaluate these aspects hinder their efficient application. Section 2 is a systematic, historical review of the biomarker-surrogate endpoint literature with special reference to the nomenclature, the systems of classification and statistical methods developed for their evaluation. In Section 3 an explicit, criterion-based, quantitative, multidimensional hierarchical levels of evidence schema - Biomarker-Surrogacy Evaluation Schema - is proposed to evaluate and co-ordinate the multiple dimensions (biological, epidemiological, statistical, clinical trial and risk-benefit evidence) of the biomarker clinical endpoint relationships. The schema systematically evaluates and ranks the surrogacy status of biomarkers and surrogate endpoints using defined levels of evidence. The schema incorporates the three independent domains: Study Design, Target Outcome and Statistical Evaluation. Each domain has items ranked from zero to five. An additional category called Penalties incorporates additional considerations of biological plausibility, risk-benefit and generalizability. The total score (0-15) determines the level of evidence, with Level 1 the strongest and Level 5 the weakest. The term ;surrogate' is restricted to markers attaining Levels 1 or 2 only. Surrogacy status of markers can then be directly compared within and across different areas of medicine to guide individual, trial-based or drug-development decisions. This schema would facilitate communication between clinical, researcher, regulatory, industry and consumer participants necessary for evaluation of the biomarker-surrogate-clinical endpoint relationship in their different settings.

How to Perform a Systematic Review and Meta-analysis of Diagnostic Imaging Studies.

PubMed

Cronin, Paul; Kelly, Aine Marie; Altaee, Duaa; Foerster, Bradley; Petrou, Myria; Dwamena, Ben A

2018-05-01

A systematic review is a comprehensive search, critical evaluation, and synthesis of all the relevant studies on a specific (clinical) topic that can be applied to the evaluation of diagnostic and screening imaging studies. It can be a qualitative or a quantitative (meta-analysis) review of available literature. A meta-analysis uses statistical methods to combine and summarize the results of several studies. In this review, a 12-step approach to performing a systematic review (and meta-analysis) is outlined under the four domains: (1) Problem Formulation and Data Acquisition, (2) Quality Appraisal of Eligible Studies, (3) Statistical Analysis of Quantitative Data, and (4) Clinical Interpretation of the Evidence. This review is specifically geared toward the performance of a systematic review and meta-analysis of diagnostic test accuracy (imaging) studies. Copyright © 2018 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

Methods for the evaluation of hospital cooperation activities (Systematic review protocol).

PubMed

Rotter, Thomas; Popa, Daniela; Riley, Beatrice; Ellermann, Tim; Ryll, Ulrike; Burazeri, Genc; Daemen, Piet; Peeters, Guy; Brand, Helmut

2012-02-10

Hospital partnerships, mergers and cooperatives are arrangements frequently seen as a means of improving health service delivery. Many of the assumptions used in planning hospital cooperatives are not stated clearly and are often based on limited or poor scientific evidence. This is a protocol for a systematic review, following the Cochrane EPOC methodology. The review aims to document, catalogue and synthesize the existing literature on the reported methods for the evaluation of hospital cooperation activities as well as methods of hospital cooperation. We will search the Database of Abstracts of Reviews of Effectiveness, the Effective Practice and Organisation of Care Register, the Cochrane Central Register of Controlled Trials and bibliographic databases including PubMed (via NLM), Web of Science, NHS EED, Business Source Premier (via EBSCO) and Global Health for publications that report on methods for evaluating hospital cooperatives, strategic partnerships, mergers, alliances, networks and related activities and methods used for such partnerships. The method proposed by the Cochrane EPOC group regarding randomized study designs, controlled clinical trials, controlled before and after studies, and interrupted time series will be followed. In addition, we will also include cohort, case-control studies, and relevant non-comparative publications such as case reports. We will categorize and analyze the review findings according to the study design employed, the study quality (low versus high quality studies) and the method reported in the primary studies. We will present the results of studies in tabular form. Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin hospital cooperation activities as defined in this protocol. As a result, the review will provide an evidence base for partnerships, alliances or other fields of cooperation in a hospital setting. PROSPERO registration number: CRD42011001579.

Environmental scan and evaluation of best practices for online systematic review resources.

PubMed

Parker, Robin M N; Boulos, Leah M; Visintini, Sarah; Ritchie, Krista; Hayden, Jill

2018-04-01

Online training for systematic review methodology is an attractive option due to flexibility and limited availability of in-person instruction. Librarians often direct new reviewers to these online resources, so they should be knowledgeable about the variety of available resources. The objective for this project was to conduct an environmental scan of online systematic review training resources and evaluate those identified resources. The authors systematically searched for electronic learning resources pertaining to systematic review methods. After screening for inclusion, we collected data about characteristics of training resources and assigned scores in the domains of (1) content, (2) design, (3) interactivity, and (4) usability by applying a previously published evaluation rubric for online instruction modules. We described the characteristics and scores for each training resource and compared performance across the domains. Twenty training resources were evaluated. Average overall score of online instructional resources was 61%. Online courses (n=7) averaged 73%, web modules (n=5) 64%, and videos (n=8) 48%. The top 5 highest scoring resources were in course or web module format, featured high interactivity, and required a longer (>5hrs) time commitment from users. This study revealed that resources include appropriate content but are less likely to adhere to principles of online training design and interactivity. Awareness of these resources will allow librarians to make informed recommendations for training based on patrons' needs. Future online systematic review training resources should use established best practices for e-learning to provide high-quality resources, regardless of format or user time commitment.

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review

PubMed Central

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

OBJECTIVE: Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. METHODS: This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; “simulation,” “practice,” “drill,” “exercise,” “instrument,” “tool,” “questionnaire,” “ measurement,” “checklist,” “scale,” “test,” “inventory,” “battery,” “evaluation,” “assessment,” “appraisal,” “emergency,” “disaster,” “cricise,” “hazard,” “catastrophe,: “hospital”, “prehospital,” “health centers,” “treatment centers,” were used in combination with Boolean operators OR and AND. RESULTS: The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. CONCLUSION: Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages. PMID:29417075

SU-D-BRD-07: Evaluation of the Effectiveness of Statistical Process Control Methods to Detect Systematic Errors For Routine Electron Energy Verification

DOE Office of Scientific and Technical Information (OSTI.GOV)

Parker, S

2015-06-15

Purpose: To evaluate the ability of statistical process control methods to detect systematic errors when using a two dimensional (2D) detector array for routine electron beam energy verification. Methods: Electron beam energy constancy was measured using an aluminum wedge and a 2D diode array on four linear accelerators. Process control limits were established. Measurements were recorded in control charts and compared with both calculated process control limits and TG-142 recommended specification limits. The data was tested for normality, process capability and process acceptability. Additional measurements were recorded while systematic errors were intentionally introduced. Systematic errors included shifts in the alignmentmore » of the wedge, incorrect orientation of the wedge, and incorrect array calibration. Results: Control limits calculated for each beam were smaller than the recommended specification limits. Process capability and process acceptability ratios were greater than one in all cases. All data was normally distributed. Shifts in the alignment of the wedge were most apparent for low energies. The smallest shift (0.5 mm) was detectable using process control limits in some cases, while the largest shift (2 mm) was detectable using specification limits in only one case. The wedge orientation tested did not affect the measurements as this did not affect the thickness of aluminum over the detectors of interest. Array calibration dependence varied with energy and selected array calibration. 6 MeV was the least sensitive to array calibration selection while 16 MeV was the most sensitive. Conclusion: Statistical process control methods demonstrated that the data distribution was normally distributed, the process was capable of meeting specifications, and that the process was centered within the specification limits. Though not all systematic errors were distinguishable from random errors, process control limits increased the ability to detect systematic errors using routine measurement of electron beam energy constancy.« less

Validation of rapid descriptive sensory methods against conventional descriptive analyses: A systematic review.

PubMed

Aguiar, Lorena Andrade de; Melo, Lauro; de Lacerda de Oliveira, Lívia

2018-04-03

A major drawback of conventional descriptive profile (CDP) in sensory evaluation is the long time spent in panel training. Rapid descriptive methods (RDM) have increased significantly. Some of them have been compared with CDP for validation. In Health Sciences, systematic reviews (SR) are performed to evaluate validation of diagnostic tests in relation to a gold standard method. SR present a well-defined protocol to summarize research evidence and to evaluate the quality of the studies with determined criteria. We adapted SR protocol to evaluate the validation of RDM against CDP as satisfactory procedures to obtain food characterization. We used "Population Intervention Comparison Outcome Study - PICOS" framework to design the research in which "Population" was food/ beverages; "intervention" were RDM, "Comparison" was CDP as gold standard, "Outcome" was the ability of RDM to generate similar descriptive profiles in comparison with CDP and "Studies" was sensory descriptive analyses. The proportion of studies concluding for similarity of the RDM with CDP ranged from 0% to 100%. Low and moderate risk of bias were reached by 87% and 13% of the studies, respectively, supporting the conclusions of SR. RDM with semi-trained assessors and evaluation of individual attributes presented higher percentages of concordance with CDP.

Evaluating core technology capacity based on an improved catastrophe progression method: the case of automotive industry

NASA Astrophysics Data System (ADS)

Zhao, Shijia; Liu, Zongwei; Wang, Yue; Zhao, Fuquan

2017-01-01

Subjectivity usually causes large fluctuations in evaluation results. Many scholars attempt to establish new mathematical methods to make evaluation results consistent with actual objective situations. An improved catastrophe progression method (ICPM) is constructed to overcome the defects of the original method. The improved method combines the merits of the principal component analysis' information coherence and the catastrophe progression method's none index weight and has the advantage of highly objective comprehensive evaluation. Through the systematic analysis of the influencing factors of the automotive industry's core technology capacity, the comprehensive evaluation model is established according to the different roles that different indices play in evaluating the overall goal with a hierarchical structure. Moreover, ICPM is developed for evaluating the automotive industry's core technology capacity for the typical seven countries in the world, which demonstrates the effectiveness of the method.

75 FR 13515 - Office of Innovation and Improvement (OII); Overview Information; Ready-to-Learn Television...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-22

... on rigorous scientifically based research methods to assess the effectiveness of a particular... activities and programs; and (B) Includes research that-- (i) Employs systematic, empirical methods that draw... or observational methods that provide reliable and valid data across evaluators and observers, across...

Dynamic Transmission Economic Evaluation of Infectious Disease Interventions in Low- and Middle-Income Countries: A Systematic Literature Review.

PubMed

Drake, Tom L; Devine, Angela; Yeung, Shunmay; Day, Nicholas P J; White, Lisa J; Lubell, Yoel

2016-02-01

Economic evaluation using dynamic transmission models is important for capturing the indirect effects of infectious disease interventions. We examine the use of these methods in low- and middle-income countries, where infectious diseases constitute a major burden. This review is comprised of two parts: (1) a summary of dynamic transmission economic evaluations across all disease areas published between 2011 and mid-2014 and (2) an in-depth review of mosquito-borne disease studies focusing on health economic methods and reporting. Studies were identified through a systematic search of the MEDLINE database and supplemented by reference list screening. Fifty-seven studies were eligible for inclusion in the all-disease review. The most common subject disease was HIV/AIDS, followed by malaria. A diverse range of modelling methods, outcome metrics and sensitivity analyses were used, indicating little standardisation. Seventeen studies were included in the mosquito-borne disease review. With notable exceptions, most studies did not employ economic evaluation methods beyond calculating a cost-effectiveness ratio or net benefit. Many did not adhere to health care economic evaluations reporting guidelines, particularly with respect to full model reporting and uncertainty analysis. We present a summary of the state-of-the-art and offer recommendations for improved implementation and reporting of health economic methods in this crossover discipline. © 2016 The Authors. Health Economics published by John Wiley & Sons Ltd.

Review of Comprehensive Evaluation Methods for Power Quality and Its Trend in New Generation Energy System

NASA Astrophysics Data System (ADS)

Liu, Ruihua; Wang, Rong; Liu, Qunying; Yang, Li; Xi, Chuan; Wang, Wei; Li, Lingzhou; Zhao, Zhoufang; Zhou, Ying

2018-02-01

With China’s new energy generation grid connected capacity being in the forefront of the world and the uncertainty of new energy sources, such as wind energy and solar energy, it is be of great significance to study scientific and comprehensive assessment of power quality. On the foundation of analysizing the current power quality index systematically and objectively, the new energy grid power quality analysis method and comprehensive evaluation method, this paper tentatively explored the trend of the new generation of energy system power quality comprehensive evaluation.

Economic Evaluation of Occupational Safety and Health Interventions From the Employer Perspective

PubMed Central

Grimani, Aikaterini; Bergström, Gunnar; Casallas, Martha Isabel Riaño; Aboagye, Emmanuel; Jensen, Irene; Lohela-Karlsson, Malin

2018-01-01

Objectives: The aim of this systematic review was to evaluate the cost-effectiveness of occupational safety and health interventions from the employer perspective. Methods: A comprehensive literature search (2005 to 2016) in five electronic databases was conducted. Pre-2005 studies were identified from the reference lists of previous studies and systematic reviews, which have similar objective to those of this search. Results: A total of 19 randomized controlled trials and quasi-experimental studies were included, targeting diverse health problems in a number of settings. Few studies included organizational-level interventions. When viewed in relation to the methodological quality and the sufficiency of economic evidence, five of 11 cost-effective occupational safety and health (OSH) interventions appear to be promising. Conclusion: The present systematic review highlights the need for high-quality economic evidence to evaluate the cost-effectiveness of OSH interventions, especially at organizational-level, in all areas of worker health. PMID:29112631

A systematic evaluation of normalization methods in quantitative label-free proteomics.

PubMed

Välikangas, Tommi; Suomi, Tomi; Elo, Laura L

2018-01-01

To date, mass spectrometry (MS) data remain inherently biased as a result of reasons ranging from sample handling to differences caused by the instrumentation. Normalization is the process that aims to account for the bias and make samples more comparable. The selection of a proper normalization method is a pivotal task for the reliability of the downstream analysis and results. Many normalization methods commonly used in proteomics have been adapted from the DNA microarray techniques. Previous studies comparing normalization methods in proteomics have focused mainly on intragroup variation. In this study, several popular and widely used normalization methods representing different strategies in normalization are evaluated using three spike-in and one experimental mouse label-free proteomic data sets. The normalization methods are evaluated in terms of their ability to reduce variation between technical replicates, their effect on differential expression analysis and their effect on the estimation of logarithmic fold changes. Additionally, we examined whether normalizing the whole data globally or in segments for the differential expression analysis has an effect on the performance of the normalization methods. We found that variance stabilization normalization (Vsn) reduced variation the most between technical replicates in all examined data sets. Vsn also performed consistently well in the differential expression analysis. Linear regression normalization and local regression normalization performed also systematically well. Finally, we discuss the choice of a normalization method and some qualities of a suitable normalization method in the light of the results of our evaluation. © The Author 2016. Published by Oxford University Press.

Systematic evaluation of a targeted gene capture sequencing panel for molecular diagnosis of retinitis pigmentosa

PubMed Central

Ma, Yuanyuan; Chiang, Pei-Wen; Zhong, Jing; Liu, Xuyang; Asan; Wu, Jing; Su, Yan; Li, Xin; Deng, Jianlian; Huang, Yingping; Zhang, Xinxin; Li, Yang; Fan, Ning; Wang, Ying; Tang, Lihui; Shen, Jinting; Chen, Meiyan; Zhang, Xiuqing; Te, Deng; Banerjee, Santasree; Liu, Hui; Qi, Ming; Yi, Xin

2018-01-01

Background Inherited eye diseases are major causes of vision loss in both children and adults. Inherited eye diseases are characterized by clinical variability and pronounced genetic heterogeneity. Genetic testing may provide an accurate diagnosis for ophthalmic genetic disorders and allow gene therapy for specific diseases. Methods A targeted gene capture panel was designed to capture exons of 283 inherited eye disease genes including 58 known causative retinitis pigmentosa (RP) genes. 180 samples were tested with this panel, 68 were previously tested by Sanger sequencing. Systematic evaluation of our method and comprehensive molecular diagnosis were carried on 99 RP patients. Results 96.85% targeted regions were covered by at least 20 folds, the accuracy of variants detection was 99.994%. In 4 of the 68 samples previously tested by Sanger sequencing, mutations of other diseases not consisting with the clinical diagnosis were detected by next-generation sequencing (NGS) not Sanger. Among the 99 RP patients, 64 (64.6%) were detected with pathogenic mutations, while in 3 patients, it was inconsistent between molecular diagnosis and their initial clinical diagnosis. After revisiting, one patient’s clinical diagnosis was reclassified. In addition, 3 patients were found carrying large deletions. Conclusions We have systematically evaluated our method and compared it with Sanger sequencing, and have identified a large number of novel mutations in a cohort of 99 RP patients. The results showed a sufficient accuracy of our method and suggested the importance of molecular diagnosis in clinical diagnosis. PMID:29641573

The Estimation and Inclusion of Presenteeism Costs in Applied Economic Evaluation: A Systematic Review.

PubMed

Kigozi, Jesse; Jowett, Sue; Lewis, Martyn; Barton, Pelham; Coast, Joanna

2017-03-01

Given the significant costs of reduced productivity (presenteeism) in comparison to absenteeism, and overall societal costs, presenteeism has a potentially important role to play in economic evaluations. However, these costs are often excluded. The objective of this study is to review applied cost of illness studies and economic evaluations to identify valuation methods used for, and impact of including presenteeism costs in practice. A structured systematic review was carried out to explore (i) the extent to which presenteeism has been applied in cost of illness studies and economic evaluations and (ii) the overall impact of including presenteeism on overall costs and outcomes. Potential articles were identified by searching Medline, PsycINFO and NHS EED databases. A standard template was developed and used to extract information from economic evaluations and cost of illness studies incorporating presenteeism costs. A total of 28 studies were included in the systematic review which also demonstrated that presenteeism costs are rarely included in full economic evaluations. Estimation and monetisation methods differed between the instruments. The impact of disease on presenteeism whilst in paid work is high. The potential impact of presenteeism costs needs to be highlighted and greater consideration should be given to including these in economic evaluations and cost of illness studies. The importance of including presenteeism costs when conducting economic evaluation from a societal perspective should be emphasised in national economic guidelines and more methodological work is required to improve the practical application of presenteeism instruments to generate productivity cost estimates. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

A systematic approach to the application of Automation, Robotics, and Machine Intelligence Systems /ARAMIS/ to future space projects

NASA Technical Reports Server (NTRS)

Smith, D. B. S.

1982-01-01

The potential applications of Automation, Robotics, and Machine Intelligence Systems (ARAMIS) to space projects are investigated, through a systematic method. In this method selected space projects are broken down into space project tasks, and 69 of these tasks are selected for study. Candidate ARAMIS options are defined for each task. The relative merits of these options are evaluated according to seven indices of performance. Logical sequences of ARAMIS development are also defined. Based on this data, promising applications of ARAMIS are

Evaluation Studies of Robotic Rollators by the User Perspective: A Systematic Review.

PubMed

Werner, Christian; Ullrich, Phoebe; Geravand, Milad; Peer, Angelika; Hauer, Klaus

2016-01-01

Robotic rollators enhance the basic functions of established devices by technically advanced physical, cognitive, or sensory support to increase autonomy in persons with severe impairment. In the evaluation of such ambient assisted living solutions, both the technical and user perspectives are important to prove usability, effectiveness and safety, and to ensure adequate device application. The aim of this systematic review is to summarize the methodology of studies evaluating robotic rollators with focus on the user perspective and to give recommendations for future evaluation studies. A systematic literature search up to December 31, 2014, was conducted based on the Cochrane Review methodology using the electronic databases PubMed and IEEE Xplore. Articles were selected according to the following inclusion criteria: evaluation studies of robotic rollators documenting human-robot interaction, no case reports, published in English language. Twenty-eight studies were identified that met the predefined inclusion criteria. Large heterogeneity in the definitions of the target user group, study populations, study designs and assessment methods was found across the included studies. No generic methodology to evaluate robotic rollators could be identified. We found major methodological shortcomings related to insufficient sample descriptions and sample sizes, and lack of appropriate, standardized and validated assessment methods. Long-term use in habitual environment was also not evaluated. Apart from the heterogeneity, methodological deficits in most of the identified studies became apparent. Recommendations for future evaluation studies include: clear definition of target user group, adequate selection of subjects, inclusion of other assistive mobility devices for comparison, evaluation of the habitual use of advanced prototypes, adequate assessment strategy with established, standardized and validated methods, and statistical analysis of study results. Assessment strategies may additionally focus on specific functionalities of the robotic rollators allowing an individually tailored assessment of innovative features to document their added value. © 2016 S. Karger AG, Basel.

A Decade of Research on Evaluation: A Systematic Review of Research on Evaluation Published between 2005 and 2014

ERIC Educational Resources Information Center

Coryn, Chris L. S.; Wilson, Lyssa N.; Westine, Carl D.; Hobson, Kristin A.; Ozeki, Satoshi; Fiekowsky, Erica L.; Greenman, Gregory D., II; Schröter, Daniela C.

2017-01-01

Although investigations into evaluation theories, methods, and practices have been occurring since the late 1970s, research on evaluation (RoE) has seemingly increased in the past decade. In this review, 257 studies published in 14 evaluation-focused journals over a 10-year period (between 2005 and 2014) were identified as RoE and then classified…

Searching for evidence or approval? A commentary on database search in systematic reviews and alternative information retrieval methodologies.

PubMed

Delaney, Aogán; Tamás, Peter A

2018-03-01

Despite recognition that database search alone is inadequate even within the health sciences, it appears that reviewers in fields that have adopted systematic review are choosing to rely primarily, or only, on database search for information retrieval. This commentary reminds readers of factors that call into question the appropriateness of default reliance on database searches particularly as systematic review is adapted for use in new and lower consensus fields. It then discusses alternative methods for information retrieval that require development, formalisation, and evaluation. Our goals are to encourage reviewers to reflect critically and transparently on their choice of information retrieval methods and to encourage investment in research on alternatives. Copyright © 2017 John Wiley & Sons, Ltd.

Multiwalled Carbon Nanotube Dispersion Methods Affect Their Aggregation, Deposition, and Biomarker Response

EPA Science Inventory

To systematically evaluate how dispersion methods affect the environmental behaviors of multiwalled carbon nanotubes (MWNTs), MWNTs were dispersed in various solutions (e.g., surfactants, natural organic matter (NOM), and etc.) via ultrasonication (SON) and long-term stirring (LT...

Review of reviews on exposures to synthetic organic chemicals and children's neurodevelopment: Methodological and interpretation challenges.

PubMed

LaKind, Judy S; Anthony, Laura G; Goodman, Michael

2017-01-01

Environmental epidemiology data are becoming increasingly important in public health decision making, which commonly incorporates a systematic review of multiple studies. This review addresses two fundamental questions: What is the quality of available reviews on associations between exposure to synthetic organic chemicals and neurodevelopmental outcomes? What is the value (e.g., quality and consistency) of the underlying literature? Published reviews on associations between synthetic organic environmental chemical exposures and neurodevelopmental outcomes in children were systematically evaluated. Seventy-four relevant reviews were identified, and these were evaluated with respect to four methodological characteristics: (1) systematic inclusion/exclusion criteria and reproducible methods for search and retrieval of studies; (2) structured evaluation of underlying data quality; (3) systematic assessment of consistency across specific exposure-outcome associations; and (4) evaluation of reporting/publication bias. None of the 74 reviews fully met the criteria for all four methodological characteristics. Only four reviews met two criteria, and six reviews fulfilled only one criterion. Perhaps more importantly, the higher quality reviews were not able to meet all of the criteria owing to the shortcomings of underlying studies, which lacked comparability in terms of specific research question of interest, overall design, exposure assessment, outcome ascertainment, and analytic methods. Thus, even the most thoughtful and rigorous review may be of limited value if the underlying literature includes investigations that address different hypotheses and are beset by methodological inconsistencies and limitations. Issues identified in this review of reviews illustrate considerable challenges that are facing assessments of epidemiological evidence.

New methods for the assessment of Parkinson's disease (2005 to 2015): A systematic review.

PubMed

Sánchez-Ferro, Álvaro; Elshehabi, Morad; Godinho, Catarina; Salkovic, Dina; Hobert, Markus A; Domingos, Josefa; van Uem, Janet Mt; Ferreira, Joaquim J; Maetzler, Walter

2016-09-01

The past decade has witnessed a highly dynamic and growing expansion of novel methods aimed at improving the assessment of Parkinson's disease with technology (NAM-PD) in laboratory, clinical, and home environments. However, the current state of NAM-PD regarding their maturity, feasibility, and usefulness in assessing the main PD features has not been systematically evaluated. A systematic review of articles published in the field from 2005 to 2015 was performed. Of 9,503 publications identified in PubMed and the Web of Science, 848 full papers were evaluated, and 588 original articles were assessed to evaluate the technological, demographic, clinimetric, and technology transfer readiness parameters of NAM-PD. Of the studies, 65% included fewer than 30 patients, < 50% employed a standard methodology to validate diagnostic tests, 8% confirmed their results in a different dataset, and 87% occurred in a clinic or lab. The axial features domain was the most frequently studied, followed by bradykinesia. Rigidity and nonmotor domains were rarely investigated. Only 6% of the systems reached a technology level that justified the hope of being included in clinical assessments in a useful time period. This systematic evaluation provides an overview of the current options for quantitative assessment of PD and what can be expected in the near future. There is a particular need for standardized and collaborative studies to confirm the results of preliminary initiatives, assess domains that are currently underinvestigated, and better validate the existing and upcoming NAM-PD. © 2016 International Parkinson and Movement Disorder Society. © 2016 International Parkinson and Movement Disorder Society.

Acknowledging patient heterogeneity in economic evaluation : a systematic literature review.

PubMed

Grutters, Janneke P C; Sculpher, Mark; Briggs, Andrew H; Severens, Johan L; Candel, Math J; Stahl, James E; De Ruysscher, Dirk; Boer, Albert; Ramaekers, Bram L T; Joore, Manuela A

2013-02-01

Patient heterogeneity is the part of variability that can be explained by certain patient characteristics (e.g. age, disease stage). Population reimbursement decisions that acknowledge patient heterogeneity could potentially save money and increase population health. To date, however, economic evaluations pay only limited attention to patient heterogeneity. The objective of the present paper is to provide a comprehensive overview of the current knowledge regarding patient heterogeneity within economic evaluation of healthcare programmes. A systematic literature review was performed to identify methodological papers on the topic of patient heterogeneity in economic evaluation. Data were obtained using a keyword search of the PubMed database and manual searches. Handbooks were also included. Relevant data were extracted regarding potential sources of patient heterogeneity, in which of the input parameters of an economic evaluation these occur, methods to acknowledge patient heterogeneity and specific concerns associated with this acknowledgement. A total of 20 articles and five handbooks were included. The relevant sources of patient heterogeneity (demographics, preferences and clinical characteristics) and the input parameters where they occurred (baseline risk, treatment effect, health state utility and resource utilization) were combined in a framework. Methods were derived for the design, analysis and presentation phases of an economic evaluation. Concerns related mainly to the danger of false-positive results and equity issues. By systematically reviewing current knowledge regarding patient heterogeneity within economic evaluations of healthcare programmes, we provide guidance for future economic evaluations. Guidance is provided on which sources of patient heterogeneity to consider, how to acknowledge them in economic evaluation and potential concerns. The improved acknowledgement of patient heterogeneity in future economic evaluations may well improve the efficiency of healthcare.

A systematic method for using 3D echocardiography to evaluate tricuspid valve insufficiency in hypoplastic left heart syndrome.

PubMed

Mart, Christopher Robin; Eckhauser, Aaron Wesley; Murri, Michael; Su, Jason Thomas

2014-09-01

With surgical palliation of hypoplastic left heart syndrome (HLHS), the tricuspid valve (TV) becomes the systemic atrioventricular valve and moderate/severe TV insufficiency (TVI), an adverse risk factor for survival to Fontan, has been reported in up to 35% of patients prior to stage I palliation. Precise echocardiographic identification of the mechanism of TVI cannot be determined by two-dimensional echocardiography. Three-dimensional echocardiography (3DE) can provide significant insight into the mechanisms of TVI. It is the intent of this report to propose a systematic method on how to evaluate and display 3DE images of the TV in HLHS which has not been done previously. TV anatomy, function, and the known mechanisms of insufficiency are reviewed. We defined three regions of the TV (anterior, posterior, septal) that can help define valve "leaflets" that incorporates the many variations of TV anatomy. To determine how the surgeon views the TV, a picture of a pathologic specimen of the TV was placed on a computer screen and rotated until it was oriented as it appears during surgery, the "surgeons view." We have proposed a systematic method for evaluating and displaying the TV using 3DE which can provide significant insight into the mechanisms causing TVI in HLHS. This has the potential to improve both the surgical approach to repairing the valve and, ultimately, patient outcomes.

A systematic method for using 3D echocardiography to evaluate tricuspid valve insufficiency in hypoplastic left heart syndrome

PubMed Central

Mart, Christopher Robin; Eckhauser, Aaron Wesley; Murri, Michael; Su, Jason Thomas

2014-01-01

With surgical palliation of hypoplastic left heart syndrome (HLHS), the tricuspid valve (TV) becomes the systemic atrioventricular valve and moderate/severe TV insufficiency (TVI), an adverse risk factor for survival to Fontan, has been reported in up to 35% of patients prior to stage I palliation. Precise echocardiographic identification of the mechanism of TVI cannot be determined by two-dimensional echocardiography. Three-dimensional echocardiography (3DE) can provide significant insight into the mechanisms of TVI. It is the intent of this report to propose a systematic method on how to evaluate and display 3DE images of the TV in HLHS which has not been done previously. TV anatomy, function, and the known mechanisms of insufficiency are reviewed. We defined three regions of the TV (anterior, posterior, septal) that can help define valve “leaflets” that incorporates the many variations of TV anatomy. To determine how the surgeon views the TV, a picture of a pathologic specimen of the TV was placed on a computer screen and rotated until it was oriented as it appears during surgery, the “surgeons view.” We have proposed a systematic method for evaluating and displaying the TV using 3DE which can provide significant insight into the mechanisms causing TVI in HLHS. This has the potential to improve both the surgical approach to repairing the valve and, ultimately, patient outcomes. PMID:25298694

Development and Evaluation of ‘Briefing Notes’ as a Novel Knowledge Translation Tool to Aid the Implementation of Sex/Gender Analysis in Systematic Reviews: A Pilot Study

PubMed Central

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E.; Shea, Beverley; O’Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

Background There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly ‘briefing note’ format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Methods Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Results Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group’s focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Conclusions Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can assist systematic reviewers in ensuring the applicability of research evidence, with the goal of improved health outcomes for diverse populations. PMID:25372876

Economic evidence for the prevention and treatment of atopic eczema: a protocol for a systematic review.

PubMed

Sach, Tracey Helen; McManus, Emma; Mcmonagle, Christopher; Levell, Nick

2016-05-27

Eczema, synonymous with atopic eczema or atopic dermatitis, is a chronic skin disease that has a similar impact on health-related quality of life as other chronic diseases. The proposed research aims to provide a comprehensive systematic assessment of the economic evidence base available to inform economic modelling and decision making on interventions to prevent and treat eczema at any stage of the life course. Whilst the Global Resource of Eczema Trials (GREAT) database collects together the effectiveness evidence for eczema, there is currently no such systematic resource on the economics of eczema. It is important to gain an overview of the current state of the art of economic methods in the field of eczema in order to strengthen the economic evidence base further. The proposed study is a systematic review of the economic evidence surrounding interventions for the prevention and treatment of eczema. Relevant search terms will be used to search MEDLINE, EMBASE, Database of Abstracts of Reviews of Effects, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, National Health Service (NHS) Economic Evaluation Database, Health Technology Assessment, Cumulative Index to Nursing and Allied Health Literature, EconLit, Scopus, Cost-Effectiveness Analysis Registry and Web of Science in order to identify relevant evidence. To be eligible for inclusion studies will be primary empirical studies evaluating the cost, utility or full economic evaluation of interventions for preventing or treating eczema. Two reviewers will independently assess studies for eligibility and perform data abstraction. Evidence tables will be produced presenting details of study characteristics, costing methods, outcome methods and quality assessment. The methodological quality of studies will be assessed using accepted checklists. The systematic review is being undertaken to identify the type of economic evidence available, summarise the results of the available economic evidence and critically appraise the quality of economic evidence currently available to inform future economic modelling and resource allocation decisions about interventions to prevent or treat eczema. We aim to use the review to offer guidance about how to gather economic evidence in studies of eczema and/or what further research is necessary in order to inform this. PROSPERO CRD42015024633.

The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes.

PubMed

Woodruff, Tracey J; Sutton, Patrice

2014-10-01

Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. We sought to develop a proof of concept of the "Navigation Guide," a systematic and transparent method of research synthesis in environmental health. The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of "risk of bias," and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a "moderate" quality rating to human observational studies and combining diverse evidence streams. The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm.

Child maltreatment prevention: a systematic review of reviews

PubMed Central

Butchart, Alexander

2009-01-01

Abstract Objective To synthesize recent evidence from systematic and comprehensive reviews on the effectiveness of universal and selective child maltreatment prevention interventions, evaluate the methodological quality of the reviews and outcome evaluation studies they are based on, and map the geographical distribution of the evidence. Methods A systematic review of reviews was conducted. The quality of the systematic reviews was evaluated with a tool for the assessment of multiple systematic reviews (AMSTAR), and the quality of the outcome evaluations was assessed using indicators of internal validity and of the construct validity of outcome measures. Findings The review focused on seven main types of interventions: home visiting, parent education, child sex abuse prevention, abusive head trauma prevention, multi-component interventions, media-based interventions, and support and mutual aid groups. Four of the seven – home-visiting, parent education, abusive head trauma prevention and multi-component interventions – show promise in preventing actual child maltreatment. Three of them – home visiting, parent education and child sexual abuse prevention – appear effective in reducing risk factors for child maltreatment, although these conclusions are tentative due to the methodological shortcomings of the reviews and outcome evaluation studies they draw on. An analysis of the geographical distribution of the evidence shows that outcome evaluations of child maltreatment prevention interventions are exceedingly rare in low- and middle-income countries and make up only 0.6% of the total evidence base. Conclusion Evidence for the effectiveness of four of the seven main types of interventions for preventing child maltreatment is promising, although it is weakened by methodological problems and paucity of outcome evaluations from low- and middle-income countries. PMID:19551253

Does classroom-based Crew Resource Management training improve patient safety culture? A systematic review

PubMed Central

de Bruijne, Martine C; Zwijnenberg, Nicolien C; Jansma, Elise P; van Dyck, Cathy; Wagner, Cordula

2014-01-01

Aim: To evaluate the evidence of the effectiveness of classroom-based Crew Resource Management training on safety culture by a systematic review of literature. Methods: Studies were identified in PubMed, Cochrane Library, PsycINFO, and Educational Resources Information Center up to 19 December 2012. The Methods Guide for Comparative Effectiveness Reviews was used to assess the risk of bias in the individual studies. Results: In total, 22 manuscripts were included for review. Training settings, study designs, and evaluation methods varied widely. Most studies reporting only a selection of culture dimensions found mainly positive results, whereas studies reporting all safety culture dimensions of the particular survey found mixed results. On average, studies were at moderate risk of bias. Conclusion: Evidence of the effectiveness of Crew Resource Management training in health care on safety culture is scarce and the validity of most studies is limited. The results underline the necessity of more valid study designs, preferably using triangulation methods. PMID:26770720

'Keep fit' exercise interventions to improve health, fitness and well-being of children and young people who use wheelchairs: mixed-method systematic review protocol.

PubMed

O'Brien, Thomas D; Noyes, Jane; Spencer, Llinos Haf; Kubis, Hans-Peter; Hastings, Richard P; Edwards, Rhiannon T; Bray, Nathan; Whitaker, Rhiannon

2014-12-01

This mixed-method systematic review aims to establish the current evidence base for 'keep fit', exercise or physical activity interventions for children and young people who use wheelchairs. Nurses have a vital health promotion, motivational and monitoring role in optimizing the health and well-being of disabled children. Children with mobility impairments are prone to have low participation levels in physical activity, which reduces fitness and well-being. Effective physical activity interventions that are fun and engaging for children are required to promote habitual participation as part of a healthy lifestyle. Previous intervention programmes have been trialled, but little is known about the most effective types of exercise to improve the fitness of young wheelchair users. Mixed-method design using Cochrane systematic processes. Evidence regarding physiological and psychological effectiveness, health economics, user perspectives and service evaluations will be included and analysed under distinct streams. The project was funded from October 2012. Multiple databases will be searched using search strings combining relevant medical subheadings and intervention-specific terms. Articles will also be identified from ancestral references and by approaching authors to identify unpublished work. Only studies or reports evaluating the effectiveness, participation experiences or cost of a physical activity programme will be included. Separate analyses will be performed for each data stream, including a meta-analysis if sufficient homogeneity exists and thematic analyses. Findings across streams will be synthesized in an overarching narrative summary. Evidence from the first systematic review of this type will inform development of effective child-centred physical activity interventions and their evaluation. © 2014 John Wiley & Sons Ltd.

Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: a systematic map.

PubMed

Daigneault, Pierre-Marc

2014-08-01

Stakeholder participation and evaluation use have attracted a lot of attention from practitioners, theorists and researchers. A common hypothesis is that participation is positively associated with evaluation use. Whereas the number of empirical studies conducted on this topic is impressive, quantitative research has held a minority position within this scientific production. This study mobilizes systematic review methods to 'map' the empirical literature that has quantitatively studied participation and use. The goal is to take stock and assess the strength of evidence of this literature (but not to synthesize the findings) and, based on this assessment, to provide directions for future research. Copyright © 2014 Elsevier Ltd. All rights reserved.

Methods to Evaluate the Effects of Internet-Based Digital Health Interventions for Citizens: Systematic Review of Reviews.

PubMed

Zanaboni, Paolo; Ngangue, Patrice; Mbemba, Gisele Irène Claudine; Schopf, Thomas Roger; Bergmo, Trine Strand; Gagnon, Marie-Pierre

2018-06-07

Digital health can empower citizens to manage their health and address health care system problems including poor access, uncoordinated care and increasing costs. Digital health interventions are typically complex interventions. Therefore, evaluations present methodological challenges. The objective of this study was to provide a systematic overview of the methods used to evaluate the effects of internet-based digital health interventions for citizens. Three research questions were addressed to explore methods regarding approaches (study design), effects and indicators. We conducted a systematic review of reviews of the methods used to measure the effects of internet-based digital health interventions for citizens. The protocol was developed a priori according to Preferred Reporting Items for Systematic review and Meta-Analysis Protocols and the Cochrane Collaboration methodology for overviews of reviews. Qualitative, mixed-method, and quantitative reviews published in English or French from January 2010 to October 2016 were included. We searched for published reviews in PubMed, EMBASE, The Cochrane Database of Systematic Reviews, CINHAL and Epistemonikos. We categorized the findings based on a thematic analysis of the reviews structured around study designs, indicators, types of interventions, effects and perspectives. A total of 20 unique reviews were included. The most common digital health interventions for citizens were patient portals and patients' access to electronic health records, covered by 10/20 (50%) and 6/20 (30%) reviews, respectively. Quantitative approaches to study design included observational study (15/20 reviews, 75%), randomized controlled trial (13/20 reviews, 65%), quasi-experimental design (9/20 reviews, 45%), and pre-post studies (6/20 reviews, 30%). Qualitative studies or mixed methods were reported in 13/20 (65%) reviews. Five main categories of effects were identified: (1) health and clinical outcomes, (2) psychological and behavioral outcomes, (3) health care utilization, (4) system adoption and use, and (5) system attributes. Health and clinical outcomes were measured with both general indicators and disease-specific indicators and reported in 11/20 (55%) reviews. Patient-provider communication and patient satisfaction were the most investigated psychological and behavioral outcomes, reported in 13/20 (65%) and 12/20 (60%) reviews, respectively. Evaluation of health care utilization was included in 8/20 (40%) reviews, most of which focused on the economic effects on the health care system. Although observational studies and surveys have provided evidence of benefits and satisfaction for patients, there is still little reliable evidence from randomized controlled trials of improved health outcomes. Future evaluations of digital health interventions for citizens should focus on specific populations or chronic conditions which are more likely to achieve clinically meaningful benefits and use high-quality approaches such as randomized controlled trials. Implementation research methods should also be considered. We identified a wide range of effects and indicators, most of which focused on patients as main end users. Implications for providers and the health system should also be included in evaluations or monitoring of digital health interventions. ©Paolo Zanaboni, Patrice Ngangue, Gisele Irène Claudine Mbemba, Thomas Roger Schopf, Trine Strand Bergmo, Marie-Pierre Gagnon. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 07.06.2018.

Photogrammetry as a tool for the postural evaluation of the spine: A systematic review

PubMed Central

Furlanetto, Tássia Silveira; Sedrez, Juliana Adami; Candotti, Cláudia Tarragô; Loss, Jefferson Fagundes

2016-01-01

AIM: To evaluate the use of photogrammetry and identify the mathematical procedures applied when evaluating spinal posture. METHODS: A systematic search using keywords was conducted in the PubMed, EMBASE, Scopus, Science and Medicine® databases. The following inclusion criteria adopted were: (1) the use of photogrammetry as a method to evaluate spinal posture; (2) evaluations of spinal curvature in the sagittal and/or frontal plane; (3) studies published within the last three decades; and (4) written entirely in English. The exclusion criteria were: (1) studies which objective involved the verification of some aspect of validation of instruments; (2) studies published as abstracts and those published in scientific events; and (3) studies using evaluation of the anteriorization of the head to determine the angular positioning of the cervical spine. The articles in this review were included and evaluated for their methodological quality, based on the Downs and Black scale, by two independent reviewers. RESULTS: Initially, 1758 articles were found, 76 of which were included upon reading the full texts and 29 were included in accordance with the predetermined criteria. In addition, after analyzing the references in those articles, a further six articles were selected, so that 35 articles were included in this review. This systematic review revealed that the photogrammetry has been using in observational studies. Furthermore, it was also found that, although the data collection methodologies are similar across the studies, in relation to aspects of data analysis, the methodologies are very different, especially regarding the mathematical routines employed to support different postural evaluation software. CONCLUSION: With photogrammetry, the aim of the assessment, whether it is for clinical, research or collective health purposes, must be considered when choosing which protocol to use to evaluate spinal posture. PMID:26925386

Searching for qualitative research for inclusion in systematic reviews: a structured methodological review.

PubMed

Booth, Andrew

2016-05-04

Qualitative systematic reviews or qualitative evidence syntheses (QES) are increasingly recognised as a way to enhance the value of systematic reviews (SRs) of clinical trials. They can explain the mechanisms by which interventions, evaluated within trials, might achieve their effect. They can investigate differences in effects between different population groups. They can identify which outcomes are most important to patients, carers, health professionals and other stakeholders. QES can explore the impact of acceptance, feasibility, meaningfulness and implementation-related factors within a real world setting and thus contribute to the design and further refinement of future interventions. To produce valid, reliable and meaningful QES requires systematic identification of relevant qualitative evidence. Although the methodologies of QES, including methods for information retrieval, are well-documented, little empirical evidence exists to inform their conduct and reporting. This structured methodological overview examines papers on searching for qualitative research identified from the Cochrane Qualitative and Implementation Methods Group Methodology Register and from citation searches of 15 key papers. A single reviewer reviewed 1299 references. Papers reporting methodological guidance, use of innovative methodologies or empirical studies of retrieval methods were categorised under eight topical headings: overviews and methodological guidance, sampling, sources, structured questions, search procedures, search strategies and filters, supplementary strategies and standards. This structured overview presents a contemporaneous view of information retrieval for qualitative research and identifies a future research agenda. This review concludes that poor empirical evidence underpins current information practice in information retrieval of qualitative research. A trend towards improved transparency of search methods and further evaluation of key search procedures offers the prospect of rapid development of search methods.

Post-trial follow-up methodology in large randomized controlled trials: a systematic review protocol.

PubMed

Llewellyn-Bennett, Rebecca; Bowman, Louise; Bulbulia, Richard

2016-12-15

Clinical trials typically have a relatively short follow-up period, and may both underestimate potential benefits of treatments investigated, and fail to detect hazards, which can take much longer to emerge. Prolonged follow-up of trial participants after the end of the scheduled trial period can provide important information on both efficacy and safety outcomes. This protocol describes a systematic review to qualitatively compare methods of post-trial follow-up used in large randomized controlled trials. A systematic search of electronic databases and clinical trial registries will use a predefined search strategy. All large (more than 1000 adult participants) randomized controlled trials will be evaluated. Two reviewers will screen and extract data according to this protocol with the aim of 95% concordance of papers checked and discrepancies will be resolved by a third reviewer. Trial methods, participant retention rates and prevalence of missing data will be recorded and compared. The potential for bias will be evaluated using the Cochrane Risk of Bias tool (applied to the methods used during the in-trial period) with the aim of investigating whether the quality of the post-trial follow-up methodology might be predicted by the quality of the methods used for the original trial. Post-trial follow-up can provide valuable information about the long-term benefits and hazards of medical interventions. However, it can be logistically challenging and costly. The aim of this systematic review is to describe how trial participants have been followed-up post-trial in order to inform future post-trial follow-up designs. Not applicable for PROSPERO registration.

Measuring organizational and individual factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2012-01-01

Background Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. Study selection: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited. Conclusions Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice. PMID:23241168

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews.

PubMed

Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin; Noyes, Jane

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Research on Sustainable Development Level Evaluation of Resource-based Cities Based on Shapely Entropy and Chouqet Integral

NASA Astrophysics Data System (ADS)

Zhao, Hui; Qu, Weilu; Qiu, Weiting

2018-03-01

In order to evaluate sustainable development level of resource-based cities, an evaluation method with Shapely entropy and Choquet integral is proposed. First of all, a systematic index system is constructed, the importance of each attribute is calculated based on the maximum Shapely entropy principle, and then the Choquet integral is introduced to calculate the comprehensive evaluation value of each city from the bottom up, finally apply this method to 10 typical resource-based cities in China. The empirical results show that the evaluation method is scientific and reasonable, which provides theoretical support for the sustainable development path and reform direction of resource-based cities.

Standardizing the evaluation criteria on treatment outcomes of mandibular implant overdentures: a systematic review

PubMed Central

Kim, Ha-Young; Shin, Sang-Wan

2014-01-01

PURPOSE The aim of this review was to analyze the evaluation criteria on mandibular implant overdentures through a systematic review and suggest standardized evaluation criteria. MATERIALS AND METHODS A systematic literature search was conducted by PubMed search strategy and hand-searching of relevant journals from included studies considering inclusion and exclusion criteria. Randomized clinical trials (RCT) and clinical trial studies comparing attachment systems on mandibular implant overdentures until December, 2011 were selected. Twenty nine studies were finally selected and the data about evaluation methods were collected. RESULTS Evaluation criteria could be classified into 4 groups (implant survival, peri-implant tissue evaluation, prosthetic evaluation, and patient satisfaction). Among 29 studies, 21 studies presented implant survival rate, while any studies reporting implant failure did not present cumulative implant survival rate. Seventeen studies evaluating peri-implant tissue status presented following items as evaluation criteria; marginal bone level (14), plaque Index (13), probing depth (8), bleeding index (8), attachment gingiva level (8), gingival index (6), amount of keratinized gingiva (1). Eighteen studies evaluating prosthetic maintenance and complication also presented following items as evaluation criteria; loose matrix (17), female detachment (15), denture fracture (15), denture relining (14), abutment fracture (14), abutment screw loosening (11), and occlusal adjustment (9). Atypical questionnaire (9), Visual analog scales (VAS) (4), and Oral Health Impact Profile (OHIP) (1) were used as the format of criteria to evaluate patients satisfaction in 14 studies. CONCLUSION For evaluation of implant overdenture, it is necessary to include cumulative survival rate for implant evaluation. It is suggested that peri-implant tissue evaluation criteria include marginal bone level, plaque index, bleeding index, probing depth, and attached gingiva level. It is also suggested that prosthetic evaluation criteria include loose matrix, female detachment, denture fracture, denture relining, abutment fracture, abutment screw loosening, and occlusal adjustment. Finally standardized criteria like OHIP-EDENT or VAS are required for patient satisfaction. PMID:25352954

Systematic iteration between model and methodology: A proposed approach to evaluating unintended consequences.

PubMed

Morell, Jonathan A

2018-06-01

This article argues that evaluators could better deal with unintended consequences if they improved their methods of systematically and methodically combining empirical data collection and model building over the life cycle of an evaluation. This process would be helpful because it can increase the timespan from when the need for a change in methodology is first suspected to the time when the new element of the methodology is operational. The article begins with an explanation of why logic models are so important in evaluation, and why the utility of models is limited if they are not continually revised based on empirical evaluation data. It sets the argument within the larger context of the value and limitations of models in the scientific enterprise. Following will be a discussion of various issues that are relevant to model development and revision. What is the relevance of complex system behavior for understanding predictable and unpredictable unintended consequences, and the methods needed to deal with them? How might understanding of unintended consequences be improved with an appreciation of generic patterns of change that are independent of any particular program or change effort? What are the social and organizational dynamics that make it rational and adaptive to design programs around single-outcome solutions to multi-dimensional problems? How does cognitive bias affect our ability to identify likely program outcomes? Why is it hard to discern change as a result of programs being embedded in multi-component, continually fluctuating, settings? The last part of the paper outlines a process for actualizing systematic iteration between model and methodology, and concludes with a set of research questions that speak to how the model/data process can be made efficient and effective. Copyright © 2017 Elsevier Ltd. All rights reserved.

Simulations using patient data to evaluate systematic errors that may occur in 4D treatment planning: a proof of concept study.

PubMed

St James, Sara; Seco, Joao; Mishra, Pankaj; Lewis, John H

2013-09-01

The purpose of this work is to present a framework to evaluate the accuracy of four-dimensional treatment planning in external beam radiation therapy using measured patient data and digital phantoms. To accomplish this, 4D digital phantoms of two model patients were created using measured patient lung tumor positions. These phantoms were used to simulate a four-dimensional computed tomography image set, which in turn was used to create a 4D Monte Carlo (4DMC) treatment plan. The 4DMC plan was evaluated by simulating the delivery of the treatment plan over approximately 5 min of tumor motion measured from the same patient on a different day. Unique phantoms accounting for the patient position (tumor position and thorax position) at 2 s intervals were used to represent the model patients on the day of treatment delivery and the delivered dose to the tumor was determined using Monte Carlo simulations. For Patient 1, the tumor was adequately covered with 95.2% of the tumor receiving the prescribed dose. For Patient 2, the tumor was not adequately covered and only 74.3% of the tumor received the prescribed dose. This study presents a framework to evaluate 4D treatment planning methods and demonstrates a potential limitation of 4D treatment planning methods. When systematic errors are present, including when the imaging study used for treatment planning does not represent all potential tumor locations during therapy, the treatment planning methods may not adequately predict the dose to the tumor. This is the first example of a simulation study based on patient tumor trajectories where systematic errors that occur due to an inaccurate estimate of tumor motion are evaluated.

[Identification of the authentic quality of Longdanxiegan pill by systematic quantified fingerprint method based on three wavelength fusion chromatogram].

PubMed

Sun, Guoxiang; Zhang, Jingxian

2009-05-01

The three wavelength fusion high performance liquid chromatographic fingerprin (TWFFP) of Longdanxiegan pill (LDXGP) was established to identify the quality of LDXGP by the systematic quantified fingerprint method. The chromatographic fingerprints (CFPs) of the 12 batches of LDXGP were determined by reversed-phase high performance liquid chromatography. The technique of multi-wavelength fusion fingerprint was applied during processing the fingerprints. The TWFFPs containing 63 co-possessing peaks were obtained when choosing baicalin peak as the referential peak. The 12 batches of LDXGP were identified with hierarchical clustering analysis by using macro qualitative similarity (S(m)) as the variable. According to the results of classification, the referential fingerprint (RFP) was synthesized from 10 batches of LDXGP. Taking the RFP for the qualified model, all the 12 batches of LDXGP were evaluated by the systematic quantified fingerprint method. Among the 12 batches of LDXGP, 9 batches were completely qualified, the contents of 1 batch were obviously higher while the chemical constituents quantity and distributed proportion in 2 batches were not qualified. The systematic quantified fingerprint method based on the technique of multi-wavelength fusion fingerprint ca effectively identify the authentic quality of traditional Chinese medicine.

Early economic evaluation of emerging health technologies: protocol of a systematic review

PubMed Central

2014-01-01

Background The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. Methods/design This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status. Discussion This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives. PMID:25055987

Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments.

PubMed

Vessey, Judith; Strout, Tania D; DiFazio, Rachel L; Walker, Allison

2014-12-01

Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified psychometric papers evaluating youth bullying measures. A systematic review of the literature was conducted using 4 electronic databases. Data extraction and appraisal of identified instruments were completed using a standardized method and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Thirty-one articles describing 27 self-report instruments were evaluated in our analysis. Quality assessments ranged from 18% to 91%, with 6 papers reaching or exceeding a quality score of 75%. Limited evidence supporting the reliability, validity, and responsiveness of existing youth bullying measures was identified. Evidence supporting the psychometric soundness of the instruments identified was limited. Many measures were in early development and additional evaluation is necessary to validate their psychometric properties. A pool of instruments possesses acceptable initial psychometric dependability for selected assessment purposes. These findings have significant implications for assessing youth bullying and designing and evaluating school-based interventions. © 2014, American School Health Association.

Qualitative Collection Analysis: The Conspectus Methodology. SPEC Kit 151.

ERIC Educational Resources Information Center

Jakubs, Deborah

The introduction to this Systems and Procedures Exchange Center (SPEC) kit explains the Conspectus method, which was developed in 1980 by the Research Libraries Group (RLG) as a means of systematically and qualitatively evaluating large library collections. The discussion considers advantages and disadvantages of this tool, which evaluates past…

Truancy Interventions: A Review of the Research Literature

ERIC Educational Resources Information Center

Sutphen, Richard D.; Ford, Janet P.; Flaherty, Chris

2010-01-01

Objectives: This article presents a systematic review of the literature on evaluative studies of truancy interventions. Method: Included studies evaluating truancy interventions appearing in peer-reviewed academic journals from 1990 to 2007. Findings: In total, 16 studies were assessed. Eight studies used group comparison designs and eight studies…

Evaluating Presentation Skills of Volunteer Trainers.

ERIC Educational Resources Information Center

Mohan, Donna K.

A systematic method for evaluating the presentation skills of volunteer trainers would enable the discovery of hidden problems. It would also increase individual trainer skills and satisfaction and improve the overall effectiveness of the training program. A first step is to determine the general presentation skills a successful volunteer trainer…

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review

PubMed Central

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; De Marchi, Ana Carolina Bertoletti

2016-01-01

Background Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. Objective This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. Methods The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. Results In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user’s age and limitations. Conclusions Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence. PMID:27702737

The Navigation Guide Systematic Review Methodology: A Rigorous and Transparent Method for Translating Environmental Health Science into Better Health Outcomes

PubMed Central

Sutton, Patrice

2014-01-01

Background: Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. Objectives: We sought to develop a proof of concept of the “Navigation Guide,” a systematic and transparent method of research synthesis in environmental health. Discussion: The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of “risk of bias,” and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a “moderate” quality rating to human observational studies and combining diverse evidence streams. Conclusions: The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm. Citation: Woodruff TJ, Sutton P. 2014. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122:1007–1014; http://dx.doi.org/10.1289/ehp.1307175 PMID:24968373

What is the quality of economic evaluations of non-drug therapies? A systematic review and critical appraisal of economic evaluations of radiotherapy for cancer.

PubMed

Barbieri, M; Weatherly, H L A; Ara, R; Basarir, H; Sculpher, M; Adams, R; Ahmed, H; Coles, C; Guerrero-Urbano, T; Nutting, C; Powell, M

2014-10-01

Breast, cervical and colorectal cancers are the three most frequent cancers in women, while lung, prostate and colorectal cancers are the most frequent in men. Much attention has been given to the economic evaluation of pharmaceuticals for treatment of cancer by the National Institute for Health and Care Excellence (NICE) in the UK and similar authorities internationally, while economic analysis developed for other types of anti-cancer interventions, including radiotherapy and surgery, are less common. Our objective was to review methods used in published cost-effectiveness studies evaluating radiotherapy for breast, cervical, colorectal, head and neck and prostate cancer, and to compare the economic evaluation methods applied with those defined in the guidelines used by the NICE technology appraisal programme. A systematic search of seven databases (MEDLINE, EMBASE, CDSR, NHSEED, HTA, DARE, EconLit) as well as research registers, the NICE website and conference proceedings was conducted in July 2012. Only economic evaluations of radiotherapy interventions in individuals diagnosed with cancer that included quality-adjusted life-years (QALYs) or life-years (LYs) were included. Included studies were appraised on the basis of satisfying essential, preferred and UK-specific methods requirements, building on the NICE Reference Case for economic evaluations and on other methods guidelines. A total of 29 studies satisfied the inclusion criteria (breast 14, colorectal 2, prostate 10, cervical 0, head and neck 3). Only two studies were conducted in the UK (13 in the USA). Among essential methods criteria, the main issue was that only three (10%) of the studies used clinical-effectiveness estimates identified through systematic review of the literature. Similarly, only eight (28%) studies sourced health-related quality-of-life data directly from patients with the condition of interest. Other essential criteria (e.g. clear description of comparators, patient group indication and appropriate time horizon) were generally fulfilled, while most of the UK-specific requirements were not met. Based on this review there is a dearth of up-to-date, robust evidence on the cost effectiveness of radiotherapy in cancer suitable to support decision making in the UK. Studies selected did not fully satisfy essential method standards currently recommended by NICE.

Supporting adherence and healthy lifestyles in leg ulcer patients: systematic development of the Lively Legs program for dermatology outpatient clinics.

PubMed

Heinen, Maud M; Bartholomew, L Kay; Wensing, Michel; van de Kerkhof, Peter; van Achterberg, Theo

2006-05-01

The objective of our project was to develop a lifestyle program for leg ulcer patients at outpatient clinics for dermatology. We used the intervention-mapping (IM) framework for systematically developing theory and evidence based health promotion programs. We started with a needs-assessment. A multidisciplinary project group of health care workers and patients was involved in all five IM steps; formulating proximal program objectives, selecting methods and strategies, producing program components, planning for adoption and implementation and planning for evaluation. Several systematic literature reviews and original studies were performed to support this process. Social Cognitive Theory was selected as the main theory behind the program 'Lively Legs' and was combined with elements of Goal-Setting Theory, the precaution adoption model and motivational interviewing. The program is conducted through health counseling by dermatology nurses and was successfully pre-tested. Also, an implementation and evaluation plan were made. Intervention mapping helped us to succeed in developing a lifestyle program with clear goals and methods, operational strategies and materials and clear procedures. Coaching leg ulcer patients towards adherence with compression therapy and healthy lifestyles should be taken on without delay. Systematic development of lifestyle programs for other patient groups should be encouraged.

Systematic review of non-surgical therapies for osteoarthritis of the hand: an update.

PubMed

Lue, S; Koppikar, S; Shaikh, K; Mahendira, D; Towheed, T E

2017-09-01

To update our earlier systematic reviews which evaluated all published randomized controlled trials (RCTs) evaluating pharmacological and non-pharmacological therapies in patients with hand osteoarthritis (OA). Surgical therapies were not evaluated. RCTs published between March 2008 and December 2015 were added to the previous systematic reviews. A total of 95 RCTs evaluating various pharmacological and non-pharmacological therapies in hand OA were analyzed in this update. Generally, the methodological quality of these RCTs has improved since the last update, with more studies describing their methods for randomization, blinding, and allocation concealment. However, RCTs continue to be weakened by a lack of consistent case definition and a lack of standardized outcome assessments specific to hand OA. The number and location of evaluated hand joints continues to be underreported, and only 25% of RCTs adequately described the method used to ensure allocation concealment. These remain major weaknesses of published RCTs. A meta-analysis could not be performed because of marked study heterogeneity, insufficient statistical data available in the published RCTs, and a small number of identical comparators. Hand OA is a complex area in which to study the efficacy of therapies. There has been an improvement in the overall design and conduct of RCTs, however, additional large RCTs with a more robust methodological approach specific to hand OA are needed in order to make clinically relevant conclusions about the efficacy of the diverse treatment options available. Copyright © 2017 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Management of Ready-to-Use Parenteral Nutrition in Newborns: Systematic Review.

PubMed

Mena, Karen Daniela Romero; Espitia, Olga Lucia Pinzón; Vergara, José Alejandro Daza

2018-04-27

Parenteral support has increased the possibility of neonatal recovery. However, complications associated with its use have been documented. One commercial method developed to decrease the complications of this type of support is the ready-to-use parenteral nutrition (PN), a 3-chamber bag that provides a complete nutrient mix. This systematic review seeks, through the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology, to establish the benefits in newborns. Seven databases and gray literature were used. The search was limited to publications from 2007-2017 and to articles written in English, Spanish, and Portuguese. Articles that did not meet the inclusion criteria and studies with low quality evaluated with the Scottish Intercollegiate Guidelines Network guidelines, which were without information about the study or analytical methods, were excluded. A total of 24,193 articles were obtained, which were initially evaluated by title and abstract according to the inclusion criteria. A total of 24,167 articles were discarded, obtaining 27 eligible for follow-up evaluation. After a detailed evaluation of the full text, 13 articles were selected. It was found that ready-to-use PN has the potential benefit to reduce the risks for infections, provide an adequate supply of nutrients, generate growth within the expected range, provide ease of use, decrease prescription errors, and potentially reduce costs. It is necessary to evaluate the short- and long-term impact of its use. © 2018 American Society for Parenteral and Enteral Nutrition.

Evaluating the effectiveness of clinical medical librarian programs: a systematic review of the literature*

PubMed Central

Wagner, Kay Cimpl; Byrd, Gary D.

2004-01-01

Objective: This study was undertaken to determine if a systematic review of the evidence from thirty years of literature evaluating clinical medical librarian (CML) programs could help clarify the effectiveness of this outreach service model. Methods: A descriptive review of the CML literature describes the general characteristics of these services as they have been implemented, primarily in teaching-hospital settings. Comprehensive searches for CML studies using quantitative or qualitative evaluation methods were conducted in the medical, allied health, librarianship, and social sciences literature. Findings: Thirty-five studies published between 1974 and 2001 met the review criteria. Most (30) evaluated single, active programs and used descriptive research methods (e.g., use statistics or surveys/questionnaires). A weighted average of 89% of users in twelve studies found CML services useful and of high quality, and 65% of users in another overlapping, but not identical, twelve studies said these services contributed to improved patient care. Conclusions: The total amount of research evidence for CML program effectiveness is not great and most of it is descriptive rather than comparative or analytically qualitative. Standards are needed to consistently evaluate CML or informationist programs in the future. A carefully structured multiprogram study including three to five of the best current programs is needed to define the true value of these services. PMID:14762460

120: THE CLINICAL EFFECTIVENESS AND COST-EFFECTIVENESS OF FRACTIONAL CO2 LASER IN ACNE SCARS AND SKIN REJUVENATION: A SYSTEMATIC REVIEW AND ECONOMIC EVALUATION

PubMed Central

Yaaghoobian, Barmak; Sadeghi-Ghyassi, Fatemeh; Hajebrahimi, Sakineh

2017-01-01

Background and aims Skin rejuvenation is one of high demand cosmetic interventions in Iran. Fractional CO2 Laser is a high power ablative laser which has variety of utilization in medicine including treatment of acne scars and rejuvenation. The aim of this study was to evaluate the safety, efficacy, and cost-effectiveness of Fractional CO2 Laser in comparison with other methods of rejuvenation and acne scar treatment. Methods A systematic database search including Medline (via OVID and PubMed), EMBASE, CINHAL, Cochrane Library, CRD, SCOPUS and Web of Science conducted. After screening search results, selected publications appraised by CASP and Cochrane Collaboration's tool for assessing risk of bias and eligible studies included in the systematic review. In economic evaluation, all costs and benefits analyzed from Iran ministry of health's perspective. Results From 2667 publications, two randomized control trials were eligible and included in the study. The affectivity and complications of Fractional CO2 laser were comparable with Er: YAG but Fractional CO2 laser was 14.7% (P=0.01) more effective than Q-Switched ND: YAG laser. Cost affectivity of this method was the same as other alternative lasers. Conclusions Fractional CO2 laser is an effective and safe method for curing several kinds of skin. Never the less there was not sufficient evidence to support its advantage. This device has equal or lower price in comparison to competent technologies except for the non- fractional ablative Co2 laser that has the same or lower price and comparable effects.

Amateur boxing and risk of chronic traumatic brain injury: systematic review of observational studies

PubMed Central

Knowles, Charles H; Whyte, Greg P

2007-01-01

Objective To evaluate the risk of chronic traumatic brain injury from amateur boxing. Setting Secondary research performed by combination of sport physicians and clinical academics. Design, data sources, and methods Systematic review of observational studies in which chronic traumatic brain injury was defined as any abnormality on clinical neurological examination, psychometric testing, neuroimaging studies, and electroencephalography. Studies were identified through database (1950 to date) and bibliographic searches without language restrictions. Two reviewers extracted study characteristics, quality, and data, with adherence to a protocol developed from a widely recommended method for systematic review of observational studies (MOOSE). Results 36 papers had relevant extractable data (from a detailed evaluation of 93 studies of 943 identified from the initial search). Quality of evidence was generally poor. The best quality studies were those with a cohort design and those that used psychometric tests. These yielded the most negative results: only four of 17 (24%) better quality studies found any indication of chronic traumatic brain injury in a minority of boxers studied. Conclusion There is no strong evidence to associate chronic traumatic brain injury with amateur boxing. PMID:17916811

Amateur boxing and risk of chronic traumatic brain injury: systematic review of observational studies.

PubMed

Loosemore, Mike; Knowles, Charles H; Whyte, Greg P

2007-10-20

To evaluate the risk of chronic traumatic brain injury from amateur boxing. Secondary research performed by combination of sport physicians and clinical academics. DESIGN, DATA SOURCES, AND METHODS: Systematic review of observational studies in which chronic traumatic brain injury was defined as any abnormality on clinical neurological examination, psychometric testing, neuroimaging studies, and electroencephalography. Studies were identified through database (1950 to date) and bibliographic searches without language restrictions. Two reviewers extracted study characteristics, quality, and data, with adherence to a protocol developed from a widely recommended method for systematic review of observational studies (MOOSE). 36 papers had relevant extractable data (from a detailed evaluation of 93 studies of 943 identified from the initial search). Quality of evidence was generally poor. The best quality studies were those with a cohort design and those that used psychometric tests. These yielded the most negative results: only four of 17 (24%) better quality studies found any indication of chronic traumatic brain injury in a minority of boxers studied. There is no strong evidence to associate chronic traumatic brain injury with amateur boxing.

Indices for the assessment of nutritional quality of meals: a systematic review.

PubMed

Gorgulho, B M; Pot, G K; Sarti, F M; Marchioni, D M

2016-06-01

This systematic review aimed to synthesise information on indices developed to evaluate nutritional quality of meals. A strategy for systematic search of the literature was developed using keywords related to assessment of meal quality. Databases searched included ScienceDirect, PubMed, Lilacs, SciELO, Scopus, Cochrane, Embase and Google Scholar. The literature search resulted in seven different meal quality indices. Each article was analysed in order to identify the following items: authors, country, year, study design, population characteristics, type of meal evaluated, dietary assessment method, characteristics evaluated (nutrients or food items), score range, index components, nutritional references, correlations performed, validation and relationship with an outcome (if existing). Two studies developed instruments to assess the quality of breakfast, three analysed lunch, one evaluated dinner and one was applied to all types of meals and snacks. All meal quality indices reviewed were based on the evaluation of presence or absence of food groups and relative contributions of nutrients, according to food-based guidelines or nutrient references, adapting the daily dietary recommendations to one specific meal. Most of the indices included three items as components for meal quality assessment: (I) total fat or some specific type of fat, (II) fruits and vegetables and (III) cereals or whole grains. This systematic review indicates aspects that need further research, particularly the numerous approaches to assessing meals considering different foods and nutrients, and the need for validation studies of meal indices.

The application of knowledge synthesis methods in agri-food public health: recent advancements, challenges and opportunities.

PubMed

Young, Ian; Waddell, Lisa; Sanchez, Javier; Wilhelm, Barbara; McEwen, Scott A; Rajić, Andrijana

2014-03-01

Knowledge synthesis refers to the integration of findings from individual research studies on a given topic or question into the global knowledge base. The application of knowledge synthesis methods, particularly systematic reviews and meta-analysis, has increased considerably in the agri-food public health sector over the past decade and this trend is expected to continue. The objectives of our review were: (1) to describe the most promising knowledge synthesis methods and their applicability in agri-food public health, and (2) to summarize the recent advancements, challenges, and opportunities in the use of systematic review and meta-analysis methods in this sector. We performed a structured review of knowledge synthesis literature from various disciplines to address the first objective, and used comprehensive insights and experiences in applying these methods in the agri-food public health sector to inform the second objective. We describe five knowledge synthesis methods that can be used to address various agri-food public health questions or topics under different conditions and contexts. Scoping reviews describe the main characteristics and knowledge gaps in a broad research field and can be used to evaluate opportunities for prioritizing focused questions for related systematic reviews. Structured rapid reviews are streamlined systematic reviews conducted within a short timeframe to inform urgent decision-making. Mixed-method and qualitative reviews synthesize diverse sources of contextual knowledge (e.g. socio-cognitive, economic, and feasibility considerations). Systematic reviews are a structured and transparent method used to summarize and synthesize literature on a clearly-defined question, and meta-analysis is the statistical combination of data from multiple individual studies. We briefly describe and discuss key advancements in the use of systematic reviews and meta-analysis, including: risk-of-bias assessments; an overall quality-of-evidence approach; engagement of stakeholders; Bayesian, multivariate, and network meta-analysis; and synthesis of diagnostic test accuracy studies. We also highlight several challenges and opportunities in the conduct of systematic reviews (e.g. inclusion of grey literature, minimizing language bias, and optimizing search strategies) and meta-analysis (e.g. inclusion of observational studies and approaches to address the insufficient reporting of data and significant heterogeneity). Many of these developments have yet to be comprehensively applied and evaluated in an agri-food public health context, and more research is needed in this area. There is a need to strengthen knowledge synthesis capacity and infrastructure at the regional, national, and international levels in this sector to ensure that the best available knowledge is used to inform future decision-making about agri-food public health issues. Crown Copyright © 2013. Published by Elsevier B.V. All rights reserved.

Economic evaluations on centralisation of specialised healthcare services: a systematic review of methods

PubMed Central

Bhattarai, Nawaraj; McMeekin, Peter; Price, Christopher; Vale, Luke

2016-01-01

Objective To systematically review and appraise the quality of economic evaluations assessing centralisation of specialised healthcare services. Methods A systematic review to identify economic evaluations on centralisation of any specialised healthcare service. Full economic evaluations comparing costs and consequences of centralisation of any specialised healthcare service were eligible for inclusion. Methodological characteristics of included studies were appraised using checklists adapted from recommended guidelines. Results A total of 64 full-text articles met the inclusion criteria. Two studies were conducted in the UK. Most of the studies used volume of activity as a proxy measure of centralisation. The methods used to assess centralisation were heterogeneous. Studies differed in terms of study design used and aspect of centralisation they considered. There were major limitations in studies. Only 12 studies reported the study perspective. Charges which are not true representation of costs were used by 17 studies to assess cost outcomes. Only 10 reported the detailed breakdown of the cost components used in their analysis. Discounting was necessary in 14 studies but was reported only in 7 studies. Sensitivity analyses were included by less than one-third of the studies. The applicability of the identified studies to a setting other than the one they were conducted in is questionable, given variations in the organisation of services and healthcare costs. Centralisation as a concept has also been variably and narrowly defined as activity of specific services which may not reflect the wider aspects of centralisation. Conclusions Confounded and biased information coming from studies without standardised methods may mislead decision-makers towards making wrong decisions on centralisation. It is important to improve the methodology and reporting of economic evaluations in order to provide more robust and transferable evidence. Wider aspects of healthcare centralisation should be considered in the estimates of costs and health outcomes. PMID:27154484

Cervical spondylotic myelopathy: methodological approaches to evaluate the literature and establish best evidence.

PubMed

Skelly, Andrea C; Hashimoto, Robin E; Norvell, Daniel C; Dettori, Joseph R; Fischer, Dena J; Wilson, Jefferson R; Tetreault, Lindsay A; Fehlings, Michael G

2013-10-15

Review of methods. To provide a detailed description of the methods undertaken in the articles in this focus issue pertaining to cervical spondylotic myelopathy (CSM) and ossification of the posterior longitudinal ligament (OPLL) and to describe the process used to develop summary statements and clinical recommendations regarding factors associated with the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. We present methods used in conducting the systematic, evidence-based reviews and development of expert panel summary statements and clinical recommendations of the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. Our intent is that clinicians will combine the information from these systematic reviews, narrative reviews, and primary research studies with an understanding of their own capacities and experience to better manage patients with CSM or OPLL and consider future research for the diagnosis and treatment of these diseases. For the systematic reviews, which make up the bulk of the studies in this focus issue, a systematic search and critical review of the English language literature was undertaken for articles published on the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. Articles were screened for relevance using a priori criteria and relevant articles were critically reviewed. Whether an article was included for review depended on whether the study question was descriptive, one of therapy, or one of prognosis. The strength of evidence for the overall body of literature in each topic area was determined by 2 independent reviewers considering risk of bias, consistency, directness, and precision of results using a modification of the Grading of Recommendation Assessment, Development and Evaluation criteria. Disagreements were resolved by consensus. Findings from articles meeting inclusion criteria were summarized. From these summaries, summary statements or clinical recommendations were formulated among subject experts through a modified Delphi process using the Grading of Recommendation Assessment, Development and Evaluation approach. Methods for the 2 primary research studies and the narrative reviews are also reviewed. Because of the nature of questions that needed to be addressed, not all studies in this focus issue were amenable to systematic review. As a result, this focus issue consists of several different article types, including 1 research protocol, 2 primary research studies, 2 narrative literature reviews, 7 systematic reviews, and 3 articles that combine a systematic review component with either a narrative section (n = 2) or a provider survey (n = 1). In general, the strength of evidence ratings ranged from insufficient to moderate. Summary statements or clinical recommendations were made according to available evidence and study type: 16 summary statements were made across 8 articles, and 17 clinical recommendations were made across 9 articles. Three articles had both summary statements and clinical recommendations, 5 had summary statements only, 6 had clinical recommendations only, and 1 (the research protocol) was not amenable to either. Systematic reviews, narrative reviews, and primary research studies were undertaken to understand the mechanisms, diagnosis, progression, and treatment of CSM and OPLL and to provide summary statements and clinical recommendations. This article reports the methods used in the studies in this focus issue. SUMMARY STATEMENTS: The objectives of this focus issue were met using a variety of article and study designs, each of which has some unique methodological aspects associated with it. The reader should refer to the full article in this issue for additional details specific to that topic. The methods for systematic review follow accepted standards for rigor and, together with the application of Grading of Recommendation Assessment, Development and Evaluation, are intended to allow for transparency in the process for creating the clinical recommendation.

Assessing Clinical Significance: Does it Matter which Method we Use?

ERIC Educational Resources Information Center

Atkins, David C.; Bedics, Jamie D.; Mcglinchey, Joseph B.; Beauchaine, Theodore P.

2005-01-01

Measures of clinical significance are frequently used to evaluate client change during therapy. Several alternatives to the original method devised by N. S. Jacobson, W. C. Follette, & D. Revenstorf (1984) have been proposed, each purporting to increase accuracy. However, researchers have had little systematic guidance in choosing among…

How does feedback from patients impact upon healthcare student clinical skill development and learning? A systematic review.

PubMed

Finch, Emma; Lethlean, Jennifer; Rose, Tanya; Fleming, Jennifer; Theodoros, Deborah; Cameron, Ashley; Coleman, Adele; Copland, David; McPhail, Steven M

2018-03-01

A key feature of health professionals' training, irrespective of discipline, is the acquisition and application of clinical and communication skills. Despite this, little is known about the potential role of patient feedback on this process. This systematic review aimed to answer the question: How does feedback from patients impact upon healthcare student clinical skill development and learning? Systematic review of published literature. Electronic databases were searched for studies that explored the effects of patient feedback on student learning and were published before March 2016. Eligible articles underwent methodological evaluation using the McMaster University Critical Evaluation Forms and data extraction. A total of 237 articles were retrieved following searches of electronic databases and hand searches of reference lists. Twelve (7 quantitative, 2 qualitative, 3 mixed methods) studies met the inclusion criteria. Eleven studies reported that patient feedback improved students' clinical skills. Minimal research has explored the impact of patient feedback on student learning. The research to date suggests that direct feedback from patients may be beneficial for the development of students' communication and clinical skills; however, the wide variety of evaluation methods and the lack of validated tools for patients to provide feedback suggest that further exploration is warranted.

Efficiency of polymerization of bulk-fill composite resins: a systematic review.

PubMed

Reis, André Figueiredo; Vestphal, Mariana; Amaral, Roberto Cesar do; Rodrigues, José Augusto; Roulet, Jean-François; Roscoe, Marina Guimarães

2017-08-28

This systematic review assessed the literature to evaluate the efficiency of polymerization of bulk-fill composite resins at 4 mm restoration depth. PubMed, Cochrane, Scopus and Web of Science databases were searched with no restrictions on year, publication status, or article's language. Selection criteria included studies that evaluated bulk-fill composite resin when inserted in a minimum thickness of 4 mm, followed by curing according to the manufacturers' instructions; presented sound statistical data; and comparison with a control group and/or a reference measurement of quality of polymerization. The evidence level was evaluated by qualitative scoring system and classified as high-, moderate- and low- evidence level. A total of 534 articles were retrieved in the initial search. After the review process, only 10 full-text articles met the inclusion criteria. Most articles included (80%) were classified as high evidence level. Among several techniques, microhardness was the most frequently method performed by the studies included in this systematic review. Irrespective to the "in vitro" method performed, bulk fill RBCs were partially likely to fulfill the important requirement regarding properly curing in 4 mm of cavity depth measured by depth of cure and / or degree of conversion. In general, low viscosities BFCs performed better regarding polymerization efficiency compared to the high viscosities BFCs.

Methodologic quality of meta-analyses and systematic reviews on the Mediterranean diet and cardiovascular disease outcomes: a review.

PubMed

Huedo-Medina, Tania B; Garcia, Marissa; Bihuniak, Jessica D; Kenny, Anne; Kerstetter, Jane

2016-03-01

Several systematic reviews/meta-analyses published within the past 10 y have examined the associations of Mediterranean-style diets (MedSDs) on cardiovascular disease (CVD) risk. However, these reviews have not been evaluated for satisfying contemporary methodologic quality standards. This study evaluated the quality of recent systematic reviews/meta-analyses on MedSD and CVD risk outcomes by using an established methodologic quality scale. The relation between review quality and impact per publication value of the journal in which the article had been published was also evaluated. To assess compliance with current standards, we applied a modified version of the Assessment of Multiple Systematic Reviews (AMSTARMedSD) quality scale to systematic reviews/meta-analyses retrieved from electronic databases that had met our selection criteria: 1) used systematic or meta-analytic procedures to review the literature, 2) examined MedSD trials, and 3) had MedSD interventions independently or combined with other interventions. Reviews completely satisfied from 8% to 75% of the AMSTARMedSD items (mean ± SD: 31.2% ± 19.4%), with those published in higher-impact journals having greater quality scores. At a minimum, 60% of the 24 reviews did not disclose full search details or apply appropriate statistical methods to combine study findings. Only 5 of the reviews included participant or study characteristics in their analyses, and none evaluated MedSD diet characteristics. These data suggest that current meta-analyses/systematic reviews evaluating the effect of MedSD on CVD risk do not fully comply with contemporary methodologic quality standards. As a result, there are more research questions to answer to enhance our understanding of how MedSD affects CVD risk or how these effects may be modified by the participant or MedSD characteristics. To clarify the associations between MedSD and CVD risk, future meta-analyses and systematic reviews should not only follow methodologic quality standards but also include more statistical modeling results when data allow. © 2016 American Society for Nutrition.

Evaluation Methods for Assessing Users’ Psychological Experiences of Web-Based Psychosocial Interventions: A Systematic Review

PubMed Central

Howson, Moira; Ritchie, Linda; Carter, Philip D; Parry, David Tudor; Koziol-McLain, Jane

2016-01-01

Background The use of Web-based interventions to deliver mental health and behavior change programs is increasingly popular. They are cost-effective, accessible, and generally effective. Often these interventions concern psychologically sensitive and challenging issues, such as depression or anxiety. The process by which a person receives and experiences therapy is important to understanding therapeutic process and outcomes. While the experience of the patient or client in traditional face-to-face therapy has been evaluated in a number of ways, there appeared to be a gap in the evaluation of patient experiences of therapeutic interventions delivered online. Evaluation of Web-based artifacts has focused either on evaluation of experience from a computer Web-design perspective through usability testing or on evaluation of treatment effectiveness. Neither of these methods focuses on the psychological experience of the person while engaged in the therapeutic process. Objective This study aimed to investigate what methods, if any, have been used to evaluate the in situ psychological experience of users of Web-based self-help psychosocial interventions. Methods A systematic literature review was undertaken of interdisciplinary databases with a focus on health and computer sciences. Studies that met a predetermined search protocol were included. Results Among 21 studies identified that examined psychological experience of the user, only 1 study collected user experience in situ. The most common method of understanding users’ experience was through semistructured interviews conducted posttreatment or questionnaires administrated at the end of an intervention session. The questionnaires were usually based on standardized tools used to assess user experience with traditional face-to-face treatment. Conclusions There is a lack of methods specified in the literature to evaluate the interface between Web-based mental health or behavior change artifacts and users. Main limitations in the research were the nascency of the topic and cross-disciplinary nature of the field. There is a need to develop and deliver methods of understanding users’ psychological experiences while using an intervention. PMID:27363519

Improving patient safety through the systematic evaluation of patient outcomes

PubMed Central

Forster, Alan J.; Dervin, Geoff; Martin, Claude; Papp, Steven

2012-01-01

Despite increased advocacy for patient safety and several large-scale programs designed to reduce preventable harm, most notably surgical checklists, recent data evaluating entire health systems suggests that we are no further ahead in improving patient safety and that hospital complications are no less frequent now than in the 1990s. We suggest that the failure to systematically measure patient safety is the reason for our limited progress. In addition to defining patient safety outcomes and describing their financial and clinical impact, we argue why the failure to implement patient safety measurement systems has compromised the ability to move the agenda forward. We also present an overview of how patient safety can be assessed and the strengths and weaknesses of each method and comment on some of the consequences created by the absence of a systematic measurement system. PMID:23177520

Design and Simulation Plant Layout Using Systematic Layout Planning

NASA Astrophysics Data System (ADS)

Suhardini, D.; Septiani, W.; Fauziah, S.

2017-12-01

This research aims to design the factory layout of PT. Gunaprima Budiwijaya in order to increase production capacity. The problem faced by this company is inappropriate layout causes cross traffic on the production floor. The re-layout procedure consist of these three steps: analysing the existing layout, designing plant layout based on SLP and evaluation and selection of alternative layout using Simulation Pro model version 6. Systematic layout planning is used to re-layout not based on the initial layout. This SLP produces four layout alternatives, and each alternative will be evaluated based on two criteria, namely cost of material handling using Material Handling Evaluation Sheet (MHES) and processing time by simulation. The results showed that production capacity is increasing as much as 37.5% with the addition of the machine and the operator, while material handling cost was reduced by improvement of the layout. The use of systematic layout planning method reduces material handling cost of 10,98% from initial layout or amounting to Rp1.229.813,34.

Speech and language interventions for infants aged 0 to 2 years at high risk for cerebral palsy: a systematic review

PubMed Central

Chorna, Olena; Hamm, Ellyn; Cummings, Caitlin; Fetters, Ashley; Maitre, Nathalie L

2017-01-01

Aim We evaluated the level of evidence of speech, language, and communication interventions for infants at high-risk for, or with a diagnosis of, cerebral palsy (CP) from 0 to 2 years old. Method We performed a systematic review of relevant terms. Articles were evaluated based on the level of methodological quality and evidence according to A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidelines. Results The search terms provided 17 publications consisting of speech or language interventions. There were no interventions in the high level of evidence category. The overall level of evidence was very low. Promising interventions included Responsivity and Prelinguistic Milieu Teaching and other parent–infant transaction frameworks. Interpretation There are few evidence-based interventions addressing speech, language, and communication needs of infants and toddlers at high risk for CP, and none for infants diagnosed with CP. Recommendation guidelines include parent–infant transaction programs. PMID:27897320

Liaison psychiatry and bariatric surgery: double standards. What are the possibilities for the systematization of the pre-operative psychiatric assessment in Belgium?

PubMed

Jacques, Denis; Reynaert, Christine; Zdanowicz, Nicolas

2016-09-01

In the context of health care in Belgium, the psychological or psychiatric opinion of a multidisciplinary team is required in the assessment of bariatric surgery candidates. In clinical practice, a wide variety of liaison psychiatry assessment methods exist. On the basis of a post-operative psychiatric comorbidity case report and a literature review on "liaison psychiatry and bariatric surgery" we aim to identify opportunities for the systematization of bariatric pre-surgery psychiatric evaluation. The bariatric pre-surgery evaluation must be rigorous and founded on evidence-based medicine. On this basis, specific psychiatric criteria may be defined and researched in assessments. The issue remains for psychiatric comorbidities that develop after surgery and for which a preventive framework should be sustained in the liaison psychiatry approach. The aim of the research is to support an improved systematization of the psychological assessments of pre-operative bariatric surgery candidates. We believe that systematic evaluation tools should be defined for the identification of possible absolute or relative contra-indications and that a preventive approach to post-operative psychiatric disorders should be included in this assessment.

Intelligent interface design and evaluation

NASA Technical Reports Server (NTRS)

Greitzer, Frank L.

1988-01-01

Intelligent interface concepts and systematic approaches to assessing their functionality are discussed. Four general features of intelligent interfaces are described: interaction efficiency, subtask automation, context sensitivity, and use of an appropriate design metaphor. Three evaluation methods are discussed: Functional Analysis, Part-Task Evaluation, and Operational Testing. Design and evaluation concepts are illustrated with examples from a prototype expert system interface for environmental control and life support systems for manned space platforms.

Systematic evaluation of a targeted gene capture sequencing panel for molecular diagnosis of retinitis pigmentosa.

PubMed

Huang, Hui; Chen, Yanhua; Chen, Huishuang; Ma, Yuanyuan; Chiang, Pei-Wen; Zhong, Jing; Liu, Xuyang; Asan; Wu, Jing; Su, Yan; Li, Xin; Deng, Jianlian; Huang, Yingping; Zhang, Xinxin; Li, Yang; Fan, Ning; Wang, Ying; Tang, Lihui; Shen, Jinting; Chen, Meiyan; Zhang, Xiuqing; Te, Deng; Banerjee, Santasree; Liu, Hui; Qi, Ming; Yi, Xin

2018-01-01

Inherited eye diseases are major causes of vision loss in both children and adults. Inherited eye diseases are characterized by clinical variability and pronounced genetic heterogeneity. Genetic testing may provide an accurate diagnosis for ophthalmic genetic disorders and allow gene therapy for specific diseases. A targeted gene capture panel was designed to capture exons of 283 inherited eye disease genes including 58 known causative retinitis pigmentosa (RP) genes. 180 samples were tested with this panel, 68 were previously tested by Sanger sequencing. Systematic evaluation of our method and comprehensive molecular diagnosis were carried on 99 RP patients. 96.85% targeted regions were covered by at least 20 folds, the accuracy of variants detection was 99.994%. In 4 of the 68 samples previously tested by Sanger sequencing, mutations of other diseases not consisting with the clinical diagnosis were detected by next-generation sequencing (NGS) not Sanger. Among the 99 RP patients, 64 (64.6%) were detected with pathogenic mutations, while in 3 patients, it was inconsistent between molecular diagnosis and their initial clinical diagnosis. After revisiting, one patient's clinical diagnosis was reclassified. In addition, 3 patients were found carrying large deletions. We have systematically evaluated our method and compared it with Sanger sequencing, and have identified a large number of novel mutations in a cohort of 99 RP patients. The results showed a sufficient accuracy of our method and suggested the importance of molecular diagnosis in clinical diagnosis.

Reviewing the research methods literature: principles and strategies illustrated by a systematic overview of sampling in qualitative research.

PubMed

Gentles, Stephen J; Charles, Cathy; Nicholas, David B; Ploeg, Jenny; McKibbon, K Ann

2016-10-11

Overviews of methods are potentially useful means to increase clarity and enhance collective understanding of specific methods topics that may be characterized by ambiguity, inconsistency, or a lack of comprehensiveness. This type of review represents a distinct literature synthesis method, although to date, its methodology remains relatively undeveloped despite several aspects that demand unique review procedures. The purpose of this paper is to initiate discussion about what a rigorous systematic approach to reviews of methods, referred to here as systematic methods overviews, might look like by providing tentative suggestions for approaching specific challenges likely to be encountered. The guidance offered here was derived from experience conducting a systematic methods overview on the topic of sampling in qualitative research. The guidance is organized into several principles that highlight specific objectives for this type of review given the common challenges that must be overcome to achieve them. Optional strategies for achieving each principle are also proposed, along with discussion of how they were successfully implemented in the overview on sampling. We describe seven paired principles and strategies that address the following aspects: delimiting the initial set of publications to consider, searching beyond standard bibliographic databases, searching without the availability of relevant metadata, selecting publications on purposeful conceptual grounds, defining concepts and other information to abstract iteratively, accounting for inconsistent terminology used to describe specific methods topics, and generating rigorous verifiable analytic interpretations. Since a broad aim in systematic methods overviews is to describe and interpret the relevant literature in qualitative terms, we suggest that iterative decision making at various stages of the review process, and a rigorous qualitative approach to analysis are necessary features of this review type. We believe that the principles and strategies provided here will be useful to anyone choosing to undertake a systematic methods overview. This paper represents an initial effort to promote high quality critical evaluations of the literature regarding problematic methods topics, which have the potential to promote clearer, shared understandings, and accelerate advances in research methods. Further work is warranted to develop more definitive guidance.

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review.

PubMed

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti

2016-10-04

Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence.

The use of individualized contract plans as a method of performance evaluation for allied health faculty.

PubMed

Mitcham, M D; Vericella, B J

1985-11-01

Results from a two-year study of the individualized contract plan (ICP) approach to faculty evaluation indicate this is a workable method of performance evaluation for allied health faculty. The ICP was found to be individualized, systematic, flexible, and objective. Faculty members and department chairpersons differed in their perception of the effectiveness of the ICP, but both groups supported its continued use. Five major recommendations were made regarding the continued use of the ICP as a method of faculty performance evaluation: (1) separate evaluation and professional development aspects, (2) link results to the institutional reward structure, (3) administer the ICP uniformly among departments, (4) develop a monitoring mechanism, and (5) foster open communication among all participants in the system.

Integration of Family Planning Services into HIV Care and Treatment Services: A Systematic Review.

PubMed

Haberlen, Sabina A; Narasimhan, Manjulaa; Beres, Laura K; Kennedy, Caitlin E

2017-06-01

Evidence on the feasibility, effectiveness, and cost-effectiveness of integrating family planning (FP) and HIV services has grown significantly since the 2004 Glion Call to Action. This systematic review adds to the knowledge base by characterizing the range of models used to integrate FP into HIV care and treatment, and synthesizing the evidence on integration outcomes among women living with HIV. Fourteen studies met our inclusion criteria, eight of which were published after the last systematic review on the topic in 2013. Overall, integration was associated with higher modern method contraceptive prevalence and knowledge, although there was insufficient evidence to evaluate its effects on unintended pregnancy or achieving safe and healthy pregnancy. Evidence for change in unmet need for FP was limited, although two of the three evaluations that measured unmet need suggested possible improvements associated with integrated services. However, improving access to FP services through integration was not always sufficient to increase the use of more effective (noncondom) modern methods among women who wanted to prevent pregnancy. Integration efforts, particularly in contexts where contraceptive use is low, must address community-wide and HIV-specific barriers to using effective FP methods alongside improving access to information, commodities, and services within routine HIV care. © 2017 The Population Council, Inc.

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

Revista de Investigacion Educativa, 2000 (Journal of Educational Research, 2000).

ERIC Educational Resources Information Center

Revista de Investigacion Educativa, 2000

2000-01-01

Articles in this volume focus on the following: teacher evaluation and quality management in education; steps toward a comprehensive and systematic staff evaluation; opinions of university students on teaching methods at science faculties; design of a scale to assess the ability to jump for the use in elementary school physical education; effects…

An evaluation of multipass electrofishing for estimating the abundance of stream-dwelling salmonids

Treesearch

James T. Peterson; Russell F. Thurow; John W. Guzevich

2004-01-01

Failure to estimate capture efficiency, defined as the probability of capturing individual fish, can introduce a systematic error or bias into estimates of fish abundance. We evaluated the efficacy of multipass electrofishing removal methods for estimating fish abundance by comparing estimates of capture efficiency from multipass removal estimates to capture...

DEVELOPMENT OF BIOAVAILABILITY AND BIOKINETICS DETERMINATION METHODS FOR ORGANIC POLLUTANTS IN SOIL TO ENHANCE IN-SITU AND ON-SITE BIOREMEDIATION

EPA Science Inventory

Determination of biodegradation rates of organics in soil slurry and compacted soil systems is essential for evaluating the efficacy of bioremediation for treatment of contaminated soils. In this paper, a systematic protocol has been developed for evaluating bioknetic and transp...

A Systematic Review of the Empirical Literature on Intercessory Prayer

ERIC Educational Resources Information Center

Hodge, David R.

2007-01-01

Perhaps surprisingly, many social workers appear to use intercessory prayer in direct practice settings. To help inform practitioners' use of this intervention, this article evaluates the empirical literature on the topic using the following three methods: (a) an individual assessment of each study, (b) an evaluation of intercessory prayer as an…

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

PubMed

Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

2018-01-01

To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

The Clinimetric Properties of Instruments Measuring Home Hazards for Older People at Risk of Falling: A Systematic Review.

PubMed

Romli, Muhammad Hibatullah; Mackenzie, Lynette; Lovarini, Meryl; Tan, Maw Pin; Clemson, Lindy

2018-03-01

Home hazards are associated with falls among older people living in the community. However, evaluating home hazards is a complex process as environmental factors vary according to geography, culture, and architectural design. As a result, many health practitioners commonly use nonstandardized assessment methods that may lead to inaccurate findings. Thus, the aim of this systematic review was to identify standardized instruments for evaluating home hazards related to falls and evaluate the clinimetric properties of these instruments for use by health practitioners. A systematic search was conducted in the Medline, CINAHL, AgeLine, Web of Science databases, and the University of Sydney Library CrossSearch Engine. Study screening, assessment, and quality ratings were conducted independently. Thirty-six studies were identified describing 19 instruments and three assessment techniques. The clinimetric properties varied between instruments. The Home Falls and Accidents Screening Tool, Home Safety Self-Assessment Tool, In-Home Occupational Performance Evaluation, and Westmead Home Safety Assessment were the instruments with high potential for evaluating home hazards associated with falls. Health practitioners can choose the most appropriate instruments for their practice, as a range of standardized instruments with established clinimetric properties are available.

Evaluating the Risks of Clinical Research: Direct Comparative Analysis

PubMed Central

Abdoler, Emily; Roberson-Nay, Roxann; Pine, Daniel S.; Wendler, David

2014-01-01

Abstract Objectives: Many guidelines and regulations allow children and adolescents to be enrolled in research without the prospect of clinical benefit when it poses minimal risk. However, few systematic methods exist to determine when research risks are minimal. This situation has led to significant variation in minimal risk judgments, raising concern that some children are not being adequately protected. To address this concern, we describe a new method for implementing the widely endorsed “risks of daily life” standard for minimal risk. This standard defines research risks as minimal when they do not exceed the risks posed by daily life activities or routine examinations. Methods: This study employed a conceptual and normative analysis, and use of an illustrative example. Results: Different risks are composed of the same basic elements: Type, likelihood, and magnitude of harm. Hence, one can compare the risks of research and the risks of daily life by comparing the respective basic elements with each other. We use this insight to develop a systematic method, direct comparative analysis, for implementing the “risks of daily life” standard for minimal risk. The method offers a way of evaluating research procedures that pose the same types of risk as daily life activities, such as the risk of experiencing anxiety, stress, or other psychological harm. We thus illustrate how direct comparative analysis can be applied in practice by using it to evaluate whether the anxiety induced by a respiratory CO2 challenge poses minimal or greater than minimal risks in children and adolescents. Conclusions: Direct comparative analysis is a systematic method for applying the “risks of daily life” standard for minimal risk to research procedures that pose the same types of risk as daily life activities. It thereby offers a method to protect children and adolescents in research, while ensuring that important studies are not blocked because of unwarranted concerns about research risks. PMID:25210944

Performance measurement of commercial electronic still picture cameras

NASA Astrophysics Data System (ADS)

Hsu, Wei-Feng; Tseng, Shinn-Yih; Chiang, Hwang-Cheng; Cheng, Jui-His; Liu, Yuan-Te

1998-06-01

Commercial electronic still picture cameras need a low-cost, systematic method for evaluating the performance. In this paper, we present a measurement method to evaluating the dynamic range and sensitivity by constructing the opto- electronic conversion function (OECF), the fixed pattern noise by the peak S/N ratio (PSNR) and the image shading function (ISF), and the spatial resolution by the modulation transfer function (MTF). The evaluation results of individual color components and the luminance signal from a PC camera using SONY interlaced CCD array as the image sensor are then presented.

Measurement methods to assess diastasis of the rectus abdominis muscle (DRAM): A systematic review of their measurement properties and meta-analytic reliability generalisation.

PubMed

van de Water, A T M; Benjamin, D R

2016-02-01

Systematic literature review. Diastasis of the rectus abdominis muscle (DRAM) has been linked with low back pain, abdominal and pelvic dysfunction. Measurement is used to either screen or to monitor DRAM width. Determining which methods are suitable for screening and monitoring DRAM is of clinical value. To identify the best methods to screen for DRAM presence and monitor DRAM width. AMED, Embase, Medline, PubMed and CINAHL databases were searched for measurement property studies of DRAM measurement methods. Population characteristics, measurement methods/procedures and measurement information were extracted from included studies. Quality of all studies was evaluated using 'quality rating criteria'. When possible, reliability generalisation was conducted to provide combined reliability estimations. Thirteen studies evaluated measurement properties of the 'finger width'-method, tape measure, calipers, ultrasound, CT and MRI. Ultrasound was most evaluated. Methodological quality of these studies varied widely. Pearson's correlations of r = 0.66-0.79 were found between calipers and ultrasound measurements. Calipers and ultrasound had Intraclass Correlation Coefficients (ICC) of 0.78-0.97 for test-retest, inter- and intra-rater reliability. The 'finger width'-method had weighted Kappa's of 0.73-0.77 for test-retest reliability, but moderate agreement (63%; weighted Kappa = 0.53) between raters. Comparing calipers and ultrasound, low measurement error was found (above the umbilicus), and the methods had good agreement (83%; weighted Kappa = 0.66) for discriminative purposes. The available information support ultrasound and calipers as adequate methods to assess DRAM. For other methods limited measurement information of low to moderate quality is available and further evaluation of their measurement properties is required. Copyright © 2015 Elsevier Ltd. All rights reserved.

Study Sensitivity: Evaluating the Ability to Detect Effects in Systematic Reviews of Chemical Exposures

PubMed Central

Cooper, Glinda S.; Lunn, Ruth M.; Ågerstrand, Marlene; Glenn, Barbara S.; Kraft, Andrew D.; Luke, April M.; Ratcliffe, Jennifer M.

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as “sensitivity”, is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and sensitivity can be used to identify the most informative studies, to evaluate the confidence of the findings from individual studies and to identify those study elements that may help to explain heterogeneity across the body of literature. PMID:27156196

Occult gastrointestinal bleeding. An evaluation of available diagnostic methods.

PubMed

Richardson, J D; McInnis, W D; Ramos, R; Aust, J B

1975-05-01

Occult gastrointestinal bleeding was defined as continued bleeding in spite of a normal series of roentgenorgrams of the upper part of the gastrointestinal tract, barium enema, and sigmoidoscopy. Twenty-six such patients were treated. A thorough systematic evaluation, including gastroscopy, colonoscopy, visceral angiography, and isotopic scanning, was done preoperatively. Using colonoscopy and arteriography, nearly 60% of the bleeding sites were identified. Seventy-six percent of the lesions identified were in the terminal part of the ileum or the ascending colon. Exploratory laparotomy should be performed for life-threatening hemorrhage or as a diagnostic test only after a thorough preoperative evaluation. If results of a complete preoperative evaluation including arteriography were normal, then the likelihood of finding a discrete cause of bleeding at laparotomy was high (80%). A systematic evaluation and diligence of both physcian and patient in localizing the site of bleeding are essential.

Randomized, Controlled Trial of CBT Training for PTSD Providers

DTIC Science & Technology

2015-10-01

design, implement and evaluate a cost effective, web based self paced training program to provide skills-oriented continuing education for mental...but has received little systematic evaluation to date. Noting the urgency and high priority of this issue, Fairburn and Cooper (2011) have... evaluate scalable and cost-effective new methods for training of mental health clinicians providing treatment services to veterans with PTSD. The

A multi-institutional study of independent calculation verification in inhomogeneous media using a simple and effective method of heterogeneity correction integrated with the Clarkson method.

PubMed

Jinno, Shunta; Tachibana, Hidenobu; Moriya, Shunsuke; Mizuno, Norifumi; Takahashi, Ryo; Kamima, Tatsuya; Ishibashi, Satoru; Sato, Masanori

2018-05-21

In inhomogeneous media, there is often a large systematic difference in the dose between the conventional Clarkson algorithm (C-Clarkson) for independent calculation verification and the superposition-based algorithms of treatment planning systems (TPSs). These treatment site-dependent differences increase the complexity of the radiotherapy planning secondary check. We developed a simple and effective method of heterogeneity correction integrated with the Clarkson algorithm (L-Clarkson) to account for the effects of heterogeneity in the lateral dimension, and performed a multi-institutional study to evaluate the effectiveness of the method. In the method, a 2D image reconstructed from computed tomography (CT) images is divided according to lines extending from the reference point to the edge of the multileaf collimator (MLC) or jaw collimator for each pie sector, and the radiological path length (RPL) of each line is calculated on the 2D image to obtain a tissue maximum ratio and phantom scatter factor, allowing the dose to be calculated. A total of 261 plans (1237 beams) for conventional breast and lung treatments and lung stereotactic body radiotherapy were collected from four institutions. Disagreements in dose between the on-site TPSs and a verification program using the C-Clarkson and L-Clarkson algorithms were compared. Systematic differences with the L-Clarkson method were within 1% for all sites, while the C-Clarkson method resulted in systematic differences of 1-5%. The L-Clarkson method showed smaller variations. This heterogeneity correction integrated with the Clarkson algorithm would provide a simple evaluation within the range of -5% to +5% for a radiotherapy plan secondary check.

The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature.

PubMed

Pölkki, Tarja; Kanste, Outi; Kääriäinen, Maria; Elo, Satu; Kyngäs, Helvi

2014-02-01

To analyse systematic review articles published in the top 10 nursing journals to determine the quality of the methods employed within them. Systematic review is defined as a scientific research method that synthesises high-quality scientific knowledge on a given topic. The number of such reviews in nursing science has increased dramatically during recent years, but their methodological quality has not previously been assessed. A review of the literature using a narrative approach. Ranked impact factor scores for nursing journals were obtained from the Journal Citation Report database of the Institute of Scientific Information (ISI Web of Knowledge). All issues from the years 2009 and 2010 of the top 10 ranked journals were included. CINAHL and MEDLINE databases were searched to locate studies using the search terms 'systematic review' and 'systematic literature review'. A total of 39 eligible studies were identified. Their methodological quality was evaluated through the specific criteria of quality assessment, description of synthesis and strengths and weaknesses reported in the included studies. Most of the eligible systematic reviews included several different designs or types of quantitative study. The majority included a quality assessment, and a total of 17 different criteria were identified. The method of synthesis was mentioned in about half of the reviews, the most common being narrative synthesis. The weaknesses of reviews were discussed, while strengths were rarely highlighted. The methodological quality of the systematic reviews examined varied considerably, although they were all published in nursing journals with a high-impact factor. Despite the fact that systematic reviews are considered the most robust source of research evidence, they vary in methodological quality. This point is important to consider in clinical practice when applying the results to patient care. © 2013 Blackwell Publishing Ltd.

A systematic and critical review on bioanalytical method validation using the example of simultaneous quantitation of antidiabetic agents in blood.

PubMed

Fachi, Mariana Millan; Leonart, Letícia Paula; Cerqueira, Letícia Bonancio; Pontes, Flavia Lada Degaut; de Campos, Michel Leandro; Pontarolo, Roberto

2017-06-15

A systematic and critical review was conducted on bioanalytical methods validated to quantify combinations of antidiabetic agents in human blood. The aim of this article was to verify how the validation process of bioanalytical methods is performed and the quality of the published records. The validation assays were evaluated according to international guidelines. The main problems in the validation process are pointed out and discussed to help researchers to choose methods that are truly reliable and can be successfully applied for their intended use. The combination of oral antidiabetic agents was chosen as these are some of the most studied drugs and several methods are present in the literature. Moreover, this article may be applied to the validation process of all bioanalytical. Copyright © 2017 Elsevier B.V. All rights reserved.

Aromatherapy for managing menopausal symptoms

PubMed Central

Choi, Jiae; Lee, Hye Won; Lee, Ju Ah; Lim, Hyun-Ja; Lee, Myeong Soo

2018-01-01

Abstract Background: Aromatherapy is often used as a complementary therapy for women's health. This systematic review aims to evaluate the therapeutic effects of aromatherapy as a management for menopausal symptoms. Methods: Eleven electronic databases will be searched from inception to February 2018. Randomized controlled trials that evaluated any type of aromatherapy against any type of control in individuals with menopausal symptoms will be eligible. The methodological quality will be assessed using the Cochrane risk of bias tool. Two authors will independently assess each study for eligibility and risk of bias and to extract data. Results: This study will provide a high quality synthesis of current evidence of aromatherapy for menopausal symptoms measured with Menopause Rating Scale, the Kupperman Index, the Greene Climacteric Scale, or other validated questionnaires. Conclusions: The conclusion of our systematic review will provide evidence to judge whether aromatherapy is an effective intervention for patient with menopausal women. Ethics and dissemination: Ethical approval will not be required, given that this protocol is for a systematic review. The systematic review will be published in a peer-reviewed journal. The review will also be disseminated electronically and in print. Systematic review registration: PROSPERO CRD42017079191. PMID:29419673

Stakeholder involvement in systematic reviews: a protocol for a systematic review of methods, outcomes and effects.

PubMed

Pollock, Alex; Campbell, Pauline; Struthers, Caroline; Synnot, Anneliese; Nunn, Jack; Hill, Sophie; Goodare, Heather; Watts, Chris; Morley, Richard

2017-01-01

Researchers are expected to actively involve stakeholders (including patients, the public, health professionals, and others) in their research. Although researchers increasingly recognise that this is good practice, there is limited practical guidance about how to involve stakeholders. Systematic reviews are a research method in which international literature is brought together, using carefully designed and rigorous methods to answer a specified question about healthcare. We want to investigate how researchers have involved stakeholders in systematic reviews, and how involvement has potentially affected the quality and impact of reviews. We plan to bring this information together by searching and reviewing the literature for reports of stakeholder involvement in systematic reviews. This paper describes in detail the methods that we plan to use to do this. After carrying out comprehensive searches for literature, we will: 1. Provide an overview of identified reports, describing key information such as types of stakeholders involved, and how. 2. Pick out reports of involvement which include detailed descriptions of how researchers involved people in a systematic review and summarise the methods they used. We will consider who was involved, how people were recruited, and how the involvement was organised and managed. 3. Bring together any reports which have explored the effect, or impact, of involving stakeholders in a systematic review. We will assess the quality of these reports, and summarise their findings. Once completed, our review will be used to produce training resources aimed at helping researchers to improve ways of involving stakeholders in systematic reviews. Background There is an expectation for stakeholders (including patients, the public, health professionals, and others) to be involved in research. Researchers are increasingly recognising that it is good practice to involve stakeholders in systematic reviews. There is currently a lack of evidence about (A) how to do this and (B) the effects, or impact, of such involvement. We aim to create a map of the evidence relating to stakeholder involvement in systematic reviews, and use this evidence to address the two points above. Methods We will complete a mixed-method synthesis of the evidence, first completing a scoping review to create a broad map of evidence relating to stakeholder involvement in systematic reviews, and secondly completing two contingent syntheses. We will use a stepwise approach to searching; the initial step will include comprehensive searches of electronic databases, including CENTRAL, AMED, Embase, Medline, Cinahl and other databases, supplemented with pre-defined hand-searching and contacting authors. Two reviewers will undertake each review task (i.e., screening, data extraction) using standard systematic review processes. For the scoping review, we will include any paper, regardless of publication status or study design, which investigates, reports or discusses involvement in a systematic review. Included papers will be summarised within structured tables. Criteria for judging the focus and comprehensiveness of the description of methods of involvement will be applied, informing which papers are included within the two contingent syntheses. Synthesis A will detail the methods that have been used to involve stakeholders in systematic reviews. Papers from the scoping review that are judged to provide an adequate description of methods or approaches will be included. Details of the methods of involvement will be extracted from included papers using pre-defined headings, presented in tables and described narratively. Synthesis B will include studies that explore the effect of stakeholder involvement on the quality, relevance or impact of a systematic review, as identified from the scoping review. Study quality will be appraised, data extracted and synthesised within tables. Discussion This review should help researchers select, improve and evaluate methods of involving stakeholders in systematic reviews. Review findings will contribute to Cochrane training resources.

Cognitive-Behavioral Therapies for Young People in Outpatient Treatment for Nonopioid Drug Use

ERIC Educational Resources Information Center

Filges, Trine; Jorgensen, Anne-Marie Klint

2018-01-01

Objectives: This review evaluates the evidence on the effects of cognitive-behavioral therapy (CBT) on drug use reduction for young people in treatment for nonopioid drug use. Method: We followed Campbell Collaboration guidelines to conduct a systematic review of randomized and nonrandomized trials. Meta-analytic methods were used to…

Systematically Retrieving Research: A Case Study Evaluating Seven Databases

ERIC Educational Resources Information Center

Taylor, Brian; Wylie, Emma; Dempster, Martin; Donnelly, Michael

2007-01-01

Objective: Developing the scientific underpinnings of social welfare requires effective and efficient methods of retrieving relevant items from the increasing volume of research. Method: We compared seven databases by running the nearest equivalent search on each. The search topic was chosen for relevance to social work practice with older people.…

Learning outcomes associated with patient simulation method in pharmacotherapy education: an integrative review.

PubMed

Aura, Suvi M; Sormunen, Marjorita S T; Jordan, Sue E; Tossavainen, Kerttu A; Turunen, Hannele E

2015-06-01

The aims of this systematic integrative review were to identify evidence for the use of patient simulation teaching methods in pharmacotherapy education and to explore related learning outcomes. A systematic literature search was conducted using 6 databases as follows: CINAHL, PubMed, SCOPUS, ERIC, MEDIC, and the Cochrane Library, using the key words relating to patient simulation and pharmacotherapy. The methodological quality of each study was evaluated. Eighteen articles met the inclusion criteria. The earliest article was published in 2005. The selected research articles were subjected to qualitative content analysis. Patient simulation has been used in pharmacotherapy education for preregistration nursing, dental, medical, and pharmacy students and for the continuing education of nurses. Learning outcomes reported were summarized as follows: (1) commitment to pharmacotherapy learning, (2) development of pharmacotherapy evaluation skills, (3) improvement in pharmacotherapy application skills, and (4) knowledge and understanding of pharmacotherapy. To develop effective teaching methods and ensure health care professionals' competence in medication management, further research is needed to determine the educational and clinical effectiveness of simulation teaching methods.

Seeing the forests and the trees—innovative approaches to exploring heterogeneity in systematic reviews of complex interventions to enhance health system decision-making: a protocol

PubMed Central

2014-01-01

Background To improve quality of care and patient outcomes, health system decision-makers need to identify and implement effective interventions. An increasing number of systematic reviews document the effects of quality improvement programs to assist decision-makers in developing new initiatives. However, limitations in the reporting of primary studies and current meta-analysis methods (including approaches for exploring heterogeneity) reduce the utility of existing syntheses for health system decision-makers. This study will explore the role of innovative meta-analysis approaches and the added value of enriched and updated data for increasing the utility of systematic reviews of complex interventions. Methods/Design We will use the dataset from our recent systematic review of 142 randomized trials of diabetes quality improvement programs to evaluate novel approaches for exploring heterogeneity. These will include exploratory methods, such as multivariate meta-regression analyses and all-subsets combinatorial meta-analysis. We will then update our systematic review to include new trials and enrich the dataset by surveying authors of all included trials. In doing so, we will explore the impact of variables not, reported in previous publications, such as details of study context, on the effectiveness of the intervention. We will use innovative analytical methods on the enriched and updated dataset to identify key success factors in the implementation of quality improvement interventions for diabetes. Decision-makers will be involved throughout to help identify and prioritize variables to be explored and to aid in the interpretation and dissemination of results. Discussion This study will inform future systematic reviews of complex interventions and describe the value of enriching and updating data for exploring heterogeneity in meta-analysis. It will also result in an updated comprehensive systematic review of diabetes quality improvement interventions that will be useful to health system decision-makers in developing interventions to improve outcomes for people with diabetes. Systematic review registration PROSPERO registration no. CRD42013005165 PMID:25115289

Effect of patient setup errors on simultaneously integrated boost head and neck IMRT treatment plans

DOE Office of Scientific and Technical Information (OSTI.GOV)

Siebers, Jeffrey V.; Keall, Paul J.; Wu Qiuwen

2005-10-01

Purpose: The purpose of this study is to determine dose delivery errors that could result from random and systematic setup errors for head-and-neck patients treated using the simultaneous integrated boost (SIB)-intensity-modulated radiation therapy (IMRT) technique. Methods and Materials: Twenty-four patients who participated in an intramural Phase I/II parotid-sparing IMRT dose-escalation protocol using the SIB treatment technique had their dose distributions reevaluated to assess the impact of random and systematic setup errors. The dosimetric effect of random setup error was simulated by convolving the two-dimensional fluence distribution of each beam with the random setup error probability density distribution. Random setup errorsmore » of {sigma} = 1, 3, and 5 mm were simulated. Systematic setup errors were simulated by randomly shifting the patient isocenter along each of the three Cartesian axes, with each shift selected from a normal distribution. Systematic setup error distributions with {sigma} = 1.5 and 3.0 mm along each axis were simulated. Combined systematic and random setup errors were simulated for {sigma} = {sigma} = 1.5 and 3.0 mm along each axis. For each dose calculation, the gross tumor volume (GTV) received by 98% of the volume (D{sub 98}), clinical target volume (CTV) D{sub 90}, nodes D{sub 90}, cord D{sub 2}, and parotid D{sub 50} and parotid mean dose were evaluated with respect to the plan used for treatment for the structure dose and for an effective planning target volume (PTV) with a 3-mm margin. Results: Simultaneous integrated boost-IMRT head-and-neck treatment plans were found to be less sensitive to random setup errors than to systematic setup errors. For random-only errors, errors exceeded 3% only when the random setup error {sigma} exceeded 3 mm. Simulated systematic setup errors with {sigma} = 1.5 mm resulted in approximately 10% of plan having more than a 3% dose error, whereas a {sigma} = 3.0 mm resulted in half of the plans having more than a 3% dose error and 28% with a 5% dose error. Combined random and systematic dose errors with {sigma} = {sigma} = 3.0 mm resulted in more than 50% of plans having at least a 3% dose error and 38% of the plans having at least a 5% dose error. Evaluation with respect to a 3-mm expanded PTV reduced the observed dose deviations greater than 5% for the {sigma} = {sigma} = 3.0 mm simulations to 5.4% of the plans simulated. Conclusions: Head-and-neck SIB-IMRT dosimetric accuracy would benefit from methods to reduce patient systematic setup errors. When GTV, CTV, or nodal volumes are used for dose evaluation, plans simulated including the effects of random and systematic errors deviate substantially from the nominal plan. The use of PTVs for dose evaluation in the nominal plan improves agreement with evaluated GTV, CTV, and nodal dose values under simulated setup errors. PTV concepts should be used for SIB-IMRT head-and-neck squamous cell carcinoma patients, although the size of the margins may be less than those used with three-dimensional conformal radiation therapy.« less

An optimal search filter for retrieving systematic reviews and meta-analyses

PubMed Central

2012-01-01

Background Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters. Methods This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter. Results Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened. Conclusions The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity. PMID:22512835

Economic evaluations of angiotensin-converting enzyme inhibitors and angiotensin II receptor blockers in type 2 diabetic nephropathy: a systematic review

PubMed Central

2014-01-01

Background Structured comparison of pharmacoeconomic analyses for ACEIs and ARBs in patients with type 2 diabetic nephropathy is still lacking. This review aims to systematically review the cost-effectiveness of both ACEIs and ARBs in type 2 diabetic patients with nephropathy. Methods A systematic literature search was performed in MEDLINE and EMBASE for the period from November 1, 1999 to Oct 31, 2011. Two reviewers independently assessed the quality of the articles included and extracted data. All cost-effectiveness results were converted to 2011 Euros. Results Up to October 2011, 434 articles were identified. After full-text checking and quality assessment, 30 articles were finally included in this review involving 39 study settings. All 6 ACEIs studies were literature-based evaluations which synthesized data from different sources. Other 33 studies were directed at ARBs and were designed based on specific trials. The Markov model was the most common decision analytic method used in the evaluations. From the cost-effectiveness results, 37 out of 39 studies indicated either ACEIs or ARBs were cost-saving comparing with placebo/conventional treatment, such as amlodipine. A lack of evidence was assessed for valid direct comparison of cost-effectiveness between ACEIs and ARBs. Conclusion There is a lack of direct comparisons of ACEIs and ARBs in existing economic evaluations. Considering the current evidence, both ACEIs and ARBs are likely cost-saving comparing with conventional therapy, excluding such RAAS inhibitors. PMID:24428868

Method for technology-delivered healthcare measures.

PubMed

Kramer-Jackman, Kelli Lee; Popkess-Vawter, Sue

2011-12-01

Current healthcare literature lacks development and evaluation methods for research and practice measures administered by technology. Researchers with varying levels of informatics experience are developing technology-delivered measures because of the numerous advantages they offer. Hasty development of technology-delivered measures can present issues that negatively influence administration and psychometric properties. The Method for Technology-delivered Healthcare Measures is designed to systematically guide the development and evaluation of technology-delivered measures. The five-step Method for Technology-delivered Healthcare Measures includes establishment of content, e-Health literacy, technology delivery, expert usability, and participant usability. Background information and Method for Technology-delivered Healthcare Measures steps are detailed.

Effect of Face-to-face Education, Problem-based Learning, and Goldstein Systematic Training Model on Quality of Life and Fatigue among Caregivers of Patients with Diabetes.

PubMed

Masoudi, Reza; Soleimani, Mohammad Ali; Yaghoobzadeh, Ameneh; Baraz, Shahram; Hakim, Ashrafalsadat; Chan, Yiong H

2017-01-01

Education is a fundamental component for patients with diabetes to achieve good glycemic control. In addition, selecting the appropriate method of education is one of the most effective factors in the quality of life. The present study aimed to evaluate the effect of face-to-face education, problem-based learning, and Goldstein systematic training model on the quality of life (QOL) and fatigue among caregivers of patients with diabetes. This randomized clinical trial was conducted in Hajar Hospital (Shahrekord, Iran) in 2012. The study subjects consisted of 105 family caregivers of patients with diabetes. The participants were randomly assigned to three intervention groups (35 caregivers in each group). For each group, 5-h training sessions were held separately. QOL and fatigue were evaluated immediately before and after the intervention, and after 1, 2, 3, and 4 months of intervention. There was a significant increase in QOL for all the three groups. Both the problem-based learning and the Goldstein method showed desirable QOL improvement over time. The desired educational intervention for fatigue reduction during the 4-month post-intervention period was the Goldstein method. A significant reduction was observed in fatigue in all three groups after the intervention ( P < 0.001). The results of the present study illustrated that the problem-based learning and Goldstein systematic training model improve the QOL of caregivers of patients with diabetes. In addition, the Goldstein systematic training model had the greatest effect on the reduction of fatigue within 4 months of the intervention.

Revealed Preference Methods for Studying Bicycle Route Choice-A Systematic Review.

PubMed

Pritchard, Ray

2018-03-07

One fundamental aspect of promoting utilitarian bicycle use involves making modifications to the built environment to improve the safety, efficiency and enjoyability of cycling. Revealed preference data on bicycle route choice can assist greatly in understanding the actual behaviour of a highly heterogeneous group of users, which in turn assists the prioritisation of infrastructure or other built environment initiatives. This systematic review seeks to compare the relative strengths and weaknesses of the empirical approaches for evaluating whole journey route choices of bicyclists. Two electronic databases were systematically searched for a selection of keywords pertaining to bicycle and route choice. In total seven families of methods are identified: GPS devices, smartphone applications, crowdsourcing, participant-recalled routes, accompanied journeys, egocentric cameras and virtual reality. The study illustrates a trade-off in the quality of data obtainable and the average number of participants. Future additional methods could include dockless bikeshare, multiple camera solutions using computer vision and immersive bicycle simulator environments.

Revealed Preference Methods for Studying Bicycle Route Choice—A Systematic Review

PubMed Central

2018-01-01

One fundamental aspect of promoting utilitarian bicycle use involves making modifications to the built environment to improve the safety, efficiency and enjoyability of cycling. Revealed preference data on bicycle route choice can assist greatly in understanding the actual behaviour of a highly heterogeneous group of users, which in turn assists the prioritisation of infrastructure or other built environment initiatives. This systematic review seeks to compare the relative strengths and weaknesses of the empirical approaches for evaluating whole journey route choices of bicyclists. Two electronic databases were systematically searched for a selection of keywords pertaining to bicycle and route choice. In total seven families of methods are identified: GPS devices, smartphone applications, crowdsourcing, participant-recalled routes, accompanied journeys, egocentric cameras and virtual reality. The study illustrates a trade-off in the quality of data obtainable and the average number of participants. Future additional methods could include dockless bikeshare, multiple camera solutions using computer vision and immersive bicycle simulator environments. PMID:29518991

Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement.

PubMed

McInnes, Matthew D F; Moher, David; Thombs, Brett D; McGrath, Trevor A; Bossuyt, Patrick M; Clifford, Tammy; Cohen, Jérémie F; Deeks, Jonathan J; Gatsonis, Constantine; Hooft, Lotty; Hunt, Harriet A; Hyde, Christopher J; Korevaar, Daniël A; Leeflang, Mariska M G; Macaskill, Petra; Reitsma, Johannes B; Rodin, Rachel; Rutjes, Anne W S; Salameh, Jean-Paul; Stevens, Adrienne; Takwoingi, Yemisi; Tonelli, Marcello; Weeks, Laura; Whiting, Penny; Willis, Brian H

2018-01-23

Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of 1 or more index tests against a reference standard, provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy. To develop the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagnostic test accuracy guideline as a stand-alone extension of the PRISMA statement. Modifications to the PRISMA statement reflect the specific requirements for reporting of systematic reviews and meta-analyses of diagnostic test accuracy studies and the abstracts for these reviews. Established standards from the Enhancing the Quality and Transparency of Health Research (EQUATOR) Network were followed for the development of the guideline. The original PRISMA statement was used as a framework on which to modify and add items. A group of 24 multidisciplinary experts used a systematic review of articles on existing reporting guidelines and methods, a 3-round Delphi process, a consensus meeting, pilot testing, and iterative refinement to develop the PRISMA diagnostic test accuracy guideline. The final version of the PRISMA diagnostic test accuracy guideline checklist was approved by the group. The systematic review (produced 64 items) and the Delphi process (provided feedback on 7 proposed items; 1 item was later split into 2 items) identified 71 potentially relevant items for consideration. The Delphi process reduced these to 60 items that were discussed at the consensus meeting. Following the meeting, pilot testing and iterative feedback were used to generate the 27-item PRISMA diagnostic test accuracy checklist. To reflect specific or optimal contemporary systematic review methods for diagnostic test accuracy, 8 of the 27 original PRISMA items were left unchanged, 17 were modified, 2 were added, and 2 were omitted. The 27-item PRISMA diagnostic test accuracy checklist provides specific guidance for reporting of systematic reviews. The PRISMA diagnostic test accuracy guideline can facilitate the transparent reporting of reviews, and may assist in the evaluation of validity and applicability, enhance replicability of reviews, and make the results from systematic reviews of diagnostic test accuracy studies more useful.

Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews.

PubMed

Song, Fujian; Loke, Yoon K; Walsh, Tanya; Glenny, Anne-Marie; Eastwood, Alison J; Altman, Douglas G

2009-04-03

To investigate basic assumptions and other methodological problems in the application of indirect comparison in systematic reviews of competing healthcare interventions. Survey of published systematic reviews. Inclusion criteria Systematic reviews published between 2000 and 2007 in which an indirect approach had been explicitly used. Identified reviews were assessed for comprehensiveness of the literature search, method for indirect comparison, and whether assumptions about similarity and consistency were explicitly mentioned. The survey included 88 review reports. In 13 reviews, indirect comparison was informal. Results from different trials were naively compared without using a common control in six reviews. Adjusted indirect comparison was usually done using classic frequentist methods (n=49) or more complex methods (n=18). The key assumption of trial similarity was explicitly mentioned in only 40 of the 88 reviews. The consistency assumption was not explicit in most cases where direct and indirect evidence were compared or combined (18/30). Evidence from head to head comparison trials was not systematically searched for or not included in nine cases. Identified methodological problems were an unclear understanding of underlying assumptions, inappropriate search and selection of relevant trials, use of inappropriate or flawed methods, lack of objective and validated methods to assess or improve trial similarity, and inadequate comparison or inappropriate combination of direct and indirect evidence. Adequate understanding of basic assumptions underlying indirect and mixed treatment comparison is crucial to resolve these methodological problems. APPENDIX 1: PubMed search strategy. APPENDIX 2: Characteristics of identified reports. APPENDIX 3: Identified studies. References of included studies.

Functional Analysis of Problem Behavior: A Systematic Approach for Identifying Idiosyncratic Variables

PubMed Central

Roscoe, Eileen M.; Schlichenmeyer, Kevin J.; Dube, William V.

2015-01-01

When inconclusive functional analysis (FA) outcomes occur, a number of modifications have been made to enhance the putative establishing operation or consequence associated with behavioral maintenance. However, a systematic method for identifying relevant events to test during modified FAs has not been evaluated. The purpose of this study was to develop and evaluate a technology for systematically identifying events to test in a modified FA after an initial FA led to inconclusive outcomes. Six individuals whose initial FA showed little or no responding or high levels only in the control condition participated. An indirect assessment (IA) questionnaire developed for identifying idiosyncratic variables was administered, and a descriptive analysis (DA) was conducted. Results from the IA only or a combination of the IA and DA were used to inform modified FA test and control conditions. Conclusive FA outcomes were obtained with five of the six participants during the modified FA phase. PMID:25930176

Iridology: A systematic review.

PubMed

Ernst, E

1999-02-01

Iridologists claim to be able to diagnose medical conditions through abnormalities of pigmentation in the iris. This technique is popular in many countries. Therefore it is relevant to ask whether it is valid. To systematically review all interpretable tests of the validity of iridology as a diagnostic tool. DATA SOURCE AND EXTRACTION: Three independent literature searches were performed to identify all blinded tests. Data were extracted in a predefined, standardized fashion. Four case control studies were found. The majority of these investigations suggests that iridology is not a valid diagnostic method. The validity of iridology as a diagnostic tool is not supported by scientific evaluations. Patients and therapists should be discouraged from using this method.

Indigenous health program evaluation design and methods in Australia: a systematic review of the evidence.

PubMed

Lokuge, Kamalini; Thurber, Katherine; Calabria, Bianca; Davis, Meg; McMahon, Kathryn; Sartor, Lauren; Lovett, Raymond; Guthrie, Jill; Banks, Emily

2017-10-01

Indigenous Australians experience a disproportionately higher burden of disease compared to non-Indigenous Australians. High-quality evaluation of Indigenous health programs is required to inform health and health services improvement. We aimed to quantify methodological and other characteristics of Australian Indigenous health program evaluations published in the peer-reviewed literature. Systematic review of peer-reviewed literature (November 2009-2014) on Indigenous health program evaluation. We identified 118 papers describing evaluations of 109 interventions; 72.0% were university/research institution-led. 82.2% of evaluations included a quantitative component; 49.2% utilised quantitative data only and 33.1% used both quantitative and qualitative data. The most common design was a before/after comparison (30.5%, n=36/118). 7.6% of studies (n=9/118) used an experimental design: six individual-level and three cluster-randomised controlled trials. 56.8% (67/118) reported on service delivery/process outcomes (versus health or health risk factor outcomes) only. Given the number of Indigenous health programs that are implemented, few evaluations overall are published in the peer-reviewed literature and, of these, few use optimal methodologies such as mixed methods and experimental design. Implications for public health: Multiple strategies are required to increase high-quality, accessible evaluation in Indigenous health, including supporting stronger research-policy-practice partnerships and capacity building for evaluation by health services and government. © 2017 The Authors.

Impacts of structuring the electronic health record: Results of a systematic literature review from the perspective of secondary use of patient data.

PubMed

Vuokko, Riikka; Mäkelä-Bengs, Päivi; Hyppönen, Hannele; Lindqvist, Minna; Doupi, Persephone

2017-01-01

To explore the impacts that structuring of electronic health records (EHRs) has had from the perspective of secondary use of patient data as reflected in currently published literature. This paper presents the results of a systematic literature review aimed at answering the following questions; (1) what are the common methods of structuring patient data to serve secondary use purposes; (2) what are the common methods of evaluating patient data structuring in the secondary use context, and (3) what impacts or outcomes of EHR structuring have been reported from the secondary use perspective. The reported study forms part of a wider systematic literature review on the impacts of EHR structuring methods and evaluations of their impact. The review was based on a 12-step systematic review protocol adapted from the Cochrane methodology. Original articles included in the study were divided into three groups for analysis and reporting based on their use focus: nursing documentation, medical use and secondary use (presented in this paper). The analysis from the perspective of secondary use of data includes 85 original articles from 1975 to 2010 retrieved from 15 bibliographic databases. The implementation of structured EHRs can be roughly divided into applications for documenting patient data at the point of care and application for retrieval of patient data (post hoc structuring). Two thirds of the secondary use articles concern EHR structuring methods which were still under development or in the testing phase. of structuring patient data such as codes, terminologies, reference information models, forms or templates and documentation standards were usually applied in combination. Most of the identified benefits of utilizing structured EHR data for secondary use purposes concentrated on information content and quality or on technical quality and reliability, particularly in the case of Natural Language Processing (NLP) studies. A few individual articles evaluated impacts on care processes, productivity and costs, patient safety, care quality or other health impacts. In most articles these endpoints were usually discussed as goals of secondary use and less as evidence-supported impacts, resulting from the use of structured EHR data for secondary purposes. Further studies and more sound evaluation methods are needed for evidence on how EHRs are utilized for secondary purposes, and how structured documentation methods can serve different users' needs, e.g. administration, statistics and research and development, in parallel to medical use purposes. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluating the risks of clinical research: direct comparative analysis.

PubMed

Rid, Annette; Abdoler, Emily; Roberson-Nay, Roxann; Pine, Daniel S; Wendler, David

2014-09-01

Many guidelines and regulations allow children and adolescents to be enrolled in research without the prospect of clinical benefit when it poses minimal risk. However, few systematic methods exist to determine when research risks are minimal. This situation has led to significant variation in minimal risk judgments, raising concern that some children are not being adequately protected. To address this concern, we describe a new method for implementing the widely endorsed "risks of daily life" standard for minimal risk. This standard defines research risks as minimal when they do not exceed the risks posed by daily life activities or routine examinations. This study employed a conceptual and normative analysis, and use of an illustrative example. Different risks are composed of the same basic elements: Type, likelihood, and magnitude of harm. Hence, one can compare the risks of research and the risks of daily life by comparing the respective basic elements with each other. We use this insight to develop a systematic method, direct comparative analysis, for implementing the "risks of daily life" standard for minimal risk. The method offers a way of evaluating research procedures that pose the same types of risk as daily life activities, such as the risk of experiencing anxiety, stress, or other psychological harm. We thus illustrate how direct comparative analysis can be applied in practice by using it to evaluate whether the anxiety induced by a respiratory CO2 challenge poses minimal or greater than minimal risks in children and adolescents. Direct comparative analysis is a systematic method for applying the "risks of daily life" standard for minimal risk to research procedures that pose the same types of risk as daily life activities. It thereby offers a method to protect children and adolescents in research, while ensuring that important studies are not blocked because of unwarranted concerns about research risks.

Spontaneous pregnancy loss: evaluation, management, and follow-up counseling.

PubMed

Scroggins, K M; Smucker, W D; Krishen, A E

2000-03-01

Spontaneous pregnancy loss is a common problem requiring a logical and systematic approach to evaluation and management. This article outlines a practical method for primary care physicians to use throughout the diagnosis, management, and follow-up periods. It integrates collaborative decision making and attention to the emotional and informational needs of the patient experiencing spontaneous pregnancy loss.

Using Consensus Building Procedures with Expert Raters to Establish Comparison Scores of Behavior for Direct Behavior Rating

ERIC Educational Resources Information Center

Jaffery, Rose; Johnson, Austin H.; Bowler, Mark C.; Riley-Tillman, T. Chris; Chafouleas, Sandra M.; Harrison, Sayward E.

2015-01-01

To date, rater accuracy when using Direct Behavior Rating (DBR) has been evaluated by comparing DBR-derived data to scores yielded through systematic direct observation. The purpose of this study was to evaluate an alternative method for establishing comparison scores using expert-completed DBR alongside best practices in consensus building…

Realist Evaluation in Wraparound: A New Approach in Social Work Evidence-Based Practice

ERIC Educational Resources Information Center

Kazi, Mansoor A. F.; Pagkos, Brian; Milch, Heidi A.

2011-01-01

Objectives: The purpose of this study was to develop a realist evaluation paradigm in social work evidence-based practice. Method: Wraparound (at Gateway-Longview Inc., New York) used a reliable outcome measure and an electronic database to systematically collect and analyze data on the interventions, the client demographics and circumstances, and…

Nurse manager succession planning: synthesis of the evidence.

PubMed

Titzer, Jennifer; Phillips, Tracy; Tooley, Stephanie; Hall, Norma; Shirey, Maria

2013-10-01

The literature supporting nurse manager succession planning is reviewed and synthesised to discover best practice for identifying and developing future nurse managers. Healthcare succession planning practices are lacking. Nurse managers are historically selected based on clinical skills and lack formal leadership preparation. A systematic literature search appraises and summarises the current literature supporting nurse manager succession planning. Multiple reviewers were used to increase the reliability and validity of article selection and analysis. New nurse managers require months to adapt to their positions. Deliberate nurse manager succession planning should be integrated in the organisation's strategic plan and provide a proactive method for identifying and developing potential leaders. Organisations that identify and develop internal human capital can improve role transition, reduce nurse manager turnover rates and decrease replacement costs. Despite the clear benefits of succession planning, studies show that resource allocation for proactive, deliberate development of current and future nurse leaders is lacking. Additionally, systematic evaluation of succession planning is limited. Deliberate succession planning efforts and appropriate resource allocation require strategic planning and evaluation methods. Detailed evaluation methods demonstrating a positive return on investment utilising a cost-benefit analysis and empirical outcomes are necessary. © 2013 John Wiley & Sons Ltd.

A systematic review of model-based economic evaluations of diagnostic and therapeutic strategies for lower extremity artery disease.

PubMed

Vaidya, Anil; Joore, Manuela A; ten Cate-Hoek, Arina J; Kleinegris, Marie-Claire; ten Cate, Hugo; Severens, Johan L

2014-01-01

Lower extremity artery disease (LEAD) is a sign of wide spread atherosclerosis also affecting coronary, cerebral and renal arteries and is associated with increased risk of cardiovascular events. Many economic evaluations have been published for LEAD due to its clinical, social and economic importance. The aim of this systematic review was to assess modelling methods used in published economic evaluations in the field of LEAD. Our review appraised and compared the general characteristics, model structure and methodological quality of published models. Electronic databases MEDLINE and EMBASE were searched until February 2013 via OVID interface. Cochrane database of systematic reviews, Health Technology Assessment database hosted by National Institute for Health research and National Health Services Economic Evaluation Database (NHSEED) were also searched. The methodological quality of the included studies was assessed by using the Philips' checklist. Sixteen model-based economic evaluations were identified and included. Eleven models compared therapeutic health technologies; three models compared diagnostic tests and two models compared a combination of diagnostic and therapeutic options for LEAD. Results of this systematic review revealed an acceptable to low methodological quality of the included studies. Methodological diversity and insufficient information posed a challenge for valid comparison of the included studies. In conclusion, there is a need for transparent, methodologically comparable and scientifically credible model-based economic evaluations in the field of LEAD. Future modelling studies should include clinically and economically important cardiovascular outcomes to reflect the wider impact of LEAD on individual patients and on the society.

Use of a problem-based learning teaching model for undergraduate medical and nursing education: a systematic review and meta-analysis

PubMed Central

Sayyah, Mehdi; Shirbandi, Kiarash; Saki-Malehi, Amal; Rahim, Fakher

2017-01-01

Objectives The aim of this systematic review and meta-analysis was to evaluate the problem-based learning (PBL) method as an alternative to conventional educational methods in Iranian undergraduate medical courses. Materials and methods We systematically searched international datasets banks, including PubMed, Scopus, and Embase, and internal resources of banks, including MagirIran, IranMedex, IranDoc, and Scientific Information Database (SID), using appropriate search terms, such as “PBL”, “problem-based learning”, “based on problems”, “active learning”, and“ learner centered”, to identify PBL studies, and these were combined with other key terms such as “medical”, “undergraduate”, “Iranian”, “Islamic Republic of Iran”, “I.R. of Iran”, and “Iran”. The search included the period from 1980 to 2016 with no language limits. Results Overall, a total of 1,057 relevant studies were initially found, of which 21 studies were included in the systematic review and meta-analysis. Of the 21 studies, 12 (57.14%) had a high methodological quality. Considering the pooled effect size data, there was a significant difference in the scores (standardized mean difference [SMD]=0.80, 95% CI [0.52, 1.08], P<0.000) in favor of PBL, compared with the lecture-based method. Subgroup analysis revealed that using PBL alone is more favorable compared to using a mixed model with other learning methods such as lecture-based learning (LBL). Conclusion The results of this systematic review showed that using PBL may have a positive effect on the academic achievement of undergraduate medical courses. The results suggest that teachers and medical education decision makers give more attention on using this method for effective and proper training. PMID:29042827

A hybrid method for evaluating enterprise architecture implementation.

PubMed

Nikpay, Fatemeh; Ahmad, Rodina; Yin Kia, Chiam

2017-02-01

Enterprise Architecture (EA) implementation evaluation provides a set of methods and practices for evaluating the EA implementation artefacts within an EA implementation project. There are insufficient practices in existing EA evaluation models in terms of considering all EA functions and processes, using structured methods in developing EA implementation, employing matured practices, and using appropriate metrics to achieve proper evaluation. The aim of this research is to develop a hybrid evaluation method that supports achieving the objectives of EA implementation. To attain this aim, the first step is to identify EA implementation evaluation practices. To this end, a Systematic Literature Review (SLR) was conducted. Second, the proposed hybrid method was developed based on the foundation and information extracted from the SLR, semi-structured interviews with EA practitioners, program theory evaluation and Information Systems (ISs) evaluation. Finally, the proposed method was validated by means of a case study and expert reviews. This research provides a suitable foundation for researchers who wish to extend and continue this research topic with further analysis and exploration, and for practitioners who would like to employ an effective and lightweight evaluation method for EA projects. Copyright © 2016 Elsevier Ltd. All rights reserved.

Microcomputer Microeconomics.

DTIC Science & Technology

1982-12-01

COSIIlI3 . ............... 341 1. The Hfardwace Market ........... 38 5 2. Costing Method .............. 35 3. Hardware MaIntenince :3st ........ 39...systematic method for the identification of mi~cocomputer applications for a single user in a small business gnvironme.t. It will discuss how to extend the...planning is identification and evaluation of pc3spective applications. The application identificition methoD that will be presented is designed to be

Methodological and reporting quality of systematic reviews on tuberculosis.

PubMed

Nicolau, I; Ling, D; Tian, L; Lienhardt, C; Pai, M

2013-09-01

Systematic reviews are used to inform tuberculosis (TB) guidelines. However, there are no data on whether TB systematic reviews are conducted well and reported transparently. We searched four databases for reviews published between 2005 and 2010. Methodological quality was evaluated using AMSTAR and quality of reporting was assessed using PRISMA. Of 152 articles, 137 (90%) met the inclusion criteria. Only 3 of 11 AMSTAR quality items were met in most reviews: appropriate methods to combine findings (67%), comprehensive literature search (72%) and presentation of characteristics of included studies (90%). The other eight items were met in 4-53% of the reviews. Only 4% of the reviews disclosed conflicts of interest. The majority of the PRISMA items were reported in more than 60-76% of the reviews. Only nine items were reported in less than 55% of the reviews, the lowest being the full-search strategy (30%), risk of bias across studies in the Methods (27%) and Results (21%) sections, and indication of a review protocol (15%). Systematic reviews in our survey were well reported but generally of moderate to low quality. Better training, use of reporting guidelines and registration of systematic reviews could improve the quality of TB reviews.

Promotional communications for influenza vaccination: a systematic review.

PubMed

Macdonald, Laura; Cairns, Georgina; Angus, Kathryn; de Andrade, Marisa

2013-01-01

The authors conducted a systematic review that aimed to map current practice and identify effective practice in promotional communications for seasonal influenza vaccination in Europe. They identified 22 studies from 7 European countries. Included studies were primarily outcome evaluations of communications promoting vaccination to health care workers and elderly adults. Evidence on communications to improve public acceptance was sparse. A range of communication approaches, methods, materials, and channels were used, frequently in combination. All forms of promotional communications have the potential to increase uptake in health care workers and can also improve uptake among patients. There was promising evidence that mass communication methods, delivered as standalone activities or as one component of a communication mix, can improve uptake in target populations. Education for health care workers and improved service delivery are common adjuncts to promotional communications that were associated with effectiveness. The evidence suggests that personalized communications, combined with improved service delivery, might boost rates of uptake among elderly adults. Future development of good practice could be enhanced by more systematic, theory-based intervention design and more detailed reporting of process and outcome evaluations. Vaccine hesitancy is increasingly prevalent; more policy and research to improve public acceptance should therefore be considered.

The quality of dietary intake methodology and reporting in child and adolescent obesity intervention trials: a systematic review.

PubMed

Burrows, T; Golley, R K; Khambalia, A; McNaughton, S A; Magarey, A; Rosenkranz, R R; Alllman-Farinelli, M; Rangan, A M; Truby, H; Collins, C

2012-12-01

Assessing dietary intake is important in evaluating childhood obesity intervention effectiveness. The purpose of this review was to evaluate the dietary intake methods and reporting in intervention studies that included a dietary component to treat overweight or obese children. A systematic review of studies published in the English language, between 1985 and August 2010 in health databases. The search identified 2,295 papers, of which 335 were retrieved and 31 met the inclusion criteria. Twenty-three studies reported energy intake as an outcome measure, 20 reported macronutrient intakes and 10 studies reported food intake outcomes. The most common dietary method employed was the food diary (n = 13), followed by 24-h recall (n = 5), food frequency questionnaire (FFQ) (n = 4) and dietary questionnaire (n = 4). The quality of the dietary intake methods reporting was rated as 'poor' in 15 studies (52%) and only 3 were rated as 'excellent'. The reporting quality of FFQs tended to be higher than food diaries/recalls. Deficiencies in the quality of dietary intake methods reporting in child obesity studies were identified. Use of a dietary intake methods reporting checklist is recommended. This will enable the quality of dietary intake results to be evaluated, and an increased ability to replicate study methodology by other researchers. © 2012 The Authors. obesity reviews © 2012 International Association for the Study of Obesity.

Single-Case Experimental Designs: A Systematic Review of Published Research and Current Standards

PubMed Central

Smith, Justin D.

2013-01-01

This article systematically reviews the research design and methodological characteristics of single-case experimental design (SCED) research published in peer-reviewed journals between 2000 and 2010. SCEDs provide researchers with a flexible and viable alternative to group designs with large sample sizes. However, methodological challenges have precluded widespread implementation and acceptance of the SCED as a viable complementary methodology to the predominant group design. This article includes a description of the research design, measurement, and analysis domains distinctive to the SCED; a discussion of the results within the framework of contemporary standards and guidelines in the field; and a presentation of updated benchmarks for key characteristics (e.g., baseline sampling, method of analysis), and overall, it provides researchers and reviewers with a resource for conducting and evaluating SCED research. The results of the systematic review of 409 studies suggest that recently published SCED research is largely in accordance with contemporary criteria for experimental quality. Analytic method emerged as an area of discord. Comparison of the findings of this review with historical estimates of the use of statistical analysis indicates an upward trend, but visual analysis remains the most common analytic method and also garners the most support amongst those entities providing SCED standards. Although consensus exists along key dimensions of single-case research design and researchers appear to be practicing within these parameters, there remains a need for further evaluation of assessment and sampling techniques and data analytic methods. PMID:22845874

Systematic Review of Economic Models Used to Compare Techniques for Detecting Peripheral Arterial Disease.

PubMed

Moloney, Eoin; O'Connor, Joanne; Craig, Dawn; Robalino, Shannon; Chrysos, Alexandros; Javanbakht, Mehdi; Sims, Andrew; Stansby, Gerard; Wilkes, Scott; Allen, John

2018-04-23

Peripheral arterial disease (PAD) is a common condition, in which atherosclerotic narrowing in the arteries restricts blood supply to the leg muscles. In order to support future model-based economic evaluations comparing methods of diagnosis in this area, a systematic review of economic modelling studies was conducted. A systematic literature review was performed in June 2017 to identify model-based economic evaluations of diagnostic tests to detect PAD, with six individual databases searched. The review was conducted in accordance with the methods outlined in the Centre for Reviews and Dissemination's guidance for undertaking reviews in healthcare, and appropriate inclusion criteria were applied. Relevant data were extracted, and studies were quality assessed. Seven studies were included in the final review, all of which were published between 1995 and 2014. There was wide variation in the types of diagnostic test compared. The majority of the studies (six of seven) referenced the sources used to develop their model, and all studies stated and justified the structural assumptions. Reporting of the data within the included studies could have been improved. Only one identified study focused on the cost-effectiveness of a test typically used in primary care. This review brings together all applied modelling methods for tests used in the diagnosis of PAD, which could be used to support future model-based economic evaluations in this field. The limited modelling work available on tests typically used for the detection of PAD in primary care, in particular, highlights the importance of future work in this area.

A Systematic Review of Measurement Properties of Patient-Reported Outcome Measures Used in Patients Undergoing Total Knee Arthroplasty.

PubMed

Gagnier, Joel J; Mullins, Megan; Huang, Hsiaomin; Marinac-Dabic, Danica; Ghambaryan, Anna; Eloff, Benjamin; Mirza, Faisal; Bayona, Manuel

2017-05-01

While clinical research on total knee arthroplasty (TKA) outcomes is prevalent in the literature, studies often have poor methodological and reporting quality. A high-quality patient-reported outcome instrument is reliable, valid, and responsive. Many studies evaluate these properties, but none have done so with a systematic and accepted method. The objectives of this study were to identify patient-reported outcome measures (PROMs) for TKA, and to critically appraise, compare, and summarize their psychometric properties using accepted methods. MEDLINE, EMBASE, SCOPUS, Web of Science, PsycINFO, and SPORTDiscus were systematically searched for articles with the following inclusion criteria: publication before December 2014, English language, non-generic PRO, and evaluation in the TKA population. Methodological quality and evidence of psychometric properties were assessed with the COnsensus-based standards for the selection of health Status Measurement INstruments (COSMIN) checklist and criteria for psychometric evidence proposed by the COSMIN group and Terwee et al. One-hundred fifteen studies on 32 PROMs were included in this review. Only the Work, Osteoarthritis or joint-Replacement Questionnaire, the Oxford Knee Score, and the Western Ontario and McMaster Universities Arthritis Index had 4 or more properties with positive evidence. Most TKA PROMs have limited evidence for their psychometric properties. Although not all the properties were studied, the Work, Osteoarthritis or joint-Replacement Questionnaire, with the highest overall ratings, could be a useful PROM for evaluating patients undergoing TKA. The methods and reporting of this literature can improve by following accepted guidelines. Published by Elsevier Inc.

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews.

PubMed

Mayo-Wilson, Evan; Ng, Sueko Matsumura; Chuck, Roy S; Li, Tianjing

2017-09-05

Systematic reviews should inform American Academy of Ophthalmology (AAO) Preferred Practice Pattern® (PPP) guidelines. The quality of systematic reviews related to the forthcoming Preferred Practice Pattern® guideline (PPP) Refractive Errors & Refractive Surgery is unknown. We sought to identify reliable systematic reviews to assist the AAO Refractive Errors & Refractive Surgery PPP. Systematic reviews were eligible if they evaluated the effectiveness or safety of interventions included in the 2012 PPP Refractive Errors & Refractive Surgery. To identify potentially eligible systematic reviews, we searched the Cochrane Eyes and Vision United States Satellite database of systematic reviews. Two authors identified eligible reviews and abstracted information about the characteristics and quality of the reviews independently using the Systematic Review Data Repository. We classified systematic reviews as "reliable" when they (1) defined criteria for the selection of studies, (2) conducted comprehensive literature searches for eligible studies, (3) assessed the methodological quality (risk of bias) of the included studies, (4) used appropriate methods for meta-analyses (which we assessed only when meta-analyses were reported), (5) presented conclusions that were supported by the evidence provided in the review. We identified 124 systematic reviews related to refractive error; 39 met our eligibility criteria, of which we classified 11 to be reliable. Systematic reviews classified as unreliable did not define the criteria for selecting studies (5; 13%), did not assess methodological rigor (10; 26%), did not conduct comprehensive searches (17; 44%), or used inappropriate quantitative methods (3; 8%). The 11 reliable reviews were published between 2002 and 2016. They included 0 to 23 studies (median = 9) and analyzed 0 to 4696 participants (median = 666). Seven reliable reviews (64%) assessed surgical interventions. Most systematic reviews of interventions for refractive error are low methodological quality. Following widely accepted guidance, such as Cochrane or Institute of Medicine standards for conducting systematic reviews, would contribute to improved patient care and inform future research.

Systematic review of systematic reviews for the management of urinary incontinence and promotion of continence using conservative behavioural approaches in older people in care homes.

PubMed

Roe, Brenda; Flanagan, Lisa; Maden, Michelle

2015-07-01

To synthesize evidence from systematic reviews on the management of urinary incontinence and promotion of continence using conservative/behavioural approaches in older people in care homes to inform clinical practice, guidelines and research. Incontinence is highly prevalent in older people in care home populations. Systematic review of systematic reviews with narrative synthesis. Electronic searches of published systematic reviews in English using MEDLINE and CINAHL with no date restrictions up to September 2013. Searches supplemented by hand searching and electronic searching of Cochrane Library and PROSPERO. PRISMA statement was followed, as were established methods for systematic review of systematic reviews. Five systematic reviews of high quality were included, three specific to intervention studies and two reviewed descriptive studies. Urinary incontinence was the primary outcome in three reviews with factors associated with the management of urinary incontinence the primary outcome for the other reviews. Toileting programmes, in particular prompted voiding, with use of incontinence pads are the main conservative behavioural approach for the management of incontinence and promotion of continence in this population with evidence of effectiveness in the short term. Evidence from associated factors; exercise, mobility, comorbidities, hydration, skin care, staff perspectives, policies and older people's experiences and preference are limited. The majority of evidence of effectiveness are from studies from one country which may or may not be transferable to other care home populations. Future international studies are warranted of complex combined interventions using mixed methods to provide evidence of effectiveness, context of implementation and economic evaluation. © 2015 John Wiley & Sons Ltd.

The Evaluation of Hospital Performance in Iran: A Systematic Review Article.

PubMed

Bahadori, Mohammadkarim; Izadi, Ahmad Reza; Ghardashi, Fatemeh; Ravangard, Ramin; Hosseini, Seyed Mojtaba

2016-07-01

This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them.

Measuring the impact of medicines regulatory interventions - Systematic review and methodological considerations.

PubMed

Goedecke, Thomas; Morales, Daniel R; Pacurariu, Alexandra; Kurz, Xavier

2018-03-01

Evaluating the public health impact of regulatory interventions is important but there is currently no common methodological approach to guide this evaluation. This systematic review provides a descriptive overview of the analytical methods for impact research. We searched MEDLINE and EMBASE for articles with an empirical analysis evaluating the impact of European Union or non-European Union regulatory actions to safeguard public health published until March 2017. References from systematic reviews and articles from other known sources were added. Regulatory interventions, data sources, outcomes of interest, methodology and key findings were extracted. From 1246 screened articles, 229 were eligible for full-text review and 153 articles in English language were included in the descriptive analysis. Over a third of articles studied analgesics and antidepressants. Interventions most frequently evaluated are regulatory safety communications (28.8%), black box warnings (23.5%) and direct healthcare professional communications (10.5%); 55% of studies measured changes in drug utilization patterns, 27% evaluated health outcomes, and 18% targeted knowledge, behaviour or changes in clinical practice. Unintended consequences like switching therapies or spill-over effects were rarely evaluated. Two-thirds used before-after time series and 15.7% before-after cross-sectional study designs. Various analytical approaches were applied including interrupted time series regression (31.4%), simple descriptive analysis (28.8%) and descriptive analysis with significance tests (23.5%). Whilst impact evaluation of pharmacovigilance and product-specific regulatory interventions is increasing, the marked heterogeneity in study conduct and reporting highlights the need for scientific guidance to ensure robust methodologies are applied and systematic dissemination of results occurs. © 2017 The Authors. British Journal of Clinical Pharmacology published by John Wiley & Sons Ltd on behalf of British Pharmacological Society.

Systematic Diabetes Screening Using Point-of-Care HbA1c Testing Facilitates Identification of Prediabetes.

PubMed

Whitley, Heather P; Hanson, Courtney; Parton, Jason M

2017-03-01

This prospective longitudinal study compares diabetes screenings between standard practices vs systematically offered point-of-care (POC) hemoglobin A 1c (HbA 1c ) tests in patients aged 45 years or older. Systematically screened participants (n = 164) identified 63% (n = 104) with unknown hyperglycemia and 53% (n = 88) in prediabetes. The standard practice (n = 324) screened 22% (n = 73), most commonly by blood glucose (96%); 8% (n = 6) and 33% (n = 24) were found to have diabetes and prediabetes, respectively. The association between screening outcome and screening method was statistically significant ( P = 0.005) in favor of HbA 1C HbA 1c may be the most effective method to identify patients unknowingly living in hyperglycemia. Point-of-care tests further facilitate screening evaluation in a timely and feasible fashion. © 2017 Annals of Family Medicine, Inc.

Standardized assessment of psychosocial factors and their influence on medically confirmed health outcomes in workers: a systematic review.

PubMed

Rosário, Susel; Fonseca, João A; Nienhaus, Albert; da Costa, José Torres

2016-01-01

Previous studies of psychosocial work factors have indicated their importance for workers' health. However, to what extent health problems can be attributed to the nature of the work environment or other psychosocial factors is not clear. No previous systematic review has used inclusion criteria based on specific medical evaluation of work-related health outcomes and the use of validated instruments for the assessment of the psychosocial (work) environment. The aim of this systematic review is to summarize the evidence assessing the relationship between the psychosocial work environment and workers' health based on studies that used standardized and validated instruments to assess the psychosocial work environment and that focused on medically confirmed health outcomes. A systematic review of the literature was carried out by searching the databases PubMed, B-ON, Science Direct, Psycarticles, Psychology and Behavioral Sciences Collection and the search engine (Google Scholar) using appropriate words for studies published from 2004 to 2014. This review follows the recommendations of the Statement for Reporting Systematic Reviews (PRISMA). Studies were included in the review if data on psychosocial validated assessment method(s) for the study population and specific medical evaluation of health-related work outcome(s) were presented. In total, the search strategy yielded 10,623 references, of which 10 studies (seven prospective cohort and three cross-sectional) met the inclusion criteria. Most studies (7/10) observed an adverse effect of poor psychosocial work factors on workers' health: 3 on sickness absence, 4 on cardiovascular diseases. The other 3 studies reported detrimental effects on sleep and on disease-associated biomarkers. A more consistent effect was observed in studies of higher methodological quality that used a prospective design jointly with the use of validated instruments for the assessment of the psychosocial (work) environment and clinical evaluation. More prospective studies are needed to assess the evidence of work-related psychosocial factors on workers´ health.

Evidence-based Nursing Education - a Systematic Review of Empirical Research

PubMed Central

Reiber, Karin

2011-01-01

The project „Evidence-based Nursing Education – Preparatory Stage“, funded by the Landesstiftung Baden-Württemberg within the programme Impulsfinanzierung Forschung (Funding to Stimulate Research), aims to collect information on current research concerned with nursing education and to process existing data. The results of empirical research which has already been carried out were systematically evaluated with aim of identifying further topics, fields and matters of interest for empirical research in nursing education. In the course of the project, the available empirical studies on nursing education were scientifically analysed and systematised. The over-arching aim of the evidence-based training approach – which extends beyond the aims of this project - is the conception, organisation and evaluation of vocational training and educational processes in the caring professions on the basis of empirical data. The following contribution first provides a systematic, theoretical link to the over-arching reference framework, as the evidence-based approach is adapted from thematically related specialist fields. The research design of the project is oriented towards criteria introduced from a selection of studies and carries out a two-stage systematic review of the selected studies. As a result, the current status of research in nursing education, as well as its organisation and structure, and questions relating to specialist training and comparative education are introduced and discussed. Finally, the empirical research on nursing training is critically appraised as a complementary element in educational theory/psychology of learning and in the ethical tradition of research. This contribution aims, on the one hand, to derive and describe the methods used, and to introduce the steps followed in gathering and evaluating the data. On the other hand, it is intended to give a systematic overview of empirical research work in nursing education. In order to preserve a holistic view of the research field and methods, detailed individual findings are not included. PMID:21818237

A systematic review of health economic evaluations of vaccines in Brazil

PubMed Central

2017-01-01

ABSTRACT Background: In Brazil, since 2005, the Ministry of Health requires Health Economic Evaluation (HEE) of vaccines for introduction into the National Immunization Program. Objectives: To describe and analyze the full HEE on vaccines conducted in Brazil from 1980 to 2013. Methods: Systematic review of the literature. We searched multiple databases. Two researchers independently selected the studies and extracted the data. The methodological quality of individual studies was evaluated using CHEERS items. Results: Twenty studies were reviewed. The most evaluated vaccines were pneumococcal (25%) and HPV (15%). The most used types of HEE were cost-effectiveness analysis (45%) and cost-utility analysis (20%). The research question and compared strategies were stated in all 20 studies and the target population was clear in 95%. Nevertheless, many studies did not inform the perspective of analysis or data sources. Conclusions: HEE of vaccines in Brazil has increased since 2008. However, the studies still have methodological deficiencies. PMID:28129026

PERT and CPM: A Comparison with Implications for Education.

ERIC Educational Resources Information Center

Ragan, Stephen W.

Two systematic ways of analyzing and planning the components of a program or project, both used extensively by industry and government, are discussed in this paper. The methods are Program Evaluation and Review Technique (PERT) Networks and Critical Path Method (CPM) Arrow Diagrams. The purposes of this paper are (1) to explore the need for…

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery

PubMed Central

Gudlaugsdottir, Katrin; Andrews, James

2017-01-01

Objective Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality. Background Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated. Methods Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality. Results 112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression. Conclusions There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians. PMID:28384296

Micro-costing studies in the health and medical literature: protocol for a systematic review

PubMed Central

2014-01-01

Background Micro-costing is a cost estimation method that allows for precise assessment of the economic costs of health interventions. It has been demonstrated to be particularly useful for estimating the costs of new interventions, for interventions with large variability across providers, and for estimating the true costs to the health system and to society. However, existing guidelines for economic evaluations do not provide sufficient detail of the methods and techniques to use when conducting micro-costing analyses. Therefore, the purpose of this study is to review the current literature on micro-costing studies of health and medical interventions, strategies, and programs to assess the variation in micro-costing methodology and the quality of existing studies. This will inform current practice in conducting and reporting micro-costing studies and lead to greater standardization in methodology in the future. Methods/Design We will perform a systematic review of the current literature on micro-costing studies of health and medical interventions, strategies, and programs. Using rigorously designed search strategies, we will search Ovid MEDLINE, EconLit, BIOSIS Previews, Embase, Scopus, and the National Health Service Economic Evaluation Database (NHS EED) to identify relevant English-language articles. These searches will be supplemented by a review of the references of relevant articles identified. Two members of the review team will independently extract detailed information on the design and characteristics of each included article using a standardized data collection form. A third reviewer will be consulted to resolve discrepancies. We will use checklists that have been developed for critical appraisal of health economics studies to evaluate the quality and potential risk of bias of included studies. Discussion This systematic review will provide useful information to help standardize the methods and techniques for conducting and reporting micro-costing studies in research, which can improve the quality and transparency of future studies and enhance comparability and interpretation of findings. In the long run, these efforts will facilitate clinical and health policy decision-making about resource allocation. Trial registration Systematic review registration: PROSPERO CRD42014007453. PMID:24887208

Non-Surgical Interventions for Adolescents with Idiopathic Scoliosis: An Overview of Systematic Reviews

PubMed Central

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Background Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Objectives Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Design Systematic overview of systematic reviews. Methods Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute’s hierarchies were applied to analyze the levels of evidence from included reviews. Results From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Conclusions Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. Protocol registry number CRD42013003538, PROSPERO PMID:25353954

Development and evaluation of 'briefing notes' as a novel knowledge translation tool to aid the implementation of sex/gender analysis in systematic reviews: a pilot study.

PubMed

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E; Shea, Beverley; O'Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly 'briefing note' format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group's focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can assist systematic reviewers in ensuring the applicability of research evidence, with the goal of improved health outcomes for diverse populations.

Fracture control methods for space vehicles. Volume 1: Fracture control design methods. [for space shuttle configuration planning

NASA Technical Reports Server (NTRS)

Liu, A. F.

1974-01-01

A systematic approach for applying methods for fracture control in the structural components of space vehicles consists of four major steps. The first step is to define the primary load-carrying structural elements and the type of load, environment, and design stress levels acting upon them. The second step is to identify the potential fracture-critical parts by means of a selection logic flow diagram. The third step is to evaluate the safe-life and fail-safe capabilities of the specified part. The last step in the sequence is to apply the control procedures that will prevent damage to the fracture-critical parts. The fracture control methods discussed include fatigue design and analysis methods, methods for preventing crack-like defects, fracture mechanics analysis methods, and nondestructive evaluation methods. An example problem is presented for evaluation of the safe-crack-growth capability of the space shuttle crew compartment skin structure.

A Youth Suicide Prevention Plan for Canada: A Systematic Review of Reviews

PubMed Central

Bennett, Kathryn; Rhodes, Anne E; Duda, Stephanie; Cheung, Amy H; Manassis, Katharina; Links, Paul; Mushquash, Christopher; Braunberger, Peter; Newton, Amanda S; Kutcher, Stanley; Bridge, Jeffrey A; Santos, Robert G; Manion, Ian G; McLennan, John D; Bagnell, Alexa; Lipman, Ellen; Rice, Maureen; Szatmari, Peter

2015-01-01

Objective: We conducted an expedited knowledge synthesis (EKS) to facilitate evidence-informed decision making concerning youth suicide prevention, specifically school-based strategies and nonschool-based interventions designed to prevent repeat attempts. Methods: Systematic review of review methods were applied. Inclusion criteria were as follows: systematic review or meta-analysis; prevention in youth 0 to 24 years; peer-reviewed English literature. Review quality was determined with AMSTAR (a measurement tool to assess systematic reviews). Nominal group methods quantified consensus on recommendations derived from the findings. Results: No included review addressing school-based prevention (n = 7) reported decreased suicide death rates based on randomized controlled trials (RCTs) or controlled cohort studies (CCSs), but reduced suicide attempts, suicidal ideation, and proxy measures of suicide risk were reported (based on RCTs and CCSs). Included reviews addressing prevention of repeat suicide attempts (n = 14) found the following: emergency department transition programs may reduce suicide deaths, hospitalizations, and treatment nonadherence (based on RCTs and CCSs); training primary care providers in depression treatment may reduce repeated attempts (based on one RCT); antidepressants may increase short-term suicide risk in some patients (based on RCTs and meta-analyses); this increase is offset by overall population-based reductions in suicide associated with antidepressant treatment of youth depression (based on observational studies); and prevention with psychosocial interventions requires further evaluation. No review addressed sex or gender differences systematically, Aboriginal youth as a special population, harm, or cost-effectiveness. Consensus on 6 recommendations ranged from 73% to 100%. Conclusions: Our EKS facilitates decision maker access to what is known about effective youth suicide prevention interventions. A national research-to-practice network that links researchers and decision makers is recommended to implement and evaluate promising interventions; to eliminate the use of ineffective or harmful interventions; and to clarify prevention intervention effects on death by suicide, suicide attempts, and suicidal ideation. Such a network could position Canada as a leader in youth suicide prevention. PMID:26175322

Evaluation of Different Scoring Rules for a Noncognitive Test in Development. Research Report. ETS RR-16-03

ERIC Educational Resources Information Center

Guo, Hongwen; Zu, Jiyun; Kyllonen, Patrick; Schmitt, Neal

2016-01-01

In this report, systematic applications of statistical and psychometric methods are used to develop and evaluate scoring rules in terms of test reliability. Data collected from a situational judgment test are used to facilitate the comparison. For a well-developed item with appropriate keys (i.e., the correct answers), agreement among various…

Is Performance Feedback for Educators an Evidence-Based Practice? A Systematic Review and Evaluation Based on Single-Case Research

ERIC Educational Resources Information Center

Fallon, Lindsay M.; Collier-Meek, Melissa A.; Maggin, Daniel M.; Sanetti, Lisa M. H.; Johnson, Austin H.

2015-01-01

Optimal levels of treatment fidelity, a critical moderator of intervention effectiveness, are often difficult to sustain in applied settings. It is unknown whether performance feedback, a widely researched method for increasing educators' treatment fidelity, is an evidence-based practice. The purpose of this review was to evaluate the current…

A Comparison of Three Methods for the Analysis of Skin Flap Viability: Reliability and Validity.

PubMed

Tim, Carla Roberta; Martignago, Cintia Cristina Santi; da Silva, Viviane Ribeiro; Dos Santos, Estefany Camila Bonfim; Vieira, Fabiana Nascimento; Parizotto, Nivaldo Antonio; Liebano, Richard Eloin

2018-05-01

Objective: Technological advances have provided new alternatives to the analysis of skin flap viability in animal models; however, the interrater validity and reliability of these techniques have yet to be analyzed. The present study aimed to evaluate the interrater validity and reliability of three different methods: weight of paper template (WPT), paper template area (PTA), and photographic analysis. Approach: Sixteen male Wistar rats had their cranially based dorsal skin flap elevated. On the seventh postoperative day, the viable tissue area and the necrotic area of the skin flap were recorded using the paper template method and photo image. The evaluation of the percentage of viable tissue was performed using three methods, simultaneously and independently by two raters. The analysis of interrater reliability and viability was performed using the intraclass correlation coefficient and Bland Altman Plot Analysis was used to visualize the presence or absence of systematic bias in the evaluations of data validity. Results: The results showed that interrater reliability for WPT, measurement of PTA, and photographic analysis were 0.995, 0.990, and 0.982, respectively. For data validity, a correlation >0.90 was observed for all comparisons made between the three methods. In addition, Bland Altman Plot Analysis showed agreement between the comparisons of the methods and the presence of systematic bias was not observed. Innovation: Digital methods are an excellent choice for assessing skin flap viability; moreover, they make data use and storage easier. Conclusion: Independently from the method used, the interrater reliability and validity proved to be excellent for the analysis of skin flaps' viability.

Product Quality Research Institute evaluation of cascade impactor profiles of pharmaceutical aerosols: part 2--evaluation of a method for determining equivalence.

PubMed

Christopher, David; Adams, Wallace P; Lee, Douglas S; Morgan, Beth; Pan, Ziqing; Singh, Gur Jai Pal; Tsong, Yi; Lyapustina, Svetlana

2007-01-19

The purpose of this article is to present the thought process, methods, and interim results of a PQRI Working Group, which was charged with evaluating the chi-square ratio test as a potential method for determining in vitro equivalence of aerodynamic particle size distribution (APSD) profiles obtained from cascade impactor measurements. Because this test was designed with the intention of being used as a tool in regulatory review of drug applications, the capability of the test to detect differences in APSD profiles correctly and consistently was evaluated in a systematic way across a designed space of possible profiles. To establish a "base line," properties of the test in the simplest case of pairs of identical profiles were studied. Next, the test's performance was studied with pairs of profiles, where some difference was simulated in a systematic way on a single deposition site using realistic product profiles. The results obtained in these studies, which are presented in detail here, suggest that the chi-square ratio test in itself is not sufficient to determine equivalence of particle size distributions. This article, therefore, introduces the proposal to combine the chi-square ratio test with a test for impactor-sized mass based on Population Bioequivalence and describes methods for evaluating discrimination capabilities of the combined test. The approaches and results described in this article elucidate some of the capabilities and limitations of the original chi-square ratio test and provide rationale for development of additional tests capable of comparing APSD profiles of pharmaceutical aerosols.

Evidence-Based Practice for the Use of Internal Strategies as a Memory Compensation Technique After Brain Injury: A Systematic Review.

PubMed

OʼNeil-Pirozzi, Therese M; Kennedy, Mary R T; Sohlberg, McKay M

2016-01-01

To complete a systematic review of internal memory strategy use with people who have brain injury and provide practitioners with information that will impact their clinical work. A systematic literature search to identify published intervention studies that evaluated an internal memory strategy or technique to improve memory function of individuals with brain injury. Relevant data from reviewed articles were coded using 4 clinical questions targeting participants, interventions, research methods, and outcomes. A comprehensive search identified 130 study citations and abstracts. Forty-six met inclusion/exclusion criteria and were systematically reviewed. Visual imagery was most frequently studied, in isolation or in combination with other internal strategies. Despite significant variability in research methods and outcomes across studies, the evidence provides impetus for use of internal memory strategies with individuals following brain injury. Individuals with traumatic brain injury may benefit from internal memory strategy use, and clinicians should consider internal memory strategy instruction as part of intervention plans. Further research needs to better delineate influences on intervention candidacy and outcomes.

GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods.

PubMed

Schaffter, Thomas; Marbach, Daniel; Floreano, Dario

2011-08-15

Over the last decade, numerous methods have been developed for inference of regulatory networks from gene expression data. However, accurate and systematic evaluation of these methods is hampered by the difficulty of constructing adequate benchmarks and the lack of tools for a differentiated analysis of network predictions on such benchmarks. Here, we describe a novel and comprehensive method for in silico benchmark generation and performance profiling of network inference methods available to the community as an open-source software called GeneNetWeaver (GNW). In addition to the generation of detailed dynamical models of gene regulatory networks to be used as benchmarks, GNW provides a network motif analysis that reveals systematic prediction errors, thereby indicating potential ways of improving inference methods. The accuracy of network inference methods is evaluated using standard metrics such as precision-recall and receiver operating characteristic curves. We show how GNW can be used to assess the performance and identify the strengths and weaknesses of six inference methods. Furthermore, we used GNW to provide the international Dialogue for Reverse Engineering Assessments and Methods (DREAM) competition with three network inference challenges (DREAM3, DREAM4 and DREAM5). GNW is available at http://gnw.sourceforge.net along with its Java source code, user manual and supporting data. Supplementary data are available at Bioinformatics online. dario.floreano@epfl.ch.

Computer-Aided Evaluation of Blood Vessel Geometry From Acoustic Images.

PubMed

Lindström, Stefan B; Uhlin, Fredrik; Bjarnegård, Niclas; Gylling, Micael; Nilsson, Kamilla; Svensson, Christina; Yngman-Uhlin, Pia; Länne, Toste

2018-04-01

A method for computer-aided assessment of blood vessel geometries based on shape-fitting algorithms from metric vision was evaluated. Acoustic images of cross sections of the radial artery and cephalic vein were acquired, and medical practitioners used a computer application to measure the wall thickness and nominal diameter of these blood vessels with a caliper method and the shape-fitting method. The methods performed equally well for wall thickness measurements. The shape-fitting method was preferable for measuring the diameter, since it reduced systematic errors by up to 63% in the case of the cephalic vein because of its eccentricity. © 2017 by the American Institute of Ultrasound in Medicine.

The Water-Energy-Food Nexus: A systematic review of methods for nexus assessment

NASA Astrophysics Data System (ADS)

Albrecht, Tamee R.; Crootof, Arica; Scott, Christopher A.

2018-04-01

The water-energy-food (WEF) nexus is rapidly expanding in scholarly literature and policy settings as a novel way to address complex resource and development challenges. The nexus approach aims to identify tradeoffs and synergies of water, energy, and food systems, internalize social and environmental impacts, and guide development of cross-sectoral policies. However, while the WEF nexus offers a promising conceptual approach, the use of WEF nexus methods to systematically evaluate water, energy, and food interlinkages or support development of socially and politically-relevant resource policies has been limited. This paper reviews WEF nexus methods to provide a knowledge base of existing approaches and promote further development of analytical methods that align with nexus thinking. The systematic review of 245 journal articles and book chapters reveals that (a) use of specific and reproducible methods for nexus assessment is uncommon (less than one-third); (b) nexus methods frequently fall short of capturing interactions among water, energy, and food—the very linkages they conceptually purport to address; (c) assessments strongly favor quantitative approaches (nearly three-quarters); (d) use of social science methods is limited (approximately one-quarter); and (e) many nexus methods are confined to disciplinary silos—only about one-quarter combine methods from diverse disciplines and less than one-fifth utilize both quantitative and qualitative approaches. To help overcome these limitations, we derive four key features of nexus analytical tools and methods—innovation, context, collaboration, and implementation—from the literature that reflect WEF nexus thinking. By evaluating existing nexus analytical approaches based on these features, we highlight 18 studies that demonstrate promising advances to guide future research. This paper finds that to address complex resource and development challenges, mixed-methods and transdisciplinary approaches are needed that incorporate social and political dimensions of water, energy, and food; utilize multiple and interdisciplinary approaches; and engage stakeholders and decision-makers.

Abstract analysis method facilitates filtering low-methodological quality and high-bias risk systematic reviews on psoriasis interventions.

PubMed

Gómez-García, Francisco; Ruano, Juan; Aguilar-Luque, Macarena; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesús; Hernández-Romero, José Luis; Sanz-Cabanillas, Juan Luis; Maestre-López, Beatriz; González-Padilla, Marcelino; Carmona-Fernández, Pedro J; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-29

Article summaries' information and structure may influence researchers/clinicians' decisions to conduct deeper full-text analyses. Specifically, abstracts of systematic reviews (SRs) and meta-analyses (MA) should provide structured summaries for quick assessment. This study explored a method for determining the methodological quality and bias risk of full-text reviews using abstract information alone. Systematic literature searches for SRs and/or MA about psoriasis were undertaken on MEDLINE, EMBASE, and Cochrane database. For each review, quality, abstract-reporting completeness, full-text methodological quality, and bias risk were evaluated using Preferred Reporting Items for Systematic Reviews and Meta-analyses for abstracts (PRISMA-A), Assessing the Methodological Quality of Systematic Reviews (AMSTAR), and ROBIS tools, respectively. Article-, author-, and journal-derived metadata were systematically extracted from eligible studies using a piloted template, and explanatory variables concerning abstract-reporting quality were assessed using univariate and multivariate-regression models. Two classification models concerning SRs' methodological quality and bias risk were developed based on per-item and total PRISMA-A scores and decision-tree algorithms. This work was supported, in part, by project ICI1400136 (JR). No funding was received from any pharmaceutical company. This study analysed 139 SRs on psoriasis interventions. On average, they featured 56.7% of PRISMA-A items. The mean total PRISMA-A score was significantly higher for high-methodological-quality SRs than for moderate- and low-methodological-quality reviews. SRs with low-bias risk showed higher total PRISMA-A values than reviews with high-bias risk. In the final model, only 'authors per review > 6' (OR: 1.098; 95%CI: 1.012-1.194), 'academic source of funding' (OR: 3.630; 95%CI: 1.788-7.542), and 'PRISMA-endorsed journal' (OR: 4.370; 95%CI: 1.785-10.98) predicted PRISMA-A variability. Reviews with a total PRISMA-A score < 6, lacking identification as SR or MA in the title, and lacking explanation concerning bias risk assessment methods were classified as low-methodological quality. Abstracts with a total PRISMA-A score ≥ 9, including main outcomes results and explanation bias risk assessment method were classified as having low-bias risk. The methodological quality and bias risk of SRs may be determined by abstract's quality and completeness analyses. Our proposal aimed to facilitate synthesis of evidence evaluation by clinical professionals lacking methodological skills. External validation is necessary.

Evaluation of three sampling methods to monitor outcomes of antiretroviral treatment programmes in low- and middle-income countries.

PubMed

Tassie, Jean-Michel; Malateste, Karen; Pujades-Rodríguez, Mar; Poulet, Elisabeth; Bennett, Diane; Harries, Anthony; Mahy, Mary; Schechter, Mauro; Souteyrand, Yves; Dabis, François

2010-11-10

Retention of patients on antiretroviral therapy (ART) over time is a proxy for quality of care and an outcome indicator to monitor ART programs. Using existing databases (Antiretroviral in Lower Income Countries of the International Databases to Evaluate AIDS and Médecins Sans Frontières), we evaluated three sampling approaches to simplify the generation of outcome indicators. We used individual patient data from 27 ART sites and included 27,201 ART-naive adults (≥15 years) who initiated ART in 2005. For each site, we generated two outcome indicators at 12 months, retention on ART and proportion of patients lost to follow-up (LFU), first using all patient data and then within a smaller group of patients selected using three sampling methods (random, systematic and consecutive sampling). For each method and each site, 500 samples were generated, and the average result was compared with the unsampled value. The 95% sampling distribution (SD) was expressed as the 2.5(th) and 97.5(th) percentile values from the 500 samples. Overall, retention on ART was 76.5% (range 58.9-88.6) and the proportion of patients LFU, 13.5% (range 0.8-31.9). Estimates of retention from sampling (n = 5696) were 76.5% (SD 75.4-77.7) for random, 76.5% (75.3-77.5) for systematic and 76.0% (74.1-78.2) for the consecutive method. Estimates for the proportion of patients LFU were 13.5% (12.6-14.5), 13.5% (12.6-14.3) and 14.0% (12.5-15.5), respectively. With consecutive sampling, 50% of sites had SD within ±5% of the unsampled site value. Our results suggest that random, systematic or consecutive sampling methods are feasible for monitoring ART indicators at national level. However, sampling may not produce precise estimates in some sites.

Evaluating stakeholder management performance using a stakeholder report card: the next step in theory and practice.

PubMed

Malvey, Donna; Fottler, Myron D; Slovensky, Donna J

2002-01-01

In the highly competitive health care environment, the survival of an organization may depend on how well powerful stakeholders are managed. Yet, the existing strategic stakeholder management process does not include evaluation of stakeholder management performance. To address this critical gap, this paper proposes a systematic method for evaluation using a stakeholder report card. An example of a physician report card based on this methodology is presented.

Identifying Obstacles and Research Gaps of Telemedicine Projects: Approach for a State-of-the-Art Analysis.

PubMed

Harst, Lorenz; Timpel, Patrick; Otto, Lena; Wollschlaeger, Bastian; Richter, Peggy; Schlieter, Hannes

2018-01-01

This paper presents an approach for an evaluation of finished telemedicine projects using qualitative methods. Telemedicine applications are said to improve the performance of health care systems. While there are countless telemedicine projects, the vast majority never makes the threshold from testing to implementation and diffusion. Projects were collected from German project databases in the area of telemedicine following systematically developed criteria. In a testing phase, ten projects were subject to a qualitative content analysis to identify limitations, need for further research, and lessons learned. Using Mayring's method of inductive category development, six categories of possible future research were derived. Thus, the proposed method is an important contribution to diffusion and translation research regarding telemedicine, as it is applicable to a systematic research of databases.

Curriculum Mapping in Academic Libraries

ERIC Educational Resources Information Center

Buchanan, Heidi; Webb, Katy Kavanagh; Houk, Amy Harris; Tingelstad, Catherine

2015-01-01

Librarians at four different academic institutions concurrently completed curriculum mapping projects using varying methods to analyze their information literacy instruction. Curriculum mapping is a process for systematically evaluating components of an instructional program for cohesiveness, proper sequencing, and goal achievement. There is a…

Estimating the Lifecycle of Pavement Markings on Primary And Secondary Roads in South Carolina

DOT National Transportation Integrated Search

2012-02-01

The absence of systematic procedures and standardized methods to quantitatively evaluate pavement marking materials on South Carolina's primary and secondary roads has made it difficult for the South Carolina Department of Transportation (SCDOT) to t...

Describing methods and interventions: a protocol for the systematic analysis of the perioperative quality improvement literature.

PubMed

Jones, Emma; Lees, Nicholas; Martin, Graham; Dixon-Woods, Mary

2014-09-05

Quality improvement (QI) methods are widely used in surgery in an effort to improve care, often using techniques such as Plan-Do-Study-Act cycles to implement specific interventions. Explicit definition of both the QI method and quality intervention is necessary to enable the accurate replication of effective interventions in practice, facilitate cumulative learning, reduce research waste and optimise benefits to patients. This systematic review aims to assess quality of reporting of QI methods and quality interventions in perioperative care. Studies reporting on quality interventions implemented in perioperative care settings will be identified. Searches will be conducted in the Ovid SP version of Medline, Scopus, the Cochrane Central Register of Controlled Trials, the Cochrane Effective Practice and Organisation of Care database and the related articles function of PubMed. The journal BMJ Quality will be searched separately. Search strategy terms will relate to (i) surgery, (ii) QI and (iii) evaluation methods. Explicit exclusion and inclusion criteria will be applied. Data from studies will be extracted using a data extraction form. The Template for Intervention Description and Replication (TIDieR) checklist will be used to evaluate quality of reporting, together with additional items aimed at assessing QI methods specifically. PROSPERO http://CRD42014012845.

Study sensitivity: Evaluating the ability to detect effects in systematic reviews of chemical exposures.

PubMed

Cooper, Glinda S; Lunn, Ruth M; Ågerstrand, Marlene; Glenn, Barbara S; Kraft, Andrew D; Luke, April M; Ratcliffe, Jennifer M

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as "sensitivity", is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and sensitivity can be used to identify the most informative studies, to evaluate the confidence of the findings from individual studies and to identify those study elements that may help to explain heterogeneity across the body of literature. Copyright © 2016. Published by Elsevier Ltd.

Measurement properties of existing clinical assessment methods evaluating scapular positioning and function. A systematic review.

PubMed

Larsen, Camilla Marie; Juul-Kristensen, Birgit; Lund, Hans; Søgaard, Karen

2014-10-01

The aims were to compile a schematic overview of clinical scapular assessment methods and critically appraise the methodological quality of the involved studies. A systematic, computer-assisted literature search using Medline, CINAHL, SportDiscus and EMBASE was performed from inception to October 2013. Reference lists in articles were also screened for publications. From 50 articles, 54 method names were identified and categorized into three groups: (1) Static positioning assessment (n = 19); (2) Semi-dynamic (n = 13); and (3) Dynamic functional assessment (n = 22). Fifteen studies were excluded for evaluation due to no/few clinimetric results, leaving 35 studies for evaluation. Graded according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN checklist), the methodological quality in the reliability and validity domains was "fair" (57%) to "poor" (43%), with only one study rated as "good". The reliability domain was most often investigated. Few of the assessment methods in the included studies that had "fair" or "good" measurement property ratings demonstrated acceptable results for both reliability and validity. We found a substantially larger number of clinical scapular assessment methods than previously reported. Using the COSMIN checklist the methodological quality of the included measurement properties in the reliability and validity domains were in general "fair" to "poor". None were examined for all three domains: (1) reliability; (2) validity; and (3) responsiveness. Observational evaluation systems and assessment of scapular upward rotation seem suitably evidence-based for clinical use. Future studies should test and improve the clinimetric properties, and especially diagnostic accuracy and responsiveness, to increase utility for clinical practice.

How comprehensive are research studies investigating the efficacy of technology-enhanced learning resources in anatomy education? A systematic review.

PubMed

Clunie, Lauren; Morris, Neil P; Joynes, Viktoria C T; Pickering, James D

2018-05-06

Anatomy education is at the forefront of integrating innovative technologies into its curricula. However, despite this rise in technology numerous authors have commented on the shortfall in efficacy studies to assess the impact such technology-enhanced learning (TEL) resources have on learning. To assess the range of evaluation approaches to TEL across anatomy education, a systematic review was conducted using MEDLINE, the Educational Resources Information Centre (ERIC), Scopus, and Google Scholar, with a total of 3,345 articles retrieved. Following the PRISMA method for reporting items, 153 articles were identified and reviewed against a published framework-the technology-enhanced learning evaluation model (TELEM). The model allowed published reports to be categorized according to evaluations at the level of (1) learner satisfaction, (2) learning gain, (3) learner impact, and (4) institutional impact. The results of this systematic review reveal that most evaluation studies into TEL within anatomy curricula were based on learner satisfaction, followed by module or course learning outcomes. Randomized controlled studies assessing learning gain with a specific TEL resource were in a minority, with no studies reporting a comprehensive assessment on the overall impact of introducing a specific TEL resource (e.g., return on investment). This systematic review has provided clear evidence that anatomy education is engaged in evaluating the impact of TEL resources on student education, although it remains at a level that fails to provide comprehensive causative evidence. Anat Sci Educ 11: 303-319. © 2017 American Association of Anatomists. © 2017 American Association of Anatomists.

The systematic assessment of traditional evidence from the premodern Chinese medical literature: a text-mining approach.

PubMed

May, Brian H; Zhang, Anthony; Lu, Yubo; Lu, Chuanjian; Xue, Charlie C L

2014-12-01

This project aimed to develop an approach to evaluating information contained in the premodern Traditional Chinese Medicine (TCM) literature that was (1) comprehensive, systematic, and replicable and (2) able to produce quantifiable output that could be used to answer specific research questions in order to identify natural products for clinical and experimental research. The project involved two stages. In stage 1, 14 TCM collections and compendia were evaluated for suitability as sources for searching; 8 of these were compared in detail. The results were published in the Journal of Alternative and Complementary Medicine. Stage 2 developed a text-mining approach for two of these sources. The text-mining approach was developed for Zhong Hua Yi Dian; Encyclopaedia of Traditional Chinese Medicine, 4th edition) and Zhong Yi Fang Ji Da Ci Dian; Great Compendium of Chinese Medical Formulae). This approach developed procedures for search term selection; methods for screening, classifying, and scoring data; procedures for systematic searching and data extraction; data checking procedures; and approaches for analyzing results. Examples are provided for studies of memory impairment and diabetic nephropathy, and issues relating to data interpretation are discussed. This approach to the analysis of large collections of the premodern TCM literature uses widely available sources and provides a text-mining approach that is systematic, replicable, and adaptable to the requirements of the particular project. Researchers can use these methods to explore changes in the names and conceptions of a disease over time, to identify which therapeutic methods have been more or less frequently used in different eras for particular disorders, and to assist in the selection of natural products for research efforts.

Novel approaches and application of contemporary sensory evaluation practices in iron fortification programs

NASA Technical Reports Server (NTRS)

Bovell-Benjamin, Adelia C.; Guinard, Jean-Xavier

2003-01-01

Iron deficiency is the leading nutritional deficiency in the U.S. and the rest of the world, with its highest prevalences in the developing world. Iron fortification of food has been proposed as a strategy to reduce the high prevalence of iron deficiency. Poor consumer acceptance, unacceptable taste, and discoloration of the iron-fortified foods have been frequently listed as causes of unsuccessful iron fortification programs. An excellent prospect for improving consumer acceptance of iron-fortified foods is the incorporation of a thorough, organized, and unified approach to sensory evaluation practices into iron fortification programs for product optimization. The information gained from systematic sensory evaluation allows for the manipulation of the sensory attributes, and thus improvement of the sensory properties of the fortified food. However, iron fortification programs have not systematically measured the effect of fortification on the sensory quality of the food. Because sensory evaluation is an important criterion in successful iron fortification, an integrated approach is necessary. Therefore, nutritionists and sensory scientists should work closely with each other to select the most suitable sensory tests and methods. The objectives of this article are to: (1) critically review and discuss some traditional and contemporary approaches and applications of sensory evaluation practices in iron fortification programs, and (2) demonstrate the importance of incorporating a multidisciplinary, systematic sensory evaluation approach in iron fortification programs.

A systematic review of economic evaluations of local authority commissioned preventative public health interventions in overweight and obesity, physical inactivity, alcohol and illicit drugs use and smoking cessation in the United Kingdom.

PubMed

White, Pam; Skirrow, Helen; George, Abraham; Memon, Anjum

2018-02-16

Since 2013, local authorities in England have been responsible for commissioning preventative public health interventions. The aim of this systematic review was to support commissioning by collating published data on economic evaluations and modelling of local authority commissioned public health preventative interventions in the UK. Following the PRISMA protocol, we searched for economic evaluations of preventative intervention studies in four different areas: overweight and obesity, physical inactivity, alcohol and illicit drugs use and smoking cessation. The systematic review identified studies between January 1994 and February 2015, using five databases. We synthesized the studies to identify the key methods and examined results of the economic evaluations. The majority of the evaluations related to cost-effectiveness, rather than cost-benefit analyses or cost-utility analyses. These analyses found preventative interventions to be cost effective, though the context of the interventions differed between the studies. Preventative public health interventions in general are cost-effective. There is a need for further studies to support justification of continued and/or increased funding for public health interventions. There is much variation between the types of economically evaluated preventative interventions in our review. Broader studies incorporating different contexts may help support funding for local authority-sponsored public health initiatives.

Early economic evaluation of emerging health technologies: protocol of a systematic review.

PubMed

Pham, Ba'; Tu, Hong Anh Thi; Han, Dolly; Pechlivanoglou, Petros; Miller, Fiona; Rac, Valeria; Chin, Warren; Tricco, Andrea C; Paulden, Mike; Bielecki, Joanna; Krahn, Murray

2014-07-23

The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status. This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives.

Can Communicating Personalised Disease Risk Promote Healthy Behaviour Change? A Systematic Review of Systematic Reviews.

PubMed

French, David P; Cameron, Elaine; Benton, Jack S; Deaton, Christi; Harvie, Michelle

2017-10-01

The assessment and communication of disease risk that is personalised to the individual is widespread in healthcare contexts. Despite several systematic reviews of RCTs, it is unclear under what circumstances that personalised risk estimates promotes change in four key health-related behaviours: smoking, physical activity, diet and alcohol consumption. The present research aims to systematically identify, evaluate and synthesise the findings of existing systematic reviews. This systematic review of systematic reviews followed published guidance. A search of four databases and two-stage screening procedure with good reliability identified nine eligible systematic reviews. The nine reviews each included between three and 15 primary studies, containing 36 unique studies. Methods of personalising risk feedback included imaging/visual feedback, genetic testing, and numerical estimation from risk algorithms. The reviews were generally high quality. For a broad range of methods of estimating and communicating risk, the reviews found no evidence that risk information had strong or consistent effects on health-related behaviours. The most promising effects came from interventions using visual or imaging techniques and with smoking cessation and dietary behaviour as outcomes, but with inconsistent results. Few interventions explicitly used theory, few targeted self-efficacy or response efficacy, and a limited range of Behaviour Change Techniques were used. Presenting risk information on its own, even when highly personalised, does not produce strong effects on health-related behaviours or changes which are sustained. Future research in this area should build on the existing knowledge base about increasing the effects of risk communication on behaviour.

The new United Nations approach to sustainable development post-2015: Findings from four overviews of systematic reviews on interventions for sustainable development and health.

PubMed

Galvão, Luiz A C; Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Câmara, Volney Magalhães; Luiz, Ronir Raggio; Becerra-Posada, Francisco

2016-03-01

Objective To identify reported interventions that facilitate sustainable development and have had a positive impact on health in four areas: sustainable food production; sustainable energy use; sustainable jobs ("decent work"); and prevention of toxic exposure to chemicals. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations. A comprehensive search was conducted of at least 14 databases and 8 websites for each of the four overviews, using pre-defined protocols, including clear inclusion criteria. To qualify as "sustainable," interventions needed to aim (explicitly or implicitly) to positively impact at least two dimensions of the integrated framework for sustainable development and had to include measures of health impact. Results In total, 47 systematic reviews and 10 economic evaluations met the inclusion criteria. The most promising interventions, such as agricultural policies, were identified for each of the four topics. While the evidence for the interventions is not strong because of the limited number of studies, there is no evidence of a definite negative impact on health. The only possible exception is that of taxes and subsidies-though this intervention also has the potential to be pro-equity with higher relative impacts for lower income groups. Conclusions The evidence found for effective interventions is useful for guiding countries toward the best options for non-health sector interventions that can positively impact health. This overviews shows that intersectoral work benefits every sector involved.

Music Appreciation after Cochlear Implantation in Adult Patients: A Systematic Review.

PubMed

Riley, Phoebe E; Ruhl, Douglas S; Camacho, Macario; Tolisano, Anthony M

2018-06-01

Objective The cochlear implant (CI) improves quality of life for people who are severely and profoundly deafened, allowing implantees to perceive speech at levels similar to those of individuals with normal hearing. However, patients with CIs generally report a reduced appreciation of music after implantation. We aimed to systematically review the English-language literature for studies evaluating music enjoyment and perception among adult patients with CIs. Data Sources A systematic review of PubMed/MEDLINE, Scopus, Embase, and the Cochrane Library. Review Methods The PRISMA statement was utilized to identify English-language studies reporting music appreciation among adults with CIs. Two independent reviewers performed searches through May 2017. Included studies investigated parameters related to music enjoyment and music perception, including (1) pitch and timbre perception, (2) noise-canceling algorithms, and (3) the presence of dissonant chords, lyrics, or visual cues. Results A total of 508 articles were screened for relevance. Forty-one full-text articles were evaluated, and 18 met final inclusion criteria. Studies used heterogeneous methods of outcome measurement for identifying music appreciation. The outcome measures suggest that rhythm and lyrics are important components of enjoyment. Patients with CIs had difficulty with pitch and timbre perception. Conclusion The heterogeneous outcome measures identified in this systematic review suggest that rhythm and lyrics are important components of enjoyment, while patients with CIs had difficulty with pitch and timbre perception. Because there is no standardized reporting metric for music appreciation among adult patients with CIs, a standardized validated outcome-measuring tool is warranted.

Evaluation of Normalization Methods to Pave the Way Towards Large-Scale LC-MS-Based Metabolomics Profiling Experiments

PubMed Central

Valkenborg, Dirk; Baggerman, Geert; Vanaerschot, Manu; Witters, Erwin; Dujardin, Jean-Claude; Burzykowski, Tomasz; Berg, Maya

2013-01-01

Abstract Combining liquid chromatography-mass spectrometry (LC-MS)-based metabolomics experiments that were collected over a long period of time remains problematic due to systematic variability between LC-MS measurements. Until now, most normalization methods for LC-MS data are model-driven, based on internal standards or intermediate quality control runs, where an external model is extrapolated to the dataset of interest. In the first part of this article, we evaluate several existing data-driven normalization approaches on LC-MS metabolomics experiments, which do not require the use of internal standards. According to variability measures, each normalization method performs relatively well, showing that the use of any normalization method will greatly improve data-analysis originating from multiple experimental runs. In the second part, we apply cyclic-Loess normalization to a Leishmania sample. This normalization method allows the removal of systematic variability between two measurement blocks over time and maintains the differential metabolites. In conclusion, normalization allows for pooling datasets from different measurement blocks over time and increases the statistical power of the analysis, hence paving the way to increase the scale of LC-MS metabolomics experiments. From our investigation, we recommend data-driven normalization methods over model-driven normalization methods, if only a few internal standards were used. Moreover, data-driven normalization methods are the best option to normalize datasets from untargeted LC-MS experiments. PMID:23808607

Methodology for applying monitored natural attenuation to petroleum hydrocarbon-contaminated ground-water systems with examples from South Carolina

USGS Publications Warehouse

Chapelle, Frank H.; Robertson, John F.; Landmeyer, James E.; Bradley, Paul M.

2000-01-01

These two sites illustrate how the efficiency of natural attenuation processes acting on petroleum hydrocarbons can be systematically evaluated using hydrologic, geochemical, and microbiologic methods.  These methods, in turn, can be used to assess the role that the natural attenuation of petroleum hydrocarbons can play in achieving overall site remediation.

How healthcare systems evaluate their advance care planning initiatives: Results from a systematic review.

PubMed

Biondo, Patricia D; Lee, Lydia D; Davison, Sara N; Simon, Jessica E

2016-09-01

Advance care planning initiatives are being implemented across healthcare systems around the world, but how best to evaluate their implementation is unknown. To identify gaps and/or redundancies in current evaluative strategies to help healthcare systems develop future evaluative frameworks for ACP. Systematic review. Peer-reviewed and gray literature searches were conducted till February 2015 to answer: "What methods have healthcare systems used to evaluate implementation of advance care planning initiatives?" A PICOS framework was developed to identify articles describing the implementation and evaluation of a health system-level advance care planning initiative. Outcome measures were mapped onto a conceptual quality indicator framework based on the Institute of Medicine and Donabedian models of healthcare quality. A total of 46 studies met inclusion criteria for analysis. Most articles reported on single parts of a healthcare system (e.g. continuing care). The most common outcome measures pertained to document completion, followed by healthcare resource use. Patient-, family-, or healthcare provider-reported outcomes were less commonly measured. Concordance measures (e.g. dying in place of choice) were reported by only 26% of studies. The conceptual quality indicator framework identified gaps and redundancies in measurement and is presented as a potential foundation from which to develop a comprehensive advance care planning evaluation framework. Document completion is frequently used to evaluate advance care planning program implementation; capturing the quality of care appears to be more difficult. This systematic review provides health system administrators with a comprehensive summary of measures used to evaluate advance care planning and may identify gaps in evaluation within their local context. © The Author(s) 2016.

Training Feedback Handbook. Research Product 83-7.

ERIC Educational Resources Information Center

Burnside, Billy L.; And Others

This handbook is designed to assist training developers and evaluators in structuring their collection of feedback data. Addressed first are various methods for collecting feedback data, including informal feedback, existing unit performance records, questionnaires, structured interviews, systematic observation, and testing. The next chapter, a…

Support Systems for Treatment Integrity

ERIC Educational Resources Information Center

Goense, Pauline Brigitta; Boendermaker, Leonieke; van Yperen, Tom

2016-01-01

Objective: This systematic review evaluates the content of effective support provided to practitioners of evidence-based interventions in order to establish and maintain treatment integrity. Method: Four articles covering six outcome studies are included in this review, these studies (1) adequately operationalized treatment integrity procedures…

Model‐based economic evaluations in smoking cessation and their transferability to new contexts: a systematic review

PubMed Central

Berg, Marrit L.; Cheung, Kei Long; Hiligsmann, Mickaël; Evers, Silvia; de Kinderen, Reina J. A.; Kulchaitanaroaj, Puttarin

2017-01-01

Abstract Aims To identify different types of models used in economic evaluations of smoking cessation, analyse the quality of the included models examining their attributes and ascertain their transferability to a new context. Methods A systematic review of the literature on the economic evaluation of smoking cessation interventions published between 1996 and April 2015, identified via Medline, EMBASE, National Health Service (NHS) Economic Evaluation Database (NHS EED), Health Technology Assessment (HTA). The checklist‐based quality of the included studies and transferability scores was based on the European Network of Health Economic Evaluation Databases (EURONHEED) criteria. Studies that were not in smoking cessation, not original research, not a model‐based economic evaluation, that did not consider adult population and not from a high‐income country were excluded. Findings Among the 64 economic evaluations included in the review, the state‐transition Markov model was the most frequently used method (n = 30/64), with quality adjusted life years (QALY) being the most frequently used outcome measure in a life‐time horizon. A small number of the included studies (13 of 64) were eligible for EURONHEED transferability checklist. The overall transferability scores ranged from 0.50 to 0.97, with an average score of 0.75. The average score per section was 0.69 (range = 0.35–0.92). The relative transferability of the studies could not be established due to a limitation present in the EURONHEED method. Conclusion All existing economic evaluations in smoking cessation lack in one or more key study attributes necessary to be fully transferable to a new context. PMID:28060453

A systematic review of economic evaluations of health and health-related interventions in Bangladesh

PubMed Central

2011-01-01

Background Economic evaluation is used for effective resource allocation in health sector. Accumulated knowledge about economic evaluation of health programs in Bangladesh is not currently available. While a number of economic evaluation studies have been performed in Bangladesh, no systematic investigation of the studies has been done to our knowledge. The aim of this current study is to systematically review the published articles in peer-reviewed journals on economic evaluation of health and health-related interventions in Bangladesh. Methods Literature searches was carried out during November-December 2008 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface. The first specific interest was mapping the articles considering the areas of exploration by economic evaluation and the second interest was to scrutiny the methodological quality of studies. The methodological quality of economic evaluation of all articles has been scrutinized against the checklist developed by Evers Silvia and associates. Result Of 1784 potential articles 12 were accepted for inclusion. Ten studies described the competing alternatives clearly and only two articles stated the perspective of their articles clearly. All studies included direct cost, incurred by the providers. Only one study included the cost of community donated resources and volunteer costs. Two studies calculated the incremental cost effectiveness ratio (ICER). Six of the studies applied some sort of sensitivity analysis. Two of the studies discussed financial affordability of expected implementers and four studies discussed the issue of generalizability for application in different context. Conclusion Very few economic evaluation studies in Bangladesh are found in different areas of health and health-related interventions, which does not provide a strong basis of knowledge in the area. The most frequently applied economic evaluation is cost-effectiveness analysis. The majority of the studies did not follow the scientific method of economic evaluation process, which consequently resulted into lack of robustness of the analyses. Capacity building on economic evaluation of health and health-related programs should be enhanced. PMID:21771343

Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review.

PubMed

Eysenbach, Gunther; Powell, John; Kuss, Oliver; Sa, Eun-Ryoung

The quality of consumer health information on the World Wide Web is an important issue for medicine, but to date no systematic and comprehensive synthesis of the methods and evidence has been performed. To establish a methodological framework on how quality on the Web is evaluated in practice, to determine the heterogeneity of the results and conclusions, and to compare the methodological rigor of these studies, to determine to what extent the conclusions depend on the methodology used, and to suggest future directions for research. We searched MEDLINE and PREMEDLINE (1966 through September 2001), Science Citation Index (1997 through September 2001), Social Sciences Citation Index (1997 through September 2001), Arts and Humanities Citation Index (1997 through September 2001), LISA (1969 through July 2001), CINAHL (1982 through July 2001), PsychINFO (1988 through September 2001), EMBASE (1988 through June 2001), and SIGLE (1980 through June 2001). We also conducted hand searches, general Internet searches, and a personal bibliographic database search. We included published and unpublished empirical studies in any language in which investigators searched the Web systematically for specific health information, evaluated the quality of Web sites or pages, and reported quantitative results. We screened 7830 citations and retrieved 170 potentially eligible full articles. A total of 79 distinct studies met the inclusion criteria, evaluating 5941 health Web sites and 1329 Web pages, and reporting 408 evaluation results for 86 different quality criteria. Two reviewers independently extracted study characteristics, medical domains, search strategies used, methods and criteria of quality assessment, results (percentage of sites or pages rated as inadequate pertaining to a quality criterion), and quality and rigor of study methods and reporting. Most frequently used quality criteria used include accuracy, completeness, readability, design, disclosures, and references provided. Fifty-five studies (70%) concluded that quality is a problem on the Web, 17 (22%) remained neutral, and 7 studies (9%) came to a positive conclusion. Positive studies scored significantly lower in search (P =.02) and evaluation (P =.04) methods. Due to differences in study methods and rigor, quality criteria, study population, and topic chosen, study results and conclusions on health-related Web sites vary widely. Operational definitions of quality criteria are needed.

Sequencing of hepatitis C virus for detection of resistance to direct-acting antiviral therapy: A systematic review.

PubMed

Bartlett, Sofia R; Grebely, Jason; Eltahla, Auda A; Reeves, Jacqueline D; Howe, Anita Y M; Miller, Veronica; Ceccherini-Silberstein, Francesca; Bull, Rowena A; Douglas, Mark W; Dore, Gregory J; Harrington, Patrick; Lloyd, Andrew R; Jacka, Brendan; Matthews, Gail V; Wang, Gary P; Pawlotsky, Jean-Michel; Feld, Jordan J; Schinkel, Janke; Garcia, Federico; Lennerstrand, Johan; Applegate, Tanya L

2017-07-01

The significance of the clinical impact of direct-acting antiviral (DAA) resistance-associated substitutions (RASs) in hepatitis C virus (HCV) on treatment failure is unclear. No standardized methods or guidelines for detection of DAA RASs in HCV exist. To facilitate further evaluations of the impact of DAA RASs in HCV, we conducted a systematic review of RAS sequencing protocols, compiled a comprehensive public library of sequencing primers, and provided expert guidance on the most appropriate methods to screen and identify RASs. The development of standardized RAS sequencing protocols is complicated due to a high genetic variability and the need for genotype- and subtype-specific protocols for multiple regions. We have identified several limitations of the available methods and have highlighted areas requiring further research and development. The development, validation, and sharing of standardized methods for all genotypes and subtypes should be a priority. ( Hepatology Communications 2017;1:379-390).

Photons Revisited

NASA Astrophysics Data System (ADS)

Batic, Matej; Begalli, Marcia; Han, Min Cheol; Hauf, Steffen; Hoff, Gabriela; Kim, Chan Hyeong; Kim, Han Sung; Grazia Pia, Maria; Saracco, Paolo; Weidenspointner, Georg

2014-06-01

A systematic review of methods and data for the Monte Carlo simulation of photon interactions is in progress: it concerns a wide set of theoretical modeling approaches and data libraries available for this purpose. Models and data libraries are assessed quantitatively with respect to an extensive collection of experimental measurements documented in the literature to determine their accuracy; this evaluation exploits rigorous statistical analysis methods. The computational performance of the associated modeling algorithms is evaluated as well. An overview of the assessment of photon interaction models and results of the experimental validation are presented.

Swallowing outcomes following Intensity Modulated Radiation Therapy (IMRT) for head & neck cancer - a systematic review.

PubMed

Roe, Justin W G; Carding, Paul N; Dwivedi, Raghav C; Kazi, Rehan A; Rhys-Evans, Peter H; Harrington, Kevin J; Nutting, Christopher M

2010-10-01

A systematic review to establish what evidence is available for swallowing outcomes following IMRT for head and neck cancer. Online electronic databases were searched to identify papers published in English from January 1998 to December 2009. Papers were independently appraised by two reviewers for methodological quality, method of swallowing evaluation and categorized according to the World Health Organisation's International Classification of Health Functions. The impact of radiation dose to dysphagia aspiration risk structures (DARS) was also evaluated. Sixteen papers met the inclusion criteria. The literature suggests that limiting the radiation dose to certain structures may result in favourable swallowing outcomes. Methodological limitations included variable assessment methods and outcome measures and heterogeneity of patients. There are only limited prospective data, especially where pre-treatment measures have been taken and compared to serial post-treatment assessment. Few studies have investigated the impact of IMRT on swallow function and the impact on everyday life. Initial studies have reported potential benefits but are limited in terms of study design and outcome data. Further well designed, prospective, longitudinal swallowing studies including multidimensional evaluation methods are required to enable a more comprehensive understanding of dysphagia complications and inform pre-treatment counselling and rehabilitation planning. Copyright © 2010 Elsevier Ltd. All rights reserved.

Systematic review; Nutritional therapy in gestational diabetes mellitus.

PubMed

Thomaz de Lima, Helaine; Lopes Rosado, Eliane; Ribeiro Neves, Paulo Augusto; Corrêa Monteiro Machado, Raphaela; Mello de Oliveira, Larissa; Saunders, Cláudia

2013-11-01

Several methods of dietetic counseling can be used in the nutritional therapy in gestational diabetes mellitus (GDM). The main methods are the traditional method (TM) and the carbohydrate counting (CCM). Presenting a systematic review of the literature on the impact of nutritional therapy in GDM, through TM and CCM, evaluating the results for maternal and child health. We searched databases PubMed, Scopus, Web of Science, Lilacs and CAPES Digital Bank of Thesis. The methodological quality of all the studies included was made using the Jadad score. We have found five studies that evaluated the effects of nutritional therapy, through the TM, on the maternal and child health. None study evaluating the CCM was detected in pregnant women with GDM Nutritional therapy given during antenatal care was effective in reducing pregnancy complications (preeclampsia, excessive gestational weight gain, necessity for cesarean delivery, for insulin therapy and for shoulder dystocia), perinatal complications (macrosomia, neonatal hypoglycemia, and birth weight) and also in better glycemic control. The use of nutritional therapy should be highlighted within the antenatal care for pregnant women with GDM, giving the satisfactory results on metabolic control and on pregnancy outcomes. Studies examining the CCM to GDM patients should be conducted to show its effects on maternal and child health.

Cost-effectiveness of Colorectal Cancer Screening and Treatment Methods: Mapping of Systematic Reviews.

PubMed

Abdolahi, Hossein Mashhadi; Asiabar, Ali Sarabi; Azami-Aghdash, Saber; Pournaghi-Azar, Fatemeh; Rezapour, Aziz

2018-01-01

Due to extensive literature on colorectal cancer and their heterogeneous results, this study aimed to summarize the systematic reviews which review the cost-effectiveness studies on different aspects of colorectal cancer. The required data were collected by searching the following key words according to MeSH: "colorectal cancer," "colorectal oncology," "colorectal carcinoma," "colorectal neoplasm," "colorectal tumors," "cost-effectiveness," "systematic review," and "meta-analysis." The following databases were searched: PubMed, Cochrane, Google Scholar, and Scopus. Two reviewers evaluated the articles according to the checklist of "assessment of multiple systematic reviews" (AMSTAR) tool. Finally, eight systematic reviews were included in the study. The Drummond checklist was mostly used for assessing the quality of the articles. The main perspective was related to the payer and the least was relevant to the social. The majority of the cases referred to sensitivity analysis (in 76% of the cases) and the lowest point also was allocated to discounting (in 37% of cases). The Markov model was used most widely in the studies. Treatment methods examined in the studies were not cost-effective in comparison with the studied units. Among the screening methods, computerized tomographic colonography and fecal DNA were cost-effective. The average score of the articles' qualities was high (9.8 out of 11). The community perspective should be taken into consideration at large in the studies. It is necessary to pay more attention to discounting subject in studies. More frequent application of the Markov model is recommended.

Diagnostic validity of methods for assessment of swallowing sounds: a systematic review.

PubMed

Taveira, Karinna Veríssimo Meira; Santos, Rosane Sampaio; Leão, Bianca Lopes Cavalcante de; Neto, José Stechman; Pernambuco, Leandro; Silva, Letícia Korb da; De Luca Canto, Graziela; Porporatti, André Luís

2018-02-03

Oropharyngeal dysphagia is a highly prevalent comorbidity in neurological patients and presents a serious health threat, which may lead to outcomes of aspiration pneumonia, ranging from hospitalization to death. This assessment proposes a non-invasive, acoustic-based method to differentiate between individuals with and without signals of penetration and aspiration. This systematic review evaluated the diagnostic validity of different methods for assessment of swallowing sounds, when compared to Videofluroscopic of Swallowing Study (VFSS) to detect oropharyngeal dysphagia. Articles in which the primary objective was to evaluate the accuracy of swallowing sounds were searched in five electronic databases with no language or time limitations. Accuracy measurements described in the studies were transformed to construct receiver operating characteristic curves and forest plots with the aid of Review Manager v. 5.2 (The Nordic Cochrane Centre, Copenhagen, Denmark). The methodology of the selected studies was evaluated using the Quality Assessment Tool for Diagnostic Accuracy Studies-2. The final electronic search revealed 554 records, however only 3 studies met the inclusion criteria. The accuracy values (area under the curve) were 0.94 for microphone, 0.80 for Doppler, and 0.60 for stethoscope. Based on limited evidence and low methodological quality because few studies were included, with a small sample size, from all index testes found for this systematic review, Doppler showed excellent diagnostic accuracy for the discrimination of swallowing sounds, whereas microphone-reported good accuracy discrimination of swallowing sounds of dysphagic patients and stethoscope showed best screening test. Copyright © 2018 Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial. Published by Elsevier Editora Ltda. All rights reserved.

Methods of classification for women undergoing induction of labour: a systematic review and novel classification system.

PubMed

Nippita, T A; Khambalia, A Z; Seeho, S K; Trevena, J A; Patterson, J A; Ford, J B; Morris, J M; Roberts, C L

2015-09-01

A lack of reproducible methods for classifying women having an induction of labour (IOL) has led to controversies regarding IOL and related maternal and perinatal health outcomes. To evaluate articles that classify IOL and to develop a novel IOL classification system. Electronic searches using CINAHL, EMBASE, WEB of KNOWLEDGE, and reference lists. Two reviewers independently assessed studies that classified women having an IOL. For the systematic review, data were extracted on study characteristics, quality, and results. Pre-specified criteria were used for evaluation. A multidisciplinary collaboration developed a new classification system using a clinically logical model and stakeholder feedback, demonstrating applicability in a population cohort of 909 702 maternities in New South Wales, Australia, over the period 2002-2011. All seven studies included in the systematic review categorised women according to the presence or absence of varying medical indications for IOL. Evaluation identified uncertainties or deficiencies across all studies, related to the criteria of total inclusivity, reproducibility, clinical utility, implementability, and data availability. A classification system of ten groups was developed based on parity, previous caesarean, gestational age, number, and presentation of the fetus. Nulliparous and parous women at full term were the largest groups (21.2 and 24.5%, respectively), and accounted for the highest proportion of all IOL (20.7 and 21.5%, respectively). Current methods of classifying women undertaking IOL based on medical indications are inadequate. We propose a classification system that has the attributes of simplicity and clarity, uses information that is readily and reliably collected, and enables the standard characterisation of populations of women having an IOL across and within jurisdictions. © 2015 Royal College of Obstetricians and Gynaecologists.

Physical Therapy and Exercise Interventions in Huntington’s Disease: A Mixed Methods Systematic Review

PubMed Central

Fritz, Nora E.; Rao, Ashwini K.; Kegelmeyer, Deb; Kloos, Anne; Busse, Monica; Hartel, Lynda; Carrier, Judith; Quinn, Lori

2017-01-01

Background: A number of studies evaluating physical therapy and exercise interventions in Huntington’s disease have been conducted over the past 15 years. However, an assessment of the quality and strength of the evidence in support of these interventions is lacking. Objective: The purpose of this systematic review was to investigate the effectiveness of physical therapy and exercise interventions in people with Huntington’s disease, and to examine the perceptions of patients, families and caregivers of these interventions. Methods: This mixed-methods systematic review utilized the Joanna Briggs Institute (JBI) approach and extraction tools to evaluate the literature from January 2003 until May 2016. The review considered interventions that included exercise and physical therapy interventions, and included both quantitative and qualitative outcome measures. Results: Twenty (20) studies met the inclusion criteria, including eighteen (18) that had quantitative outcome measures and two (2) that utilized qualitative methods. JBI Levels of evidence for the 18 quantitative studies were as follows: Eight studies were at evidence Level 1, seven were at Level 2, two were at Level 3, and one was at Level 4. Conclusions: Our review suggests that there is preliminary support for the benefits of exercise and physical activity in Huntington’s disease in terms of motor function, gait speed, and balance, as well as a range of physical and social benefits identified through patient-reported outcomes. Variability in mode of intervention as well as outcome measures limits the interpretability of these studies, and high-quality studies that incorporate adaptive trial designs for this rare disease are needed. PMID:28968244

[Development process of Evidence-based "Return-to-work Guidance in Occupational Health 2017"].

PubMed

Kojimahara, Noriko; Fukumoto, Masakatsu; Yoshikawa, Etsuko; Shinada, Kayoko; Tsuiki, Hirokazu

2018-06-05

Objective"Return-to-work Guidance in Occupational Health 2017 (RTW Guidance 2017) " is the first occupational health guide in Japan that evaluates the quality of evidence and offers recommendations based on results of the systematic review of randomized controlled trials. Details of the systematic review of each review question (RQs) will be described separately. This article presents an overview of the method and process of developing the "RTW Guidance 2017."Materials and MethodsThe guidance was developed following the previously-published "Method for developing evidence based occupational health guidance," which included the composition of a highly-transparent guidance developing group as well as the recruitment and selection of RQs. Using the Cochrane Library, PubMed, and Ichushi-Web, a literature search for the six RQs was conducted in January 2016 by partly modifying the search terms of the existing systematic review. Articles were selected according to the inclusion criteria, and the quality of evidence was evaluated using the GRADE approach. Meta-analysis was conducted for RQ2 and RQ4, and a qualitative systematic review was conducted for RQ5, RQ6, and cost-effectiveness. Recommendations were subsequently made after a thorough consideration for feasibility in Japan by examining the costs and available resources.ResultsBased on a comprehensive literature search, eleven RQ2, four RQ4, one RQ5, and three RQ6 were selected. Support program for returning to work, such as "Re-work" for those who are temporarily not working due to musculoskeletal disorders or mental health disorder, was recommended based on moderate evidence (RQ2). For RQ4, the collaboration between occupational health practice and clinical practice was weakly recommended based on low evidence. For RQ5 that evaluated the usefulness of social support, intervention by the manager/co-worker was proposed as a "best practice statement" without indicating it as a recommendation. Work accommodation was weakly recommended based on low evidence in RQ6.Discussion and ConclusionFrom the result of systematic reviews, it was recommended for workers on sick leave more than four weeks regardless of sick leave and sickness absence that interventions during leave would improve work-related outcomes, such as earlier reinstatement. Although there is limited evidence regarding occupational health in Japan, it is important for many occupational health professionals to learn the method of developing guidance and to identify issues for future studies with priority in Japan.

Wearable Inertial Sensor Systems for Lower Limb Exercise Detection and Evaluation: A Systematic Review.

PubMed

O'Reilly, Martin; Caulfield, Brian; Ward, Tomas; Johnston, William; Doherty, Cailbhe

2018-05-01

Analysis of lower limb exercises is traditionally completed with four distinct methods: (1) 3D motion capture; (2) depth-camera-based systems; (3) visual analysis from a qualified exercise professional; and (4) self-assessment. Each method is associated with a number of limitations. The aim of this systematic review is to synthesise and evaluate studies which have investigated the capacity for inertial measurement unit (IMU) technologies to assess movement quality in lower limb exercises. A systematic review of studies identified through the databases of PubMed, ScienceDirect and Scopus was conducted. Articles written in English and published in the last 10 years which investigated an IMU system for the analysis of repetition-based targeted lower limb exercises were included. The quality of included studies was measured using an adapted version of the STROBE assessment criteria for cross-sectional studies. The studies were categorised into three groupings: exercise detection, movement classification or measurement validation. Each study was then qualitatively summarised. From the 2452 articles that were identified with the search strategies, 47 papers are included in this review. Twenty-six of the 47 included studies were deemed as being of high quality. Wearable inertial sensor systems for analysing lower limb exercises is a rapidly growing field of research. Research over the past 10 years has predominantly focused on validating measurements that the systems produce and classifying users' exercise quality. There have been very few user evaluation studies and no clinical trials in this field to date.

Hospital-related cost of sepsis: A systematic review.

PubMed

Arefian, Habibollah; Heublein, Steffen; Scherag, André; Brunkhorst, Frank Martin; Younis, Mustafa Z; Moerer, Onnen; Fischer, Dagmar; Hartmann, Michael

2017-02-01

This article systematically reviews research on the costs of sepsis and, as a secondary aim, evaluates the quality of economic evaluations reported in peer-reviewed journals. We systematically searched the MEDLINE, National Health Service (Abstracts of Reviews of Effects, Economic Evaluation and Health Technology Assessment), Cost-effectiveness Analysis Registry and Web of Knowledge databases for studies published between January 2005 and June 2015. We selected original articles that provided cost and cost-effectiveness analyses, defined sepsis and described their cost calculation method. Only studies that considered index admissions and re-admissions in the first 30 days were published in peer-reviewed journals and used standard treatments were considered. All costs were adjusted to 2014 US dollars. Medians and interquartile ranges (IQRs) for various costs of sepsis were calculated. The quality of economic studies was assessed using the Drummond 10-item checklist. Overall, 37 studies met our eligibility criteria. The median of the mean hospital-wide cost of sepsis per patient was $32,421 (IQR $20,745-$40,835), and the median of the mean ICU cost of sepsis per patient was $27,461 (IQR $16,007-$31,251). Overall, the quality of economic studies was low. Estimates of the hospital-related costs of sepsis varied considerably across the included studies depending on the method used for cost calculation, the type of sepsis and the population that was examined. A standard model for conducting cost improve the quality of studies on the costs of sepsis. Copyright © 2016 The British Infection Association. All rights reserved.

The effectiveness of interventions for reducing stigma related to substance use disorders: a systematic review

PubMed Central

Livingston, James D; Milne, Teresa; Fang, Mei Lan; Amari, Erica

2012-01-01

Aims This study provides a systematic review of existing research that has empirically evaluated interventions designed to reduce stigma related to substance use disorders. Methods A comprehensive review of electronic databases was conducted to identify evaluations of substance use disorder related stigma interventions. Studies that met inclusion criteria were synthesized and assessed using systematic review methods. Results Thirteen studies met the inclusion criteria. The methodological quality of the studies was moderately strong. Interventions of three studies (23%) focused on people with substance use disorders (self-stigma), three studies (23%) targeted the general public (social stigma) and seven studies (54%) focused on medical students and other professional groups (structural stigma). Nine interventions (69%) used approaches that included education and/or direct contact with people who have substance use disorders. All but one study indicated their interventions produced positive effects on at least one stigma outcome measure. None of the interventions have been evaluated across different settings or populations. Conclusions A range of interventions demonstrate promise for achieving meaningful improvements in stigma related to substance use disorders. The limited evidence indicates that self-stigma can be reduced through therapeutic interventions such as group-based acceptance and commitment therapy. Effective strategies for addressing social stigma include motivational interviewing and communicating positive stories of people with substance use disorders. For changing stigma at a structural level, contact-based training and education programs targeting medical students and professionals (e.g. police, counsellors) are effective. PMID:21815959

MRI/US fusion-guided prostate biopsy allows for equivalent cancer detection with significantly fewer needle cores in biopsy-naive men

PubMed Central

Yarlagadda, Vidhush K.; Lai, Win Shun; Gordetsky, Jennifer B.; Porter, Kristin K.; Nix, Jeffrey W.; Thomas, John V.; Rais-Bahrami, Soroush

2018-01-01

PURPOSE We aimed to investigate the efficiency and cancer detection of magnetic resonance imaging (MRI)/ultrasonography (US) fusion-guided prostate biopsy in a cohort of biopsy-naive men compared with standard-of-care systematic extended sextant transrectal ultrasonography (TRUS)-guided biopsy. METHODS From 2014 to 2016, 72 biopsy-naive men referred for initial prostate cancer evaluation who underwent MRI of the prostate were prospectively evaluated. Retrospective review was performed on 69 patients with lesions suspicious for malignancy who underwent MRI/US fusion-guided biopsy in addition to systematic extended sextant biopsy. Biometric, imaging, and pathology data from both the MRI-targeted biopsies and systematic biopsies were analyzed and compared. RESULTS There were no significant differences in overall prostate cancer detection when comparing MRI-targeted biopsies to standard systematic biopsies (P = 0.39). Furthermore, there were no significant differences in the distribution of severity of cancers based on grade groups in cases with cancer detection (P = 0.68). However, significantly fewer needle cores were taken during the MRI/US fusion-guided biopsy compared with systematic biopsy (63% less cores sampled, P < 0.001) CONCLUSION In biopsy-naive men, MRI/US fusion-guided prostate biopsy offers equal prostate cancer detection compared with systematic TRUS-guided biopsy with significantly fewer tissue cores using the targeted technique. This approach can potentially reduce morbidity in the future if used instead of systematic biopsy without sacrificing the ability to detect prostate cancer, particularly in cases with higher grade disease. PMID:29770762

Gastroesophageal reflux, dental erosion, and halitosis in epidemiological surveys: a systematic review.

PubMed

Marsicano, Juliane A; de Moura-Grec, Patrícia G; Bonato, Rafaela C S; Sales-Peres, Matheus de Carvalho; Sales-Peres, Arsenio; Sales-Peres, Sílvia Helena de Carvalho

2013-02-01

In published studies, it has been suggested that dental wear is associated with gastroesophageal reflux disease (GERD). This systematic review was carried out to evaluate the association of GERD, dental erosion, and halitosis and to compare the indices adopted in epidemiological surveys. The Medline database (until October, 2011) was searched systematically to identify studies evaluating the prevalence of oral alterations, such as dental erosion and halitosis, in patients with GERD symptoms. Two reviewers analyzed all reports and the selected studies were evaluated according to the quality of evidence, using the validated Newcastle-Ottawa Quality Assessment Scale. Full-text copies of a total of 32 publications were obtained in duplicate. Sixteen publications were identified among the citations in the Bibliographic lists of studies that fulfilled the exclusion/inclusion criteria and quality of evidence. The relationship between dental erosion and GERD patients was significant in only seven studies. According to three studies, halitosis could be one of several extraesophageal symptoms or manifestations in GERD patients. In one study, it was found that the mucosa of GERD patients was significantly more acidic in comparison with that of the control group. This systematic review showed that there is a relationship between GERD and oral diseases (dental erosion and halitosis). The epidemiological surveys used different indices to analyze GERD and dental erosion. Further research could investigate the best method for assessing the two diseases.

Systematic uncertainties in the Monte Carlo calculation of ion chamber replacement correction factors

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wang, L. L. W.; La Russa, D. J.; Rogers, D. W. O.

In a previous study [Med. Phys. 35, 1747-1755 (2008)], the authors proposed two direct methods of calculating the replacement correction factors (P{sub repl} or p{sub cav}p{sub dis}) for ion chambers by Monte Carlo calculation. By ''direct'' we meant the stopping-power ratio evaluation is not necessary. The two methods were named as the high-density air (HDA) and low-density water (LDW) methods. Although the accuracy of these methods was briefly discussed, it turns out that the assumption made regarding the dose in an HDA slab as a function of slab thickness is not correct. This issue is reinvestigated in the current study,more » and the accuracy of the LDW method applied to ion chambers in a {sup 60}Co photon beam is also studied. It is found that the two direct methods are in fact not completely independent of the stopping-power ratio of the two materials involved. There is an implicit dependence of the calculated P{sub repl} values upon the stopping-power ratio evaluation through the choice of an appropriate energy cutoff {Delta}, which characterizes a cavity size in the Spencer-Attix cavity theory. Since the {Delta} value is not accurately defined in the theory, this dependence on the stopping-power ratio results in a systematic uncertainty on the calculated P{sub repl} values. For phantom materials of similar effective atomic number to air, such as water and graphite, this systematic uncertainty is at most 0.2% for most commonly used chambers for either electron or photon beams. This uncertainty level is good enough for current ion chamber dosimetry, and the merits of the two direct methods of calculating P{sub repl} values are maintained, i.e., there is no need to do a separate stopping-power ratio calculation. For high-Z materials, the inherent uncertainty would make it practically impossible to calculate reliable P{sub repl} values using the two direct methods.« less

Photoneutron cross sections for 59Co : Systematic uncertainties of data from various experiments

NASA Astrophysics Data System (ADS)

Varlamov, V. V.; Davydov, A. I.; Ishkhanov, B. S.

2017-09-01

Data on partial photoneutron reaction cross sections (γ ,1n), (γ ,2n), and (γ ,3n) for 59Co obtained in two experiments carried out at Livermore (USA) were analyzed. The sources of radiation in both experiments were the monoenergetic photon beams from the annihilation in flight of relativistic positrons. The total yield was sorted by the neutron multiplicity, taking into account the difference in the neutron energy spectra for different multiplicity. The two quoted studies differ in the method of determining the neutron. Significant systematic disagreements between the results of the two experiments exist. They are considered to be caused by large systematic uncertainties in partial cross sections, since they do not satisfy physical criteria for reliability of the data. To obtain reliable cross sections of partial and total photoneutron reactions a new method combining experimental data and theoretical evaluation was used. It is based on the experimental neutron yield cross section which is rather independent of neutron multiplicity and the transitional neutron multiplicity functions of the combined photonucleon reaction model (CPNRM). The model transitional multiplicity functions were used for the decomposition of the neutron yield cross section into the contributions of partial reactions. The results of the new evaluation noticeably differ from the partial cross sections obtained in the two experimental studies are under discussion.

Evidence-based practice guidelines for instructing individuals with neurogenic memory impairments: what have we learned in the past 20 years?

PubMed

Ehlhardt, Laurie A; Sohlberg, McKay Moore; Kennedy, Mary; Coelho, Carl; Ylvisaker, Mark; Turkstra, Lyn; Yorkston, Kathryn

2008-06-01

This article examines the instructional research literature pertinent to teaching procedures or information to individuals with acquired memory impairments due to brain injury or related conditions. The purpose is to evaluate the available evidence in order to generate practice guidelines for clinicians working in the field of cognitive rehabilitation. A systematic review of the instructional literature from 1986 to 2006 revealed 51 studies meeting search criteria. Studies were analysed and coded within the following four key domains: Population Sample, Intervention, Study Design, and Treatment Outcomes. Coding included 17 characteristics of the population sample; seven intervention parameters; five study design features; and five treatment outcome parameters. Interventions that were evaluated included systematic instructional techniques such as method of vanishing cues and errorless learning. The majority of the studies reported positive outcomes in favour of systematic instruction. However, issues related to the design and execution of effective instruction lack clarity and require further study. The interaction between the target learning objective and the individual learner profile is not well understood. The evidence review concludes with clinical recommendations based on the instructional literature and a call to clinicians to incorporate these methods into their practice to maximise patient outcomes.

Does the Finnish intervention prevent obstetric anal sphincter injuries? A systematic review of the literature

PubMed Central

Poulsen, Mette Østergaard; Madsen, Mia Lund; Skriver-Møller, Anne-Cathrine; Overgaard, Charlotte

2015-01-01

Objectives A rise in obstetric anal sphincter injuries (OASIS) has been observed and a preventive approach, originating in Finland, has been introduced in several European hospitals. The aim of this paper was to systematically evaluate the evidence behind the ‘Finnish intervention’. Design A systematic review of the literature conducted according to the Preferred Reporting for Systematic Reviews and Meta-analyses (PRISMA) guidelines. Outcome measures The primary outcome was OASIS. Secondary outcomes were (perinatal): Apgar scores, pH and standard base excess in the umbilical cord, and (maternal): episiotomy, intact perineum, first and second-degree perineal lacerations, duration of second stage, birth position and women's perceptions/birth experiences. Methods Multiple databases (Cochrane, Embase, Pubmed and SveMed) were systematically searched for studies published up to December 2014. Both randomised controlled trials and observational studies were eligible for inclusion. Studies were excluded if a full-text article was not available. Studies were evaluated by use of international reporting guidelines (eg, STROBE). Results Overall, 1042 articles were screened and 65 retrieved for full-text evaluation. Seven studies, all observational and with a level of evidence at 2c or lower, were included and consistently reported a significant reduction in OASIS. All evaluated episiotomy and found a significant increase. Three studies evaluated perinatal outcomes and reported conflicting results. No study reported on other perineal outcomes, duration of the second stage, birth positions or women's perceptions. Conclusions A reduction in OASIS has been contributed to the Finnish intervention in seven observational studies, all with a low level of evidence. Knowledge about the potential perinatal and maternal side effects and women's perceptions of the intervention is extremely limited and the biological mechanisms underlying the Finnish intervention are not well documented. Studies with a high level of evidence are needed to assess the effects of the intervention before implementation in clinical settings can be recommended. PMID:26369797

What Are the Effects of Teaching Evidence-Based Health Care (EBHC)? Overview of Systematic Reviews

PubMed Central

Young, Taryn; Rohwer, Anke; Volmink, Jimmy; Clarke, Mike

2014-01-01

Background An evidence-based approach to health care is recognized internationally as a key competency for healthcare practitioners. This overview systematically evaluated and organized evidence from systematic reviews on teaching evidence-based health care (EBHC). Methods/Findings We searched for systematic reviews evaluating interventions for teaching EBHC to health professionals compared to no intervention or different strategies. Outcomes covered EBHC knowledge, skills, attitudes, practices and health outcomes. Comprehensive searches were conducted in April 2013. Two reviewers independently selected eligible reviews, extracted data and evaluated methodological quality. We included 16 systematic reviews, published between 1993 and 2013. There was considerable overlap across reviews. We found that 171 source studies included in the reviews related to 81 separate studies, of which 37 are in more than one review. Studies used various methodologies to evaluate educational interventions of varying content, format and duration in undergraduates, interns, residents and practicing health professionals. The evidence in the reviews showed that multifaceted, clinically integrated interventions, with assessment, led to improvements in knowledge, skills and attitudes. Interventions improved critical appraisal skills and integration of results into decisions, and improved knowledge, skills, attitudes and behaviour amongst practicing health professionals. Considering single interventions, EBHC knowledge and attitude were similar for lecture-based versus online teaching. Journal clubs appeared to increase clinical epidemiology and biostatistics knowledge and reading behavior, but not appraisal skills. EBHC courses improved appraisal skills and knowledge. Amongst practicing health professionals, interactive online courses with guided critical appraisal showed significant increase in knowledge and appraisal skills. A short workshop using problem-based approaches, compared to no intervention, increased knowledge but not appraisal skills. Conclusions EBHC teaching and learning strategies should focus on implementing multifaceted, clinically integrated approaches with assessment. Future rigorous research should evaluate minimum components for multifaceted interventions, assessment of medium to long-term outcomes, and implementation of these interventions. PMID:24489771

The local food environment and diet: A systematic review

PubMed Central

Caspi, Caitlin E.; Sorensen, Glorian; Subramanian, S.V.; Kawachi, Ichiro

2013-01-01

Despite growing attention to the problem of obesogenic environments, there has not been a comprehensive review evaluating the food environment-diet relationship. This study aims to evaluate this relationship in the current literature, focusing specifically on the method of exposure assessment (GIS, survey, or store audit). This study also explores 5 dimensions of “food access” (availability, accessibility, affordability, accommodation, acceptability) using a conceptual definition proposed by Penchansky and Thomas (1981). Articles were retrieved through a systematic keyword search in Web of Science and supplemented by the reference lists of included studies. Thirty-eight studies were reviewed and categorized by the exposure assessment method and the conceptual dimensions of access it captured. GIS-based measures were the most common measures, but were less consistently associated with diet than other measures. Few studies examined dimensions of affordability, accommodation, and acceptability. Because GIS-based measures on their own may not capture important non-geographic dimensions of access, a set of recommendations for future researchers is outlined. PMID:22717379

The local food environment and diet: a systematic review.

PubMed

Caspi, Caitlin E; Sorensen, Glorian; Subramanian, S V; Kawachi, Ichiro

2012-09-01

Despite growing attention to the problem of obesogenic environments, there has not been a comprehensive review evaluating the food environment-diet relationship. This study aims to evaluate this relationship in the current literature, focusing specifically on the method of exposure assessment (GIS, survey, or store audit). This study also explores 5 dimensions of "food access" (availability, accessibility, affordability, accommodation, acceptability) using a conceptual definition proposed by Penchansky and Thomas (1981). Articles were retrieved through a systematic keyword search in Web of Science and supplemented by the reference lists of included studies. Thirty-eight studies were reviewed and categorized by the exposure assessment method and the conceptual dimensions of access it captured. GIS-based measures were the most common measures, but were less consistently associated with diet than other measures. Few studies examined dimensions of affordability, accommodation, and acceptability. Because GIS-based measures on their own may not capture important non-geographic dimensions of access, a set of recommendations for future researchers is outlined. Copyright © 2012 Elsevier Ltd. All rights reserved.

Bystander programs addressing sexual violence on college campuses: A systematic review and meta-analysis of program outcomes and delivery methods.

PubMed

Jouriles, Ernest N; Krauss, Alison; Vu, Nicole L; Banyard, Victoria L; McDonald, Renee

2018-02-06

This systematic review and meta-analysis evaluates the effectiveness of bystander programs that address sexual violence on college campuses. Program effects on student attitudes/beliefs and bystander behavior were examined. Durability of program outcomes and the influence of program-delivery methods (e.g., facilitator-led programs vs. video, online or poster campaign programs) and program-parameters (e.g., program length) were also evaluated. Twenty-four studies met criteria for inclusion in the meta-analysis, and 207 separate results from these studies were coded. Students who participated in a bystander program, compared to those who had not, had more pro-social attitudes/beliefs about sexual violence and intervening to prevent it, and engaged in more bystander behavior. Program effects diminished over time, but meaningful changes persisted for at least three months following program delivery. Longer programs had greater effects than shorter programs on attitudes/beliefs. Bystander programs can be a valuable addition to colleges' violence prevention efforts.

Clinical and diagnostic utility of saliva as a non-invasive diagnostic fluid:
a systematic review

PubMed Central

Nunes, Lazaro Alessandro Soares; Mussavira, Sayeeda

2015-01-01

This systematic review presents the latest trends in salivary research and its applications in health and disease. Among the large number of analytes present in saliva, many are affected by diverse physiological and pathological conditions. Further, the non-invasive, easy and cost-effective collection methods prompt an interest in evaluating its diagnostic or prognostic utility. Accumulating data over the past two decades indicates towards the possible utility of saliva to monitor overall health, diagnose and treat various oral or systemic disorders and drug monitoring. Advances in saliva based systems biology has also contributed towards identification of several biomarkers, development of diverse salivary diagnostic kits and other sensitive analytical techniques. However, its utilization should be carefully evaluated in relation to standardization of pre-analytical and analytical variables, such as collection and storage methods, analyte circadian variation, sample recovery, prevention of sample contamination and analytical procedures. In spite of all these challenges, there is an escalating evolution of knowledge with the use of this biological matrix. PMID:26110030

Technical Packages in Injury and Violence Prevention to Move Evidence into Practice: Systematic Reviews and Beyond

PubMed Central

Haegerich, Tamara M.; David-Ferdon, Corinne; Noonan, Rita K.; Manns, Brian J.; Billie, Holly C.

2016-01-01

Injury and violence prevention strategies have greater potential for impact when they are based on scientific evidence. Systematic reviews of the scientific evidence can contribute key information about which policies and programs might have the greatest impact when implemented. However, systematic reviews have limitations, such as lack of implementation guidance and contextual information, that can limit the application of knowledge. “Technical packages,” developed by knowledge brokers such as the federal government, nonprofit agencies, and academic institutions, have the potential to be an efficient mechanism for making information from systematic reviews actionable. Technical packages provide information about specific evidence-based prevention strategies, along with the estimated costs and impacts, and include accompanying implementation and evaluation guidance to facilitate adoption, implementation, and performance measurement. We describe how systematic reviews can inform the development of technical packages for practitioners, provide examples of technical packages in injury and violence prevention, and explain how enhancing review methods and reporting could facilitate the use and applicability of scientific evidence. PMID:27604301

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews

PubMed Central

2013-01-01

Background Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. Methods This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. Results A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. Conclusion There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words) PMID:23331384

Evaluation and integration of existing methods for computational prediction of allergens

PubMed Central

2013-01-01

Background Allergy involves a series of complex reactions and factors that contribute to the development of the disease and triggering of the symptoms, including rhinitis, asthma, atopic eczema, skin sensitivity, even acute and fatal anaphylactic shock. Prediction and evaluation of the potential allergenicity is of importance for safety evaluation of foods and other environment factors. Although several computational approaches for assessing the potential allergenicity of proteins have been developed, their performance and relative merits and shortcomings have not been compared systematically. Results To evaluate and improve the existing methods for allergen prediction, we collected an up-to-date definitive dataset consisting of 989 known allergens and massive putative non-allergens. The three most widely used allergen computational prediction approaches including sequence-, motif- and SVM-based (Support Vector Machine) methods were systematically compared using the defined parameters and we found that SVM-based method outperformed the other two methods with higher accuracy and specificity. The sequence-based method with the criteria defined by FAO/WHO (FAO: Food and Agriculture Organization of the United Nations; WHO: World Health Organization) has higher sensitivity of over 98%, but having a low specificity. The advantage of motif-based method is the ability to visualize the key motif within the allergen. Notably, the performances of the sequence-based method defined by FAO/WHO and motif eliciting strategy could be improved by the optimization of parameters. To facilitate the allergen prediction, we integrated these three methods in a web-based application proAP, which provides the global search of the known allergens and a powerful tool for allergen predication. Flexible parameter setting and batch prediction were also implemented. The proAP can be accessed at http://gmobl.sjtu.edu.cn/proAP/main.html. Conclusions This study comprehensively evaluated sequence-, motif- and SVM-based computational prediction approaches for allergens and optimized their parameters to obtain better performance. These findings may provide helpful guidance for the researchers in allergen-prediction. Furthermore, we integrated these methods into a web application proAP, greatly facilitating users to do customizable allergen search and prediction. PMID:23514097

Evaluation and integration of existing methods for computational prediction of allergens.

PubMed

Wang, Jing; Yu, Yabin; Zhao, Yunan; Zhang, Dabing; Li, Jing

2013-01-01

Allergy involves a series of complex reactions and factors that contribute to the development of the disease and triggering of the symptoms, including rhinitis, asthma, atopic eczema, skin sensitivity, even acute and fatal anaphylactic shock. Prediction and evaluation of the potential allergenicity is of importance for safety evaluation of foods and other environment factors. Although several computational approaches for assessing the potential allergenicity of proteins have been developed, their performance and relative merits and shortcomings have not been compared systematically. To evaluate and improve the existing methods for allergen prediction, we collected an up-to-date definitive dataset consisting of 989 known allergens and massive putative non-allergens. The three most widely used allergen computational prediction approaches including sequence-, motif- and SVM-based (Support Vector Machine) methods were systematically compared using the defined parameters and we found that SVM-based method outperformed the other two methods with higher accuracy and specificity. The sequence-based method with the criteria defined by FAO/WHO (FAO: Food and Agriculture Organization of the United Nations; WHO: World Health Organization) has higher sensitivity of over 98%, but having a low specificity. The advantage of motif-based method is the ability to visualize the key motif within the allergen. Notably, the performances of the sequence-based method defined by FAO/WHO and motif eliciting strategy could be improved by the optimization of parameters. To facilitate the allergen prediction, we integrated these three methods in a web-based application proAP, which provides the global search of the known allergens and a powerful tool for allergen predication. Flexible parameter setting and batch prediction were also implemented. The proAP can be accessed at http://gmobl.sjtu.edu.cn/proAP/main.html. This study comprehensively evaluated sequence-, motif- and SVM-based computational prediction approaches for allergens and optimized their parameters to obtain better performance. These findings may provide helpful guidance for the researchers in allergen-prediction. Furthermore, we integrated these methods into a web application proAP, greatly facilitating users to do customizable allergen search and prediction.

Rapid On-Site Evaluation of Fine-Needle Aspiration by Non-Cytopathologists: A Systematic Review and Meta-Analysis of Diagnostic Accuracy Studies for Adequacy Assessment.

PubMed

Pearson, Lauren; Factor, Rachel E; White, Sandra K; Walker, Brandon S; Layfield, Lester J; Schmidt, Robert L

2018-06-06

Rapid on-site evaluation (ROSE) has been shown to improve adequacy rates and reduce needle passes. ROSE is often performed by cytopathologists who have limited availability and may be costlier than alternatives. Several recent studies examined the use of alternative evaluators (AEs) for ROSE. A summary of this information could help inform guidelines regarding the use of AEs. The objective was to assess the accuracy of AEs compared to cytopathologists in assessing the adequacy of specimens during ROSE. This was a systematic review and meta-analysis. Reporting and study quality were assessed using the STARD guidelines and QUADAS-2. All steps were performed independently by two evaluators. Summary estimates were obtained using the hierarchal method in Stata v14. Heterogeneity was evaluated using Higgins' I2 statistic. The systematic review identified 13 studies that were included in the meta-analysis. Summary estimates of sensitivity and specificity for AEs were 97% (95% CI: 92-99%) and 83% (95% CI: 68-92%). There was wide variation in accuracy statistics between studies (I2 = 0.99). AEs sometimes have accuracy that is close to cytopathologists. However, there is wide variability between studies, so it is not possible to provide a broad guideline regarding the use of AEs. © 2018 S. Karger AG, Basel.

Physical Therapy and Exercise Interventions in Huntington's Disease: A Mixed Methods Systematic Review.

PubMed

Fritz, Nora E; Rao, Ashwini K; Kegelmeyer, Deb; Kloos, Anne; Busse, Monica; Hartel, Lynda; Carrier, Judith; Quinn, Lori

2017-01-01

A number of studies evaluating physical therapy and exercise interventions in Huntington's disease have been conducted over the past 15 years. However, an assessment of the quality and strength of the evidence in support of these interventions is lacking. The purpose of this systematic review was to investigate the effectiveness of physical therapy and exercise interventions in people with Huntington's disease, and to examine the perceptions of patients, families and caregivers of these interventions. This mixed-methods systematic review utilized the Joanna Briggs Institute (JBI) approach and extraction tools to evaluate the literature from January 2003 until May 2016. The review considered interventions that included exercise and physical therapy interventions, and included both quantitative and qualitative outcome measures. Twenty (20) studies met the inclusion criteria, including eighteen (18) that had quantitative outcome measures and two (2) that utilized qualitative methods. JBI Levels of evidence for the 18 quantitative studies were as follows: Eight studies were at evidence Level 1, seven were at Level 2, two were at Level 3, and one was at Level 4. Our review suggests that there is preliminary support for the benefits of exercise and physical activity in Huntington's disease in terms of motor function, gait speed, and balance, as well as a range of physical and social benefits identified through patient-reported outcomes. Variability in mode of intervention as well as outcome measures limits the interpretability of these studies, and high-quality studies that incorporate adaptive trial designs for this rare disease are needed.

A review of evidence for safe abortion care.

PubMed

Kapp, Nathalie; Whyte, Patti; Tang, Jennifer; Jackson, Emily; Brahmi, Dalia

2013-09-01

The provision of safe abortion services to women who need them has the potential to drastically reduce or eliminate maternal deaths due to unsafe abortion. The World Health Organization recently updated its evidence-based guidance for safe and effective clinical practices using data from systematic reviews of the literature. Systematic reviews pertaining to the evidence for safe abortion services, from pre-abortion care, medical and surgical methods of abortion and post-abortion care were evaluated for relevant outcomes, primarily those relating to safety, effectiveness and women's preference. Sixteen systematic reviews were identified and evaluated. The available evidence does not support the use of pre-abortion ultrasound to increase safety. Routine use of cervical preparation with osmotic dilators, mifepristone or misoprostol after 14 weeks gestation reduces complications; at early gestational ages, surgical abortions have very few complications. Prophylactic antibiotics result in lower rates of post-surgical abortion infection. Pain medication such as non-steroidal anti-inflammatories should be offered to women undergoing abortion procedures; acetaminophen, however, is not effective in reducing pain. Women who are eligible should be offered a choice between surgical (vacuum aspiration or dilation and evacuation) and medical methods (mifepristone and misoprostol) of abortion when possible. Modern methods of contraception can be safely initiated immediately following abortion procedures. Evidence-based guidelines assist health care providers and policymakers to utilize the best data available to provide safe abortion care and prevent the millions of deaths and disabilities that result from unsafe abortion. Copyright © 2013 Elsevier Inc. All rights reserved.

The Use of Intervention Mapping to Develop a Tailored Web-Based Intervention, Condom-HIM

PubMed Central

2017-01-01

Background Many HIV (human immunodeficiency virus) prevention interventions are currently being implemented and evaluated, with little information published on their development. A framework highlighting the method of development of an intervention can be used by others wanting to replicate interventions or develop similar interventions to suit other contexts and settings. It provides researchers with a comprehensive development process of the intervention. Objective The objective of this paper was to describe how a systematic approach, intervention mapping, was used to develop a tailored Web-based intervention to increase condom use among HIV-positive men who have sex with men. Methods The intervention was developed in consultation with a multidisciplinary team composed of academic researchers, community members, Web designers, and the target population. Intervention mapping involved a systematic process of 6 steps: (1) needs assessment; (2) identification of proximal intervention objectives; (3) selection of theory-based intervention methods and practical strategies; (4) development of intervention components and materials; (5) adoption, implementation, and maintenance; and (6) evaluation planning. Results The application of intervention mapping resulted in the development of a tailored Web-based intervention for HIV-positive men who have sex with men, called Condom-HIM. Conclusions Using intervention mapping as a systematic process to develop interventions is a feasible approach that specifically integrates the use of theory and empirical findings. Outlining the process used to develop a particular intervention provides clarification on the conceptual use of experimental interventions in addition to potentially identifying reasons for intervention failures. PMID:28428162

Geodetic imaging of tectonic deformation with InSAR

NASA Astrophysics Data System (ADS)

Fattahi, Heresh

Precise measurements of ground deformation across the plate boundaries are crucial observations to evaluate the location of strain localization and to understand the pattern of strain accumulation at depth. Such information can be used to evaluate the possible location and magnitude of future earthquakes. Interferometric Synthetic Aperture Radar (InSAR) potentially can deliver small-scale (few mm/yr) ground displacement over long distances (hundreds of kilometers) across the plate boundaries and over continents. However, Given the ground displacement as our signal of interest, the InSAR observations of ground deformation are usually affected by several sources of systematic and random noises. In this dissertation I identify several sources of systematic and random noise, develop new methods to model and mitigate the systematic noise and to evaluate the uncertainty of the ground displacement measured with InSAR. I use the developed approach to characterize the tectonic deformation and evaluate the rate of strain accumulation along the Chaman fault system, the western boundary of the India with Eurasia tectonic plates. I evaluate the bias due to the topographic residuals in the InSAR range-change time-series and develope a new method to estimate the topographic residuals and mitigate the effect from the InSAR range-change time-series (Chapter 2). I develop a new method to evaluate the uncertainty of the InSAR velocity field due to the uncertainty of the satellite orbits (Chapter 3) and a new algorithm to automatically detect and correct the phase unwrapping errors in a dense network of interferograms (Chapter 4). I develop a new approach to evaluate the impact of systematic and stochastic components of the tropospheric delay on the InSAR displacement time-series and its uncertainty (Chapter 5). Using the new InSAR time-series approach developed in the previous chapters, I study the tectonic deformation across the western boundary of the India plate with Eurasia and evaluated the rate of strain accumulation along the Chaman fault system (Chapter 5). I also evaluate the co-seismic and post-seismic displacement of a moderate M5.5 earthquake on the Ghazaband fault (Chapter 6). The developed methods to mitigate the systematic noise from InSAR time-series, significantly improve the accuracy of the InSAR displacement time-series and velocity. The approaches to evaluate the effect of the stochastic components of noise in InSAR displacement time-series enable us to obtain the variance-covariance matrix of the InSAR displacement time-series and to express their uncertainties. The effect of the topographic residuals in the InSAR range-change time-series is proportional to the perpendicular baseline history of the set of SAR acquisitions. The proposed method for topographic residual correction, efficiently corrects the displacement time-series. Evaluation of the uncertainty of velocity due to the orbital errors shows that for modern SAR satellites with precise orbits such as TerraSAR-X and Sentinel-1, the uncertainty of 0.2 mm/yr per 100 km and for older satellites with less accurate orbits such as ERS and Envisat, the uncertainty of 1.5 and 0.5mm/yr per 100 km, respectively are achievable. However, the uncertainty due to the orbital errors depends on the orbital uncertainties, the number and time span of SAR acquisitions. Contribution of the tropospheric delay to the InSAR range-change time-series can be subdivided to systematic (seasonal delay) and stochastic components. The systematic component biases the displacement times-series and velocity field as a function of the acquisition time and the non-seasonal component significantly contributes to the InSAR uncertainty. Both components are spatially correlated and therefore the covariance of noise between pixels should be considered for evaluating the uncertainty due to the random tropospheric delay. The relative velocity uncertainty due to the random tropospheric delay depends on the scatter of the random tropospheric delay, and is inversely proportional to the number of acquisitions, and the total time span covered by the SAR acquisitions. InSAR observations across the Chaman fault system shows that relative motion between India and Eurasia in the western boundary is distributed among different faults. The InSAR velocity field indicates strain localization on the Chaman fault and Ghazaband fault with slip rates of ~8 and ~16 mm/yr, respectively. High rate of strain accumulation on the Ghazaband fault and lack of evidence for rupturing the fault during the 1935 Quetta earthquake indicates that enough strain has been accumulated for large (M>7) earthquake, which threatens Balochistan and the City of Quetta. Chaman fault from latitudes ~29.5 N to ~32.5 N is creeping with a maximum surface creep rate of 8 mm/yr, which indicates that Chaman fault is only partially locked and therefore moderate earthquakes (M<7) similar to what has been recorded in last 100 years are expected.

User Experience Evaluation Methods in Product Development (UXEM'09)

NASA Astrophysics Data System (ADS)

Roto, Virpi; Väänänen-Vainio-Mattila, Kaisa; Law, Effie; Vermeeren, Arnold

High quality user experience (UX) has become a central competitive factor of product development in mature consumer markets [1]. Although the term UX originated from industry and is a widely used term also in academia, the tools for managing UX in product development are still inadequate. A prerequisite for designing delightful UX in an industrial setting is to understand both the requirements tied to the pragmatic level of functionality and interaction and the requirements pertaining to the hedonic level of personal human needs, which motivate product use [2]. Understanding these requirements helps managers set UX targets for product development. The next phase in a good user-centered design process is to iteratively design and evaluate prototypes [3]. Evaluation is critical for systematically improving UX. In many approaches to UX, evaluation basically needs to be postponed until the product is fully or at least almost fully functional. However, in an industrial setting, it is very expensive to find the UX failures only at this phase of product development. Thus, product development managers and developers have a strong need to conduct UX evaluation as early as possible, well before all the parts affecting the holistic experience are available. Different types of products require evaluation on different granularity and maturity levels of a prototype. For example, due to its multi-user characteristic, a community service or an enterprise resource planning system requires a broader scope of UX evaluation than a microwave oven or a word processor that is meant for a single user at a time. Before systematic UX evaluation can be taken into practice, practical, lightweight UX evaluation methods suitable for different types of products and different phases of product readiness are needed. A considerable amount of UX research is still about the conceptual frameworks and models for user experience [4]. Besides, applying existing usability evaluation methods (UEMs) without adaptation to evaluate UX may lead to some scoping issues. Consequently, there is a strong need to put UX evaluation from research into practice.

[Systematic evaluation of retention behavior of carbohydrates in hydrophilic interaction liquid chromatography].

PubMed

Fu, Qing; Wang, Jun; Liang, Tu; Xu, Xiaoyong; Jin, Yu

2013-11-01

A systematic evaluation of retention behavior of carbohydrates in hydrophilic interaction liquid chromatography (HILIC) was performed. The influences of mobile phase, stationary phase and buffer salt on the retention of carbohydrates were investigated. According to the results, the retention time of carbohydrates decreased as the proportion of acetonitrile in mobile phase decreased. Increased time of carbohydrates was observed as the concentration of buffer salt in mobile phase increased. The retention behavior of carbohydrates was also affected by organic solvent and HILIC stationary phase. Furthermore, an appropriate retention equation was used in HILIC mode. The retention equation lnk = a + blnC(B) + cC(B) could quantitatively describe the retention factors of carbohydrates of plant origin with good accuracy: the relative error of the predicted time to actual time was less than 0.3%. The evaluation results could provide guidance for carbohydrates to optimize the experimental conditions in HILIC method development especially for carbohydrate separation

Evidence-based development and evaluation of mobile cognitive support apps for people on the autism spectrum: methodological conclusions from two R+D projects.

PubMed

Gyori, Miklos; Stefanik, Krisztina; Kanizsai-Nagy, Ildikó

2015-01-01

A growing body of evidence confirms that mobile digital devices have key potentials as assistive/educational tools for people with autism spectrum disorders. The aim of this paper is to outline key aspects of development and evaluation methodologies that build on, and provide systematic evidence on effects of using such apps. We rely on the results of two R+D projects, both using quantitative and qualitative methods to support development and to evaluate developed apps (n=54 and n=22). Analyzing methodological conclusions from these studies we outline some guidelines for an 'ideal' R+D methodology but we also point to important trade-offs between the need for best systematic evidence and the limitations on development time and costs. We see these trade-offs as a key issue to be resolved in this field.

New knowledge network evaluation method for design rationale management

NASA Astrophysics Data System (ADS)

Jing, Shikai; Zhan, Hongfei; Liu, Jihong; Wang, Kuan; Jiang, Hao; Zhou, Jingtao

2015-01-01

Current design rationale (DR) systems have not demonstrated the value of the approach in practice since little attention is put to the evaluation method of DR knowledge. To systematize knowledge management process for future computer-aided DR applications, a prerequisite is to provide the measure for the DR knowledge. In this paper, a new knowledge network evaluation method for DR management is presented. The method characterizes the DR knowledge value from four perspectives, namely, the design rationale structure scale, association knowledge and reasoning ability, degree of design justification support and degree of knowledge representation conciseness. The DR knowledge comprehensive value is also measured by the proposed method. To validate the proposed method, different style of DR knowledge network and the performance of the proposed measure are discussed. The evaluation method has been applied in two realistic design cases and compared with the structural measures. The research proposes the DR knowledge evaluation method which can provide object metric and selection basis for the DR knowledge reuse during the product design process. In addition, the method is proved to be more effective guidance and support for the application and management of DR knowledge.

A study on reliability of power customer in distribution network

NASA Astrophysics Data System (ADS)

Liu, Liyuan; Ouyang, Sen; Chen, Danling; Ma, Shaohua; Wang, Xin

2017-05-01

The existing power supply reliability index system is oriented to power system without considering actual electricity availability in customer side. In addition, it is unable to reflect outage or customer’s equipment shutdown caused by instantaneous interruption and power quality problem. This paper thus makes a systematic study on reliability of power customer. By comparing with power supply reliability, reliability of power customer is defined and extracted its evaluation requirements. An indexes system, consisting of seven customer indexes and two contrast indexes, are designed to describe reliability of power customer from continuity and availability. In order to comprehensively and quantitatively evaluate reliability of power customer in distribution networks, reliability evaluation method is proposed based on improved entropy method and the punishment weighting principle. Practical application has proved that reliability index system and evaluation method for power customer is reasonable and effective.

A protocol for a systematic review of non-randomised evaluations of strategies to improve participant recruitment to randomised controlled trials.

PubMed

Gardner, Heidi R; Fraser, Cynthia; MacLennan, Graeme; Treweek, Shaun

2016-08-02

Randomised controlled trials guard against selection bias and therefore offer the fairest way of evaluating healthcare interventions such as medicinal products, devices and services. Recruitment to trials can be extremely difficult, and poor recruitment can lead to extensions to both time and budget and may result in an underpowered study which does not satisfactorily answer the original research question. In the worst cases, a trial may be abandoned, causing huge waste. The evidence to support the choice of recruitment interventions is currently weak. Non-randomised evaluations of recruitment interventions are currently rejected on grounds of poor methodological quality, but systematic evaluation and assessment of this substantial body of work (using Grading of Recommendations Assessment, Development and Evaluation (GRADE) where possible) may provide useful information to support and inform the recruitment decisions of trialists and the research priorities of methodology researchers. The following databases will be searched for relevant studies: Cochrane Methodology Register, MEDLINE, EMBASE, CINAHL and PsycINFO. Any non-randomised study that includes a comparison of two or more interventions to improve recruitment to randomised controlled trials will be included. We will not apply any restrictions on publication date, language or journal. The primary outcome will be the number of individuals or centres recruited into a randomised controlled trial. The secondary outcome will be cost per recruit. Two reviewers will independently screen abstracts for eligible studies, and then, full texts of potentially relevant records will be reviewed. Disagreements will be resolved through discussion. The methodological quality of studies will be assessed using the Cochrane risk of bias tool for non-randomised studies, and the GRADE system will be used if studies are pooled. This review aims to summarise the evidence on methods used to improve recruitment to randomised controlled trials. Carrying out a systematic review including only data from non-randomised studies is a novel approach, and one which some may argue is futile. However, we believe that the systematic evaluation of what is likely to be a substantial amount of research activity is necessary, worthwhile, and will yield valuable results for the clinical trials community regardless of whether the outcomes find in favour of one or more interventions. Should the results of this review suggest that non-randomised evaluations do have something to offer trialists planning their recruitment strategies, the review may be combined in the future with the Cochrane review of randomised evaluations to produce a full review of recruitment strategies encompassing both randomised and non-randomised evaluation methods. PROSPERO CRD42016037718.

A Comparison of Two Balance Calibration Model Building Methods

NASA Technical Reports Server (NTRS)

DeLoach, Richard; Ulbrich, Norbert

2007-01-01

Simulated strain-gage balance calibration data is used to compare the accuracy of two balance calibration model building methods for different noise environments and calibration experiment designs. The first building method obtains a math model for the analysis of balance calibration data after applying a candidate math model search algorithm to the calibration data set. The second building method uses stepwise regression analysis in order to construct a model for the analysis. Four balance calibration data sets were simulated in order to compare the accuracy of the two math model building methods. The simulated data sets were prepared using the traditional One Factor At a Time (OFAT) technique and the Modern Design of Experiments (MDOE) approach. Random and systematic errors were introduced in the simulated calibration data sets in order to study their influence on the math model building methods. Residuals of the fitted calibration responses and other statistical metrics were compared in order to evaluate the calibration models developed with different combinations of noise environment, experiment design, and model building method. Overall, predicted math models and residuals of both math model building methods show very good agreement. Significant differences in model quality were attributable to noise environment, experiment design, and their interaction. Generally, the addition of systematic error significantly degraded the quality of calibration models developed from OFAT data by either method, but MDOE experiment designs were more robust with respect to the introduction of a systematic component of the unexplained variance.

System and method for generating and/or screening potential metal-organic frameworks

DOEpatents

Wilmer, Christopher E; Leaf, Michael; Snurr, Randall Q; Farha, Omar K; Hupp, Joseph T

2015-04-21

A system and method for systematically generating potential metal-organic framework (MOFs) structures given an input library of building blocks is provided herein. One or more material properties of the potential MOFs are evaluated using computational simulations. A range of material properties (surface area, pore volume, pore size distribution, powder x-ray diffraction pattern, methane adsorption capability, and the like) can be estimated, and in doing so, illuminate unidentified structure-property relationships that may only have been recognized by taking a global view of MOF structures. In addition to identifying structure-property relationships, this systematic approach to identify the MOFs of interest is used to identify one or more MOFs that may be useful for high pressure methane storage.

System and method for generating and/or screening potential metal-organic frameworks

DOEpatents

Wilmer, Christopher E; Leaf, Michael; Snurr, Randall Q; Farha, Omar K; Hupp, Joseph T

2014-12-02

A system and method for systematically generating potential metal-organic framework (MOFs) structures given an input library of building blocks is provided herein. One or more material properties of the potential MOFs are evaluated using computational simulations. A range of material properties (surface area, pore volume, pore size distribution, powder x-ray diffraction pattern, methane adsorption capability, and the like) can be estimated, and in doing so, illuminate unidentified structure-property relationships that may only have been recognized by taking a global view of MOF structures. In addition to identifying structure-property relationships, this systematic approach to identify the MOFs of interest is used to identify one or more MOFs that may be useful for high pressure methane storage.

Investigation of internal friction in fused quartz, steel, Plexiglass, and Westerly granite from 0.01 to 1.00 Hertz at 10- 8 to 10-7 strain amplitude.

USGS Publications Warehouse

Hsi-Ping, Liu; Peselnick, L.

1983-01-01

A detailed evaluation on the method of internal friction measurement by the stress-strain hysteresis loop method from 0.01 to 1 Hz at 10-8-10-7 strain amplitude and 23.9oC is presented. Significant systematic errors in relative phase measurement can result from convex end surfaces of the sample and stress sensor and from end surface irregularities such as nicks and asperities. Preparation of concave end surfaces polished to optical smoothness having a radius of curvature >3.6X104 cm reduces the systematic error in relative phase measurements to <(5.5+ or -2.2)X10-4 radians. -from Authors

Additively Manufactured Metals in Oxygen Systems Project

NASA Technical Reports Server (NTRS)

Tylka, Jonathan

2015-01-01

Metals produced by additive manufacturing methods, such as Powder Bed Fusion Technology, are now mature enough to be considered for qualification in human spaceflight oxygen systems. The mechanical properties of metals produced through AM processes are being systematically studied. However, it is unknown whether AM metals in oxygen applications may present an increased risk of flammability or ignition as compared to wrought metals of the same metallurgical composition due to increased porosity. Per NASA-STD-6001B materials to be used in oxygen system applications shall be based on flammability and combustion test data, followed by a flammability assessment. Without systematic flammability and ignition testing in oxygen there is no credible method for NASA to accurately evaluate the risk of using AM metals in oxygen systems.

Uncertainty evaluation of mass values determined by electronic balances in analytical chemistry: a new method to correct for air buoyancy.

PubMed

Wunderli, S; Fortunato, G; Reichmuth, A; Richard, Ph

2003-06-01

A new method to correct for the largest systematic influence in mass determination-air buoyancy-is outlined. A full description of the most relevant influence parameters is given and the combined measurement uncertainty is evaluated according to the ISO-GUM approach [1]. A new correction method for air buoyancy using an artefact is presented. This method has the advantage that only a mass artefact is used to correct for air buoyancy. The classical approach demands the determination of the air density and therefore suitable equipment to measure at least the air temperature, the air pressure and the relative air humidity within the demanded uncertainties (i.e. three independent measurement tasks have to be performed simultaneously). The calculated uncertainty is lower for the classical method. However a field laboratory may not always be in possession of fully traceable measurement systems for these room climatic parameters.A comparison of three approaches applied to the calculation of the combined uncertainty of mass values is presented. Namely the classical determination of air buoyancy, the artefact method, and the neglecting of this systematic effect as proposed in the new EURACHEM/CITAC guide [2]. The artefact method is suitable for high-precision measurement in analytical chemistry and especially for the production of certified reference materials, reference values and analytical chemical reference materials. The method could also be used either for volume determination of solids or for air density measurement by an independent method.

Treatment with GLP1 receptor agonists reduce serum CRP concentrations in patients with type 2 diabetes mellitus: A systematic review and meta-analysis of randomized controlled trials.

PubMed

Mazidi, Mohsen; Karimi, Ehsan; Rezaie, Peyman; Ferns, Gordon A

2017-07-01

To undertake a systematic review and meta-analysis of randomized controlled trials of the effect of glucagon-like peptide-1 receptor agonist (GLP-1 RAs) therapy on serum C-reactive protein (CRP) concentrations. PubMed-Medline, SCOPUS, Web of Science and Google Scholar databases were searched for the period up until March 16, 2016. Prospective studies evaluating the impact of GLP-1 RAs on serum CRP were identified. A random effects model (using the DerSimonian-Laird method) and generic inverse variance methods were used for quantitative data synthesis. Sensitivity analysis was conducted using the leave-one-out method. Heterogeneity was quantitatively assessed using the I 2 index. Random effects meta-regression was performed using unrestricted maximum likelihood method to evaluate the impact of potential moderator. International Prospective Register for Systematic Reviews (PROSPERO) number CRD42016036868. Meta-analysis of the data from 7 treatment arms revealed a significant reduction in serum CRP concentrations following treatment with GLP-1 RAs (WMD -2.14 (mg/dL), 95% CI -3.51, -0.78, P=0.002; I 2 96.1%). Removal of one study in the meta-analysis did not change the result in the sensitivity analysis (WMD -2.14 (mg/dL), 95% CI -3.51, -0.78, P=0.002; I 2 96.1%), indicating that our results could not be solely attributed to the effect of a single study. Random effects meta-regression was performed to evaluate the impact of potential moderator on the estimated effect size. Changes in serum CRP concentration were associated with the duration of treatment (slope -0.097, 95% CI -0.158, -0.042, P<0.001). This meta-analysis suggests that GLP-1 RAs therapy causes a significant reduction in CRP. Copyright © 2016 Elsevier Inc. All rights reserved.

Cost-effectiveness of Colorectal Cancer Screening and Treatment Methods: Mapping of Systematic Reviews

PubMed Central

Abdolahi, Hossein Mashhadi; Asiabar, Ali Sarabi; Azami-Aghdash, Saber; Pournaghi-Azar, Fatemeh; Rezapour, Aziz

2018-01-01

Objective: Due to extensive literature on colorectal cancer and their heterogeneous results, this study aimed to summarize the systematic reviews which review the cost-effectiveness studies on different aspects of colorectal cancer. Methods: The required data were collected by searching the following key words according to MeSH: “colorectal cancer,” “colorectal oncology,” “colorectal carcinoma,” “colorectal neoplasm,” “colorectal tumors,” “cost-effectiveness,” “systematic review,” and “meta-analysis.” The following databases were searched: PubMed, Cochrane, Google Scholar, and Scopus. Two reviewers evaluated the articles according to the checklist of “assessment of multiple systematic reviews” (AMSTAR) tool. Results: Finally, eight systematic reviews were included in the study. The Drummond checklist was mostly used for assessing the quality of the articles. The main perspective was related to the payer and the least was relevant to the social. The majority of the cases referred to sensitivity analysis (in 76% of the cases) and the lowest point also was allocated to discounting (in 37% of cases). The Markov model was used most widely in the studies. Treatment methods examined in the studies were not cost-effective in comparison with the studied units. Among the screening methods, computerized tomographic colonography and fecal DNA were cost-effective. The average score of the articles’ qualities was high (9.8 out of 11). Conclusions: The community perspective should be taken into consideration at large in the studies. It is necessary to pay more attention to discounting subject in studies. More frequent application of the Markov model is recommended. PMID:29379836

Health economic evaluations in orthodontics: a systematic review

PubMed Central

Petrén, Sofia; Björnsson, Liselotte; Norlund, Anders; Bondemark, Lars

2016-01-01

Summary Background: Economic evaluation is assuming increasing importance as an integral component of health services research. Aim: To conduct a systematic review of the literature and assess the evidence from studies presenting orthodontic treatment outcomes and the related costs. Materials/methods: The literature review was conducted in four steps, according to Goodman’s model, in order to identify all studies evaluating economic aspects of orthodontic interventions. The search covered the databases Medline, Cinahl, Cochrane, Embase, Google Scholar, National Health Service Economic Evaluation Database, and SCOPUS, for the period from 1966 to September 2014. The inclusion criteria were as follows: randomized controlled trials or controlled clinical trials comparing at least two different orthodontic interventions, evaluation of both economic and orthodontic outcomes, and study populations of all ages. The quality of each included study was assessed as limited, moderate, or high. The overall evidence was assessed according to the GRADE system (The Grading of Recommendations Assessment, Development and Evaluation). Results: The applied terms for searches yielded 1838 studies, of which 989 were excluded as duplicates. Application of the inclusion and exclusion criteria identified 26 eligible studies for which the full-text versions were retrieved and scrutinized. At the final analysis, eight studies remained. Three studies were based on cost-effectiveness analyses and the other five on cost-minimization analysis. Two of the cost-minimization studies included a societal perspective, i.e. the sum of direct and indirect costs. The aims of most of the studies varied widely and of studies comparing equivalent treatment methods, few were of sufficiently high study quality. Thus, the literature to date provides an inadequate evidence base for economic aspects of orthodontic treatment. Conclusion: This systematic review disclosed that few orthodontic studies have presented both economic and clinical outcomes. There is currently insufficient evidence available about the health economics of orthodontic interventions. Further investigation is warranted. PMID:26070925

A Systematic Review and Critical Appraisal of Economic Evaluations of Pharmacological Interventions for People with Bipolar Disorder.

PubMed

Mavranezouli, Ifigeneia; Lokkerbol, Joran

2017-03-01

Bipolar disorder (BD) is a chronic mood disorder that causes substantial psychological and financial burden. Various pharmacological treatments are effective in the management and prevention of acute episodes of BD. In an era of tighter healthcare budgets and a need for more efficient use of resources, several economic evaluations have evaluated the cost effectiveness of treatments for BD. The aim of this study was to systematically review and appraise published economic evaluations of pharmacological interventions for BD. A systematic search combining search terms specific to BD with a health economics search filter was conducted on six bibliographic databases (EMBASE, MEDLINE, PsycINFO, HTA, NHS EED, CENTRAL) in order to identify trial- or model-based full economic evaluations of pharmacological treatments of any phase of the disorder that were published between 1 January 1990 and 18 December 2015. Studies that met the inclusion criteria were critically appraised using the Quality of Health Economic Studies (QHES) checklist, and synthesised in a narrative way. The review included 19 economic studies, which varied with regard to the type and number of interventions assessed, the study design, the phase of treatment (acute or maintenance), the source of efficacy data and the method for evidence synthesis, the outcome measures, the time horizon and the countries/settings in which the studies were conducted. The study quality was variable but the majority of studies were of high or fair quality. Pharmacological interventions are cost effective, compared with no treatment, in the management of BD, both in the acute and maintenance phases. However, it is difficult to draw safe conclusions on the relative cost effectiveness between drugs due to differences across studies and limitations characterising many of them. Future economic evaluations need to consider the whole range of treatment options available for the management of BD and adopt appropriate methods for evidence synthesis and economic modelling, to explore more robustly the relative cost effectiveness of pharmacological interventions for people with BD.

The application of quantitative methods for identifying and exploring the presence of bias in systematic reviews: PDE-5 inhibitors for erectile dysfunction.

PubMed

Bekkering, G E; Abou-Setta, A M; Kleijnen, J

2008-01-01

A systematic review of PDE-5 inhibitors for erectile dysfunction was performed to evaluate the utility of quantitative methods for identifying and exploring the influence of bias and study quality on pooled outcomes from meta-analyses. We included 123 randomized controlled trials (RCTs). Methodological quality was poorly reported. All three drugs appeared highly effective. Indirect adjusted analyses showed no differences between the three drugs. Funnel plots and statistical tests showed no evidence of small-study effects for sildenafil whereas there was evidence of such bias for tadalafil and vardenafil. Adjustment for missing studies using trim and fill techniques did not alter the pooled estimates substantially. The exclusion of previous sildenafil nonresponders was associated with larger treatment effects for tadalafil. This investigation was hampered by poor reporting of methodological quality, a low number of studies, heterogeneity and large effect sizes. Despite such limitations, a comprehensive assessment of biases should be a routine in systematic reviews.

A Variational Assimilation Method for Satellite and Conventional Data: a Revised Basic Model 2B

NASA Technical Reports Server (NTRS)

Achtemeier, Gary L.; Scott, Robert W.; Chen, J.

1991-01-01

A variational objective analysis technique that modifies observations of temperature, height, and wind on the cyclone scale to satisfy the five 'primitive' model forecast equations is presented. This analysis method overcomes all of the problems that hindered previous versions, such as over-determination, time consistency, solution method, and constraint decoupling. A preliminary evaluation of the method shows that it converges rapidly, the divergent part of the wind is strongly coupled in the solution, fields of height and temperature are well-preserved, and derivative quantities such as vorticity and divergence are improved. Problem areas are systematic increases in the horizontal velocity components, and large magnitudes of the local tendencies of the horizontal velocity components. The preliminary evaluation makes note of these problems but detailed evaluations required to determine the origin of these problems await future research.

Evaluations of Structural Interventions for HIV Prevention: A Review of Approaches and Methods.

PubMed

Iskarpatyoti, Brittany S; Lebov, Jill; Hart, Lauren; Thomas, Jim; Mandal, Mahua

2018-04-01

Structural interventions alter the social, economic, legal, political, and built environments that underlie processes affecting population health. We conducted a systematic review of evaluations of structural interventions for HIV prevention in low- and middle-income countries (LMICs) to better understand methodological and other challenges and identify effective evaluation strategies. We included 27 peer-reviewed articles on interventions related to economic empowerment, education, and substance abuse in LMICs. Twenty-one evaluations included clearly articulated theories of change (TOCs); 14 of these assessed the TOC by measuring intermediary variables in the causal pathway between the intervention and HIV outcomes. Although structural interventions address complex interactions, no evaluation included methods designed to evaluate complex systems. To strengthen evaluations of structural interventions, we recommend clearly articulating a TOC and measuring intermediate variables between the predictor and outcome. We additionally recommend adapting study designs and analytic methods outside traditional epidemiology to better capture complex results, influences external to the intervention, and unintended consequences.

Developing Learning Objectives for a Model Course to Prepare Adults for the Assessment of Prior, Non-Sponsored Learning by Portfolio Evaluation.

ERIC Educational Resources Information Center

Stevens, Mary A.

A study was conducted in order to develop a systematic method for the evaluation of students' prior, non-sponsored learning for the award of college credit at Blackhawk College (Illinois). It was determined that a course designed to prepare the student for assessment of prior learning was the best way for the institution to provide assistance to…

Systematic review on measurement properties of questionnaires assessing the neighbourhood environment in the context of youth physical activity behaviour

PubMed Central

2013-01-01

Background High-quality measurement instruments for assessing the neighbourhood environment are a prerequisite for identifying associations between the neighbourhood environment and a person’s physical activity. The aim of this systematic review was to identify reliable and valid questionnaires assessing neighbourhood environmental attributes in the context of physical activity behaviours in children and adolescents. In addition, current gaps and best practice models in instrumentation and their evaluation are discussed. Methods We conducted a systematic literature search using six databases (Web of Science, Medline, TRID, SportDISCUS, PsycARTICLES and PsycINFO). Two independent reviewers screened the identified English-language peer-reviewed journal articles. Only studies examining the measurement properties of self- or proxy-report questionnaires on any aspects of the neighbourhood environment in children and adolescents aged 3 to 18 years were included. The methodological quality of the included studies was assessed using the COSMIN checklists. Results We identified 13 questionnaires on attributes of the neighbourhood environment. Most of these studies were conducted in the United States (n = 7). Eight studies evaluated self-report measures, two studies evaluated parent-report measures and three studies included both administration types. While eight studies had poor methodological quality, we identified three questionnaires with substantial test-retest reliability and two questionnaires with acceptable convergent validity based on sufficient evidential basis. Conclusions Based on the results of this review, we recommend that cross-culturally adapted questionnaires should be used and that existing questionnaires should be evaluated especially in diverse samples and in countries other than the United States. Further, high-quality studies on measurement properties should be promoted and measurement models (formative vs. reflexive) should be specified to ensure that appropriate methods for psychometric testing are applied in future studies. PMID:23663328

Systematic Review of Biological Modulation of Healing in Anterior Cruciate Ligament Reconstruction

PubMed Central

Fu, Sai-Chuen; Cheuk, Yau-Chuk; Yung, Shu-Hang; Rolf, Christer Gustav; Chan, Kai-Ming

2014-01-01

Background: Whether biological modulation is effective to promote healing in anterior cruciate ligament (ACL) reconstruction remains unclear. Purpose: To perform a systematic review of both clinical and experimental evidence of preclinical animal studies on biological modulation to promote healing in ACL reconstruction. Study Design: Systematic review; Level of evidence, 2. Methods: A systematic search was performed using the PubMed, Ovid, and Scopus search engines. Inclusion criteria were clinical and animal studies involving subjects with ACL injury with the use of biological modulation to promote healing outcomes. Methodological quality of clinical studies was evaluated using the Critical Appraisal Skill Programme (CASP) appraisal tool, and animal studies were evaluated by a scoring system based on a published checklist of good animal studies. Results: Ten clinical studies and 50 animal studies were included. Twenty-five included studies were regarded as good quality, with a methodological score ≥5. These studies suggested that transforming growth factor–beta (TGF-β), mesenchymal stem cells, osteogenic factors, and modalities that reduce local inflammation may be beneficial to promote graft healing in ACL reconstruction. Conclusion: This systematic review suggests that biological modulation is able to promote healing on top of surgical treatment for ACL injuries. This treatment strategy chiefly works through promotion of healing at the tunnel-graft interface, but the integrity of the intra-articular midsubstance of the graft would be another target for biological modulation. PMID:26535311

A Point Kinetics Model for Estimating Neutron Multiplication of Bare Uranium Metal in Tagged Neutron Measurements

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tweardy, Matthew C.; McConchie, Seth; Hayward, Jason P.

An extension of the point kinetics model is developed in this paper to describe the neutron multiplicity response of a bare uranium object under interrogation by an associated particle imaging deuterium-tritium (D-T) measurement system. This extended model is used to estimate the total neutron multiplication of the uranium. Both MCNPX-PoliMi simulations and data from active interrogation measurements of highly enriched and depleted uranium geometries are used to evaluate the potential of this method and to identify the sources of systematic error. The detection efficiency correction for measured coincidence response is identified as a large source of systematic error. If themore » detection process is not considered, results suggest that the method can estimate total multiplication to within 13% of the simulated value. Values for multiplicity constants in the point kinetics equations are sensitive to enrichment due to (n, xn) interactions by D-T neutrons and can introduce another significant source of systematic bias. This can theoretically be corrected if isotopic composition is known a priori. Finally, the spatial dependence of multiplication is also suspected of introducing further systematic bias for high multiplication uranium objects.« less

A Point Kinetics Model for Estimating Neutron Multiplication of Bare Uranium Metal in Tagged Neutron Measurements

DOE PAGES

Tweardy, Matthew C.; McConchie, Seth; Hayward, Jason P.

2017-06-13

An extension of the point kinetics model is developed in this paper to describe the neutron multiplicity response of a bare uranium object under interrogation by an associated particle imaging deuterium-tritium (D-T) measurement system. This extended model is used to estimate the total neutron multiplication of the uranium. Both MCNPX-PoliMi simulations and data from active interrogation measurements of highly enriched and depleted uranium geometries are used to evaluate the potential of this method and to identify the sources of systematic error. The detection efficiency correction for measured coincidence response is identified as a large source of systematic error. If themore » detection process is not considered, results suggest that the method can estimate total multiplication to within 13% of the simulated value. Values for multiplicity constants in the point kinetics equations are sensitive to enrichment due to (n, xn) interactions by D-T neutrons and can introduce another significant source of systematic bias. This can theoretically be corrected if isotopic composition is known a priori. Finally, the spatial dependence of multiplication is also suspected of introducing further systematic bias for high multiplication uranium objects.« less

Colic in infants

PubMed Central

2010-01-01

Introduction Colic in infants causes one in six families (17%) with children to consult a health professional. One systematic review of 15 community-based studies found a wide variation in prevalence, which depended on study design and method of recording. Methods and outcomes We conducted a systematic review and aimed to answer the following clinical question: What are the effects of treatments for colic in infants? We searched: Medline, Embase, The Cochrane Library, and other important databases up to September 2009 (Clinical Evidence reviews are updated periodically, please check our website for the most up-to-date version of this review). We included harms alerts from relevant organisations such as the US Food and Drug Administration (FDA) and the UK Medicines and Healthcare products Regulatory Agency (MHRA). Results We found 27 systematic reviews, RCTs, or observational studies that met our inclusion criteria. We performed a GRADE evaluation of the quality of evidence for interventions. Conclusions In this systematic review we present information relating to the effectiveness and safety of the following interventions: advice to increase carrying, advice to reduce stimulation, casein hydrolysate milk, cranial osteopathy, crib vibrator device, focused counselling, gripe water, infant massage, low-lactose milk, simethicone, soya-based infant feeds, spinal manipulation, and whey hydrolysate milk. PMID:21729336

The impact of Cochrane Systematic Reviews: a mixed method evaluation of outputs from Cochrane Review Groups supported by the UK National Institute for Health Research.

PubMed

Bunn, Frances; Trivedi, Daksha; Alderson, Phil; Hamilton, Laura; Martin, Alice; Iliffe, Steve

2014-10-27

There has been a growing emphasis on evidence-informed decision-making in health care. Systematic reviews, such as those produced by the Cochrane Collaboration, have been a key component of this movement. The UK National Institute for Health Research (NIHR) Systematic Review Programme currently supports 20 Cochrane Review Groups (CRGs). The aim of this study was to identify the impacts of Cochrane reviews published by NIHR-funded CRGs during the years 2007-2011. We sent questionnaires to CRGs and review authors, interviewed guideline developers and used bibliometrics and documentary review to get an overview of CRG impact and to evaluate the impact of a sample of 60 Cochrane reviews. We used a framework with four categories (knowledge production, research targeting, informing policy development and impact on practice/services). A total of 1,502 new and updated reviews were produced by the 20 NIHR-funded CRGs between 2007 and 2011. The clearest impacts were on policy with a total of 483 systematic reviews cited in 247 sets of guidance: 62 were international, 175 national (87 from the UK) and 10 local. Review authors and CRGs provided some examples of impact on practice or services, for example, safer use of medication, the identification of new effective drugs or treatments and potential economic benefits through the reduction in the use of unproven or unnecessary procedures. However, such impacts are difficult to objectively document, and the majority of reviewers were unsure if their review had produced specific impacts. Qualitative data suggested that Cochrane reviews often play an instrumental role in informing guidance, although a poor fit with guideline scope or methods, reviews being out of date and a lack of communication between CRGs and guideline developers were barriers to their use. Health and economic impacts of research are generally difficult to measure. We found that to be the case with this evaluation. Impacts on knowledge production and clinical guidance were easier to identify and substantiate than those on clinical practice. Questions remain about how we define and measure impact, and more work is needed to develop suitable methods for impact analysis.

Identifying additional studies for a systematic review of retention strategies in randomised controlled trials: making contact with trials units and trial methodologists.

PubMed

Brueton, Valerie; Tierney, Jayne F; Stenning, Sally; Rait, Greta

2017-08-22

Search strategies for systematic reviews aim to identify all evidence relevant to the research question posed. Reports of methodological research can be difficult to find leading to biased results in systematic reviews of research methodology. Evidence suggests that contact with investigators can help to identify unpublished research. To identify additional eligible randomised controlled trials (RCTs) for a Cochrane systematic review of strategies to improve retention in RCTs, we conducted a survey of UK clinical trials units (CTUs) and made contact with RCT methodologists. Key contacts for all UK CTUs were sent a personalised email with a short questionnaire and summary protocol of the Cochrane methodology review. The questionnaire asked whether a RCT evaluating strategies to improve retention embedded in a RCT had ever been conducted by the CTU. Questions about the stage of completion and publication of such RCTs were included. The summary protocol outlined the aims, eligibility criteria, examples of types of retention strategies, and the primary outcome for the systematic review. Personal communication with RCT methodologists and presentations of preliminary results of the review at conferences were also used to identify additional eligible RCTs. We checked the results of our standard searches to see if eligible studies identified through these additional methods were also found using our standard searches. We identified 14 of the 38 RCTs included in the Cochrane methodology review by contacting trials units and methodologists. Eleven of the 14 RCTs identified by these methods were either published in grey literature, in press or unpublished. Three remaining RCTs were fully published at the time. Six of the RCTs identified were not found through any other searches. The RCTs identified represented data for 6 of 14 RCTs of incentive strategies (52% of randomised participants included in the review), and 6 of 14 RCTs of communication strategies (52% of randomised participants included in the Cochrane review). Data were unavailable for two of the RCTs identified. Methodological evaluations embedded in RCTs may be unpublished, published in the grey literature or where published, poorly indexed in bibliographic databases. To identify such studies and minimise selection bias in systematic reviews of methodological evaluations, reviewers should consider contacting CTUs and trial methodologists.

Toward a systematic exploration of nano-bio interactions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bai, Xue; Liu, Fang; Liu, Yin

Many studies of nanomaterials make non-systematic alterations of nanoparticle physicochemical properties. Given the immense size of the property space for nanomaterials, such approaches are not very useful in elucidating fundamental relationships between inherent physicochemical properties of these materials and their interactions with, and effects on, biological systems. Data driven artificial intelligence methods such as machine learning algorithms have proven highly effective in generating models with good predictivity and some degree of interpretability. They can provide a viable method of reducing or eliminating animal testing. However, careful experimental design with the modelling of the results in mind is a proven andmore » efficient way of exploring large materials spaces. This approach, coupled with high speed automated experimental synthesis and characterization technologies now appearing, is the fastest route to developing models that regulatory bodies may find useful. We advocate greatly increased focus on systematic modification of physicochemical properties of nanoparticles combined with comprehensive biological evaluation and computational analysis. This is essential to obtain better mechanistic understanding of nano-bio interactions, and to derive quantitatively predictive and robust models for the properties of nanomaterials that have useful domains of applicability. - Highlights: • Nanomaterials studies make non-systematic alterations to nanoparticle properties. • Vast nanomaterials property spaces require systematic studies of nano-bio interactions. • Experimental design and modelling are efficient ways of exploring materials spaces. • We advocate systematic modification and computational analysis to probe nano-bio interactions.« less

Current applications of robotics in spine surgery: a systematic review of the literature.

PubMed

Joseph, Jacob R; Smith, Brandon W; Liu, Xilin; Park, Paul

2017-05-01

OBJECTIVE Surgical robotics has demonstrated utility across the spectrum of surgery. Robotics in spine surgery, however, remains in its infancy. Here, the authors systematically review the evidence behind robotic applications in spinal instrumentation. METHODS This systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. Relevant studies (through October 2016) that reported the use of robotics in spinal instrumentation were identified from a search of the PubMed database. Data regarding the accuracy of screw placement, surgeon learning curve, radiation exposure, and reasons for robotic failure were extracted. RESULTS Twenty-five studies describing 2 unique robots met inclusion criteria. Of these, 22 studies evaluated accuracy of spinal instrumentation. Although grading of pedicle screw accuracy was variable, the most commonly used method was the Gertzbein and Robbins system of classification. In the studies using the Gertzbein and Robbins system, accuracy (Grades A and B) ranged from 85% to 100%. Ten studies evaluated radiation exposure during the procedure. In studies that detailed fluoroscopy usage, overall fluoroscopy times ranged from 1.3 to 34 seconds per screw. Nine studies examined the learning curve for the surgeon, and 12 studies described causes of robotic failure, which included registration failure, soft-tissue hindrance, and lateral skiving of the drill guide. CONCLUSIONS Robotics in spine surgery is an emerging technology that holds promise for future applications. Surgical accuracy in instrumentation implanted using robotics appears to be high. However, the impact of robotics on radiation exposure is not clear and seems to be dependent on technique and robot type.

Impact of study design on development and evaluation of an activity-type classifier.

PubMed

van Hees, Vincent T; Golubic, Rajna; Ekelund, Ulf; Brage, Søren

2013-04-01

Methods to classify activity types are often evaluated with an experimental protocol involving prescribed physical activities under confined (laboratory) conditions, which may not reflect real-life conditions. The present study aims to evaluate how study design may impact on classifier performance in real life. Twenty-eight healthy participants (21-53 yr) were asked to wear nine triaxial accelerometers while performing 58 activity types selected to simulate activities in real life. For each sensor location, logistic classifiers were trained in subsets of up to 8 activities to distinguish between walking and nonwalking activities and were then evaluated in all 58 activities. Different weighting factors were used to convert the resulting confusion matrices into an estimation of the confusion matrix as would apply in the real-life setting by creating four different real-life scenarios, as well as one traditional laboratory scenario. The sensitivity of a classifier estimated with a traditional laboratory protocol is within the range of estimates derived from real-life scenarios for any body location. The specificity, however, was systematically overestimated by the traditional laboratory scenario. Walking time was systematically overestimated, except for lower back sensor data (range: 7-757%). In conclusion, classifier performance under confined conditions may not accurately reflect classifier performance in real life. Future studies that aim to evaluate activity classification methods are warranted to pay special attention to the representativeness of experimental conditions for real-life conditions.

Empirical studies on usability of mHealth apps: a systematic literature review.

PubMed

Zapata, Belén Cruz; Fernández-Alemán, José Luis; Idri, Ali; Toval, Ambrosio

2015-02-01

The release of smartphones and tablets, which offer more advanced communication and computing capabilities, has led to the strong emergence of mHealth on the market. mHealth systems are being used to improve patients' lives and their health, in addition to facilitating communication between doctors and patients. Researchers are now proposing mHealth applications for many health conditions such as dementia, autism, dysarthria, Parkinson's disease, and so on. Usability becomes a key factor in the adoption of these applications, which are often used by people who have problems when using mobile devices and who have a limited experience of technology. The aim of this paper is to investigate the empirical usability evaluation processes described in a total of 22 selected studies related to mHealth applications by means of a Systematic Literature Review. Our results show that the empirical evaluation methods employed as regards usability could be improved by the adoption of automated mechanisms. The evaluation processes should also be revised to combine more than one method. This paper will help researchers and developers to create more usable applications. Our study demonstrates the importance of adapting health applications to users' need.

Systematic searching for theory to inform systematic reviews: is it feasible? Is it desirable?

PubMed

Booth, Andrew; Carroll, Christopher

2015-09-01

In recognising the potential value of theory in understanding how interventions work comes a challenge - how to make identification of theory less haphazard? To explore the feasibility of systematic identification of theory. We searched PubMed for published reviews (1998-2012) that had explicitly sought to identify theory. Systematic searching may be characterised by a structured question, methodological filters and an itemised search procedure. We constructed a template (BeHEMoTh - Behaviour of interest; Health context; Exclusions; Models or Theories) for use when systematically identifying theory. The authors tested the template within two systematic reviews. Of 34 systematic reviews, only 12 reviews (35%) reported a method for identifying theory. Nineteen did not specify how they identified studies containing theory. Data were unavailable for three reviews. Candidate terms include concept(s)/conceptual, framework(s), model(s), and theory/theories/theoretical. Information professionals must overcome inadequate reporting and the use of theory out of context. The review team faces an additional concern in lack of 'theory fidelity'. Based on experience with two systematic reviews, the BeHEMoTh template and procedure offers a feasible and useful approach for identification of theory. Applications include realist synthesis, framework synthesis or review of complex interventions. The procedure requires rigorous evaluation. © 2015 Health Libraries Group.

Is the coverage of google scholar enough to be used alone for systematic reviews

PubMed Central

2013-01-01

Background In searches for clinical trials and systematic reviews, it is said that Google Scholar (GS) should never be used in isolation, but in addition to PubMed, Cochrane, and other trusted sources of information. We therefore performed a study to assess the coverage of GS specifically for the studies included in systematic reviews and evaluate if GS was sensitive enough to be used alone for systematic reviews. Methods All the original studies included in 29 systematic reviews published in the Cochrane Database Syst Rev or in the JAMA in 2009 were gathered in a gold standard database. GS was searched for all these studies one by one to assess the percentage of studies which could have been identified by searching only GS. Results All the 738 original studies included in the gold standard database were retrieved in GS (100%). Conclusion The coverage of GS for the studies included in the systematic reviews is 100%. If the authors of the 29 systematic reviews had used only GS, no reference would have been missed. With some improvement in the research options, to increase its precision, GS could become the leading bibliographic database in medicine and could be used alone for systematic reviews. PMID:23302542

Systematic reviews of therapeutic interventions frequently consider patient-important outcomes.

PubMed

Ameur, Hayet; Ravaud, Philippe; Fayard, Florence; Riveros, Carolina; Dechartres, Agnes

2017-04-01

To determine whether recently published and ongoing systematic reviews of therapeutic interventions assess patient-important outcomes. For this methodological review, we searched MEDLINE via PubMed for recently published systematic reviews and online registry of systematic reviews (PROSPERO) for ongoing systematic reviews. We selected systematic reviews with meta-analyses of randomized controlled trials. We extracted all outcomes defined in the methods section and categorized them. Mortality, other clinical events, pain, quality of life, function, and therapeutic decisions were considered patient-important outcomes. We included 420 systematic reviews: 90 Cochrane reviews, 200 other published reviews, and 130 registered ongoing reviews. Primary outcomes were defined in 85 Cochrane reviews (95%), 98 (49%) other published reviews and all ongoing reviews. At least one patient-important outcome was defined as a primary outcome in 81/85 Cochrane reviews (95%), 78/98 other published reviews (80%), and 117/130 ongoing reviews (90%). Considering all outcomes assessed, at least one patient-important outcome was evaluated in 90/90 Cochrane reviews (100%), 189/200 other published reviews (95%), and 121/130 ongoing reviews (93%). Most recent systematic reviews aim to assess patient-important outcomes, which contrasts with RCTs. These results suggest some important gaps between primary and secondary research. Copyright © 2017 Elsevier Inc. All rights reserved.

A Stereological Method for the Quantitative Evaluation of Cartilage Repair Tissue

PubMed Central

Nyengaard, Jens Randel; Lind, Martin; Spector, Myron

2015-01-01

Objective To implement stereological principles to develop an easy applicable algorithm for unbiased and quantitative evaluation of cartilage repair. Design Design-unbiased sampling was performed by systematically sectioning the defect perpendicular to the joint surface in parallel planes providing 7 to 10 hematoxylin–eosin stained histological sections. Counting windows were systematically selected and converted into image files (40-50 per defect). The quantification was performed by two-step point counting: (1) calculation of defect volume and (2) quantitative analysis of tissue composition. Step 2 was performed by assigning each point to one of the following categories based on validated and easy distinguishable morphological characteristics: (1) hyaline cartilage (rounded cells in lacunae in hyaline matrix), (2) fibrocartilage (rounded cells in lacunae in fibrous matrix), (3) fibrous tissue (elongated cells in fibrous tissue), (4) bone, (5) scaffold material, and (6) others. The ability to discriminate between the tissue types was determined using conventional or polarized light microscopy, and the interobserver variability was evaluated. Results We describe the application of the stereological method. In the example, we assessed the defect repair tissue volume to be 4.4 mm3 (CE = 0.01). The tissue fractions were subsequently evaluated. Polarized light illumination of the slides improved discrimination between hyaline cartilage and fibrocartilage and increased the interobserver agreement compared with conventional transmitted light. Conclusion We have applied a design-unbiased method for quantitative evaluation of cartilage repair, and we propose this algorithm as a natural supplement to existing descriptive semiquantitative scoring systems. We also propose that polarized light is effective for discrimination between hyaline cartilage and fibrocartilage. PMID:26069715

A Stereological Method for the Quantitative Evaluation of Cartilage Repair Tissue.

PubMed

Foldager, Casper Bindzus; Nyengaard, Jens Randel; Lind, Martin; Spector, Myron

2015-04-01

To implement stereological principles to develop an easy applicable algorithm for unbiased and quantitative evaluation of cartilage repair. Design-unbiased sampling was performed by systematically sectioning the defect perpendicular to the joint surface in parallel planes providing 7 to 10 hematoxylin-eosin stained histological sections. Counting windows were systematically selected and converted into image files (40-50 per defect). The quantification was performed by two-step point counting: (1) calculation of defect volume and (2) quantitative analysis of tissue composition. Step 2 was performed by assigning each point to one of the following categories based on validated and easy distinguishable morphological characteristics: (1) hyaline cartilage (rounded cells in lacunae in hyaline matrix), (2) fibrocartilage (rounded cells in lacunae in fibrous matrix), (3) fibrous tissue (elongated cells in fibrous tissue), (4) bone, (5) scaffold material, and (6) others. The ability to discriminate between the tissue types was determined using conventional or polarized light microscopy, and the interobserver variability was evaluated. We describe the application of the stereological method. In the example, we assessed the defect repair tissue volume to be 4.4 mm(3) (CE = 0.01). The tissue fractions were subsequently evaluated. Polarized light illumination of the slides improved discrimination between hyaline cartilage and fibrocartilage and increased the interobserver agreement compared with conventional transmitted light. We have applied a design-unbiased method for quantitative evaluation of cartilage repair, and we propose this algorithm as a natural supplement to existing descriptive semiquantitative scoring systems. We also propose that polarized light is effective for discrimination between hyaline cartilage and fibrocartilage.

Evaluating the performance of free-formed surface parts using an analytic network process

NASA Astrophysics Data System (ADS)

Qian, Xueming; Ma, Yanqiao; Liang, Dezhi

2018-03-01

To successfully design parts with a free-formed surface, the critical issue of how to evaluate and select a favourable evaluation strategy before design is raised. The evaluation of free-formed surface parts is a multiple criteria decision-making (MCDM) problem that requires the consideration of a large number of interdependent factors. The analytic network process (ANP) is a relatively new MCDM method that can systematically deal with all kinds of dependences. In this paper, the factors, which come from the life-cycle and influence the design of free-formed surface parts, are proposed. After analysing the interdependence among these factors, a Hybrid ANP (HANP) structure for evaluating the part’s curved surface is constructed. Then, a HANP evaluation of an impeller is presented to illustrate the application of the proposed method.

[Considerations on the use of meta-analyses in the orientation of knowledge and decisions in Occupational Medicine].

PubMed

Catalani, Simona; Berra, Alessandro; Tomasi, Cesare; Romano, Canzio; Pira, Enrico; Garzaro, Giacomo; Apostoli, Pietro

2015-01-01

In recent years, due to the need to elaborate the amount of information available from the scientific literature, the meta-analyses and systematic reviews have become very numerous. The meta-analyses are carried out to evaluate the association between two events when single researches haven't provided comprehensive data. On the other hand, a good meta-analysis must satisfy certain criteria, from the selection of the studies until the evaluation of the outcomes; to this purpose, the application of methods for quality assessment is a crucial point to obtain data of adequate reliability. The aim of this review is to give some introductory tools for a critical approach to meta-analyses and systematic reviews, which have become useful instruments also in occupational medicine.

The role and impact of nurses in American elementary schools: a systematic review of the research.

PubMed

Lineberry, Michelle J; Ickes, Melinda J

2015-02-01

School nurses are tasked with the critical job of keeping students safe and well. Due to competing demands for resources in schools, the impact of school nurses must be demonstrated to secure their jobs. A systematic review of the literature from 1937 to 2013 was conducted to show the efficacy of school nursing activities in American elementary schools. While some studies of immunization compliance, attendance rates, body mass index screening, vision screening, and follow-up are promising, results are mixed and additional evidence is needed. The impact of school nurses on educational and health outcomes must continue to be evaluated and more rigorous evaluation methods should be explored. Suggestions for future research and collaborations are discussed. © The Author(s) 2014.

State of the art of immunoassay methods for B-type natriuretic peptides: An update.

PubMed

Clerico, Aldo; Franzini, Maria; Masotti, Silvia; Prontera, Concetta; Passino, Claudio

2015-01-01

The aim of this review article is to give an update on the state of the art of the immunoassay methods for the measurement of B-type natriuretic peptide (BNP) and its related peptides. Using chromatographic procedures, several studies reported an increasing number of circulating peptides related to BNP in human plasma of patients with heart failure. These peptides may have reduced or even no biological activity. Furthermore, other studies have suggested that, using immunoassays that are considered specific for BNP, the precursor of the peptide hormone, proBNP, constitutes a major portion of the peptide measured in plasma of patients with heart failure. Because BNP immunoassay methods show large (up to 50%) systematic differences in values, the use of identical decision values for all immunoassay methods, as suggested by the most recent international guidelines, seems unreasonable. Since proBNP significantly cross-reacts with all commercial immunoassay methods considered specific for BNP, manufacturers should test and clearly declare the degree of cross-reactivity of glycosylated and non-glycosylated proBNP in their BNP immunoassay methods. Clinicians should take into account that there are large systematic differences between methods when they compare results from different laboratories that use different BNP immunoassays. On the other hand, clinical laboratories should take part in external quality assessment (EQA) programs to evaluate the bias of their method in comparison to other BNP methods. Finally, the authors believe that the development of more specific methods for the active peptide, BNP1-32, should reduce the systematic differences between methods and result in better harmonization of results.

A systematic scoping review of the evidence for consumer involvement in organisations undertaking systematic reviews: focus on Cochrane.

PubMed

Morley, Richard F; Norman, Gill; Golder, Su; Griffith, Polly

2016-01-01

Cochrane is the largest international producer of systematic reviews of clinical trial evidence. We looked for published evidence that reports where consumers (patients and the public) have been involved in Cochrane systematic reviews, and also in reviews published by other organisations.We found 36 studies that reported about consumer involvement either in individual systematic reviews, or in other organisations. The studies showed that consumers were involved in reviews in a range of different ways: coordinating and producing reviews, making reviews more accessible, and spreading the results of reviews ("knowledge transfer"). The most common role was commenting on reviews ("peer reviewing"). Consumers also had other general roles, for example in educating people about evidence or helping other consumers. There were some interesting examples of new ways of involving consumers. The studies showed that most consumers came from rich and English speaking countries. There was little evidence about how consumer involvement had changed the reviews ("impact"). The studies found that consumer involvement needed to be properly supported.In future we believe that more research should be done to understand what kind of consumer involvement has the best impact; that more review authors should report how consumers have been involved; and that consumers who help with reviews should come from more varied backgrounds. Background Cochrane is the largest international producer of systematic reviews, and is committed to consumer involvement in the production and dissemination of its reviews. The review aims to systematically scope the evidence base for consumer involvement in organisations which commission, undertake or support systematic reviews; with an emphasis on Cochrane. Methods In June 2015 we searched six databases and other sources for studies of consumer involvement in organisations which commission, undertake or support systematic reviews, or in individual systematic review processes. All types of reports and evaluations were eligible. Included studies were combined in a narrative synthesis structured by the level of evaluation and the type of involvement. Results We identified 36 relevant studies. Eleven of these were evaluations at the level of a whole organisation; seven of these studied consumer involvement in Cochrane. Ten studies examined individual Cochrane review groups. Twelve studies reported on individual reviews; only two of these were Cochrane reviews. Finally, three studies were themselves syntheses of other studies. The included studies reported varying levels of consumer involvement across a wide range of activities related to review design and conduct. These included activities such as priority setting and outcome definition as well as review-specific roles such as acting as peer referees and producing plain language summaries. The level of satisfaction and awareness of impact was generally higher in studies focused on individual Cochrane review groups than in the organisation-wide studies. Conclusions There was evidence of highly variable levels and types of consumer involvement within and beyond Cochrane, but limited evidence for what makes the most effective methods and levels of involving consumers in review production. Where evidence of impact was found at the level of individual reviews and review groups it underlined the need for properly resourced and supported processes in order to derive the greatest benefit from the lived experiences of consumers who are willing to be involved. Where reviews do involve consumers, their contribution to the final result could be more clearly identified. More rigorous evaluations are needed to determine the best approach to achieving this. Trial registration Not applicable.

Is computer-assisted instruction more effective than other educational methods in achieving ECG competence among medical students and residents? Protocol for a systematic review and meta-analysis.

PubMed

Viljoen, Charle André; Scott Millar, Rob; Engel, Mark E; Shelton, Mary; Burch, Vanessa

2017-12-26

Although ECG interpretation is an essential skill in clinical medicine, medical students and residents often lack ECG competence. Novel teaching methods are increasingly being implemented and investigated to improve ECG training. Computer-assisted instruction is one such method under investigation; however, its efficacy in achieving better ECG competence among medical students and residents remains uncertain. This article describes the protocol for a systematic review and meta-analysis that will compare the effectiveness of computer-assisted instruction with other teaching methods used for the ECG training of medical students and residents. Only studies with a comparative research design will be considered. Articles will be searched for in electronic databases (PubMed, Scopus, Web of Science, Academic Search Premier, CINAHL, PsycINFO, Education Resources Information Center, Africa-Wide Information and Teacher Reference Center). In addition, we will review citation indexes and conduct a grey literature search. Data extraction will be done on articles that met the predefined eligibility criteria. A descriptive analysis of the different teaching modalities will be provided and their educational impact will be assessed in terms of effect size and the modified version of Kirkpatrick framework for the evaluation of educational interventions. This systematic review aims to provide evidence as to whether computer-assisted instruction is an effective teaching modality for ECG training. It is hoped that the information garnered from this systematic review will assist in future curricular development and improve ECG training. As this research is a systematic review of published literature, ethical approval is not required. The results will be reported according to the Preferred Reporting Items for Systematic Review and Meta-Analysis statement and will be submitted to a peer-reviewed journal. The protocol and systematic review will be included in a PhD dissertation. CRD42017067054; Pre-results. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Overview of systematic reviews of therapeutic ranges: methodologies and recommendations for practice.

PubMed

Cooney, Lewis; Loke, Yoon K; Golder, Su; Kirkham, Jamie; Jorgensen, Andrea; Sinha, Ian; Hawcutt, Daniel

2017-06-02

Many medicines are dosed to achieve a particular therapeutic range, and monitored using therapeutic drug monitoring (TDM). The evidence base for a therapeutic range can be evaluated using systematic reviews, to ensure it continues to reflect current indications, doses, routes and formulations, as well as updated adverse effect data. There is no consensus on the optimal methodology for systematic reviews of therapeutic ranges. An overview of systematic reviews of therapeutic ranges was undertaken. The following databases were used: Cochrane Database of Systematic Reviews (CDSR), Database of Abstracts and Reviews of Effects (DARE) and MEDLINE. The published methodologies used when systematically reviewing the therapeutic range of a drug were analyzed. Step by step recommendations to optimize such systematic reviews are proposed. Ten systematic reviews that investigated the correlation between serum concentrations and clinical outcomes encompassing a variety of medicines and indications were assessed. There were significant variations in the methodologies used (including the search terms used, data extraction methods, assessment of bias, and statistical analyses undertaken). Therapeutic ranges should be population and indication specific and based on clinically relevant outcomes. Recommendations for future systematic reviews based on these findings have been developed. Evidence based therapeutic ranges have the potential to improve TDM practice. Current systematic reviews investigating therapeutic ranges have highly variable methodologies and there is no consensus of best practice when undertaking systematic reviews in this field. These recommendations meet a need not addressed by standard protocols.

Evaluation of a Three-Dimensional Stereophotogrammetric Method to Identify and Measure the Palatal Surface Area in Children With Unilateral Cleft Lip and Palate.

PubMed

De Menezes, Marcio; Cerón-Zapata, Ana Maria; López-Palacio, Ana Maria; Mapelli, Andrea; Pisoni, Luca; Sforza, Chiarella

2016-01-01

To assess a three-dimensional (3D) stereophotogrammetric method for area delimitation and evaluation of the dental arches of children with unilateral cleft lip and palate (UCLP). Obtained data were also used to assess the 3D changes occurring in the maxillary arch with the use of orthopedic therapy prior to rhinocheiloplasty and before the first year of life. Within the collaboration between the Università degli Studi di Milano (Italy) and the University CES of Medellin (Colombia), 96 palatal cast models obtained from neonatal patients with UCLP were analyzed using a 3D stereophotogrammetric imaging system. The area of the minor and greater cleft segments on the digital dental cast surface were delineated by the visualization tool of the stereophotogrammetric software and then examined. "Trueness" of the measurements, as well as systematic and random errors between operators' tracings ("precision") were calculated. The method gave area measurements close to true values (errors lower than 2%), without systematic measurement errors for tracings by both interoperators and intraoperators (P > .05). Statistically significant differences (P < .05) were noted for alveolar segment and time. Maxillary segments have the potential for growth during presurgical orthopedic treatment in the early neonatal period. The cleft segment delimitation on digital dental casts and area measurements by the 3D stereophotogrammetric system revealed an accurate (true and precise) method for evaluating the stone casts of newborn patients with UCLP.

Health technology assessment: Off-site sterilization

PubMed Central

Dehnavieh, Reza; Mirshekari, Nadia; Ghasemi, Sara; Goudarzi, Reza; Haghdoost, AliAkbar; Mehrolhassani, Mohammad Hossain; Moshkani, Zahra; Noori Hekmat, Somayeh

2016-01-01

Background: Every year millions of dollars are expended to equip and maintain the hospital sterilization centers, and our country is not an exception of this matter. According to this, it is important to use more effective technologies and methods in health system in order to reach more effectiveness and saving in costs. This study was conducted with the aim of evaluating the technology of regional sterilization centers. Methods: This study was done in four steps. At the first step, safety and effectiveness of technology was studied via systematic study of evidence. The next step was done to evaluate the economical aspect of off-site sterilization technology using gathered data from systematic review of the texts which were related to the technology and costs of off-site and in-site hospital sterilization. Third step was conducted to collect experiences of using technology in some selected hospitals around the world. And in the last step different aspects of acceptance and use of this technology in Iran were evaluated. Results: Review of the selected articles indicated that efficacy and effectiveness of this technology is Confirmed. The results also showed that using this method is not economical in Iran. Conclusion: According to the revealed evidences and also cost analysis, due to shortage of necessary substructures and economical aspect, installing the off-site sterilization health technology in hospitals is not possible currently. But this method can be used to provide sterilization services for clinics and outpatients centers. PMID:27390714

Does Parent-Child Interaction Therapy Reduce Future Physical Abuse? A Meta-Analysis

ERIC Educational Resources Information Center

Kennedy, Stephanie C.; Kim, Johnny S.; Tripodi, Stephen J.; Brown, Samantha M.; Gowdy, Grace

2016-01-01

Objective: To use meta-analytic techniques to evaluating the effectiveness of parent-child interaction therapy (PCIT) at reducing future physical abuse among physically abusive families. Methods: A systematic search identified six eligible studies. Outcomes of interest were physical abuse recurrence, child abuse potential, and parenting stress.…

School Programs Targeting Stress Management in Children and Adolescents: A Meta-Analysis

ERIC Educational Resources Information Center

Kraag, Gerda; Zeegers, Maurice P.; Kok, Gerjo; Hosman, Clemens; Abu-Saad, Huda Huijer

2006-01-01

Introduction: This meta-analysis evaluates the effect of school programs targeting stress management or coping skills in school children. Methods: Articles were selected through a systematic literature search. Only randomized controlled trials or quasi-experimental studies were included. The standardized mean differences (SMDs) between baseline…

Development Research of a Teachers' Educational Performance Support System: The Practices of Design, Development, and Evaluation

ERIC Educational Resources Information Center

Hung, Wei-Chen; Smith, Thomas J.; Harris, Marian S.; Lockard, James

2010-01-01

This study adopted design and development research methodology (Richey & Klein, "Design and development research: Methods, strategies, and issues," 2007) to systematically investigate the process of applying instructional design principles, human-computer interaction, and software engineering to a performance support system (PSS) for behavior…

In Transit...Making the Change to Metrics.

ERIC Educational Resources Information Center

Farnsworth, Briant J.; And Others

1980-01-01

Granite School District (Utah) developed a systematic, effective, and cost-efficient teacher inservice program which provides a basic understanding of metrics, materials and methods for direct classroom use, and evaluation of the learning process, through the use of self-contained, three-phase modules for home or school use. (Author/SB)

Antipsychotic Drug Side Effects for Persons with Intellectual Disability

ERIC Educational Resources Information Center

Matson, Johnny L.; Mahan, Sara

2010-01-01

Antipsychotic drugs are the most frequently prescribed of the psychotropic drugs among the intellectually disabled (ID) population. Given their widespread use, efforts to systematically assess and report side effects are warranted. Specific scaling methods such as the "Matson Evaluation of Side Effects" ("MEDS"), the "Abnormal Inventory Movement…

A Meta-Analysis of Interventions to Reduce Adolescent Cannabis Use

ERIC Educational Resources Information Center

Bender, Kimberly; Tripodi, Stephen J.; Sarteschi, Christy; Vaughn, Michael G.

2011-01-01

Objective: This meta-analytic review assesses the effectiveness of substance abuse interventions to reduce adolescent cannabis use. Method: A systematic search identified 15 randomized controlled evaluations of interventions to reduce adolescent cannabis use published between 1960 and 2008. The primary outcome variables, frequency of cannabis use,…

Evaluation of Contextual Variability in Prediction of Reinforcer Effectiveness

ERIC Educational Resources Information Center

Pino, Olimpia; Dazzi, Carla

2005-01-01

Previous research has shown that stimulus preference assessments based on caregiver-opinion did not coincide with results of a more systematic method of assessing reinforcing value unless stimuli that were assessed to represent preferences were also preferred on paired stimulus presentation format, and that the relative preference based on the…

Teaching Evidence-based Medicine Using Literature for Problem Solving.

ERIC Educational Resources Information Center

Mottonen, Merja; Tapanainen, Paivi; Nuutinen, Matti; Rantala, Heikki; Vainionpaa, Leena; Uhari, Matti

2001-01-01

Evidence-based medicine--the process of using research findings systematically as the basis for clinical decisions--can be taught using problem-solving teaching methods. Evaluates whether it was possible to motivate students to use the original literature by giving them selected patient problems to solve. (Author/ASK)

Quebec: La valse des valeurs (Quebec: The Waltz of Values).

ERIC Educational Resources Information Center

Ueberschlag, Roger

1991-01-01

In recent decades, Quebec has been continuously examining its educational values, addressing in particular the effectiveness of traditional educational methods and curricula, role of institutional culture in academic success, and value placed on ethnic integration. Priority should be given to cognitive development and systematic evaluation but…

Ethics: A Bridge for Studying the Social Contexts of Professional Communication.

ERIC Educational Resources Information Center

Speck, Bruce W.

1989-01-01

Describes a method for helping students evaluate ethical issues in a systematic way, based on Lawrence Kohlberg's stages of moral development. Recommends the case-study approach for creating social constructs in which students face ethical dilemmas, and outlines a case-study ethics unit using Kohlberg's model. (MM)

Computer-Based Education for Patients with Hypertension: A Systematic Review

ERIC Educational Resources Information Center

Saksena, Anuraag

2010-01-01

Objective: To evaluate the benefits of using computer-based interventions to provide patient education to individuals with hypertension. Methods: MEDLINE, Web of Knowledge, CINAHL, ERIC, EMBASE, and PsychINFO were searched from 1995 to April 2009 using keywords related to "computers," "hypertension," "education," and "clinical trial." Additional…

Mapping Children's Understanding of Mathematical Equivalence

ERIC Educational Resources Information Center

Taylor, Roger S.; Rittle-Johnson, Bethany; Matthews, Percival G.; McEldoon, Katherine L.

2009-01-01

The focus of this research is to develop an initial framework for assessing and interpreting students' level of understanding of mathematical equivalence. Although this topic has been studied for many years, there has been no systematic development or evaluation of a valid measure of equivalence knowledge. A powerful method for accomplishing this…

Speech Perception in Individuals with Auditory Neuropathy

ERIC Educational Resources Information Center

Zeng, Fan-Gang; Liu, Sheng

2006-01-01

Purpose: Speech perception in participants with auditory neuropathy (AN) was systematically studied to answer the following 2 questions: Does noise present a particular problem for people with AN: Can clear speech and cochlear implants alleviate this problem? Method: The researchers evaluated the advantage in intelligibility of clear speech over…

Bridging the Gap: Direct Behavior Rating-Single Item Scales

ERIC Educational Resources Information Center

Miller, Faith G.; Crovello, Nicholas; Swenson, Nicole

2017-01-01

Direct Behavior Ratings (DBRs) are behavioral assessment methods that combine the benefits of systematic direct observation and behavior rating scales. That is, DBRs involve the observation of operationally defined target behaviors during a prespecified observation period and the evaluation of those behaviors via brief ratings. In this way, DBR is…

Seeking consent for research with indigenous communities: a systematic review.

PubMed

Fitzpatrick, Emily F M; Martiniuk, Alexandra L C; D'Antoine, Heather; Oscar, June; Carter, Maureen; Elliott, Elizabeth J

2016-10-22

When conducting research with Indigenous populations consent should be sought from both individual participants and the local community. We aimed to search and summarise the literature about methods for seeking consent for research with Indigenous populations. A systematic literature search was conducted for articles that describe or evaluate the process of seeking informed consent for research with Indigenous participants. Guidelines for ethical research and for seeking consent with Indigenous people are also included in our review. Of 1447 articles found 1391 were excluded (duplicates, irrelevant, not in English); 56 were relevant and included. Articles were categorised into original research that evaluated the consent process (n = 5) or publications detailing the process of seeking consent (n = 13) and guidelines for ethical research (n = 38). Guidelines were categorised into international (n = 8); national (n = 20) and state/regional/local guidelines (n = 10). In five studies based in Australia, Canada and The United States of America the consent process with Indigenous people was objectively evaluated. In 13 other studies interpreters, voice recording, videos, pictures, flipcharts and "plain language" forms were used to assist in seeking consent but these processes were not evaluated. Some Indigenous organisations provide examples of community-designed resources for seeking consent and describe methods of community engagement, but none are evaluated. International, national and local ethical guidelines stress the importance of upholding Indigenous values but fail to specify methods for engaging communities or obtaining individual consent. In the 'Grey literature' concerns about the consent process are identified but no solutions are offered. Consultation with Indigenous communities is needed to determine how consent should be sought from the community and the individual, and how to evaluate this process.

NetBenchmark: a bioconductor package for reproducible benchmarks of gene regulatory network inference.

PubMed

Bellot, Pau; Olsen, Catharina; Salembier, Philippe; Oliveras-Vergés, Albert; Meyer, Patrick E

2015-09-29

In the last decade, a great number of methods for reconstructing gene regulatory networks from expression data have been proposed. However, very few tools and datasets allow to evaluate accurately and reproducibly those methods. Hence, we propose here a new tool, able to perform a systematic, yet fully reproducible, evaluation of transcriptional network inference methods. Our open-source and freely available Bioconductor package aggregates a large set of tools to assess the robustness of network inference algorithms against different simulators, topologies, sample sizes and noise intensities. The benchmarking framework that uses various datasets highlights the specialization of some methods toward network types and data. As a result, it is possible to identify the techniques that have broad overall performances.

Statistical Inference and Reverse Engineering of Gene Regulatory Networks from Observational Expression Data

PubMed Central

Emmert-Streib, Frank; Glazko, Galina V.; Altay, Gökmen; de Matos Simoes, Ricardo

2012-01-01

In this paper, we present a systematic and conceptual overview of methods for inferring gene regulatory networks from observational gene expression data. Further, we discuss two classic approaches to infer causal structures and compare them with contemporary methods by providing a conceptual categorization thereof. We complement the above by surveying global and local evaluation measures for assessing the performance of inference algorithms. PMID:22408642

Economic analysis of the health impacts of housing improvement studies: a systematic review

PubMed Central

Fenwick, Elisabeth; Macdonald, Catriona; Thomson, Hilary

2013-01-01

Background Economic evaluation of public policies has been advocated but rarely performed. Studies from a systematic review of the health impacts of housing improvement included data on costs and some economic analysis. Examination of these data provides an opportunity to explore the difficulties and the potential for economic evaluation of housing. Methods Data were extracted from all studies included in the systematic review of housing improvement which had reported costs and economic analysis (n=29/45). The reported data were assessed for their suitability to economic evaluation. Where an economic analysis was reported the analysis was described according to pre-set definitions of various types of economic analysis used in the field of health economics. Results 25 studies reported cost data on the intervention and/or benefits to the recipients. Of these, 11 studies reported data which was considered amenable to economic evaluation. A further four studies reported conducting an economic evaluation. Three of these studies presented a hybrid ‘balance sheet’ approach and indicated a net economic benefit associated with the intervention. One cost-effectiveness evaluation was identified but the data were unclearly reported; the cost-effectiveness plane suggested that the intervention was more costly and less effective than the status quo. Conclusions Future studies planning an economic evaluation need to (i) make best use of available data and (ii) ensure that all relevant data are collected. To facilitate this, economic evaluations should be planned alongside the intervention with input from health economists from the outset of the study. When undertaken appropriately, economic evaluation provides the potential to make significant contributions to housing policy. PMID:23929616

Photogrammetry as a tool for the postural evaluation of the spine: A systematic review.

PubMed

Furlanetto, Tássia Silveira; Sedrez, Juliana Adami; Candotti, Cláudia Tarragô; Loss, Jefferson Fagundes

2016-02-18

To evaluate the use of photogrammetry and identify the mathematical procedures applied when evaluating spinal posture. A systematic search using keywords was conducted in the PubMed, EMBASE, Scopus, Science and Medicine(®) databases. The following inclusion criteria adopted were: (1) the use of photogrammetry as a method to evaluate spinal posture; (2) evaluations of spinal curvature in the sagittal and/or frontal plane; (3) studies published within the last three decades; and (4) written entirely in English. The exclusion criteria were: (1) studies which objective involved the verification of some aspect of validation of instruments; (2) studies published as abstracts and those published in scientific events; and (3) studies using evaluation of the anteriorization of the head to determine the angular positioning of the cervical spine. The articles in this review were included and evaluated for their methodological quality, based on the Downs and Black scale, by two independent reviewers. Initially, 1758 articles were found, 76 of which were included upon reading the full texts and 29 were included in accordance with the predetermined criteria. In addition, after analyzing the references in those articles, a further six articles were selected, so that 35 articles were included in this review. This systematic review revealed that the photogrammetry has been using in observational studies. Furthermore, it was also found that, although the data collection methodologies are similar across the studies, in relation to aspects of data analysis, the methodologies are very different, especially regarding the mathematical routines employed to support different postural evaluation software. With photogrammetry, the aim of the assessment, whether it is for clinical, research or collective health purposes, must be considered when choosing which protocol to use to evaluate spinal posture.

Multibody Kinematics Optimization for the Estimation of Upper and Lower Limb Human Joint Kinematics: A Systematized Methodological Review.

PubMed

Begon, Mickaël; Andersen, Michael Skipper; Dumas, Raphaël

2018-03-01

Multibody kinematics optimization (MKO) aims to reduce soft tissue artefact (STA) and is a key step in musculoskeletal modeling. The objective of this review was to identify the numerical methods, their validation and performance for the estimation of the human joint kinematics using MKO. Seventy-four papers were extracted from a systematized search in five databases and cross-referencing. Model-derived kinematics were obtained using either constrained optimization or Kalman filtering to minimize the difference between measured (i.e., by skin markers, electromagnetic or inertial sensors) and model-derived positions and/or orientations. While hinge, universal, and spherical joints prevail, advanced models (e.g., parallel and four-bar mechanisms, elastic joint) have been introduced, mainly for the knee and shoulder joints. Models and methods were evaluated using: (i) simulated data based, however, on oversimplified STA and joint models; (ii) reconstruction residual errors, ranging from 4 mm to 40 mm; (iii) sensitivity analyses which highlighted the effect (up to 36 deg and 12 mm) of model geometrical parameters, joint models, and computational methods; (iv) comparison with other approaches (i.e., single body kinematics optimization and nonoptimized kinematics); (v) repeatability studies that showed low intra- and inter-observer variability; and (vi) validation against ground-truth bone kinematics (with errors between 1 deg and 22 deg for tibiofemoral rotations and between 3 deg and 10 deg for glenohumeral rotations). Moreover, MKO was applied to various movements (e.g., walking, running, arm elevation). Additional validations, especially for the upper limb, should be undertaken and we recommend a more systematic approach for the evaluation of MKO. In addition, further model development, scaling, and personalization methods are required to better estimate the secondary degrees-of-freedom (DoF).

Systematic Review of the Effectiveness of Mass Media Interventions for Child Survival in Low- and Middle-Income Countries

PubMed Central

Naugle, Danielle A.; Hornik, Robert C.

2014-01-01

Through a systematic review of the literature, this article summarizes and evaluates evidence for the effectiveness of mass media interventions for child survival. To be included, studies had to describe a mass media intervention; address a child survival health topic; present quantitative data from a low- or middle-income country; use an evaluation design that compared outcomes using pre- and postintervention data, treatment versus comparison groups, or postintervention data across levels of exposure; and report a behavioral or health outcome. The 111 campaign evaluations that met the inclusion criteria included 15 diarrheal disease, 8 immunization, 2 malaria, 14 nutrition, 1 preventing mother-to-child transmission of HIV, 4 respiratory disease, and 67 reproductive health interventions. These evaluations were then sorted into weak (n = 33), moderate (n = 32), and stronger evaluations (n = 46) on the basis of the sampling method, the evaluation design, and efforts to address threats to inference of mass media effects. The moderate and stronger evaluations provide evidence that mass media-centric campaigns can positively impact a wide range of child survival health behaviors. PMID:25207453

Evaluating test-retest reliability in patient-reported outcome measures for older people: A systematic review.

PubMed

Park, Myung Sook; Kang, Kyung Ja; Jang, Sun Joo; Lee, Joo Yun; Chang, Sun Ju

2018-03-01

This study aimed to evaluate the components of test-retest reliability including time interval, sample size, and statistical methods used in patient-reported outcome measures in older people and to provide suggestions on the methodology for calculating test-retest reliability for patient-reported outcomes in older people. This was a systematic literature review. MEDLINE, Embase, CINAHL, and PsycINFO were searched from January 1, 2000 to August 10, 2017 by an information specialist. This systematic review was guided by both the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist and the guideline for systematic review published by the National Evidence-based Healthcare Collaborating Agency in Korea. The methodological quality was assessed by the Consensus-based Standards for the selection of health Measurement Instruments checklist box B. Ninety-five out of 12,641 studies were selected for the analysis. The median time interval for test-retest reliability was 14days, and the ratio of sample size for test-retest reliability to the number of items in each measure ranged from 1:1 to 1:4. The most frequently used statistical methods for continuous scores was intraclass correlation coefficients (ICCs). Among the 63 studies that used ICCs, 21 studies presented models for ICC calculations and 30 studies reported 95% confidence intervals of the ICCs. Additional analyses using 17 studies that reported a strong ICC (>0.09) showed that the mean time interval was 12.88days and the mean ratio of the number of items to sample size was 1:5.37. When researchers plan to assess the test-retest reliability of patient-reported outcome measures for older people, they need to consider an adequate time interval of approximately 13days and the sample size of about 5 times the number of items. Particularly, statistical methods should not only be selected based on the types of scores of the patient-reported outcome measures, but should also be described clearly in the studies that report the results of test-retest reliability. Copyright © 2017 Elsevier Ltd. All rights reserved.

A Systematic Review of Validated Methods for Identifying Cerebrovascular Accident or Transient Ischemic Attack Using Administrative Data

PubMed Central

Andrade, Susan E.; Harrold, Leslie R.; Tjia, Jennifer; Cutrona, Sarah L.; Saczynski, Jane S.; Dodd, Katherine S.; Goldberg, Robert J.; Gurwitz, Jerry H.

2012-01-01

Purpose To perform a systematic review of the validity of algorithms for identifying cerebrovascular accidents (CVAs) or transient ischemic attacks (TIAs) using administrative and claims data. Methods PubMed and Iowa Drug Information Service (IDIS) searches of the English language literature were performed to identify studies published between 1990 and 2010 that evaluated the validity of algorithms for identifying CVAs (ischemic and hemorrhagic strokes, intracranial hemorrhage and subarachnoid hemorrhage) and/or TIAs in administrative data. Two study investigators independently reviewed the abstracts and articles to determine relevant studies according to pre-specified criteria. Results A total of 35 articles met the criteria for evaluation. Of these, 26 articles provided data to evaluate the validity of stroke, 7 reported the validity of TIA, 5 reported the validity of intracranial bleeds (intracerebral hemorrhage and subarachnoid hemorrhage), and 10 studies reported the validity of algorithms to identify the composite endpoints of stroke/TIA or cerebrovascular disease. Positive predictive values (PPVs) varied depending on the specific outcomes and algorithms evaluated. Specific algorithms to evaluate the presence of stroke and intracranial bleeds were found to have high PPVs (80% or greater). Algorithms to evaluate TIAs in adult populations were generally found to have PPVs of 70% or greater. Conclusions The algorithms and definitions to identify CVAs and TIAs using administrative and claims data differ greatly in the published literature. The choice of the algorithm employed should be determined by the stroke subtype of interest. PMID:22262598

Evaluation of normalization methods in mammalian microRNA-Seq data

PubMed Central

Garmire, Lana Xia; Subramaniam, Shankar

2012-01-01

Simple total tag count normalization is inadequate for microRNA sequencing data generated from the next generation sequencing technology. However, so far systematic evaluation of normalization methods on microRNA sequencing data is lacking. We comprehensively evaluate seven commonly used normalization methods including global normalization, Lowess normalization, Trimmed Mean Method (TMM), quantile normalization, scaling normalization, variance stabilization, and invariant method. We assess these methods on two individual experimental data sets with the empirical statistical metrics of mean square error (MSE) and Kolmogorov-Smirnov (K-S) statistic. Additionally, we evaluate the methods with results from quantitative PCR validation. Our results consistently show that Lowess normalization and quantile normalization perform the best, whereas TMM, a method applied to the RNA-Sequencing normalization, performs the worst. The poor performance of TMM normalization is further evidenced by abnormal results from the test of differential expression (DE) of microRNA-Seq data. Comparing with the models used for DE, the choice of normalization method is the primary factor that affects the results of DE. In summary, Lowess normalization and quantile normalization are recommended for normalizing microRNA-Seq data, whereas the TMM method should be used with caution. PMID:22532701

Cost-Effectiveness of HBV and HCV Screening Strategies – A Systematic Review of Existing Modelling Techniques

PubMed Central

Geue, Claudia; Wu, Olivia; Xin, Yiqiao; Heggie, Robert; Hutchinson, Sharon; Martin, Natasha K.; Fenwick, Elisabeth; Goldberg, David

2015-01-01

Introduction Studies evaluating the cost-effectiveness of screening for Hepatitis B Virus (HBV) and Hepatitis C Virus (HCV) are generally heterogeneous in terms of risk groups, settings, screening intervention, outcomes and the economic modelling framework. It is therefore difficult to compare cost-effectiveness results between studies. This systematic review aims to summarise and critically assess existing economic models for HBV and HCV in order to identify the main methodological differences in modelling approaches. Methods A structured search strategy was developed and a systematic review carried out. A critical assessment of the decision-analytic models was carried out according to the guidelines and framework developed for assessment of decision-analytic models in Health Technology Assessment of health care interventions. Results The overall approach to analysing the cost-effectiveness of screening strategies was found to be broadly consistent for HBV and HCV. However, modelling parameters and related structure differed between models, producing different results. More recent publications performed better against a performance matrix, evaluating model components and methodology. Conclusion When assessing screening strategies for HBV and HCV infection, the focus should be on more recent studies, which applied the latest treatment regimes, test methods and had better and more complete data on which to base their models. In addition to parameter selection and associated assumptions, careful consideration of dynamic versus static modelling is recommended. Future research may want to focus on these methodological issues. In addition, the ability to evaluate screening strategies for multiple infectious diseases, (HCV and HIV at the same time) might prove important for decision makers. PMID:26689908

Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions

PubMed Central

Egan, M; Bambra, C; Petticrew, M; Whitehead, M

2009-01-01

Background: The reporting of intervention implementation in studies included in systematic reviews of organisational-level workplace interventions was appraised. Implementation is taken to include such factors as intervention setting, resources, planning, collaborations, delivery and macro-level socioeconomic contexts. Understanding how implementation affects intervention outcomes may help prevent erroneous conclusions and misleading assumptions about generalisability, but implementation must be adequately reported if it is to be taken into account. Methods: Data on implementation were obtained from four systematic reviews of complex interventions in workplace settings. Implementation was appraised using a specially developed checklist and by means of an unstructured reading of the text. Results: 103 studies were identified and appraised, evaluating four types of organisational-level workplace intervention (employee participation, changing job tasks, shift changes and compressed working weeks). Many studies referred to implementation, but reporting was generally poor and anecdotal in form. This poor quality of reporting did not vary greatly by type or date of publication. A minority of studies described how implementation may have influenced outcomes. These descriptions were more usefully explored through an unstructured reading of the text, rather than by means of the checklist. Conclusions: Evaluations of complex interventions should include more detailed reporting of implementation and consider how to measure quality of implementation. The checklist helped us explore the poor reporting of implementation in a more systematic fashion. In terms of interpreting study findings and their transferability, however, the more qualitative appraisals appeared to offer greater potential for exploring how implementation may influence the findings of specific evaluations. Implementation appraisal techniques for systematic reviews of complex interventions require further development and testing. PMID:18718981

Transport Coefficients from Large Deviation Functions

NASA Astrophysics Data System (ADS)

Gao, Chloe; Limmer, David

2017-10-01

We describe a method for computing transport coefficients from the direct evaluation of large deviation function. This method is general, relying on only equilibrium fluctuations, and is statistically efficient, employing trajectory based importance sampling. Equilibrium fluctuations of molecular currents are characterized by their large deviation functions, which is a scaled cumulant generating function analogous to the free energy. A diffusion Monte Carlo algorithm is used to evaluate the large deviation functions, from which arbitrary transport coefficients are derivable. We find significant statistical improvement over traditional Green-Kubo based calculations. The systematic and statistical errors of this method are analyzed in the context of specific transport coefficient calculations, including the shear viscosity, interfacial friction coefficient, and thermal conductivity.

Commentary: Writing and Evaluating Qualitative Research Reports

PubMed Central

Thompson, Deborah; Aroian, Karen J.; McQuaid, Elizabeth L.; Deatrick, Janet A.

2016-01-01

Objective To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. Methods A question and answer format is used to address considerations for writing and evaluating qualitative research. Results and Conclusions When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field’s ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. PMID:27118271

A scoping review of rapid review methods.

PubMed

Tricco, Andrea C; Antony, Jesmin; Zarin, Wasifa; Strifler, Lisa; Ghassemi, Marco; Ivory, John; Perrier, Laure; Hutton, Brian; Moher, David; Straus, Sharon E

2015-09-16

Rapid reviews are a form of knowledge synthesis in which components of the systematic review process are simplified or omitted to produce information in a timely manner. Although numerous centers are conducting rapid reviews internationally, few studies have examined the methodological characteristics of rapid reviews. We aimed to examine articles, books, and reports that evaluated, compared, used or described rapid reviews or methods through a scoping review. MEDLINE, EMBASE, the Cochrane Library, internet websites of rapid review producers, and reference lists were searched to identify articles for inclusion. Two reviewers independently screened literature search results and abstracted data from included studies. Descriptive analysis was conducted. We included 100 articles plus one companion report that were published between 1997 and 2013. The studies were categorized as 84 application papers, seven development papers, six impact papers, and four comparison papers (one was included in two categories). The rapid reviews were conducted between 1 and 12 months, predominantly in Europe (58 %) and North America (20 %). The included studies failed to report 6 % to 73 % of the specific systematic review steps examined. Fifty unique rapid review methods were identified; 16 methods occurred more than once. Streamlined methods that were used in the 82 rapid reviews included limiting the literature search to published literature (24 %) or one database (2 %), limiting inclusion criteria by date (68 %) or language (49 %), having one person screen and another verify or screen excluded studies (6 %), having one person abstract data and another verify (23 %), not conducting risk of bias/quality appraisal (7 %) or having only one reviewer conduct the quality appraisal (7 %), and presenting results as a narrative summary (78 %). Four case studies were identified that compared the results of rapid reviews to systematic reviews. Three studies found that the conclusions between rapid reviews and systematic reviews were congruent. Numerous rapid review approaches were identified and few were used consistently in the literature. Poor quality of reporting was observed. A prospective study comparing the results from rapid reviews to those obtained through systematic reviews is warranted.

A Systematic Review Exploring the Social Cognitive Theory of Self-Regulation as a Framework for Chronic Health Condition Interventions

PubMed Central

Tougas, Michelle E.; Hayden, Jill A.; McGrath, Patrick J.; Huguet, Anna; Rozario, Sharlene

2015-01-01

Background Theory is often recommended as a framework for guiding hypothesized mechanisms of treatment effect. However, there is limited guidance about how to use theory in intervention development. Methods We conducted a systematic review to provide an exemplar review evaluating the extent to which use of theory is identified and incorporated within existing interventions. We searched electronic databases PubMed, PsycINFO, CENTRAL, and EMBASE from inception to May 2014. We searched clinicaltrials.gov for registered protocols, reference lists of relevant systematic reviews and included studies, and conducted a citation search in Web of Science. We included peer-reviewed publications of interventions that referenced the social cognitive theory of self-regulation as a framework for interventions to manage chronic health conditions. Two reviewers independently assessed articles for eligibility. We contacted all authors of included studies for information detailing intervention content. We describe how often theory mechanisms were addressed by interventions, and report intervention characteristics used to address theory. Results Of 202 articles that reported using the social cognitive theory of self-regulation, 52% failed to incorporate self-monitoring, a main theory component, and were therefore excluded. We included 35 interventions that adequately used the theory framework. Intervention characteristics were often poorly reported in peer-reviewed publications, 21 of 35 interventions incorporated characteristics that addressed each of the main theory components. Each intervention addressed, on average, six of eight self-monitoring mechanisms, two of five self-judgement mechanisms, and one of three self-evaluation mechanisms. The self-monitoring mechanisms ‘Feedback’ and ‘Consistency’ were addressed by all interventions, whereas the self-evaluation mechanisms ‘Self-incentives’ and ‘External rewards’ were addressed by six and four interventions, respectively. The present review establishes that systematic review is a feasible method of identifying use of theory as a conceptual framework for existing interventions. We identified the social cognitive theory of self-regulation as a feasible framework to guide intervention development for chronic health conditions. PMID:26252889

Alternative method for evaluating the pair energy of nucleons in nuclei

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nurmukhamedov, A. M., E-mail: fattah52@mail.ru

2015-12-15

An alternative method for determining the odd–even effect parameter related to special features of the Casimir operator in Wigner’s mass formula for nuclei is proposed. A procedure for calculating this parameter is presented. The proposed method relies on a geometric interpretation of the Casimir operator, experimental data concerning the contribution of spin–orbit interaction to the nuclear mass for even–even and odd–odd nuclei, and systematics of energy gaps in the spectra of excited states of even–even nuclei.

System calibration method for Fourier ptychographic microscopy

NASA Astrophysics Data System (ADS)

Pan, An; Zhang, Yan; Zhao, Tianyu; Wang, Zhaojun; Dan, Dan; Lei, Ming; Yao, Baoli

2017-09-01

Fourier ptychographic microscopy (FPM) is a recently proposed computational imaging technique with both high-resolution and wide field of view. In current FPM imaging platforms, systematic error sources come from aberrations, light-emitting diode (LED) intensity fluctuation, parameter imperfections, and noise, all of which may severely corrupt the reconstruction results with similar artifacts. Therefore, it would be unlikely to distinguish the dominating error from these degraded reconstructions without any preknowledge. In addition, systematic error is generally a mixture of various error sources in the real situation, and it cannot be separated due to their mutual restriction and conversion. To this end, we report a system calibration procedure, termed SC-FPM, to calibrate the mixed systematic errors simultaneously from an overall perspective, based on the simulated annealing algorithm, the LED intensity correction method, the nonlinear regression process, and the adaptive step-size strategy, which involves the evaluation of an error metric at each iteration step, followed by the re-estimation of accurate parameters. The performance achieved both in simulations and experiments demonstrates that the proposed method outperforms other state-of-the-art algorithms. The reported system calibration scheme improves the robustness of FPM, relaxes the experiment conditions, and does not require any preknowledge, which makes the FPM more pragmatic.

Getting under the skin of the primary care consultation using video stimulated recall: a systematic review

PubMed Central

2014-01-01

Background Video stimulated recall (VSR) is a method of enhancing participants’ accounts of the consultation using a video recording of the event to encourage and prompt recall in a post consultation interview. VSR is used in education and education research, and to a lesser extent in medical and nursing research. Little is known about the sort of research questions that lend themselves best to the use of VSR or the impact of the specific VSR procedure on study quality. This systematic review describes studies in primary care that have used the method and aims to identify the strengths, weaknesses and role of VSR. Methods A systematic literature search has been conducted to identify primary care consultation research using VSR. Two authors undertook data extraction and quality appraisal of identified papers and a narrative synthesis has been conducted to draw together the findings. In addition, theory on classifying VSR procedures derived from other disciplines is used as a lens through which to assess the relevance of VSR technique. Results Twenty eight publications were identified that reported VSR in primary care doctor-patient consultation research. VSR was identified as a useful method to explore specific events within the consultation, mundane or routine occurrences, non-spoken events and appears to particularly add value to doctor’s post consultation accounts. However, studies frequently had insufficient description of methods to properly evaluate both the quality of the study, and the influence of VSR technique on findings. Conclusions VSR is particularly useful for study of specific consultation events when a ‘within case’ approach is used in analysis, comparing and contrasting findings from the consultation and post-consultation interview. Alignment of the choice of VSR procedure and sampling to the study research question was established as particularly important in the quality of studies. Future researchers may consider the role of process evaluation to understand further the impact of research design on data yielded and the acceptability of the method to participants. PMID:25175450

Prevention and assessment of infectious diseases among children and adult migrants arriving to the European Union/European Economic Association: a protocol for a suite of systematic reviews for public health and health systems

PubMed Central

Mayhew, Alain D; Morton, Rachael L; Greenaway, Christina; Akl, Elie A; Rahman, Prinon; Zenner, Dominik; Pareek, Manish; Tugwell, Peter; Welch, Vivian; Meerpohl, Joerg; Alonso-Coello, Pablo; Hui, Charles; Biggs, Beverley-Ann; Requena-Méndez, Ana; Agbata, Eric; Noori, Teymur; Schünemann, Holger J

2017-01-01

Introduction The European Centre for Disease Prevention and Control is developing evidence-based guidance for voluntary screening, treatment and vaccine prevention of infectious diseases for newly arriving migrants to the European Union/European Economic Area. The objective of this systematic review protocol is to guide the identification, appraisal and synthesis of the best available evidence on prevention and assessment of the following priority infectious diseases: tuberculosis, HIV, hepatitis B, hepatitis C, measles, mumps, rubella, diphtheria, tetanus, pertussis, poliomyelitis (polio), Haemophilus influenza disease, strongyloidiasis and schistosomiasis. Methods and analysis The search strategy will identify evidence from existing systematic reviews and then update the effectiveness and cost-effectiveness evidence using prospective trials, economic evaluations and/or recently published systematic reviews. Interdisciplinary teams have designed logic models to help define study inclusion and exclusion criteria, guiding the search strategy and identifying relevant outcomes. We will assess the certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. Ethics and dissemination There are no ethical or safety issues. We anticipate disseminating the findings through open-access publications, conference abstracts and presentations. We plan to publish technical syntheses as GRADEpro evidence summaries and the systematic reviews as part of a special edition open-access publication on refugee health. We are following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Protocols reporting guideline. This protocol is registered in PROSPERO: CRD42016045798. PMID:28893741

A Systematic Review of the Effects of Continuing Education Programs on Providing Clinical Community Pharmacy Services

PubMed Central

Marques dos Reis, Tiago; Guidoni, Camilo Molino; Girotto, Edmarlon; Guerra, Marisabelle Lima; de Oliveira Baldoni, André; Leira Pereira, Leonardo Régis

2016-01-01

Objective. To summarize the effects of media methods used in continuing education (CE) programs on providing clinical community pharmacy services and the methods used to evaluate the effectiveness of these programs. Methods. A systematic review was performed using Medline, SciELO, and Scopus databases. The timeline of the search was 1990 to 2013. Searches were conducted in English, Portuguese, and Spanish. Results. Nineteen articles of 3990 were included. Fourteen studies used only one media method, and the live method (n=11) was the most frequent (alone or in combination). Only two studies found that the CE program was ineffective or partially effective; these studies used only the live method. Most studies used nonrobust, nonvalidated, and nonstandardized methods to measure effectiveness. The majority of studies focused on the effect of the CE program on modifying the knowledge and skills of the pharmacists. One study assessed the CE program’s benefits to patients or clients. Conclusion. No evidence was obtained regarding which media methods are the most effective. Robust and validated methods, as well as assessment standardization, are required to clearly determine whether a particular media method is effective. PMID:27402991

An evaluation of methods used to teach quality improvement to undergraduate healthcare students to inform curriculum development within preregistration nurse education: a protocol for systematic review and narrative synthesis.

PubMed

Armstrong, Lorraine; Lauder, William; Shepherd, Ashley

2015-01-14

Despite criticism, quality improvement (QI) continues to drive political and educational priorities within health care. Until recently, QI educational interventions have varied, targeting mainly postgraduates, middle management and the medical profession. However, there is now consensus within the UK, USA and beyond to integrate QI explicitly into nurse education, and faculties may require redesign of their QI curriculum to achieve this. Whilst growth in QI preregistration nurse education is emerging, little empirical evidence exists to determine such effects. Furthermore, previous healthcare studies evaluating QI educational interventions lend little in the way of support and have instead been subject to criticism. They reveal methodological weakness such as no reporting of theoretical underpinnings, insufficient intervention description, poor evaluation methods, little clinical or patient impact and lack of sustainability. This study aims therefore to identify, evaluate and synthesise teaching methods used within the undergraduate population to aid development of QI curriculum within preregistration nurse education. A systematic review of the literature will be conducted. Electronic databases, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Psychological Information (PsychINFO), Education Resources Information Centre (ERIC), Medical Literature Analysis and Retrieval System Online (MEDLINE) and Applied Social Sciences Index and Abstracts (ASSIA), will be searched alongside reference list scanning and a grey literature search. Peer-reviewed studies from 2000-2014 will be identified using key terms quality improvement, education, curriculum, training, undergraduate, teaching methods, students and evaluation. Studies describing a QI themed educational intervention aimed at undergraduate healthcare students will be included and data extracted using a modified version of the Reporting of Primary Studies in Education (REPOSE) Guidelines. Studies will be judged for quality and relevance using the Evidence for Policy and Practice Information and Co-ordinating Centre's (EPPI) Weight of Evidence framework and a narrative synthesis of the findings provided. This study aims to identify, evaluate and synthesise the teaching methods used in quality improvement education for undergraduate healthcare students where currently this is lacking. This will enable nursing faculty to adopt the most effective methods when developing QI education within their curriculum. Prospero CRD42014013847.

Accurate evaluation and analysis of functional genomics data and methods

PubMed Central

Greene, Casey S.; Troyanskaya, Olga G.

2016-01-01

The development of technology capable of inexpensively performing large-scale measurements of biological systems has generated a wealth of data. Integrative analysis of these data holds the promise of uncovering gene function, regulation, and, in the longer run, understanding complex disease. However, their analysis has proved very challenging, as it is difficult to quickly and effectively assess the relevance and accuracy of these data for individual biological questions. Here, we identify biases that present challenges for the assessment of functional genomics data and methods. We then discuss evaluation methods that, taken together, begin to address these issues. We also argue that the funding of systematic data-driven experiments and of high-quality curation efforts will further improve evaluation metrics so that they more-accurately assess functional genomics data and methods. Such metrics will allow researchers in the field of functional genomics to continue to answer important biological questions in a data-driven manner. PMID:22268703

Cleaning Hospital Room Surfaces to Prevent Health Care-Associated Infections: A Technical Brief.

PubMed

Han, Jennifer H; Sullivan, Nancy; Leas, Brian F; Pegues, David A; Kaczmarek, Janice L; Umscheid, Craig A

2015-10-20

The cleaning of hard surfaces in hospital rooms is critical for reducing health care-associated infections. This review describes the evidence examining current methods of cleaning, disinfecting, and monitoring cleanliness of patient rooms, as well as contextual factors that may affect implementation and effectiveness. Key informants were interviewed, and a systematic search for publications since 1990 was done with the use of several bibliographic and gray literature resources. Studies examining surface contamination, colonization, or infection with Clostridium difficile, methicillin-resistant Staphylococcus aureus, or vancomycin-resistant enterococci were included. Eighty studies were identified-76 primary studies and 4 systematic reviews. Forty-nine studies examined cleaning methods, 14 evaluated monitoring strategies, and 17 addressed challenges or facilitators to implementation. Only 5 studies were randomized, controlled trials, and surface contamination was the most commonly assessed outcome. Comparative effectiveness studies of disinfecting methods and monitoring strategies were uncommon. Future research should evaluate and compare newly emerging strategies, such as self-disinfecting coatings for disinfecting and adenosine triphosphate and ultraviolet/fluorescent surface markers for monitoring. Studies should also assess patient-centered outcomes, such as infection, when possible. Other challenges include identifying high-touch surfaces that confer the greatest risk for pathogen transmission; developing standard thresholds for defining cleanliness; and using methods to adjust for confounders, such as hand hygiene, when examining the effect of disinfecting methods.

Cleaning Hospital Room Surfaces to Prevent Health Care–Associated Infections

PubMed Central

Han, Jennifer H.; Sullivan, Nancy; Leas, Brian F.; Pegues, David A.; Kaczmarek, Janice L.; Umscheid, Craig A.

2015-01-01

The cleaning of hard surfaces in hospital rooms is critical for reducing health care–associated infections. This review describes the evidence examining current methods of cleaning, disinfecting, and monitoring cleanliness of patient rooms, as well as contextual factors that may affect implementation and effectiveness. Key informants were interviewed, and a systematic search for publications since 1990 was done with the use of several bibliographic and gray literature resources. Studies examining surface contamination, colonization, or infection with Clostridium difficile, methicillin-resistant Staphylococcus aureus, or vancomycinresistant enterococci were included. Eighty studies were identified—76 primary studies and 4 systematic reviews. Forty-nine studies examined cleaning methods, 14 evaluated monitoring strategies, and 17 addressed challenges or facilitators to implementation. Only 5 studies were randomized, controlled trials, and surface contamination was the most commonly assessed outcome. Comparative effectiveness studies of disinfecting methods and monitoring strategies were uncommon. Future research should evaluate and compare newly emerging strategies, such as self-disinfecting coatings for disinfecting and adenosine triphosphate and ultraviolet/fluorescent surface markers for monitoring. Studies should also assess patient-centered outcomes, such as infection, when possible. Other challenges include identifying high-touch surfaces that confer the greatest risk for pathogen transmission; developing standard thresholds for defining cleanliness; and using methods to adjust for confounders, such as hand hygiene, when examining the effect of disinfecting methods. PMID:26258903

Learning process mapping heuristics under stochastic sampling overheads

NASA Technical Reports Server (NTRS)

Ieumwananonthachai, Arthur; Wah, Benjamin W.

1991-01-01

A statistical method was developed previously for improving process mapping heuristics. The method systematically explores the space of possible heuristics under a specified time constraint. Its goal is to get the best possible heuristics while trading between the solution quality of the process mapping heuristics and their execution time. The statistical selection method is extended to take into consideration the variations in the amount of time used to evaluate heuristics on a problem instance. The improvement in performance is presented using the more realistic assumption along with some methods that alleviate the additional complexity.

Relative entropy and optimization-driven coarse-graining methods in VOTCA

DOE PAGES

Mashayak, S. Y.; Jochum, Mara N.; Koschke, Konstantin; ...

2015-07-20

We discuss recent advances of the VOTCA package for systematic coarse-graining. Two methods have been implemented, namely the downhill simplex optimization and the relative entropy minimization. We illustrate the new methods by coarse-graining SPC/E bulk water and more complex water-methanol mixture systems. The CG potentials obtained from both methods are then evaluated by comparing the pair distributions from the coarse-grained to the reference atomistic simulations.We have also added a parallel analysis framework to improve the computational efficiency of the coarse-graining process.

Topic detection using paragraph vectors to support active learning in systematic reviews.

PubMed

Hashimoto, Kazuma; Kontonatsios, Georgios; Miwa, Makoto; Ananiadou, Sophia

2016-08-01

Systematic reviews require expert reviewers to manually screen thousands of citations in order to identify all relevant articles to the review. Active learning text classification is a supervised machine learning approach that has been shown to significantly reduce the manual annotation workload by semi-automating the citation screening process of systematic reviews. In this paper, we present a new topic detection method that induces an informative representation of studies, to improve the performance of the underlying active learner. Our proposed topic detection method uses a neural network-based vector space model to capture semantic similarities between documents. We firstly represent documents within the vector space, and cluster the documents into a predefined number of clusters. The centroids of the clusters are treated as latent topics. We then represent each document as a mixture of latent topics. For evaluation purposes, we employ the active learning strategy using both our novel topic detection method and a baseline topic model (i.e., Latent Dirichlet Allocation). Results obtained demonstrate that our method is able to achieve a high sensitivity of eligible studies and a significantly reduced manual annotation cost when compared to the baseline method. This observation is consistent across two clinical and three public health reviews. The tool introduced in this work is available from https://nactem.ac.uk/pvtopic/. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Interleukin gene polymorphisms and breast cancer: a case control study and systematic literature review

PubMed Central

Balasubramanian, SP; Azmy, IAF; Higham, SE; Wilson, AG; Cross, SS; Cox, A; Brown, NJ; Reed, MW

2006-01-01

Background Interleukins and cytokines play an important role in the pathogenesis of many solid cancers. Several single nucleotide polymorphisms (SNPs) identified in cytokine genes are thought to influence the expression or function of these proteins and many have been evaluated for their role in inflammatory disease and cancer predisposition. The aim of this study was to evaluate any role of specific SNPs in the interleukin genes IL1A, IL1B, IL1RN, IL4R, IL6 and IL10 in predisposition to breast cancer susceptibility and severity. Methods Candidate single nucleotide polymorphisms (SNPs) in key cytokine genes were genotyped in breast cancer patients and in appropriate healthy volunteers who were similar in age, race and sex. Genotyping was performed using a high throughput allelic discrimination method. Data on clinico-pathological details and survival were collected. A systematic review of Medline English literature was done to retrieve previous studies of these polymorphisms in breast cancer. Results None of the polymorphisms studied showed any overall predisposition to breast cancer susceptibility, severity or to time to death or occurrence of distant metastases. The results of the systematic review are summarised. Conclusion Polymorphisms within key interleukin genes (IL1A, IL1B, IL1RN, IL4R, IL6 and IL10 do not appear to play a significant overall role in breast cancer susceptibility or severity. PMID:16842617

Empirical studies of clinical supervision in psychiatric nursing: A systematic literature review and methodological critique.

PubMed

Buus, Niels; Gonge, Henrik

2009-08-01

The objective of this paper was to systematically review and critically evaluate all English language research papers reporting empirical studies of clinical supervision in psychiatric nursing. The first part of the search strategy was a combination of brief and building block strategies in the PubMed, CINAHL, and PsycINFO databases. The second part was a citation pearl growing strategy with reviews of 179 reference lists. In total, the search strategy demonstrated a low level of precision and a high level of recall. Thirty four articles met the criteria of the review and were systematically evaluated using three checklists. The findings were summarized by using a new checklist with nine overall questions regarding the studies' design, methods, findings, and limitations. The studies were categorized as: (i) effect studies; (ii) survey studies; (iii) interview studies; and (iv) case studies. In general, the studies were relatively small scale; they used relatively new and basic methods for data collection and analysis, and rarely included sufficient strategies for identifying confounding factors or how the researchers' preconceptions influenced the analyses. Empirical research of clinical supervision in psychiatric nursing was characterized by a basic lack of agreement about which models and instruments to use. Challenges and recommendations for future research are discussed. Clinical supervision in psychiatric nursing was commonly perceived as a good thing, but there was limited empirical evidence supporting this claim.

Community-based Interventions to Prevent Skin Cancer: Two Community Guide Systematic Reviews

PubMed Central

Sandhu, Paramjit K.; Elder, Randy; Patel, Mona; Saraiya, Mona; Holman, Dawn M.; Perna, Frank; Smith, Robert A.; Buller, David; Sinclair, Craig; Reeder, Anthony; Makin, Jen; McNoe, Bronwen; Glanz, Karen

2016-01-01

Context Skin cancer is a preventable and commonly diagnosed cancer in the U.S. Excessive ultraviolet radiation exposure is a known cause of skin cancer. This article presents updated results of two types of interventions evaluated in a previously published Community Guide systematic review: multicomponent community-wide (MCCW) interventions and mass media (MM) interventions when used alone. Evidence acquisition Studies assessing MCCW and MM interventions to prevent skin cancer by reducing ultraviolet radiation exposure were evaluated using Community Guide systematic review methods. Relevant studies published between 1966 and 2013 were included and analyzed for this review. Evidence synthesis Seven studies evaluating the effectiveness of MCCW interventions showed a median increase in sunscreen use of 10.8 percentage points (interquartile interval=7.3, 23.2); a small decrease in ultraviolet radiation exposure; a decrease in indoor tanning device use of 4.0 percentage points (95% CI=2.5, 5.5); and mixed results for other protective behaviors. Four studies evaluating the effectiveness of MM interventions found that they generally led to improved ultraviolet protection behaviors among children and adults. Conclusions The available evidence showed that MCCW interventions are effective in reducing ultraviolet radiation exposure by increasing sunscreen use. There was, however, insufficient evidence to determine the effectiveness of MM interventions alone in reducing ultraviolet radiation exposure, indicating a continuing need for more research in this field to improve assessment of effectiveness. PMID:27647053

Systematic Review of Economic Evaluation of Laparotomy versus Laparoscopy for Patients Submitted to Roux-en-Y Gastric Bypass

PubMed Central

Sussenbach, Samanta Pereira; Silva, Everton Nunes; Pufal, Milene Amarante; Casagrande, Daniela Shan; Padoin, Alexandre Vontobel; Mottin, Cláudio Corá

2014-01-01

Background Because of the high prevalence of obesity, there is a growing demand for bariatric surgery worldwide. The objective of this systematic review was to analyze the difference in relation to cost-effectiveness of access route by laparoscopy versus laparotomy of Roux en-Y gastric bypass (RYGB). Methods A systematic review was conducted in the electronic databases MEDLINE, Embase, Scopus, Cochrane and Lilacs in order to identify economic evaluation studies that compare the cost-effectiveness of laparoscopic and laparotomic routes in RYGB. Results In a total of 494 articles, only 6 fulfilled the eligibility criteria. All studies were published between 2001 and 2008 in the United States (USA). Three studies fulfilled less than half of the items that evaluated the results quality; two satisfied 5 of the required items, and only 1 study fulfilled 7 of 10 items. The economic evaluation of studies alternated between cost-effectiveness and cost-consequence. Five studies considered the surgery by laparoscopy the dominant strategy, because it showed greater clinical benefit (less probability of post-surgical complications, less hospitalization time) and lower total cost. Conclusion This review indicates that laparoscopy is a safe and well-tolerated technique, despite the costs of surgery being higher when compared with laparotomy. However, the additional costs are compensated by the lower probability of complications after surgery and, consequently, avoiding their costs. PMID:24945704

Sequential assessment via daphnia and zebrafish for systematic toxicity screening of heterogeneous substances.

PubMed

Jang, Gun Hyuk; Park, Chang-Beom; Kang, Benedict J; Kim, Young Jun; Lee, Kwan Hyi

2016-09-01

Environment and organisms are persistently exposed by a mixture of various substances. However, the current evaluation method is mostly based on an individual substance's toxicity. A systematic toxicity evaluation of heterogeneous substances needs to be established. To demonstrate toxicity assessment of mixture, we chose a group of three typical ingredients in cosmetic sunscreen products that frequently enters ecosystems: benzophenone-3 (BP-3), ethylhexyl methoxycinnamate (EHMC), and titanium dioxide nanoparticle (TiO2 NP). We first determined a range of nominal toxic concentration of each ingredient or substance using Daphnia magna, and then for the subsequent organismal level phenotypic assessment, chose the wild-type zebrafish embryos. Any phenotype change, such as body deformation, led to further examinations on the specific organs of transgenic zebrafish embryos. Based on the systematic toxicity assessments of the heterogeneous substances, we offer a sequential environmental toxicity assessment protocol that starts off by utilizing Daphnia magna to determine a nominal concentration range of each substance and finishes by utilizing the zebrafish embryos to detect defects on the embryos caused by the heterogeneous substances. The protocol showed additive toxic effects of the mixtures. We propose a sequential environmental toxicity assessment protocol for the systematic toxicity screening of heterogeneous substances from Daphnia magna to zebrafish embryo in-vivo models. Copyright © 2016 Elsevier Ltd. All rights reserved.

National Institutes of Health Pathways to Prevention Workshop: Methods for Evaluating Natural Experiments in Obesity.

PubMed

Emmons, Karen M; Doubeni, Chyke A; Fernandez, Maria E; Miglioretti, Diana L; Samet, Jonathan M

2018-06-05

On 5 and 6 December 2017, the National Institutes of Health (NIH) convened the Pathways to Prevention Workshop: Methods for Evaluating Natural Experiments in Obesity to identify the status of methods for assessing natural experiments to reduce obesity, areas in which these methods could be improved, and research needs for advancing the field. This article considers findings from a systematic evidence review on methods for evaluating natural experiments in obesity, workshop presentations by experts and stakeholders, and public comment. Research gaps are identified, and recommendations related to 4 key issues are provided. Recommendations on population-based data sources and data integration include maximizing use and sharing of existing surveillance and research databases and ensuring significant effort to integrate and link databases. Recommendations on measurement include use of standardized and validated measures of obesity-related outcomes and exposures, systematic measurement of co-benefits and unintended consequences, and expanded use of validated technologies for measurement. Study design recommendations include improving guidance, documentation, and communication about methods used; increasing use of designs that minimize bias in natural experiments; and more carefully selecting control groups. Cross-cutting recommendations target activities that the NIH and other funders might undertake to improve the rigor of natural experiments in obesity, including training and collaboration on modeling and causal inference, promoting the importance of community engagement in the conduct of natural experiments, ensuring maintenance of relevant surveillance systems, and supporting extended follow-up assessments for exemplar natural experiments. To combat the significant public health threat posed by obesity, researchers should continue to take advantage of natural experiments. The recommendations in this report aim to strengthen evidence from such studies.

Human brain mapping: A systematic comparison of parcellation methods for the human cerebral cortex.

PubMed

Arslan, Salim; Ktena, Sofia Ira; Makropoulos, Antonios; Robinson, Emma C; Rueckert, Daniel; Parisot, Sarah

2018-04-15

The macro-connectome elucidates the pathways through which brain regions are structurally connected or functionally coupled to perform a specific cognitive task. It embodies the notion of representing and understanding all connections within the brain as a network, while the subdivision of the brain into interacting functional units is inherent in its architecture. As a result, the definition of network nodes is one of the most critical steps in connectivity network analysis. Although brain atlases obtained from cytoarchitecture or anatomy have long been used for this task, connectivity-driven methods have arisen only recently, aiming to delineate more homogeneous and functionally coherent regions. This study provides a systematic comparison between anatomical, connectivity-driven and random parcellation methods proposed in the thriving field of brain parcellation. Using resting-state functional MRI data from the Human Connectome Project and a plethora of quantitative evaluation techniques investigated in the literature, we evaluate 10 subject-level and 24 groupwise parcellation methods at different resolutions. We assess the accuracy of parcellations from four different aspects: (1) reproducibility across different acquisitions and groups, (2) fidelity to the underlying connectivity data, (3) agreement with fMRI task activation, myelin maps, and cytoarchitectural areas, and (4) network analysis. This extensive evaluation of different parcellations generated at the subject and group level highlights the strengths and shortcomings of the various methods and aims to provide a guideline for the choice of parcellation technique and resolution according to the task at hand. The results obtained in this study suggest that there is no optimal method able to address all the challenges faced in this endeavour simultaneously. Copyright © 2017 Elsevier Inc. All rights reserved.

Impact of parasitic thermal effects on thermoelectric property measurements by Harman method.

PubMed

Kwon, Beomjin; Baek, Seung-Hyub; Kim, Seong Keun; Kim, Jin-Sang

2014-04-01

Harman method is a rapid and simple technique to measure thermoelectric properties. However, its validity has been often questioned due to the over-simplified assumptions that this method relies on. Here, we quantitatively investigate the influence of the previously ignored parasitic thermal effects on the Harman method and develop a method to determine an intrinsic ZT. We expand the original Harman relation with three extra terms: heat losses via both the lead wires and radiation, and Joule heating within the sample. Based on the expanded Harman relation, we use differential measurement of the sample geometry to measure the intrinsic ZT. To separately evaluate the parasitic terms, the measured ZTs with systematically varied sample geometries and the lead wire types are fitted to the expanded relation. A huge discrepancy (∼28%) of the measured ZTs depending on the measurement configuration is observed. We are able to separately evaluate those parasitic terms. This work will help to evaluate the intrinsic thermoelectric property with Harman method by eliminating ambiguities coming from extrinsic effects.

A systematic review of recent clinical practice guidelines and best practice statements for the evaluation of the infertile male.

PubMed

Esteves, Sandro C; Chan, Peter

2015-09-01

We systematically identified and reviewed the methods and consistency of recommendations of recently developed clinical practice guidelines (CPG) and best practice statements (BPS) on the evaluation of the infertile male. MEDLINE and related engines as well as guidelines' Web sites were searched for CPG and BPS written in English on the general evaluation of male infertility published between January 2008 and April 2015. Four guidelines were identified, all of which reported to have been recently updated. Systematic review was not consistently used in the BPS despite being reported in the CPG. Only one of them reported having a patient representative in its development team. The CPG issued by the European Association of Urology (EAU) graded some recommendations and related that to levels (but not quality) of evidence. Overall, the BPS issued respectively by the American Urological Association and American Society for Reproductive Medicine concurred with each other, but both differed from the EAU guidelines with regard to methods of collection, extraction and interpretation of data. None of the guidelines incorporated health economics. Important specific limitations of conventional semen analysis results were ignored by all guidelines. Besides variation in the methodological quality, implementation strategies were not reported in two out of four guidelines. While the various panels of experts who contributed to the development of the CPG and BPS reviewed should be commended on their tremendous efforts aiming to establish a clinical standard in both the evaluation and management of male infertility, we recognized inconsistencies in the methodology of their synthesis and in the contents of their final recommendations. These discrepancies pose a barrier in the general implementation of these guidelines and may limit their utility in standardizing clinical practice or improving health-related outcomes. Continuous efforts are needed to generate high-quality evidence to allow further development of these important guidelines for the evaluation and management of males suffering from infertility.

Seed Placement in Permanent Breast Seed Implant Brachytherapy: Are Concerns Over Accuracy Valid?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Morton, Daniel, E-mail: dmorton@bccancer.bc.ca; Department of Physics and Astronomy, University of Victoria, Victoria, British Columbia; Hilts, Michelle

Purpose: To evaluate seed placement accuracy in permanent breast seed implant brachytherapy (PBSI), to identify any systematic errors and evaluate their effect on dosimetry. Methods and Materials: Treatment plans and postimplant computed tomography scans for 20 PBSI patients were spatially registered and used to evaluate differences between planned and implanted seed positions, termed seed displacements. For each patient, the mean total and directional seed displacements were determined in both standard room coordinates and in needle coordinates relative to needle insertion angle. Seeds were labeled according to their proximity to the anatomy within the breast, to evaluate the influence of anatomicmore » regions on seed placement. Dosimetry within an evaluative target volume (seroma + 5 mm), skin, breast, and ribs was evaluated to determine the impact of seed placement on the treatment. Results: The overall mean (±SD) difference between implanted and planned positions was 9 ± 5 mm for the aggregate seed population. No significant systematic directional displacements were observed for this whole population. However, for individual patients, systematic displacements were observed, implying that intrapatient offsets occur during the procedure. Mean displacements for seeds in the different anatomic areas were not found to be significantly different from the mean for the entire seed population. However, small directional trends were observed within the anatomy, potentially indicating some bias in the delivery. Despite observed differences between the planned and implanted seed positions, the median (range) V{sub 90} for the 20 patients was 97% (66%-100%), and acceptable dosimetry was achieved for critical structures. Conclusions: No significant trends or systematic errors were observed in the placement of seeds in PBSI, including seeds implanted directly into the seroma. Recorded seed displacements may be related to intrapatient setup adjustments. Despite observed seed displacements, acceptable postimplant dosimetry was achieved.« less

Cost-effectiveness of enhanced recovery in hip and knee replacement: a systematic review protocol

PubMed Central

Pritchard, Mark G; Cheng, Lok Yin; Janarthanan, Roshni

2018-01-01

Introduction Hip and knee replacement represents a significant burden to the UK healthcare system. ‘Enhanced recovery’ pathways have been introduced in the National Health Service (NHS) for patients undergoing hip and knee replacement, with the aim of improving outcomes and timely recovery after surgery. To support policymaking, there is a need to evaluate the cost-effectiveness of enhanced recovery pathways across jurisdictions. Our aim is to systematically summarise the published cost-effectiveness evidence on enhanced recovery in hip and knee replacement, both as a whole and for each of the various components of enhanced recovery pathways. Methods and analysis A systematic review will be conducted using MEDLINE, EMBASE, Econlit and the National Health Service Economic Evaluations Database. Separate search strategies were developed for each database including terms relating to hip and knee replacement/arthroplasty, economic evaluations, decision modelling and quality of life measures. We will extract peer-reviewed studies published between 2000 and 2017 reporting economic evaluations of preoperative, perioperative or postoperative enhanced recovery interventions within hip or knee replacement. Economic evaluations alongside cohort studies or based on decision models will be included. Only studies with patients undergoing elective replacement surgery of the hip or knee will be included. Data will be extracted using a predefined pro forma following best practice guidelines for economic evaluation, decision modelling and model validation. Our primary outcome will be the cost-effectiveness of enhanced recovery (entire pathway and individual components) in terms of incremental cost per quality-adjusted life year. A narrative synthesis of all studies will be presented, focussing on cost-effectiveness results, study design, quality and validation status. Ethics and dissemination This systematic review is exempted from ethics approval because the work is carried out on published documents. The results of the review will be disseminated in a peer-reviewed academic journal and at conferences. PROSPERO registration number CRD42017059473. PMID:29540418

Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy: A Practical Review for Clinical Researchers-Part II. Statistical Methods of Meta-Analysis

PubMed Central

Lee, Juneyoung; Kim, Kyung Won; Choi, Sang Hyun; Huh, Jimi

2015-01-01

Meta-analysis of diagnostic test accuracy studies differs from the usual meta-analysis of therapeutic/interventional studies in that, it is required to simultaneously analyze a pair of two outcome measures such as sensitivity and specificity, instead of a single outcome. Since sensitivity and specificity are generally inversely correlated and could be affected by a threshold effect, more sophisticated statistical methods are required for the meta-analysis of diagnostic test accuracy. Hierarchical models including the bivariate model and the hierarchical summary receiver operating characteristic model are increasingly being accepted as standard methods for meta-analysis of diagnostic test accuracy studies. We provide a conceptual review of statistical methods currently used and recommended for meta-analysis of diagnostic test accuracy studies. This article could serve as a methodological reference for those who perform systematic review and meta-analysis of diagnostic test accuracy studies. PMID:26576107

A methodology for evaluating the usability of audiovisual consumer electronic products.

PubMed

Kwahk, Jiyoung; Han, Sung H

2002-09-01

Usability evaluation is now considered an essential procedure in consumer product development. Many studies have been conducted to develop various techniques and methods of usability evaluation hoping to help the evaluators choose appropriate methods. However, planning and conducting usability evaluation requires considerations of a number of factors surrounding the evaluation process including the product, user, activity, and environmental characteristics. In this perspective, this study suggested a new methodology of usability evaluation through a simple, structured framework. The framework was outlined by three major components: the interface features of a product as design variables, the evaluation context consisting of user, product, activity, and environment as context variables, and the usability measures as dependent variables. Based on this framework, this study established methods to specify the product interface features, to define evaluation context, and to measure usability. The effectiveness of this methodology was demonstrated through case studies in which the usability of audiovisual products was evaluated by using the methods developed in this study. This study is expected to help the usability practitioners in consumer electronics industry in various ways. Most directly, it supports the evaluators' plan and conduct usability evaluation sessions in a systematic and structured manner. In addition, it can be applied to other categories of consumer products (such as appliances, automobiles, communication devices, etc.) with minor modifications as necessary.

Project evaluation and selection using fuzzy Delphi method and zero - one goal programming

NASA Astrophysics Data System (ADS)

Alias, Suriana; Adna, Nofarziah; Arsad, Roslah; Soid, Siti Khuzaimah; Ali, Zaileha Md

2014-12-01

Project evaluation and selection is a factor affecting the impotence of board director in which is trying to maximize all the possible goals. Assessment of the problem occurred in organization plan is the first phase for decision making process. The company needs a group of expert to evaluate the problems. The Fuzzy Delphi Method (FDM) is a systematic procedure to evoke the group's opinion in order to get the best result to evaluate the project performance. This paper proposes an evaluation and selection of the best alternative project based on combination of FDM and Zero - One Goal Programming (ZOGP) formulation. ZOGP is used to solve the multi-criteria decision making for final decision part by using optimization software LINDO 6.1. An empirical example on an ongoing decision making project in Johor, Malaysia is implemented for case study.

Athlete's foot: oral antifungals

PubMed Central

2015-01-01

Introduction Around 15% to 30% of people are likely to have athlete's foot at any one time. The infection can spread to other parts of the body and to other people. Methods and outcomes We conducted a systematic overview, aiming to answer the following clinical question: What are the effects of oral treatments for athlete's foot? We searched: Medline, Embase, The Cochrane Library, and other important databases up to September 2014 (BMJ Clinical Evidence overviews are updated periodically; please check our website for the most up-to-date version of this overview). Results At this update, searching of electronic databases retrieved 335 studies. After deduplication and removal of conference abstracts, 210 records were screened for inclusion in the overview. Appraisal of titles and abstracts led to the exclusion of 162 studies and the further review of 48 full publications. Of the 48 full articles evaluated, one systematic review was included. We performed a GRADE evaluation for six PICO combinations. Conclusions In this systematic overview, we categorised the efficacy for one intervention based on information relating to the effectiveness and safety of oral antifungals versus placebo and different oral antifungals versus each other.

Burning mouth syndrome

PubMed Central

2016-01-01

Introduction Burning mouth syndrome mainly affects women, particularly after the menopause, when its prevalence may be 18% to 33%. Methods and outcomes We conducted a systematic overview, aiming to answer the following clinical question: What are the effects of selected treatments for burning mouth syndrome? We searched: Medline, Embase, The Cochrane Library, and other important databases up to January 2015 (BMJ Clinical Evidence overviews are updated periodically; please check our website for the most up-to-date version of this overview). Results At this update, searching of electronic databases retrieved 70 studies. After deduplication and removal of conference abstracts, 45 records were screened for inclusion in the overview. Appraisal of titles and abstracts led to the exclusion of 25 studies and the further review of 20 full publications. Of the 20 full articles evaluated, one systematic review and nine RCTs were added at this update. We performed a GRADE evaluation for five PICO combinations. Conclusions In this systematic overview, we categorised the efficacy for six interventions based on information about the effectiveness and safety of alphalipoic acid, benzodiazepines, benzydamine hydrochloride, cognitive behavioural therapy (CBT), selective serotonin re-uptake inhibitors (SSRIs), and tricyclic antidepressants. PMID:26745781

Improved water resource management for a highly complex environment using three-dimensional groundwater modelling

NASA Astrophysics Data System (ADS)

Moeck, Christian; Affolter, Annette; Radny, Dirk; Dressmann, Horst; Auckenthaler, Adrian; Huggenberger, Peter; Schirmer, Mario

2018-02-01

A three-dimensional groundwater model was used to improve water resource management for a study area in north-west Switzerland, where drinking-water production is close to former landfills and industrial areas. To avoid drinking-water contamination, artificial groundwater recharge with surface water is used to create a hydraulic barrier between the contaminated sites and drinking-water extraction wells. The model was used for simulating existing and proposed water management strategies as a tool to ensure the utmost security for drinking water. A systematic evaluation of the flow direction between existing observation points using a developed three-point estimation method for a large number of scenarios was carried out. It is demonstrated that systematically applying the developed methodology helps to identify vulnerable locations which are sensitive to changing boundary conditions such as those arising from changes to artificial groundwater recharge rates. At these locations, additional investigations and protection are required. The presented integrated approach, using the groundwater flow direction between observation points, can be easily transferred to a variety of hydrological settings to systematically evaluate groundwater modelling scenarios.

Poor methodological quality and reporting standards of systematic reviews in burn care management.

PubMed

Wasiak, Jason; Tyack, Zephanie; Ware, Robert; Goodwin, Nicholas; Faggion, Clovis M

2017-10-01

The methodological and reporting quality of burn-specific systematic reviews has not been established. The aim of this study was to evaluate the methodological quality of systematic reviews in burn care management. Computerised searches were performed in Ovid MEDLINE, Ovid EMBASE and The Cochrane Library through to February 2016 for systematic reviews relevant to burn care using medical subject and free-text terms such as 'burn', 'systematic review' or 'meta-analysis'. Additional studies were identified by hand-searching five discipline-specific journals. Two authors independently screened papers, extracted and evaluated methodological quality using the 11-item A Measurement Tool to Assess Systematic Reviews (AMSTAR) tool and reporting quality using the 27-item Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist. Characteristics of systematic reviews associated with methodological and reporting quality were identified. Descriptive statistics and linear regression identified features associated with improved methodological quality. A total of 60 systematic reviews met the inclusion criteria. Six of the 11 AMSTAR items reporting on 'a priori' design, duplicate study selection, grey literature, included/excluded studies, publication bias and conflict of interest were reported in less than 50% of the systematic reviews. Of the 27 items listed for PRISMA, 13 items reporting on introduction, methods, results and the discussion were addressed in less than 50% of systematic reviews. Multivariable analyses showed that systematic reviews associated with higher methodological or reporting quality incorporated a meta-analysis (AMSTAR regression coefficient 2.1; 95% CI: 1.1, 3.1; PRISMA regression coefficient 6·3; 95% CI: 3·8, 8·7) were published in the Cochrane library (AMSTAR regression coefficient 2·9; 95% CI: 1·6, 4·2; PRISMA regression coefficient 6·1; 95% CI: 3·1, 9·2) and included a randomised control trial (AMSTAR regression coefficient 1·4; 95%CI: 0·4, 2·4; PRISMA regression coefficient 3·4; 95% CI: 0·9, 5·8). The methodological and reporting quality of systematic reviews in burn care requires further improvement with stricter adherence by authors to the PRISMA checklist and AMSTAR tool. © 2016 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

Systematic Review of Health Economic Evaluations of Diagnostic Tests in Brazil: How accurate are the results?

PubMed

Oliveira, Maria Regina Fernandes; Leandro, Roseli; Decimoni, Tassia Cristina; Rozman, Luciana Martins; Novaes, Hillegonda Maria Dutilh; De Soárez, Patrícia Coelho

2017-08-01

The aim of this study is to identify and characterize the health economic evaluations (HEEs) of diagnostic tests conducted in Brazil, in terms of their adherence to international guidelines for reporting economic studies and specific questions in test accuracy reports. We systematically searched multiple databases, selecting partial and full HEEs of diagnostic tests, published between 1980 and 2013. Two independent reviewers screened articles for relevance and extracted the data. We performed a qualitative narrative synthesis. Forty-three articles were reviewed. The most frequently studied diagnostic tests were laboratory tests (37.2%) and imaging tests (32.6%). Most were non-invasive tests (51.2%) and were performed in the adult population (48.8%). The intended purposes of the technologies evaluated were mostly diagnostic (69.8%), but diagnosis and treatment and screening, diagnosis, and treatment accounted for 25.6% and 4.7%, respectively. Of the reviewed studies, 12.5% described the methods used to estimate the quantities of resources, 33.3% reported the discount rate applied, and 29.2% listed the type of sensitivity analysis performed. Among the 12 cost-effectiveness analyses, only two studies (17%) referred to the application of formal methods to check the quality of the accuracy studies that provided support for the economic model. The existing Brazilian literature on the HEEs of diagnostic tests exhibited reasonably good performance. However, the following points still require improvement: 1) the methods used to estimate resource quantities and unit costs, 2) the discount rate, 3) descriptions of sensitivity analysis methods, 4) reporting of conflicts of interest, 5) evaluations of the quality of the accuracy studies considered in the cost-effectiveness models, and 6) the incorporation of accuracy measures into sensitivity analyses.

An empirical understanding of triple collocation evaluation measure

NASA Astrophysics Data System (ADS)

Scipal, Klaus; Doubkova, Marcela; Hegyova, Alena; Dorigo, Wouter; Wagner, Wolfgang

2013-04-01

Triple collocation method is an advanced evaluation method that has been used in the soil moisture field for only about half a decade. The method requires three datasets with an independent error structure that represent an identical phenomenon. The main advantages of the method are that it a) doesn't require a reference dataset that has to be considered to represent the truth, b) limits the effect of random and systematic errors of other two datasets, and c) simultaneously assesses the error of three datasets. The objective of this presentation is to assess the triple collocation error (Tc) of the ASAR Global Mode Surface Soil Moisture (GM SSM 1) km dataset and highlight problems of the method related to its ability to cancel the effect of error of ancillary datasets. In particular, the goal is to a) investigate trends in Tc related to the change in spatial resolution from 5 to 25 km, b) to investigate trends in Tc related to the choice of a hydrological model, and c) to study the relationship between Tc and other absolute evaluation methods (namely RMSE and Error Propagation EP). The triple collocation method is implemented using ASAR GM, AMSR-E, and a model (either AWRA-L, GLDAS-NOAH, or ERA-Interim). First, the significance of the relationship between the three soil moisture datasets was tested that is a prerequisite for the triple collocation method. Second, the trends in Tc related to the choice of the third reference dataset and scale were assessed. For this purpose the triple collocation is repeated replacing AWRA-L with two different globally available model reanalysis dataset operating at different spatial resolution (ERA-Interim and GLDAS-NOAH). Finally, the retrieved results were compared to the results of the RMSE and EP evaluation measures. Our results demonstrate that the Tc method does not eliminate the random and time-variant systematic errors of the second and the third dataset used in the Tc. The possible reasons include the fact a) that the TC method could not fully function with datasets acting at very different spatial resolutions, or b) that the errors were not fully independent as initially assumed.

Publication Bias and Nonreporting Found in Majority of Systematic Reviews and Meta-analyses in Anesthesiology Journals.

PubMed

Hedin, Riley J; Umberham, Blake A; Detweiler, Byron N; Kollmorgen, Lauren; Vassar, Matt

2016-10-01

Systematic reviews and meta-analyses are used by clinicians to derive treatment guidelines and make resource allocation decisions in anesthesiology. One cause for concern with such reviews is the possibility that results from unpublished trials are not represented in the review findings or data synthesis. This problem, known as publication bias, results when studies reporting statistically nonsignificant findings are left unpublished and, therefore, not included in meta-analyses when estimating a pooled treatment effect. In turn, publication bias may lead to skewed results with overestimated effect sizes. The primary objective of this study is to determine the extent to which evaluations for publication bias are conducted by systematic reviewers in highly ranked anesthesiology journals and which practices reviewers use to mitigate publication bias. The secondary objective of this study is to conduct publication bias analyses on the meta-analyses that did not perform these assessments and examine the adjusted pooled effect estimates after accounting for publication bias. This study considered meta-analyses and systematic reviews from 5 peer-reviewed anesthesia journals from 2007 through 2015. A PubMed search was conducted, and full-text systematic reviews that fit inclusion criteria were downloaded and coded independently by 2 authors. Coding was then validated, and disagreements were settled by consensus. In total, 207 systematic reviews were included for analysis. In addition, publication bias evaluation was performed for 25 systematic reviews that did not do so originally. We used Egger regression, Duval and Tweedie trim and fill, and funnel plots for these analyses. Fifty-five percent (n = 114) of the reviews discussed publication bias, and 43% (n = 89) of the reviews evaluated publication bias. Funnel plots and Egger regression were the most common methods for evaluating publication bias. Publication bias was reported in 34 reviews (16%). Thirty-six of the 45 (80.0%) publication bias analyses indicated the presence of publication bias by trim and fill analysis, whereas Egger regression indicated publication bias in 23 of 45 (51.1%) analyses. The mean absolute percent difference between adjusted and observed point estimates was 15.5%, the median was 6.2%, and the range was 0% to 85.5%. Many of these reviews reported following published guidelines such as PRISMA or MOOSE, yet only half appropriately addressed publication bias in their reviews. Compared with previous research, our study found fewer reviews assessing publication bias and greater likelihood of publication bias among reviews not performing these evaluations.

A simple solution to systematic errors in density determination by X-ray reflectivity: The XRR-density evaluation (XRR-DE) method

NASA Astrophysics Data System (ADS)

Bergese, P.; Bontempi, E.; Depero, L. E.

2006-10-01

X-ray reflectivity (XRR) is a non-destructive, accurate and fast technique for evaluating film density. Indeed, sample-goniometer alignment is a critical experimental factor and the overriding error source in XRR density determination. With commercial single-wavelength X-ray reflectometers, alignment is difficult to control and strongly depends on the operator. In the present work, the contribution of misalignment on density evaluation error is discussed, and a novel procedure (named XRR-density evaluation or XRR-DE method) to minimize the problem will be presented. The method allows to overcome the alignment step through the extrapolation of the correct density value from appropriate non-specular XRR data sets. This procedure is operator independent and suitable for commercial single-wavelength X-ray reflectometers. To test the XRR-DE method, single crystals of TiO 2 and SrTiO 3 were used. In both cases the determined densities differed from the nominal ones less than 5.5%. Thus, the XRR-DE method can be successfully applied to evaluate the density of thin films for which only optical reflectivity is today used. The advantage is that this method can be considered thickness independent.

Economic impact of electronic prescribing in the hospital setting: A systematic review.

PubMed

Ahmed, Zamzam; Barber, Nick; Jani, Yogini; Garfield, Sara; Franklin, Bryony Dean

2016-04-01

To examine evidence on the economic impact of electronic prescribing (EP) systems in the hospital setting. We conducted a systematic search of MEDLINE, EMBASE, PsycINFO, International Pharmaceutical Abstracts, the NHS Economic Evaluation Database, the European Network of Health Economic Evaluation Database and Web of Science from inception to October 2013. Full and partial economic evaluations of EP or computerized provider order entry were included. We excluded studies assessing prescribing packages for specific drugs, and monetary outcomes that were not related to medicines. A checklist was used to evaluate risk of bias and evidence quality. The search yielded 1160 articles of which three met the inclusion criteria. Two were full economic evaluations and one a partial economic evaluation. A meta-analysis was not appropriate as studies were heterogeneous in design, economic evaluation method, interventions and outcome measures. Two studies investigated the financial impact of reducing preventable adverse drug events. The third measured savings related to various aspects of the system including those related to medication. Two studies reported positive financial effects. However the overall quality of the economic evidence was low and key details often not reported. There seems to be some evidence of financial benefits of EP in the hospital setting. However, it is not clear if evidence is transferable to other settings. Research is scarce and limited in quality, and reported methods are not always transparent. Further robust, high quality research is required to establish if hospital EP is cost effective and thus inform policy makers' decisions. Copyright © 2016. Published by Elsevier Ireland Ltd.

Can Systematic Reviews Inform GMO Risk Assessment and Risk Management?

PubMed

Kohl, Christian; Frampton, Geoff; Sweet, Jeremy; Spök, Armin; Haddaway, Neal Robert; Wilhelm, Ralf; Unger, Stefan; Schiemann, Joachim

2015-01-01

Systematic reviews represent powerful tools to identify, collect, synthesize, and evaluate primary research data on specific research questions in a highly standardized and reproducible manner. They enable the defensible synthesis of outcomes by increasing precision and minimizing bias whilst ensuring transparency of the methods used. This makes them especially valuable to inform evidence-based risk analysis and decision making in various topics and research disciplines. Although seen as a "gold standard" for synthesizing primary research data, systematic reviews are not without limitations as they are often cost, labor and time intensive and the utility of synthesis outcomes depends upon the availability of sufficient and robust primary research data. In this paper, we (1) consider the added value systematic reviews could provide when synthesizing primary research data on genetically modified organisms (GMO) and (2) critically assess the adequacy and feasibility of systematic review for collating and analyzing data on potential impacts of GMOs in order to better inform specific steps within GMO risk assessment and risk management. The regulatory framework of the EU is used as an example, although the issues we discuss are likely to be more widely applicable.

Technical Packages in Injury and Violence Prevention to Move Evidence Into Practice: Systematic Reviews and Beyond.

PubMed

Haegerich, Tamara M; David-Ferdon, Corinne; Noonan, Rita K; Manns, Brian J; Billie, Holly C

2016-09-07

Injury and violence prevention strategies have greater potential for impact when they are based on scientific evidence. Systematic reviews of the scientific evidence can contribute key information about which policies and programs might have the greatest impact when implemented. However, systematic reviews have limitations, such as lack of implementation guidance and contextual information, that can limit the application of knowledge. "Technical packages," developed by knowledge brokers such as the federal government, nonprofit agencies, and academic institutions, have the potential to be an efficient mechanism for making information from systematic reviews actionable. Technical packages provide information about specific evidence-based prevention strategies, along with the estimated costs and impacts, and include accompanying implementation and evaluation guidance to facilitate adoption, implementation, and performance measurement. We describe how systematic reviews can inform the development of technical packages for practitioners, provide examples of technical packages in injury and violence prevention, and explain how enhancing review methods and reporting could facilitate the use and applicability of scientific evidence. © The Author(s) 2016.

Applicability and feasibility of systematic review for performing evidence-based risk assessment in food and feed safety.

PubMed

Aiassa, E; Higgins, J P T; Frampton, G K; Greiner, M; Afonso, A; Amzal, B; Deeks, J; Dorne, J-L; Glanville, J; Lövei, G L; Nienstedt, K; O'connor, A M; Pullin, A S; Rajić, A; Verloo, D

2015-01-01

Food and feed safety risk assessment uses multi-parameter models to evaluate the likelihood of adverse events associated with exposure to hazards in human health, plant health, animal health, animal welfare, and the environment. Systematic review and meta-analysis are established methods for answering questions in health care, and can be implemented to minimize biases in food and feed safety risk assessment. However, no methodological frameworks exist for refining risk assessment multi-parameter models into questions suitable for systematic review, and use of meta-analysis to estimate all parameters required by a risk model may not be always feasible. This paper describes novel approaches for determining question suitability and for prioritizing questions for systematic review in this area. Risk assessment questions that aim to estimate a parameter are likely to be suitable for systematic review. Such questions can be structured by their "key elements" [e.g., for intervention questions, the population(s), intervention(s), comparator(s), and outcome(s)]. Prioritization of questions to be addressed by systematic review relies on the likely impact and related uncertainty of individual parameters in the risk model. This approach to planning and prioritizing systematic review seems to have useful implications for producing evidence-based food and feed safety risk assessment.

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A Youth Suicide Prevention Plan for Canada: A Systematic Review of Reviews.

PubMed

Bennett, Kathryn; Rhodes, Anne E; Duda, Stephanie; Cheung, Amy H; Manassis, Katharina; Links, Paul; Mushquash, Christopher; Braunberger, Peter; Newton, Amanda S; Kutcher, Stanley; Bridge, Jeffrey A; Santos, Robert G; Manion, Ian G; Mclennan, John D; Bagnell, Alexa; Lipman, Ellen; Rice, Maureen; Szatmari, Peter

2015-06-01

We conducted an expedited knowledge synthesis (EKS) to facilitate evidence-informed decision making concerning youth suicide prevention, specifically school-based strategies and nonschool-based interventions designed to prevent repeat attempts. Systematic review of review methods were applied. Inclusion criteria were as follows: systematic review or meta-analysis; prevention in youth 0 to 24 years; peer-reviewed English literature. Review quality was determined with AMSTAR (a measurement tool to assess systematic reviews). Nominal group methods quantified consensus on recommendations derived from the findings. No included review addressing school-based prevention (n = 7) reported decreased suicide death rates based on randomized controlled trials (RCTs) or controlled cohort studies (CCSs), but reduced suicide attempts, suicidal ideation, and proxy measures of suicide risk were reported (based on RCTs and CCSs). Included reviews addressing prevention of repeat suicide attempts (n = 14) found the following: emergency department transition programs may reduce suicide deaths, hospitalizations, and treatment nonadherence (based on RCTs and CCSs); training primary care providers in depression treatment may reduce repeated attempts (based on one RCT); antidepressants may increase short-term suicide risk in some patients (based on RCTs and meta-analyses); this increase is offset by overall population-based reductions in suicide associated with antidepressant treatment of youth depression (based on observational studies); and prevention with psychosocial interventions requires further evaluation. No review addressed sex or gender differences systematically, Aboriginal youth as a special population, harm, or cost-effectiveness. Consensus on 6 recommendations ranged from 73% to 100%. Our EKS facilitates decision maker access to what is known about effective youth suicide prevention interventions. A national research-to-practice network that links researchers and decision makers is recommended to implement and evaluate promising interventions; to eliminate the use of ineffective or harmful interventions; and to clarify prevention intervention effects on death by suicide, suicide attempts, and suicidal ideation. Such a network could position Canada as a leader in youth suicide prevention.

Change in Function, Pain, and Quality of Life Following Structured Nonoperative Treatment in Patients With Degenerative Cervical Myelopathy: A Systematic Review

PubMed Central

Tetreault, Lindsay A.; Rhee, John; Prather, Heidi; Kwon, Brian K.; Wilson, Jefferson R.; Martin, Allan R.; Andersson, Ian B.; Dembek, Anna H.; Pagarigan, Krystle T.; Dettori, Joseph R.

2017-01-01

Study Design: Systematic review. Objectives: The objective of this study was to conduct a systematic review to determine (1) change in function, pain, and quality of life following structured nonoperative treatment for degenerative cervical myelopathy (DCM); (2) variability of change in function, pain, and quality of life following different types of structured nonoperative treatment; (3) differences in outcomes observed between certain subgroups (eg, baseline severity score, duration of symptoms); and (4) negative outcomes and harms resulting from structured nonoperative treatment. Methods: A systematic search was conducted in Embase, PubMed, and the Cochrane Collaboration for articles published between January 1, 1950, and February 9, 2015. Studies were included if they evaluated outcomes following structured nonoperative treatment, including therapeutic exercise, manual therapy, cervical bracing, and/or traction. The quality of each study was evaluated using the Newcastle-Ottawa Scale, and strength of the overall body of evidence was rated using guidelines outlined by the Grading of Recommendation Assessment, Development and Evaluation Working Group. Results: Of the 570 retrieved citations, 8 met inclusion criteria and were summarized in this review. Based on our results, there is very low evidence to suggest that structured nonoperative treatment for DCM results in either a positive or negative change in function as evaluated by the Japanese Orthopaedic Association score. Conclusion: There is a lack of evidence to determine the role of nonoperative treatment in patients with DCM. However, in the majority of studies, patients did not achieve clinically significant gains in function following structured nonoperative treatment. Furthermore, 23% to 54% of patients managed nonoperatively subsequently underwent surgical treatment. PMID:29164032

Surgical versus injection treatment for injection-confirmed chronic sacroiliac joint pain

PubMed Central

Spiker, William Ryan; Lawrence, Brandon D.; Raich, Annie L.; Skelly, Andrea C.; Brodke, Darrel S.

2012-01-01

Study design: Systematic review. Study rationale: Chronic sacroiliac joint pain (CSJP) is a common clinical entity with highly controversial treatment options. A recent systematic review compared surgery with denervation, but the current systematic review compares outcomes of surgical intervention with therapeutic injection for the treatment of CSJP and serves as the next step for evaluating current evidence on the comparative effectiveness of treatments for non-traumatic sacroiliac joint pain. Objective or clinical question: In adult patients with injection-confirmed CSJP, does surgical treatment lead to better outcomes and fewer complications than injection therapy? Methods: A systematic review of the English-language literature was undertaken for articles published between 1970 and June 2012. Electronic databases and reference lists of key articles were searched to identify studies evaluating surgery or injection treatment for injection-confirmed CSJP. Studies involving traumatic onset or non-injection–confirmed CSJP were excluded. Two independent reviewers assessed the level of evidence quality using the grading of recommendations assessment, development and evaluation (GRADE) system, and disagreements were resolved by consensus. Results: We identified twelve articles (seven surgical and five injection treatment) meeting our inclusion criteria. Regardless of the type of treatment, most studies reported over 40% improvement in pain as measured by Visual Analog Scale or Numeric rating Scale score. Regardless of the type of treatment, most studies reported over 20% improvement in functionality. Most complications were reported in the surgical studies. Conclusion: Surgical fusion and therapeutic injections can likely provide pain relief, improve quality of life, and improve work status. The comparative effectiveness of these interventions cannot be evaluated with the current literature. PMID:23526911

Economic evaluation of diagnostic methods used in dentistry. A systematic review.

PubMed

Christell, Helena; Birch, Stephen; Horner, Keith; Lindh, Christina; Rohlin, Madeleine

2014-11-01

To review the literature of economic evaluations regarding diagnostic methods used in dentistry. Four databases (MEDLINE, Web of Science, The Cochrane library, the NHS Economic Evaluation Database) were searched for studies, complemented by hand search, until February 2013. Two authors independently screened all titles or abstracts and then applied inclusion and exclusion criteria to select full-text publications published in English, which reported an economic evaluation comparing at least two alternative methods. Studies of diagnostic methods were assessed by four reviewers using a protocol based on the QUADAS tool regarding diagnostic methods and a check-list for economic evaluations. The results of the data extraction were summarized in a structured table and as a narrative description. From 476 identified full-text publications, 160 were considered to be economic evaluations. Only 12 studies (7%) were on diagnostic methods, whilst 78 studies (49%) were on prevention and 70 (40%) on treatment. Among studies on diagnostic methods, there was between-study heterogeneity methodologically, regarding the diagnostic method analysed and type of economic evaluation addressed. Generally, the choice of economic evaluation method was not justified and the perspective of the study not stated. Costing of diagnostic methods varied. A small body of literature addresses economic evaluation of diagnostic methods in dentistry. Thus, there is a need for studies from various perspectives with well defined research questions and measures of the cost and effectiveness. Economic resources in healthcare are finite. For diagnostic methods, an understanding of efficacy provides only part of the information needed for evidence-based practice. This study highlighted a paucity of economic evaluations of diagnostic methods used in dentistry, indicating that much of what we practise lacks sufficient evidence.

Indigenous Youth Peer-Led Health Promotion in Canada, New Zealand, Australia, and the United States: A Systematic Review of the Approaches, Study Designs, and Effectiveness.

PubMed

Vujcich, Daniel; Thomas, Jessica; Crawford, Katy; Ward, James

2018-01-01

Youth peer-led interventions have become a popular way of sharing health information with young people and appear well suited to Indigenous community contexts. However, no systematic reviews focusing on Indigenous youth have been published. We conducted a systematic review to understand the range and characteristics of Indigenous youth-led health promotion projects implemented and their effectiveness. A systematic search of Medline, Embase, and ProQuest Social Sciences databases was conducted, supplemented by gray literature searches. Included studies focused on interventions where young Indigenous people delivered health information to age-matched peers. Twenty-four studies were identified for inclusion, based on 20 interventions (9 Australian, 4 Canadian, and 7 from the United States of America). Only one intervention was evaluated using a randomized controlled study design. The majority of evaluations took the form of pre-post studies. Methodological limitations were identified in a majority of studies. Study outcomes included improved knowledge, attitude, and behaviors. Currently, there is limited high quality evidence for the effectiveness of peer-led health interventions with Indigenous young people, and the literature is dominated by Australian-based sexual health interventions. More systematic research investigating the effectiveness of peer-led inventions is required, specifically with Indigenous populations. To improve health outcomes for Indigenous youth, greater knowledge of the mechanisms and context under which peer-delivered health promotion is effective in comparison to other methods of health promotion is needed.

Children's Physical Activity in Day Care and Preschool

ERIC Educational Resources Information Center

Reunamo, Jyrki; Hakala, Liisa; Saros, Leila; Lehto, Satu; Kyhälä, Anna-Liisa; Valtonen, Juha

2014-01-01

The purpose of the study was to investigate the dynamics of physical activity (PA) in day care and preschool. The participants were 823 Finnish 1-7-year-old children from 50 day care centres and preschools. The research methods were systematic observation, evaluation of children's skills and interviews with children. Altogether 18,366 observations…

The Financial Burden of Attending University in Georgia: Implications for Rural Students

ERIC Educational Resources Information Center

Chankseliani, Maia

2013-01-01

By evaluating the impact of policies to financially support university students in Georgia, this article demonstrates the systematic spatial disparities that exist in a context of formally equal competition. The author uses a mixed-methods design, combining quantitative evidence on the entire population of Georgian university applicants in…

Dispersed or Clustered Housing for Adults with Intellectual Disability: A Systematic Review

ERIC Educational Resources Information Center

Mansell, Jim; Beadle-Brown, Julie

2009-01-01

Background: The purpose of this review was to evaluate the available research on the quality and costs of dispersed community-based housing when compared with clustered housing. Methods: Searches against specified criteria yielded 19 papers based on 10 studies presenting data comparing dispersed housing with some kind of clustered housing (village…

Pilot Guidelines for Improving Instructional Materials Through the Process of Learner Verification and Revision.

ERIC Educational Resources Information Center

Educational Products Information Exchange Inst., Stony Brook, NY.

Learner Verification and Revision (LVR) Process of Instructional Materials is an ongoing effort for the improvement of instructional materials based on systematic feedback from learners who have used the materials. This evaluation gives publishers a method of identifying instructional strengths and weaknesses of a product and provides an…

A Systematic Evaluation of ADHD and Comorbid Psychopathology in a Population-Based Twin Sample

ERIC Educational Resources Information Center

Volk, Heather E.; Neuman, Rosalind J.; Todd, Richard D.

2005-01-01

Objective: Clinical and population samples demonstrate that attention-deficit/hyperactivity disorder (ADHD) occurs with other disorders. Comorbid disorder clustering within ADHD subtypes is not well studied. Method: Latent class analysis (LCA) examined the co-occurrence of DSM-IV ADHD, oppositional defiant disorder (ODD), conduct disorder (CD),…

Testing a passive revegetation approach for restoring coastal plain depression wetlands

Treesearch

Diane De Steven; Rebecca R. Sharitz; Julian H. Singer; Christopher D. Barton

2006-01-01

Restoration of coastal plain depressions, a biologically significant and threatened wetland type of the southeastern United States, has received little systematic research. Within the context of an experimental project designed to evaluate several restoration approaches, we tested whether successful revegetation can be achieved by passive methods (recruitment from seed...

Teacher Development in First-Year Physical Educators: A Comparison of Effectiveness among Different Physical Education Teacher Education Backgrounds

ERIC Educational Resources Information Center

Ensign, Julene; Woods, Amelia Mays; Kulinna, Pamela Hodges

2017-01-01

Purpose: This study evaluated the teaching effectiveness of six first-year physical educators, three Southwestern and three Midwestern graduates, employing different curricular approaches. Method: Utilizing surveys, interviews, questionnaires, and systematic observations, data were analyzed through a framework of seven essential teaching tasks…

Effectiveness of Solution-Focused Brief Therapy: A Systematic Qualitative Review of Controlled Outcome Studies

ERIC Educational Resources Information Center

Gingerich, Wallace J.; Peterson, Lance T.

2013-01-01

Objective: We review all available controlled outcome studies of solution-focused brief therapy (SFBT) to evaluate evidence of its effectiveness. Method: Forty-three studies were located and key data abstracted on problem, setting, SFBT intervention, design characteristics, and outcomes. Results: Thirty-two (74%) of the studies reported…

Measured Gene-by-Environment Interaction in Relation to Attention-Deficit/Hyperactivity Disorder

ERIC Educational Resources Information Center

Nigg, Joel; Nikolas, Molly; Burt, S. Alexandra

2010-01-01

Objective: To summarize and evaluate the state of knowledge regarding the role of measured gene-by-environment interactions in relation to attention-deficit/hyperactivity disorder. Method: A selective review of methodologic issues was followed by a systematic search for relevant articles on measured gene-by-environment interactions; the search…

A Review of "Wandering" Instruments for People with Dementia Who Get Lost

ERIC Educational Resources Information Center

Bantry White, Eleanor; Montgomery, Paul

2014-01-01

Objectives: This study is the first review to be conducted to evaluate measures of wandering behavior for identifying people with dementia at risk of getting lost. Method: Drawing upon systematic review search strategies, the relevant literature was reviewed for wandering instruments using MEDLINE, Embase, PsycINFO, and Cumulative Index to Nursing…

An Empirical Review of Internet Addiction Outcome Studies in China

ERIC Educational Resources Information Center

Liu, Chennan; Liao, Minli; Smith, Douglas C.

2012-01-01

Objectives: The authors systematically reviewed the outcomes and methodological quality of 24 Internet addiction (IA) treatment outcome studies in China. Method: The authors used 15 attributes from the quality of evidence scores to evaluate 24 outcome studies. These studies came from both English and Chinese academic databases from 2000 to 2010.…

Implementing a Project-Based Learning Model in a Pre-Service Leadership Program

ERIC Educational Resources Information Center

Albritton, Shelly; Stacks, Jamie

2016-01-01

This paper describes two instructors' efforts to more authentically engage students in a preservice leadership program's course called Program Planning and Evaluation by using a project-based learning approach. Markham, Larmer, and Ravitz (2003) describe project-based learning (PjBL) as "a systematic teaching method that engages students in…

A Standardized Mean Difference Effect Size for Multiple Baseline Designs across Individuals

ERIC Educational Resources Information Center

Hedges, Larry V.; Pustejovsky, James E.; Shadish, William R.

2013-01-01

Single-case designs are a class of research methods for evaluating treatment effects by measuring outcomes repeatedly over time while systematically introducing different condition (e.g., treatment and control) to the same individual. The designs are used across fields such as behavior analysis, clinical psychology, special education, and…

Culturally Sensitive Interventions and Substance Use: A Meta-Analytic Review of Outcomes among Minority Youths

ERIC Educational Resources Information Center

Hodge, David R.; Jackson, Kelly F.; Vaughn, Michael G.

2012-01-01

This study assessed the effectiveness of culturally sensitive interventions (CSIs) ("N" = 10) designed to address substance use among minority youths. Study methods consisted of systematic search procedures, quality of study ratings, and meta-analytic techniques to gauge effects and evaluate publication bias. The results, across all measures and…

The Efficacy of Guanxinning Injection in Treating Angina Pectoris: Systematic Review and Meta-Analysis of Randomized Controlled Trials

PubMed Central

Jia, Yongliang; Leung, Siu-wai; Lee, Ming-Yuen; Cui, Guozhen; Huang, Xiaohui; Pan, Fongha

2013-01-01

Objective. The randomized controlled trials (RCTs) on Guanxinning injection (GXN) in treating angina pectoris were published only in Chinese and have not been systematically reviewed. This study aims to provide a PRISMA-compliant and internationally accessible systematic review to evaluate the efficacy of GXN in treating angina pectoris. Methods. The RCTs were included according to prespecified eligibility criteria. Meta-analysis was performed to evaluate the symptomatic (SYMPTOMS) and electrocardiographic (ECG) improvements after treatment. Odds ratios (ORs) were used to measure effect sizes. Subgroup analysis, sensitivity analysis, and metaregression were conducted to evaluate the robustness of the results. Results. Sixty-five RCTs published between 2002 and 2012 with 6064 participants were included. Overall ORs comparing GXN with other drugs were 3.32 (95% CI: [2.72, 4.04]) in SYMPTOMS and 2.59 (95% CI: [2.14, 3.15]) in ECG. Subgroup analysis, sensitivity analysis, and metaregression found no statistically significant dependence of overall ORs upon specific study characteristics. Conclusion. This meta-analysis of eligible RCTs provides evidence that GXN is effective in treating angina pectoris. This evidence warrants further RCTs of higher quality, longer follow-up periods, larger sample sizes, and multicentres/multicountries for more extensive subgroup, sensitivity, and metaregression analyses. PMID:23634167

Knee ultrasound from research to real practice: a systematic literature review of adult knee ultrasound assessment feasibility studies.

PubMed

Peltea, Alexandra; Berghea, Florian; Gudu, Tania; Ionescu, Ruxandra

2016-12-05

To identify and analyse existing data regarding knee ultrasound (US) feasibility in clinical practice. Material and methods: A systematic literature review was performed using the terms: ("knee") AND ("ultrasound" OR "ultrasonography") AND ("feasibility" OR "pilot" OR "proof of concept"). Feasibility studies regarding knee US or US aided maneuver involving knee joint, published during 2005-2015, were selected and evaluated against a complex framework constructed around mandatory key areas for feasibility studies: acceptability, demand, implementation, practicality, adaptation, integration and expansion. One hundred and fifty-nine publications were identified, of which 9 were included in the final analysis: 6 dealt with the development and implementation of novel US scores, while the rest focused on implementing MSUS in clinical practice, evaluating the usefulness of articular cartilage US assessment and the feasibility of sonography for intra-articular knee injections, respectively. Six studies quantified feasibility as time spent for the evaluation, with only two addressing areassuch as acceptability, implementation and practicality, although none of these systematically assessed all feasibility domains. Knee US feasibility is still poorly addressed; the time required for US assessment is the main area addressed. This information gap should be properly addressed in future works, in order to ensure the right place for this technique.

Effectiveness of acupuncture for cancer pain: protocol for an umbrella review and meta-analyses of controlled trials

PubMed Central

He, Yihan; Liu, Yihong; May, Brian H; Zhang, Anthony Lin; Zhang, Haibo; Lu, ChuanJian; Yang, Lihong; Guo, Xinfeng; Xue, Charlie Changli

2017-01-01

Introduction The National Comprehensive Cancer Network guidelines for adult cancer pain indicate that acupuncture and related therapies may be valuable additions to pharmacological interventions for pain management. Of the systematic reviews related to this topic, some concluded that acupuncture was promising for alleviating cancer pain, while others argued that the evidence was insufficient to support its effectiveness. Methods and analysis This review will consist of three components: (1) synthesis of findings from existing systematic reviews; (2) updated meta-analyses of randomised clinical trials and (3) analyses of results of other types of clinical studies. We will search six English and four Chinese biomedical databases, dissertations and grey literature to identify systematic reviews and primary clinical studies. Two reviewers will screen results of the literature searches independently to identify included reviews and studies. Data from included articles will be abstracted for assessment, analysis and summary. Two assessors will appraise the quality of systematic reviews using Assessment of Multiple Systematic Reviews; assess the randomised controlled trials using the Cochrane Collaboration’s risk of bias tool and other types of studies according to the Newcastle-Ottawa Scale. We will use ‘summary of evidence’ tables to present evidence from existing systematic reviews and meta-analyses. Using the primary clinical studies, we will conduct meta-analysis for each outcome, by grouping studies based on the type of acupuncture, the comparator and the specific type of pain. Sensitivity analyses are planned according to clinical factors, acupuncture method, methodological characteristics and presence of statistical heterogeneity as applicable. For the non-randomised studies, we will tabulate the characteristics, outcome measures and the reported results of each study. Consistencies and inconsistencies in evidence will be investigated and discussed. Finally, we will use the Grading of Recommendations Assessment, Development and Evaluation approach to evaluate the quality of the overall evidence. Ethics and dissemination There are no ethical considerations associated with this review. The findings will be disseminated in peer-reviewed journals or conference presentations. PROSPERO registration number CRD42017064113. PMID:29229658

Protocol for a systematic review and economic evaluation of the clinical and cost-effectiveness of non-hospital-based non-invasive ventilation (NIV) in patients with stable end-stage COPD with hypercapnic respiratory failure.

PubMed

Dave, Chirag; Turner, Alice; Dretzke, Janine; Bayliss, Sue; O'Brien, Deirdre; Jowett, Sue; Moore, David

2014-03-27

Chronic obstructive pulmonary disease (COPD) remains a significant public health burden. Non-invasive ventilation (NIV) is a method of supported breathing used as standard care for acutely unwell patients in hospital with COPD, but there is uncertainty around the potential benefits of using NIV in the treatment of stable patients in a non-hospital setting. This is a protocol for systematic reviews of the clinical and cost-effectiveness of NIV in this context, being undertaken in support of a model based economic evaluation. Standard systematic review methods aimed at minimising bias will be employed for study identification, selection and data extraction for both the clinical and economic systematic reviews. Bibliographic databases (for example MEDLINE, EMBASE) and ongoing trials registers will be searched from 1980 onwards. The search strategy will combine terms for the population with those for the intervention. Studies will be selected for review if the population includes adult patients with COPD and hypercapnic respiratory failure, however defined. Systematic reviews, randomised controlled trials and observational studies (with n >1) will be included, and quality assessment will be tailored to the different study designs. The primary outcome measures of interest are survival, quality of life, and healthcare utilisations (hospitalisation and Accident and Emergency attendances). Meta-analyses will be undertaken where clinical and methodological homogeneity exists, supported by predefined subgroup analyses where appropriate. A systematic review of the evidence on the cost-effectiveness of non-hospital NIV will be completed, and a model-based cost-utility analysis undertaken to determine the cost-effectiveness of non-hospital-based NIV compared with standard care. These reviews will attempt to clarify the clinical effectiveness of non-hospital NIV in COPD patients as well as the cost-effectiveness. The findings may indicate whether NIV in a non-hospital setting should be considered more routinely in this patient group, and what the likely cost implications will be. 2012:CRD42012003286.

Vibration response imaging: protocol for a systematic review.

PubMed

Berry, Marc P; Camporota, Luigi; Ntoumenopoulos, George

2013-09-25

The concept of lung sounds conveying information regarding lung physiology has been used extensively in clinical practice, particularly with physical auscultation using a stethoscope. Advances in computer technology have facilitated the construction of dynamic visual images derived from recorded lung sounds. Arguably, the most significant progress in this field was the development of the commercially available vibration response imaging (VRI) (Deep Breeze Ltd, Or-Akiva, Israel). This device provides a non-invasive, dynamic image of both lungs constructed from sounds detected from the lungs using surface sensors. In the literature, VRI has been utilized in a multitude of clinical and research settings. This systematic review aims to address three study questions relating to whether VRI can be used as an evaluative device, whether the images generated can be characterized, and which tools and measures have been used to assess these images. This systematic review will involve implementing search strategies in five online journal databases in order to extract articles relating to the application of VRI. Appropriate articles will be identified against a set of pre-determined eligibility criteria and assessed for methodological quality using a standardized scale. Included articles will have data extracted by the reviewers using a standardized evidence table. A narrative synthesis based on a standardized framework will be conducted, clustering evidence into three main groups; one for each of the study questions. A meta-analysis will be conducted if two or more research articles meet pre-determined criteria that allow quantitative synthesis to take place. This systematic review aims to provide a complete overview of the scope of VRI in the clinical and research settings, as well as to discuss methods to interpret the data obtained from VRI. The systematic review intends to help clinicians to make informed decisions on the clinical applicability of the device, to allow researchers to identify further potential avenues of investigation, and to provide methods for the evaluation and interpretation of dynamic and static images. The publication and registration of this review with PROSPERO provides transparency and accountability, and facilitates the appraisal of the proposed systematic review against the original design. PROSPERO registration number: CRD42013003751.

The GMO Sumrule and the πNN Coupling Constant

NASA Astrophysics Data System (ADS)

Ericson, T. E. O.; Loiseau, B.; Thomas, A. W.

The isovector GMO sumrule for forward πN scattering is critically evaluated using the precise π-p and π-d scattering lengths obtained recently from pionic atom measurements. The charged πNN coupling constant is then deduced with careful analysis of systematic and statistical sources of uncertainties. This determination gives directly from data gc2(GMO)/4π = 14.17±0.09 (statistic) ±0.17 (systematic) or fc2/ 4π=0.078(11). This value is half-way between that of indirect methods (phase-shift analyses) and the direct evaluation from from backward np differential scattering cross sections (extrapolation to pion pole). From the π-p and π-d scattering lengths our analysis leads also to accurate values for (1/2)(aπ-p+aπ-n) and (1/2) (aπ-p-aπ-n).

Influence of organizational factors on safety

DOE Office of Scientific and Technical Information (OSTI.GOV)

Haber, S.B.; Metlay, D.S.; Crouch, D.A.

There is a need for a better understanding of exactly how organizational management factors at a nuclear power plant (NPP) affect plant safety performance, either directly or indirectly, and how these factors might be observed, measured, and evaluated. The purpose of this research project is to respond to that need by developing a general methodology for characterizing these organizational and management factors, systematically collecting information on their status and integrating that information into various types of evaluative activities. Research to date has included the development of the Nuclear Organization and Management Analysis Concept (NOMAC) of a NPP, the identification ofmore » key organizational and management factors, and the identification of the methods for systematically measuring and analyzing the influence of these factors on performance. Most recently, two field studies, one at a fossil fuel plant and the other at a NPP, were conducted using the developed methodology. Results are presented from both studies highlighting the acceptability, practicality, and usefulness of the methods used to assess the influence of various organizational and management factors including culture, communication, decision-making, standardization, and oversight. 6 refs., 3 figs., 1 tab.« less

Quantification of proteins in urine samples using targeted mass spectrometry methods.

PubMed

Khristenko, Nina; Domon, Bruno

2015-01-01

Numerous clinical proteomics studies are focused on the development of biomarkers to improve either diagnostics for early disease detection or the monitoring of the response to the treatment. Although, a wealth of biomarker candidates are available, their evaluation and validation in a true clinical setup remains challenging. In biomarkers evaluation studies, a panel of proteins of interest are systematically analyzed in a large cohort of samples. However, in spite of the latest progresses in mass spectrometry, the consistent detection of pertinent proteins in high complex biological samples is still a challenging task. Thus, targeted LC-MS/MS methods are better suited for the systematic analysis of biomarkers rather than shotgun approaches. This chapter describes the workflow used to perform targeted quantitative analyses of proteins in urinary samples. The peptides, as surrogates of the protein of interest, are commonly measured using a triple quadrupole mass spectrometers operated in selected reaction monitoring (SRM) mode. More recently, the advances in targeted LC-MS/MS analysis based on parallel reaction monitoring (PRM) performed on a quadrupole-orbitrap instrument have allowed to increase the specificity and selectivity of the measurements.

Estimation of Orbital Neutron Detector Spatial Resolution by Systematic Shifting of Differential Topographic Masks

NASA Technical Reports Server (NTRS)

McClanahan, T. P.; Mitrofanov, I. G.; Boynton, W. V.; Chin, G.; Livengood, T.; Starr, R. D.; Evans, L. G.; Mazarico, E.; Smith, D. E.

2012-01-01

We present a method and preliminary results related to determining the spatial resolution of orbital neutron detectors using epithermal maps and differential topographic masks. Our technique is similar to coded aperture imaging methods for optimizing photonic signals in telescopes [I]. In that approach photon masks with known spatial patterns in a telescope aperature are used to systematically restrict incoming photons which minimizes interference and enhances photon signal to noise. Three orbital neutron detector systems with different stated spatial resolutions are evaluated. The differing spatial resolutions arise due different orbital altitudes and the use of neutron collimation techniques. 1) The uncollimated Lunar Prospector Neutron Spectrometer (LPNS) system has spatial resolution of 45km FWHM from approx. 30km altitude mission phase [2]. The Lunar Rennaissance Orbiter (LRO) Lunar Exploration Neutron Detector (LEND) with two detectors at 50km altitude evaluated here: 2) the collimated 10km FWHM spatial resolution detector CSETN and 3) LEND's collimated Sensor for Epithermal Neutrons (SETN). Thus providing two orbital altitudes to study factors of: uncollimated vs collimated and two average altitudes for their effect on fields-of-view.

Reliability and validity of non-radiographic methods of thoracic kyphosis measurement: a systematic review.

PubMed

Barrett, Eva; McCreesh, Karen; Lewis, Jeremy

2014-02-01

A wide array of instruments are available for non-invasive thoracic kyphosis measurement. Guidelines for selecting outcome measures for use in clinical and research practice recommend that properties such as validity and reliability are considered. This systematic review reports on the reliability and validity of non-invasive methods for measuring thoracic kyphosis. A systematic search of 11 electronic databases located studies assessing reliability and/or validity of non-invasive thoracic kyphosis measurement techniques. Two independent reviewers used a critical appraisal tool to assess the quality of retrieved studies. Data was extracted by the primary reviewer. The results were synthesized qualitatively using a level of evidence approach. 27 studies satisfied the eligibility criteria and were included in the review. The reliability, validity and both reliability and validity were investigated by sixteen, two and nine studies respectively. 17/27 studies were deemed to be of high quality. In total, 15 methods of thoracic kyphosis were evaluated in retrieved studies. All investigated methods showed high (ICC ≥ .7) to very high (ICC ≥ .9) levels of reliability. The validity of the methods ranged from low to very high. The strongest levels of evidence for reliability exists in support of the Debrunner kyphometer, Spinal Mouse and Flexicurve index, and for validity supports the arcometer and Flexicurve index. Further reliability and validity studies are required to strengthen the level of evidence for the remaining methods of measurement. This should be addressed by future research. Copyright © 2013 Elsevier Ltd. All rights reserved.

A Patient-Centered Framework for Evaluating Digital Maturity of Health Services: A Systematic Review

PubMed Central

Callahan, Ryan; Darzi, Ara; Mayer, Erik

2016-01-01

Background Digital maturity is the extent to which digital technologies are used as enablers to deliver a high-quality health service. Extensive literature exists about how to assess the components of digital maturity, but it has not been used to design a comprehensive framework for evaluation. Consequently, the measurement systems that do exist are limited to evaluating digital programs within one service or care setting, meaning that digital maturity evaluation is not accounting for the needs of patients across their care pathways. Objective The objective of our study was to identify the best methods and metrics for evaluating digital maturity and to create a novel, evidence-based tool for evaluating digital maturity across patient care pathways. Methods We systematically reviewed the literature to find the best methods and metrics for evaluating digital maturity. We searched the PubMed database for all papers relevant to digital maturity evaluation. Papers were selected if they provided insight into how to appraise digital systems within the health service and if they indicated the factors that constitute or facilitate digital maturity. Papers were analyzed to identify methodology for evaluating digital maturity and indicators of digitally mature systems. We then used the resulting information about methodology to design an evaluation framework. Following that, the indicators of digital maturity were extracted and grouped into increasing levels of maturity and operationalized as metrics within the evaluation framework. Results We identified 28 papers as relevant to evaluating digital maturity, from which we derived 5 themes. The first theme concerned general evaluation methodology for constructing the framework (7 papers). The following 4 themes were the increasing levels of digital maturity: resources and ability (6 papers), usage (7 papers), interoperability (3 papers), and impact (5 papers). The framework includes metrics for each of these levels at each stage of the typical patient care pathway. Conclusions The framework uses a patient-centric model that departs from traditional service-specific measurements and allows for novel insights into how digital programs benefit patients across the health system. Trial Registration N/A PMID:27080852

Participatory Design in Gerontechnology: A Systematic Literature Review.

PubMed

Merkel, Sebastian; Kucharski, Alexander

2018-05-19

Participatory design (PD) is widely used within gerontechnology but there is no common understanding about which methods are used for what purposes. This review aims to examine what different forms of PD exist in the field of gerontechnology and how these can be categorized. We conducted a systematic literature review covering several databases. The search strategy was based on 3 elements: (1) participatory methods and approaches with (2) older persons aiming at developing (3) technology for older people. Our final review included 26 studies representing a variety of technologies designed/developed and methods/instruments applied. According to the technologies, the publications reviewed can be categorized in 3 groups: Studies that (1) use already existing technology with the aim to find new ways of use; (2) aim at creating new devices; (3) test and/or modify prototypes. The implementation of PD depends on the questions: Why a participatory approach is applied, who is involved as future user(s), when those future users are involved, and how they are incorporated into the innovation process. There are multiple ways, methods, and instruments to integrate users into the innovation process. Which methods should be applied, depends on the context. However, most studies do not evaluate if participatory approaches will lead to a better acceptance and/or use of the co-developed products. Therefore, participatory design should follow a comprehensive strategy, starting with the users' needs and ending with an evaluation if the applied methods have led to better results.

What is positive youth development and how might it reduce substance use and violence? A systematic review and synthesis of theoretical literature.

PubMed

Bonell, Chris; Hinds, Kate; Dickson, Kelly; Thomas, James; Fletcher, Adam; Murphy, Simon; Melendez-Torres, G J; Bonell, Carys; Campbell, Rona

2016-02-10

Preventing adolescent substance use and youth violence are public health priorities. Positive youth development interventions are widely deployed often with the aim of preventing both. However, the theorised mechanisms by which PYD is intended to reduce substance use and violence are not clear and existing evaluated interventions are under-theorised. Using innovative methods, we systematically searched for and synthesised published theoretical literature describing what is meant by positive youth development and how it might reduce substance use and violence, as part of a broader systematic review examining process and outcomes of PYD interventions. We searched 19 electronic databases, review topic websites, and contacted experts between October 2013 and January 2014. We included studies written in English, published since 1985 that reported a theory of change for positive youth development focused on prevention of smoking, alcohol consumption, drug use or violence in out-of-school settings. Studies were independently coded and quality-assessed by two reviewers. We identified 16 studies that met our inclusion criteria. Our synthesis suggests that positive youth development aims to provide youth with affective relationships and diverse experiences which enable their development of intentional self-regulation and multiple positive assets. These in turn buffer against or compensate for involvement in substance use and violence. Existing literature is not clear on how intentional self-regulation is developed and which specific positive assets buffer against substance use or violence. Our synthesis provides: an example of a rigorous systematic synthesis of theory literature innovatively applying methods of qualitative synthesis to theoretical literature; a clearer understanding of how PYD might reduce substance use and violence to inform future interventions and empirical evaluations.

Systematic bias in genomic classification due to contaminating non-neoplastic tissue in breast tumor samples.

PubMed

Elloumi, Fathi; Hu, Zhiyuan; Li, Yan; Parker, Joel S; Gulley, Margaret L; Amos, Keith D; Troester, Melissa A

2011-06-30

Genomic tests are available to predict breast cancer recurrence and to guide clinical decision making. These predictors provide recurrence risk scores along with a measure of uncertainty, usually a confidence interval. The confidence interval conveys random error and not systematic bias. Standard tumor sampling methods make this problematic, as it is common to have a substantial proportion (typically 30-50%) of a tumor sample comprised of histologically benign tissue. This "normal" tissue could represent a source of non-random error or systematic bias in genomic classification. To assess the performance characteristics of genomic classification to systematic error from normal contamination, we collected 55 tumor samples and paired tumor-adjacent normal tissue. Using genomic signatures from the tumor and paired normal, we evaluated how increasing normal contamination altered recurrence risk scores for various genomic predictors. Simulations of normal tissue contamination caused misclassification of tumors in all predictors evaluated, but different breast cancer predictors showed different types of vulnerability to normal tissue bias. While two predictors had unpredictable direction of bias (either higher or lower risk of relapse resulted from normal contamination), one signature showed predictable direction of normal tissue effects. Due to this predictable direction of effect, this signature (the PAM50) was adjusted for normal tissue contamination and these corrections improved sensitivity and negative predictive value. For all three assays quality control standards and/or appropriate bias adjustment strategies can be used to improve assay reliability. Normal tissue sampled concurrently with tumor is an important source of bias in breast genomic predictors. All genomic predictors show some sensitivity to normal tissue contamination and ideal strategies for mitigating this bias vary depending upon the particular genes and computational methods used in the predictor.

Physical activity mass media campaigns and their evaluation: a systematic review of the literature 2003-2010.

PubMed

Leavy, Justine E; Bull, Fiona C; Rosenberg, Michael; Bauman, Adrian

2011-12-01

Internationally, mass media campaigns to promote regular moderate-intensity physical activity have increased recently. Evidence of mass media campaign effectiveness exists in other health areas, however the evidence for physical activity is limited. The purpose was to systematically review the literature on physical activity mass media campaigns, 2003-2010. A focus was on reviewing evaluation designs, theory used, formative evaluation, campaign effects and outcomes. Literature was searched resulting in 18 individual adult mass media campaigns, mostly in high-income regions and two in middle-income regions. Designs included: quasi experimental (n = 5); non experimental (n = 12); a mixed methods design (n = 1). One half used formative research. Awareness levels ranged from 17 to 95%. Seven campaigns reported significant increases in physical activity levels. The review found that beyond awareness raising, changes in other outcomes were measured, assessed but reported in varying ways. It highlighted improvements in evaluation, although limited evidence of campaign effects remain. It provides an update on the evaluation methodologies used in the adult literature. We recommend optimal evaluation design should include: (1) formative research to inform theories/frameworks, campaign content and evaluation design; (2) cohort study design with multiple data collection points; (3) sufficient duration; (4) use of validated measures; (5) sufficient evaluation resources.

Hardware Testing and System Evaluation: Procedures to Evaluate Commodity Hardware for Production Clusters

DOE Office of Scientific and Technical Information (OSTI.GOV)

Goebel, J

2004-02-27

Without stable hardware any program will fail. The frustration and expense of supporting bad hardware can drain an organization, delay progress, and frustrate everyone involved. At Stanford Linear Accelerator Center (SLAC), we have created a testing method that helps our group, SLAC Computer Services (SCS), weed out potentially bad hardware and purchase the best hardware at the best possible cost. Commodity hardware changes often, so new evaluations happen periodically each time we purchase systems and minor re-evaluations happen for revised systems for our clusters, about twice a year. This general framework helps SCS perform correct, efficient evaluations. This article outlinesmore » SCS's computer testing methods and our system acceptance criteria. We expanded the basic ideas to other evaluations such as storage, and we think the methods outlined in this article has helped us choose hardware that is much more stable and supportable than our previous purchases. We have found that commodity hardware ranges in quality, so systematic method and tools for hardware evaluation were necessary. This article is based on one instance of a hardware purchase, but the guidelines apply to the general problem of purchasing commodity computer systems for production computational work.« less

Developing methods for systematic reviewing in health services delivery and organization: an example from a review of access to health care for people with learning disabilities. Part 2. Evaluation of the literature--a practical guide.

PubMed

Alborz, Alison; McNally, Rosalind

2004-12-01

To develop methods to facilitate the 'systematic' review of evidence from a range of methodologies on diffuse or 'soft' topics, as exemplified by 'access to health care'. Twenty-eight bibliographic databases, research registers, organizational websites or library catalogues. Reference lists from identified studies. Contact with experts and service users. Current awareness and contents alerting services in the area of learning disabilities. Inclusion criteria were English language literature from 1980 onwards, relating to people with learning disabilities of any age and all study designs. The main criteria for assessment was relevance to Guillifords' model of access to health care which was adapted to the circumstances of people with learning disabilities. Selected studies were evaluated for scientific rigour then data was extracted and the results synthesized. Quality assessment was by an initial set of 'generic' quality indicators. This enabled further evidence selection before evaluation of findings according to specific criteria for qualitative, quantitative or mixed-method studies. Eighty-two studies were fully evaluated. Five studies were rated 'highly rigorous', 22 'rigorous', 46 'less rigorous' and nine 'poor' papers were retained as the sole evidence covering aspects of the guiding model. The majority of studies were quantitative but used only descriptive statistics. Most evidence lacked methodological detail, which often lowered final quality ratings. The application of a consistent structure to quality evaluation can facilitate data appraisal, extraction and synthesis across a range of methodologies in diffuse or 'soft' topics. Synthesis can be facilitated further by using software, such as the microsoft 'access' database, for managing information.

Development and application of the RE-AIM QuEST mixed methods framework for program evaluation.

PubMed

Forman, Jane; Heisler, Michele; Damschroder, Laura J; Kaselitz, Elizabeth; Kerr, Eve A

2017-06-01

To increase the likelihood of successful implementation of interventions and promote dissemination across real-world settings, it is essential to evaluate outcomes related to dimensions other than Effectiveness alone. Glasgow and colleagues' RE-AIM framework specifies four additional types of outcomes that are important to decision-makers: Reach, Adoption, Implementation (including cost), and Maintenance. To further strengthen RE-AIM, we propose integrating qualitative assessments in an expanded framework: RE-AIM Qualitative Evaluation for Systematic Translation (RE-AIM QuEST), a mixed methods framework. RE-AIM QuEST guides formative evaluation to identify real-time implementation barriers and explain how implementation context may influence translation to additional settings. RE-AIM QuEST was used to evaluate a pharmacist-led hypertension management intervention at 3 VA facilities in 2008-2009. We systematically reviewed each of the five RE-AIM dimensions and created open-ended companion questions to quantitative measures and identified qualitative and quantitative data sources, measures, and analyses. To illustrate use of the RE-AIM QuEST framework, we provide examples of real-time, coordinated use of quantitative process measures and qualitative methods to identify site-specific issues, and retrospective use of these data sources and analyses to understand variation across sites and explain outcomes. For example, in the Reach dimension, we conducted real-time measurement of enrollment across sites and used qualitative data to better understand and address barriers at a low-enrollment site. The RE-AIM QuEST framework may be a useful tool for improving interventions in real-time, for understanding retrospectively why an intervention did or did not work, and for enhancing its sustainability and translation to other settings.

Automated airway evaluation system for multi-slice computed tomography using airway lumen diameter, airway wall thickness and broncho-arterial ratio

NASA Astrophysics Data System (ADS)

Odry, Benjamin L.; Kiraly, Atilla P.; Novak, Carol L.; Naidich, David P.; Lerallut, Jean-Francois

2006-03-01

Pulmonary diseases such as bronchiectasis, asthma, and emphysema are characterized by abnormalities in airway dimensions. Multi-slice computed tomography (MSCT) has become one of the primary means to depict these abnormalities, as the availability of high-resolution near-isotropic data makes it possible to evaluate airways at oblique angles to the scanner plane. However, currently, clinical evaluation of airways is typically limited to subjective visual inspection only: systematic evaluation of the airways to take advantage of high-resolution data has not proved practical without automation. We present an automated method to quantitatively evaluate airway lumen diameter, wall thickness and broncho-arterial ratios. In addition, our method provides 3D visualization of these values, graphically illustrating the location and extent of disease. Our algorithm begins by automatic airway segmentation to extract paths to the distal airways, and to create a map of airway diameters. Normally, airway diameters decrease as paths progress distally; failure to taper indicates abnormal dilatation. Our approach monitors airway lumen diameters along each airway path in order to detect abnormal profiles, allowing even subtle degrees of pathologic dilatation to be identified. Our method also systematically computes the broncho-arterial ratio at every terminal branch of the tree model, as a ratio above 1 indicates potentially abnormal bronchial dilatation. Finally, the airway wall thickness is computed at corresponding locations. These measurements are used to highlight abnormal branches for closer inspection, and can be summed to compute a quantitative global score for the entire airway tree, allowing reproducible longitudinal assessment of disease severity. Preliminary tests on patients diagnosed with bronchiectasis demonstrated rapid identification of lack of tapering, which also was confirmed by corresponding demonstration of elevated broncho-arterial ratios.

Validity of Dietary Assessment in Athletes: A Systematic Review

PubMed Central

Beck, Kathryn L.; Gifford, Janelle A.; Slater, Gary; Flood, Victoria M.; O’Connor, Helen

2017-01-01

Dietary assessment methods that are recognized as appropriate for the general population are usually applied in a similar manner to athletes, despite the knowledge that sport-specific factors can complicate assessment and impact accuracy in unique ways. As dietary assessment methods are used extensively within the field of sports nutrition, there is concern the validity of methodologies have not undergone more rigorous evaluation in this unique population sub-group. The purpose of this systematic review was to compare two or more methods of dietary assessment, including dietary intake measured against biomarkers or reference measures of energy expenditure, in athletes. Six electronic databases were searched for English-language, full-text articles published from January 1980 until June 2016. The search strategy combined the following keywords: diet, nutrition assessment, athlete, and validity; where the following outcomes are reported but not limited to: energy intake, macro and/or micronutrient intake, food intake, nutritional adequacy, diet quality, or nutritional status. Meta-analysis was performed on studies with sufficient methodological similarity, with between-group standardized mean differences (or effect size) and 95% confidence intervals (CI) being calculated. Of the 1624 studies identified, 18 were eligible for inclusion. Studies comparing self-reported energy intake (EI) to energy expenditure assessed via doubly labelled water were grouped for comparison (n = 11) and demonstrated mean EI was under-estimated by 19% (−2793 ± 1134 kJ/day). Meta-analysis revealed a large pooled effect size of −1.006 (95% CI: −1.3 to −0.7; p < 0.001). The remaining studies (n = 7) compared a new dietary tool or instrument to a reference method(s) (e.g., food record, 24-h dietary recall, biomarker) as part of a validation study. This systematic review revealed there are limited robust studies evaluating dietary assessment methods in athletes. Existing literature demonstrates the substantial variability between methods, with under- and misreporting of intake being frequently observed. There is a clear need for careful validation of dietary assessment methods, including emerging technical innovations, among athlete populations. PMID:29207495

The efficacy and efficiency of Disability Management in job-retention and job-reintegration. A systematic review.

PubMed

Lefever, Marlies; Decuman, Saskia; Perl, François; Braeckman, Lutgart; Van de Velde, Dominique

2018-01-01

Disability management (DM) is a systematic method to ensure job-retention and job-reintegration in competitive employment for individuals with a disability. There is evidence that 'returning to work' has a positive impact on the individual, the company and on the society. However, a clear overview of the efficacy and efficiency of the DM programs is scarce. To systematically review the efficacy and efficiency of the disability management programs. Cochrane, PubMed, Google Scholar, and Web of Science were searched from 1994 to 2015. Two reviewers independently evaluated the articles on title, abstract, and full text. The data extraction and results are documented according to the study designs. Twenty-eight articles were included in the review. These 28 articles consisted of 7 systematic reviews, 3 randomized controlled trials, 9 clinical trials, 4 mixed-method studies and 5 qualitative studies. The DM program has shown to be effective and efficient. A consensus about the DM components is still not reached. Nevertheless, some components are emphasized more than others; job accommodation, facilitation of transitional duty, communication between all stakeholders, health care provider advice, early intervention, and acceptance, goodwill and trust in the stakeholders, in the organization, and in the disability management process.

Knowledge translation and implementation in spinal cord injury: a systematic review

PubMed Central

Noonan, VK; Wolfe, DL; Thorogood, NP; Park, SE; Hsieh, JT; Eng, JJ

2015-01-01

Objective To conduct a systematic review examining the effectiveness of knowledge translation (KT) interventions in changing clinical practice and patient outcomes. Methods MEDLINE/PubMed, CINAHL, EMBASE and PsycINFO were searched for studies published from January 1980 to July 2012 that reported and evaluated an implemented KT intervention in spinal cord injury (SCI) care. We reviewed and summarized results from studies that documented the implemented KT intervention, its impact on changing clinician behavior and patient outcomes as well as the facilitators and barriers encountered during the implementation. Results A total of 13 articles featuring 10 studies were selected and abstracted from 4650 identified articles. KT interventions included developing and implementing patient care protocols, providing clinician education and incorporating outcome measures into clinical practice. The methods (or drivers) to facilitate the implementation included organizing training sessions for clinical staff, introducing computerized reminders and involving organizational leaders. The methodological quality of studies was mostly poor. Only 3 out of 10 studies evaluated the success of the implementation using statistical analyses, and all 3 reported significant behavior change. Out of the 10 studies, 6 evaluated the effect of the implementation on patient outcomes using statistical analyses, with 4 reporting significant improvements. The commonly cited facilitators and barriers were communication and resources, respectively. Conclusion The field of KT in SCI is in its infancy with only a few relevant publications. However, there is some evidence that KT interventions may change clinician behavior and improve patient outcomes. Future studies should ensure rigorous study methods are used to evaluate KT interventions. PMID:24796445

A Comprehensive Critique and Review of Published Measures of Acne Severity

PubMed Central

Furber, Gareth; Leach, Matthew; Segal, Leonie

2016-01-01

Objective: Acne vulgaris is a dynamic, complex condition that is notoriously difficult to evaluate. The authors set out to critically evaluate currently available measures of acne severity, particularly in terms of suitability for use in clinical trials. Design: A systematic review was conducted to identify methods used to measure acne severity, using MEDLINE, CINAHL, Scopus, and Wiley Online. Each method was critically reviewed and given a score out of 13 based on eight quality criteria under two broad groupings of psychometric testing and suitability for research and evaluation. Results: Twenty-four methods for assessing acne severity were identified. Four scales received a quality score of zero, and 11 scored ≤3. The highest rated scales achieved a total score of 6. Six scales reported strong inter-rater reliability (ICC>0.75), and four reported strong intra-rater reliability (ICC>0.75). The poor overall performance of most scales, largely characterized by the absence of reliability testing or evidence for independent assessment and validation indicates that generally, their application in clinical trials is not supported. Conclusion: This review and appraisal of instruments for measuring acne severity supports previously identified concerns regarding the quality of published measures. It highlights the need for a valid and reliable acne severity scale, especially for use in research and evaluation. The ideal scale would demonstrate adequate validation and reliability and be easily implemented for third-party analysis. The development of such a scale is critical to interpreting results of trials and facilitating the pooling of results for systematic reviews and meta-analyses. PMID:27672410

A framework for the damage evaluation of acoustic emission signals through Hilbert-Huang transform

NASA Astrophysics Data System (ADS)

Siracusano, Giulio; Lamonaca, Francesco; Tomasello, Riccardo; Garescì, Francesca; Corte, Aurelio La; Carnì, Domenico Luca; Carpentieri, Mario; Grimaldi, Domenico; Finocchio, Giovanni

2016-06-01

The acoustic emission (AE) is a powerful and potential nondestructive testing method for structural monitoring in civil engineering. Here, we show how systematic investigation of crack phenomena based on AE data can be significantly improved by the use of advanced signal processing techniques. Such data are a fundamental source of information that can be used as the basis for evaluating the status of the material, thereby paving the way for a new frontier of innovation made by data-enabled analytics. In this article, we propose a framework based on the Hilbert-Huang Transform for the evaluation of material damages that (i) facilitates the systematic employment of both established and promising analysis criteria, and (ii) provides unsupervised tools to achieve an accurate classification of the fracture type, the discrimination between longitudinal (P-) and traversal (S-) waves related to an AE event. The experimental validation shows promising results for a reliable assessment of the health status through the monitoring of civil infrastructures.

Implant Supported Fixed Restorations versus Implant Supported Removable Overdentures: A Systematic Review

PubMed Central

Selim, Khaled; Ali, Sherif; Reda, Ahmed

2016-01-01

AIM: The aim of this study is to systematically evaluate and compare implant retained fixed restoration versus implant retained over denture. MATERIAL AND METHODS: Search was made in 2 databases including PubMed and PubMed Central. Title and abstract were screened to select studies comparing implant retained fixed restorations versus implant retained removable overdentures. Articles which did not follow the inclusion criteria were excluded. Included papers were then read carefully for a second stage filter, this was followed by manual searching of bibliography of selected articles. RESULTS: The search resulted in 5 included papers. One study evaluated the masticatory function, while the other 4 evaluated the patient satisfaction. Two of them used Visual Analogue Scale (VAS) as a measurement tool, while the other two used VAS and Categorical Scales (CAT). Stability, ability to chew, ability to clean, ability to speak and esthetics were the main outcomes of the 4 included papers. CONCLUSION: Conflicting results was observed between the fixed and removable restorations. PMID:28028423

Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review

PubMed Central

Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

2018-01-01

Introduction The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. Methods A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Results Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Discussion Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Conclusion Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families. PMID:29662521

A Targeted LC-MS/MS Method for the Simultaneous Detection and Quantitation of Egg, Milk, and Peanut Allergens in Sugar Cookies.

PubMed

Boo, Chelsea C; Parker, Christine H; Jackson, Lauren S

2018-01-01

Food allergy is a growing public health concern, with many individuals reporting allergies to multiple food sources. Compliance with food labeling regulations and prevention of inadvertent cross-contact in manufacturing requires the use of reliable methods for the detection and quantitation of allergens in processed foods. In this work, a novel liquid chromatography-tandem mass spectrometry multiple-reaction monitoring method for multiallergen detection and quantitation of egg, milk, and peanut was developed and evaluated in an allergen-incurred baked sugar cookie matrix. A systematic evaluation of method parameters, including sample extraction, concentration, and digestion, were optimized for candidate allergen peptide markers. The optimized method enabled the reliable detection and quantitation of egg, milk, and peanut allergens in sugar cookies, with allergen concentrations as low as 5 ppm allergen-incurred ingredient.

Electroencephalographic reactivity testing in unconscious patients: a systematic review of methods and definitions.

PubMed

Admiraal, M M; van Rootselaar, A-F; Horn, J

2017-02-01

Electroencephalographic (EEG) reactivity testing is often presented as a clear-cut element of electrophysiological testing. Absence of EEG reactivity is generally considered an indicator of poor outcome, especially in patients after cardiac arrest. However, guidelines do not clearly describe how to test for reactivity and how to evaluate the results. In a quest for clear guidelines, we performed a systematic review aimed at identifying testing methods and definitions of EEG reactivity. We systematically searched the literature between 1970 and May 2016. Methodological quality of the studies was assessed using the QUality In Prognostic Studies tool. Quality of the descriptions of stimulus protocol and reactivity definition was rated on a four-category grading scale based on reproducibility. We found that protocols for EEG reactivity testing vary greatly and descriptions of protocols are almost never replicable. Furthermore, replicable definitions of presence or absence of EEG reactivity are never provided. In order to draw firm conclusions on EEG reactivity as a prognostic factor, future studies should include a precise stimulation protocol and reactivity definition to facilitate guideline formation. © 2016 EAN.

Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review.

PubMed

Pace, Romina; Pluye, Pierre; Bartlett, Gillian; Macaulay, Ann C; Salsberg, Jon; Jagosh, Justin; Seller, Robbyn

2012-01-01

Systematic literature reviews identify, select, appraise, and synthesize relevant literature on a particular topic. Typically, these reviews examine primary studies based on similar methods, e.g., experimental trials. In contrast, interest in a new form of review, known as mixed studies review (MSR), which includes qualitative, quantitative, and mixed methods studies, is growing. In MSRs, reviewers appraise studies that use different methods allowing them to obtain in-depth answers to complex research questions. However, appraising the quality of studies with different methods remains challenging. To facilitate systematic MSRs, a pilot Mixed Methods Appraisal Tool (MMAT) has been developed at McGill University (a checklist and a tutorial), which can be used to concurrently appraise the methodological quality of qualitative, quantitative, and mixed methods studies. The purpose of the present study is to test the reliability and efficiency of a pilot version of the MMAT. The Center for Participatory Research at McGill conducted a systematic MSR on the benefits of Participatory Research (PR). Thirty-two PR evaluation studies were appraised by two independent reviewers using the pilot MMAT. Among these, 11 (34%) involved nurses as researchers or research partners. Appraisal time was measured to assess efficiency. Inter-rater reliability was assessed by calculating a kappa statistic based on dichotomized responses for each criterion. An appraisal score was determined for each study, which allowed the calculation of an overall intra-class correlation. On average, it took 14 min to appraise a study (excluding the initial reading of articles). Agreement between reviewers was moderate to perfect with regards to MMAT criteria, and substantial with respect to the overall quality score of appraised studies. The MMAT is unique, thus the reliability of the pilot MMAT is promising, and encourages further development. Copyright © 2011 Elsevier Ltd. All rights reserved.

Getting under the skin of the primary care consultation using video stimulated recall: a systematic review.

PubMed

Paskins, Zoe; McHugh, Gretl; Hassell, Andrew B

2014-08-30

Video stimulated recall (VSR) is a method of enhancing participants' accounts of the consultation using a video recording of the event to encourage and prompt recall in a post consultation interview. VSR is used in education and education research, and to a lesser extent in medical and nursing research. Little is known about the sort of research questions that lend themselves best to the use of VSR or the impact of the specific VSR procedure on study quality. This systematic review describes studies in primary care that have used the method and aims to identify the strengths, weaknesses and role of VSR. A systematic literature search has been conducted to identify primary care consultation research using VSR. Two authors undertook data extraction and quality appraisal of identified papers and a narrative synthesis has been conducted to draw together the findings. In addition, theory on classifying VSR procedures derived from other disciplines is used as a lens through which to assess the relevance of VSR technique. Twenty eight publications were identified that reported VSR in primary care doctor-patient consultation research. VSR was identified as a useful method to explore specific events within the consultation, mundane or routine occurrences, non-spoken events and appears to particularly add value to doctor's post consultation accounts. However, studies frequently had insufficient description of methods to properly evaluate both the quality of the study, and the influence of VSR technique on findings. VSR is particularly useful for study of specific consultation events when a 'within case' approach is used in analysis, comparing and contrasting findings from the consultation and post-consultation interview. Alignment of the choice of VSR procedure and sampling to the study research question was established as particularly important in the quality of studies. Future researchers may consider the role of process evaluation to understand further the impact of research design on data yielded and the acceptability of the method to participants.

Frequency of data extraction errors and methods to increase data extraction quality: a methodological review.

PubMed

Mathes, Tim; Klaßen, Pauline; Pieper, Dawid

2017-11-28

Our objective was to assess the frequency of data extraction errors and its potential impact on results in systematic reviews. Furthermore, we evaluated the effect of different extraction methods, reviewer characteristics and reviewer training on error rates and results. We performed a systematic review of methodological literature in PubMed, Cochrane methodological registry, and by manual searches (12/2016). Studies were selected by two reviewers independently. Data were extracted in standardized tables by one reviewer and verified by a second. The analysis included six studies; four studies on extraction error frequency, one study comparing different reviewer extraction methods and two studies comparing different reviewer characteristics. We did not find a study on reviewer training. There was a high rate of extraction errors (up to 50%). Errors often had an influence on effect estimates. Different data extraction methods and reviewer characteristics had moderate effect on extraction error rates and effect estimates. The evidence base for established standards of data extraction seems weak despite the high prevalence of extraction errors. More comparative studies are needed to get deeper insights into the influence of different extraction methods.

Methodological considerations of the GRADE method.

PubMed

Malmivaara, Antti

2015-02-01

The GRADE method (Grading of Recommendations, Assessment, Development, and Evaluation) provides a tool for rating the quality of evidence for systematic reviews and clinical guidelines. This article aims to analyse conceptually how well grounded the GRADE method is, and to suggest improvements. The eight criteria for rating the quality of evidence as proposed by GRADE are here analysed in terms of each criterion's potential to provide valid information for grading evidence. Secondly, the GRADE method of allocating weights and summarizing the values of the criteria is considered. It is concluded that three GRADE criteria have an appropriate conceptual basis to be used as indicators of confidence in research evidence in systematic reviews: internal validity of a study, consistency of the findings, and publication bias. In network meta-analyses, the indirectness of evidence may also be considered. It is here proposed that the grade for the internal validity of a study could in some instances justifiably decrease the overall grade by three grades (e.g. from high to very low) instead of the up to two grade decrease, as suggested by the GRADE method.

What is an evidence map? A systematic review of published evidence maps and their definitions, methods, and products.

PubMed

Miake-Lye, Isomi M; Hempel, Susanne; Shanman, Roberta; Shekelle, Paul G

2016-02-10

The need for systematic methods for reviewing evidence is continuously increasing. Evidence mapping is one emerging method. There are no authoritative recommendations for what constitutes an evidence map or what methods should be used, and anecdotal evidence suggests heterogeneity in both. Our objectives are to identify published evidence maps and to compare and contrast the presented definitions of evidence mapping, the domains used to classify data in evidence maps, and the form the evidence map takes. We conducted a systematic review of publications that presented results with a process termed "evidence mapping" or included a figure called an "evidence map." We identified publications from searches of ten databases through 8/21/2015, reference mining, and consulting topic experts. We abstracted the research question, the unit of analysis, the search methods and search period covered, and the country of origin. Data were narratively synthesized. Thirty-nine publications met inclusion criteria. Published evidence maps varied in their definition and the form of the evidence map. Of the 31 definitions provided, 67 % described the purpose as identification of gaps and 58 % referenced a stakeholder engagement process or user-friendly product. All evidence maps explicitly used a systematic approach to evidence synthesis. Twenty-six publications referred to a figure or table explicitly called an "evidence map," eight referred to an online database as the evidence map, and five stated they used a mapping methodology but did not present a visual depiction of the evidence. The principal conclusion of our evaluation of studies that call themselves "evidence maps" is that the implied definition of what constitutes an evidence map is a systematic search of a broad field to identify gaps in knowledge and/or future research needs that presents results in a user-friendly format, often a visual figure or graph, or a searchable database. Foundational work is needed to better standardize the methods and products of an evidence map so that researchers and policymakers will know what to expect of this new type of evidence review. Although an a priori protocol was developed, no registration was completed; this review did not fit the PROSPERO format.

Proposal For A Practical Method For Evaluating Complaints Of Eye Discomfort Arising From Clerical Work

NASA Astrophysics Data System (ADS)

Stone, Peter T.

1982-02-01

A brief review is made of the major factors that are likely to cause eye discomfort from clerical work in traditional office environments. A procedure is proposed whereby cases of complaint may be systematically investigated. Methods are suggested for making a fairly quick evaluation of the task characteristics and the lighting conditions and it is suggested that measurements of the thermal characteristics of the environment also be carried out. In order to complete the investigation, it is necessary to obtain a person's subjective responses to the environment, using a suitably prepared questionairre, and for an eye examination to be performed by an ophthalmic optician.

[Function of the present systematic evaluation in establishment of guidance for clinical practice].

PubMed

Yang, Jin-Hong; Hu, Jing; Yang, Feng-Chun; Zhang, Ning; Wang, Bing; Li, Xin

2012-07-01

Treatment of insomnia with acupuncture is taken as an example to explore the significance and problems existed in the present systematic evaluation in establishment of guidance for clinical practice. Fifteen articles on systematic evaluation of both English and Chinese were retrieved and studied carefully, their basic information was analyzed. Through study on the establishing process of the guidance of clinical practice, researches were focused on the possible significance of the articles to the guidance as well as the notes in the reuse of those articles since problem still existed. It is held that the systematic evaluation has great significance on the establishment of the guidance from the aspects of applicable people, recommended standards of diagnosis and therapeutic evaluation, extended recommendation and methodology. Great importance should also be attached to the direct application of the research result and understanding of the evaluation result. The data should be rechecked when necessary. Great guiding function can be found on the systematic evaluation of articles to the guidance. Moreover, if information needed to be taken into a full play, specific analysis should also be done on the concrete research targets.

Development of a theory- and evidence-based intervention to enhance implementation of physical therapy guidelines for the management of low back pain

PubMed Central

2014-01-01

Background Systematic planning could improve the generally moderate effectiveness of interventions to enhance adherence to clinical practice guidelines. The aim of our study was to demonstrate how the process of Intervention Mapping was used to develop an intervention to address the lack of adherence to the national CPG for low back pain by Dutch physical therapists. Methods We systematically developed a program to improve adherence to the Dutch physical therapy guidelines for low back pain. Based on multi-method formative research, we formulated program and change objectives. Selected theory-based methods of change and practical applications were combined into an intervention program. Implementation and evaluation plans were developed. Results Formative research revealed influential determinants for physical therapists and practice quality managers. Self-regulation was appropriate because both the physical therapists and the practice managers needed to monitor current practice and make and implement plans for change. The program stimulated interaction between practice levels by emphasizing collective goal setting. It combined practical applications, such as knowledge transfer and discussion-and-feedback, based on theory-based methods, such as consciousness raising and active learning. The implementation plan incorporated the wider environment. The evaluation plan included an effect and process evaluation. Conclusions Intervention Mapping is a useful framework for formative data in program planning in the field of clinical guideline implementation. However, a decision aid to select determinants of guideline adherence identified in the formative research to analyse the problem may increase the efficiency of the application of the Intervention Mapping process. PMID:24428945

Evaluation of ultrasound in assessing body composition of high school wrestlers.

PubMed

Utter, Alan C; Hager, Marion E

2008-05-01

To evaluate the accuracy of ultrasound (ULTRA) in assessing fat-free mass (FFM) in comparison with hydrostatic weighing (HW) and skinfolds (SK) in high school wrestlers in a hydrated state. Body composition was determined by ULTRA, HW, and three-site SK in 70 high school wrestlers (mean +/- SD: age, 15.5 +/- 1.5; height, 1.60 +/- 0.08 m; body mass, 65.8 +/- 12.7 kg). For all methods, body density (Db) was converted to percent body fat (%BF) using the Brozek equation. Hydration state was quantified by evaluating urine specific gravity. There were no significant differences for estimated FFM between ULTRA (57.2 +/- 9.7 kg) and HW (57.0 +/- 9.9 kg); however, SK (54.9 +/- 8.8 kg) were significantly different from HW. The standard errors of estimate for FFM with HW as the reference method were 2.40 kg for ULTRA and 2.74 kg for SK. Significant correlations were found for FFM between HW and ULTRA (r = 0.97, P < 0.001) and between HW and SK (r = 0.96, P < 0.001). A systematic bias was found for SK, as the difference between SK and HW significantly correlated with the FFM average of the two methods (r = -0.38, P < 0.001). This systematic bias was not found for ULTRA (r = - 0.07). This study demonstrates that ULTRA provides similar estimates of FFM when compared with HW in a heterogeneous high school wrestling population during a hydrated state. ULTRA should be considered as an alternative field-based method of estimating the FFM of high school wrestlers.

Participatory evaluation (I)--sharing lessons from fieldwork in Asia.

PubMed

Crishna, B

2007-05-01

There is a need to study methodologies for evaluating social development projects. Traditional methods of evaluation are often not able to capture or measure the 'spirit of change' in people, which is the very essence of human development. Using participatory methodologies is a positive way to ensure that evaluations encourage an understanding of the value of critical analysis among service providers and other stakeholders. Participatory evaluation provides a systematic process of learning through experiences. Practical experiences of conducting a number of evaluation studies in social development projects have led the author to develop four basic principles of participatory evaluation strategies. This has been further conceptualized through an extensive literature search. The article develops and shares these principles through descriptions of field experiences in Asia. The article illustrates that the role of any evaluation remains a learning process, one which promotes a climate of reflection and self-assessment. It shows how using participatory methods can create this environment of learning. However, one needs to keep in mind that participatory evaluation takes time, and that the role and calibre of the facilitator are crucial. Participatory evaluation methods have been recommended for social development projects to ensure that stakeholders remain in control of their own lives and decisions.

Model-based economic evaluations in smoking cessation and their transferability to new contexts: a systematic review.

PubMed

Berg, Marrit L; Cheung, Kei Long; Hiligsmann, Mickaël; Evers, Silvia; de Kinderen, Reina J A; Kulchaitanaroaj, Puttarin; Pokhrel, Subhash

2017-06-01

To identify different types of models used in economic evaluations of smoking cessation, analyse the quality of the included models examining their attributes and ascertain their transferability to a new context. A systematic review of the literature on the economic evaluation of smoking cessation interventions published between 1996 and April 2015, identified via Medline, EMBASE, National Health Service (NHS) Economic Evaluation Database (NHS EED), Health Technology Assessment (HTA). The checklist-based quality of the included studies and transferability scores was based on the European Network of Health Economic Evaluation Databases (EURONHEED) criteria. Studies that were not in smoking cessation, not original research, not a model-based economic evaluation, that did not consider adult population and not from a high-income country were excluded. Among the 64 economic evaluations included in the review, the state-transition Markov model was the most frequently used method (n = 30/64), with quality adjusted life years (QALY) being the most frequently used outcome measure in a life-time horizon. A small number of the included studies (13 of 64) were eligible for EURONHEED transferability checklist. The overall transferability scores ranged from 0.50 to 0.97, with an average score of 0.75. The average score per section was 0.69 (range = 0.35-0.92). The relative transferability of the studies could not be established due to a limitation present in the EURONHEED method. All existing economic evaluations in smoking cessation lack in one or more key study attributes necessary to be fully transferable to a new context. © 2017 The Authors. Addiction published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.

Economic evaluations of tobacco control mass media campaigns: a systematic review

PubMed Central

Atusingwize, Edwinah; Lewis, Sarah; Langley, Tessa

2015-01-01

Background International evidence shows that mass media campaigns are effective tobacco control interventions. However, they require substantial investment; a key question is whether their costs are justified by their benefits. The aim of this study was to systematically and comprehensively review economic evaluations of tobacco control mass media campaigns. Methods An electronic search of databases and grey literature was conducted to identify all published economic evaluations of tobacco control mass media campaigns. The authors reviewed studies independently and assessed the quality of studies using the Drummond 10-point checklist. A narrative synthesis was used to summarise the key features and quality of the identified studies. Results 10 studies met the inclusion criteria and were included in the review. All the studies included a cost effectiveness analysis, a cost utility analysis or both. The methods were highly heterogeneous, particularly in terms of the types of costs included. On the whole, studies were well conducted, but the interventions were often poorly described in terms of campaign content and intensity, and cost information was frequently inadequate. All studies concluded that tobacco control mass media campaigns are a cost effective public health intervention. Conclusions The evidence on the cost effectiveness of tobacco control mass media campaigns is limited, but of acceptable quality and consistently suggests that they offer good value for money. PMID:24985730

The process of collecting and evaluating evidences for the development of Guidelines for the management of rheumatoid arthritis, Japan College of Rheumatology 2014: Utilization of GRADE approach.

PubMed

Kojima, Masayo; Nakayama, Takeo; Kawahito, Yutaka; Kaneko, Yuko; Kishimoto, Mitsumasa; Hirata, Shintaro; Seto, Yohei; Endo, Hirahito; Ito, Hiromu; Kojima, Toshihisa; Nishida, Keiichiro; Matsushita, Isao; Tsutani, Kiichiro; Igarashi, Ataru; Kamatani, Naoyuki; Hasegawa, Mieko; Miyasaka, Nobuyuki; Yamanaka, Hisashi

2016-01-01

To describe the process of collecting and evaluating evidence for treating rheumatoid arthritis (RA) for developing clinical practice guidelines (CPGs) for rheumatologists in Japan. The task force comprised rheumatologists, epidemiologists, health economists, and patients. First, the critical outcomes were determined according to a three-round Delphi method, and eight topics with 88 clinical questions (CQs) were formulated. A systematic review of CQs was conducted using the Cochran Database of Systematic Reviews, MEDLINE, and Japana Centra Revvo Medicina (2003-2012). A questionnaire survey and focus group interview were performed to capture the patients' values and preferences. Data from the National Health Insurance drug price list and product information provided by pharmaceutical companies were collected to evaluate drug cost and safety. The GRADE approach was used to describe the evidence quality and determine the strength of recommendations. Recommendations were developed using a modified Delphi method by a multidisciplinary panel including patients. Eight meetings and frequent e-mail communications were conducted to draft a quality assessment of evidence and recommendations. For 88 CQs, recommendation statements were determined. Using the GRADE approach, new CPGs successfully addressed important clinical issues for treating RA patients. Timely updating of recommendations should be routinely considered.

The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Systematic Review of Human Evidence for PFOA Effects on Fetal Growth

PubMed Central

Sutton, Patrice; Atchley, Dylan S.; Koustas, Erica; Lam, Juleen; Sen, Saunak; Robinson, Karen A.; Axelrad, Daniel A.; Woodruff, Tracey J.

2014-01-01

Background: The Navigation Guide methodology was developed to meet the need for a robust method of systematic and transparent research synthesis in environmental health science. We conducted a case study systematic review to support proof of concept of the method. Objective: We applied the Navigation Guide systematic review methodology to determine whether developmental exposure to perfluorooctanoic acid (PFOA) affects fetal growth in humans. Methods: We applied the first 3 steps of the Navigation Guide methodology to human epidemiological data: 1) specify the study question, 2) select the evidence, and 3) rate the quality and strength of the evidence. We developed a protocol, conducted a comprehensive search of the literature, and identified relevant studies using prespecified criteria. We evaluated each study for risk of bias and conducted meta-analyses on a subset of studies. We rated quality and strength of the entire body of human evidence. Results: We identified 18 human studies that met our inclusion criteria, and 9 of these were combined through meta-analysis. Through meta-analysis, we estimated that a 1-ng/mL increase in serum or plasma PFOA was associated with a –18.9 g (95% CI: –29.8, –7.9) difference in birth weight. We concluded that the risk of bias across studies was low, and we assigned a “moderate” quality rating to the overall body of human evidence. Conclusion: On the basis of this first application of the Navigation Guide systematic review methodology, we concluded that there is “sufficient” human evidence that developmental exposure to PFOA reduces fetal growth. Citation: Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1028–1039; http://dx.doi.org/10.1289/ehp.1307893 PMID:24968388

Complementary and Alternative Medicine for Cancer Pain: An Overview of Systematic Reviews

PubMed Central

Bao, Yanju; Kong, Xiangying; Yang, Liping; Liu, Rui; Shi, Zhan; Li, Weidong; Hua, Baojin; Hou, Wei

2014-01-01

Background and Objective. Now with more and more published systematic reviews of Complementary and Alternative Medicine (CAM) on adult cancer pain, it is necessary to use the methods of overview of systematic review to summarize available evidence, appraise the evidence level, and give suggestions to future research and practice. Methods. A comprehensive search (the Cochrane Library, PubMed, Embase, and ISI Web of Knowledge) was conducted to identify all systematic reviews or meta-analyses of CAM on adult cancer pain. And the evidence levels were evaluated using GRADE approach. Results. 27 systematic reviews were included. Based on available evidence, we could find that psychoeducational interventions, music interventions, acupuncture plus drug therapy, Chinese herbal medicine plus cancer therapy, compound kushen injection, reflexology, lycopene, TENS, qigong, cupping, cannabis, Reiki, homeopathy (Traumeel), and creative arts therapies might have beneficial effects on adult cancer pain. No benefits were found for acupuncture (versus drug therapy or shame acupuncture), and the results were inconsistent for massage therapy, transcutaneous electric nerve stimulation (TENS), and Viscum album L plus cancer treatment. However, the evidence levels for these interventions were low or moderate due to high risk of bias and/or small sample size of primary studies. Conclusion. CAM may be beneficial for alleviating cancer pain, but the evidence levels were found to be low or moderate. Future large and rigor randomized controlled studies are needed to confirm the benefits of CAM on adult cancer pain. PMID:24817897

Complementary and alternative medicine for cancer pain: an overview of systematic reviews.

PubMed

Bao, Yanju; Kong, Xiangying; Yang, Liping; Liu, Rui; Shi, Zhan; Li, Weidong; Hua, Baojin; Hou, Wei

2014-01-01

Background and Objective. Now with more and more published systematic reviews of Complementary and Alternative Medicine (CAM) on adult cancer pain, it is necessary to use the methods of overview of systematic review to summarize available evidence, appraise the evidence level, and give suggestions to future research and practice. Methods. A comprehensive search (the Cochrane Library, PubMed, Embase, and ISI Web of Knowledge) was conducted to identify all systematic reviews or meta-analyses of CAM on adult cancer pain. And the evidence levels were evaluated using GRADE approach. Results. 27 systematic reviews were included. Based on available evidence, we could find that psychoeducational interventions, music interventions, acupuncture plus drug therapy, Chinese herbal medicine plus cancer therapy, compound kushen injection, reflexology, lycopene, TENS, qigong, cupping, cannabis, Reiki, homeopathy (Traumeel), and creative arts therapies might have beneficial effects on adult cancer pain. No benefits were found for acupuncture (versus drug therapy or shame acupuncture), and the results were inconsistent for massage therapy, transcutaneous electric nerve stimulation (TENS), and Viscum album L plus cancer treatment. However, the evidence levels for these interventions were low or moderate due to high risk of bias and/or small sample size of primary studies. Conclusion. CAM may be beneficial for alleviating cancer pain, but the evidence levels were found to be low or moderate. Future large and rigor randomized controlled studies are needed to confirm the benefits of CAM on adult cancer pain.

Variation, certainty, evidence, and change in dental education: employing evidence-based dentistry in dental education.

PubMed

Marinho, V C; Richards, D; Niederman, R

2001-05-01

Variation in health care, and more particularly in dental care, was recently chronicled in a Readers Digest investigative report. The conclusions of this report are consistent with sound scientific studies conducted in various areas of health care, including dental care, which demonstrate substantial variation in the care provided to patients. This variation in care parallels the certainty with which clinicians and faculty members often articulate strongly held, but very different opinions. Using a case-based dental scenario, we present systematic evidence-based methods for accessing dental health care information, evaluating this information for validity and importance, and using this information to make informed curricular and clinical decisions. We also discuss barriers inhibiting these systematic approaches to evidence-based clinical decision making and methods for effectively promoting behavior change in health care professionals.

The economics of health information technology in medication management: a systematic review of economic evaluations

PubMed Central

Tarride, Jean-Eric; Goeree, Ron; Lokker, Cynthia; McKibbon, K Ann

2011-01-01

Objective To conduct a systematic review and synthesis of the evidence surrounding the cost-effectiveness of health information technology (HIT) in the medication process. Materials and methods Peer-reviewed electronic databases and gray literature were searched to identify studies on HIT used to assist in the medication management process. Articles including an economic component were reviewed for further screening. For this review, full cost-effectiveness analyses, cost-utility analyses and cost-benefit analyses, as well as cost analyses, were eligible for inclusion and synthesis. Results The 31 studies included were heterogeneous with respect to the HIT evaluated, setting, and economic methods used. Thus the data could not be synthesized, and a narrative review was conducted. Most studies evaluated computer decision support systems in hospital settings in the USA, and only five of the studied performed full economic evaluations. Discussion Most studies merely provided cost data; however, useful economic data involves far more input. A full economic evaluation includes a full enumeration of the costs, synthesized with the outcomes of the intervention. Conclusion The quality of the economic literature in this area is poor. A few studies found that HIT may offer cost advantages despite their increased acquisition costs. However, given the uncertainty that surrounds the costs and outcomes data, and limited study designs, it is difficult to reach any definitive conclusion as to whether the additional costs and benefits represent value for money. Sophisticated concurrent prospective economic evaluations need to be conducted to address whether HIT interventions in the medication management process are cost-effective. PMID:21984590

Evaluation of the quality of the reporting of phase II clinical trials in oncology: A systematic review.

PubMed

Rivoirard, Romain; Langrand-Escure, Julien; Oriol, Mathieu; Tinquaut, Fabien; Chauvin, Franck; Rancoule, Chloé; Magné, Nicolas; Bourmaud, Aurélie

2018-05-01

To describe the current state of knowledge concerning the quality of reporting in phase II clinical trials in oncology and to describe the various methods published allowing this quality evaluation. databases including MEDLINE and COCHRANE were searched. Reviews and meta-analyses analyzing the quality of the reporting of phase II trials in oncology were included. Descriptive analysis of the results was performed. Thirteen publications were retained. Only 2 publications adopted a systematic approach of evaluation of the quality of reporting by overall scores. The Key Methodological Score (KMS), proposed by Grellety et al., gathering 3 items, seemed adapted for such an evaluation. A score of 3/3 was found in 16.1% of the 156 phase II trials analysed by this score. The other reviews used a qualitative analysis to evaluate the reporting, via an analysis of a single criterion, generally the statistical plan of the study. This item was considered as having been correctly reported in less than 50% of the analysed articles. The quality of reporting in phase II trials in oncology is a field that has been investigated very little (13 publications). When it is studied, the estimated level of quality is not satisfactory, whatever the method employed. The use of an overall score of evaluation is a path which should be pursued, in order to get reliable results. It also seems necessary to propose strong recommendations, which would create a consensus for the methodology and the reporting of these studies. Copyright © 2018 Elsevier B.V. All rights reserved.

Are there effective interventions to prevent hospital-acquired Legionnaires' disease or to reduce environmental reservoirs of Legionella in hospitals? A systematic review.

PubMed

Almeida, Dejanira; Cristovam, Elisabete; Caldeira, Daniel; Ferreira, Joaquim J; Marques, Teresa

2016-11-01

Legionnaires' disease (LD) is recognized as an important hospital-acquired disease. Despite the several methods available, the optimal method to control hospital-acquired LD is not well established and their overall efficacy requires further evaluation. To systematically review all controlled trials evaluating the efficacy of interventions to prevent hospital-acquired LD in patients at high risk of developing the disease and its effects on environmental colonization. A database search was performed through PubMed and the Cochrane Central Register of Controlled Trials (inception-November 2014). Eligible studies included all controlled studies evaluating interventions to prevent hospital-acquired LD in patients at high risk or evaluating the effect on environmental colonization. Both individual and pooled risk estimates were reported using risk ratio (RR) and 95% confidence intervals (95% CIs). There were no studies evaluating the risk reduction in hospital-acquired LD, but 4 studies evaluated the influence of copper-silver ionization and ultraviolet light in the reduction of environmental reservoirs of Legionella. The meta-analysis showed a significant 95% risk reduction of Legionella positivity in environmental samples using copper-silver ionization (RR, 0.05; 95% CI, 0.01-0.17) and 97% risk reduction with ultraviolet light (RR, 0.03; 95% CI, 0.002-0.41). The best available evidence suggests that copper-silver ionization and ultraviolet light are effective in reducing Legionella positivity in environmental samples. Nevertheless, the low quality of evidence weakens the robustness of conclusions. Copyright © 2016 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Elsevier Inc. All rights reserved.

Parameter estimation method that directly compares gravitational wave observations to numerical relativity

NASA Astrophysics Data System (ADS)

Lange, J.; O'Shaughnessy, R.; Boyle, M.; Calderón Bustillo, J.; Campanelli, M.; Chu, T.; Clark, J. A.; Demos, N.; Fong, H.; Healy, J.; Hemberger, D. A.; Hinder, I.; Jani, K.; Khamesra, B.; Kidder, L. E.; Kumar, P.; Laguna, P.; Lousto, C. O.; Lovelace, G.; Ossokine, S.; Pfeiffer, H.; Scheel, M. A.; Shoemaker, D. M.; Szilagyi, B.; Teukolsky, S.; Zlochower, Y.

2017-11-01

We present and assess a Bayesian method to interpret gravitational wave signals from binary black holes. Our method directly compares gravitational wave data to numerical relativity (NR) simulations. In this study, we present a detailed investigation of the systematic and statistical parameter estimation errors of this method. This procedure bypasses approximations used in semianalytical models for compact binary coalescence. In this work, we use the full posterior parameter distribution for only generic nonprecessing binaries, drawing inferences away from the set of NR simulations used, via interpolation of a single scalar quantity (the marginalized log likelihood, ln L ) evaluated by comparing data to nonprecessing binary black hole simulations. We also compare the data to generic simulations, and discuss the effectiveness of this procedure for generic sources. We specifically assess the impact of higher order modes, repeating our interpretation with both l ≤2 as well as l ≤3 harmonic modes. Using the l ≤3 higher modes, we gain more information from the signal and can better constrain the parameters of the gravitational wave signal. We assess and quantify several sources of systematic error that our procedure could introduce, including simulation resolution and duration; most are negligible. We show through examples that our method can recover the parameters for equal mass, zero spin, GW150914-like, and unequal mass, precessing spin sources. Our study of this new parameter estimation method demonstrates that we can quantify and understand the systematic and statistical error. This method allows us to use higher order modes from numerical relativity simulations to better constrain the black hole binary parameters.

Fluorescence-based methods for detecting caries lesions: systematic review, meta-analysis and sources of heterogeneity.

PubMed

Gimenez, Thais; Braga, Mariana Minatel; Raggio, Daniela Procida; Deery, Chris; Ricketts, David N; Mendes, Fausto Medeiros

2013-01-01

Fluorescence-based methods have been proposed to aid caries lesion detection. Summarizing and analysing findings of studies about fluorescence-based methods could clarify their real benefits. We aimed to perform a comprehensive systematic review and meta-analysis to evaluate the accuracy of fluorescence-based methods in detecting caries lesions. Two independent reviewers searched PubMed, Embase and Scopus through June 2012 to identify papers/articles published. Other sources were checked to identify non-published literature. STUDY ELIGIBILITY CRITERIA, PARTICIPANTS AND DIAGNOSTIC METHODS: The eligibility criteria were studies that: (1) have assessed the accuracy of fluorescence-based methods of detecting caries lesions on occlusal, approximal or smooth surfaces, in both primary or permanent human teeth, in the laboratory or clinical setting; (2) have used a reference standard; and (3) have reported sufficient data relating to the sample size and the accuracy of methods. A diagnostic 2×2 table was extracted from included studies to calculate the pooled sensitivity, specificity and overall accuracy parameters (Diagnostic Odds Ratio and Summary Receiver-Operating curve). The analyses were performed separately for each method and different characteristics of the studies. The quality of the studies and heterogeneity were also evaluated. Seventy five studies met the inclusion criteria from the 434 articles initially identified. The search of the grey or non-published literature did not identify any further studies. In general, the analysis demonstrated that the fluorescence-based method tend to have similar accuracy for all types of teeth, dental surfaces or settings. There was a trend of better performance of fluorescence methods in detecting more advanced caries lesions. We also observed moderate to high heterogeneity and evidenced publication bias. Fluorescence-based devices have similar overall performance; however, better accuracy in detecting more advanced caries lesions has been observed.

Touchless interaction with software in interventional radiology and surgery: a systematic literature review.

PubMed

Mewes, André; Hensen, Bennet; Wacker, Frank; Hansen, Christian

2017-02-01

In this article, we systematically examine the current state of research of systems that focus on touchless human-computer interaction in operating rooms and interventional radiology suites. We further discuss the drawbacks of current solutions and underline promising technologies for future development. A systematic literature search of scientific papers that deal with touchless control of medical software in the immediate environment of the operation room and interventional radiology suite was performed. This includes methods for touchless gesture interaction, voice control and eye tracking. Fifty-five research papers were identified and analyzed in detail including 33 journal publications. Most of the identified literature (62 %) deals with the control of medical image viewers. The others present interaction techniques for laparoscopic assistance (13 %), telerobotic assistance and operating room control (9 % each) as well as for robotic operating room assistance and intraoperative registration (3.5 % each). Only 8 systems (14.5 %) were tested in a real clinical environment, and 7 (12.7 %) were not evaluated at all. In the last 10 years, many advancements have led to robust touchless interaction approaches. However, only a few have been systematically evaluated in real operating room settings. Further research is required to cope with current limitations of touchless software interfaces in clinical environments. The main challenges for future research are the improvement and evaluation of usability and intuitiveness of touchless human-computer interaction and the full integration into productive systems as well as the reduction of necessary interaction steps and further development of hands-free interaction.

Corticosteroid Administration to Prevent Complications of Anterior Cervical Spine Fusion: A Systematic Review

PubMed Central

Zadegan, Shayan Abdollah; Jazayeri, Seyed Behnam; Abedi, Aidin; Bonaki, Hirbod Nasiri; Vaccaro, Alexander R.; Rahimi-Movaghar, Vafa

2017-01-01

Study Design: Systematic review. Objectives: Anterior cervical approach is associated with complications such as dysphagia and airway compromise. In this study, we aimed to systematically review the literature on the efficacy and safety of corticosteroid administration as a preventive measure of such complications in anterior cervical spine surgery with fusion. Methods: Following a systematic literature search of MEDLINE, Embase, and Cochrane databases in July 2016, all comparative human studies that evaluated the effect of steroids for prevention of complications in anterior cervical spine surgery with fusion were included, irrespective of number of levels and language. Risk of bias was assessed using MINORS (Methodological Index for Non-Randomized Studies) checklist and Cochrane Back and Neck group recommendations, for nonrandomized and randomized studies, respectively. Results: Our search yielded 556 articles, of which 9 studies (7 randomized controlled trials and 2 non–randomized controlled trials) were included in the final review. Dysphagia was the most commonly evaluated complication, and in most studies, its severity or incidence was significantly lower in the steroid group. Although prevertebral soft tissue swelling was less commonly assessed, the results were generally in favor of steroid use. The evidence for airway compromise and length of hospitalization was inconclusive. Steroid-related complications were rare, and in both studies that evaluated the fusion rate, it was comparable between steroid and control groups in long-term follow-up. Conclusions: Current literature supports the use of steroids for prevention of complications in anterior cervical spine surgery with fusion. However, evidence is limited by substantial risk of bias and small number of studies reporting key outcomes. PMID:29796378

Public stigma of mental illness in the United States: a systematic literature review.

PubMed

Parcesepe, Angela M; Cabassa, Leopoldo J

2013-09-01

Public stigma is a pervasive barrier that prevents many individuals in the U.S. from engaging in mental health care. This systematic literature review aims to: (1) evaluate methods used to study the public's stigma toward mental disorders, (2) summarize stigma findings focused on the public's stigmatizing beliefs and actions and attitudes toward mental health treatment for children and adults with mental illness, and (3) draw recommendations for reducing stigma towards individuals with mental disorders and advance research in this area. Public stigma of mental illness in the U.S. was widespread. Findings can inform interventions to reduce the public's stigma of mental illness.

A proposed framework for the systematic review and integrated assessment (SYRINA) of endocrine disrupting chemicals.

PubMed

Vandenberg, Laura N; Ågerstrand, Marlene; Beronius, Anna; Beausoleil, Claire; Bergman, Åke; Bero, Lisa A; Bornehag, Carl-Gustaf; Boyer, C Scott; Cooper, Glinda S; Cotgreave, Ian; Gee, David; Grandjean, Philippe; Guyton, Kathryn Z; Hass, Ulla; Heindel, Jerrold J; Jobling, Susan; Kidd, Karen A; Kortenkamp, Andreas; Macleod, Malcolm R; Martin, Olwenn V; Norinder, Ulf; Scheringer, Martin; Thayer, Kristina A; Toppari, Jorma; Whaley, Paul; Woodruff, Tracey J; Rudén, Christina

2016-07-14

The issue of endocrine disrupting chemicals (EDCs) is receiving wide attention from both the scientific and regulatory communities. Recent analyses of the EDC literature have been criticized for failing to use transparent and objective approaches to draw conclusions about the strength of evidence linking EDC exposures to adverse health or environmental outcomes. Systematic review methodologies are ideal for addressing this issue as they provide transparent and consistent approaches to study selection and evaluation. Objective methods are needed for integrating the multiple streams of evidence (epidemiology, wildlife, laboratory animal, in vitro, and in silico data) that are relevant in assessing EDCs. We have developed a framework for the systematic review and integrated assessment (SYRINA) of EDC studies. The framework was designed for use with the International Program on Chemical Safety (IPCS) and World Health Organization (WHO) definition of an EDC, which requires appraisal of evidence regarding 1) association between exposure and an adverse effect, 2) association between exposure and endocrine disrupting activity, and 3) a plausible link between the adverse effect and the endocrine disrupting activity. Building from existing methodologies for evaluating and synthesizing evidence, the SYRINA framework includes seven steps: 1) Formulate the problem; 2) Develop the review protocol; 3) Identify relevant evidence; 4) Evaluate evidence from individual studies; 5) Summarize and evaluate each stream of evidence; 6) Integrate evidence across all streams; 7) Draw conclusions, make recommendations, and evaluate uncertainties. The proposed method is tailored to the IPCS/WHO definition of an EDC but offers flexibility for use in the context of other definitions of EDCs. When using the SYRINA framework, the overall objective is to provide the evidence base needed to support decision making, including any action to avoid/minimise potential adverse effects of exposures. This framework allows for the evaluation and synthesis of evidence from multiple evidence streams. Finally, a decision regarding regulatory action is not only dependent on the strength of evidence, but also the consequences of action/inaction, e.g. limited or weak evidence may be sufficient to justify action if consequences are serious or irreversible.

Drug Utilization on Neonatal Wards: A Systematic Review of Observational Studies

PubMed Central

Rosli, Rosliana; Dali, Ahmad Fauzi; Abd Aziz, Noorizan; Abdullah, Amir Heberd; Ming, Long Chiau; Manan, Mohamed Mansor

2017-01-01

Despite limited evidence on safety and efficacy of drug use in neonates, drugs are extensively used in this age group. However, the availability of information on drug consumption in neonates, especially inpatient neonates, is limited. This paper systematically reviews published studies on drug utilization in hospitalized neonates. A systematic literature review was carried out to identify observational studies published from inception of databases used till August 2016. Four search engines, namely Medline, CINAHL, Embase, and PubMed, were used. Publications written in English that described drug utilization in neonatal wards were selected. Assessment of the data was based on the category of the study design, the objective of study and the method used in reporting drug consumption. A total of 20 drug utilization studies were identified, 12 of which focused on all drug classes, while the other eight evaluated antimicrobials. Studies were reported in Europe (n = 7), the United States (n = 6), India (n = 5), Brazil (n = 1), and Iran (n = 1). Substantial variance with regard to study types (study design and methods), data source, and sample size were found among the selected studies. Of the studies included, 45% were cross-sectional or retrospective, 40% were prospective studies, and the remaining 15% were point prevalence surveys. More than 70% of the studies were descriptive studies, describing drug consumption patterns. Fifteen per cent of the descriptive studies evaluated changes in drug utilization patterns in neonates. Volume of units was the most prevalent method used for reporting all drug categories. The ATC/DDD system for reporting drug use was only seen in studies evaluating antimicrobials. The most commonly reported drugs across all studies are anti-infectives for systemic use, followed by drugs for the cardiovascular system, the nervous system and the respiratory system. Ampicillin and gentamicin were the most prescribed antimicrobials in hospitalized neonates. The present review reveals that neonates are exposed to a high number of drugs and various methods are used to report drug consumption in this age group. The best measure of drug consumption to quantify prevalence of drug use in neonates remains to be identified and additional research in this area is warranted. PMID:28228724