Methodological issues and recommendations for systematic reviews of prognostic studies: an example from cardiovascular disease.

PubMed

Dretzke, Janine; Ensor, Joie; Bayliss, Sue; Hodgkinson, James; Lordkipanidzé, Marie; Riley, Richard D; Fitzmaurice, David; Moore, David

2014-12-03

Prognostic factors are associated with the risk of future health outcomes in individuals with a particular health condition. The prognostic ability of such factors is increasingly being assessed in both primary research and systematic reviews. Systematic review methodology in this area is continuing to evolve, reflected in variable approaches to key methodological aspects. The aim of this article was to (i) explore and compare the methodology of systematic reviews of prognostic factors undertaken for the same clinical question, (ii) to discuss implications for review findings, and (iii) to present recommendations on what might be considered to be 'good practice' approaches. The sample was comprised of eight systematic reviews addressing the same clinical question, namely whether 'aspirin resistance' (a potential prognostic factor) has prognostic utility relative to future vascular events in patients on aspirin therapy for secondary prevention. A detailed comparison of methods around study identification, study selection, quality assessment, approaches to analysis, and reporting of findings was undertaken and the implications discussed. These were summarised into key considerations that may be transferable to future systematic reviews of prognostic factors. Across systematic reviews addressing the same clinical question, there were considerable differences in the numbers of studies identified and overlap between included studies, which could only partially be explained by different study eligibility criteria. Incomplete reporting and differences in terminology within primary studies hampered study identification and selection process across reviews. Quality assessment was highly variable and only one systematic review considered a checklist for studies of prognostic questions. There was inconsistency between reviews in approaches towards analysis, synthesis, addressing heterogeneity and reporting of results. Different methodological approaches may ultimately affect the findings and interpretation of systematic reviews of prognostic research, with implications for clinical decision-making.

Use of evidence-based practice in an aid organisation: a proposal to deal with the variety in terminology and methodology.

PubMed

De Buck, Emmy; Pauwels, Nele S; Dieltjens, Tessa; Vandekerckhove, Philippe

2014-03-01

As part of its strategy Belgian Red Cross-Flanders underpins all its activities with evidence-based guidelines and systematic reviews. The aim of this publication is to describe in detail the methodology used to achieve this goal within an action-oriented organisation, in a timely and cost-effective way. To demonstrate transparency in our methods, we wrote a methodological charter describing the way in which we develop evidence-based materials to support our activities. Criteria were drawn up for deciding on project priority and the choice of different types of projects (scoping reviews, systematic reviews and evidence-based guidelines). While searching for rigorous and realistically attainable methodological standards, we encountered a wide variety in terminology and methodology used in the field of evidence-based practice. Terminologies currently being used by different organisations and institutions include systematic reviews, systematic literature searches, evidence-based guidelines, rapid reviews, pragmatic systematic reviews, and rapid response service. It is not always clear what the definition and methodology is behind these terms and whether they are used consistently. We therefore describe the terminology and methodology used by Belgian Red Cross-Flanders; criteria for making methodological choices and details on the methodology we use are given. In our search for an appropriate methodology, taking into account time and resource constraints, we encountered an enormous variety of methodological approaches and terminology used for evidence-based materials. In light of this, we recommend that authors of evidence-based guidelines and reviews are transparent and clear about the methodology used. To be transparent about our approach, we developed a methodological charter. This charter may inspire other organisations that want to use evidence-based methodology to support their activities.

Non-Surgical Interventions for Adolescents with Idiopathic Scoliosis: An Overview of Systematic Reviews

PubMed Central

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Background Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Objectives Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Design Systematic overview of systematic reviews. Methods Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute’s hierarchies were applied to analyze the levels of evidence from included reviews. Results From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Conclusions Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. Protocol registry number CRD42013003538, PROSPERO PMID:25353954

Non-surgical interventions for adolescents with idiopathic scoliosis: an overview of systematic reviews.

PubMed

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Systematic overview of systematic reviews. Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute's hierarchies were applied to analyze the levels of evidence from included reviews. From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. CRD42013003538, PROSPERO.

Systematic reviews addressing microsurgical head and neck reconstruction.

PubMed

Momeni, Arash; Jacobson, Joshua Y; Lee, Gordon K

2015-01-01

Systematic reviews frequently form the basis for clinical decision making and guideline development. Yet, the quality of systematic reviews has been variable, thus raising concerns about the validity of their conclusions. In the current study, a quality analysis of systematic reviews was performed, addressing microsurgical head and neck reconstruction. A PubMed search was performed to identify all systematic reviews published up to and including December 2012 in 12 surgical journals. Two authors independently reviewed the literature and extracted data from the included reviews. Discrepancies were resolved by consensus. Quality assessment was performed using AMSTAR. The initial search retrieved 1020 articles. After screening titles and abstracts, 987 articles were excluded. Full-text review of the remaining 33 articles resulted in further exclusion of 18 articles, leaving 15 systematic reviews for final analysis. A marked increase in the number of published systematic reviews over time was noted (P = 0.07). The median AMSTAR score was 5, thus reflecting a "fair" quality. No evidence for improvement in methodological quality over time was noted. The trend to publish more systematic reviews in microsurgical head and neck reconstruction is encouraging. However, efforts are indicated to improve the methodological quality of systematic reviews. Familiarity with criteria of methodological quality is critical to ensure future improvements in the quality of systematic reviews conducted in microsurgery.

Methological quality of systematic reviews and meta-analyses on acupuncture for stroke: A review of review.

PubMed

Chen, Xin-Lin; Mo, Chuan-Wei; Lu, Li-Ya; Gao, Ri-Yang; Xu, Qian; Wu, Min-Feng; Zhou, Qian-Yi; Hu, Yue; Zhou, Xuan; Li, Xian-Tao

2017-11-01

To assess the methodological quality of systematic reviews and meta-analyses regarding acupuncture intervention for stroke and the primary studies within them. Two researchers searched PubMed, Cumulative index to Nursing and Allied Health Literature, Embase, ISI Web of Knowledge, Cochrane, Allied and Complementary Medicine, Ovid Medline, Chinese Biomedical Literature Database, China National Knowledge Infrastructure, Wanfang and Traditional Chinese Medical Database to identify systematic reviews and meta-analyses about acupuncture for stroke published from the inception to December 2016. Review characteristics and the criteria for assessing the primary studies within reviews were extracted. The methodological quality of the reviews was assessed using adapted Oxman and Guyatt Scale. The methodological quality of primary studies was also assessed. Thirty-two eligible reviews were identified, 15 in English and 17 in Chinese. The English reviews were scored higher than the Chinese reviews (P=0.025), especially in criteria for avoiding bias and the scope of search. All reviews used the quality criteria to evaluate the methodological quality of primary studies, but some criteria were not comprehensive. The primary studies, in particular the Chinese reviews, had problems with randomization, allocation concealment, blinding, dropouts and withdrawals, intent-to-treat analysis and adverse events. Important methodological flaws were found in Chinese systematic reviews and primary studies. It was necessary to improve the methodological quality and reporting quality of both the systematic reviews published in China and primary studies on acupuncture for stroke.

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome

PubMed Central

Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety. PMID:26246841

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome.

PubMed

Lauche, Romy; Cramer, Holger; Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety.

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews

PubMed Central

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-01-01

Objective To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines—for example, in enemas, foot massage and compressing the umbilicus. Design A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. Result We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. Conclusions There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. PMID:28186925

The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature.

PubMed

Pölkki, Tarja; Kanste, Outi; Kääriäinen, Maria; Elo, Satu; Kyngäs, Helvi

2014-02-01

To analyse systematic review articles published in the top 10 nursing journals to determine the quality of the methods employed within them. Systematic review is defined as a scientific research method that synthesises high-quality scientific knowledge on a given topic. The number of such reviews in nursing science has increased dramatically during recent years, but their methodological quality has not previously been assessed. A review of the literature using a narrative approach. Ranked impact factor scores for nursing journals were obtained from the Journal Citation Report database of the Institute of Scientific Information (ISI Web of Knowledge). All issues from the years 2009 and 2010 of the top 10 ranked journals were included. CINAHL and MEDLINE databases were searched to locate studies using the search terms 'systematic review' and 'systematic literature review'. A total of 39 eligible studies were identified. Their methodological quality was evaluated through the specific criteria of quality assessment, description of synthesis and strengths and weaknesses reported in the included studies. Most of the eligible systematic reviews included several different designs or types of quantitative study. The majority included a quality assessment, and a total of 17 different criteria were identified. The method of synthesis was mentioned in about half of the reviews, the most common being narrative synthesis. The weaknesses of reviews were discussed, while strengths were rarely highlighted. The methodological quality of the systematic reviews examined varied considerably, although they were all published in nursing journals with a high-impact factor. Despite the fact that systematic reviews are considered the most robust source of research evidence, they vary in methodological quality. This point is important to consider in clinical practice when applying the results to patient care. © 2013 Blackwell Publishing Ltd.

A primer on systematic reviews in toxicology.

PubMed

Hoffmann, Sebastian; de Vries, Rob B M; Stephens, Martin L; Beck, Nancy B; Dirven, Hubert A A M; Fowle, John R; Goodman, Julie E; Hartung, Thomas; Kimber, Ian; Lalu, Manoj M; Thayer, Kristina; Whaley, Paul; Wikoff, Daniele; Tsaioun, Katya

2017-07-01

Systematic reviews, pioneered in the clinical field, provide a transparent, methodologically rigorous and reproducible means of summarizing the available evidence on a precisely framed research question. Having matured to a well-established approach in many research fields, systematic reviews are receiving increasing attention as a potential tool for answering toxicological questions. In the larger framework of evidence-based toxicology, the advantages and obstacles of, as well as the approaches for, adapting and adopting systematic reviews to toxicology are still being explored. To provide the toxicology community with a starting point for conducting or understanding systematic reviews, we herein summarized available guidance documents from various fields of application. We have elaborated on the systematic review process by breaking it down into ten steps, starting with planning the project, framing the question, and writing and publishing the protocol, and concluding with interpretation and reporting. In addition, we have identified the specific methodological challenges of toxicological questions and have summarized how these can be addressed. Ultimately, this primer is intended to stimulate scientific discussions of the identified issues to fuel the development of toxicology-specific methodology and to encourage the application of systematic review methodology to toxicological issues.

Interventional Radiology Clinical Practice Guideline Recommendations for Neurovascular Disorders Are Not Based on High-Quality Systematic Reviews.

PubMed

Chong, A B; Taylor, M; Schubert, G; Vassar, M

2017-04-01

In recent years, clinical practice guidelines have been criticized for biased interpretations of research evidence, and interventional radiology is no exception. Our aim was to evaluate the methodologic quality and transparency of reporting in systematic reviews used as evidence in interventional radiology clinical practice guidelines for neurovascular disorders from the Society of Interventional Radiology. Our sources were 9 neurovascular disorder clinical practice guidelines from the Society of Interventional Radiology. We selected 65 systematic reviews and meta-analyses. A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) tools were used to assess the methodologic quality and reporting transparency of systematic reviews. Radial plots were created on the basis of average scores for PRISMA and AMSTAR items. On the basis of AMSTAR scores, 3 (4.62%) reviews were high-quality, 28 reviews (43.08%) were moderate-quality, and 34 reviews (52.31%) were low-quality, with an average quality score of 3.66 (34.32%; minimum, 0%; maximum, 81.82%). The average PRISMA score was 18.18 (69.41%). We were unable to obtain previous versions for 8 reviews, 7 of which were from the Cochrane Database of Systematic Reviews. The methodologic quality of systematic reviews needs to be improved. Although reporting clarity was much better than the methodologic quality, it still has room for improvement. The methodologic quality and transparency of reporting did not vary much among clinical practice guidelines. This study can also be applied to other medical specialties to examine the quality of studies used as evidence in their own clinical practice guidelines. © 2017 by American Journal of Neuroradiology.

Methodological Reflections on the Use of Systematic Reviews in Early Childhood Research

ERIC Educational Resources Information Center

Ang, Lynn

2018-01-01

This article sets out to look critically at the use of systematic reviews in the cross-disciplinary field of early childhood and international development. Systematic reviews--a specialist methodology involving the secondary analysis of existing knowledge on a particular topic--is prevalently used to address complex questions in social and…

Methodological Quality of Systematic Reviews Published in the Urological Literature from 1998 to 2012.

PubMed

Corbyons, Katherine; Han, Julia; Neuberger, Molly M; Dahm, Philipp

2015-11-01

Systematic reviews synthesize the current best evidence to address a clinical question. Given the growing emphasis on evidence-based clinical practice, systematic reviews are being increasingly sought after and published. We previously reported limitations in the methodological quality of 57 individual systematic reviews published from 1998 to 2008. We provide an update to our previous study, adding systematic reviews published from 2009 to 2012. We systematically searched PubMed® and hand searched the table of contents of 4 major urological journals to identify systematic reviews related to questions of prevention and therapy. Two independent reviewers with prior formal evidence-based medicine training assessed the methodological quality using the validated 11-point AMSTAR (A Measurement Tool to Assess Systematic Reviews) instrument. We performed predefined statistical hypothesis testing for differences by publication period (1998 to 2008 vs 2009 to 2012) and journal of publication. We performed statistical testing using SPSS®, version 23.0 with a 2-sided α of 0.05 using the Student t-test, ANOVA and the chi-square test. A total of 113 systematic reviews published from 2009 to 2012 met study inclusion criteria. The most common topics were oncology (44 reviews or 38.9%), voiding dysfunction (26 or 23.0%) and stones/endourology (13 or 11.5%). The largest contributor was European Urology (46 reviews or 40.7%), followed by BJU International (31 or 27.4%) and The Journal of Urology® (22 or 19.5%). The mean ± SD AMSTAR score for the 2009 to 2012 period was 5.3 ± 2.3 compared to 4.8 ± 2.0 for 1998 to 2008 with a mean difference of 0.5 (95% CI 0.2 to 1.2, p = 0.133). While the number of systematic reviews published in the urological literature has increased substantially, the methodological quality of these studies remains suboptimal. Systematic review authors and editors should make every effort to adhere to well established methodological standards to enhance the impact of their research efforts. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews.

PubMed

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-11-14

To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines-for example, in enemas, foot massage and compressing the umbilicus. A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Eligibility criteria in systematic reviews published in prominent medical journals: a methodological review.

PubMed

McCrae, Niall; Purssell, Edward

2015-12-01

Clear and logical eligibility criteria are fundamental to the design and conduct of a systematic review. This methodological review examined the quality of reporting and application of eligibility criteria in systematic reviews published in three leading medical journals. All systematic reviews in the BMJ, JAMA and The Lancet in the years 2013 and 2014 were extracted. These were assessed using a refined version of a checklist previously designed by the authors. A total of 113 papers were eligible, of which 65 were in BMJ, 17 in The Lancet and 31 in JAMA. Although a generally high level of reporting was found, eligibility criteria were often problematic. In 67% of papers, eligibility was specified after the search sources or terms. Unjustified time restrictions were used in 21% of reviews, and unpublished or unspecified data in 27%. Inconsistency between journals was apparent in the requirements for systematic reviews. The quality of reviews in these leading medical journals was high; however, there were issues that reduce the clarity and replicability of the review process. As well as providing a useful checklist, this methodological review informs the continued development of standards for systematic reviews. © 2015 John Wiley & Sons, Ltd.

Methodological quality of systematic reviews referenced in clinical practice guidelines for the treatment of opioid use disorder.

PubMed

Ross, Andrew; Rankin, Justin; Beaman, Jason; Murray, Kelly; Sinnett, Philip; Riddle, Ross; Haskins, Jordan; Vassar, Matt

2017-01-01

With efforts to combat opioid use disorder, there is an increased interest in clinical practice guidelines (CPGs) for opioid use disorder treatments. No literature exists examining the quality of systematic reviews used in opioid use disorder CPGs. This study aims to describe the methodological quality and reporting clarity of systematic reviews (SRs) used to create CPGs for opioid use disorder. From June to July 2016 guideline clearinghouses and medical literature databases were searched for relevant CPGs used in the treatment of opioid use disorder. Included CPGs must have been recognized by a national organization. SRs from the reference section of each CPG was scored by using AMSTAR (a measurement tool to assess the methodological quality of systematic reviews) tool and PRISMA (preferred reporting items for systematic reviews and meta-analyses) checklist. Seventeen CPGs from 2006-2016 were included in the review. From these, 57 unique SRs were extracted. SRS comprised 0.28% to 17.92% of all references found in the CPGs. All SRs obtained moderate or high methodological quality score on the AMSTAR tool. All reviews met at least 70% of PRISMA criteria. In PRISMA, underperforming areas included accurate title labeling, protocol registration, and risk of bias. Underperforming areas in AMSTAR included conflicts of interest, funding, and publication bias. A positive correlation was found between AMSTAR and PRISMA scores (r = .79). Although the SRs in the CPGs were of good quality, there are still areas for improvement. Systematic reviewers should consult PRISMA and AMSTAR when conducting and reporting reviews. It is important for CPG developers to consider methodological quality as a factor when developing CPG recommendations, recognizing that the quality of systematic reviews underpinning guidelines does not necessarily correspond to the quality of the guideline itself.

Cognitive remediation in schizophrenia: A methodological appraisal of systematic reviews and meta-analyses.

PubMed

Bryce, Shayden; Sloan, Elise; Lee, Stuart; Ponsford, Jennie; Rossell, Susan

2016-04-01

Systematic reviews and meta-analyses are a primary source of evidence when evaluating the benefit(s) of cognitive remediation (CR) in schizophrenia. These studies are designed to rigorously synthesize scientific literature; however, cannot be assumed to be of high methodological quality. The aims of this report were to: 1) review the use of systematic reviews and meta-analyses regarding CR in schizophrenia; 2) conduct a systematic methodological appraisal of published reports examining the benefits of this intervention on core outcome domains; and 3) compare the correspondence between methodological and reporting quality. Electronic databases were searched for relevant articles. Twenty-one reviews met inclusion criteria and were scored according to the AMSTAR checklist-a validated scale of methodological quality. Five meta-analyses were also scored according to PRISMA statement to compare 'quality of conduct' with 'quality of reporting'. Most systematic reviews and meta-analyses shared strengths and fell within a 'medium' level of methodological quality. Nevertheless, there were consistent areas of potential weakness that were not addressed by most reviews. These included the lack of protocol registration, uncertainty regarding independent data extraction and consensus procedures, and the minimal assessment of publication bias. Moreover, quality of conduct may not necessarily parallel quality of reporting, suggesting that consideration of these methods independently may be important. Reviews concerning CR for schizophrenia are a valuable source of evidence. However, the methodological quality of these reports may require additional consideration. Enhancing quality of conduct is essential for enabling research literature to be interpreted with confidence. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews.

PubMed

Mayo-Wilson, Evan; Ng, Sueko Matsumura; Chuck, Roy S; Li, Tianjing

2017-09-05

Systematic reviews should inform American Academy of Ophthalmology (AAO) Preferred Practice Pattern® (PPP) guidelines. The quality of systematic reviews related to the forthcoming Preferred Practice Pattern® guideline (PPP) Refractive Errors & Refractive Surgery is unknown. We sought to identify reliable systematic reviews to assist the AAO Refractive Errors & Refractive Surgery PPP. Systematic reviews were eligible if they evaluated the effectiveness or safety of interventions included in the 2012 PPP Refractive Errors & Refractive Surgery. To identify potentially eligible systematic reviews, we searched the Cochrane Eyes and Vision United States Satellite database of systematic reviews. Two authors identified eligible reviews and abstracted information about the characteristics and quality of the reviews independently using the Systematic Review Data Repository. We classified systematic reviews as "reliable" when they (1) defined criteria for the selection of studies, (2) conducted comprehensive literature searches for eligible studies, (3) assessed the methodological quality (risk of bias) of the included studies, (4) used appropriate methods for meta-analyses (which we assessed only when meta-analyses were reported), (5) presented conclusions that were supported by the evidence provided in the review. We identified 124 systematic reviews related to refractive error; 39 met our eligibility criteria, of which we classified 11 to be reliable. Systematic reviews classified as unreliable did not define the criteria for selecting studies (5; 13%), did not assess methodological rigor (10; 26%), did not conduct comprehensive searches (17; 44%), or used inappropriate quantitative methods (3; 8%). The 11 reliable reviews were published between 2002 and 2016. They included 0 to 23 studies (median = 9) and analyzed 0 to 4696 participants (median = 666). Seven reliable reviews (64%) assessed surgical interventions. Most systematic reviews of interventions for refractive error are low methodological quality. Following widely accepted guidance, such as Cochrane or Institute of Medicine standards for conducting systematic reviews, would contribute to improved patient care and inform future research.

Oral Chinese proprietary medicine for angina pectoris: an overview of systematic reviews/meta-analyses.

PubMed

Luo, Jing; Xu, Hao; Yang, Guoyan; Qiu, Yu; Liu, Jianping; Chen, Keji

2014-08-01

Oral Chinese proprietary medicine (CPM) is commonly used to treat angina pectoris, and many relevant systematic reviews/meta-analyses are available. However, these reviews have not been systematically summarized and evaluated. We conducted an overview of these reviews, and explored their methodological and reporting quality to inform both practice and further research. We included systematic reviews/meta-analyses on oral CPM in treating angina until March 2013 by searching PubMed, Embase, the Cochrane Library and four Chinese databases. We extracted data according to a pre-designed form, and assessed the methodological and reporting characteristics of the reviews in terms of AMSTAR and PRISMA respectively. Most of the data analyses were descriptive. 36 systematic reviews/meta-analyses involving over 82,105 participants with angina reviewing 13 kinds of oral CPM were included. The main outcomes assessed in the reviews were surrogate outcomes (34/36, 94.4%), adverse events (31/36, 86.1%), and symptoms (30/36, 83.3%). Six reviews (6/36, 16.7%) drew definitely positive conclusions, while the others suggested potential benefits in the symptoms, electrocardiogram, and adverse events. The overall methodological and reporting quality of the reviews was limited, with many serious flaws such as the lack of review protocol and incomprehensive literature searches. Though many systematic reviews/meta-analyses on oral CPM for angina suggested potential benefits or definitely positive effects, stakeholders should interpret the findings of these reviews with caution, considering the overall limited methodological and reporting quality. We recommend further studies should be appropriately conducted and systematic reviews reported according to PRISMA standard. Copyright © 2014 Elsevier Ltd. All rights reserved.

Environmental and Sustainability Education Policy Research: A Systematic Review of Methodological and Thematic Trends

ERIC Educational Resources Information Center

Aikens, Kathleen; McKenzie, Marcia; Vaughter, Philip

2016-01-01

This paper reports on a systematic literature review of policy research in the area of environmental and sustainability education. We analyzed 215 research articles, spanning four decades and representing 71 countries, and which engaged a range of methodologies. Our analysis combines quantification of geographic and methodological trends with…

Abstract analysis method facilitates filtering low-methodological quality and high-bias risk systematic reviews on psoriasis interventions.

PubMed

Gómez-García, Francisco; Ruano, Juan; Aguilar-Luque, Macarena; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesús; Hernández-Romero, José Luis; Sanz-Cabanillas, Juan Luis; Maestre-López, Beatriz; González-Padilla, Marcelino; Carmona-Fernández, Pedro J; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-29

Article summaries' information and structure may influence researchers/clinicians' decisions to conduct deeper full-text analyses. Specifically, abstracts of systematic reviews (SRs) and meta-analyses (MA) should provide structured summaries for quick assessment. This study explored a method for determining the methodological quality and bias risk of full-text reviews using abstract information alone. Systematic literature searches for SRs and/or MA about psoriasis were undertaken on MEDLINE, EMBASE, and Cochrane database. For each review, quality, abstract-reporting completeness, full-text methodological quality, and bias risk were evaluated using Preferred Reporting Items for Systematic Reviews and Meta-analyses for abstracts (PRISMA-A), Assessing the Methodological Quality of Systematic Reviews (AMSTAR), and ROBIS tools, respectively. Article-, author-, and journal-derived metadata were systematically extracted from eligible studies using a piloted template, and explanatory variables concerning abstract-reporting quality were assessed using univariate and multivariate-regression models. Two classification models concerning SRs' methodological quality and bias risk were developed based on per-item and total PRISMA-A scores and decision-tree algorithms. This work was supported, in part, by project ICI1400136 (JR). No funding was received from any pharmaceutical company. This study analysed 139 SRs on psoriasis interventions. On average, they featured 56.7% of PRISMA-A items. The mean total PRISMA-A score was significantly higher for high-methodological-quality SRs than for moderate- and low-methodological-quality reviews. SRs with low-bias risk showed higher total PRISMA-A values than reviews with high-bias risk. In the final model, only 'authors per review > 6' (OR: 1.098; 95%CI: 1.012-1.194), 'academic source of funding' (OR: 3.630; 95%CI: 1.788-7.542), and 'PRISMA-endorsed journal' (OR: 4.370; 95%CI: 1.785-10.98) predicted PRISMA-A variability. Reviews with a total PRISMA-A score < 6, lacking identification as SR or MA in the title, and lacking explanation concerning bias risk assessment methods were classified as low-methodological quality. Abstracts with a total PRISMA-A score ≥ 9, including main outcomes results and explanation bias risk assessment method were classified as having low-bias risk. The methodological quality and bias risk of SRs may be determined by abstract's quality and completeness analyses. Our proposal aimed to facilitate synthesis of evidence evaluation by clinical professionals lacking methodological skills. External validation is necessary.

Single-Case Experimental Designs: A Systematic Review of Published Research and Current Standards

ERIC Educational Resources Information Center

Smith, Justin D.

2012-01-01

This article systematically reviews the research design and methodological characteristics of single-case experimental design (SCED) research published in peer-reviewed journals between 2000 and 2010. SCEDs provide researchers with a flexible and viable alternative to group designs with large sample sizes. However, methodological challenges have…

Critical appraisal of systematic reviews on the effect of a history of periodontitis on dental implant loss.

PubMed

Faggion, Clovis Mariano; Giannakopoulos, Nikolaos Nikitas

2013-05-01

To perform a systematic critical appraisal of the methodological quality of systematic reviews on the effect of a history of periodontitis on dental implant loss. PubMed, the Cochrane database for systematic reviews, the DARE, Biosis Preview, CINAHL, Web of Science, and LILACS electronic databases were searched on 16th June 2012, independently and in duplicate, for systematic reviews and meta-analyses related to dental implants for patients with and without a history of periodontitis. Manual searching of the reference lists of included papers was also conducted. The methodological quality of these systematic reviews was assessed by use of the AMSTAR and R-AMSTAR checklists. Before quality assessment was initiated, the reviewers were calibrated until they achieved excellent agreement. Sixty-eight papers were initially retrieved. Of these, nine systematic reviews and three meta-analyses were included. Some domains, for example, "characteristics of the included studies" were satisfied in both checklists. In contrast, domains such as "comprehensive literature search" and "assessment of likelihood of publication bias" were rarely met. Much methodological variability was encountered in the selected reviews. To furnish readers with a more comprehensive assessment of the evidence, authors should observe higher standards when conducting and reporting their reviews. © 2013 John Wiley & Sons A/S.

Checklists of Methodological Issues for Review Authors to Consider When Including Non-Randomized Studies in Systematic Reviews

ERIC Educational Resources Information Center

Wells, George A.; Shea, Beverley; Higgins, Julian P. T.; Sterne, Jonathan; Tugwell, Peter; Reeves, Barnaby C.

2013-01-01

Background: There is increasing interest from review authors about including non-randomized studies (NRS) in their systematic reviews of health care interventions. This series from the Ottawa Non-Randomized Studies Workshop consists of six papers identifying methodological issues when doing this. Aim: To format the guidance from the preceding…

Methodologic quality of meta-analyses and systematic reviews on the Mediterranean diet and cardiovascular disease outcomes: a review.

PubMed

Huedo-Medina, Tania B; Garcia, Marissa; Bihuniak, Jessica D; Kenny, Anne; Kerstetter, Jane

2016-03-01

Several systematic reviews/meta-analyses published within the past 10 y have examined the associations of Mediterranean-style diets (MedSDs) on cardiovascular disease (CVD) risk. However, these reviews have not been evaluated for satisfying contemporary methodologic quality standards. This study evaluated the quality of recent systematic reviews/meta-analyses on MedSD and CVD risk outcomes by using an established methodologic quality scale. The relation between review quality and impact per publication value of the journal in which the article had been published was also evaluated. To assess compliance with current standards, we applied a modified version of the Assessment of Multiple Systematic Reviews (AMSTARMedSD) quality scale to systematic reviews/meta-analyses retrieved from electronic databases that had met our selection criteria: 1) used systematic or meta-analytic procedures to review the literature, 2) examined MedSD trials, and 3) had MedSD interventions independently or combined with other interventions. Reviews completely satisfied from 8% to 75% of the AMSTARMedSD items (mean ± SD: 31.2% ± 19.4%), with those published in higher-impact journals having greater quality scores. At a minimum, 60% of the 24 reviews did not disclose full search details or apply appropriate statistical methods to combine study findings. Only 5 of the reviews included participant or study characteristics in their analyses, and none evaluated MedSD diet characteristics. These data suggest that current meta-analyses/systematic reviews evaluating the effect of MedSD on CVD risk do not fully comply with contemporary methodologic quality standards. As a result, there are more research questions to answer to enhance our understanding of how MedSD affects CVD risk or how these effects may be modified by the participant or MedSD characteristics. To clarify the associations between MedSD and CVD risk, future meta-analyses and systematic reviews should not only follow methodologic quality standards but also include more statistical modeling results when data allow. © 2016 American Society for Nutrition.

Chinese herbal medicine for the treatment of primary hypertension: a methodology overview of systematic reviews.

PubMed

Xinke, Zhao; Yingdong, Li; Mingxia, Feng; Kai, Liu; Kaibing, Chen; Yuqing, Lu; Shaobo, Sun; Peng, Song; Bin, Liu

2016-10-20

Chinese herbal medicine has been used to treat hypertension in China and East Asia since centuries. In this study, we conduct an overview of systematic reviews of Chinese herbal medicine in the treatment of primary hypertension to 1) summarize the conclusions of these reviews, 2) evaluate the methodological quality of these reviews, and 3) rate the confidence in the effect on each outcome. We comprehensively searched six databases to retrieve systematic reviews of Chinese herbal medicine for primary hypertension from inception to December 31, 2015. We used AMSTAR to evaluate the methodological quality of included reviews, and we classified the quality of evidence for each outcome in included reviews using the GRADE approach. A total of 12 systematic reviews with 31 outcomes were included, among which 11 systematic reviews focus on the therapeutic effect of Chinese herbal medicine combined with conventional medicine or simple Chinese herbal medicine versus simple conventional medicine. Among the 11 items of AMSTAR, the lowest quality was "providing a priori design" item, none review conformed to this item, the next was "stating the conflict of interest" item, only three reviews conformed to this item. Five reviews scored less than seven in AMSTAR, which means that the overall methodological quality was fairly poor. For GRADE, of the 31 outcomes, the quality of evidence was high in none (0 %), moderate in three (10 %), low in 19 (61 %), and very low in nine (29 %). Of the five downgrading factors, risk of bias (100 %) was the most common downgrading factor in the included reviews, followed by imprecision (42 %), inconsistency (39 %), publication bias (39 %), and indirectness (0 %). The methodological quality of systematic reviews about Chinese herbal medicine for primary hypertension is fairly poor, and the quality of evidence level is low. Physicians should be cautious when applying the interventions in these reviews for primary hypertension patients in clinical practice.

Most systematic reviews of high methodological quality on psoriasis interventions are classified as high risk of bias using ROBIS tool.

PubMed

Gómez-García, Francisco; Ruano, Juan; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Sanz-Cabanillas, Juan Luis; Alcalde-Mellado, Patricia; Maestre-López, Beatriz; Carmona-Fernández, Pedro Jesús; González-Padilla, Marcelino; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-01

No gold standard exists to assess methodological quality of systematic reviews (SRs). Although Assessing the Methodological Quality of Systematic Reviews (AMSTAR) is widely accepted for analyzing quality, the ROBIS instrument has recently been developed. This study aimed to compare the capacity of both instruments to capture the quality of SRs concerning psoriasis interventions. Systematic literature searches were undertaken on relevant databases. For each review, methodological quality and bias risk were evaluated using the AMSTAR and ROBIS tools. Descriptive and principal component analyses were conducted to describe similarities and discrepancies between both assessment tools. We classified 139 intervention SRs as displaying high/moderate/low methodological quality and as high/low risk of bias. A high risk of bias was detected for most SRs classified as displaying high or moderate methodological quality by AMSTAR. When comparing ROBIS result profiles, responses to domain 4 signaling questions showed the greatest differences between bias risk assessments, whereas domain 2 items showed the least. When considering SRs published about psoriasis, methodological quality remains suboptimal, and the risk of bias is elevated, even for SRs exhibiting high methodological quality. Furthermore, the AMSTAR and ROBIS tools may be considered as complementary when conducting quality assessment of SRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Clinical information modeling processes for semantic interoperability of electronic health records: systematic review and inductive analysis.

PubMed

Moreno-Conde, Alberto; Moner, David; Cruz, Wellington Dimas da; Santos, Marcelo R; Maldonado, José Alberto; Robles, Montserrat; Kalra, Dipak

2015-07-01

This systematic review aims to identify and compare the existing processes and methodologies that have been published in the literature for defining clinical information models (CIMs) that support the semantic interoperability of electronic health record (EHR) systems. Following the preferred reporting items for systematic reviews and meta-analyses systematic review methodology, the authors reviewed published papers between 2000 and 2013 that covered that semantic interoperability of EHRs, found by searching the PubMed, IEEE Xplore, and ScienceDirect databases. Additionally, after selection of a final group of articles, an inductive content analysis was done to summarize the steps and methodologies followed in order to build CIMs described in those articles. Three hundred and seventy-eight articles were screened and thirty six were selected for full review. The articles selected for full review were analyzed to extract relevant information for the analysis and characterized according to the steps the authors had followed for clinical information modeling. Most of the reviewed papers lack a detailed description of the modeling methodologies used to create CIMs. A representative example is the lack of description related to the definition of terminology bindings and the publication of the generated models. However, this systematic review confirms that most clinical information modeling activities follow very similar steps for the definition of CIMs. Having a robust and shared methodology could improve their correctness, reliability, and quality. Independently of implementation technologies and standards, it is possible to find common patterns in methods for developing CIMs, suggesting the viability of defining a unified good practice methodology to be used by any clinical information modeler. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina.

PubMed

Zhang, Xiaoxia; Wang, Hui; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina

PubMed Central

Zhang, Xiaoxia; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved. PMID:26539221

The role of pragmatism in explaining heterogeneity in meta-analyses of randomised trials: a protocol for a cross-sectional methodological review.

PubMed

Aves, Theresa; Allan, Katherine S; Lawson, Daeria; Nieuwlaat, Robby; Beyene, Joseph; Mbuagbaw, Lawrence

2017-09-03

There has been increasing interest in pragmatic trials methodology. As a result, tools such as the Pragmatic-Explanatory Continuum Indicator Summary-2 (PRECIS-2) are being used prospectively to help researchers design randomised controlled trials (RCTs) within the pragmatic-explanatory continuum. There may be value in applying the PRECIS-2 tool retrospectively in a systematic review setting as it could provide important information about how to pool data based on the degree of pragmatism. To investigate the role of pragmatism as a source of heterogeneity in systematic reviews by (1) identifying systematic reviews with meta-analyses of RCTs that have moderate to high heterogeneity, (2) applying PRECIS-2 to RCTs of systematic reviews, (3) evaluating the inter-rater reliability of PRECIS-2, (4) determining how much of this heterogeneity may be explained by pragmatism. A cross-sectional methodological review will be conducted on systematic reviews of RCTs published in the Cochrane Library from 1 January 2014 to 1 January 2017. Included systematic reviews will have a minimum of 10 RCTs in the meta-analysis of the primary outcome and moderate to substantial heterogeneity (I 2 ≥50%). Of the eligible systematic reviews, a random selection of 10 will be included for quantitative evaluation. In each systematic review, RCTs will be scored using the PRECIS-2 tool, in duplicate. Agreement between raters will be measured using the intraclass correlation coefficient. Subgroup analyses and meta-regression will be used to evaluate how much variability in the primary outcome may be due to pragmatism. This review will be among the first to evaluate the PRECIS-2 tool in a systematic review setting. Results from this research will provide inter-rater reliability information about PRECIS-2 and may be used to provide methodological guidance when dealing with pragmatism in systematic reviews and subgroup considerations. On completion, this review will be submitted to a peer-reviewed journal for publication. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Risk of bias in overviews of reviews: a scoping review of methodological guidance and four-item checklist.

PubMed

Ballard, Madeleine; Montgomery, Paul

2017-03-01

To assess the conditions under which employing an overview of systematic reviews is likely to lead to a high risk of bias. To synthesise existing guidance concerning overview practice, a scoping review was conducted. Four electronic databases were searched with a pre-specified strategy (PROSPERO 2015:CRD42015027592) ending October 2015. Included studies needed to describe or develop overview methodology. Data were narratively synthesised to delineate areas highlighted as outstanding challenges or where methodological recommendations conflict. Twenty-four papers met the inclusion criteria. There is emerging debate regarding overlapping systematic reviews; systematic review scope; quality of included research; updating; and synthesizing and reporting results. While three functions for overviews have been proposed-identify gaps, explore heterogeneity, summarize evidence-overviews cannot perform the first; are unlikely to achieve the second and third simultaneously; and can only perform the third under specific circumstances. Namely, when identified systematic reviews meet the following four conditions: (1) include primary trials that do not substantially overlap, (2) match overview scope, (3) are of high methodological quality, and (4) are up-to-date. Considering the intended function of proposed overviews with the corresponding methodological conditions may improve the quality of this burgeoning publication type. Copyright © 2017 John Wiley & Sons, Ltd. Copyright © 2017 John Wiley & Sons, Ltd.

Do systematic reviews on pediatric topics need special methodological considerations?

PubMed

Farid-Kapadia, Mufiza; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2017-03-06

Systematic reviews are key tools to enable decision making by healthcare providers and policymakers. Despite the availability of the evidence based Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA-2009 and PRISMA-P 2015) statements that were developed to improve the transparency and quality of reporting of systematic reviews, uncertainty on how to deal with pediatric-specific methodological challenges of systematic reviews impairs decision-making in child health. In this paper, we identify methodological challenges specific to the design, conduct and reporting of pediatric systematic reviews, and propose a process to address these challenges. One fundamental decision at the outset of a systematic review is whether to focus on a pediatric population only, or to include both adult and pediatric populations. Both from the policy and patient care point of view, the appropriateness of interventions and comparators administered to pre-defined pediatric age subgroup is critical. Decisions need to be based on the biological plausibility of differences in treatment effects across the developmental trajectory in children. Synthesis of evidence from different trials is often impaired by the use of outcomes and measurement instruments that differ between trials and are neither relevant nor validated in the pediatric population. Other issues specific to pediatric systematic reviews include lack of pediatric-sensitive search strategies and inconsistent choices of pediatric age subgroups in meta-analyses. In addition to these methodological issues generic to all pediatric systematic reviews, special considerations are required for reviews of health care interventions' safety and efficacy in neonatology, global health, comparative effectiveness interventions and individual participant data meta-analyses. To date, there is no standard approach available to overcome this problem. We propose to develop a consensus-based checklist of essential items which researchers should consider when they are planning (PRISMA-PC-Protocol for Children) or reporting (PRISMA-C-reporting for Children) a pediatric systematic review. Available guidelines including PRISMA do not cover the complexity associated with the conduct and reporting of systematic reviews in the pediatric population; they require additional and modified standards for reporting items. Such guidance will facilitate the translation of knowledge from the literature to bedside care and policy, thereby enhancing delivery of care and improving child health outcomes.

Systematic reviews of health economic evaluations: a protocol for a systematic review of characteristics and methods applied.

PubMed

Luhnen, Miriam; Prediger, Barbara; Neugebauer, Edmund A M; Mathes, Tim

2017-12-02

The number of systematic reviews of economic evaluations is steadily increasing. This is probably related to the continuing pressure on health budgets worldwide which makes an efficient resource allocation increasingly crucial. In particular in recent years, the introduction of several high-cost interventions presents enormous challenges regarding universal accessibility and sustainability of health care systems. An increasing number of health authorities, inter alia, feel the need for analyzing economic evidence. Economic evidence might effectively be generated by means of systematic reviews. Nevertheless, no standard methods seem to exist for their preparation so far. The objective of this study was to analyze the methods applied for systematic reviews of health economic evaluations (SR-HE) with a focus on the identification of common challenges. The planned study is a systematic review of the characteristics and methods actually applied in SR-HE. We will combine validated search filters developed for the retrieval of economic evaluations and systematic reviews to identify relevant studies in MEDLINE (via Ovid, 2015-present). To be eligible for inclusion, studies have to conduct a systematic review of full economic evaluations. Articles focusing exclusively on methodological aspects and secondary publications of health technology assessment (HTA) reports will be excluded. Two reviewers will independently assess titles and abstracts and then full-texts of studies for eligibility. Methodological features will be extracted in a standardized, beforehand piloted data extraction form. Data will be summarized with descriptive statistical measures and systematically analyzed focusing on differences/similarities and methodological weaknesses. The systematic review will provide a detailed overview of characteristics of SR-HE and the applied methods. Differences and methodological shortcomings will be detected and their implications will be discussed. The findings of our study can improve the recommendations on the preparation of SR-HE. This can increase the acceptance and usefulness of systematic reviews in health economics for researchers and medical decision makers. The review will not be registered with PROSPERO as it does not meet the eligibility criterion of dealing with clinical outcomes.

Reporting and Handling Missing Outcome Data in Mental Health: A Systematic Review of Cochrane Systematic Reviews and Meta-Analyses

ERIC Educational Resources Information Center

Spineli, Loukia M.; Pandis, Nikolaos; Salanti, Georgia

2015-01-01

Objectives: The purpose of the study was to provide empirical evidence about the reporting of methodology to address missing outcome data and the acknowledgement of their impact in Cochrane systematic reviews in the mental health field. Methods: Systematic reviews published in the Cochrane Database of Systematic Reviews after January 1, 2009 by…

What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Barreto, Jorge; Reveiz, Ludovic; Lavis, John N

2016-11-25

Rapid reviews have the potential to overcome a key barrier to the use of research evidence in decision making, namely that of the lack of timely and relevant research. This rapid review of systematic reviews and primary studies sought to answer the question: What are the best methodologies to enable a rapid review of research evidence for evidence-informed decision making in health policy and practice? This rapid review utilised systematic review methods and was conducted according to a pre-defined protocol including clear inclusion criteria (PROSPERO registration: CRD42015015998). A comprehensive search strategy was used, including published and grey literature, written in English, French, Portuguese or Spanish, from 2004 onwards. Eleven databases and two websites were searched. Two review authors independently applied the eligibility criteria. Data extraction was done by one reviewer and checked by a second. The methodological quality of included studies was assessed independently by two reviewers. A narrative summary of the results is presented. Five systematic reviews and one randomised controlled trial (RCT) that investigated methodologies for rapid reviews met the inclusion criteria. None of the systematic reviews were of sufficient quality to allow firm conclusions to be made. Thus, the findings need to be treated with caution. There is no agreed definition of rapid reviews in the literature and no agreed methodology for conducting rapid reviews. While a wide range of 'shortcuts' are used to make rapid reviews faster than a full systematic review, the included studies found little empirical evidence of their impact on the conclusions of either rapid or systematic reviews. There is some evidence from the included RCT (that had a low risk of bias) that rapid reviews may improve clarity and accessibility of research evidence for decision makers. Greater care needs to be taken in improving the transparency of the methods used in rapid review products. There is no evidence available to suggest that rapid reviews should not be done or that they are misleading in any way. We offer an improved definition of rapid reviews to guide future research as well as clearer guidance for policy and practice.

A Conceptual Framework for Systematic Reviews of Research in Educational Leadership and Management

ERIC Educational Resources Information Center

Hallinger, Philip

2013-01-01

Purpose: The purpose of this paper is to present a framework for scholars carrying out reviews of research that meet international standards for publication. Design/methodology/approach: This is primarily a conceptual paper focusing on the methodology of conducting systematic reviews of research. However, the paper draws on a database of reviews…

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Reviewing methodologically disparate data: a practical guide for the patient safety research field.

PubMed

Brown, Katrina F; Long, Susannah J; Athanasiou, Thanos; Vincent, Charles A; Kroll, J Simon; Sevdalis, Nick

2012-02-01

This article addresses key questions frequently asked by researchers conducting systematic reviews in patient safety. This discipline is relatively young, and asks complex questions about complex aspects of health care delivery and experience, therefore its studies are typically methodologically heterogeneous, non-randomized and complex; but content rich and highly relevant to practice. Systematic reviews are increasingly necessary to drive forward practice and research in this area, but the data do not always lend themselves to 'standard' review methodologies. This accessible 'how-to' article demonstrates that data diversity need not preclude high-quality systematic reviews. It draws together information from published guidelines and experience within our multidisciplinary patient safety research group to provide entry-level advice for the clinician-researcher new to systematic reviewing, to non-biomedical research data or to both. It offers entry-level advice, illustrated with detailed practical examples, on defining a research question, creating a comprehensive search strategy, selecting articles for inclusion, assessing study quality, extracting data, synthesizing data and evaluating the impact of your review. The article concludes with a comment on the vital role of robust systematic reviews in the continuing advancement of the patient safety field. © 2010 Blackwell Publishing Ltd.

Factors contributing to chronic ankle instability: a protocol for a systematic review of systematic reviews.

PubMed

Thompson, Cassandra; Schabrun, Siobhan; Romero, Rick; Bialocerkowski, Andrea; Marshall, Paul

2016-06-07

Ankle sprains are a significant clinical problem. Researchers have identified a multitude of factors contributing to the presence of recurrent ankle sprains including deficits in balance, postural control, kinematics, muscle activity, strength, range of motion, ligament laxity and bone/joint characteristics. Unfortunately, the literature examining the presence of these factors in chronic ankle instability (CAI) is conflicting. As a result, researchers have attempted to integrate this evidence using systematic reviews to reach conclusions; however, readers are now faced with an increasing number of systematic review findings that are also conflicting. The overall aim of this review is to critically appraise the methodological quality of previous systematic reviews and pool this evidence to identify contributing factors to CAI. A systematic review will be conducted on systematic reviews that investigate the presence of various deficits identified in CAI. Databases will be searched using pre-determined search terms. Reviews will then be assessed for inclusion based on the set eligibility criteria. Two independent reviewers will assess the articles for inclusion before evaluating the methodological quality and presence of bias of the included studies; any disagreements will be resolved by discussion between reviewers to reach consensus or by a third reviewer. Data concerning the specific research question, search strategy, inclusion/exclusion criteria, population, method and outcomes will be extracted. Findings will be analysed with respect to the methodological quality of the included reviews. It is expected that this review will clarify the cause of contradicting findings in the literature and facilitate future research directions. PROSPERO CRD42016032592 .

Longitudinal analysis of reporting and quality of systematic reviews in high-impact surgical journals.

PubMed

Chapman, S J; Drake, T M; Bolton, W S; Barnard, J; Bhangu, A

2017-02-01

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement aims to optimize the reporting of systematic reviews. The performance of the PRISMA Statement in improving the reporting and quality of surgical systematic reviews remains unclear. Systematic reviews published in five high-impact surgical journals between 2007 and 2015 were identified from online archives. Manuscripts blinded to journal, publication year and authorship were assessed according to 27 reporting criteria described by the PRISMA Statement and scored using a validated quality appraisal tool (AMSTAR, Assessing the Methodological Quality of Systematic Reviews). Comparisons were made between studies published before (2007-2009) and after (2011-2015) its introduction. The relationship between reporting and study quality was measured using Spearman's rank test. Of 281 eligible manuscripts, 80 were published before the PRISMA Statement and 201 afterwards. Most manuscripts (208) included a meta-analysis, with the remainder comprising a systematic review only. There was no meaningful change in median compliance with the PRISMA Statement (19 (i.q.r. 16-21) of 27 items before versus 19 (17-22) of 27 after introduction of PRISMA) despite achieving statistical significance (P = 0·042). Better reporting compliance was associated with higher methodological quality (r s  = 0·70, P < 0·001). The PRISMA Statement has had minimal impact on the reporting of surgical systematic reviews. Better compliance was associated with higher-quality methodology. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

An overview of systematic review.

PubMed

Baker, Kathy A; Weeks, Susan Mace

2014-12-01

Systematic review is an invaluable tool for the practicing clinician. A well-designed systematic review represents the latest and most complete information available on a particular topic or intervention. This article highlights the key elements of systematic review, what it is and is not, and provides an overview of several reputable organizations supporting the methodological development and conduct of systematic review. Important aspects for evaluating the quality of a systematic review are also included. Copyright © 2014 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

Systematic reviews need systematic searchers

PubMed Central

McGowan, Jessie; Sampson, Margaret

2005-01-01

Purpose: This paper will provide a description of the methods, skills, and knowledge of expert searchers working on systematic review teams. Brief Description: Systematic reviews and meta-analyses are very important to health care practitioners, who need to keep abreast of the medical literature and make informed decisions. Searching is a critical part of conducting these systematic reviews, as errors made in the search process potentially result in a biased or otherwise incomplete evidence base for the review. Searches for systematic reviews need to be constructed to maximize recall and deal effectively with a number of potentially biasing factors. Librarians who conduct the searches for systematic reviews must be experts. Discussion/Conclusion: Expert searchers need to understand the specifics about data structure and functions of bibliographic and specialized databases, as well as the technical and methodological issues of searching. Search methodology must be based on research about retrieval practices, and it is vital that expert searchers keep informed about, advocate for, and, moreover, conduct research in information retrieval. Expert searchers are an important part of the systematic review team, crucial throughout the review process—from the development of the proposal and research question to publication. PMID:15685278

Association between prospective registration and overall reporting and methodological quality of systematic reviews: a meta-epidemiological study.

PubMed

Ge, Long; Tian, Jin-Hui; Li, Ya-Nan; Pan, Jia-Xue; Li, Ge; Wei, Dang; Xing, Xin; Pan, Bei; Chen, Yao-Long; Song, Fu-Jian; Yang, Ke-Hu

2018-01-01

The aim of this study was to investigate the differences in main characteristics, reporting and methodological quality between prospectively registered and nonregistered systematic reviews. PubMed was searched to identify systematic reviews of randomized controlled trials published in 2015 in English. After title and abstract screening, potentially relevant reviews were divided into three groups: registered non-Cochrane reviews, Cochrane reviews, and nonregistered reviews. For each group, random number tables were generated in Microsoft Excel, and the first 50 eligible studies from each group were randomly selected. Data of interest from systematic reviews were extracted. Regression analyses were conducted to explore the association between total Revised Assessment of Multiple Systematic Review (R-AMSTAR) or Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) scores and the selected characteristics of systematic reviews. The conducting and reporting of literature search in registered reviews were superior to nonregistered reviews. Differences in 9 of the 11 R-AMSTAR items were statistically significant between registered and nonregistered reviews. The total R-AMSTAR score of registered reviews was higher than nonregistered reviews [mean difference (MD) = 4.82, 95% confidence interval (CI): 3.70, 5.94]. Sensitivity analysis by excluding the registration-related item presented similar result (MD = 4.34, 95% CI: 3.28, 5.40). Total PRISMA scores of registered reviews were significantly higher than nonregistered reviews (all reviews: MD = 1.47, 95% CI: 0.64-2.30; non-Cochrane reviews: MD = 1.49, 95% CI: 0.56-2.42). However, the difference in the total PRISMA score was no longer statistically significant after excluding the item related to registration (item 5). Regression analyses showed similar results. Prospective registration may at least indirectly improve the overall methodological quality of systematic reviews, although its impact on the overall reporting quality was not significant. Copyright © 2017 Elsevier Inc. All rights reserved.

Behavioural and Autonomic Regulation of Response to Sensory Stimuli among Children: A Systematic Review of Relationship and Methodology.

PubMed

Gomez, Ivan Neil; Lai, Cynthia Y Y; Morato-Espino, Paulin Grace; Chan, Chetwyn C H; Tsang, Hector W H

2017-01-01

Previous studies have explored the correlates of behavioural and autonomic regulation of response to sensory stimuli in children; however, a comprehensive review of such relationship is lacking. This systematic review was performed to critically appraise the current evidence on such relationship and describe the methods used in these studies. Online databases were systematically searched for peer-reviewed, full-text articles in the English language between 1999 and 2016, initially screened by title and abstract, and appraised and synthesized by two independent review authors. Fourteen Level III-3 cross-sectional studies were included for systematic review, among which six studies explored the relationship between behaviour and physiological regulation of responses to sensory stimuli. Three studies reported significant positive weak correlations among ASD children; however, no correlations were found in typically developing children. Methodological differences related to individual differences among participants, measures used, and varied laboratory experimental setting were noted. This review suggests inconclusive evidence supporting the relationship between behavioural and physiological regulation of responses to sensory stimuli among children. Methodological differences may likely have confounded the results of the current evidence. We present methodological recommendations to address this matter for future researches. This trial is registered with PROSPERO registration number CRD42016043887.

Behavioural and Autonomic Regulation of Response to Sensory Stimuli among Children: A Systematic Review of Relationship and Methodology

PubMed Central

Morato-Espino, Paulin Grace; Chan, Chetwyn C. H.; Tsang, Hector W. H.

2017-01-01

Background Previous studies have explored the correlates of behavioural and autonomic regulation of response to sensory stimuli in children; however, a comprehensive review of such relationship is lacking. This systematic review was performed to critically appraise the current evidence on such relationship and describe the methods used in these studies. Methods Online databases were systematically searched for peer-reviewed, full-text articles in the English language between 1999 and 2016, initially screened by title and abstract, and appraised and synthesized by two independent review authors. Results Fourteen Level III-3 cross-sectional studies were included for systematic review, among which six studies explored the relationship between behaviour and physiological regulation of responses to sensory stimuli. Three studies reported significant positive weak correlations among ASD children; however, no correlations were found in typically developing children. Methodological differences related to individual differences among participants, measures used, and varied laboratory experimental setting were noted. Conclusion This review suggests inconclusive evidence supporting the relationship between behavioural and physiological regulation of responses to sensory stimuli among children. Methodological differences may likely have confounded the results of the current evidence. We present methodological recommendations to address this matter for future researches. This trial is registered with PROSPERO registration number CRD42016043887. PMID:29333436

Methodological quality evaluation of systematic reviews or meta-analyses on ERCC1 in non-small cell lung cancer: a systematic review.

PubMed

Tao, Huan; Zhang, Yueyuan; Li, Qian; Chen, Jin

2017-11-01

To assess the methodological quality of systematic reviews (SRs) or meta-analysis concerning the predictive value of ERCC1 in platinum chemotherapy of non-small cell lung cancer. We searched the PubMed, EMbase, Cochrane library, international prospective register of systematic reviews, Chinese BioMedical Literature Database, China National Knowledge Infrastructure, Wan Fang and VIP database for SRs or meta-analysis. The methodological quality of included literatures was evaluated by risk of bias in systematic review (ROBIS) scale. Nineteen eligible SRs/meta-analysis were included. The most frequently searched databases were EMbase (74%), PubMed, Medline and CNKI. Fifteen SRs did additional retrieval manually, but none of them retrieved the registration platform. 47% described the two-reviewers model in the screening for eligible original articles, and seven SRs described the two reviewers to extract data. In methodological quality assessment, inter-rater reliability Kappa was 0.87 between two reviewers. Research question were well related to all SRs in phase 1 and the eligibility criteria was suitable for each SR, and rated as 'low' risk bias. But the 'high' risk bias existed in all the SRs regarding methods used to identify and/or select studies, and data collection and study appraisal. More than two-third of SRs or meta-analysis were finished with high risk of bias in the synthesis, findings and the final phase. The study demonstrated poor methodological quality of SRs/meta-analysis assessing the predictive value of ERCC1 in chemotherapy among the NSCLC patients, especially the high performance bias. Registration or publishing the protocol is recommended in future research.

Searching for qualitative research for inclusion in systematic reviews: a structured methodological review.

PubMed

Booth, Andrew

2016-05-04

Qualitative systematic reviews or qualitative evidence syntheses (QES) are increasingly recognised as a way to enhance the value of systematic reviews (SRs) of clinical trials. They can explain the mechanisms by which interventions, evaluated within trials, might achieve their effect. They can investigate differences in effects between different population groups. They can identify which outcomes are most important to patients, carers, health professionals and other stakeholders. QES can explore the impact of acceptance, feasibility, meaningfulness and implementation-related factors within a real world setting and thus contribute to the design and further refinement of future interventions. To produce valid, reliable and meaningful QES requires systematic identification of relevant qualitative evidence. Although the methodologies of QES, including methods for information retrieval, are well-documented, little empirical evidence exists to inform their conduct and reporting. This structured methodological overview examines papers on searching for qualitative research identified from the Cochrane Qualitative and Implementation Methods Group Methodology Register and from citation searches of 15 key papers. A single reviewer reviewed 1299 references. Papers reporting methodological guidance, use of innovative methodologies or empirical studies of retrieval methods were categorised under eight topical headings: overviews and methodological guidance, sampling, sources, structured questions, search procedures, search strategies and filters, supplementary strategies and standards. This structured overview presents a contemporaneous view of information retrieval for qualitative research and identifies a future research agenda. This review concludes that poor empirical evidence underpins current information practice in information retrieval of qualitative research. A trend towards improved transparency of search methods and further evaluation of key search procedures offers the prospect of rapid development of search methods.

Rational decision-making in mental health: the role of systematic reviews.

PubMed

Gilbody, Simon M.; Petticrew, Mark

1999-09-01

BACKGROUND: "Systematic reviews" have come to be recognized as the most rigorous method of summarizing confusing and often contradictory primary research in a transparent and reproducible manner. Their greatest impact has been in the summarization of epidemiological literature - particularly that relating to clinical effectiveness. Systematic reviews also have a potential to inform rational decision-making in healthcare policy and to form a component of economic evaluation. AIMS OF THE STUDY: This article aims to introduce the rationale behind systematic reviews and, using examples from mental health, to introduce the strengths and limitations of systematic reviews, particularly in informing mental health policy and economic evaluation. METHODS: Examples are selected from recent controversies surrounding the introduction of new psychiatric drugs (anti-depressants and anti-schizophrenia drugs) and methods of delivering psychiatric care in the community (case management and assertive community treatment). The potential for systematic reviews to (i) produce best estimates of clinical efficacy and effectiveness, (ii) aid economic evaluation and policy decision-making and (iii) highlight gaps in the primary research knowledge base are discussed. Lastly examples are selected from outside mental health to show how systematic reviews have a potential to be explicitly used in economic and health policy evaluation. RESULTS: Systematic reviews produce the best estimates of clinical efficacy, which can form an important component of economic evaluation. Importantly, serious methodological flaws and areas of uncertainty in the primary research literature are identified within an explicit framework. Summary indices of clinical effectiveness can be produced, but it is difficult to produce such summary indices of cost effectiveness by pooling economic data from primary studies. Modelling is commonly used in economic and policy evaluation. Here, systematic reviews can provide the best estimates of effectiveness and, importantly, highlight areas of uncertainty that can be used in "sensitivity analysis". DISCUSSION: Systematic reviews are an important recent methodological advance, the potential for which has only begun to be realized in mental health. This use of systematic reviews is probably most advanced in producing critical summaries of clinical effectiveness data. Systematic reviews cannot produce valid and believable conclusions when the primary research literature is of poor quality. An important function of systematic reviews will be in highlighting this poor quality research which is of little use in mental health decision making. IMPLICATIONS FOR HEALTH PROVISION: Health care provision should be both clinically and cost effective. Systematic reviews are a key component in ensuring that this goal is achieved. IMPLICATIONS FOR HEALTH POLICIES: Systematic reviews have potential to inform health policy. Examples presented show that health policy is often made without due consideration of the research evidence. Systematic reviews can provide robust and believable answers, which can help inform rational decision-making. Importantly, systematic reviews can highlight the need for important primary research and can inform the design of this research such that it provides answers that will help in forming healthcare policy. IMPLICATIONS FOR FURTHER RESEARCH: Systematic reviews should precede costly (and often unnecessary) primary research. Many areas of health policy and practice have yet to be evaluated using systematic review methodology. Methods for the summarization of economic data are methodologically complex and deserve further research

Application of Resource Description Framework to Personalise Learning: Systematic Review and Methodology

ERIC Educational Resources Information Center

Jevsikova, Tatjana; Berniukevicius, Andrius; Kurilovas, Eugenijus

2017-01-01

The paper is aimed to present a methodology of learning personalisation based on applying Resource Description Framework (RDF) standard model. Research results are two-fold: first, the results of systematic literature review on Linked Data, RDF "subject-predicate-object" triples, and Web Ontology Language (OWL) application in education…

Surgical interventions for gastric cancer: a review of systematic reviews.

PubMed

He, Weiling; Tu, Jian; Huo, Zijun; Li, Yuhuang; Peng, Jintao; Qiu, Zhenwen; Luo, Dandong; Ke, Zunfu; Chen, Xinlin

2015-01-01

To evaluate methodological quality and the extent of concordance among meta-analysis and/or systematic reviews on surgical interventions for gastric cancer (GC). A comprehensive search of PubMed, Medline, EMBASE, the Cochrane library and the DARE database was conducted to identify the reviews comparing different surgical interventions for GC prior to April 2014. After applying included criteria, available data were summarized and appraised by the Oxman and Guyatt scale. Fifty six reviews were included. Forty five reviews (80.4%) were well conducted, with scores of adapted Oxman and Guyatt scale ≥ 14. The reviews differed in criteria for avoiding bias and assessing the validity of the primary studies. Many primary studies displayed major methodological flaws, such as randomization, allocation concealment, and dropouts and withdrawals. According to the concordance assessment, laparoscopy-assisted gastrectomy (LAG) was superior to open gastrectomy, and laparoscopy-assisted distal gastrectomy was superior to open distal gastrectomy in short-term outcomes. However, the concordance regarding other surgical interventions, such as D1 vs. D2 lymphadenectomy, and robotic gastrectomy vs. LAG were absent. Systematic reviews on surgical interventions for GC displayed relatively high methodological quality. The improvement of methodological quality and reporting was necessary for primary studies. The superiority of laparoscopic over open surgery was demonstrated. But concordance on other surgical interventions was rare, which needed more well-designed RCTs and systematic reviews.

Issues and Advances in the Systematic Review of Single-Case Research: A Commentary on the Exemplars

ERIC Educational Resources Information Center

Manolov, Rumen; Guilera, Georgina; Solanas, Antonio

2017-01-01

The current text comments on three systematic reviews published in the special section "Issues and Advances in the Systematic Review of Single-Case Research: An Update and Exemplars." The commentary is provided in relation to the need to combine the assessment of the methodological quality of the studies included in systematic reviews,…

The effectiveness of massage therapy for the treatment of nonspecific low back pain: a systematic review of systematic reviews.

PubMed

Kumar, Saravana; Beaton, Kate; Hughes, Tricia

2013-09-04

The last decade has seen a growth in the utilization of complementary and alternative medicine therapies, and one of the most popular and sought-after complementary and alternative medicine therapies for nonspecific low back pain is massage. Massage may often be perceived as a safe therapeutic modality without any significant risks or side effects. However, despite its popularity, there continues to be ongoing debate on the effectiveness of massage in treating nonspecific low back pain. With a rapidly evolving research evidence base and access to innovative means of synthesizing evidence, it is time to reinvestigate this issue. A systematic, step-by-step approach, underpinned by best practice in reviewing the literature, was utilized as part of the methodology of this umbrella review. A systematic search was conducted in the following databases: Embase, MEDLINE, AMED, ICONDA, Academic Search Premier, Australia/New Zealand Reference Centre, CINAHL, HealthSource, SPORTDiscus, PubMed, The Cochrane Library, Scopus, Web of Knowledge/Web of Science, PsycINFO, and ProQuest Nursing and Allied Health Source, investigating systematic reviews and meta-analyses from January 2000 to December 2012, and restricted to English-language documents. Methodological quality of included reviews was undertaken using the Centre for Evidence Based Medicine critical appraisal tool. Nine systematic reviews were found. The methodological quality of the systematic reviews varied (from poor to excellent) although, overall, the primary research informing these systematic reviews was generally considered to be weak quality. The findings indicate that massage may be an effective treatment option when compared to placebo and some active treatment options (such as relaxation), especially in the short term. There is conflicting and contradictory findings for the effectiveness of massage therapy for the treatment of nonspecific low back pain when compared against other manual therapies (such as mobilization), standard medical care, and acupuncture. There is an emerging body of evidence, albeit small, that supports the effectiveness of massage therapy for the treatment of non-specific low back pain in the short term. Due to common methodological flaws in the primary research, which informed the systematic reviews, recommendations arising from this evidence base should be interpreted with caution.

The landscape of systematic reviews in urology (1998 to 2015): an assessment of methodological quality.

PubMed

Han, Julia L; Gandhi, Shreyas; Bockoven, Crystal G; Narayan, Vikram M; Dahm, Philipp

2017-04-01

To assess the quality of published systematic reviews in the urology literature (an extension of our previously reported work), as high-quality systematic reviews play a paramount role in informing evidence-based clinical practice. Our focus was on systematic reviews in the urology literature that incorporated questions of prevention and therapy. To identify such reviews published during a 36-month period (2013-2015), we systematically searched PubMed and hand-searched the table of contents of four major urology journals. Two reviewers independently assessed the methodological quality of those reviews, using the 11-point 'Assessment of Multiple Systematic Reviews' (AMSTAR) instrument. We performed protocol-driven analyses of the data from our present study's 36-month period alone, as well as in aggregate with the data from our previously reported work's study periods (2009-2012 and 1998-2008). In our literature search of the 36-month period (2013-2015), we initially identified 490 possibly relevant reviews, of which 125 met our inclusion criteria. The most common topic of reviews for the 2013-2015 period was oncology (51.2%; n = 64), followed by voiding dysfunction (21.6%; n = 27). The mean [standard deviation (SD)] AMSTAR score in the 2013-2015 period (n = 125) was 4.8 (2.4); 2009-2012 (n = 113), 5.4 (2.3); and 1998-2008 (n = 57), 4.8 (2.0) (P = 0.127). In the 2013-2015 period, the mean (SD) AMSTAR score for the BJU International (n = 25) was 5.6 (2.9); for The Journal of Urology (n = 20), 5.1 (2.6); for European Urology (n = 60), 4.5 (2.2); and for Urology (n = 20), 4.4 (2.2) (P = 0.106). The number of systematic reviews published in the urology literature has exponentially increased, year by year, but their methodological quality has stagnated. To enhance the validity and impact of systematic reviews, all authors and editors must apply established methodological standards. © 2016 The Authors BJU International © 2016 BJU International Published by John Wiley & Sons Ltd.

Relationships between abstract features and methodological quality explained variations of social media activity derived from systematic reviews about psoriasis interventions.

PubMed

Ruano, J; Aguilar-Luque, M; Isla-Tejera, B; Alcalde-Mellado, P; Gay-Mimbrera, J; Hernandez-Romero, José Luis; Sanz-Cabanillas, J L; Maestre-López, B; González-Padilla, M; Carmona-Fernández, P J; Gómez-García, F; García-Nieto, A Vélez

2018-05-24

The aim of this study was to describe the relationship among abstract structure, readability, and completeness, and how these features may influence social media activity and bibliometric results, considering systematic reviews (SRs) about interventions in psoriasis classified by methodological quality. Systematic literature searches about psoriasis interventions were undertaken on relevant databases. For each review, methodological quality was evaluated using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Abstract extension, structure, readability, and quality and completeness of reporting were analyzed. Social media activity, which consider Twitter and Facebook mention counts, as well as Mendeley readers and Google scholar citations were obtained for each article. Analyses were conducted to describe any potential influence of abstract characteristics on review's social media diffusion. We classified 139 intervention SRs as displaying high/moderate/low methodological quality. We observed that abstract readability of SRs has been maintained high for last 20 years, although there are some differences based on their methodological quality. Free-format abstracts were most sensitive to the increase of text readability as compared with more structured abstracts (IMRAD or 8-headings), yielding opposite effects on their quality and completeness depending on the methodological quality: a worsening in low quality reviews and an improvement in those of high-quality. Both readability indices and PRISMA for Abstract total scores showed an inverse relationship with social media activity and bibliometric results in high methodological quality reviews but not in those of lower quality. Our results suggest that increasing abstract readability must be specially considered when writing free-format summaries of high-quality reviews, because this fact correlates with an improvement of their completeness and quality, and this may help to achieve broader social media visibility and article usage. Copyright © 2018 Elsevier Inc. All rights reserved.

The systematic review as a research process in music therapy.

PubMed

Hanson-Abromeit, Deanna; Sena Moore, Kimberly

2014-01-01

Music therapists are challenged to present evidence on the efficacy of music therapy treatment and incorporate the best available research evidence to make informed healthcare and treatment decisions. Higher standards of evidence can come from a variety of sources including systematic reviews. To define and describe a range of research review methods using examples from music therapy and related literature, with emphasis on the systematic review. In addition, the authors provide a detailed overview of methodological processes for conducting and reporting systematic reviews in music therapy. The systematic review process is described in five steps. Step 1 identifies the research plan and operationalized research question(s). Step 2 illustrates the identification and organization of the existing literature related to the question(s). Step 3 details coding of data extracted from the literature. Step 4 explains the synthesis of coded findings and analysis to answer the research question(s). Step 5 describes the strength of evidence evaluation and results presentation for practice recommendations. Music therapists are encouraged to develop and conduct systematic reviews. This methodology contributes to review outcome credibility and can determine how information is interpreted and used by clinicians, clients or patients, and policy makers. A systematic review is a methodologically rigorous research method used to organize and evaluate extant literature related to a clinical problem. Systematic reviews can assist music therapists in managing the ever-increasing literature, making well-informed evidence based practice and research decisions, and translating existing music-based and nonmusic based literature to clinical practice and research development. © the American Music Therapy Association 2014. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations.

PubMed

Mueller, Monika; D'Addario, Maddalena; Egger, Matthias; Cevallos, Myriam; Dekkers, Olaf; Mugglin, Catrina; Scott, Pippa

2018-05-21

Systematic reviews and meta-analyses of observational studies are frequently performed, but no widely accepted guidance is available at present. We performed a systematic scoping review of published methodological recommendations on how to systematically review and meta-analyse observational studies. We searched online databases and websites and contacted experts in the field to locate potentially eligible articles. We included articles that provided any type of recommendation on how to conduct systematic reviews and meta-analyses of observational studies. We extracted and summarised recommendations on pre-defined key items: protocol development, research question, search strategy, study eligibility, data extraction, dealing with different study designs, risk of bias assessment, publication bias, heterogeneity, statistical analysis. We summarised recommendations by key item, identifying areas of agreement and disagreement as well as areas where recommendations were missing or scarce. The searches identified 2461 articles of which 93 were eligible. Many recommendations for reviews and meta-analyses of observational studies were transferred from guidance developed for reviews and meta-analyses of RCTs. Although there was substantial agreement in some methodological areas there was also considerable disagreement on how evidence synthesis of observational studies should be conducted. Conflicting recommendations were seen on topics such as the inclusion of different study designs in systematic reviews and meta-analyses, the use of quality scales to assess the risk of bias, and the choice of model (e.g. fixed vs. random effects) for meta-analysis. There is a need for sound methodological guidance on how to conduct systematic reviews and meta-analyses of observational studies, which critically considers areas in which there are conflicting recommendations.

Identifying additional studies for a systematic review of retention strategies in randomised controlled trials: making contact with trials units and trial methodologists.

PubMed

Brueton, Valerie; Tierney, Jayne F; Stenning, Sally; Rait, Greta

2017-08-22

Search strategies for systematic reviews aim to identify all evidence relevant to the research question posed. Reports of methodological research can be difficult to find leading to biased results in systematic reviews of research methodology. Evidence suggests that contact with investigators can help to identify unpublished research. To identify additional eligible randomised controlled trials (RCTs) for a Cochrane systematic review of strategies to improve retention in RCTs, we conducted a survey of UK clinical trials units (CTUs) and made contact with RCT methodologists. Key contacts for all UK CTUs were sent a personalised email with a short questionnaire and summary protocol of the Cochrane methodology review. The questionnaire asked whether a RCT evaluating strategies to improve retention embedded in a RCT had ever been conducted by the CTU. Questions about the stage of completion and publication of such RCTs were included. The summary protocol outlined the aims, eligibility criteria, examples of types of retention strategies, and the primary outcome for the systematic review. Personal communication with RCT methodologists and presentations of preliminary results of the review at conferences were also used to identify additional eligible RCTs. We checked the results of our standard searches to see if eligible studies identified through these additional methods were also found using our standard searches. We identified 14 of the 38 RCTs included in the Cochrane methodology review by contacting trials units and methodologists. Eleven of the 14 RCTs identified by these methods were either published in grey literature, in press or unpublished. Three remaining RCTs were fully published at the time. Six of the RCTs identified were not found through any other searches. The RCTs identified represented data for 6 of 14 RCTs of incentive strategies (52% of randomised participants included in the review), and 6 of 14 RCTs of communication strategies (52% of randomised participants included in the Cochrane review). Data were unavailable for two of the RCTs identified. Methodological evaluations embedded in RCTs may be unpublished, published in the grey literature or where published, poorly indexed in bibliographic databases. To identify such studies and minimise selection bias in systematic reviews of methodological evaluations, reviewers should consider contacting CTUs and trial methodologists.

Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews.

PubMed

Song, Fujian; Loke, Yoon K; Walsh, Tanya; Glenny, Anne-Marie; Eastwood, Alison J; Altman, Douglas G

2009-04-03

To investigate basic assumptions and other methodological problems in the application of indirect comparison in systematic reviews of competing healthcare interventions. Survey of published systematic reviews. Inclusion criteria Systematic reviews published between 2000 and 2007 in which an indirect approach had been explicitly used. Identified reviews were assessed for comprehensiveness of the literature search, method for indirect comparison, and whether assumptions about similarity and consistency were explicitly mentioned. The survey included 88 review reports. In 13 reviews, indirect comparison was informal. Results from different trials were naively compared without using a common control in six reviews. Adjusted indirect comparison was usually done using classic frequentist methods (n=49) or more complex methods (n=18). The key assumption of trial similarity was explicitly mentioned in only 40 of the 88 reviews. The consistency assumption was not explicit in most cases where direct and indirect evidence were compared or combined (18/30). Evidence from head to head comparison trials was not systematically searched for or not included in nine cases. Identified methodological problems were an unclear understanding of underlying assumptions, inappropriate search and selection of relevant trials, use of inappropriate or flawed methods, lack of objective and validated methods to assess or improve trial similarity, and inadequate comparison or inappropriate combination of direct and indirect evidence. Adequate understanding of basic assumptions underlying indirect and mixed treatment comparison is crucial to resolve these methodological problems. APPENDIX 1: PubMed search strategy. APPENDIX 2: Characteristics of identified reports. APPENDIX 3: Identified studies. References of included studies.

The baby or the bath water? Lessons learned from the National Action Alliance for Suicide Prevention Research Prioritization Task Force literature review.

PubMed

Davis Molock, Sherry; Heekin, Janet M; Matlin, Samantha G; Barksdale, Crystal L; Gray, Ekwenzi; Booth, Chelsea L

2014-09-01

The Research Prioritization Task Force of the National Action Alliance for Suicide Prevention conducted a comprehensive literature review of suicide prevention/intervention trials to assess the quality of the scientific evidence. A literature "review of reviews" was conducted by searching the most widely used databases for mental health and public health research. The quality of the reviews was evaluated using the Revised Assessment of Multiple Systematic Reviews system; the quality of the scientific evidence for the suicide preventions/interventions was assessed using U.S. Preventive Services Task Force criteria. The reviews were limited to peer-reviewed publications with human subjects published in English. Ninety-eight systematic reviews and 45 primary sources on suicide prevention/interventions published between January 2000 and September 2012 were evaluated. The results suggest that the quality of both the systematic reviews and the scientific evidence for suicide preventions/interventions were mixed. The majority of the systematic reviews and prevention/interventions were evaluated as fair to poor in quality. There are many promising suicide prevention/intervention trials, but research findings are often inconclusive because of methodologic problems. Methodologic problems across systematic reviews include not conducting hand searches, not surveying gray literature, and being unable to aggregate data across studies. Methodologic problems with the scientific quality of the prevention/intervention trials include paucity of information on sample demographic characteristics, poorly defined outcomes, and excluding actively suicidal participants. Suggestions for ways to improve the quality of the systematic reviews and suicide preventions/interventions are provided. Copyright © 2014 American Journal of Preventive Medicine. All rights reserved.

Systematic reviews and meta-analyses on treatment of asthma: critical evaluation

PubMed Central

Jadad, Alejandro R; Moher, Michael; Browman, George P; Booker, Lynda; Sigouin, Christopher; Fuentes, Mario; Stevens, Robert

2000-01-01

Objective To evaluate the clinical, methodological, and reporting aspects of systematic reviews and meta-analyses on the treatment of asthma and to compare those published by the Cochrane Collaboration with those published in paper based journals. Design Analysis of studies identified from Medline, CINAHL, HealthSTAR, EMBASE, Cochrane Library, personal collections, and reference lists. Studies Articles describing a systematic review or a meta-analysis of the treatment of asthma that were published as a full report, in any language or format, in a peer reviewed journal or the Cochrane Library. Main outcome measures General characteristics of studies reviewed and methodological characteristics (sources of articles; language restrictions; format, design, and publication status of studies included; type of data synthesis; and methodological quality). Results 50 systematic reviews and meta-analyses were included. More than half were published in the past two years. Twelve reviews were published in the Cochrane Library and 38 were published in 22 peer reviewed journals. Forced expiratory volume in one second was the most frequently used outcome, but few reviews evaluated the effect of treatment on costs or patient preferences. Forty reviews were judged to have serious or extensive flaws. All six reviews associated with industry were in this group. Seven of the 10 most rigorous reviews were published in the Cochrane Library. Conclusions Most reviews published in peer reviewed journals or funded by industry have serious methodological flaws that limit their value to guide decisions. Cochrane reviews are more rigorous and better reported than those published in peer reviewed journals. PMID:10688558

Author-paper affiliation network architecture influences the methodological quality of systematic reviews and meta-analyses of psoriasis.

PubMed

Sanz-Cabanillas, Juan Luis; Ruano, Juan; Gomez-Garcia, Francisco; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Maestre-Lopez, Beatriz; Gonzalez-Padilla, Marcelino; Carmona-Fernandez, Pedro J; Velez Garcia-Nieto, Antonio; Isla-Tejera, Beatriz

2017-01-01

Moderate-to-severe psoriasis is associated with significant comorbidity, an impaired quality of life, and increased medical costs, including those associated with treatments. Systematic reviews (SRs) and meta-analyses (MAs) of randomized clinical trials are considered two of the best approaches to the summarization of high-quality evidence. However, methodological bias can reduce the validity of conclusions from these types of studies and subsequently impair the quality of decision making. As co-authorship is among the most well-documented forms of research collaboration, the present study aimed to explore whether authors' collaboration methods might influence the methodological quality of SRs and MAs of psoriasis. Methodological quality was assessed by two raters who extracted information from full articles. After calculating total and per-item Assessment of Multiple Systematic Reviews (AMSTAR) scores, reviews were classified as low (0-4), medium (5-8), or high (9-11) quality. Article metadata and journal-related bibliometric indices were also obtained. A total of 741 authors from 520 different institutions and 32 countries published 220 reviews that were classified as high (17.2%), moderate (55%), or low (27.7%) methodological quality. The high methodological quality subnetwork was larger but had a lower connection density than the low and moderate methodological quality subnetworks; specifically, the former contained relatively fewer nodes (authors and reviews), reviews by authors, and collaborators per author. Furthermore, the high methodological quality subnetwork was highly compartmentalized, with several modules representing few poorly interconnected communities. In conclusion, structural differences in author-paper affiliation network may influence the methodological quality of SRs and MAs on psoriasis. As the author-paper affiliation network structure affects study quality in this research field, authors who maintain an appropriate balance between scientific quality and productivity are more likely to develop higher quality reviews.

Systematic reviews of animal studies; missing link in translational research?

PubMed

van Luijk, Judith; Bakker, Brenda; Rovers, Maroeska M; Ritskes-Hoitinga, Merel; de Vries, Rob B M; Leenaars, Marlies

2014-01-01

The methodological quality of animal studies is an important factor hampering the translation of results from animal studies to a clinical setting. Systematic reviews of animal studies may provide a suitable method to assess and thereby improve their methodological quality. The aims of this study were: 1) to evaluate the risk of bias assessment in animal-based systematic reviews, and 2) to study the internal validity of the primary animal studies included in these systematic reviews. We systematically searched Pubmed and Embase for SRs of preclinical animal studies published between 2005 and 2012. A total of 91 systematic reviews met our inclusion criteria. The risk of bias was assessed in 48 (52.7%) of these 91 systematic reviews. Thirty-three (36.3%) SRs provided sufficient information to evaluate the internal validity of the included studies. Of the evaluated primary studies, 24.6% was randomized, 14.6% reported blinding of the investigator/caretaker, 23.9% blinded the outcome assessment, and 23.1% reported drop-outs. To improve the translation of animal data to clinical practice, systematic reviews of animal studies are worthwhile, but the internal validity of primary animal studies needs to be improved. Furthermore, risk of bias should be assessed by systematic reviews of animal studies to provide insight into the reliability of the available evidence.

Systematic Review Methodology for the Fatigue in Emergency Medical Services Project.

PubMed

Patterson, P Daniel; Higgins, J Stephen; Weiss, Patricia M; Lang, Eddy; Martin-Gill, Christian

2018-02-15

Guidance for managing fatigue in the Emergency Medical Services (EMS) setting is limited. The Fatigue in EMS Project sought to complete multiple systematic reviews guided by seven explicit research questions, assemble the best available evidence, and rate the quality of that evidence for purposes of producing an Evidence Based Guideline (EBG) for fatigue risk management in EMS operations. We completed seven systematic reviews that involved searches of six databases for literature relevant to seven research questions. These questions were developed a priori by an expert panel and framed in the Population, Intervention, Comparison, and Outcome (PICO) format and pre-registered with PROSPERO. Our target population was defined as persons 18 years of age and older classified as EMS personnel or similar shift worker groups. A panel of experts selected outcomes for each PICO question as prescribed by the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology. We pooled findings, stratified by study design (experimental vs. observational) and presented results of each systematic review in narrative and quantitative form. We used meta-analyses of select outcomes to generate pooled effects. We used the GRADE methodology and the GRADEpro software to designate a quality of evidence rating for each outcome. We present the results for each systematic review in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA). More than 38,000 records were screened across seven systematic reviews. The median, minimum, and maximum inter-rater agreements (Kappa) between screeners for our seven systematic reviews were 0.66, 0.49, and 0.88, respectively. The median, minimum, and maximum number of records retained for the seven systematic reviews was 13, 1, and 100, respectively. We present key findings in GRADE Evidence Profile Tables in separate publications for each systematic review. We describe a protocol for conducting multiple, simultaneous systematic reviews connected to fatigue with the goal of creating an EBG for fatigue risk management in the EMS setting. Our approach may be informative to others challenged with the creation of EBGs that address multiple, inter-related systematic reviews with overlapping outcomes.

A systematic tale of two differing reviews: evaluating the evidence on public and private sector quality of primary care in low and middle income countries.

PubMed

Coarasa, Jorge; Das, Jishnu; Gummerson, Elizabeth; Bitton, Asaf

2017-04-12

Systematic reviews are powerful tools for summarizing vast amounts of data in controversial areas; but their utility is limited by methodological choices and assumptions. Two systematic reviews of literature on the quality of private sector primary care in low and middle income countries (LMIC), published in the same journal within a year, reached conflicting conclusions. The difference in findings reflects different review methodologies, but more importantly, a weak underlying body of literature. A detailed examination of the literature cited in both reviews shows that only one of the underlying studies met the gold standard for methodological robustness. Given the current policy momentum on universal health coverage and primary health care reform across the globe, there is an urgent need for high quality empirical evidence on the quality of private versus public sector primary health care in LMIC.

Descriptive analysis of cochrane child-relevant systematic reviews: an update and comparison between 2009 and 2013.

PubMed

Crick, Katelynn; Thomson, Denise; Fernandes, Ricardo M; Nuspl, Megan; Eurich, Dean T; Rowe, Brian H; Hartling, Lisa

2017-07-11

Systematic reviews support health systems and clinical decision-making by identifying and summarizing all existing studies on a particular topic. In 2009, a comprehensive description of child-relevant systematic reviews published in the Cochrane Database of Systematic Reviews was compiled. This study aims to provide an update, and to describe these systematic reviews according to their content and methodological approaches. All child-relevant systematic reviews published by the Cochrane Collaboration in the Cochrane Database of Systematic Reviews (CDSR) as of March, 2013 were identified and described in relation to their content and methodological approaches. This step equated to an update of the Child Health Field Review Register (CHFRR). The content of the updated CHFRR was compared to the published 2009 CHFRR description regarding clinical and methodological characteristics, using bivariate analyses. As the Cochrane Collaboration has recognized that disease burden should guide research prioritization, we extracted data from the Global and National Burden of Diseases and Injuries Among Children and Adolescents Between 1990 and 2013 study in order to map the distribution of the burden of disease in child health to the distribution of evidence across Review Groups in the CHFRR. Of the 5,520 potential Cochrane systematic reviews identified, 1,293 (23.4%) were child-relevant (an increase of 24% since 2009). Overall, these reviews included 16,738 primary studies. The most commonly represented Review Groups were Airways (11.5%), Cystic Fibrosis and Genetic Diseases (7.9%), Acute Respiratory Infections (7.8%), Developmental, Psychological and Learning Problems (6.7%), and Infectious Diseases (6.2%). Corresponding authors were most often from Europe (51%), North America (15%), and Australia (15%). The majority of systematic reviews examined pharmacological interventions alone (52% compared to 59% in 2009). Out of 611 reviews that were assessed as up-to-date, GRADE was used in 204 (35%) reviews to assess the overall quality of the evidence, which was often moderate (35.6%) or low (37.8%) for primary outcomes. Ninety percent of reviews that were assessed as up to date used the Cochrane Risk of Bias tool, or a modified version, to assess methodological quality. Most reviews conducted one or more meta-analyses (73%). Among the 25 leading causes of death globally, the Review Groups associated with the largest number of causes were: 1) Infectious Diseases, 2) Anaesthesia, Critical, and Emergency Care, 3) Injuries, 4) Pregnancy and Childbirth (PC), and 5) Neonatal. There were large discrepancies between the number of causes of mortality that each Review Group was associated with and the total amount of evidence each Review Group contributed to the CHFRR. Ninety-eight percent of the causes of mortality in 2013 were from developing nations, but only 224 (17.3%) reviews had corresponding authors from developing countries. The content and methodological characteristics of child-relevant systematic reviews in the Cochrane CHFRR have been described in detail. There were modest advances in methods between 2009 and 2013. Systematic reviews contained in the CDSR offer an important resource for researcher's, clinicians and policy makers by synthesizing an extensive body of primary research. Further content analysis will allow the identification of clinical topics of greatest priority for future systematic reviews in child health.

Searching for grey literature for systematic reviews: challenges and benefits.

PubMed

Mahood, Quenby; Van Eerd, Dwayne; Irvin, Emma

2014-09-01

There is ongoing interest in including grey literature in systematic reviews. Including grey literature can broaden the scope to more relevant studies, thereby providing a more complete view of available evidence. Searching for grey literature can be challenging despite greater access through the Internet, search engines and online bibliographic databases. There are a number of publications that list sources for finding grey literature in systematic reviews. However, there is scant information about how searches for grey literature are executed and how it is included in the review process. This level of detail is important to ensure that reviews follow explicit methodology to be systematic, transparent and reproducible. The purpose of this paper is to provide a detailed account of one systematic review team's experience in searching for grey literature and including it throughout the review. We provide a brief overview of grey literature before describing our search and review approach. We also discuss the benefits and challenges of including grey literature in our systematic review, as well as the strengths and limitations to our approach. Detailed information about incorporating grey literature in reviews is important in advancing methodology as review teams adapt and build upon the approaches described. Copyright © 2013 John Wiley & Sons, Ltd.

Review of reviews on exposures to synthetic organic chemicals and children's neurodevelopment: Methodological and interpretation challenges.

PubMed

LaKind, Judy S; Anthony, Laura G; Goodman, Michael

2017-01-01

Environmental epidemiology data are becoming increasingly important in public health decision making, which commonly incorporates a systematic review of multiple studies. This review addresses two fundamental questions: What is the quality of available reviews on associations between exposure to synthetic organic chemicals and neurodevelopmental outcomes? What is the value (e.g., quality and consistency) of the underlying literature? Published reviews on associations between synthetic organic environmental chemical exposures and neurodevelopmental outcomes in children were systematically evaluated. Seventy-four relevant reviews were identified, and these were evaluated with respect to four methodological characteristics: (1) systematic inclusion/exclusion criteria and reproducible methods for search and retrieval of studies; (2) structured evaluation of underlying data quality; (3) systematic assessment of consistency across specific exposure-outcome associations; and (4) evaluation of reporting/publication bias. None of the 74 reviews fully met the criteria for all four methodological characteristics. Only four reviews met two criteria, and six reviews fulfilled only one criterion. Perhaps more importantly, the higher quality reviews were not able to meet all of the criteria owing to the shortcomings of underlying studies, which lacked comparability in terms of specific research question of interest, overall design, exposure assessment, outcome ascertainment, and analytic methods. Thus, even the most thoughtful and rigorous review may be of limited value if the underlying literature includes investigations that address different hypotheses and are beset by methodological inconsistencies and limitations. Issues identified in this review of reviews illustrate considerable challenges that are facing assessments of epidemiological evidence.

Use of methodological tools for assessing the quality of studies in periodontology and implant dentistry: a systematic review.

PubMed

Faggion, Clovis M; Huda, Fahd; Wasiak, Jason

2014-06-01

To evaluate the methodological approaches used to assess the quality of studies included in systematic reviews (SRs) in periodontology and implant dentistry. Two electronic databases (PubMed and Cochrane Database of Systematic Reviews) were searched independently to identify SRs examining interventions published through 2 September 2013. The reference lists of included SRs and records of 10 specialty dental journals were searched manually. Methodological approaches were assessed using seven criteria based on the Cochrane Handbook for Systematic Reviews of Interventions. Temporal trends in methodological quality were also explored. Of the 159 SRs with meta-analyses included in the analysis, 44 (28%) reported the use of domain-based tools, 15 (9%) reported the use of checklists and 7 (4%) reported the use of scales. Forty-two (26%) SRs reported use of more than one tool. Criteria were met heterogeneously; authors of 15 (9%) publications incorporated the quality of evidence of primary studies into SRs, whereas 69% of SRs reported methodological approaches in the Materials/Methods section. Reporting of four criteria was significantly better in recent (2010-2013) than in previous publications. The analysis identified several methodological limitations of approaches used to assess evidence in studies included in SRs in periodontology and implant dentistry. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Systematic reviews: guidance relevant for studies of older people

PubMed Central

Wilkinson, Tim; Dodds, Richard M.; Ioannidis, John P. A.

2017-01-01

Abstract Systematic reviews and meta-analyses are increasingly common. This article aims to provide guidance for people conducting systematic reviews relevant to the healthcare of older people. An awareness of these issues will also help people reading systematic reviews to determine whether the results will influence their clinical practice. It is essential that systematic reviews are performed by a team which includes the required technical and clinical expertise. Those performing reviews for the first time should ensure they have appropriate training and support. They must be planned and performed in a transparent and methodologically robust way: guidelines are available. The protocol should be written—and if possible published—before starting the review. Geriatricians will be interested in a table of baseline characteristics, which will help to determine if the studied samples or populations are similar to their patients. Reviews of studies of older people should consider how they will manage issues such as different age cut-offs; non-specific presentations; multiple predictors and outcomes; potential biases and confounders. Systematic reviews and meta-analyses may provide evidence to improve older people's care, or determine where new evidence is required. Newer methodologies, such as meta-analyses of individual level data, network meta-analyses and umbrella reviews, and realist synthesis, may improve the reliability and clinical utility of systematic reviews. PMID:28655142

Improving Mathematics Performance among Secondary Students with EBD: A Methodological Review

ERIC Educational Resources Information Center

Mulcahy, Candace A.; Krezmien, Michael P.; Travers, Jason

2016-01-01

In this methodological review, the authors apply special education research quality indicators and standards for single case design to analyze mathematics intervention studies for secondary students with emotional and behavioral disorders (EBD). A systematic methodological review of literature from 1975 to December 2012 yielded 19 articles that…

Neuropsychological investigations in obsessive-compulsive disorder: A systematic review of methodological challenges.

PubMed

Abramovitch, Amitai; Mittelman, Andrew; Tankersley, Amelia P; Abramowitz, Jonathan S; Schweiger, Avraham

2015-07-30

The inconsistent nature of the neuropsychology literature pertaining to obsessive-compulsive disorder (OCD) has long been recognized. However, individual studies, systematic reviews, and recent meta-analytic reviews were unsuccessful in establishing a consensus regarding a disorder-specific neuropsychological profile. In an attempt to identify methodological factors that may contribute to the inconsistency that is characteristic of this body of research, a systematic review of methodological factors in studies comparing OCD patients and non-psychiatric controls on neuropsychological tests was conducted. This review covered 115 studies that included nearly 3500 patients. Results revealed a range of methodological weaknesses. Some of these weaknesses have been previously noted in the broader neuropsychological literature, while some are more specific to psychiatric disorders, and to OCD. These methodological shortcomings have the potential to hinder the identification of a specific neuropsychological profile associated with OCD as well as to obscure the association between neurocognitive dysfunctions and contemporary neurobiological models. Rectifying these weaknesses may facilitate replicability, and promote our ability to extract cogent, meaningful, and more unified inferences regarding the neuropsychology of OCD. To that end, we present a set of methodological recommendations to facilitate future neuropsychology research in psychiatric disorders in general, and in OCD in particular. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

A systematic review of grounded theory studies in physiotherapy.

PubMed

Ali, Nancy; May, Stephen; Grafton, Kate

2018-05-23

This systematic review aimed at appraising the methodological rigor of grounded theory research published in the field of physiotherapy to assess how the methodology is understood and applied. A secondary aim was to provide research implications drawn from the findings to guide future grounded theory methodology (GTM) research. A systematic search was conducted in MEDLINE, CINHAL, SPORT Discus, Science Direct, PubMed, Scopus, and Web of Science to identify studies in the field of physiotherapy that reported using GTM and/or methods in the study title and/or abstract. The descriptive characteristics and methodological quality of eligible studies were examined using grounded theory methodology assessment guidelines. The review included 68 studies conducted between 1998 and 2017. The findings showed that GTM is becoming increasingly used by physiotherapy researchers. Thirty-six studies (53%) demonstrated a good understanding and appropriate application of GTM. Thirty-two studies (47%) presented descriptive findings and were considered to be of poor methodological quality. There are several key tenets of GTM that are integral to the iterative process of qualitative theorizing and need to be applied throughout all research practices including sampling, data collection, and analysis.

Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.

PubMed

Dosenovic, Svjetlana; Jelicic Kadic, Antonia; Vucic, Katarina; Markovina, Nikolina; Pieper, Dawid; Puljak, Livia

2018-05-08

Systematic reviews (SRs) in the field of neuropathic pain (NeuP) are increasingly important for decision-making. However, methodological flaws in SRs can reduce the validity of conclusions. Hence, it is important to assess the methodological quality of NeuP SRs critically. Additionally, it remains unclear which assessment tool should be used. We studied the methodological quality of SRs published in the field of NeuP and compared two assessment tools. We systematically searched 5 electronic databases to identify SRs of randomized controlled trials of interventions for NeuP available up to March 2015. Two independent reviewers assessed the methodological quality of the studies using the Assessment of Multiple Systematic Reviews (AMSTAR) and the revised AMSTAR (R-AMSTAR) tools. The scores were converted to percentiles and ranked into 4 grades to allow comparison between the two checklists. Gwet's AC1 coefficient was used for interrater reliability assessment. The 97 included SRs had a wide range of methodological quality scores (AMSTAR median (IQR): 6 (5-8) vs. R-AMSTAR median (IQR): 30 (26-35)). The overall agreement score between the 2 raters was 0.62 (95% CI 0.39-0.86) for AMSTAR and 0.62 (95% CI 0.53-0.70) for R-AMSTAR. The 31 Cochrane systematic reviews (CSRs) were consistently ranked higher than the 66 non-Cochrane systematic reviews (NCSRs). The analysis of individual domains showed the best compliance in a comprehensive literature search (item 3) on both checklists. The results for the domain that was the least compliant differed: conflict of interest (item 11) was the item most poorly reported on AMSTAR vs. publication bias assessment (item 10) on R-AMSTAR. A high positive correlation between the total AMSTAR and R-AMSTAR scores for all SRs, as well as for CSRs and NCSRs, was observed. The methodological quality of analyzed SRs in the field of NeuP was not optimal, and CSRs had a higher quality than NCSRs. Both AMSTAR and R-AMSTAR tools produced comparable quality ratings. Our results point out to weaknesses in the methodology of existing SRs on interventions for the management NeuP and call for future improvement by better adherence to analyzed quality checklists, either AMSTAR or R-AMSTAR.

Methodological and reporting quality of systematic reviews on tuberculosis.

PubMed

Nicolau, I; Ling, D; Tian, L; Lienhardt, C; Pai, M

2013-09-01

Systematic reviews are used to inform tuberculosis (TB) guidelines. However, there are no data on whether TB systematic reviews are conducted well and reported transparently. We searched four databases for reviews published between 2005 and 2010. Methodological quality was evaluated using AMSTAR and quality of reporting was assessed using PRISMA. Of 152 articles, 137 (90%) met the inclusion criteria. Only 3 of 11 AMSTAR quality items were met in most reviews: appropriate methods to combine findings (67%), comprehensive literature search (72%) and presentation of characteristics of included studies (90%). The other eight items were met in 4-53% of the reviews. Only 4% of the reviews disclosed conflicts of interest. The majority of the PRISMA items were reported in more than 60-76% of the reviews. Only nine items were reported in less than 55% of the reviews, the lowest being the full-search strategy (30%), risk of bias across studies in the Methods (27%) and Results (21%) sections, and indication of a review protocol (15%). Systematic reviews in our survey were well reported but generally of moderate to low quality. Better training, use of reporting guidelines and registration of systematic reviews could improve the quality of TB reviews.

Systematic Reviews of Research in Education: Aims, Myths and Multiple Methods

ERIC Educational Resources Information Center

Gough, David; Thomas, James

2016-01-01

Systematic reviews are still a controversial topic in some quarters, with the arguments for and against their use being well-rehearsed. In an attempt to advance a more nuanced approach to thinking about systematic reviewing, this paper illustrates the wide range of theoretical perspectives, methodologies and purposes that underpin the vast range…

A flood tide of systematic reviews on endodontic posts: methodological assessment using of R-AMSTAR.

PubMed

Schmitter, M; Sterzenbach, G; Faggion, C M; Krastl, G

2013-06-01

To help the dental practitioner solve a specific clinical problem, systematic reviews (SRs) are seen as the best guide. In addition to the unmanageable quantity of SRs, however, one should be aware of their variable quality. The present review describes the methodological quality of SRs on postendodontic restorations to work out the value of these reviews for the dental practitioner. SRs were searched in April 2012, independently and in triplicate. Post survival was used as measure of outcome. The methodological quality of included SRs was assessed with the Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) checklist. Kappa statistics were used to assess reviewer agreement. Three hundred sixty-three papers were retrieved from the initial search. Ten SRs were included. One SR achieved a high R-AMSTAR score, whereas the other nine SRs achieved scores that indicate a substantial lack of methodological quality. Especially the items "grey literature," "combination of findings," "likelihood of publication bias," and conflict of interest" showed low R-AMSTAR scores. The three reviews with the highest R-AMSTAR scores tended to conclude that fewer failures occurred when using nonmetal posts. The reviewer agreement was excellent (kappa ranged from 0.79 to 0.85) in the R-AMSTAR classification. The approach presented revealed a lack of SRs with high methodological quality. Thus, no decisive conclusion can be drawn with respect to this topic. It appears that there is a trend for the superiority of fiber-reinforced posts. SRs must be of high methodological quality. This can be achieved by taking into consideration the results of this review. Improved methodological quality would make SRs more supportive for the general practitioner.

Scoping meta-review: introducing a new methodology.

PubMed

Sarrami-Foroushani, Pooria; Travaglia, Joanne; Debono, Deborah; Clay-Williams, Robyn; Braithwaite, Jeffrey

2015-02-01

For researchers, policymakers, and practitioners facing a new field, undertaking a systematic review can typically present a challenge due to the enormous number of relevant papers. A scoping review is a method suggested for addressing this dilemma; however, scoping reviews present their own challenges. This paper introduces the "scoping meta-review" (SMR) for expanding current methodologies and is based on our experiences in mapping the field of consumer engagement in healthcare. During this process, we developed the novel SMR method. An SMR combines aspects of a scoping review and a meta-review to establish an evidence-based map of a field. Similar to a scoping review, an SMR offers a practical and flexible methodology. However, unlike in a traditional scoping review, only systematic reviews are included. Stages of the SMR include: undertaking a preliminary nonsystematic review; building a search strategy; interrogating academic literature databases; classifying and excluding studies based on titles and abstracts; saving the refined database of references; revising the search strategy; selecting and reviewing the full text papers; and thematically analyzing the selected texts and writing the report. The main benefit of an SMR is to map a new field based on high-level evidence provided by systematic reviews. © 2014 Wiley Periodicals, Inc.

Cochrane Systematic Reviews of Chinese Herbal Medicines: An Overview

PubMed Central

Hu, Jing; Zhang, Junhua; Zhao, Wei; Zhang, Yongling; Zhang, Li; Shang, Hongcai

2011-01-01

Objectives Our study had two objectives: a) to systematically identify all existing systematic reviews of Chinese herbal medicines (CHM) published in Cochrane Library; b) to assess the methodological quality of included reviews. Methodology/Principal Findings We performed a systematic search of the Cochrane Database of Systematic Reviews (CDSR, Issue 5, 2010) to identify all reviews of CHM. A total of fifty-eight reviews were eligible for our study. Twenty-one of the included reviews had at least one Traditional Chinese Medicine (TCM) practitioner as its co-author. 7 reviews didn't include any primary study, the remaining reviews (n = 51) included a median of 9 studies and 936 participants. 50% of reviews were last assessed as up-to-date prior to 2008. The questions addressed by 39 reviews were broad in scope, in which 9 reviews combined studies with different herbal medicines. For OQAQ, the mean of overall quality score (item 10) was 5.05 (95% CI; 4.58-5.52). All reviews assessed the methodological quality of primary studies, 16% of included primary studies used adequate sequence generation and 7% used adequate allocation concealment. Of the 51 nonempty reviews, 23 reviews were reported as being inconclusive, while 27 concluded that there might be benefit of CHM, which was limited by the poor quality or inadequate quantity of included studies. 58 reviews reported searching a median of seven electronic databases, while 10 reviews did not search any Chinese database. Conclusions Now CDSR has included large numbers of CHM reviews, our study identified some areas which could be improved, such as almost half of included reviews did not have the participation of TCM practitioners and were not up-to-date according to Cochrane criteria, some reviews pooled the results of different herbal medicines and ignored the searching of Chinese databases. PMID:22174870

The effectiveness of massage therapy for the treatment of nonspecific low back pain: a systematic review of systematic reviews

PubMed Central

Kumar, Saravana; Beaton, Kate; Hughes, Tricia

2013-01-01

Introduction The last decade has seen a growth in the utilization of complementary and alternative medicine therapies, and one of the most popular and sought-after complementary and alternative medicine therapies for nonspecific low back pain is massage. Massage may often be perceived as a safe therapeutic modality without any significant risks or side effects. However, despite its popularity, there continues to be ongoing debate on the effectiveness of massage in treating nonspecific low back pain. With a rapidly evolving research evidence base and access to innovative means of synthesizing evidence, it is time to reinvestigate this issue. Methods A systematic, step-by-step approach, underpinned by best practice in reviewing the literature, was utilized as part of the methodology of this umbrella review. A systematic search was conducted in the following databases: Embase, MEDLINE, AMED, ICONDA, Academic Search Premier, Australia/New Zealand Reference Centre, CINAHL, HealthSource, SPORTDiscus, PubMed, The Cochrane Library, Scopus, Web of Knowledge/Web of Science, PsycINFO, and ProQuest Nursing and Allied Health Source, investigating systematic reviews and meta-analyses from January 2000 to December 2012, and restricted to English-language documents. Methodological quality of included reviews was undertaken using the Centre for Evidence Based Medicine critical appraisal tool. Results Nine systematic reviews were found. The methodological quality of the systematic reviews varied (from poor to excellent) although, overall, the primary research informing these systematic reviews was generally considered to be weak quality. The findings indicate that massage may be an effective treatment option when compared to placebo and some active treatment options (such as relaxation), especially in the short term. There is conflicting and contradictory findings for the effectiveness of massage therapy for the treatment of nonspecific low back pain when compared against other manual therapies (such as mobilization), standard medical care, and acupuncture. Conclusion There is an emerging body of evidence, albeit small, that supports the effectiveness of massage therapy for the treatment of non-specific low back pain in the short term. Due to common methodological flaws in the primary research, which informed the systematic reviews, recommendations arising from this evidence base should be interpreted with caution. PMID:24043951

Developing the WCRF International/University of Bristol Methodology for Identifying and Carrying Out Systematic Reviews of Mechanisms of Exposure-Cancer Associations.

PubMed

Lewis, Sarah J; Gardner, Mike; Higgins, Julian; Holly, Jeff M P; Gaunt, Tom R; Perks, Claire M; Turner, Suzanne D; Rinaldi, Sabina; Thomas, Steve; Harrison, Sean; Lennon, Rosie J; Tan, Vanessa; Borwick, Cath; Emmett, Pauline; Jeffreys, Mona; Northstone, Kate; Mitrou, Giota; Wiseman, Martin; Thompson, Rachel; Martin, Richard M

2017-11-01

Background: Human, animal, and cell experimental studies; human biomarker studies; and genetic studies complement epidemiologic findings and can offer insights into biological plausibility and pathways between exposure and disease, but methods for synthesizing such studies are lacking. We, therefore, developed a methodology for identifying mechanisms and carrying out systematic reviews of mechanistic studies that underpin exposure-cancer associations. Methods: A multidisciplinary team with expertise in informatics, statistics, epidemiology, systematic reviews, cancer biology, and nutrition was assembled. Five 1-day workshops were held to brainstorm ideas; in the intervening periods we carried out searches and applied our methods to a case study to test our ideas. Results: We have developed a two-stage framework, the first stage of which is designed to identify mechanisms underpinning a specific exposure-disease relationship; the second stage is a targeted systematic review of studies on a specific mechanism. As part of the methodology, we also developed an online tool for text mining for mechanism prioritization (TeMMPo) and a new graph for displaying related but heterogeneous data from epidemiologic studies (the Albatross plot). Conclusions: We have developed novel tools for identifying mechanisms and carrying out systematic reviews of mechanistic studies of exposure-disease relationships. In doing so, we have outlined how we have overcome the challenges that we faced and provided researchers with practical guides for conducting mechanistic systematic reviews. Impact: The aforementioned methodology and tools will allow potential mechanisms to be identified and the strength of the evidence underlying a particular mechanism to be assessed. Cancer Epidemiol Biomarkers Prev; 26(11); 1667-75. ©2017 AACR . ©2017 American Association for Cancer Research.

Systematic Reviews in Sports Medicine.

PubMed

DiSilvestro, Kevin J; Tjoumakaris, Fotios P; Maltenfort, Mitchell G; Spindler, Kurt P; Freedman, Kevin B

2016-02-01

The number of systematic reviews published in the orthopaedic literature has increased, and these reviews can help guide clinical decision making. However, the quality of these reviews can affect the reader's ability to use the data to arrive at accurate conclusions and make clinical decisions. To evaluate the methodological and reporting quality of systematic reviews and meta-analyses in the sports medicine literature to determine whether such reviews should be used to guide treatment decisions. The hypothesis was that many systematic reviews in the orthopaedic sports medicine literature may not follow the appropriate reporting guidelines or methodological criteria recommended for systematic reviews. Systematic review. All clinical sports medicine systematic reviews and meta-analyses from 2009 to 2013 published in The American Journal of Sports Medicine (AJSM), The Journal of Bone and Joint Surgery (JBJS), Arthroscopy, Sports Health, and Knee Surgery, Sports Traumatology, Arthroscopy (KSSTA) were reviewed and evaluated for level of evidence according to the guidelines from the Oxford Centre for Evidence-Based Medicine, for reporting quality according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, and for methodological quality according to the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Analysis was performed by year and journal of publication, and the levels of evidence included in the systematic reviews were also analyzed. A total of 200 systematic reviews and meta-analyses were identified over the study period. Of these, 53% included evidence levels 4 and 5 in their analyses, with just 32% including evidence levels 1 and 2 only. There were significant differences in the proportion of articles with high levels of evidence (P < .001) and low levels of evidence (P = .005) by journal. The average PRISMA score was 87% and the average AMSTAR score was 73% among all journals. The average AMSTAR and PRISMA scores were significantly different by journal (P = .002 and .001, respectively) and by year (P = .046 and .019, respectively). Arthroscopy, AJSM, and JBJS all scored higher than Sports Health and KSSTA on the PRISMA and AMSTAR. The average PRISMA score by year varied from 85% to 89%, and the average AMSTAR score varied from 70% to 76%. Systematic reviews and meta-analyses in orthopaedics sports medicine literature relied on evidence levels 4 and 5 in 53% of studies over the 5-year study period. Overall, PRISMA and AMSTAR scores are high and may be better than those in other disciplines. Readers need to be conscious of potential shortcomings when reading systematic reviews and using them in practice. © 2015 The Author(s).

The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration

PubMed Central

Liberati, Alessandro; Altman, Douglas G; Tetzlaff, Jennifer; Mulrow, Cynthia; Gøtzsche, Peter C; Ioannidis, John P A; Clarke, Mike; Devereaux, P J; Kleijnen, Jos; Moher, David

2009-01-01

Systematic reviews and meta-analyses are essential to summarise evidence relating to efficacy and safety of healthcare interventions accurately and reliably. The clarity and transparency of these reports, however, are not optimal. Poor reporting of systematic reviews diminishes their value to clinicians, policy makers, and other users. Since the development of the QUOROM (quality of reporting of meta-analysis) statement—a reporting guideline published in 1999—there have been several conceptual, methodological, and practical advances regarding the conduct and reporting of systematic reviews and meta-analyses. Also, reviews of published systematic reviews have found that key information about these studies is often poorly reported. Realising these issues, an international group that included experienced authors and methodologists developed PRISMA (preferred reporting items for systematic reviews and meta-analyses) as an evolution of the original QUOROM guideline for systematic reviews and meta-analyses of evaluations of health care interventions. The PRISMA statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. In this explanation and elaboration document, we explain the meaning and rationale for each checklist item. For each item, we include an example of good reporting and, where possible, references to relevant empirical studies and methodological literature. The PRISMA statement, this document, and the associated website (www.prisma-statement.org/) should be helpful resources to improve reporting of systematic reviews and meta-analyses. PMID:19622552

Systematic reviews of surgical procedures in children: quantity, coverage and quality.

PubMed

McGee, Richard G; Craig, Jonathan C; Rogerson, Thomas E; Webster, Angela C

2013-04-01

Systematic reviews have the potential to map those areas where children are under-represented in surgical research. We aimed to describe and evaluate the quantity, coverage and the quality of conduct and reporting of systematic reviews of surgical procedures in children. We searched four biomedical databases, a systematic review register, reference lists and conducted hand searching to identify relevant reviews. Two reviewers worked independently to critically appraise included studies and abstract data. We assessed reporting quality using the preferred reporting items for systematic reviews and meta-analysis statement and methodological quality using the Assessment of Multiple SysTemAtic Reviews tool. Fifteen systematic reviews were identified, representing 0.01% of all paediatric surgical citations in MEDLINE and Embase. Thirteen of the reviews were Cochrane reviews, and most reviews (12/15) addressed subspecialty interests such as otorhinolaryngology. The median number of included trials per systematic review was four (interquartile range 1 to 9.5), the median number of primary outcomes was 5.5 (interquartile range 3.5 to 7.5). In general, reporting and methodological quality was good although there were several omissions, particularly around completeness of reporting of statistical methods used, and utilisation of quality assessments in analyses. Outcomes were often not clearly defined and descriptions of procedures lacked sufficient detail to determine the similarities and differences among surgical procedures within the contributing trials. Systematic reviews of surgical procedures in children are rarely published. To improve the evidence base and guide research agendas, more systematic reviews should be conducted, using standard guidelines for conduct and reporting. © 2013 The Authors. Journal of Paediatrics and Child Health © 2013 Paediatrics and Child Health Division (Royal Australasian College of Physicians).

Interventions for postoperative pain in children: An overview of systematic reviews.

PubMed

Boric, Krste; Dosenovic, Svjetlana; Jelicic Kadic, Antonia; Batinic, Marijan; Cavar, Marija; Urlic, Marjan; Markovina, Nikolina; Puljak, Livia

2017-09-01

The aim of this study was to conduct an overview of systematic reviews that summarizes the results about efficacy and safety from randomized controlled trials involving the various strategies used for postoperative pain management in children. We searched the Cochrane Database of Systematic Reviews, CINAHL, Database of Reviews of Effect, Embase, MEDLINE, and PsycINFO from the earliest date to January 24, 2016. This overview included 45 systematic reviews that evaluated interventions for postoperative pain in children. Out of 45 systematic reviews that investigated various interventions for postoperative pain in children, 19 systematic reviews (42%) presented conclusive evidence of efficacy. Positive conclusive evidence was reported in 18 systematic reviews (40%) for the efficacy of diclofenac, ketamine, caudal analgesia, dexmedetomidine, music therapy, corticosteroid, epidural analgesia, paracetamol, and/or nonsteroidal anti-inflammatory drugs and transversus abdominis plane block. Only one systematic review reported conclusive evidence of equal efficacy that involved a comparison of dexmedetomidine vs morphine and fentanyl. Safety of interventions was reported as conclusive in 14 systematic reviews (31%), with positive conclusive evidence for dexmedetomidine, corticosteroid, epidural analgesia, transversus abdominis plane block, and clonidine. Seven systematic reviews reported equal conclusive safety for epidural infusion, diclofenac intravenous vs ketamine added to opioid analgesia, bupivacaine, ketamine, paracetamol, and dexmedetomidine vs intravenous infusions of various opioid analgesics, oral suspension and suppository of diclofenac, only opioid, normal saline, no treatment, placebo, and midazolam. Negative conclusive statement for safety was reported in one systematic review for caudal analgesia vs noncaudal regional analgesia. More than half of systematic reviews included in this overview were rated as having medium methodological quality. Of 45 included systematic reviews, 10 were Cochrane reviews and they had higher methodological quality than non-Cochrane reviews. As evidence concerning efficacy and safety is inconclusive for most of the analyzed interventions, our review points out the need for more rigorous trials concerning pain management in children. © 2017 John Wiley & Sons Ltd.

Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist.

PubMed

Terwee, Caroline B; Mokkink, Lidwine B; Knol, Dirk L; Ostelo, Raymond W J G; Bouter, Lex M; de Vet, Henrica C W

2012-05-01

The COSMIN checklist is a standardized tool for assessing the methodological quality of studies on measurement properties. It contains 9 boxes, each dealing with one measurement property, with 5-18 items per box about design aspects and statistical methods. Our aim was to develop a scoring system for the COSMIN checklist to calculate quality scores per measurement property when using the checklist in systematic reviews of measurement properties. The scoring system was developed based on discussions among experts and testing of the scoring system on 46 articles from a systematic review. Four response options were defined for each COSMIN item (excellent, good, fair, and poor). A quality score per measurement property is obtained by taking the lowest rating of any item in a box ("worst score counts"). Specific criteria for excellent, good, fair, and poor quality for each COSMIN item are described. In defining the criteria, the "worst score counts" algorithm was taken into consideration. This means that only fatal flaws were defined as poor quality. The scores of the 46 articles show how the scoring system can be used to provide an overview of the methodological quality of studies included in a systematic review of measurement properties. Based on experience in testing this scoring system on 46 articles, the COSMIN checklist with the proposed scoring system seems to be a useful tool for assessing the methodological quality of studies included in systematic reviews of measurement properties.

Systematic reviews: guidance relevant for studies of older people.

PubMed

Shenkin, Susan D; Harrison, Jennifer K; Wilkinson, Tim; Dodds, Richard M; Ioannidis, John P A

2017-09-01

Systematic reviews and meta-analyses are increasingly common. This article aims to provide guidance for people conducting systematic reviews relevant to the healthcare of older people. An awareness of these issues will also help people reading systematic reviews to determine whether the results will influence their clinical practice. It is essential that systematic reviews are performed by a team which includes the required technical and clinical expertise. Those performing reviews for the first time should ensure they have appropriate training and support. They must be planned and performed in a transparent and methodologically robust way: guidelines are available. The protocol should be written-and if possible published-before starting the review. Geriatricians will be interested in a table of baseline characteristics, which will help to determine if the studied samples or populations are similar to their patients. Reviews of studies of older people should consider how they will manage issues such as different age cut-offs; non-specific presentations; multiple predictors and outcomes; potential biases and confounders. Systematic reviews and meta-analyses may provide evidence to improve older people's care, or determine where new evidence is required. Newer methodologies, such as meta-analyses of individual level data, network meta-analyses and umbrella reviews, and realist synthesis, may improve the reliability and clinical utility of systematic reviews. © The Author 2017. Published by Oxford University Press on behalf of the British Geriatrics Society.

Systematic Reviews and Meta-Analyses of Home Telemonitoring Interventions for Patients With Chronic Diseases: A Critical Assessment of Their Methodological Quality

PubMed Central

2013-01-01

Background Systematic reviews and meta-analyses of home telemonitoring interventions for patients with chronic diseases have increased over the past decade and become increasingly important to a wide range of clinicians, policy makers, and other health care stakeholders. While a few criticisms about their methodological rigor and synthesis approaches have recently appeared, no formal appraisal of their quality has been conducted yet. Objective The primary aim of this critical review was to evaluate the methodology, quality, and reporting characteristics of prior reviews that have investigated the effects of home telemonitoring interventions in the context of chronic diseases. Methods Ovid MEDLINE, the Database of Abstract of Reviews of Effects (DARE), and Health Technology Assessment Database (HTA) of the Cochrane Library were electronically searched to find relevant systematic reviews, published between January 1966 and December 2012. Potential reviews were screened and assessed for inclusion independently by three reviewers. Data pertaining to the methods used were extracted from each included review and examined for accuracy by two reviewers. A validated quality assessment instrument, R-AMSTAR, was used as a framework to guide the assessment process. Results Twenty-four reviews, nine of which were meta-analyses, were identified from more than 200 citations. The bibliographic search revealed that the number of published reviews has increased substantially over the years in this area and although most reviews focus on studying the effects of home telemonitoring on patients with congestive heart failure, researcher interest has extended to other chronic diseases as well, such as diabetes, hypertension, chronic obstructive pulmonary disease, and asthma. Nevertheless, an important number of these reviews appear to lack optimal scientific rigor due to intrinsic methodological issues. Also, the overall quality of reviews does not appear to have improved over time. While several criteria were met satisfactorily by either all or nearly all reviews, such as the establishment of an a priori design with inclusion and exclusion criteria, use of electronic searches on multiple databases, and reporting of studies characteristics, there were other important areas that needed improvement. Duplicate data extraction, manual searches of highly relevant journals, inclusion of gray and non-English literature, assessment of the methodological quality of included studies and quality of evidence were key methodological procedures that were performed infrequently. Furthermore, certain methodological limitations identified in the synthesis of study results have affected the results and conclusions of some reviews. Conclusions Despite the availability of methodological guidelines that can be utilized to guide the proper conduct of systematic reviews and meta-analyses and eliminate potential risks of bias, this knowledge has not yet been fully integrated in the area of home telemonitoring. Further efforts should be made to improve the design, conduct, reporting, and publication of systematic reviews and meta-analyses in this area. PMID:23880072

Epidemiology, methodological and reporting characteristics of systematic reviews of nursing interventions published in China.

PubMed

Shi, Chunhu; Zhu, Lin; Wang, Xue; Qin, Chunxia; Xu, Qi; Tian, Jinhui

2014-12-01

The importance of systematic reviews (SRs) of nursing interventions' impact on practice makes their methodological quality and reporting characteristics especially important as it directly influence their utility for clinicians, patients and policy makers.The study aims to assess the methodological quality and reporting characteristics of SRs of nursing interventions in Chinese nursing journals. Three Chinese databases were searched for SRs of nursing interventions from inception to October 2011. The assessment of multiple systematic reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) statements were used to assess methodological quality and reporting characteristics. Seventy-four SRs were included. The proportion of SRs complying with AMSTAR checklist items ranged from 0% to 82.4%. No SRs reported an 'a priori' design or conflict of interest. Only four items were found to be reported in more than 50% of the SRs: a list of included and excluded studies, the scientific quality of included studies, the appropriate use of methods to combine findings, and formulating conclusions appropriately. The majority of SRs of nursing interventions in China had major methodological and reporting flaws that limited their value to guide decisions. Chinese authors and journals should adopt and keep up with the AMSTAR and PRISMA statements to improve the quality of SRs in this field. © 2014 Wiley Publishing Asia Pty Ltd.

School Leadership and Management in South Africa: Findings from a Systematic Literature Review

ERIC Educational Resources Information Center

Bush, Tony; Glover, Derek

2016-01-01

Purpose: The purpose of this paper is to provide a systematic review of the literature on school leadership and management in South Africa, linked to the 20th anniversary of democratic government and integrated education. Design/Methodology/Approach: The authors conducted a systematic review of all published work since 2007 with a more selective…

Behavioural Intervention Practices for Stereotypic and Repetitive Behaviour in Individuals with Autism Spectrum Disorder: A Systematic Review

ERIC Educational Resources Information Center

Patterson, Stephanie Y.; Smith, Veronica; Jelen, Michaela

2010-01-01

Aim: The purpose of this systematic review was to examine the quality of conduct of experimental studies contributing to our empirical understanding of function-based behavioural interventions for stereotypic and repetitive behaviours (SRBs) in individuals with autism spectrum disorders (ASDs). Method: Systematic review methodology was used to…

Considering methodological options for reviews of theory: illustrated by a review of theories linking income and health.

PubMed

Campbell, Mhairi; Egan, Matt; Lorenc, Theo; Bond, Lyndal; Popham, Frank; Fenton, Candida; Benzeval, Michaela

2014-10-13

Review of theory is an area of growing methodological advancement. Theoretical reviews are particularly useful where the literature is complex, multi-discipline, or contested. It has been suggested that adopting methods from systematic reviews may help address these challenges. However, the methodological approaches to reviews of theory, including the degree to which systematic review methods can be incorporated, have received little discussion in the literature. We recently employed systematic review methods in a review of theories about the causal relationship between income and health. This article discusses some of the methodological issues we considered in developing the review and offers lessons learnt from our experiences. It examines the stages of a systematic review in relation to how they could be adapted for a review of theory. The issues arising and the approaches taken in the review of theories in income and health are considered, drawing on the approaches of other reviews of theory. Different approaches to searching were required, including electronic and manual searches, and electronic citation tracking to follow the development of theories. Determining inclusion criteria was an iterative process to ensure that inclusion criteria were specific enough to make the review practical and focused, but not so narrow that key literature was excluded. Involving subject specialists was valuable in the literature searches to ensure principal papers were identified and during the inductive approaches used in synthesis of theories to provide detailed understanding of how theories related to another. Reviews of theory are likely to involve iterations and inductive processes throughout, and some of the concepts and techniques that have been developed for qualitative evidence synthesis can be usefully translated to theoretical reviews of this kind. It may be useful at the outset of a review of theory to consider whether the key aim of the review is to scope out theories relating to a particular issue; to conduct in-depth analysis of key theoretical works with the aim of developing new, overarching theories and interpretations; or to combine both these processes in the review. This can help decide the most appropriate methodological approach to take at particular stages of the review.

Aromatherapy for health care: an overview of systematic reviews.

PubMed

Lee, Myeong Soo; Choi, Jiae; Posadzki, Paul; Ernst, Edzard

2012-03-01

Aromatherapy is the therapeutic use of essential oil from herbs, flowers, and other plants. The aim of this overview was to provide an overview of systematic reviews evaluating the effectiveness of aromatherapy. We searched 12 electronic databases and our departmental files without restrictions of time or language. The methodological quality of all systematic reviews was evaluated independently by two authors. Of 201 potentially relevant publications, 10 met our inclusion criteria. Most of the systematic reviews were of poor methodological quality. The clinical subject areas were hypertension, depression, anxiety, pain relief, and dementia. For none of the conditions was the evidence convincing. Several SRs of aromatherapy have recently been published. Due to a number of caveats, the evidence is not sufficiently convincing that aromatherapy is an effective therapy for any condition. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Author-paper affiliation network architecture influences the methodological quality of systematic reviews and meta-analyses of psoriasis

PubMed Central

Gomez-Garcia, Francisco; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Maestre-Lopez, Beatriz; Gonzalez-Padilla, Marcelino; Carmona-Fernandez, Pedro J.; Velez Garcia-Nieto, Antonio; Isla-Tejera, Beatriz

2017-01-01

Moderate-to-severe psoriasis is associated with significant comorbidity, an impaired quality of life, and increased medical costs, including those associated with treatments. Systematic reviews (SRs) and meta-analyses (MAs) of randomized clinical trials are considered two of the best approaches to the summarization of high-quality evidence. However, methodological bias can reduce the validity of conclusions from these types of studies and subsequently impair the quality of decision making. As co-authorship is among the most well-documented forms of research collaboration, the present study aimed to explore whether authors’ collaboration methods might influence the methodological quality of SRs and MAs of psoriasis. Methodological quality was assessed by two raters who extracted information from full articles. After calculating total and per-item Assessment of Multiple Systematic Reviews (AMSTAR) scores, reviews were classified as low (0-4), medium (5-8), or high (9-11) quality. Article metadata and journal-related bibliometric indices were also obtained. A total of 741 authors from 520 different institutions and 32 countries published 220 reviews that were classified as high (17.2%), moderate (55%), or low (27.7%) methodological quality. The high methodological quality subnetwork was larger but had a lower connection density than the low and moderate methodological quality subnetworks; specifically, the former contained relatively fewer nodes (authors and reviews), reviews by authors, and collaborators per author. Furthermore, the high methodological quality subnetwork was highly compartmentalized, with several modules representing few poorly interconnected communities. In conclusion, structural differences in author-paper affiliation network may influence the methodological quality of SRs and MAs on psoriasis. As the author-paper affiliation network structure affects study quality in this research field, authors who maintain an appropriate balance between scientific quality and productivity are more likely to develop higher quality reviews. PMID:28403245

The conceptual framework and assessment methodology for the systematic reviews of community-based interventions for the prevention and control of infectious diseases of poverty.

PubMed

Lassi, Zohra S; Salam, Rehana A; Das, Jai K; Bhutta, Zulfiqar A

2014-01-01

This paper describes the conceptual framework and the methodology used to guide the systematic reviews of community-based interventions (CBIs) for the prevention and control of infectious diseases of poverty (IDoP). We adapted the conceptual framework from the 3ie work on the 'Community-Based Intervention Packages for Preventing Maternal Morbidity and Mortality and Improving Neonatal Outcomes' to aid in the analyzing of the existing CBIs for IDoP. The conceptual framework revolves around objectives, inputs, processes, outputs, outcomes, and impacts showing the theoretical linkages between the delivery of the interventions targeting these diseases through various community delivery platforms and the consequent health impacts. We also describe the methodology undertaken to conduct the systematic reviews and the meta-analyses.

Child maltreatment prevention: a systematic review of reviews.

PubMed

Mikton, Christopher; Butchart, Alexander

2009-05-01

To synthesize recent evidence from systematic and comprehensive reviews on the effectiveness of universal and selective child maltreatment prevention interventions, evaluate the methodological quality of the reviews and outcome evaluation studies they are based on, and map the geographical distribution of the evidence. A systematic review of reviews was conducted. The quality of the systematic reviews was evaluated with a tool for the assessment of multiple systematic reviews (AMSTAR), and the quality of the outcome evaluations was assessed using indicators of internal validity and of the construct validity of outcome measures. The review focused on seven main types of interventions: home visiting, parent education, child sex abuse prevention, abusive head trauma prevention, multi-component interventions, media-based interventions, and support and mutual aid groups. Four of the seven - home-visiting, parent education, abusive head trauma prevention and multi-component interventions - show promise in preventing actual child maltreatment. Three of them - home visiting, parent education and child sexual abuse prevention - appear effective in reducing risk factors for child maltreatment, although these conclusions are tentative due to the methodological shortcomings of the reviews and outcome evaluation studies they draw on. An analysis of the geographical distribution of the evidence shows that outcome evaluations of child maltreatment prevention interventions are exceedingly rare in low- and middle-income countries and make up only 0.6% of the total evidence base. Evidence for the effectiveness of four of the seven main types of interventions for preventing child maltreatment is promising, although it is weakened by methodological problems and paucity of outcome evaluations from low- and middle-income countries.

Does consideration and assessment of effects on health equity affect the conclusions of systematic reviews? A methodology study.

PubMed

Welch, Vivian; Petticrew, Mark; Ueffing, Erin; Benkhalti Jandu, Maria; Brand, Kevin; Dhaliwal, Bharbhoor; Kristjansson, Elizabeth; Smylie, Janet; Wells, George Anthony; Tugwell, Peter

2012-01-01

Tackling health inequities both within and between countries remains high on the agenda of international organizations including the World Health Organization and local, regional and national governments. Systematic reviews can be a useful tool to assess effects on equity in health status because they include studies conducted in a variety of settings and populations. This study aims to describe the extent to which the impacts of health interventions on equity in health status are considered in systematic reviews, describe methods used, and assess the implications of their equity related findings for policy, practice and research. We conducted a methodology study of equity assessment in systematic reviews. Two independent reviewers extracted information on the reporting and analysis of impacts of health interventions on equity in health status in a group of 300 systematic reviews collected from all systematic reviews indexed in one month of MEDLINE, using a pre-tested data collection form. Any differences in data extraction were resolved by discussion. Of the 300 systematic reviews, 224 assessed the effectiveness of interventions on health outcomes. Of these 224 reviews, 29 systematic reviews assessed effects on equity in health status using subgroup analysis or targeted analyses of vulnerable populations. Of these, seven conducted subgroup analyses related to health equity which were reported in insufficient detail to judge their credibility. Of these 29 reviews, 18 described implications for policy and practice based on assessment of effects on health equity. The quality and completeness of reporting should be enhanced as a priority, because without this policymakers and practitioners will continue lack the evidence base they need to inform decision-making about health inequity. Furthermore, there is a need to develop methods to systematically consider impacts on equity in health status that is currently lacking in systematic reviews.

Survey of systematic review authors in dentistry: challenges in methodology and reporting.

PubMed

Major, Michael P; Warren, Sharon; Flores-Mir, Carlos

2009-04-01

The study reported in this article had three objectives: 1) identify the challenges faced by authors of dental systematic reviews (SR) during the process of literature search and selection; 2) determine whether dental SR authors' responses to survey questions about their study methodology were consistent with the reported published methodology; and 3) assess whether dental SR authors' evidence-based publication experience was associated with reported methodology. Seventy-eight authors (53 percent) of dental SRs out of 147 potential authors published from 2000 to 2006 responded to an online survey. According to the respondents, the most challenging aspects of literature search and selection were the initial design and performing extended literature searches. Agreement between the protocol identified by SR authors on the survey and the actual protocol described in their publications was fair to moderate. There were virtually no correlations between authors' publication experience, systematic review literature search, and selection thoroughness except for the number of past SRs published, and no differences in thoroughness between SRs written by clinicians (dental practitioners in the community) and dental school faculty members. Dental SR authors do not appear to fully appreciate the importance of extensive literature searches as central to the validity of their systematic review methods and potential findings.

Collaboration challenges in systematic reviews: a survey of health sciences librarians

PubMed Central

Nicholson, Joey; McCrillis, Aileen; Williams, Jeff D.

2017-01-01

Objective: While many librarians have been asked to participate in systematic reviews with researchers, often these researchers are not familiar with the systematic review process or the appropriate role for librarians. The purpose of this study was to identify the challenges and barriers that librarians face when collaborating on systematic reviews. To take a wider view of the whole process of collaborating on systematic reviews, the authors deliberately focused on interpersonal and methodological issues other than searching itself. Methods: To characterize the biggest challenges that librarians face while collaborating on systematic review projects, we used a web-based survey. The thirteen-item survey included seventeen challenges grouped into two categories: methodological and interpersonal. Participants were required to indicate the frequency and difficulty of the challenges listed. Open-ended questions allowed survey participants to describe challenges not listed in the survey and to describe strategies used to overcome challenges. Results: Of the 17 challenges listed in the survey, 8 were reported as common by over 40% of respondents. These included methodological issues around having too broad or narrow research questions, lacking eligibility criteria, having unclear research questions, and not following established methods. The remaining challenges were interpersonal, including issues around student-led projects and the size of the research team. Of the top 8 most frequent challenges, 5 were also ranked as most difficult to handle. Open-ended responses underscored many of the challenges included in the survey and revealed several additional challenges. Conclusions: These results suggest that the most frequent and challenging issues relate to development of the research question and general communication with team members. Clear protocols for collaboration on systematic reviews, as well as a culture of mentorship, can help librarians prevent and address these challenges. PMID:28983202

Collaboration challenges in systematic reviews: a survey of health sciences librarians.

PubMed

Nicholson, Joey; McCrillis, Aileen; Williams, Jeff D

2017-10-01

While many librarians have been asked to participate in systematic reviews with researchers, often these researchers are not familiar with the systematic review process or the appropriate role for librarians. The purpose of this study was to identify the challenges and barriers that librarians face when collaborating on systematic reviews. To take a wider view of the whole process of collaborating on systematic reviews, the authors deliberately focused on interpersonal and methodological issues other than searching itself. To characterize the biggest challenges that librarians face while collaborating on systematic review projects, we used a web-based survey. The thirteen-item survey included seventeen challenges grouped into two categories: methodological and interpersonal. Participants were required to indicate the frequency and difficulty of the challenges listed. Open-ended questions allowed survey participants to describe challenges not listed in the survey and to describe strategies used to overcome challenges. Of the 17 challenges listed in the survey, 8 were reported as common by over 40% of respondents. These included methodological issues around having too broad or narrow research questions, lacking eligibility criteria, having unclear research questions, and not following established methods. The remaining challenges were interpersonal, including issues around student-led projects and the size of the research team. Of the top 8 most frequent challenges, 5 were also ranked as most difficult to handle. Open-ended responses underscored many of the challenges included in the survey and revealed several additional challenges. These results suggest that the most frequent and challenging issues relate to development of the research question and general communication with team members. Clear protocols for collaboration on systematic reviews, as well as a culture of mentorship, can help librarians prevent and address these challenges.

Complexities and Perplexities: A Critical Appraisal of the Evidence for Soil-Transmitted Helminth Infection-Related Morbidity

PubMed Central

Nery, Susana V.; Doi, Suhail A.; Gray, Darren J.; Soares Magalhães, Ricardo J.; McCarthy, James S.; Traub, Rebecca J.; Andrews, Ross M.; Clements, Archie C. A.

2016-01-01

Background: Soil-transmitted helminths (STH) have acute and chronic manifestations, and can result in lifetime morbidity. Disease burden is difficult to quantify, yet quantitative evidence is required to justify large-scale deworming programmes. A recent Cochrane systematic review, which influences Global Burden of Disease (GBD) estimates for STH, has again called into question the evidence for deworming benefit on morbidity due to STH. In this narrative review, we investigate in detail what the shortfalls in evidence are. Methodology/Principal Findings: We systematically reviewed recent literature that used direct measures to investigate morbidity from STH and we critically appraised systematic reviews, particularly the most recent Cochrane systematic review investigating deworming impact on morbidity. We included six systematic reviews and meta-analyses, 36 literature reviews, 44 experimental or observational studies, and five case series. We highlight where evidence is insufficient and where research needs to be directed to strengthen morbidity evidence, ideally to prove benefits of deworming. Conclusions/Significance: Overall, the Cochrane systematic review and recent studies indicate major shortfalls in evidence for direct morbidity. However, it is questionable whether the systematic review methodology should be applied to STH due to heterogeneity of the prevalence of different species in each setting. Urgent investment in studies powered to detect direct morbidity effects due to STH is required. PMID:27196100

Citation of previous meta-analyses on the same topic: a clue to perpetuation of incorrect methods?

PubMed

Li, Tianjing; Dickersin, Kay

2013-06-01

Systematic reviews and meta-analyses serve as a basis for decision-making and clinical practice guidelines and should be carried out using appropriate methodology to avoid incorrect inferences. We describe the characteristics, statistical methods used for meta-analyses, and citation patterns of all 21 glaucoma systematic reviews we identified pertaining to the effectiveness of prostaglandin analog eye drops in treating primary open-angle glaucoma, published between December 2000 and February 2012. We abstracted data, assessed whether appropriate statistical methods were applied in meta-analyses, and examined citation patterns of included reviews. We identified two forms of problematic statistical analyses in 9 of the 21 systematic reviews examined. Except in 1 case, none of the 9 reviews that used incorrect statistical methods cited a previously published review that used appropriate methods. Reviews that used incorrect methods were cited 2.6 times more often than reviews that used appropriate statistical methods. We speculate that by emulating the statistical methodology of previous systematic reviews, systematic review authors may have perpetuated incorrect approaches to meta-analysis. The use of incorrect statistical methods, perhaps through emulating methods described in previous research, calls conclusions of systematic reviews into question and may lead to inappropriate patient care. We urge systematic review authors and journal editors to seek the advice of experienced statisticians before undertaking or accepting for publication a systematic review and meta-analysis. The author(s) have no proprietary or commercial interest in any materials discussed in this article. Copyright © 2013 American Academy of Ophthalmology. Published by Elsevier Inc. All rights reserved.

Conducting systematic reviews of association (etiology): The Joanna Briggs Institute's approach.

PubMed

Moola, Sandeep; Munn, Zachary; Sears, Kim; Sfetcu, Raluca; Currie, Marian; Lisy, Karolina; Tufanaru, Catalin; Qureshi, Rubab; Mattis, Patrick; Mu, Peifan

2015-09-01

The systematic review of evidence is the research method which underpins the traditional approach to evidence-based healthcare. There is currently no uniform methodology for conducting a systematic review of association (etiology). This study outlines and describes the Joanna Briggs Institute's approach and guidance for synthesizing evidence related to association with a predominant focus on etiology and contributes to the emerging field of systematic review methodologies. It should be noted that questions of association typically address etiological or prognostic issues.The systematic review of studies to answer questions of etiology follows the same basic principles of systematic review of other types of data. An a priori protocol must inform the conduct of the systematic review, comprehensive searching must be performed and critical appraisal of retrieved studies must be carried out.The overarching objective of systematic reviews of etiology is to identify and synthesize the best available evidence on the factors of interest that are associated with a particular disease or outcome. The traditional PICO (population, interventions, comparators and outcomes) format for systematic reviews of effects does not align with questions relating to etiology. A systematic review of etiology should include the following aspects: population, exposure of interest (independent variable) and outcome (dependent variable).Studies of etiology are predominantly explanatory or predictive. The objective of reviews of explanatory or predictive studies is to contribute to, and improve our understanding of, the relationship of health-related events or outcomes by examining the association between variables. When interpreting possible associations between variables based on observational study data, caution must be exercised due to the likely presence of confounding variables or moderators that may impact on the results.As with all systematic reviews, there are various approaches to present the results, including a narrative, graphical or tabular summary, or meta-analysis. When meta-analysis is not possible, a set of alternative methods for synthesizing research is available. On the basis of the research question and objectives, narrative, tabular and/or visual approaches can be used for data synthesis. There are some special considerations when conducting meta-analysis for questions related to risk and correlation. These include, but are not limited to, causal inference.Systematic review and meta-analysis of studies related to etiology is an emerging methodology in the field of evidence synthesis. These reviews can provide useful information for healthcare professionals and policymakers on the burden of disease. The standardized Joanna Briggs Institute approach offers a rigorous and transparent method to conduct reviews of etiology.

Epidemiological characteristics and methodological quality of meta-analyses on diabetes mellitus treatment: a systematic review.

PubMed

Wu, Xin Yin; Lam, Victor C K; Yu, Yue Feng; Ho, Robin S T; Feng, Ye; Wong, Charlene H L; Yip, Benjamin H K; Tsoi, Kelvin K F; Wong, Samuel Y S; Chung, Vincent C H

2016-11-01

Well-conducted meta-analyses (MAs) are considered as one of the best sources of clinical evidence for treatment decision. MA with methodological flaws may introduce bias and mislead evidence users. The aim of this study is to investigate the characteristics and methodological quality of MAs on diabetes mellitus (DM) treatments. Systematic review. Cochrane Database of Systematic Review and Database of Abstract of Reviews of Effects were searched for relevant MAs. Assessing methodological quality of systematic reviews (AMSTAR) tool was used to evaluate the methodological quality of included MAs. Logistic regression analysis was used to identify association between characteristics of MA and AMSTAR results. A total of 252 MAs including 4999 primary studies and 13,577,025 patients were included. Over half of the MAs (65.1%) only included type 2 DM patients and 160 MAs (63.5%) focused on pharmacological treatments. About 89.7% MAs performed comprehensive literature search and 89.3% provided characteristics of included studies. Included MAs generally had poor performance on the remaining AMSTAR items, especially in assessing publication bias (39.3%), providing lists of studies (19.0%) and declaring source of support comprehensively (7.5%). Only 62.7% MAs mentioned about harm of interventions. MAs with corresponding author from Asia performed less well in providing MA protocol than those from Europe. Methodological quality of MA on DM treatments was unsatisfactory. There is considerable room for improvement, especially in assessing publication bias, providing lists of studies and declaring source of support comprehensively. Also, there is an urgent need for MA authors to report treatment harm comprehensively. © 2016 European Society of Endocrinology.

The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration

PubMed Central

Liberati, Alessandro; Altman, Douglas G.; Tetzlaff, Jennifer; Mulrow, Cynthia; Gøtzsche, Peter C.; Ioannidis, John P. A.; Clarke, Mike; Devereaux, P. J.; Kleijnen, Jos; Moher, David

2009-01-01

Systematic reviews and meta-analyses are essential to summarize evidence relating to efficacy and safety of health care interventions accurately and reliably. The clarity and transparency of these reports, however, is not optimal. Poor reporting of systematic reviews diminishes their value to clinicians, policy makers, and other users. Since the development of the QUOROM (QUality Of Reporting Of Meta-analysis) Statement—a reporting guideline published in 1999—there have been several conceptual, methodological, and practical advances regarding the conduct and reporting of systematic reviews and meta-analyses. Also, reviews of published systematic reviews have found that key information about these studies is often poorly reported. Realizing these issues, an international group that included experienced authors and methodologists developed PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) as an evolution of the original QUOROM guideline for systematic reviews and meta-analyses of evaluations of health care interventions. The PRISMA Statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. In this Explanation and Elaboration document, we explain the meaning and rationale for each checklist item. For each item, we include an example of good reporting and, where possible, references to relevant empirical studies and methodological literature. The PRISMA Statement, this document, and the associated Web site (http://www.prisma-statement.org/) should be helpful resources to improve reporting of systematic reviews and meta-analyses. PMID:19621070

Methodological Quality of Systematic Reviews in Subfertility: A Comparison of Two Different Approaches

PubMed Central

Popovich, Ivor; Windsor, Bethany; Jordan, Vanessa; Showell, Marian; Shea, Bev; Farquhar, Cynthia M.

2012-01-01

Background Systematic reviews are used widely to guide health care decisions. Several tools have been created to assess systematic review quality. The measurement tool for assessing the methodological quality of systematic reviews known as the AMSTAR tool applies a yes/no score to eleven relevant domains of review methodology. This tool has been reworked so that each domain is scored based on a four point scale, producing R-AMSTAR. Methods and Findings We aimed to compare the AMSTAR and R-AMSTAR tools in assessing systematic reviews in the field of assisted reproduction for subfertility. All published systematic reviews on assisted reproductive technology, with the latest search for studies taking place from 2007–2011, were considered. Reviews that contained no included studies or considered diagnostic outcomes were excluded. Thirty each of Cochrane and non-Cochrane reviews were randomly selected from a search of relevant databases. Both tools were then applied to all sixty reviews. The results were converted to percentage scores and all reviews graded and ranked based on this. AMSTAR produced a much wider variation in percentage scores and achieved higher inter-rater reliability than R-AMSTAR according to kappa statistics. The average rating for Cochrane reviews was consistent between the two tools (88.3% for R-AMSTAR versus 83.6% for AMSTAR) but inconsistent for non-Cochrane reviews (63.9% R-AMSTAR vs. 38.5% AMSTAR). In comparing the rankings generated between the two tools Cochrane reviews changed an average of 4.2 places, compared to 2.9 for non-Cochrane. Conclusion R-AMSTAR provided greater guidance in the assessment of domains and produced quantitative results. However, there were many problems with the construction of its criteria and AMSTAR was much easier to apply consistently. We recommend that AMSTAR incorporates the findings of this study and produces additional guidance for its application in order to improve its reliability and usefulness. PMID:23300526

Methodological quality and implications for practice of systematic Cochrane reviews in pediatric oral health: a critical assessment

PubMed Central

2014-01-01

Background To ensure evidence-based decision-making in pediatric oral health, Cochrane systematic reviews that address topics pertinent to this field are necessary. We aimed to identify all systematic reviews of paediatric dentistry and oral health by the Cochrane Oral Health Group (COHG), summarize their characteristics and assess their methodological quality. Our second objective was to assess implications for practice in the review conclusions and provide an overview of clinical implications about the usefulness of paediatric oral health interventions in practice. Methods We conducted a methodological survey including all paediatric dentistry reviews from the COHG. We extracted data on characteristics of included reviews, then assessed the methodological quality using a validated 11-item quality assessment tool (AMSTAR). Finally, we coded each review to indicate whether its authors concluded that an intervention should be implemented in practice, was not supported or was refuted by the evidence, or should be used only in research (inconclusive evidence). Results We selected 37 reviews; most concerned the prevention of caries. The methodological quality was high, except for the assessment of reporting bias. In 7 reviews (19%), the research showed that benefits outweighed harms; in 1, the experimental intervention was found ineffective; and in 29 (78%), evidence was insufficient to assess benefits and harms. In the 7 reviews, topical fluoride treatments (with toothpaste, gel or varnish) were found effective for permanent and deciduous teeth in children and adolescents, and sealants for occlusal tooth surfaces of permanent molars. Conclusions Cochrane reviews of paediatric dentistry were of high quality. They provided strong evidence that topical fluoride treatments and sealants are effective for children and adolescents and thus should be implemented in practice. However, a substantial number of reviews yielded inconclusive evidence. PMID:24716532

A systematic review of model-based economic evaluations of diagnostic and therapeutic strategies for lower extremity artery disease.

PubMed

Vaidya, Anil; Joore, Manuela A; ten Cate-Hoek, Arina J; Kleinegris, Marie-Claire; ten Cate, Hugo; Severens, Johan L

2014-01-01

Lower extremity artery disease (LEAD) is a sign of wide spread atherosclerosis also affecting coronary, cerebral and renal arteries and is associated with increased risk of cardiovascular events. Many economic evaluations have been published for LEAD due to its clinical, social and economic importance. The aim of this systematic review was to assess modelling methods used in published economic evaluations in the field of LEAD. Our review appraised and compared the general characteristics, model structure and methodological quality of published models. Electronic databases MEDLINE and EMBASE were searched until February 2013 via OVID interface. Cochrane database of systematic reviews, Health Technology Assessment database hosted by National Institute for Health research and National Health Services Economic Evaluation Database (NHSEED) were also searched. The methodological quality of the included studies was assessed by using the Philips' checklist. Sixteen model-based economic evaluations were identified and included. Eleven models compared therapeutic health technologies; three models compared diagnostic tests and two models compared a combination of diagnostic and therapeutic options for LEAD. Results of this systematic review revealed an acceptable to low methodological quality of the included studies. Methodological diversity and insufficient information posed a challenge for valid comparison of the included studies. In conclusion, there is a need for transparent, methodologically comparable and scientifically credible model-based economic evaluations in the field of LEAD. Future modelling studies should include clinically and economically important cardiovascular outcomes to reflect the wider impact of LEAD on individual patients and on the society.

Methodological quality assessment of paper-based systematic reviews published in oral health.

PubMed

Wasiak, J; Shen, A Y; Tan, H B; Mahar, R; Kan, G; Khoo, W R; Faggion, C M

2016-04-01

This study aimed to conduct a methodological assessment of paper-based systematic reviews (SR) published in oral health using a validated checklist. A secondary objective was to explore temporal trends on methodological quality. Two electronic databases (OVID Medline and OVID EMBASE) were searched for paper-based SR of interventions published in oral health from inception to October 2014. Manual searches of the reference lists of paper-based SR were also conducted. Methodological quality of included paper-based SR was assessed using an 11-item questionnaire, Assessment of Multiple Systematic Reviews (AMSTAR) checklist. Methodological quality was summarized using the median and inter-quartile range (IQR) of the AMSTAR score over different categories and time periods. A total of 643 paper-based SR were included. The overall median AMSTAR score was 4 (IQR 2-6). The highest median score (5) was found in the pain dentistry and periodontology fields, while the lowest median score (3) was found in implant dentistry, restorative dentistry, oral medicine, and prosthodontics. The number of paper-based SR per year and the median AMSTAR score increased over time (median score in 1990s was 2 (IQR 2-3), 2000s was 4 (IQR 2-5), and 2010 onwards was 5 (IQR 3-6)). Although the methodological quality of paper-based SR published in oral health has improved in the last few years, there is still scope for improving quality in most evaluated dental specialties. Large-scale assessment of methodological quality of dental SR highlights areas of methodological strengths and weaknesses that can be targeted in future publications to encourage better quality review methodology.

Appraisal of the methodological quality and summary of the findings of systematic reviews on the relationship between SSRIs and suicidality.

PubMed

Li, Wei; Li, Wei; Wan, Yumei; Ren, Juanjuan; Li, Ting; Li, Chunbo

2014-10-01

Several systematic reviews have been published about the relationship of the use of selective serotonin reuptake inhibitors (SSRIs) and risk of suicidal ideation or behavior but there has been no formal assessment of the quality of these reports. Assess the methodological quality of systematic reviews about the relationship of SSRI use and suicidal ideation and behavior; and provide overall conclusions based on this assessment. Systematic reviews of RCTs that compared SSRIs to placebo and used suicidal ideation or behavior as a key outcome variable were identified by searching Pubmed, Embase, The Cochrane Library, EBSCO, PsycINFO, Chinese National Knowledge Infrastructure, Chongqing VIP database for Chinese Technical Periodicals, WANFANG DATA, and the Chinese Biological Medical Literature Database. The methodological quality of included reviews was independently assessed by two expert raters using the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) scale. Twelve systematic reviews and meta-analyses were identified. The inter-rater reliability of the overall AMSTAR quality score was excellent (ICC=0.86) but the inter-rater reliability of 5 of the 11 AMSTAR items was poor (Kappa <0.60). Based on the AMSTAR total score, there was one high-quality review, eight moderate-quality reviews, and three low-quality reviews. The high-quality review and three of the moderate-quality reviews reported a significantly increased risk of suicidal ideation or behavior in the SSRI group compared to the placebo group. Three of the four reviews limited to children and adolescents found a significantly increased risk of suicidal ideation or behavior with SSRI use which was most evident in teenagers taking paroxetine and in teenagers with depressive disorders. The available evidence suggests that adolescents may experience an increase in suicidal ideation and behavior with SSRI use, particularly those who have a depressive disorder and those treated with paroxetine. However, there are few high-quality reviews on this issue, so some doubt about the evidence remains. The AMSTAR scale may be useful in the ongoing efforts to improve the quality of systematic reviews, but further work is needed on tightening the operational criteria for some of the items in the scale.

Comparison of search strategies in systematic reviews of adverse effects to other systematic reviews.

PubMed

Golder, Su; Loke, Yoon K; Zorzela, Liliane

2014-06-01

Research indicates that the methods used to identify data for systematic reviews of adverse effects may need to differ from other systematic reviews. To compare search methods in systematic reviews of adverse effects with other reviews. The search methodologies in 849 systematic reviews of adverse effects were compared with other reviews. Poor reporting of search strategies is apparent in both systematic reviews of adverse effects and other types of systematic reviews. Systematic reviews of adverse effects are less likely to restrict their searches to MEDLINE or include only randomised controlled trials (RCTs). The use of other databases is largely dependent on the topic area and the year the review was conducted, with more databases searched in more recent reviews. Adverse effects search terms are used by 72% of reviews and despite recommendations only two reviews report using floating subheadings. The poor reporting of search strategies in systematic reviews is universal, as is the dominance of searching MEDLINE. However, reviews of adverse effects are more likely to include a range of study designs (not just RCTs) and search beyond MEDLINE. © 2014 Crown Copyright.

Vitamin D and depression: a systematic review and meta-analysis comparing studies with and without biological flaws.

PubMed

Spedding, Simon

2014-04-11

Efficacy of Vitamin D supplements in depression is controversial, awaiting further literature analysis. Biological flaws in primary studies is a possible reason meta-analyses of Vitamin D have failed to demonstrate efficacy. This systematic review and meta-analysis of Vitamin D and depression compared studies with and without biological flaws. The systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The literature search was undertaken through four databases for randomized controlled trials (RCTs). Studies were critically appraised for methodological quality and biological flaws, in relation to the hypothesis and study design. Meta-analyses were performed for studies according to the presence of biological flaws. The 15 RCTs identified provide a more comprehensive evidence-base than previous systematic reviews; methodological quality of studies was generally good and methodology was diverse. A meta-analysis of all studies without flaws demonstrated a statistically significant improvement in depression with Vitamin D supplements (+0.78 CI +0.24, +1.27). Studies with biological flaws were mainly inconclusive, with the meta-analysis demonstrating a statistically significant worsening in depression by taking Vitamin D supplements (-1.1 CI -0.7, -1.5). Vitamin D supplementation (≥800 I.U. daily) was somewhat favorable in the management of depression in studies that demonstrate a change in vitamin levels, and the effect size was comparable to that of anti-depressant medication.

Methodological Review of Studies on Educational Leaders and Emotions (1992-2012): Insights into the Meaning of an Emerging Research Field in Educational Administration

ERIC Educational Resources Information Center

Berkovich, Izhak; Eyal, Ori

2017-01-01

Purpose: The purpose of this paper is to do methodological review of the literature on educational leaders and emotions that includes 49 empirical studies published in peer-reviewed journals between 1992 and 2012. Design/methodology/approach: The work systematically analyzes descriptive information, methods, and designs in these studies, and their…

Systematic Review Methodology for the Fatigue in Emergency Medical Services Project

DOT National Transportation Integrated Search

2018-01-11

Background: Guidance for managing fatigue in the Emergency Medical Services (EMS) setting is limited. The Fatigue in EMS Project sought to complete multiple systematic reviews guided by seven explicit research questions, assemble the best available e...

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool.

PubMed

Ho, Robin S T; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel Y S; Chung, Vincent C H

2015-01-08

Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. To assess the methodological quality of MAs on COPD treatments. A cross-sectional study on MAs of COPD trials. MAs published during 2000-2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool

PubMed Central

Ho, Robin ST; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel YS; Chung, Vincent CH

2015-01-01

Background: Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. Aims: To assess the methodological quality of MAs on COPD treatments. Methods: A cross-sectional study on MAs of COPD trials. MAs published during 2000–2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Results: Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. Conclusions: The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods. PMID:25569783

Web-Based Interventions for Weight Loss or Weight Loss Maintenance in Overweight and Obese People: A Systematic Review of Systematic Reviews

PubMed Central

Sorgente, Angela; Manzoni, Gian Mauro; Re, Federica; Simpson, Susan; Perona, Sara; Rossi, Alessandro; Cattivelli, Roberto; Innamorati, Marco; Jackson, Jeffrey B; Castelnuovo, Gianluca

2017-01-01

Background Weight loss is challenging and maintenance of weight loss is problematic. Web-based programs offer good potential for delivery of interventions for weight loss or weight loss maintenance. However, the precise impact of Web-based weight management programs is still unclear. Objective The purpose of this meta-systematic review was to provide a comprehensive summary of the efficacy of Web-based interventions for weight loss and weight loss maintenance. Methods Electronic databases were searched for systematic reviews and meta-analyses that included at least one study investigating the effect of a Web-based intervention on weight loss and/or weight loss maintenance among samples of overweight and/or obese individuals. Twenty identified reviews met the inclusion criteria. The Revised Assessment of Multiple SysTemAtic Reviews (R-AMSTAR) was used to assess methodological quality of reviews. All included reviews were of sufficient methodological quality (R-AMSTAR score ≥22). Key methodological and outcome data were extracted from each review. Results Web-based interventions for both weight loss and weight loss maintenance were more effective than minimal or control conditions. However, when contrasted with comparable non-Web-based interventions, results were less consistent across reviews. Conclusions Overall, the efficacy of weight loss maintenance interventions was stronger than the efficacy of weight loss interventions, but further evidence is needed to more clearly understand the efficacy of both types of Web-based interventions. Trial Registration PROSPERO 2015: CRD42015029377; http://www.crd.york.ac.uk/PROSPERO/display_record.asp? ID=CRD42015029377 (Archived by WebCite at http://www.webcitation.org/6qkSafdCZ) PMID:28652225

Child maltreatment prevention: a systematic review of reviews

PubMed Central

Butchart, Alexander

2009-01-01

Abstract Objective To synthesize recent evidence from systematic and comprehensive reviews on the effectiveness of universal and selective child maltreatment prevention interventions, evaluate the methodological quality of the reviews and outcome evaluation studies they are based on, and map the geographical distribution of the evidence. Methods A systematic review of reviews was conducted. The quality of the systematic reviews was evaluated with a tool for the assessment of multiple systematic reviews (AMSTAR), and the quality of the outcome evaluations was assessed using indicators of internal validity and of the construct validity of outcome measures. Findings The review focused on seven main types of interventions: home visiting, parent education, child sex abuse prevention, abusive head trauma prevention, multi-component interventions, media-based interventions, and support and mutual aid groups. Four of the seven – home-visiting, parent education, abusive head trauma prevention and multi-component interventions – show promise in preventing actual child maltreatment. Three of them – home visiting, parent education and child sexual abuse prevention – appear effective in reducing risk factors for child maltreatment, although these conclusions are tentative due to the methodological shortcomings of the reviews and outcome evaluation studies they draw on. An analysis of the geographical distribution of the evidence shows that outcome evaluations of child maltreatment prevention interventions are exceedingly rare in low- and middle-income countries and make up only 0.6% of the total evidence base. Conclusion Evidence for the effectiveness of four of the seven main types of interventions for preventing child maltreatment is promising, although it is weakened by methodological problems and paucity of outcome evaluations from low- and middle-income countries. PMID:19551253

Using systematic reviews for hazard and risk assessment of endocrine disrupting chemicals

PubMed Central

Beronius, Anna; Vandenberg, Laura N.

2016-01-01

The possibility that endocrine disrupting chemicals (EDCs) in our environment contribute to hormonally related effects and diseases observed in human and wildlife populations has caused concern among decision makers and researchers alike. EDCs challenge principles traditionally applied in chemical risk assessment and the identification and assessment of these compounds has been a much debated topic during the last decade. State of the science reports and risk assessments of potential EDCs have been criticized for not using systematic and transparent approaches in the evaluation of evidence. In the fields of medicine and health care, systematic review methodologies have been developed and used to enable objectivity and transparency in the evaluation of scientific evidence for decision making. Lately, such approaches have also been promoted for use in the environmental health sciences and risk assessment of chemicals. Systematic review approaches could provide a tool for improving the evaluation of evidence for decision making regarding EDCs, e.g. by enabling systematic and transparent use of academic research data in this process. In this review we discuss the advantages and challenges of applying systematic review methodology in the identification and assessment of EDCs. PMID:26847432

Using systematic reviews for hazard and risk assessment of endocrine disrupting chemicals.

PubMed

Beronius, Anna; Vandenberg, Laura N

2015-12-01

The possibility that endocrine disrupting chemicals (EDCs) in our environment contribute to hormonally related effects and diseases observed in human and wildlife populations has caused concern among decision makers and researchers alike. EDCs challenge principles traditionally applied in chemical risk assessment and the identification and assessment of these compounds has been a much debated topic during the last decade. State of the science reports and risk assessments of potential EDCs have been criticized for not using systematic and transparent approaches in the evaluation of evidence. In the fields of medicine and health care, systematic review methodologies have been developed and used to enable objectivity and transparency in the evaluation of scientific evidence for decision making. Lately, such approaches have also been promoted for use in the environmental health sciences and risk assessment of chemicals. Systematic review approaches could provide a tool for improving the evaluation of evidence for decision making regarding EDCs, e.g. by enabling systematic and transparent use of academic research data in this process. In this review we discuss the advantages and challenges of applying systematic review methodology in the identification and assessment of EDCs.

Cluster Randomised Trials in Cochrane Reviews: Evaluation of Methodological and Reporting Practice.

PubMed

Richardson, Marty; Garner, Paul; Donegan, Sarah

2016-01-01

Systematic reviews can include cluster-randomised controlled trials (C-RCTs), which require different analysis compared with standard individual-randomised controlled trials. However, it is not known whether review authors follow the methodological and reporting guidance when including these trials. The aim of this study was to assess the methodological and reporting practice of Cochrane reviews that included C-RCTs against criteria developed from existing guidance. Criteria were developed, based on methodological literature and personal experience supervising review production and quality. Criteria were grouped into four themes: identifying, reporting, assessing risk of bias, and analysing C-RCTs. The Cochrane Database of Systematic Reviews was searched (2nd December 2013), and the 50 most recent reviews that included C-RCTs were retrieved. Each review was then assessed using the criteria. The 50 reviews we identified were published by 26 Cochrane Review Groups between June 2013 and November 2013. For identifying C-RCTs, only 56% identified that C-RCTs were eligible for inclusion in the review in the eligibility criteria. For reporting C-RCTs, only eight (24%) of the 33 reviews reported the method of cluster adjustment for their included C-RCTs. For assessing risk of bias, only one review assessed all five C-RCT-specific risk-of-bias criteria. For analysing C-RCTs, of the 27 reviews that presented unadjusted data, only nine (33%) provided a warning that confidence intervals may be artificially narrow. Of the 34 reviews that reported data from unadjusted C-RCTs, only 13 (38%) excluded the unadjusted results from the meta-analyses. The methodological and reporting practices in Cochrane reviews incorporating C-RCTs could be greatly improved, particularly with regard to analyses. Criteria developed as part of the current study could be used by review authors or editors to identify errors and improve the quality of published systematic reviews incorporating C-RCTs.

An overview and methodological assessment of systematic reviews and meta-analyses of enhanced recovery programmes in colorectal surgery

PubMed Central

Chambers, Duncan; Paton, Fiona; Wilson, Paul; Eastwood, Alison; Craig, Dawn; Fox, Dave; Jayne, David; McGinnes, Erika

2014-01-01

Objectives To identify and critically assess the extent to which systematic reviews of enhanced recovery programmes for patients undergoing colorectal surgery differ in their methodology and reported estimates of effect. Design Review of published systematic reviews. We searched the Cochrane Database of Systematic Reviews, the Database of Abstracts of Reviews of Effects (DARE) and Health Technology Assessment (HTA) Database from 1990 to March 2013. Systematic reviews of enhanced recovery programmes for patients undergoing colorectal surgery were eligible for inclusion. Primary and secondary outcome measures The primary outcome was length of hospital stay. We assessed changes in pooled estimates of treatment effect over time and how these might have been influenced by decisions taken by researchers as well as by the availability of new trials. The quality of systematic reviews was assessed using the Centre for Reviews and Dissemination (CRD) DARE critical appraisal process. Results 10 systematic reviews were included. Systematic reviews of randomised controlled trials have consistently shown a reduction in length of hospital stay with enhanced recovery compared with traditional care. The estimated effect tended to increase from 2006 to 2010 as more trials were published but has not altered significantly in the most recent review, despite the inclusion of several unique trials. The best estimate appears to be an average reduction of around 2.5 days in primary postoperative length of stay. Differences between reviews reflected differences in interpretation of inclusion criteria, searching and analytical methods or software. Conclusions Systematic reviews of enhanced recovery programmes show a high level of research waste, with multiple reviews covering identical or very similar groups of trials. Where multiple reviews exist on a topic, interpretation may require careful attention to apparently minor differences between reviews. Researchers can help readers by acknowledging existing reviews and through clear reporting of key decisions, especially on inclusion/exclusion and on statistical pooling. PMID:24879828

Surface electromyography in animals: A systematic review

PubMed Central

Valentin, Stephanie; Zsoldos, Rebeka R.

2017-01-01

The study of muscle activity using surface electromyography (sEMG) is commonly used for investigations of the neuromuscular system in man. Although sEMG has faced methodological challenges, considerable technical advances have been made in the last few decades. Similarly, the field of animal biomechanics, including sEMG, has grown despite being confronted with often complex experimental conditions. In human sEMG research, standardised protocols have been developed, however these are lacking in animal sEMG. Before standards can be proposed in this population group, the existing research in animal sEMG should be collated and evaluated. Therefore the aim of this review is to systematically identify and summarise the literature in animal sEMG focussing on (1) species, breeds, activities and muscles investigated, and (2) electrode placement and normalisation methods used. The databases PubMed, Web of Science, Scopus, and Vetmed Resource were searched systematically for sEMG studies in animals and 38 articles were included in the final review. Data on methodological quality was collected and summarised. The findings from this systematic review indicate the divergence in animal sEMG methodology and as a result, future steps required to develop standardisation in animal sEMG are proposed. PMID:26763600

Surface electromyography in animal biomechanics: A systematic review.

PubMed

Valentin, Stephanie; Zsoldos, Rebeka R

2016-06-01

The study of muscle activity using surface electromyography (sEMG) is commonly used for investigations of the neuromuscular system in man. Although sEMG has faced methodological challenges, considerable technical advances have been made in the last few decades. Similarly, the field of animal biomechanics, including sEMG, has grown despite being confronted with often complex experimental conditions. In human sEMG research, standardised protocols have been developed, however these are lacking in animal sEMG. Before standards can be proposed in this population group, the existing research in animal sEMG should be collated and evaluated. Therefore the aim of this review is to systematically identify and summarise the literature in animal sEMG focussing on (1) species, breeds, activities and muscles investigated, and (2) electrode placement and normalisation methods used. The databases PubMed, Web of Science, Scopus, and Vetmed Resource were searched systematically for sEMG studies in animals and 38 articles were included in the final review. Data on methodological quality was collected and summarised. The findings from this systematic review indicate the divergence in animal sEMG methodology and as a result, future steps required to develop standardisation in animal sEMG are proposed. Copyright © 2015 Elsevier Ltd. All rights reserved.

Considering methodological options for reviews of theory: illustrated by a review of theories linking income and health

PubMed Central

2014-01-01

Background Review of theory is an area of growing methodological advancement. Theoretical reviews are particularly useful where the literature is complex, multi-discipline, or contested. It has been suggested that adopting methods from systematic reviews may help address these challenges. However, the methodological approaches to reviews of theory, including the degree to which systematic review methods can be incorporated, have received little discussion in the literature. We recently employed systematic review methods in a review of theories about the causal relationship between income and health. Methods This article discusses some of the methodological issues we considered in developing the review and offers lessons learnt from our experiences. It examines the stages of a systematic review in relation to how they could be adapted for a review of theory. The issues arising and the approaches taken in the review of theories in income and health are considered, drawing on the approaches of other reviews of theory. Results Different approaches to searching were required, including electronic and manual searches, and electronic citation tracking to follow the development of theories. Determining inclusion criteria was an iterative process to ensure that inclusion criteria were specific enough to make the review practical and focused, but not so narrow that key literature was excluded. Involving subject specialists was valuable in the literature searches to ensure principal papers were identified and during the inductive approaches used in synthesis of theories to provide detailed understanding of how theories related to another. Reviews of theory are likely to involve iterations and inductive processes throughout, and some of the concepts and techniques that have been developed for qualitative evidence synthesis can be usefully translated to theoretical reviews of this kind. Conclusions It may be useful at the outset of a review of theory to consider whether the key aim of the review is to scope out theories relating to a particular issue; to conduct in-depth analysis of key theoretical works with the aim of developing new, overarching theories and interpretations; or to combine both these processes in the review. This can help decide the most appropriate methodological approach to take at particular stages of the review. PMID:25312937

Application of systematic review methodology to the field of nutrition

USDA-ARS?s Scientific Manuscript database

Systematic reviews represent a rigorous and transparent approach of synthesizing scientific evidence that minimizes bias. They evolved within the medical community to support development of clinical and public health practice guidelines, set research agendas and formulate scientific consensus state...

A competency framework for librarians involved in systematic reviews.

PubMed

Townsend, Whitney A; Anderson, Patricia F; Ginier, Emily C; MacEachern, Mark P; Saylor, Kate M; Shipman, Barbara L; Smith, Judith E

2017-07-01

The project identified a set of core competencies for librarians who are involved in systematic reviews. A team of seven informationists with broad systematic review experience examined existing systematic review standards, conducted a literature search, and used their own expertise to identify core competencies and skills that are necessary to undertake various roles in systematic review projects. The team identified a total of six competencies for librarian involvement in systematic reviews: "Systematic review foundations," "Process management and communication," "Research methodology," "Comprehensive searching," "Data management," and "Reporting." Within each competency are the associated skills and knowledge pieces (indicators). Competence can be measured using an adaptation of Miller's Pyramid for Clinical Assessment, either through self-assessment or identification of formal assessment instruments. The Systematic Review Competencies Framework provides a standards-based, flexible way for librarians and organizations to identify areas of competence and areas in need of development to build capacity for systematic review integration. The framework can be used to identify or develop appropriate assessment tools and to target skill development opportunities.

What determines the effects and costs of breast cancer screening? A protocol of a systematic review of reviews.

PubMed

Mandrik, O; Ekwunife, O I; Zielonke, N; Meheus, F; Severens, J L; Lhachimi, S K; Murillo, R

2017-06-28

Multiple reviews demonstrated high variability in effectiveness and cost-effectiveness outcomes among studies on breast cancer screening (BCS) programmes. No study to our knowledge has summarized the current evidence on determinants of effectiveness and cost-effectiveness of the most used BCS approaches or tried to explain differences in conclusions of systematic reviews on this topic. Based on published reviews, this systematic review aims to assess the degree of variability of determinants for (a) effectiveness and (b) cost-effectiveness of BCS programmes using mammography, clinical breast examination, breast self-examination, ultrasonography, or their combinations among the general population. We will perform a comprehensive systematic literature search in Cochrane, Scopus, Embase, and Medline (via Pubmed). The search will be supplemented with hand searching of references of the included reviews, with hand searching in the specialized journals, and by contacting prominent experts in the field. Additional search for grey literature will be conducted on the websites of international cancer associations and networks. Two trained research assistants will screen titles and abstracts of publications independently, with at least random 10% of all abstracts being also screened by the principal researcher. The full texts of the systematic reviews will then be screened independently by two authors, and disagreements will be solved by consensus. The included reviews will be grouped by publication year, outcomes, designs of original studies, and quality. Additionally, for reviews published since 2011, transparency in reporting will be assessed using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist for the review on determinants of effectiveness and a modified PRISMA checklist for the review on determinants for cost-effectiveness. The study will apply the Assessing the Methodological Quality of Systematic Reviews checklist to assess the methodological quality of systematic reviews. We will report the data extracted from the systematic reviews in a systematic format. Meta-meta-analysis of extracted data will be conducted when feasible. This systematic review of reviews will examine the degree of variability in the effectiveness and cost-effectiveness of BCS programmes. PROSPERO CRD42016050764 and CRD42016050765.

Screening for Autism Spectrum Disorder in Low- and Middle-Income Countries: A Systematic Review

ERIC Educational Resources Information Center

Stewart, Lydia A.; Lee, Li-Ching

2017-01-01

This review contributes to the growing body of global autism spectrum disorder literature by examining the use of screening instruments in low- and middle-income countries with respect to study design and methodology, instrument adaptation and performance, and collaboration with community stakeholders in research. A systematic review was conducted…

Does Consideration and Assessment of Effects on Health Equity Affect the Conclusions of Systematic Reviews? A Methodology Study

PubMed Central

Welch, Vivian; Petticrew, Mark; Ueffing, Erin; Benkhalti Jandu, Maria; Brand, Kevin; Dhaliwal, Bharbhoor; Kristjansson, Elizabeth; Smylie, Janet; Wells, George Anthony; Tugwell, Peter

2012-01-01

Introduction Tackling health inequities both within and between countries remains high on the agenda of international organizations including the World Health Organization and local, regional and national governments. Systematic reviews can be a useful tool to assess effects on equity in health status because they include studies conducted in a variety of settings and populations. This study aims to describe the extent to which the impacts of health interventions on equity in health status are considered in systematic reviews, describe methods used, and assess the implications of their equity related findings for policy, practice and research. Methods We conducted a methodology study of equity assessment in systematic reviews. Two independent reviewers extracted information on the reporting and analysis of impacts of health interventions on equity in health status in a group of 300 systematic reviews collected from all systematic reviews indexed in one month of MEDLINE, using a pre-tested data collection form. Any differences in data extraction were resolved by discussion. Results Of the 300 systematic reviews, 224 assessed the effectiveness of interventions on health outcomes. Of these 224 reviews, 29 systematic reviews assessed effects on equity in health status using subgroup analysis or targeted analyses of vulnerable populations. Of these, seven conducted subgroup analyses related to health equity which were reported in insufficient detail to judge their credibility. Of these 29 reviews, 18 described implications for policy and practice based on assessment of effects on health equity. Conclusion The quality and completeness of reporting should be enhanced as a priority, because without this policymakers and practitioners will continue lack the evidence base they need to inform decision-making about health inequity. Furthermore, there is a need to develop methods to systematically consider impacts on equity in health status that is currently lacking in systematic reviews. PMID:22427804

Traditional Chinese medicine injection for angina pectoris: an overview of systematic reviews.

PubMed

Luo, Jing; Shang, Qinghua; Han, Mei; Chen, Keji; Xu, Hao

2014-01-01

Traditional Chinese medicine (TCM) injection is widely used to treat angina pectoris in China. This overview aims to systematically summarize the general characteristics of systematic reviews (SRs) on TCM injection in treating angina, and assess the methodological and reporting quality of these reviews. We searched PubMed, Embase, the Cochrane Library and four Chinese databases from inception until March 2013. Data were extracted according to a preset form. The AMSTAR and PRISMA checklists were used to explore the methodological quality and reporting characteristics of included reviews, respectively. All data analyses were descriptive. 46 SRs involving over 57,463 participants with angina reviewing 23 kinds of TCM injections were included. The main outcomes evaluated in the reviews were symptoms (43/46, 93.5%), surrogate outcomes (42/46, 91.3%) and adverse events (41/46, 87.0%). Few reviews evaluated endpoints (7/46, 15.2%) and quality of life (1/46, 2.2%). One third of the reviews (16/46, 34.8%) drew definitely positive conclusions while the others (30/46, 65.2%) suggested potential benefits mainly in symptoms, electrocardiogram and adverse events. With many serious flaws such as lack of a protocol and inappropriate data synthesis, the overall methodological and reporting quality of the reviews was limited. While many SRs of TCM injection on the treatment of angina suggested potential benefits or definitely positive effects, stakeholders should not accept the findings of these reviews uncritically due to the limited methodological and reporting quality. Future SRs should be appropriately conducted and reported according to international standards such as AMSTAR and PRISMA, rather than published in large numbers.

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery

PubMed Central

Gudlaugsdottir, Katrin; Andrews, James

2017-01-01

Objective Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality. Background Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated. Methods Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality. Results 112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression. Conclusions There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians. PMID:28384296

Vitamin D and Depression: A Systematic Review and Meta-Analysis Comparing Studies with and without Biological Flaws

PubMed Central

Spedding, Simon

2014-01-01

Efficacy of Vitamin D supplements in depression is controversial, awaiting further literature analysis. Biological flaws in primary studies is a possible reason meta-analyses of Vitamin D have failed to demonstrate efficacy. This systematic review and meta-analysis of Vitamin D and depression compared studies with and without biological flaws. The systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The literature search was undertaken through four databases for randomized controlled trials (RCTs). Studies were critically appraised for methodological quality and biological flaws, in relation to the hypothesis and study design. Meta-analyses were performed for studies according to the presence of biological flaws. The 15 RCTs identified provide a more comprehensive evidence-base than previous systematic reviews; methodological quality of studies was generally good and methodology was diverse. A meta-analysis of all studies without flaws demonstrated a statistically significant improvement in depression with Vitamin D supplements (+0.78 CI +0.24, +1.27). Studies with biological flaws were mainly inconclusive, with the meta-analysis demonstrating a statistically significant worsening in depression by taking Vitamin D supplements (−1.1 CI −0.7, −1.5). Vitamin D supplementation (≥800 I.U. daily) was somewhat favorable in the management of depression in studies that demonstrate a change in vitamin levels, and the effect size was comparable to that of anti-depressant medication. PMID:24732019

Frequency of data extraction errors and methods to increase data extraction quality: a methodological review.

PubMed

Mathes, Tim; Klaßen, Pauline; Pieper, Dawid

2017-11-28

Our objective was to assess the frequency of data extraction errors and its potential impact on results in systematic reviews. Furthermore, we evaluated the effect of different extraction methods, reviewer characteristics and reviewer training on error rates and results. We performed a systematic review of methodological literature in PubMed, Cochrane methodological registry, and by manual searches (12/2016). Studies were selected by two reviewers independently. Data were extracted in standardized tables by one reviewer and verified by a second. The analysis included six studies; four studies on extraction error frequency, one study comparing different reviewer extraction methods and two studies comparing different reviewer characteristics. We did not find a study on reviewer training. There was a high rate of extraction errors (up to 50%). Errors often had an influence on effect estimates. Different data extraction methods and reviewer characteristics had moderate effect on extraction error rates and effect estimates. The evidence base for established standards of data extraction seems weak despite the high prevalence of extraction errors. More comparative studies are needed to get deeper insights into the influence of different extraction methods.

The Navigation Guide Systematic Review Methodology: A Rigorous and Transparent Method for Translating Environmental Health Science into Better Health Outcomes

PubMed Central

Sutton, Patrice

2014-01-01

Background: Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. Objectives: We sought to develop a proof of concept of the “Navigation Guide,” a systematic and transparent method of research synthesis in environmental health. Discussion: The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of “risk of bias,” and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a “moderate” quality rating to human observational studies and combining diverse evidence streams. Conclusions: The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm. Citation: Woodruff TJ, Sutton P. 2014. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122:1007–1014; http://dx.doi.org/10.1289/ehp.1307175 PMID:24968373

The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Systematic Review of Human Evidence for PFOA Effects on Fetal Growth

PubMed Central

Sutton, Patrice; Atchley, Dylan S.; Koustas, Erica; Lam, Juleen; Sen, Saunak; Robinson, Karen A.; Axelrad, Daniel A.; Woodruff, Tracey J.

2014-01-01

Background: The Navigation Guide methodology was developed to meet the need for a robust method of systematic and transparent research synthesis in environmental health science. We conducted a case study systematic review to support proof of concept of the method. Objective: We applied the Navigation Guide systematic review methodology to determine whether developmental exposure to perfluorooctanoic acid (PFOA) affects fetal growth in humans. Methods: We applied the first 3 steps of the Navigation Guide methodology to human epidemiological data: 1) specify the study question, 2) select the evidence, and 3) rate the quality and strength of the evidence. We developed a protocol, conducted a comprehensive search of the literature, and identified relevant studies using prespecified criteria. We evaluated each study for risk of bias and conducted meta-analyses on a subset of studies. We rated quality and strength of the entire body of human evidence. Results: We identified 18 human studies that met our inclusion criteria, and 9 of these were combined through meta-analysis. Through meta-analysis, we estimated that a 1-ng/mL increase in serum or plasma PFOA was associated with a –18.9 g (95% CI: –29.8, –7.9) difference in birth weight. We concluded that the risk of bias across studies was low, and we assigned a “moderate” quality rating to the overall body of human evidence. Conclusion: On the basis of this first application of the Navigation Guide systematic review methodology, we concluded that there is “sufficient” human evidence that developmental exposure to PFOA reduces fetal growth. Citation: Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1028–1039; http://dx.doi.org/10.1289/ehp.1307893 PMID:24968388

E-therapy for mental health problems: a systematic review.

PubMed

Postel, Marloes G; de Haan, Hein A; De Jong, Cor A J

2008-09-01

The widespread availability of the Internet offers opportunities for improving access to therapy for people with mental health problems. There is a seemingly infinite supply of Internet-based interventions available on the World Wide Web. The aim of the present study is to systematically assess the methodological quality of randomized controlled trials (RCTs) concerning e-therapy for mental health problems. Two reviewers independently assessed the methodological quality of the RCTs, based on a list of criteria for the methodological quality assessment as recommended by the Cochrane Back Review Group. The search yielded 14 papers that reported RCTs concerning e-therapy for mental-health problems. The methodological quality of studies included in this review was generally low. It is concluded that e-therapy may turn out to be an appropriate therapeutic entity, but the evidence needs to be more convincing. Recommendations are made concerning the method of reporting RCTs and the need to add some content items to an e-therapy study.

Creativity and psychopathology: a systematic review.

PubMed

Thys, Erik; Sabbe, Bernard; De Hert, Marc

2014-01-01

The possible link between creativity and psychopathology has been a long-time focus of research up to the present day. However, the research results in this field are heterogeneous and contradictory. Links between creativity and specific psychiatric disorders have been confirmed and refuted in different studies. This disparity is partly explained by the methodological challenges peculiar to this field. In this systematic review of the literature from 1950, research articles in the field of creativity and psychopathology are presented, focusing on the methodology and results of the collected studies. This review confirms the methodological problems and the heterogeneity of the study designs and results. The assessment of psychopathology, but more so of creativity, remains a fundamental challenge. On the whole, study results cautiously confirm an association between creativity and both bipolar disorder and schizotypy. The research on creativity and psychopathology is hampered by serious methodological problems. Study results are to be interpreted with caution and future research needs more methodological rigor. © 2014 S. Karger AG, Basel.

Quality of systematic reviews: an example of studies comparing artificial disc replacement with fusion in the cervical spine.

PubMed

Tashani, Osama A; El-Tumi, Hanan; Aneiba, Khaled

2015-01-01

Cervical artificial disc replacement (C-ADR) is now an alternative to anterior cervical discectomy and fusion (ACDF). Many studies have evaluated the efficacy of C-ADR compared with ACDF. This led to a series of systematic reviews and meta-analyses to evaluate the evidence of the superiority of one intervention against the other. The aim of the study presented here was to evaluate the quality of these reviews and meta-analyses. Medline via Ovid, Embase, and Cochrane Library were searched using the keywords: (total disk replacement, prosthesis, implantation, discectomy, and arthroplasty) AND (cervical vertebrae, cervical spine, and spine) AND (systematic reviews, reviews, and meta-analysis). Screening and data extraction were conducted by two reviewers independently. Two reviewers then assessed the quality of the selected reviews and meta-analysis using 11-item AMSTAR score which is a validated measurement tool to assess the methodological quality of systematic reviews. Screening of full reports of 46 relevant abstracts resulted in the selection of 15 systematic reviews and/or meta-analyses as eligible for this study. The two reviewers' inter-rater agreement level was high as indicated by kappa of >0.72. The AMSTAR score of the reviews ranged from 3 to 11. Only one study (a Cochrane review) scored 100% (AMSTAR 11). Five studies scored below (AMSTAR 5) indicating low-quality reviews. The most significant drawbacks of reviews of a score below 5 were not using an extensive search strategy, failure to use the scientific quality of the included studies appropriately in formulating a conclusion, not assessing publication bias, and not reporting the excluded studies. With a significant exception of a Cochrane review, the methodological quality of systematic reviews evaluating the evidence of C-ADR versus ACDF has to be improved.

Integrated care programmes for adults with chronic conditions: a meta-review.

PubMed

Martínez-González, Nahara Anani; Berchtold, Peter; Ullman, Klara; Busato, André; Egger, Matthias

2014-10-01

To review systematic reviews and meta-analyses of integrated care programmes in chronically ill patients, with a focus on methodological quality, elements of integration assessed and effects reported. Meta-review of systematic reviews and meta-analyses identified in Medline (1946-March 2012), Embase (1980-March 2012), CINHAL (1981-March 2012) and the Cochrane Library of Systematic Reviews (issue 1, 2012). Methodological quality assessed by the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) checklist; elements of integration assessed using a published list of 10 key principles of integration; effects on patient-centred outcomes, process quality, use of healthcare and costs. Twenty-seven systematic reviews were identified; conditions included chronic heart failure (CHF; 12 reviews), diabetes mellitus (DM; seven reviews), chronic obstructive pulmonary disease (COPD; seven reviews) and asthma (five reviews). The median number of AMSTAR checklist items met was five: few reviewers searched for unpublished literature or described the primary studies and interventions in detail. Most reviews covered comprehensive services across the care continuum or standardization of care through inter-professional teams, but organizational culture, governance structure or financial management were rarely assessed. A majority of reviews found beneficial effects of integration, including reduced hospital admissions and re-admissions (in CHF and DM), improved adherence to treatment guidelines (DM, COPD and asthma) or quality of life (DM). Few reviews showed reductions in costs. Systematic reviews of integrated care programmes were of mixed quality, assessed only some components of integration of care, and showed consistent benefits for some outcomes but not others. © The Author 2014. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Systematic review of communication partner training in aphasia: methodological quality.

PubMed

Cherney, Leora R; Simmons-Mackie, Nina; Raymer, Anastasia; Armstrong, Elizabeth; Holland, Audrey

2013-10-01

Twenty-three studies identified from a previous systematic review examining the effects of communication partner training on persons with aphasia and their communication partners were evaluated for methodological quality. Two reviewers rated the studies on defined methodological quality criteria relevant to each study design. There were 11 group studies, seven single-subject participant design studies, and five qualitative studies. Quality scores were derived for each study. The mean inter-rater reliability of scores for each study design ranged from 85-93%, with Cohen's Kappa indicating substantial agreement between raters. Methodological quality of research on communication partner training in aphasia was highly varied. Overall, group studies employed the least rigorous methodology as compared to single subject and qualitative research. Only two of 11 group studies complied with more than half of the quality criteria. No group studies reported therapist blinding and only one group study reported participant blinding. Across all types of studies, the criterion of treatment fidelity was most commonly omitted. Failure to explicitly report certain methodological quality criteria may account for low ratings. Using methodological rating scales specific to the type of study design may help improve the methodological quality of aphasia treatment studies, including those on communication partner training.

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

Higher Education for Sustainable Development: A Systematic Review

ERIC Educational Resources Information Center

Wu, Yen-Chun Jim; Shen, Ju-Peng

2016-01-01

Purpose: This study aims to provide a complete understanding of academic research into higher education for sustainable development (HESD). Design/methodology/approach: This study utilizes a systematic review of four scientific literature databases to outline topics of research during the UN's Decade of Education for Sustainable Development…

Conducting systematic reviews of economic evaluations.

PubMed

Gomersall, Judith Streak; Jadotte, Yuri Tertilus; Xue, Yifan; Lockwood, Suzi; Riddle, Dru; Preda, Alin

2015-09-01

In 2012, a working group was established to review and enhance the Joanna Briggs Institute (JBI) guidance for conducting systematic review of evidence from economic evaluations addressing a question(s) about health intervention cost-effectiveness. The objective is to present the outcomes of the working group. The group conducted three activities to inform the new guidance: review of literature on the utility/futility of systematic reviews of economic evaluations and consideration of its implications for updating the existing methodology; assessment of the critical appraisal tool in the existing guidance against criteria that promotes validity in economic evaluation research and two other commonly used tools; and a workshop. The debate in the literature on the limitations/value of systematic review of economic evidence cautions that systematic reviews of economic evaluation evidence are unlikely to generate one size fits all answers to questions about the cost-effectiveness of interventions and their comparators. Informed by this finding, the working group adjusted the framing of the objectives definition in the existing JBI methodology. The shift is away from defining the objective as to determine one cost-effectiveness measure toward summarizing study estimates of cost-effectiveness and informed by consideration of the included study characteristics (patient, setting, intervention component, etc.), identifying conditions conducive to lowering costs and maximizing health benefits. The existing critical appraisal tool was included in the new guidance. The new guidance includes the recommendation that a tool designed specifically for the purpose of appraising model-based studies be used together with the generic appraisal tool for economic evaluations assessment to evaluate model-based evaluations. The guidance produced by the group offers reviewers guidance for each step of the systematic review process, which are the same steps followed in JBI reviews of other types of evidence. The updated JBI guidance will be useful for researchers wanting to synthesize evidence about economic questions, either as stand-alone reviews or part of comprehensive or mixed method evidence reviews. Although the updated methodology produced by the work of the working group has improved the JBI guidance for systematic reviews of economic evaluations, there are areas where further work is required. These include adjusting the critical appraisal tool to separate out questions addressing intervention cost and effectiveness measurement; providing more explicit guidance for assessing generalizability of findings; and offering a more robust method for evidence synthesis that facilitates achieving the more ambitious review objectives.

USDA Nutrition Evidence Library: methodology used to identify topics and develop systematic review questions for the birth-to-24-mo population.

PubMed

Obbagy, Julie E; Blum-Kemelor, Donna M; Essery, Eve V; Lyon, Joan M G; Spahn, Joanne M

2014-03-01

The USDA's Nutrition Evidence Library (NEL) specializes in conducting food- and nutrition-related systematic reviews that are used to inform federal government decision making. To ensure the utility of NEL systematic reviews, the most relevant topics must be addressed, questions must be clearly focused and appropriate in scope, and review frameworks must reflect the state of the science. Identifying the optimal topics and questions requires input from a variety of stakeholders, including scientists with technical expertise, as well as government policy and program leaders. The objective of this article is to describe the rationale and NEL methodology for identifying topics and developing systematic review questions implemented as part of the "Evaluating the evidence base to support the inclusion of infants and children from birth to 24 months of age in the Dietary Guidelines for Americans--the B-24 Project." This is the first phase of a larger project designed to develop dietary guidance for the birth to 24-mo population in the United States.

The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation.

PubMed

Lewis, Cara C; Stanick, Cameo F; Martinez, Ruben G; Weiner, Bryan J; Kim, Mimi; Barwick, Melanie; Comtois, Katherine A

2015-01-08

Identification of psychometrically strong instruments for the field of implementation science is a high priority underscored in a recent National Institutes of Health working meeting (October 2013). Existing instrument reviews are limited in scope, methods, and findings. The Society for Implementation Research Collaboration Instrument Review Project's objectives address these limitations by identifying and applying a unique methodology to conduct a systematic and comprehensive review of quantitative instruments assessing constructs delineated in two of the field's most widely used frameworks, adopt a systematic search process (using standard search strings), and engage an international team of experts to assess the full range of psychometric criteria (reliability, construct and criterion validity). Although this work focuses on implementation of psychosocial interventions in mental health and health-care settings, the methodology and results will likely be useful across a broad spectrum of settings. This effort has culminated in a centralized online open-access repository of instruments depicting graphical head-to-head comparisons of their psychometric properties. This article describes the methodology and preliminary outcomes. The seven stages of the review, synthesis, and evaluation methodology include (1) setting the scope for the review, (2) identifying frameworks to organize and complete the review, (3) generating a search protocol for the literature review of constructs, (4) literature review of specific instruments, (5) development of an evidence-based assessment rating criteria, (6) data extraction and rating instrument quality by a task force of implementation experts to inform knowledge synthesis, and (7) the creation of a website repository. To date, this multi-faceted and collaborative search and synthesis methodology has identified over 420 instruments related to 34 constructs (total 48 including subconstructs) that are relevant to implementation science. Despite numerous constructs having greater than 20 available instruments, which implies saturation, preliminary results suggest that few instruments stem from gold standard development procedures. We anticipate identifying few high-quality, psychometrically sound instruments once our evidence-based assessment rating criteria have been applied. The results of this methodology may enhance the rigor of implementation science evaluations by systematically facilitating access to psychometrically validated instruments and identifying where further instrument development is needed.

The systematic review team: contributions of the health sciences librarian.

PubMed

Dudden, Rosalind F; Protzko, Shandra L

2011-01-01

While the role of the librarian as an expert searcher in the systematic review process is widely recognized, librarians also can be enlisted to help systematic review teams with other challenges. This article reviews the contributions of librarians to systematic reviews, including communicating methods of the review process, collaboratively formulating the research question and exclusion criteria, formulating the search strategy on a variety of databases, documenting the searches, record keeping, and writing the search methodology. It also discusses challenges encountered such as irregular timelines, providing education, communication, and learning new technologies for record keeping. Rewards include building relationships with researchers, expanding professional expertise, and receiving recognition for contributions to health care outcomes.

Physical rehabilitation interventions for adult patients with critical illness across the continuum of recovery: an overview of systematic reviews protocol.

PubMed

Connolly, Bronwen; O'Neill, Brenda; Salisbury, Lisa; McDowell, Kathryn; Blackwood, Bronagh

2015-09-29

Patients admitted to the intensive care unit with critical illness often experience significant physical impairments, which typically persist for many years following resolution of the original illness. Physical rehabilitation interventions that enhance restoration of physical function have been evaluated across the continuum of recovery following critical illness including within the intensive care unit, following discharge to the ward and beyond hospital discharge. Multiple systematic reviews have been published appraising the expanding evidence investigating these physical rehabilitation interventions, although there appears to be variability in review methodology and quality. We aim to conduct an overview of existing systematic reviews of physical rehabilitation interventions for adult intensive care patients across the continuum of recovery. This protocol has been developed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocol (PRISMA-P) guidelines. We will search the Cochrane Systematic Review Database, Database of Abstracts of Reviews of Effectiveness, Cochrane Central Register of Controlled Trials, MEDLINE, Excerpta Medica Database and Cumulative Index to Nursing and Allied Health Literature databases. We will include systematic reviews of randomised controlled trials of adult patients, admitted to the intensive care unit and who have received physical rehabilitation interventions at any time point during their recovery. Data extraction will include systematic review aims and rationale, study types, populations, interventions, comparators, outcomes and quality appraisal method. Primary outcomes of interest will focus on findings reflecting recovery of physical function. Quality of reporting and methodological quality will be appraised using the PRISMA checklist and the Assessment of Multiple Systematic Reviews tool. We anticipate the findings from this novel overview of systematic reviews will contribute to the synthesis and interpretation of existing evidence regarding physical rehabilitation interventions and physical recovery in post-critical illness patients across the continuum of recovery. PROSPERO CRD42015001068.

The reliability of physical examination tests for the diagnosis of anterior cruciate ligament rupture--A systematic review.

PubMed

Lange, Toni; Freiberg, Alice; Dröge, Patrik; Lützner, Jörg; Schmitt, Jochen; Kopkow, Christian

2015-06-01

Systematic literature review. Despite their frequent application in routine care, a systematic review on the reliability of clinical examination tests to evaluate the integrity of the ACL is missing. To summarize and evaluate intra- and interrater reliability research on physical examination tests used for the diagnosis of ACL tears. A comprehensive systematic literature search was conducted in MEDLINE, EMBASE and AMED until May 30th 2013. Studies were included if they assessed the intra- and/or interrater reliability of physical examination tests for the integrity of the ACL. Methodological quality was evaluated with the Quality Appraisal of Reliability Studies (QAREL) tool by two independent reviewers. 110 hits were achieved of which seven articles finally met the inclusion criteria. These studies examined the reliability of four physical examination tests. Intrarater reliability was assessed in three studies and ranged from fair to almost perfect (Cohen's k = 0.22-1.00). Interrater reliability was assessed in all included studies and ranged from slight to almost perfect (Cohen's k = 0.02-0.81). The Lachman test is the physical tests with the highest intrarater reliability (Cohen's k = 1.00), the Lachman test performed in prone position the test with the highest interrater reliability (Cohen's k = 0.81). Included studies were partly of low methodological quality. A meta-analysis could not be performed due to the heterogeneity in study populations, reliability measures and methodological quality of included studies. Systematic investigations on the reliability of physical examination tests to assess the integrity of the ACL are scarce and of varying methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

Methodological and Reporting Quality of Systematic Reviews and Meta-analyses in Endodontics.

PubMed

Nagendrababu, Venkateshbabu; Pulikkotil, Shaju Jacob; Sultan, Omer Sheriff; Jayaraman, Jayakumar; Peters, Ove A

2018-06-01

The aim of this systematic review (SR) was to evaluate the quality of SRs and meta-analyses (MAs) in endodontics. A comprehensive literature search was conducted to identify relevant articles in the electronic databases from January 2000 to June 2017. Two reviewers independently assessed the articles for eligibility and data extraction. SRs and MAs on interventional studies with a minimum of 2 therapeutic strategies in endodontics were included in this SR. Methodologic and reporting quality were assessed using A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA), respectively. The interobserver reliability was calculated using the Cohen kappa statistic. Statistical analysis with the level of significance at P < .05 was performed using Kruskal-Wallis tests and simple linear regression analysis. A total of 30 articles were selected for the current SR. Using AMSTAR, the item related to the scientific quality of studies used in conclusion was adhered by less than 40% of studies. Using PRISMA, 3 items were reported by less than 40% of studies, which were on objectives, protocol registration, and funding. No association was evident comparing the number of authors and country with quality. Statistical significance was observed when quality was compared among journals, with studies published as Cochrane reviews superior to those published in other journals. AMSTAR and PRISMA scores were significantly related. SRs in endodontics showed variability in both methodologic and reporting quality. Copyright © 2018 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

A Systematic Review of Depression Treatments in Primary Care for Latino Adults

ERIC Educational Resources Information Center

Cabassa, Leopoldo J.; Hansen, Marissa C.

2007-01-01

Objective: A systematic literature review of randomized clinical trials (RCTs) assessing depression treatments in primary care for Latinos is conducted. The authors rate the methodological quality of studies, examine cultural and linguistic adaptations, summarize clinical outcomes and cost-effectiveness findings, and draw conclusions for improving…

Train the Trainer Effectiveness Trials of Behavioral Intervention for Individuals with Autism: A Systematic Review

ERIC Educational Resources Information Center

Shire, Stephanie Yoshiko; Kasari, Connie

2014-01-01

This systematic review examines train the trainer (TTT) effectiveness trials of behavioral interventions for individuals with autism spectrum disorder (ASD). Published methodological quality scales were used to assess studies including participant description, research design, intervention, outcomes, and analysis. Twelve studies including 9 weak…

Problem-Solving Therapy for Depression in Adults: A Systematic Review

ERIC Educational Resources Information Center

Gellis, Zvi D.; Kenaley, Bonnie

2008-01-01

Objectives: This article presents a systematic review of the evidence on problem-solving therapy (PST) for depressive disorders in noninstitutionalized adults. Method: Intervention studies using randomized controlled designs are included and methodological quality is assessed using a standard set of criteria from the Cochrane Collaborative Review…

Meta-Study as Diagnostic: Toward Content Over Form in Qualitative Synthesis.

PubMed

Frost, Julia; Garside, Ruth; Cooper, Chris; Britten, Nicky

2016-02-01

Having previously conducted qualitative syntheses of the diabetes literature, we wanted to explore the changes in theoretical approaches, methodological practices, and the construction of substantive knowledge which have recently been presented in the qualitative diabetes literature. The aim of this research was to explore the feasibility of synthesizing existing qualitative syntheses of patient perspectives of diabetes using meta-study methodology. A systematic review of qualitative literature, published between 2000 and 2013, was conducted. Six articles were identified as qualitative syntheses. The meta-study methodology was used to compare the theoretical, methodological, analytic, and synthetic processes across the six studies, exploring the potential for an overarching synthesis. We identified that while research questions have increasingly concentrated on specific aspects of diabetes, the focus on systematic review processes has led to the neglect of qualitative theory and methods. This can inhibit the production of compelling results with meaningful clinical applications. Although unable to produce a synthesis of syntheses, we recommend that researchers who conduct qualitative syntheses pay equal attention to qualitative traditions and systematic review processes, to produce research products that are both credible and applicable. © The Author(s) 2015.

Systematic reviews and meta-analyses on psoriasis: role of funding sources, conflict of interest and bibliometric indices as predictors of methodological quality.

PubMed

Gómez-García, F; Ruano, J; Aguilar-Luque, M; Gay-Mimbrera, J; Maestre-Lopez, B; Sanz-Cabanillas, J L; Carmona-Fernández, P J; González-Padilla, M; Vélez García-Nieto, A; Isla-Tejera, B

2017-06-01

The quality of systematic reviews and meta-analyses on psoriasis, a chronic inflammatory skin disease that severely impairs quality of life and is associated with high costs, remains unknown. To assess the methodological quality of systematic reviews published on psoriasis. After a comprehensive search in MEDLINE, Embase and the Cochrane Database (PROSPERO: CDR42016041611), the quality of studies was assessed by two raters using the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Article metadata and journal-related bibliometric indices were also obtained. Systematic reviews were classified as low (0-4), moderate (5-8) or high (9-11) quality. A prediction model for methodological quality was fitted using principal component and multivariate ordinal logistic regression analyses. We classified 220 studies as high (17·2%), moderate (55·0%) or low (27·8%) quality. Lower compliance rates were found for AMSTAR question (Q)5 (list of studies provided, 11·4%), Q10 (publication bias assessed, 27·7%), Q4 (status of publication included, 39·5%) and Q1 (a priori design provided, 40·9%). Factors such as meta-analysis inclusion [odds ratio (OR) 6·22; 95% confidence interval (CI) 2·78-14·86], funding by academic institutions (OR 2·90, 95% CI 1·11-7·89), Article Influence score (OR 2·14, 95% CI 1·05-6·67), 5-year impact factor (OR 1·34, 95% CI 1·02-1·40) and article page count (OR 1·08, 95% CI 1·02-1·15) significantly predicted higher quality. A high number of authors with a conflict of interest (OR 0·90, 95% CI 0·82-0·99) was significantly associated with lower quality. The methodological quality of systematic reviews published about psoriasis remains suboptimal. The type of funding sources and author conflicts may compromise study quality, increasing the risk of bias. © 2017 British Association of Dermatologists.

Using Multiple Types of Studies in Systematic Reviews of Health Care Interventions – A Systematic Review

PubMed Central

Peinemann, Frank; Tushabe, Doreen Allen; Kleijnen, Jos

2013-01-01

Background A systematic review may evaluate different aspects of a health care intervention. To accommodate the evaluation of various research questions, the inclusion of more than one study design may be necessary. One aim of this study is to find and describe articles on methodological issues concerning the incorporation of multiple types of study designs in systematic reviews on health care interventions. Another aim is to evaluate methods studies that have assessed whether reported effects differ by study types. Methods and Findings We searched PubMed, the Cochrane Database of Systematic Reviews, and the Cochrane Methodology Register on 31 March 2012 and identified 42 articles that reported on the integration of single or multiple study designs in systematic reviews. We summarized the contents of the articles qualitatively and assessed theoretical and empirical evidence. We found that many examples of reviews incorporating multiple types of studies exist and that every study design can serve a specific purpose. The clinical questions of a systematic review determine the types of design that are necessary or sufficient to provide the best possible answers. In a second independent search, we identified 49 studies, 31 systematic reviews and 18 trials that compared the effect sizes between randomized and nonrandomized controlled trials, which were statistically different in 35%, and not different in 53%. Twelve percent of studies reported both, different and non-different effect sizes. Conclusions Different study designs addressing the same question yielded varying results, with differences in about half of all examples. The risk of presenting uncertain results without knowing for sure the direction and magnitude of the effect holds true for both nonrandomized and randomized controlled trials. The integration of multiple study designs in systematic reviews is required if patients should be informed on the many facets of patient relevant issues of health care interventions. PMID:24416098

Note of the methodological flaws in the paper entitled "GSTT1 and GSTM1 polymorphisms predict treatment outcome for breast cancer: a systematic review and meta-analysis".

PubMed

Qiu, Mali; Wu, Xu; Qu, Xiaobing

2016-09-01

With great interest, we read the paper "GSTT1 and GSTM1 polymorphisms predict treatment outcome for breast cancer: a systematic review and meta-analysis" (by Hu XY et al.), which has reached important conclusions that GSTM1 null and GSTT1/GSTM1 double null polymorphisms might be significantly associated with an increased tumor response in breast cancer. The result is encouraging. Nevertheless, several methodological flaws in this meta-analysis are worth noticing.

Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES)

PubMed Central

2011-01-01

Background There is growing interest in theory-driven, qualitative and mixed-method approaches to systematic review as an alternative to (or to extend and supplement) conventional Cochrane-style reviews. These approaches offer the potential to expand the knowledge base in policy-relevant areas - for example by explaining the success, failure or mixed fortunes of complex interventions. However, the quality of such reviews can be difficult to assess. This study aims to produce methodological guidance, publication standards and training resources for those seeking to use the realist and/or meta-narrative approach to systematic review. Methods/design We will: [a] collate and summarise existing literature on the principles of good practice in realist and meta-narrative systematic review; [b] consider the extent to which these principles have been followed by published and in-progress reviews, thereby identifying how rigour may be lost and how existing methods could be improved; [c] using an online Delphi method with an interdisciplinary panel of experts from academia and policy, produce a draft set of methodological steps and publication standards; [d] produce training materials with learning outcomes linked to these steps; [e] pilot these standards and training materials prospectively on real reviews-in-progress, capturing methodological and other challenges as they arise; [f] synthesise expert input, evidence review and real-time problem analysis into more definitive guidance and standards; [g] disseminate outputs to audiences in academia and policy. The outputs of the study will be threefold: 1. Quality standards and methodological guidance for realist and meta-narrative reviews for use by researchers, research sponsors, students and supervisors 2. A 'RAMESES' (Realist and Meta-review Evidence Synthesis: Evolving Standards) statement (comparable to CONSORT or PRISMA) of publication standards for such reviews, published in an open-access academic journal. 3. A training module for researchers, including learning outcomes, outline course materials and assessment criteria. Discussion Realist and meta-narrative review are relatively new approaches to systematic review whose overall place in the secondary research toolkit is not yet fully established. As with all secondary research methods, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency of studies. PMID:21843376

The differential impact of scientific quality, bibliometric factors, and social media activity on the influence of systematic reviews and meta-analyses about psoriasis.

PubMed

Ruano, Juan; Aguilar-Luque, Macarena; Gómez-Garcia, Francisco; Alcalde Mellado, Patricia; Gay-Mimbrera, Jesus; Carmona-Fernandez, Pedro J; Maestre-López, Beatriz; Sanz-Cabanillas, Juan Luís; Hernández Romero, José Luís; González-Padilla, Marcelino; Vélez García-Nieto, Antonio; Isla-Tejera, Beatriz

2018-01-01

Researchers are increasingly using on line social networks to promote their work. Some authors have suggested that measuring social media activity can predict the impact of a primary study (i.e., whether or not an article will be highly cited). However, the influence of variables such as scientific quality, research disclosures, and journal characteristics on systematic reviews and meta-analyses has not yet been assessed. The present study aims to describe the effect of complex interactions between bibliometric factors and social media activity on the impact of systematic reviews and meta-analyses about psoriasis (PROSPERO 2016: CRD42016053181). Methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Altmetrics, which consider Twitter, Facebook, and Google+ mention counts as well as Mendeley and SCOPUS readers, and corresponding article citation counts from Google Scholar were obtained for each article. Metadata and journal-related bibliometric indices were also obtained. One-hundred and sixty-four reviews with available altmetrics information were included in the final multifactorial analysis, which showed that social media and impact factor have less effect than Mendeley and SCOPUS readers on the number of cites that appear in Google Scholar. Although a journal's impact factor predicted the number of tweets (OR, 1.202; 95% CI, 1.087-1.049), the years of publication and the number of Mendeley readers predicted the number of citations in Google Scholar (OR, 1.033; 95% CI, 1.018-1.329). Finally, methodological quality was related neither with bibliometric influence nor social media activity for systematic reviews. In conclusion, there seems to be a lack of connectivity between scientific quality, social media activity, and article usage, thus predicting scientific success based on these variables may be inappropriate in the particular case of systematic reviews.

The differential impact of scientific quality, bibliometric factors, and social media activity on the influence of systematic reviews and meta-analyses about psoriasis

PubMed Central

Gómez-Garcia, Francisco; Alcalde Mellado, Patricia; Gay-Mimbrera, Jesus; Carmona-Fernandez, Pedro J.; Maestre-López, Beatriz; Sanz-Cabanillas, Juan Luís; Hernández Romero, José Luís; González-Padilla, Marcelino; Vélez García-Nieto, Antonio; Isla-Tejera, Beatriz

2018-01-01

Researchers are increasingly using on line social networks to promote their work. Some authors have suggested that measuring social media activity can predict the impact of a primary study (i.e., whether or not an article will be highly cited). However, the influence of variables such as scientific quality, research disclosures, and journal characteristics on systematic reviews and meta-analyses has not yet been assessed. The present study aims to describe the effect of complex interactions between bibliometric factors and social media activity on the impact of systematic reviews and meta-analyses about psoriasis (PROSPERO 2016: CRD42016053181). Methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Altmetrics, which consider Twitter, Facebook, and Google+ mention counts as well as Mendeley and SCOPUS readers, and corresponding article citation counts from Google Scholar were obtained for each article. Metadata and journal-related bibliometric indices were also obtained. One-hundred and sixty-four reviews with available altmetrics information were included in the final multifactorial analysis, which showed that social media and impact factor have less effect than Mendeley and SCOPUS readers on the number of cites that appear in Google Scholar. Although a journal’s impact factor predicted the number of tweets (OR, 1.202; 95% CI, 1.087–1.049), the years of publication and the number of Mendeley readers predicted the number of citations in Google Scholar (OR, 1.033; 95% CI, 1.018–1.329). Finally, methodological quality was related neither with bibliometric influence nor social media activity for systematic reviews. In conclusion, there seems to be a lack of connectivity between scientific quality, social media activity, and article usage, thus predicting scientific success based on these variables may be inappropriate in the particular case of systematic reviews. PMID:29377889

Use of programme theory to understand the differential effects of interventions across socio-economic groups in systematic reviews-a systematic methodology review.

PubMed

Maden, Michelle; Cunliffe, Alex; McMahon, Naoimh; Booth, Andrew; Carey, Gina Michelle; Paisley, Suzy; Dickson, Rumona; Gabbay, Mark

2017-12-29

Systematic review guidance recommends the use of programme theory to inform considerations of if and how healthcare interventions may work differently across socio-economic status (SES) groups. This study aimed to address the lack of detail on how reviewers operationalise this in practice. A methodological systematic review was undertaken to assess if, how and the extent to which systematic reviewers operationalise the guidance on the use of programme theory in considerations of socio-economic inequalities in health. Multiple databases were searched from January 2013 to May 2016. Studies were included if they were systematic reviews assessing the effectiveness of an intervention and included data on SES. Two reviewers independently screened all studies, undertook quality assessment and extracted data. A narrative approach to synthesis was adopted. A total of 37 systematic reviews were included, 10 of which were explicit in the use of terminology for 'programme theory'. Twenty-nine studies used programme theory to inform both their a priori assumptions and explain their review findings. Of these, 22 incorporated considerations of both what and how interventions do/do not work in SES groups to both predict and explain their review findings. Thirteen studies acknowledged 24 unique theoretical references to support their assumptions of what or how interventions may have different effects in SES groups. Most reviewers used supplementary evidence to support their considerations of differential effectiveness. The majority of authors outlined a programme theory in the "Introduction" and "Discussion" sections of the review to inform their assumptions or provide explanations of what or how interventions may result in differential effects within or across SES groups. About a third of reviews used programme theory to inform the review analysis and/or synthesis. Few authors used programme theory to inform their inclusion criteria, data extraction or quality assessment. Twenty-one studies tested their a priori programme theory. The use of programme theory to inform considerations of if, what and how interventions lead to differential effects on health in different SES groups in the systematic review process is not yet widely adopted, is used implicitly, is often fragmented and is not implemented in a systematic way.

Node-making process in network meta-analysis of nonpharmacological treatment are poorly reported.

PubMed

James, Arthur; Yavchitz, Amélie; Ravaud, Philippe; Boutron, Isabelle

2018-05-01

To identify methods to support the node-making process in network meta-analyses (NMAs) of nonpharmacological treatments. We proceeded in two stages. First, we conducted a literature review of guidelines and methodological articles about NMAs to identify methods proposed to lump interventions into nodes. Second, we conducted a systematic review of NMAs of nonpharmacological treatments to extract methods used by authors to support their node-making process. MEDLINE and Google Scholar were searched to identify articles assessing NMA guidelines or methodology intended for NMA authors. MEDLINE, CENTRAL, and EMBASE were searched to identify reports of NMAs including at least one nonpharmacological treatment. Both searches involved articles available from database inception to March 2016. From the methodological review, we identified and extracted methods proposed to lump interventions into nodes. From the systematic review, the reporting of the network was assessed as long as the method described supported the node-making process. Among the 116 articles retrieved in the literature review, 12 (10%) discussed the concept of lumping or splitting interventions in NMAs. No consensual method was identified during the methodological review, and expert consensus was the only method proposed to support the node-making process. Among 5187 references for the systematic review, we included 110 reports of NMAs published between 2007 and 2016. The nodes were described in the introduction section of 88 reports (80%), which suggested that the node content might have been a priori decided before the systematic review. Nine reports (8.1%) described a specific process or justification to build nodes for the network. Two methods were identified: (1) fit a previously published classification and (2) expert consensus. Despite the importance of NMA in the delivery of evidence when several interventions are available for a single indication, recommendations on the reporting of the node-making process in NMAs are lacking, and reporting of the node-making process in NMAs seems insufficient. Copyright © 2017 Elsevier Inc. All rights reserved.

Methodological Synthesis in Quantitative L2 Research: A Review of Reviews and a Case Study of Exploratory Factor Analysis

ERIC Educational Resources Information Center

Plonsky, Luke; Gonulal, Talip

2015-01-01

Research synthesis and meta-analysis provide a pathway to bring together findings in a given domain with greater systematicity, objectivity, and transparency than traditional reviews. The same techniques and corresponding benefits can be and have been applied to examine methodological practices in second language (L2) research (e.g., Plonsky,…

Acupuncture to treat common reproductive health complaints: An overview of the evidence.

PubMed

Smith, Caroline A; Carmady, Bridget

2010-10-28

Women specific health complaints are common, and women are higher users of complementary therapies and medicines. Acupuncture is one modality used by women. The aim of this paper was to summarise the evidence from scientific trials and systematic reviews assessing the effectiveness of acupuncture to treat the most common women specific reproductive health complaints. We conducted a search of the major databases PubMed, CINAHL, and the Cochrane Library from their inception to Sept 2009, to obtain English language texts of randomised controlled trials (RCTs) and systematic reviews. The following English Australian search terms were used: acupuncture and period pain or dysmenorrhea, or premenstrual syndrome, or poly cystic ovarian syndrome/PCOS, or menstrual headache, or irregular periods/menstruation, or amenorrhea, or heavy menses/periods, or menorrhagia, or menopause, and randomised controlled trial and systematic review. Both authors extracted data and reviewed each trial and systematic review for methodological quality. Five systematic reviews were included, and six RCTs. The symptoms of the menopause and dysmenorrhea have been subject to greater clinical evaluation through RCTs, and the evidence summarised in systematic reviews, than any other reproductive health complaint. The evidence for acupuncture to treat dysmenorrhea and menopause remains unclear, due to small study populations and the presence of methodological bias. Acupuncture to treat PMS, PCOS and other menstrual related symptoms is under-studied, and the evidence for acupuncture to treat these conditions is frequently based on single studies. Further research is needed. Copyright © 2010 Elsevier B.V. All rights reserved.

Application of systematic review methodology to the field of nutrition.

PubMed

Lichtenstein, Alice H; Yetley, Elizabeth A; Lau, Joseph

2008-12-01

Systematic reviews represent a rigorous and transparent approach to synthesizing scientific evidence that minimizes bias. They evolved within the medical community to support development of clinical and public health practice guidelines, set research agendas, and formulate scientific consensus statements. The use of systematic reviews for nutrition-related topics is more recent. Systematic reviews provide independently conducted comprehensive and objective assessments of available information addressing precise questions. This approach to summarizing available data is a useful tool for identifying the state of science including knowledge gaps and associated research needs, supporting development of science-based recommendations and guidelines, and serving as the foundation for updates as new data emerge. Our objective is to describe the steps for performing systematic reviews and highlight areas unique to the discipline of nutrition that are important to consider in data assessment. The steps involved in generating systematic reviews include identifying staffing and planning for outside expert input, forming a research team, developing an analytic framework, developing and refining research questions, defining eligibility criteria, identifying search terms, screening abstracts according to eligibility criteria, retrieving articles for evaluation, constructing evidence and summary tables, assessing methodological quality and applicability, and synthesizing results including performing meta-analysis, if appropriate. Unique and at times challenging, nutrition-related considerations include baseline nutrient exposure, nutrient status, bioequivalence of bioactive compounds, bioavailability, multiple and interrelated biological functions, undefined nature of some interventions, and uncertainties in intake assessment. Systematic reviews are a valuable and independent component of decision-making processes by groups responsible for developing science-based recommendations and policies.

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Methodological quality and descriptive characteristics of prosthodontic-related systematic reviews.

PubMed

Aziz, T; Compton, S; Nassar, U; Matthews, D; Ansari, K; Flores-Mir, C

2013-04-01

Ideally, healthcare systematic reviews (SRs) should be beneficial to practicing professionals in making evidence-based clinical decisions. However, the conclusions drawn from SRs are directly related to the quality of the SR and of the included studies. The aim was to investigate the methodological quality and key descriptive characteristics of SRs published in prosthodontics. Methodological quality was analysed using the Assessment of Multiple Reviews (AMSTAR) tool. Several electronic resources (MEDLINE, EMBASE, Web of Science and American Dental Association's Evidence-based Dentistry website) were searched. In total 106 SRs were located. Key descriptive characteristics and methodological quality features were gathered and assessed, and descriptive and inferential statistical testing performed. Most SRs in this sample originated from the European continent followed by North America. Two to five authors conducted most SRs; the majority was affiliated with academic institutions and had prior experience publishing SRs. The majority of SRs were published in specialty dentistry journals, with implant or implant-related topics, the primary topics of interest for most. According to AMSTAR, most quality aspects were adequately fulfilled by less than half of the reviews. Publication bias and grey literature searches were the most poorly adhered components. Overall, the methodological quality of the prosthodontic-related systematic was deemed limited. Future recommendations would include authors to have prior training in conducting SRs and for journals to include a universal checklist that should be adhered to address all key characteristics of an unbiased SR process. © 2013 Blackwell Publishing Ltd.

How effects on health equity are assessed in systematic reviews of interventions.

PubMed

Welch, Vivian; Tugwell, Peter; Petticrew, Mark; de Montigny, Joanne; Ueffing, Erin; Kristjansson, Betsy; McGowan, Jessie; Benkhalti Jandu, Maria; Wells, George A; Brand, Kevin; Smylie, Janet

2010-12-08

Enhancing health equity has now achieved international political importance with endorsement from the World Health Assembly in 2009.  The failure of systematic reviews to consider effects on health equity is cited by decision-makers as a limitation to their ability to inform policy and program decisions.  To systematically review methods to assess effects on health equity in systematic reviews of effectiveness. We searched the following databases up to July 2 2010: MEDLINE, PsychINFO, the Cochrane Methodology Register, CINAHL, Education Resources Information Center, Education Abstracts, Criminal Justice Abstracts, Index to Legal Periodicals, PAIS International, Social Services Abstracts, Sociological Abstracts, Digital Dissertations and the Health Technology Assessment Database. We searched SCOPUS to identify articles that cited any of the included studies on October 7 2010. We included empirical studies of cohorts of systematic reviews that assessed methods for measuring effects on health inequalities. Data were extracted using a pre-tested form by two independent reviewers. Risk of bias was appraised for included studies according to the potential for bias in selection and detection of systematic reviews.  Thirty-four methodological studies were included.  The methods used by these included studies were: 1) Targeted approaches (n=22); 2) gap approaches (n=12) and gradient approach (n=1).  Gender or sex was assessed in eight out of 34 studies, socioeconomic status in ten studies, race/ethnicity in seven studies, age in seven studies, low and middle income countries in 14 studies, and two studies assessed multiple factors across health inequity may exist.Only three studies provided a definition of health equity. Four methodological approaches to assessing effects on health equity were identified: 1) descriptive assessment of reporting and analysis in systematic reviews (all 34 studies used a type of descriptive method); 2) descriptive assessment of reporting and analysis in original trials (12/34 studies); 3) analytic approaches (10/34 studies); and 4) applicability assessment (11/34 studies). Both analytic and applicability approaches were not reported transparently nor in sufficient detail to judge their credibility. There is a need for improvement in conceptual clarity about the definition of health equity, describing sufficient detail about analytic approaches (including subgroup analyses) and transparent reporting of judgments required for applicability assessments in order to assess and report effects on health equity in systematic reviews.

Peer-based health interventions for people with serious mental illness: A systematic literature review.

PubMed

Cabassa, Leopoldo J; Camacho, David; Vélez-Grau, Carolina M; Stefancic, Ana

2017-01-01

Health interventions delivered by peer specialists or co-facilitated by peer specialists and health professionals can help improve the physical health of people with serious mental illness (SMI). Yet, the quality of the studies examining these health interventions and their impact on health outcomes remains unclear. To address this gap, we conducted a systematic literature review of peer-based health interventions for people with SMI. We rated the methodological quality of studies, summarized intervention strategies and health outcomes, and evaluated the inclusion of racial and ethnic minorities in these studies. We used the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines to conduct our systematic literature review. Electronic bibliographic databases and manual searches were used to locate articles that were published in English in peer-reviewed journals between 1990 and 2015, described peer-based health interventions for people with SMI, and evaluated the impact of the interventions on physical health outcomes. Two independent reviewers used a standardized instrument to rate studies' methodological quality, abstracted study characteristics, and evaluated the effects of the interventions on different health outcomes. Eighteen articles were reviewed. Findings indicated that the strength of the evidence generated from these studies is limited due to several methodological limitations. Mixed and limited intervention effects were reported for most health outcomes. The most promising interventions were self-management and peer-navigator interventions. Efforts to strengthen the evidence of peer-based interventions require a research agenda that focuses on establishing the efficacy and effectiveness of these interventions across different populations and settings. Copyright © 2016 Elsevier Ltd. All rights reserved.

[Marxism as a theoretical and methodological framework in collective health: implications for systematic review and synthesis of evidence].

PubMed

Soares, Cassia Baldini; Campos, Celia Maria Sivalli; Yonekura, Tatiana

2013-12-01

In this study, we discuss the integration in systematic reviews of research developed from a Marxist perspective of knowledge production and their results as evidence in healthcare. The study objectives are to review the assumptions of dialectical and historical materialism (DHM) and discuss the implications of dialectics for a literature review and the synthesis of evidence. DHM is a powerful framework for knowledge generation and transformation of policies and practices in healthcare. It assumes that social contradictions underlie the health-disease process, the fundamental theoretical construction in the field of collective health. Currently, we observe a considerable influence of the critical paradigm, of Marxist origin, in the construction of knowledge in health. Studies based on this critical paradigm incorporate complex methods, which are inherent to the guidelines of dialect, to identify the object and arrive at results that constitute evidence in healthcare. Systematic reviews should address the methodological difficulties associated with entirely integrating these results to healthcare.

[Quality appraisal of systematic reviews or meta-analysis on traditional Chinese medicine published in Chinese journals].

PubMed

Liu, Jian-ping; Xia, Yun

2007-04-01

To critically assess the quality of literature about systematic review or meta-analysis on traditional Chinese medicine (TCM) published in Chinese journals. Electronic searches in CNKI, VIP and Wanfang data-base were conducted to retrieve the systematic reviews or meta-analysis reports on TCM, including herbal medicine, needling, acupuncture and moxibustion, as well as integrative medicine, they were identified and extracted according to the 18 items of QUOROM (quality of reporting of meta-analyses) Statement and relative information. The appraisal was made taking the indexes mainly including objectives, source of data, methods of data extraction, quality assessment of the included studies, measurement data synthesis, etc. Eighty-two systematic reviews were identified, except 6 reviews were excluded for repeatedly published or didn't comply with the enrolled criterion, 76 reviews concerning 51 kinds of diseases were enrolled for appraisal. Among them, 70 reviews evaluated the efficacy of TCM, mainly on Chinese herbs and 9 on acupuncture and moxibustion. In majority of the reviews, randomised controlled trials were included and the data resources were described, but in 26 reviews only the Chinese databases were searched and the description about data extraction and analysis method were too simple; and 70% of reviews assessed the quality of the included studies; none used flow chart to express the process of selection, inclusion and exclusion of studies. Few reviews or Meta-analysis reports reached the international standard and there is insufficient description of methodology for conducting systematic reviews, so it is hardly to be repeated. The authors suggested that advanced methodological training is necessary for reviewers.

Impact of ambient temperature on morbidity and mortality: An overview of reviews.

PubMed

Song, Xuping; Wang, Shigong; Hu, Yuling; Yue, Man; Zhang, Tingting; Liu, Yu; Tian, Jinhui; Shang, Kezheng

2017-05-15

The objectives were (i) to conduct an overview of systematic reviews to summarize evidence from and evaluate the methodological quality of systematic reviews assessing the impact of ambient temperature on morbidity and mortality; and (ii) to reanalyse meta-analyses of cold-induced cardiovascular morbidity in different age groups. The registration number is PROSPERO-CRD42016047179. PubMed, Embase, the Cochrane Library, Web of Science, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Global Health were systematically searched to identify systematic reviews. Two reviewers independently selected studies for inclusion, extracted data, and assessed quality. The Assessment of Multiple Systematic Reviews (AMSTAR) checklist was used to assess the methodological quality of included systematic reviews. Estimates of morbidity and mortality risk in association with heat exposure, cold exposure, heatwaves, cold spells and diurnal temperature ranges (DTRs) were the primary outcomes. Twenty-eight systematic reviews were included in the overview of systematic reviews. (i) The median (interquartile range) AMSTAR scores were 7 (1.75) for quantitative reviews and 3.5 (1.75) for qualitative reviews. (ii) Heat exposure was identified to be associated with increased risk of cardiovascular, cerebrovascular and respiratory mortality, but was not found to have an impact on cardiovascular or cerebrovascular morbidity. (iii) Reanalysis of the meta-analyses indicated that cold-induced cardiovascular morbidity increased in youth and middle-age (RR=1.009, 95% CI: 1.004-1.015) as well as the elderly (RR=1.013, 95% CI: 1.007-1.018). (iv) The definitions of temperature exposure adopted by different studies included various temperature indicators and thresholds. In conclusion, heat exposure seemed to have an adverse effect on mortality and cold-induced cardiovascular morbidity increased in the elderly. Developing definitions of temperature exposure at the regional level may contribute to more accurate evaluations of the health effects of temperature. Copyright © 2017 Elsevier B.V. All rights reserved.

Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review

PubMed Central

Krauth, David; Woodruff, Tracey J.

2013-01-01

Background: Results from animal toxicology studies are critical to evaluating the potential harm from exposure to environmental chemicals or the safety of drugs prior to human testing. However, there is significant debate about how to evaluate the methodology and potential biases of the animal studies. There is no agreed-upon approach, and a systematic evaluation of current best practices is lacking. Objective: We performed a systematic review to identify and evaluate instruments for assessing the risk of bias and/or other methodological criteria of animal studies. Method: We searched Medline (January 1966–November 2011) to identify all relevant articles. We extracted data on risk of bias criteria (e.g., randomization, blinding, allocation concealment) and other study design features included in each assessment instrument. Discussion: Thirty distinct instruments were identified, with the total number of assessed risk of bias, methodological, and/or reporting criteria ranging from 2 to 25. The most common criteria assessed were randomization (25/30, 83%), investigator blinding (23/30, 77%), and sample size calculation (18/30, 60%). In general, authors failed to empirically justify why these or other criteria were included. Nearly all (28/30, 93%) of the instruments have not been rigorously tested for validity or reliability. Conclusion: Our review highlights a number of risk of bias assessment criteria that have been empirically tested for animal research, including randomization, concealment of allocation, blinding, and accounting for all animals. In addition, there is a need for empirically testing additional methodological criteria and assessing the validity and reliability of a standard risk of bias assessment instrument. Citation: Krauth D, Woodruff TJ, Bero L. 2013. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121:985–992 (2013); http://dx.doi.org/10.1289/ehp.1206389 PMID:23771496

Systematic reviews of therapeutic interventions frequently consider patient-important outcomes.

PubMed

Ameur, Hayet; Ravaud, Philippe; Fayard, Florence; Riveros, Carolina; Dechartres, Agnes

2017-04-01

To determine whether recently published and ongoing systematic reviews of therapeutic interventions assess patient-important outcomes. For this methodological review, we searched MEDLINE via PubMed for recently published systematic reviews and online registry of systematic reviews (PROSPERO) for ongoing systematic reviews. We selected systematic reviews with meta-analyses of randomized controlled trials. We extracted all outcomes defined in the methods section and categorized them. Mortality, other clinical events, pain, quality of life, function, and therapeutic decisions were considered patient-important outcomes. We included 420 systematic reviews: 90 Cochrane reviews, 200 other published reviews, and 130 registered ongoing reviews. Primary outcomes were defined in 85 Cochrane reviews (95%), 98 (49%) other published reviews and all ongoing reviews. At least one patient-important outcome was defined as a primary outcome in 81/85 Cochrane reviews (95%), 78/98 other published reviews (80%), and 117/130 ongoing reviews (90%). Considering all outcomes assessed, at least one patient-important outcome was evaluated in 90/90 Cochrane reviews (100%), 189/200 other published reviews (95%), and 121/130 ongoing reviews (93%). Most recent systematic reviews aim to assess patient-important outcomes, which contrasts with RCTs. These results suggest some important gaps between primary and secondary research. Copyright © 2017 Elsevier Inc. All rights reserved.

Dissemination of Periodontal Pathogens in the Bloodstream after Periodontal Procedures: A Systematic Review

PubMed Central

Horliana, Anna Carolina Ratto Tempestini; Chambrone, Leandro; Foz, Adriana Moura; Artese, Hilana Paula Carillo; Rabelo, Mariana de Sousa; Pannuti, Cláudio Mendes; Romito, Giuseppe Alexandre

2014-01-01

Background To date, there is no compilation of evidence-based information associating bacteremia and periodontal procedures. This systematic review aims to assess magnitude, duration, prevalence and nature of bacteremia caused by periodontal procedures. Study Design Systematic Review Types of Studies Reviewed MEDLINE, EMBASE and LILACS databases were searched in duplicate through August, 2013 without language restriction. Observational studies were included if blood samples were collected before, during or after periodontal procedures of patients with periodontitis. The methodological quality was assessed in duplicate using the modified Newcastle-Ottawa scale (NOS). Results Search strategy identified 509 potentially eligible articles and nine were included. Only four studies demonstrated high methodological quality, whereas five were of medium or low methodological quality. The study characteristics were considered too heterogeneous to conduct a meta-analysis. Among 219 analyzed patients, 106 (49.4%) had positive bacteremia. More frequent bacteria were S. viridans, A. actinomycetemcomitans P. gingivalis, M. micros and species Streptococcus and Actinomyces, although identification methods of microbiologic assays were different among studies. Clinical Implications Although half of the patients presented positive bacteremia after periodontal procedures, accurate results regarding the magnitude, duration and nature of bacteremia could not be confidentially assessed. PMID:24870125

Communication Interventions and Their Impact on Behaviour in the Young Child: A Systematic Review

ERIC Educational Resources Information Center

Law, James; Plunkett, Charlene C.; Stringer, Helen

2012-01-01

Speech, language and communication needs (SLCN) and social, emotional and behaviour difficulties (SEBD) commonly overlap, yet we know relatively little about the mechanism linking the two, specifically to what extent it is possible to reduce behaviour difficulties by targeted communication skills. The EPPI Centre systematic review methodology was…

Measuring the impact of medicines regulatory interventions – Systematic review and methodological considerations

PubMed Central

Morales, Daniel R.; Pacurariu, Alexandra; Kurz, Xavier

2017-01-01

Aims Evaluating the public health impact of regulatory interventions is important but there is currently no common methodological approach to guide this evaluation. This systematic review provides a descriptive overview of the analytical methods for impact research. Methods We searched MEDLINE and EMBASE for articles with an empirical analysis evaluating the impact of European Union or non‐European Union regulatory actions to safeguard public health published until March 2017. References from systematic reviews and articles from other known sources were added. Regulatory interventions, data sources, outcomes of interest, methodology and key findings were extracted. Results From 1246 screened articles, 229 were eligible for full‐text review and 153 articles in English language were included in the descriptive analysis. Over a third of articles studied analgesics and antidepressants. Interventions most frequently evaluated are regulatory safety communications (28.8%), black box warnings (23.5%) and direct healthcare professional communications (10.5%); 55% of studies measured changes in drug utilization patterns, 27% evaluated health outcomes, and 18% targeted knowledge, behaviour or changes in clinical practice. Unintended consequences like switching therapies or spill‐over effects were rarely evaluated. Two‐thirds used before–after time series and 15.7% before–after cross‐sectional study designs. Various analytical approaches were applied including interrupted time series regression (31.4%), simple descriptive analysis (28.8%) and descriptive analysis with significance tests (23.5%). Conclusion Whilst impact evaluation of pharmacovigilance and product‐specific regulatory interventions is increasing, the marked heterogeneity in study conduct and reporting highlights the need for scientific guidance to ensure robust methodologies are applied and systematic dissemination of results occurs. PMID:29105853

Applying systematic review methods to studies of people's views: an example from public health research.

PubMed

Harden, Angela; Garcia, Jo; Oliver, Sandy; Rees, Rebecca; Shepherd, Jonathan; Brunton, Ginny; Oakley, Ann

2004-09-01

Methods for systematic reviews are well developed for trials, but not for non-experimental or qualitative research. This paper describes the methods developed for reviewing research on people's perspectives and experiences ("views" studies) alongside trials within a series of reviews on young people's mental health, physical activity, and healthy eating. Reports of views studies were difficult to locate; could not easily be classified as "qualitative" or "quantitative"; and often failed to meet seven basic methodological reporting standards used in a newly developed quality assessment tool. Synthesising views studies required the adaptation of qualitative analysis techniques. The benefits of bringing together views studies in a systematic way included gaining a greater breadth of perspectives and a deeper understanding of public health issues from the point of view of those targeted by interventions. A systematic approach also aided reflection on study methods that may distort, misrepresent, or fail to pick up people's views. This methodology is likely to create greater opportunities for people's own perspectives and experiences to inform policies to promote their health.

Applying systematic review methods to studies of people's views: an example from public health research

PubMed Central

Harden, A.; Garcia, J.; Oliver, S.; Rees, R.; Shepherd, J.; Brunton, G.; Oakley, A.

2004-01-01

Methods for systematic reviews are well developed for trials, but not for non-experimental or qualitative research. This paper describes the methods developed for reviewing research on people's perspectives and experiences ("views" studies) alongside trials within a series of reviews on young people's mental health, physical activity, and healthy eating. Reports of views studies were difficult to locate; could not easily be classified as "qualitative" or "quantitative"; and often failed to meet seven basic methodological reporting standards used in a newly developed quality assessment tool. Synthesising views studies required the adaptation of qualitative analysis techniques. The benefits of bringing together views studies in a systematic way included gaining a greater breadth of perspectives and a deeper understanding of public health issues from the point of view of those targeted by interventions. A systematic approach also aided reflection on study methods that may distort, misrepresent, or fail to pick up people's views. This methodology is likely to create greater opportunities for people's own perspectives and experiences to inform policies to promote their health. PMID:15310807

A methodological systematic review of what's wrong with meta-ethnography reporting.

PubMed

France, Emma F; Ring, Nicola; Thomas, Rebecca; Noyes, Jane; Maxwell, Margaret; Jepson, Ruth

2014-11-19

Syntheses of qualitative studies can inform health policy, services and our understanding of patient experience. Meta-ethnography is a systematic seven-phase interpretive qualitative synthesis approach well-suited to producing new theories and conceptual models. However, there are concerns about the quality of meta-ethnography reporting, particularly the analysis and synthesis processes. Our aim was to investigate the application and reporting of methods in recent meta-ethnography journal papers, focusing on the analysis and synthesis process and output. Methodological systematic review of health-related meta-ethnography journal papers published from 2012-2013. We searched six electronic databases, Google Scholar and Zetoc for papers using key terms including 'meta-ethnography.' Two authors independently screened papers by title and abstract with 100% agreement. We identified 32 relevant papers. Three authors independently extracted data and all authors analysed the application and reporting of methods using content analysis. Meta-ethnography was applied in diverse ways, sometimes inappropriately. In 13% of papers the approach did not suit the research aim. In 66% of papers reviewers did not follow the principles of meta-ethnography. The analytical and synthesis processes were poorly reported overall. In only 31% of papers reviewers clearly described how they analysed conceptual data from primary studies (phase 5, 'translation' of studies) and in only one paper (3%) reviewers explicitly described how they conducted the analytic synthesis process (phase 6). In 38% of papers we could not ascertain if reviewers had achieved any new interpretation of primary studies. In over 30% of papers seminal methodological texts which could have informed methods were not cited. We believe this is the first in-depth methodological systematic review of meta-ethnography conduct and reporting. Meta-ethnography is an evolving approach. Current reporting of methods, analysis and synthesis lacks clarity and comprehensiveness. This is a major barrier to use of meta-ethnography findings that could contribute significantly to the evidence base because it makes judging their rigour and credibility difficult. To realise the high potential value of meta-ethnography for enhancing health care and understanding patient experience requires reporting that clearly conveys the methodology, analysis and findings. Tailored meta-ethnography reporting guidelines, developed through expert consensus, could improve reporting.

Towards a methodology for cluster searching to provide conceptual and contextual "richness" for systematic reviews of complex interventions: case study (CLUSTER).

PubMed

Booth, Andrew; Harris, Janet; Croot, Elizabeth; Springett, Jane; Campbell, Fiona; Wilkins, Emma

2013-09-28

Systematic review methodologies can be harnessed to help researchers to understand and explain how complex interventions may work. Typically, when reviewing complex interventions, a review team will seek to understand the theories that underpin an intervention and the specific context for that intervention. A single published report from a research project does not typically contain this required level of detail. A review team may find it more useful to examine a "study cluster"; a group of related papers that explore and explain various features of a single project and thus supply necessary detail relating to theory and/or context.We sought to conduct a preliminary investigation, from a single case study review, of techniques required to identify a cluster of related research reports, to document the yield from such methods, and to outline a systematic methodology for cluster searching. In a systematic review of community engagement we identified a relevant project - the Gay Men's Task Force. From a single "key pearl citation" we conducted a series of related searches to find contextually or theoretically proximate documents. We followed up Citations, traced Lead authors, identified Unpublished materials, searched Google Scholar, tracked Theories, undertook ancestry searching for Early examples and followed up Related projects (embodied in the CLUSTER mnemonic). Our structured, formalised procedure for cluster searching identified useful reports that are not typically identified from topic-based searches on bibliographic databases. Items previously rejected by an initial sift were subsequently found to inform our understanding of underpinning theory (for example Diffusion of Innovations Theory), context or both. Relevant material included book chapters, a Web-based process evaluation, and peer reviewed reports of projects sharing a common ancestry. We used these reports to understand the context for the intervention and to explore explanations for its relative lack of success. Additional data helped us to challenge simplistic assumptions on the homogeneity of the target population. A single case study suggests the potential utility of cluster searching, particularly for reviews that depend on an understanding of context, e.g. realist synthesis. The methodology is transparent, explicit and reproducible. There is no reason to believe that cluster searching is not generalizable to other review topics. Further research should examine the contribution of the methodology beyond improved yield, to the final synthesis and interpretation, possibly by utilizing qualitative sensitivity analysis.

METHODOLOGICAL QUALITY OF ECONOMIC EVALUATIONS ALONGSIDE TRIALS OF KNEE PHYSIOTHERAPY.

PubMed

García-Pérez, Lidia; Linertová, Renata; Arvelo-Martín, Alejandro; Guerra-Marrero, Carolina; Martínez-Alberto, Carlos Enrique; Cuéllar-Pompa, Leticia; Escobar, Antonio; Serrano-Aguilar, Pedro

2017-01-01

The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis. Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale. All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account. Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

Global trends in the incidence and prevalence of type 2 diabetes in children and adolescents: a systematic review and evaluation of methodological approaches.

PubMed

Fazeli Farsani, S; van der Aa, M P; van der Vorst, M M J; Knibbe, C A J; de Boer, A

2013-07-01

This study aimed to systematically review what has been reported on the incidence and prevalence of type 2 diabetes in children and adolescents, to scrutinise the methodological issues observed in the included studies and to prepare recommendations for future research and surveillances. PubMed, the Cochrane Database of Systematic Reviews, Scopus, EMBASE and Web of Science were searched from inception to February 2013. Population-based studies on incidence and prevalence of type 2 diabetes in children and adolescents were summarised and methodologically evaluated. Owing to substantial methodological heterogeneity and considerable differences in study populations a quantitative meta-analysis was not performed. Among 145 potentially relevant studies, 37 population-based studies met the inclusion criteria. Variations in the incidence and prevalence rates of type 2 diabetes in children and adolescents were mainly related to age of the study population, calendar time, geographical regions and ethnicity, resulting in a range of 0-330 per 100,000 person-years for incidence rates, and 0-5,300 per 100,000 population for prevalence rates. Furthermore, a substantial variation in the methodological characteristics was observed for response rates (60-96%), ascertainment rates (53-99%), diagnostic tests and criteria used to diagnose type 2 diabetes. Worldwide incidence and prevalence of type 2 diabetes in children and adolescents vary substantially among countries, age categories and ethnic groups and this can be explained by variations in population characteristics and methodological dissimilarities between studies.

Traditional chinese medicine: an update on clinical evidence.

PubMed

Xue, Charlie C L; Zhang, Anthony L; Greenwood, Kenneth M; Lin, Vivian; Story, David F

2010-03-01

As an alternative medical system, Traditional Chinese Medicine (TCM) has been increasingly used over the last several decades. Such a consumer-driven development has resulted in introduction of education programs for practitioner training, development of product and practitioner regulation systems, and generation of an increasing interest in research. Significant efforts have been made in validating the quality, effectiveness, and safety of TCM interventions evidenced by a growing number of published trials and systematic reviews. Commonly, the results of these studies were inconclusive due to the lack of quality and quantity of the trials to answer specific and answerable clinical questions. The methodology of a randomized clinical trial (RCT) is not free from bias, and the unique features of TCM (such as individualization and holism) further complicate effective execution of RCTs in TCM therapies. Thus, data from limited RCTs and systematic reviews need to be interpreted with great caution. Nevertheless, until new and specific methodology is developed that can adequately address these methodology challenges for RCTs in TCM, evidence from quality RCTs and systematic reviews still holds the credibility of TCM in the scientific community. This article summarizes studies on TCM utilization, and regulatory and educational development with a focus on updating the TCM clinical evidence from RCTs and systematic reviews over the last decade. The key issues and challenges associated with evidence-based TCM developments are also explored.

Documenting legal status: a systematic review of measurement of undocumented status in health research.

PubMed

Young, Maria-Elena De Trinidad; Madrigal, Daniel S

2017-01-01

Undocumented status is rarely measured in health research, yet it influences the lives and well-being of immigrants. The growing body of research on undocumented status and health shows the need to assess the measurement of this legal status. We discuss the definition of undocumented status, conduct a systematic review of the methodological approaches currently taken to measure undocumented status of immigrants in the USA, and discuss recommendations for advancement of measurement methods. We conducted a systematic review of 61 studies indexed in PubMed, conducted in the USA, and published from 2004 to 2014. We categorized each of the studies' data source and type, measurement type, and information for classifying undocumented participants. Studies used self-reported or proxy measures of legal status. Information to classify undocumented participants included self-reported status, possession of a Social Security number, possession of health insurance or institutional resources, concern about deportation, and participant characteristics. Findings show it is feasible to collect self-reported measures of undocumented status. We recommend that researchers collect self-reported measures of undocumented status whenever possible and limit the use of proxy measures. Validated and standardized measures are needed for within and across country measurement. Authors should provide methodological information about measurement in publications. Finally, individuals who are undocumented should be included in the development of these methodologies. This systematic review is not registered.

Recruitment for exercise or physical activity interventions: a protocol for systematic review.

PubMed

Hoover, Jeffrey C; Alenazi, Aqeel M; Alothman, Shaima; Alshehri, Mohammed M; Rucker, Jason; Kluding, Patricia

2018-03-27

Recruiting participants into research trials is essential for the advancement of scientific knowledge that depends on clinical research studies. For the field of exercise and physical activity, there is an added difficulty in recruiting participants because participants must be willing to participate in an intervention that requires a significant commitment of both time and physical effort. Therefore, we have planned a systematic review to analyse how methodological factors, intervention characteristics and participant demographics impact recruitment rates in specific populations. This information will help researchers improve the design and recruitment approach in future studies. A mixed methods systematic review will be performed on studies that implement physical activity interventions and present data on participant recruitment. We plan on searching the Pubmed, Cumulative Index to Nursing and Allied Health Literature and Online Resource for Recruitment research in Clinical Trials databases for potentially eligible articles from database inception through 10 February 2017. A standardised approach will be used to identify studies through a review of titles, abstracts and reference lists. The process for each eligible study is to determine their eligibility, extract data from eligible studies and rate each eligible study's methodological quality. Exploratory multivariate regression models will be used to determine the effects of methodological factors, intervention characteristics and participant demographics on the recruitment variables of interest. Because all of the data used in this systematic review has been published, this review does not require ethical approval. The results of this review will be disseminated through peer-reviewed publication as well as through conference presentations. CRD42017057284. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Synthesising quantitative and qualitative research in evidence-based patient information.

PubMed

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-03-01

Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence-based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non-quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg "explain what the test involves") was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review.

Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol)

PubMed Central

2014-01-01

Background Lean is a set of operating philosophies and methods that help create a maximum value for patients by reducing waste and waits. It emphasizes the consideration of the customer’s needs, employee involvement and continuous improvement. Research on the application and implementation of lean principles in health care has been limited. Methods This is a protocol for a systematic review, following the Cochrane Effective Practice and Organisation of Care (EPOC) methodology. The review aims to document, catalogue and synthesize the existing literature on the effects of lean implementation in health care settings especially the potential effects on professional practice and health care outcomes. We have developed a Medline keyword search strategy, and this focused strategy will be translated into other databases. All search strategies will be provided in the review. The method proposed by the Cochrane EPOC group regarding randomized study designs, non-randomised controlled trials controlled before and after studies and interrupted time series will be followed. In addition, we will also include cohort, case–control studies, and relevant non-comparative publications such as case reports. We will categorize and analyse the review findings according to the study design employed, the study quality (low- versus high-quality studies) and the reported types of implementation in the primary studies. We will present the results of studies in a tabular form. Discussion Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin the implementation of lean activities in health care settings as defined in this protocol. As a result, the review will provide an evidence base for the effectiveness of lean and implementation methodologies reported in health care. Systematic review registration PROSPERO CRD42014008853 PMID:25238974

Sugar-Sweetened Beverages and Obesity Risk in Children and Adolescents: A Systematic Analysis on How Methodological Quality May Influence Conclusions.

PubMed

Bucher Della Torre, Sophie; Keller, Amélie; Laure Depeyre, Jocelyne; Kruseman, Maaike

2016-04-01

In the context of a worldwide high prevalence of childhood obesity, the role of sugar-sweetened beverage (SSB) consumption as a cause of excess weight gain remains controversial. Conflicting results may be due to methodological issues in original studies and in reviews. The aim of this review was to systematically analyze the methodology of studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents, and the studies' ability to answer this research question. A systematic review of cohort and experimental studies published until December 2013 in peer-reviewed journals was performed on Medline, CINAHL, Web of Knowledge, and ClinicalTrials.gov. Studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents were included, and methodological quality to answer this question was assessed independently by two investigators using the Academy of Nutrition and Dietetics Quality Criteria Checklist. Among the 32 identified studies, nine had positive quality ratings and 23 studies had at least one major methodological issue. Main methodological issues included SSB definition and inadequate measurement of exposure. Studies with positive quality ratings found an association between SSB consumption and risk of obesity or obesity (n=5) (ie, when SSB consumption increased so did obesity) or mixed results (n=4). Studies with a neutral quality rating found a positive association (n=7), mixed results (n=9), or no association (n=7). The present review shows that the majority of studies with strong methodology indicated a positive association between SSB consumption and risk of obesity or obesity, especially among overweight children. In addition, study findings highlight the need for the careful and precise measurement of the consumption of SSBs and of important confounders. Copyright © 2016 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Systematic reviews do not adequately report or address missing outcome data in their analyses: a methodological survey.

PubMed

Kahale, Lara A; Diab, Batoul; Brignardello-Petersen, Romina; Agarwal, Arnav; Mustafa, Reem A; Kwong, Joey; Neumann, Ignacio; Li, Ling; Lopes, Luciane Cruz; Briel, Matthias; Busse, Jason W; Iorio, Alfonso; Vandvik, Per Olav; Alexander, Paul Elias; Guyatt, Gordon; Akl, Elie A

2018-07-01

To describe how systematic review authors report and address categories of participants with potential missing outcome data of trial participants. Methodological survey of systematic reviews reporting a group-level meta-analysis. We included a random sample of 50 Cochrane and 50 non-Cochrane systematic reviews. Of these, 25 reported in their methods section a plan to consider at least one of the 10 categories of missing outcome data; 42 reported in their results, data for at least one category of missing data. The most reported category in the methods and results sections was "unexplained loss to follow-up" (n = 34 in methods section and n = 6 in the results section). Only 19 reported a method to handle missing data in their primary analyses, which was most often complete case analysis. Few reviews (n = 9) reported in the methods section conducting sensitivity analysis to judge risk of bias associated with missing outcome data at the level of the meta-analysis; and only five of them presented the results of these analyses in the results section. Most systematic reviews do not explicitly report sufficient information on categories of trial participants with potential missing outcome data or address missing data in their primary analyses. Copyright © 2018 Elsevier Inc. All rights reserved.

Methodology of a systematic review.

PubMed

Linares-Espinós, E; Hernández, V; Domínguez-Escrig, J L; Fernández-Pello, S; Hevia, V; Mayor, J; Padilla-Fernández, B; Ribal, M J

2018-05-03

The objective of evidence-based medicine is to employ the best scientific information available to apply to clinical practice. Understanding and interpreting the scientific evidence involves understanding the available levels of evidence, where systematic reviews and meta-analyses of clinical trials are at the top of the levels-of-evidence pyramid. The review process should be well developed and planned to reduce biases and eliminate irrelevant and low-quality studies. The steps for implementing a systematic review include (i) correctly formulating the clinical question to answer (PICO), (ii) developing a protocol (inclusion and exclusion criteria), (iii) performing a detailed and broad literature search and (iv) screening the abstracts of the studies identified in the search and subsequently of the selected complete texts (PRISMA). Once the studies have been selected, we need to (v) extract the necessary data into a form designed in the protocol to summarise the included studies, (vi) assess the biases of each study, identifying the quality of the available evidence, and (vii) develop tables and text that synthesise the evidence. A systematic review involves a critical and reproducible summary of the results of the available publications on a particular topic or clinical question. To improve scientific writing, the methodology is shown in a structured manner to implement a systematic review. Copyright © 2018 AEU. Publicado por Elsevier España, S.L.U. All rights reserved.

Epidemiology, quality, and reporting characteristics of systematic reviews and meta-analyses of nursing interventions published in Chinese journals.

PubMed

Zhang, Juxia; Wang, Jiancheng; Han, Lin; Zhang, Fengwa; Cao, Jianxun; Ma, Yuxia

2015-01-01

Systematic reviews (SRs) and meta-analyses (MAs) of nursing interventions have become increasingly popular in China. This review provides the first examination of epidemiological characteristics of these SRs as well as compliance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses and Assessment of Multiple Systematic Reviews guidelines. The purpose of this study was to examine epidemiologic and reporting characteristics as well as the methodologic quality of SRs and MAs of nursing interventions published in Chinese journals. Four Chinese databases were searched (the Chinese Biomedicine Literature Database, Chinese Scientific Journal Full-text Database, Chinese Journal Full-text Database, and Wanfang Database) for SRs and MAs of nursing intervention from inception through June 2013. Data were extracted into Excel (Microsoft, Redmond, WA). The Assessment of Multiple Systematic Reviews and Preferred Reporting Items for Systematic Reviews and Meta-analyses checklists were used to assess methodologic quality and reporting characteristics, respectively. A total of 144 SRs were identified, most (97.2%) of which used "systematic review" or "meta-analyses" in the titles. None of the reviews had been updated. Nearly half (41%) were written by nurses, and more than half (61%) were reported in specialist journals. The most common conditions studied were endocrine, nutritional and metabolic diseases, and neoplasms. Most (70.8%) reported information about quality assessment, whereas less than half (25%) reported assessing for publication bias. None of the reviews reported a conflict of interest. Although many SRs of nursing interventions have been published in Chinese journals, the quality of these reviews is of concern. As a potential key source of information for nurses and nursing administrators, not only were many of these reviews incomplete in the information they provided, but also some results were misleading. Improving the quality of SRs of nursing interventions conducted and published by nurses in China is urgently needed in order to increase the value of these studies. Copyright © 2015 Elsevier Inc. All rights reserved.

Introduction to systematic reviews in animal agriculture and veterinary medicine.

PubMed

Sargeant, J M; O'Connor, A M

2014-06-01

This article is the first in a series of six articles related to systematic reviews in animal agriculture and veterinary medicine. In this article, we overview the methodology of systematic reviews and provide a discussion of their use. Systematic reviews differ qualitatively from traditional reviews by explicitly defining a specific review question, employing methods to reduce bias in the selection and inclusion of studies that address the review question (including a systematic and specified search strategy, and selection of studies based on explicit eligibility criteria), an assessment of the risk of bias for included studies and objectively summarizing the results qualitatively or quantitatively (i.e. via meta-analysis). Systematic reviews have been widely used to address human healthcare questions and are increasingly being used in veterinary medicine. Systematic reviews can provide veterinarians and other decision-makers with a scientifically defensible summary of the current state of knowledge on a topic without the need for the end-user to read the vast amount of primary research related to that topic. © 2014 Blackwell Verlag GmbH.

[Injuries in the Martial Arts Judo, Taekwondo and Wrestling - A Systematic Review].

PubMed

Jäggi, U; Joray, C P; Brülhart, Y; Luijckx, E; Rogan, S

2015-12-01

Martial arts such as judo, taekwondo and wrestling are regulated, usually athletic duels. The aim is to score better than your opponent or to win. As with any type of sport, athletes in martial arts sustain minor and major injuries, which may have many negative consequences. In addition, sports injuries and their rehabilitation generate high costs to the healthcare system. In contrast to the FIFA 11+ warm-up program, no preventive programs have been postulated for injury prevention in these martial arts. Therefore, the aim of this systematic review was to summarise the latest research findings and to evaluate whether initial recommendations can be given for the reduction of injuries in the martial arts judo, wrestling and taekwondo. To gain an overview of the latest research findings, we searched for systematic reviews in PEDro, PubMed, Cochrane and the internet search engine Google Scholar. The methodological quality of these reviews was assessed using the Critical Appraisal Tool for a Systematic Review (CASP), and data was extracted on the risk of injury, injury location and injury type. It was found that all three review articles are of low to moderate methodological quality. Regarding injury location, it became evident that the extremities are particularly vulnerable to injury in all three martial arts. Effusion was observed to be the most common type of injury. Due to the moderate methodological quality and the injury type of effusion, it is not possible to formulate recommendations for injury prevention. Moreover, uniform definitions should be developed to describe sports injuries. © Georg Thieme Verlag KG Stuttgart · New York.

Iodised salt and iodine supplements for prenatal and postnatal growth: a rapid scoping of existing systematic reviews.

PubMed

Farebrother, Jessica; Naude, Celeste E; Nicol, Liesl; Andersson, Maria; Zimmermann, Michael B

2015-09-02

Iodine deficiency can adversely affect child development including stunted growth. However, the effect of iodine supplementation or fortification on prenatal and postnatal growth in children (<18 years) is unclear. We identified the potential need for a systematic review to contribute to the evidence base in this area. To avoid duplication and inform the need for a new systematic review and its protocol, we undertook a rapid scoping review of existing systematic reviews investigating the effect of iodised salt and iodine supplements on growth and other iodine-related outcomes. We searched TRIP and Epistemokinos (latest search date 15 December 2014). All English language systematic reviews reporting on the effect of iodine supplementation or fortification in any form, dose or regimen on any iodine-related health outcomes (including but not limited to growth) were included. Eligible systematic reviews could include experimental or observational studies in pregnant or lactating women or children to age 18. We tabulated the extracted data to capture the scope of questions addressed, including: author, publication year, most recent search date, participants, pre-specified treatment/exposure and comparator, pre-specified outcomes, outcomes relevant to our question and number and type of studies included. Methodological quality of included reviews was assessed using AMSTAR. Nine hundred and seventy-six records were screened and 10 reviews included. Most studies were of moderate methodological quality. Outcomes included assessments of thyroid function, iodine deficiency disorders, mental development and growth. Populations studied included pregnant women, preterm infants and children into adulthood. Most reviews looked at direct iodine supplementation or fortification, though some reviews considered iodine status, including the relationship between iodine intake and iodine biomarkers. Although five reviews pre-specified inclusion of growth outcomes, none provided synthesised evidence on the effects of iodine supplementation or fortification on prenatal and postnatal somatic growth. Our rapid scoping review demonstrates a gap in the evidence base with no existing, up-to-date systematic reviews on the effects of all forms of iodine supplementation/fortification in all of the relevant population groups on relevant growth and growth-related outcomes. A new systematic review examining this question will assist in addressing this gap.

Efficacy of coloured overlays and lenses for treating reading difficulty: an overview of systematic reviews.

PubMed

Suttle, Catherine M; Lawrenson, John G; Conway, Miriam L

2018-04-06

Coloured overlays or lenses are widely available for use by children and adults with difficulties or discomfort while reading. In recent years, systematic reviews have been conducted in an attempt to establish the strength of the evidence base for this intervention. The aim of this overview is to systematically review these reviews. The methodology was published prospectively as a protocol (Prospero CRD42017059172). Online databases Medline, Cinahl, Embase and the Cochrane Library were searched for systematic reviews on the efficacy of coloured overlays or lenses for the alleviation of reading difficulty or discomfort. Included studies were appraised using the AMSTAR 2 checklist. Characteristics of included studies such as aspects of methods, results and conclusions were recorded. Both processes were conducted independently by two reviewers and any discrepancies were resolved by discussion. Thirty-one studies were found via databases and other sources. After excluding duplicates and those not fitting the inclusion criteria, four reviews were included in the analysis. While all reviews were systematic, their methodology, results and conclusions differed. Three of the four concluded that there is insufficient good quality evidence to support the use of coloured overlays or lenses for reading difficulty, while one concluded that, despite research limitations, the evidence does support their use. On balance, systematic reviews to date indicate that there is not yet a reliable evidence base on which to recommend coloured overlays or lenses for the alleviation of reading difficulty or discomfort. High quality, low bias research is needed to investigate their effectiveness in different forms of reading difficulty and discomfort for adults and children. © 2018 Optometry Australia.

Measurement properties of patient reported outcome measures for spondyloarthritis: A systematic review.

PubMed

Png, Kelly; Kwan, Yu Heng; Leung, Ying Ying; Phang, Jie Kie; Lau, Jia Qi; Lim, Ka Keat; Chew, Eng Hui; Low, Lian Leng; Tan, Chuen Seng; Thumboo, Julian; Fong, Warren; Østbye, Truls

2018-03-21

This systematic review aimed to identify studies investigating measurement properties of patient reported outcome measures (PROMs) for spondyloarthritis (SpA), and to evaluate their methodological quality and level of evidence relating to the measurement properties of PROMs. This systematic review was guided by the preferred reporting items for systematic review and meta-analysis (PRISMA). Articles published before 30 June 2017 were retrieved from PubMed ® , Embase ® , and PsychINFO ® (Ovid). Methodological quality and level of evidence were evaluated according to recommendations from the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). We identified 60 unique PROMs from 125 studies in 39 countries. Twenty-one PROMs were validated for two or more SpA subtypes. The literature examined hypothesis testing (82.4%) most frequently followed by reliability (60.0%). A percentage of 77.7% and 42.7% of studies that assessed PROMs for hypothesis testing and reliability, respectively had "fair" or better methodological quality. Among the PROMs identified, 41.7% were studied in ankylosing spondylitis (AS) only and 23.3% were studied in psoriatic arthritis (PsA) only. The more extensively assessed PROMs included the ankylosing spondylitis quality of life (ASQoL) and bath ankylosing spondylitis functional index (BASFI) for ankylosing spondylitis, and the psoriatic arthritis quality of life questionnaire (VITACORA-19) for psoriatic arthritis. This study identified 60 unique PROMs through a systematic review and synthesized evidence of the measurement properties of the PROMs. There is a lack of validation of PROMs for use across SpA subtypes. Future studies may consider validating PROMs for use across different SpA subtypes. Copyright © 2018 Elsevier Inc. All rights reserved.

Sensory re-education after nerve injury of the upper limb: a systematic review.

PubMed

Oud, Tanja; Beelen, Anita; Eijffinger, Elianne; Nollet, Frans

2007-06-01

To systematically review the available evidence for the effectiveness of sensory re-education to improve the sensibility of the hand in patients with a peripheral nerve injury of the upper limb. Studies were identified by an electronic search in the databases MEDLINE, Cumulative Index to Nursing & Allied Health Literature (CINAHL), EMBASE, the Cochrane Library, the Physiotherapy Evidence Database (PEDro), and the database of the Dutch National Institute of Allied Health Professions (Doconline) and by screening the reference lists of relevant articles. Two reviewers selected studies that met the following inclusion criteria: all designs except case reports, adults with impaired sensibility of the hand due to a peripheral nerve injury of the upper limb, and sensibility and functional sensibility as outcome measures. The methodological quality of the included studies was independently assessed by two reviewers. A best-evidence synthesis was performed, based on design, methodological quality and significant findings on outcome measures. Seven studies, with sample sizes ranging from 11 to 49, were included in the systematic review and appraised for content. Five of these studies were of poor methodological quality. One uncontrolled study (N = 1 3 ) was considered to be of sufficient methodological quality, and one randomized controlled trial (N = 49) was of high methodological quality. Best-evidence synthesis showed that there is limited evidence for the effectiveness of sensory re-education, provided by a statistically significant improvement in sensibility found in one high-quality randomized controlled trial. There is a need for further well-defined clinical trials to assess the effectiveness of sensory re-education of patients with impaired sensibility of the hand due to a peripheral nerve injury.

Is there relationship between temporomandibular disorders and head and cervical posture? A systematic review.

PubMed

Rocha, C P; Croci, C S; Caria, P H F

2013-11-01

The objective of this systematic review was to find sufficient evidence to deny or accept the association between the head and cervical posture and temporomandibular disorders (TMDs), and thus assist health professionals in the evaluation and treatment of patients with TMDs. A search was conducted through all publications written in English about this topic using the databases from Medline, ISI Web of Science, EMBASE, PubMed and Lilacs. The abstracts that fulfilled the initial guideline were retrieved and evaluated to ensure they met the inclusion criteria. To assess the methodological quality of the studies, we developed a questionnaire considering the following criteria: participant's eligibility, control group, diagnosis of TMDs, posture diagnosis and randomisation. Twenty-two studies were selected as potential studies based on their abstracts. Only seventeen studies actually fulfilled the inclusion criteria. The search provided information about the methodological quality of the studies, in which several methodological defects were found. The evidence presented in this systematic review shows that the relation between TMDs and the head and neck posture is still controversial and unclear. The insufficient number of articles considered of excellent methodological quality is a factor that hinders the acceptance or denial of this association. © 2013 John Wiley & Sons Ltd.

[Counseling interventions for smoking cessation: systematic review].

PubMed

Alba, Luz Helena; Murillo, Raúl; Castillo, Juan Sebastián

2013-04-01

A systematic review on efficacy and safety of smoking cessation counseling was developed. The ADAPTE methodology was used with a search of Clinical Practice Guidelines (CPG) in Medline, EMBASE, CINAHL, LILACS, and Cochrane. DELBI was used to select CPG with score over 60 in methodological rigor and applicability to the Colombian health system. Smoking cessation rates at 6 months were assessed according to counseling provider, model, and format. In total 5 CPG out of 925 references were selected comprising 44 systematic reviews and meta-analyses. Physician brief counseling and trained health professionals' intensive counseling (individual, group, proactive telephone) are effective with abstinence rates between 2.1% and 17.4%. Only practical counseling and motivational interview were found effective intensive interventions. The clinical effect of smoking cessation counseling is low and long term cessation rates uncertain. Cost-effectiveness analyses are recommended for the implementation of counseling in public health programs.

Potential value of systematic reviews of qualitative evidence in informing user-centered health and social care: findings from a descriptive overview.

PubMed

Dalton, Jane; Booth, Andrew; Noyes, Jane; Sowden, Amanda J

2017-08-01

Systematic reviews of quantitative evidence are well established in health and social care. Systematic reviews of qualitative evidence are increasingly available, but volume, topics covered, methods used, and reporting quality are largely unknown. We provide a descriptive overview of systematic reviews of qualitative evidence assessing health and social care interventions included on the Database of Abstracts of Reviews of Effects (DARE). We searched DARE for reviews published between January 1, 2009, and December 31, 2014. We extracted data on review content and methods, summarized narratively, and explored patterns over time. We identified 145 systematic reviews conducted worldwide (64 in the UK). Interventions varied but largely covered treatment or service delivery in community and hospital settings. There were no discernible patterns over time. Critical appraisal of primary studies was conducted routinely. Most reviews were poorly reported. Potential exists to use systematic reviews of qualitative evidence when driving forward user-centered health and social care. We identify where more research is needed and propose ways to improve review methodology and reporting. Copyright © 2017 Elsevier Inc. All rights reserved.

Writing in the Secondary-Level Disciplines: A Systematic Review of Context, Cognition, and Content

ERIC Educational Resources Information Center

Miller, Diane M.; Scott, Chyllis E.; McTigue, Erin M.

2018-01-01

Situated within the historical and current state of writing and adolescent literacy research, this systematic literature review screened 3504 articles to determine the prevalent themes in current research on writing tasks in content-area classrooms. Each of the 3504 studies was evaluated and coded using seven methodological quality indicators. The…

Meta-Ethnography and Systematic Reviews--Linked to the Evidence Movement and Caught in a Dilemma

ERIC Educational Resources Information Center

Borgnakke, Karen

2017-01-01

Meta-ethnography and systematic review of qualitative research are needed but also challenged by the link to the evidence movement's models and PISA-traditions for measuring learning effects. For reflections on the perspective for meta-ethnography it means to reconstruct the methodological argument almost divided in a "Before and After…

Prevalence of Chronic Health Conditions in Children with Intellectual Disability: A Systematic Literature Review

ERIC Educational Resources Information Center

Oeseburg, Barth; Dijkstra, Geke J.; Groothoff, Johan W.; Reijneveld, Sijmen A.; Jansen, Danielle E. M. C.

2011-01-01

A systematic review of the prevalence rates of chronic health conditions in populations of children with intellectual disability was provided. We identified 2,994 relevant studies by searching Medline, Cinahl, and PsycINFO databases from 1996 to 2008. We included the 31 studies that had sufficient methodological quality. The 6 most prevalent…

Factors Associated with Social Interactions between Deaf Children and Their Hearing Peers: A Systematic Literature Review

ERIC Educational Resources Information Center

Batten, Georgina; Oakes, Peter M.; Alexander, Tim

2014-01-01

Research indicates that deaf children can have marked social difficulties compared with their hearing peers. Factors that influence these social interactions need to be reviewed to inform interventions. A systematic search of 5 key databases and 3 specialized journals identified 14 papers that met the inclusion criteria. Methodological quality of…

Methodological quality is underrated in systematic reviews and meta-analyses in health psychology.

PubMed

Oliveras, Isabel; Losilla, Josep-Maria; Vives, Jaume

2017-06-01

In this paper, we compile and describe the main approaches proposed in the literature to include methodological quality (MQ) or risk of bias (RoB) into research synthesis. We also meta-review how the RoB of observational primary studies is being assessed and to what extent the results are incorporated in the conclusions of research synthesis. Electronic databases were searched for systematic reviews or meta-analyses related to health and clinical psychology. A random sample of 90 reviews published between January 2010 and May 2016 was examined. A total of 46 reviews (51%) performed a formal assessment of the RoB of primary studies. Only 17 reviews (19%) linked the outcomes of quality assessment with the results of the review. According to the previous literature, our results corroborate the lack of guidance to incorporate the RoB assessment in the results of systematic reviews and meta-analyses. Our recommendation is to appraise MQ according to domains of RoB to rate the degree of credibility of the results of a research synthesis, as well as subgroup analysis or meta-regression as analytical methods to incorporate the quality assessment. Copyright © 2017 Elsevier Inc. All rights reserved.

HIV RISK REDUCTION INTERVENTIONS AMONG SUBSTANCE-ABUSING REPRODUCTIVE-AGE WOMEN: A SYSTEMATIC REVIEW

PubMed Central

Weissman, Jessica; Kanamori, Mariano; Dévieux, Jessy G.; Trepka, Mary Jo; De La Rosa, Mario

2017-01-01

HIV/AIDS is one of the leading causes of death among reproductive-age women throughout the world, and substance abuse plays a major role in HIV infection. We conducted a systematic review, in accordance with the 2015 Preferred Items for Reporting Systematic Reviews and Meta-analysis tool, to assess HIV risk-reduction intervention studies among reproductive-age women who abuse substances. We initially identified 6,506 articles during our search and, after screening titles and abstracts, examining articles in greater detail, and finally excluding those rated methodologically weak, a total of 10 studies were included in this review. Studies that incorporated behavioral skills training into the intervention and were based on theoretical model(s) were the most effective in general at decreasing sex and drug risk behaviors. Additional HIV risk-reduction intervention research with improved methodological designs is warranted to determine the most efficacious HIV risk-reduction intervention for reproductive-age women who abuse substances. PMID:28467160

Intergenerational Trauma in Refugee Families: A Systematic Review

PubMed Central

Sangalang, Cindy C.; Vang, Cindy

2016-01-01

Although a robust literature describes the intergenerational effects of traumatic experiences in various populations, evidence specific to refugee families is scattered and contains wide variations in approaches for examining intergenerational trauma. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria, the purpose of this systematic review was to describe the methodologies and findings of peer-reviewed literature regarding intergenerational trauma in refugee families. In doing so we aimed to critically examine how existing literature characterizes refugee trauma, its long-term effects on descendants, and psychosocial processes of transmission in order to provide recommendations for future research. The results highlight populations upon which current evidence is based, conceptualizations of refugee trauma, effects of parental trauma transmission on descendants’ health and well-being, and mechanisms of transmission and underlying meanings attributed to parental trauma in refugee families. Greater methodological rigor and consistency in future evidence-based research is needed to inform supportive systems that promote the health and well-being of refugees and their descendants. PMID:27659490

The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes.

PubMed

Woodruff, Tracey J; Sutton, Patrice

2014-10-01

Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. We sought to develop a proof of concept of the "Navigation Guide," a systematic and transparent method of research synthesis in environmental health. The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of "risk of bias," and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a "moderate" quality rating to human observational studies and combining diverse evidence streams. The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm.

Bias due to selective inclusion and reporting of outcomes and analyses in systematic reviews of randomised trials of healthcare interventions.

PubMed

Page, Matthew J; McKenzie, Joanne E; Kirkham, Jamie; Dwan, Kerry; Kramer, Sharon; Green, Sally; Forbes, Andrew

2014-10-01

Systematic reviews may be compromised by selective inclusion and reporting of outcomes and analyses. Selective inclusion occurs when there are multiple effect estimates in a trial report that could be included in a particular meta-analysis (e.g. from multiple measurement scales and time points) and the choice of effect estimate to include in the meta-analysis is based on the results (e.g. statistical significance, magnitude or direction of effect). Selective reporting occurs when the reporting of a subset of outcomes and analyses in the systematic review is based on the results (e.g. a protocol-defined outcome is omitted from the published systematic review). To summarise the characteristics and synthesise the results of empirical studies that have investigated the prevalence of selective inclusion or reporting in systematic reviews of randomised controlled trials (RCTs), investigated the factors (e.g. statistical significance or direction of effect) associated with the prevalence and quantified the bias. We searched the Cochrane Methodology Register (to July 2012), Ovid MEDLINE, Ovid EMBASE, Ovid PsycINFO and ISI Web of Science (each up to May 2013), and the US Agency for Healthcare Research and Quality (AHRQ) Effective Healthcare Program's Scientific Resource Center (SRC) Methods Library (to June 2013). We also searched the abstract books of the 2011 and 2012 Cochrane Colloquia and the article alerts for methodological work in research synthesis published from 2009 to 2011 and compiled in Research Synthesis Methods. We included both published and unpublished empirical studies that investigated the prevalence and factors associated with selective inclusion or reporting, or both, in systematic reviews of RCTs of healthcare interventions. We included empirical studies assessing any type of selective inclusion or reporting, such as investigations of how frequently RCT outcome data is selectively included in systematic reviews based on the results, outcomes and analyses are discrepant between protocol and published review or non-significant outcomes are partially reported in the full text or summary within systematic reviews. Two review authors independently selected empirical studies for inclusion, extracted the data and performed a risk of bias assessment. A third review author resolved any disagreements about inclusion or exclusion of empirical studies, data extraction and risk of bias. We contacted authors of included studies for additional unpublished data. Primary outcomes included overall prevalence of selective inclusion or reporting, association between selective inclusion or reporting and the statistical significance of the effect estimate, and association between selective inclusion or reporting and the direction of the effect estimate. We combined prevalence estimates and risk ratios (RRs) using a random-effects meta-analysis model. Seven studies met the inclusion criteria. No studies had investigated selective inclusion of results in systematic reviews, or discrepancies in outcomes and analyses between systematic review registry entries and published systematic reviews. Based on a meta-analysis of four studies (including 485 Cochrane Reviews), 38% (95% confidence interval (CI) 23% to 54%) of systematic reviews added, omitted, upgraded or downgraded at least one outcome between the protocol and published systematic review. The association between statistical significance and discrepant outcome reporting between protocol and published systematic review was uncertain. The meta-analytic estimate suggested an increased risk of adding or upgrading (i.e. changing a secondary outcome to primary) when the outcome was statistically significant, although the 95% CI included no association and a decreased risk as plausible estimates (RR 1.43, 95% CI 0.71 to 2.85; two studies, n = 552 meta-analyses). Also, the meta-analytic estimate suggested an increased risk of downgrading (i.e. changing a primary outcome to secondary) when the outcome was statistically significant, although the 95% CI included no association and a decreased risk as plausible estimates (RR 1.26, 95% CI 0.60 to 2.62; two studies, n = 484 meta-analyses). None of the included studies had investigated whether the association between statistical significance and adding, upgrading or downgrading of outcomes was modified by the type of comparison, direction of effect or type of outcome; or whether there is an association between direction of the effect estimate and discrepant outcome reporting.Several secondary outcomes were reported in the included studies. Two studies found that reasons for discrepant outcome reporting were infrequently reported in published systematic reviews (6% in one study and 22% in the other). One study (including 62 Cochrane Reviews) found that 32% (95% CI 21% to 45%) of systematic reviews did not report all primary outcomes in the abstract. Another study (including 64 Cochrane and 118 non-Cochrane reviews) found that statistically significant primary outcomes were more likely to be completely reported in the systematic review abstract than non-significant primary outcomes (RR 2.66, 95% CI 1.81 to 3.90). None of the studies included systematic reviews published after 2009 when reporting standards for systematic reviews (Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) Statement, and Methodological Expectations of Cochrane Intervention Reviews (MECIR)) were disseminated, so the results might not be generalisable to more recent systematic reviews. Discrepant outcome reporting between the protocol and published systematic review is fairly common, although the association between statistical significance and discrepant outcome reporting is uncertain. Complete reporting of outcomes in systematic review abstracts is associated with statistical significance of the results for those outcomes. Systematic review outcomes and analysis plans should be specified prior to seeing the results of included studies to minimise post-hoc decisions that may be based on the observed results. Modifications that occur once the review has commenced, along with their justification, should be clearly reported. Effect estimates and CIs should be reported for all systematic review outcomes regardless of the results. The lack of research on selective inclusion of results in systematic reviews needs to be addressed and studies that avoid the methodological weaknesses of existing research are also needed.

A systematic review of methodology applied during preclinical anesthetic neurotoxicity studies: important issues and lessons relevant to the design of future clinical research.

PubMed

Disma, Nicola; Mondardini, Maria C; Terrando, Niccolò; Absalom, Anthony R; Bilotta, Federico

2016-01-01

Preclinical evidence suggests that anesthetic agents harm the developing brain thereby causing long-term neurocognitive impairments. It is not clear if these findings apply to humans, and retrospective epidemiological studies thus far have failed to show definitive evidence that anesthetic agents are harmful to the developing human brain. The aim of this systematic review was to summarize the preclinical studies published over the past decade, with a focus on methodological issues, to facilitate the comparison between different preclinical studies and inform better design of future trials. The literature search identified 941 articles related to the topic of neurotoxicity. As the primary aim of this systematic review was to compare methodologies applied in animal studies to inform future trials, we excluded a priori all articles focused on putative mechanism of neurotoxicity and the neuroprotective agents. Forty-seven preclinical studies were finally included in this review. Methods used in these studies were highly heterogeneous-animals were exposed to anesthetic agents at different developmental stages, in various doses and in various combinations with other drugs, and overall showed diverse toxicity profiles. Physiological monitoring and maintenance of physiological homeostasis was variable and the use of cognitive tests was generally limited to assessment of specific brain areas, with restricted translational relevance to humans. Comparison between studies is thus complicated by this heterogeneous methodology and the relevance of the combined body of literature to humans remains uncertain. Future preclinical studies should use better standardized methodologies to facilitate transferability of findings from preclinical into clinical science. © 2015 John Wiley & Sons Ltd.

Arthroscopic repair of lateral ankle ligament complex by suture anchor.

PubMed

Wang, Jingwei; Hua, Yinghui; Chen, Shiyi; Li, Hongyun; Zhang, Jian; Li, Yunxia

2014-06-01

Arthroscopic repair of the lateral ligament complex with suture anchors is increasingly used to treat chronic ankle instability (CAI). Our aims are (1) to analyze and evaluate the literature on arthroscopic suture anchor repair of the anterior talofibular ligament and (2) to conduct a systematic review of the clinical evidence on the reported outcomes and complications of treating CAI with this technique. We performed a systematic review of the literature using PubMed, Ovid, Elsevier ScienceDirect, Web of Science-Conference Proceedings Citation Index, and the Cochrane Database of Systematic Reviews from 1987 to September 2013. Clinical studies using the arthroscopic suture anchor technique to treat CAI were included. Outcome measures consisted of clinical assessment of postoperative ligament stability and complications. In addition, the methodologic quality of the included studies was assessed by use of the modified Coleman Methodology Score. After reviewing 371 studies, we identified 6 studies (5 retrospective case series and 1 prospective case series, all Level IV) that met the inclusion criteria, with a mean Coleman Methodology Score of 71.8 ± 7.52 (range, 63 to 82). In these studies 178 patients (179 ankles) underwent arthroscopic suture anchor repair of the anterior talofibular ligament with a mean follow-up period of 38.9 months (range, 6 to 117.6 months). All patients were reported to have subjective improvement of their ankle instability, with complications in 31 cases. Studies of arthroscopic suture anchor technique to treat CAI are sparse, with moderate mean methodologic quality. The included studies suggest that the arthroscopic technique is a feasible procedure to restore ankle stability; however, on the basis of our review, this technique seems to be associated with a relatively high complication rate. Extensive cadaveric studies, clinical trials, and comparative studies comparing arthroscopic and open repair should be performed in the future. Level IV, systematic review of Level IV studies. Copyright © 2014 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Consistency and accuracy of indexing systematic review articles and meta-analyses in medline.

PubMed

Wilczynski, Nancy L; Haynes, R Brian

2009-09-01

Systematic review articles support the advance of science and translation of research evidence into healthcare practice. Inaccurate retrieval from medline could limit access to reviews. To determine the quality of indexing systematic reviews and meta-analyses in medline. The Clinical Hedges Database, containing the results of a hand search of 161 journals, was used to test medline indexing terms for their ability to retrieve systematic reviews that met predefined methodologic criteria (labelled as 'pass' review articles) and reviews that reported a meta-analysis. The Clinical Hedges Database contained 49 028 articles; 753 were 'pass' review articles (552 with a meta-analysis). In total 758 review articles (independent of whether they passed) reported a meta-analysis. The search strategy that retrieved the highest number of 'pass' systematic reviews achieved a sensitivity of 97.1%. The publication type 'meta analysis' had a false positive rate of 5.6% (95% CI 3.9 to 7.6), and false negative rate of 0.31% (95% CI 0.26 to 0.36) for retrieving systematic reviews that reported a meta-analysis. Inaccuracies in indexing systematic reviews and meta-analyses in medline can be partly overcome by a 5-term search strategy. Introducing a publication type for systematic reviews of the literature could improve retrieval performance.

Impact of searching clinical trial registries in systematic reviews of pharmaceutical treatments: methodological systematic review and reanalysis of meta-analyses.

PubMed

Baudard, Marie; Yavchitz, Amélie; Ravaud, Philippe; Perrodeau, Elodie; Boutron, Isabelle

2017-02-17

Objective  To evaluate the impact of searching clinical trial registries in systematic reviews. Design  Methodological systematic review and reanalyses of meta-analyses. Data sources  Medline was searched to identify systematic reviews of randomised controlled trials (RCTs) assessing pharmaceutical treatments published between June 2014 and January 2015. For all systematic reviews that did not report a trial registry search but reported the information to perform it, the World Health Organization International Trials Registry Platform (WHO ICTRP search portal) was searched for completed or terminated RCTs not originally included in the systematic review. Data extraction  For each systematic review, two researchers independently extracted the outcomes analysed, the number of patients included, and the treatment effect estimated. For each RCT identified, two researchers independently determined whether the results were available (ie, posted, published, or available on the sponsor website) and extracted the data. When additional data were retrieved, we reanalysed meta-analyses and calculated the weight of the additional RCTs and the change in summary statistics by comparison with the original meta-analysis. Results  Among 223 selected systematic reviews, 116 (52%) did not report a search of trial registries; 21 of these did not report the information to perform the search (key words, search date). A search was performed for 95 systematic reviews; for 54 (57%), no additional RCTs were found and for 41 (43%) 122 additional RCTs were identified. The search allowed for increasing the number of patients by more than 10% in 19 systematic reviews, 20% in 10, 30% in seven, and 50% in four. Moreover, 63 RCTs had results available; the results for 45 could be included in a meta-analysis. 14 systematic reviews including 45 RCTs were reanalysed. The weight of the additional RCTs in the recalculated meta-analyses ranged from 0% to 58% and was greater than 10% in five of 14 systematic reviews, 20% in three, and 50% in one. The change in summary statistics ranged from 0% to 29% and was greater than 10% for five of 14 systematic reviews and greater than 20% for two. However, none of the changes to summary effect estimates led to a qualitative change in the interpretation of the results once the new trials were added. Conclusions  Trial registries are an important source for identifying additional RCTs. The additional number of RCTs and patients included if a search were performed varied across systematic reviews. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation.

PubMed

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7-8) versus Group B: 8 (7-9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals.

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation

PubMed Central

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Introduction Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. Methods In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Results Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7–8) versus Group B: 8 (7–9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). Conclusion The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals. PMID:27167982

A systematic review of training programs for parents of children with autism spectrum disorders: single subject contributions.

PubMed

Patterson, Stephanie Y; Smith, Veronica; Mirenda, Pat

2012-09-01

The purpose of this systematic review was to examine research utilizing single subject research designs (SSRD) to explore the effectiveness of interventions designed to increase parents' ability to support communication and social development in children with autism spectrum disorders (ASDs). Included studies were systematically assessed for methodological quality (Logan et al., 2008; Smith et al., 2007) and intervention effects. Data examining participant characteristics, study methodology, outcomes, and analysis were systematically extracted. Eleven SSRD parent-training intervention studies examining 44 participants with ASD were included. Overall, the studies were of moderate quality and reported increases in parent skills and child language and communication outcomes. The results supported by improvement rate difference (IRD) analysis indicated several interventions demonstrated positive effects for both parent and child outcomes. However, limited generalization and follow-up data suggested only one intervention demonstrated parents' accurate and ongoing intervention implementation beyond training.

Reporting of financial and non-financial conflicts of interest by authors of systematic reviews: a methodological survey

PubMed Central

Anouti, Sirine; Al-Gibbawi, Mounir; Abou-Jaoude, Elias A; Hasbani, Divina Justina; Guyatt, Gordon; Akl, Elie A

2016-01-01

Background Conflicts of interest may bias the findings of systematic reviews. The objective of this methodological survey was to assess the frequency and different types of conflicts of interest that authors of Cochrane and non-Cochrane systematic reviews report. Methods We searched for systematic reviews using the Cochrane Database of Systematic Reviews and Ovid MEDLINE (limited to the 119 Core Clinical Journals and the year 2015). We defined a conflict of interest disclosure as the reporting of whether a conflict of interest exists or not, and used a framework to classify conflicts of interest into individual (financial, professional and intellectual) and institutional (financial and advocatory) conflicts of interest. We conducted descriptive and regression analyses. Results Of the 200 systematic reviews, 194 (97%) reported authors' conflicts of interest disclosures, typically in the main document, and in a few cases either online (2%) or on request (5%). Of the 194 Cochrane and non-Cochrane reviews, 49% and 33%, respectively, had at least one author reporting any type of conflict of interest (p=0.023). Institutional conflicts of interest were less frequently reported than individual conflicts of interest, and Cochrane reviews were more likely to report individual intellectual conflicts of interest compared with non-Cochrane reviews (19% and 5%, respectively, p=0.004). Regression analyses showed a positive association between reporting of conflicts of interest (at least one type of conflict of interest, individual financial conflict of interest, institutional financial conflict of interest) and journal impact factor and between reporting individual financial conflicts of interest and pharmacological versus non-pharmacological intervention. Conclusions Although close to half of the published systematic reviews report that authors (typically many) have conflicts of interest, more than half report that they do not. Authors reported individual conflicts of interest more frequently than institutional and non-financial conflicts of interest. PMID:27515760

Measuring the impact of medicines regulatory interventions - Systematic review and methodological considerations.

PubMed

Goedecke, Thomas; Morales, Daniel R; Pacurariu, Alexandra; Kurz, Xavier

2018-03-01

Evaluating the public health impact of regulatory interventions is important but there is currently no common methodological approach to guide this evaluation. This systematic review provides a descriptive overview of the analytical methods for impact research. We searched MEDLINE and EMBASE for articles with an empirical analysis evaluating the impact of European Union or non-European Union regulatory actions to safeguard public health published until March 2017. References from systematic reviews and articles from other known sources were added. Regulatory interventions, data sources, outcomes of interest, methodology and key findings were extracted. From 1246 screened articles, 229 were eligible for full-text review and 153 articles in English language were included in the descriptive analysis. Over a third of articles studied analgesics and antidepressants. Interventions most frequently evaluated are regulatory safety communications (28.8%), black box warnings (23.5%) and direct healthcare professional communications (10.5%); 55% of studies measured changes in drug utilization patterns, 27% evaluated health outcomes, and 18% targeted knowledge, behaviour or changes in clinical practice. Unintended consequences like switching therapies or spill-over effects were rarely evaluated. Two-thirds used before-after time series and 15.7% before-after cross-sectional study designs. Various analytical approaches were applied including interrupted time series regression (31.4%), simple descriptive analysis (28.8%) and descriptive analysis with significance tests (23.5%). Whilst impact evaluation of pharmacovigilance and product-specific regulatory interventions is increasing, the marked heterogeneity in study conduct and reporting highlights the need for scientific guidance to ensure robust methodologies are applied and systematic dissemination of results occurs. © 2017 The Authors. British Journal of Clinical Pharmacology published by John Wiley & Sons Ltd on behalf of British Pharmacological Society.

Tailored Communication Within Mobile Apps for Diabetes Self-Management: A Systematic Review

PubMed Central

Wahl, Astrid Klopstad; Cvancarova Småstuen, Milada; Ribu, Lis

2017-01-01

Background The prevalence of diabetes is increasing and with the requirements for self-management and risk of late complications, it remains a challenge for the individual and society. Patients can benefit from support from health care personnel in their self-management, and the traditional communication between patients and health care personnel is changing. Smartphones and apps offer a unique platform for communication, but apps with integrated health care personnel communication based on patient data are yet to be investigated to provide evidence of possible effects. Objective Our goal was to systematically review studies that aimed to evaluate integrated communication within mobile apps for tailored feedback between patients with diabetes and health care personnel in terms of (1) study characteristics, (2) functions, (3) study outcomes, (4) effects, and (5) methodological quality. Methods A systematic literature search was conducted following our International Prospective Register of Systematic Reviews (PROSPERO) protocol, searching for apps with integrated communication for persons with diabetes tested in a controlled trial in the period 2008 to 2016. We searched the databases PubMed, Medical Literature Analysis and Retrieval System Online (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Central, Excerpta Medica database (EMBASE), ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform. The search was closed in September 2016. Reference lists of primary articles and review papers were assessed. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed, and we applied the Cochrane risk of bias tool to assess methodological quality. Results We identified 2822 citations and after duplicate removal, we assessed 1128 citations. A total of 6 papers were included in this systematic review, reporting on data from 431 persons participating in small trials of short duration. The integrated communication features were mostly individualized as written non–real-time feedback. The number of functions varied from 2 to 9, and blood glucose tracking was the most common. HbA1c was the most common primary outcome, but the remaining reported outcomes were not standardized and comparable. Because of both the heterogeneity of the included trials and the poor methodological quality of the studies, a meta-analysis was not possible. A statistically significant improvement in the primary measure of outcome was found in 3 of the 6 included studies, of which 2 were HbA1c and 1 was mean daytime ambulatory blood pressure. Participants in the included trials reported positive usability or feasibility postintervention in 5 out of 6 trials. The overall methodological quality of the trials was, however, scored as an uncertain risk of bias. Conclusions This systematic review highlights the need for more trials of higher methodological quality. Few studies offer an integrated function for communication and feedback from health care personnel, and the research field represents an area of heterogeneity with few studies of highly rigorous methodological quality. This, in combination with a low number of participants and a short follow-up, is making it difficult to provide reliable evidence of effects for stakeholders. PMID:28645890

Considering axiological integrity: a methodological analysis of qualitative evidence syntheses, and its implications for health professions education.

PubMed

Kelly, Martina; Ellaway, Rachel H; Reid, Helen; Ganshorn, Heather; Yardley, Sarah; Bennett, Deirdre; Dornan, Tim

2018-05-14

Qualitative evidence synthesis (QES) is a suite of methodologies that combine qualitative techniques with the synthesis of qualitative knowledge. They are particularly suited to medical education as these approaches pool findings from original qualitative studies, whilst paying attention to context and theoretical development. Although increasingly sophisticated use is being made of qualitative primary research methodologies in health professions education (HPE) the use of secondary qualitative reviews in HPE remains underdeveloped. This study examined QES methods applied to clinical humanism in healthcare as a way of advancing thinking around the use of QES in HPE in general. A systematic search strategy identified 49 reviews that fulfilled the inclusion criteria. Meta-study was used to develop an analytic summary of methodological characteristics, the role of theory, and the synthetic processes used in QES reviews. Fifteen reviews used a defined methodology, and 17 clearly explained the processes that led from data extraction to synthesis. Eight reviews adopted a specific theoretical perspective. Authors rarely described their reflexive relationship with their data. Epistemological positions tended to be implied rather than explicit. Twenty-five reviews included some form of quality appraisal, although it was often unclear how authors acted on its results. Reviewers under-reported qualitative approaches in their review methodologies, and tended to focus on elements such as systematicity and checklist quality appraisal that were more germane to quantitative evidence synthesis. A core concern was that the axiological (value) dimensions of the source materials were rarely considered let alone accommodated in the synthesis techniques used. QES can be used in HPE research but only with careful attention to maintaining axiological integrity.

Terrorism, Radicalisation, Extremism, Authoritarianism and Fundamentalism: A Systematic Review of the Quality and Psychometric Properties of Assessments.

PubMed

Scarcella, Akimi; Page, Ruairi; Furtado, Vivek

2016-01-01

Currently, terrorism and suicide bombing are global psychosocial processes that attracts a growing number of psychological and psychiatric contributions to enhance practical counter-terrorism measures. The present study is a systematic review that explores the methodological quality reporting and the psychometric soundness of the instruments developed to identify risk factors of terrorism, extremism, radicalisation, authoritarianism and fundamentalism. A systematic search strategy was established to identify instruments and studies developed to screen individuals at risk of committing extremist or terrorist offences using 20 different databases across the fields of law, medicine, psychology, sociology and politics. Information extracted was consolidated into two different tables and a 26-item checklist, reporting respectively background information, the psychometric properties of each tool, and the methodological quality markers of these tools. 37 articles met our criteria, which included a total of 4 instruments to be used operationally by professionals, 17 tools developed as research measures, and 9 inventories that have not been generated from a study. Just over half of the methodological quality markers required for a transparent methodological description of the instruments were reported. The amount of reported psychological properties was even fewer, with only a third of them available across the different studies. The category presenting the least satisfactory results was that containing the 4 instruments to be used operationally by professionals, which can be explained by the fact that half of them refrained from publishing the major part of their findings and relevant guidelines. A great number of flaws have been identified through this systematic review. The authors encourage future researchers to be more thorough, comprehensive and transparent in their methodology. They also recommend the creation of a multi-disciplinary joint working group in order to best tackle this growing contemporary problem.

Does Maltreatment Beget Maltreatment? A Systematic Review of the Intergenerational Literature

PubMed Central

Thornberry, Terence P.; Knight, Kelly E.; Lovegrove, Peter J.

2014-01-01

In this paper, we critically review the literature testing the cycle of maltreatment hypothesis which posits continuity in maltreatment across adjacent generations. That is, we examine whether a history of maltreatment victimization is a significant risk factor for the later perpetration of maltreatment. We begin by establishing 11 methodological criteria that studies testing this hypothesis should meet. They include such basic standards as using representative samples, valid and reliable measures, prospective designs, and different reporters for each generation. We identify 47 studies that investigated this issue and then evaluate them with regard to the 11 methodological criteria. Overall, most of these studies report findings consistent with the cycle of maltreatment hypothesis. Unfortunately, at the same time, few of them satisfy the basic methodological criteria that we established; indeed, even the stronger studies in this area only meet about half of them. Moreover, the methodologically stronger studies present mixed support for the hypothesis. As a result, the positive association often reported in the literature appears to be based largely on the methodologically weaker designs. Based on our systematic methodological review, we conclude that this small and methodologically weak body of literature does not provide a definitive test of the cycle of maltreatment hypothesis. We conclude that it is imperative to develop more robust and methodologically adequate assessments of this hypothesis to more accurately inform the development of prevention and treatment programs. PMID:22673145

Reporting and handling missing outcome data in mental health: a systematic review of Cochrane systematic reviews and meta-analyses.

PubMed

Spineli, Loukia M; Pandis, Nikolaos; Salanti, Georgia

2015-06-01

The purpose of the study was to provide empirical evidence about the reporting of methodology to address missing outcome data and the acknowledgement of their impact in Cochrane systematic reviews in the mental health field. Systematic reviews published in the Cochrane Database of Systematic Reviews after January 1, 2009 by three Cochrane Review Groups relating to mental health were included. One hundred ninety systematic reviews were considered. Missing outcome data were present in at least one included study in 175 systematic reviews. Of these 175 systematic reviews, 147 (84%) accounted for missing outcome data by considering a relevant primary or secondary outcome (e.g., dropout). Missing outcome data implications were reported only in 61 (35%) systematic reviews and primarily in the discussion section by commenting on the amount of the missing outcome data. One hundred forty eligible meta-analyses with missing data were scrutinized. Seventy-nine (56%) of them had studies with total dropout rate between 10 and 30%. One hundred nine (78%) meta-analyses reported to have performed intention-to-treat analysis by including trials with imputed outcome data. Sensitivity analysis for incomplete outcome data was implemented in less than 20% of the meta-analyses. Reporting of the techniques for handling missing outcome data and their implications in the findings of the systematic reviews are suboptimal. Copyright © 2014 John Wiley & Sons, Ltd.

Ethical and methodological issues in qualitative health research involving children: A systematic review.

PubMed

Huang, Xiaoyan; O'Connor, Margaret; Ke, Li-Shan; Lee, Susan

2016-05-01

The right of children to have their voice heard has been accepted by researchers, and there are increasing numbers of qualitative health studies involving children. The ethical and methodological issues of including children in research have caused worldwide concerns, and many researchers have published articles sharing their own experiences. To systematically review and synthesise experts' opinions and experiences about ethical and methodological issues of including children in research, as well as related solution strategies. The research design was a systematic review of opinion-based evidence, based on the guidelines by Joanna Briggs Institute. A search of five computerised databases has been conducted in April 2014 and 2271 articles were found. After screening the titles, abstracts, full texts and appraising the quality, 30 articles were finally included in the review. A meta-aggregative approach was applied in the data analysis and synthesis process. Ethical approval is not needed as it is a systematic review of published literature. Six themes were identified, including evaluating potential risks and benefits, gaining access, obtaining informed consent/assent, protecting confidentiality and privacy, building rapport and collecting rich data. The similarities and differences between research involving children and that involving adults were indicated. All potential incentives should be justified when designing the study. Further studies need to research how to evaluate individual capacity of children and how to balance protecting children's right to participate and their interests in the research. Cultural differences related to researching children in different regions should also be studied. © The Author(s) 2014.

Systematic review adherence to methodological or reporting quality.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-07-19

Guidelines for assessing methodological and reporting quality of systematic reviews (SRs) were developed to contribute to implementing evidence-based health care and the reduction of research waste. As SRs assessing a cohort of SRs is becoming more prevalent in the literature and with the increased uptake of SR evidence for decision-making, methodological quality and standard of reporting of SRs is of interest. The objective of this study is to evaluate SR adherence to the Quality of Reporting of Meta-analyses (QUOROM) and PRISMA reporting guidelines and the A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Overview Quality Assessment Questionnaire (OQAQ) quality assessment tools as evaluated in methodological overviews. The Cochrane Library, MEDLINE®, and EMBASE® databases were searched from January 1990 to October 2014. Title and abstract screening and full-text screening were conducted independently by two reviewers. Reports assessing the quality or reporting of a cohort of SRs of interventions using PRISMA, QUOROM, OQAQ, or AMSTAR were included. All results are reported as frequencies and percentages of reports and SRs respectively. Of the 20,765 independent records retrieved from electronic searching, 1189 reports were reviewed for eligibility at full text, of which 56 reports (5371 SRs in total) evaluating the PRISMA, QUOROM, AMSTAR, and/or OQAQ tools were included. Notable items include the following: of the SRs using PRISMA, over 85% (1532/1741) provided a rationale for the review and less than 6% (102/1741) provided protocol information. For reports using QUOROM, only 9% (40/449) of SRs provided a trial flow diagram. However, 90% (402/449) described the explicit clinical problem and review rationale in the introduction section. Of reports using AMSTAR, 30% (534/1794) used duplicate study selection and data extraction. Conversely, 80% (1439/1794) of SRs provided study characteristics of included studies. In terms of OQAQ, 37% (499/1367) of the SRs assessed risk of bias (validity) in the included studies, while 80% (1112/1387) reported the criteria for study selection. Although reporting guidelines and quality assessment tools exist, reporting and methodological quality of SRs are inconsistent. Mechanisms to improve adherence to established reporting guidelines and methodological assessment tools are needed to improve the quality of SRs.

The effect of docetaxel on developing oedema in patients with breast cancer: a systematic review.

PubMed

Hugenholtz-Wamsteker, W; Robbeson, C; Nijs, J; Hoelen, W; Meeus, M

2016-03-01

Docetaxel is extensively used in chemotherapy for the treatment of breast cancer. Little attention has been given to oedema as a possible side effect of docetaxel-containing therapies. Until now, no review was conducted to evaluate docetaxel-containing therapies versus docetaxel-free therapies on the magnitude of the risk of developing oedema. In this systematic review, we investigated the risk of developing oedema in patients being treated for breast cancer with or without docetaxel. In this systematic literature review, we searched PubMed and Web of Knowledge for studies on breast cancer patients treated with chemotherapy containing docetaxel. We included clinical trials comparing docetaxel versus docetaxel-free chemotherapy. Oedema had to be reported and measured as a key outcome or an adverse effect. Methodological checklists were used to assess the risk of bias within the selected studies. Seven randomised clinical trials were included. Six trials were of moderate methodological quality. All trials showed an increased rate of oedema in the docetaxel-treatment arm. The trial of weakest methodological quality reported the highest incidence of oedema. The results moderately suggest that adjuvant chemotherapy containing docetaxel is related to a significantly increased risk of developing oedema, compared with docetaxel-free chemotherapy. © 2014 John Wiley & Sons Ltd.

Reference values of elements in human hair: a systematic review.

PubMed

Mikulewicz, Marcin; Chojnacka, Katarzyna; Gedrange, Thomas; Górecki, Henryk

2013-11-01

The lack of systematic review on reference values of elements in human hair with the consideration of methodological approach. The absence of worldwide accepted and implemented universal reference ranges causes that hair mineral analysis has not become yet a reliable and useful method of assessment of nutritional status and exposure of individuals. Systematic review of reference values of elements in human hair. PubMed, ISI Web of Knowledge, Scopus. Humans, hair mineral analysis, elements or minerals, reference values, original studies. The number of studies screened and assessed for eligibility was 52. Eventually, included in the review were 5 papers. The studies report reference ranges for the content of elements in hair: macroelements, microelements, toxic elements and other elements. Reference ranges were elaborated for different populations in the years 2000-2012. The analytical methodology differed, in particular sample preparation, digestion and analysis (ICP-AES, ICP-MS). Consequently, the levels of hair minerals reported as reference values varied. It is necessary to elaborate the standard procedures and furtherly validate hair mineral analysis and deliver detailed methodology. Only then it would be possible to provide meaningful reference ranges and take advantage of the potential that lies in Hair Mineral Analysis as a medical diagnostic technique. Copyright © 2013 Elsevier B.V. All rights reserved.

Long-Term Positive and Negative Psychological Late Effects for Parents of Childhood Cancer Survivors: A Systematic Review

PubMed Central

Ljungman, Lisa; Cernvall, Martin; Grönqvist, Helena; Ljótsson, Brjánn; Ljungman, Gustaf; von Essen, Louise

2014-01-01

Increasing survival rates in childhood cancer have yielded a growing population of parents of childhood cancer survivors (CCSs). This systematic review compiles the literature on positive and negative long-term psychological late effects for parents of CCSs, reported at least five years after the child's diagnosis and/or two years after the end of the child's treatment. Systematic searches were made in the databases CINAHL, EMBASE, PsycINFO, and PubMed. Fifteen studies, published between 1988 and 2010, from 12 projects were included. Thirteen studies used quantitative methodology, one quantitative and qualitative methodology, and one qualitative methodology. A total of 1045 parents participated in the reviewed studies. Mean scores were within normal ranges for general psychological distress, coping, and family functioning. However, a substantial subgroup reported a clinical level of general psychological distress, and 21–44% reported a severe level of posttraumatic stress symptoms. Worry, disease-related thoughts and feelings, marital strains, as well as posttraumatic growth was reported. Several factors were associated with the long-term late effects, such as parents' maladaptive coping during earlier stages of the childs disease trajectory and children's current poor adjustment. Quality assessments of reviewed studies and clinical implications of findings are discussed and recommendations for future research are presented. PMID:25058607

Decision to abort after a prenatal diagnosis of sex chromosome abnormality: a systematic review of the literature.

PubMed

Jeon, Kwon Chan; Chen, Lei-Shih; Goodson, Patricia

2012-01-01

We performed a systematic review of factors affecting parental decisions to continue or terminate a pregnancy after prenatal diagnosis of a sex chromosome abnormality, as reported in published studies from 1987 to May 2011. Based on the Matrix Method for systematic reviews, 19 studies were found in five electronic databases, meeting specific inclusion/exclusion criteria. Abstracted data were organized in a matrix. Alongside the search for factors influencing parental decisions, each study was judged on its methodological quality and assigned a methodological quality score. Decisions either to terminate or to continue a sex chromosome abnormality-affected pregnancy shared five similar factors: specific type of sex chromosome abnormality, gestational week at diagnosis, parents' age, providers' genetic expertise, and number of children/desire for (more) children. Factors unique to termination decisions included parents' fear/anxiety and directive counseling. Factors uniquely associated with continuation decisions were parents' socioeconomic status and ethnicity. The studies' average methodological quality score was 10.6 (SD = 1.67; range, 8-14). Findings from this review can be useful in adapting and modifying guidelines for genetic counseling after prenatal diagnosis of a sex chromosome abnormality. Moreover, improving the quality of future studies on this topic may allow clearer understanding of the most influential factors affecting parental decisions.

The effects of community pharmacy public health interventions on population health and health inequalities: a systematic review of reviews protocol.

PubMed

Hillier-Brown, Frances; Bambra, Clare; Thomson, Katie; Balaj, Mirza; Walton, Nick; Todd, Adam

2017-08-30

Community pharmacies have great potential to deliver services aimed at promoting health and preventing disease, and are embedded within communities. In the light of a rapid increase in community pharmacy-delivered public health services and an accompanying increase in the evidence base, this systematic review of reviews will synthesise systematic reviews of public health community pharmacy interventions and assess their effects on public health and health inequalities. Systematic review methodology will be used to identify all systematic reviews that describe the health and health equity effects of community pharmacy public health interventions. Twenty databases will be searched using a pre-determined search strategy to evaluate community pharmacy-delivered public health interventions. Findings from the included reviews will be pooled, and a narrative synthesis executed to identify overarching patterns and results. Findings will support future decision-making around how community pharmacy public health services can be used alongside other strategies to promote health, prevent disease and reduce health inequalities. PROSPERO registration number: CRD42017056264 .

Modifiable worker risk factors contributing to workplace absence: a stakeholder-centred best-evidence synthesis of systematic reviews.

PubMed

Wagner, Shannon; White, Marc; Schultz, Izabela; Murray, Eleanor; Bradley, Susan M; Hsu, Vernita; McGuire, Lisa; Schulz, Werner

2014-01-01

A challenge facing stakeholders is the identification and translation of relevant high quality research to inform policy and practice. This study engaged academic and community stakeholders in conducting a best evidence-synthesis to identify modifiable risk and protective worker factors across health conditions impacting work-related absence. To identify modifiable worker disability risk and protective factors across common health conditions impacting work-related absence. We searched Medline, Embase, CINHAL, The Cochrane Library, PsycINFO, BusinessSourceComplete, and ABI/Inform from 2000 to 2011. Quantitative, qualitative, or mixed methods systematic reviews of work-focused population were considered for inclusion. Two or more reviewers independently reviewed articles for inclusion and methodological screening. The search strategy, expert input and grey literature identified 2,467 unique records. One hundred and forty-two full text articles underwent comprehensive review. Twenty-four systematic reviews met eligibility criteria. Modifiable worker factors found to have consistent evidence across two or more health conditions included emotional distress, negative enduring psychology/personality factors, negative health and disability perception, decreased physical activity, lack of family support, poor general health, increased functional disability, increased pain, increased fatigue and lack of motivation to return to work. Systematic reviews are limited by availability of high quality studies, lack of consistency of methodological screening and reporting, and variability of outcome measures used.

A Systematic Review of Autologous Platelet-Rich Plasma and Fat Graft Preparation Methods.

PubMed

Luck, Joshua; Smith, Oliver J; Mosahebi, Afshin

2017-12-01

The addition of platelet-rich plasma (PRP) to adipose tissue may improve fat graft survival, although graft retention rates vary markedly between studies. To what extent this outcome heterogeneity reflects differing methodological factors remains unknown. This systematic review aims to synthesize and critically review methodological approaches to autologous PRP and fat cotransplantation in both human and animal studies. In accordance with PRISMA guidelines, Ovid MEDLINE, Scopus, and Cochrane Library databases were searched from inception to April 2017. Data were extracted from all in vivo studies involving autologous PRP and fat cotransplantation. A secondary aim was to assess reporting of technical detail; authors were not contacted to provide missing data. From 335 articles, 23 studies were included in the qualitative synthesis. Some 21 were performed in humans and 2 in rabbits. Six studies were randomized control trials; the remainder reported on observational data. Methods of PRP extraction and activation varied markedly between studies. Fat graft preparation was comparatively more consistent. Methods of PRP and fat mixing differed significantly, especially with regards to relative volume/volume ratios. Our study represents the first systematic review of methodological factors in autologous PRP and fat cotransplantation. It demonstrates that technical factors in graft preparation and administration vary significantly between in vivo studies. Such methodological heterogeneity may explain observed differences in experimental and clinical outcomes. Reporting of key procedural information is inconsistent and often inadequate. These issues make meaningful evaluation of the PRP-enhanced fat grafting literature difficult and may limit its translation into clinical practice.

A systematic review of etiological and risk factors associated with bruxism.

PubMed

Feu, Daniela; Catharino, Fernanda; Quintão, Catia Cardoso Abdo; Almeida, Marco Antonio de Oliveira

2013-06-01

The aim of the present work was to systematically review the literature and identify all peer-reviewed papers dealing with etiological and risk factors associated with bruxism. Data extraction was carried out according to the standard Cochrane systematic review methodology. The following databases were searched for randomized clinical trials (RCT), controlled clinical trials (CCT) or cohort studies: Cochrane Library, Medline, and Embase from 1980 to 2011. Unpublished literature was searched electronically using ClinicalTrials.gov. The primary outcome was bruxism etiology. Studies should have a standardized method to assess bruxism. Screening of eligible studies, assessment of the methodological quality and data extraction were conducted independently and in duplicate. Two reviewers inspected the references using the same search strategy and then applied the same inclusion criteria to the selected studies. They used criteria for methodological quality that was previously described in the Cochrane Handbook. Among the 1247 related articles that were critically assessed, one randomized clinical trial, one controlled clinical trial and seven longitudinal studies were included in the critical appraisal. Of these studies, five were selected, but reported different outcomes. There is convincing evidence that (sleep-related) bruxism can be induced by esophageal acidification and also that it has an important relationship with smoking in a dose-dependent manner. Disturbances in the central dopaminergic system are also implicated in the etiology of bruxism.

Systematic review of the cost effectiveness of prophylactic treatments in the prevention of gastropathy in patients with rheumatoid arthritis or osteoarthritis taking non-steroidal anti-inflammatory drugs

PubMed Central

van Dieten, H. E M; Bos, I.; van Tulder, M. W; Lems, W.; Dijkmans, B.; Boers, M.

2000-01-01

A systematic review on the cost effectiveness of prophylactic treatments of non-steroidal anti-inflammatory drug (NSAID) induced gastropathy in patients with osteoarthritis or rheumatoid arthritis was conducted. Two reviewers conducted the literature search and the review. Both full and partial economic evaluations published in English, Dutch, or German were included. The criteria list published in the textbook of Drummond was used to determine the quality of the economic evaluations. The methodological quality of three randomised controlled trials (RCTs) in which the economic evaluations obtained probability estimates of NSAID induced gastropathy and adverse events was assessed by a list of internal validity criteria. The conclusions were based on a rating system consisting of four levels of evidence.
  Ten economic evaluations were included; three were based on RCTs. All evaluations studied misoprostol as prophylactic treatment: in one evaluation misoprostol was studied as a fixed component in a combination with diclofenac (Arthrotec). All economic evaluations comprised analytical studies containing a decision tree. The three trials were of high methodological quality. Nine economic evaluations were considered high quality and one economic evaluation was considered of low methodological quality. There is strong evidence (level "A") that the use of misoprostol for the prevention of NSAID induced gastropathy is cost effective, and limited evidence (level "C") that the use of Arthrotec is cost effective. Although the levels of evidence used in this review are arbitrary, it is believed that a qualitative analysis is useful: quantitative analyses in this field are hampered by the heterogeneity of economic evaluations. Existing criteria to evaluate the methodological quality of economic evaluations may need refinement for use in systematic reviews.

 PMID:11005773

Systematic review of the cost effectiveness of prophylactic treatments in the prevention of gastropathy in patients with rheumatoid arthritis or osteoarthritis taking non-steroidal anti-inflammatory drugs.

PubMed

van Dieten, H E; Korthals-de Bos, I B; van Tulder, M W; Lems, W F; Dijkmans, B A; Boers, M

2000-10-01

A systematic review on the cost effectiveness of prophylactic treatments of non-steroidal anti-inflammatory drug (NSAID) induced gastropathy in patients with osteoarthritis or rheumatoid arthritis was conducted. Two reviewers conducted the literature search and the review. Both full and partial economic evaluations published in English, Dutch, or German were included. The criteria list published in the textbook of Drummond was used to determine the quality of the economic evaluations. The methodological quality of three randomised controlled trials (RCTs) in which the economic evaluations obtained probability estimates of NSAID induced gastropathy and adverse events was assessed by a list of internal validity criteria. The conclusions were based on a rating system consisting of four levels of evidence. Ten economic evaluations were included; three were based on RCTs. All evaluations studied misoprostol as prophylactic treatment: in one evaluation misoprostol was studied as a fixed component in a combination with diclofenac (Arthrotec). All economic evaluations comprised analytical studies containing a decision tree. The three trials were of high methodological quality. Nine economic evaluations were considered high quality and one economic evaluation was considered of low methodological quality. There is strong evidence (level "A") that the use of misoprostol for the prevention of NSAID induced gastropathy is cost effective, and limited evidence (level "C") that the use of Arthrotec is cost effective. Although the levels of evidence used in this review are arbitrary, it is believed that a qualitative analysis is useful: quantitative analyses in this field are hampered by the heterogeneity of economic evaluations. Existing criteria to evaluate the methodological quality of economic evaluations may need refinement for use in systematic reviews.

Promoting physical activity for children and adolescents in low- and middle-income countries: An umbrella systematic review: A review on promoting physical activity in LMIC.

PubMed

Barbosa Filho, Valter Cordeiro; Minatto, Giseli; Mota, Jorge; Silva, Kelly Samara; de Campos, Wagner; Lopes, Adair da Silva

2016-07-01

It is unknown how much previous reviews on promoting physical activity (PA) for children and adolescents (aged 6-18years) take into account studies from low- and middle-income countries (LMIC, based on the World Bank definition) and the level of evidence of the effect of PA interventions in this population. This study aims to answer such questions using an umbrella systematic review approach. We searched for peer-reviewed systematic reviews and original studies in eight electronic databases, screening of reference lists and expert contacts. Information in systematic reviews on PA interventions for children and adolescents from LMIC was discussed. Original studies on PA interventions (randomized-controlled trials [RCT], cluster-RCT and non-RCT) with children and adolescents from LMIC were eligible. We assessed the methodological quality in all studies, and the evidence level of effect on PA in intervention studies. Fifty systematic reviews (nine meta-analyses) and 25 original studies (20 different interventions) met eligibility criteria. Only 3.1% of mentioned studies in previous reviews were from LMIC. Strong and LMIC-specific evidence was found that school-based, multicomponent, and short-term (up to six months) interventions, focused on adolescents primarily (aged 13-18years), can promote PA in children and adolescents from LMIC. Other intervention characteristics had inconclusive evidence due to the low number of studies, low methodological quality, and/or small sample size. A minimal part of PA interventions mentioned in previous reviews are from LMIC. Our LMIC-specific analyses showed priorities of implementation and practical implication that can be used in public policies for PA promotion in LMIC. Copyright © 2016 Elsevier Inc. All rights reserved.

What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary.

PubMed

Pollock, Michelle; Fernandes, Ricardo M; Becker, Lorne A; Featherstone, Robin; Hartling, Lisa

2016-11-14

Overviews of reviews (overviews) compile data from multiple systematic reviews to provide a single synthesis of relevant evidence for decision-making. Despite their increasing popularity, there is limited methodological guidance available for researchers wishing to conduct overviews. The objective of this scoping review is to identify and collate all published and unpublished documents containing guidance for conducting overviews examining the efficacy, effectiveness, and/or safety of healthcare interventions. Our aims were to provide a map of existing guidance documents; identify similarities, differences, and gaps in the guidance contained within these documents; and identify common challenges involved in conducting overviews. We conducted an iterative and extensive search to ensure breadth and comprehensiveness of coverage. The search involved reference tracking, database and web searches (MEDLINE, EMBASE, DARE, Scopus, Cochrane Methods Studies Database, Google Scholar), handsearching of websites and conference proceedings, and contacting overview producers. Relevant guidance statements and challenges encountered were extracted, edited, grouped, abstracted, and presented using a qualitative metasummary approach. We identified 52 guidance documents produced by 19 research groups. Relatively consistent guidance was available for the first stages of the overview process (deciding when and why to conduct an overview, specifying the scope, and searching for and including systematic reviews). In contrast, there was limited or conflicting guidance for the latter stages of the overview process (quality assessment of systematic reviews and their primary studies, collecting and analyzing data, and assessing quality of evidence), and many of the challenges identified were also related to these stages. An additional, overarching challenge identified was that overviews are limited by the methods, reporting, and coverage of their included systematic reviews. This compilation of methodological guidance for conducting overviews of healthcare interventions will facilitate the production of future overviews and can help authors address key challenges they are likely to encounter. The results of this project have been used to identify areas where future methodological research is required to generate empirical evidence for overview methods. Additionally, these results have been used to update the chapter on overviews in the next edition of the Cochrane Handbook for Systematic Reviews of Interventions.

Balancing benefit and risk of medicines: a systematic review and classification of available methodologies.

PubMed

Mt-Isa, Shahrul; Hallgreen, Christine E; Wang, Nan; Callréus, Torbjörn; Genov, Georgy; Hirsch, Ian; Hobbiger, Stephen F; Hockley, Kimberley S; Luciani, Davide; Phillips, Lawrence D; Quartey, George; Sarac, Sinan B; Stoeckert, Isabelle; Tzoulaki, Ioanna; Micaleff, Alain; Ashby, Deborah

2014-07-01

The need for formal and structured approaches for benefit-risk assessment of medicines is increasing, as is the complexity of the scientific questions addressed before making decisions on the benefit-risk balance of medicines. We systematically collected, appraised and classified available benefit-risk methodologies to facilitate and inform their future use. A systematic review of publications identified benefit-risk assessment methodologies. Methodologies were appraised on their fundamental principles, features, graphical representations, assessability and accessibility. We created a taxonomy of methodologies to facilitate understanding and choice. We identified 49 methodologies, critically appraised and classified them into four categories: frameworks, metrics, estimation techniques and utility survey techniques. Eight frameworks describe qualitative steps in benefit-risk assessment and eight quantify benefit-risk balance. Nine metric indices include threshold indices to measure either benefit or risk; health indices measure quality-of-life over time; and trade-off indices integrate benefits and risks. Six estimation techniques support benefit-risk modelling and evidence synthesis. Four utility survey techniques elicit robust value preferences from relevant stakeholders to the benefit-risk decisions. Methodologies to help benefit-risk assessments of medicines are diverse and each is associated with different limitations and strengths. There is not a 'one-size-fits-all' method, and a combination of methods may be needed for each benefit-risk assessment. The taxonomy introduced herein may guide choice of adequate methodologies. Finally, we recommend 13 of 49 methodologies for further appraisal for use in the real-life benefit-risk assessment of medicines. Copyright © 2014 John Wiley & Sons, Ltd.

A systematic assessment of Cochrane reviews and systematic reviews published in high-impact medical journals related to cancer.

PubMed

Goldkuhle, Marius; Narayan, Vikram M; Weigl, Aaron; Dahm, Philipp; Skoetz, Nicole

2018-03-25

To compare cancer-related systematic reviews (SRs) published in the Cochrane Database of SRs (CDSR) and high-impact journals, with respect to type, content, quality and citation rates. Methodological SR with assessment and comparison of SRs and meta-analyses. Two authors independently assessed methodological quality using an Assessment of Multiple Systematic Reviews (AMSTAR)-based extraction form. Both authors independently screened search results, extracted content-relevant characteristics and retrieved citation numbers of the included reviews using the Clarivate Analytics Web of Science database. Cancer-related SRs were retrieved from the CDSR, as well as from the 10 journals which publish oncological SRs and had the highest impact factors, using a comprehensive search in both the CDSR and MEDLINE. We included all cancer-related SRs and meta-analyses published from January 2011 to May 2016. Methodological SRs were excluded. We included 346 applicable Cochrane reviews and 215 SRs from high-impact journals. Cochrane reviews consistently met more individual AMSTAR criteria, notably with regard to an a priori design (risk ratio (RR) 3.89; 95% CI 3.10 to 4.88), inclusion of the grey literature and trial registries (RR 3.52; 95% CI 2.84 to 4.37) in their searches, and the reporting of excluded studies (RR 8.80; 95% CI 6.06 to 12.78). Cochrane reviews were less likely to address questions of prognosis (RR 0.04; 95% CI 0.02 to 0.09), use individual patient data (RR 0.03; 95% CI 0.01 to 0.09) or be based on non-randomised controlled trials (RR 0.04; 95% CI 0.02 to 0.09). Citation rates of Cochrane reviews were notably lower than those for high-impact journals (Cochrane reviews: mean number of citations 6.52 (range 0-143); high-impact journal SRs: 74.45 (0-652)). When comparing cancer-related SRs published in the CDSR versus those published in high-impact medical journals, Cochrane reviews were consistently of higher methodological quality, but cited less frequently. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Single-Case Experimental Designs: A Systematic Review of Published Research and Current Standards

PubMed Central

Smith, Justin D.

2013-01-01

This article systematically reviews the research design and methodological characteristics of single-case experimental design (SCED) research published in peer-reviewed journals between 2000 and 2010. SCEDs provide researchers with a flexible and viable alternative to group designs with large sample sizes. However, methodological challenges have precluded widespread implementation and acceptance of the SCED as a viable complementary methodology to the predominant group design. This article includes a description of the research design, measurement, and analysis domains distinctive to the SCED; a discussion of the results within the framework of contemporary standards and guidelines in the field; and a presentation of updated benchmarks for key characteristics (e.g., baseline sampling, method of analysis), and overall, it provides researchers and reviewers with a resource for conducting and evaluating SCED research. The results of the systematic review of 409 studies suggest that recently published SCED research is largely in accordance with contemporary criteria for experimental quality. Analytic method emerged as an area of discord. Comparison of the findings of this review with historical estimates of the use of statistical analysis indicates an upward trend, but visual analysis remains the most common analytic method and also garners the most support amongst those entities providing SCED standards. Although consensus exists along key dimensions of single-case research design and researchers appear to be practicing within these parameters, there remains a need for further evaluation of assessment and sampling techniques and data analytic methods. PMID:22845874

Methodologies for measuring travelers' risk perception of infectious diseases: A systematic review.

PubMed

Sridhar, Shruti; Régner, Isabelle; Brouqui, Philippe; Gautret, Philippe

2016-01-01

Numerous studies in the past have stressed the importance of travelers' psychology and perception in the implementation of preventive measures. The aim of this systematic review was to identify the methodologies used in studies reporting on travelers' risk perception of infectious diseases. A systematic search for relevant literature was conducted according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. There were 39 studies identified. In 35 of 39 studies, the methodology used was that of a knowledge, attitude and practice (KAP) survey based on questionnaires. One study used a combination of questionnaires and a visual psychometric measuring instrument called the 'pictorial representation of illness and self-measurement" or PRISM. One study used a self-representation model (SRM) method. Two studies measured psychosocial factors. Valuable information was obtained from KAP surveys showing an overall lack of knowledge among travelers about the most frequent travel-associated infections and associated preventive measures. This methodological approach however, is mainly descriptive, addressing knowledge, attitudes, and practices separately and lacking an examination of the interrelationships between these three components. Another limitation of the KAP method is underestimating psychosocial variables that have proved influential in health related behaviors, including perceived benefits and costs of preventive measures, perceived social pressure, perceived personal control, unrealistic optimism and risk propensity. Future risk perception studies in travel medicine should consider psychosocial variables with inferential and multivariate statistical analyses. The use of implicit measurements of attitudes could also provide new insights in the field of travelers' risk perception of travel-associated infectious diseases. Copyright © 2016 Elsevier Ltd. All rights reserved.

A systematic literature review of neuroimaging research on developmental stuttering between 1995 and 2016.

PubMed

Etchell, Andrew C; Civier, Oren; Ballard, Kirrie J; Sowman, Paul F

2018-03-01

Stuttering is a disorder that affects millions of people all over the world. Over the past two decades, there has been a great deal of interest in investigating the neural basis of the disorder. This systematic literature review is intended to provide a comprehensive summary of the neuroimaging literature on developmental stuttering. It is a resource for researchers to quickly and easily identify relevant studies for their areas of interest and enable them to determine the most appropriate methodology to utilize in their work. The review also highlights gaps in the literature in terms of methodology and areas of research. We conducted a systematic literature review on neuroimaging studies on developmental stuttering according to the PRISMA guidelines. We searched for articles in the pubmed database containing "stuttering" OR "stammering" AND either "MRI", "PET", "EEG", "MEG", "TMS"or "brain" that were published between 1995/​01/​01 and 2016/​01/​01. The search returned a total of 359 items with an additional 26 identified from a manual search. Of these, there were a total of 111 full text articles that met criteria for inclusion in the systematic literature review. We also discuss neuroimaging studies on developmental stuttering published throughout 2016. The discussion of the results is organized first by methodology and second by population (i.e., adults or children) and includes tables that contain all items returned by the search. There are widespread abnormalities in the structural architecture and functional organization of the brains of adults and children who stutter. These are evident not only in speech tasks, but also non-speech tasks. Future research should make greater use of functional neuroimaging and noninvasive brain stimulation, and employ structural methodologies that have greater sensitivity. Newly planned studies should also investigate sex differences, focus on augmenting treatment, examine moments of dysfluency and longitudinally or cross-sectionally investigate developmental trajectories in stuttering. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Association between long travel and venous thromboembolic disease: a systematic review and meta-analysis of case-control studies

PubMed Central

Jiménez-Puente, Alberto; Perea-Milla, Emilio

2007-01-01

The term “economy-class syndrome” defines an infrequent episode of venous thromboembolism (VTED) related to a long travel, namely by plane. However, this relation has not clearly been demonstrated by investigators. We carried out a systematic review and a meta-analysis of cases-control studies that had studied this topic. We realised a systematic review of the literature and selected all the case-control studies published. Two authors carried out a methodological evaluation according to the Scottish Intercollegiate Guidelines Network items (concordance was analysed by weighted kappa index), and a systematic analysis of the potential biases of each study was assessed. We carried out the meta-analysis with the data extracted from the studies. We recovered eight cases-control studies. The relation between the antecedent of a long travel and subsequent VTED varied from OR = 1.1 to OR = 4.0 and was found to be significant in four studies. The studies were highly heterogeneous in methodology and so the results obtained about the relation between the long travel and the VTED and the score at SIGN50. Two meta-analysis were carried out: only with travels by plane in which the relation was not significant (OR = 1.21; CI 95%, 0.95–1.55) and with all types of transport, with a slightly significant relation (OR = 1.46; CI95%, 1.24–1.72). We may deduce from this systematic review that there does exist a weak association between episodes of VTED and a long travel, but not by plane specifically. The heterogeneity and the methodological quality of the studies published preclude of more robust conclusions. PMID:17899081

Systematic review of the methodological quality of clinical guideline development for the management of chronic disease in Europe.

PubMed

Knai, Cécile; Brusamento, Serena; Legido-Quigley, Helena; Saliba, Vanessa; Panteli, Dimitra; Turk, Eva; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

The use of evidence-based clinical guidelines is an essential component of chronic disease management. However, there is well-documented concern about variability in the quality of clinical guidelines, with evidence of persisting methodological shortcomings. The most widely accepted approach to assessing the quality of guidelines is the Appraisal of Guidelines for Research and Evaluation (AGREE) instrument. We have conducted a systematic review of the methodological quality (as assessed by AGREE) of clinical guidelines developed in Europe for the management of chronic diseases published since 2000. The systematic review was undertaken in accordance with the Cochrane methodology. The inclusion criteria were that studies should have appraised European clinical guidelines for certain selected chronic disorders using the AGREE instrument. We searched five databases (Cab Abstracts, EMBASE, MEDLINE, Trip and EPPI). Nine studies reported in 10 papers, analysing a total of 28 European guidelines from eight countries as well as pan-European, were included. There was considerable variation in the quality of clinical guidelines across the AGREE domains. The least well addressed domains were 'editorial independence' (with a mean domain score of 41%), 'applicability' (44%), 'stakeholder involvement' (55%), and 'rigour of development' (64%), while 'clarity of presentation' (80%) and 'scope and purpose' (84%) were less problematic. This review indicates that there is considerable scope for improvement in the methods used to develop clinical guidelines for the prevention, management and treatment of chronic diseases in Europe. Given the importance of decision support strategies such as clinical guidelines in chronic disease management, improvement measures should include the explicit and transparent involvement of key stakeholders (especially scientific experts, guideline users and methodological specialists) and consideration of the implications for guideline implementation and applicability early on in the process. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

[Pharmacological Treatment of Apathy in Parkinson's Disease: a Systematic Review of the Literature].

PubMed

Holguín Lew, Jorge Carlos; Caamaño Jaraba, Jessica; Gómez Alzate, Alejandra; Hidalgo López, Catalina; Marino Mondragón, Daniel Felipe; Restrepo Moreno, Sebastián; Rico Abella, Liz Evelin

2017-10-01

Apathy, defined as a deficit for initiating and maintaining action, is a symptom affecting patients with diverse psychiatric and neuropsychiatric diseases, including dementia, sequelae of traumatic brain injury, schizophrenia, depression, and Parkinson's disease (PD). Apathy negatively affects function and quality of life of PD patients, and it is an important cause of caregiver's distress. The pharmacological treatment of apathy in PD is the focus of this systematic review. A comprehensive search and systematic selection was performed in different databases of original research papers on the treatment of apathy in PD. The results were then consolidated, and a critical analysis was made of the research papers. The results are then discussed according to the methodological standards for systematic reviews of the literature. A total of 11 studies were included. Although some studies showed efficacy, all of them had important methodological limitations that hampered the interpretation of results. The results of the examined studies cannot be considered as evidence for guiding clinical decisions. So far, no evidence-based recommendations can be offered for the treatment of apathy in PD. More studies with better methodological quality are needed. It is a potentially fruitful area for research and one badly needed by both PD patients and their caregivers. Copyright © 2017 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

How to write a systematic review.

PubMed

Harris, Joshua D; Quatman, Carmen E; Manring, M M; Siston, Robert A; Flanigan, David C

2014-11-01

The role of evidence-based medicine in sports medicine and orthopaedic surgery is rapidly growing. Systematic reviews and meta-analyses are also proliferating in the medical literature. To provide the outline necessary for a practitioner to properly understand and/or conduct a systematic review for publication in a sports medicine journal. Review. The steps of a successful systematic review include the following: identification of an unanswered answerable question; explicit definitions of the investigation's participant(s), intervention(s), comparison(s), and outcome(s); utilization of PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines and PROSPERO registration; thorough systematic data extraction; and appropriate grading of the evidence and strength of the recommendations. An outline to understand and conduct a systematic review is provided, and the difference between meta-analyses and systematic reviews is described. The steps necessary to perform a systematic review are fully explained, including the study purpose, search methodology, data extraction, reporting of results, identification of bias, and reporting of the study's main findings. Systematic reviews or meta-analyses critically appraise and formally synthesize the best existing evidence to provide a statement of conclusion that answers specific clinical questions. Readers and reviewers, however, must recognize that the quality and strength of recommendations in a review are only as strong as the quality of studies that it analyzes. Thus, great care must be used in the interpretation of bias and extrapolation of the review's findings to translation to clinical practice. Without advanced education on the topic, the reader may follow the steps discussed herein to perform a systematic review. © 2013 The Author(s).

Systematic searching for theory to inform systematic reviews: is it feasible? Is it desirable?

PubMed

Booth, Andrew; Carroll, Christopher

2015-09-01

In recognising the potential value of theory in understanding how interventions work comes a challenge - how to make identification of theory less haphazard? To explore the feasibility of systematic identification of theory. We searched PubMed for published reviews (1998-2012) that had explicitly sought to identify theory. Systematic searching may be characterised by a structured question, methodological filters and an itemised search procedure. We constructed a template (BeHEMoTh - Behaviour of interest; Health context; Exclusions; Models or Theories) for use when systematically identifying theory. The authors tested the template within two systematic reviews. Of 34 systematic reviews, only 12 reviews (35%) reported a method for identifying theory. Nineteen did not specify how they identified studies containing theory. Data were unavailable for three reviews. Candidate terms include concept(s)/conceptual, framework(s), model(s), and theory/theories/theoretical. Information professionals must overcome inadequate reporting and the use of theory out of context. The review team faces an additional concern in lack of 'theory fidelity'. Based on experience with two systematic reviews, the BeHEMoTh template and procedure offers a feasible and useful approach for identification of theory. Applications include realist synthesis, framework synthesis or review of complex interventions. The procedure requires rigorous evaluation. © 2015 Health Libraries Group.

[Reevaluation for systematic reviews for traditional Chinese medicine injections for coronary disease].

PubMed

Yin, Xiu-Ping; Xie, Yan-Ming; Liao, Xing; Luo, Man

2016-11-01

To reevaluate the systematic reviews for traditional Chinese medicine(TCM) injections for treating coronary disease, data in four Chinese databases and PubMed, Embase, Cochrane Library, Wed of Science OVID from inception until May 2016 were searched. We extracted data according to the AMSTAR and PRISMA checklists to evaluate the methodological quality and reporting characteristics of included literatures. A total of 69 systematic reviews were included, involving 24 TCM injections, which showed certain efficacy in treating coronary disease, and whose main outcome indexes included alleviation of symptoms of angina pectoris and electrocardiogram. In all of the systematic reviews, the duration of follow-up were not reported. Six systematic reviews reported TCM typing. In the 44 system reviews, 1 335 reports mentioned 4 137 adverse events. According to the results of AMSTAR and PRISMA checklists, the quality assessment scores about included studies were not high, and most of the systematic reviews suffered heterogeneity and irrational processing of forest plots. In conclusion, TCM injections in the treatment of coronary disease have a wide range and positive effects. However, affected by the low quality of systematic reviews and the production of reevaluation, the study had some limitations. Therefore, the systematic reviews shall be further improved, in order to provide more advanced clinical evidences to clinicians. Copyright© by the Chinese Pharmaceutical Association.

Making literature reviews more reliable through application of lessons from systematic reviews.

PubMed

Haddaway, N R; Woodcock, P; Macura, B; Collins, A

2015-12-01

Review articles can provide valuable summaries of the ever-increasing volume of primary research in conservation biology. Where findings may influence important resource-allocation decisions in policy or practice, there is a need for a high degree of reliability when reviewing evidence. However, traditional literature reviews are susceptible to a number of biases during the identification, selection, and synthesis of included studies (e.g., publication bias, selection bias, and vote counting). Systematic reviews, pioneered in medicine and translated into conservation in 2006, address these issues through a strict methodology that aims to maximize transparency, objectivity, and repeatability. Systematic reviews will always be the gold standard for reliable synthesis of evidence. However, traditional literature reviews remain popular and will continue to be valuable where systematic reviews are not feasible. Where traditional reviews are used, lessons can be taken from systematic reviews and applied to traditional reviews in order to increase their reliability. Certain key aspects of systematic review methods that can be used in a context-specific manner in traditional reviews include focusing on mitigating bias; increasing transparency, consistency, and objectivity, and critically appraising the evidence and avoiding vote counting. In situations where conducting a full systematic review is not feasible, the proposed approach to reviewing evidence in a more systematic way can substantially improve the reliability of review findings, providing a time- and resource-efficient means of maximizing the value of traditional reviews. These methods are aimed particularly at those conducting literature reviews where systematic review is not feasible, for example, for graduate students, single reviewers, or small organizations. © 2015 Society for Conservation Biology.

Vending machine assessment methodology. A systematic review.

PubMed

Matthews, Melissa A; Horacek, Tanya M

2015-07-01

The nutritional quality of food and beverage products sold in vending machines has been implicated as a contributing factor to the development of an obesogenic food environment. How comprehensive, reliable, and valid are the current assessment tools for vending machines to support or refute these claims? A systematic review was conducted to summarize, compare, and evaluate the current methodologies and available tools for vending machine assessment. A total of 24 relevant research studies published between 1981 and 2013 met inclusion criteria for this review. The methodological variables reviewed in this study include assessment tool type, study location, machine accessibility, product availability, healthfulness criteria, portion size, price, product promotion, and quality of scientific practice. There were wide variations in the depth of the assessment methodologies and product healthfulness criteria utilized among the reviewed studies. Of the reviewed studies, 39% evaluated machine accessibility, 91% evaluated product availability, 96% established healthfulness criteria, 70% evaluated portion size, 48% evaluated price, 52% evaluated product promotion, and 22% evaluated the quality of scientific practice. Of all reviewed articles, 87% reached conclusions that provided insight into the healthfulness of vended products and/or vending environment. Product healthfulness criteria and complexity for snack and beverage products was also found to be variable between the reviewed studies. These findings make it difficult to compare results between studies. A universal, valid, and reliable vending machine assessment tool that is comprehensive yet user-friendly is recommended. Copyright © 2015 Elsevier Ltd. All rights reserved.

Qualitative systematic reviews of treatment burden in stroke, heart failure and diabetes - methodological challenges and solutions.

PubMed

Gallacher, Katie; Jani, Bhautesh; Morrison, Deborah; Macdonald, Sara; Blane, David; Erwin, Patricia; May, Carl R; Montori, Victor M; Eton, David T; Smith, Fiona; Batty, G David; Batty, David G; Mair, Frances S

2013-01-28

Treatment burden can be defined as the self-care practices that patients with chronic illness must perform to respond to the requirements of their healthcare providers, as well as the impact that these practices have on patient functioning and well being. Increasing levels of treatment burden may lead to suboptimal adherence and negative outcomes. Systematic review of the qualitative literature is a useful method for exploring the patient experience of care, in this case the experience of treatment burden. There is no consensus on methods for qualitative systematic review. This paper describes the methodology used for qualitative systematic reviews of the treatment burdens identified in three different common chronic conditions, using stroke as our exemplar. Qualitative studies in peer reviewed journals seeking to understand the patient experience of stroke management were sought. Limitations of English language and year of publication 2000 onwards were set. An exhaustive search strategy was employed, consisting of a scoping search, database searches (Scopus, CINAHL, Embase, Medline & PsycINFO) and reference, footnote and citation searching. Papers were screened, data extracted, quality appraised and analysed by two individuals, with a third party for disagreements. Data analysis was carried out using a coding framework underpinned by Normalization Process Theory (NPT). A total of 4364 papers were identified, 54 were included in the review. Of these, 51 (94%) were retrieved from our database search. Methodological issues included: creating an appropriate search strategy; investigating a topic not previously conceptualised; sorting through irrelevant data within papers; the quality appraisal of qualitative research; and the use of NPT as a novel method of data analysis, shown to be a useful method for the purposes of this review. The creation of our search strategy may be of particular interest to other researchers carrying out synthesis of qualitative studies. Importantly, the successful use of NPT to inform a coding frame for data analysis involving qualitative data that describes processes relating to self management highlights the potential of a new method for analyses of qualitative data within systematic reviews.

Pain assessment for people with dementia: a systematic review of systematic reviews of pain assessment tools.

PubMed

Lichtner, Valentina; Dowding, Dawn; Esterhuizen, Philip; Closs, S José; Long, Andrew F; Corbett, Anne; Briggs, Michelle

2014-12-17

There is evidence of under-detection and poor management of pain in patients with dementia, in both long-term and acute care. Accurate assessment of pain in people with dementia is challenging and pain assessment tools have received considerable attention over the years, with an increasing number of tools made available. Systematic reviews on the evidence of their validity and utility mostly compare different sets of tools. This review of systematic reviews analyses and summarises evidence concerning the psychometric properties and clinical utility of pain assessment tools in adults with dementia or cognitive impairment. We searched for systematic reviews of pain assessment tools providing evidence of reliability, validity and clinical utility. Two reviewers independently assessed each review and extracted data from them, with a third reviewer mediating when consensus was not reached. Analysis of the data was carried out collaboratively. The reviews were synthesised using a narrative synthesis approach. We retrieved 441 potentially eligible reviews, 23 met the criteria for inclusion and 8 provided data for extraction. Each review evaluated between 8 and 13 tools, in aggregate providing evidence on a total of 28 tools. The quality of the reviews varied and the reporting often lacked sufficient methodological detail for quality assessment. The 28 tools appear to have been studied in a variety of settings and with varied types of patients. The reviews identified several methodological limitations across the original studies. The lack of a 'gold standard' significantly hinders the evaluation of tools' validity. Most importantly, the samples were small providing limited evidence for use of any of the tools across settings or populations. There are a considerable number of pain assessment tools available for use with the elderly cognitive impaired population. However there is limited evidence about their reliability, validity and clinical utility. On the basis of this review no one tool can be recommended given the existing evidence.

Synthesising quantitative and qualitative research in evidence‐based patient information

PubMed Central

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-01-01

Background Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence‐based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. Aims This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Methods Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non‐quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg “explain what the test involves”) was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. Results 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. Conclusions A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review. PMID:17325406

Developing and Applying a Protocol for a Systematic Review in the Social Sciences

ERIC Educational Resources Information Center

Campbell, Allison; Taylor, Brian; Bates, Jessica; O'Connor-Bones, Una

2018-01-01

The article reports on a systematic method of undertaking a literature search on the educational impact of being a young carer (16-24 years old). The search methodology applied and described in detail will be of value to academic librarians and to other education researchers who undertake systematic literature searches. Seven bibliographic…

Rater methodology for stroboscopy: a systematic review.

PubMed

Bonilha, Heather Shaw; Focht, Kendrea L; Martin-Harris, Bonnie

2015-01-01

Laryngeal endoscopy with stroboscopy (LES) remains the clinical gold standard for assessing vocal fold function. LES is used to evaluate the efficacy of voice treatments in research studies and clinical practice. LES as a voice treatment outcome tool is only as good as the clinician interpreting the recordings. Research using LES as a treatment outcome measure should be evaluated based on rater methodology and reliability. The purpose of this literature review was to evaluate the rater-related methodology from studies that use stroboscopic findings as voice treatment outcome measures. Systematic literature review. Computerized journal databases were searched for relevant articles using terms: stroboscopy and treatment. Eligible articles were categorized and evaluated for the use of rater-related methodology, reporting of number of raters, types of raters, blinding, and rater reliability. Of the 738 articles reviewed, 80 articles met inclusion criteria. More than one-third of the studies included in the review did not report the number of raters who participated in the study. Eleven studies reported results of rater reliability analysis with only two studies reporting good inter- and intrarater reliability. The comparability and use of results from treatment studies that use LES are limited by a lack of rigor in rater methodology and variable, mostly poor, inter- and intrarater reliability. To improve our ability to evaluate and use the findings from voice treatment studies that use LES features as outcome measures, greater consistency of reporting rater methodology characteristics across studies and improved rater reliability is needed. Copyright © 2015 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

The application of quantitative methods for identifying and exploring the presence of bias in systematic reviews: PDE-5 inhibitors for erectile dysfunction.

PubMed

Bekkering, G E; Abou-Setta, A M; Kleijnen, J

2008-01-01

A systematic review of PDE-5 inhibitors for erectile dysfunction was performed to evaluate the utility of quantitative methods for identifying and exploring the influence of bias and study quality on pooled outcomes from meta-analyses. We included 123 randomized controlled trials (RCTs). Methodological quality was poorly reported. All three drugs appeared highly effective. Indirect adjusted analyses showed no differences between the three drugs. Funnel plots and statistical tests showed no evidence of small-study effects for sildenafil whereas there was evidence of such bias for tadalafil and vardenafil. Adjustment for missing studies using trim and fill techniques did not alter the pooled estimates substantially. The exclusion of previous sildenafil nonresponders was associated with larger treatment effects for tadalafil. This investigation was hampered by poor reporting of methodological quality, a low number of studies, heterogeneity and large effect sizes. Despite such limitations, a comprehensive assessment of biases should be a routine in systematic reviews.

Systematic review finds that study data not published in full text articles have unclear impact on meta-analyses results in medical research.

PubMed

Schmucker, Christine M; Blümle, Anette; Schell, Lisa K; Schwarzer, Guido; Oeller, Patrick; Cabrera, Laura; von Elm, Erik; Briel, Matthias; Meerpohl, Joerg J

2017-01-01

A meta-analysis as part of a systematic review aims to provide a thorough, comprehensive and unbiased statistical summary of data from the literature. However, relevant study results could be missing from a meta-analysis because of selective publication and inadequate dissemination. If missing outcome data differ systematically from published ones, a meta-analysis will be biased with an inaccurate assessment of the intervention effect. As part of the EU-funded OPEN project (www.open-project.eu) we conducted a systematic review that assessed whether the inclusion of data that were not published at all and/or published only in the grey literature influences pooled effect estimates in meta-analyses and leads to different interpretation. Systematic review of published literature (methodological research projects). Four bibliographic databases were searched up to February 2016 without restriction of publication year or language. Methodological research projects were considered eligible for inclusion if they reviewed a cohort of meta-analyses which (i) compared pooled effect estimates of meta-analyses of health care interventions according to publication status of data or (ii) examined whether the inclusion of unpublished or grey literature data impacts the result of a meta-analysis. Seven methodological research projects including 187 meta-analyses comparing pooled treatment effect estimates according to different publication status were identified. Two research projects showed that published data showed larger pooled treatment effects in favour of the intervention than unpublished or grey literature data (Ratio of ORs 1.15, 95% CI 1.04-1.28 and 1.34, 95% CI 1.09-1.66). In the remaining research projects pooled effect estimates and/or overall findings were not significantly changed by the inclusion of unpublished and/or grey literature data. The precision of the pooled estimate was increased with narrower 95% confidence interval. Although we may anticipate that systematic reviews and meta-analyses not including unpublished or grey literature study results are likely to overestimate the treatment effects, current empirical research shows that this is only the case in a minority of reviews. Therefore, currently, a meta-analyst should particularly consider time, effort and costs when adding such data to their analysis. Future research is needed to identify which reviews may benefit most from including unpublished or grey data.

Systematic review finds that study data not published in full text articles have unclear impact on meta-analyses results in medical research

PubMed Central

Blümle, Anette; Schell, Lisa K.; Schwarzer, Guido; Oeller, Patrick; Cabrera, Laura; von Elm, Erik; Briel, Matthias; Meerpohl, Joerg J.

2017-01-01

Background A meta-analysis as part of a systematic review aims to provide a thorough, comprehensive and unbiased statistical summary of data from the literature. However, relevant study results could be missing from a meta-analysis because of selective publication and inadequate dissemination. If missing outcome data differ systematically from published ones, a meta-analysis will be biased with an inaccurate assessment of the intervention effect. As part of the EU-funded OPEN project (www.open-project.eu) we conducted a systematic review that assessed whether the inclusion of data that were not published at all and/or published only in the grey literature influences pooled effect estimates in meta-analyses and leads to different interpretation. Methods and findings Systematic review of published literature (methodological research projects). Four bibliographic databases were searched up to February 2016 without restriction of publication year or language. Methodological research projects were considered eligible for inclusion if they reviewed a cohort of meta-analyses which (i) compared pooled effect estimates of meta-analyses of health care interventions according to publication status of data or (ii) examined whether the inclusion of unpublished or grey literature data impacts the result of a meta-analysis. Seven methodological research projects including 187 meta-analyses comparing pooled treatment effect estimates according to different publication status were identified. Two research projects showed that published data showed larger pooled treatment effects in favour of the intervention than unpublished or grey literature data (Ratio of ORs 1.15, 95% CI 1.04–1.28 and 1.34, 95% CI 1.09–1.66). In the remaining research projects pooled effect estimates and/or overall findings were not significantly changed by the inclusion of unpublished and/or grey literature data. The precision of the pooled estimate was increased with narrower 95% confidence interval. Conclusions Although we may anticipate that systematic reviews and meta-analyses not including unpublished or grey literature study results are likely to overestimate the treatment effects, current empirical research shows that this is only the case in a minority of reviews. Therefore, currently, a meta-analyst should particularly consider time, effort and costs when adding such data to their analysis. Future research is needed to identify which reviews may benefit most from including unpublished or grey data. PMID:28441452

Anti-tobacco mass media and socially disadvantaged groups: a systematic and methodological review.

PubMed

Guillaumier, Ashleigh; Bonevski, Billie; Paul, Chris

2012-07-01

Only a limited amount of research has been conducted to explore whether there are socioeconomic status differences in responses to mass media. However, the methodological quality of this evidence has not been assessed, limiting confidence in conclusions that can be drawn regarding study outcomes. A systematic review of the effectiveness of anti-tobacco mass media campaigns with socially disadvantaged groups was conducted, and the methodological quality of included studies was assessed. Medline, The Cochrane Library, PsycInfo, Embase and Web of Science were searched using MeSH and keywords for quantitative studies conducted in Western countries prior to March 2012. A methodological quality assessment and narrative analysis of included studies was undertaken. Seventeen relevant studies (reported in 18 papers) were identified; however, weak study designs and selection bias were common characteristics, limiting strong conclusions about effectiveness. Using predominantly non-cessation related outcome measures reviewed papers indicated mixed results for mass media tobacco control campaign effectiveness among various social groups. Most studies assessed mass media impact on low socioeconomic status groups rather than highly socially disadvantaged groups. Methodological rigour of evaluations in this field must be improved to aid understanding regarding the effectiveness of mass media campaigns in driving cessation among disadvantaged groups. The results of this review indicate a gap in methodologically rigorous research into the effectiveness of mass media campaigns among socially disadvantaged groups, particularly the highly disadvantaged. © 2012 Australasian Professional Society on Alcohol and other Drugs.

Evidence-based Frameworks for Teaching and Learning in Classical Singing Training: A Systematic Review.

PubMed

Crocco, Laura; Madill, Catherine J; McCabe, Patricia

2017-01-01

The study systematically reviews evidence-based frameworks for teaching and learning of classical singing training. This is a systematic review. A systematic literature search of 15 electronic databases following the Preferred Reporting Items for Systematic Reviews (PRISMA) guidelines was conducted. Eligibility criteria included type of publication, participant characteristics, intervention, and report of outcomes. Quality rating scales were applied to support assessment of the included literature. Data analysis was conducted using meta-aggregation. Nine papers met the inclusion criteria. No complete evidence-based teaching and learning framework was found. Thematic content analysis showed that studies either (1) identified teaching practices in one-to-one lessons, (2) identified student learning strategies in one-to-one lessons or personal practice sessions, and (3) implemented a tool to enhance one specific area of teaching and learning in lessons. The included studies showed that research in music education is not always specific to musical genre or instrumental group, with four of the nine studies including participant teachers and students of classical voice training only. The overall methodological quality ratings were low. Research in classical singing training has not yet developed an evidence-based framework for classical singing training. This review has found that introductory information on teaching and learning practices has been provided, and tools have been suggested for use in the evaluation of the teaching-learning process. High-quality methodological research designs are needed. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Tailored Communication Within Mobile Apps for Diabetes Self-Management: A Systematic Review.

PubMed

Holmen, Heidi; Wahl, Astrid Klopstad; Cvancarova Småstuen, Milada; Ribu, Lis

2017-06-23

The prevalence of diabetes is increasing and with the requirements for self-management and risk of late complications, it remains a challenge for the individual and society. Patients can benefit from support from health care personnel in their self-management, and the traditional communication between patients and health care personnel is changing. Smartphones and apps offer a unique platform for communication, but apps with integrated health care personnel communication based on patient data are yet to be investigated to provide evidence of possible effects. Our goal was to systematically review studies that aimed to evaluate integrated communication within mobile apps for tailored feedback between patients with diabetes and health care personnel in terms of (1) study characteristics, (2) functions, (3) study outcomes, (4) effects, and (5) methodological quality. A systematic literature search was conducted following our International Prospective Register of Systematic Reviews (PROSPERO) protocol, searching for apps with integrated communication for persons with diabetes tested in a controlled trial in the period 2008 to 2016. We searched the databases PubMed, Medical Literature Analysis and Retrieval System Online (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Central, Excerpta Medica database (EMBASE), ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform. The search was closed in September 2016. Reference lists of primary articles and review papers were assessed. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed, and we applied the Cochrane risk of bias tool to assess methodological quality. We identified 2822 citations and after duplicate removal, we assessed 1128 citations. A total of 6 papers were included in this systematic review, reporting on data from 431 persons participating in small trials of short duration. The integrated communication features were mostly individualized as written non-real-time feedback. The number of functions varied from 2 to 9, and blood glucose tracking was the most common. HbA 1c was the most common primary outcome, but the remaining reported outcomes were not standardized and comparable. Because of both the heterogeneity of the included trials and the poor methodological quality of the studies, a meta-analysis was not possible. A statistically significant improvement in the primary measure of outcome was found in 3 of the 6 included studies, of which 2 were HbA 1c and 1 was mean daytime ambulatory blood pressure. Participants in the included trials reported positive usability or feasibility postintervention in 5 out of 6 trials. The overall methodological quality of the trials was, however, scored as an uncertain risk of bias. This systematic review highlights the need for more trials of higher methodological quality. Few studies offer an integrated function for communication and feedback from health care personnel, and the research field represents an area of heterogeneity with few studies of highly rigorous methodological quality. This, in combination with a low number of participants and a short follow-up, is making it difficult to provide reliable evidence of effects for stakeholders. ©Heidi Holmen, Astrid Klopstad Wahl, Milada Cvancarova Småstuen, Lis Ribu. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.06.2017.

Systematic Review of Biological Modulation of Healing in Anterior Cruciate Ligament Reconstruction

PubMed Central

Fu, Sai-Chuen; Cheuk, Yau-Chuk; Yung, Shu-Hang; Rolf, Christer Gustav; Chan, Kai-Ming

2014-01-01

Background: Whether biological modulation is effective to promote healing in anterior cruciate ligament (ACL) reconstruction remains unclear. Purpose: To perform a systematic review of both clinical and experimental evidence of preclinical animal studies on biological modulation to promote healing in ACL reconstruction. Study Design: Systematic review; Level of evidence, 2. Methods: A systematic search was performed using the PubMed, Ovid, and Scopus search engines. Inclusion criteria were clinical and animal studies involving subjects with ACL injury with the use of biological modulation to promote healing outcomes. Methodological quality of clinical studies was evaluated using the Critical Appraisal Skill Programme (CASP) appraisal tool, and animal studies were evaluated by a scoring system based on a published checklist of good animal studies. Results: Ten clinical studies and 50 animal studies were included. Twenty-five included studies were regarded as good quality, with a methodological score ≥5. These studies suggested that transforming growth factor–beta (TGF-β), mesenchymal stem cells, osteogenic factors, and modalities that reduce local inflammation may be beneficial to promote graft healing in ACL reconstruction. Conclusion: This systematic review suggests that biological modulation is able to promote healing on top of surgical treatment for ACL injuries. This treatment strategy chiefly works through promotion of healing at the tunnel-graft interface, but the integrity of the intra-articular midsubstance of the graft would be another target for biological modulation. PMID:26535311

DPP-4 inhibitors for the treatment of type 2 diabetes: a methodology overview of systematic reviews.

PubMed

Ling, Juan; Ge, Long; Zhang, Ding-Hua; Wang, Yong-Feng; Xie, Zhuo-Lin; Tian, Jin-Hui; Xiao, Xiao-Hui; Yang, Ke-Hu

2018-06-01

To evaluate the methodological quality of systematic reviews (SRs), and summarize evidence of important outcomes from dipeptidyl peptidase-4 inhibitors (DPP4-I) in treating type 2 diabetes mellitus (T2DM). We included SRs of DPP4-I for the treatment of T2DM until January, 2018 by searching the Cochrane Library, PubMed, EMBASE and three Chinese databases. We evaluated the methodological qualities with the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool and the GRADE (The Grading of Recommendations Assessment, Development and Evaluation) approach. Sixty-three SRs (a total of 2,603,140 participants) receiving DPP4-I for the treatment of T2DM were included. The results of AMSTAR showed that the lowest quality was "a list of studies (included and excluded) item" with only one (1.6%) study provided, followed by the "providing a priori design" item with only four (6.3%) studies conforming to this item, the next were "the status of publication (gray literature) used as an inclusion criterion item", with only 18 (28.9%) studies conforming to these items. Only seven (11.1%) studies scored more than nine points in AMSTAR, indicating high methodological quality. For GRADE, of the 128 outcomes, high quality evidence was provided in only 28 (21.9%), moderate in 70 (54.7%), low in 27 (21.1%), and very low in three (2.3%). The methodological quality of SRs of DPP4-I for type 2 diabetes mellitus is not high and there are common areas for improvement. Furthermore, the quality of evidence level is moderate and more high quality evidence is needed.

Effectiveness of mHealth interventions for patients with diabetes: An overview of systematic reviews.

PubMed

Kitsiou, Spyros; Paré, Guy; Jaana, Mirou; Gerber, Ben

2017-01-01

Diabetes is a common chronic disease that places an unprecedented strain on health care systems worldwide. Mobile health technologies such as smartphones, mobile applications, and wearable devices, known as mHealth, offer significant and innovative opportunities for improving patient to provider communication and self-management of diabetes. The purpose of this overview is to critically appraise and consolidate evidence from multiple systematic reviews on the effectiveness of mHealth interventions for patients with diabetes to inform policy makers, practitioners, and researchers. A comprehensive search on multiple databases was performed to identify relevant systematic reviews published between January 1996 and December 2015. Two authors independently selected reviews, extracted data, and assessed the methodological quality of included reviews using AMSTAR. Fifteen systematic reviews published between 2008 and 2014 were eligible for inclusion. The quality of the reviews varied considerably and most of them had important methodological limitations. Focusing on systematic reviews that offered the most direct evidence, this overview demonstrates that on average, mHealth interventions improve glycemic control (HbA1c) compared to standard care or other non-mHealth approaches by as much as 0.8% for patients with type 2 diabetes and 0.3% for patients with type 1 diabetes, at least in the short-term (≤12 months). However, limitations in the overall quality of evidence suggest that further research will likely have an important impact in these estimates of effect. Findings are consistent with clinically relevant improvements, particularly with respect to patients with type 2 diabetes. Similar to home telemonitoring, mHealth interventions represent a promising approach for self-management of diabetes.

A comparison of results of empirical studies of supplementary search techniques and recommendations in review methodology handbooks: a methodological review.

PubMed

Cooper, Chris; Booth, Andrew; Britten, Nicky; Garside, Ruth

2017-11-28

The purpose and contribution of supplementary search methods in systematic reviews is increasingly acknowledged. Numerous studies have demonstrated their potential in identifying studies or study data that would have been missed by bibliographic database searching alone. What is less certain is how supplementary search methods actually work, how they are applied, and the consequent advantages, disadvantages and resource implications of each search method. The aim of this study is to compare current practice in using supplementary search methods with methodological guidance. Four methodological handbooks in informing systematic review practice in the UK were read and audited to establish current methodological guidance. Studies evaluating the use of supplementary search methods were identified by searching five bibliographic databases. Studies were included if they (1) reported practical application of a supplementary search method (descriptive) or (2) examined the utility of a supplementary search method (analytical) or (3) identified/explored factors that impact on the utility of a supplementary method, when applied in practice. Thirty-five studies were included in this review in addition to the four methodological handbooks. Studies were published between 1989 and 2016, and dates of publication of the handbooks ranged from 1994 to 2014. Five supplementary search methods were reviewed: contacting study authors, citation chasing, handsearching, searching trial registers and web searching. There is reasonable consistency between recommended best practice (handbooks) and current practice (methodological studies) as it relates to the application of supplementary search methods. The methodological studies provide useful information on the effectiveness of the supplementary search methods, often seeking to evaluate aspects of the method to improve effectiveness or efficiency. In this way, the studies advance the understanding of the supplementary search methods. Further research is required, however, so that a rational choice can be made about which supplementary search strategies should be used, and when.

Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations

PubMed Central

Greenhalgh, Trisha; Robert, Glenn; Macfarlane, Fraser; Bate, Paul; Kyriakidou, Olivia

2004-01-01

This article summarizes an extensive literature review addressing the question, How can we spread and sustain innovations in health service delivery and organization? It considers both content (defining and measuring the diffusion of innovation in organizations) and process (reviewing the literature in a systematic and reproducible way). This article discusses (1) a parsimonious and evidence-based model for considering the diffusion of innovations in health service organizations, (2) clear knowledge gaps where further research should be focused, and (3) a robust and transferable methodology for systematically reviewing health service policy and management. Both the model and the method should be tested more widely in a range of contexts. PMID:15595944

Searching for evidence or approval? A commentary on database search in systematic reviews and alternative information retrieval methodologies.

PubMed

Delaney, Aogán; Tamás, Peter A

2018-03-01

Despite recognition that database search alone is inadequate even within the health sciences, it appears that reviewers in fields that have adopted systematic review are choosing to rely primarily, or only, on database search for information retrieval. This commentary reminds readers of factors that call into question the appropriateness of default reliance on database searches particularly as systematic review is adapted for use in new and lower consensus fields. It then discusses alternative methods for information retrieval that require development, formalisation, and evaluation. Our goals are to encourage reviewers to reflect critically and transparently on their choice of information retrieval methods and to encourage investment in research on alternatives. Copyright © 2017 John Wiley & Sons, Ltd.

Advantages of virtual reality in the rehabilitation of balance and gait: Systematic review.

PubMed

Cano Porras, Desiderio; Siemonsma, Petra; Inzelberg, Rivka; Zeilig, Gabriel; Plotnik, Meir

2018-05-29

Virtual reality (VR) has emerged as a therapeutic tool facilitating motor learning for balance and gait rehabilitation. The evidence, however, has not yet resulted in standardized guidelines. The aim of this study was to systematically review the application of VR-based rehabilitation of balance and gait in 6 neurologic cohorts, describing methodologic quality, intervention programs, and reported efficacy. This study follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. VR-based treatments of Parkinson disease, multiple sclerosis, acute and chronic poststroke, traumatic brain injury, and cerebral palsy were researched in PubMed and Scopus, including earliest available records. Therapeutic validity (CONTENT scale) and risk of bias in randomized controlled trials (RCT) (Cochrane Collaboration tool) and non-RCT (Newcastle-Ottawa scale) were assessed. Ninety-seven articles were included, 68 published in 2013 or later. VR improved balance and gait in all cohorts, especially when combined with conventional rehabilitation. Most studies presented poor methodologic quality, lacked a clear rationale for intervention programs, and did not utilize motor learning principles meticulously. RCTs with more robust methodologic designs were widely recommended. Our results suggest that VR-based rehabilitation is developing rapidly, has the potential to improve balance and gait in neurologic patients, and brings additional benefits when combined with conventional rehabilitation. This systematic review provides detailed information for developing theory-driven protocols that may assist overcoming the observed lack of argued choices for intervention programs and motor learning implementation and serves as a reference for the design and planning of personalized VR-based treatments. PROSPERO CRD42016042051. © 2018 American Academy of Neurology.

How Methodologic Differences Affect Results of Economic Analyses: A Systematic Review of Interferon Gamma Release Assays for the Diagnosis of LTBI

PubMed Central

Oxlade, Olivia; Pinto, Marcia; Trajman, Anete; Menzies, Dick

2013-01-01

Introduction Cost effectiveness analyses (CEA) can provide useful information on how to invest limited funds, however they are less useful if different analysis of the same intervention provide unclear or contradictory results. The objective of our study was to conduct a systematic review of methodologic aspects of CEA that evaluate Interferon Gamma Release Assays (IGRA) for the detection of Latent Tuberculosis Infection (LTBI), in order to understand how differences affect study results. Methods A systematic review of studies was conducted with particular focus on study quality and the variability in inputs used in models used to assess cost-effectiveness. A common decision analysis model of the IGRA versus Tuberculin Skin Test (TST) screening strategy was developed and used to quantify the impact on predicted results of observed differences of model inputs taken from the studies identified. Results Thirteen studies were ultimately included in the review. Several specific methodologic issues were identified across studies, including how study inputs were selected, inconsistencies in the costing approach, the utility of the QALY (Quality Adjusted Life Year) as the effectiveness outcome, and how authors choose to present and interpret study results. When the IGRA versus TST test strategies were compared using our common decision analysis model predicted effectiveness largely overlapped. Implications Many methodologic issues that contribute to inconsistent results and reduced study quality were identified in studies that assessed the cost-effectiveness of the IGRA test. More specific and relevant guidelines are needed in order to help authors standardize modelling approaches, inputs, assumptions and how results are presented and interpreted. PMID:23505412

Health-Related Quality of Life in Non–Small-Cell Lung Cancer: An Update of a Systematic Review on Methodologic Issues in Randomized Controlled Trials

PubMed Central

Claassens, Lily; van Meerbeeck, Jan; Coens, Corneel; Quinten, Chantal; Ghislain, Irina; Sloan, Elizabeth K.; Wang, Xin Shelly; Velikova, Galina; Bottomley, Andrew

2011-01-01

Purpose This study is an update of a systematic review of health-related quality-of-life (HRQOL) methodology reporting in non–small-cell lung cancer (NSCLC) randomized controlled trials (RCTs). The objective was to evaluate HRQOL methodology reporting over the last decade and its benefit for clinical decision making. Methods A MEDLINE systematic literature review was performed. Eligible RCTs implemented patient-reported HRQOL assessments and regular oncology treatments for newly diagnosed adult patients with NSCLC. Included studies were published in English from August 2002 to July 2010. Two independent reviewers evaluated all included RCTs. Results Fifty-three RCTs were assessed. Of the 53 RCTs, 81% reported that there was no significant difference in overall survival (OS). However, 50% of RCTs that were unable to find OS differences reported a significant difference in HRQOL scores. The quality of HRQOL reporting has improved; both reporting of clinically significant differences and statistical testing of HRQOL have improved. A European Organisation for Research and Treatment of Cancer HRQOL questionnaire was used in 57% of the studies. However, reporting of HRQOL hypotheses and rationales for choosing HRQOL instruments were significantly less than before 2002 (P < .05). Conclusion The number of NSCLC RCTs incorporating HRQOL assessments has considerably increased. HRQOL continues to demonstrate its importance in RCTs, especially in those studies in which no OS difference is found. Despite the improved quality of HRQOL methodology reporting, certain aspects remain underrepresented. Our findings suggest need for an international standardization of HRQOL reporting similar to the CONSORT guidelines for clinical findings. PMID:21464420

A Systematic Review of Autologous Platelet-Rich Plasma and Fat Graft Preparation Methods

PubMed Central

Smith, Oliver J.; Mosahebi, Afshin

2017-01-01

Background: The addition of platelet-rich plasma (PRP) to adipose tissue may improve fat graft survival, although graft retention rates vary markedly between studies. To what extent this outcome heterogeneity reflects differing methodological factors remains unknown. This systematic review aims to synthesize and critically review methodological approaches to autologous PRP and fat cotransplantation in both human and animal studies. Methods: In accordance with PRISMA guidelines, Ovid MEDLINE, Scopus, and Cochrane Library databases were searched from inception to April 2017. Data were extracted from all in vivo studies involving autologous PRP and fat cotransplantation. A secondary aim was to assess reporting of technical detail; authors were not contacted to provide missing data. Results: From 335 articles, 23 studies were included in the qualitative synthesis. Some 21 were performed in humans and 2 in rabbits. Six studies were randomized control trials; the remainder reported on observational data. Methods of PRP extraction and activation varied markedly between studies. Fat graft preparation was comparatively more consistent. Methods of PRP and fat mixing differed significantly, especially with regards to relative volume/volume ratios. Conclusions: Our study represents the first systematic review of methodological factors in autologous PRP and fat cotransplantation. It demonstrates that technical factors in graft preparation and administration vary significantly between in vivo studies. Such methodological heterogeneity may explain observed differences in experimental and clinical outcomes. Reporting of key procedural information is inconsistent and often inadequate. These issues make meaningful evaluation of the PRP-enhanced fat grafting literature difficult and may limit its translation into clinical practice. PMID:29632775

Computerized Cognitive Rehabilitation of Attention and Executive Function in Acquired Brain Injury: A Systematic Review.

PubMed

Bogdanova, Yelena; Yee, Megan K; Ho, Vivian T; Cicerone, Keith D

Comprehensive review of the use of computerized treatment as a rehabilitation tool for attention and executive function in adults (aged 18 years or older) who suffered an acquired brain injury. Systematic review of empirical research. Two reviewers independently assessed articles using the methodological quality criteria of Cicerone et al. Data extracted included sample size, diagnosis, intervention information, treatment schedule, assessment methods, and outcome measures. A literature review (PubMed, EMBASE, Ovid, Cochrane, PsychINFO, CINAHL) generated a total of 4931 publications. Twenty-eight studies using computerized cognitive interventions targeting attention and executive functions were included in this review. In 23 studies, significant improvements in attention and executive function subsequent to training were reported; in the remaining 5, promising trends were observed. Preliminary evidence suggests improvements in cognitive function following computerized rehabilitation for acquired brain injury populations including traumatic brain injury and stroke. Further studies are needed to address methodological issues (eg, small sample size, inadequate control groups) and to inform development of guidelines and standardized protocols.

Distal biceps brachii tendon repair: a systematic review of patient outcome determination using modified Coleman methodology score criteria.

PubMed

Nyland, John; Causey, Brandon; Wera, Jeff; Krupp, Ryan; Tate, David; Gupta, Amit

2017-07-01

This systematic literature review evaluated the methodological research design quality of studies that evaluated patient outcomes following distal biceps brachii tendon repair and developed evidence-based recommendations for future patient clinical outcomes research. Following the preferred reporting items for systematic reviews and meta-analyses criteria, and using "biceps brachii", "tendon", "repair" and "outcome assessment" search terms, the CINAHL, Academic Search Premier and MEDLINE databases were searched from January 1960-October 2015. The modified Coleman methodology score (MCMS) served as the primary outcome measure. Descriptive statistical analysis was performed for composite and component MCMS and for patient outcome assessment methodology use frequency. A total of 93 studies were evaluated. Overall MCMS was low (57.1 ± 14). Only 12 (12.9 %) had prospective cohort or randomized controlled trial designs. There was a moderate relationship between publication year and MCMS (r = 0.53, P < 0.0001). Although 61 studies (65.6 %) had adequate surgical descriptions, only 3 (3.2 %) had well-described rehabilitation. Of 2253 subjects, only 39 (1.7 %) were women. Studies published after 2008 had higher MCMS scores than studies published earlier (61.3 ± 10 versus 52.9 ± 16, P = 0.003). Although overall research study methodological scores improved on average since 2008, generally low MCMS scores, retrospective designs, lack of eccentric elbow flexor or supinator strength testing, and poorly described surgical and rehabilitation descriptions remain commonplace. These findings decrease clinical study validity and generalizability. III.

Systematic review of the methodological and reporting quality of case series in surgery.

PubMed

Agha, R A; Fowler, A J; Lee, S-Y; Gundogan, B; Whitehurst, K; Sagoo, H K; Jeong, K J L; Altman, D G; Orgill, D P

2016-09-01

Case series are an important and common study type. No guideline exists for reporting case series and there is evidence of key data being missed from such reports. The first step in the process of developing a methodologically sound reporting guideline is a systematic review of literature relevant to the reporting deficiencies of case series. A systematic review of methodological and reporting quality in surgical case series was performed. The electronic search strategy was developed by an information specialist and included MEDLINE, Embase, Cochrane Methods Register, Science Citation Index and Conference Proceedings Citation index, from the start of indexing to 5 November 2014. Independent screening, eligibility assessments and data extraction were performed. Included articles were then analysed for five areas of deficiency: failure to use standardized definitions, missing or selective data (including the omission of whole cases or important variables), transparency or incomplete reporting, whether alternative study designs were considered, and other issues. Database searching identified 2205 records. Through the process of screening and eligibility assessments, 92 articles met inclusion criteria. Frequencies of methodological and reporting issues identified were: failure to use standardized definitions (57 per cent), missing or selective data (66 per cent), transparency or incomplete reporting (70 per cent), whether alternative study designs were considered (11 per cent) and other issues (52 per cent). The methodological and reporting quality of surgical case series needs improvement. The data indicate that evidence-based guidelines for the conduct and reporting of case series may be useful. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Methodological and ethical challenges in studying patients' perceptions of coercion: a systematic mixed studies review.

PubMed

Soininen, Päivi; Putkonen, Hanna; Joffe, Grigori; Korkeila, Jyrki; Välimäki, Maritta

2014-06-04

Despite improvements in psychiatric inpatient care, patient restrictions in psychiatric hospitals are still in use. Studying perceptions among patients who have been secluded or physically restrained during their hospital stay is challenging. We sought to review the methodological and ethical challenges in qualitative and quantitative studies aiming to describe patients' perceptions of coercive measures, especially seclusion and physical restraints during their hospital stay. Systematic mixed studies review was the study method. Studies reporting patients' perceptions of coercive measures, especially seclusion and physical restraints during hospital stay were included. Methodological issues such as study design, data collection and recruitment process, participants, sampling, patient refusal or non-participation, and ethical issues such as informed consent process, and approval were synthesized systematically. Electronic searches of CINALH, MEDLINE, PsychINFO and The Cochrane Library (1976-2012) were carried out. Out of 846 initial citations, 32 studies were included, 14 qualitative and 18 quantitative studies. A variety of methodological approaches were used, although descriptive and explorative designs were used in most cases. Data were mainly collected in qualitative studies by interviews (n = 13) or in quantitative studies by self-report questionnaires (n = 12). The recruitment process was explained in 59% (n = 19) of the studies. In most cases convenience sampling was used, yet five studies used randomization. Patient's refusal or non-participation was reported in 37% (n = 11) of studies. Of all studies, 56% (n = 18) had reported undergone an ethical review process in an official board or committee. Respondents were informed and consent was requested in 69% studies (n = 22). The use of different study designs made comparison methodologically challenging. The timing of data collection (considering bias and confounding factors) and the reasons for non-participation of eligible participants are likewise methodological challenges, e.g. recommended flow charts could aid the information. Other challenges identified were the recruitment of large and representative samples. Ethical challenges included requesting participants' informed consent and respecting ethical procedures.

Occupational therapy and return to work: a systematic literature review

PubMed Central

2011-01-01

Background The primary aim of this review study was to gather evidence on the effectiveness in terms of return to work (RTW) of occupational therapy interventions (OTIs) in rehabilitation patients with non-congenital disorders. A secondary aim was to be able to select the most efficient OTI. Methods A systematic literature review of peer-reviewed papers was conducted using electronic databases (Cinahl, Cochrane Library, Ebsco, Medline (Pubmed), and PsycInfo). The search focussed on randomised controlled trials and cohort studies published in English from 1980 until September 2010. Scientific validity of the studies was assessed. Results Starting from 1532 papers with pertinent titles, six studies met the quality criteria. Results show systematic reviewing of OTIs on RTW was challenging due to varying populations, different outcome measures, and poor descriptions of methodology. There is evidence that OTIs as part of rehabilitation programs, increase RTW rates, although the methodological evidence of most studies is weak. Conclusions Analysis of the selected papers indicated that OTIs positively influence RTW; two studies described precisely what the content of their OTI was. In order to identify the added value of OTIs on RTW, studies with well-defined OT intervention protocols are necessary. PMID:21810228

The Mediterranean diet and age-related cognitive functioning: A systematic review of study findings and neuropsychological assessment methodology.

PubMed

Knight, Alissa; Bryan, Janet; Murphy, Karen

2017-10-01

The primary aims of this review were to identify studies investigating the association between the MedDiet pattern and age-related cognitive function, to determine the current status of knowledge, and to ascertain whether a lack of standardization with the operationalization of age-related cognitive function and differences in the chosen neuropsychological assessment methodology impacted on the results and findings. The systematic review protocol for this paper was carried out following the statement and general principles of PRISMA and the UK Centre for Reviews and Dissemination (CRD). A systematic search of electronic databases yielded two cross-sectional studies, two cross-sectional/prospective studies, and 11 prospective studies for inclusion. Among this group of studies, conflicting results and conclusions regarding the efficacy of the MedDiet as a therapeutic approach for age-related cognitive function were found. Of importance, clear differences among studies in relation to neuropsychological assessment methodology were identified. Such disparity appeared to be one plausible factor contributing to the lack of consensus among study findings. One of the important challenges for future research will be to aim toward some kind of standardized neuropsychological assessment criteria. This type of endeavor will enable the ability to validate with greater confidence, whether or not adherence to a MedDiet does promote benefit for age-related cognitive function.

Bone mass improved effect of icariin for postmenopausal osteoporosis in ovariectomy-induced rats: a meta-analysis and systematic review.

PubMed

Xu, Jin-Hai; Yao, Min; Ye, Jie; Wang, Guo-Dong; Wang, Jing; Cui, Xue-Jun; Mo, Wen

2016-10-01

Ovariectomy (OVX)-induced rats are the most frequently used animal model to research postmenopausal osteoporosis. Our objective was to summarize and critically assess the bone mass improved effect of icariin (ICA) for treatment of postmenopausal osteoporosis in an OVX-induced rat model. The PUBMED, EMBASE, and Chinese databases were searched from their inception date to February 2015. Two reviewers independently selected animal studies that evaluated the bone mass improved effect of ICA compared with control in OVX-induced rats. Extracted data were analyzed by RevMan statistical software, and the methodological quality of each study was assessed. Seven studies with adequate randomization were included in the systematic review. Overall, ICA seemed to significantly improve bone mass as assessed using the bone mineral density (seven studies, n = 169; weighted mean difference, 0.02; 95% CI, 0.01-0.02, I = 77%, P < 0.00001) using a random-effects model. There is no significant difference between ICA and estrogen (E) (six studies, n = 128; weighted mean difference, 0.00; 95% CI, -0.00 to 0.01, I = 54%, P = 0.01). Bone mass improved effect of ICA for postmenopausal osteoporosis was observed in OVX-induced rats. Assessment of the methodological quality of studies involving OVX-induced animal models is required, and good methodological quality should be valued in systematic reviews of animal studies.

Neuropsychological rehabilitation in alcohol-related brain damage: a systematic review.

PubMed

Svanberg, Jenny; Evans, Jonathan J

2013-01-01

The evidence base for rehabilitating alcohol-related brain damage (ARBD) is still in its infancy. The aim of this review was to collate evidence of intervention studies for ARBD and Wernicke-Korsakoff syndrome (WKS), to offer some indication of methodological quality, and to suggest directions for future research in this area. A comprehensive search strategy resulted in systematic review of 16 studies investigating neurorehabilitation of cognitive impairment relating to ARBD. Most studies addressed rehabilitation of the memory impairments associated with Korsakoff's syndrome, although one study seeking to remediate executive functioning impairment was also included. Three studies outlining service models or approaches were included, with the aim of generating advances in service development for this population. The reviewed studies were of varying methodology, allowing only tentative conclusions. However, the available evidence suggested benefits of a number of memory rehabilitation strategies. Options for practice are suggested.

Exercise as Treatment for Anxiety: Systematic Review and Analysis

PubMed Central

Stonerock, Gregory L.; Hoffman, Benson M.; Smith, Patrick J.; Blumenthal, James A.

2015-01-01

Background Exercise has been shown to reduce symptoms of anxiety, but few studies have studied exercise in individuals pre-selected because of their high anxiety. Purpose To review and critically evaluate studies of exercise training in adults with either high levels of anxiety or an anxiety disorder. Methods We conducted a systematic review of randomized clinical trials (RCTs) in which anxious adults were randomized to an exercise or non-exercise control condition. Data were extracted concerning anxiety outcomes and study design. Existing meta-analyses were also reviewed. Results Evidence from 12 RCTs suggested benefits of exercise, for select groups, similar to established treatments and greater than placebo. However, most studies had significant methodological limitations, including small sample sizes, concurrent therapies, and inadequate assessment of adherence and fitness levels. Conclusions Exercise may be a useful treatment for anxiety, but lack of data from rigorous, methodologically sound RCTs precludes any definitive conclusions about its effectiveness. PMID:25697132

Exercise as Treatment for Anxiety: Systematic Review and Analysis.

PubMed

Stonerock, Gregory L; Hoffman, Benson M; Smith, Patrick J; Blumenthal, James A

2015-08-01

Exercise has been shown to reduce symptoms of anxiety, but few studies have studied exercise in individuals preselected because of their high anxiety. The objective of this study is to review and critically evaluate studies of exercise training in adults with either high levels of anxiety or an anxiety disorder. We conducted a systematic review of randomized clinical trials (RCTs) in which anxious adults were randomized to an exercise or nonexercise control condition. Data were extracted concerning anxiety outcomes and study design. Existing meta-analyses were also reviewed. Evidence from 12 RCTs suggested benefits of exercise, for select groups, similar to established treatments and greater than placebo. However, most studies had significant methodological limitations, including small sample sizes, concurrent therapies, and inadequate assessment of adherence and fitness levels. Exercise may be a useful treatment for anxiety, but lack of data from rigorous, methodologically sound RCTs precludes any definitive conclusions about its effectiveness.

Does Indigenous health research have impact? A systematic review of reviews.

PubMed

Kinchin, Irina; Mccalman, Janya; Bainbridge, Roxanne; Tsey, Komla; Lui, Felecia Watkin

2017-03-21

Aboriginal and Torres Strait Islander Australians (hereafter respectfully Indigenous Australians) claim that they have been over-researched without corresponding research benefit. This claim raises two questions. The first, which has been covered to some extent in the literature, is about what type(s) of research are likely to achieve benefits for Indigenous people. The second is how researchers report the impact of their research for Indigenous people. This systematic review of Indigenous health reviews addresses the second enquiry. Fourteen electronic databases were systematically searched for Indigenous health reviews which met eligibility criteria. Two reviewers assessed their characteristics and methodological rigour using an a priori protocol. Three research hypotheses were stated and tested: (1) reviews address Indigenous health priority needs; (2) reviews adopt best practice guidelines on research conduct and reporting in respect to methodological transparency and rigour, as well as acceptability and appropriateness of research implementation to Indigenous people; and (3) reviews explicitly report the incremental impacts of the included studies and translation of research. We argue that if review authors explicitly address each of these three hypotheses, then the impact of research for Indigenous peoples' health would be explicated. Seventy-six reviews were included; comprising 55 journal articles and 21 Australian Government commissioned evidence review reports. While reviews are gaining prominence and recognition in Indigenous health research and increasing in number, breadth and complexity, there is little reporting of the impact of health research for Indigenous people. This finding raises questions about the relevance of these reviews for Indigenous people, their impact on policy and practice and how reviews have been commissioned, reported and evaluated. The findings of our study serve two main purposes. First, we have identified knowledge and methodological gaps in documenting Indigenous health research impact that can be addressed by researchers and policy makers. Second, the findings provide the justification for developing a framework allowing researchers and funding bodies to structure future Indigenous health research to improve the reporting and assessment of impact over time.

Methodological criteria for the assessment of moderators in systematic reviews of randomised controlled trials: a consensus study

PubMed Central

2011-01-01

Background Current methodological guidelines provide advice about the assessment of sub-group analysis within RCTs, but do not specify explicit criteria for assessment. Our objective was to provide researchers with a set of criteria that will facilitate the grading of evidence for moderators, in systematic reviews. Method We developed a set of criteria from methodological manuscripts (n = 18) using snowballing technique, and electronic database searches. Criteria were reviewed by an international Delphi panel (n = 21), comprising authors who have published methodological papers in this area, and researchers who have been active in the study of sub-group analysis in RCTs. We used the Research ANd Development/University of California Los Angeles appropriateness method to assess consensus on the quantitative data. Free responses were coded for consensus and disagreement. In a subsequent round additional criteria were extracted from the Cochrane Reviewers' Handbook, and the process was repeated. Results The recommendations are that meta-analysts report both confirmatory and exploratory findings for sub-groups analysis. Confirmatory findings must only come from studies in which a specific theory/evidence based a-priori statement is made. Exploratory findings may be used to inform future/subsequent trials. However, for inclusion in the meta-analysis of moderators, the following additional criteria should be applied to each study: Baseline factors should be measured prior to randomisation, measurement of baseline factors should be of adequate reliability and validity, and a specific test of the interaction between baseline factors and interventions must be presented. Conclusions There is consensus from a group of 21 international experts that methodological criteria to assess moderators within systematic reviews of RCTs is both timely and necessary. The consensus from the experts resulted in five criteria divided into two groups when synthesising evidence: confirmatory findings to support hypotheses about moderators and exploratory findings to inform future research. These recommendations are discussed in reference to previous recommendations for evaluating and reporting moderator studies. PMID:21281501

US adolescents’ friendship networks and health risk behaviors: a systematic review of studies using social network analysis and Add Health data

PubMed Central

Goodson, Patricia

2015-01-01

Background. Documented trends in health-related risk behaviors among US adolescents have remained high over time. Studies indicate relationships among mutual friends are a major influence on adolescents’ risky behaviors. Social Network Analysis (SNA) can help understand friendship ties affecting individual adolescents’ engagement in these behaviors. Moreover, a systematic literature review can synthesize findings from a range of studies using SNA, as well as assess these studies’ methodological quality. Review findings also can help health educators and promoters develop more effective programs. Objective. This review systematically examined studies of the influence of friendship networks on adolescents’ risk behaviors, which utilized SNA and the Add Health data (a nationally representative sample). Methods. We employed the Matrix Method to synthesize and evaluate 15 published studies that met our inclusion and exclusion criteria, retrieved from the Add Health website and 3 major databases (Medline, Eric, and PsycINFO). Moreover, we assigned each study a methodological quality score (MQS). Results. In all studies, friendship networks among adolescents promoted their risky behaviors, including drinking alcohol, smoking, sexual intercourse, and marijuana use. The average MQS was 4.6, an indicator of methodological rigor (scale: 1–9). Conclusion. Better understanding of risky behaviors influenced by friends can be useful for health educators and promoters, as programs targeting friendships might be more effective. Additionally, the overall MQ of these reviewed studies was good, as average scores fell above the scale’s mid-point. PMID:26157622

Measurement properties of patient-reported outcome measures (PROMS) in Patellofemoral Pain Syndrome: a systematic review.

PubMed

Green, Andrew; Liles, Clive; Rushton, Alison; Kyte, Derek G

2014-12-01

This systematic review investigated the measurement properties of disease-specific patient-reported outcome measures used in Patellofemoral Pain Syndrome. Two independent reviewers conducted a systematic search of key databases (MEDLINE, EMBASE, AMED, CINHAL+ and the Cochrane Library from inception to August 2013) to identify relevant studies. A third reviewer mediated in the event of disagreement. Methodological quality was evaluated using the validated COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) tool. Data synthesis across studies determined the level of evidence for each patient-reported outcome measure. The search strategy returned 2177 citations. Following the eligibility review phase, seven studies, evaluating twelve different patient-reported outcome measures, met inclusion criteria. A 'moderate' level of evidence supported the structural validity of several measures: the Flandry Questionnaire, Anterior Knee Pain Scale, Functional Index Questionnaire, Eng and Pierrynowski Questionnaire and Visual Analogue Scales for 'usual' and 'worst' pain. In addition, there was a 'Limited' level of evidence supporting the test-retest reliability and validity (cross-cultural, hypothesis testing) of the Persian version of the Anterior Knee Pain Scale. Other measurement properties were evaluated with poor methodological quality, and many properties were not evaluated in any of the included papers. Current disease-specific outcome measures for Patellofemoral Pain Syndrome require further investigation. Future studies should evaluate all important measurement properties, utilising an appropriate framework such as COSMIN to guide study design, to facilitate optimal methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

Protocol: a systematic review of studies developing and/or evaluating search strategies to identify prognosis studies.

PubMed

Corp, Nadia; Jordan, Joanne L; Hayden, Jill A; Irvin, Emma; Parker, Robin; Smith, Andrea; van der Windt, Danielle A

2017-04-20

Prognosis research is on the rise, its importance recognised because chronic health conditions and diseases are increasingly common and costly. Prognosis systematic reviews are needed to collate and synthesise these research findings, especially to help inform effective clinical decision-making and healthcare policy. A detailed, comprehensive search strategy is central to any systematic review. However, within prognosis research, this is challenging due to poor reporting and inconsistent use of available indexing terms in electronic databases. Whilst many published search filters exist for finding clinical trials, this is not the case for prognosis studies. This systematic review aims to identify and compare existing methodological filters developed and evaluated to identify prognosis studies of any of the three main types: overall prognosis, prognostic factors, and prognostic [risk prediction] models. Primary studies reporting the development and/or evaluation of methodological search filters to retrieve any type of prognosis study will be included in this systematic review. Multiple electronic bibliographic databases will be searched, grey literature will be sought from relevant organisations and websites, experts will be contacted, and citation tracking of key papers and reference list checking of all included papers will be undertaken. Titles will be screened by one person, and abstracts and full articles will be reviewed for inclusion independently by two reviewers. Data extraction and quality assessment will also be undertaken independently by two reviewers with disagreements resolved by discussion or by a third reviewer if necessary. Filters' characteristics and performance metrics reported in the included studies will be extracted and tabulated. To enable comparisons, filters will be grouped according to database, platform, type of prognosis study, and type of filter for which it was intended. This systematic review will identify all existing validated prognosis search filters and synthesise evidence about their applicability and performance. These findings will identify if current filters provide a proficient means of searching electronic bibliographic databases or if further prognosis filters are needed and can feasibly be developed for systematic searches of prognosis studies.

Reporting of financial and non-financial conflicts of interest by authors of systematic reviews: a methodological survey.

PubMed

Hakoum, Maram B; Anouti, Sirine; Al-Gibbawi, Mounir; Abou-Jaoude, Elias A; Hasbani, Divina Justina; Lopes, Luciane Cruz; Agarwal, Arnav; Guyatt, Gordon; Akl, Elie A

2016-08-10

Conflicts of interest may bias the findings of systematic reviews. The objective of this methodological survey was to assess the frequency and different types of conflicts of interest that authors of Cochrane and non-Cochrane systematic reviews report. We searched for systematic reviews using the Cochrane Database of Systematic Reviews and Ovid MEDLINE (limited to the 119 Core Clinical Journals and the year 2015). We defined a conflict of interest disclosure as the reporting of whether a conflict of interest exists or not, and used a framework to classify conflicts of interest into individual (financial, professional and intellectual) and institutional (financial and advocatory) conflicts of interest. We conducted descriptive and regression analyses. Of the 200 systematic reviews, 194 (97%) reported authors' conflicts of interest disclosures, typically in the main document, and in a few cases either online (2%) or on request (5%). Of the 194 Cochrane and non-Cochrane reviews, 49% and 33%, respectively, had at least one author reporting any type of conflict of interest (p=0.023). Institutional conflicts of interest were less frequently reported than individual conflicts of interest, and Cochrane reviews were more likely to report individual intellectual conflicts of interest compared with non-Cochrane reviews (19% and 5%, respectively, p=0.004). Regression analyses showed a positive association between reporting of conflicts of interest (at least one type of conflict of interest, individual financial conflict of interest, institutional financial conflict of interest) and journal impact factor and between reporting individual financial conflicts of interest and pharmacological versus non-pharmacological intervention. Although close to half of the published systematic reviews report that authors (typically many) have conflicts of interest, more than half report that they do not. Authors reported individual conflicts of interest more frequently than institutional and non-financial conflicts of interest. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

The relationship between childhood body weight and dental caries experience: an umbrella systematic review protocol.

PubMed

Carson, Susan J; Abuhaloob, Lamis; Richards, Derek; Hector, Mark P; Freeman, Ruth

2017-10-25

Obesity and dental caries are global public health problems which can impact in childhood and throughout the life course. In simple terms, childhood dental caries and body weight are linked via the common risk factor of diet. An association between dental caries and obesity has been described in a number of studies and reviews. However, similarly, a relationship has also been noted between low body weight and caries experience in children. This protocol will provide the framework for an umbrella review to address the following question: Does the available evidence support a relationship between dental caries experience and body weight in the child population? This review protocol outlines the process to carry out an umbrella systematic review which will synthesise previous reviews of childhood dental caries experience and body weight. An umbrella review methodology will be used to examine the methodological and reporting quality of existing reviews. The final umbrella review aims to aggregate the available evidence in order to provide a summary for policymakers and to inform healthcare interventions. PROSPERO CRD42016047304.

Developing an evidence base for interdisciplinary learning: a systematic review.

PubMed

Cooper, H; Carlisle, C; Gibbs, T; Watkins, C

2001-07-01

The overall aim of the study was to explore the feasibility of introducing interdisciplinary education within undergraduate health professional programmes. This paper reports on the first stage of the study in which a systematic review was conducted to summarize the evidence for interdisciplinary education of undergraduate health professional students. Systematic reviews integrate valid information providing a basis for rational decision making about health care which should be based on empirical and not anecdotal evidence. The accepted principles for systematic reviews were adapted in order to allow integration of the literature to produce recommendations for educational practice and guidelines for future research. The literature on interdisciplinary education was found to be diverse, including relatively small amounts of research data and much larger amounts of evaluation literature. Methodological rating schemes were used to test for confounding influences in the research studies. The number of studies found was 141 but only 30 (21%) were included in the analysis because of lack of methodological rigour in the research and poorly developed outcome measures. Student health professionals were found to benefit from interdisciplinary education with outcome effects primarily relating to changes in knowledge, skills, attitudes and beliefs. Effects upon professional practice were not discernible and educational and psychological theories were rarely used to guide the development of the educational interventions.

Melaleuca alternifolia and its application against dental plaque and periodontal diseases: A systematic review.

PubMed

Casarin, Maísa; Pazinatto, Josiele; Santos, Roberto Christ Vianna; Zanatta, Fabricio Batistin

2018-02-01

This is a systematic review of clinical and laboratory studies evaluating the effect of Melaleuca alternifolia on periodontopathogens, dental plaque, gingivitis, periodontitis, and inflammatory responses. The PubMed, Cochrane, Web of science, Bireme, Lilacs, Prospero, Open Grey, and Clinical Trials databases were searched to identify potentially eligible studies through October 2016. Of 1,654 potentially eligible studies, 25 were included in the systematic review. Their methodology was evaluated through the Cochrane Handbook for clinical studies and the GRADE system for in vivo/in vitro studies. Although clinical studies must be interpreted with caution due to methodological limitations, laboratory studies have found promising results. In vitro evidences showed that M. alternifolia has bactericidal and bacteriostatic effects against the most prevalent periodontopathogens. Clinical studies found comparable effects to chlorhexidine 0.12% in reducing gingival inflammation, although the antiplaque effect was lower. M. alternifolia also showed antioxidant properties, which are beneficial to the host, allied to the reduction on immune-inflammatory responses to pathogens. This systematic review suggests that the M. alternifolia has potential anti-inflammatory and antimicrobial properties, which can be easily applied to the periodontal tissues. However, further clinical trials are needed to elucidate the clinical relevance of its application. Copyright © 2017 John Wiley & Sons, Ltd.

Chest physiotherapy with positive expiratory pressure breathing after abdominal and thoracic surgery: a systematic review.

PubMed

Orman, J; Westerdahl, E

2010-03-01

A variety of chest physiotherapy techniques are used following abdominal and thoracic surgery to prevent or reduce post-operative complications. Breathing techniques with a positive expiratory pressure (PEP) are used to increase airway pressure and improve pulmonary function. No systematic review of the effects of PEP in surgery patients has been performed previously. The purpose of this systematic review was to determine the effect of PEP breathing after an open upper abdominal or thoracic surgery. A literature search of randomised-controlled trials (RCT) was performed in five databases. The trials included were systematically reviewed by two independent observers and critically assessed for methodological quality. We selected six RCT evaluating the PEP technique performed with a mechanical device in spontaneously breathing adult patients after abdominal or thoracic surgery via thoracotomy. The methodological quality score varied between 4 and 6 on the Physiotherapy Evidence Database score. The studies were published between 1979 and 1993. Only one of the included trials showed any positive effects of PEP compared to other breathing techniques. Today, there is scarce scientific evidence that PEP treatment is better than other physiotherapy breathing techniques in patients undergoing abdominal or thoracic surgery. There is a lack of studies investigating the effect of PEP over placebo or no physiotherapy treatment.

Prenatal Care and Hypertensive Gestational Syndromes: A Systematic Review.

PubMed

Dutra, Gláucya Raquel Souza da Fonsêca; Dutra, Laio da Costa; Fonsêca, Gabriela Karine Souza da; Nascimento Júnior, Mauro Bezerra do; Lucena, Eudes Euler de Souza

2018-06-20

 Evaluate the influence of prenatal care on the occurrence of gestational hypertension.  The Web of Science, Scopus, Pubmed, Cochrane and ClinicalTrials electronic databases were searched for articles published between January 1 st , 2012 and December 31 st , 2016. No language restrictions were imposed. The following keywords were used: prenatal care, medical assistance, prenatal education, pregnancy-induced hypertension. The preferred reporting items for systematic reviews and meta-analyses (PRISMA) checklist was employed. Two hundred and forty articles were identified during the initial search, but only seven met the inclusion criteria. This systematic review is registered with the international prospective register of systematic reviews (PROSPERO; #CRD42017064103).  The seven studies had a low risk of bias, with methodological quality scores ranging from six to eight points. Five studies found a positive relationship between prenatal care and pregnancy-induced hypertension, whereas two studies found no significant association between the two variables. The divergence among the studies may have been due to the type of healthcare service at which the study was conducted and the sample size.  Although the studies analyzed differed with regard to methodological aspects, the findings demonstrate the importance of prenatal care during the gestational period as a prevention and health promotion measure. Thieme Revinter Publicações Ltda Rio de Janeiro, Brazil.

Interventions encouraging the use of systematic reviews by health policymakers and managers: A systematic review

PubMed Central

2011-01-01

Background Systematic reviews have the potential to inform decisions made by health policymakers and managers, yet little is known about the impact of interventions to increase the use of systematic reviews by these groups in decision making. Methods We systematically reviewed the evidence on the impact of interventions for seeking, appraising, and applying evidence from systematic reviews in decision making by health policymakers or managers. Medline, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, Cochrane Methodology Register, Health Technology Assessment Database, and LISA were searched from the earliest date available until April 2010. Two independent reviewers selected studies for inclusion if the intervention intended to increase seeking, appraising, or applying evidence from systematic reviews by a health policymaker or manager. Minimum inclusion criteria were a description of the study population and availability of extractable data. Results 11,297 titles and abstracts were reviewed, leading to retrieval of 37 full-text articles for assessment; four of these articles met all inclusion criteria. Three articles described one study where five systematic reviews were mailed to public health officials and followed up with surveys at three months and two years. The articles reported from 23% to 63% of respondents declaring they had used systematic reviews in policymaking decisions. One randomised trial indicated that tailored messages combined with access to a registry of systematic reviews had a significant effect on policies made in the area of healthy body weight promotion in health departments. Conclusions The limited empirical data renders the strength of evidence weak for the effectiveness and the types of interventions that encourage health policymakers and managers to use systematic reviews in decision making. PMID:21524292

Interventions encouraging the use of systematic reviews by health policymakers and managers: a systematic review.

PubMed

Perrier, Laure; Mrklas, Kelly; Lavis, John N; Straus, Sharon E

2011-04-27

Systematic reviews have the potential to inform decisions made by health policymakers and managers, yet little is known about the impact of interventions to increase the use of systematic reviews by these groups in decision making. We systematically reviewed the evidence on the impact of interventions for seeking, appraising, and applying evidence from systematic reviews in decision making by health policymakers or managers. Medline, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, Cochrane Methodology Register, Health Technology Assessment Database, and LISA were searched from the earliest date available until April 2010. Two independent reviewers selected studies for inclusion if the intervention intended to increase seeking, appraising, or applying evidence from systematic reviews by a health policymaker or manager. Minimum inclusion criteria were a description of the study population and availability of extractable data. 11,297 titles and abstracts were reviewed, leading to retrieval of 37 full-text articles for assessment; four of these articles met all inclusion criteria. Three articles described one study where five systematic reviews were mailed to public health officials and followed up with surveys at three months and two years. The articles reported from 23% to 63% of respondents declaring they had used systematic reviews in policymaking decisions. One randomised trial indicated that tailored messages combined with access to a registry of systematic reviews had a significant effect on policies made in the area of healthy body weight promotion in health departments. The limited empirical data renders the strength of evidence weak for the effectiveness and the types of interventions that encourage health policymakers and managers to use systematic reviews in decision making.

An Integrative Review of Multicomponent Weight Management Interventions for Adults with Intellectual Disabilities

ERIC Educational Resources Information Center

Doherty, Alison J.; Jones, Stephanie P.; Chauhan, Umesh; Gibson, Josephine M. E.

2018-01-01

Background: Obesity is more prevalent in people with intellectual disabilities and increases the risk of developing serious medical conditions. UK guidance recommends multicomponent weight management interventions (MCIs), tailored for different population groups. Methods: An integrative review utilizing systematic review methodology was conducted…

Methodological quality of systematic reviews on treatments for depression: a cross-sectional study.

PubMed

Chung, V C H; Wu, X Y; Feng, Y; Ho, R S T; Wong, S Y S; Threapleton, D

2017-05-02

Depression is one of the most common mental disorders and identifying effective treatment strategies is crucial for the control of depression. Well-conducted systematic reviews (SRs) and meta-analyses can provide the best evidence for supporting treatment decision-making. Nevertheless, the trustworthiness of conclusions can be limited by lack of methodological rigour. This study aims to assess the methodological quality of a representative sample of SRs on depression treatments. A cross-sectional study on the bibliographical and methodological characteristics of SRs published on depression treatments trials was conducted. Two electronic databases (the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects) were searched for potential SRs. SRs with at least one meta-analysis on the effects of depression treatments were considered eligible. The methodological quality of included SRs was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. The associations between bibliographical characteristics and scoring on AMSTAR items were analysed using logistic regression analysis. A total of 358 SRs were included and appraised. Over half of included SRs (n = 195) focused on non-pharmacological treatments and harms were reported in 45.5% (n = 163) of all studies. Studies varied in methods and reporting practices: only 112 (31.3%) took the risk of bias among primary studies into account when formulating conclusions; 245 (68.4%) did not fully declare conflict of interests; 93 (26.0%) reported an 'a priori' design and 104 (29.1%) provided lists of both included and excluded studies. Results from regression analyses showed: more recent publications were more likely to report 'a priori' designs [adjusted odds ratio (AOR) 1.31, 95% confidence interval (CI) 1.09-1.57], to describe study characteristics fully (AOR 1.16, 95% CI 1.06-1.28), and to assess presence of publication bias (AOR 1.13, 95% CI 1.06-1.19), but were less likely to list both included and excluded studies (AOR 0.86, 95% CI 0.81-0.92). SRs published in journals with higher impact factor (AOR 1.14, 95% CI 1.04-1.25), completed by more review authors (AOR 1.12, 95% CI 1.01-1.24) and SRs on non-pharmacological treatments (AOR 1.62, 95% CI 1.01-2.59) were associated with better performance in publication bias assessment. The methodological quality of included SRs is disappointing. Future SRs should strive to improve rigour by considering of risk of bias when formulating conclusions, reporting conflict of interests and authors should explicitly describe harms. SR authors should also use appropriate methods to combine the results, prevent language and publication biases, and ensure timely updates.

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated. Clinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement. Copyright © 2017 Elsevier Ltd. All rights reserved.

What methods do reviews of normative ethics literature use for search, selection, analysis, and synthesis? In-depth results from a systematic review of reviews.

PubMed

Mertz, Marcel; Strech, Daniel; Kahrass, Hannes

2017-12-19

(Semi-)systematic approaches to finding, analysing, and synthesising ethics literature on medical topics are still in their infancy. However, our recent systematic review showed that the rate of publication of such (semi-)systematic reviews has increased in the last two decades. This is not only true for reviews of empirical ethics literature, but also for reviews of normative ethics literature. In the latter case, there is currently little in the way of standards and guidance available. Therefore, the methods and reporting strategies of such reviews vary greatly. The purpose of the follow-up study we present was to obtain deeper methodological insight into the ways reviews of normative literature are actually conducted and to analyse the methods used. Our search in the PubMed, PhilPapers, and Google Scholar databases led to the identification of 183 reviews of ethics literature published between 1997 and 2015, of which 84 were identified as reviews of normative and mixed literature. Qualitative content analysis was used to extract and synthesise descriptions of search, selection, quality appraisal, analysis, and synthesis methods. We further assessed quantitatively how often certain methods (e.g. search strategies, data analysis procedures) were used by the reviews. The overall reporting quality varies among the analysed reviews and was generally poor even for major criteria regarding the search and selection of literature. For example, only 24 (29%) used a PRISMA flowchart. Also, only 55 (66%) reviews mentioned the information unit they sought to extract, and 12 (14%) stated an ethical approach as the theoretical basis for the analysis. Interpretable information on the synthesis method was given by 47 (60%); the most common methods applied were qualitative methods commonly used in social science research (83%). Reviews which fail to provide sufficient relevant information to readers have reduced methodological transparency regardless of actual methodological quality. In order to increase the internal validity (i.e. reproducibility) as well as the external validity (i.e. utility for the intended audience) of future reviews of normative literature, we suggest more accurate reporting regarding the goal of the review, the definition of the information unit, the ethical approach used, and technical aspects.

A mixed-methods approach to systematic reviews.

PubMed

Pearson, Alan; White, Heath; Bath-Hextall, Fiona; Salmond, Susan; Apostolo, Joao; Kirkpatrick, Pamela

2015-09-01

There are an increasing number of published single-method systematic reviews that focus on different types of evidence related to a particular topic. As policy makers and practitioners seek clear directions for decision-making from systematic reviews, it is likely that it will be increasingly difficult for them to identify 'what to do' if they are required to find and understand a plethora of syntheses related to a particular topic.Mixed-methods systematic reviews are designed to address this issue and have the potential to produce systematic reviews of direct relevance to policy makers and practitioners.On the basis of the recommendations of the Joanna Briggs Institute International Mixed Methods Reviews Methodology Group in 2012, the Institute adopted a segregated approach to mixed-methods synthesis as described by Sandelowski et al., which consists of separate syntheses of each component method of the review. Joanna Briggs Institute's mixed-methods synthesis of the findings of the separate syntheses uses a Bayesian approach to translate the findings of the initial quantitative synthesis into qualitative themes and pooling these with the findings of the initial qualitative synthesis.

Aromatherapy for managing menopausal symptoms: A protocol for systematic review and meta-analysis.

PubMed

Choi, Jiae; Lee, Hye Won; Lee, Ju Ah; Lim, Hyun-Ja; Lee, Myeong Soo

2018-02-01

Aromatherapy is often used as a complementary therapy for women's health. This systematic review aims to evaluate the therapeutic effects of aromatherapy as a management for menopausal symptoms. Eleven electronic databases will be searched from inception to February 2018. Randomized controlled trials that evaluated any type of aromatherapy against any type of control in individuals with menopausal symptoms will be eligible. The methodological quality will be assessed using the Cochrane risk of bias tool. Two authors will independently assess each study for eligibility and risk of bias and to extract data. This study will provide a high quality synthesis of current evidence of aromatherapy for menopausal symptoms measured with Menopause Rating Scale, the Kupperman Index, the Greene Climacteric Scale, or other validated questionnaires. The conclusion of our systematic review will provide evidence to judge whether aromatherapy is an effective intervention for patient with menopausal women. Ethical approval will not be required, given that this protocol is for a systematic review. The systematic review will be published in a peer-reviewed journal. The review will also be disseminated electronically and in print. PROSPERO CRD42017079191.

Gaps in the evidence for prevention and treatment of maternal anaemia: a review of systematic reviews.

PubMed

Parker, Jacqui A; Barroso, Filipa; Stanworth, Simon J; Spiby, Helen; Hopewell, Sally; Doree, Carolyn J; Renfrew, Mary J; Allard, Shubha

2012-06-24

Anaemia, in particular due to iron deficiency, is common in pregnancy with associated negative outcomes for mother and infant. However, there is evidence of significant variation in management. The objectives of this review of systematic reviews were to analyse and summarise the evidence base, identify gaps in the evidence and develop a research agenda for this important component of maternity care. Multiple databases were searched, including MEDLINE, EMBASE and The Cochrane Library. All systematic reviews relating to interventions to prevent and treat anaemia in the antenatal and postnatal period were eligible. Two reviewers independently assessed data inclusion, extraction and quality of methodology. 27 reviews were included, all reporting on the prevention and treatment of anaemia in the antenatal (n = 24) and postnatal periods (n = 3). Using AMSTAR as the assessment tool for methodological quality, only 12 of the 27 were rated as high quality reviews. The greatest number of reviews covered antenatal nutritional supplementation for the prevention of anaemia (n = 19). Iron supplementation was the most extensively researched, but with ongoing uncertainty about optimal dose and regimen. Few identified reviews addressed anaemia management post-partum or correlations between laboratory and clinical outcomes, and no reviews reported on clinical symptoms of anaemia. The review highlights evidence gaps including the management of anaemia in the postnatal period, screening for anaemia, and optimal interventions for treatment. Research priorities include developing standardised approaches to reporting of laboratory outcomes, and information on clinical outcomes relevant to the experiences of pregnant women.

Economic evaluation of HIV pre-exposure prophylaxis strategies: protocol for a methodological systematic review and quantitative synthesis.

PubMed

Thavorn, Kednapa; Kugathasan, Howsikan; Tan, Darrell H S; Moqueet, Nasheed; Baral, Stefan D; Skidmore, Becky; MacFadden, Derek; Simkin, Anna; Mishra, Sharmistha

2018-03-15

Pre-exposure prophylaxis (PrEP) with antiretrovirals is an efficacious and effective intervention to decrease the risk of HIV (human immunodeficiency virus) acquisition. Yet drug and delivery costs prohibit access in many jurisdictions. In the absence of guidelines for the synthesis of economic evaluations, we developed a protocol for a systematic review of economic evaluation studies for PrEP by drawing on best practices in systematic reviews and the conduct and reporting of economic evaluations. We aim to estimate the incremental cost per health outcome of PrEP compared with placebo, no PrEP, or other HIV prevention strategies; assess the methodological variability in, and quality of, economic evaluations of PrEP; estimate the incremental cost per health outcome of different PrEP implementation strategies; and quantify the potential sources of heterogeneity in outcomes. We will systematically search electronic databases (MEDLINE, Embase) and the gray literature. We will include economic evaluation studies that assess both costs and health outcomes of PrEP in HIV-uninfected individuals, without restricting language or year of publication. Two reviewers will independently screen studies using predefined inclusion criteria, extract data, and assess methodological quality using the Philips checklist, Second Panel on the Cost-effectiveness of Health and Medicines, and the International Society for Pharmacoeconomics and Outcomes Research recommendations. Outcomes of interest include incremental costs and outcomes in natural units or utilities, cost-effectiveness ratios, and net monetary benefit. We will perform descriptive and quantitative syntheses using sensitivity analyses of outcomes by population subgroups, HIV epidemic settings, study designs, baseline intervention contexts, key parameter inputs and assumptions, type of outcomes, economic perspectives, and willingness to pay values. Findings will guide future economic evaluation of PrEP strategies in terms of methodological and knowledge gaps, and will inform decisions on the efficient integration of PrEP into public health programs across epidemiologic and health system contexts. PROSPERO CRD42016038440 .

Terrorism, Radicalisation, Extremism, Authoritarianism and Fundamentalism: A Systematic Review of the Quality and Psychometric Properties of Assessments

PubMed Central

Scarcella, Akimi; Page, Ruairi; Furtado, Vivek

2016-01-01

Background Currently, terrorism and suicide bombing are global psychosocial processes that attracts a growing number of psychological and psychiatric contributions to enhance practical counter-terrorism measures. The present study is a systematic review that explores the methodological quality reporting and the psychometric soundness of the instruments developed to identify risk factors of terrorism, extremism, radicalisation, authoritarianism and fundamentalism. Method A systematic search strategy was established to identify instruments and studies developed to screen individuals at risk of committing extremist or terrorist offences using 20 different databases across the fields of law, medicine, psychology, sociology and politics. Information extracted was consolidated into two different tables and a 26-item checklist, reporting respectively background information, the psychometric properties of each tool, and the methodological quality markers of these tools. 37 articles met our criteria, which included a total of 4 instruments to be used operationally by professionals, 17 tools developed as research measures, and 9 inventories that have not been generated from a study. Results Just over half of the methodological quality markers required for a transparent methodological description of the instruments were reported. The amount of reported psychological properties was even fewer, with only a third of them available across the different studies. The category presenting the least satisfactory results was that containing the 4 instruments to be used operationally by professionals, which can be explained by the fact that half of them refrained from publishing the major part of their findings and relevant guidelines. Conclusions A great number of flaws have been identified through this systematic review. The authors encourage future researchers to be more thorough, comprehensive and transparent in their methodology. They also recommend the creation of a multi-disciplinary joint working group in order to best tackle this growing contemporary problem. PMID:28002457

Anti-bullying interventions in schools: a systematic literature review.

PubMed

Silva, Jorge Luiz da; Oliveira, Wanderlei Abadio de; Mello, Flávia Carvalho Malta de; Andrade, Luciane Sá de; Bazon, Marina Rezende; Silva, Marta Angélica Iossi

2017-07-01

This paper presents a systematic literature review addressing rigorously planned and assessed interventions intended to reduce school bullying. The search for papers was performed in four databases (Lilacs, Psycinfo, Scielo and Web of Science) and guided by the question: What are the interventions used to reduce bullying in schools? Only case-control studies specifically focusing on school bullying without a time frame were included. The methodological quality of investigations was assessed using the SIGN checklist. A total of 18 papers composed the corpus of analysis and all were considered to have high methodological quality. The interventions conducted in the revised studies were divided into four categories: multi-component or whole-school, social skills training, curricular, and computerized. The review synthesizes knowledge that can be used to contemplate practices and intervention programs in the education and health fields with a multidisciplinary nature.

Training practitioners in preparing systematic reviews: a cross-sectional survey of participants in the Australasian Cochrane Centre training program.

PubMed

Piehl, Janet H; Green, Sally; Silagy, Chris

2002-06-02

Although systematic reviews of health care interventions are an invaluable tool for health care providers and researchers, many potential authors never publish reviews. This study attempts to determine why some people with interest in performing systematic reviews do not subsequently publish a review; and what steps could possibly increase review completion. Cross-sectional survey by email and facsimile of the 179 participants in Australasian Cochrane Centre training events between 1998 and 2000. Ninety-two participants responded to the survey (51 percent). Response rate of deliverable surveys was 82 percent (92/112). The remainder of the participants had invalid or no contact information on file. More than 75 percent of respondents felt that the current workshops met their needs for training. The most critical barriers to completion of a Cochrane review were: lack of time (80 percent), lack of financial support (36 percent), methodological problems (23 percent) and problems with group dynamics (10 percent). Strategies to protect reviewer time and increase the efficiency of the review process may increase the numbers of trained reviewers completing a systematic review.

Hamstring autograft versus soft-tissue allograft in anterior cruciate ligament reconstruction: a systematic review and meta-analysis of randomized controlled trials.

PubMed

Cvetanovich, Gregory L; Mascarenhas, Randy; Saccomanno, Maristella F; Verma, Nikhil N; Cole, Brian J; Bush-Joseph, Charles A; Bach, Bernard R

2014-12-01

To compare outcomes of anterior cruciate ligament (ACL) reconstruction with hamstring autograft versus soft-tissue allograft by systematic review and meta-analysis. A systematic review of randomized controlled studies comparing hamstring autograft with soft-tissue allograft in ACL reconstruction was performed. Studies were identified by strict inclusion and exclusion criteria. Descriptive statistics were reported. Where possible, the data were pooled and a meta-analysis was performed using RevMan software (The Nordic Cochrane Centre, The Cochrane Collaboration, Copenhagen, Denmark). Dichotomous data were reported as risk ratios, whereas continuous data were reported as standardized mean differences and 95% confidence intervals. Heterogeneity was assessed by use of I(2) for each meta-analysis. Study methodologic quality was analyzed with the Modified Coleman Methodology Score and Jadad scale. Five studies with 504 combined patients (251 autograft and 253 allograft; 374 male and 130 female patients) with a mean age of 29.9 ± 2.2 years were included. The allografts used were fresh-frozen hamstring, irradiated hamstring, mixture of fresh-frozen and cryopreserved hamstring, fresh-frozen tibialis anterior, and fresh-frozen Achilles tendon grafts without bone blocks. The mean follow-up period was 47.4 ± 26.9 months, with a mean follow-up rate of 83.3% ± 8.6%. Two studies found a longer operative time with autograft than with allograft (77.1 ± 2.0 minutes v 59.9 ± 0.9 minutes, P = .008). Meta-analysis showed no statistically significant differences between autografts and allografts for any outcome measures (P > .05 for all tests). One study found significantly greater laxity for irradiated allograft than for autograft. The methodologic quality of the 5 studies was poor, with a mean Modified Coleman Methodology Score of 54.4 ± 6.9 and mean Jadad score of 1.6 ± 1.5. On the basis of this systematic review and meta-analysis of 5 randomized controlled trials, there is no statistically significant difference in outcome between patients undergoing ACL reconstruction with hamstring autograft and those undergoing ACL reconstruction with soft-tissue allograft. These results may not extrapolate to younger patient populations. The methodology of the available randomized controlled trials comparing hamstring autograft and soft-tissue allograft is poor. Level II, systematic review of Level I and II studies. Copyright © 2014 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Can cognitive behavioural therapy based strategies be integrated into physiotherapy for the prevention of chronic low back pain? A systematic review.

PubMed

Brunner, Emanuel; De Herdt, Amber; Minguet, Philippe; Baldew, Se-Sergio; Probst, Michel

2013-01-01

The primary purpose was to detect randomized controlled trials investigating cognitive behaviour therapy-based (CBT) treatments applied in acute/sub-acute low back pain (LBP). The secondary purpose was to analyse the methodological properties of the included studies, and to identify theory-based treatment strategies that are applicable for physiotherapists. A systematic literature search was conducted using four databases. Risk of bias of included studies was assessed and the methodological properties summarized. In addition, content and treatment theory of detected CBT-based strategies were systematically analysed and classified into three distinctive concepts of CBT: operant, cognitive and respondent treatment. Finally, applicability of treatment strategies in physiotherapy practice was discussed. Eight studies were included in the present systematic review. Half of the studies suffered from high risk of bias, and study characteristics varied in all domains of methodology, particularly in terms of treatment design and outcome measures. Graded activity, an operant treatment approach based on principles of operant conditioning, was identified as a CBT-based strategy with traceable theoretical justification that can be applied by physiotherapists. Operant conditioning can be integrated in ambulant physiotherapy practice and is a promising CBT-based strategy for the prevention of chronic LBP.

The role of reporting standards in producing robust literature reviews

NASA Astrophysics Data System (ADS)

Haddaway, Neal Robert; Macura, Biljana

2018-06-01

Literature reviews can help to inform decision-making, yet they may be subject to fatal bias if not conducted rigorously as `systematic reviews'. Reporting standards help authors to provide sufficient methodological detail to allow verification and replication, clarifying when key steps, such as critical appraisal, have been omitted.

Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol).

PubMed

Lawal, Adegboyega K; Rotter, Thomas; Kinsman, Leigh; Sari, Nazmi; Harrison, Liz; Jeffery, Cathy; Kutz, Mareike; Khan, Mohammad F; Flynn, Rachel

2014-09-19

Lean is a set of operating philosophies and methods that help create a maximum value for patients by reducing waste and waits. It emphasizes the consideration of the customer's needs, employee involvement and continuous improvement. Research on the application and implementation of lean principles in health care has been limited. This is a protocol for a systematic review, following the Cochrane Effective Practice and Organisation of Care (EPOC) methodology. The review aims to document, catalogue and synthesize the existing literature on the effects of lean implementation in health care settings especially the potential effects on professional practice and health care outcomes. We have developed a Medline keyword search strategy, and this focused strategy will be translated into other databases. All search strategies will be provided in the review. The method proposed by the Cochrane EPOC group regarding randomized study designs, non-randomised controlled trials controlled before and after studies and interrupted time series will be followed. In addition, we will also include cohort, case-control studies, and relevant non-comparative publications such as case reports. We will categorize and analyse the review findings according to the study design employed, the study quality (low- versus high-quality studies) and the reported types of implementation in the primary studies. We will present the results of studies in a tabular form. Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin the implementation of lean activities in health care settings as defined in this protocol. As a result, the review will provide an evidence base for the effectiveness of lean and implementation methodologies reported in health care. PROSPERO CRD42014008853.

The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies.

PubMed

Morrison, Andra; Polisena, Julie; Husereau, Don; Moulton, Kristen; Clark, Michelle; Fiander, Michelle; Mierzwinski-Urban, Monika; Clifford, Tammy; Hutton, Brian; Rabb, Danielle

2012-04-01

The English language is generally perceived to be the universal language of science. However, the exclusive reliance on English-language studies may not represent all of the evidence. Excluding languages other than English (LOE) may introduce a language bias and lead to erroneous conclusions. We conducted a comprehensive literature search using bibliographic databases and grey literature sources. Studies were eligible for inclusion if they measured the effect of excluding randomized controlled trials (RCTs) reported in LOE from systematic review-based meta-analyses (SR/MA) for one or more outcomes. None of the included studies found major differences between summary treatment effects in English-language restricted meta-analyses and LOE-inclusive meta-analyses. Findings differed about the methodological and reporting quality of trials reported in LOE. The precision of pooled estimates improved with the inclusion of LOE trials. Overall, we found no evidence of a systematic bias from the use of language restrictions in systematic review-based meta-analyses in conventional medicine. Further research is needed to determine the impact of language restriction on systematic reviews in particular fields of medicine.

Evolution of the methodological quality of controlled clinical trials for myofascial trigger point treatments for the period 1978-2015: A systematic review.

PubMed

Stoop, Rahel; Clijsen, Ron; Leoni, Diego; Soldini, Emiliano; Castellini, Greta; Redaelli, Valentina; Barbero, Marco

2017-08-01

The methodological quality of controlled clinical trials (CCTs) of physiotherapeutic treatment modalities for myofascial trigger points (MTrP) has not been investigated yet. To detect the methodological quality of CCTs for physiotherapy treatments of MTrPs and demonstrating the possible increase over time. Systematic review. A systematic search was conducted in two databases, Physiotherapy Evidence Database (PEDro) and Medicine Medical Literature Analysis and Retrieval System online (MEDLINE), using the same keywords and selection procedure corresponding to pre-defined inclusion criteria. The methodological quality, assessed by the 11-item PEDro scale, served as outcome measure. The CCTs had to compare at least two interventions, where one intervention had to lay within the scope of physiotherapy. Participants had to be diagnosed with myofascial pain syndrome or trigger points (active or latent). A total of n = 230 studies was analysed. The cervico-thoracic region was the most frequently treated body part (n = 143). Electrophysical agent applications was the most frequent intervention. The average methodological quality reached 5.5 on the PEDro scale. A total of n = 6 studies scored the value of 9. The average PEDro score increased by 0.7 points per decade between 1978 and 2015. The average PEDro score of CCTs for MTrP treatments does not reach the cut-off of 6 proposed for moderate to high methodological quality. Nevertheless, a promising trend towards an increase of the average methodological quality of CCTs for MTrPs was recorded. More high-quality CCT studies with thorough research procedures are recommended to enhance methodological quality. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Culturally Sensitive Risk Behavior Prevention Programs for African American Adolescents: A Systematic Analysis

ERIC Educational Resources Information Center

Metzger, Isha; Cooper, Shauna M.; Zarrett, Nicole; Flory, Kate

2013-01-01

The current review conducted a systematic assessment of culturally sensitive risk prevention programs for African American adolescents. Prevention programs meeting the inclusion and exclusion criteria were evaluated across several domains: (1) theoretical orientation and foundation; (2) methodological rigor; (3) level of cultural integration; (4)…

What Are the Effects of Teaching Evidence-Based Health Care (EBHC)? Overview of Systematic Reviews

PubMed Central

Young, Taryn; Rohwer, Anke; Volmink, Jimmy; Clarke, Mike

2014-01-01

Background An evidence-based approach to health care is recognized internationally as a key competency for healthcare practitioners. This overview systematically evaluated and organized evidence from systematic reviews on teaching evidence-based health care (EBHC). Methods/Findings We searched for systematic reviews evaluating interventions for teaching EBHC to health professionals compared to no intervention or different strategies. Outcomes covered EBHC knowledge, skills, attitudes, practices and health outcomes. Comprehensive searches were conducted in April 2013. Two reviewers independently selected eligible reviews, extracted data and evaluated methodological quality. We included 16 systematic reviews, published between 1993 and 2013. There was considerable overlap across reviews. We found that 171 source studies included in the reviews related to 81 separate studies, of which 37 are in more than one review. Studies used various methodologies to evaluate educational interventions of varying content, format and duration in undergraduates, interns, residents and practicing health professionals. The evidence in the reviews showed that multifaceted, clinically integrated interventions, with assessment, led to improvements in knowledge, skills and attitudes. Interventions improved critical appraisal skills and integration of results into decisions, and improved knowledge, skills, attitudes and behaviour amongst practicing health professionals. Considering single interventions, EBHC knowledge and attitude were similar for lecture-based versus online teaching. Journal clubs appeared to increase clinical epidemiology and biostatistics knowledge and reading behavior, but not appraisal skills. EBHC courses improved appraisal skills and knowledge. Amongst practicing health professionals, interactive online courses with guided critical appraisal showed significant increase in knowledge and appraisal skills. A short workshop using problem-based approaches, compared to no intervention, increased knowledge but not appraisal skills. Conclusions EBHC teaching and learning strategies should focus on implementing multifaceted, clinically integrated approaches with assessment. Future rigorous research should evaluate minimum components for multifaceted interventions, assessment of medium to long-term outcomes, and implementation of these interventions. PMID:24489771

Applicability and feasibility of systematic review for performing evidence-based risk assessment in food and feed safety.

PubMed

Aiassa, E; Higgins, J P T; Frampton, G K; Greiner, M; Afonso, A; Amzal, B; Deeks, J; Dorne, J-L; Glanville, J; Lövei, G L; Nienstedt, K; O'connor, A M; Pullin, A S; Rajić, A; Verloo, D

2015-01-01

Food and feed safety risk assessment uses multi-parameter models to evaluate the likelihood of adverse events associated with exposure to hazards in human health, plant health, animal health, animal welfare, and the environment. Systematic review and meta-analysis are established methods for answering questions in health care, and can be implemented to minimize biases in food and feed safety risk assessment. However, no methodological frameworks exist for refining risk assessment multi-parameter models into questions suitable for systematic review, and use of meta-analysis to estimate all parameters required by a risk model may not be always feasible. This paper describes novel approaches for determining question suitability and for prioritizing questions for systematic review in this area. Risk assessment questions that aim to estimate a parameter are likely to be suitable for systematic review. Such questions can be structured by their "key elements" [e.g., for intervention questions, the population(s), intervention(s), comparator(s), and outcome(s)]. Prioritization of questions to be addressed by systematic review relies on the likely impact and related uncertainty of individual parameters in the risk model. This approach to planning and prioritizing systematic review seems to have useful implications for producing evidence-based food and feed safety risk assessment.

Overview of Evidence in Prevention and Aetiology of Food Allergy: A Review of Systematic Reviews

PubMed Central

Lodge, Caroline J.; Allen, Katrina J.; Lowe, Adrian J.; Dharmage, Shyamali C.

2013-01-01

The worldwide prevalence of food allergy appears to be increasing. Early life environmental factors are implicated in the aetiology of this global epidemic. The largest burden of disease is in early childhood, where research efforts aimed at prevention have been focused. Evidence synthesis from good quality systematic reviews is needed. We performed an overview of systematic reviews concerning the prevention and aetiology of food allergy, retrieving 14 systematic reviews, which covered three broad topics: formula (hydrolysed or soy) for the prevention of food allergy or food sensitization; maternal and infant diet and dietary supplements for the prevention of food allergy or food sensitization and hygiene hypothesis-related interventions. Using the AMSTAR criteria for assessment of methodological quality, we found five reviews to be of high quality, seven of medium quality and two of low quality. Overall we found no compelling evidence that any of the interventions that had been systematically reviewed were related to the risk of food allergy. Updating of existing reviews, and production of new systematic reviews, are needed in areas where evidence is emerging for interventions and environmental associations. Furthermore, additional primary studies, with greater numbers of participants and objective food allergy definitions are urgently required. PMID:24192789

Systems science and systems thinking for public health: a systematic review of the field

PubMed Central

Carey, Gemma; Malbon, Eleanor; Carey, Nicole; Joyce, Andrew; Crammond, Brad; Carey, Alan

2015-01-01

Objectives This paper reports on findings from a systematic review designed to investigate the state of systems science research in public health. The objectives were to: (1) explore how systems methodologies are being applied within public health and (2) identify fruitful areas of activity. Design A systematic review was conducted from existing literature that draws on or uses systems science (in its various forms) and relates to key public health areas of action and concern, including tobacco, alcohol, obesity and the social determinants of health. Data analysis 117 articles were included in the review. An inductive qualitative content analysis was used for data extraction. The following were systematically extracted from the articles: approach, methodology, transparency, strengths and weaknesses. These were then organised according to theme (ie, commonalities between studies within each category), in order to provide an overview of the state of the field as a whole. The assessment of data quality was intrinsic to the goals of the review itself, and therefore, was carried out as part of the analysis. Results 4 categories of research were identified from the review, ranging from editorial and commentary pieces to complex system dynamic modelling. Our analysis of each of these categories of research highlighted areas of potential for systems science to strengthen public health efforts, while also revealing a number of limitations in the dynamic systems modelling being carried out in public health. Conclusions There is a great deal of interest in how the application of systems concepts and approach might aid public health. Our analysis suggests that soft systems modelling techniques are likely to be the most useful addition to public health, and align well with current debate around knowledge transfer and policy. However, the full range of systems methodologies is yet to be engaged with by public health researchers. PMID:26719314

Systems science and systems thinking for public health: a systematic review of the field.

PubMed

Carey, Gemma; Malbon, Eleanor; Carey, Nicole; Joyce, Andrew; Crammond, Brad; Carey, Alan

2015-12-30

This paper reports on findings from a systematic review designed to investigate the state of systems science research in public health. The objectives were to: (1) explore how systems methodologies are being applied within public health and (2) identify fruitful areas of activity. A systematic review was conducted from existing literature that draws on or uses systems science (in its various forms) and relates to key public health areas of action and concern, including tobacco, alcohol, obesity and the social determinants of health. 117 articles were included in the review. An inductive qualitative content analysis was used for data extraction. The following were systematically extracted from the articles: approach, methodology, transparency, strengths and weaknesses. These were then organised according to theme (ie, commonalities between studies within each category), in order to provide an overview of the state of the field as a whole. The assessment of data quality was intrinsic to the goals of the review itself, and therefore, was carried out as part of the analysis. 4 categories of research were identified from the review, ranging from editorial and commentary pieces to complex system dynamic modelling. Our analysis of each of these categories of research highlighted areas of potential for systems science to strengthen public health efforts, while also revealing a number of limitations in the dynamic systems modelling being carried out in public health. There is a great deal of interest in how the application of systems concepts and approach might aid public health. Our analysis suggests that soft systems modelling techniques are likely to be the most useful addition to public health, and align well with current debate around knowledge transfer and policy. However, the full range of systems methodologies is yet to be engaged with by public health researchers. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Implementing the 4D cycle of appreciative inquiry in health care: a methodological review.

PubMed

Trajkovski, Suza; Schmied, Virginia; Vickers, Margaret; Jackson, Debra

2013-06-01

To examine and critique how the phases of the 4D cycle (Discovery, Dream, Design, and Destiny) of appreciative inquiry are implemented in a healthcare context. Appreciative inquiry is a theoretical research perspective, an emerging research methodology and a world view that builds on action research, organizational learning, and organizational change. Increasing numbers of articles published provide insights and learning into its theoretical and philosophical underpinnings. Many articles describe appreciative inquiry and the outcomes of their studies; however, there is a gap in the literature examining the approaches commonly used to implement the 4D cycle in a healthcare context. A methodological review following systematic principles. A methodological review was conducted including articles from the inception of appreciative inquiry in 1986 to the time of writing this review in November, 2011. Key database searches included CINAHL, Emerald, MEDLINE, PubMed, PsycINFO, and Scopus. A methodological review following systematic principles was undertaken. Studies were included if they described in detail the methods used to implement the 4D cycle of appreciative inquiry in a healthcare context. Nine qualitative studies met the inclusion criteria. Results highlighted that appreciative inquiry application is unique and varied between studies. The 4D phases were not rigid steps and were adapted to the setting and participants. Overall, participant enthusiasm and commitment were highlighted suggesting appreciative inquiry was mostly positively perceived by participants. Appreciative inquiry provides a positive way forward shifting from problems to solutions offering a new way of practicing in health care and health research. © 2012 Blackwell Publishing Ltd.

Same family, different species: methodological conduct and quality varies according to purpose for five types of knowledge synthesis.

PubMed

Tricco, Andrea C; Zarin, Wasifa; Ghassemi, Marco; Nincic, Vera; Lillie, Erin; Page, Matthew J; Shamseer, Larissa; Antony, Jesmin; Rios, Patricia; Hwee, Jeremiah; Veroniki, Areti Angeliki; Moher, David; Hartling, Lisa; Pham, Ba'; Straus, Sharon E

2018-04-01

The aim of the study was to characterize methodological conduct, reporting, and quality of five knowledge synthesis (KS) approaches. Retrospective analysis of a convenience sample of five published databases of KS approaches: overview of reviews (n = 74), scoping reviews (n = 494), rapid reviews (n = 84), systematic reviews (n = 300), and network meta-analyses (NMAs; n = 456). Data in the five published databases were abstracted by two reviewers independently, any missing data for this retrospective analysis were abstracted by one experienced reviewer. Methods were appraised using the A MeaSurement Tool to Assess systematic Reviews (AMSTAR) tool. Descriptive analysis was performed. Reporting the use of a protocol ranged from 4% for rapid reviews to 32% for systematic reviews. The use of two reviewers for citation and full-text screening ranged from 20% for scoping reviews to 60% for NMAs. Data abstraction was performed in duplicate for 11% of rapid reviews and 54% of NMAs, and for risk of bias appraisal, this ranged from 6% for scoping reviews to 41% for NMAs. NMAs had the highest median percentage of maximum obtainable AMSTAR score (64%; Q1-Q3:45-73%), while scoping reviews had the lowest (25%; Q1-Q3:13-38%). NMAs consistently scored the highest on the AMSTAR tool likely because the purpose is to estimate treatment effects statistically. Scoping reviews scored the lowest (even after adjusting the score for not relevant items) likely because the purpose is to characterize the literature. Copyright © 2017 Elsevier Inc. All rights reserved.

Social costs of illegal drugs, alcohol and tobacco in the European Union: A systematic review.

PubMed

Barrio, Pablo; Reynolds, Jillian; García-Altés, Anna; Gual, Antoni; Anderson, Peter

2017-09-01

Drug use accounts for one of the main disease groups in Europe, with relevant consequences to society. There is an increasing need to evaluate the economic consequences of drug use in order to develop appropriate policies. Here, we review the social costs of illegal drugs, alcohol and tobacco in the European Union. A systematic search of relevant databases was conducted. Grey literature and previous systematic reviews were also searched. Studies reporting on social costs of illegal drugs, alcohol and tobacco were included. Methodology, cost components as well as costs were assessed from individual studies. To compare across studies, final costs were transformed to 2014 Euros. Forty-five studies reported in 43 papers met the inclusion criteria (11 for illegal drugs, 26 for alcohol and 8 for tobacco). While there was a constant inclusion of direct costs related to treatment of substance use and comorbidities, there was a high variability for the rest of cost components. Total costs showed also a great variability. Price per capita for the year 2014 ranged from €0.38 to €78 for illegal drugs, from €26 to €1500 for alcohol and from €10.55 to €391 for tobacco. Drug use imposes a heavy economic burden to Europe. However, given the high existing heterogeneity in methodologies, and in order to better assess the burden and thus to develop adequate policies, standardised methodological guidance is needed. [Barrio P, Reynolds J, García-Altés A, Gual A, Anderson P. Social costs of illegal drugs, alcohol and tobacco in the European Union: A systematic review. Drug Alcohol Rev 2017;00:000-000]. © 2017 Australasian Professional Society on Alcohol and other Drugs.

Efficacy and safety of Suanzaoren decoction for primary insomnia: a systematic review of randomized controlled trials

PubMed Central

2013-01-01

Background Insomnia is a widespread human health problem, but there currently are the limitations of conventional therapies available. Suanzaoren decoction (SZRD) is a well known classic Chinese herbal prescription for insomnia and has been treating people’s insomnia for more than thousand years. The objective of this study was to evaluate the efficacy and safety of SZRD for insomnia. Methods A systematic literature search was performed for 6 databases up to July of 2012 to identify randomized control trials (RCTs) involving SZRD for insomniac patients. The methodological quality of RCTs was assessed independently using the Cochrane Handbook for Systematic Reviews of Interventions. Results Twelve RCTs with total of 1376 adult participants were identified. The methodological quality of all included trials are no more than 3/8 score. Majority of the RCTs concluded that SZRD was more significantly effective than benzodiazepines for treating insomnia. Despite these positive outcomes, there were many methodological shortcomings in the studies reviewed, including insufficient information about randomization generation and absence of allocation concealment, lack of blinding and no placebo control, absence of intention-to-treat analysis and lack of follow-ups, selective publishing and reporting, and small number of sample sizes. A number of clinical heterogeneity such as diagnosis, intervention, control, and outcome measures were also reviewed. Only 3 trials reported adverse events, whereas the other 9 trials did not provide the safety information. Conclusions Despite the apparent reported positive findings, there is insufficient evidence to support efficacy of SZRD for insomnia due to the poor methodological quality and the small number of trials of the included studies. SZRD seems generally safe, but is insufficient evidence to make conclusions on the safety because fewer studies reported the adverse events. Further large sample-size and well-designed RCTs are needed. PMID:23336848

How effective is drug testing as a workplace safety strategy? A systematic review of the evidence.

PubMed

Pidd, Ken; Roche, Ann M

2014-10-01

The growing prevalence of workplace drug testing and the narrow scope of previous reviews of the evidence base necessitate a comprehensive review of research concerning the efficacy of drug testing as a workplace strategy. A systematic qualitative review of relevant research published between January 1990 and January 2013 was undertaken. Inclusion criteria were studies that evaluated the effectiveness of drug testing in deterring employee drug use or reducing workplace accident or injury rates. Methodological adequacy was assessed using a published assessment tool specifically designed to assess the quality of intervention studies. A total of 23 studies were reviewed and assessed, six of which reported on the effectiveness of testing in reducing employee drug use and 17 which reported on occupational accident or injury rates. No studies involved randomised control trials. Only one study was assessed as demonstrating strong methodological rigour. That study found random alcohol testing reduced fatal accidents in the transport industry. The majority of studies reviewed contained methodological weaknesses including; inappropriate study design, limited sample representativeness, the use of ecological data to evaluate individual behaviour change and failure to adequately control for potentially confounding variables. This latter finding is consistent with previous reviews and indicates the evidence base for the effectiveness of testing in improving workplace safety is at best tenuous. Better dissemination of the current evidence in relation to workplace drug testing is required to support evidence-informed policy and practice. There is also a pressing need for more methodologically rigorous research to evaluate the efficacy and utility of drug testing. Copyright © 2014 Elsevier Ltd. All rights reserved.

Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare.

PubMed

Nicolay, C R; Purkayastha, S; Greenhalgh, A; Benn, J; Chaturvedi, S; Phillips, N; Darzi, A

2012-03-01

The demand for the highest-quality patient care coupled with pressure on funding has led to the increasing use of quality improvement (QI) methodologies from the manufacturing industry. The aim of this systematic review was to identify and evaluate the application and effectiveness of these QI methodologies to the field of surgery. MEDLINE, the Cochrane Database, Allied and Complementary Medicine Database, British Nursing Index, Cumulative Index to Nursing and Allied Health Literature, Embase, Health Business(™) Elite, the Health Management Information Consortium and PsycINFO(®) were searched according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement. Empirical studies were included that implemented a described QI methodology to surgical care and analysed a named outcome statistically. Some 34 of 1595 articles identified met the inclusion criteria after consensus from two independent investigators. Nine studies described continuous quality improvement (CQI), five Six Sigma, five total quality management (TQM), five plan-do-study-act (PDSA) or plan-do-check-act (PDCA) cycles, five statistical process control (SPC) or statistical quality control (SQC), four Lean and one Lean Six Sigma; 20 of the studies were undertaken in the USA. The most common aims were to reduce complications or improve outcomes (11), to reduce infection (7), and to reduce theatre delays (7). There was one randomized controlled trial. QI methodologies from industry can have significant effects on improving surgical care, from reducing infection rates to increasing operating room efficiency. The evidence is generally of suboptimal quality, and rigorous randomized multicentre studies are needed to bring evidence-based management into the same league as evidence-based medicine. Copyright © 2011 British Journal of Surgery Society Ltd. Published by John Wiley & Sons, Ltd.

Reporting of various methodological and statistical parameters in negative studies published in prominent Indian Medical Journals: a systematic review.

PubMed

Charan, J; Saxena, D

2014-01-01

Biased negative studies not only reflect poor research effort but also have an impact on 'patient care' as they prevent further research with similar objectives, leading to potential research areas remaining unexplored. Hence, published 'negative studies' should be methodologically strong. All parameters that may help a reader to judge validity of results and conclusions should be reported in published negative studies. There is a paucity of data on reporting of statistical and methodological parameters in negative studies published in Indian Medical Journals. The present systematic review was designed with an aim to critically evaluate negative studies published in prominent Indian Medical Journals for reporting of statistical and methodological parameters. Systematic review. All negative studies published in 15 Science Citation Indexed (SCI) medical journals published from India were included in present study. Investigators involved in the study evaluated all negative studies for the reporting of various parameters. Primary endpoints were reporting of "power" and "confidence interval." Power was reported in 11.8% studies. Confidence interval was reported in 15.7% studies. Majority of parameters like sample size calculation (13.2%), type of sampling method (50.8%), name of statistical tests (49.1%), adjustment of multiple endpoints (1%), post hoc power calculation (2.1%) were reported poorly. Frequency of reporting was more in clinical trials as compared to other study designs and in journals having impact factor more than 1 as compared to journals having impact factor less than 1. Negative studies published in prominent Indian medical journals do not report statistical and methodological parameters adequately and this may create problems in the critical appraisal of findings reported in these journals by its readers.

Methodological Quality Assessment of Meta-Analyses and Systematic Reviews of Probiotics in Inflammatory Bowel Disease and Pouchitis.

PubMed

Dong, Jinpei; Teng, Guigen; Wei, Tiantong; Gao, Wen; Wang, Huahong

2016-01-01

Probiotics are widely used for the induction and maintenance of remission in inflammatory bowel disease (IBD) and pouchitis. There are a large number of meta-analyses (MAs)/ systematic reviews (SRs) on this subject, the methodological quality of which has not been evaluated. This study aimed to evaluate the methodological quality of and summarize the evidence obtained from MAs/SRs of probiotic treatments for IBD and pouchitis patients. The PubMed, EMBASE, Cochrane Library and China National Knowledge Infrastructure (CNKI) databases were searched to identify Chinese and English language MAs/SRs of the use of probiotics for IBD and pouchitis. The Assessment of Multiple Systematic Reviews (AMSTAR) scale was used to assess the methodological quality of the studies. A total of 36 MAs/SRs were evaluated. The AMSTAR scores of the included studies ranged from 1 to 10, and the average score was 5.81. According to the Canadian Agency for Drugs and Technologies in Health, 4 articles were classified as high quality, 24 articles were classified as moderate quality, and 8 articles were classified as low quality. Most of the MAs/SRs suggested that probiotics had potential benefits for patients with ulcerative colitis (UC), but failed to show effectiveness in the induction and maintenance of remission in Crohn's disease (CD). The probiotic preparation VSL#3 may play a beneficial role in pouchitis. The overall methodological quality of the current MAs/SRs in the field of probiotics for IBD and pouchitis was found to be low to moderate. More MAs/SRs of high quality are required to support using probiotics to treat IBD and pouchitis.

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

Systematic review of interventions addressing social isolation and depression in aged care clients.

PubMed

Franck, Linél; Molyneux, Natalie; Parkinson, Lynne

2016-06-01

A systematic review was undertaken of studies reporting interventions for reducing social isolation and depression in older people receiving aged care services (community or residential). Gray literature and relevant electronic databases were systematically searched for studies published in English between January 2009 and December 2013. Two reviewers independently screened studies for selection using predetermined inclusion and exclusion criteria and independently completed methodological quality review at study level. Studies of poor methodological quality were excluded. Data were extracted at study level by one reviewer and independently checked by a second reviewer, using a standardized form. The results across studies were qualitatively synthesized with outcomes described and summarized at last follow-up. Although the original objective was to review rural studies, no intervention studies based in rural areas met criteria for inclusion in the review, and only urban studies could be reviewed. Of 403 articles, six articles representing five studies with moderate-to-low risk of bias were included for review. All study participants were older adults ranging in age from 77 to 86 years. All studies had small sample sizes, ranging from 26 to 113 participants. Three of the five included intervention studies successfully reduced social isolation; one also successfully reduced depression. Only one intervention, group-based reminiscence therapy, was reported as successful in reducing both social isolation and depression in older people within an urban aged care setting. More research is needed to explore transferability of interventions across different aged care settings and into rural areas.

Systematic Review of Integrative Health Care Research: Randomized Control Trials, Clinical Controlled Trials, and Meta-Analysis

PubMed Central

Khorsan, Raheleh; Coulter, Ian D.; Crawford, Cindy; Hsiao, An-Fu

2011-01-01

A systematic review was conducted to assess the level of evidence for integrative health care research. We searched PubMed, Allied and Complementary Medicine (AMED), BIOSIS Previews, EMBASE, the entire Cochrane Library, MANTIS, Social SciSearch, SciSearch Cited Ref Sci, PsychInfo, CINAHL, and NCCAM grantee publications listings, from database inception to May 2009, as well as searches of the “gray literature.” Available studies published in English language were included. Three independent reviewers rated each article and assessed the methodological quality of studies using the Scottish Intercollegiate Guidelines Network (SIGN 50). Our search yielded 11,891 total citations but 6 clinical studies, including 4 randomized, met our inclusion criteria. There are no available systematic reviews/meta-analyses published that met our inclusion criteria. The methodological quality of the included studies was assessed independently using quality checklists of the SIGN 50. Only a small number of RCTs and CCTs with a limited number of patients and lack of adequate control groups assessing integrative health care research are available. These studies provide limited evidence of effective integrative health care on some modalities. However, integrative health care regimen appears to be generally safe. PMID:20953383

Peer-Delivered Recovery Support Services for Addictions in the United States: A Systematic Review.

PubMed

Bassuk, Ellen L; Hanson, Justine; Greene, R Neil; Richard, Molly; Laudet, Alexandre

2016-04-01

This systematic review identifies, appraises, and summarizes the evidence on the effectiveness of peer-delivered recovery support services for people in recovery from alcohol and drug addiction. Nine studies met criteria for inclusion in the review. They were assessed for quality and outcomes including substance use and recovery-related factors. Despite significant methodological limitations found in the included studies, the body of evidence suggests salutary effects on participants. Current limitations and recommendations for future research are discussed. Copyright © 2016 Elsevier Inc. All rights reserved.

A Systematic Review of the Prevalence of Psychiatric Disorders in Adults with Intellectual Disability, 2003-2010

ERIC Educational Resources Information Center

Buckles, Jason; Luckasson, Ruth; Keefe, Elizabeth

2013-01-01

Research regarding the prevalence of psychiatric conditions co-occurring with intellectual disability in adults was reviewed. Particular attention was paid to the qualities of sampling and diagnostic methodology, which have been identified as needs in two recent reviews. Sixteen articles published in peer-reviewed journals between 2003 and 2009…

The relationship between study sponsorship, risks of bias, and research outcomes in atrazine exposure studies conducted in non-human animals: Systematic review and meta-analysis.

PubMed

Bero, L; Anglemyer, A; Vesterinen, H; Krauth, D

2016-01-01

A critical component of systematic review methodology is the assessment of the risks of bias of studies that are included in the review. There is controversy about whether funding source should be included in a risk of bias assessment of animal toxicology studies. To determine whether industry research sponsorship is associated with methodological biases, the results, or conclusions of animal studies examining the effect of exposure to atrazine on reproductive or developmental outcomes. We searched multiple electronic databases and the reference lists of relevant articles to identify original research studies examining the effect of any dose of atrazine exposure at any life stage on reproduction or development in non-human animals. We compared methodological risks of bias, the conclusions of the studies, the statistical significance of the findings, and the magnitude of effect estimates between industry sponsored and non-industry sponsored studies. Fifty-one studies met the inclusion criteria. There were no differences in methodological risks of bias in industry versus non-industry sponsored studies. 39 studies tested environmentally relevant concentrations of atrazine (11 industry sponsored, 24 non-industry sponsored, 4 with no funding disclosures). Non-industry sponsored studies (12/24, 50.0%) were more likely to conclude that atrazine was harmful compared to industry sponsored studies (2/11, 18.1%) (p value=0.07). A higher proportion of non-industry sponsored studies reported statistically significant harmful effects (8/24, 33.3%) compared to industry-sponsored studies (1/11; 9.1%) (p value=0.13). The association of industry sponsorship with decreased effect sizes for harm outcomes was inconclusive. Our findings support the inclusion of research sponsorship as a risk of bias criterion in tools used to assess risks of bias in animal studies for systematic reviews. The reporting of other empirically based risk of bias criteria for animal studies, such as blinded outcome assessment, randomization, and all animals included in analyses, needs to improve to facilitate the assessment of studies for systematic reviews. Copyright © 2015 Elsevier Ltd. All rights reserved.

PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research.

PubMed

Kapadia, Mufiza Z; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2016-04-18

Paediatric systematic reviews differ from adult systematic reviews in several key aspects such as considerations of child tailored interventions, justifiable comparators, valid outcomes and child sensitive search strategies. Available guidelines, including PRISMA-P (2015) and PRISMA (2009), do not cover all the complexities associated with reporting systematic reviews in the paediatric population. Using a collaborative, multidisciplinary structure, we aim to develop evidence-based and consensus-based PRISMA-P-C (Protocol for Children) and PRISMA-C (Children) Extensions to guide paediatric systematic review protocol and completed review reporting. This project's methodology follows published recommendations for developing reporting guidelines and involves the following six phases; (1) establishment of a steering committee representing key stakeholder groups; (2) a scoping review to identify potential Extension items; (3) three types of consensus activities including meetings of the steering committee to achieve high-level decisions on the content and methodology of the Extensions, a survey of key stakeholders to generate a list of possible items to include in the Extensions and a formal consensus meeting to select the reporting items to add to, or modify for, the Extension; (4) the preliminary checklist items generated in phase III will be evaluated against the existing evidence and reporting practices in paediatric systematic reviews; (5) extension statements and explanation and elaboration documents will provide detailed advice for each item and examples of good reporting; (6) development and implementation of effective knowledge translation of the extension checklist, and an evaluation of the Extensions by key stakeholders. This protocol was considered a quality improvement project by the Hospital for Sick Children's Ethics Committee and did not require ethical review. The resultant checklists, jointly developed with all relevant stakeholders, will be disseminated through peer-reviewed journals as well as national and international conference presentations. Endorsement of the checklist will be sought simultaneously in multiple journals. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research

PubMed Central

Kapadia, Mufiza Z; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2016-01-01

Introduction Paediatric systematic reviews differ from adult systematic reviews in several key aspects such as considerations of child tailored interventions, justifiable comparators, valid outcomes and child sensitive search strategies. Available guidelines, including PRISMA-P (2015) and PRISMA (2009), do not cover all the complexities associated with reporting systematic reviews in the paediatric population. Using a collaborative, multidisciplinary structure, we aim to develop evidence-based and consensus-based PRISMA-P-C (Protocol for Children) and PRISMA-C (Children) Extensions to guide paediatric systematic review protocol and completed review reporting. Methods and analysis This project's methodology follows published recommendations for developing reporting guidelines and involves the following six phases; (1) establishment of a steering committee representing key stakeholder groups; (2) a scoping review to identify potential Extension items; (3) three types of consensus activities including meetings of the steering committee to achieve high-level decisions on the content and methodology of the Extensions, a survey of key stakeholders to generate a list of possible items to include in the Extensions and a formal consensus meeting to select the reporting items to add to, or modify for, the Extension; (4) the preliminary checklist items generated in phase III will be evaluated against the existing evidence and reporting practices in paediatric systematic reviews; (5) extension statements and explanation and elaboration documents will provide detailed advice for each item and examples of good reporting; (6) development and implementation of effective knowledge translation of the extension checklist, and an evaluation of the Extensions by key stakeholders. Ethics and Dissemination This protocol was considered a quality improvement project by the Hospital for Sick Children's Ethics Committee and did not require ethical review. The resultant checklists, jointly developed with all relevant stakeholders, will be disseminated through peer-reviewed journals as well as national and international conference presentations. Endorsement of the checklist will be sought simultaneously in multiple journals. PMID:27091820

Strategies for obtaining unpublished drug trial data: a qualitative interview study

PubMed Central

2013-01-01

Background Authors of systematic reviews have difficulty obtaining unpublished data for their reviews. This project aimed to provide an in-depth description of the experiences of authors in searching for and gaining access to unpublished data for their systematic reviews, and to give guidance on best practices for identifying, obtaining and using unpublished data. Methods This is a qualitative study analyzing in-depth interviews with authors of systematic reviews who have published Cochrane reviews or published systematic reviews outside of The Cochrane Library. We included participants who 1) were the first or senior author of a published systematic review of a drug intervention, 2) had expertise in conducting systematic reviews, searching for data, and assessing methodological biases, and 3) were able to participate in an interview in English. We used non-random sampling techniques to identify potential participants. Eighteen Cochrane authors were contacted and 16 agreed to be interviewed (89% response rate). Twenty-four non-Cochrane authors were contacted and 16 were interviewed (67% response rate). Results Respondents had different understandings of what was meant by unpublished data, including specific outcomes and methodological details. Contacting study authors was the most common method used to obtain unpublished data and the value of regulatory agencies as a data source was underappreciated. Using the data obtained was time consuming and labor intensive. Respondents described the collaboration with other colleagues and/or students required to organize, manage and use the data in their reviews, generally developing and using templates, spreadsheets and computer programs for data extraction and analysis. Respondents had a shared belief that data should be accessible but some had concerns about sharing their own data. Respondents believed that obtaining unpublished data for reviews has important public health implications. There was widespread support for government intervention to ensure open access to trial data. Conclusions Respondents uniformly agreed that the benefit of identifying unpublished data was worth the effort and was necessary to identify the true harms and benefits of drugs. Recent actions by government, such as increased availability of trial data from the European Medicines Agency, may make it easier to acquire critical drug trial data. PMID:23680054

The effect of vision on knee biomechanics during functional activities - A systematic review.

PubMed

Louw, Quinette; Gillion, Nadia; van Niekerk, Sjan-Mari; Morris, Linzette; Baumeister, Jochen

2015-07-01

The objective of this study was to assess the effect of occluded vision on lower limb kinematics and kinetics of the knee joint during functional tasks including drop landing (single or double leg), squatting (single or double leg), stepping down, cutting movement and hopping in healthy individuals, or individuals who had an ACL reconstruction or deficiency with no vision impairments. A systematic review was conducted. A systematic review was conducted and electronic databases were searched between March 2012 and April 2013 for eligible papers. Methodological quality of each study was assessed using the Downs and Black revised checklist. Six studies met the eligibility criteria and a wide variation in methodological approaches was reported. This small evidence base indicated equivocal evidence about the effect of vision on knee biomechanics in individuals with healthy and compromised somatosensory function post an ACL reconstruction or injury. Clinicians should consider innovative, individualised ACL rehabilitation strategies when prescribing exercises which involve visual occlusion. Further research to increase the relatively small evidence base for the effect of vision on knee biomechanics is warranted. Copyright © 2014 Sports Medicine Australia. All rights reserved.

Obesogenic environments: a systematic review of the association between the physical environment and adult weight status, the SPOTLIGHT project

PubMed Central

2014-01-01

Background Understanding which physical environmental factors affect adult obesity, and how best to influence them, is important for public health and urban planning. Previous attempts to summarise the literature have not systematically assessed the methodological quality of included studies, or accounted for environmental differences between continents or the ways in which environmental characteristics were measured. Methods We have conducted an updated review of the scientific literature on associations of physical environmental factors with adult weight status, stratified by continent and mode of measurement, accompanied by a detailed risk-of-bias assessment. Five databases were systematically searched for studies published between 1995 and 2013. Results Two factors, urban sprawl and land use mix, were found consistently associated with weight status, although only in North America. Conclusions With the exception of urban sprawl and land use mix in the US the results of the current review confirm that the available research does not allow robust identification of ways in which that physical environment influences adult weight status, even after taking into account methodological quality. PMID:24602291

Mind-body Therapies for Menopausal Symptoms: A Systematic Review

PubMed Central

Innes, Kim E; Selfe, Terry Kit; Vishnu, Abhishek

2010-01-01

Objective To systematically review the peer-reviewed literature regarding the effects of self-administered mind-body therapies on menopausal symptoms. Methods To identify qualifying studies, we searched 10 scientific databases and scanned bibliographies of relevant review papers and all identified articles. The methodological quality of all studies was assessed systematically using predefined criteria. Results Twenty-one papers representing 18 clinical trials from 6 countries met our inclusion criteria, including 12 randomized controlled trials (N=719), 1 non-randomized controlled trial (N=58), and 5 uncontrolled trials (N=105). Interventions included yoga and/or meditation-based programs, tai chi, and other relaxation practices, including muscle relaxation and breath-based techniques, relaxation response training, and low frequency sound-wave therapy. Eight of the nine studies of yoga, tai chi, and meditation-based programs reported improvement in overall menopausal and vasomotor symptoms; six of seven trials indicated improvement in mood and sleep with yoga-based programs, and four studies reported reduced musculoskeletal pain. Results from the remaining nine trials suggest that breath-based and other relaxation therapies also show promise for alleviating vasomotor and other menopausal symptoms, although intergroup findings were mixed. Most studies reviewed suffered methodological or other limitations, complicating interpretation of findings. Conclusions Collectively, findings of these studies suggest that yoga-based and certain other mind-body therapies may be beneficial for alleviating specific menopausal symptoms. However, the limitations characterizing most studies hinder interpretation of findings and preclude firm conclusions regarding efficacy. Additional large, methodologically sound trials are needed to determine the effects of specific mind-body therapies on menopausal symptoms, examine long-term outcomes, and investigate underlying mechanisms. PMID:20167444

Use of Electroencephalography Brain-Computer Interface Systems as a Rehabilitative Approach for Upper Limb Function After a Stroke: A Systematic Review.

PubMed

Monge-Pereira, Esther; Ibañez-Pereda, Jaime; Alguacil-Diego, Isabel M; Serrano, Jose I; Spottorno-Rubio, María P; Molina-Rueda, Francisco

2017-09-01

Brain-computer interface (BCI) systems have been suggested as a promising tool for neurorehabilitation. However, to date, there is a lack of homogeneous findings. Furthermore, no systematic reviews have analyzed the degree of validation of these interventions for upper limb (UL) motor rehabilitation poststroke. The study aims were to compile all available studies that assess an UL intervention based on an electroencephalography (EEG) BCI system in stroke; to analyze the methodological quality of the studies retrieved; and to determine the effects of these interventions on the improvement of motor abilities. TYPE: This was a systematic review. Searches were conducted in PubMed, PEDro, Embase, Cumulative Index to Nursing and Allied Health, Web of Science, and Cochrane Central Register of Controlled Trial from inception to September 30, 2015. This systematic review compiles all available studies that assess UL intervention based on an EEG-BCI system in patients with stroke, analyzing their methodological quality using the Critical Review Form for Quantitative Studies, and determining the grade of recommendation of these interventions for improving motor abilities as established by the Oxford Centre for Evidence-based Medicine. The articles were selected according to the following criteria: studies evaluating an EEG-based BCI intervention; studies including patients with a stroke and hemiplegia, regardless of lesion origin or temporal evolution; interventions using an EEG-based BCI to restore functional abilities of the affected UL, regardless of the interface used or its combination with other therapies; and studies using validated tools to evaluate motor function. After the literature search, 13 articles were included in this review: 4 studies were randomized controlled trials; 1 study was a controlled study; 4 studies were case series studies; and 4 studies were case reports. The methodological quality of the included papers ranged from 6 to 15, and the level of evidence varied from 1b to 5. The articles included in this review involved a total of 141 stroke patients. This systematic review suggests that BCI interventions may be a promising rehabilitation approach in subjects with stroke. II. Copyright © 2017 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

Evaluation of AMSTAR to assess the methodological quality of systematic reviews in overviews of reviews of healthcare interventions.

PubMed

Pollock, Michelle; Fernandes, Ricardo M; Hartling, Lisa

2017-03-23

Overviews of reviews (overviews) compile information from multiple systematic reviews (SRs) to provide a single synthesis of relevant evidence for decision-making. It is recommended that authors assess and report the methodological quality of SRs in overviews-for example, using A MeaSurement Tool to Assess systematic Reviews (AMSTAR). Currently, there is variation in whether and how overview authors assess and report SR quality, and limited guidance is available. Our objectives were to: examine methodological considerations involved in using AMSTAR to assess the quality of Cochrane and non-Cochrane SRs in overviews of healthcare interventions; identify challenges (and develop potential decision rules) when using AMSTAR in overviews; and examine the potential impact of considering methodological quality when making inclusion decisions in overviews. We selected seven overviews of healthcare interventions and included all SRs meeting each overview's inclusion criteria. For each SR, two reviewers independently conducted AMSTAR assessments with consensus and discussed challenges encountered. We also examined the correlation between AMSTAR assessments and SR results/conclusions. Ninety-five SRs were included (30 Cochrane, 65 non-Cochrane). Mean AMSTAR assessments (9.6/11 vs. 5.5/11; p < 0.001) and inter-rater reliability (AC1 statistic: 0.84 vs. 0.69; "almost perfect" vs. "substantial" using the Landis & Koch criteria) were higher for Cochrane compared to non-Cochrane SRs. Four challenges were identified when applying AMSTAR in overviews: the scope of the SRs and overviews often differed; SRs examining similar topics sometimes made different methodological decisions; reporting of non-Cochrane SRs was sometimes poor; and some non-Cochrane SRs included other SRs as well as primary studies. Decision rules were developed to address each challenge. We found no evidence that AMSTAR assessments were correlated with SR results/conclusions. Results indicate that the AMSTAR tool can be used successfully in overviews that include Cochrane and non-Cochrane SRs, though decision rules may be useful to circumvent common challenges. Findings support existing recommendations that quality assessments of SRs in overviews be conducted independently, in duplicate, with a process for consensus. Results also suggest that using methodological quality to guide inclusion decisions (e.g., to exclude poorly conducted and reported SRs) may not introduce bias into the overview process.

Cochrane Rapid Reviews Methods Group to play a leading role in guiding the production of informed high-quality, timely research evidence syntheses.

PubMed

Garritty, Chantelle; Stevens, Adrienne; Gartlehner, Gerald; King, Valerie; Kamel, Chris

2016-10-28

Policymakers and healthcare stakeholders are increasingly seeking evidence to inform the policymaking process, and often use existing or commissioned systematic reviews to inform decisions. However, the methodologies that make systematic reviews authoritative take time, typically 1 to 2 years to complete. Outside the traditional SR timeline, "rapid reviews" have emerged as an efficient tool to get evidence to decision-makers more quickly. However, the use of rapid reviews does present challenges. To date, there has been limited published empirical information about this approach to compiling evidence. Thus, it remains a poorly understood and ill-defined set of diverse methodologies with various labels. In recent years, the need to further explore rapid review methods, characteristics, and their use has been recognized by a growing network of healthcare researchers, policymakers, and organizations, several with ties to Cochrane, which is recognized as representing an international gold standard for high-quality, systematic reviews. In this commentary, we introduce the newly established Cochrane Rapid Reviews Methods Group developed to play a leading role in guiding the production of rapid reviews given they are increasingly employed as a research synthesis tool to support timely evidence-informed decision-making. We discuss how the group was formed and outline the group's structure and remit. We also discuss the need to establish a more robust evidence base for rapid reviews in the published literature, and the importance of promoting registration of rapid review protocols in an effort to promote efficiency and transparency in research. As with standard systematic reviews, the core principles of evidence-based synthesis should apply to rapid reviews in order to minimize bias to the extent possible. The Cochrane Rapid Reviews Methods Group will serve to establish a network of rapid review stakeholders and provide a forum for discussion and training. By facilitating exchange, the group will strive to conduct research to advance the methods of rapid reviews.

Quantification of pelvic floor muscle strength in female urinary incontinence: A systematic review and comparison of contemporary methodologies.

PubMed

Deegan, Emily G; Stothers, Lynn; Kavanagh, Alex; Macnab, Andrew J

2018-01-01

There remains no gold standard for quantification of voluntary pelvic floor muscle (PFM) strength, despite international guidelines that recommend PFM assessment in females with urinary incontinence (UI). Methods currently reported for quantification of skeletal muscle strength across disciplines are systematically reviewed and their relevance for clinical and academic use related to the pelvic floor are described. A systematic review via Medline, PubMed, CINHAL, and the Cochrane database using key terms for pelvic floor anatomy and function were cross referenced with skeletal muscle strength quantification from 1946 to 2016. Full text peer-reviewed articles in English having female subjects with incontinence were identified. Each study was analyzed for use of controls, type of methodology as direct or indirect measures, benefits, and limitations of the technique. A total of 1586 articles were identified of which 50 met the inclusion criteria. Nine methodologies of determining PFM strength were described including: digital palpation, perineometer, dynamometry, EMG, vaginal cones, ultrasonography, magnetic resonance imaging, urine stream interruption test, and the Colpexin pull test. Thirty-two percent lacked a control group. Technical refinements in both direct and indirect instrumentation for PFM strength measurement are allowing for sensitivity. However, the most common methods of quantification remain digital palpation and perineometry; techniques that pose limitations and yield subjective or indirect measures of muscular strength. Dynamometry has potential as an accurate and sensitive tool, but is limited by inability to assess PFM strength during dynamic movements. © 2017 Wiley Periodicals, Inc.

Evidence mapping based on systematic reviews of therapeutic interventions for gastrointestinal stromal tumors (GIST).

PubMed

Ballesteros, Mónica; Montero, Nadia; López-Pousa, Antonio; Urrútia, Gerard; Solà, Ivan; Rada, Gabriel; Pardo-Hernandez, Hector; Bonfill, Xavier

2017-09-07

Gastrointestinal Stromal Tumours (GISTs) are the most common mesenchymal tumours. Currently, different pharmacological and surgical options are used to treat localised and metastatic GISTs, although this research field is broad and the body of evidence is scattered and expanding. Our objectives are to identify, describe and organise the current available evidence for GIST through an evidence mapping approach. We followed the methodology of Global Evidence Mapping (GEM). We searched Pubmed, EMBASE, The Cochrane Library and Epistemonikos in order to identify systematic reviews (SRs) with or without meta-analyses published between 1990 and March 2016. Two authors assessed eligibility and extracted data. Methodological quality of the included systematic reviews was assessed using AMSTAR. We organised the results according to identified PICO questions and presented the evidence map in tables and a bubble plot. A total of 17 SRs met eligibility criteria. These reviews included 66 individual studies, of which three quarters were either observational or uncontrolled clinical trials. Overall, the quality of the included SRs was moderate or high. In total, we extracted 14 PICO questions from them and the corresponding results mostly favoured the intervention arm. The most common type of study used to evaluate therapeutic interventions in GIST sarcomas has been non-experimental studies. However, the majority of the interventions are reported as beneficial or probably beneficial by the respective authors of SRs. The evidence mapping is a useful and reliable methodology to identify and present the existing evidence about therapeutic interventions.

Validation methodology in publications describing epidemiological registration methods of dental caries: a systematic review.

PubMed

Sjögren, P; Ordell, S; Halling, A

2003-12-01

The aim was to describe and systematically review the methodology and reporting of validation in publications describing epidemiological registration methods for dental caries. BASIC RESEARCH METHODOLOGY: Literature searches were conducted in six scientific databases. All publications fulfilling the predetermined inclusion criteria were assessed for methodology and reporting of validation using a checklist including items described previously as well as new items. The frequency of endorsement of the assessed items was analysed. Moreover, the type and strength of evidence, was evaluated. Reporting of predetermined items relating to methodology of validation and the frequency of endorsement of the assessed items were of primary interest. Initially 588 publications were located. 74 eligible publications were obtained, 23 of which fulfilled the inclusion criteria and remained throughout the analyses. A majority of the studies reported the methodology of validation. The reported methodology of validation was generally inadequate, according to the recommendations of evidence-based medicine. The frequencies of reporting the assessed items (frequencies of endorsement) ranged from four to 84 per cent. A majority of the publications contributed to a low strength of evidence. There seems to be a need to improve the methodology and the reporting of validation in publications describing professionally registered caries epidemiology. Four of the items assessed in this study are potentially discriminative for quality assessments of reported validation.

Prevalence of psychotic disorders and its association with methodological issues. A systematic review and meta-analyses

PubMed Central

Martín, Carlos; Pastor, Loly

2018-01-01

Objectives The purpose of this study is to provide an updated systematic review to identify studies describing the prevalence of psychosis in order to explore methodological factors that could account for the variation in prevalence estimates. Methods Studies with original data related to the prevalence of psychosis (published between 1990 and 2015) were identified via searching electronic databases and reviewing manual citations. Prevalence estimates were sorted according to prevalence type (point, 12-months and lifetime). The independent association between key methodological variables and the mean effect of prevalence was examined (prevalence type, case-finding setting, method of confirming diagnosis, international classification of diseases, diagnosis category, and study quality) by meta-analytical techniques and random-effects meta-regression. Results Seventy-three primary studies were included, providing a total of 101 estimates of prevalence rates of psychosis. Across these studies, the pooled median point and 12-month prevalence for persons was 3.89 and 4.03 per 1000 respectively; and the median lifetime prevalence was 7.49 per 1000. The result of the random-effects meta-regression analysis revealed a significant effect for the prevalence type, with higher rates of lifetime prevalence than 12-month prevalence (p<0.001). Studies conducted in the general population presented higher prevalence rates than those carried out in populations attended in health/social services (p = 0.006). Compared to the diagnosis of schizophrenia only, prevalence rates were higher in the probable psychotic disorder (p = 0.022) and non-affective psychosis (p = 0.009). Finally, a higher study quality is associated with a lower estimated prevalence of psychotic disorders (p<0.001). Conclusions This systematic review provides a comprehensive comparison of methodologies used in studies of the prevalence of psychosis, which can provide insightful information for future epidemiological studies in adopting the most relevant methodological approach. PMID:29649252

Systematic Review of Empirically Evaluated School-Based Gambling Education Programs.

PubMed

Keen, Brittany; Blaszczynski, Alex; Anjoul, Fadi

2017-03-01

Adolescent problem gambling prevalence rates are reportedly five times higher than in the adult population. Several school-based gambling education programs have been developed in an attempt to reduce problem gambling among adolescents; however few have been empirically evaluated. The aim of this review was to report the outcome of studies empirically evaluating gambling education programs across international jurisdictions. A systematic review following guidelines outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement searching five academic databases: PubMed, Scopus, Medline, PsycINFO, and ERIC, was conducted. A total of 20 papers and 19 studies were included after screening and exclusion criteria were applied. All studies reported intervention effects on cognitive outcomes such as knowledge, perceptions, and beliefs. Only nine of the studies attempted to measure intervention effects on behavioural outcomes, and only five of those reported significant changes in gambling behaviour. Of these five, methodological inadequacies were commonly found including brief follow-up periods, lack of control comparison in post hoc analyses, and inconsistencies and misclassifications in the measurement of gambling behaviour, including problem gambling. Based on this review, recommendations are offered for the future development and evaluation of school-based gambling education programs relating to both methodological and content design and delivery considerations.

How Strong Is the Evidence that Illicit Drug Use by Young People Is an Important Cause of Psychological or Social Harm? Methodological and Policy Implications of a Systematic Review of Longitudinal, General Population Studies

ERIC Educational Resources Information Center

MacLeod, John; Oakes, Rachel; Oppenkowski, Thomas; Stokes-Lampard, Helen; Copello, Alex; Crome, Ilana; Davey Smith, George; Egger, Matthias; Hickman, Mathew; Judd, Ali

2004-01-01

Recreational use of illicit drugs (i.e. use not associated with a diagnosed drug problem) may cause psychological and social harm. A recent systematic review found that evidence for this was equivocal. Extensive evidence was only available in relation to cannabis use. This was relatively consistently associated with lower educational attainment…

Nature-assisted therapy: systematic review of controlled and observational studies.

PubMed

Annerstedt, Matilda; Währborg, Peter

2011-06-01

Nature's potentially positive effect on human health may serve as an important public health intervention. While several scientific studies have been performed on the subject, no systematic review of existing evidence has until date been established. This article is a systematic evaluation of available scientific evidence for nature-assisted therapy (NAT). With the design of a systematic review relevant data sources were scrutinised to retrieve studies meeting predefined inclusion criteria. The methodological quality of studies and abstracted data were assessed for intervention studies on NAT for a defined disease. The final inclusion of a study was decided by the authors together. The included studies were heterogeneous for participant characteristics, intervention type, and methodological quality. Three meta-analyses, six studies of high evidence grade (four reporting significant improvement), and 29 studies of low to moderate evidence grade (26 reporting health improvements) were included. For the studies with high evidence grade, the results were generally positive, though somewhat ambiguous. Among the studies of moderate to low evidence grade, health improvements were reported in 26 cases out of 29. This review gives at hand that a rather small but reliable evidence base supports the effectiveness and appropriateness of NAT as a relevant resource for public health. Significant improvements were found for varied outcomes in diverse diagnoses, spanning from obesity to schizophrenia. Recommendations for specific areas of future research of the subject are provided.

A systematic review of systematic reviews on interventions for caregivers of people with chronic conditions.

PubMed

Corry, Margarita; While, Alison; Neenan, Kathleen; Smith, Valerie

2015-04-01

To evaluate the effectiveness of interventions to support caregivers of people with selected chronic conditions. Informal caregivers provide millions of care hours each week contributing to significant healthcare savings. Despite much research evaluating a range of interventions for caregivers, their impact remains unclear. A systematic review of systematic reviews of interventions to support caregivers of people with selected chronic conditions. The electronic databases of PubMed, CINAHL, British Nursing Index, PsycINFO, Social Science Index (January 1990-May 2014) and The Cochrane Library (Issue 6, June 2014), were searched using Medical Subject Heading and index term combinations of the keywords caregiver, systematic review, intervention and named chronic conditions. Papers were included if they reported a systematic review of interventions for caregivers of people with chronic conditions. The methodological quality of the included reviews was independently assessed by two reviewers using R-AMSTAR. Data were independently extracted by two reviewers using a pre-designed data extraction form. Narrative synthesis of review findings was used to present the results. Eight systematic reviews were included. There was evidence that education and support programme interventions improved caregiver quality of life. Information-giving interventions improved caregiver knowledge for stroke caregivers. Education, support and information-giving interventions warrant further investigation across caregiver groups. A large-scale funded programme for caregiver research is required to ensure that studies are of high quality to inform service development across settings. © 2014 John Wiley & Sons Ltd.

[Audit and feedback, and continuous quality improvement strategies to improve the quality of care for type 2 diabetes: a systematic review of literature].

PubMed

Vecchi, Simona; Agabiti, Nera; Mitrova, Susanna; Cacciani, Laura; Amato, Laura; Davoli, Marina; Bargagli, Anna Maria

2016-01-01

we analysed evidence on effective interventions to improve the quality of care and management in patients with diabetes type 2. This review focuses particularly on audit and feedback intervention, targeted to healthcare providers, and continuous quality improvement (CQI) involving health professionals and health care systems, respectively. we searched The Cochrane Library, PubMed, and EMBASE (search period: January 2005-December 2015) to identify systematic reviews (SR) and randomized controlled trials (RCTs) considering patients' outcomes and process measures as quality indicators in diabetes care. Selection of studies and data extraction were carried out independently by two reviewers. Methodological quality of individual studies was assessed using the checklist «Assessment of methodological quality of systematic review» (AMSTAR) and the Cochrane's tool, respectively. We produced summaries of results for each study design. the search process resulted in 810 citations. One SR and 7 RCTs that compared any intervention in which audit and feedback and CQI was a component vs. other interventions were selected. The SR found that audit and feedback activity was associated with improvements of glycaemic (mean difference: 0.26; 95%CI 0.08;0.44) and cholesterol control (mean difference: 0.03; 95%CI -0.04;0.10). CQI interventions were not associated with an improvement of quality of diabetes care. The RCTs considered in this review compared a broad range of interventions including feedback as unique activity or as part of more complex strategies. The methodological quality was generally poor in all the included trials. the available evidence suggests that audit and feedback and CQI improve quality of care in diabetic patients, although the effect is small and heterogeneous among process and outcomes indicators.

The reliability and validity of cervical auscultation in the diagnosis of dysphagia: a systematic review.

PubMed

Lagarde, Marloes L J; Kamalski, Digna M A; van den Engel-Hoek, Lenie

2016-02-01

To systematically review the available evidence for the reliability and validity of cervical auscultation in diagnosing the several aspects of dysphagia in adults and children suffering from dysphagia. Medline (PubMed), Embase and the Cochrane Library databases. The systematic review was carried out applying the steps of the PRISMA-statement. The methodological quality of the included studies were evaluated using the Dutch 'Cochrane checklist for diagnostic accuracy studies'. A total of 90 articles were identified through the search strategy, and after applying the inclusion and exclusion criteria, six articles were included in this review. In the six studies, 197 patients were assessed with cervical auscultation. Two of the six articles were considered to be of 'good' quality and three studies were of 'moderate' quality. One article was excluded because of a 'poor' methodological quality. Sensitivity ranges from 23%-94% and specificity ranges from 50%-74%. Inter-rater reliability was 'poor' or 'fair' in all studies. The intra-rater reliability shows a wide variance among speech language therapists. In this systematic review, conflicting evidence is found for the validity of cervical auscultation. The reliability of cervical auscultation is insufficient when used as a stand-alone tool in the diagnosis of dysphagia in adults. There is no available evidence for the validity and reliability of cervical auscultation in children. Cervical auscultation should not be used as a stand-alone instrument to diagnose dysphagia. © The Author(s) 2015.

Environmental factors associated with disordered weight-control behaviours among youth: a systematic review.

PubMed

Wang, Monica L; Peterson, Karen E; McCormick, Marie C; Austin, S Bryn

2014-07-01

Environmental factors may be very important in the development of disordered weight-control behaviours (DWCB) among youth, yet no study to date has conducted a review that synthesizes these findings. The purpose of the present study was to systematically review existing literature on environmental influences on DWCB among youth and to identify conceptual and methodological gaps in the literature. Systematic review. Studies were identified through a systematic search using PubMed, PsycINFO, Google Scholar and secondary references. Inclusion criteria included observational studies published in peer-reviewed journals from 1994 to 2012 that examined environmental exposure(s) associated with DWCB among youth. Ninety-three studies, the majority of which utilized a cross-sectional design (75 %; n 70), were identified. Longitudinal studies' follow-up time ranged from 8 months to 10 years. Parental, peer and media influences have been extensively studied as factors associated with DWCB among youth. Fewer studies have examined behavioural settings (i.e. homes, schools, neighbourhoods) or sectors of influence other than the media on DWCB. No studies utilized multilevel methods to parse out environmental influences on DWCB. Most studies (69 %, n 64) did not explicitly utilize a theory or model to guide the research. Findings indicate that exploring a wider range of environmental influences on DWCB, specifically behavioural settings and sectors of influence, using diverse study samples and multilevel methodology is needed to advance the field and to inform the design of comprehensive prevention programmes that target DWCB and other weight-related behaviours.

Establishing confidence in the output of qualitative research synthesis: the ConQual approach.

PubMed

Munn, Zachary; Porritt, Kylie; Lockwood, Craig; Aromataris, Edoardo; Pearson, Alan

2014-09-20

The importance of findings derived from syntheses of qualitative research has been increasingly acknowledged. Findings that arise from qualitative syntheses inform questions of practice and policy in their own right and are commonly used to complement findings from quantitative research syntheses. The GRADE approach has been widely adopted by international organisations to rate the quality and confidence of the findings of quantitative systematic reviews. To date, there has been no widely accepted corresponding approach to assist health care professionals and policy makers in establishing confidence in the synthesised findings of qualitative systematic reviews. A methodological group was formed develop a process to assess the confidence in synthesised qualitative research findings and develop a Summary of Findings tables for meta-aggregative qualitative systematic reviews. Dependability and credibility are two elements considered by the methodological group to influence the confidence of qualitative synthesised findings. A set of critical appraisal questions are proposed to establish dependability, whilst credibility can be ranked according to the goodness of fit between the author's interpretation and the original data. By following the processes outlined in this article, an overall ranking can be assigned to rate the confidence of synthesised qualitative findings, a system we have labelled ConQual. The development and use of the ConQual approach will assist users of qualitative systematic reviews to establish confidence in the evidence produced in these types of reviews and can serve as a practical tool to assist in decision making.

A Review of Singapore Principals' Leadership Qualities, Styles, and Roles

ERIC Educational Resources Information Center

Ng, David Foo Seong; Nguyen, Dong Thanh; Wong, Benjamin Koon Siak; Choy, William Kim Weng

2015-01-01

Purpose: The purpose of this paper is to present a review of empirical studies on principal leadership in Singapore. It seeks to provide a general picture of Singapore principals' leadership qualities, styles, and roles. Design/methodology/approach: This is a systematic review of empirical studies, using a "bounded" approach with a focus…

Systematic Review of the Role of External Contributors in School Substance Use Education

ERIC Educational Resources Information Center

Buckley, Emily J.; White, David G.

2007-01-01

Purpose: A literature review was conducted to evaluate the effectiveness of external contributors (anyone other than a teacher at the school) in delivering school-based drug, alcohol and tobacco education (substance use education) programmes. Design/methodology/approach: The review focused upon literature published from 1990 onwards in English.…

Induction of lucid dreams: a systematic review of evidence.

PubMed

Stumbrys, Tadas; Erlacher, Daniel; Schädlich, Melanie; Schredl, Michael

2012-09-01

In lucid dreams the dreamer is aware of dreaming and often able to influence the ongoing dream content. Lucid dreaming is a learnable skill and a variety of techniques is suggested for lucid dreaming induction. This systematic review evaluated the evidence for the effectiveness of induction techniques. A comprehensive literature search was carried out in biomedical databases and specific resources. Thirty-five studies were included in the analysis (11 sleep laboratory and 24 field studies), of which 26 employed cognitive techniques, 11 external stimulation and one drug application. The methodological quality of the included studies was relatively low. None of the induction techniques were verified to induce lucid dreams reliably and consistently, although some of them look promising. On the basis of the reviewed studies, a taxonomy of lucid dream induction methods is presented. Several methodological issues are discussed and further directions for future studies are proposed. Copyright © 2012 Elsevier Inc. All rights reserved.

A systematic review of health economic evaluations of vaccines in Brazil.

PubMed

Sartori, Ana Marli Christovam; Rozman, Luciana Martins; Decimoni, Tassia Cristina; Leandro, Roseli; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2017-06-03

In Brazil, since 2005, the Ministry of Health requires Health Economic Evaluation (HEE) of vaccines for introduction into the National Immunization Program. To describe and analyze the full HEE on vaccines conducted in Brazil from 1980 to 2013. Systematic review of the literature. We searched multiple databases. Two researchers independently selected the studies and extracted the data. The methodological quality of individual studies was evaluated using CHEERS items. Twenty studies were reviewed. The most evaluated vaccines were pneumococcal (25%) and HPV (15%). The most used types of HEE were cost-effectiveness analysis (45%) and cost-utility analysis (20%). The research question and compared strategies were stated in all 20 studies and the target population was clear in 95%. Nevertheless, many studies did not inform the perspective of analysis or data sources. HEE of vaccines in Brazil has increased since 2008. However, the studies still have methodological deficiencies.

Mindfulness Meditation for Substance Use Disorders: A Systematic Review

PubMed Central

Zgierska, Aleksandra; Rabago, David; Chawla, Neharika; Kushner, Kenneth; Koehler, Robert; Marlatt, Allan

2009-01-01

Relapse is common in substance use disorders (SUDs), even among treated individuals. The goal of this article was to systematically review the existing evidence on mindfulness meditation-based interventions (MM) for SUDs. The comprehensive search for and review of literature found over 2,000 abstracts and resulted in 25 eligible manuscripts (22 published, 3 unpublished: 8 RCTs, 7 controlled non-randomized, 6 non-controlled prospective, 2 qualitative studies, 1 case report). When appropriate, methodological quality, absolute risk reduction, number needed to treat, and effect size (ES) were assessed. Overall, although preliminary evidence suggests MM efficacy and safety, conclusive data for MM as a treatment of SUDs are lacking. Significant methodological limitations exist in most studies. Further, it is unclear which persons with SUDs might benefit most from MM. Future trials must be of sufficient sample size to answer a specific clinical question and should target both assessment of effect size and mechanisms of action. PMID:19904664

A systematic review of health economic evaluations of vaccines in Brazil

PubMed Central

2017-01-01

ABSTRACT Background: In Brazil, since 2005, the Ministry of Health requires Health Economic Evaluation (HEE) of vaccines for introduction into the National Immunization Program. Objectives: To describe and analyze the full HEE on vaccines conducted in Brazil from 1980 to 2013. Methods: Systematic review of the literature. We searched multiple databases. Two researchers independently selected the studies and extracted the data. The methodological quality of individual studies was evaluated using CHEERS items. Results: Twenty studies were reviewed. The most evaluated vaccines were pneumococcal (25%) and HPV (15%). The most used types of HEE were cost-effectiveness analysis (45%) and cost-utility analysis (20%). The research question and compared strategies were stated in all 20 studies and the target population was clear in 95%. Nevertheless, many studies did not inform the perspective of analysis or data sources. Conclusions: HEE of vaccines in Brazil has increased since 2008. However, the studies still have methodological deficiencies. PMID:28129026

Telemedicine security: a systematic review.

PubMed

Garg, Vaibhav; Brewer, Jeffrey

2011-05-01

Telemedicine is a technology-based alternative to traditional health care delivery. However, poor security measures in telemedicine services can have an adverse impact on the quality of care provided, regardless of the chronic condition being studied. We undertook a systematic review of 58 journal articles pertaining to telemedicine security. These articles were selected based on a keyword search on 14 relevant journals. The articles were coded to evaluate the methodology and to identify the key areas of research in security that are being reviewed. Seventy-six percent of the articles defined the security problem they were addressing, and only 47% formulated a research question pertaining to security. Sixty-one percent proposed a solution, and 20% of these tested the security solutions that they proposed. Prior research indicates inadequate reporting of methodology in telemedicine research. We found that to be true for security research as well. We also identified other issues such as using outdated security standards. © 2011 Diabetes Technology Society.

Telemedicine Security: A Systematic Review

PubMed Central

Garg, Vaibhav; Brewer, Jeffrey

2011-01-01

Telemedicine is a technology-based alternative to traditional health care delivery. However, poor security measures in telemedicine services can have an adverse impact on the quality of care provided, regardless of the chronic condition being studied. We undertook a systematic review of 58 journal articles pertaining to telemedicine security. These articles were selected based on a keyword search on 14 relevant journals. The articles were coded to evaluate the methodology and to identify the key areas of research in security that are being reviewed. Seventy-six percent of the articles defined the security problem they were addressing, and only 47% formulated a research question pertaining to security. Sixty-one percent proposed a solution, and 20% of these tested the security solutions that they proposed. Prior research indicates inadequate reporting of methodology in telemedicine research. We found that to be true for security research as well. We also identified other issues such as using outdated security standards. PMID:21722592

Oropharyngeal dysphagia in myotonic dystrophy type 1: a systematic review.

PubMed

Pilz, Walmari; Baijens, Laura W J; Kremer, Bernd

2014-06-01

A systematic review was conducted to investigate the pathophysiology of and diagnostic procedures for oropharyngeal dysphagia in myotonic dystrophy (MD). The electronic databases Embase, PubMed, and The Cochrane Library were used. The search was limited to English, Dutch, French, German, Spanish, and Portuguese publications. Sixteen studies met the inclusion criteria. Two independent reviewers assessed the methodological quality of the included articles. Swallowing assessment tools, the corresponding protocols, the studies' outcome measurements, and main findings are summarized and presented. The body of literature on pathophysiology of swallowing in dysphagic patients with MD type 1 remains scant. The included studies are heterogeneous with respect to design and outcome measures and hence are not directly comparable. More importantly, most studies had methodological problems. These are discussed in detail and recommendations for further research on diagnostic examinations for swallowing disorders in patients with MD type 1 are provided.

PRECEPT: an evidence assessment framework for infectious disease epidemiology, prevention and control.

PubMed

Harder, Thomas; Takla, Anja; Eckmanns, Tim; Ellis, Simon; Forland, Frode; James, Roberta; Meerpohl, Joerg J; Morgan, Antony; Rehfuess, Eva; Schünemann, Holger; Zuiderent-Jerak, Teun; de Carvalho Gomes, Helena; Wichmann, Ole

2017-10-01

Decisions in public health should be based on the best available evidence, reviewed and appraised using a rigorous and transparent methodology. The Project on a Framework for Rating Evidence in Public Health (PRECEPT) defined a methodology for evaluating and grading evidence in infectious disease epidemiology, prevention and control that takes different domains and question types into consideration. The methodology rates evidence in four domains: disease burden, risk factors, diagnostics and intervention. The framework guiding it has four steps going from overarching questions to an evidence statement. In step 1, approaches for identifying relevant key areas and developing specific questions to guide systematic evidence searches are described. In step 2, methodological guidance for conducting systematic reviews is provided; 15 study quality appraisal tools are proposed and an algorithm is given for matching a given study design with a tool. In step 3, a standardised evidence-grading scheme using the Grading of Recommendations Assessment, Development and Evaluation Working Group (GRADE) methodology is provided, whereby findings are documented in evidence profiles. Step 4 consists of preparing a narrative evidence summary. Users of this framework should be able to evaluate and grade scientific evidence from the four domains in a transparent and reproducible way.

PRECEPT: an evidence assessment framework for infectious disease epidemiology, prevention and control

PubMed Central

Harder, Thomas; Takla, Anja; Eckmanns, Tim; Ellis, Simon; Forland, Frode; James, Roberta; Meerpohl, Joerg J; Morgan, Antony; Rehfuess, Eva; Schünemann, Holger; Zuiderent-Jerak, Teun; de Carvalho Gomes, Helena; Wichmann, Ole

2017-01-01

Decisions in public health should be based on the best available evidence, reviewed and appraised using a rigorous and transparent methodology. The Project on a Framework for Rating Evidence in Public Health (PRECEPT) defined a methodology for evaluating and grading evidence in infectious disease epidemiology, prevention and control that takes different domains and question types into consideration. The methodology rates evidence in four domains: disease burden, risk factors, diagnostics and intervention. The framework guiding it has four steps going from overarching questions to an evidence statement. In step 1, approaches for identifying relevant key areas and developing specific questions to guide systematic evidence searches are described. In step 2, methodological guidance for conducting systematic reviews is provided; 15 study quality appraisal tools are proposed and an algorithm is given for matching a given study design with a tool. In step 3, a standardised evidence-grading scheme using the Grading of Recommendations Assessment, Development and Evaluation Working Group (GRADE) methodology is provided, whereby findings are documented in evidence profiles. Step 4 consists of preparing a narrative evidence summary. Users of this framework should be able to evaluate and grade scientific evidence from the four domains in a transparent and reproducible way. PMID:29019317

Language barriers and qualitative nursing research: methodological considerations.

PubMed

Squires, A

2008-09-01

This review of the literature synthesizes methodological recommendations for the use of translators and interpreters in cross-language qualitative research. Cross-language qualitative research involves the use of interpreters and translators to mediate a language barrier between researchers and participants. Qualitative nurse researchers successfully address language barriers between themselves and their participants when they systematically plan for how they will use interpreters and translators throughout the research process. Experienced qualitative researchers recognize that translators can generate qualitative data through translation processes and by participating in data analysis. Failure to address language barriers and the methodological challenges they present threatens the credibility, transferability, dependability and confirmability of cross-language qualitative nursing research. Through a synthesis of the cross-language qualitative methods literature, this article reviews the basics of language competence, translator and interpreter qualifications, and roles for each kind of qualitative research approach. Methodological and ethical considerations are also provided. By systematically addressing the methodological challenges cross-language research presents, nurse researchers can produce better evidence for nursing practice and policy making when working across different language groups. Findings from qualitative studies will also accurately represent the experiences of the participants without concern that the meaning was lost in translation.

Language barriers and qualitative nursing research: methodological considerations

PubMed Central

Squires, A.

2009-01-01

Aim This review of the literature synthesizes methodological recommendations for the use of translators and interpreters in cross-language qualitative research. Background Cross-language qualitative research involves the use of interpreters and translators to mediate a language barrier between researchers and participants. Qualitative nurse researchers successfully address language barriers between themselves and their participants when they systematically plan for how they will use interpreters and translators throughout the research process. Experienced qualitative researchers recognize that translators can generate qualitative data through translation processes and by participating in data analysis. Failure to address language barriers and the methodological challenges they present threatens the credibility, transferability, dependability and confirmability of cross-language qualitative nursing research. Through a synthesis of the cross-language qualitative methods literature, this article reviews the basics of language competence, translator and interpreter qualifications, and roles for each kind of qualitative research approach. Methodological and ethical considerations are also provided. Conclusion By systematically addressing the methodological challenges cross-language research presents, nurse researchers can produce better evidence for nursing practice and policy making when working across different language groups. Findings from qualitative studies will also accurately represent the experiences of the participants without concern that the meaning was lost in translation. PMID:19522941

76 FR 32971 - Proposed Priority for the Disability and Rehabilitation Research Projects and Centers Program

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-07

... and systematic search of the research literature on a topic for relevant studies, which are then evaluated using pre-determined, objective criteria for relevance and methodological rigor. In a systematic review, the evidence from relevant studies that meet the pre-determined criteria is then analyzed and...

A protocol for a systematic review of non-randomised evaluations of strategies to improve participant recruitment to randomised controlled trials.

PubMed

Gardner, Heidi R; Fraser, Cynthia; MacLennan, Graeme; Treweek, Shaun

2016-08-02

Randomised controlled trials guard against selection bias and therefore offer the fairest way of evaluating healthcare interventions such as medicinal products, devices and services. Recruitment to trials can be extremely difficult, and poor recruitment can lead to extensions to both time and budget and may result in an underpowered study which does not satisfactorily answer the original research question. In the worst cases, a trial may be abandoned, causing huge waste. The evidence to support the choice of recruitment interventions is currently weak. Non-randomised evaluations of recruitment interventions are currently rejected on grounds of poor methodological quality, but systematic evaluation and assessment of this substantial body of work (using Grading of Recommendations Assessment, Development and Evaluation (GRADE) where possible) may provide useful information to support and inform the recruitment decisions of trialists and the research priorities of methodology researchers. The following databases will be searched for relevant studies: Cochrane Methodology Register, MEDLINE, EMBASE, CINAHL and PsycINFO. Any non-randomised study that includes a comparison of two or more interventions to improve recruitment to randomised controlled trials will be included. We will not apply any restrictions on publication date, language or journal. The primary outcome will be the number of individuals or centres recruited into a randomised controlled trial. The secondary outcome will be cost per recruit. Two reviewers will independently screen abstracts for eligible studies, and then, full texts of potentially relevant records will be reviewed. Disagreements will be resolved through discussion. The methodological quality of studies will be assessed using the Cochrane risk of bias tool for non-randomised studies, and the GRADE system will be used if studies are pooled. This review aims to summarise the evidence on methods used to improve recruitment to randomised controlled trials. Carrying out a systematic review including only data from non-randomised studies is a novel approach, and one which some may argue is futile. However, we believe that the systematic evaluation of what is likely to be a substantial amount of research activity is necessary, worthwhile, and will yield valuable results for the clinical trials community regardless of whether the outcomes find in favour of one or more interventions. Should the results of this review suggest that non-randomised evaluations do have something to offer trialists planning their recruitment strategies, the review may be combined in the future with the Cochrane review of randomised evaluations to produce a full review of recruitment strategies encompassing both randomised and non-randomised evaluation methods. PROSPERO CRD42016037718.

A Systematic Review of Brief Functional Analysis Methodology with Typically Developing Children

ERIC Educational Resources Information Center

Gardner, Andrew W.; Spencer, Trina D.; Boelter, Eric W.; DuBard, Melanie; Jennett, Heather K.

2012-01-01

Brief functional analysis (BFA) is an abbreviated assessment methodology derived from traditional extended functional analysis methods. BFAs are often conducted when time constraints in clinics, schools or homes are of concern. While BFAs have been used extensively to identify the function of problem behavior for children with disabilities, their…

Methodology for astronaut reconditioning research.

PubMed

Beard, David J; Cook, Jonathan A

2017-01-01

Space medicine offers some unique challenges, especially in terms of research methodology. A specific challenge for astronaut reconditioning involves identification of what aspects of terrestrial research methodology hold and which require modification. This paper reviews this area and presents appropriate solutions where possible. It is concluded that spaceflight rehabilitation research should remain question/problem driven and is broadly similar to the terrestrial equivalent on small populations, such as rare diseases and various sports. Astronauts and Medical Operations personnel should be involved at all levels to ensure feasibility of research protocols. There is room for creative and hybrid methodology but careful systematic observation is likely to be more achievable and fruitful than complex trial based comparisons. Multi-space agency collaboration will be critical to pool data from small groups of astronauts with the accepted use of standardised outcome measures across all agencies. Systematic reviews will be an essential component. Most limitations relate to the inherent small sample size available for human spaceflight research. Early adoption of a co-operative model for spaceflight rehabilitation research is therefore advised. Copyright © 2016 Elsevier Ltd. All rights reserved.

Methodological quality of systematic reviews analyzing the use of laser therapy in restorative dentistry.

PubMed

Salmos, Janaina; Gerbi, Marleny E M M; Braz, Rodivan; Andrade, Emanuel S S; Vasconcelos, Belmiro C E; Bessa-Nogueira, Ricardo V

2010-01-01

The purpose of this study was to identify systematic reviews (SRs) that compared laser with other dental restorative procedures and to evaluate their methodological quality. A search strategy was developed and implemented for MEDLINE, the Cochrane Library, LILACS, and the Brazilian Dentistry Bibliography (1966- 2007). Inclusion criteria were: the article had to be an SR (+/- meta-analysis); primary focus was the use of laser in restorative dentistry; published in English, Spanish, Portuguese, Italian, German. Two investigators independently selected and evaluated the SRs. The overview quality assessment questionnaire (OQAQ) was used to evaluate methodological quality, and the results were averaged. There were 145 references identified, of which seven were SRs that met the inclusion criteria (kappa=0.81). Of the SRs, 71.4% appraised lasers in dental caries diagnosis. The mean overall OQAQ score was 4.4 [95% confidence interval (CI) 2.4- 6.5]. Of the SRs, 57.1% had major flaws, scoring < or = 4. SR methodological quality is low; therefore, clinicians should critically appraise them prior to considering their recommendations to guide patient care.

Review of evaluation on ecological carrying capacity: The progress and trend of methodology

NASA Astrophysics Data System (ADS)

Wang, S. F.; Xu, Y.; Liu, T. J.; Ye, J. M.; Pan, B. L.; Chu, C.; Peng, Z. L.

2018-02-01

The ecological carrying capacity (ECC) has been regarded as an important reference to indicate the level of regional sustainable development since the very beginning of twenty-first century. By a brief review of the main progress in ECC evaluation methodologies in recent five years, this paper systematically discusses the features and differences of these methods and expounds the current states and future development trend of ECC methodology. The result shows that further exploration in terms of the dynamic, comprehensive and intelligent assessment technologies needs to be provided in order to form a unified and scientific ECC methodology system and to produce a reliable basis for environmental-economic decision-makings.

Challenges of Systematic Reviewing Integrative Health Care

PubMed Central

Coulter, Ian D.; Khorsan, Raheleh; Crawford, Cindy; Hsiao, An-Fu

2013-01-01

This article is based on an extensive review of integrative medicine (IM) and integrative health care (IHC). Since there is no general agreement of what constitutes IM/IHC, several major problems were identified that make the review of work in this field problematic. In applying the systematic review methodology, we found that many of those captured articles that used the term integrative medicine were in actuality referring to adjunctive, complementary, or supplemental medicine. The objective of this study was to apply a sensitivity analysis to demonstrate how the results of a systematic review of IM and IHC will differ according to what inclusion criteria is used based on the definition of IM/IHC. By analyzing 4 different scenarios, the authors show that, due to unclear usage of these terms, results vary dramatically, exposing an inconsistent literature base for this field. PMID:23843689

Celebrating methodological challenges and changes: reflecting on the emergence and importance of the role of qualitative evidence in Cochrane reviews

PubMed Central

2013-01-01

Cochrane systematic reviews have proven to be beneficial for decision making processes, both on a practitioner and a policy level, and there are current initiatives to extend the types of evidence used by them, including qualitative research. In this article we outline the major achievements of the Cochrane Qualitative and Implementation Methods Group. Although the Group has encountered numerous challenges in dealing with the evolution of qualitative evidence synthesis, both outside and within the Cochrane Collaboration, it has successfully responded to the challenges posed in terms of incorporating qualitative evidence in systematic reviews. The Methods Group will continue to advocate for more flexible and inclusive approaches to evidence synthesis in order to meet the exciting challenges and opportunities presented by mixed methods systematic reviews and reviews of complex interventions. PMID:24135194

Gaps in the evidence for prevention and treatment of maternal anaemia: a review of systematic reviews

PubMed Central

2012-01-01

Background Anaemia, in particular due to iron deficiency, is common in pregnancy with associated negative outcomes for mother and infant. However, there is evidence of significant variation in management. The objectives of this review of systematic reviews were to analyse and summarise the evidence base, identify gaps in the evidence and develop a research agenda for this important component of maternity care. Methods Multiple databases were searched, including MEDLINE, EMBASE and The Cochrane Library. All systematic reviews relating to interventions to prevent and treat anaemia in the antenatal and postnatal period were eligible. Two reviewers independently assessed data inclusion, extraction and quality of methodology. Results 27 reviews were included, all reporting on the prevention and treatment of anaemia in the antenatal (n = 24) and postnatal periods (n = 3). Using AMSTAR as the assessment tool for methodological quality, only 12 of the 27 were rated as high quality reviews. The greatest number of reviews covered antenatal nutritional supplementation for the prevention of anaemia (n = 19). Iron supplementation was the most extensively researched, but with ongoing uncertainty about optimal dose and regimen. Few identified reviews addressed anaemia management post-partum or correlations between laboratory and clinical outcomes, and no reviews reported on clinical symptoms of anaemia. Conclusions The review highlights evidence gaps including the management of anaemia in the postnatal period, screening for anaemia, and optimal interventions for treatment. Research priorities include developing standardised approaches to reporting of laboratory outcomes, and information on clinical outcomes relevant to the experiences of pregnant women. PMID:22727258

Definitions and methods of measuring and reporting on injurious falls in randomised controlled fall prevention trials: a systematic review

PubMed Central

2012-01-01

Background The standardisation of the assessment methodology and case definition represents a major precondition for the comparison of study results and the conduction of meta-analyses. International guidelines provide recommendations for the standardisation of falls methodology; however, injurious falls have not been targeted. The aim of the present article was to review systematically the range of case definitions and methods used to measure and report on injurious falls in randomised controlled trials (RCTs) on fall prevention. Methods An electronic literature search of selected comprehensive databases was performed to identify injurious falls definitions in published trials. Inclusion criteria were: RCTs on falls prevention published in English, study population ≥ 65 years, definition of injurious falls as a study endpoint by using the terms "injuries" and "falls". Results The search yielded 2089 articles, 2048 were excluded according to defined inclusion criteria. Forty-one articles were included. The systematic analysis of the methodology applied in RCTs disclosed substantial variations in the definition and methods used to measure and document injurious falls. The limited standardisation hampered comparability of study results. Our results also highlight that studies which used a similar, standardised definition of injurious falls showed comparable outcomes. Conclusions No standard for defining, measuring, and documenting injurious falls could be identified among published RCTs. A standardised injurious falls definition enhances the comparability of study results as demonstrated by a subgroup of RCTs used a similar definition. Recommendations for standardising the methodology are given in the present review. PMID:22510239

Methodology and reporting quality of reporting guidelines: systematic review.

PubMed

Wang, Xiaoqin; Chen, Yaolong; Yang, Nan; Deng, Wei; Wang, Qi; Li, Nan; Yao, Liang; Wei, Dang; Chen, Gen; Yang, Kehu

2015-09-22

With increasing attention put on the methodology of reporting guidelines, Moher et al. conducted a review of reporting guidelines up to December 2009. Information gaps appeared on many aspects. Therefore, in 2010, the Guidance for Developers of Health Research Reporting Guidelines was developed. With more than four years passed and a considerable investment was put into reporting guideline development, a large number of new, updated, and expanded reporting guidelines have become available since January 2010. We aimed to systematically review the reporting guidelines published since January 2010, and investigate the application of the Guidance. We systematically searched databases including the Cochrane Methodology Register, MEDLINE, and EMBASE, and retrieved EQUATOR and the website (if available) to find reporting guidelines as well as their accompanying documents. We screened the titles and abstracts resulting from searches and extracted data. We focused on the methodology and reporting of the included guidelines, and described information with a series of tables and narrative summaries. Data were summarized descriptively using frequencies, proportions, and medians as appropriate. Twenty-eight and 32 reporting guidelines were retrieved from databases and EQUATOR network, respectively. Reporting guidelines were designed for a broad spectrum of types of research. A considerable number of reporting guidelines were published and updated in recent years. Methods of initial items were given in 45 (75%) guidelines. Thirty-eight (63%) guidelines reported they have reached consensus, and 35 (58%) described their consensus methods. Only 9 (15%) guidelines followed the Guidance. Only few guidelines were developed complying with the Guidance. More attention should be paid to the quality of reporting guidelines.

The association between head and cervical posture and temporomandibular disorders: a systematic review.

PubMed

Olivo, Susan Armijo; Bravo, Jaime; Magee, David J; Thie, Norman M R; Major, Paul W; Flores-Mir, Carlos

2006-01-01

To carry out a systematic review to assess the evidence concerning the association between head and cervical posture and temporomandibular disorders (TMD). A search of Medline, Pubmed, Embase, Web of Science, Lilacs, and Cochrane Library databases was conducted in all languages with the help of a health sciences librarian. Key words used in the search were posture, head posture, cervical spine or neck, vertebrae, cervical lordosis, craniomandibular disorders or temporomandibular disorders, temporomandibular disorders, and orofacial pain or facial pain. Abstracts which appeared to fulfill the initial selection criteria were selected by consensus. The original articles were retrieved and evaluated to ensure they met the inclusion criteria. A methodological checklist was used to evaluate the quality of the selected articles and their references were hand-searched for possible missing articles. Twelve studies met all inclusion criteria and were analyzed in detail for their methodology and information quality. Nine articles that analyzed the association between head posture and TMD included patients with mixed TMD diagnosis; 1 article differentiated among muscular, articular, and mixed symptomatology; and 3 articles analyzed information from patients with only articular problems. Finally, 2 studies evaluated the association between head posture and TMD in patients with muscular TMD. Several methodological defects were noted in the 12 studies. Since most of the studies included in this systematic review were of poor methodological quality, the findings of the studies should be interpreted with caution. The association between intra-articular and muscular TMD and head and cervical posture is still unclear, and better controlled studies with comprehensive TMD diagnoses, greater sample sizes, and objective posture evaluation are necessary.

Simulation modeling for stratified breast cancer screening - a systematic review of cost and quality of life assumptions.

PubMed

Arnold, Matthias

2017-12-02

The economic evaluation of stratified breast cancer screening gains momentum, but produces also very diverse results. Systematic reviews so far focused on modeling techniques and epidemiologic assumptions. However, cost and utility parameters received only little attention. This systematic review assesses simulation models for stratified breast cancer screening based on their cost and utility parameters in each phase of breast cancer screening and care. A literature review was conducted to compare economic evaluations with simulation models of personalized breast cancer screening. Study quality was assessed using reporting guidelines. Cost and utility inputs were extracted, standardized and structured using a care delivery framework. Studies were then clustered according to their study aim and parameters were compared within the clusters. Eighteen studies were identified within three study clusters. Reporting quality was very diverse in all three clusters. Only two studies in cluster 1, four studies in cluster 2 and one study in cluster 3 scored high in the quality appraisal. In addition to the quality appraisal, this review assessed if the simulation models were consistent in integrating all relevant phases of care, if utility parameters were consistent and methodological sound and if cost were compatible and consistent in the actual parameters used for screening, diagnostic work up and treatment. Of 18 studies, only three studies did not show signs of potential bias. This systematic review shows that a closer look into the cost and utility parameter can help to identify potential bias. Future simulation models should focus on integrating all relevant phases of care, using methodologically sound utility parameters and avoiding inconsistent cost parameters.

A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews.

PubMed

Pluye, Pierre; Gagnon, Marie-Pierre; Griffiths, Frances; Johnson-Lafleur, Janique

2009-04-01

A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies. To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components. A three-step critical review was conducted. 2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic. Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs). Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality. A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.

Overview of Systematic Reviews: Yoga as a Therapeutic Intervention for Adults with Acute and Chronic Health Conditions

PubMed Central

McCall, Marcy C.; Ward, Alison; Roberts, Nia W.; Heneghan, Carl

2013-01-01

Objectives. Overview the quality, direction, and characteristics of yoga interventions for treatment of acute and chronic health conditions in adult populations. Methods. We searched for systematic reviews in 10 online databases, bibliographic references, and hand-searches in yoga-related journals. Included reviews satisfy Oxman criteria and specify yoga as a primary intervention in one or more randomized controlled trials for treatment in adults. The AMSTAR tool and GRADE approach evaluated the methodological quality of reviews and quality of evidence. Results. We identified 2202 titles, of which 41 full-text articles were assessed for eligibility and 26 systematic reviews satisfied inclusion criteria. Thirteen systematic reviews include quantitative data and six papers include meta-analysis. The quality of evidence is generally low. Sixteen different types of health conditions are included. Eleven reviews show tendency towards positive effects of yoga intervention, 15 reviews report unclear results, and no, reviews report adverse effects of yoga. Yoga appears most effective for reducing symptoms in anxiety, depression, and pain. Conclusion. Although the quality of systematic reviews is high, the quality of supporting evidence is low. Significant heterogeneity and variability in reporting interventions by type of yoga, settings, and population characteristics limit the generalizability of results. PMID:23762174

Aromatherapy for managing menopausal symptoms

PubMed Central

Choi, Jiae; Lee, Hye Won; Lee, Ju Ah; Lim, Hyun-Ja; Lee, Myeong Soo

2018-01-01

Abstract Background: Aromatherapy is often used as a complementary therapy for women's health. This systematic review aims to evaluate the therapeutic effects of aromatherapy as a management for menopausal symptoms. Methods: Eleven electronic databases will be searched from inception to February 2018. Randomized controlled trials that evaluated any type of aromatherapy against any type of control in individuals with menopausal symptoms will be eligible. The methodological quality will be assessed using the Cochrane risk of bias tool. Two authors will independently assess each study for eligibility and risk of bias and to extract data. Results: This study will provide a high quality synthesis of current evidence of aromatherapy for menopausal symptoms measured with Menopause Rating Scale, the Kupperman Index, the Greene Climacteric Scale, or other validated questionnaires. Conclusions: The conclusion of our systematic review will provide evidence to judge whether aromatherapy is an effective intervention for patient with menopausal women. Ethics and dissemination: Ethical approval will not be required, given that this protocol is for a systematic review. The systematic review will be published in a peer-reviewed journal. The review will also be disseminated electronically and in print. Systematic review registration: PROSPERO CRD42017079191. PMID:29419673

Antimicrobial Photodynamic Therapy and Dental Plaque: A Systematic Review of the Literature

PubMed Central

Santin, G. C.; Oliveira, D. S. B.; Galo, R.; Borsatto, M. C.; Corona, S. A. M.

2014-01-01

Background. The aim of this study was to perform a systematic review of the literature on the efficacy of antimicrobial photodynamic therapy (PDTa) on cariogenic dental biofilm. Types of Studies Reviewed. Studies in vivo, in vitro, and in situ were included. Articles that did not address PDTa, those that did not involve cariogenic biofilm, those that used microorganisms in the plankton phase, and reviews were excluded. Data extraction and quality assessments were performed independently by two raters using a scale. Results. Two hundred forty articles were retrieved; only seventeen of them met the eligibility criteria and were analyzed in the present review. Considerable variability was found regarding the methodologies and application protocols for antimicrobial PDTa. Two articles reported unfavorable results. Practical Implications. The present systematic review does not allow drawing any concrete conclusions regarding the efficacy of antimicrobial PDTa, although this method seems to be a promising option. PMID:25379545

Methodology Series Module 6: Systematic Reviews and Meta-analysis

PubMed Central

Setia, Maninder Singh

2016-01-01

Systematic reviews and meta-analysis have become an important of biomedical literature, and they provide the “highest level of evidence” for various clinical questions. There are a lot of studies – sometimes with contradictory conclusions – on a particular topic in literature. Hence, as a clinician, which results will you believe? What will you tell your patient? Which drug is better? A systematic review or a meta-analysis may help us answer these questions. In addition, it may also help us understand the quality of the articles in literature or the type of studies that have been conducted and published (example, randomized trials or observational studies). The first step it to identify a research question for systematic review or meta-analysis. The next step is to identify the articles that will be included in the study. This will be done by searching various databases; it is important that the researcher should search for articles in more than one database. It will also be useful to form a group of researchers and statisticians that have expertise in conducting systematic reviews and meta-analysis before initiating them. We strongly encourage the readers to register their proposed review/meta-analysis with PROSPERO. Finally, these studies should be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analysis checklist. PMID:27904176

Methodology Series Module 6: Systematic Reviews and Meta-analysis.

PubMed

Setia, Maninder Singh

2016-01-01

Systematic reviews and meta-analysis have become an important of biomedical literature, and they provide the "highest level of evidence" for various clinical questions. There are a lot of studies - sometimes with contradictory conclusions - on a particular topic in literature. Hence, as a clinician, which results will you believe? What will you tell your patient? Which drug is better? A systematic review or a meta-analysis may help us answer these questions. In addition, it may also help us understand the quality of the articles in literature or the type of studies that have been conducted and published (example, randomized trials or observational studies). The first step it to identify a research question for systematic review or meta-analysis. The next step is to identify the articles that will be included in the study. This will be done by searching various databases; it is important that the researcher should search for articles in more than one database. It will also be useful to form a group of researchers and statisticians that have expertise in conducting systematic reviews and meta-analysis before initiating them. We strongly encourage the readers to register their proposed review/meta-analysis with PROSPERO. Finally, these studies should be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analysis checklist.

Qualitative systematic reviews: their importance for our understanding of research relevant to pain.

PubMed

Seers, Kate

2015-02-01

This article outlines what a qualitative systematic review is and explores what it can contribute to our understanding of pain. Many of us use evidence of effectiveness for various interventions when working with people in pain. A good systematic review can be invaluable in bringing together research evidence to help inform our practice and help us understand what works. In addition to evidence of effectiveness, understanding how people with pain experience both their pain and their care can help us when we are working with them to provide care that meets their needs. A rigorous qualitative systematic review can also uncover new understandings, often helping illuminate 'why' and can help build theory. Such a review can answer the question 'What is it like to have chronic pain?' This article presents the different stages of meta-ethnography, which is the most common methodology used for qualitative systematic reviews. It presents evidence from four meta-ethnographies relevant to pain to illustrate the types of findings that can emerge from this approach. It shows how new understandings may emerge and gives an example of chronic musculoskeletal pain being experienced as 'an adversarial struggle' across many aspects of the person's life. This article concludes that evidence from qualitative systematic reviews has its place alongside or integrated with evidence from more quantitative approaches.

Methodological quality of behavioural weight loss studies: a systematic review

PubMed Central

Lemon, S. C.; Wang, M. L.; Haughton, C. F.; Estabrook, D. P.; Frisard, C. F.; Pagoto, S. L.

2018-01-01

Summary This systematic review assessed the methodological quality of behavioural weight loss intervention studies conducted among adults and associations between quality and statistically significant weight loss outcome, strength of intervention effectiveness and sample size. Searches for trials published between January, 2009 and December, 2014 were conducted using PUBMED, MEDLINE and PSYCINFO and identified ninety studies. Methodological quality indicators included study design, anthropometric measurement approach, sample size calculations, intent-to-treat (ITT) analysis, loss to follow-up rate, missing data strategy, sampling strategy, report of treatment receipt and report of intervention fidelity (mean = 6.3). Indicators most commonly utilized included randomized design (100%), objectively measured anthropometrics (96.7%), ITT analysis (86.7%) and reporting treatment adherence (76.7%). Most studies (62.2%) had a follow-up rate >75% and reported a loss to follow-up analytic strategy or minimal missing data (69.9%). Describing intervention fidelity (34.4%) and sampling from a known population (41.1%) were least common. Methodological quality was not associated with reporting a statistically significant result, effect size or sample size. This review found the published literature of behavioural weight loss trials to be of high quality for specific indicators, including study design and measurement. Identified for improvement include utilization of more rigorous statistical approaches to loss to follow up and better fidelity reporting. PMID:27071775

Synthesis of qualitative linguistic research--a pilot review integrating and generalizing findings on doctor-patient interaction.

PubMed

Nowak, Peter

2011-03-01

There is a broad range qualitative linguistic research (sequential analysis) on doctor-patient interaction that had only a marginal impact on clinical research and practice. At least in parts this is due to the lack of qualitative research synthesis in the field. Available research summaries are not systematic in their methodology. This paper proposes a synthesis methodology for qualitative, sequential analytic research on doctor-patient interaction. The presented methodology is not new but specifies standard methodology of qualitative research synthesis for sequential analytic research. This pilot review synthesizes twelve studies on German-speaking doctor-patient interactions, identifies 45 verbal actions of doctors and structures them in a systematics of eight interaction components. Three interaction components ("Listening", "Asking for information", and "Giving information") seem to be central and cover two thirds of the identified action types. This pilot review demonstrates that sequential analytic research can be synthesized in a consistent and meaningful way, thus providing a more comprehensive and unbiased integration of research. Future synthesis of qualitative research in the area of health communication research is very much needed. Qualitative research synthesis can support the development of quantitative research and of educational materials in medical training and patient training. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Validity and reliability of Internet-based physiotherapy assessment for musculoskeletal disorders: a systematic review.

PubMed

Mani, Suresh; Sharma, Shobha; Omar, Baharudin; Paungmali, Aatit; Joseph, Leonard

2017-04-01

Purpose The purpose of this review is to systematically explore and summarise the validity and reliability of telerehabilitation (TR)-based physiotherapy assessment for musculoskeletal disorders. Method A comprehensive systematic literature review was conducted using a number of electronic databases: PubMed, EMBASE, PsycINFO, Cochrane Library and CINAHL, published between January 2000 and May 2015. The studies examined the validity, inter- and intra-rater reliabilities of TR-based physiotherapy assessment for musculoskeletal conditions were included. Two independent reviewers used the Quality Appraisal Tool for studies of diagnostic Reliability (QAREL) and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool to assess the methodological quality of reliability and validity studies respectively. Results A total of 898 hits were achieved, of which 11 articles based on inclusion criteria were reviewed. Nine studies explored the concurrent validity, inter- and intra-rater reliabilities, while two studies examined only the concurrent validity. Reviewed studies were moderate to good in methodological quality. The physiotherapy assessments such as pain, swelling, range of motion, muscle strength, balance, gait and functional assessment demonstrated good concurrent validity. However, the reported concurrent validity of lumbar spine posture, special orthopaedic tests, neurodynamic tests and scar assessments ranged from low to moderate. Conclusion TR-based physiotherapy assessment was technically feasible with overall good concurrent validity and excellent reliability, except for lumbar spine posture, orthopaedic special tests, neurodynamic testa and scar assessment.

Re-examining the Evidence in Radiation Dermatitis Management Literature: An Overview and a Critical Appraisal of Systematic Reviews

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chan, Raymond Javan, E-mail: email.rchan@gmail.com; School of Nursing and Midwifery, University of Queensland, and Research Centre for Clinical and Community Practice Innovation, Griffith University; Larsen, Emily

2012-11-01

Purpose: To provide an overview and a critical appraisal of systematic reviews (SRs) of published interventions for the prevention/management of radiation dermatitis. Methods and Materials: We searched Medline, CINAHL, Embase, and the Cochrane Library. We also manually searched through individual reference lists of potentially eligible articles and a number of key journals in the topic area. Two authors screened all potential articles and included eligible SRs. Two authors critically appraised and extracted key findings from the included reviews using AMSTAR (the measurement tool for 'assessment of multiple systematic reviews'). Results: Of 1837 potential titles, 6 SRs were included. A numbermore » of interventions have been reported to be potentially beneficial for managing radiation dermatitis. Interventions evaluated in these reviews included skin care advice, steroidal/nonsteroidal topical agents, systemic therapies, modes of radiation delivery, and dressings. However, all the included SRs reported that there is insufficient evidence supporting any single effective intervention. The methodological quality of the included studies varied, and methodological shortfalls in these reviews might create biases to the overall results or recommendations for clinical practice. Conclusions: An up-to-date high-quality SR in the prevention/management of radiation dermatitis is needed to guide practice and direction for future research. We recommend that clinicians or guideline developers critically evaluate the information of SRs in their decision making.« less

Tackling the wider social determinants of health and health inequalities: evidence from systematic reviews

PubMed Central

Gibson, M; Sowden, A; Wright, K; Whitehead, M; Petticrew, M

2010-01-01

Background There is increasing pressure to tackle the wider social determinants of health through the implementation of appropriate interventions. However, turning these demands for better evidence about interventions around the social determinants of health into action requires identifying what we already know and highlighting areas for further development. Methods Systematic review methodology was used to identify systematic reviews (from 2000 to 2007, developed countries only) that described the health effects of any intervention based on the wider social determinants of health: water and sanitation, agriculture and food, access to health and social care services, unemployment and welfare, working conditions, housing and living environment, education, and transport. Results Thirty systematic reviews were identified. Generally, the effects of interventions on health inequalities were unclear. However, there is suggestive systematic review evidence that certain categories of intervention may impact positively on inequalities or on the health of specific disadvantaged groups, particularly interventions in the fields of housing and the work environment. Conclusion Intervention studies that address inequalities in health are a priority area for future public health research. PMID:19692738

Methodological and ethical challenges in studying patients’ perceptions of coercion: a systematic mixed studies review

PubMed Central

2014-01-01

Background Despite improvements in psychiatric inpatient care, patient restrictions in psychiatric hospitals are still in use. Studying perceptions among patients who have been secluded or physically restrained during their hospital stay is challenging. We sought to review the methodological and ethical challenges in qualitative and quantitative studies aiming to describe patients’ perceptions of coercive measures, especially seclusion and physical restraints during their hospital stay. Methods Systematic mixed studies review was the study method. Studies reporting patients’ perceptions of coercive measures, especially seclusion and physical restraints during hospital stay were included. Methodological issues such as study design, data collection and recruitment process, participants, sampling, patient refusal or non-participation, and ethical issues such as informed consent process, and approval were synthesized systematically. Electronic searches of CINALH, MEDLINE, PsychINFO and The Cochrane Library (1976-2012) were carried out. Results Out of 846 initial citations, 32 studies were included, 14 qualitative and 18 quantitative studies. A variety of methodological approaches were used, although descriptive and explorative designs were used in most cases. Data were mainly collected in qualitative studies by interviews (n = 13) or in quantitative studies by self-report questionnaires (n = 12). The recruitment process was explained in 59% (n = 19) of the studies. In most cases convenience sampling was used, yet five studies used randomization. Patient’s refusal or non-participation was reported in 37% (n = 11) of studies. Of all studies, 56% (n = 18) had reported undergone an ethical review process in an official board or committee. Respondents were informed and consent was requested in 69% studies (n = 22). Conclusions The use of different study designs made comparison methodologically challenging. The timing of data collection (considering bias and confounding factors) and the reasons for non-participation of eligible participants are likewise methodological challenges, e.g. recommended flow charts could aid the information. Other challenges identified were the recruitment of large and representative samples. Ethical challenges included requesting participants’ informed consent and respecting ethical procedures. PMID:24894162

Evidence- and consensus-based (S3) Guidelines for the Treatment of Actinic Keratosis - International League of Dermatological Societies in cooperation with the European Dermatology Forum - Short version.

PubMed

Werner, R N; Stockfleth, E; Connolly, S M; Correia, O; Erdmann, R; Foley, P; Gupta, A K; Jacobs, A; Kerl, H; Lim, H W; Martin, G; Paquet, M; Pariser, D M; Rosumeck, S; Röwert-Huber, H-J; Sahota, A; Sangueza, O P; Shumack, S; Sporbeck, B; Swanson, N A; Torezan, L; Nast, A

2015-11-01

Actinic keratosis (AK) is a frequent health condition attributable to chronic exposure to ultraviolet radiation. Several treatment options are available and evidence based guidelines are missing. The goal of these evidence- and consensus-based guidelines was the development of treatment recommendations appropriate for different subgroups of patients presenting with AK. A secondary aim of these guidelines was the implementation of knowledge relating to the clinical background of AK, including consensus-based recommendations for the histopathological definition, diagnosis and the assessment of patients. The guidelines development followed a pre-defined and structured process. For the underlying systematic literature review of interventions for AK, the methodology suggested by the Cochrane Handbook for Systematic Reviews of Interventions, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement and Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology was adapted. All recommendations were consented during a consensus conference using a formal consensus methodology. Strength of recommendations was expressed based on the GRADE approach. If expert opinion without external evidence was incorporated into the reasoning for making a certain recommendation, the rationale was provided. The Guidelines underwent open public review and approval by the commissioning societies. Various interventions for the treatment of AK have been assessed for their efficacy. The consenting procedure led to a treatment algorithm as shown in the guidelines document. Based on expert consensus, the present guidelines present recommendations on the classification of patients, diagnosis and histopathological definition of AK. Details on the methods and results of the systematic literature review and guideline development process have been published separately. International guidelines are intended to be adapted to national or regional circumstances (regulatory approval, availability and reimbursement of treatments). © 2015 European Academy of Dermatology and Venereology.

Pregnancy outcome and ultraviolet radiation; A systematic review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Megaw, Lauren, E-mail: lauren.megaw@ed.ac.uk

Background: Season and vitamin D are indirect and direct correlates of ultraviolet (UV) radiation and are associated with pregnancy outcomes. Further to producing vitamin D, UV has positive effects on cardiovascular and immune health that may support a role for UV directly benefitting pregnancy. Objectives: To investigate the effects of UV exposure on pregnancy; specifically fetal growth, preterm birth and hypertensive complications. Methods: We conducted a systematic review of Medline, EMBASE, DoPHER, Global Health, ProQuest Public Health, AustHealth Informit, SCOPUS and Google Scholar to identify 537 citations, 8 of which are included in this review. This review was registered onmore » PROSPERO and a. narrative synthesis is presented following PRISMA guidance. Results: All studies were observational and assessed at high risk of bias. Higher first trimester UV was associated with and improved fetal growth and increased hypertension in pregnancy. Interpretation is limited by study design and quality. Meta-analysis was precluded by the variety of outcomes and methods. Discussion: The low number of studies and risk of bias limit the validity of any conclusions. Environmental health methodological issues are discussed with consideration given to design and analytical improvements to further address this reproductive environmental health question. Conclusions: The evidence for UV having benefits for pregnancy hypertension and fetal growth is limited by the methodological approaches utilized. Future epidemiological efforts should focus on improving the methods of modeling and linking widely available environmental data to reproductive health outcomes. - Highlights: • Biologically plausible pathways support an association between ultraviolet radiation (UV) and pregnancy outcomes. • This study is the first systematic review of prevailing literature on the relationship between UV and singleton pregnancy outcomes. • It focuses on both substantive findings and the methodologies that were used. • Only seven studies met the search criteria and these were methodologically heterogeneous demonstrating a paucity of evidence. • Given the plausibility of the UV pathway, more studies examining this hypothesis are needed.« less

Twenty years of meta-analyses in orthopaedic surgery: has quality kept up with quantity?

PubMed

Dijkman, Bernadette G; Abouali, Jihad A K; Kooistra, Bauke W; Conter, Henry J; Poolman, Rudolf W; Kulkarni, Abhaya V; Tornetta, Paul; Bhandari, Mohit

2010-01-01

As the number of studies in the literature is increasing, orthopaedic surgeons highly depend on meta-analyses as their primary source of scientific evidence. The objectives of this review were to assess the scientific quality and number of published meta-analyses on orthopaedics-related topics over time. We conducted, in duplicate and independently, a systematic review of published meta-analyses in orthopaedics in the years 2005 and 2008 and compared them with a previous systematic review of meta-analyses from 1969 to 1999. A search of electronic databases (MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews) was performed to identify meta-analyses published in 2005 and 2008. We searched bibliographies and contacted content experts to identify additional relevant studies. Two investigators independently assessed the quality of the studies, using the Oxman and Guyatt index, and abstracted relevant data. We included forty-five and forty-four meta-analyses from 2005 and 2008, respectively. While the number of meta-analyses increased fivefold from 1999 to 2008, the mean quality score did not change significantly over time (p = 0.067). In the later years, a significantly lower proportion of meta-analyses had methodological flaws (56% in 2005 and 68% in 2008) compared with meta-analyses published prior to 2000 (88%) (p = 0.006). In 2005 and 2008, respectively, 18% and 30% of the meta-analyses had major to extensive flaws in their methodology. Studies from 2008 with positive conclusions used and described appropriate criteria for the validity assessment less often than did those with negative results. The use of random-effects and fixed-effects models as pooling methods became more popular toward 2008. Although the methodological quality of orthopaedic meta-analyses has increased in the past twenty years, a substantial proportion continues to show major to extensive flaws. As the number of published meta-analyses is increasing, a routine checklist for scientific quality should be used in the peer-review process to ensure methodological standards for publication.

Training practitioners in preparing systematic reviews: a cross-sectional survey of participants in the Australasian Cochrane Centre training program

PubMed Central

Piehl, Janet H; Green, Sally; Silagy, Chris

2002-01-01

Background Although systematic reviews of health care interventions are an invaluable tool for health care providers and researchers, many potential authors never publish reviews. This study attempts to determine why some people with interest in performing systematic reviews do not subsequently publish a review; and what steps could possibly increase review completion. Methods Cross-sectional survey by email and facsimile of the 179 participants in Australasian Cochrane Centre training events between 1998 and 2000. Results Ninety-two participants responded to the survey (51 percent). Response rate of deliverable surveys was 82 percent (92/112). The remainder of the participants had invalid or no contact information on file. More than 75 percent of respondents felt that the current workshops met their needs for training. The most critical barriers to completion of a Cochrane review were: lack of time (80 percent), lack of financial support (36 percent), methodological problems (23 percent) and problems with group dynamics (10 percent). Conclusions Strategies to protect reviewer time and increase the efficiency of the review process may increase the numbers of trained reviewers completing a systematic review. PMID:12057022

Case-Crossover Analysis of Air Pollution Health Effects: A Systematic Review of Methodology and Application

PubMed Central

Carracedo-Martínez, Eduardo; Taracido, Margarita; Tobias, Aurelio; Saez, Marc; Figueiras, Adolfo

2010-01-01

Background Case-crossover is one of the most used designs for analyzing the health-related effects of air pollution. Nevertheless, no one has reviewed its application and methodology in this context. Objective We conducted a systematic review of case-crossover (CCO) designs used to study the relationship between air pollution and morbidity and mortality, from the standpoint of methodology and application. Data sources and extraction A search was made of the MEDLINE and EMBASE databases. Reports were classified as methodologic or applied. From the latter, the following information was extracted: author, study location, year, type of population (general or patients), dependent variable(s), independent variable(s), type of CCO design, and whether effect modification was analyzed for variables at the individual level. Data synthesis The review covered 105 reports that fulfilled the inclusion criteria. Of these, 24 addressed methodological aspects, and the remainder involved the design’s application. In the methodological reports, the designs that yielded the best results in simulation were symmetric bidirectional CCO and time-stratified CCO. Furthermore, we observed an increase across time in the use of certain CCO designs, mainly symmetric bidirectional and time-stratified CCO. The dependent variables most frequently analyzed were those relating to hospital morbidity; the pollutants most often studied were those linked to particulate matter. Among the CCO-application reports, 13.6% studied effect modification for variables at the individual level. Conclusions The use of CCO designs has undergone considerable growth; the most widely used designs were those that yielded better results in simulation studies: symmetric bidirectional and time-stratified CCO. However, the advantages of CCO as a method of analysis of variables at the individual level are put to little use. PMID:20356818

A Practical Guide to Conducting a Systematic Review and Meta-analysis of Health State Utility Values.

PubMed

Petrou, Stavros; Kwon, Joseph; Madan, Jason

2018-05-10

Economic analysts are increasingly likely to rely on systematic reviews and meta-analyses of health state utility values to inform the parameter inputs of decision-analytic modelling-based economic evaluations. Beyond the context of economic evaluation, evidence from systematic reviews and meta-analyses of health state utility values can be used to inform broader health policy decisions. This paper provides practical guidance on how to conduct a systematic review and meta-analysis of health state utility values. The paper outlines a number of stages in conducting a systematic review, including identifying the appropriate evidence, study selection, data extraction and presentation, and quality and relevance assessment. The paper outlines three broad approaches that can be used to synthesise multiple estimates of health utilities for a given health state or condition, namely fixed-effect meta-analysis, random-effects meta-analysis and mixed-effects meta-regression. Each approach is illustrated by a synthesis of utility values for a hypothetical decision problem, and software code is provided. The paper highlights a number of methodological issues pertinent to the conduct of meta-analysis or meta-regression. These include the importance of limiting synthesis to 'comparable' utility estimates, for example those derived using common utility measurement approaches and sources of valuation; the effects of reliance on limited or poorly reported published data from primary utility assessment studies; the use of aggregate outcomes within analyses; approaches to generating measures of uncertainty; handling of median utility values; challenges surrounding the disentanglement of utility estimates collected serially within the context of prospective observational studies or prospective randomised trials; challenges surrounding the disentanglement of intervention effects; and approaches to measuring model validity. Areas of methodological debate and avenues for future research are highlighted.

The Efficacy of Eye Movement Desensitization and Reprocessing in Children and Adults Who Have Experienced Complex Childhood Trauma: A Systematic Review of Randomized Controlled Trials.

PubMed

Chen, Runsen; Gillespie, Amy; Zhao, Yanhui; Xi, Yingjun; Ren, Yanping; McLean, Loyola

2018-01-01

Background: Survivors of complex childhood trauma (CT) such as sexual abuse show poorer outcomes compared to single event trauma survivors. A growing number of studies investigate Eye Movement Desensitization and Reprocessing (EMDR) treatment for posttraumatic stress disorder (PTSD), but no systematic reviews have focused on EMDR treatment for CT as an intervention for both adults and children. This study therefore systematically reviewed all randomized controlled trials (RCTs) evaluating the effect of EMDR on PTSD symptoms in adults and children exposed to CT. Methods: Databases including PubMed, Web of Science, and PsycINFO were searched in October 2017. Randomized controlled trials which recruited adult and children with experience of CT, which compared EMDR to alternative treatments or control conditions, and which measured PTSD symptoms were included. Study methodology quality was evaluated with Platinum Standard scale. Results: Six eligible RCTs of 251 participants were included in this systematic review. The results indicated that EMDR was associated with reductions in PTSD symptoms, depression and/or anxiety both post-treatment and at follow-up compared with all other alternative therapies (cognitive behavior therapy, individual/group therapy and fluoxetine) and control treatment (pill placebo, active listening, EMDR delayed treatment, and treatment as usual). However, studies suffered from significant heterogeneity in study populations, length of EMDR treatment, length of follow-up, comparison groups, and outcome measures. One study had a high risk of bias. Discussion: This systematic review suggests that there is growing evidence to support the clinical efficacy of EMDR in treating CT in both children and adults. However, conclusions are limited by the small number of heterogenous trials. Further RCTs with standardized methodologies, as well as studies addressing real world challenges in treating CT are required.

The Efficacy of Eye Movement Desensitization and Reprocessing in Children and Adults Who Have Experienced Complex Childhood Trauma: A Systematic Review of Randomized Controlled Trials

PubMed Central

Chen, Runsen; Gillespie, Amy; Zhao, Yanhui; Xi, Yingjun; Ren, Yanping; McLean, Loyola

2018-01-01

Background: Survivors of complex childhood trauma (CT) such as sexual abuse show poorer outcomes compared to single event trauma survivors. A growing number of studies investigate Eye Movement Desensitization and Reprocessing (EMDR) treatment for posttraumatic stress disorder (PTSD), but no systematic reviews have focused on EMDR treatment for CT as an intervention for both adults and children. This study therefore systematically reviewed all randomized controlled trials (RCTs) evaluating the effect of EMDR on PTSD symptoms in adults and children exposed to CT. Methods: Databases including PubMed, Web of Science, and PsycINFO were searched in October 2017. Randomized controlled trials which recruited adult and children with experience of CT, which compared EMDR to alternative treatments or control conditions, and which measured PTSD symptoms were included. Study methodology quality was evaluated with Platinum Standard scale. Results: Six eligible RCTs of 251 participants were included in this systematic review. The results indicated that EMDR was associated with reductions in PTSD symptoms, depression and/or anxiety both post-treatment and at follow-up compared with all other alternative therapies (cognitive behavior therapy, individual/group therapy and fluoxetine) and control treatment (pill placebo, active listening, EMDR delayed treatment, and treatment as usual). However, studies suffered from significant heterogeneity in study populations, length of EMDR treatment, length of follow-up, comparison groups, and outcome measures. One study had a high risk of bias. Discussion: This systematic review suggests that there is growing evidence to support the clinical efficacy of EMDR in treating CT in both children and adults. However, conclusions are limited by the small number of heterogenous trials. Further RCTs with standardized methodologies, as well as studies addressing real world challenges in treating CT are required. PMID:29695993

Infantile colic: a systematic review of medical and conventional therapies.

PubMed

Hall, Belinda; Chesters, Janice; Robinson, Anske

2012-02-01

Infantile colic is a prevalent and distressing condition for which there is no proven standard therapy. The aim of this paper is to review medical and conventional treatments for infantile colic. A systematic literature review was undertaken of studies on medical and conventional interventions for infantile colic from 1980 to March 2009. The results and methodological rigour of included studies were analysed using the CONSORT (Consolidated Standards Of Reporting Trials) 2001 statement checklist and Centre for Evidence Based Medicine critical appraisal tools. Nineteen studies and two literature reviews were included for review. Pharmacological studies on Simethicone gave conflicting results and with Dicyclomine hydrochloride and Cimetropium bromide results were favourable but side effects were noted along with issues in study methodology. Some nutritional studies reported favourable results for the use of hydrolysed formulas in bottle-fed infants or low-allergen maternal diets in breastfed infants but not for the use of additional fibre or lactase. There were several issues in regards to methodological rigour. Behavioural studies on the use of increased stimulation gave unfavourable results, whereas results from the use of decreased stimulation and contingent music were favourable. These studies demonstrated poor methodological rigour. There is some scientific evidence to support the use of a casein hydrolysate formula in formula-fed infants or a low-allergen maternal diet in breastfed infants with infantile colic. However, there is little scientific evidence to support the use of Simethicone, Dicyclomine hydrochloride, Cimetropium bromide, lactase, additional fibre or behavioural interventions. Further research of good methodological quality on low-allergenic formulas and maternal diets is indicated. © 2011 The Authors. Journal of Paediatrics and Child Health © 2011 Paediatrics and Child Health Division (Royal Australasian College of Physicians).

Interventions for Age-Related Macular Degeneration: Are Practice Guidelines Based on Systematic Reviews?

PubMed

Lindsley, Kristina; Li, Tianjing; Ssemanda, Elizabeth; Virgili, Gianni; Dickersin, Kay

2016-04-01

Are existing systematic reviews of interventions for age-related macular degeneration incorporated into clinical practice guidelines? High-quality systematic reviews should be used to underpin evidence-based clinical practice guidelines and clinical care. We examined the reliability of systematic reviews of interventions for age-related macular degeneration (AMD) and described the main findings of reliable reviews in relation to clinical practice guidelines. Eligible publications were systematic reviews of the effectiveness of treatment interventions for AMD. We searched a database of systematic reviews in eyes and vision without language or date restrictions; the database was up to date as of May 6, 2014. Two authors independently screened records for eligibility and abstracted and assessed the characteristics and methods of each review. We classified reviews as reliable when they reported eligibility criteria, comprehensive searches, methodologic quality of included studies, appropriate statistical methods for meta-analysis, and conclusions based on results. We mapped treatment recommendations from the American Academy of Ophthalmology (AAO) Preferred Practice Patterns (PPPs) for AMD to systematic reviews and citations of reliable systematic reviews to support each treatment recommendation. Of 1570 systematic reviews in our database, 47 met inclusion criteria; most targeted neovascular AMD and investigated anti-vascular endothelial growth factor (VEGF) interventions, dietary supplements, or photodynamic therapy. We classified 33 (70%) reviews as reliable. The quality of reporting varied, with criteria for reliable reporting met more often by Cochrane reviews and reviews whose authors disclosed conflicts of interest. Anti-VEGF agents and photodynamic therapy were the only interventions identified as effective by reliable reviews. Of 35 treatment recommendations extracted from the PPPs, 15 could have been supported with reliable systematic reviews; however, only 1 recommendation cited a reliable intervention systematic review. No reliable systematic review was identified for 20 treatment recommendations, highlighting areas of evidence gaps. For AMD, reliable systematic reviews exist for many treatment recommendations in the AAO PPPs and should be cited to support these recommendations. We also identified areas where no high-level evidence exists. Mapping clinical practice guidelines to existing systematic reviews is one way to highlight areas where evidence generation or evidence synthesis is either available or needed. Copyright © 2016 American Academy of Ophthalmology. Published by Elsevier Inc. All rights reserved.

Epidemiology of bruxism in adults: a systematic review of the literature.

PubMed

Manfredini, Daniele; Winocur, Ephraim; Guarda-Nardini, Luca; Paesani, Daniel; Lobbezoo, Frank

2013-01-01

To perform a systematic review of the literature dealing with the prevalence of bruxism in adult populations. A systematic search of the medical literature was performed to identify all peer-reviewed English-language papers dealing with the prevalence assessment of either awake or sleep bruxism at the general population level by the adoption of questionnaires, clinical assessments, and polysomnographic (PSG) or electromyographic (EMG) recordings. Quality assessment of the reviewed papers was performed according to the Methodological evaluation of Observational REsearch (MORE) checklist, which enables the identification of flaws in the external and internal validity. Cut-off criteria for an acceptable external validity were established to select studies for the discussion of prevalence data. For each included study, the sample features, diagnostic strategy, and prevalence of bruxism in relation to age, sex, and circadian rhythm, if available, were recorded. Thirty-five publications were included in the review. Several methodological problems limited the external validity of findings in most studies, and prevalence data extraction was performed only on seven papers. Of those, only one paper had a flaw less external validity, whilst internal validity was low in all the selected papers due to their self-reported bruxism diagnosis alone, mainly based on only one or two questionnaire items. No epidemiologic data were available from studies adopting other diagnostic strategies (eg, PSG, EMG). Generically identified "bruxism" was assessed in two studies reporting an 8% to 31.4% prevalence, awake bruxism was investigated in two studies describing a 22.1% to 31% prevalence, and prevalence of sleep bruxism was found to be more consistent across the three studies investigating the report of "frequent" bruxism (12.8% ± 3.1%). Bruxism activities were found to be unrelated to sex, and a decrease with age was described in elderly people. The present systematic review described variable prevalence data for bruxism activities. Findings must be interpreted with caution due to the poor methodological quality of the reviewed literature and to potential diagnostic bias related with having to rely on an individual's self-report of bruxism.

Reviewing the methodology of an integrative review.

PubMed

Hopia, Hanna; Latvala, Eila; Liimatainen, Leena

2016-12-01

Whittemore and Knafl's updated description of methodological approach for integrative review was published in 2005. Since then, the five stages of the approach have been regularly used as a basic conceptual structure of the integrative reviews conducted by nursing researchers. However, this methodological approach is seldom examined from the perspective of how systematically and rigorously the stages are implemented in the published integrative reviews. To appraise the selected integrative reviews on the basis of the methodological approach according to the five stages published by Whittemore and Knafl in 2005. A literature review was used in this study. CINAHL (Cumulative Index to Nursing and Allied Health), PubMed, OVID (Journals@Ovid) and the Cochrane Library databases were searched for integrative reviews published between 2002 and 2014. Papers were included if they used the methodological approach described by Whittemore and Knafl, were published in English and were focused on nursing education or nursing expertise. A total of 259 integrative review publications for potential inclusion were identified. Ten integrative reviews fulfilled the inclusion criteria. Findings from the studies were extracted and critically examined according to the five methodological stages. The reviews assessed followed the guidelines of the stated methodology approach to different extents. The stages of literature search, data evaluation and data analysis were fairly poorly formulated and only partially implemented in the studies included in the sample. The other two stages, problem identification and presentation, followed those described in the methodological approach quite well. Increasing use of research in clinical practice is inevitable, and therefore, integrative reviews can play a greater role in developing evidence-based nursing practices. Because of this, nurse researchers should pay more attention to sound integrative nursing research to systematise the review process and make it more rigorous. © 2016 Nordic College of Caring Science.

Interventions for Age-Related Macular Degeneration: Are Practice Guidelines Based on Systematic Reviews?

PubMed Central

Lindsley, Kristina; Li, Tianjing; Ssemanda, Elizabeth; Virgili, Gianni; Dickersin, Kay

2016-01-01

Topic Are existing systematic reviews of interventions for age-related macular degeneration incorporated into clinical practice guidelines? Clinical relevance High-quality systematic reviews should be used to underpin evidence-based clinical practice guidelines and clinical care. We have examined the reliability of systematic reviews of interventions for age-related macular degeneration (AMD) and described the main findings of reliable reviews in relation to clinical practice guidelines. Methods Eligible publications are systematic reviews of the effectiveness of treatment interventions for AMD. We searched a database of systematic reviews in eyes and vision and employed no language or date restrictions; the database is up-to-date as of May 6, 2014. Two authors independently screened records for eligibility and abstracted and assessed the characteristics and methods of each review. We classified reviews as “reliable” when they reported eligibility criteria, comprehensive searches, appraisal of methodological quality of included studies, appropriate statistical methods for meta-analysis, and conclusions based on results. We mapped treatment recommendations from the American Academy of Ophthalmology Preferred Practice Patterns (AAO PPP) for AMD to the identified systematic reviews and assessed whether any reliable systematic review was cited or could have been cited to support each treatment recommendation. Results Of 1,570 systematic reviews in our database, 47 met our inclusion criteria. Most of the systematic reviews targeted neovascular AMD and investigated anti-vascular endothelial growth factor (anti-VEGF) interventions, dietary supplements or photodynamic therapy. We classified over two-thirds (33/47) of the reports as reliable. The quality of reporting varied, with criteria for reliable reporting met more often for Cochrane reviews and for reviews whose authors disclosed conflicts of interest. Although most systematic reviews were reliable, anti-VEGF agents and photodynamic therapy were the only interventions identified as effective by reliable reviews. Of 35 treatment recommendations extracted from the AAO PPP, 15 could have been supported with reliable systematic reviews; however, only one recommendation had an accompanying intervention systematic review citation, which we assessed as a reliable systematic review. No reliable systematic review was identified for 20 treatment recommendations, highlighting areas of evidence gaps. Conclusions For AMD, reliable systematic reviews exist for many treatment recommendations in the AAO PPP and should be used to support these recommendations. We also identified areas where no high-level evidence exists. Mapping clinical practice guidelines to existing systematic reviews is one way to highlight areas where evidence generation or evidence synthesis is either available or needed. PMID:26804762

An evaluation of psychometric properties of caregiver burden outcome measures used in caregivers of children with cerebral palsy: a systematic review protocol.

PubMed

Dambi, Jermaine M; Jelsma, Jennifer; Mlambo, Tecla; Chiwaridzo, Matthew; Dangarembizi-Munambah, Nyaradzai; Corten, Lieselotte

2016-03-09

Cerebral palsy (CP) is the most common, life-long paediatric disability. Taking care of a child with CP often results in caregiver burden/strain in the long run. As caregivers play an essential role in the rehabilitation of these children, it is therefore important to routinely screen for health outcomes in informal caregivers. Consequently, a plethora of caregiver burden outcome measures have been developed; however, there is a dearth of evidence of the most psychometrically sound tools. Therefore, the broad objective of this systematic review is to evaluate the psychometrical properties and clinical utility of tools used to measure caregiver burden in caregivers of children with CP. This is a systematic review for the evaluation of the psychometric properties of caregiver burden outcome tools. Two independent and blinded reviewers will search articles on PubMed, Scopus, Web of Science, CINAHL, PsychINFO and Africa-Wide Google Scholar. Information will be analysed using predefined criteria. Thereafter, three independent reviewers will then screen the retrieved articles. The methodological quality of studies on the development and validation of the identified tools will be evaluated using the four point COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Finally, the psychometric properties of the tools which were developed and validated from methodological sound studies will then be analysed using predefined criteria. The proposed systematic review will give an extensive review of the psychometrical properties of tools used to measure caregiver burden in caregivers of children with CP. We hope to identify tools that can be used to accurately screen for caregiver burden both in clinical setting and for research purposes. PROSPERO CRD42015028026.

Health situation of migrant and minority nurses: A systematic review.

PubMed

Schilgen, Benjamin; Nienhaus, Albert; Handtke, Oriana; Schulz, Holger; Mösko, Mike

2017-01-01

Globally, life expectancy together with multimorbidity and chronic diseases are increasing. This leads to a growing demand for care and hence for healthcare personnel and nurses. To meet this demand, healthcare workers from abroad are increasingly hired. The nurses' workplace in general is characterized by physically and psychologically demanding tasks, while that of migrant and minority nurses is additionally characterized by discriminatory practices. The present knowledge about the health of migrant and minority nurses and the terminology in this context are diverse. Thus, the purpose of this review is to systematically identify and synthesize international publications that explicitly focus on migrant nurses' health. A systematic review of relevant studies was undertaken using the databases Medline, PsycINFO, CINAHL and Web of Science. The screening process was conducted in several phases. This review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines while the methodological quality assessment of the included papers was performed with the Mixed Method Appraisal Tool (MMAT). Out of 11,599 citations initially obtained, 14 empirical studies were included in the final synthesis. The methodological quality of the empirical studies and reviews was diverse. The majority of the studies were conducted in the US and the nurses under study migrated from countries like the Philippines, India, Europe, and Africa. Among migrant nurses of different origins, there are differences in their physiological responses to stress. Migrant nurses and native nurses differ in reporting work-related injuries. Migrant and minority nurses are at high risk of work-related injuries and discrimination than native or majority nurses. However, mixed results were obtained, namely that the reported health of migrant nurses either improves over time or it decreases. This review revealed that discrimination is the leading cause of impaired health amongst migrant and minority nurses.

21st Century Cognitive Behavioural Therapy for Anger: A Systematic Review of Research Design, Methodology and Outcome.

PubMed

Fernandez, Ephrem; Malvaso, Catia; Day, Andrew; Guharajan, Deepan

2018-07-01

Past reviews of cognitive behavioural therapy (CBT) for anger have focused on outcome in specific subpopulations, with few questions posed about research design and methodology. Since the turn of the century, there has been a surge of methodologically varied studies awaiting systematic review. The basic aim was to review this recent literature in terms of trends and patterns in research design, operationalization of anger, and covariates such as social desirability bias (SDB). Also of interest was clinical outcome. After successive culling, 42 relevant studies were retained. These were subjected to a rapid evidence assessment (REA) with special attention to design (ranked on the Scientific Methods Scale) measurement methodology (self-monitored behaviour, anger questionnaires, and others' ratings), SDB assessment, and statistical versus clinical significance. The randomized controlled trial characterized 60% of the studies, and the State Trait Anger Expression Inventory was the dominant measure of anger. All but one of the studies reported statistically significant outcome, and all but one of the 21 studies evaluating clinical significance laid claim to it. The one study with neither statistical nor clinical significance was the only one that had assessed and corrected for SDB. Measures remain relatively narrow in scope, but study designs have improved, and the outcomes suggest efficacy and clinical effectiveness. In conjunction with previous findings of an inverse relationship between anger and SDB, the results raise the possibility that the favourable picture of CBT for anger may need closer scrutiny with SDB and other methodological details in mind.

Hypnosis for procedure-related pain and distress in pediatric cancer patients: a systematic review of effectiveness and methodology related to hypnosis interventions.

PubMed

Richardson, Janet; Smith, Joanna E; McCall, Gillian; Pilkington, Karen

2006-01-01

The aim of this study was to systematically review and critically appraise the evidence on the effectiveness of hypnosis for procedure-related pain and distress in pediatric cancer patients. A comprehensive search of major biomedical and specialist complementary and alternative medicine databases was conducted. Citations were included from the databases' inception to March 2005. Efforts were made to identify unpublished and ongoing research. Controlled trials were appraised using predefined criteria. Clinical commentaries were obtained for each study. Seven randomized controlled clinical trials and one controlled clinical trial were found. Studies report positive results, including statistically significant reductions in pain and anxiety/distress, but a number of methodological limitations were identified. Systematic searching and appraisal has demonstrated that hypnosis has potential as a clinically valuable intervention for procedure-related pain and distress in pediatric cancer patients. Further research into the effectiveness and acceptability of hypnosis for pediatric cancer patients is recommended.

Association between exogenous testosterone and cardiovascular events: an overview of systematic reviews.

PubMed

Onasanya, Oluwadamilola; Iyer, Geetha; Lucas, Eleanor; Lin, Dora; Singh, Sonal; Alexander, G Caleb

2016-11-01

Given the conflicting evidence regarding the association between exogenous testosterone and cardiovascular events, we systematically assessed published systematic reviews for evidence of the association between exogenous testosterone and cardiovascular events. We searched PubMed, MEDLINE, Embase, Cochrane Collaboration Clinical Trials, ClinicalTrials.gov, and the US Food and Drug Administration website for systematic reviews of randomised controlled trials published up to July 19, 2016. Two independent reviewers screened 954 full texts from 29 335 abstracts to identify systematic reviews of randomised controlled trials in which the cardiovascular effects of exogenous testosterone on men aged 18 years or older were examined. We extracted data for study characteristics, analytic methods, and key findings, and applied the AMSTAR (A Measurement Tool to Assess Systematic Reviews) checklist to assess methodological quality of each review. Our primary outcome measure was the direction and magnitude of association between exogenous testosterone and cardiovascular events. We identified seven reviews and meta-analyses, which had substantial clinical heterogeneity, differing statistical methods, and variable methodological quality and quality of data abstraction. AMSTAR scores ranged from 3 to 9 out of 11. Six systematic reviews that each included a meta-analysis showed no significant association between exogenous testosterone and cardiovascular events, with summary estimates ranging from 1·07 to 1·82 and imprecise confidence intervals. Two of these six meta-analyses showed increased risk in subgroup analyses of oral testosterone and men aged 65 years or older during their first treatment year. One meta-analysis showed a significant association between exogenous testosterone and cardiovascular events, in men aged 18 years or older generally, with a summary estimate of 1·54 (95% CI 1·09-2·18). Our optimal information size analysis showed that any randomised controlled trial aiming to detect a true difference in cardiovascular risk between treatment groups receiving exogenous testosterone and their controls (with a two-sided p value of 0·05 and a power of 80%) would require at least 17 664 participants in each trial group. Therefore, given the challenge of adequately powering clinical trials for rare outcomes, rigorous observational studies are needed to clarify the association between testosterone-replacement therapy and major adverse cardiovascular outcomes. Copyright © 2016 Elsevier Ltd. All rights reserved.

Cost-of-illness studies for bipolar disorder: systematic review of international studies.

PubMed

Jin, Huajie; McCrone, Paul

2015-04-01

Bipolar disorder (BD) may result in a greater burden than all forms of cancer, Alzheimer's disease and epilepsy. Cost-of-illness (COI) studies provide useful information on the economic burden that BD imposes on a society. Furthermore, COI studies are pivotal sources of evidence used in economic evaluations. This study aims to give a general overview of COI studies for BD and to discuss methodological issues that might potentially influence results. This study also aims to provide recommendations to improve practice in this area, based on the review. A search was performed to identify COI studies of BD. The following electronic databases were searched: MEDLINE, EMBASE, PsycInfo, Cochrane Database of Systematic Reviews, HMIC and openSIGLE. The primary outcome of this review was the annual cost per BD patient. A narrative assessment of key methodological issues was also included. Based on these findings, recommendations for good practice were drafted. Fifty-four studies were included in this review. Because of the widespread methodological heterogeneity among included studies, no attempt has been made to pool results of different studies. Potential areas for methodological improvement were identified. These were: description of the disease and population, the approach to deal with comorbidities, reporting the rationale and impact for choosing different cost perspectives, and ways in which uncertainty is addressed. This review showed that numerous COI studies have been conducted for BD since 1995. However, these studies employed varying methods, which limit the comparability of findings. The recommendations provided by this review can be used by those conducting COI studies and those critiquing them, to increase the credibility and reporting of study results.

A systematic literature review of the key challenges for developing the structure of public health economic models.

PubMed

Squires, Hazel; Chilcott, James; Akehurst, Ronald; Burr, Jennifer; Kelly, Michael P

2016-04-01

To identify the key methodological challenges for public health economic modelling and set an agenda for future research. An iterative literature search identified papers describing methodological challenges for developing the structure of public health economic models. Additional multidisciplinary literature searches helped expand upon important ideas raised within the review. Fifteen articles were identified within the formal literature search, highlighting three key challenges: inclusion of non-healthcare costs and outcomes; inclusion of equity; and modelling complex systems and multi-component interventions. Based upon these and multidisciplinary searches about dynamic complexity, the social determinants of health, and models of human behaviour, six areas for future research were specified. Future research should focus on: the use of systems approaches within health economic modelling; approaches to assist the systematic consideration of the social determinants of health; methods for incorporating models of behaviour and social interactions; consideration of equity; and methodology to help modellers develop valid, credible and transparent public health economic model structures.

Tablet Use in Schools: A Critical Review of the Evidence for Learning Outcomes

ERIC Educational Resources Information Center

Haßler, B.; Major, L.; Hennessy, S.

2016-01-01

The increased popularity of tablets in general has led to uptake in education. We critically review the literature reporting use of tablets by primary and secondary school children across the curriculum, with a particular emphasis on learning outcomes. The systematic review methodology was used, and our literature search resulted in 33 relevant…

Systematic review of the effectiveness of mirror therapy in upper extremity function.

PubMed

Ezendam, Daniëlle; Bongers, Raoul M; Jannink, Michiel J A

2009-01-01

This review gives an overview of the current state of research regarding the effectiveness of mirror therapy in upper extremity function. A systematic literature search was performed to identify studies concerning mirror therapy in upper extremity. The included journal articles were reviewed according to a structured diagram and the methodological quality was assessed. Fifteen studies were identified and reviewed. Five different patient categories were studied: two studies focussed on mirror therapy after an amputation of the upper limb, five studies focussed on mirror therapy after stroke, five studies focussed on mirror therapy with complex regional pain syndrome type 1 (CRPS1) patients, one study on mirror therapy with complex regional pain syndrome type 2 (CRPS2) and two studies focussed on mirror therapy after hand surgery other than amputation. Most of the evidence for mirror therapy is from studies with weak methodological quality. The present review showed a trend that mirror therapy is effective in upper limb treatment of stroke patients and patients with CRPS, whereas the effectiveness in other patient groups has yet to be determined.

Effective Evaluation of the FRIENDS Anxiety Prevention Program in School Settings: A Response to Maggin and Johnson

ERIC Educational Resources Information Center

Barrett, Paula M.; Cooper, Marita; Stallard, Paul; Zeggio, Larissa; Gallegos- Guajardo, Julia

2017-01-01

This response aims to critically evaluate the methodology and aims of the meta-analytic review written by Maggin and Johnson (2014). The present authors systematically provide responses for each of the original criticisms and highlight concerns regarding Maggin and Johnson's methodology, while objectively describing the current state of evidence…

Are we talking the same paradigm? Considering methodological choices in health education systematic review.

PubMed

Gordon, Morris

2016-07-01

For the past two decades, there have been calls for medical education to become more evidence-based. Whilst previous works have described how to use such methods, there are no works discussing when or why to select different methods from either a conceptual or pragmatic perspective. This question is not to suggest the superiority of such methods, but that having a clear rationale to underpin such choices is key and should be communicated to the reader of such works. Our goal within this manuscript is to consider the philosophical alignment of these different review and synthesis modalities and how this impacts on their suitability to answer different systematic review questions within health education. The key characteristic of a systematic review that should impact the synthesis choice is discussed in detail. By clearly defining this and the related outcome expected from the review and for educators who will receive this outcome, the alignment will become apparent. This will then allow deployment of an appropriate methodology that is fit for purpose and will indeed justify the significant work needed to complete a systematic. Key items discussed are the positivist synthesis methods meta-analysis and content analysis to address questions in the form of 'whether and what' education is effective. These can be juxtaposed with the constructivist aligned thematic analysis and meta-ethnography to address questions in the form of 'why'. The concept of the realist review is also considered. It is proposed that authors of such work should describe their research alignment and the link between question, alignment and evidence synthesis method selected. The process of exploring the range of modalities and their alignment highlights gaps in the researcher's arsenal. Future works are needed to explore the impact of such changes in writing from authors of medical education systematic review.

Are we talking the same paradigm? Considering methodological choices in health education systematic review

PubMed Central

Gordon, Morris

2016-01-01

Abstract For the past two decades, there have been calls for medical education to become more evidence-based. Whilst previous works have described how to use such methods, there are no works discussing when or why to select different methods from either a conceptual or pragmatic perspective. This question is not to suggest the superiority of such methods, but that having a clear rationale to underpin such choices is key and should be communicated to the reader of such works. Our goal within this manuscript is to consider the philosophical alignment of these different review and synthesis modalities and how this impacts on their suitability to answer different systematic review questions within health education. The key characteristic of a systematic review that should impact the synthesis choice is discussed in detail. By clearly defining this and the related outcome expected from the review and for educators who will receive this outcome, the alignment will become apparent. This will then allow deployment of an appropriate methodology that is fit for purpose and will indeed justify the significant work needed to complete a systematic. Key items discussed are the positivist synthesis methods meta-analysis and content analysis to address questions in the form of ‘whether and what’ education is effective. These can be juxtaposed with the constructivist aligned thematic analysis and meta-ethnography to address questions in the form of ‘why’. The concept of the realist review is also considered. It is proposed that authors of such work should describe their research alignment and the link between question, alignment and evidence synthesis method selected. The process of exploring the range of modalities and their alignment highlights gaps in the researcher’s arsenal. Future works are needed to explore the impact of such changes in writing from authors of medical education systematic review. PMID:27007488

Photogrammetry as a tool for the postural evaluation of the spine: A systematic review.

PubMed

Furlanetto, Tássia Silveira; Sedrez, Juliana Adami; Candotti, Cláudia Tarragô; Loss, Jefferson Fagundes

2016-02-18

To evaluate the use of photogrammetry and identify the mathematical procedures applied when evaluating spinal posture. A systematic search using keywords was conducted in the PubMed, EMBASE, Scopus, Science and Medicine(®) databases. The following inclusion criteria adopted were: (1) the use of photogrammetry as a method to evaluate spinal posture; (2) evaluations of spinal curvature in the sagittal and/or frontal plane; (3) studies published within the last three decades; and (4) written entirely in English. The exclusion criteria were: (1) studies which objective involved the verification of some aspect of validation of instruments; (2) studies published as abstracts and those published in scientific events; and (3) studies using evaluation of the anteriorization of the head to determine the angular positioning of the cervical spine. The articles in this review were included and evaluated for their methodological quality, based on the Downs and Black scale, by two independent reviewers. Initially, 1758 articles were found, 76 of which were included upon reading the full texts and 29 were included in accordance with the predetermined criteria. In addition, after analyzing the references in those articles, a further six articles were selected, so that 35 articles were included in this review. This systematic review revealed that the photogrammetry has been using in observational studies. Furthermore, it was also found that, although the data collection methodologies are similar across the studies, in relation to aspects of data analysis, the methodologies are very different, especially regarding the mathematical routines employed to support different postural evaluation software. With photogrammetry, the aim of the assessment, whether it is for clinical, research or collective health purposes, must be considered when choosing which protocol to use to evaluate spinal posture.

Photogrammetry as a tool for the postural evaluation of the spine: A systematic review

PubMed Central

Furlanetto, Tássia Silveira; Sedrez, Juliana Adami; Candotti, Cláudia Tarragô; Loss, Jefferson Fagundes

2016-01-01

AIM: To evaluate the use of photogrammetry and identify the mathematical procedures applied when evaluating spinal posture. METHODS: A systematic search using keywords was conducted in the PubMed, EMBASE, Scopus, Science and Medicine® databases. The following inclusion criteria adopted were: (1) the use of photogrammetry as a method to evaluate spinal posture; (2) evaluations of spinal curvature in the sagittal and/or frontal plane; (3) studies published within the last three decades; and (4) written entirely in English. The exclusion criteria were: (1) studies which objective involved the verification of some aspect of validation of instruments; (2) studies published as abstracts and those published in scientific events; and (3) studies using evaluation of the anteriorization of the head to determine the angular positioning of the cervical spine. The articles in this review were included and evaluated for their methodological quality, based on the Downs and Black scale, by two independent reviewers. RESULTS: Initially, 1758 articles were found, 76 of which were included upon reading the full texts and 29 were included in accordance with the predetermined criteria. In addition, after analyzing the references in those articles, a further six articles were selected, so that 35 articles were included in this review. This systematic review revealed that the photogrammetry has been using in observational studies. Furthermore, it was also found that, although the data collection methodologies are similar across the studies, in relation to aspects of data analysis, the methodologies are very different, especially regarding the mathematical routines employed to support different postural evaluation software. CONCLUSION: With photogrammetry, the aim of the assessment, whether it is for clinical, research or collective health purposes, must be considered when choosing which protocol to use to evaluate spinal posture. PMID:26925386

Measurement Properties of the Quebec Back Pain Disability Scale in Patients With Nonspecific Low Back Pain: Systematic Review.

PubMed

Speksnijder, Caroline M; Koppenaal, Tjarco; Knottnerus, J André; Spigt, Mark; Staal, J Bart; Terwee, Caroline B

2016-11-01

The Quebec Back Pain Disability Scale (QBPDS) has been translated into different languages, and several studies on its measurement properties have been done. The purpose of this review was to critically appraise and compare the measurement properties, when possible, of all language versions of the QBPDS by systematically reviewing the methodological quality and results of the available studies. Bibliographic databases (PubMed, Embase, CINAHL, and PsycINFO) were searched for articles with the key words "Quebec," "back," "pain," and "disability" in combination with a methodological search filter for finding studies on measurement properties concerning the development or evaluation of the measurement properties of the QBPDS in patients with nonspecific low back pain. Assessment of the methodological quality was carried out by the reviewers using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist for both the original language version of the QBPDS in English and French and all translated versions. The results of the measurement properties were rated based on criteria proposed by Terwee et al. The search strategy resulted in identification of 1,436 publications, and 27 articles were included in the systematic review. There was limited-to-moderate evidence of good reliability, validity, and responsiveness of the QBPDS for the different language versions, but for no language version was evidence available for all measurement properties. For research and clinical practice, caution is advised when using the QBPDS to measure disability in patients with nonspecific low back pain. Strong evidence is lacking on all measurement properties for each language version of the QBPDS. © 2016 American Physical Therapy Association.

Lean interventions in healthcare: do they actually work? A systematic literature review.

PubMed

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-04-01

Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data on design, methods, interventions and key outcomes were extracted and collated. Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Lean interventions in healthcare: do they actually work? A systematic literature review

PubMed Central

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-01-01

Purpose Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. Data sources We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Study selection Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data extraction Data on design, methods, interventions and key outcomes were extracted and collated. Results of data synthesis Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. Conclusion While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. PMID:26811118

The risk of bias in systematic reviews tool showed fair reliability and good construct validity.

PubMed

Bühn, Stefanie; Mathes, Tim; Prengel, Peggy; Wegewitz, Uta; Ostermann, Thomas; Robens, Sibylle; Pieper, Dawid

2017-11-01

There is a movement from generic quality checklists toward a more domain-based approach in critical appraisal tools. This study aimed to report on a first experience with the newly developed risk of bias in systematic reviews (ROBIS) tool and compare it with A Measurement Tool to Assess Systematic Reviews (AMSTAR), that is, the most common used tool to assess methodological quality of systematic reviews while assessing validity, reliability, and applicability. Validation study with four reviewers based on 16 systematic reviews in the field of occupational health. Interrater reliability (IRR) of all four raters was highest for domain 2 (Fleiss' kappa κ = 0.56) and lowest for domain 4 (κ = 0.04). For ROBIS, median IRR was κ = 0.52 (range 0.13-0.88) for the experienced pair of raters compared to κ = 0.32 (range 0.12-0.76) for the less experienced pair of raters. The percentage of "yes" scores of each review of ROBIS ratings was strongly correlated with the AMSTAR ratings (r s  = 0.76; P = 0.01). ROBIS has fair reliability and good construct validity to assess the risk of bias in systematic reviews. More validation studies are needed to investigate reliability and applicability, in particular. Copyright © 2017 Elsevier Inc. All rights reserved.

The integrative review: updated methodology.

PubMed

Whittemore, Robin; Knafl, Kathleen

2005-12-01

The aim of this paper is to distinguish the integrative review method from other review methods and to propose methodological strategies specific to the integrative review method to enhance the rigour of the process. Recent evidence-based practice initiatives have increased the need for and the production of all types of reviews of the literature (integrative reviews, systematic reviews, meta-analyses, and qualitative reviews). The integrative review method is the only approach that allows for the combination of diverse methodologies (for example, experimental and non-experimental research), and has the potential to play a greater role in evidence-based practice for nursing. With respect to the integrative review method, strategies to enhance data collection and extraction have been developed; however, methods of analysis, synthesis, and conclusion drawing remain poorly formulated. A modified framework for research reviews is presented to address issues specific to the integrative review method. Issues related to specifying the review purpose, searching the literature, evaluating data from primary sources, analysing data, and presenting the results are discussed. Data analysis methods of qualitative research are proposed as strategies that enhance the rigour of combining diverse methodologies as well as empirical and theoretical sources in an integrative review. An updated integrative review method has the potential to allow for diverse primary research methods to become a greater part of evidence-based practice initiatives.

Systematic Review of Knowledge Translation Strategies to Promote Research Uptake in Child Health Settings.

PubMed

Albrecht, Lauren; Archibald, Mandy; Snelgrove-Clarke, Erna; Scott, Shannon D

2016-01-01

Strategies to assist evidence-based decision-making for healthcare professionals are crucial to ensure high quality patient care and outcomes. The goal of this systematic review was to identify and synthesize the evidence on knowledge translation interventions aimed at putting explicit research evidence into child health practice. A comprehensive search of thirteen electronic databases was conducted, restricted by date (1985-2011) and language (English). Articles were included if: 1) studies were randomized controlled trials (RCT), controlled clinical trials (CCT), or controlled before-and-after (CBA) studies; 2) target population was child health professionals; 3) interventions implemented research in child health practice; and 4) outcomes were measured at the professional/process, patient, or economic level. Two reviewers independently extracted data and assessed methodological quality. Study data were aggregated and analyzed using evidence tables. Twenty-one studies (13 RCT, 2 CCT, 6 CBA) were included. The studies employed single (n=9) and multiple interventions (n=12). The methodological quality of the included studies was largely moderate (n=8) or weak (n=11). Of the studies with moderate to strong methodological quality ratings, three demonstrated consistent, positive effect(s) on the primary outcome(s); effective knowledge translation interventions were two single, non-educational interventions and one multiple, educational intervention. This multidisciplinary systematic review in child health setting identified effective knowledge translation strategies assessed by the most rigorous research designs. Given the overall poor quality of the research literature, specific recommendations were made to improve knowledge translation efforts in child health. Copyright © 2016 Elsevier Inc. All rights reserved.

Unilateral Vocal Fold Paralysis: A Systematic Review of Speech-Language Pathology Management.

PubMed

Walton, Chloe; Conway, Erin; Blackshaw, Helen; Carding, Paul

2017-07-01

Dysphonia due to unilateral vocal fold paralysis (UVFP) can be characterized by hoarseness and weakness, resulting in a significant impact on patients' activity and participation. Voice therapy provided by a speech-language pathologist is designed to maximize vocal function and improve quality of life. The purpose of this paper is to systematically review literature surrounding the effectiveness of speech-language pathology intervention for the management of UVFP in adults. This is a systematic review. Electronic databases were searched using a range of key terms including dysphonia, vocal fold paralysis, and speech-language pathology. Eligible articles were extracted and reviewed by the authors for risk of bias, methodology, treatment efficacy, and clinical outcomes. Of the 3311 articles identified, 12 met the inclusion criteria: seven case series and five comparative studies. All 12 studies subjectively reported positive effects following the implementation of voice therapy for UVFP; however, the heterogeneity of participant characteristics, voice therapy, and voice outcome resulted in a low level of evidence. There is presently a lack of methodological rigor and clinical efficacy in the speech-language pathology management of dysphonia arising from UVFP in adults. Reasons for this reduced efficacy can be attributed to the following: (1) no standardized speech-language pathology intervention; (2) no consistency of assessment battery; (3) the variable etiology and clinical presentation of UVFP; and (4) inconsistent timing, frequency, and intensity of treatment. Further research is required to develop the evidence for the management of UVFP incorporating controlled treatment protocols and more rigorous clinical methodology. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Prevalence of hypertension among adolescents: systematic review and meta-analysis.

PubMed

Gonçalves, Vivian Siqueira Santos; Galvão, Taís Freire; de Andrade, Keitty Regina Cordeiro; Dutra, Eliane Said; Bertolin, Maria Natacha Toral; de Carvalho, Kenia Mara Baiocchi; Pereira, Mauricio Gomes

2016-01-01

To estimate the prevalence of hypertension among adolescent Brazilian students. A systematic review of school-based cross-sectional studies was conducted. The articles were searched in the databases MEDLINE, Embase, Scopus, LILACS, SciELO, Web of Science, CAPES thesis database and Trip Database. In addition, we examined the lists of references of relevant studies to identify potentially eligible articles. No restrictions regarding publication date, language, or status applied. The studies were selected by two independent evaluators, who also extracted the data and assessed the methodological quality following eight criteria related to sampling, measuring blood pressure, and presenting results. The meta-analysis was calculated using a random effects model and analyses were performed to investigate heterogeneity. We retrieved 1,577 articles from the search and included 22 in the review. The included articles corresponded to 14,115 adolescents, 51.2% (n = 7,230) female. We observed a variety of techniques, equipment, and references used. The prevalence of hypertension was 8.0% (95%CI 5.0-11.0; I2 = 97.6%), 9.3% (95%CI 5.6-13.6; I2 = 96.4%) in males and 6.5% (95%CI 4.2-9.1; I2 = 94.2%) in females. The meta-regression failed to identify the causes of the heterogeneity among studies. Despite the differences found in the methodologies of the included studies, the results of this systematic review indicate that hypertension is prevalent in the Brazilian adolescent school population. For future investigations, we suggest the standardization of techniques, equipment, and references, aiming at improving the methodological quality of the studies.

Measuring attitudes towards the dying process: A systematic review of tools.

PubMed

Groebe, Bernadette; Strupp, Julia; Eisenmann, Yvonne; Schmidt, Holger; Schlomann, Anna; Rietz, Christian; Voltz, Raymond

2018-04-01

At the end of life, anxious attitudes concerning the dying process are common in patients in Palliative Care. Measurement tools can identify vulnerabilities, resources and the need for subsequent treatment to relieve suffering and support well-being. To systematically review available tools measuring attitudes towards dying, their operationalization, the method of measurement and the methodological quality including generalizability to different contexts. Systematic review according to the PRISMA Statement. Methodological quality of tools assessed by standardized review criteria. MEDLINE, PsycINFO, PsyndexTests and the Health and Psychosocial Instruments were searched from their inception to April 2017. A total of 94 identified studies reported the development and/or validation of 44 tools. Of these, 37 were questionnaires and 7 alternative measurement methods (e.g. projective measures). In 34 of 37 questionnaires, the emotional evaluation (e.g. anxiety) towards dying is measured. Dying is operationalized in general items ( n = 20), in several specific aspects of dying ( n = 34) and as dying of others ( n = 14). Methodological quality of tools was reported inconsistently. Nine tools reported good internal consistency. Of 37 tools, 4 were validated in a clinical sample (e.g. terminal cancer; Huntington disease), indicating questionable generalizability to clinical contexts for most tools. Many tools exist to measure attitudes towards the dying process using different endpoints. This overview can serve as decision framework on which tool to apply in which contexts. For clinical application, only few tools were available. Further validation of existing tools and potential alternative methods in various populations is needed.

Effectiveness of mirror therapy, motor imagery, and virtual feedback on phantom limb pain following amputation: A systematic review.

PubMed

Herrador Colmenero, Laura; Perez Marmol, Jose Manuel; Martí-García, Celia; Querol Zaldivar, María de Los Ángeles; Tapia Haro, Rosa María; Castro Sánchez, Adelaida María; Aguilar-Ferrándiz, María Encarnación

2018-06-01

Phantom limb pain is reported in 50%-85% of people with amputation. Clinical interventions in treating central pain, such as mirror therapy, motor imagery, or virtual visual feedback, could redound in benefits to amputee patients with phantom limb pain. To provide an overview of the effectiveness of different techniques for treating phantom limb pain in amputee patients. Systematic review. A computerized literature search up to April 2017 was performed using the following databases: PubMed, Scopus, CINAHL, MEDLINE, ProQuest, PEDro, EBSCOhost, and Cochrane Plus. Methodological quality and internal validity score of each study were assessed using PEDro scale. For data synthesis, qualitative methods from the Cochrane Back Review Group were applied. In all, 12 studies met our inclusion criteria, where 9 were rated as low methodological quality and 3 rated moderate quality. All studies showed a significant reduction in pain, but there was heterogeneity among subjects and methodologies and any high-quality clinical trial (PEDro score ≤8; internal validity score ≤5) was not found. Mirror therapy, motor imaginary, and virtual visual feedback reduce phantom limb pain; however, there is limited scientific evidence supporting their effectiveness. Future studies should include designs with more solid research methods, exploring short- and long-term benefits of these therapies. Clinical relevance This systematic review investigates the effectiveness of mirror therapy, motor imagery, and virtual visual feedback on phantom limb pain, summarizing the currently published trials and evaluating the research quality. Although these interventions have positive benefits in phantom limb pain, there is still a lack of evidence for supporting their effectiveness.

Quality assessment of systematic reviews on alveolar socket preservation.

PubMed

Moraschini, V; Barboza, E Dos S P

2016-09-01

The aim of this overview was to evaluate and compare the quality of systematic reviews, with or without meta-analysis, that have evaluated studies on techniques or biomaterials used for the preservation of alveolar sockets post tooth extraction in humans. An electronic search was conducted without date restrictions using the Medline/PubMed, Cochrane Library, and Web of Science databases up to April 2015. Eligibility criteria included systematic reviews, with or without meta-analysis, focused on the preservation of post-extraction alveolar sockets in humans. Two independent authors assessed the quality of the included reviews using AMSTAR and the checklist proposed by Glenny et al. in 2003. After the selection process, 12 systematic reviews were included. None of these reviews obtained the maximum score using the quality assessment tools implemented, and the results of the analyses were highly variable. A significant statistical correlation was observed between the scores of the two checklists. A wide structural and methodological variability was observed between the systematic reviews published on the preservation of alveolar sockets post tooth extraction. None of the reviews evaluated obtained the maximum score using the two quality assessment tools implemented. Copyright © 2016 International Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

What do Cochrane systematic reviews say about non-surgical interventions for urinary incontinence in women?

PubMed

Costa, Anderson Adriano Leal Freitas da; Vasconcellos, Igor Martins; Pacheco, Rafael Leite; Bella, Zsuzsanna Ilona Katalin de Jármy Di; Riera, Rachel

2018-01-01

Urinary incontinence is a highly prevalent condition that impacts self-esteem and overall quality of life. Many non-surgical treatment options are available, ranging from pharmacological approaches to pelvic exercises. We aimed to summarize the available evidence regarding these non-surgical interventions. Review of systematic reviews, conducted in the Discipline of Evidence-Based Medicine, Escola Paulista de Medicina, Universidade Federal de São Paulo (EPM-UNIFESP). A sensitive search was conducted to identify all Cochrane systematic reviews that fulfilled the inclusion criteria. Titles and abstracts were screened by two authors. We included 20 Cochrane systematic reviews: 4 assessing methods of vesical training, 3 evaluating pharmacological interventions, 4 studying pelvic floor muscle training approaches and 9 aimed at other alternatives (such as urethral injections, weighted vaginal cone use, acupuncture, biostimulation and radiofrequency therapy). The reviews found that the evidence regarding the benefits of these diverse interventions ranged in quality from low to high. This review included 20 Cochrane systematic reviews that provided evidence (of diverse quality) for non-pharmacological interventions for patients with urinary incontinence. Moderate to high quality of evidence was found favoring the use of pelvic floor muscle training among women with urinary incontinence. To establish solid conclusions for all the other comparisons, further studies of good methodological quality are needed.

Conceptualizing the Critical Path Linked by Teacher Commitment

ERIC Educational Resources Information Center

Sun, Jingping

2015-01-01

Purpose: The purpose of this paper is to propose a critical path through which school leadership travels to students by highlighting the importance of teacher commitment. Design/methodology/approach: Using both meta-analytic and narrative review methods, this paper systematically reviews the evidence in the past 20 years about the…

Mexican American Mothers' Perceptions of Childhood Obesity: A Theory-Guided Systematic Literature Review

ERIC Educational Resources Information Center

Sosa, Erica T.

2012-01-01

Childhood obesity continues to increase, disproportionately affecting Mexican American children. The aims of this review are to (a) assess the literature regarding Mexican American mothers' knowledge and perceptions of childhood obesity, prevention, and their role in prevention; (b) critically evaluate the methodological quality of the research…

Methods of Quality Appraisal for Studies Reviewed by Evidence Clearinghouses

ERIC Educational Resources Information Center

Wilson, Sandra Jo; Tanner-Smith, Emily

2015-01-01

This presentation will discuss quality appraisal methods for assessing research studies used in systematic reviews, research syntheses, and evidence-based practice repositories such as the What Works Clearinghouse. The different ways that the methodological rigor and risk of bias of primary studies included in syntheses is assessed means that…

The impact of eHealth on the quality and safety of health care: a systematic overview.

PubMed

Black, Ashly D; Car, Josip; Pagliari, Claudia; Anandan, Chantelle; Cresswell, Kathrin; Bokun, Tomislav; McKinstry, Brian; Procter, Rob; Majeed, Azeem; Sheikh, Aziz

2011-01-18

There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care. We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking. There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and "techno-enthusiasts" as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption.

PRISMA and AMSTAR Show Systematic Reviews of Health Literacy and Cancer Screening are Good Quality.

PubMed

Sharma, Sakshi; Oremus, Mark

2018-04-11

To evaluate the reporting and methodological quality of systematic reviews (SRs) in health literacy and cancer screening; to investigate factors that may influence overall quality. A review of SRs published between 2009 and 2017. We calculated indices to represent the included SRs' adherence to PRISMA and AMSTAR. To assess possible determinants of SR quality, we regressed the index scores on year and region of publication, journal impact factor, authors' reported use of PRISMA, and presence of funding statements. We included 19 SRs and median index scores were 0.86 for PRISMA (interquartile range [IQR] = 0.11; range = 0.32 to 1.00) and 0.67 for AMSTAR (IQR = 0.30; range = 0.22 to 1.00). Methodological and reporting problems pertained to protocol registration or publication, number of raters used, gray literature searches, excluded article lists, and unintegrated discussions of risk of bias and efficacy. Only journal impact factor was statistically significantly associated (positively) with PRISMA and AMSTAR index scores. The quality of SRs in health literacy and cancer screening was generally good. Systematic reviewers should register or publish their protocols, include PRISMA and AMSTAR checklists when submitting SRs to journals, and self-evaluate their SRs before submission. Copyright © 2018. Published by Elsevier Inc.

Automatic indexing and retrieval of encounter-specific evidence for point-of-care support.

PubMed

O'Sullivan, Dympna M; Wilk, Szymon A; Michalowski, Wojtek J; Farion, Ken J

2010-08-01

Evidence-based medicine relies on repositories of empirical research evidence that can be used to support clinical decision making for improved patient care. However, retrieving evidence from such repositories at local sites presents many challenges. This paper describes a methodological framework for automatically indexing and retrieving empirical research evidence in the form of the systematic reviews and associated studies from The Cochrane Library, where retrieved documents are specific to a patient-physician encounter and thus can be used to support evidence-based decision making at the point of care. Such an encounter is defined by three pertinent groups of concepts - diagnosis, treatment, and patient, and the framework relies on these three groups to steer indexing and retrieval of reviews and associated studies. An evaluation of the indexing and retrieval components of the proposed framework was performed using documents relevant for the pediatric asthma domain. Precision and recall values for automatic indexing of systematic reviews and associated studies were 0.93 and 0.87, and 0.81 and 0.56, respectively. Moreover, precision and recall for the retrieval of relevant systematic reviews and associated studies were 0.89 and 0.81, and 0.92 and 0.89, respectively. With minor modifications, the proposed methodological framework can be customized for other evidence repositories. Copyright 2010 Elsevier Inc. All rights reserved.

Herbal Medicine for Hot Flushes Induced by Endocrine Therapy in Women with Breast Cancer: A Systematic Review and Meta-Analysis.

PubMed

Li, Yuanqing; Zhu, Xiaoshu; Bensussan, Alan; Li, Pingping; Moylan, Eugene; Delaney, Geoff; McPherson, Luke

2016-01-01

Objective. This systematic review was conducted to evaluate the clinical effectiveness and safety of herbal medicine (HM) as an alternative management for hot flushes induced by endocrine therapy in breast cancer patients. Methods. Key English and Chinese language databases were searched from inception to July 2015. Randomized Controlled Trials (RCTs) evaluating the effects of HM on hot flushes induced by endocrine therapy in women with breast cancer were retrieved. We conducted data collection and analysis in accordance with the Cochrane Handbook for Systematic Reviews of Interventions. Statistical analysis was performed with the software (Review Manager 5.3). Results. 19 articles were selected from the articles retrieved, and 5 articles met the inclusion criteria for analysis. Some included individual studies showed that HM can relieve hot flushes as well as other menopausal symptoms induced by endocrine therapy among women with breast cancer and improve the quality of life. There are minor side effects related to HM which are well tolerated. Conclusion. Given the small number of included studies and relatively poor methodological quality, there is insufficient evidence to draw positive conclusions regarding the objective benefit of HM. Additional high quality studies are needed with more rigorous methodological approach to answer this question.

Cannabinoids for nausea and vomiting related to chemotherapy: Overview of systematic reviews.

PubMed

Schussel, Victor; Kenzo, Lucas; Santos, Andreia; Bueno, Júlia; Yoshimura, Ellen; de Oliveira Cruz Latorraca, Carolina; Pachito, Daniela Vianna; Riera, Rachel

2018-04-01

Nausea and vomiting are common and distressing adverse events of chemotherapy. This review focuses on the findings and quality of systematic reviews (SRs) of cannabinoids for chemotherapy-induced nausea and vomiting (CINV). Review of SRs, a systematic literature search, was conducted in several electronic databases and included SRs evaluating cannabinoids for CINV in cancer patients. Methodological quality and quality of reporting were evaluated by AMSTAR and PRISMA, respectively. Initial search retrieved 2,206 records, and 5 SRs were included. On the basis of findings of the sole SR judged as high methodological quality, cannabinoids seem to be more effective than placebo, equal to prochlorperazine for reducing CINV, and to be preferred by patients. The response to different combinations of antiemetic agents seems to be equal to 1 antiemetic alone. The average of AMSTAR score was 5, and the average of PRISMA score was 13.2. Cannabinoids represent a valuable option for treating CINV, despite the adverse events related to treatment, such as drowsiness and cognitive impairment. There is no good quality evidence to recommend or not the use of cannabinoids for CINV. More studies are still needed to evaluate the effectiveness of cannabinoids when compared with modern antiemetics. Copyright © 2017 John Wiley & Sons, Ltd.

The economic burden of physical inactivity: a systematic review and critical appraisal.

PubMed

Ding, Ding; Kolbe-Alexander, Tracy; Nguyen, Binh; Katzmarzyk, Peter T; Pratt, Michael; Lawson, Kenny D

2017-10-01

To summarise the literature on the economic burden of physical inactivity in populations, with emphases on appraising the methodologies and providing recommendations for future studies. Systematic review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines (PROSPERO registration number CRD42016047705). Electronic databases for peer-reviewed and grey literature were systematically searched, followed by reference searching and consultation with experts. Studies that examined the economic consequences of physical inactivity in a population/population-based sample, with clearly stated methodologies and at least an abstract/summary written in English. Of the 40 eligible studies, 27 focused on direct healthcare costs only, 13 also estimated indirect costs and one study additionally estimated household costs. For direct costs, 23 studies used a population attributable fraction (PAF) approach with estimated healthcare costs attributable to physical inactivity ranging from 0.3% to 4.6% of national healthcare expenditure; 17 studies used an econometric approach, which tended to yield higher estimates than those using a PAF approach. For indirect costs, 10 studies used a human capital approach, two used a friction cost approach and one used a value of a statistical life approach. Overall, estimates varied substantially, even within the same country, depending on analytical approaches, time frame and other methodological considerations. Estimating the economic burden of physical inactivity is an area of increasing importance that requires further development. There is a marked lack of consistency in methodological approaches and transparency of reporting. Future studies could benefit from cross-disciplinary collaborations involving economists and physical activity experts, taking a societal perspective and following best practices in conducting and reporting analysis, including accounting for potential confounding, reverse causality and comorbidity, applying discounting and sensitivity analysis, and reporting assumptions, limitations and justifications for approaches taken. We have adapted the Consolidated Health Economic Evaluation Reporting Standards checklist as a guide for future estimates of the economic burden of physical inactivity and other risk factors. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Systematic review of surveillance systems and methods for early detection of exotic, new and re-emerging diseases in animal populations.

PubMed

Rodríguez-Prieto, V; Vicente-Rubiano, M; Sánchez-Matamoros, A; Rubio-Guerri, C; Melero, M; Martínez-López, B; Martínez-Avilés, M; Hoinville, L; Vergne, T; Comin, A; Schauer, B; Dórea, F; Pfeiffer, D U; Sánchez-Vizcaíno, J M

2015-07-01

In this globalized world, the spread of new, exotic and re-emerging diseases has become one of the most important threats to animal production and public health. This systematic review analyses conventional and novel early detection methods applied to surveillance. In all, 125 scientific documents were considered for this study. Exotic (n = 49) and re-emerging (n = 27) diseases constituted the most frequently represented health threats. In addition, the majority of studies were related to zoonoses (n = 66). The approaches found in the review could be divided in surveillance modalities, both active (n = 23) and passive (n = 5); and tools and methodologies that support surveillance activities (n = 57). Combinations of surveillance modalities and tools (n = 40) were also found. Risk-based approaches were very common (n = 60), especially in the papers describing tools and methodologies (n = 50). The main applications, benefits and limitations of each approach were extracted from the papers. This information will be very useful for informing the development of tools to facilitate the design of cost-effective surveillance strategies. Thus, the current literature review provides key information about the advantages, disadvantages, limitations and potential application of methodologies for the early detection of new, exotic and re-emerging diseases.

Methodological developments in searching for studies for systematic reviews: past, present and future?

PubMed

Lefebvre, Carol; Glanville, Julie; Wieland, L Susan; Coles, Bernadette; Weightman, Alison L

2013-09-25

The Cochrane Collaboration was established in 1993, following the opening of the UK Cochrane Centre in 1992, at a time when searching for studies for inclusion in systematic reviews was not well-developed. Review authors largely conducted their own searches or depended on medical librarians, who often possessed limited awareness and experience of systematic reviews. Guidance on the conduct and reporting of searches was limited. When work began to identify reports of randomized controlled trials (RCTs) for inclusion in Cochrane Reviews in 1992, there were only approximately 20,000 reports indexed as RCTs in MEDLINE and none indexed as RCTs in Embase. No search filters had been developed with the aim of identifying all RCTs in MEDLINE or other major databases. This presented The Cochrane Collaboration with a considerable challenge in identifying relevant studies.Over time, the number of studies indexed as RCTs in the major databases has grown considerably and the Cochrane Central Register of Controlled Trials (CENTRAL) has become the best single source of published controlled trials, with approximately 700,000 records, including records identified by the Collaboration from Embase and MEDLINE. Search filters for various study types, including systematic reviews and the Cochrane Highly Sensitive Search Strategies for RCTs, have been developed. There have been considerable advances in the evidence base for methodological aspects of information retrieval. The Cochrane Handbook for Systematic Reviews of Interventions now provides detailed guidance on the conduct and reporting of searches. Initiatives across The Cochrane Collaboration to improve the quality inter alia of information retrieval include: the recently introduced Methodological Expectations for Cochrane Intervention Reviews (MECIR) programme, which stipulates 'mandatory' and 'highly desirable' standards for various aspects of review conduct and reporting including searching, the development of Standard Training Materials for Cochrane Reviews and work on peer review of electronic search strategies. Almost all Cochrane Review Groups and some Cochrane Centres and Fields now have a Trials Search Co-ordinator responsible for study identification and medical librarians and other information specialists are increasingly experienced in searching for studies for systematic reviews.Prospective registration of clinical trials is increasing and searching trials registers is now mandatory for Cochrane Reviews, where relevant. Portals such as the WHO International Clinical Trials Registry Platform (ICTRP) are likely to become increasingly attractive, given concerns about the number of trials which may not be registered and/or published. The importance of access to information from regulatory and reimbursement agencies is likely to increase. Cross-database searching, gateways or portals and improved access to full-text databases will impact on how searches are conducted and reported, as will services such as Google Scholar, Scopus and Web of Science. Technologies such as textual analysis, semantic analysis, text mining and data linkage will have a major impact on the search process but efficient and effective updating of reviews may remain a challenge.In twenty years' time, we envisage that the impact of universal social networking, as well as national and international legislation, will mean that all trials involving humans will be registered at inception and detailed trial results will be routinely available to all. Challenges will remain, however, to ensure the discoverability of relevant information in diverse and often complex sources and the availability of metadata to provide the most efficient access to information. We envisage an ongoing role for information professionals as experts in identifying new resources, researching efficient ways to link or mine them for relevant data and managing their content for the efficient production of systematic reviews.

Methodological developments in searching for studies for systematic reviews: past, present and future?

PubMed Central

2013-01-01

The Cochrane Collaboration was established in 1993, following the opening of the UK Cochrane Centre in 1992, at a time when searching for studies for inclusion in systematic reviews was not well-developed. Review authors largely conducted their own searches or depended on medical librarians, who often possessed limited awareness and experience of systematic reviews. Guidance on the conduct and reporting of searches was limited. When work began to identify reports of randomized controlled trials (RCTs) for inclusion in Cochrane Reviews in 1992, there were only approximately 20,000 reports indexed as RCTs in MEDLINE and none indexed as RCTs in Embase. No search filters had been developed with the aim of identifying all RCTs in MEDLINE or other major databases. This presented The Cochrane Collaboration with a considerable challenge in identifying relevant studies. Over time, the number of studies indexed as RCTs in the major databases has grown considerably and the Cochrane Central Register of Controlled Trials (CENTRAL) has become the best single source of published controlled trials, with approximately 700,000 records, including records identified by the Collaboration from Embase and MEDLINE. Search filters for various study types, including systematic reviews and the Cochrane Highly Sensitive Search Strategies for RCTs, have been developed. There have been considerable advances in the evidence base for methodological aspects of information retrieval. The Cochrane Handbook for Systematic Reviews of Interventions now provides detailed guidance on the conduct and reporting of searches. Initiatives across The Cochrane Collaboration to improve the quality inter alia of information retrieval include: the recently introduced Methodological Expectations for Cochrane Intervention Reviews (MECIR) programme, which stipulates 'mandatory’ and 'highly desirable’ standards for various aspects of review conduct and reporting including searching, the development of Standard Training Materials for Cochrane Reviews and work on peer review of electronic search strategies. Almost all Cochrane Review Groups and some Cochrane Centres and Fields now have a Trials Search Co-ordinator responsible for study identification and medical librarians and other information specialists are increasingly experienced in searching for studies for systematic reviews. Prospective registration of clinical trials is increasing and searching trials registers is now mandatory for Cochrane Reviews, where relevant. Portals such as the WHO International Clinical Trials Registry Platform (ICTRP) are likely to become increasingly attractive, given concerns about the number of trials which may not be registered and/or published. The importance of access to information from regulatory and reimbursement agencies is likely to increase. Cross-database searching, gateways or portals and improved access to full-text databases will impact on how searches are conducted and reported, as will services such as Google Scholar, Scopus and Web of Science. Technologies such as textual analysis, semantic analysis, text mining and data linkage will have a major impact on the search process but efficient and effective updating of reviews may remain a challenge. In twenty years’ time, we envisage that the impact of universal social networking, as well as national and international legislation, will mean that all trials involving humans will be registered at inception and detailed trial results will be routinely available to all. Challenges will remain, however, to ensure the discoverability of relevant information in diverse and often complex sources and the availability of metadata to provide the most efficient access to information. We envisage an ongoing role for information professionals as experts in identifying new resources, researching efficient ways to link or mine them for relevant data and managing their content for the efficient production of systematic reviews. PMID:24066664

Critical appraisal of nonrandomized studies-A review of recommended and commonly used tools.

PubMed

Quigley, Joan M; Thompson, Juliette C; Halfpenny, Nicholas J; Scott, David A

2018-02-27

When randomized controlled trial data are limited or unavailable, or to supplement randomized controlled trial evidence, health technology assessment (HTA) agencies may rely on systematic reviews of nonrandomized studies (NRSs) for evidence of the effectiveness of health care interventions. NRS designs may introduce considerable bias into systematic reviews, and several methodologies by which to evaluate this risk of bias are available. This study aimed to identify tools commonly used to assess bias in NRS and determine those recommended by HTA bodies. Appraisal tools used in NRS were identified through a targeted search of systematic reviews (January 2013-March 2017; MEDLINE and EMBASE [OVID SP]). Recommendations for the critical appraisal of NRS by expert review groups and HTA bodies were reviewed. From the 686 studies included in the narrative synthesis, 48 critical appraisal tools were identified. Commonly used tools included the Newcastle-Ottawa Scale, the methodological index for NRS, and bespoke appraisal tools. Neither the Cochrane Handbook nor the Centre for Reviews and Dissemination recommends a particular instrument for the assessment of risk of bias in NRS, although Cochrane has recently developed their own NRS critical appraisal tool. Among HTA bodies, only the Canadian Agency for Drugs and Technologies in Health recommends use of a specific critical appraisal tool-SIGN 50 (for cohort or case-control studies). Several criteria including reporting, external validity, confounding, and power were examined. There is no consensus between HTA groups on the preferred appraisal tool. Reviewers should select from a suite of tools on the basis of the design of studies included in their review. © 2018 John Wiley & Sons, Ltd.

Social Support and Supervisory Quality Interventions in the Workplace: A Stakeholder-Centered Best-Evidence Synthesis of Systematic Reviews on Work Outcomes.

PubMed

Wagner, S L; White, M I; Schultz, I Z; Williams-Whitt, K; Koehn, C; Dionne, C E; Koehoorn, M; Harder, H G; Pasca, R; Wärje, O; Hsu, V; McGuire, L; Lama, I; Schulz, W; Kube, D; Wright, M D

2015-10-01

There is controversy surrounding the impact of workplace interventions aimed at improving social support and supervisory quality on absenteeism, productivity and financial outcomes. To determine the value of social support interventions for work outcomes. Databases were searched for systematic reviews between 2000 and 2012 to complete a synthesis of systematic reviews guided by the PRISMA statement and the IOM guidelines for systematic reviews. Assessment of articles for inclusion and methodological quality was conducted independently by at least two researchers, with differences resolved by consensus. The search resulted in 3363 titles of which 3248 were excluded following title/abstract review, leaving 115 articles that were retrieved and underwent full article review. 10 articles met the set inclusion criteria, with 7 focusing on social support, 2 on supervisory quality and 1 on both. We found moderate and limited evidence, respectively, that social support and supervisory quality interventions positively impact workplace outcomes. There is moderate evidence that social support and limited evidence that supervisory quality interventions have a positive effect on work outcomes.

The Quality of Systematic Reviews in Head and Neck Microsurgery: A Perspective from Plastic Surgery and Otolaryngology.

PubMed

Sun, Beatrice J; Tijerina, Jonathan; Nazerali, Rahim S; Lee, Gordon K

2018-05-01

In recent years, there has been a push to publish higher level of evidence studies in medicine, particularly in plastic surgery. Well-conducted systematic reviews are considered the strongest level of evidence in medicine, recently becoming the key process indicators for quality delivery. A varying quality of systematic reviews, however, has led to concerns of their validity in clinical decision-making. We perform a quality analysis of systematic reviews published in head and neck microsurgery by the surgical specialties of plastic surgery and otolaryngology. An evaluation of systematic reviews published on microsurgery in 13 high-impact surgical journals was conducted by searching PubMed and Scopus. Two authors independently performed searches, screened for eligibility, and extracted data from included articles. Discrepancies were resolved by discussion and consensus. Assessment of Multiple Systematic Reviews (AMSTAR) criteria were used to assess methodological quality. The initial database search retrieved 166 articles. After removing duplicates, screening titles and abstracts, 26 articles remained for full text review. Seven did not focus on head and neck microsurgery and were further excluded, leaving 19 systematic reviews for final analysis. Of those, 10 systematic reviews were published by otolaryngology, and 9 were published by plastic surgery. Median AMSTAR score was 8 for otolaryngology, 7 for plastic surgery, and 8 overall, reflecting "fair to good" quality. The number of systematic reviews on head and neck microsurgery markedly increased over time. Of note, both the AMSTAR score and the number of systematic reviews published by plastic surgery have steadily increased from 2014 to 2016, whereas those published by otolaryngology have remained relatively stable since 2010. Our review shows a trend toward publishing more systematic reviews. The increasing quantity and quality of systematic reviews published by plastic surgeons indicates recognition in the need for higher levels of evidence in plastic surgery, as well as growing interest and advances in microsurgery. Given these trends, familiarity with quality assessment guidelines, such as AMSTAR, will remain important in providing a basis for building relevant value-based quality measures.

The outcomes of recent patient safety education interventions for trainee physicians and medical students: a systematic review

PubMed Central

Kirkman, Matthew A; Sevdalis, Nick; Arora, Sonal; Baker, Paul; Vincent, Charles; Ahmed, Maria

2015-01-01

Objective To systematically review the latest evidence for patient safety education for physicians in training and medical students, updating, extending and improving on a previous systematic review on this topic. Design A systematic review. Data sources Embase, Ovid Medline and PsycINFO databases. Study selection Studies including an evaluation of patient safety training interventions delivered to trainees/residents and medical students published between January 2009 and May 2014. Data extraction The review was performed using a structured data capture tool. Thematic analysis also identified factors influencing successful implementation of interventions. Results We identified 26 studies reporting patient safety interventions: 11 involving students and 15 involving trainees/residents. Common educational content included a general overview of patient safety, root cause/systems-based analysis, communication and teamwork skills, and quality improvement principles and methodologies. The majority of courses were well received by learners, and improved patient safety knowledge, skills and attitudes. Moreover, some interventions were shown to result in positive behaviours, notably subsequent engagement in quality improvement projects. No studies demonstrated patient benefit. Availability of expert faculty, competing curricular/service demands and institutional culture were important factors affecting implementation. Conclusions There is an increasing trend for developing educational interventions in patient safety delivered to trainees/residents and medical students. However, significant methodological shortcomings remain and additional evidence of impact on patient outcomes is needed. While there is some evidence of enhanced efforts to promote sustainability of such interventions, further work is needed to encourage their wider adoption and spread. PMID:25995240

Post-trial follow-up methodology in large randomized controlled trials: a systematic review protocol.

PubMed

Llewellyn-Bennett, Rebecca; Bowman, Louise; Bulbulia, Richard

2016-12-15

Clinical trials typically have a relatively short follow-up period, and may both underestimate potential benefits of treatments investigated, and fail to detect hazards, which can take much longer to emerge. Prolonged follow-up of trial participants after the end of the scheduled trial period can provide important information on both efficacy and safety outcomes. This protocol describes a systematic review to qualitatively compare methods of post-trial follow-up used in large randomized controlled trials. A systematic search of electronic databases and clinical trial registries will use a predefined search strategy. All large (more than 1000 adult participants) randomized controlled trials will be evaluated. Two reviewers will screen and extract data according to this protocol with the aim of 95% concordance of papers checked and discrepancies will be resolved by a third reviewer. Trial methods, participant retention rates and prevalence of missing data will be recorded and compared. The potential for bias will be evaluated using the Cochrane Risk of Bias tool (applied to the methods used during the in-trial period) with the aim of investigating whether the quality of the post-trial follow-up methodology might be predicted by the quality of the methods used for the original trial. Post-trial follow-up can provide valuable information about the long-term benefits and hazards of medical interventions. However, it can be logistically challenging and costly. The aim of this systematic review is to describe how trial participants have been followed-up post-trial in order to inform future post-trial follow-up designs. Not applicable for PROSPERO registration.

An Integrated Methodology to Assess Compliance with Delphi Survey Key Components of Yoga Interventions for Musculoskeletal Conditions as Applied in a Systematic Review of Fibromyalgia Studies.

PubMed

Fischer-White, Tamara G; Anderson, Joel G; Taylor, Ann Gill

2016-01-01

The objective of this article was to present a methodology incorporating existing guidelines and tools for systematic reviews and to evaluate the Delphi survey 33 key component recommendations of yoga interventions for musculoskeletal conditions as a tool for a systematic review in fibromyalgia studies. Databases searched included PubMed, Ovid Medline, PsychINFO, the Cochrane Library, CINAHL, ALT HealthWatch, PEDro, and Web of Science. Selected were articles published between November 14, 2004 and November 13, 2014, written in English, reporting original research of yoga interventions for adults with fibromyalgia. Six articles met the inclusion criteria, revealing that three yoga styles ("Relaxing" yoga, Yoga of Awareness, and Hatha yoga) have been assessed in persons with fibromyalgia. Overall, reporting compliance with the 33 key components ranged from 39.4% to 84.8%, with a mean adherence rate of 62.63% ± 17.74. None of the authors used an accepted reporting guideline; specific components of asana, pranayama, relaxation, and mindfulness practices that would have been incorporated into the interventions tested were identified in only 33.33% of the articles reviewed; and none of the articles included detailed, replicable descriptions of the interventions. This systematic review supports the need for comprehensive yoga research guidelines. Findings reveal a lack of reporting of intervention details, the need to report a disease-specific rationale for selection of the particular yoga style used for the intervention, and that a limited number of yoga styles have been investigated in persons with fibromyalgia. Copyright © 2016 Elsevier Inc. All rights reserved.

Physical examination tests for the diagnosis of posterior cruciate ligament rupture: a systematic review.

PubMed

Kopkow, Christian; Freiberg, Alice; Kirschner, Stephan; Seidler, Andreas; Schmitt, Jochen

2013-11-01

Systematic literature review. To summarize and evaluate research on the accuracy of physical examination tests for diagnosis of posterior cruciate ligament (PCL) tear. Rupture of the PCL is a severe knee injury that can lead to delayed rehabilitation, instability, or chronic knee pathologies. To our knowledge, there is currently no systematic review of studies on the diagnostic accuracy of clinical examination tests to evaluate the integrity of the PCL. A comprehensive systematic literature search was conducted in MEDLINE from 1946, Embase from 1974, and the Allied and Complementary Medicine Database from 1985 until April 30, 2012. Studies were considered eligible if they compared the results of physical examination tests performed in the context of a PCL physical examination to those of a reference standard (arthroscopy, arthrotomy, magnetic resonance imaging). Methodological quality assessment was performed by 2 independent reviewers using the revised version of the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. The search strategy revealed 1307 articles, of which 11 met the inclusion criteria for this review. In these studies, 11 different physical examination tests were identified. Due to differences in study types, different patient populations, and methodological quality, meta-analysis was not indicated. Presently, most physical examination tests have not been evaluated sufficiently enough to be confident in their ability to either confirm or rule out a PCL tear. The diagnostic accuracy of physical examination tests to assess the integrity of the PCL is largely unknown. There is a strong need for further research in this area. Level of Evidence Diagnosis, level 3a.

Methods for the guideline-based development of quality indicators--a systematic review

PubMed Central

2012-01-01

Background Quality indicators (QIs) are used in many healthcare settings to measure, compare, and improve quality of care. For the efficient development of high-quality QIs, rigorous, approved, and evidence-based development methods are needed. Clinical practice guidelines are a suitable source to derive QIs from, but no gold standard for guideline-based QI development exists. This review aims to identify, describe, and compare methodological approaches to guideline-based QI development. Methods We systematically searched medical literature databases (Medline, EMBASE, and CINAHL) and grey literature. Two researchers selected publications reporting methodological approaches to guideline-based QI development. In order to describe and compare methodological approaches used in these publications, we extracted detailed information on common steps of guideline-based QI development (topic selection, guideline selection, extraction of recommendations, QI selection, practice test, and implementation) to predesigned extraction tables. Results From 8,697 hits in the database search and several grey literature documents, we selected 48 relevant references. The studies were of heterogeneous type and quality. We found no randomized controlled trial or other studies comparing the ability of different methodological approaches to guideline-based development to generate high-quality QIs. The relevant publications featured a wide variety of methodological approaches to guideline-based QI development, especially regarding guideline selection and extraction of recommendations. Only a few studies reported patient involvement. Conclusions Further research is needed to determine which elements of the methodological approaches identified, described, and compared in this review are best suited to constitute a gold standard for guideline-based QI development. For this research, we provide a comprehensive groundwork. PMID:22436067

Complementary and alternative medicine for lowering blood lipid levels: A systematic review of systematic reviews.

PubMed

Posadzki, Paul; AlBedah, Abdullah M N; Khalil, Mohamed M K; AlQaed, Meshari S

2016-12-01

The aim of this article is to summarize and critically evaluate the evidence from systematic reviews (SRs) of complementary and alternative medicine (CAM) for lowering blood lipid levels (BLL). Eight electronic databases were searched until March 2016. Additionally, all the retrieved references were inspected manually for further relevant papers. Systematic reviews were considered eligible, if they included patients of any age and/or gender with elevated blood lipid levels using any type of CAM. We used the Oxman and AMSTAR criteria to critically appraise the methodological quality of the included SRs. Twenty-seven SRs were included in the analyses. The majority of the SRs were of high methodological quality (mean Oxman score=4.81, SD=4.88; and the mean AMSTAR score=7.22, SD=3.38). The majority of SRs (56%) arrived at equivocal conclusions (of these 8 were of high quality); 7 SRs (37%) arrived at positive conclusions (of these 6 were of high quality), and 2 (7%) arrived at negative conclusions (both were of high quality). There was conflicting evidence regarding the effectiveness of garlic; and promising evidence for yoga. To conclude, the evidence from SRs evaluating the effectiveness of CAM in lowering BLL is predominantly equivocal and confusing. Several limitations exist, such as variety of doses and preparations, confounding effects of diets and lifestyle factors, or heterogeneity of the primary trials among others. Copyright © 2016. Published by Elsevier Ltd.

A Systematic Scoping Review of Yoga Intervention Components and Study Quality

PubMed Central

Elwy, A. Rani; Groessl, Erik J.; Eisen, Susan V.; Riley, Kristen; Maiya, Meghan; Lee, Jennifer P.; Sarkin, Andrew; Park, Crystal L.

2014-01-01

Context The scientific study of yoga requires rigorous methodology. This review aimed to systematically assess all studies of yoga interventions to: (1) determine yoga intervention characteristics; (2) examine methodologic quality of the subset of RCTs; and (3) explore how well these interventions are reported. Evidence acquisition Searches were conducted through April 2012 in PubMed, PsycInfo, Ageline, and Ovid’s Alternative and Complementary Medicine database using the text term yoga, and through handsearching five journals. Original studies were included if the intervention: (1) consisted of at least one yoga session with some type of health assessment; (2) targeted adults age ≥18 years; (3) was published in an English language peer–reviewed journal; and (4) was available for review. Evidence synthesis Of 3,062 studies identified, 465 studies in 30 countries were included. Analyses were conducted through 2013. Most interventions took place in India (n=228) or the U.S. (n=124), with intensity ranging from a single yoga session up to two sessions per day. Intervention lengths ranged from one session to 2 years. Asanas (poses) were mentioned as yoga components in 369 (79%) interventions, but were either minimally or not at all described in 200 (54%) of these. Most interventions (74%, n=336) did not include home practice. Of the included studies, 151 were RCTs. RCT quality was rated as poor. Conclusions This review highlights the inadequate reporting and methodologic limitations of current yoga intervention research, which limits study interpretation and comparability. Recommendations for future methodology and reporting are discussed. PMID:24996759

Systematic reviews of diagnostic tests in endocrinology: an audit of methods, reporting, and performance.

PubMed

Spencer-Bonilla, Gabriela; Singh Ospina, Naykky; Rodriguez-Gutierrez, Rene; Brito, Juan P; Iñiguez-Ariza, Nicole; Tamhane, Shrikant; Erwin, Patricia J; Murad, M Hassan; Montori, Victor M

2017-07-01

Systematic reviews provide clinicians and policymakers estimates of diagnostic test accuracy and their usefulness in clinical practice. We identified all available systematic reviews of diagnosis in endocrinology, summarized the diagnostic accuracy of the tests included, and assessed the credibility and clinical usefulness of the methods and reporting. We searched Ovid MEDLINE, EMBASE, and Cochrane CENTRAL from inception to December 2015 for systematic reviews and meta-analyses reporting accuracy measures of diagnostic tests in endocrinology. Experienced reviewers independently screened for eligible studies and collected data. We summarized the results, methods, and reporting of the reviews. We performed subgroup analyses to categorize diagnostic tests as most useful based on their accuracy. We identified 84 systematic reviews; half of the tests included were classified as helpful when positive, one-fourth as helpful when negative. Most authors adequately reported how studies were identified and selected and how their trustworthiness (risk of bias) was judged. Only one in three reviews, however, reported an overall judgment about trustworthiness and one in five reported using adequate meta-analytic methods. One in four reported contacting authors for further information and about half included only patients with diagnostic uncertainty. Up to half of the diagnostic endocrine tests in which the likelihood ratio was calculated or provided are likely to be helpful in practice when positive as are one-quarter when negative. Most diagnostic systematic reviews in endocrine lack methodological rigor, protection against bias, and offer limited credibility. Substantial efforts, therefore, seem necessary to improve the quality of diagnostic systematic reviews in endocrinology.

Guidance for updating clinical practice guidelines: a systematic review of methodological handbooks.

PubMed

Vernooij, Robin W M; Sanabria, Andrea Juliana; Solà, Ivan; Alonso-Coello, Pablo; Martínez García, Laura

2014-01-02

Updating clinical practice guidelines (CPGs) is a crucial process for maintaining the validity of recommendations. Methodological handbooks should provide guidance on both developing and updating CPGs. However, little is known about the updating guidance provided by these handbooks. We conducted a systematic review to identify and describe the updating guidance provided by CPG methodological handbooks and included handbooks that provide updating guidance for CPGs. We searched in the Guidelines International Network library, US National Guidelines Clearinghouse and MEDLINE (PubMed) from 1966 to September 2013. Two authors independently selected the handbooks and extracted the data. We used descriptive statistics to analyze the extracted data and conducted a narrative synthesis. We included 35 handbooks. Most handbooks (97.1%) focus mainly on developing CPGs, including variable degrees of information about updating. Guidance on identifying new evidence and the methodology of assessing the need for an update is described in 11 (31.4%) and eight handbooks (22.8%), respectively. The period of time between two updates is described in 25 handbooks (71.4%), two to three years being the most frequent (40.0%). The majority of handbooks do not provide guidance for the literature search, evidence selection, assessment, synthesis, and external review of the updating process. Guidance for updating CPGs is poorly described in methodological handbooks. This guidance should be more rigorous and explicit. This could lead to a more optimal updating process, and, ultimately to valid trustworthy guidelines.

The clinico-radiological paradox of cognitive function and MRI burden of white matter lesions in people with multiple sclerosis: A systematic review and meta-analysis.

PubMed

Mollison, Daisy; Sellar, Robin; Bastin, Mark; Mollison, Denis; Chandran, Siddharthan; Wardlaw, Joanna; Connick, Peter

2017-01-01

Moderate correlation exists between the imaging quantification of brain white matter lesions and cognitive performance in people with multiple sclerosis (MS). This may reflect the greater importance of other features, including subvisible pathology, or methodological limitations of the primary literature. To summarise the cognitive clinico-radiological paradox and explore the potential methodological factors that could influence the assessment of this relationship. Systematic review and meta-analysis of primary research relating cognitive function to white matter lesion burden. Fifty papers met eligibility criteria for review, and meta-analysis of overall results was possible in thirty-two (2050 participants). Aggregate correlation between cognition and T2 lesion burden was r = -0.30 (95% confidence interval: -0.34, -0.26). Wide methodological variability was seen, particularly related to key factors in the cognitive data capture and image analysis techniques. Resolving the persistent clinico-radiological paradox will likely require simultaneous evaluation of multiple components of the complex pathology using optimum measurement techniques for both cognitive and MRI feature quantification. We recommend a consensus initiative to support common standards for image analysis in MS, enabling benchmarking while also supporting ongoing innovation.

A systematic review on the affordability of a healthful diet for families in the United States.

PubMed

Horning, Melissa L; Fulkerson, Jayne A

2015-01-01

As obesity rates remain alarmingly high, the importance of healthful diets is emphasized; however, affordability of such diets is disputed. Market basket surveys (MBSs) investigate the affordability of diets for families that meet minimum daily dietary requirements using actual food prices from grocery stores. This review paper describes the methods of MBSs, summarizes methodology, price and affordability findings, limitations, and suggests related policy and practice implications. This is a systematic review of 16 MBSs performed in the United States from 1985 to 2012. A comprehensive multidisciplinary database search strategy was used to identify articles meeting inclusion criteria. Results indicated MBS methodology varied across studies and price data indicated healthful diets for families are likely unaffordable when purchased from small- to medium-sized stores and may be unaffordable in larger stores when compared to the Thrifty Food Plan. Using a social ecological approach, public health nurses and all public health professionals are prime advocates for increased affordability of healthful foods. This study includes policy advocacy, particularly in support of Supplemental Nutrition Assistance Program benefits for low-income families. Future research implications are provided, including methodological recommendations for consistency and quality of forthcoming MBS research. © 2014 Wiley Periodicals, Inc.

Prevalence of self-medication in the adult population of Brazil: a systematic review

PubMed Central

Domingues, Paulo Henrique Faria; Galvão, Taís Freire; de Andrade, Keitty Regina Cordeiro; de Sá, Pedro Terra Teles; Silva, Marcus Tolentino; Pereira, Mauricio Gomes

2015-01-01

OBJECTIVE To evaluate the prevalence of self-medication in Brazil’s adult population. METHODS Systematic review of cross-sectional population-based studies. The following databases were used: Medline, Embase, Scopus, ISI, CINAHL, Cochrane Library, CRD, Lilacs, SciELO, the Banco de teses brasileiras (Brazilian theses database) (Capes) and files from the Portal Domínio Público (Brazilian Public Domain). In addition, the reference lists from relevant studies were examined to identify potentially eligible articles. There were no applied restrictions in terms of the publication date, language or publication status. Data related to publication, population, methods and prevalence of self-medication were extracted by three independent researchers. Methodological quality was assessed following eight criteria related to sampling, measurement and presentation of results. The prevalences were measured from participants who used at least one medication during the recall period of the studies. RESULTS The literature screening identified 2,778 records, from which 12 were included for analysis. Most studies were conducted in the Southeastern region of Brazil, after 2000 and with a 15-day recall period. Only five studies achieved high methodological quality, of which one study had a 7-day recall period, in which the prevalence of self-medication was 22.9% (95%CI 14.6;33.9). The prevalence of self-medication in three studies of high methodological quality with a 15-day recall period was 35.0% (95%CI 29.0;40.0, I2 = 83.9%) in the adult Brazilian population. CONCLUSIONS Despite differences in the methodologies of the included studies, the results of this systematic review indicate that a significant proportion of the adult Brazilian population self-medicates. It is suggested that future research projects that assess self-medication in Brazil standardize their methods. PMID:26083944

Cochrane Rehabilitation Methodology Committee: an international survey of priorities for future work.

PubMed

Levack, William M; Meyer, Thorsten; Negrini, Stefano; Malmivaara, Antti

2017-10-01

Cochrane Rehabilitation aims to improve the application of evidence-based practice in rehabilitation. It also aims to support Cochrane in the production of reliable, clinically meaningful syntheses of evidence related to the practice of rehabilitation, while accommodating the many methodological challenges facing the field. To this end, Cochrane Rehabilitation established a Methodology Committee to examine, explore and find solutions for the methodological challenges related to evidence synthesis and knowledge translation in rehabilitation. We conducted an international online survey via Cochrane Rehabilitation networks to canvass opinions regarding the future work priorities for this committee and to seek information on people's current capabilities to assist with this work. The survey findings indicated strongest interest in work on how reviewers have interpreted and applied Cochrane methods in reviews on rehabilitation topics in the past, and on gathering a collection of existing publications on review methods for undertaking systematic reviews relevant to rehabilitation. Many people are already interested in contributing to the work of the Methodology Committee and there is a large amount of expertise for this work in the extended Cochrane Rehabilitation network already.

Improving utility of evidence synthesis for healthy public policy: the three Rs (relevance, rigor, and readability [and resources]).

PubMed

Thomson, Hilary

2013-08-01

Systematic reviews have the potential to promote knowledge exchange between researchers and decision-makers. Review planning requires engagement with evidence users to ensure preparation of relevant reviews, and well-conducted reviews should provide accessible and reliable synthesis to support decision-making. Yet, systematic reviews are not routinely referred to by decision-makers, and innovative approaches to improve the utility of reviews is needed. Evidence synthesis for healthy public policy is typically complex and methodologically challenging. Although not lessening the value of reviews, these challenges can be overwhelming and threaten their utility. Using the interrelated principles of relevance, rigor, and readability, and in light of available resources, this article considers how utility of evidence synthesis for healthy public policy might be improved.

Improving Utility of Evidence Synthesis for Healthy Public Policy: the Three Rs (Relevance, Rigor, and Readability [and Resources])

PubMed Central

2013-01-01

Systematic reviews have the potential to promote knowledge exchange between researchers and decision-makers. Review planning requires engagement with evidence users to ensure preparation of relevant reviews, and well-conducted reviews should provide accessible and reliable synthesis to support decision-making. Yet, systematic reviews are not routinely referred to by decision-makers, and innovative approaches to improve the utility of reviews is needed. Evidence synthesis for healthy public policy is typically complex and methodologically challenging. Although not lessening the value of reviews, these challenges can be overwhelming and threaten their utility. Using the interrelated principles of relevance, rigor, and readability, and in light of available resources, this article considers how utility of evidence synthesis for healthy public policy might be improved. PMID:23763400

Clinical relevance in anesthesia journals.

PubMed

Lauritsen, Jakob; Møller, Ann M

2006-04-01

The purpose of this review is to present the latest knowledge and research on the definition and distribution of clinically relevant articles in anesthesia journals. It will also discuss the importance of the chosen methodology and outcome of articles. In the last few years, more attention has been paid to evidence-based medicine in anesthesia. Several articles on the subject have focused on the need to base clinical decisions on sound research employing both methodological rigor and clinically relevant outcomes. The number of systematic reviews in anesthesia literature is increasing as well as the focus on diminishing the number of surrogate outcomes. It has been shown that the impact factor is not a valid measure of establishing the level of clinical relevance to a journal. This review presents definitions of clinically relevant anesthesia articles. A clinically relevant article employs both methodological rigor and a clinically relevant outcome. The terms methodological rigor and clinical outcomes are fully discussed in the review as well as problems with journal impact factors.

Health effects of training laypeople to deliver emergency care in underserviced populations: a systematic review protocol.

PubMed

Orkin, Aaron M; Curran, Jeffrey D; Fortune, Melanie K; McArthur, Allison; Mew, Emma J; Ritchie, Stephen D; Van de Velde, Stijn; VanderBurgh, David

2016-05-18

The Disease Control Priorities Project recommends emergency care training for laypersons in low-resource settings, but evidence for these interventions has not yet been systematically reviewed. This review will identify the individual and community health effects of educating laypeople to deliver prehospital emergency care interventions in low-resource settings. This systematic review addresses the following question: in underserviced populations and low-resource settings (P), does first aid or emergency care training or education for laypeople (I) confer any individual or community health benefit for emergency health conditions (O), in comparison with no training or other forms of education (C)? We restrict this review to studies reporting quantitatively measurable outcomes, and search 12 electronic bibliographic databases and grey literature sources. A team of expert content and methodology reviewers will conduct title and abstract screening and full-text review, using a custom-built online platform. Two investigators will independently extract methodological variables and outcomes related to patient-level morbidity and mortality and community-level effects on resilience or emergency care capacity. Two investigators will independently assess external validity, selection bias, performance bias, measurement bias, attrition bias and confounding. We will summarise the findings using a narrative approach to highlight similarities and differences between the gathered studies. Formal ethical approval is not required. The results will be disseminated through a peer-reviewed publication and knowledge translation strategy. CRD42014009685. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Evidence of the clinical effectiveness of cognitive pharmaceutical services for aged patients.

PubMed

Sáez-Benito, Loreto; Fernandez-Llimos, Fernando; Feletto, Eleonora; Gastelurrutia, Miguel Angel; Martinez-Martinez, Fernando; Benrimoj, Shalom I

2013-07-01

cognitive pharmaceutical services (CPSs) encompass a variety of pharmacists' interventions to optimise pharmacotherapy. The clinical effectiveness of CPSs for aged patients remains controversial. to analyse and describe the evidence of the clinical effectiveness of CPSs in aged patients by means of performing a systematic review of systematic reviews. using the recommended methodology by Cochrane, a search was undertaken for systematic reviews of the clinical effectiveness of CPSs in MEDLINE, EMBASE, DOAJ, SCIELO and COCHRANE LIBRARY. Reviews were assessed using the Assessment of Multiple Systematic Reviews (AMSTAR) instrument. Quality of the evidence in the reviews was ranked using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. a total of 14 systematic reviews and one meta-analysis were analysed. The overall quality of the reviews was moderate. High and moderate strength of evidence was found for the positive effect of certain CPSs on reducing the number and improving the appropriateness of medicines. There was conflicting evidence of the effect on adherence. There was limited evidence of high and moderate strength on clinical outcomes. No positive evidence was found on mortality, hospitalisations, functional capacity and cognitive function. No systematic reviews reported the effect on the level of control of health problems. certain types of CPSs reduce the number of medicines and improve the appropriateness of prescriptions. Longer follow-up periods and/or the use of surrogate clinical variables measuring the short-term impact are required to demonstrate the effect on clinical outcomes.

Reflections on International Comparative Education Survey Methodology: A Case Study of the European Survey on Language Competences

ERIC Educational Resources Information Center

Ashton, Karen

2016-01-01

This paper reflects on the methodology used in international comparative education surveys by conducting a systematic review of the European Survey on Language Competences (ESLC). The ESLC was administered from February to March 2011, with final results released in June 2012. The survey tested approximately 55,000 students across 14 European…

The use of Lean and Six Sigma methodologies in surgery: a systematic review.

PubMed

Mason, S E; Nicolay, C R; Darzi, A

2015-04-01

Lean and Six Sigma are improvement methodologies developed in the manufacturing industry and have been applied to healthcare settings since the 1990 s. They use a systematic and reproducible approach to provide Quality Improvement (QI), with a flexible process that can be applied to a range of outcomes across different patient groups. This review assesses the literature with regard to the use and utility of Lean and Six Sigma methodologies in surgery. MEDLINE, Embase, PsycINFO, Allied and Complementary Medicine Database, British Nursing Index, Cumulative Index to Nursing and Allied Health Literature, Health Business Elite and the Health Management Information Consortium were searched in January 2014. Experimental studies were included if they assessed the use of Lean or Six Sigma on the ability to improve specified outcomes in surgical patients. Of the 124 studies returned, 23 were suitable for inclusion with 11 assessing Lean, 6 Six Sigma and 6 Lean Six Sigma. The broad range of outcomes can be collated into six common aims: to optimise outpatient efficiency, to improve operating theatre efficiency, to decrease operative complications, to reduce ward-based harms, to reduce mortality and to limit unnecessary cost and length of stay. The majority of studies (88%) demonstrate improvement; however high levels of systematic bias and imprecision were evident. Lean and Six Sigma QI methodologies have the potential to produce clinically significant improvement for surgical patients. However there is a need to conduct high-quality studies with low risk of systematic bias in order to further understand their role. Copyright © 2014 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

Animal models for studying homeopathy and high dilutions: conceptual critical review.

PubMed

Bonamin, Leoni Villano; Endler, Peter Christian

2010-01-01

This is a systematic review of the animal models used in studies of high dilutions. The objectives are to analyze methodological quality of papers and reported results, and to highlight key conceptual aspects of high dilution to suggest clues concerning putative mechanisms of action. Papers for inclusion were identified systematically, from the Pubmed-Medline database, using 'Homeopathy' and 'Animal' as keywords. Only original full papers in English published between January 1999 and June 2009 were included, reviews, scientific reports, thesis, older papers, papers extracted from Medline using similar keywords, papers about mixed commercial formulas and books were also considered for discussion only. 31 papers describing 33 experiments were identified for the main analysis and a total of 89 items cited. Systematic analysis of the selected papers yielded evidence of some important intrinsic features of high dilution studies performed in animal models: a) methodological quality was generally adequate, some aspects could be improved; b) convergence between results and materia medica is seen in some studies, pointing toward to the possibility of systematic study of the Similia principle c) both isopathic and Similia models seem useful to understand some complex biological phenomena, such as parasite-host interactions; d) the effects of high dilutions seem to stimulate restoration of a 'stable state', as seen in several experimental models from both descriptive and mathematical points of view. Copyright 2009 The Faculty of Homeopathy. Published by Elsevier Ltd. All rights reserved.

Methodological Considerations in Social Cost Studies of Addictive Substances: A Systematic Literature Review.

PubMed

Verhaeghe, Nick; Lievens, Delfine; Annemans, Lieven; Vander Laenen, Freya; Putman, Koen

2016-01-01

Alcohol, tobacco, illicit drugs, and psychoactive pharmaceuticals' use is associated with a higher likelihood of developing several diseases and injuries and, as a consequence, considerable health-care expenditures. There is yet a lack of consistent methodologies to estimate the economic impact of addictive substances to society. The aim was to assess the methodological approaches applied in social cost studies estimating the economic impact of alcohol, tobacco, illicit drugs, and psychoactive pharmaceuticals. A systematic literature review through the electronic databases, Medline (PubMed) and Web of Science, was performed. Studies in English published from 1997 examining the social costs of the addictive substances alcohol, tobacco, illicit drugs, and psychoactive pharmaceuticals were eligible for inclusion. Twelve social cost studies met the inclusion criteria. In all studies, the direct and indirect costs were measured, but the intangible costs were seldom taken into account. A wide variety in cost items included across studies was observed. Sensitivity analyses to address the uncertainty around certain cost estimates were conducted in eight studies considered in the review. Differences in cost items included in cost-of-illness studies limit the comparison across studies. It is clear that it is difficult to deal with all consequences of substance use in cost-of-illness studies. Future social cost studies should be based on sound methodological principles in order to result in more reliable cost estimates of the economic burden of substance use.

Impact of rehabilitation on self-concept following traumatic brain injury: An exploratory systematic review of intervention methodology and efficacy.

PubMed

Ownsworth, Tamara; Haslam, Catherine

2016-01-01

To date, reviews of rehabilitation efficacy after traumatic brain injury (TBI) have overlooked the impact on sense of self, focusing instead on functional impairment and psychological distress. The present review sought to address this gap by critically appraising the methodology and efficacy of intervention studies that assess changes in self-concept. A systematic search of PsycINFO, Medline, CINAHL and PubMed was conducted from inception to September 2013 to identify studies reporting pre- and post-intervention changes on validated measures of self-esteem or self-concept in adults with TBI. Methodological quality of randomised controlled trials (RCTs) was examined using the Physiotherapy Evidence Database (PEDro) scale. A total of 17 studies (10 RCTs, 4 non-RCT group studies, 3 case studies) was identified, which examined the impact of psychotherapy, family-based support, cognitive rehabilitation or activity-based interventions on self-concept. The findings on the efficacy of these interventions were mixed, with only 10 studies showing some evidence of improvement in self-concept based on within-group or pre-post comparisons. Such findings highlight the need for greater focus on the impact of rehabilitation on self-understanding with improved assessment and intervention methodology. We draw upon theories of identity reconstruction and highlight implications for the design and evaluation of identity-oriented interventions that can supplement existing rehabilitation programmes for people with TBI.

Effectiveness of preventive and treatment interventions for primary headaches in the workplace: A systematic review of the literature.

PubMed

Lardon, Arnaud; Girard, Marie-Pier; Zaïm, Chérine; Lemeunier, Nadège; Descarreaux, Martin; Marchand, Andrée-Anne

2017-01-01

Aim The purpose of this systematic literature review is to assess the benefits of workplace-based occupational therapies and interventions, including acute and preventive medication, on headache intensity and frequency, related disability as well as work-related outcomes. Methods A search of the literature was conducted in PubMed, MEDLINE, Cochrane library, CINAHL and Embase using terms related to headache, workplace and occupational health. The Cochrane Collaboration's risk of bias assessment tool was used on individual studies to assess internal validity and the Grading of Recommendations Assessment, Development, and Evaluation system was applied to studies by clinical outcome and used to rate quality of evidence. Results Fifteen articles were included in the systematic review. None of them were classified as low risk of bias according to the Cochrane Collaboration's tool for assessing risk of bias. This systematic review found preliminary low-quality evidence suggesting that exercise and acupuncture can reduce workers' headache pain intensity, frequency and related disability. Conclusion Although this systematic review provided preliminary low evidence in favour of work-based intervention, studies with more rigorous designs and methodologies are needed to provide further evidence of the effectiveness of workplace-based headache management strategies.

Behaviour change counselling for tobacco use cessation and promotion of healthy lifestyles: a systematic review.

PubMed

Ramseier, Christoph A; Suvan, Jean E

2015-04-01

To systematically assess the efficacy of oral health behaviour change counselling for tobacco use cessation (TUC) and the promotion of healthy lifestyles. Systematic Reviews, Randomized (RCTs), and Controlled Clinical Trials (CCTs) were identified through an electronic search of four databases complemented by manual search. Identification, screening, eligibility and inclusion of studies were performed independently by two reviewers. Quality assessment of the included publications was performed according to the AMSTAR tool for the assessment of the methodological quality of systematic reviews. A total of seven systematic reviews were included. With the exception of inadequate oral hygiene, the following unhealthy lifestyles related with periodontal diseases were investigated: tobacco use, unhealthy diets, harmful use of alcohol, physical inactivity, and stress. Brief interventions for TUC were shown to be effective when applied in the dental practice setting while evidence for dietary counselling and the promotion of other healthy lifestyles was limited or non-existent. While aiming to improve periodontal treatment outcomes and the maintenance of periodontal health current evidence suggests that tobacco use brief interventions conducted in the dental practice setting were effective thus underlining the rational for behavioural support. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Is grey literature essential for a better control of publication bias in psychiatry? An example from three meta-analyses of schizophrenia.

PubMed

Martin, José Luis R; Pérez, Víctor; Sacristán, Montse; Alvarez, Enric

2005-12-01

Systematic reviews in mental health have become useful tools for health professionals in view of the massive amount and heterogeneous nature of biomedical information available today. In order to determine the risk of bias in the studies evaluated and to avoid bias in generalizing conclusions from the reviews it is therefore important to use a very strict methodology in systematic reviews. One bias which may affect the generalization of results is publication bias, which is determined by the nature and direction of the study results. To control or minimize this type of bias, the authors of systematic reviews undertake comprehensive searches of medical databases and expand on the findings, often undertaking searches of grey literature (material which is not formally published). This paper attempts to show the consequences (and risk) of generalizing the implications of grey literature in the control of publication bias, as was proposed in a recent systematic work. By repeating the analyses for the same outcome from three different systematic reviews that included both published and grey literature our results showed that confusion between grey literature and publication bias may affect the results of a concrete meta-analysis.

Maximizing the Impact of Systematic Reviews in Health Care Decision Making: A Systematic Scoping Review of Knowledge-Translation Resources

PubMed Central

Chambers, Duncan; Wilson, Paul M; Thompson, Carl A; Hanbury, Andria; Farley, Katherine; Light, Kate

2011-01-01

Context: Barriers to the use of systematic reviews by policymakers may be overcome by resources that adapt and present the findings in formats more directly tailored to their needs. We performed a systematic scoping review to identify such knowledge-translation resources and evaluations of them. Methods: Resources were eligible for inclusion in this study if they were based exclusively or primarily on systematic reviews and were aimed at health care policymakers at the national or local level. Resources were identified by screening the websites of health technology assessment agencies and systematic review producers, supplemented by an email survey. Electronic databases and proceedings of the Cochrane Colloquium and HTA International were searched as well for published and unpublished evaluations of knowledge-translation resources. Resources were classified as summaries, overviews, or policy briefs using a previously published classification. Findings: Twenty knowledge-translation resources were identified, of which eleven were classified as summaries, six as overviews, and three as policy briefs. Resources added value to systematic reviews by, for example, evaluating their methodological quality or assessing the reliability of their conclusions or their generalizability to particular settings. The literature search found four published evaluation studies of knowledge-translation resources, and the screening of abstracts and contact with authors found three more unpublished studies. The majority of studies reported on the perceived usefulness of the service, although there were some examples of review-based resources being used to assist actual decision making. Conclusions: Systematic review producers provide a variety of resources to help policymakers, of which focused summaries are the most common. More evaluations of these resources are required to ensure users’ needs are being met, to demonstrate their impact, and to justify their funding. PMID:21418315

Integrating teamwork, clinician occupational well-being and patient safety - development of a conceptual framework based on a systematic review.

PubMed

Welp, Annalena; Manser, Tanja

2016-07-19

There is growing evidence that teamwork in hospitals is related to both patient outcomes and clinician occupational well-being. Furthermore, clinician well-being is associated with patient safety. Despite considerable research activity, few studies include all three concepts, and their interrelations have not yet been investigated systematically. To advance our understanding of these potentially complex interrelations we propose an integrative framework taking into account current evidence and research gaps identified in a systematic review. We conducted a literature search in six major databases (Medline, PsycArticles, PsycInfo, Psyndex, ScienceDirect, and Web of Knowledge). Inclusion criteria were: peer reviewed papers published between January 2000 and June 2015 investigating a statistical relationship between at least two of the three concepts; teamwork, patient safety, and clinician occupational well-being in hospital settings, including practicing nurses and physicians. We assessed methodological quality using a standardized rating system and qualitatively appraised and extracted relevant data, such as instruments, analyses and outcomes. The 98 studies included in this review were highly diverse regarding quality, methodology and outcomes. We found support for the existence of independent associations between teamwork, clinician occupational well-being and patient safety. However, we identified several conceptual and methodological limitations. The main barrier to advancing our understanding of the causal relationships between teamwork, clinician well-being and patient safety is the lack of an integrative, theory-based, and methodologically thorough approach investigating the three concepts simultaneously and longitudinally. Based on psychological theory and our findings, we developed an integrative framework that addresses these limitations and proposes mechanisms by which these concepts might be linked. Knowledge about the mechanisms underlying the relationships between these concepts helps to identify avenues for future research, aimed at benefiting clinicians and patients by using the synergies between teamwork, clinician occupational well-being and patient safety.

Evaluation Studies of Robotic Rollators by the User Perspective: A Systematic Review.

PubMed

Werner, Christian; Ullrich, Phoebe; Geravand, Milad; Peer, Angelika; Hauer, Klaus

2016-01-01

Robotic rollators enhance the basic functions of established devices by technically advanced physical, cognitive, or sensory support to increase autonomy in persons with severe impairment. In the evaluation of such ambient assisted living solutions, both the technical and user perspectives are important to prove usability, effectiveness and safety, and to ensure adequate device application. The aim of this systematic review is to summarize the methodology of studies evaluating robotic rollators with focus on the user perspective and to give recommendations for future evaluation studies. A systematic literature search up to December 31, 2014, was conducted based on the Cochrane Review methodology using the electronic databases PubMed and IEEE Xplore. Articles were selected according to the following inclusion criteria: evaluation studies of robotic rollators documenting human-robot interaction, no case reports, published in English language. Twenty-eight studies were identified that met the predefined inclusion criteria. Large heterogeneity in the definitions of the target user group, study populations, study designs and assessment methods was found across the included studies. No generic methodology to evaluate robotic rollators could be identified. We found major methodological shortcomings related to insufficient sample descriptions and sample sizes, and lack of appropriate, standardized and validated assessment methods. Long-term use in habitual environment was also not evaluated. Apart from the heterogeneity, methodological deficits in most of the identified studies became apparent. Recommendations for future evaluation studies include: clear definition of target user group, adequate selection of subjects, inclusion of other assistive mobility devices for comparison, evaluation of the habitual use of advanced prototypes, adequate assessment strategy with established, standardized and validated methods, and statistical analysis of study results. Assessment strategies may additionally focus on specific functionalities of the robotic rollators allowing an individually tailored assessment of innovative features to document their added value. © 2016 S. Karger AG, Basel.

Systematic Review of the Application of Lean and Six Sigma Quality Improvement Methodologies in Radiology.

PubMed

Amaratunga, Thelina; Dobranowski, Julian

2016-09-01

Preventable yet clinically significant rates of medical error remain systemic, while health care spending is at a historic high. Industry-based quality improvement (QI) methodologies show potential for utility in health care and radiology because they use an empirical approach to reduce variability and improve workflow. The aim of this review was to systematically assess the literature with regard to the use and efficacy of Lean and Six Sigma (the most popular of the industrial QI methodologies) within radiology. MEDLINE, the Allied & Complementary Medicine Database, Embase Classic + Embase, Health and Psychosocial Instruments, and the Ovid HealthStar database, alongside the Cochrane Library databases, were searched on June 2015. Empirical studies in peer-reviewed journals were included if they assessed the use of Lean, Six Sigma, or Lean Six Sigma with regard to their ability to improve a variety of quality metrics in a radiology-centered clinical setting. Of the 278 articles returned, 23 studies were suitable for inclusion. Of these, 10 assessed Six Sigma, 7 assessed Lean, and 6 assessed Lean Six Sigma. The diverse range of measured outcomes can be organized into 7 common aims: cost savings, reducing appointment wait time, reducing in-department wait time, increasing patient volume, reducing cycle time, reducing defects, and increasing staff and patient safety and satisfaction. All of the included studies demonstrated improvements across a variety of outcomes. However, there were high rates of systematic bias and imprecision as per the Grading of Recommendations Assessment, Development and Evaluation guidelines. Lean and Six Sigma QI methodologies have the potential to reduce error and costs and improve quality within radiology. However, there is a pressing need to conduct high-quality studies in order to realize the true potential of these QI methodologies in health care and radiology. Recommendations on how to improve the quality of the literature are proposed. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand

PubMed Central

2013-01-01

Background Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. Methods A systematic search of 17 electronic databases and 13 websites for the period 1981–2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Results Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. Conclusions There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise. PMID:23663493

Effect of periodontal treatment on preterm birth rate: a systematic review of meta-analyses.

PubMed

López, Néstor J; Uribe, Sergio; Martinez, Benjamín

2015-02-01

Preterm birth is a major cause of neonatal morbidity and mortality in both developed and developing countries. Preterm birth is a highly complex syndrome that includes distinct clinical subtypes in which many different causes may be involved. The results of epidemiological, molecular, microbiological and animal-model studies support a positive association between maternal periodontal disease and preterm birth. However, the results of intervention studies carried out to determine the effect of periodontal treatment on reducing the risk of preterm birth are controversial. This systematic review critically analyzes the methodological issues of meta-analyses of the studies to determine the effect of periodontal treatment to reduce preterm birth. The quality of the individual randomized clinical trials selected is of highest relevance for a systematic review. This article describes the methodological features that should be identified a priori and assessed individually to determine the quality of a randomized controlled trial performed to evaluate the effect of periodontal treatment on pregnancy outcomes. The AMSTAR and the PRISMA checklist tools were used to assess the quality of the six meta-analyses selected, and the bias domain of the Cochrane Collaboration's Tool was applied to evaluate each of the trials included in the meta-analyses. In addition, the methodological characteristics of each clinical trial were assessed. The majority of the trials included in the meta-analyses have significant methodological flaws that threaten their internal validity. The lack of effect of periodontal treatment on preterm birth rate concluded by four meta-analyses, and the positive effect of treatment for reducing preterm birth risk concluded by the remaining two meta-analyses are not based on consistent scientific evidence. Well-conducted randomized controlled trials using rigorous methodology, including appropriate definition of the exposure, adequate control of confounders for preterm birth and application of effective periodontal interventions to eliminate periodontal infection, are needed to confirm the positive association between periodontal disease and preterm birth. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.