Poor methodological quality and reporting standards of systematic reviews in burn care management.

PubMed

Wasiak, Jason; Tyack, Zephanie; Ware, Robert; Goodwin, Nicholas; Faggion, Clovis M

2017-10-01

The methodological and reporting quality of burn-specific systematic reviews has not been established. The aim of this study was to evaluate the methodological quality of systematic reviews in burn care management. Computerised searches were performed in Ovid MEDLINE, Ovid EMBASE and The Cochrane Library through to February 2016 for systematic reviews relevant to burn care using medical subject and free-text terms such as 'burn', 'systematic review' or 'meta-analysis'. Additional studies were identified by hand-searching five discipline-specific journals. Two authors independently screened papers, extracted and evaluated methodological quality using the 11-item A Measurement Tool to Assess Systematic Reviews (AMSTAR) tool and reporting quality using the 27-item Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist. Characteristics of systematic reviews associated with methodological and reporting quality were identified. Descriptive statistics and linear regression identified features associated with improved methodological quality. A total of 60 systematic reviews met the inclusion criteria. Six of the 11 AMSTAR items reporting on 'a priori' design, duplicate study selection, grey literature, included/excluded studies, publication bias and conflict of interest were reported in less than 50% of the systematic reviews. Of the 27 items listed for PRISMA, 13 items reporting on introduction, methods, results and the discussion were addressed in less than 50% of systematic reviews. Multivariable analyses showed that systematic reviews associated with higher methodological or reporting quality incorporated a meta-analysis (AMSTAR regression coefficient 2.1; 95% CI: 1.1, 3.1; PRISMA regression coefficient 6·3; 95% CI: 3·8, 8·7) were published in the Cochrane library (AMSTAR regression coefficient 2·9; 95% CI: 1·6, 4·2; PRISMA regression coefficient 6·1; 95% CI: 3·1, 9·2) and included a randomised control trial (AMSTAR regression coefficient 1·4; 95%CI: 0·4, 2·4; PRISMA regression coefficient 3·4; 95% CI: 0·9, 5·8). The methodological and reporting quality of systematic reviews in burn care requires further improvement with stricter adherence by authors to the PRISMA checklist and AMSTAR tool. © 2016 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews

PubMed Central

2013-01-01

Background Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. Methods This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. Results A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. Conclusion There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words) PMID:23331384

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews.

PubMed

Wells, Cherie; Kolt, Gregory S; Marshall, Paul; Hill, Bridget; Bialocerkowski, Andrea

2013-01-19

Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words).

Systematic reviews identify important methodological flaws in stroke rehabilitation therapy primary studies: review of reviews.

PubMed

Santaguida, Pasqualina; Oremus, Mark; Walker, Kathryn; Wishart, Laurie R; Siegel, Karen Lohmann; Raina, Parminder

2012-04-01

A "review of reviews" was undertaken to assess methodological issues in studies evaluating nondrug rehabilitation interventions in stroke patients. MEDLINE, CINAHL, PsycINFO, and the Cochrane Database of Systematic Reviews were searched from January 2000 to January 2008 within the stroke rehabilitation setting. Electronic searches were supplemented by reviews of reference lists and citations identified by experts. Eligible studies were systematic reviews; excluded citations were narrative reviews or reviews of reviews. Review characteristics and criteria for assessing methodological quality of primary studies within them were extracted. The search yielded 949 English-language citations. We included a final set of 38 systematic reviews. Cochrane reviews, which have a standardized methodology, were generally of higher methodological quality than non-Cochrane reviews. Most systematic reviews used standardized quality assessment criteria for primary studies, but not all were comprehensive. Reviews showed that primary studies had problems with randomization, allocation concealment, and blinding. Baseline comparability, adverse events, and co-intervention or contamination were not consistently assessed. Blinding of patients and providers was often not feasible and was not evaluated as a source of bias. The eligible systematic reviews identified important methodological flaws in the evaluated primary studies, suggesting the need for improvement of research methods and reporting. Copyright © 2012 Elsevier Inc. All rights reserved.

Methodological quality of systematic reviews referenced in clinical practice guidelines for the treatment of opioid use disorder.

PubMed

Ross, Andrew; Rankin, Justin; Beaman, Jason; Murray, Kelly; Sinnett, Philip; Riddle, Ross; Haskins, Jordan; Vassar, Matt

2017-01-01

With efforts to combat opioid use disorder, there is an increased interest in clinical practice guidelines (CPGs) for opioid use disorder treatments. No literature exists examining the quality of systematic reviews used in opioid use disorder CPGs. This study aims to describe the methodological quality and reporting clarity of systematic reviews (SRs) used to create CPGs for opioid use disorder. From June to July 2016 guideline clearinghouses and medical literature databases were searched for relevant CPGs used in the treatment of opioid use disorder. Included CPGs must have been recognized by a national organization. SRs from the reference section of each CPG was scored by using AMSTAR (a measurement tool to assess the methodological quality of systematic reviews) tool and PRISMA (preferred reporting items for systematic reviews and meta-analyses) checklist. Seventeen CPGs from 2006-2016 were included in the review. From these, 57 unique SRs were extracted. SRS comprised 0.28% to 17.92% of all references found in the CPGs. All SRs obtained moderate or high methodological quality score on the AMSTAR tool. All reviews met at least 70% of PRISMA criteria. In PRISMA, underperforming areas included accurate title labeling, protocol registration, and risk of bias. Underperforming areas in AMSTAR included conflicts of interest, funding, and publication bias. A positive correlation was found between AMSTAR and PRISMA scores (r = .79). Although the SRs in the CPGs were of good quality, there are still areas for improvement. Systematic reviewers should consult PRISMA and AMSTAR when conducting and reporting reviews. It is important for CPG developers to consider methodological quality as a factor when developing CPG recommendations, recognizing that the quality of systematic reviews underpinning guidelines does not necessarily correspond to the quality of the guideline itself.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool.

PubMed

Ho, Robin S T; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel Y S; Chung, Vincent C H

2015-01-08

Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. To assess the methodological quality of MAs on COPD treatments. A cross-sectional study on MAs of COPD trials. MAs published during 2000-2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool

PubMed Central

Ho, Robin ST; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel YS; Chung, Vincent CH

2015-01-01

Background: Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. Aims: To assess the methodological quality of MAs on COPD treatments. Methods: A cross-sectional study on MAs of COPD trials. MAs published during 2000–2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Results: Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. Conclusions: The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods. PMID:25569783

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews

PubMed Central

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-01-01

Objective To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines—for example, in enemas, foot massage and compressing the umbilicus. Design A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. Result We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. Conclusions There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. PMID:28186925

Methodological quality assessment of paper-based systematic reviews published in oral health.

PubMed

Wasiak, J; Shen, A Y; Tan, H B; Mahar, R; Kan, G; Khoo, W R; Faggion, C M

2016-04-01

This study aimed to conduct a methodological assessment of paper-based systematic reviews (SR) published in oral health using a validated checklist. A secondary objective was to explore temporal trends on methodological quality. Two electronic databases (OVID Medline and OVID EMBASE) were searched for paper-based SR of interventions published in oral health from inception to October 2014. Manual searches of the reference lists of paper-based SR were also conducted. Methodological quality of included paper-based SR was assessed using an 11-item questionnaire, Assessment of Multiple Systematic Reviews (AMSTAR) checklist. Methodological quality was summarized using the median and inter-quartile range (IQR) of the AMSTAR score over different categories and time periods. A total of 643 paper-based SR were included. The overall median AMSTAR score was 4 (IQR 2-6). The highest median score (5) was found in the pain dentistry and periodontology fields, while the lowest median score (3) was found in implant dentistry, restorative dentistry, oral medicine, and prosthodontics. The number of paper-based SR per year and the median AMSTAR score increased over time (median score in 1990s was 2 (IQR 2-3), 2000s was 4 (IQR 2-5), and 2010 onwards was 5 (IQR 3-6)). Although the methodological quality of paper-based SR published in oral health has improved in the last few years, there is still scope for improving quality in most evaluated dental specialties. Large-scale assessment of methodological quality of dental SR highlights areas of methodological strengths and weaknesses that can be targeted in future publications to encourage better quality review methodology.

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome

PubMed Central

Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety. PMID:26246841

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome.

PubMed

Lauche, Romy; Cramer, Holger; Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety.

Chinese herbal medicine for the treatment of primary hypertension: a methodology overview of systematic reviews.

PubMed

Xinke, Zhao; Yingdong, Li; Mingxia, Feng; Kai, Liu; Kaibing, Chen; Yuqing, Lu; Shaobo, Sun; Peng, Song; Bin, Liu

2016-10-20

Chinese herbal medicine has been used to treat hypertension in China and East Asia since centuries. In this study, we conduct an overview of systematic reviews of Chinese herbal medicine in the treatment of primary hypertension to 1) summarize the conclusions of these reviews, 2) evaluate the methodological quality of these reviews, and 3) rate the confidence in the effect on each outcome. We comprehensively searched six databases to retrieve systematic reviews of Chinese herbal medicine for primary hypertension from inception to December 31, 2015. We used AMSTAR to evaluate the methodological quality of included reviews, and we classified the quality of evidence for each outcome in included reviews using the GRADE approach. A total of 12 systematic reviews with 31 outcomes were included, among which 11 systematic reviews focus on the therapeutic effect of Chinese herbal medicine combined with conventional medicine or simple Chinese herbal medicine versus simple conventional medicine. Among the 11 items of AMSTAR, the lowest quality was "providing a priori design" item, none review conformed to this item, the next was "stating the conflict of interest" item, only three reviews conformed to this item. Five reviews scored less than seven in AMSTAR, which means that the overall methodological quality was fairly poor. For GRADE, of the 31 outcomes, the quality of evidence was high in none (0 %), moderate in three (10 %), low in 19 (61 %), and very low in nine (29 %). Of the five downgrading factors, risk of bias (100 %) was the most common downgrading factor in the included reviews, followed by imprecision (42 %), inconsistency (39 %), publication bias (39 %), and indirectness (0 %). The methodological quality of systematic reviews about Chinese herbal medicine for primary hypertension is fairly poor, and the quality of evidence level is low. Physicians should be cautious when applying the interventions in these reviews for primary hypertension patients in clinical practice.

Systematic reviews addressing microsurgical head and neck reconstruction.

PubMed

Momeni, Arash; Jacobson, Joshua Y; Lee, Gordon K

2015-01-01

Systematic reviews frequently form the basis for clinical decision making and guideline development. Yet, the quality of systematic reviews has been variable, thus raising concerns about the validity of their conclusions. In the current study, a quality analysis of systematic reviews was performed, addressing microsurgical head and neck reconstruction. A PubMed search was performed to identify all systematic reviews published up to and including December 2012 in 12 surgical journals. Two authors independently reviewed the literature and extracted data from the included reviews. Discrepancies were resolved by consensus. Quality assessment was performed using AMSTAR. The initial search retrieved 1020 articles. After screening titles and abstracts, 987 articles were excluded. Full-text review of the remaining 33 articles resulted in further exclusion of 18 articles, leaving 15 systematic reviews for final analysis. A marked increase in the number of published systematic reviews over time was noted (P = 0.07). The median AMSTAR score was 5, thus reflecting a "fair" quality. No evidence for improvement in methodological quality over time was noted. The trend to publish more systematic reviews in microsurgical head and neck reconstruction is encouraging. However, efforts are indicated to improve the methodological quality of systematic reviews. Familiarity with criteria of methodological quality is critical to ensure future improvements in the quality of systematic reviews conducted in microsurgery.

Methodological quality and implications for practice of systematic Cochrane reviews in pediatric oral health: a critical assessment

PubMed Central

2014-01-01

Background To ensure evidence-based decision-making in pediatric oral health, Cochrane systematic reviews that address topics pertinent to this field are necessary. We aimed to identify all systematic reviews of paediatric dentistry and oral health by the Cochrane Oral Health Group (COHG), summarize their characteristics and assess their methodological quality. Our second objective was to assess implications for practice in the review conclusions and provide an overview of clinical implications about the usefulness of paediatric oral health interventions in practice. Methods We conducted a methodological survey including all paediatric dentistry reviews from the COHG. We extracted data on characteristics of included reviews, then assessed the methodological quality using a validated 11-item quality assessment tool (AMSTAR). Finally, we coded each review to indicate whether its authors concluded that an intervention should be implemented in practice, was not supported or was refuted by the evidence, or should be used only in research (inconclusive evidence). Results We selected 37 reviews; most concerned the prevention of caries. The methodological quality was high, except for the assessment of reporting bias. In 7 reviews (19%), the research showed that benefits outweighed harms; in 1, the experimental intervention was found ineffective; and in 29 (78%), evidence was insufficient to assess benefits and harms. In the 7 reviews, topical fluoride treatments (with toothpaste, gel or varnish) were found effective for permanent and deciduous teeth in children and adolescents, and sealants for occlusal tooth surfaces of permanent molars. Conclusions Cochrane reviews of paediatric dentistry were of high quality. They provided strong evidence that topical fluoride treatments and sealants are effective for children and adolescents and thus should be implemented in practice. However, a substantial number of reviews yielded inconclusive evidence. PMID:24716532

Methodological Quality Assessment of Meta-Analyses of Hyperthyroidism Treatment.

PubMed

Qin, Yahong; Yao, Liang; Shao, Feifei; Yang, Kehu; Tian, Limin

2018-01-01

Hyperthyroidism is a common condition that is associated with increased morbidity and mortality. A number of meta-analyses (MAs) have assessed the therapeutic measures for hyperthyroidism, including antithyroid drugs, surgery, and radioiodine, however, the methodological quality has not been evaluated. This study evaluated the methodological quality and summarized the evidence obtained from MAs of hyperthyroidism treatments for radioiodine, antithyroid drugs, and surgery. We searched the PubMed, EMBASE, Cochrane Library, Web of Science, and Chinese Biomedical Literature Database databases. Two investigators independently assessed the meta-analyses titles and abstracts for inclusion. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. A total of 26 MAs fulfilled the inclusion criteria. Based on the AMSTAR scores, the average methodological quality was 8.31, with large variability ranging from 4 to 11. The methodological quality of English meta-analyses was better than that of Chinese meta-analyses. Cochrane reviews had better methodological quality than non-Cochrane reviews due to better study selection and data extraction, the inclusion of unpublished studies, and better reporting of study characteristics. The authors did not report conflicts of interest in 53.8% meta-analyses, and 19.2% did not report the harmful effects of treatment. Publication bias was not assessed in 38.5% of meta-analyses, and 19.2% did not report the follow-up time. Large-scale assessment of methodological quality of meta-analyses of hyperthyroidism treatment highlighted methodological strengths and weaknesses. Consideration of scientific quality when formulating conclusions should be made explicit. Future meta-analyses should improve on reporting conflict of interest. © Georg Thieme Verlag KG Stuttgart · New York.

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews.

PubMed

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-11-14

To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines-for example, in enemas, foot massage and compressing the umbilicus. A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Methodologic quality of meta-analyses and systematic reviews on the Mediterranean diet and cardiovascular disease outcomes: a review.

PubMed

Huedo-Medina, Tania B; Garcia, Marissa; Bihuniak, Jessica D; Kenny, Anne; Kerstetter, Jane

2016-03-01

Several systematic reviews/meta-analyses published within the past 10 y have examined the associations of Mediterranean-style diets (MedSDs) on cardiovascular disease (CVD) risk. However, these reviews have not been evaluated for satisfying contemporary methodologic quality standards. This study evaluated the quality of recent systematic reviews/meta-analyses on MedSD and CVD risk outcomes by using an established methodologic quality scale. The relation between review quality and impact per publication value of the journal in which the article had been published was also evaluated. To assess compliance with current standards, we applied a modified version of the Assessment of Multiple Systematic Reviews (AMSTARMedSD) quality scale to systematic reviews/meta-analyses retrieved from electronic databases that had met our selection criteria: 1) used systematic or meta-analytic procedures to review the literature, 2) examined MedSD trials, and 3) had MedSD interventions independently or combined with other interventions. Reviews completely satisfied from 8% to 75% of the AMSTARMedSD items (mean ± SD: 31.2% ± 19.4%), with those published in higher-impact journals having greater quality scores. At a minimum, 60% of the 24 reviews did not disclose full search details or apply appropriate statistical methods to combine study findings. Only 5 of the reviews included participant or study characteristics in their analyses, and none evaluated MedSD diet characteristics. These data suggest that current meta-analyses/systematic reviews evaluating the effect of MedSD on CVD risk do not fully comply with contemporary methodologic quality standards. As a result, there are more research questions to answer to enhance our understanding of how MedSD affects CVD risk or how these effects may be modified by the participant or MedSD characteristics. To clarify the associations between MedSD and CVD risk, future meta-analyses and systematic reviews should not only follow methodologic quality standards but also include more statistical modeling results when data allow. © 2016 American Society for Nutrition.

Methodological quality of meta-analyses of single-case experimental studies.

PubMed

Jamshidi, Laleh; Heyvaert, Mieke; Declercq, Lies; Fernández-Castilla, Belén; Ferron, John M; Moeyaert, Mariola; Beretvas, S Natasha; Onghena, Patrick; Van den Noortgate, Wim

2017-12-28

Methodological rigor is a fundamental factor in the validity and credibility of the results of a meta-analysis. Following an increasing interest in single-case experimental design (SCED) meta-analyses, the current study investigates the methodological quality of SCED meta-analyses. We assessed the methodological quality of 178 SCED meta-analyses published between 1985 and 2015 through the modified Revised-Assessment of Multiple Systematic Reviews (R-AMSTAR) checklist. The main finding of the current review is that the methodological quality of the SCED meta-analyses has increased over time, but is still low according to the R-AMSTAR checklist. A remarkable percentage of the studies (93.80% of the included SCED meta-analyses) did not even reach the midpoint score (22, on a scale of 0-44). The mean and median methodological quality scores were 15.57 and 16, respectively. Relatively high scores were observed for "providing the characteristics of the included studies" and "doing comprehensive literature search". The key areas of deficiency were "reporting an assessment of the likelihood of publication bias" and "using the methods appropriately to combine the findings of studies". Although the results of the current review reveal that the methodological quality of the SCED meta-analyses has increased over time, still more efforts are needed to improve their methodological quality. Copyright © 2017 Elsevier Ltd. All rights reserved.

Appendix C: Background and Methodology for Alternative Certification Pilot. [2014 Teacher Prep Review

ERIC Educational Resources Information Center

Greenberg, Julie; Walsh, Kate; McKee, Arthur

2014-01-01

The "NCTQ Teacher Prep Review" evaluates the quality of programs that provide preservice preparation of public school teachers. As part of the "Review," this appendix reports on a pilot study of new standards for assessing the quality of alternative certification programs. Background and methodology for alternative…

Non-Surgical Interventions for Adolescents with Idiopathic Scoliosis: An Overview of Systematic Reviews

PubMed Central

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Background Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Objectives Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Design Systematic overview of systematic reviews. Methods Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute’s hierarchies were applied to analyze the levels of evidence from included reviews. Results From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Conclusions Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. Protocol registry number CRD42013003538, PROSPERO PMID:25353954

Non-surgical interventions for adolescents with idiopathic scoliosis: an overview of systematic reviews.

PubMed

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Systematic overview of systematic reviews. Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute's hierarchies were applied to analyze the levels of evidence from included reviews. From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. CRD42013003538, PROSPERO.

Does updating improve the methodological and reporting quality of systematic reviews?

PubMed

Shea, Beverley; Boers, Maarten; Grimshaw, Jeremy M; Hamel, Candyce; Bouter, Lex M

2006-06-13

Systematic reviews (SRs) must be of high quality. The purpose of our research was to compare the methodological and reporting quality of original versus updated Cochrane SRs to determine whether updating had improved these two quality dimensions. We identified updated Cochrane SRs published in issue 4, 2002 of the Cochrane Library. We assessed the updated and original versions of the SRs using two instruments: the 10 item enhanced Overview Quality Assessment Questionnaire (OQAQ), and an 18-item reporting quality checklist and flow chart based upon the Quality of Reporting of Meta-analyses (QUOROM) statement. At least two reviewers extracted data and assessed quality. We calculated the percentage (with a 95% confidence interval) of 'yes' answers to each question. We calculated mean differences in percentage, 95% confidence intervals and p-values for each of the individual items and the overall methodological quality score of the updated and pre-updated versions using OQAQ. We assessed 53 SRs. There was no significant improvement in the global quality score of the OQAQ (mean difference 0.11 (-0.28; 0.70 p = 0.52)). Updated reviews showed a significant improvement of 18.9 (7.2; 30.6 p < .01) on the OQAQ item assessing whether the conclusions drawn by the author(s) were supported by the data and/or analysis presented in the SR. The QUOROM statement showed that the quality of reporting of Cochrane reviews improved in some areas with updating. Improvements were seen on the items relating to data sources reported in the abstract, with a significant difference of 17.0 (9.8; 28.7 p = 0.01), review methods, reported in the abstract 35 (24.1; 49.1 p = 0.00), searching methods 18.9 (9.7; 31.6 p = 0.01), and data abstraction 18.9 (11.7; 30.9 p = 0.00). The overall quality of Cochrane SRs is fair-to-good. Although reporting quality improved on certain individual items there was no overall improvement seen with updating and methodological quality remained unchanged. Further improvement of quality of reporting is possible. There is room for improvement of methodological quality as well. Authors updating reviews should address identified methodological or reporting weaknesses. We recommend to give full attention to both quality domains when updating SRs.

Measuring e-Commerce service quality from online customer review using sentiment analysis

NASA Astrophysics Data System (ADS)

Kencana Sari, Puspita; Alamsyah, Andry; Wibowo, Sulistyo

2018-03-01

The biggest e-Commerce challenge to understand their market is to chart their level of service quality according to customer perception. The opportunities to collect user perception through online user review is considered faster methodology than conducting direct sampling methodology. To understand the service quality level, sentiment analysis methodology is used to classify the reviews into positive and negative sentiment for five dimensions of electronic service quality (e-Servqual). As case study in this research, we use Tokopedia, one of the biggest e-Commerce service in Indonesia. We obtain the online review comments about Tokopedia service quality during several month observations. The Naïve Bayes classification methodology is applied for the reason of its high-level accuracy and support large data processing. The result revealed that personalization and reliability dimension required more attention because have high negative sentiment. Meanwhile, trust and web design dimension have high positive sentiments that means it has very good services. The responsiveness dimension have balance sentiment positive and negative.

A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews.

PubMed

Pluye, Pierre; Gagnon, Marie-Pierre; Griffiths, Frances; Johnson-Lafleur, Janique

2009-04-01

A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies. To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components. A three-step critical review was conducted. 2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic. Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs). Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality. A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Systematic review adherence to methodological or reporting quality.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-07-19

Guidelines for assessing methodological and reporting quality of systematic reviews (SRs) were developed to contribute to implementing evidence-based health care and the reduction of research waste. As SRs assessing a cohort of SRs is becoming more prevalent in the literature and with the increased uptake of SR evidence for decision-making, methodological quality and standard of reporting of SRs is of interest. The objective of this study is to evaluate SR adherence to the Quality of Reporting of Meta-analyses (QUOROM) and PRISMA reporting guidelines and the A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Overview Quality Assessment Questionnaire (OQAQ) quality assessment tools as evaluated in methodological overviews. The Cochrane Library, MEDLINE®, and EMBASE® databases were searched from January 1990 to October 2014. Title and abstract screening and full-text screening were conducted independently by two reviewers. Reports assessing the quality or reporting of a cohort of SRs of interventions using PRISMA, QUOROM, OQAQ, or AMSTAR were included. All results are reported as frequencies and percentages of reports and SRs respectively. Of the 20,765 independent records retrieved from electronic searching, 1189 reports were reviewed for eligibility at full text, of which 56 reports (5371 SRs in total) evaluating the PRISMA, QUOROM, AMSTAR, and/or OQAQ tools were included. Notable items include the following: of the SRs using PRISMA, over 85% (1532/1741) provided a rationale for the review and less than 6% (102/1741) provided protocol information. For reports using QUOROM, only 9% (40/449) of SRs provided a trial flow diagram. However, 90% (402/449) described the explicit clinical problem and review rationale in the introduction section. Of reports using AMSTAR, 30% (534/1794) used duplicate study selection and data extraction. Conversely, 80% (1439/1794) of SRs provided study characteristics of included studies. In terms of OQAQ, 37% (499/1367) of the SRs assessed risk of bias (validity) in the included studies, while 80% (1112/1387) reported the criteria for study selection. Although reporting guidelines and quality assessment tools exist, reporting and methodological quality of SRs are inconsistent. Mechanisms to improve adherence to established reporting guidelines and methodological assessment tools are needed to improve the quality of SRs.

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

Systematic Reviews and Meta-Analyses of Home Telemonitoring Interventions for Patients With Chronic Diseases: A Critical Assessment of Their Methodological Quality

PubMed Central

2013-01-01

Background Systematic reviews and meta-analyses of home telemonitoring interventions for patients with chronic diseases have increased over the past decade and become increasingly important to a wide range of clinicians, policy makers, and other health care stakeholders. While a few criticisms about their methodological rigor and synthesis approaches have recently appeared, no formal appraisal of their quality has been conducted yet. Objective The primary aim of this critical review was to evaluate the methodology, quality, and reporting characteristics of prior reviews that have investigated the effects of home telemonitoring interventions in the context of chronic diseases. Methods Ovid MEDLINE, the Database of Abstract of Reviews of Effects (DARE), and Health Technology Assessment Database (HTA) of the Cochrane Library were electronically searched to find relevant systematic reviews, published between January 1966 and December 2012. Potential reviews were screened and assessed for inclusion independently by three reviewers. Data pertaining to the methods used were extracted from each included review and examined for accuracy by two reviewers. A validated quality assessment instrument, R-AMSTAR, was used as a framework to guide the assessment process. Results Twenty-four reviews, nine of which were meta-analyses, were identified from more than 200 citations. The bibliographic search revealed that the number of published reviews has increased substantially over the years in this area and although most reviews focus on studying the effects of home telemonitoring on patients with congestive heart failure, researcher interest has extended to other chronic diseases as well, such as diabetes, hypertension, chronic obstructive pulmonary disease, and asthma. Nevertheless, an important number of these reviews appear to lack optimal scientific rigor due to intrinsic methodological issues. Also, the overall quality of reviews does not appear to have improved over time. While several criteria were met satisfactorily by either all or nearly all reviews, such as the establishment of an a priori design with inclusion and exclusion criteria, use of electronic searches on multiple databases, and reporting of studies characteristics, there were other important areas that needed improvement. Duplicate data extraction, manual searches of highly relevant journals, inclusion of gray and non-English literature, assessment of the methodological quality of included studies and quality of evidence were key methodological procedures that were performed infrequently. Furthermore, certain methodological limitations identified in the synthesis of study results have affected the results and conclusions of some reviews. Conclusions Despite the availability of methodological guidelines that can be utilized to guide the proper conduct of systematic reviews and meta-analyses and eliminate potential risks of bias, this knowledge has not yet been fully integrated in the area of home telemonitoring. Further efforts should be made to improve the design, conduct, reporting, and publication of systematic reviews and meta-analyses in this area. PMID:23880072

A systematic tale of two differing reviews: evaluating the evidence on public and private sector quality of primary care in low and middle income countries.

PubMed

Coarasa, Jorge; Das, Jishnu; Gummerson, Elizabeth; Bitton, Asaf

2017-04-12

Systematic reviews are powerful tools for summarizing vast amounts of data in controversial areas; but their utility is limited by methodological choices and assumptions. Two systematic reviews of literature on the quality of private sector primary care in low and middle income countries (LMIC), published in the same journal within a year, reached conflicting conclusions. The difference in findings reflects different review methodologies, but more importantly, a weak underlying body of literature. A detailed examination of the literature cited in both reviews shows that only one of the underlying studies met the gold standard for methodological robustness. Given the current policy momentum on universal health coverage and primary health care reform across the globe, there is an urgent need for high quality empirical evidence on the quality of private versus public sector primary health care in LMIC.

E-therapy for mental health problems: a systematic review.

PubMed

Postel, Marloes G; de Haan, Hein A; De Jong, Cor A J

2008-09-01

The widespread availability of the Internet offers opportunities for improving access to therapy for people with mental health problems. There is a seemingly infinite supply of Internet-based interventions available on the World Wide Web. The aim of the present study is to systematically assess the methodological quality of randomized controlled trials (RCTs) concerning e-therapy for mental health problems. Two reviewers independently assessed the methodological quality of the RCTs, based on a list of criteria for the methodological quality assessment as recommended by the Cochrane Back Review Group. The search yielded 14 papers that reported RCTs concerning e-therapy for mental-health problems. The methodological quality of studies included in this review was generally low. It is concluded that e-therapy may turn out to be an appropriate therapeutic entity, but the evidence needs to be more convincing. Recommendations are made concerning the method of reporting RCTs and the need to add some content items to an e-therapy study.

Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.

PubMed

Dosenovic, Svjetlana; Jelicic Kadic, Antonia; Vucic, Katarina; Markovina, Nikolina; Pieper, Dawid; Puljak, Livia

2018-05-08

Systematic reviews (SRs) in the field of neuropathic pain (NeuP) are increasingly important for decision-making. However, methodological flaws in SRs can reduce the validity of conclusions. Hence, it is important to assess the methodological quality of NeuP SRs critically. Additionally, it remains unclear which assessment tool should be used. We studied the methodological quality of SRs published in the field of NeuP and compared two assessment tools. We systematically searched 5 electronic databases to identify SRs of randomized controlled trials of interventions for NeuP available up to March 2015. Two independent reviewers assessed the methodological quality of the studies using the Assessment of Multiple Systematic Reviews (AMSTAR) and the revised AMSTAR (R-AMSTAR) tools. The scores were converted to percentiles and ranked into 4 grades to allow comparison between the two checklists. Gwet's AC1 coefficient was used for interrater reliability assessment. The 97 included SRs had a wide range of methodological quality scores (AMSTAR median (IQR): 6 (5-8) vs. R-AMSTAR median (IQR): 30 (26-35)). The overall agreement score between the 2 raters was 0.62 (95% CI 0.39-0.86) for AMSTAR and 0.62 (95% CI 0.53-0.70) for R-AMSTAR. The 31 Cochrane systematic reviews (CSRs) were consistently ranked higher than the 66 non-Cochrane systematic reviews (NCSRs). The analysis of individual domains showed the best compliance in a comprehensive literature search (item 3) on both checklists. The results for the domain that was the least compliant differed: conflict of interest (item 11) was the item most poorly reported on AMSTAR vs. publication bias assessment (item 10) on R-AMSTAR. A high positive correlation between the total AMSTAR and R-AMSTAR scores for all SRs, as well as for CSRs and NCSRs, was observed. The methodological quality of analyzed SRs in the field of NeuP was not optimal, and CSRs had a higher quality than NCSRs. Both AMSTAR and R-AMSTAR tools produced comparable quality ratings. Our results point out to weaknesses in the methodology of existing SRs on interventions for the management NeuP and call for future improvement by better adherence to analyzed quality checklists, either AMSTAR or R-AMSTAR.

METHODOLOGICAL QUALITY OF ECONOMIC EVALUATIONS ALONGSIDE TRIALS OF KNEE PHYSIOTHERAPY.

PubMed

García-Pérez, Lidia; Linertová, Renata; Arvelo-Martín, Alejandro; Guerra-Marrero, Carolina; Martínez-Alberto, Carlos Enrique; Cuéllar-Pompa, Leticia; Escobar, Antonio; Serrano-Aguilar, Pedro

2017-01-01

The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis. Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale. All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account. Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

What Is the Methodologic Quality of Human Therapy Studies in ISI Surgical Publications?

PubMed Central

Manterola, Carlos; Pineda, Viviana; Vial, Manuel; Losada, Héctor

2006-01-01

Objective: To determine the methodologic quality of therapy articles about humans published in ISI surgical journals, and to explore the association between methodologic quality, origin, and subject matter. Summary Background Data: It is supposed that ISI journals contain the best methodologic articles. Methods: This is a bibliometric study. All journals listed in the 2002 ISI under the subject heading of “Surgery” were included. A simple randomized sampling was conducted for selected journals (Annals of Surgery, The American Surgeon, Archives of Surgery, British Journal of Surgery, European Journal of Surgery, Journal of the American College of Surgeons, Surgery, and World Journal of Surgery). Published articles related to therapy on humans of the selected journals were reviewed and analyzed. All kinds of clinical designs were considered, excluding editorials, review articles, letters to the editor, and experimental studies. The variables considered were: place of origin, design, and the methodologic quality of articles, which was determined by applying a valid and reliable scale. The review was performed interchangeably and independently by 2 research teams. Descriptive and analytical statistics were used. Statistical significance was defined as P values less than 1%. Results: A total of 653 articles were studied. Studies came predominantly from the United States and Europe (43.6% and 36.8%, respectively). The subject areas most frequently found were digestive and hepatobiliopancreatic surgery (29.1% and 24.5%, respectively). Average and median methodologic quality scores of the entire series were 11.6 ± 4.9 points and 11 points, respectively. The association between methodologic quality and journals was determined. Also, the association between methodologic quality and origin was observed, but no association with subject area was verified. Conclusions: The methodologic quality of therapy articles published in the journals analyzed is low; however, statistical significance was determined between them. Association was observed between methodologic quality and origin, but not with subject matter. PMID:17060778

Improving Mathematics Performance among Secondary Students with EBD: A Methodological Review

ERIC Educational Resources Information Center

Mulcahy, Candace A.; Krezmien, Michael P.; Travers, Jason

2016-01-01

In this methodological review, the authors apply special education research quality indicators and standards for single case design to analyze mathematics intervention studies for secondary students with emotional and behavioral disorders (EBD). A systematic methodological review of literature from 1975 to December 2012 yielded 19 articles that…

Indirect Comparisons: A Review of Reporting and Methodological Quality

PubMed Central

Donegan, Sarah; Williamson, Paula; Gamble, Carrol; Tudur-Smith, Catrin

2010-01-01

Background The indirect comparison of two interventions can be valuable in many situations. However, the quality of an indirect comparison will depend on several factors including the chosen methodology and validity of underlying assumptions. Published indirect comparisons are increasingly more common in the medical literature, but as yet, there are no published recommendations of how they should be reported. Our aim is to systematically review the quality of published indirect comparisons to add to existing empirical data suggesting that improvements can be made when reporting and applying indirect comparisons. Methodology/Findings Reviews applying statistical methods to indirectly compare the clinical effectiveness of two interventions using randomised controlled trials were eligible. We searched (1966–2008) Database of Abstracts and Reviews of Effects, The Cochrane library, and Medline. Full review publications were assessed for eligibility. Specific criteria to assess quality were developed and applied. Forty-three reviews were included. Adequate methodology was used to calculate the indirect comparison in 41 reviews. Nineteen reviews assessed the similarity assumption using sensitivity analysis, subgroup analysis, or meta-regression. Eleven reviews compared trial-level characteristics. Twenty-four reviews assessed statistical homogeneity. Twelve reviews investigated causes of heterogeneity. Seventeen reviews included direct and indirect evidence for the same comparison; six reviews assessed consistency. One review combined both evidence types. Twenty-five reviews urged caution in interpretation of results, and 24 reviews indicated when results were from indirect evidence by stating this term with the result. Conclusions This review shows that the underlying assumptions are not routinely explored or reported when undertaking indirect comparisons. We recommend, therefore, that the quality of indirect comparisons should be improved, in particular, by assessing assumptions and reporting the assessment methods applied. We propose that the quality criteria applied in this article may provide a basis to help review authors carry out indirect comparisons and to aid appropriate interpretation. PMID:21085712

Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist.

PubMed

Terwee, Caroline B; Mokkink, Lidwine B; Knol, Dirk L; Ostelo, Raymond W J G; Bouter, Lex M; de Vet, Henrica C W

2012-05-01

The COSMIN checklist is a standardized tool for assessing the methodological quality of studies on measurement properties. It contains 9 boxes, each dealing with one measurement property, with 5-18 items per box about design aspects and statistical methods. Our aim was to develop a scoring system for the COSMIN checklist to calculate quality scores per measurement property when using the checklist in systematic reviews of measurement properties. The scoring system was developed based on discussions among experts and testing of the scoring system on 46 articles from a systematic review. Four response options were defined for each COSMIN item (excellent, good, fair, and poor). A quality score per measurement property is obtained by taking the lowest rating of any item in a box ("worst score counts"). Specific criteria for excellent, good, fair, and poor quality for each COSMIN item are described. In defining the criteria, the "worst score counts" algorithm was taken into consideration. This means that only fatal flaws were defined as poor quality. The scores of the 46 articles show how the scoring system can be used to provide an overview of the methodological quality of studies included in a systematic review of measurement properties. Based on experience in testing this scoring system on 46 articles, the COSMIN checklist with the proposed scoring system seems to be a useful tool for assessing the methodological quality of studies included in systematic reviews of measurement properties.

Methodological quality and descriptive characteristics of prosthodontic-related systematic reviews.

PubMed

Aziz, T; Compton, S; Nassar, U; Matthews, D; Ansari, K; Flores-Mir, C

2013-04-01

Ideally, healthcare systematic reviews (SRs) should be beneficial to practicing professionals in making evidence-based clinical decisions. However, the conclusions drawn from SRs are directly related to the quality of the SR and of the included studies. The aim was to investigate the methodological quality and key descriptive characteristics of SRs published in prosthodontics. Methodological quality was analysed using the Assessment of Multiple Reviews (AMSTAR) tool. Several electronic resources (MEDLINE, EMBASE, Web of Science and American Dental Association's Evidence-based Dentistry website) were searched. In total 106 SRs were located. Key descriptive characteristics and methodological quality features were gathered and assessed, and descriptive and inferential statistical testing performed. Most SRs in this sample originated from the European continent followed by North America. Two to five authors conducted most SRs; the majority was affiliated with academic institutions and had prior experience publishing SRs. The majority of SRs were published in specialty dentistry journals, with implant or implant-related topics, the primary topics of interest for most. According to AMSTAR, most quality aspects were adequately fulfilled by less than half of the reviews. Publication bias and grey literature searches were the most poorly adhered components. Overall, the methodological quality of the prosthodontic-related systematic was deemed limited. Future recommendations would include authors to have prior training in conducting SRs and for journals to include a universal checklist that should be adhered to address all key characteristics of an unbiased SR process. © 2013 Blackwell Publishing Ltd.

Methodological quality evaluation of systematic reviews or meta-analyses on ERCC1 in non-small cell lung cancer: a systematic review.

PubMed

Tao, Huan; Zhang, Yueyuan; Li, Qian; Chen, Jin

2017-11-01

To assess the methodological quality of systematic reviews (SRs) or meta-analysis concerning the predictive value of ERCC1 in platinum chemotherapy of non-small cell lung cancer. We searched the PubMed, EMbase, Cochrane library, international prospective register of systematic reviews, Chinese BioMedical Literature Database, China National Knowledge Infrastructure, Wan Fang and VIP database for SRs or meta-analysis. The methodological quality of included literatures was evaluated by risk of bias in systematic review (ROBIS) scale. Nineteen eligible SRs/meta-analysis were included. The most frequently searched databases were EMbase (74%), PubMed, Medline and CNKI. Fifteen SRs did additional retrieval manually, but none of them retrieved the registration platform. 47% described the two-reviewers model in the screening for eligible original articles, and seven SRs described the two reviewers to extract data. In methodological quality assessment, inter-rater reliability Kappa was 0.87 between two reviewers. Research question were well related to all SRs in phase 1 and the eligibility criteria was suitable for each SR, and rated as 'low' risk bias. But the 'high' risk bias existed in all the SRs regarding methods used to identify and/or select studies, and data collection and study appraisal. More than two-third of SRs or meta-analysis were finished with high risk of bias in the synthesis, findings and the final phase. The study demonstrated poor methodological quality of SRs/meta-analysis assessing the predictive value of ERCC1 in chemotherapy among the NSCLC patients, especially the high performance bias. Registration or publishing the protocol is recommended in future research.

Risk of bias in overviews of reviews: a scoping review of methodological guidance and four-item checklist.

PubMed

Ballard, Madeleine; Montgomery, Paul

2017-03-01

To assess the conditions under which employing an overview of systematic reviews is likely to lead to a high risk of bias. To synthesise existing guidance concerning overview practice, a scoping review was conducted. Four electronic databases were searched with a pre-specified strategy (PROSPERO 2015:CRD42015027592) ending October 2015. Included studies needed to describe or develop overview methodology. Data were narratively synthesised to delineate areas highlighted as outstanding challenges or where methodological recommendations conflict. Twenty-four papers met the inclusion criteria. There is emerging debate regarding overlapping systematic reviews; systematic review scope; quality of included research; updating; and synthesizing and reporting results. While three functions for overviews have been proposed-identify gaps, explore heterogeneity, summarize evidence-overviews cannot perform the first; are unlikely to achieve the second and third simultaneously; and can only perform the third under specific circumstances. Namely, when identified systematic reviews meet the following four conditions: (1) include primary trials that do not substantially overlap, (2) match overview scope, (3) are of high methodological quality, and (4) are up-to-date. Considering the intended function of proposed overviews with the corresponding methodological conditions may improve the quality of this burgeoning publication type. Copyright © 2017 John Wiley & Sons, Ltd. Copyright © 2017 John Wiley & Sons, Ltd.

A low proportion of systematic reviews in physical therapy are registered: a survey of 150 published systematic reviews.

PubMed

Oliveira, Crystian B; Elkins, Mark R; Lemes, Ítalo Ribeiro; de Oliveira Silva, Danilo; Briani, Ronaldo V; Monteiro, Henrique Luiz; Azevedo, Fábio Mícolis de; Pinto, Rafael Zambelli

Systematic reviews provide the best evidence about the effectiveness of healthcare interventions. Although systematic reviews are conducted with explicit and transparent methods, discrepancies might occur between the protocol and the publication. To estimate the proportion of systematic reviews of physical therapy interventions that are registered, the methodological quality of (un)registered systematic reviews and the prevalence of outcome reporting bias in registered systematic reviews. A random sample of 150 systematic reviews published in 2015 indexed on the PEDro database. We included systematic reviews written in English, Italian, Portuguese and Spanish. A checklist for assessing the methodological quality of systematic reviews tool was used. Relative risk was calculated to explore the association between meta-analysis results and the changes in the outcomes. Twenty-nine (19%) systematic reviews were registered. Funding and publication in a journal with an impact factor higher than 5.0 were associated with registration. Registered systematic reviews demonstrated significantly higher methodological quality (median=8) than unregistered systematic reviews (median=5). Nine (31%) registered systematic reviews demonstrated discrepancies between protocol and publication with no evidence that such discrepancies were applied to favor the statistical significance of the intervention (RR=1.16; 95% CI: 0.63-2.12). A low proportion of systematic reviews in the physical therapy field are registered. The registered systematic reviews showed high methodological quality without evidence of outcome reporting bias. Further strategies should be implemented to encourage registration. Copyright © 2017 Associação Brasileira de Pesquisa e Pós-Graduação em Fisioterapia. Publicado por Elsevier Editora Ltda. All rights reserved.

Traditional Chinese medicine injection for angina pectoris: an overview of systematic reviews.

PubMed

Luo, Jing; Shang, Qinghua; Han, Mei; Chen, Keji; Xu, Hao

2014-01-01

Traditional Chinese medicine (TCM) injection is widely used to treat angina pectoris in China. This overview aims to systematically summarize the general characteristics of systematic reviews (SRs) on TCM injection in treating angina, and assess the methodological and reporting quality of these reviews. We searched PubMed, Embase, the Cochrane Library and four Chinese databases from inception until March 2013. Data were extracted according to a preset form. The AMSTAR and PRISMA checklists were used to explore the methodological quality and reporting characteristics of included reviews, respectively. All data analyses were descriptive. 46 SRs involving over 57,463 participants with angina reviewing 23 kinds of TCM injections were included. The main outcomes evaluated in the reviews were symptoms (43/46, 93.5%), surrogate outcomes (42/46, 91.3%) and adverse events (41/46, 87.0%). Few reviews evaluated endpoints (7/46, 15.2%) and quality of life (1/46, 2.2%). One third of the reviews (16/46, 34.8%) drew definitely positive conclusions while the others (30/46, 65.2%) suggested potential benefits mainly in symptoms, electrocardiogram and adverse events. With many serious flaws such as lack of a protocol and inappropriate data synthesis, the overall methodological and reporting quality of the reviews was limited. While many SRs of TCM injection on the treatment of angina suggested potential benefits or definitely positive effects, stakeholders should not accept the findings of these reviews uncritically due to the limited methodological and reporting quality. Future SRs should be appropriately conducted and reported according to international standards such as AMSTAR and PRISMA, rather than published in large numbers.

The baby or the bath water? Lessons learned from the National Action Alliance for Suicide Prevention Research Prioritization Task Force literature review.

PubMed

Davis Molock, Sherry; Heekin, Janet M; Matlin, Samantha G; Barksdale, Crystal L; Gray, Ekwenzi; Booth, Chelsea L

2014-09-01

The Research Prioritization Task Force of the National Action Alliance for Suicide Prevention conducted a comprehensive literature review of suicide prevention/intervention trials to assess the quality of the scientific evidence. A literature "review of reviews" was conducted by searching the most widely used databases for mental health and public health research. The quality of the reviews was evaluated using the Revised Assessment of Multiple Systematic Reviews system; the quality of the scientific evidence for the suicide preventions/interventions was assessed using U.S. Preventive Services Task Force criteria. The reviews were limited to peer-reviewed publications with human subjects published in English. Ninety-eight systematic reviews and 45 primary sources on suicide prevention/interventions published between January 2000 and September 2012 were evaluated. The results suggest that the quality of both the systematic reviews and the scientific evidence for suicide preventions/interventions were mixed. The majority of the systematic reviews and prevention/interventions were evaluated as fair to poor in quality. There are many promising suicide prevention/intervention trials, but research findings are often inconclusive because of methodologic problems. Methodologic problems across systematic reviews include not conducting hand searches, not surveying gray literature, and being unable to aggregate data across studies. Methodologic problems with the scientific quality of the prevention/intervention trials include paucity of information on sample demographic characteristics, poorly defined outcomes, and excluding actively suicidal participants. Suggestions for ways to improve the quality of the systematic reviews and suicide preventions/interventions are provided. Copyright © 2014 American Journal of Preventive Medicine. All rights reserved.

Sugar-Sweetened Beverages and Obesity Risk in Children and Adolescents: A Systematic Analysis on How Methodological Quality May Influence Conclusions.

PubMed

Bucher Della Torre, Sophie; Keller, Amélie; Laure Depeyre, Jocelyne; Kruseman, Maaike

2016-04-01

In the context of a worldwide high prevalence of childhood obesity, the role of sugar-sweetened beverage (SSB) consumption as a cause of excess weight gain remains controversial. Conflicting results may be due to methodological issues in original studies and in reviews. The aim of this review was to systematically analyze the methodology of studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents, and the studies' ability to answer this research question. A systematic review of cohort and experimental studies published until December 2013 in peer-reviewed journals was performed on Medline, CINAHL, Web of Knowledge, and ClinicalTrials.gov. Studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents were included, and methodological quality to answer this question was assessed independently by two investigators using the Academy of Nutrition and Dietetics Quality Criteria Checklist. Among the 32 identified studies, nine had positive quality ratings and 23 studies had at least one major methodological issue. Main methodological issues included SSB definition and inadequate measurement of exposure. Studies with positive quality ratings found an association between SSB consumption and risk of obesity or obesity (n=5) (ie, when SSB consumption increased so did obesity) or mixed results (n=4). Studies with a neutral quality rating found a positive association (n=7), mixed results (n=9), or no association (n=7). The present review shows that the majority of studies with strong methodology indicated a positive association between SSB consumption and risk of obesity or obesity, especially among overweight children. In addition, study findings highlight the need for the careful and precise measurement of the consumption of SSBs and of important confounders. Copyright © 2016 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Review of reviews on exposures to synthetic organic chemicals and children's neurodevelopment: Methodological and interpretation challenges.

PubMed

LaKind, Judy S; Anthony, Laura G; Goodman, Michael

2017-01-01

Environmental epidemiology data are becoming increasingly important in public health decision making, which commonly incorporates a systematic review of multiple studies. This review addresses two fundamental questions: What is the quality of available reviews on associations between exposure to synthetic organic chemicals and neurodevelopmental outcomes? What is the value (e.g., quality and consistency) of the underlying literature? Published reviews on associations between synthetic organic environmental chemical exposures and neurodevelopmental outcomes in children were systematically evaluated. Seventy-four relevant reviews were identified, and these were evaluated with respect to four methodological characteristics: (1) systematic inclusion/exclusion criteria and reproducible methods for search and retrieval of studies; (2) structured evaluation of underlying data quality; (3) systematic assessment of consistency across specific exposure-outcome associations; and (4) evaluation of reporting/publication bias. None of the 74 reviews fully met the criteria for all four methodological characteristics. Only four reviews met two criteria, and six reviews fulfilled only one criterion. Perhaps more importantly, the higher quality reviews were not able to meet all of the criteria owing to the shortcomings of underlying studies, which lacked comparability in terms of specific research question of interest, overall design, exposure assessment, outcome ascertainment, and analytic methods. Thus, even the most thoughtful and rigorous review may be of limited value if the underlying literature includes investigations that address different hypotheses and are beset by methodological inconsistencies and limitations. Issues identified in this review of reviews illustrate considerable challenges that are facing assessments of epidemiological evidence.

Epidemiology, methodological and reporting characteristics of systematic reviews of nursing interventions published in China.

PubMed

Shi, Chunhu; Zhu, Lin; Wang, Xue; Qin, Chunxia; Xu, Qi; Tian, Jinhui

2014-12-01

The importance of systematic reviews (SRs) of nursing interventions' impact on practice makes their methodological quality and reporting characteristics especially important as it directly influence their utility for clinicians, patients and policy makers.The study aims to assess the methodological quality and reporting characteristics of SRs of nursing interventions in Chinese nursing journals. Three Chinese databases were searched for SRs of nursing interventions from inception to October 2011. The assessment of multiple systematic reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) statements were used to assess methodological quality and reporting characteristics. Seventy-four SRs were included. The proportion of SRs complying with AMSTAR checklist items ranged from 0% to 82.4%. No SRs reported an 'a priori' design or conflict of interest. Only four items were found to be reported in more than 50% of the SRs: a list of included and excluded studies, the scientific quality of included studies, the appropriate use of methods to combine findings, and formulating conclusions appropriately. The majority of SRs of nursing interventions in China had major methodological and reporting flaws that limited their value to guide decisions. Chinese authors and journals should adopt and keep up with the AMSTAR and PRISMA statements to improve the quality of SRs in this field. © 2014 Wiley Publishing Asia Pty Ltd.

Use of methodological tools for assessing the quality of studies in periodontology and implant dentistry: a systematic review.

PubMed

Faggion, Clovis M; Huda, Fahd; Wasiak, Jason

2014-06-01

To evaluate the methodological approaches used to assess the quality of studies included in systematic reviews (SRs) in periodontology and implant dentistry. Two electronic databases (PubMed and Cochrane Database of Systematic Reviews) were searched independently to identify SRs examining interventions published through 2 September 2013. The reference lists of included SRs and records of 10 specialty dental journals were searched manually. Methodological approaches were assessed using seven criteria based on the Cochrane Handbook for Systematic Reviews of Interventions. Temporal trends in methodological quality were also explored. Of the 159 SRs with meta-analyses included in the analysis, 44 (28%) reported the use of domain-based tools, 15 (9%) reported the use of checklists and 7 (4%) reported the use of scales. Forty-two (26%) SRs reported use of more than one tool. Criteria were met heterogeneously; authors of 15 (9%) publications incorporated the quality of evidence of primary studies into SRs, whereas 69% of SRs reported methodological approaches in the Materials/Methods section. Reporting of four criteria was significantly better in recent (2010-2013) than in previous publications. The analysis identified several methodological limitations of approaches used to assess evidence in studies included in SRs in periodontology and implant dentistry. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Methodological quality of diagnostic accuracy studies on non-invasive coronary CT angiography: influence of QUADAS (Quality Assessment of Diagnostic Accuracy Studies included in systematic reviews) items on sensitivity and specificity.

PubMed

Schueler, Sabine; Walther, Stefan; Schuetz, Georg M; Schlattmann, Peter; Dewey, Marc

2013-06-01

To evaluate the methodological quality of diagnostic accuracy studies on coronary computed tomography (CT) angiography using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies included in systematic reviews) tool. Each QUADAS item was individually defined to adapt it to the special requirements of studies on coronary CT angiography. Two independent investigators analysed 118 studies using 12 QUADAS items. Meta-regression and pooled analyses were performed to identify possible effects of methodological quality items on estimates of diagnostic accuracy. The overall methodological quality of coronary CT studies was merely moderate. They fulfilled a median of 7.5 out of 12 items. Only 9 of the 118 studies fulfilled more than 75 % of possible QUADAS items. One QUADAS item ("Uninterpretable Results") showed a significant influence (P = 0.02) on estimates of diagnostic accuracy with "no fulfilment" increasing specificity from 86 to 90 %. Furthermore, pooled analysis revealed that each QUADAS item that is not fulfilled has the potential to change estimates of diagnostic accuracy. The methodological quality of studies investigating the diagnostic accuracy of non-invasive coronary CT is only moderate and was found to affect the sensitivity and specificity. An improvement is highly desirable because good methodology is crucial for adequately assessing imaging technologies. • Good methodological quality is a basic requirement in diagnostic accuracy studies. • Most coronary CT angiography studies have only been of moderate design quality. • Weak methodological quality will affect the sensitivity and specificity. • No improvement in methodological quality was observed over time. • Authors should consider the QUADAS checklist when undertaking accuracy studies.

Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols

PubMed Central

Mhaskar, Rahul; Djulbegovic, Benjamin; Magazin, Anja; Soares, Heloisa P.; Kumar, Ambuj

2011-01-01

Objectives To assess whether reported methodological quality of randomized controlled trials (RCTs) reflect the actual methodological quality, and to evaluate the association of effect size (ES) and sample size with methodological quality. Study design Systematic review Setting Retrospective analysis of all consecutive phase III RCTs published by 8 National Cancer Institute Cooperative Groups until year 2006. Data were extracted from protocols (actual quality) and publications (reported quality) for each study. Results 429 RCTs met the inclusion criteria. Overall reporting of methodological quality was poor and did not reflect the actual high methodological quality of RCTs. The results showed no association between sample size and actual methodological quality of a trial. Poor reporting of allocation concealment and blinding exaggerated the ES by 6% (ratio of hazard ratio [RHR]: 0.94, 95%CI: 0.88, 0.99) and 24% (RHR: 1.24, 95%CI: 1.05, 1.43), respectively. However, actual quality assessment showed no association between ES and methodological quality. Conclusion The largest study to-date shows poor quality of reporting does not reflect the actual high methodological quality. Assessment of the impact of quality on the ES based on reported quality can produce misleading results. PMID:22424985

Longitudinal analysis of reporting and quality of systematic reviews in high-impact surgical journals.

PubMed

Chapman, S J; Drake, T M; Bolton, W S; Barnard, J; Bhangu, A

2017-02-01

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement aims to optimize the reporting of systematic reviews. The performance of the PRISMA Statement in improving the reporting and quality of surgical systematic reviews remains unclear. Systematic reviews published in five high-impact surgical journals between 2007 and 2015 were identified from online archives. Manuscripts blinded to journal, publication year and authorship were assessed according to 27 reporting criteria described by the PRISMA Statement and scored using a validated quality appraisal tool (AMSTAR, Assessing the Methodological Quality of Systematic Reviews). Comparisons were made between studies published before (2007-2009) and after (2011-2015) its introduction. The relationship between reporting and study quality was measured using Spearman's rank test. Of 281 eligible manuscripts, 80 were published before the PRISMA Statement and 201 afterwards. Most manuscripts (208) included a meta-analysis, with the remainder comprising a systematic review only. There was no meaningful change in median compliance with the PRISMA Statement (19 (i.q.r. 16-21) of 27 items before versus 19 (17-22) of 27 after introduction of PRISMA) despite achieving statistical significance (P = 0·042). Better reporting compliance was associated with higher methodological quality (r s  = 0·70, P < 0·001). The PRISMA Statement has had minimal impact on the reporting of surgical systematic reviews. Better compliance was associated with higher-quality methodology. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Epidemiological characteristics and methodological quality of meta-analyses on diabetes mellitus treatment: a systematic review.

PubMed

Wu, Xin Yin; Lam, Victor C K; Yu, Yue Feng; Ho, Robin S T; Feng, Ye; Wong, Charlene H L; Yip, Benjamin H K; Tsoi, Kelvin K F; Wong, Samuel Y S; Chung, Vincent C H

2016-11-01

Well-conducted meta-analyses (MAs) are considered as one of the best sources of clinical evidence for treatment decision. MA with methodological flaws may introduce bias and mislead evidence users. The aim of this study is to investigate the characteristics and methodological quality of MAs on diabetes mellitus (DM) treatments. Systematic review. Cochrane Database of Systematic Review and Database of Abstract of Reviews of Effects were searched for relevant MAs. Assessing methodological quality of systematic reviews (AMSTAR) tool was used to evaluate the methodological quality of included MAs. Logistic regression analysis was used to identify association between characteristics of MA and AMSTAR results. A total of 252 MAs including 4999 primary studies and 13,577,025 patients were included. Over half of the MAs (65.1%) only included type 2 DM patients and 160 MAs (63.5%) focused on pharmacological treatments. About 89.7% MAs performed comprehensive literature search and 89.3% provided characteristics of included studies. Included MAs generally had poor performance on the remaining AMSTAR items, especially in assessing publication bias (39.3%), providing lists of studies (19.0%) and declaring source of support comprehensively (7.5%). Only 62.7% MAs mentioned about harm of interventions. MAs with corresponding author from Asia performed less well in providing MA protocol than those from Europe. Methodological quality of MA on DM treatments was unsatisfactory. There is considerable room for improvement, especially in assessing publication bias, providing lists of studies and declaring source of support comprehensively. Also, there is an urgent need for MA authors to report treatment harm comprehensively. © 2016 European Society of Endocrinology.

Methodological and reporting quality of systematic reviews on tuberculosis.

PubMed

Nicolau, I; Ling, D; Tian, L; Lienhardt, C; Pai, M

2013-09-01

Systematic reviews are used to inform tuberculosis (TB) guidelines. However, there are no data on whether TB systematic reviews are conducted well and reported transparently. We searched four databases for reviews published between 2005 and 2010. Methodological quality was evaluated using AMSTAR and quality of reporting was assessed using PRISMA. Of 152 articles, 137 (90%) met the inclusion criteria. Only 3 of 11 AMSTAR quality items were met in most reviews: appropriate methods to combine findings (67%), comprehensive literature search (72%) and presentation of characteristics of included studies (90%). The other eight items were met in 4-53% of the reviews. Only 4% of the reviews disclosed conflicts of interest. The majority of the PRISMA items were reported in more than 60-76% of the reviews. Only nine items were reported in less than 55% of the reviews, the lowest being the full-search strategy (30%), risk of bias across studies in the Methods (27%) and Results (21%) sections, and indication of a review protocol (15%). Systematic reviews in our survey were well reported but generally of moderate to low quality. Better training, use of reporting guidelines and registration of systematic reviews could improve the quality of TB reviews.

DPP-4 inhibitors for the treatment of type 2 diabetes: a methodology overview of systematic reviews.

PubMed

Ling, Juan; Ge, Long; Zhang, Ding-Hua; Wang, Yong-Feng; Xie, Zhuo-Lin; Tian, Jin-Hui; Xiao, Xiao-Hui; Yang, Ke-Hu

2018-06-01

To evaluate the methodological quality of systematic reviews (SRs), and summarize evidence of important outcomes from dipeptidyl peptidase-4 inhibitors (DPP4-I) in treating type 2 diabetes mellitus (T2DM). We included SRs of DPP4-I for the treatment of T2DM until January, 2018 by searching the Cochrane Library, PubMed, EMBASE and three Chinese databases. We evaluated the methodological qualities with the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool and the GRADE (The Grading of Recommendations Assessment, Development and Evaluation) approach. Sixty-three SRs (a total of 2,603,140 participants) receiving DPP4-I for the treatment of T2DM were included. The results of AMSTAR showed that the lowest quality was "a list of studies (included and excluded) item" with only one (1.6%) study provided, followed by the "providing a priori design" item with only four (6.3%) studies conforming to this item, the next were "the status of publication (gray literature) used as an inclusion criterion item", with only 18 (28.9%) studies conforming to these items. Only seven (11.1%) studies scored more than nine points in AMSTAR, indicating high methodological quality. For GRADE, of the 128 outcomes, high quality evidence was provided in only 28 (21.9%), moderate in 70 (54.7%), low in 27 (21.1%), and very low in three (2.3%). The methodological quality of SRs of DPP4-I for type 2 diabetes mellitus is not high and there are common areas for improvement. Furthermore, the quality of evidence level is moderate and more high quality evidence is needed.

Appraisal of the methodological quality and summary of the findings of systematic reviews on the relationship between SSRIs and suicidality.

PubMed

Li, Wei; Li, Wei; Wan, Yumei; Ren, Juanjuan; Li, Ting; Li, Chunbo

2014-10-01

Several systematic reviews have been published about the relationship of the use of selective serotonin reuptake inhibitors (SSRIs) and risk of suicidal ideation or behavior but there has been no formal assessment of the quality of these reports. Assess the methodological quality of systematic reviews about the relationship of SSRI use and suicidal ideation and behavior; and provide overall conclusions based on this assessment. Systematic reviews of RCTs that compared SSRIs to placebo and used suicidal ideation or behavior as a key outcome variable were identified by searching Pubmed, Embase, The Cochrane Library, EBSCO, PsycINFO, Chinese National Knowledge Infrastructure, Chongqing VIP database for Chinese Technical Periodicals, WANFANG DATA, and the Chinese Biological Medical Literature Database. The methodological quality of included reviews was independently assessed by two expert raters using the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) scale. Twelve systematic reviews and meta-analyses were identified. The inter-rater reliability of the overall AMSTAR quality score was excellent (ICC=0.86) but the inter-rater reliability of 5 of the 11 AMSTAR items was poor (Kappa <0.60). Based on the AMSTAR total score, there was one high-quality review, eight moderate-quality reviews, and three low-quality reviews. The high-quality review and three of the moderate-quality reviews reported a significantly increased risk of suicidal ideation or behavior in the SSRI group compared to the placebo group. Three of the four reviews limited to children and adolescents found a significantly increased risk of suicidal ideation or behavior with SSRI use which was most evident in teenagers taking paroxetine and in teenagers with depressive disorders. The available evidence suggests that adolescents may experience an increase in suicidal ideation and behavior with SSRI use, particularly those who have a depressive disorder and those treated with paroxetine. However, there are few high-quality reviews on this issue, so some doubt about the evidence remains. The AMSTAR scale may be useful in the ongoing efforts to improve the quality of systematic reviews, but further work is needed on tightening the operational criteria for some of the items in the scale.

Sensory re-education after nerve injury of the upper limb: a systematic review.

PubMed

Oud, Tanja; Beelen, Anita; Eijffinger, Elianne; Nollet, Frans

2007-06-01

To systematically review the available evidence for the effectiveness of sensory re-education to improve the sensibility of the hand in patients with a peripheral nerve injury of the upper limb. Studies were identified by an electronic search in the databases MEDLINE, Cumulative Index to Nursing & Allied Health Literature (CINAHL), EMBASE, the Cochrane Library, the Physiotherapy Evidence Database (PEDro), and the database of the Dutch National Institute of Allied Health Professions (Doconline) and by screening the reference lists of relevant articles. Two reviewers selected studies that met the following inclusion criteria: all designs except case reports, adults with impaired sensibility of the hand due to a peripheral nerve injury of the upper limb, and sensibility and functional sensibility as outcome measures. The methodological quality of the included studies was independently assessed by two reviewers. A best-evidence synthesis was performed, based on design, methodological quality and significant findings on outcome measures. Seven studies, with sample sizes ranging from 11 to 49, were included in the systematic review and appraised for content. Five of these studies were of poor methodological quality. One uncontrolled study (N = 1 3 ) was considered to be of sufficient methodological quality, and one randomized controlled trial (N = 49) was of high methodological quality. Best-evidence synthesis showed that there is limited evidence for the effectiveness of sensory re-education, provided by a statistically significant improvement in sensibility found in one high-quality randomized controlled trial. There is a need for further well-defined clinical trials to assess the effectiveness of sensory re-education of patients with impaired sensibility of the hand due to a peripheral nerve injury.

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated. Clinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement. Copyright © 2017 Elsevier Ltd. All rights reserved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina.

PubMed

Zhang, Xiaoxia; Wang, Hui; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina

PubMed Central

Zhang, Xiaoxia; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved. PMID:26539221

Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols.

PubMed

Mhaskar, Rahul; Djulbegovic, Benjamin; Magazin, Anja; Soares, Heloisa P; Kumar, Ambuj

2012-06-01

To assess whether the reported methodological quality of randomized controlled trials (RCTs) reflects the actual methodological quality and to evaluate the association of effect size (ES) and sample size with methodological quality. Systematic review. This is a retrospective analysis of all consecutive phase III RCTs published by eight National Cancer Institute Cooperative Groups up to 2006. Data were extracted from protocols (actual quality) and publications (reported quality) for each study. Four hundred twenty-nine RCTs met the inclusion criteria. Overall reporting of methodological quality was poor and did not reflect the actual high methodological quality of RCTs. The results showed no association between sample size and actual methodological quality of a trial. Poor reporting of allocation concealment and blinding exaggerated the ES by 6% (ratio of hazard ratio [RHR]: 0.94; 95% confidence interval [CI]: 0.88, 0.99) and 24% (RHR: 1.24; 95% CI: 1.05, 1.43), respectively. However, actual quality assessment showed no association between ES and methodological quality. The largest study to date shows that poor quality of reporting does not reflect the actual high methodological quality. Assessment of the impact of quality on the ES based on reported quality can produce misleading results. Copyright © 2012 Elsevier Inc. All rights reserved.

Appendix B: Methodology. [2014 Teacher Prep Review

ERIC Educational Resources Information Center

Greenberg, Julie; Walsh, Kate; McKee, Arthur

2014-01-01

The "NCTQ Teacher Prep Review" evaluates the quality of programs that provide preservice preparation of public school teachers. This appendix describes the scope, methodology, timeline, staff, and standards involved in the production of "Teacher Prep Review 2014." Data collection, validation, and analysis for the report are…

Mobile and Web 2.0 interventions for weight management: an overview of review evidence and its methodological quality

PubMed Central

Smith, Jane R.; Samaha, Laya; Abraham, Charles

2016-01-01

Abstract Background : The use of Internet and related technologies for promoting weight management (WM), physical activity (PA), or dietary-related behaviours has been examined in many articles and systematic reviews. This overview aims to summarize and assess the quality of the review evidence specifically focusing on mobile and Web 2.0 technologies, which are the most utilized, currently available technologies. Methods: Following a registered protocol (CRD42014010323), we searched 16 databases for articles published in English until 31 December 2014 discussing the use of either mobile or Web 2.0 technologies to promote WM or related behaviors, i.e. diet and physical activity (PA). Two reviewers independently selected reviews and assessed their methodological quality using the AMSTAR checklist. Citation matrices were used to determine the overlap among reviews. Results: Forty-four eligible reviews were identified, 39 of which evaluated the effects of interventions using mobile or Web 2.0 technologies. Methodological quality was generally low with only 7 reviews (16%) meeting the highest standards. Suggestive evidence exists for positive effects of mobile technologies on weight-related outcomes and, to a lesser extent, PA. Evidence is inconclusive regarding Web 2.0 technologies. Conclusions : Reviews on mobile and Web 2.0 interventions for WM and related behaviors suggest that these technologies can, under certain circumstances, be effective, but conclusions are limited by poor review quality based on a heterogeneous evidence base. PMID:27335330

Surgical interventions for gastric cancer: a review of systematic reviews.

PubMed

He, Weiling; Tu, Jian; Huo, Zijun; Li, Yuhuang; Peng, Jintao; Qiu, Zhenwen; Luo, Dandong; Ke, Zunfu; Chen, Xinlin

2015-01-01

To evaluate methodological quality and the extent of concordance among meta-analysis and/or systematic reviews on surgical interventions for gastric cancer (GC). A comprehensive search of PubMed, Medline, EMBASE, the Cochrane library and the DARE database was conducted to identify the reviews comparing different surgical interventions for GC prior to April 2014. After applying included criteria, available data were summarized and appraised by the Oxman and Guyatt scale. Fifty six reviews were included. Forty five reviews (80.4%) were well conducted, with scores of adapted Oxman and Guyatt scale ≥ 14. The reviews differed in criteria for avoiding bias and assessing the validity of the primary studies. Many primary studies displayed major methodological flaws, such as randomization, allocation concealment, and dropouts and withdrawals. According to the concordance assessment, laparoscopy-assisted gastrectomy (LAG) was superior to open gastrectomy, and laparoscopy-assisted distal gastrectomy was superior to open distal gastrectomy in short-term outcomes. However, the concordance regarding other surgical interventions, such as D1 vs. D2 lymphadenectomy, and robotic gastrectomy vs. LAG were absent. Systematic reviews on surgical interventions for GC displayed relatively high methodological quality. The improvement of methodological quality and reporting was necessary for primary studies. The superiority of laparoscopic over open surgery was demonstrated. But concordance on other surgical interventions was rare, which needed more well-designed RCTs and systematic reviews.

Systematic review of the cost effectiveness of prophylactic treatments in the prevention of gastropathy in patients with rheumatoid arthritis or osteoarthritis taking non-steroidal anti-inflammatory drugs

PubMed Central

van Dieten, H. E M; Bos, I.; van Tulder, M. W; Lems, W.; Dijkmans, B.; Boers, M.

2000-01-01

A systematic review on the cost effectiveness of prophylactic treatments of non-steroidal anti-inflammatory drug (NSAID) induced gastropathy in patients with osteoarthritis or rheumatoid arthritis was conducted. Two reviewers conducted the literature search and the review. Both full and partial economic evaluations published in English, Dutch, or German were included. The criteria list published in the textbook of Drummond was used to determine the quality of the economic evaluations. The methodological quality of three randomised controlled trials (RCTs) in which the economic evaluations obtained probability estimates of NSAID induced gastropathy and adverse events was assessed by a list of internal validity criteria. The conclusions were based on a rating system consisting of four levels of evidence.
  Ten economic evaluations were included; three were based on RCTs. All evaluations studied misoprostol as prophylactic treatment: in one evaluation misoprostol was studied as a fixed component in a combination with diclofenac (Arthrotec). All economic evaluations comprised analytical studies containing a decision tree. The three trials were of high methodological quality. Nine economic evaluations were considered high quality and one economic evaluation was considered of low methodological quality. There is strong evidence (level "A") that the use of misoprostol for the prevention of NSAID induced gastropathy is cost effective, and limited evidence (level "C") that the use of Arthrotec is cost effective. Although the levels of evidence used in this review are arbitrary, it is believed that a qualitative analysis is useful: quantitative analyses in this field are hampered by the heterogeneity of economic evaluations. Existing criteria to evaluate the methodological quality of economic evaluations may need refinement for use in systematic reviews.

 PMID:11005773

Systematic review of the cost effectiveness of prophylactic treatments in the prevention of gastropathy in patients with rheumatoid arthritis or osteoarthritis taking non-steroidal anti-inflammatory drugs.

PubMed

van Dieten, H E; Korthals-de Bos, I B; van Tulder, M W; Lems, W F; Dijkmans, B A; Boers, M

2000-10-01

A systematic review on the cost effectiveness of prophylactic treatments of non-steroidal anti-inflammatory drug (NSAID) induced gastropathy in patients with osteoarthritis or rheumatoid arthritis was conducted. Two reviewers conducted the literature search and the review. Both full and partial economic evaluations published in English, Dutch, or German were included. The criteria list published in the textbook of Drummond was used to determine the quality of the economic evaluations. The methodological quality of three randomised controlled trials (RCTs) in which the economic evaluations obtained probability estimates of NSAID induced gastropathy and adverse events was assessed by a list of internal validity criteria. The conclusions were based on a rating system consisting of four levels of evidence. Ten economic evaluations were included; three were based on RCTs. All evaluations studied misoprostol as prophylactic treatment: in one evaluation misoprostol was studied as a fixed component in a combination with diclofenac (Arthrotec). All economic evaluations comprised analytical studies containing a decision tree. The three trials were of high methodological quality. Nine economic evaluations were considered high quality and one economic evaluation was considered of low methodological quality. There is strong evidence (level "A") that the use of misoprostol for the prevention of NSAID induced gastropathy is cost effective, and limited evidence (level "C") that the use of Arthrotec is cost effective. Although the levels of evidence used in this review are arbitrary, it is believed that a qualitative analysis is useful: quantitative analyses in this field are hampered by the heterogeneity of economic evaluations. Existing criteria to evaluate the methodological quality of economic evaluations may need refinement for use in systematic reviews.

Methodological and Reporting Quality of Systematic Reviews and Meta-analyses in Endodontics.

PubMed

Nagendrababu, Venkateshbabu; Pulikkotil, Shaju Jacob; Sultan, Omer Sheriff; Jayaraman, Jayakumar; Peters, Ove A

2018-06-01

The aim of this systematic review (SR) was to evaluate the quality of SRs and meta-analyses (MAs) in endodontics. A comprehensive literature search was conducted to identify relevant articles in the electronic databases from January 2000 to June 2017. Two reviewers independently assessed the articles for eligibility and data extraction. SRs and MAs on interventional studies with a minimum of 2 therapeutic strategies in endodontics were included in this SR. Methodologic and reporting quality were assessed using A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA), respectively. The interobserver reliability was calculated using the Cohen kappa statistic. Statistical analysis with the level of significance at P < .05 was performed using Kruskal-Wallis tests and simple linear regression analysis. A total of 30 articles were selected for the current SR. Using AMSTAR, the item related to the scientific quality of studies used in conclusion was adhered by less than 40% of studies. Using PRISMA, 3 items were reported by less than 40% of studies, which were on objectives, protocol registration, and funding. No association was evident comparing the number of authors and country with quality. Statistical significance was observed when quality was compared among journals, with studies published as Cochrane reviews superior to those published in other journals. AMSTAR and PRISMA scores were significantly related. SRs in endodontics showed variability in both methodologic and reporting quality. Copyright © 2018 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Methods for the guideline-based development of quality indicators--a systematic review

PubMed Central

2012-01-01

Background Quality indicators (QIs) are used in many healthcare settings to measure, compare, and improve quality of care. For the efficient development of high-quality QIs, rigorous, approved, and evidence-based development methods are needed. Clinical practice guidelines are a suitable source to derive QIs from, but no gold standard for guideline-based QI development exists. This review aims to identify, describe, and compare methodological approaches to guideline-based QI development. Methods We systematically searched medical literature databases (Medline, EMBASE, and CINAHL) and grey literature. Two researchers selected publications reporting methodological approaches to guideline-based QI development. In order to describe and compare methodological approaches used in these publications, we extracted detailed information on common steps of guideline-based QI development (topic selection, guideline selection, extraction of recommendations, QI selection, practice test, and implementation) to predesigned extraction tables. Results From 8,697 hits in the database search and several grey literature documents, we selected 48 relevant references. The studies were of heterogeneous type and quality. We found no randomized controlled trial or other studies comparing the ability of different methodological approaches to guideline-based development to generate high-quality QIs. The relevant publications featured a wide variety of methodological approaches to guideline-based QI development, especially regarding guideline selection and extraction of recommendations. Only a few studies reported patient involvement. Conclusions Further research is needed to determine which elements of the methodological approaches identified, described, and compared in this review are best suited to constitute a gold standard for guideline-based QI development. For this research, we provide a comprehensive groundwork. PMID:22436067

Methodological quality of behavioural weight loss studies: a systematic review

PubMed Central

Lemon, S. C.; Wang, M. L.; Haughton, C. F.; Estabrook, D. P.; Frisard, C. F.; Pagoto, S. L.

2018-01-01

Summary This systematic review assessed the methodological quality of behavioural weight loss intervention studies conducted among adults and associations between quality and statistically significant weight loss outcome, strength of intervention effectiveness and sample size. Searches for trials published between January, 2009 and December, 2014 were conducted using PUBMED, MEDLINE and PSYCINFO and identified ninety studies. Methodological quality indicators included study design, anthropometric measurement approach, sample size calculations, intent-to-treat (ITT) analysis, loss to follow-up rate, missing data strategy, sampling strategy, report of treatment receipt and report of intervention fidelity (mean = 6.3). Indicators most commonly utilized included randomized design (100%), objectively measured anthropometrics (96.7%), ITT analysis (86.7%) and reporting treatment adherence (76.7%). Most studies (62.2%) had a follow-up rate >75% and reported a loss to follow-up analytic strategy or minimal missing data (69.9%). Describing intervention fidelity (34.4%) and sampling from a known population (41.1%) were least common. Methodological quality was not associated with reporting a statistically significant result, effect size or sample size. This review found the published literature of behavioural weight loss trials to be of high quality for specific indicators, including study design and measurement. Identified for improvement include utilization of more rigorous statistical approaches to loss to follow up and better fidelity reporting. PMID:27071775

Evolution of the methodological quality of controlled clinical trials for myofascial trigger point treatments for the period 1978-2015: A systematic review.

PubMed

Stoop, Rahel; Clijsen, Ron; Leoni, Diego; Soldini, Emiliano; Castellini, Greta; Redaelli, Valentina; Barbero, Marco

2017-08-01

The methodological quality of controlled clinical trials (CCTs) of physiotherapeutic treatment modalities for myofascial trigger points (MTrP) has not been investigated yet. To detect the methodological quality of CCTs for physiotherapy treatments of MTrPs and demonstrating the possible increase over time. Systematic review. A systematic search was conducted in two databases, Physiotherapy Evidence Database (PEDro) and Medicine Medical Literature Analysis and Retrieval System online (MEDLINE), using the same keywords and selection procedure corresponding to pre-defined inclusion criteria. The methodological quality, assessed by the 11-item PEDro scale, served as outcome measure. The CCTs had to compare at least two interventions, where one intervention had to lay within the scope of physiotherapy. Participants had to be diagnosed with myofascial pain syndrome or trigger points (active or latent). A total of n = 230 studies was analysed. The cervico-thoracic region was the most frequently treated body part (n = 143). Electrophysical agent applications was the most frequent intervention. The average methodological quality reached 5.5 on the PEDro scale. A total of n = 6 studies scored the value of 9. The average PEDro score increased by 0.7 points per decade between 1978 and 2015. The average PEDro score of CCTs for MTrP treatments does not reach the cut-off of 6 proposed for moderate to high methodological quality. Nevertheless, a promising trend towards an increase of the average methodological quality of CCTs for MTrPs was recorded. More high-quality CCT studies with thorough research procedures are recommended to enhance methodological quality. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Systematic reviews and meta-analyses on psoriasis: role of funding sources, conflict of interest and bibliometric indices as predictors of methodological quality.

PubMed

Gómez-García, F; Ruano, J; Aguilar-Luque, M; Gay-Mimbrera, J; Maestre-Lopez, B; Sanz-Cabanillas, J L; Carmona-Fernández, P J; González-Padilla, M; Vélez García-Nieto, A; Isla-Tejera, B

2017-06-01

The quality of systematic reviews and meta-analyses on psoriasis, a chronic inflammatory skin disease that severely impairs quality of life and is associated with high costs, remains unknown. To assess the methodological quality of systematic reviews published on psoriasis. After a comprehensive search in MEDLINE, Embase and the Cochrane Database (PROSPERO: CDR42016041611), the quality of studies was assessed by two raters using the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Article metadata and journal-related bibliometric indices were also obtained. Systematic reviews were classified as low (0-4), moderate (5-8) or high (9-11) quality. A prediction model for methodological quality was fitted using principal component and multivariate ordinal logistic regression analyses. We classified 220 studies as high (17·2%), moderate (55·0%) or low (27·8%) quality. Lower compliance rates were found for AMSTAR question (Q)5 (list of studies provided, 11·4%), Q10 (publication bias assessed, 27·7%), Q4 (status of publication included, 39·5%) and Q1 (a priori design provided, 40·9%). Factors such as meta-analysis inclusion [odds ratio (OR) 6·22; 95% confidence interval (CI) 2·78-14·86], funding by academic institutions (OR 2·90, 95% CI 1·11-7·89), Article Influence score (OR 2·14, 95% CI 1·05-6·67), 5-year impact factor (OR 1·34, 95% CI 1·02-1·40) and article page count (OR 1·08, 95% CI 1·02-1·15) significantly predicted higher quality. A high number of authors with a conflict of interest (OR 0·90, 95% CI 0·82-0·99) was significantly associated with lower quality. The methodological quality of systematic reviews published about psoriasis remains suboptimal. The type of funding sources and author conflicts may compromise study quality, increasing the risk of bias. © 2017 British Association of Dermatologists.

Guidance on assessing the methodological and reporting quality of toxicologically relevant studies: A scoping review.

PubMed

Samuel, Gbeminiyi O; Hoffmann, Sebastian; Wright, Robert A; Lalu, Manoj Mathew; Patlewicz, Grace; Becker, Richard A; DeGeorge, George L; Fergusson, Dean; Hartung, Thomas; Lewis, R Jeffrey; Stephens, Martin L

2016-01-01

Assessments of methodological and reporting quality are critical to adequately judging the credibility of a study's conclusions and to gauging its potential reproducibility. To aid those seeking to assess the methodological or reporting quality of studies relevant to toxicology, we conducted a scoping review of the available guidance with respect to four types of studies: in vivo and in vitro, (quantitative) structure-activity relationships ([Q]SARs), physico-chemical, and human observational studies. Our aims were to identify the available guidance in this diverse literature, briefly summarize each document, and distill the common elements of these documents for each study type. In general, we found considerable guidance for in vivo and human studies, but only one paper addressed in vitro studies exclusively. The guidance for (Q)SAR studies and physico-chemical studies was scant but authoritative. There was substantial overlap across guidance documents in the proposed criteria for both methodological and reporting quality. Some guidance documents address toxicology research directly, whereas others address preclinical research generally or clinical research and therefore may not be fully applicable to the toxicology context without some translation. Another challenge is the degree to which assessments of methodological quality in toxicology should focus on risk of bias - as in clinical medicine and healthcare - or be broadened to include other quality measures, such as confirming the identity of test substances prior to exposure. Our review is intended primarily for those in toxicology and risk assessment seeking an entry point into the extensive and diverse literature on methodological and reporting quality applicable to their work. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Is Article Methodological Quality Associated With Conflicts of Interest?: An Analysis of the Plastic Surgery Literature.

PubMed

Cho, Brian H; Lopez, Joseph; Means, Jessica; Lopez, Sandra; Milton, Jacqueline; Tufaro, Anthony P; May, James W; Dorafshar, Amir H

2017-12-01

Conflicts of interest (COI) are an emerging area of discussion within the field of plastic surgery. Recently, several reports have found that research studies that disclose COI are associated with publication of positive outcomes. We hypothesize that this association is driven by higher-quality studies receiving industry funding. This study aimed to investigate the association between industry support and study methodological quality. We reviewed all entries in Plastic and Reconstructive Surgery, Annals of Plastic Surgery, and Journal of Plastic, Reconstructive, and Aesthetic Surgery within a 1-year period encompassing 2013. All clinical research articles were analyzed. Studies were evaluated blindly for methodology quality based on a validated scoring system. An ordinal logistic regression model was used to examine the association between methodology score and COI. A total of 1474 articles were reviewed, of which 483 met our inclusion criteria. These articles underwent methodological quality scoring. Conflicts of interest were reported in 28 (5.8%) of these articles. After adjusting for article characteristics in the ordinal logistic regression analysis, there was no significant association between articles with COI and higher methodological scores (P = 0.7636). Plastic surgery studies that disclose COI are not associated with higher methodological quality when compared with studies that do not disclose COI. These findings suggest that although the presence of COI is associated with positive findings, the association is not shown to be driven by higher-quality studies.

[Audit and feedback, and continuous quality improvement strategies to improve the quality of care for type 2 diabetes: a systematic review of literature].

PubMed

Vecchi, Simona; Agabiti, Nera; Mitrova, Susanna; Cacciani, Laura; Amato, Laura; Davoli, Marina; Bargagli, Anna Maria

2016-01-01

we analysed evidence on effective interventions to improve the quality of care and management in patients with diabetes type 2. This review focuses particularly on audit and feedback intervention, targeted to healthcare providers, and continuous quality improvement (CQI) involving health professionals and health care systems, respectively. we searched The Cochrane Library, PubMed, and EMBASE (search period: January 2005-December 2015) to identify systematic reviews (SR) and randomized controlled trials (RCTs) considering patients' outcomes and process measures as quality indicators in diabetes care. Selection of studies and data extraction were carried out independently by two reviewers. Methodological quality of individual studies was assessed using the checklist «Assessment of methodological quality of systematic review» (AMSTAR) and the Cochrane's tool, respectively. We produced summaries of results for each study design. the search process resulted in 810 citations. One SR and 7 RCTs that compared any intervention in which audit and feedback and CQI was a component vs. other interventions were selected. The SR found that audit and feedback activity was associated with improvements of glycaemic (mean difference: 0.26; 95%CI 0.08;0.44) and cholesterol control (mean difference: 0.03; 95%CI -0.04;0.10). CQI interventions were not associated with an improvement of quality of diabetes care. The RCTs considered in this review compared a broad range of interventions including feedback as unique activity or as part of more complex strategies. The methodological quality was generally poor in all the included trials. the available evidence suggests that audit and feedback and CQI improve quality of care in diabetic patients, although the effect is small and heterogeneous among process and outcomes indicators.

Improving the Quality of Services in Residential Treatment Facilities: A Strength-Based Consultative Review Process

ERIC Educational Resources Information Center

Pavkov, Thomas W.; Lourie, Ira S.; Hug, Richard W.; Negash, Sesen

2010-01-01

This descriptive case study reports on the positive impact of a consultative review methodology used to conduct quality assurance reviews as part of the Residential Treatment Center Evaluation Project. The study details improvement in the quality of services provided to youth in unmonitored residential treatment facilities. Improvements were…

Methodological Quality Assessment of Meta-Analyses and Systematic Reviews of Probiotics in Inflammatory Bowel Disease and Pouchitis.

PubMed

Dong, Jinpei; Teng, Guigen; Wei, Tiantong; Gao, Wen; Wang, Huahong

2016-01-01

Probiotics are widely used for the induction and maintenance of remission in inflammatory bowel disease (IBD) and pouchitis. There are a large number of meta-analyses (MAs)/ systematic reviews (SRs) on this subject, the methodological quality of which has not been evaluated. This study aimed to evaluate the methodological quality of and summarize the evidence obtained from MAs/SRs of probiotic treatments for IBD and pouchitis patients. The PubMed, EMBASE, Cochrane Library and China National Knowledge Infrastructure (CNKI) databases were searched to identify Chinese and English language MAs/SRs of the use of probiotics for IBD and pouchitis. The Assessment of Multiple Systematic Reviews (AMSTAR) scale was used to assess the methodological quality of the studies. A total of 36 MAs/SRs were evaluated. The AMSTAR scores of the included studies ranged from 1 to 10, and the average score was 5.81. According to the Canadian Agency for Drugs and Technologies in Health, 4 articles were classified as high quality, 24 articles were classified as moderate quality, and 8 articles were classified as low quality. Most of the MAs/SRs suggested that probiotics had potential benefits for patients with ulcerative colitis (UC), but failed to show effectiveness in the induction and maintenance of remission in Crohn's disease (CD). The probiotic preparation VSL#3 may play a beneficial role in pouchitis. The overall methodological quality of the current MAs/SRs in the field of probiotics for IBD and pouchitis was found to be low to moderate. More MAs/SRs of high quality are required to support using probiotics to treat IBD and pouchitis.

Quality Perception within Corporate E-Learning Providers in Catalonia

ERIC Educational Resources Information Center

Sangra, Albert; Fernandez-Michels, Pedro

2011-01-01

Purpose: The paper seeks to describe the Catalan corporate e-learning providers from the perspective of quality perception, quality assessment and quality control. Design/methodology/approach: A literature review reveals key aspects of the definition of quality in e-learning. The results of the review constitute the basis for exploratory research…

The reporting characteristics and methodological quality of Cochrane reviews about health policy research.

PubMed

Xiu-xia, Li; Ya, Zheng; Yao-long, Chen; Ke-hu, Yang; Zong-jiu, Zhang

2015-04-01

The systematic review has increasingly become a popular tool for researching health policy. However, due to the complexity and diversity in the health policy research, it has also encountered more challenges. We set out the Cochrane reviews on health policy research as a representative to provide the first examination of epidemiological and descriptive characteristics as well as the compliance of methodological quality with the AMSTAR. 99 reviews were included by inclusion criteria, 73% of which were Implementation Strategies, 15% were Financial Arrangements and 12% were Governance Arrangements; involved Public Health (34%), Theoretical Exploration (18%), Hospital Management (17%), Medical Insurance (12%), Pharmaceutical Policy (9%), Community Health (7%) and Rural Health (2%). Only 39% conducted meta-analysis, and 49% reported being updates, and none was rated low methodological quality. Our research reveals that the quantity and quality of the evidence should be improved, especially Financial Arrangements and Governance Arrangements involved Rural Health, Health Care Reform and Health Equity, etc. And the reliability of AMSTAR needs to be tested in larger range in this field. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Evaluation of AMSTAR to assess the methodological quality of systematic reviews in overviews of reviews of healthcare interventions.

PubMed

Pollock, Michelle; Fernandes, Ricardo M; Hartling, Lisa

2017-03-23

Overviews of reviews (overviews) compile information from multiple systematic reviews (SRs) to provide a single synthesis of relevant evidence for decision-making. It is recommended that authors assess and report the methodological quality of SRs in overviews-for example, using A MeaSurement Tool to Assess systematic Reviews (AMSTAR). Currently, there is variation in whether and how overview authors assess and report SR quality, and limited guidance is available. Our objectives were to: examine methodological considerations involved in using AMSTAR to assess the quality of Cochrane and non-Cochrane SRs in overviews of healthcare interventions; identify challenges (and develop potential decision rules) when using AMSTAR in overviews; and examine the potential impact of considering methodological quality when making inclusion decisions in overviews. We selected seven overviews of healthcare interventions and included all SRs meeting each overview's inclusion criteria. For each SR, two reviewers independently conducted AMSTAR assessments with consensus and discussed challenges encountered. We also examined the correlation between AMSTAR assessments and SR results/conclusions. Ninety-five SRs were included (30 Cochrane, 65 non-Cochrane). Mean AMSTAR assessments (9.6/11 vs. 5.5/11; p < 0.001) and inter-rater reliability (AC1 statistic: 0.84 vs. 0.69; "almost perfect" vs. "substantial" using the Landis & Koch criteria) were higher for Cochrane compared to non-Cochrane SRs. Four challenges were identified when applying AMSTAR in overviews: the scope of the SRs and overviews often differed; SRs examining similar topics sometimes made different methodological decisions; reporting of non-Cochrane SRs was sometimes poor; and some non-Cochrane SRs included other SRs as well as primary studies. Decision rules were developed to address each challenge. We found no evidence that AMSTAR assessments were correlated with SR results/conclusions. Results indicate that the AMSTAR tool can be used successfully in overviews that include Cochrane and non-Cochrane SRs, though decision rules may be useful to circumvent common challenges. Findings support existing recommendations that quality assessments of SRs in overviews be conducted independently, in duplicate, with a process for consensus. Results also suggest that using methodological quality to guide inclusion decisions (e.g., to exclude poorly conducted and reported SRs) may not introduce bias into the overview process.

Single-Subject Evaluation: A Tool for Quality Assurance.

ERIC Educational Resources Information Center

Nuehring, Elane M.; Pascone, Anne B.

1986-01-01

The use of single-subject designs in peer review, in utilization review, and in other quality-assurance audits is encouraged. Presents an overview of the methodologies of single-subject designs and quality assurance, and provides examples of cases in which single-subject techniques furnished relevant quality assurance documentation. (Author/ABB)

Methodological quality of randomized controlled trials of spinal manipulation and mobilization in tension-type headache, migraine, and cervicogenic headache.

PubMed

Fernández-de-las-Peñas, César; Alonso-Blanco, Cristina; San-Roman, Jesús; Miangolarra-Page, Juan C

2006-03-01

Literature review of quality of clinical trials. To determine the methodological quality of published randomized controlled trials that used spinal manipulation and/or mobilization to treat patients with tension-type headache (TTH), cervicogenic headache (CeH), and migraine (M) in the last decade. TTH, CeH, and M are the most prevalent types of headaches seen in adults. Individuals who have headaches frequently use physical therapy, manual therapy, or chiropractic care. Randomized controlled trials are considered an optimal method with which to assess the efficacy of any intervention. Computerized literature searches were performed in MEDLINE, EMBASE, COCHRANE, AMED, MANTIS, CINHAL, and PEDro databases. Randomized controlled trials in which spinal manipulation and/or mobilization had been used for TTH, CeH, and M published in a peer-reviewed journal as full text, and with at least 1 clinically relevant outcome measure (ie, headache intensity, duration, or frequency) were reviewed. The methodological quality of the studies was assessed independently by 2 reviewers using a set of predefined criteria. Only 8 studies met all the inclusion criteria. One clinical trial evaluated spinal manipulation and mobilization together, and the remaining 7 assessed spinal manipulative therapy. No controlled trials analyzing exclusively the effects of spinal mobilization were found. Methodological scores ranged from 35 to 56 points out of a theoretical maximum of 100 points, indicating an overall poor methodology of the studies. Only 2 studies obtained a high-quality score (greater than 50 points). No significant differences in quality scores were found based on the type of headache investigated. Methodological quality was not associated with the year of publication (before 2000, or later) nor with the results (positive, neutral, negative) reported in the studies. The most common flaws were a small sample size, the absence of a placebo control group, lack of blinded patients, and no description of the manipulative procedure. There are few published randomized controlled trials analyzing the effectiveness of spinal manipulation and/or mobilization for TTH, CeH, and M in the last decade. In addition, the methodological quality of these papers is typically low. Clearly, there is a need for high-quality randomized controlled trials assessing the effectiveness of these interventions in these headache disorders.

Methodological Quality of Systematic Reviews Published in the Urological Literature from 1998 to 2012.

PubMed

Corbyons, Katherine; Han, Julia; Neuberger, Molly M; Dahm, Philipp

2015-11-01

Systematic reviews synthesize the current best evidence to address a clinical question. Given the growing emphasis on evidence-based clinical practice, systematic reviews are being increasingly sought after and published. We previously reported limitations in the methodological quality of 57 individual systematic reviews published from 1998 to 2008. We provide an update to our previous study, adding systematic reviews published from 2009 to 2012. We systematically searched PubMed® and hand searched the table of contents of 4 major urological journals to identify systematic reviews related to questions of prevention and therapy. Two independent reviewers with prior formal evidence-based medicine training assessed the methodological quality using the validated 11-point AMSTAR (A Measurement Tool to Assess Systematic Reviews) instrument. We performed predefined statistical hypothesis testing for differences by publication period (1998 to 2008 vs 2009 to 2012) and journal of publication. We performed statistical testing using SPSS®, version 23.0 with a 2-sided α of 0.05 using the Student t-test, ANOVA and the chi-square test. A total of 113 systematic reviews published from 2009 to 2012 met study inclusion criteria. The most common topics were oncology (44 reviews or 38.9%), voiding dysfunction (26 or 23.0%) and stones/endourology (13 or 11.5%). The largest contributor was European Urology (46 reviews or 40.7%), followed by BJU International (31 or 27.4%) and The Journal of Urology® (22 or 19.5%). The mean ± SD AMSTAR score for the 2009 to 2012 period was 5.3 ± 2.3 compared to 4.8 ± 2.0 for 1998 to 2008 with a mean difference of 0.5 (95% CI 0.2 to 1.2, p = 0.133). While the number of systematic reviews published in the urological literature has increased substantially, the methodological quality of these studies remains suboptimal. Systematic review authors and editors should make every effort to adhere to well established methodological standards to enhance the impact of their research efforts. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Dissemination Bias in Systematic Reviews of Animal Research: A Systematic Review

PubMed Central

Mueller, Katharina F.; Briel, Matthias; Strech, Daniel; Meerpohl, Joerg J.; Lang, Britta; Motschall, Edith; Gloy, Viktoria; Lamontagne, Francois; Bassler, Dirk

2014-01-01

Background Systematic reviews of preclinical studies, in vivo animal experiments in particular, can influence clinical research and thus even clinical care. Dissemination bias, selective dissemination of positive or significant results, is one of the major threats to validity in systematic reviews also in the realm of animal studies. We conducted a systematic review to determine the number of published systematic reviews of animal studies until present, to investigate their methodological features especially with respect to assessment of dissemination bias, and to investigate the citation of preclinical systematic reviews on clinical research. Methods Eligible studies for this systematic review constitute systematic reviews that summarize in vivo animal experiments whose results could be interpreted as applicable to clinical care. We systematically searched Ovid Medline, Embase, ToxNet, and ScienceDirect from 1st January 2009 to 9th January 2013 for eligible systematic reviews without language restrictions. Furthermore we included articles from two previous systematic reviews by Peters et al. and Korevaar et al. Results The literature search and screening process resulted in 512 included full text articles. We found an increasing number of published preclinical systematic reviews over time. The methodological quality of preclinical systematic reviews was low. The majority of preclinical systematic reviews did not assess methodological quality of the included studies (71%), nor did they assess heterogeneity (81%) or dissemination bias (87%). Statistics quantifying the importance of clinical research citing systematic reviews of animal studies showed that clinical studies referred to the preclinical research mainly to justify their study or a future study (76%). Discussion Preclinical systematic reviews may have an influence on clinical research but their methodological quality frequently remains low. Therefore, systematic reviews of animal research should be critically appraised before translating them to a clinical context. PMID:25541734

Comparison of methodological quality of positive versus negative comparative studies published in Indian medical journals: a systematic review

PubMed Central

Charan, Jaykaran; Chaudhari, Mayur; Jackson, Ryan; Mhaskar, Rahul; Reljic, Tea; Kumar, Ambuj

2015-01-01

Objectives Published negative studies should have the same rigour of methodological quality as studies with positive findings. However, the methodological quality of negative versus positive studies is not known. The objective was to assess the reported methodological quality of positive versus negative studies published in Indian medical journals. Design A systematic review (SR) was performed of all comparative studies published in Indian medical journals with a clinical science focus and impact factor >1 between 2011 and 2013. The methodological quality of randomised controlled trials (RCTs) was assessed using the Cochrane risk of bias tool, and the Newcastle-Ottawa scale for observational studies. The results were considered positive if the primary outcome was statistically significant and negative otherwise. When the primary outcome was not specified, we used data on the first outcome reported in the history followed by the results section. Differences in various methodological quality domains between positive versus negative studies were assessed by Fisher's exact test. Results Seven journals with 259 comparative studies were included in this SR. 24% (63/259) were RCTs, 24% (63/259) cohort studies, and 49% (128/259) case–control studies. 53% (137/259) of studies explicitly reported the primary outcome. Five studies did not report sufficient data to enable us to determine if results were positive or negative. Statistical significance was determined by p value in 78.3% (199/254), CI in 2.8% (7/254), both p value and CI in 11.8% (30/254), and only descriptive in 6.3% (16/254) of studies. The overall methodological quality was poor and no statistically significant differences between reporting of methodological quality were detected between studies with positive versus negative findings. Conclusions There was no difference in the reported methodological quality of positive versus negative studies. However, the uneven reporting of positive versus negative studies (72% vs 28%) indicates a publication bias in Indian medical journals with an impact factor of >1. PMID:26109118

Cochrane Systematic Reviews of Chinese Herbal Medicines: An Overview

PubMed Central

Hu, Jing; Zhang, Junhua; Zhao, Wei; Zhang, Yongling; Zhang, Li; Shang, Hongcai

2011-01-01

Objectives Our study had two objectives: a) to systematically identify all existing systematic reviews of Chinese herbal medicines (CHM) published in Cochrane Library; b) to assess the methodological quality of included reviews. Methodology/Principal Findings We performed a systematic search of the Cochrane Database of Systematic Reviews (CDSR, Issue 5, 2010) to identify all reviews of CHM. A total of fifty-eight reviews were eligible for our study. Twenty-one of the included reviews had at least one Traditional Chinese Medicine (TCM) practitioner as its co-author. 7 reviews didn't include any primary study, the remaining reviews (n = 51) included a median of 9 studies and 936 participants. 50% of reviews were last assessed as up-to-date prior to 2008. The questions addressed by 39 reviews were broad in scope, in which 9 reviews combined studies with different herbal medicines. For OQAQ, the mean of overall quality score (item 10) was 5.05 (95% CI; 4.58-5.52). All reviews assessed the methodological quality of primary studies, 16% of included primary studies used adequate sequence generation and 7% used adequate allocation concealment. Of the 51 nonempty reviews, 23 reviews were reported as being inconclusive, while 27 concluded that there might be benefit of CHM, which was limited by the poor quality or inadequate quantity of included studies. 58 reviews reported searching a median of seven electronic databases, while 10 reviews did not search any Chinese database. Conclusions Now CDSR has included large numbers of CHM reviews, our study identified some areas which could be improved, such as almost half of included reviews did not have the participation of TCM practitioners and were not up-to-date according to Cochrane criteria, some reviews pooled the results of different herbal medicines and ignored the searching of Chinese databases. PMID:22174870

Oral Chinese proprietary medicine for angina pectoris: an overview of systematic reviews/meta-analyses.

PubMed

Luo, Jing; Xu, Hao; Yang, Guoyan; Qiu, Yu; Liu, Jianping; Chen, Keji

2014-08-01

Oral Chinese proprietary medicine (CPM) is commonly used to treat angina pectoris, and many relevant systematic reviews/meta-analyses are available. However, these reviews have not been systematically summarized and evaluated. We conducted an overview of these reviews, and explored their methodological and reporting quality to inform both practice and further research. We included systematic reviews/meta-analyses on oral CPM in treating angina until March 2013 by searching PubMed, Embase, the Cochrane Library and four Chinese databases. We extracted data according to a pre-designed form, and assessed the methodological and reporting characteristics of the reviews in terms of AMSTAR and PRISMA respectively. Most of the data analyses were descriptive. 36 systematic reviews/meta-analyses involving over 82,105 participants with angina reviewing 13 kinds of oral CPM were included. The main outcomes assessed in the reviews were surrogate outcomes (34/36, 94.4%), adverse events (31/36, 86.1%), and symptoms (30/36, 83.3%). Six reviews (6/36, 16.7%) drew definitely positive conclusions, while the others suggested potential benefits in the symptoms, electrocardiogram, and adverse events. The overall methodological and reporting quality of the reviews was limited, with many serious flaws such as the lack of review protocol and incomprehensive literature searches. Though many systematic reviews/meta-analyses on oral CPM for angina suggested potential benefits or definitely positive effects, stakeholders should interpret the findings of these reviews with caution, considering the overall limited methodological and reporting quality. We recommend further studies should be appropriately conducted and systematic reviews reported according to PRISMA standard. Copyright © 2014 Elsevier Ltd. All rights reserved.

Methodological and Reporting Quality of Comparative Studies Evaluating Health-Related Quality of Life of Colorectal Cancer Patients and Controls: A Systematic Review.

PubMed

Wong, Carlos K H; Guo, Vivian Y W; Chen, Jing; Lam, Cindy L K

2016-11-01

Health-related quality of life is an important outcome measure in patients with colorectal cancer. Comparison with normative data has been increasingly undertaken to assess the additional impact of colorectal cancer on health-related quality of life. This review aimed to critically appraise the methodological details and reporting characteristics of comparative studies evaluating differences in health-related quality of life between patients and controls. A systematic search of English-language literature published between January 1985 and May 2014 was conducted through a database search of PubMed, Web of Science, Embase, and Medline. Comparative studies reporting health-related quality-of-life outcomes among patients who have colorectal cancer and controls were selected. Methodological and reporting quality per comparison study was evaluated based on a 11-item methodological checklist proposed by Efficace in 2003 and a set of criteria predetermined by reviewers. Thirty-one comparative studies involving >10,000 patients and >10,000 controls were included. Twenty-three studies (74.2%) originated from European countries, with the largest number from the Netherlands (n = 6). Twenty-eight studies (90.3%) compared the health-related quality of life of patients with normative data published elsewhere, whereas the remaining studies recruited a group of patients who had colorectal cancer and a group of control patients within the same studies. The European Organisation for Research and Treatment of Cancer Quality-of-Life Questionnaire Core 30 was the most extensively used instrument (n = 16; 51.6%). Eight studies (25.8%) were classified as "probably robust" for clinical decision making according to the Efficace standard methodological checklist. Our further quality assessment revealed the lack of score differences reported (61.3%), contemporary comparisons (36.7%), statistical significance tested (38.7%), and matching of control group (58.1%), possibly leading to inappropriate control groups for fair comparisons. Meta-analysis of differences between the 2 groups was not available. In general, one-fourth of comparative studies that evaluated health-related quality of life of patients who had colorectal cancer achieved high quality in reporting characteristics and methodological details. Future studies are encouraged to undertake health-related quality-of-life measurement and adhere to a methodological checklist in comparison with controls.

Systematic Review of Measurement Property Evidence for 8 Financial Management Instruments in Populations With Acquired Cognitive Impairment.

PubMed

Engel, Lisa; Chui, Adora; Beaton, Dorcas E; Green, Robin E; Dawson, Deirdre R

2018-03-07

To critically appraise the measurement property evidence (ie, psychometric) for 8 observation-based financial management assessment instruments. Seven databases were searched in May 2015. Two reviewers used an independent decision-agreement process to select studies of measurement property evidence relevant to populations with adulthood acquired cognitive impairment, appraise the quality of the evidence, and extract data. Twenty-one articles were selected. This review used the COnsensus-based Standards for the selection of health Measurement Instruments review guidelines and 4-point tool to appraise evidence. After appraising the methodologic quality, the adequacy of results and volume of evidence per instrument were synthesized. Measurement property evidence with high risk of bias was excluded from the synthesis. The volume of measurement property evidence per instrument is low; most instruments had 1 to 3 included studies. Many included studies had poor methodologic quality per measurement property evidence area examined. Six of the 8 instruments reviewed had supporting construct validity/hypothesis-testing evidence of fair methodologic quality. There is a dearth of acceptable quality content validity, reliability, and responsiveness evidence for all 8 instruments. Rehabilitation practitioners assess financial management functions in adults with acquired cognitive impairments. However, there is limited published evidence to support using any of the reviewed instruments. Practitioners should exercise caution when interpreting the results of these instruments. This review highlights the importance of appraising the quality of measurement property evidence before examining the adequacy of the results and synthesizing the evidence. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Outpatient Interventions for Adolescent Substance Abuse: A Quality of Evidence Review

ERIC Educational Resources Information Center

Becker, Sara J.; Curry, John F.

2008-01-01

Previous reviews of outpatient interventions for adolescent substance abuse have been limited in the extent to which they considered the methodological quality of individual studies. The authors assessed 31 randomized trials of outpatient interventions for adolescent substance abuse on 14 attributes of trial quality. A quality of evidence score…

Critical appraisal of systematic reviews on the effect of a history of periodontitis on dental implant loss.

PubMed

Faggion, Clovis Mariano; Giannakopoulos, Nikolaos Nikitas

2013-05-01

To perform a systematic critical appraisal of the methodological quality of systematic reviews on the effect of a history of periodontitis on dental implant loss. PubMed, the Cochrane database for systematic reviews, the DARE, Biosis Preview, CINAHL, Web of Science, and LILACS electronic databases were searched on 16th June 2012, independently and in duplicate, for systematic reviews and meta-analyses related to dental implants for patients with and without a history of periodontitis. Manual searching of the reference lists of included papers was also conducted. The methodological quality of these systematic reviews was assessed by use of the AMSTAR and R-AMSTAR checklists. Before quality assessment was initiated, the reviewers were calibrated until they achieved excellent agreement. Sixty-eight papers were initially retrieved. Of these, nine systematic reviews and three meta-analyses were included. Some domains, for example, "characteristics of the included studies" were satisfied in both checklists. In contrast, domains such as "comprehensive literature search" and "assessment of likelihood of publication bias" were rarely met. Much methodological variability was encountered in the selected reviews. To furnish readers with a more comprehensive assessment of the evidence, authors should observe higher standards when conducting and reporting their reviews. © 2013 John Wiley & Sons A/S.

Preventing Harm in the ICU-Building a Culture of Safety and Engaging Patients and Families.

PubMed

Thornton, Kevin C; Schwarz, Jennifer J; Gross, A Kendall; Anderson, Wendy G; Liu, Kathleen D; Romig, Mark C; Schell-Chaple, Hildy; Pronovost, Peter J; Sapirstein, Adam; Gropper, Michael A; Lipshutz, Angela K M

2017-09-01

Preventing harm remains a persistent challenge in the ICU despite evidence-based practices known to reduce the prevalence of adverse events. This review seeks to describe the critical role of safety culture and patient and family engagement in successful quality improvement initiatives in the ICU. We review the evidence supporting the impact of safety culture and provide practical guidance for those wishing to implement initiatives aimed at improving safety culture and more effectively integrate patients and families in such efforts. Literature review using PubMed including evaluation of key studies assessing large-scale quality improvement efforts in the ICU, impact of safety culture on patient outcomes, methodologies for quality improvement commonly used in healthcare, and patient and family engagement. Print and web-based resources from leading patient safety organizations were also searched. Our group completed a review of original studies, review articles, book chapters, and recommendations from leading patient safety organizations. Our group determined by consensus which resources would best inform this review. A strong safety culture is associated with reduced adverse events, lower mortality rates, and lower costs. Quality improvement efforts have been shown to be more effective and sustainable when paired with a strong safety culture. Different methodologies exist for quality improvement in the ICU; a thoughtful approach to implementation that engages frontline providers and administrative leadership is essential for success. Efforts to substantively include patients and families in the processes of quality improvement work in the ICU should be expanded. Efforts to establish a culture of safety and meaningfully engage patients and families should form the foundation for all safety interventions in the ICU. This review describes an approach that integrates components of several proven quality improvement methodologies to enhance safety culture in the ICU and highlights opportunities to include patients and families.

Vending machine assessment methodology. A systematic review.

PubMed

Matthews, Melissa A; Horacek, Tanya M

2015-07-01

The nutritional quality of food and beverage products sold in vending machines has been implicated as a contributing factor to the development of an obesogenic food environment. How comprehensive, reliable, and valid are the current assessment tools for vending machines to support or refute these claims? A systematic review was conducted to summarize, compare, and evaluate the current methodologies and available tools for vending machine assessment. A total of 24 relevant research studies published between 1981 and 2013 met inclusion criteria for this review. The methodological variables reviewed in this study include assessment tool type, study location, machine accessibility, product availability, healthfulness criteria, portion size, price, product promotion, and quality of scientific practice. There were wide variations in the depth of the assessment methodologies and product healthfulness criteria utilized among the reviewed studies. Of the reviewed studies, 39% evaluated machine accessibility, 91% evaluated product availability, 96% established healthfulness criteria, 70% evaluated portion size, 48% evaluated price, 52% evaluated product promotion, and 22% evaluated the quality of scientific practice. Of all reviewed articles, 87% reached conclusions that provided insight into the healthfulness of vended products and/or vending environment. Product healthfulness criteria and complexity for snack and beverage products was also found to be variable between the reviewed studies. These findings make it difficult to compare results between studies. A universal, valid, and reliable vending machine assessment tool that is comprehensive yet user-friendly is recommended. Copyright © 2015 Elsevier Ltd. All rights reserved.

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews.

PubMed

Mayo-Wilson, Evan; Ng, Sueko Matsumura; Chuck, Roy S; Li, Tianjing

2017-09-05

Systematic reviews should inform American Academy of Ophthalmology (AAO) Preferred Practice Pattern® (PPP) guidelines. The quality of systematic reviews related to the forthcoming Preferred Practice Pattern® guideline (PPP) Refractive Errors & Refractive Surgery is unknown. We sought to identify reliable systematic reviews to assist the AAO Refractive Errors & Refractive Surgery PPP. Systematic reviews were eligible if they evaluated the effectiveness or safety of interventions included in the 2012 PPP Refractive Errors & Refractive Surgery. To identify potentially eligible systematic reviews, we searched the Cochrane Eyes and Vision United States Satellite database of systematic reviews. Two authors identified eligible reviews and abstracted information about the characteristics and quality of the reviews independently using the Systematic Review Data Repository. We classified systematic reviews as "reliable" when they (1) defined criteria for the selection of studies, (2) conducted comprehensive literature searches for eligible studies, (3) assessed the methodological quality (risk of bias) of the included studies, (4) used appropriate methods for meta-analyses (which we assessed only when meta-analyses were reported), (5) presented conclusions that were supported by the evidence provided in the review. We identified 124 systematic reviews related to refractive error; 39 met our eligibility criteria, of which we classified 11 to be reliable. Systematic reviews classified as unreliable did not define the criteria for selecting studies (5; 13%), did not assess methodological rigor (10; 26%), did not conduct comprehensive searches (17; 44%), or used inappropriate quantitative methods (3; 8%). The 11 reliable reviews were published between 2002 and 2016. They included 0 to 23 studies (median = 9) and analyzed 0 to 4696 participants (median = 666). Seven reliable reviews (64%) assessed surgical interventions. Most systematic reviews of interventions for refractive error are low methodological quality. Following widely accepted guidance, such as Cochrane or Institute of Medicine standards for conducting systematic reviews, would contribute to improved patient care and inform future research.

Standard Review Plan for Environmental Restoration Program Quality Management Plans. Revision 2

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1993-12-01

The Department of Energy, Richland Operations Office (RL) Manual Environmental Restoration Program Quality System Requirements (QSR) for the Hanford Site, defines all quality requirements governing Hanford Environmental Restoration (ER) Program activities. The QSR requires that ER Program participants develop Quality Management Plans (QMPs) that describe how the QSR requirements will be implemented for their assigned scopes of work. This standard review plan (SRP) describes the ER program participant responsibilities for submittal of QMPs to the RL Environmental Restoration Division for review and the RL methodology for performing the reviews of participant QMPS. The SRP serves the following functions: acts asmore » a guide in the development or revision of QMPs to assure that the content is complete and adequate; acts as a checklist to be used by the RL staff in their review of participant QMPs; acts as an index or matrix between the requirements of the QSR and implementing methodologies described in the QMPs; decreases the time and subjectivity of document reviews; and provides a formal, documented method for describing exceptions, modifications, or waivers to established ER Program quality requirements.« less

Methodological quality of systematic reviews analyzing the use of laser therapy in restorative dentistry.

PubMed

Salmos, Janaina; Gerbi, Marleny E M M; Braz, Rodivan; Andrade, Emanuel S S; Vasconcelos, Belmiro C E; Bessa-Nogueira, Ricardo V

2010-01-01

The purpose of this study was to identify systematic reviews (SRs) that compared laser with other dental restorative procedures and to evaluate their methodological quality. A search strategy was developed and implemented for MEDLINE, the Cochrane Library, LILACS, and the Brazilian Dentistry Bibliography (1966- 2007). Inclusion criteria were: the article had to be an SR (+/- meta-analysis); primary focus was the use of laser in restorative dentistry; published in English, Spanish, Portuguese, Italian, German. Two investigators independently selected and evaluated the SRs. The overview quality assessment questionnaire (OQAQ) was used to evaluate methodological quality, and the results were averaged. There were 145 references identified, of which seven were SRs that met the inclusion criteria (kappa=0.81). Of the SRs, 71.4% appraised lasers in dental caries diagnosis. The mean overall OQAQ score was 4.4 [95% confidence interval (CI) 2.4- 6.5]. Of the SRs, 57.1% had major flaws, scoring < or = 4. SR methodological quality is low; therefore, clinicians should critically appraise them prior to considering their recommendations to guide patient care.

Methodological quality of randomised controlled trials in burns care. A systematic review.

PubMed

Danilla, Stefan; Wasiak, Jason; Searle, Susana; Arriagada, Cristian; Pedreros, Cesar; Cleland, Heather; Spinks, Anneliese

2009-11-01

To evaluate the methodological quality of published randomised controlled trials (RCTs) in burn care treatment and management. Using a predetermined search strategy we searched Ovid MEDLINE (1950 to January 2008) database to identify all English RCTs related to burn care. Full text studies identified were reviewed for key demographic and methodological characteristics. Methodological trial quality was assessed using the Jadad scale. A total of 257 studies involving 14,535 patients met the inclusion criteria. The median Jadad score was 2 (out of a best possible score of 5). Information was given in the introduction and discussion sections of most RCTs, although insufficient detail was provided on randomisation, allocation concealment, and blinding. The number of RCTs increased between 1950 and 2008 (Spearman's rho=0.6129, P<0.001), although the reporting quality did not improve over the same time period (P=0.1896) and was better in RCTs with larger sample sizes (median Jadad score, 4 vs. 2 points, P<0.0001). Methodological quality did not correlate with journal impact factor (P=0.2371). The reporting standards of RCTs are highly variable and less than optimal in most cases. The advent of evidence-based medicine heralds a new approach to burns care and systematic steps are needed to improve the quality of RCTs in this field. Identifying and reviewing the existing number of RCTs not only highlights the need for burn clinicians to conduct more trials, but may also encourage burn health clinicians to consider the importance of conducting trials that follow appropriate, evidence-based standards.

Development of a Valid and Reliable Knee Articular Cartilage Condition-Specific Study Methodological Quality Score.

PubMed

Harris, Joshua D; Erickson, Brandon J; Cvetanovich, Gregory L; Abrams, Geoffrey D; McCormick, Frank M; Gupta, Anil K; Verma, Nikhil N; Bach, Bernard R; Cole, Brian J

2014-02-01

Condition-specific questionnaires are important components in evaluation of outcomes of surgical interventions. No condition-specific study methodological quality questionnaire exists for evaluation of outcomes of articular cartilage surgery in the knee. To develop a reliable and valid knee articular cartilage-specific study methodological quality questionnaire. Cross-sectional study. A stepwise, a priori-designed framework was created for development of a novel questionnaire. Relevant items to the topic were identified and extracted from a recent systematic review of 194 investigations of knee articular cartilage surgery. In addition, relevant items from existing generic study methodological quality questionnaires were identified. Items for a preliminary questionnaire were generated. Redundant and irrelevant items were eliminated, and acceptable items modified. The instrument was pretested and items weighed. The instrument, the MARK score (Methodological quality of ARticular cartilage studies of the Knee), was tested for validity (criterion validity) and reliability (inter- and intraobserver). A 19-item, 3-domain MARK score was developed. The 100-point scale score demonstrated face validity (focus group of 8 orthopaedic surgeons) and criterion validity (strong correlation to Cochrane Quality Assessment score and Modified Coleman Methodology Score). Interobserver reliability for the overall score was good (intraclass correlation coefficient [ICC], 0.842), and for all individual items of the MARK score, acceptable to perfect (ICC, 0.70-1.000). Intraobserver reliability ICC assessed over a 3-week interval was strong for 2 reviewers (≥0.90). The MARK score is a valid and reliable knee articular cartilage condition-specific study methodological quality instrument. This condition-specific questionnaire may be used to evaluate the quality of studies reporting outcomes of articular cartilage surgery in the knee.

The landscape of systematic reviews in urology (1998 to 2015): an assessment of methodological quality.

PubMed

Han, Julia L; Gandhi, Shreyas; Bockoven, Crystal G; Narayan, Vikram M; Dahm, Philipp

2017-04-01

To assess the quality of published systematic reviews in the urology literature (an extension of our previously reported work), as high-quality systematic reviews play a paramount role in informing evidence-based clinical practice. Our focus was on systematic reviews in the urology literature that incorporated questions of prevention and therapy. To identify such reviews published during a 36-month period (2013-2015), we systematically searched PubMed and hand-searched the table of contents of four major urology journals. Two reviewers independently assessed the methodological quality of those reviews, using the 11-point 'Assessment of Multiple Systematic Reviews' (AMSTAR) instrument. We performed protocol-driven analyses of the data from our present study's 36-month period alone, as well as in aggregate with the data from our previously reported work's study periods (2009-2012 and 1998-2008). In our literature search of the 36-month period (2013-2015), we initially identified 490 possibly relevant reviews, of which 125 met our inclusion criteria. The most common topic of reviews for the 2013-2015 period was oncology (51.2%; n = 64), followed by voiding dysfunction (21.6%; n = 27). The mean [standard deviation (SD)] AMSTAR score in the 2013-2015 period (n = 125) was 4.8 (2.4); 2009-2012 (n = 113), 5.4 (2.3); and 1998-2008 (n = 57), 4.8 (2.0) (P = 0.127). In the 2013-2015 period, the mean (SD) AMSTAR score for the BJU International (n = 25) was 5.6 (2.9); for The Journal of Urology (n = 20), 5.1 (2.6); for European Urology (n = 60), 4.5 (2.2); and for Urology (n = 20), 4.4 (2.2) (P = 0.106). The number of systematic reviews published in the urology literature has exponentially increased, year by year, but their methodological quality has stagnated. To enhance the validity and impact of systematic reviews, all authors and editors must apply established methodological standards. © 2016 The Authors BJU International © 2016 BJU International Published by John Wiley & Sons Ltd.

78 FR 40149 - Scientific Information Request on Chronic Urinary Retention (CUR) Treatment

Federal Register 2010, 2011, 2012, 2013, 2014

2013-07-03

... improve the quality of this review. AHRQ is conducting this comparative effectiveness review pursuant to..., study period, design, methodology, indication and diagnosis, proper use instructions, inclusion and... study number, the study period, design, methodology, indication and diagnosis, proper use instructions...

Qualitative case study methodology in nursing research: an integrative review.

PubMed

Anthony, Susan; Jack, Susan

2009-06-01

This paper is a report of an integrative review conducted to critically analyse the contemporary use of qualitative case study methodology in nursing research. Increasing complexity in health care and increasing use of case study in nursing research support the need for current examination of this methodology. In 2007, a search for case study research (published 2005-2007) indexed in the CINAHL, MEDLINE, EMBASE, PsychINFO, Sociological Abstracts and SCOPUS databases was conducted. A sample of 42 case study research papers met the inclusion criteria. Whittemore and Knafl's integrative review method guided the analysis. Confusion exists about the name, nature and use of case study. This methodology, including terminology and concepts, is often invisible in qualitative study titles and abstracts. Case study is an exclusive methodology and an adjunct to exploring particular aspects of phenomena under investigation in larger or mixed-methods studies. A high quality of case study exists in nursing research. Judicious selection and diligent application of literature review methods promote the development of nursing science. Case study is becoming entrenched in the nursing research lexicon as a well-accepted methodology for studying phenomena in health and social care, and its growing use warrants continued appraisal to promote nursing knowledge development. Attention to all case study elements, process and publication is important in promoting authenticity, methodological quality and visibility.

Systematic review of the methodological quality of clinical guideline development for the management of chronic disease in Europe.

PubMed

Knai, Cécile; Brusamento, Serena; Legido-Quigley, Helena; Saliba, Vanessa; Panteli, Dimitra; Turk, Eva; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

The use of evidence-based clinical guidelines is an essential component of chronic disease management. However, there is well-documented concern about variability in the quality of clinical guidelines, with evidence of persisting methodological shortcomings. The most widely accepted approach to assessing the quality of guidelines is the Appraisal of Guidelines for Research and Evaluation (AGREE) instrument. We have conducted a systematic review of the methodological quality (as assessed by AGREE) of clinical guidelines developed in Europe for the management of chronic diseases published since 2000. The systematic review was undertaken in accordance with the Cochrane methodology. The inclusion criteria were that studies should have appraised European clinical guidelines for certain selected chronic disorders using the AGREE instrument. We searched five databases (Cab Abstracts, EMBASE, MEDLINE, Trip and EPPI). Nine studies reported in 10 papers, analysing a total of 28 European guidelines from eight countries as well as pan-European, were included. There was considerable variation in the quality of clinical guidelines across the AGREE domains. The least well addressed domains were 'editorial independence' (with a mean domain score of 41%), 'applicability' (44%), 'stakeholder involvement' (55%), and 'rigour of development' (64%), while 'clarity of presentation' (80%) and 'scope and purpose' (84%) were less problematic. This review indicates that there is considerable scope for improvement in the methods used to develop clinical guidelines for the prevention, management and treatment of chronic diseases in Europe. Given the importance of decision support strategies such as clinical guidelines in chronic disease management, improvement measures should include the explicit and transparent involvement of key stakeholders (especially scientific experts, guideline users and methodological specialists) and consideration of the implications for guideline implementation and applicability early on in the process. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Anti-tobacco mass media and socially disadvantaged groups: a systematic and methodological review.

PubMed

Guillaumier, Ashleigh; Bonevski, Billie; Paul, Chris

2012-07-01

Only a limited amount of research has been conducted to explore whether there are socioeconomic status differences in responses to mass media. However, the methodological quality of this evidence has not been assessed, limiting confidence in conclusions that can be drawn regarding study outcomes. A systematic review of the effectiveness of anti-tobacco mass media campaigns with socially disadvantaged groups was conducted, and the methodological quality of included studies was assessed. Medline, The Cochrane Library, PsycInfo, Embase and Web of Science were searched using MeSH and keywords for quantitative studies conducted in Western countries prior to March 2012. A methodological quality assessment and narrative analysis of included studies was undertaken. Seventeen relevant studies (reported in 18 papers) were identified; however, weak study designs and selection bias were common characteristics, limiting strong conclusions about effectiveness. Using predominantly non-cessation related outcome measures reviewed papers indicated mixed results for mass media tobacco control campaign effectiveness among various social groups. Most studies assessed mass media impact on low socioeconomic status groups rather than highly socially disadvantaged groups. Methodological rigour of evaluations in this field must be improved to aid understanding regarding the effectiveness of mass media campaigns in driving cessation among disadvantaged groups. The results of this review indicate a gap in methodologically rigorous research into the effectiveness of mass media campaigns among socially disadvantaged groups, particularly the highly disadvantaged. © 2012 Australasian Professional Society on Alcohol and other Drugs.

Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare.

PubMed

Nicolay, C R; Purkayastha, S; Greenhalgh, A; Benn, J; Chaturvedi, S; Phillips, N; Darzi, A

2012-03-01

The demand for the highest-quality patient care coupled with pressure on funding has led to the increasing use of quality improvement (QI) methodologies from the manufacturing industry. The aim of this systematic review was to identify and evaluate the application and effectiveness of these QI methodologies to the field of surgery. MEDLINE, the Cochrane Database, Allied and Complementary Medicine Database, British Nursing Index, Cumulative Index to Nursing and Allied Health Literature, Embase, Health Business(™) Elite, the Health Management Information Consortium and PsycINFO(®) were searched according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement. Empirical studies were included that implemented a described QI methodology to surgical care and analysed a named outcome statistically. Some 34 of 1595 articles identified met the inclusion criteria after consensus from two independent investigators. Nine studies described continuous quality improvement (CQI), five Six Sigma, five total quality management (TQM), five plan-do-study-act (PDSA) or plan-do-check-act (PDCA) cycles, five statistical process control (SPC) or statistical quality control (SQC), four Lean and one Lean Six Sigma; 20 of the studies were undertaken in the USA. The most common aims were to reduce complications or improve outcomes (11), to reduce infection (7), and to reduce theatre delays (7). There was one randomized controlled trial. QI methodologies from industry can have significant effects on improving surgical care, from reducing infection rates to increasing operating room efficiency. The evidence is generally of suboptimal quality, and rigorous randomized multicentre studies are needed to bring evidence-based management into the same league as evidence-based medicine. Copyright © 2011 British Journal of Surgery Society Ltd. Published by John Wiley & Sons, Ltd.

A systematic review of grounded theory studies in physiotherapy.

PubMed

Ali, Nancy; May, Stephen; Grafton, Kate

2018-05-23

This systematic review aimed at appraising the methodological rigor of grounded theory research published in the field of physiotherapy to assess how the methodology is understood and applied. A secondary aim was to provide research implications drawn from the findings to guide future grounded theory methodology (GTM) research. A systematic search was conducted in MEDLINE, CINHAL, SPORT Discus, Science Direct, PubMed, Scopus, and Web of Science to identify studies in the field of physiotherapy that reported using GTM and/or methods in the study title and/or abstract. The descriptive characteristics and methodological quality of eligible studies were examined using grounded theory methodology assessment guidelines. The review included 68 studies conducted between 1998 and 2017. The findings showed that GTM is becoming increasingly used by physiotherapy researchers. Thirty-six studies (53%) demonstrated a good understanding and appropriate application of GTM. Thirty-two studies (47%) presented descriptive findings and were considered to be of poor methodological quality. There are several key tenets of GTM that are integral to the iterative process of qualitative theorizing and need to be applied throughout all research practices including sampling, data collection, and analysis.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Quality Management and Enhancement Processes in UK Business Schools: A Review

ERIC Educational Resources Information Center

Hodgkinson, Myra; Kelly, Mike

2007-01-01

Purpose: The aim of this paper is to provide insights into the processes that can be and have been adopted by UK business schools as they attempt to meet the Quality Assurance Agency's concern with the standard of quality management and enhancement. Design/methodology/approach: A review of the literature provides interpretations of quality,…

Missing and accounted for: gaps and areas of wealth in the public health review literature

PubMed Central

2011-01-01

Background High-quality review evidence is useful for informing and influencing public health policy and practice decisions. However, certain topic areas lack representation in terms of the quantity and quality of review literature available. The objectives of this paper are to identify the quantity, as well as quality, of review-level evidence available on the effectiveness of public health interventions for public health decision makers. Methods Searches conducted on http://www.health-evidence.ca produced an inventory of public health review literature in 21 topic areas. Gaps and areas of wealth in the review literature, as well as the proportion of reviews rated methodologically strong, moderate, or weak were identified. The top 10 topic areas of interest for registered users and visitors of http://www.health-evidence.ca were extracted from user profile data and Google Analytics. Results Registered users' top three interests included: 1) healthy communities, 2) chronic diseases, and 3) nutrition. The top three preferences for visitors included: 1) chronic diseases, 2) physical activity, and 3) addiction/substance use. All of the topic areas with many (301+) available reviews were of interest to registered users and/or visitors (mental health, physical activity, addiction/substance use, adolescent health, child health, nutrition, adult health, and chronic diseases). Conversely, the majority of registered users and/or visitors did not have preference for topic areas with few (≤ 150) available reviews (food safety and inspection, dental health, environmental health) with the exception of social determinants of health and healthy communities. Across registered users' and visitors' topic areas of preference, 80.2% of the reviews were of well-done methodological quality, with 43.5% of reviews having a strong quality rating and 36.7% a moderate review quality rating. Conclusions In topic areas in which many reviews are available, higher level syntheses are needed to guide policy and practice. For other topic areas with few reviews, it is necessary to determine whether primary study evidence exists, or is needed, so that reviews can be conducted in the future. Considering that less than half of the reviews available on http://www.health-evidence.ca are of strong methodological quality, the quality of the review-level evidence needs to improve across the range of public health topic areas. PMID:21967658

Panning for the gold in health research: incorporating studies' methodological quality in meta-analysis.

PubMed

Johnson, Blair T; Low, Robert E; MacDonald, Hayley V

2015-01-01

Systematic reviews now routinely assess methodological quality to gauge the validity of the included studies and of the synthesis as a whole. Although trends from higher quality studies should be clearer, it is uncertain how often meta-analyses incorporate methodological quality in models of study results either as predictors, or, more interestingly, in interactions with theoretical moderators. We survey 200 meta-analyses in three health promotion domains to examine when and how meta-analyses incorporate methodological quality. Although methodological quality assessments commonly appear in contemporary meta-analyses (usually as scales), they are rarely incorporated in analyses, and still more rarely analysed in interaction with theoretical determinants of the success of health promotions. The few meta-analyses (2.5%) that did include such an interaction analysis showed that moderator results remained significant in higher quality studies or were present only among higher quality studies. We describe how to model quality interactively with theoretically derived moderators and discuss strengths and weaknesses of this approach and in relation to current meta-analytic practice. In large literatures exhibiting heterogeneous effects, meta-analyses can incorporate methodological quality and generate conclusions that enable greater confidence not only about the substantive phenomenon but also about the role that methodological quality itself plays.

Systematic review and quality assessment of cost-effectiveness analysis of pharmaceutical therapies for advanced colorectal cancer.

PubMed

Leung, Henry W C; Chan, Agnes L F; Leung, Matthew S H; Lu, Chin-Li

2013-04-01

To systematically review and assess the quality of cost-effectiveness analyses (CEAs) of pharmaceutical therapies for metastatic colorectal cancer (mCRC). The MEDLINE, EMBASE, Cochrane, and EconLit databases were searched for the Medical Subject Headings or text key words quality-adjusted, QALY, life-year gained (LYG), and cost-effectiveness (January 1, 1999-December 31, 2009). Original CEAs of mCRC pharmacotherapy published in English were included. CEAs that measured health effects in units other than quality-adjusted life years or LYG and letters to the editor, case reports, posters, and editorials were excluded. Each article was independently assessed by 2 trained reviewers according to a quality checklist created by the Panel on Cost-Effectiveness in Health and Medicine. Twenty-four CEA studies pertaining to pharmaceutical therapies for mCRC were identified. All studies showed a wide variation in methodologic approaches, which resulted in a different range of incremental cost-effectiveness ratios reported for each regimen. We found common methodologic flaws in a significant number of CEA studies, including lack of clear description for critique of data quality; lack of method for adjusting costs for inflation and methods for obtaining expert judgment; no results of model validation; wide differences in the types of perspective, time horizon, study design, cost categories, and effect outcomes; and no quality assessment of data (cost and effectiveness) for the interventions evaluation. This study has shown a wide variation in the methodology and quality of cost-effectiveness analysis for mCRC. Improving quality and harmonization of CEA for cancer treatment is needed. Further study is suggested to assess the quality of CEA methodology outside the mCRC disease state.

10 CFR 26.137 - Quality assurance and quality control.

Code of Federal Regulations, 2013 CFR

2013-01-01

... validation of analytical procedures. Quality assurance procedures must be designed, implemented, and reviewed... resolving any technical, methodological, or administrative errors in the licensee testing facility's testing...

10 CFR 26.137 - Quality assurance and quality control.

Code of Federal Regulations, 2010 CFR

2010-01-01

... validation of analytical procedures. Quality assurance procedures must be designed, implemented, and reviewed... resolving any technical, methodological, or administrative errors in the licensee testing facility's testing...

10 CFR 26.137 - Quality assurance and quality control.

Code of Federal Regulations, 2011 CFR

2011-01-01

... validation of analytical procedures. Quality assurance procedures must be designed, implemented, and reviewed... resolving any technical, methodological, or administrative errors in the licensee testing facility's testing...

10 CFR 26.137 - Quality assurance and quality control.

Code of Federal Regulations, 2012 CFR

2012-01-01

... validation of analytical procedures. Quality assurance procedures must be designed, implemented, and reviewed... resolving any technical, methodological, or administrative errors in the licensee testing facility's testing...

10 CFR 26.137 - Quality assurance and quality control.

Code of Federal Regulations, 2014 CFR

2014-01-01

... validation of analytical procedures. Quality assurance procedures must be designed, implemented, and reviewed... resolving any technical, methodological, or administrative errors in the licensee testing facility's testing...

What's the Difference, Still? A Follow-Up Review of the Quantitative Research Methodology in Distance Learning

ERIC Educational Resources Information Center

Randolph, Justus

2005-01-01

A high quality review of the distance learning literature from 1992-1999 concluded that most of the research on distance learning had serious methodological flaws. This paper presents the results of a small-scale replication of that review. From three leading distance education journals, a sample of 66 articles was categorized by study type and…

78 FR 52929 - Scientific Information Request on Imaging Tests for the Diagnosis and Staging of Pancreatic...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-27

... improve the quality of this review. AHRQ is conducting this comparative effectiveness review pursuant to..., study period, design, methodology, indication and diagnosis, proper use instructions, inclusion and... including a study number, the study period, design, methodology, indication and diagnosis, proper use...

Cost-effectiveness analyses of hepatitis A vaccine: a systematic review to explore the effect of methodological quality on the economic attractiveness of vaccination strategies.

PubMed

Anonychuk, Andrea M; Tricco, Andrea C; Bauch, Chris T; Pham, Ba'; Gilca, Vladimir; Duval, Bernard; John-Baptiste, Ava; Woo, Gloria; Krahn, Murray

2008-01-01

Hepatitis A vaccines have been available for more than a decade. Because the burden of hepatitis A virus has fallen in developed countries, the appropriate role of vaccination programmes, especially universal vaccination strategies, remains unclear. Cost-effectiveness analysis is a useful method of relating the costs of vaccination to its benefits, and may inform policy. This article systematically reviews the evidence on the cost effectiveness of hepatitis A vaccination in varying populations, and explores the effects of methodological quality and key modelling issues on the cost-effectiveness ratios.Cost-effectiveness/cost-utility studies of hepatitis A vaccine were identified via a series of literature searches (MEDLINE, EMBASE, HSTAR and SSCI). Citations and full-text articles were reviewed independently by two reviewers. Reference searching, author searches and expert consultation ensured literature saturation. Incremental cost-effectiveness ratios (ICERs) were abstracted for base-case analyses, converted to $US, year 2005 values, and categorised to reflect various levels of cost effectiveness. Quality of reporting, methodological issues and key modelling issues were assessed using frameworks published in the literature.Thirty-one cost-effectiveness studies (including 12 cost-utility analyses) were included from full-text article review (n = 58) and citation screening (n = 570). These studies evaluated universal mass vaccination (n = 14), targeted vaccination (n = 17) and vaccination of susceptibles (i.e. individuals initially screened for antibody and, if susceptible, vaccinated) [n = 13]. For universal vaccination, 50% of the ICERs were <$US20 000 per QALY or life-year gained. Analyses evaluating vaccination in children, particularly in high incidence areas, produced the most attractive ICERs. For targeted vaccination, cost effectiveness was highly dependent on the risk of infection.Incidence, vaccine cost and discount rate were the most influential parameters in sensitivity analyses. Overall, analyses that evaluated the combined hepatitis A/hepatitis B vaccine, adjusted incidence for under-reporting, included societal costs and that came from studies of higher methodological quality tended to have more attractive cost-effectiveness ratios. Methodological quality varied across studies. Major methodological flaws included inappropriate model type, comparator, incidence estimate and inclusion/exclusion of costs.

Eligibility criteria in systematic reviews published in prominent medical journals: a methodological review.

PubMed

McCrae, Niall; Purssell, Edward

2015-12-01

Clear and logical eligibility criteria are fundamental to the design and conduct of a systematic review. This methodological review examined the quality of reporting and application of eligibility criteria in systematic reviews published in three leading medical journals. All systematic reviews in the BMJ, JAMA and The Lancet in the years 2013 and 2014 were extracted. These were assessed using a refined version of a checklist previously designed by the authors. A total of 113 papers were eligible, of which 65 were in BMJ, 17 in The Lancet and 31 in JAMA. Although a generally high level of reporting was found, eligibility criteria were often problematic. In 67% of papers, eligibility was specified after the search sources or terms. Unjustified time restrictions were used in 21% of reviews, and unpublished or unspecified data in 27%. Inconsistency between journals was apparent in the requirements for systematic reviews. The quality of reviews in these leading medical journals was high; however, there were issues that reduce the clarity and replicability of the review process. As well as providing a useful checklist, this methodological review informs the continued development of standards for systematic reviews. © 2015 John Wiley & Sons, Ltd.

A Comparison of Randomised Controlled Trials in Health and Education

ERIC Educational Resources Information Center

Torgerson, Carole J.; Torgerson, David J.; Birks, Yvonne F.; Porthouse, Jill

2005-01-01

Health care and educational trials face similar methodological challenges. Methodological reviews of health care trials have shown that a significant proportion have methodological flaws. Whether or not educational trials have a similar proportion of poor-quality trials is unknown. The authors undertook a methodological comparison between health…

Traditional Chinese medicine for knee osteoarthritis: An overview of systematic review.

PubMed

Yang, Min; Jiang, Li; Wang, Qing; Chen, Hao; Xu, Guihua

2017-01-01

Traditional Chinese medicine (TCM) has been accepted as a complementary therapy for knee osteoarthritis. However, the efficacy and safety of the intervention were still conflicting and uncertain. Meanwhile, the quality of methodology and evidence in the field was unknown. To summarize the characteristics and critically evaluate the quality of methodology, as well as the evidence of systematic reviews (SRs) on TCM for knee osteoarthritis. Five electronic databases were searched from inception to April 2016. The methodological quality of the included studies was assessed by AMSTAR and ROBIS. The quality of the evidence was determined using the GRADE approach. Ten SRs were included. The conclusions suggest that TCM provides potential benefits for patients with knee osteoarthritis. These benefits include pain relief, functional improvement, and presence of few adverse events. Limitations of the methodological quality mainly included the lack of a-priori protocol or protocol registration and incomprehensive literature search. A list of excluded studies was also not provided. The overall quality of evidence in the SRs was poor, ranging from "very low" to "low," mainly because of the serious risk of bias of original trials, inconsistencies, and imprecision in the outcomes. TCM generally appears to be effective for knee osteoarthritis treatment. However, the evidence is not robust enough because of the methodological flaws in SRs. Hence, these conclusions on available SRs should be treated with caution for clinical practice.

Development of an evidence-based review with recommendations using an online iterative process.

PubMed

Rudmik, Luke; Smith, Timothy L

2011-01-01

The practice of modern medicine is governed by evidence-based principles. Due to the plethora of medical literature, clinicians often rely on systematic reviews and clinical guidelines to summarize the evidence and provide best practices. Implementation of an evidence-based clinical approach can minimize variation in health care delivery and optimize the quality of patient care. This article reports a method for developing an "Evidence-based Review with Recommendations" using an online iterative process. The manuscript describes the following steps involved in this process: Clinical topic selection, Evidence-hased review assignment, Literature review and initial manuscript preparation, Iterative review process with author selection, and Manuscript finalization. The goal of this article is to improve efficiency and increase the production of evidence-based reviews while maintaining the high quality and transparency associated with the rigorous methodology utilized for clinical guideline development. With the rise of evidence-based medicine, most medical and surgical specialties have an abundance of clinical topics which would benefit from a formal evidence-based review. Although clinical guideline development is an important methodology, the associated challenges limit development to only the absolute highest priority clinical topics. As outlined in this article, the online iterative approach to the development of an Evidence-based Review with Recommendations may improve productivity without compromising the quality associated with formal guideline development methodology. Copyright © 2011 American Rhinologic Society-American Academy of Otolaryngic Allergy, LLC.

Quality of systematic reviews: an example of studies comparing artificial disc replacement with fusion in the cervical spine.

PubMed

Tashani, Osama A; El-Tumi, Hanan; Aneiba, Khaled

2015-01-01

Cervical artificial disc replacement (C-ADR) is now an alternative to anterior cervical discectomy and fusion (ACDF). Many studies have evaluated the efficacy of C-ADR compared with ACDF. This led to a series of systematic reviews and meta-analyses to evaluate the evidence of the superiority of one intervention against the other. The aim of the study presented here was to evaluate the quality of these reviews and meta-analyses. Medline via Ovid, Embase, and Cochrane Library were searched using the keywords: (total disk replacement, prosthesis, implantation, discectomy, and arthroplasty) AND (cervical vertebrae, cervical spine, and spine) AND (systematic reviews, reviews, and meta-analysis). Screening and data extraction were conducted by two reviewers independently. Two reviewers then assessed the quality of the selected reviews and meta-analysis using 11-item AMSTAR score which is a validated measurement tool to assess the methodological quality of systematic reviews. Screening of full reports of 46 relevant abstracts resulted in the selection of 15 systematic reviews and/or meta-analyses as eligible for this study. The two reviewers' inter-rater agreement level was high as indicated by kappa of >0.72. The AMSTAR score of the reviews ranged from 3 to 11. Only one study (a Cochrane review) scored 100% (AMSTAR 11). Five studies scored below (AMSTAR 5) indicating low-quality reviews. The most significant drawbacks of reviews of a score below 5 were not using an extensive search strategy, failure to use the scientific quality of the included studies appropriately in formulating a conclusion, not assessing publication bias, and not reporting the excluded studies. With a significant exception of a Cochrane review, the methodological quality of systematic reviews evaluating the evidence of C-ADR versus ACDF has to be improved.

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

Identifying approaches for assessing methodological and reporting quality of systematic reviews: a descriptive study.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-06-19

The methodological quality and completeness of reporting of the systematic reviews (SRs) is fundamental to optimal implementation of evidence-based health care and the reduction of research waste. Methods exist to appraise SRs yet little is known about how they are used in SRs or where there are potential gaps in research best-practice guidance materials. The aims of this study are to identify reports assessing the methodological quality (MQ) and/or reporting quality (RQ) of a cohort of SRs and to assess their number, general characteristics, and approaches to 'quality' assessment over time. The Cochrane Library, MEDLINE®, and EMBASE® were searched from January 1990 to October 16, 2014, for reports assessing MQ and/or RQ of SRs. Title, abstract, and full-text screening of all reports were conducted independently by two reviewers. Reports assessing the MQ and/or RQ of a cohort of ten or more SRs of interventions were included. All results are reported as frequencies and percentages of reports. Of 20,765 unique records retrieved, 1189 of them were reviewed for full-text review, of which 76 reports were included. Eight previously published approaches to assessing MQ or reporting guidelines used as proxy to assess RQ were used in 80% (61/76) of identified reports. These included two reporting guidelines (PRISMA and QUOROM) and five quality assessment tools (AMSTAR, R-AMSTAR, OQAQ, Mulrow, Sacks) and GRADE criteria. The remaining 24% (18/76) of reports developed their own criteria. PRISMA, OQAQ, and AMSTAR were the most commonly used published tools to assess MQ or RQ. In conjunction with other approaches, published tools were used in 29% (22/76) of reports, with 36% (8/22) assessing adherence to both PRISMA and AMSTAR criteria and 26% (6/22) using QUOROM and OQAQ. The methods used to assess quality of SRs are diverse, and none has become universally accepted. The most commonly used quality assessment tools are AMSTAR, OQAQ, and PRISMA. As new tools and guidelines are developed to improve both the MQ and RQ of SRs, authors of methodological studies are encouraged to put thoughtful consideration into the use of appropriate tools to assess quality and reporting.

A Review of Singapore Principals' Leadership Qualities, Styles, and Roles

ERIC Educational Resources Information Center

Ng, David Foo Seong; Nguyen, Dong Thanh; Wong, Benjamin Koon Siak; Choy, William Kim Weng

2015-01-01

Purpose: The purpose of this paper is to present a review of empirical studies on principal leadership in Singapore. It seeks to provide a general picture of Singapore principals' leadership qualities, styles, and roles. Design/methodology/approach: This is a systematic review of empirical studies, using a "bounded" approach with a focus…

Comparison of methodological quality of positive versus negative comparative studies published in Indian medical journals: a systematic review.

PubMed

Charan, Jaykaran; Chaudhari, Mayur; Jackson, Ryan; Mhaskar, Rahul; Reljic, Tea; Kumar, Ambuj

2015-06-24

Published negative studies should have the same rigour of methodological quality as studies with positive findings. However, the methodological quality of negative versus positive studies is not known. The objective was to assess the reported methodological quality of positive versus negative studies published in Indian medical journals. A systematic review (SR) was performed of all comparative studies published in Indian medical journals with a clinical science focus and impact factor >1 between 2011 and 2013. The methodological quality of randomised controlled trials (RCTs) was assessed using the Cochrane risk of bias tool, and the Newcastle-Ottawa scale for observational studies. The results were considered positive if the primary outcome was statistically significant and negative otherwise. When the primary outcome was not specified, we used data on the first outcome reported in the history followed by the results section. Differences in various methodological quality domains between positive versus negative studies were assessed by Fisher's exact test. Seven journals with 259 comparative studies were included in this SR. 24% (63/259) were RCTs, 24% (63/259) cohort studies, and 49% (128/259) case-control studies. 53% (137/259) of studies explicitly reported the primary outcome. Five studies did not report sufficient data to enable us to determine if results were positive or negative. Statistical significance was determined by p value in 78.3% (199/254), CI in 2.8% (7/254), both p value and CI in 11.8% (30/254), and only descriptive in 6.3% (16/254) of studies. The overall methodological quality was poor and no statistically significant differences between reporting of methodological quality were detected between studies with positive versus negative findings. There was no difference in the reported methodological quality of positive versus negative studies. However, the uneven reporting of positive versus negative studies (72% vs 28%) indicates a publication bias in Indian medical journals with an impact factor of >1. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Forty years of quality-of-life research in congenital heart disease: Temporal trends in conceptual and methodological rigor.

PubMed

Bratt, Ewa-Lena; Moons, Philip

2015-09-15

The first study on quality of life (QoL) in patients with congenital heart disease was published 40 years ago. Since then, the number of QoL articles on these patients has grown exponentially. We conducted a systematic literature review of all empirical studies on QoL in patients with congenital heart disease published since 1974, with the aim of determining the range of conceptual and methodological rigor of studies and identifying temporal trends in these parameters. PubMed, Embase, and Cinahl were searched for empirical studies addressing QoL in children, adolescents, or adults with congenital heart disease, published between January 1, 1974, and December 31, 2014. We applied 10 review criteria that were previously developed by Gill and Feinstein in 1994 and further refined by Moons et al. in 2004. Overall, 234 articles were reviewed. We found slight but non-significant temporal improvements in conceptual and methodological rigor and in use of assessment methods. This indicates a trend toward a more professional and exacting approach in QoL assessments. However, the majority of articles still had substantial conceptual and methodological deficits. Furthermore, we observed that citation of the publications of Gill and Feinstein and Moons et al. in published QoL research is associated with higher quality scores, suggesting that these articles have a positive impact on conceptual and methodological caliber. Despite 40 years of QoL research in this field, this review shows that major weaknesses in methodological rigor remain highly prevalent, which may make QoL studies inconclusive. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Sexual health education interventions for young people: a methodological review.

PubMed Central

Oakley, A.; Fullerton, D.; Holland, J.; Arnold, S.; France-Dawson, M.; Kelley, P.; McGrellis, S.

1995-01-01

OBJECTIVES--To locate reports of sexual health education interventions for young people, assess the methodological quality of evaluations, identify the subgroup with a methodologically sound design, and assess the evidence with respect to the effectiveness of different approaches to promoting young people's sexual health. DESIGN--Survey of reports in English by means of electronic databases and hand searches for relevant studies conducted in the developed world since 1982. Papers were reviewed for eight methodological qualities. The evidence on effectiveness generated by studies meeting four core criteria was assessed. Judgments on effectiveness by reviewers and authors were compared. PAPERS--270 papers reporting sexual health interventions. MAIN OUTCOME MEASURE--The methodological quality of evaluations. RESULTS--73 reports of evaluations of sexual health interventions examining the effectiveness of these interventions in changing knowledge, attitudes, or behavioural outcomes were identified, of which 65 were separate outcome evaluations. Of these studies, 45 (69%) lacked random control groups, 44 (68%) failed to present preintervention and 38 (59%) postintervention data, and 26 (40%) omitted to discuss the relevance of loss of data caused by drop outs. Only 12 (18%) of the 65 outcome evaluations were judged to be methodologically sound. Academic reviewers were more likely than authors to judge studies as unclear because of design faults. Only two of the sound evaluations recorded interventions which were effective in showing an impact on young people's sexual behaviour. CONCLUSIONS--The design of evaluations in sexual health intervention needs to be improved so that reliable evidence of the effectiveness of different approaches to promoting young people's sexual health may be generated. PMID:7833754

Methodological quality is underrated in systematic reviews and meta-analyses in health psychology.

PubMed

Oliveras, Isabel; Losilla, Josep-Maria; Vives, Jaume

2017-06-01

In this paper, we compile and describe the main approaches proposed in the literature to include methodological quality (MQ) or risk of bias (RoB) into research synthesis. We also meta-review how the RoB of observational primary studies is being assessed and to what extent the results are incorporated in the conclusions of research synthesis. Electronic databases were searched for systematic reviews or meta-analyses related to health and clinical psychology. A random sample of 90 reviews published between January 2010 and May 2016 was examined. A total of 46 reviews (51%) performed a formal assessment of the RoB of primary studies. Only 17 reviews (19%) linked the outcomes of quality assessment with the results of the review. According to the previous literature, our results corroborate the lack of guidance to incorporate the RoB assessment in the results of systematic reviews and meta-analyses. Our recommendation is to appraise MQ according to domains of RoB to rate the degree of credibility of the results of a research synthesis, as well as subgroup analysis or meta-regression as analytical methods to incorporate the quality assessment. Copyright © 2017 Elsevier Inc. All rights reserved.

Association between prospective registration and overall reporting and methodological quality of systematic reviews: a meta-epidemiological study.

PubMed

Ge, Long; Tian, Jin-Hui; Li, Ya-Nan; Pan, Jia-Xue; Li, Ge; Wei, Dang; Xing, Xin; Pan, Bei; Chen, Yao-Long; Song, Fu-Jian; Yang, Ke-Hu

2018-01-01

The aim of this study was to investigate the differences in main characteristics, reporting and methodological quality between prospectively registered and nonregistered systematic reviews. PubMed was searched to identify systematic reviews of randomized controlled trials published in 2015 in English. After title and abstract screening, potentially relevant reviews were divided into three groups: registered non-Cochrane reviews, Cochrane reviews, and nonregistered reviews. For each group, random number tables were generated in Microsoft Excel, and the first 50 eligible studies from each group were randomly selected. Data of interest from systematic reviews were extracted. Regression analyses were conducted to explore the association between total Revised Assessment of Multiple Systematic Review (R-AMSTAR) or Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) scores and the selected characteristics of systematic reviews. The conducting and reporting of literature search in registered reviews were superior to nonregistered reviews. Differences in 9 of the 11 R-AMSTAR items were statistically significant between registered and nonregistered reviews. The total R-AMSTAR score of registered reviews was higher than nonregistered reviews [mean difference (MD) = 4.82, 95% confidence interval (CI): 3.70, 5.94]. Sensitivity analysis by excluding the registration-related item presented similar result (MD = 4.34, 95% CI: 3.28, 5.40). Total PRISMA scores of registered reviews were significantly higher than nonregistered reviews (all reviews: MD = 1.47, 95% CI: 0.64-2.30; non-Cochrane reviews: MD = 1.49, 95% CI: 0.56-2.42). However, the difference in the total PRISMA score was no longer statistically significant after excluding the item related to registration (item 5). Regression analyses showed similar results. Prospective registration may at least indirectly improve the overall methodological quality of systematic reviews, although its impact on the overall reporting quality was not significant. Copyright © 2017 Elsevier Inc. All rights reserved.

A systematic review of model-based economic evaluations of diagnostic and therapeutic strategies for lower extremity artery disease.

PubMed

Vaidya, Anil; Joore, Manuela A; ten Cate-Hoek, Arina J; Kleinegris, Marie-Claire; ten Cate, Hugo; Severens, Johan L

2014-01-01

Lower extremity artery disease (LEAD) is a sign of wide spread atherosclerosis also affecting coronary, cerebral and renal arteries and is associated with increased risk of cardiovascular events. Many economic evaluations have been published for LEAD due to its clinical, social and economic importance. The aim of this systematic review was to assess modelling methods used in published economic evaluations in the field of LEAD. Our review appraised and compared the general characteristics, model structure and methodological quality of published models. Electronic databases MEDLINE and EMBASE were searched until February 2013 via OVID interface. Cochrane database of systematic reviews, Health Technology Assessment database hosted by National Institute for Health research and National Health Services Economic Evaluation Database (NHSEED) were also searched. The methodological quality of the included studies was assessed by using the Philips' checklist. Sixteen model-based economic evaluations were identified and included. Eleven models compared therapeutic health technologies; three models compared diagnostic tests and two models compared a combination of diagnostic and therapeutic options for LEAD. Results of this systematic review revealed an acceptable to low methodological quality of the included studies. Methodological diversity and insufficient information posed a challenge for valid comparison of the included studies. In conclusion, there is a need for transparent, methodologically comparable and scientifically credible model-based economic evaluations in the field of LEAD. Future modelling studies should include clinically and economically important cardiovascular outcomes to reflect the wider impact of LEAD on individual patients and on the society.

Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES)

PubMed Central

2011-01-01

Background There is growing interest in theory-driven, qualitative and mixed-method approaches to systematic review as an alternative to (or to extend and supplement) conventional Cochrane-style reviews. These approaches offer the potential to expand the knowledge base in policy-relevant areas - for example by explaining the success, failure or mixed fortunes of complex interventions. However, the quality of such reviews can be difficult to assess. This study aims to produce methodological guidance, publication standards and training resources for those seeking to use the realist and/or meta-narrative approach to systematic review. Methods/design We will: [a] collate and summarise existing literature on the principles of good practice in realist and meta-narrative systematic review; [b] consider the extent to which these principles have been followed by published and in-progress reviews, thereby identifying how rigour may be lost and how existing methods could be improved; [c] using an online Delphi method with an interdisciplinary panel of experts from academia and policy, produce a draft set of methodological steps and publication standards; [d] produce training materials with learning outcomes linked to these steps; [e] pilot these standards and training materials prospectively on real reviews-in-progress, capturing methodological and other challenges as they arise; [f] synthesise expert input, evidence review and real-time problem analysis into more definitive guidance and standards; [g] disseminate outputs to audiences in academia and policy. The outputs of the study will be threefold: 1. Quality standards and methodological guidance for realist and meta-narrative reviews for use by researchers, research sponsors, students and supervisors 2. A 'RAMESES' (Realist and Meta-review Evidence Synthesis: Evolving Standards) statement (comparable to CONSORT or PRISMA) of publication standards for such reviews, published in an open-access academic journal. 3. A training module for researchers, including learning outcomes, outline course materials and assessment criteria. Discussion Realist and meta-narrative review are relatively new approaches to systematic review whose overall place in the secondary research toolkit is not yet fully established. As with all secondary research methods, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency of studies. PMID:21843376

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Twenty years of meta-analyses in orthopaedic surgery: has quality kept up with quantity?

PubMed

Dijkman, Bernadette G; Abouali, Jihad A K; Kooistra, Bauke W; Conter, Henry J; Poolman, Rudolf W; Kulkarni, Abhaya V; Tornetta, Paul; Bhandari, Mohit

2010-01-01

As the number of studies in the literature is increasing, orthopaedic surgeons highly depend on meta-analyses as their primary source of scientific evidence. The objectives of this review were to assess the scientific quality and number of published meta-analyses on orthopaedics-related topics over time. We conducted, in duplicate and independently, a systematic review of published meta-analyses in orthopaedics in the years 2005 and 2008 and compared them with a previous systematic review of meta-analyses from 1969 to 1999. A search of electronic databases (MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews) was performed to identify meta-analyses published in 2005 and 2008. We searched bibliographies and contacted content experts to identify additional relevant studies. Two investigators independently assessed the quality of the studies, using the Oxman and Guyatt index, and abstracted relevant data. We included forty-five and forty-four meta-analyses from 2005 and 2008, respectively. While the number of meta-analyses increased fivefold from 1999 to 2008, the mean quality score did not change significantly over time (p = 0.067). In the later years, a significantly lower proportion of meta-analyses had methodological flaws (56% in 2005 and 68% in 2008) compared with meta-analyses published prior to 2000 (88%) (p = 0.006). In 2005 and 2008, respectively, 18% and 30% of the meta-analyses had major to extensive flaws in their methodology. Studies from 2008 with positive conclusions used and described appropriate criteria for the validity assessment less often than did those with negative results. The use of random-effects and fixed-effects models as pooling methods became more popular toward 2008. Although the methodological quality of orthopaedic meta-analyses has increased in the past twenty years, a substantial proportion continues to show major to extensive flaws. As the number of published meta-analyses is increasing, a routine checklist for scientific quality should be used in the peer-review process to ensure methodological standards for publication.

Quality and methodological challenges in Internet-based mental health trials.

PubMed

Ye, Xibiao; Bapuji, Sunita Bayyavarapu; Winters, Shannon; Metge, Colleen; Raynard, Mellissa

2014-08-01

To review the quality of Internet-based mental health intervention studies and their methodological challenges. We searched multiple literature databases to identify relevant studies according to the Population, Interventions, Comparators, Outcomes, and Study Design framework. Two reviewers independently assessed selection bias, allocation bias, confounding bias, blinding, data collection methods, and withdrawals/dropouts, using the Quality Assessment Tool for Quantitative Studies. We rated each component as strong, moderate, or weak and assigned a global rating (strong, moderate, or weak) to each study. We discussed methodological issues related to the study quality. Of 122 studies included, 31 (25%), 44 (36%), and 47 (39%) were rated strong, moderate, and weak, respectively. Only five studies were rated strong for all of the six quality components (three of them were published by the same group). Lack of blinding, selection bias, and low adherence were the top three challenges in Internet-based mental health intervention studies. The overall quality of Internet-based mental health intervention needs to improve. In particular, studies need to improve sample selection, intervention allocation, and blinding.

Methodological issues and recommendations for systematic reviews of prognostic studies: an example from cardiovascular disease.

PubMed

Dretzke, Janine; Ensor, Joie; Bayliss, Sue; Hodgkinson, James; Lordkipanidzé, Marie; Riley, Richard D; Fitzmaurice, David; Moore, David

2014-12-03

Prognostic factors are associated with the risk of future health outcomes in individuals with a particular health condition. The prognostic ability of such factors is increasingly being assessed in both primary research and systematic reviews. Systematic review methodology in this area is continuing to evolve, reflected in variable approaches to key methodological aspects. The aim of this article was to (i) explore and compare the methodology of systematic reviews of prognostic factors undertaken for the same clinical question, (ii) to discuss implications for review findings, and (iii) to present recommendations on what might be considered to be 'good practice' approaches. The sample was comprised of eight systematic reviews addressing the same clinical question, namely whether 'aspirin resistance' (a potential prognostic factor) has prognostic utility relative to future vascular events in patients on aspirin therapy for secondary prevention. A detailed comparison of methods around study identification, study selection, quality assessment, approaches to analysis, and reporting of findings was undertaken and the implications discussed. These were summarised into key considerations that may be transferable to future systematic reviews of prognostic factors. Across systematic reviews addressing the same clinical question, there were considerable differences in the numbers of studies identified and overlap between included studies, which could only partially be explained by different study eligibility criteria. Incomplete reporting and differences in terminology within primary studies hampered study identification and selection process across reviews. Quality assessment was highly variable and only one systematic review considered a checklist for studies of prognostic questions. There was inconsistency between reviews in approaches towards analysis, synthesis, addressing heterogeneity and reporting of results. Different methodological approaches may ultimately affect the findings and interpretation of systematic reviews of prognostic research, with implications for clinical decision-making.

Lean interventions in healthcare: do they actually work? A systematic literature review.

PubMed

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-04-01

Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data on design, methods, interventions and key outcomes were extracted and collated. Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Factors contributing to chronic ankle instability: a protocol for a systematic review of systematic reviews.

PubMed

Thompson, Cassandra; Schabrun, Siobhan; Romero, Rick; Bialocerkowski, Andrea; Marshall, Paul

2016-06-07

Ankle sprains are a significant clinical problem. Researchers have identified a multitude of factors contributing to the presence of recurrent ankle sprains including deficits in balance, postural control, kinematics, muscle activity, strength, range of motion, ligament laxity and bone/joint characteristics. Unfortunately, the literature examining the presence of these factors in chronic ankle instability (CAI) is conflicting. As a result, researchers have attempted to integrate this evidence using systematic reviews to reach conclusions; however, readers are now faced with an increasing number of systematic review findings that are also conflicting. The overall aim of this review is to critically appraise the methodological quality of previous systematic reviews and pool this evidence to identify contributing factors to CAI. A systematic review will be conducted on systematic reviews that investigate the presence of various deficits identified in CAI. Databases will be searched using pre-determined search terms. Reviews will then be assessed for inclusion based on the set eligibility criteria. Two independent reviewers will assess the articles for inclusion before evaluating the methodological quality and presence of bias of the included studies; any disagreements will be resolved by discussion between reviewers to reach consensus or by a third reviewer. Data concerning the specific research question, search strategy, inclusion/exclusion criteria, population, method and outcomes will be extracted. Findings will be analysed with respect to the methodological quality of the included reviews. It is expected that this review will clarify the cause of contradicting findings in the literature and facilitate future research directions. PROSPERO CRD42016032592 .

Quality Assurance in Post-Secondary Education: The Student Experience

ERIC Educational Resources Information Center

Law, Dennis Chung Sea

2010-01-01

Purpose: A major focus of the recent research into the quality of post-secondary education is the centrality of the student experience. The purpose of this paper is to review the literature on studies addressing such a focus to shed light on how quality assurance (QA) practices can be improved. Design/methodology/approach: The paper reviews some…

Applying Quality Indicators to Single-Case Research Designs Used in Special Education: A Systematic Review

ERIC Educational Resources Information Center

Moeller, Jeremy D.; Dattilo, John; Rusch, Frank

2015-01-01

This study examined how specific guidelines and heuristics have been used to identify methodological rigor associated with single-case research designs based on quality indicators developed by Horner et al. Specifically, this article describes how literature reviews have applied Horner et al.'s quality indicators and evidence-based criteria.…

Measurement properties of rheumatoid arthritis-specific quality-of-life questionnaires: systematic review of the literature.

PubMed

Lee, Jiyeon; Kim, Soo Hyun; Moon, Seung Hei; Lee, Eun-Hyun

2014-12-01

This study conducted a systematic review of the methodological quality of the psychometric evaluation process and the quality of measurement properties of rheumatoid arthritis (RA)-specific health-related quality-of-life (HRQOL) questionnaires with the purpose of obtaining the best evidence to help in the selection of the most appropriate instrument for measuring HRQOL in RA patients. A systematic literature search was performed to identify RA-specific HRQOL questionnaires in databases. The methodological quality of the studies was assessed using the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. The quality of the measurement properties was assessed using quality criteria. The evidence regarding the measurement properties was pooled using best-evidence synthesis, with considerations of the number and methodological quality of the studies, and the consistency of their findings in terms of the quality of the measurement properties. The search identified 37 studies describing 9 instruments. Best-evidence synthesis suggested that the Rheumatoid Arthritis Quality of Life (RAQoL) questionnaire had the strongest positive evidence, especially with respect to reliability, measurement error, and content validity, and moderate positive evidence with respect to hypothesis testing and responsiveness. The current evidence suggests that the best-validated instrument among the RA-specific HRQOL measures is the RAQoL questionnaire in terms of both methodological quality in the process of psychometric evaluation and the quality of the measurement properties. However, there is limited evidence regarding internal consistency and structural validity of the RAQoL. Further efforts are warranted to establish the psychometric quality of this questionnaire.

Decision to abort after a prenatal diagnosis of sex chromosome abnormality: a systematic review of the literature.

PubMed

Jeon, Kwon Chan; Chen, Lei-Shih; Goodson, Patricia

2012-01-01

We performed a systematic review of factors affecting parental decisions to continue or terminate a pregnancy after prenatal diagnosis of a sex chromosome abnormality, as reported in published studies from 1987 to May 2011. Based on the Matrix Method for systematic reviews, 19 studies were found in five electronic databases, meeting specific inclusion/exclusion criteria. Abstracted data were organized in a matrix. Alongside the search for factors influencing parental decisions, each study was judged on its methodological quality and assigned a methodological quality score. Decisions either to terminate or to continue a sex chromosome abnormality-affected pregnancy shared five similar factors: specific type of sex chromosome abnormality, gestational week at diagnosis, parents' age, providers' genetic expertise, and number of children/desire for (more) children. Factors unique to termination decisions included parents' fear/anxiety and directive counseling. Factors uniquely associated with continuation decisions were parents' socioeconomic status and ethnicity. The studies' average methodological quality score was 10.6 (SD = 1.67; range, 8-14). Findings from this review can be useful in adapting and modifying guidelines for genetic counseling after prenatal diagnosis of a sex chromosome abnormality. Moreover, improving the quality of future studies on this topic may allow clearer understanding of the most influential factors affecting parental decisions.

Considering axiological integrity: a methodological analysis of qualitative evidence syntheses, and its implications for health professions education.

PubMed

Kelly, Martina; Ellaway, Rachel H; Reid, Helen; Ganshorn, Heather; Yardley, Sarah; Bennett, Deirdre; Dornan, Tim

2018-05-14

Qualitative evidence synthesis (QES) is a suite of methodologies that combine qualitative techniques with the synthesis of qualitative knowledge. They are particularly suited to medical education as these approaches pool findings from original qualitative studies, whilst paying attention to context and theoretical development. Although increasingly sophisticated use is being made of qualitative primary research methodologies in health professions education (HPE) the use of secondary qualitative reviews in HPE remains underdeveloped. This study examined QES methods applied to clinical humanism in healthcare as a way of advancing thinking around the use of QES in HPE in general. A systematic search strategy identified 49 reviews that fulfilled the inclusion criteria. Meta-study was used to develop an analytic summary of methodological characteristics, the role of theory, and the synthetic processes used in QES reviews. Fifteen reviews used a defined methodology, and 17 clearly explained the processes that led from data extraction to synthesis. Eight reviews adopted a specific theoretical perspective. Authors rarely described their reflexive relationship with their data. Epistemological positions tended to be implied rather than explicit. Twenty-five reviews included some form of quality appraisal, although it was often unclear how authors acted on its results. Reviewers under-reported qualitative approaches in their review methodologies, and tended to focus on elements such as systematicity and checklist quality appraisal that were more germane to quantitative evidence synthesis. A core concern was that the axiological (value) dimensions of the source materials were rarely considered let alone accommodated in the synthesis techniques used. QES can be used in HPE research but only with careful attention to maintaining axiological integrity.

What is the effectiveness of obesity related interventions at retail grocery stores and supermarkets? -a systematic review.

PubMed

Adam, Abdulfatah; Jensen, Jørgen D

2016-12-28

The Prevalence of obesity and overweight has been increasing in many countries. Many factors have been identified as contributing to obesity including the food environment, especially the access, availability and affordability of healthy foods in grocery stores and supermarkets. Several interventions have been carried out in retail grocery/supermarket settings as part of an effort to understand and influence consumption of healthful foods. The review's key outcome variable is sale/purchase of healthy foods as a result of the interventions. This systematic review sheds light on the effectiveness of food store interventions intended to promote the consumption of healthy foods and the methodological quality of studies reporting them. Systematic literature search spanning from 2003 to 2015 (inclusive both years), and confined to papers in the English language was conducted. Studies fulfilling search criteria were identified and critically appraised. Studies included in this review report health interventions at physical food stores including supermarkets and corner stores, and with outcome variable of adopting healthier food purchasing/consumption behavior. The methodological quality of all included articles has been determined using a validated 16-item quality assessment tool (QATSDD). The literature search identified 1580 publications, of which 42 met the inclusion criteria. Most interventions used a combination of information (e.g. awareness raising through food labeling, promotions, campaigns, etc.) and increasing availability of healthy foods such as fruits and vegetables. Few used price interventions. The average quality score for all papers is 65.0%, or an overall medium methodological quality. Apart from few studies, most studies reported that store interventions were effective in promoting purchase of healthy foods. Given the diverse study settings and despite the challenges of methodological quality for some papers, we find efficacy of in-store healthy food interventions in terms of increased purchase of healthy foods. Researchers need to take risk of bias and methodological quality into account when designing future studies that should guide policy makers. Interventions which combine price, information and easy access to and availability of healthy foods with interactive and engaging nutrition information, if carefully designed can help customers of food stores to buy and consume more healthy foods.

Integrated care programmes for adults with chronic conditions: a meta-review.

PubMed

Martínez-González, Nahara Anani; Berchtold, Peter; Ullman, Klara; Busato, André; Egger, Matthias

2014-10-01

To review systematic reviews and meta-analyses of integrated care programmes in chronically ill patients, with a focus on methodological quality, elements of integration assessed and effects reported. Meta-review of systematic reviews and meta-analyses identified in Medline (1946-March 2012), Embase (1980-March 2012), CINHAL (1981-March 2012) and the Cochrane Library of Systematic Reviews (issue 1, 2012). Methodological quality assessed by the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) checklist; elements of integration assessed using a published list of 10 key principles of integration; effects on patient-centred outcomes, process quality, use of healthcare and costs. Twenty-seven systematic reviews were identified; conditions included chronic heart failure (CHF; 12 reviews), diabetes mellitus (DM; seven reviews), chronic obstructive pulmonary disease (COPD; seven reviews) and asthma (five reviews). The median number of AMSTAR checklist items met was five: few reviewers searched for unpublished literature or described the primary studies and interventions in detail. Most reviews covered comprehensive services across the care continuum or standardization of care through inter-professional teams, but organizational culture, governance structure or financial management were rarely assessed. A majority of reviews found beneficial effects of integration, including reduced hospital admissions and re-admissions (in CHF and DM), improved adherence to treatment guidelines (DM, COPD and asthma) or quality of life (DM). Few reviews showed reductions in costs. Systematic reviews of integrated care programmes were of mixed quality, assessed only some components of integration of care, and showed consistent benefits for some outcomes but not others. © The Author 2014. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Using Six Sigma for Performance Improvement in Business Curriculum: A Case Study

ERIC Educational Resources Information Center

Kukreja, Anil; Ricks, Joe M., Jr.; Meyer, Jean A.

2009-01-01

During the last few decades, a number of quality improvement methodologies have been used by organizations. This article provides a brief review of the quality improvement literature related to academia and a case study using Six Sigma methodology to analyze students' performance in a standardized examination. We found Six Sigma to be an effective…

Prevalence and risk factors associated with musculoskeletal complaints among users of mobile handheld devices: A systematic review.

PubMed

Xie, Yanfei; Szeto, Grace; Dai, Jie

2017-03-01

This systematic review aimed at evaluating the prevalence and risk factors for musculoskeletal complaints associated with mobile handheld device use. Pubmed, Medline, Web of Science, CINAHL and Embase were searched. The methodological quality of included studies was assessed. Strength of evidence for risk factors was determined based on study designs, methodological quality and consistency of results. Five high-quality, eight acceptable-quality and two low-quality peer-reviewed articles were included. This review demonstrates that the prevalence of musculoskeletal complaints among mobile device users ranges from 1.0% to 67.8% and neck complaints have the highest prevalence rates ranging from 17.3% to 67.8%. This study also finds some evidence for neck flexion, frequency of phone calls, texting and gaming in relation to musculoskeletal complaints among mobile device users. Inconclusive evidence is shown for other risk factors such as duration of use and human-device interaction techniques due to inconsistent results or a limited number of studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

Clinical trials in palliative care: a systematic review of their methodological characteristics and of the quality of their reporting.

PubMed

Bouça-Machado, Raquel; Rosário, Madalena; Alarcão, Joana; Correia-Guedes, Leonor; Abreu, Daisy; Ferreira, Joaquim J

2017-01-25

Over the past decades there has been a significant increase in the number of published clinical trials in palliative care. However, empirical evidence suggests that there are methodological problems in the design and conduct of studies, which raises questions about the validity and generalisability of the results and of the strength of the available evidence. We sought to evaluate the methodological characteristics and assess the quality of reporting of clinical trials in palliative care. We performed a systematic review of published clinical trials assessing therapeutic interventions in palliative care. Trials were identified using MEDLINE (from its inception to February 2015). We assessed methodological characteristics and describe the quality of reporting using the Cochrane Risk of Bias tool. We retrieved 107 studies. The most common medical field studied was oncology, and 43.9% of trials evaluated pharmacological interventions. Symptom control and physical dimensions (e.g. intervention on pain, breathlessness, nausea) were the palliative care-specific issues most studied. We found under-reporting of key information in particular on random sequence generation, allocation concealment, and blinding. While the number of clinical trials in palliative care has increased over time, methodological quality remains suboptimal. This compromises the quality of studies. Therefore, a greater effort is needed to enable the appropriate performance of future studies and increase the robustness of evidence-based medicine in this important field.

Interventions to Improve Parental Communication About Sex: A Systematic Review

PubMed Central

Holland, Cynthia L.; Bost, James

2011-01-01

CONTEXT: The relative effectiveness of interventions to improve parental communication with adolescents about sex is not known. OBJECTIVE: To compare the effectiveness and methodologic quality of interventions for improving parental communication with adolescents about sex. METHODS: We searched 6 databases: OVID/Medline, PsychInfo, ERIC, Cochrane Review, Communication and Mass Media, and the Cumulative Index to Nursing and Allied Health Literature. We included studies published between 1980 and July 2010 in peer-reviewed English-language journals that targeted US parents of adolescents aged 11 to 18 years, used an experimental or quasi-experimental design, included a control group, and had a pretest/posttest design. We abstracted data on multiple communication outcomes defined by the integrative conceptual model (communication frequency, content, skills, intentions, self-efficacy, perceived environmental barriers/facilitators, perceived social norms, attitudes, outcome expectations, knowledge, and beliefs). Methodologic quality was assessed using the 11-item methodologic quality score. RESULTS: Twelve studies met inclusion criteria. Compared with controls, parents who participated in these interventions experienced improvements in multiple communication domains including the frequency, quality, intentions, comfort, and self-efficacy for communicating. We noted no effects on parental attitudes toward communicating or the outcomes they expected to occur as a result of communicating. Four studies were of high quality, 7 were of medium quality, and 1 was of lower quality. CONCLUSIONS: Our review was limited by the lack of standardized measures for assessing parental communication. Still, interventions for improving parent-adolescent sex communication are well designed and have some targeted effects. Wider dissemination could augment efforts by schools, clinicians, and health educators. PMID:21321027

Interventions to improve parental communication about sex: a systematic review.

PubMed

Akers, Aletha Y; Holland, Cynthia L; Bost, James

2011-03-01

The relative effectiveness of interventions to improve parental communication with adolescents about sex is not known. To compare the effectiveness and methodologic quality of interventions for improving parental communication with adolescents about sex. We searched 6 databases: OVID/Medline, PsychInfo, ERIC, Cochrane Review, Communication and Mass Media, and the Cumulative Index to Nursing and Allied Health Literature. We included studies published between 1980 and July 2010 in peer-reviewed English-language journals that targeted US parents of adolescents aged 11 to 18 years, used an experimental or quasi-experimental design, included a control group, and had a pretest/posttest design. We abstracted data on multiple communication outcomes defined by the integrative conceptual model (communication frequency, content, skills, intentions, self-efficacy, perceived environmental barriers/facilitators, perceived social norms, attitudes, outcome expectations, knowledge, and beliefs). Methodologic quality was assessed using the 11-item methodologic quality score. Twelve studies met inclusion criteria. Compared with controls, parents who participated in these interventions experienced improvements in multiple communication domains including the frequency, quality, intentions, comfort, and self-efficacy for communicating. We noted no effects on parental attitudes toward communicating or the outcomes they expected to occur as a result of communicating. Four studies were of high quality, 7 were of medium quality, and 1 was of lower quality. Our review was limited by the lack of standardized measures for assessing parental communication. Still, interventions for improving parent-adolescent sex communication are well designed and have some targeted effects. Wider dissemination could augment efforts by schools, clinicians, and health educators.

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

Importance of methodology on (99m)technetium dimercapto-succinic acid scintigraphic image quality: imaging pilot study for RIVUR (Randomized Intervention for Children With Vesicoureteral Reflux) multicenter investigation.

PubMed

Ziessman, Harvey A; Majd, Massoud

2009-07-01

We reviewed our experience with (99m)technetium dimercapto-succinic acid scintigraphy obtained during an imaging pilot study for a multicenter investigation (Randomized Intervention for Children With Vesicoureteral Reflux) of the effectiveness of daily antimicrobial prophylaxis for preventing recurrent urinary tract infection and renal scarring. We analyzed imaging methodology and its relation to diagnostic image quality. (99m)Technetium dimercapto-succinic acid imaging guidelines were provided to participating sites. High-resolution planar imaging with parallel hole or pinhole collimation was required. Two core reviewers evaluated all submitted images. Analysis included appropriate views, presence or lack of patient motion, adequate magnification, sufficient counts and diagnostic image quality. Inter-reader agreement was evaluated. We evaluated 70, (99m)technetium dimercapto-succinic acid studies from 14 institutions. Variability was noted in methodology and image quality. Correlation (r value) between dose administered and patient age was 0.780. For parallel hole collimator imaging good correlation was noted between activity administered and counts (r = 0.800). For pinhole imaging the correlation was poor (r = 0.110). A total of 10 studies (17%) were rejected for quality issues of motion, kidney overlap, inadequate magnification, inadequate counts and poor quality images. The submitting institution was informed and provided with recommendations for improving quality, and resubmission of another study was required. Only 4 studies (6%) were judged differently by the 2 reviewers, and the differences were minor. Methodology and image quality for (99m)technetium dimercapto-succinic acid scintigraphy varied more than expected between institutions. The most common reason for poor image quality was inadequate count acquisition with insufficient attention to the tradeoff between administered dose, length of image acquisition, start time of imaging and resulting image quality. Inter-observer core reader agreement was high. The pilot study ensured good diagnostic quality standardized images for the Randomized Intervention for Children With Vesicoureteral Reflux investigation.

Traditional Chinese medicine for knee osteoarthritis: An overview of systematic review

PubMed Central

Wang, Qing; Chen, Hao

2017-01-01

Background Traditional Chinese medicine (TCM) has been accepted as a complementary therapy for knee osteoarthritis. However, the efficacy and safety of the intervention were still conflicting and uncertain. Meanwhile, the quality of methodology and evidence in the field was unknown. Objective To summarize the characteristics and critically evaluate the quality of methodology, as well as the evidence of systematic reviews (SRs) on TCM for knee osteoarthritis. Methods Five electronic databases were searched from inception to April 2016. The methodological quality of the included studies was assessed by AMSTAR and ROBIS. The quality of the evidence was determined using the GRADE approach. Results Ten SRs were included. The conclusions suggest that TCM provides potential benefits for patients with knee osteoarthritis. These benefits include pain relief, functional improvement, and presence of few adverse events. Limitations of the methodological quality mainly included the lack of a-priori protocol or protocol registration and incomprehensive literature search. A list of excluded studies was also not provided. The overall quality of evidence in the SRs was poor, ranging from “very low” to “low,” mainly because of the serious risk of bias of original trials, inconsistencies, and imprecision in the outcomes. Conclusions TCM generally appears to be effective for knee osteoarthritis treatment. However, the evidence is not robust enough because of the methodological flaws in SRs. Hence, these conclusions on available SRs should be treated with caution for clinical practice. PMID:29267324

A critical methodological review of discourse and conversation analysis studies of family therapy.

PubMed

Tseliou, Eleftheria

2013-12-01

Discourse (DA) and conversation (CA) analysis, two qualitative research methods, have been recently suggested as potentially promising for the study of family therapy due to common epistemological adherences and their potential for an in situ study of therapeutic dialog. However, to date, there is no systematic methodological review of the few existing DA and CA studies of family therapy. This study aims at addressing this lack by critically reviewing published DA and CA studies of family therapy on methodological grounds. Twenty-eight articles in total are reviewed in relation to certain methodological axes identified in the relevant literature. These include choice of method, framing of research question(s), data/sampling, type of analysis, epistemological perspective, content/type of knowledge claims, and attendance to criteria for good quality practice. It is argued that the reviewed studies show "glimpses" of the methods' potential for family therapy research despite the identification of certain "shortcomings" regarding their methodological rigor. These include unclearly framed research questions and the predominance of case study designs. They also include inconsistencies between choice of method, stated or unstated epistemological orientations and knowledge claims, and limited attendance to criteria for good quality practice. In conclusion, it is argued that DA and CA can add to the existing quantitative and qualitative methods for family therapy research. They can both offer unique ways for a detailed study of the actual therapeutic dialog, provided that future attempts strive for a methodologically rigorous practice and against their uncritical deployment. © FPI, Inc.

A review of economic evaluations of behavior change interventions: setting an agenda for research methods and practice.

PubMed

Alayli-Goebbels, Adrienne F G; Evers, Silvia M A A; Alexeeva, Daria; Ament, André J H A; de Vries, Nanne K; Tilly, Jan C; Severens, Johan L

2014-06-01

The objective of this study was to review methodological quality of economic evaluations of lifestyle behavior change interventions (LBCIs) and to examine how they address methodological challenges for public health economic evaluation identified in the literature. Pubmed and the NHS economic evaluation database were searched for published studies in six key areas for behavior change: smoking, physical activity, dietary behavior, (illegal) drug use, alcohol use and sexual behavior. From included studies (n = 142), we extracted data on general study characteristics, characteristics of the LBCIs, methodological quality and handling of methodological challenges. Economic evaluation evidence for LBCIs showed a number of weaknesses: methods, study design and characteristics of evaluated interventions were not well reported; methodological quality showed several shortcomings and progress with addressing methodological challenges remained limited. Based on the findings of this review we propose an agenda for improving future evidence to support decision-making. Recommendations for practice include improving reporting of essential study details and increasing adherence with good practice standards. Recommendations for research methods focus on mapping out complex causal pathways for modeling, developing measures to capture broader domains of wellbeing and community outcomes, testing methods for considering equity, identifying relevant non-health sector costs and advancing methods for evidence synthesis. © The Author 2013. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Reviewing methodologically disparate data: a practical guide for the patient safety research field.

PubMed

Brown, Katrina F; Long, Susannah J; Athanasiou, Thanos; Vincent, Charles A; Kroll, J Simon; Sevdalis, Nick

2012-02-01

This article addresses key questions frequently asked by researchers conducting systematic reviews in patient safety. This discipline is relatively young, and asks complex questions about complex aspects of health care delivery and experience, therefore its studies are typically methodologically heterogeneous, non-randomized and complex; but content rich and highly relevant to practice. Systematic reviews are increasingly necessary to drive forward practice and research in this area, but the data do not always lend themselves to 'standard' review methodologies. This accessible 'how-to' article demonstrates that data diversity need not preclude high-quality systematic reviews. It draws together information from published guidelines and experience within our multidisciplinary patient safety research group to provide entry-level advice for the clinician-researcher new to systematic reviewing, to non-biomedical research data or to both. It offers entry-level advice, illustrated with detailed practical examples, on defining a research question, creating a comprehensive search strategy, selecting articles for inclusion, assessing study quality, extracting data, synthesizing data and evaluating the impact of your review. The article concludes with a comment on the vital role of robust systematic reviews in the continuing advancement of the patient safety field. © 2010 Blackwell Publishing Ltd.

The reliability of physical examination tests for the diagnosis of anterior cruciate ligament rupture--A systematic review.

PubMed

Lange, Toni; Freiberg, Alice; Dröge, Patrik; Lützner, Jörg; Schmitt, Jochen; Kopkow, Christian

2015-06-01

Systematic literature review. Despite their frequent application in routine care, a systematic review on the reliability of clinical examination tests to evaluate the integrity of the ACL is missing. To summarize and evaluate intra- and interrater reliability research on physical examination tests used for the diagnosis of ACL tears. A comprehensive systematic literature search was conducted in MEDLINE, EMBASE and AMED until May 30th 2013. Studies were included if they assessed the intra- and/or interrater reliability of physical examination tests for the integrity of the ACL. Methodological quality was evaluated with the Quality Appraisal of Reliability Studies (QAREL) tool by two independent reviewers. 110 hits were achieved of which seven articles finally met the inclusion criteria. These studies examined the reliability of four physical examination tests. Intrarater reliability was assessed in three studies and ranged from fair to almost perfect (Cohen's k = 0.22-1.00). Interrater reliability was assessed in all included studies and ranged from slight to almost perfect (Cohen's k = 0.02-0.81). The Lachman test is the physical tests with the highest intrarater reliability (Cohen's k = 1.00), the Lachman test performed in prone position the test with the highest interrater reliability (Cohen's k = 0.81). Included studies were partly of low methodological quality. A meta-analysis could not be performed due to the heterogeneity in study populations, reliability measures and methodological quality of included studies. Systematic investigations on the reliability of physical examination tests to assess the integrity of the ACL are scarce and of varying methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

Methodological Quality of Randomized Clinical Trials of Respiratory Physiotherapy in Coronary Artery Bypass Grafting Patients in the Intensive Care Unit: a Systematic Review

PubMed Central

Lorscheitter, Jaqueline; Stein, Cinara; Plentz, Rodrigo Della Méa

2017-01-01

Objective To assess methodological quality of the randomized controlled trials of physiotherapy in patients undergoing coronary artery bypass grafting in the intensive care unit. Methods The studies published until May 2015, in MEDLINE, Cochrane and PEDro were included. The primary outcome extracted was proper filling of the Cochrane Collaboration's tool's items and the secondary was suitability to the requirements of the CONSORT Statement and its extension. Results From 807 studies identified, 39 were included. Most at CONSORT items showed a better adequacy after the statement's publication. Studies with positive outcomes presented better methodological quality. Conclusion The methodological quality of the studies has been improving over the years. However, many aspects can still be better designed. PMID:28977205

Systematic reviews of surgical procedures in children: quantity, coverage and quality.

PubMed

McGee, Richard G; Craig, Jonathan C; Rogerson, Thomas E; Webster, Angela C

2013-04-01

Systematic reviews have the potential to map those areas where children are under-represented in surgical research. We aimed to describe and evaluate the quantity, coverage and the quality of conduct and reporting of systematic reviews of surgical procedures in children. We searched four biomedical databases, a systematic review register, reference lists and conducted hand searching to identify relevant reviews. Two reviewers worked independently to critically appraise included studies and abstract data. We assessed reporting quality using the preferred reporting items for systematic reviews and meta-analysis statement and methodological quality using the Assessment of Multiple SysTemAtic Reviews tool. Fifteen systematic reviews were identified, representing 0.01% of all paediatric surgical citations in MEDLINE and Embase. Thirteen of the reviews were Cochrane reviews, and most reviews (12/15) addressed subspecialty interests such as otorhinolaryngology. The median number of included trials per systematic review was four (interquartile range 1 to 9.5), the median number of primary outcomes was 5.5 (interquartile range 3.5 to 7.5). In general, reporting and methodological quality was good although there were several omissions, particularly around completeness of reporting of statistical methods used, and utilisation of quality assessments in analyses. Outcomes were often not clearly defined and descriptions of procedures lacked sufficient detail to determine the similarities and differences among surgical procedures within the contributing trials. Systematic reviews of surgical procedures in children are rarely published. To improve the evidence base and guide research agendas, more systematic reviews should be conducted, using standard guidelines for conduct and reporting. © 2013 The Authors. Journal of Paediatrics and Child Health © 2013 Paediatrics and Child Health Division (Royal Australasian College of Physicians).

Cluster Randomised Trials in Cochrane Reviews: Evaluation of Methodological and Reporting Practice.

PubMed

Richardson, Marty; Garner, Paul; Donegan, Sarah

2016-01-01

Systematic reviews can include cluster-randomised controlled trials (C-RCTs), which require different analysis compared with standard individual-randomised controlled trials. However, it is not known whether review authors follow the methodological and reporting guidance when including these trials. The aim of this study was to assess the methodological and reporting practice of Cochrane reviews that included C-RCTs against criteria developed from existing guidance. Criteria were developed, based on methodological literature and personal experience supervising review production and quality. Criteria were grouped into four themes: identifying, reporting, assessing risk of bias, and analysing C-RCTs. The Cochrane Database of Systematic Reviews was searched (2nd December 2013), and the 50 most recent reviews that included C-RCTs were retrieved. Each review was then assessed using the criteria. The 50 reviews we identified were published by 26 Cochrane Review Groups between June 2013 and November 2013. For identifying C-RCTs, only 56% identified that C-RCTs were eligible for inclusion in the review in the eligibility criteria. For reporting C-RCTs, only eight (24%) of the 33 reviews reported the method of cluster adjustment for their included C-RCTs. For assessing risk of bias, only one review assessed all five C-RCT-specific risk-of-bias criteria. For analysing C-RCTs, of the 27 reviews that presented unadjusted data, only nine (33%) provided a warning that confidence intervals may be artificially narrow. Of the 34 reviews that reported data from unadjusted C-RCTs, only 13 (38%) excluded the unadjusted results from the meta-analyses. The methodological and reporting practices in Cochrane reviews incorporating C-RCTs could be greatly improved, particularly with regard to analyses. Criteria developed as part of the current study could be used by review authors or editors to identify errors and improve the quality of published systematic reviews incorporating C-RCTs.

Volume and methodological quality of randomized controlled trials in laparoscopic surgery: assessment over a 10-year period.

PubMed

Antoniou, Stavros A; Andreou, Alexandros; Antoniou, George A; Koch, Oliver O; Köhler, Gernot; Luketina, Ruzica-R; Bertsias, Antonios; Pointner, Rudolph; Granderath, Frank-Alexander

2015-11-01

Measures have been taken to improve methodological quality of randomized controlled trials (RCTs). This review systematically assessed the trends in volume and methodological quality of RCTs on minimally invasive surgery within a 10-year period. RCTs on minimally invasive surgery were searched in the 10 most cited general surgical journals and the 5 most cited journals of laparoscopic interest for the years 2002 and 2012. Bibliometric and methodological quality components were abstracted using the Scottish Intercollegiate Guidelines Network. The pooled number of RCTs from low-contribution regions demonstrated an increasing proportion of the total published RCTs, compensating for a concomitant decrease of the respective contributions from Europe and North America. International collaborations were more frequent in 2012. Acceptable or high quality RCTs accounted for 37.9% and 54.4% of RCTs published in 2002 and 2012, respectively. Components of external validity were poorly reported. Both the volume and the reporting quality of laparoscopic RCTs have increased from 2002 to 2012, but there seems to be ample room for improvement of methodological quality. Copyright © 2015 Elsevier Inc. All rights reserved.

Association of journal quality indicators with methodological quality of clinical research articles.

PubMed

Lee, Kirby P; Schotland, Marieka; Bacchetti, Peter; Bero, Lisa A

2002-06-05

The ability to identify scientific journals that publish high-quality research would help clinicians, scientists, and health-policy analysts to select the most up-to-date medical literature to review. To assess whether journal characteristics of (1) peer-review status, (2) citation rate, (3) impact factor, (4) circulation, (5) manuscript acceptance rate, (6) MEDLINE indexing, and (7) Brandon/Hill Library List indexing are predictors of methodological quality of research articles, we conducted a cross-sectional study of 243 original research articles involving human subjects published in general internal medical journals. The mean (SD) quality score of the 243 articles was 1.37 (0.22). All journals reported a peer-review process and were indexed on MEDLINE. In models that controlled for article type (randomized controlled trial [RCT] or non-RCT), journal citation rate was the most statistically significant predictor (0.051 increase per doubling; 95% confidence interval [CI], 0.037-0.065; P<.001). In separate analyses by article type, acceptance rate was the strongest predictor for RCT quality (-0.113 per doubling; 95% CI, -0.148 to -0.078; P<.001), while journal citation rate was the most predictive factor for non-RCT quality (0.051 per doubling; 95% CI, 0.044-0.059; P<.001). High citation rates, impact factors, and circulation rates, and low manuscript acceptance rates and indexing on Brandon/Hill Library List appear to be predictive of higher methodological quality scores for journal articles.

Dissemination of Periodontal Pathogens in the Bloodstream after Periodontal Procedures: A Systematic Review

PubMed Central

Horliana, Anna Carolina Ratto Tempestini; Chambrone, Leandro; Foz, Adriana Moura; Artese, Hilana Paula Carillo; Rabelo, Mariana de Sousa; Pannuti, Cláudio Mendes; Romito, Giuseppe Alexandre

2014-01-01

Background To date, there is no compilation of evidence-based information associating bacteremia and periodontal procedures. This systematic review aims to assess magnitude, duration, prevalence and nature of bacteremia caused by periodontal procedures. Study Design Systematic Review Types of Studies Reviewed MEDLINE, EMBASE and LILACS databases were searched in duplicate through August, 2013 without language restriction. Observational studies were included if blood samples were collected before, during or after periodontal procedures of patients with periodontitis. The methodological quality was assessed in duplicate using the modified Newcastle-Ottawa scale (NOS). Results Search strategy identified 509 potentially eligible articles and nine were included. Only four studies demonstrated high methodological quality, whereas five were of medium or low methodological quality. The study characteristics were considered too heterogeneous to conduct a meta-analysis. Among 219 analyzed patients, 106 (49.4%) had positive bacteremia. More frequent bacteria were S. viridans, A. actinomycetemcomitans P. gingivalis, M. micros and species Streptococcus and Actinomyces, although identification methods of microbiologic assays were different among studies. Clinical Implications Although half of the patients presented positive bacteremia after periodontal procedures, accurate results regarding the magnitude, duration and nature of bacteremia could not be confidentially assessed. PMID:24870125

75 FR 9572 - Submission for OMB Review; Comment Request: Correction

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-03

... Quality Control Reviews'' OMB control number 0584-0074. The document contained incorrect burden hours. The... methodology and assumptions used; (c) ways to enhance the quality, utility and clarity of the information to... information unless the collection of information displays a currently valid OMB control number and the agency...

Methods of Quality Appraisal for Studies Reviewed by Evidence Clearinghouses

ERIC Educational Resources Information Center

Wilson, Sandra Jo; Tanner-Smith, Emily

2015-01-01

This presentation will discuss quality appraisal methods for assessing research studies used in systematic reviews, research syntheses, and evidence-based practice repositories such as the What Works Clearinghouse. The different ways that the methodological rigor and risk of bias of primary studies included in syntheses is assessed means that…

Lean interventions in healthcare: do they actually work? A systematic literature review

PubMed Central

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-01-01

Purpose Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. Data sources We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Study selection Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data extraction Data on design, methods, interventions and key outcomes were extracted and collated. Results of data synthesis Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. Conclusion While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. PMID:26811118

Health-Related Quality of Life in Non–Small-Cell Lung Cancer: An Update of a Systematic Review on Methodologic Issues in Randomized Controlled Trials

PubMed Central

Claassens, Lily; van Meerbeeck, Jan; Coens, Corneel; Quinten, Chantal; Ghislain, Irina; Sloan, Elizabeth K.; Wang, Xin Shelly; Velikova, Galina; Bottomley, Andrew

2011-01-01

Purpose This study is an update of a systematic review of health-related quality-of-life (HRQOL) methodology reporting in non–small-cell lung cancer (NSCLC) randomized controlled trials (RCTs). The objective was to evaluate HRQOL methodology reporting over the last decade and its benefit for clinical decision making. Methods A MEDLINE systematic literature review was performed. Eligible RCTs implemented patient-reported HRQOL assessments and regular oncology treatments for newly diagnosed adult patients with NSCLC. Included studies were published in English from August 2002 to July 2010. Two independent reviewers evaluated all included RCTs. Results Fifty-three RCTs were assessed. Of the 53 RCTs, 81% reported that there was no significant difference in overall survival (OS). However, 50% of RCTs that were unable to find OS differences reported a significant difference in HRQOL scores. The quality of HRQOL reporting has improved; both reporting of clinically significant differences and statistical testing of HRQOL have improved. A European Organisation for Research and Treatment of Cancer HRQOL questionnaire was used in 57% of the studies. However, reporting of HRQOL hypotheses and rationales for choosing HRQOL instruments were significantly less than before 2002 (P < .05). Conclusion The number of NSCLC RCTs incorporating HRQOL assessments has considerably increased. HRQOL continues to demonstrate its importance in RCTs, especially in those studies in which no OS difference is found. Despite the improved quality of HRQOL methodology reporting, certain aspects remain underrepresented. Our findings suggest need for an international standardization of HRQOL reporting similar to the CONSORT guidelines for clinical findings. PMID:21464420

Clinical practice guidelines in breast cancer

PubMed Central

Tyagi, N. Kumar; Dhesy-Thind, S.

2018-01-01

Background A number of clinical practice guidelines (cpgs) concerning breast cancer (bca) screening and management are available. Here, we review the strengths and weaknesses of cpgs from various professional organizations and consensus groups with respect to their methodologic quality, recommendations, and implementability. Methods Guidelines from four groups were reviewed with respect to two clinical scenarios: adjuvant ovarian function suppression (ofs) in premenopausal women with early-stage estrogen receptor–positive bca, and use of sentinel lymph node biopsy (slnb) after neoadjuvant chemotherapy (nac) for locally advanced bca. Guidelines from the American Society of Clinical Oncology (asco); Cancer Care Ontario’s Program in Evidence Based Care (cco’s pebc); the U.S. National Comprehensive Cancer Network (nccn); and the St. Gallen International Breast Cancer Consensus Conference were reviewed by two independent assessors. Guideline methodology and applicability were evaluated using the agree ii tool. Results The quality of the cpgs was greatest for the guidelines developed by asco and cco’s pebc. The nccn and St. Gallen guidelines were found to have lower scores for methodologic rigour. All guidelines scored poorly for applicability. The recommendations for ofs were similar in three guidelines. Recommendations by the various organizations for the use of slnb after nac were contradictory. Conclusions Our review demonstrated that cpgs can be heterogeneous in methodologic quality. Low-quality cpg implementation strategies contribute to low uptake of, and adherence to, bca cpgs. Further research examining the barriers to recommendations—such as intrinsic guideline characteristics and the needs of end users—is required. The use of bca cpgs can improve the knowledge-to-practice gap and patient outcomes.

The differential impact of scientific quality, bibliometric factors, and social media activity on the influence of systematic reviews and meta-analyses about psoriasis.

PubMed

Ruano, Juan; Aguilar-Luque, Macarena; Gómez-Garcia, Francisco; Alcalde Mellado, Patricia; Gay-Mimbrera, Jesus; Carmona-Fernandez, Pedro J; Maestre-López, Beatriz; Sanz-Cabanillas, Juan Luís; Hernández Romero, José Luís; González-Padilla, Marcelino; Vélez García-Nieto, Antonio; Isla-Tejera, Beatriz

2018-01-01

Researchers are increasingly using on line social networks to promote their work. Some authors have suggested that measuring social media activity can predict the impact of a primary study (i.e., whether or not an article will be highly cited). However, the influence of variables such as scientific quality, research disclosures, and journal characteristics on systematic reviews and meta-analyses has not yet been assessed. The present study aims to describe the effect of complex interactions between bibliometric factors and social media activity on the impact of systematic reviews and meta-analyses about psoriasis (PROSPERO 2016: CRD42016053181). Methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Altmetrics, which consider Twitter, Facebook, and Google+ mention counts as well as Mendeley and SCOPUS readers, and corresponding article citation counts from Google Scholar were obtained for each article. Metadata and journal-related bibliometric indices were also obtained. One-hundred and sixty-four reviews with available altmetrics information were included in the final multifactorial analysis, which showed that social media and impact factor have less effect than Mendeley and SCOPUS readers on the number of cites that appear in Google Scholar. Although a journal's impact factor predicted the number of tweets (OR, 1.202; 95% CI, 1.087-1.049), the years of publication and the number of Mendeley readers predicted the number of citations in Google Scholar (OR, 1.033; 95% CI, 1.018-1.329). Finally, methodological quality was related neither with bibliometric influence nor social media activity for systematic reviews. In conclusion, there seems to be a lack of connectivity between scientific quality, social media activity, and article usage, thus predicting scientific success based on these variables may be inappropriate in the particular case of systematic reviews.

The differential impact of scientific quality, bibliometric factors, and social media activity on the influence of systematic reviews and meta-analyses about psoriasis

PubMed Central

Gómez-Garcia, Francisco; Alcalde Mellado, Patricia; Gay-Mimbrera, Jesus; Carmona-Fernandez, Pedro J.; Maestre-López, Beatriz; Sanz-Cabanillas, Juan Luís; Hernández Romero, José Luís; González-Padilla, Marcelino; Vélez García-Nieto, Antonio; Isla-Tejera, Beatriz

2018-01-01

Researchers are increasingly using on line social networks to promote their work. Some authors have suggested that measuring social media activity can predict the impact of a primary study (i.e., whether or not an article will be highly cited). However, the influence of variables such as scientific quality, research disclosures, and journal characteristics on systematic reviews and meta-analyses has not yet been assessed. The present study aims to describe the effect of complex interactions between bibliometric factors and social media activity on the impact of systematic reviews and meta-analyses about psoriasis (PROSPERO 2016: CRD42016053181). Methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Altmetrics, which consider Twitter, Facebook, and Google+ mention counts as well as Mendeley and SCOPUS readers, and corresponding article citation counts from Google Scholar were obtained for each article. Metadata and journal-related bibliometric indices were also obtained. One-hundred and sixty-four reviews with available altmetrics information were included in the final multifactorial analysis, which showed that social media and impact factor have less effect than Mendeley and SCOPUS readers on the number of cites that appear in Google Scholar. Although a journal’s impact factor predicted the number of tweets (OR, 1.202; 95% CI, 1.087–1.049), the years of publication and the number of Mendeley readers predicted the number of citations in Google Scholar (OR, 1.033; 95% CI, 1.018–1.329). Finally, methodological quality was related neither with bibliometric influence nor social media activity for systematic reviews. In conclusion, there seems to be a lack of connectivity between scientific quality, social media activity, and article usage, thus predicting scientific success based on these variables may be inappropriate in the particular case of systematic reviews. PMID:29377889

Instruments to assess patients with rotator cuff pathology: a systematic review of measurement properties.

PubMed

Longo, Umile Giuseppe; Saris, Daniël; Poolman, Rudolf W; Berton, Alessandra; Denaro, Vincenzo

2012-10-01

The aims of this study were to obtain an overview of the methodological quality of studies on the measurement properties of rotator cuff questionnaires and to describe how well various aspects of the design and statistical analyses of studies on measurement properties are performed. A systematic review of published studies on the measurement properties of rotator cuff questionnaires was performed. Two investigators independently rated the quality of the studies using the Consensus-based Standards for the selection of health Measurement Instruments checklist. This checklist was developed in an international Delphi consensus study. Sixteen studies were included, in which two measurement instruments were evaluated, namely the Western Ontario Rotator Cuff Index and the Rotator Cuff Quality-of-Life Measure. The methodological quality of the included studies was adequate on some properties (construct validity, reliability, responsiveness, internal consistency, and translation) but need to be improved on other aspects. The most important methodological aspects that need to be developed are as follows: measurement error, content validity, structural validity, cross-cultural validity, criterion validity, and interpretability. Considering the importance of adequate measurement properties, it is concluded that, in the field of rotator cuff pathology, there is room for improvement in the methodological quality of studies measurement properties. II.

The Concepts of Quality, Quality Assurance and Quality Enhancement

ERIC Educational Resources Information Center

Elassy, Noha

2015-01-01

Purpose: This paper aims to critically review and discuss different definitions of the concepts of quality, quality assurance (QA) and quality enhancement (QE) in higher education (HE) with presenting critical perspectives of the literature. Design/methodology/approach: The paper looks at literature concerns with the meaning of quality, QA and QE,…

[Quality appraisal of systematic reviews or meta-analysis on traditional Chinese medicine published in Chinese journals].

PubMed

Liu, Jian-ping; Xia, Yun

2007-04-01

To critically assess the quality of literature about systematic review or meta-analysis on traditional Chinese medicine (TCM) published in Chinese journals. Electronic searches in CNKI, VIP and Wanfang data-base were conducted to retrieve the systematic reviews or meta-analysis reports on TCM, including herbal medicine, needling, acupuncture and moxibustion, as well as integrative medicine, they were identified and extracted according to the 18 items of QUOROM (quality of reporting of meta-analyses) Statement and relative information. The appraisal was made taking the indexes mainly including objectives, source of data, methods of data extraction, quality assessment of the included studies, measurement data synthesis, etc. Eighty-two systematic reviews were identified, except 6 reviews were excluded for repeatedly published or didn't comply with the enrolled criterion, 76 reviews concerning 51 kinds of diseases were enrolled for appraisal. Among them, 70 reviews evaluated the efficacy of TCM, mainly on Chinese herbs and 9 on acupuncture and moxibustion. In majority of the reviews, randomised controlled trials were included and the data resources were described, but in 26 reviews only the Chinese databases were searched and the description about data extraction and analysis method were too simple; and 70% of reviews assessed the quality of the included studies; none used flow chart to express the process of selection, inclusion and exclusion of studies. Few reviews or Meta-analysis reports reached the international standard and there is insufficient description of methodology for conducting systematic reviews, so it is hardly to be repeated. The authors suggested that advanced methodological training is necessary for reviewers.

Cross-cultural adaptation and measurement properties of generic and cancer-related patient-reported outcome measures (PROMs) for use with cancer patients in Brazil: a systematic review.

PubMed

Albach, Carlos Augusto; Wagland, Richard; Hunt, Katherine J

2018-04-01

This systematic review (1) identifies the current generic and cancer-related patient-reported outcome measures (PROMs) that have been cross-culturally adapted to Brazilian Portuguese and applied to cancer patients and (2) critically evaluates their cross-cultural adaptation (CCA) and measurement properties. Seven databases were searched for articles regarding the translation and evaluation of measurement properties of generic and cancer-related PROMs cross-culturally adapted to Brazilian Portuguese that are applied in adult (≥18 years old) cancer patients. The methodological quality of included studies was assessed using the COSMIN checklist. The bibliographic search retrieved 1674 hits, of which seven studies analysing eight instruments were included in this review. Data on the interpretability of scores were poorly reported. Overall, the quality of the CCA process was inconsistent throughout the studies. None of the included studies performed a cross-cultural validation. The evidence concerning the quality of measurement properties is limited by poor or fair methodological quality. Moreover, limited information regarding measurement properties was provided within the included papers. This review aids the selection process of Brazilian Portuguese PROMs for use in cancer patients. After acknowledging the methodological caveats and strengths of each tool, our opinion is that for quality of life and symptoms assessment the adapted FACT-G version and the ESAS could be recommended, respectively. Future research should rely on the already accepted standards of CCA and validation studies.

[Evaluation of quality of service in Early Intervention: A systematic review].

PubMed

Jemes Campaña, Inmaculada Concepción; Romero-Galisteo, Rita Pilar; Labajos Manzanares, María Teresa; Moreno Morales, Noelia

2018-06-07

Early Intervention (EI), as a paediatric service, has the duty of quantifying the results and the quality of its services provided. The accessibility of valid and reliable tools allows professionals to evaluate the quality of these services. The aim of this study is to review the scientific literature on tools used to measure the methodological and service quality in EI. A search was made in different databases: Medline (from PubMed), Web of Science, PsycINFO, Cochrane, Scopus, ERIC and Scielo. The methodological quality of the studies was tested using the COSMIN scale. A total of 13 manuscripts met the criteria to be included in this review. Ten of them received a "good" or "reasonable" score based on the COSMIN scale. Despite its importance, there is no consensus among authors on the measurement of service quality in EI. It is often the family of the children attended in EI that are considered the target to study, although the opinion of professionals carries more weight and completes the information. Copyright © 2018. Publicado por Elsevier España, S.L.U.

Child maltreatment prevention: a systematic review of reviews.

PubMed

Mikton, Christopher; Butchart, Alexander

2009-05-01

To synthesize recent evidence from systematic and comprehensive reviews on the effectiveness of universal and selective child maltreatment prevention interventions, evaluate the methodological quality of the reviews and outcome evaluation studies they are based on, and map the geographical distribution of the evidence. A systematic review of reviews was conducted. The quality of the systematic reviews was evaluated with a tool for the assessment of multiple systematic reviews (AMSTAR), and the quality of the outcome evaluations was assessed using indicators of internal validity and of the construct validity of outcome measures. The review focused on seven main types of interventions: home visiting, parent education, child sex abuse prevention, abusive head trauma prevention, multi-component interventions, media-based interventions, and support and mutual aid groups. Four of the seven - home-visiting, parent education, abusive head trauma prevention and multi-component interventions - show promise in preventing actual child maltreatment. Three of them - home visiting, parent education and child sexual abuse prevention - appear effective in reducing risk factors for child maltreatment, although these conclusions are tentative due to the methodological shortcomings of the reviews and outcome evaluation studies they draw on. An analysis of the geographical distribution of the evidence shows that outcome evaluations of child maltreatment prevention interventions are exceedingly rare in low- and middle-income countries and make up only 0.6% of the total evidence base. Evidence for the effectiveness of four of the seven main types of interventions for preventing child maltreatment is promising, although it is weakened by methodological problems and paucity of outcome evaluations from low- and middle-income countries.

Methodological Quality of Consensus Guidelines in Implant Dentistry.

PubMed

Faggion, Clovis Mariano; Apaza, Karol; Ariza-Fritas, Tania; Málaga, Lilian; Giannakopoulos, Nikolaos Nikitas; Alarcón, Marco Antonio

2017-01-01

Consensus guidelines are useful to improve clinical decision making. Therefore, the methodological evaluation of these guidelines is of paramount importance. Low quality information may guide to inadequate or harmful clinical decisions. To evaluate the methodological quality of consensus guidelines published in implant dentistry using a validated methodological instrument. The six implant dentistry journals with impact factors were scrutinised for consensus guidelines related to implant dentistry. Two assessors independently selected consensus guidelines, and four assessors independently evaluated their methodological quality using the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument. Disagreements in the selection and evaluation of guidelines were resolved by consensus. First, the consensus guidelines were analysed alone. Then, systematic reviews conducted to support the guidelines were included in the analysis. Non-parametric statistics for dependent variables (Wilcoxon signed rank test) was used to compare both groups. Of 258 initially retrieved articles, 27 consensus guidelines were selected. Median scores in four domains (applicability, rigour of development, stakeholder involvement, and editorial independence), expressed as percentages of maximum possible domain scores, were below 50% (median, 26%, 30.70%, 41.70%, and 41.70%, respectively). The consensus guidelines and consensus guidelines + systematic reviews data sets could be compared for 19 guidelines, and the results showed significant improvements in all domain scores (p < 0.05). Methodological improvement of consensus guidelines published in major implant dentistry journals is needed. The findings of the present study may help researchers to better develop consensus guidelines in implant dentistry, which will improve the quality and trust of information needed to make proper clinical decisions.

Methodological Quality of Consensus Guidelines in Implant Dentistry

PubMed Central

Faggion, Clovis Mariano; Apaza, Karol; Ariza-Fritas, Tania; Málaga, Lilian; Giannakopoulos, Nikolaos Nikitas; Alarcón, Marco Antonio

2017-01-01

Background Consensus guidelines are useful to improve clinical decision making. Therefore, the methodological evaluation of these guidelines is of paramount importance. Low quality information may guide to inadequate or harmful clinical decisions. Objective To evaluate the methodological quality of consensus guidelines published in implant dentistry using a validated methodological instrument. Methods The six implant dentistry journals with impact factors were scrutinised for consensus guidelines related to implant dentistry. Two assessors independently selected consensus guidelines, and four assessors independently evaluated their methodological quality using the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument. Disagreements in the selection and evaluation of guidelines were resolved by consensus. First, the consensus guidelines were analysed alone. Then, systematic reviews conducted to support the guidelines were included in the analysis. Non-parametric statistics for dependent variables (Wilcoxon signed rank test) was used to compare both groups. Results Of 258 initially retrieved articles, 27 consensus guidelines were selected. Median scores in four domains (applicability, rigour of development, stakeholder involvement, and editorial independence), expressed as percentages of maximum possible domain scores, were below 50% (median, 26%, 30.70%, 41.70%, and 41.70%, respectively). The consensus guidelines and consensus guidelines + systematic reviews data sets could be compared for 19 guidelines, and the results showed significant improvements in all domain scores (p < 0.05). Conclusions Methodological improvement of consensus guidelines published in major implant dentistry journals is needed. The findings of the present study may help researchers to better develop consensus guidelines in implant dentistry, which will improve the quality and trust of information needed to make proper clinical decisions. PMID:28107405

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs.

PubMed

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed.

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs

PubMed Central

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed. PMID:27917143

[Methodological quality of articles on therapeutic procedures published in Cirugía Española. Evaluation of the period 2005-2008].

PubMed

Manterola, Carlos; Grande, Luís

2010-04-01

To determine methodological quality of therapy articles published in Cirugía Española and to study its association with the publication year, the centre of origin and subjects. A literature study which included all therapy articles published between 2005 and 2008. All kinds of clinical designs were considered, excluding editorials, review articles, letters to editor and experimental studies. Variables analysed included: year of publication, centre of origin, design, and methodological quality of articles. A valid and reliable scale was applied to determine methodological quality. A total of 243 articles [206 series of cases (84.8%), 27 cohort studies (11.1%), 9 clinical trials (3.7%) and 1 case control study (0.4%)] were found. Studies came preferentially from Catalonia and Valencia (22.3% and 12.3% respectively). Thematic areas most frequently found were hepato-bilio-pancreatic and colorectal surgery (20.0% and 16.6%, respectively). Average and median of the methodological quality score calculated for the entire series were 9.5+/-4.3 points and 8 points, respectively. Association between methodological quality and geographical area (p=0.0101), subject area (p=0.0267), and university origin (p=0.0369) was found. A significant increase of methodological quality by publication year was observed (p=0.0004). Methodological quality of therapy articles published in Cirugía Española between 2005 and 2008 is low; but an increase tendency with statistical significance was observed.

Is there relationship between temporomandibular disorders and head and cervical posture? A systematic review.

PubMed

Rocha, C P; Croci, C S; Caria, P H F

2013-11-01

The objective of this systematic review was to find sufficient evidence to deny or accept the association between the head and cervical posture and temporomandibular disorders (TMDs), and thus assist health professionals in the evaluation and treatment of patients with TMDs. A search was conducted through all publications written in English about this topic using the databases from Medline, ISI Web of Science, EMBASE, PubMed and Lilacs. The abstracts that fulfilled the initial guideline were retrieved and evaluated to ensure they met the inclusion criteria. To assess the methodological quality of the studies, we developed a questionnaire considering the following criteria: participant's eligibility, control group, diagnosis of TMDs, posture diagnosis and randomisation. Twenty-two studies were selected as potential studies based on their abstracts. Only seventeen studies actually fulfilled the inclusion criteria. The search provided information about the methodological quality of the studies, in which several methodological defects were found. The evidence presented in this systematic review shows that the relation between TMDs and the head and neck posture is still controversial and unclear. The insufficient number of articles considered of excellent methodological quality is a factor that hinders the acceptance or denial of this association. © 2013 John Wiley & Sons Ltd.

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students’ academic success. PMID:27031506

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

Systematic Review of the Application of Lean and Six Sigma Quality Improvement Methodologies in Radiology.

PubMed

Amaratunga, Thelina; Dobranowski, Julian

2016-09-01

Preventable yet clinically significant rates of medical error remain systemic, while health care spending is at a historic high. Industry-based quality improvement (QI) methodologies show potential for utility in health care and radiology because they use an empirical approach to reduce variability and improve workflow. The aim of this review was to systematically assess the literature with regard to the use and efficacy of Lean and Six Sigma (the most popular of the industrial QI methodologies) within radiology. MEDLINE, the Allied & Complementary Medicine Database, Embase Classic + Embase, Health and Psychosocial Instruments, and the Ovid HealthStar database, alongside the Cochrane Library databases, were searched on June 2015. Empirical studies in peer-reviewed journals were included if they assessed the use of Lean, Six Sigma, or Lean Six Sigma with regard to their ability to improve a variety of quality metrics in a radiology-centered clinical setting. Of the 278 articles returned, 23 studies were suitable for inclusion. Of these, 10 assessed Six Sigma, 7 assessed Lean, and 6 assessed Lean Six Sigma. The diverse range of measured outcomes can be organized into 7 common aims: cost savings, reducing appointment wait time, reducing in-department wait time, increasing patient volume, reducing cycle time, reducing defects, and increasing staff and patient safety and satisfaction. All of the included studies demonstrated improvements across a variety of outcomes. However, there were high rates of systematic bias and imprecision as per the Grading of Recommendations Assessment, Development and Evaluation guidelines. Lean and Six Sigma QI methodologies have the potential to reduce error and costs and improve quality within radiology. However, there is a pressing need to conduct high-quality studies in order to realize the true potential of these QI methodologies in health care and radiology. Recommendations on how to improve the quality of the literature are proposed. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Methodological quality of systematic reviews on treatments for depression: a cross-sectional study.

PubMed

Chung, V C H; Wu, X Y; Feng, Y; Ho, R S T; Wong, S Y S; Threapleton, D

2017-05-02

Depression is one of the most common mental disorders and identifying effective treatment strategies is crucial for the control of depression. Well-conducted systematic reviews (SRs) and meta-analyses can provide the best evidence for supporting treatment decision-making. Nevertheless, the trustworthiness of conclusions can be limited by lack of methodological rigour. This study aims to assess the methodological quality of a representative sample of SRs on depression treatments. A cross-sectional study on the bibliographical and methodological characteristics of SRs published on depression treatments trials was conducted. Two electronic databases (the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects) were searched for potential SRs. SRs with at least one meta-analysis on the effects of depression treatments were considered eligible. The methodological quality of included SRs was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. The associations between bibliographical characteristics and scoring on AMSTAR items were analysed using logistic regression analysis. A total of 358 SRs were included and appraised. Over half of included SRs (n = 195) focused on non-pharmacological treatments and harms were reported in 45.5% (n = 163) of all studies. Studies varied in methods and reporting practices: only 112 (31.3%) took the risk of bias among primary studies into account when formulating conclusions; 245 (68.4%) did not fully declare conflict of interests; 93 (26.0%) reported an 'a priori' design and 104 (29.1%) provided lists of both included and excluded studies. Results from regression analyses showed: more recent publications were more likely to report 'a priori' designs [adjusted odds ratio (AOR) 1.31, 95% confidence interval (CI) 1.09-1.57], to describe study characteristics fully (AOR 1.16, 95% CI 1.06-1.28), and to assess presence of publication bias (AOR 1.13, 95% CI 1.06-1.19), but were less likely to list both included and excluded studies (AOR 0.86, 95% CI 0.81-0.92). SRs published in journals with higher impact factor (AOR 1.14, 95% CI 1.04-1.25), completed by more review authors (AOR 1.12, 95% CI 1.01-1.24) and SRs on non-pharmacological treatments (AOR 1.62, 95% CI 1.01-2.59) were associated with better performance in publication bias assessment. The methodological quality of included SRs is disappointing. Future SRs should strive to improve rigour by considering of risk of bias when formulating conclusions, reporting conflict of interests and authors should explicitly describe harms. SR authors should also use appropriate methods to combine the results, prevent language and publication biases, and ensure timely updates.

Identifying Items to Assess Methodological Quality in Physical Therapy Trials: A Factor Analysis

PubMed Central

Cummings, Greta G.; Fuentes, Jorge; Saltaji, Humam; Ha, Christine; Chisholm, Annabritt; Pasichnyk, Dion; Rogers, Todd

2014-01-01

Background Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. Objective The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). Design A methodological research design was used, and an EFA was performed. Methods Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. Results Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. Limitation Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. Conclusions To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items. PMID:24786942

Identifying items to assess methodological quality in physical therapy trials: a factor analysis.

PubMed

Armijo-Olivo, Susan; Cummings, Greta G; Fuentes, Jorge; Saltaji, Humam; Ha, Christine; Chisholm, Annabritt; Pasichnyk, Dion; Rogers, Todd

2014-09-01

Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). A methodological research design was used, and an EFA was performed. Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items. © 2014 American Physical Therapy Association.

How to Select a Questionnaire with a Good Methodological Quality?

PubMed

Paiva, Saul Martins; Perazzo, Matheus de França; Ortiz, Fernanda Ruffo; Pordeus, Isabela Almeida; Martins-Júnior, Paulo Antônio

2018-01-01

In the last decades, several instruments have been used to evaluate the impact of oral health problems on the oral health-related quality of life (OHRQoL) of individuals. However, some instruments lack thorough methodological validation or present conceptual differences that hinder comparisons with instruments. Thus, it can be difficult to clinicians and researchers to select a questionnaire that accurately reflect what are really meaningful to individuals. This short communication aimed to discuss the importance of use an appropriate checklist to select an instrument with a good methodological quality. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was developed to provide tools for evidence-based instrument selection. The COSMIN checklist comprises ten boxes that evaluate whether a study meets the standard for good methodological quality and two additional boxes to meet studies that use the Item Response Theory method and general requirements for results generalization, resulting in four steps to be followed. In this way, it is required at least some expertise in psychometrics or clinimetrics to a wide-ranging use of this checklist. The COSMIN applications include its use to ensure the standardization of cross-cultural adaptations and safer comparisons between measurement studies and evaluation of methodological quality of systematic reviews of measurement properties. Also, it can be used by students when training about measurement properties and by editors and reviewers when revising manuscripts on this topic. The popularization of COSMIN checklist is therefore necessary to improve the selection and evaluation of health measurement instruments.

An Empirical Review of Internet Addiction Outcome Studies in China

ERIC Educational Resources Information Center

Liu, Chennan; Liao, Minli; Smith, Douglas C.

2012-01-01

Objectives: The authors systematically reviewed the outcomes and methodological quality of 24 Internet addiction (IA) treatment outcome studies in China. Method: The authors used 15 attributes from the quality of evidence scores to evaluate 24 outcome studies. These studies came from both English and Chinese academic databases from 2000 to 2010.…

What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Barreto, Jorge; Reveiz, Ludovic; Lavis, John N

2016-11-25

Rapid reviews have the potential to overcome a key barrier to the use of research evidence in decision making, namely that of the lack of timely and relevant research. This rapid review of systematic reviews and primary studies sought to answer the question: What are the best methodologies to enable a rapid review of research evidence for evidence-informed decision making in health policy and practice? This rapid review utilised systematic review methods and was conducted according to a pre-defined protocol including clear inclusion criteria (PROSPERO registration: CRD42015015998). A comprehensive search strategy was used, including published and grey literature, written in English, French, Portuguese or Spanish, from 2004 onwards. Eleven databases and two websites were searched. Two review authors independently applied the eligibility criteria. Data extraction was done by one reviewer and checked by a second. The methodological quality of included studies was assessed independently by two reviewers. A narrative summary of the results is presented. Five systematic reviews and one randomised controlled trial (RCT) that investigated methodologies for rapid reviews met the inclusion criteria. None of the systematic reviews were of sufficient quality to allow firm conclusions to be made. Thus, the findings need to be treated with caution. There is no agreed definition of rapid reviews in the literature and no agreed methodology for conducting rapid reviews. While a wide range of 'shortcuts' are used to make rapid reviews faster than a full systematic review, the included studies found little empirical evidence of their impact on the conclusions of either rapid or systematic reviews. There is some evidence from the included RCT (that had a low risk of bias) that rapid reviews may improve clarity and accessibility of research evidence for decision makers. Greater care needs to be taken in improving the transparency of the methods used in rapid review products. There is no evidence available to suggest that rapid reviews should not be done or that they are misleading in any way. We offer an improved definition of rapid reviews to guide future research as well as clearer guidance for policy and practice.

A Systematic Scoping Review of Yoga Intervention Components and Study Quality

PubMed Central

Elwy, A. Rani; Groessl, Erik J.; Eisen, Susan V.; Riley, Kristen; Maiya, Meghan; Lee, Jennifer P.; Sarkin, Andrew; Park, Crystal L.

2014-01-01

Context The scientific study of yoga requires rigorous methodology. This review aimed to systematically assess all studies of yoga interventions to: (1) determine yoga intervention characteristics; (2) examine methodologic quality of the subset of RCTs; and (3) explore how well these interventions are reported. Evidence acquisition Searches were conducted through April 2012 in PubMed, PsycInfo, Ageline, and Ovid’s Alternative and Complementary Medicine database using the text term yoga, and through handsearching five journals. Original studies were included if the intervention: (1) consisted of at least one yoga session with some type of health assessment; (2) targeted adults age ≥18 years; (3) was published in an English language peer–reviewed journal; and (4) was available for review. Evidence synthesis Of 3,062 studies identified, 465 studies in 30 countries were included. Analyses were conducted through 2013. Most interventions took place in India (n=228) or the U.S. (n=124), with intensity ranging from a single yoga session up to two sessions per day. Intervention lengths ranged from one session to 2 years. Asanas (poses) were mentioned as yoga components in 369 (79%) interventions, but were either minimally or not at all described in 200 (54%) of these. Most interventions (74%, n=336) did not include home practice. Of the included studies, 151 were RCTs. RCT quality was rated as poor. Conclusions This review highlights the inadequate reporting and methodologic limitations of current yoga intervention research, which limits study interpretation and comparability. Recommendations for future methodology and reporting are discussed. PMID:24996759

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery

PubMed Central

Gudlaugsdottir, Katrin; Andrews, James

2017-01-01

Objective Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality. Background Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated. Methods Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality. Results 112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression. Conclusions There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians. PMID:28384296

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

Quality indicators for musculoskeletal injury management in the emergency department: a systematic review.

PubMed

Strudwick, Kirsten; Nelson, Mark; Martin-Khan, Melinda; Bourke, Michael; Bell, Anthony; Russell, Trevor

2015-02-01

There is increasing importance placed on quality of health care for musculoskeletal injuries in emergency departments (EDs). This systematic review aimed to identify existing musculoskeletal quality indicators (QIs) developed for ED use and to critically evaluate their methodological quality. MEDLINE, EMBASE, CINAHL, and the gray literature, including relevant organizational websites, were searched in 2013. English-language articles were included that described the development of at least one QI related to the ED care of musculoskeletal injuries. Data extraction of each included article was conducted. A quality assessment was then performed by rating each relevant QI against the Appraisal of Indicators through Research and Evaluation (AIRE) Instrument. QIs with similar definitions were grouped together and categorized according to the health care quality frameworks of Donabedian and the Institute of Medicine. The search revealed 1,805 potentially relevant articles, of which 15 were finally included in the review. The number of relevant QIs per article ranged from one to 11, resulting in a total of 71 QIs overall. Pain (n = 17) and fracture management (n = 13) QIs were predominant. Ten QIs scored at least 50% across all AIRE Instrument domains, and these related to pain management and appropriate imaging of the spine. Methodological quality of the development of most QIs is poor. Recommendations for a core set of QIs that address the complete spectrum of musculoskeletal injury management in emergency medicine is not possible, and more work is needed. Currently, QIs with highest methodological quality are in the areas of pain management and medical imaging. © 2015 by the Society for Academic Emergency Medicine.

Specific guidelines for assessing and improving the methodological quality of economic evaluations of newborn screening

PubMed Central

2012-01-01

Background Economic evaluation of newborn screening poses specific methodological challenges. Amongst others, these challenges refer to the use of quality adjusted life years (QALYs) in newborns, and which costs and outcomes need to be considered in a full evaluation of newborn screening programmes. Because of the increasing scale and scope of such programmes, a better understanding of the methods of high-quality economic evaluations may be crucial for both producers/authors and consumers/reviewers of newborn screening-related economic evaluations. The aim of this study was therefore to develop specific guidelines designed to assess and improve the methodological quality of economic evaluations in newborn screening. Methods To develop the guidelines, existing guidelines for assessing the quality of economic evaluations were identified through a literature search, and were reviewed and consolidated using a deductive iterative approach. In a subsequent test phase, these guidelines were applied to various economic evaluations which acted as case studies. Results The guidelines for assessing and improving the methodological quality of economic evaluations in newborn screening are organized into 11 categories: “bibliographic details”, “study question and design”, “modelling”, “health outcomes”, “costs”, “discounting”, “presentation of results”, “sensitivity analyses”, “discussion”, “conclusions”, and “commentary”. Conclusions The application of the guidelines highlights important issues regarding newborn screening-related economic evaluations, and underscores the need for such issues to be afforded greater consideration in future economic evaluations. The variety in methodological quality detected by this study reveals the need for specific guidelines on the appropriate methods for conducting sound economic evaluations in newborn screening. PMID:22947299

Methodological Quality Assessment of Meta-analyses in Endodontics.

PubMed

Kattan, Sereen; Lee, Su-Min; Kohli, Meetu R; Setzer, Frank C; Karabucak, Bekir

2018-01-01

The objectives of this review were to assess the methodological quality of published meta-analyses related to endodontics using the assessment of multiple systematic reviews (AMSTAR) tool and to provide a follow-up to previously published reviews. Three electronic databases were searched for eligible studies according to the inclusion and exclusion criteria: Embase via Ovid, The Cochrane Library, and Scopus. The electronic search was amended by a hand search of 6 dental journals (International Endodontic Journal; Journal of Endodontics; Australian Endodontic Journal; Oral Surgery, Oral Medicine, Oral Pathology, Oral Radiology; Endodontics and Dental Traumatology; and Journal of Dental Research). The searches were conducted to include articles published after July 2009, and the deadline for inclusion of the meta-analyses was November 30, 2016. The AMSTAR assessment tool was used to evaluate the methodological quality of all included studies. A total of 36 reports of meta-analyses were included. The overall quality of the meta-analyses reports was found to be medium, with an estimated mean overall AMSTAR score of 7.25 (95% confidence interval, 6.59-7.90). The most poorly assessed areas were providing an a priori design, the assessment of the status of publication, and publication bias. In recent publications in the field of endodontics, the overall quality of the reported meta-analyses is medium according to AMSTAR. Copyright © 2017 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation.

PubMed

Lewis, Cara C; Stanick, Cameo F; Martinez, Ruben G; Weiner, Bryan J; Kim, Mimi; Barwick, Melanie; Comtois, Katherine A

2015-01-08

Identification of psychometrically strong instruments for the field of implementation science is a high priority underscored in a recent National Institutes of Health working meeting (October 2013). Existing instrument reviews are limited in scope, methods, and findings. The Society for Implementation Research Collaboration Instrument Review Project's objectives address these limitations by identifying and applying a unique methodology to conduct a systematic and comprehensive review of quantitative instruments assessing constructs delineated in two of the field's most widely used frameworks, adopt a systematic search process (using standard search strings), and engage an international team of experts to assess the full range of psychometric criteria (reliability, construct and criterion validity). Although this work focuses on implementation of psychosocial interventions in mental health and health-care settings, the methodology and results will likely be useful across a broad spectrum of settings. This effort has culminated in a centralized online open-access repository of instruments depicting graphical head-to-head comparisons of their psychometric properties. This article describes the methodology and preliminary outcomes. The seven stages of the review, synthesis, and evaluation methodology include (1) setting the scope for the review, (2) identifying frameworks to organize and complete the review, (3) generating a search protocol for the literature review of constructs, (4) literature review of specific instruments, (5) development of an evidence-based assessment rating criteria, (6) data extraction and rating instrument quality by a task force of implementation experts to inform knowledge synthesis, and (7) the creation of a website repository. To date, this multi-faceted and collaborative search and synthesis methodology has identified over 420 instruments related to 34 constructs (total 48 including subconstructs) that are relevant to implementation science. Despite numerous constructs having greater than 20 available instruments, which implies saturation, preliminary results suggest that few instruments stem from gold standard development procedures. We anticipate identifying few high-quality, psychometrically sound instruments once our evidence-based assessment rating criteria have been applied. The results of this methodology may enhance the rigor of implementation science evaluations by systematically facilitating access to psychometrically validated instruments and identifying where further instrument development is needed.

Tracking of childhood overweight into adulthood: a systematic review of the literature.

PubMed

Singh, A S; Mulder, C; Twisk, J W R; van Mechelen, W; Chinapaw, M J M

2008-09-01

Overweight and obesity in youth are important public health concerns and are of particular interest because of possible long-term associations with adult weight status and morbidity. The aim of this study was to systematically review the literature and update evidence concerning persistence of childhood overweight. A computerized bibliographical search--restricted to studies with a prospective or retrospective longitudinal design--was conducted. Two authors independently extracted data and assessed the methodological quality of the included studies in four dimensions (i) study population and participation rate; (ii) study attrition; (iii) data collection and (iv) data analysis. Conclusions were based on a rating system of three levels of evidence. A total of 25 publications were selected for inclusion in this review. According to a methodological quality assessment, 13 studies were considered to be of high quality. The majority of these high-quality studies were published after 2001, indicating that recently published data, in particular, provide us with reliable information. All included studies consistently report an increased risk of overweight and obese youth becoming overweight adults, suggesting that the likelihood of persistence of overweight into adulthood is moderate for overweight and obese youth. However, predictive values varied considerably. Limiting aspects with respect to generalizability and methodological issues are discussed.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond's Checklist: A Narrative Review.

PubMed

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-09-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond's checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles' structure was analyzed by Drummond's standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond's criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond’s Checklist: A Narrative Review

PubMed Central

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-01-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond’s checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles’ structure was analyzed by Drummond’s standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond’s criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies. PMID:29234174

Measurement properties of patient reported outcome measures for spondyloarthritis: A systematic review.

PubMed

Png, Kelly; Kwan, Yu Heng; Leung, Ying Ying; Phang, Jie Kie; Lau, Jia Qi; Lim, Ka Keat; Chew, Eng Hui; Low, Lian Leng; Tan, Chuen Seng; Thumboo, Julian; Fong, Warren; Østbye, Truls

2018-03-21

This systematic review aimed to identify studies investigating measurement properties of patient reported outcome measures (PROMs) for spondyloarthritis (SpA), and to evaluate their methodological quality and level of evidence relating to the measurement properties of PROMs. This systematic review was guided by the preferred reporting items for systematic review and meta-analysis (PRISMA). Articles published before 30 June 2017 were retrieved from PubMed ® , Embase ® , and PsychINFO ® (Ovid). Methodological quality and level of evidence were evaluated according to recommendations from the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). We identified 60 unique PROMs from 125 studies in 39 countries. Twenty-one PROMs were validated for two or more SpA subtypes. The literature examined hypothesis testing (82.4%) most frequently followed by reliability (60.0%). A percentage of 77.7% and 42.7% of studies that assessed PROMs for hypothesis testing and reliability, respectively had "fair" or better methodological quality. Among the PROMs identified, 41.7% were studied in ankylosing spondylitis (AS) only and 23.3% were studied in psoriatic arthritis (PsA) only. The more extensively assessed PROMs included the ankylosing spondylitis quality of life (ASQoL) and bath ankylosing spondylitis functional index (BASFI) for ankylosing spondylitis, and the psoriatic arthritis quality of life questionnaire (VITACORA-19) for psoriatic arthritis. This study identified 60 unique PROMs through a systematic review and synthesized evidence of the measurement properties of the PROMs. There is a lack of validation of PROMs for use across SpA subtypes. Future studies may consider validating PROMs for use across different SpA subtypes. Copyright © 2018 Elsevier Inc. All rights reserved.

Effects of Regular Classes in Outdoor Education Settings: A Systematic Review on Students’ Learning, Social and Health Dimensions

PubMed Central

Becker, Christoph; Lauterbach, Gabriele; Spengler, Sarah; Dettweiler, Ulrich; Mess, Filip

2017-01-01

Background: Participants in Outdoor Education Programmes (OEPs) presumably benefit from these programmes in terms of their social and personal development, academic achievement and physical activity (PA). The aim of this systematic review was to identify studies about regular compulsory school- and curriculum-based OEPs, to categorise and evaluate reported outcomes, to assess the methodological quality, and to discuss possible benefits for students. Methods: We searched online databases to identify English- and German-language peer-reviewed journal articles that reported any outcomes on a student level. Two independent reviewers screened studies identified for eligibility and assessed the methodological quality. Results: Thirteen studies were included for analysis. Most studies used a case-study design, the average number of participants was moderate (mean valued (M) = 62.17; standard deviation (SD) = 64.12), and the methodological quality was moderate on average for qualitative studies (M = 0.52; SD = 0.11), and low on average for quantitative studies (M = 0.18; SD = 0.42). Eight studies described outcomes in terms of social dimensions, seven studies in learning dimensions and four studies were subsumed under additional outcomes, i.e., PA and health. Eleven studies reported positive, one study positive as well as negative, and one study reported negative effects. PA and mental health as outcomes were underrepresented. Conclusion: Tendencies were detected that regular compulsory school- and curriculum-based OEPs can promote students in respect of social, academic, physical and psychological dimensions. Very little is known concerning students’ PA or mental health. We recommend conducting more quasi-experimental design and longitudinal studies with a greater number of participants, and a high methodological quality to further investigate these tendencies. PMID:28475167

Association between body composition and disease activity in rheumatoid arthritis. A systematic review.

PubMed

Alvarez-Nemegyei, José; Buenfil-Rello, Fátima Annai; Pacheco-Pantoja, Elda Leonor

2016-01-01

Reports regarding the association between body composition and inflammatory activity in rheumatoid arthritis (RA) have consistently yielded contradictory results. To perform a systematic review on the association between overweight/obesity and inflammatory activity in RA. FAST approach: Article search (Medline, EBSCO, Cochrane Library), followed by abstract retrieval, full text review and blinded assessment of methodological quality for final inclusion. Because of marked heterogeneity in statistical approach and RA activity assessment method, a meta-analysis could not be done. Results are presented as qualitative synthesis. One hundred and nineteen reports were found, 16 of them qualified for full text review. Eleven studies (8,147 patients; n range: 37-5,161) approved the methodological quality filter and were finally included. Interobserver agreement for methodological quality score (ICC: 0.93; 95% CI: 0.82-0.98; P<.001) and inclusion/rejection decision (k 1.00, P>.001) was excellent. In all reports body composition was assessed by BMI; however a marked heterogeneity was found in the method used for RA activity assessment. A significant association between BMI and RA activity was found in 6 reports having larger mean sample size: 1,274 (range: 140-5,161). On the other hand, this association was not found in 5 studies having lower mean sample size: 100 (range: 7-150). The modulation of RA clinical status by body fat mass is suggested because a significant association was found between BMI and inflammatory activity in those reports with a trend toward higher statistical power. The relationship between body composition and clinical activity in RA requires be approached with further studies with higher methodological quality. Copyright © 2015 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Effects of Regular Classes in Outdoor Education Settings: A Systematic Review on Students' Learning, Social and Health Dimensions.

PubMed

Becker, Christoph; Lauterbach, Gabriele; Spengler, Sarah; Dettweiler, Ulrich; Mess, Filip

2017-05-05

Participants in Outdoor Education Programmes (OEPs) presumably benefit from these programmes in terms of their social and personal development, academic achievement and physical activity (PA). The aim of this systematic review was to identify studies about regular compulsory school- and curriculum-based OEPs, to categorise and evaluate reported outcomes, to assess the methodological quality, and to discuss possible benefits for students. We searched online databases to identify English- and German-language peer-reviewed journal articles that reported any outcomes on a student level. Two independent reviewers screened studies identified for eligibility and assessed the methodological quality. Thirteen studies were included for analysis. Most studies used a case-study design, the average number of participants was moderate (mean valued (M) = 62.17; standard deviation (SD) = 64.12), and the methodological quality was moderate on average for qualitative studies (M = 0.52; SD = 0.11), and low on average for quantitative studies (M = 0.18; SD = 0.42). Eight studies described outcomes in terms of social dimensions, seven studies in learning dimensions and four studies were subsumed under additional outcomes, i.e., PA and health. Eleven studies reported positive, one study positive as well as negative, and one study reported negative effects. PA and mental health as outcomes were underrepresented. Tendencies were detected that regular compulsory school- and curriculum-based OEPs can promote students in respect of social, academic, physical and psychological dimensions. Very little is known concerning students' PA or mental health. We recommend conducting more quasi-experimental design and longitudinal studies with a greater number of participants, and a high methodological quality to further investigate these tendencies.

Terrorism, Radicalisation, Extremism, Authoritarianism and Fundamentalism: A Systematic Review of the Quality and Psychometric Properties of Assessments.

PubMed

Scarcella, Akimi; Page, Ruairi; Furtado, Vivek

2016-01-01

Currently, terrorism and suicide bombing are global psychosocial processes that attracts a growing number of psychological and psychiatric contributions to enhance practical counter-terrorism measures. The present study is a systematic review that explores the methodological quality reporting and the psychometric soundness of the instruments developed to identify risk factors of terrorism, extremism, radicalisation, authoritarianism and fundamentalism. A systematic search strategy was established to identify instruments and studies developed to screen individuals at risk of committing extremist or terrorist offences using 20 different databases across the fields of law, medicine, psychology, sociology and politics. Information extracted was consolidated into two different tables and a 26-item checklist, reporting respectively background information, the psychometric properties of each tool, and the methodological quality markers of these tools. 37 articles met our criteria, which included a total of 4 instruments to be used operationally by professionals, 17 tools developed as research measures, and 9 inventories that have not been generated from a study. Just over half of the methodological quality markers required for a transparent methodological description of the instruments were reported. The amount of reported psychological properties was even fewer, with only a third of them available across the different studies. The category presenting the least satisfactory results was that containing the 4 instruments to be used operationally by professionals, which can be explained by the fact that half of them refrained from publishing the major part of their findings and relevant guidelines. A great number of flaws have been identified through this systematic review. The authors encourage future researchers to be more thorough, comprehensive and transparent in their methodology. They also recommend the creation of a multi-disciplinary joint working group in order to best tackle this growing contemporary problem.

Child maltreatment prevention: a systematic review of reviews

PubMed Central

Butchart, Alexander

2009-01-01

Abstract Objective To synthesize recent evidence from systematic and comprehensive reviews on the effectiveness of universal and selective child maltreatment prevention interventions, evaluate the methodological quality of the reviews and outcome evaluation studies they are based on, and map the geographical distribution of the evidence. Methods A systematic review of reviews was conducted. The quality of the systematic reviews was evaluated with a tool for the assessment of multiple systematic reviews (AMSTAR), and the quality of the outcome evaluations was assessed using indicators of internal validity and of the construct validity of outcome measures. Findings The review focused on seven main types of interventions: home visiting, parent education, child sex abuse prevention, abusive head trauma prevention, multi-component interventions, media-based interventions, and support and mutual aid groups. Four of the seven – home-visiting, parent education, abusive head trauma prevention and multi-component interventions – show promise in preventing actual child maltreatment. Three of them – home visiting, parent education and child sexual abuse prevention – appear effective in reducing risk factors for child maltreatment, although these conclusions are tentative due to the methodological shortcomings of the reviews and outcome evaluation studies they draw on. An analysis of the geographical distribution of the evidence shows that outcome evaluations of child maltreatment prevention interventions are exceedingly rare in low- and middle-income countries and make up only 0.6% of the total evidence base. Conclusion Evidence for the effectiveness of four of the seven main types of interventions for preventing child maltreatment is promising, although it is weakened by methodological problems and paucity of outcome evaluations from low- and middle-income countries. PMID:19551253

Mentored peer review of standardized manuscripts as a teaching tool for residents: a pilot randomized controlled multi-center study.

PubMed

Wong, Victoria S S; Strowd, Roy E; Aragón-García, Rebeca; Moon, Yeseon Park; Ford, Blair; Haut, Sheryl R; Kass, Joseph S; London, Zachary N; Mays, MaryAnn; Milligan, Tracey A; Price, Raymond S; Reynolds, Patrick S; Selwa, Linda M; Spencer, David C; Elkind, Mitchell S V

2017-01-01

There is increasing need for peer reviewers as the scientific literature grows. Formal education in biostatistics and research methodology during residency training is lacking. In this pilot study, we addressed these issues by evaluating a novel method of teaching residents about biostatistics and research methodology using peer review of standardized manuscripts. We hypothesized that mentored peer review would improve resident knowledge and perception of these concepts more than non-mentored peer review, while improving review quality. A partially blinded, randomized, controlled multi-center study was performed. Seventy-eight neurology residents from nine US neurology programs were randomized to receive mentoring from a local faculty member or not. Within a year, residents reviewed a baseline manuscript and four subsequent manuscripts, all with introduced errors designed to teach fundamental review concepts. In the mentored group, mentors discussed completed reviews with residents. Primary outcome measure was change in knowledge score between pre- and post-tests, measuring epidemiology and biostatistics knowledge. Secondary outcome measures included level of confidence in the use and interpretation of statistical concepts before and after intervention, and RQI score for baseline and final manuscripts. Sixty-four residents (82%) completed initial review with gradual decline in completion on subsequent reviews. Change in primary outcome, the difference between pre- and post-test knowledge scores, did not differ between mentored (-8.5%) and non-mentored (-13.9%) residents ( p  = 0.48). Significant differences in secondary outcomes (using 5-point Likert scale, 5 = strongly agree) included mentored residents reporting enhanced understanding of research methodology (3.69 vs 2.61; p  = 0.001), understanding of manuscripts (3.73 vs 2.87; p  = 0.006), and application of study results to clinical practice (3.65 vs 2.78; p  = 0.005) compared to non-mentored residents. There was no difference between groups in level of interest in peer review (3.00 vs 3.09; p  = 0.72) or the quality of manuscript review assessed by the Review Quality Instrument (RQI) (3.25 vs 3.06; p  = 0.50). We used mentored peer review of standardized manuscripts to teach biostatistics and research methodology and introduce the peer review process to residents. Though knowledge level did not change, mentored residents had enhanced perception in their abilities to understand research methodology and manuscripts and apply study results to clinical practice.

Principals' Influence on Instructional Quality: Insights from US Schools

ERIC Educational Resources Information Center

Printy, Susan

2010-01-01

This article seeks to explain the ways in which leadership makes a difference to the quality of instruction in US schools by reviewing research published since 2000. The review of research is presented in three major sections, organised according to the methodology used in each study. The first section looks into quantitative studies that probe…

Systematic Review of Knowledge Translation Strategies to Promote Research Uptake in Child Health Settings.

PubMed

Albrecht, Lauren; Archibald, Mandy; Snelgrove-Clarke, Erna; Scott, Shannon D

2016-01-01

Strategies to assist evidence-based decision-making for healthcare professionals are crucial to ensure high quality patient care and outcomes. The goal of this systematic review was to identify and synthesize the evidence on knowledge translation interventions aimed at putting explicit research evidence into child health practice. A comprehensive search of thirteen electronic databases was conducted, restricted by date (1985-2011) and language (English). Articles were included if: 1) studies were randomized controlled trials (RCT), controlled clinical trials (CCT), or controlled before-and-after (CBA) studies; 2) target population was child health professionals; 3) interventions implemented research in child health practice; and 4) outcomes were measured at the professional/process, patient, or economic level. Two reviewers independently extracted data and assessed methodological quality. Study data were aggregated and analyzed using evidence tables. Twenty-one studies (13 RCT, 2 CCT, 6 CBA) were included. The studies employed single (n=9) and multiple interventions (n=12). The methodological quality of the included studies was largely moderate (n=8) or weak (n=11). Of the studies with moderate to strong methodological quality ratings, three demonstrated consistent, positive effect(s) on the primary outcome(s); effective knowledge translation interventions were two single, non-educational interventions and one multiple, educational intervention. This multidisciplinary systematic review in child health setting identified effective knowledge translation strategies assessed by the most rigorous research designs. Given the overall poor quality of the research literature, specific recommendations were made to improve knowledge translation efforts in child health. Copyright © 2016 Elsevier Inc. All rights reserved.

Effectiveness of mirror therapy, motor imagery, and virtual feedback on phantom limb pain following amputation: A systematic review.

PubMed

Herrador Colmenero, Laura; Perez Marmol, Jose Manuel; Martí-García, Celia; Querol Zaldivar, María de Los Ángeles; Tapia Haro, Rosa María; Castro Sánchez, Adelaida María; Aguilar-Ferrándiz, María Encarnación

2018-06-01

Phantom limb pain is reported in 50%-85% of people with amputation. Clinical interventions in treating central pain, such as mirror therapy, motor imagery, or virtual visual feedback, could redound in benefits to amputee patients with phantom limb pain. To provide an overview of the effectiveness of different techniques for treating phantom limb pain in amputee patients. Systematic review. A computerized literature search up to April 2017 was performed using the following databases: PubMed, Scopus, CINAHL, MEDLINE, ProQuest, PEDro, EBSCOhost, and Cochrane Plus. Methodological quality and internal validity score of each study were assessed using PEDro scale. For data synthesis, qualitative methods from the Cochrane Back Review Group were applied. In all, 12 studies met our inclusion criteria, where 9 were rated as low methodological quality and 3 rated moderate quality. All studies showed a significant reduction in pain, but there was heterogeneity among subjects and methodologies and any high-quality clinical trial (PEDro score ≤8; internal validity score ≤5) was not found. Mirror therapy, motor imaginary, and virtual visual feedback reduce phantom limb pain; however, there is limited scientific evidence supporting their effectiveness. Future studies should include designs with more solid research methods, exploring short- and long-term benefits of these therapies. Clinical relevance This systematic review investigates the effectiveness of mirror therapy, motor imagery, and virtual visual feedback on phantom limb pain, summarizing the currently published trials and evaluating the research quality. Although these interventions have positive benefits in phantom limb pain, there is still a lack of evidence for supporting their effectiveness.

Aromatherapy for health care: an overview of systematic reviews.

PubMed

Lee, Myeong Soo; Choi, Jiae; Posadzki, Paul; Ernst, Edzard

2012-03-01

Aromatherapy is the therapeutic use of essential oil from herbs, flowers, and other plants. The aim of this overview was to provide an overview of systematic reviews evaluating the effectiveness of aromatherapy. We searched 12 electronic databases and our departmental files without restrictions of time or language. The methodological quality of all systematic reviews was evaluated independently by two authors. Of 201 potentially relevant publications, 10 met our inclusion criteria. Most of the systematic reviews were of poor methodological quality. The clinical subject areas were hypertension, depression, anxiety, pain relief, and dementia. For none of the conditions was the evidence convincing. Several SRs of aromatherapy have recently been published. Due to a number of caveats, the evidence is not sufficiently convincing that aromatherapy is an effective therapy for any condition. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Non-pharmacological sleep interventions for youth with chronic health conditions: a critical review of the methodological quality of the evidence.

PubMed

Brown, Cary A; Kuo, Melissa; Phillips, Leah; Berry, Robyn; Tan, Maria

2013-07-01

Restorative sleep is clearly linked with well-being in youth with chronic health conditions. This review addresses the methodological quality of non-pharmacological sleep intervention (NPSI) research for youth with chronic health conditions. The Guidelines for Critical Review (GCR) and the Effective Public Health Practice Project Quality Assessment Tool (EPHPP) were used in the review. The search yielded 31 behavioural and 10 non-behavioural NPSI for review. Most studies had less than 10 participants. Autism spectrum disorders, attention deficit/hyperactivity disorders, down syndrome, intellectual disabilities, and visual impairments were the conditions that most studies focused upon. The global EPHPP scores indicated most reviewed studies were of weak quality. Only 7 studies were rated as moderate, none were strong. Studies rated as weak quality frequently had recruitment issues; non-blinded participants/parents and/or researchers; and used outcome measures without sound psychometric properties. Little conclusive evidence exists for NPSIs in this population. However, NPSIs are widely used and these preliminary studies demonstrate promising outcomes. There have not been any published reports of negative outcomes that would preclude application of the different NPSIs on a case-by-case basis guided by clinical judgement. These findings support the need for more rigorous, applied research. • Methodological Quality of Sleep Research • Disordered sleep (DS) in youth with chronic health conditions is pervasive and is important to rehabilitation therapists because DS contributes to significant functional problems across psychological, physical and emotional domains. • Rehabilitation therapists and other healthcare providers receive little education about disordered sleep and are largely unaware of the range of assessment and non-pharmacological intervention strategies that exist. An evidence-based website of pediatric sleep resources can be found at http://www.SleepRight.ualberta.ca • The current research on non-pharmacological sleep interventions (NPSI) for youth with health conditions is methodologically weak. However, consistently positive outcomes reported in the literature demonstrate that pragmatic interventions such as bright light therapy, activity, massage and behavioral interventions are promising areas. No studies found reasons that a trail of a NPSI matched to the youth's context and condition should not attempted. More rigorous clinically relevant study of pragmatic non-pharmacological interventions appropriate for therapists' and parents' needs is required.

[Systematic Review of the Methodology Quality in Lung Cancer Screening Guidelines].

PubMed

Li, Jiang; Su, Kai; Li, Fang; Tang, Wei; Huang, Yao; Wang, Le; Huang, Huiyao; Shi, Jufang; Dai, Min

2016-10-20

Lung cancer is the most common malignancy and screening can decrease the mortality. High quality screening guideline is necessary and important for effective work. Our study is to review and evaluate the basic characteristics and methodology quality of the current global lung cancer screening guidelines so as to provide useful information for domestic study in the future. Electronic searches were done in English and Chinese databases including PubMed, the Cochrane Library, Web of Science, Embase, CNKI, CBM, Wanfang, and some cancer official websites. Articles were screened according to the predefined inclusion and exclusion criteria by two researchers. The quality of guidelines was assessed by AGREE II. At last, a total of 11 guidelines with methodology were included. The guidelines were issued mainly by USA (81%). Canada and China developed one, respectively. As for quality, the average score in the "Scale and objective" of all guidelines was 80, the average score in the "Participants" was 52, the average score in the "rigorism" was 50, the average score in the "clarity" was 76, the average score in the "application" was 43 and the average score in the "independence" was 59. The highest average score was found in 2013 and 2015. Canada guideline had higher quality in six domains. 7 guidelines were evaluated as A level. The number of clinical guidelines showed an increasing trend. Most guidelines were issued by developed countries with heavy burden. Multi-country contribution to one guideline was another trend. Evidence-based methodology was accepted globally in the guideline development.

A systematic review of the quality of homeopathic pathogenetic trials published from 1945 to 1995.

PubMed

Dantas, F; Fisher, P; Walach, H; Wieland, F; Rastogi, D P; Teixeira, H; Koster, D; Jansen, J P; Eizayaga, J; Alvarez, M E P; Marim, M; Belon, P; Weckx, L L M

2007-01-01

The quality of information gathered from homeopathic pathogenetic trials (HPTs), also known as 'provings', is fundamental to homeopathy. We systematically reviewed HPTs published in six languages (English, German, Spanish, French, Portuguese and Dutch) from 1945 to 1995, to assess their quality in terms of the validity of the information they provide. The literature was comprehensively searched, only published reports of HPTs were included. Information was extracted by two reviewers per trial using a form with 87 items. Information on: medicines, volunteers, ethical aspects, blinding, randomization, use of placebo, adverse effects, assessments, presentation of data and number of claimed findings were recorded. Methodological quality was assessed by an index including indicators of internal and external validity, personal judgement and comments of reviewers for each study. 156 HPTs on 143 medicines, involving 2815 volunteers, produced 20,538 pathogenetic effects (median 6.5 per volunteer). There was wide variation in methods and results. Sample size (median 15, range 1-103) and trial duration (mean 34 days) were very variable. Most studies had design flaws, particularly absence of proper randomization, blinding, placebo control and criteria for analysis of outcomes. Mean methodological score was 5.6 (range 4-16). More symptoms were reported from HPTs of poor quality than from better ones. In 56% of trials volunteers took placebo. Pathogenetic effects were claimed in 98% of publications. On average about 84% of volunteers receiving active treatment developed symptoms. The quality of reports was in general poor, and much important information was not available. The HPTs were generally of low methodological quality. There is a high incidence of pathogenetic effects in publications and volunteers but this could be attributable to design flaws. Homeopathic medicines, tested in HPTs, appear safe. The central question of whether homeopathic medicines in high dilutions can provoke effects in healthy volunteers has not yet been definitively answered, because of methodological weaknesses of the reports. Improvement of the method and reporting of results of HPTs are required. References to all included RCTs are available on-line at.

Quality assurance and quality control in mammography: a review of available guidance worldwide.

PubMed

Reis, Cláudia; Pascoal, Ana; Sakellaris, Taxiarchis; Koutalonis, Manthos

2013-10-01

Review available guidance for quality assurance (QA) in mammography and discuss its contribution to harmonise practices worldwide. Literature search was performed on different sources to identify guidance documents for QA in mammography available worldwide in international bodies, healthcare providers, professional/scientific associations. The guidance documents identified were reviewed and a selection was compared for type of guidance (clinical/technical), technology and proposed QA methodologies focusing on dose and image quality (IQ) performance assessment. Fourteen protocols (targeted at conventional and digital mammography) were reviewed. All included recommendations for testing acquisition, processing and display systems associated with mammographic equipment. All guidance reviewed highlighted the importance of dose assessment and testing the Automatic Exposure Control (AEC) system. Recommended tests for assessment of IQ showed variations in the proposed methodologies. Recommended testing focused on assessment of low-contrast detection, spatial resolution and noise. QC of image display is recommended following the American Association of Physicists in Medicine guidelines. The existing QA guidance for mammography is derived from key documents (American College of Radiology and European Union guidelines) and proposes similar tests despite the variations in detail and methodologies. Studies reported on QA data should provide detail on experimental technique to allow robust data comparison. Countries aiming to implement a mammography/QA program may select/prioritise the tests depending on available technology and resources. •An effective QA program should be practical to implement in a clinical setting. •QA should address the various stages of the imaging chain: acquisition, processing and display. •AEC system QC testing is simple to implement and provides information on equipment performance.

Integrating Kano’s Model into Quality Function Deployment for Product Design: A Comprehensive Review

NASA Astrophysics Data System (ADS)

Ginting, Rosnani; Hidayati, Juliza; Siregar, Ikhsan

2018-03-01

Many methods and techniques are adopted by some companies to improve the competitiveness through the fulfillment of customer satisfaction by enhancement and improvement the product design quality. Over the past few years, several researcher have studied extensively combining Quality Function Deployment and Kano’s model as design techniques by focusing on translating consumer desires into a product design. This paper presents a review and analysis of several literatures that associated to the integration methodology of Kano into the QFD process. Various of international journal articles were selected, collected and analyzed through a number of relevant scientific publications. In-depth analysis was performed, and focused in this paper on the results, advantages and drawbacks of its methodology. In addition, this paper also provides the analysis that acquired in this study related to the development of the methodology. It is hopedd this paper can be a reference for other researchers and manufacturing companies to implement the integration method of QFD- Kano for product design.

10 CFR 26.167 - Quality assurance and quality control.

Code of Federal Regulations, 2012 CFR

2012-01-01

... be designed, implemented, and reviewed to monitor the conduct of each step of the testing process. (b... sample and the error is determined to be technical or methodological, the licensee or other entity shall...

10 CFR 26.167 - Quality assurance and quality control.

Code of Federal Regulations, 2011 CFR

2011-01-01

... be designed, implemented, and reviewed to monitor the conduct of each step of the testing process. (b... sample and the error is determined to be technical or methodological, the licensee or other entity shall...

10 CFR 26.167 - Quality assurance and quality control.

Code of Federal Regulations, 2014 CFR

2014-01-01

... be designed, implemented, and reviewed to monitor the conduct of each step of the testing process. (b... sample and the error is determined to be technical or methodological, the licensee or other entity shall...

10 CFR 26.167 - Quality assurance and quality control.

Code of Federal Regulations, 2010 CFR

2010-01-01

... be designed, implemented, and reviewed to monitor the conduct of each step of the testing process. (b... sample and the error is determined to be technical or methodological, the licensee or other entity shall...

10 CFR 26.167 - Quality assurance and quality control.

Code of Federal Regulations, 2013 CFR

2013-01-01

... be designed, implemented, and reviewed to monitor the conduct of each step of the testing process. (b... sample and the error is determined to be technical or methodological, the licensee or other entity shall...

Methodological issues in genetic association studies of inherited thrombophilia: original report of recent practice.

PubMed

Simundic, Ana-Maria; Nikolac, Nora; Topic, Elizabeta

2009-01-01

The aims of this article are to evaluate the methodological quality of genetic association studies on the inherited thrombophilia published during 2003 to 2005, to identify the most common mistakes made by authors of those studies, and to examine if overall quality of the article correlates with the quality of the journal. Articles were evaluated by 2 independent reviewers using the checklist of 16 items. A total of 58 eligible studies were identified. Average total score was 7.59 +/- 1.96. Total article score did not correlate with the journal impact factor (r = 0.3971; 95% confidence interval [CI], 0.1547-0.5944, P = .002). Total score did not differ across years (P = .624). Finally, it is concluded that methodological quality of genetic association studies is not optimal, and it does not depend on the quality of the journal. Journals should adopt methodological criteria for reporting the genetic association studies, and editors should encourage authors to strictly adhere to those criteria.

[Education for patients with fibromyalgia. A systematic review of randomised clinical trials].

PubMed

Elizagaray-Garcia, Ignacio; Muriente-Gonzalez, Jorge; Gil-Martinez, Alfonso

2016-01-16

To analyse the effectiveness of education about pain, quality of life and functionality in patients with fibromyalgia. The search for articles was carried out in electronic databases. Eligibility criteria were: controlled randomised clinical trials (RCT), published in English and Spanish, that had been conducted on patients with fibromyalgia, in which the therapeutic procedure was based on patient education. Two independent reviewers analysed the methodological quality using the PEDro scale. Five RCT were selected, of which four offered good methodological quality. In three of the studies, patient education, in combination with another intervention based on therapeutic exercise, improved the outcomes in the variables assessing pain and quality of life as compared with the same procedures performed separately. Moreover, an RCT with a high quality methodology showed that patient education activated inhibitory neural pathways capable of lowering the level of pain. The quantitative analysis yields strong-moderate evidence that patient education, in combination with other therapeutic exercise procedures, offers positive results in the variables pain, quality of life and functionality. Patient education in itself has not proved to be effective for pain, quality of life or functionality in patients with fibromyalgia. There is strong evidence, however, of the effectiveness of combining patient education with exercise and active strategies for coping with pain, quality of life and functionality in the short, medium and long term in patients with fibromyalgia.

Quality and reporting of diagnostic accuracy studies in TB, HIV and malaria: evaluation using QUADAS and STARD standards.

PubMed

Fontela, Patricia Scolari; Pant Pai, Nitika; Schiller, Ian; Dendukuri, Nandini; Ramsay, Andrew; Pai, Madhukar

2009-11-13

Poor methodological quality and reporting are known concerns with diagnostic accuracy studies. In 2003, the QUADAS tool and the STARD standards were published for evaluating the quality and improving the reporting of diagnostic studies, respectively. However, it is unclear whether these tools have been applied to diagnostic studies of infectious diseases. We performed a systematic review on the methodological and reporting quality of diagnostic studies in TB, malaria and HIV. We identified diagnostic accuracy studies of commercial tests for TB, malaria and HIV through a systematic search of the literature using PubMed and EMBASE (2004-2006). Original studies that reported sensitivity and specificity data were included. Two reviewers independently extracted data on study characteristics and diagnostic accuracy, and used QUADAS and STARD to evaluate the quality of methods and reporting, respectively. Ninety (38%) of 238 articles met inclusion criteria. All studies had design deficiencies. Study quality indicators that were met in less than 25% of the studies included adequate description of withdrawals (6%) and reference test execution (10%), absence of index test review bias (19%) and reference test review bias (24%), and report of uninterpretable results (22%). In terms of quality of reporting, 9 STARD indicators were reported in less than 25% of the studies: methods for calculation and estimates of reproducibility (0%), adverse effects of the diagnostic tests (1%), estimates of diagnostic accuracy between subgroups (10%), distribution of severity of disease/other diagnoses (11%), number of eligible patients who did not participate in the study (14%), blinding of the test readers (16%), and description of the team executing the test and management of indeterminate/outlier results (both 17%). The use of STARD was not explicitly mentioned in any study. Only 22% of 46 journals that published the studies included in this review required authors to use STARD. Recently published diagnostic accuracy studies on commercial tests for TB, malaria and HIV have moderate to low quality and are poorly reported. The more frequent use of tools such as QUADAS and STARD may be necessary to improve the methodological and reporting quality of future diagnostic accuracy studies in infectious diseases.

Quality and Reporting of Diagnostic Accuracy Studies in TB, HIV and Malaria: Evaluation Using QUADAS and STARD Standards

PubMed Central

Fontela, Patricia Scolari; Pant Pai, Nitika; Schiller, Ian; Dendukuri, Nandini; Ramsay, Andrew; Pai, Madhukar

2009-01-01

Background Poor methodological quality and reporting are known concerns with diagnostic accuracy studies. In 2003, the QUADAS tool and the STARD standards were published for evaluating the quality and improving the reporting of diagnostic studies, respectively. However, it is unclear whether these tools have been applied to diagnostic studies of infectious diseases. We performed a systematic review on the methodological and reporting quality of diagnostic studies in TB, malaria and HIV. Methods We identified diagnostic accuracy studies of commercial tests for TB, malaria and HIV through a systematic search of the literature using PubMed and EMBASE (2004–2006). Original studies that reported sensitivity and specificity data were included. Two reviewers independently extracted data on study characteristics and diagnostic accuracy, and used QUADAS and STARD to evaluate the quality of methods and reporting, respectively. Findings Ninety (38%) of 238 articles met inclusion criteria. All studies had design deficiencies. Study quality indicators that were met in less than 25% of the studies included adequate description of withdrawals (6%) and reference test execution (10%), absence of index test review bias (19%) and reference test review bias (24%), and report of uninterpretable results (22%). In terms of quality of reporting, 9 STARD indicators were reported in less than 25% of the studies: methods for calculation and estimates of reproducibility (0%), adverse effects of the diagnostic tests (1%), estimates of diagnostic accuracy between subgroups (10%), distribution of severity of disease/other diagnoses (11%), number of eligible patients who did not participate in the study (14%), blinding of the test readers (16%), and description of the team executing the test and management of indeterminate/outlier results (both 17%). The use of STARD was not explicitly mentioned in any study. Only 22% of 46 journals that published the studies included in this review required authors to use STARD. Conclusion Recently published diagnostic accuracy studies on commercial tests for TB, malaria and HIV have moderate to low quality and are poorly reported. The more frequent use of tools such as QUADAS and STARD may be necessary to improve the methodological and reporting quality of future diagnostic accuracy studies in infectious diseases. PMID:19915664

Quality of life assessment in children: a review of conceptual and methodological issues in multidimensional health status measures.

PubMed Central

Pal, D K

1996-01-01

STUDY OBJECTIVE: To clarify concepts and methodological problems in existing multidimensional health status measures for children. DESIGN: Thematic review of instruments found by computerised and manual searches, 1979-95. SUBJECTS: Nine health status instruments. MAIN RESULTS: Many instruments did not satisfy criteria of being child centered or family focussed; few had sufficient psychometric properties for research or clinical use; underlying conceptual assumptions were rarely explicit. CONCLUSIONS: Quality of life measures should be viewed cautiously. Interdisciplinary discussion is required, as well as discussion with children and parents, to establish constructs that are truly useful. PMID:8882220

Contemporary health care economics: an overview.

PubMed

McLaughlin, Nancy; Ong, Michael K; Tabbush, Victor; Hagigi, Farhad; Martin, Neil A

2014-11-01

Economic evaluations provide a decision-making framework in which outcomes (benefits) and costs are assessed for various alternative options. Although the interest in complete and partial economic evaluations has increased over the past 2 decades, the quality of studies has been marginal due to methodological challenges or incomplete cost determination. This paper provides an overview of the main types of complete and partial economic evaluations, reviews key methodological elements to be considered for any economic evaluation, and reviews concepts of cost determination. The goal is to provide the clinician neurosurgeon with the knowledge and tools needed to appraise published economic evaluations and to direct high-quality health economic evaluations.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed

Lexchin, J; Holbrook, A

1994-07-01

To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). Analytic study. All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed Central

Lexchin, J; Holbrook, A

1994-01-01

OBJECTIVE: To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). DESIGN: Analytic study. DATA SOURCE: All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. MAIN OUTCOME MEASURES: Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. MAIN RESULTS: Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. CONCLUSIONS: Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion. PMID:8004560

Q methodology, risk training and quality management.

PubMed

McKeown, M; Hinks, M; Stowell-Smith, M; Mercer, D; Forster, J

1999-01-01

The results of a Q methodological study of professional understandings of the notion of risk in mental health services within the UK are discussed in relation to the relevance for staff training and quality assurance. The study attempted to access the diversity of understandings of risk issues amongst a multi-professional group of staff (n = 60) attending inter-agency risk training workshops in 1998. Q methodology is presented as both an appropriate means for such inquiry and as a novel experiential technique for training purposes. A tentative argument is advanced that the qualitative accounts generated by Q research could assist in systematic reviews of quality, complementing the singularly quantitative approaches typically represented in the audit process.

[Quality of clinical studies published in the RBGO over one decade (1999-2009): methodological and ethical aspects and statistical procedures].

PubMed

de Sá, Joceline Cássia Ferezini; Marini, Gabriela; Gelaleti, Rafael Bottaro; da Silva, João Batista; de Azevedo, George Gantas; Rudge, Marilza Vieira Cunha

2013-11-01

To evaluate the methodological and statistical design evolution of the publications in the Brazilian Journal of Gynecology and Obstetrics (RBGO) from resolution 196/96. A review of 133 articles published in 1999 (65) and 2009 (68) was performed by two independent reviewers with training in clinical epidemiology and methodology of scientific research. We included all original clinical articles, case and series reports and excluded editorials, letters to the editor, systematic reviews, experimental studies, opinion articles, besides abstracts of theses and dissertations. Characteristics related to the methodological quality of the studies were analyzed in each article using a checklist that evaluated two criteria: methodological aspects and statistical procedures. We used descriptive statistics and the χ2 test for comparison of the two years. There was a difference between 1999 and 2009 regarding the study and statistical design, with more accuracy in the procedures and the use of more robust tests between 1999 and 2009. In RBGO, we observed an evolution in the methods of published articles and a more in-depth use of the statistical analyses, with more sophisticated tests such as regression and multilevel analyses, which are essential techniques for the knowledge and planning of health interventions, leading to fewer interpretation errors.

Peer-based health interventions for people with serious mental illness: A systematic literature review.

PubMed

Cabassa, Leopoldo J; Camacho, David; Vélez-Grau, Carolina M; Stefancic, Ana

2017-01-01

Health interventions delivered by peer specialists or co-facilitated by peer specialists and health professionals can help improve the physical health of people with serious mental illness (SMI). Yet, the quality of the studies examining these health interventions and their impact on health outcomes remains unclear. To address this gap, we conducted a systematic literature review of peer-based health interventions for people with SMI. We rated the methodological quality of studies, summarized intervention strategies and health outcomes, and evaluated the inclusion of racial and ethnic minorities in these studies. We used the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines to conduct our systematic literature review. Electronic bibliographic databases and manual searches were used to locate articles that were published in English in peer-reviewed journals between 1990 and 2015, described peer-based health interventions for people with SMI, and evaluated the impact of the interventions on physical health outcomes. Two independent reviewers used a standardized instrument to rate studies' methodological quality, abstracted study characteristics, and evaluated the effects of the interventions on different health outcomes. Eighteen articles were reviewed. Findings indicated that the strength of the evidence generated from these studies is limited due to several methodological limitations. Mixed and limited intervention effects were reported for most health outcomes. The most promising interventions were self-management and peer-navigator interventions. Efforts to strengthen the evidence of peer-based interventions require a research agenda that focuses on establishing the efficacy and effectiveness of these interventions across different populations and settings. Copyright © 2016 Elsevier Ltd. All rights reserved.

How to conduct a high-quality original study on a diagnostic research topic.

PubMed

Yao, Xiaomei; Vella, Emily

2017-09-01

As health research methodologists and journal reviewers, we noticed that the methodological rigor of many publications on diagnostic or prognostic topics in the medical literature could be improved. We present a concise and clear series of reviews to help clinicians and health researchers to master the basic key components of how to conduct a high-quality original study or systematic review on a diagnostic or prognostic research topic from a methodological perspective. This is the first review of the series, which focuses on how to conduct a high-quality diagnostic study. We are introducing four aspects: clarifying the objectives; generating an appropriate research question; planning the study design; and reporting and analyzing data. This review highlights that diagnostic test accuracy outcomes are surrogates for patient outcomes, a diagnostic test has three roles, the "PIRO" components should be included in a diagnostic research question, a new study should be registered, multiple index tests can be compared in one study, and prevalence affects test accuracy outcomes. This review also emphasizes reporting any thresholds, calculating sample size, and performing a two-by-three table to calculate diagnostic outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

76 FR 50188 - Notice of Proposed Methodology for the Delaware River and Bay Integrated List Water Quality...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-12

... Integrated List Water Quality Assessment AGENCY: Delaware River Basin Commission. ACTION: Notice. SUMMARY... Integrated List Water Quality Assessment is available for review and comment. DATES: Comments must be... should have the phrase ``Water Quality Assessment 2012'' in the subject line and should include the name...

75 FR 74086 - Agency Information Collection Activities; Submission for OMB Review; Comment Request; Benefits...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-30

... Administration (ETA) sponsored information collection request (ICR) titled, ``Benefits Timeliness and Quality... information and analyzes data. BTQ data measure the timeliness and quality of states' administrative actions... of information, including the validity of the methodology and assumptions used; Enhance the quality...

Scoping review of pediatric tonsillectomy quality of life assessment instruments.

PubMed

Kao, Stephen Shih-Teng; Peters, Micah D J; Dharmawardana, Nuwan; Stew, Benjamin; Ooi, Eng Hooi

2017-10-01

Sleep-disordered breathing or recurrent tonsillitis have detrimental effects on the child's physical health and quality of life. Tonsillectomy is commonly performed to treat these common conditions and improve the child's quality of life. This scoping review aims to present a comprehensive and descriptive analysis of quality of life questionnaires as a resource for clinicians and researchers when deciding which tool to use when assessing the quality of life effects after tonsillectomy. A comprehensive search strategy was undertaken across MEDLINE (PubMed), CINAHL, Embase, and Cochrane CENTRAL. Quality of life questionnaires utilized in studies investigating pediatric patients undergoing tonsillectomy for chronic tonsillitis or sleep-disordered breathing were included. Methodological quality and data extraction were conducted as per Joanna Briggs Institute methodology. Ten questionnaires were identified, consisting of six generic and four disease-specific instruments. The Pediatric Quality of Life Inventory was the most commonly utilized generic questionnaire. The Obstructive Sleep Apnea-18 was the most commonly utilized disease-specific questionnaire. This review identified a range of generic and disease-specific quality of life questionnaires utilized in pediatric patients who have undergone tonsillectomy with or without adenoidectomy for sleep-disordered breathing or chronic tonsillitis. Important aspects of each questionnaire have been summarized to aid researchers and clinicians in choosing the appropriate questionnaire when evaluating the quality of life effects of tonsillectomy. NA Laryngoscope, 127:2399-2406, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Evaluation of Reference Services--A Review

ERIC Educational Resources Information Center

Kuruppu, Pali U.

2007-01-01

Understanding the inherent deficiencies in reference service as provided is critical to providing effective, high quality service. Quantitative and qualitative research methodologies, as well as a combination of both, are being used to evaluate these services. The identification of appropriate research methodology is critical to an effective…

Collection Evaluation in Research Libraries: The Search for Quality, Consistency, and System in Collection Development.

ERIC Educational Resources Information Center

Mosher, Paul H.

1979-01-01

Reviews the history, literature, and methodology of collection evaluation or assessment in American research libraries; discusses current problems, tools, and methodology of evaluation; and describes an ongoing collection evaluation program at the Stanford University Libraries. (Author/MBR)

Social Skills Interventions for Students with Challenging Behavior: Evaluating the Quality of the Evidence Base

ERIC Educational Resources Information Center

Hutchins, Nancy S.; Burke, Mack D.; Hatton, Heather; Bowman-Perrott, Lisa

2017-01-01

This study provides results on a methodological quality review of the single-case research literature from 1998 to 2014 on the use of social skills interventions for students with challenging behavior. A systematic review of the social skills literature was conducted with the intent of updating the Mathur et al. study of social skills…

Measurement of Perceived Service Quality in Higher Education Institutions: A Review of HEdPERF Scale Use

ERIC Educational Resources Information Center

Silva, Danilo Soares; de Morales, Gustavo Hermínio Salati Marcondes; Makiya, Ieda Kanashiro; Cesar, Francisco Ignácio Giocondo

2017-01-01

Purpose: This study aims to find evidence of the HEdPERF scale use for measuring the perceived service quality from the perspective of students in higher education institutions (HEIs) worldwide. Design/methodology/approach: A systematic review of the literature was conducted to find evidence of the scale use in articles published between January…

Methodological Quality of Systematic Reviews in Subfertility: A Comparison of Two Different Approaches

PubMed Central

Popovich, Ivor; Windsor, Bethany; Jordan, Vanessa; Showell, Marian; Shea, Bev; Farquhar, Cynthia M.

2012-01-01

Background Systematic reviews are used widely to guide health care decisions. Several tools have been created to assess systematic review quality. The measurement tool for assessing the methodological quality of systematic reviews known as the AMSTAR tool applies a yes/no score to eleven relevant domains of review methodology. This tool has been reworked so that each domain is scored based on a four point scale, producing R-AMSTAR. Methods and Findings We aimed to compare the AMSTAR and R-AMSTAR tools in assessing systematic reviews in the field of assisted reproduction for subfertility. All published systematic reviews on assisted reproductive technology, with the latest search for studies taking place from 2007–2011, were considered. Reviews that contained no included studies or considered diagnostic outcomes were excluded. Thirty each of Cochrane and non-Cochrane reviews were randomly selected from a search of relevant databases. Both tools were then applied to all sixty reviews. The results were converted to percentage scores and all reviews graded and ranked based on this. AMSTAR produced a much wider variation in percentage scores and achieved higher inter-rater reliability than R-AMSTAR according to kappa statistics. The average rating for Cochrane reviews was consistent between the two tools (88.3% for R-AMSTAR versus 83.6% for AMSTAR) but inconsistent for non-Cochrane reviews (63.9% R-AMSTAR vs. 38.5% AMSTAR). In comparing the rankings generated between the two tools Cochrane reviews changed an average of 4.2 places, compared to 2.9 for non-Cochrane. Conclusion R-AMSTAR provided greater guidance in the assessment of domains and produced quantitative results. However, there were many problems with the construction of its criteria and AMSTAR was much easier to apply consistently. We recommend that AMSTAR incorporates the findings of this study and produces additional guidance for its application in order to improve its reliability and usefulness. PMID:23300526

PRISMA and AMSTAR Show Systematic Reviews of Health Literacy and Cancer Screening are Good Quality.

PubMed

Sharma, Sakshi; Oremus, Mark

2018-04-11

To evaluate the reporting and methodological quality of systematic reviews (SRs) in health literacy and cancer screening; to investigate factors that may influence overall quality. A review of SRs published between 2009 and 2017. We calculated indices to represent the included SRs' adherence to PRISMA and AMSTAR. To assess possible determinants of SR quality, we regressed the index scores on year and region of publication, journal impact factor, authors' reported use of PRISMA, and presence of funding statements. We included 19 SRs and median index scores were 0.86 for PRISMA (interquartile range [IQR] = 0.11; range = 0.32 to 1.00) and 0.67 for AMSTAR (IQR = 0.30; range = 0.22 to 1.00). Methodological and reporting problems pertained to protocol registration or publication, number of raters used, gray literature searches, excluded article lists, and unintegrated discussions of risk of bias and efficacy. Only journal impact factor was statistically significantly associated (positively) with PRISMA and AMSTAR index scores. The quality of SRs in health literacy and cancer screening was generally good. Systematic reviewers should register or publish their protocols, include PRISMA and AMSTAR checklists when submitting SRs to journals, and self-evaluate their SRs before submission. Copyright © 2018. Published by Elsevier Inc.

What is covered by "cancer rehabilitation" in PubMed? A review of randomized controlled trials 1990-2011.

PubMed

Gudbergsson, Sævar Berg; Dahl, Alv A; Loge, Jon Håvard; Thorsen, Lene; Oldervoll, Line M; Grov, Ellen K

2015-02-01

This focused review examines randomized controlled studies included by the term "cancer rehabilitation" in PubMed. The research questions concern the type of interventions performed and their methodological quality. Using the Medical Subject Headings (MeSH) terms: neoplasm AND rehabilitation, all articles with randomized controlled studies that included adult cancer patients, written in English, were extracted from PubMed. Papers covering physical exercise, psychiatric/psychological treatment or social support only were excluded as they had been reviewed recently. Abstracts and papers were assessed by 3 pairs of reviewers, and descriptive information was extracted systematically. Methodological quality was rated on a 10-item index scale, and the cut-off for acceptable quality was set at ≥ 8. A total of 132 (19%) of the 683 identified papers met the eligibility criteria and were assessed in detail. The papers were grouped into 5 thematic categories: 44 physical; 15 art and expressive; 47 psycho-educative; 21 emotionally supportive; and 5 others. Good quality of design was observed in 32 studies, 18 of them uni-dimensional and 14 multi-dimensional. Published randomized controlled studies on cancer rehabilitation are heterogeneous in terms of content and samples, and are mostly characterized by suboptimal design quality. Future studies should be more specific and well-designed with sufficient statistical strength.

Cannabinoids for nausea and vomiting related to chemotherapy: Overview of systematic reviews.

PubMed

Schussel, Victor; Kenzo, Lucas; Santos, Andreia; Bueno, Júlia; Yoshimura, Ellen; de Oliveira Cruz Latorraca, Carolina; Pachito, Daniela Vianna; Riera, Rachel

2018-04-01

Nausea and vomiting are common and distressing adverse events of chemotherapy. This review focuses on the findings and quality of systematic reviews (SRs) of cannabinoids for chemotherapy-induced nausea and vomiting (CINV). Review of SRs, a systematic literature search, was conducted in several electronic databases and included SRs evaluating cannabinoids for CINV in cancer patients. Methodological quality and quality of reporting were evaluated by AMSTAR and PRISMA, respectively. Initial search retrieved 2,206 records, and 5 SRs were included. On the basis of findings of the sole SR judged as high methodological quality, cannabinoids seem to be more effective than placebo, equal to prochlorperazine for reducing CINV, and to be preferred by patients. The response to different combinations of antiemetic agents seems to be equal to 1 antiemetic alone. The average of AMSTAR score was 5, and the average of PRISMA score was 13.2. Cannabinoids represent a valuable option for treating CINV, despite the adverse events related to treatment, such as drowsiness and cognitive impairment. There is no good quality evidence to recommend or not the use of cannabinoids for CINV. More studies are still needed to evaluate the effectiveness of cannabinoids when compared with modern antiemetics. Copyright © 2017 John Wiley & Sons, Ltd.

Quality indicators for hip fracture care, a systematic review.

PubMed

Voeten, S C; Krijnen, P; Voeten, D M; Hegeman, J H; Wouters, M W J M; Schipper, I B

2018-05-17

Quality indicators are used to measure quality of care and enable benchmarking. An overview of all existing hip fracture quality indicators is lacking. The primary aim was to identify quality indicators for hip fracture care reported in literature, hip fracture audits, and guidelines. The secondary aim was to compose a set of methodologically sound quality indicators for the evaluation of hip fracture care in clinical practice. A literature search according to the PRISMA guidelines and an internet search were performed to identify hip fracture quality indicators. The indicators were subdivided into process, structure, and outcome indicators. The methodological quality of the indicators was judged using the Appraisal of Indicators through Research and Evaluation (AIRE) instrument. For structure and process indicators, the construct validity was assessed. Sixteen publications, nine audits and five guidelines were included. In total, 97 unique quality indicators were found: 9 structure, 63 process, and 25 outcome indicators. Since detailed methodological information about the indicators was lacking, the AIRE instrument could not be applied. Seven indicators correlated with an outcome measure. A set of nine quality indicators was extracted from the literature, audits, and guidelines. Many quality indicators are described and used. Not all of them correlate with outcomes of care and have been assessed methodologically. As methodological evidence is lacking, we recommend the extracted set of nine indicators to be used as the starting point for further clinical research. Future research should focus on assessing the clinimetric properties of the existing quality indicators.

How Methodologic Differences Affect Results of Economic Analyses: A Systematic Review of Interferon Gamma Release Assays for the Diagnosis of LTBI

PubMed Central

Oxlade, Olivia; Pinto, Marcia; Trajman, Anete; Menzies, Dick

2013-01-01

Introduction Cost effectiveness analyses (CEA) can provide useful information on how to invest limited funds, however they are less useful if different analysis of the same intervention provide unclear or contradictory results. The objective of our study was to conduct a systematic review of methodologic aspects of CEA that evaluate Interferon Gamma Release Assays (IGRA) for the detection of Latent Tuberculosis Infection (LTBI), in order to understand how differences affect study results. Methods A systematic review of studies was conducted with particular focus on study quality and the variability in inputs used in models used to assess cost-effectiveness. A common decision analysis model of the IGRA versus Tuberculin Skin Test (TST) screening strategy was developed and used to quantify the impact on predicted results of observed differences of model inputs taken from the studies identified. Results Thirteen studies were ultimately included in the review. Several specific methodologic issues were identified across studies, including how study inputs were selected, inconsistencies in the costing approach, the utility of the QALY (Quality Adjusted Life Year) as the effectiveness outcome, and how authors choose to present and interpret study results. When the IGRA versus TST test strategies were compared using our common decision analysis model predicted effectiveness largely overlapped. Implications Many methodologic issues that contribute to inconsistent results and reduced study quality were identified in studies that assessed the cost-effectiveness of the IGRA test. More specific and relevant guidelines are needed in order to help authors standardize modelling approaches, inputs, assumptions and how results are presented and interpreted. PMID:23505412

Sports Injury Surveillance Systems: A Review of Methods and Data Quality.

PubMed

Ekegren, Christina L; Gabbe, Belinda J; Finch, Caroline F

2016-01-01

Data from sports injury surveillance systems are a prerequisite to the development and evaluation of injury prevention strategies. This review aimed to identify ongoing sports injury surveillance systems and determine whether there are gaps in our understanding of injuries in certain sport settings. A secondary aim was to determine which of the included surveillance systems have evaluated the quality of their data, a key factor in determining their usefulness. A systematic search was carried out to identify (1) publications presenting methodological details of sports injury surveillance systems within clubs and organisations; and (2) publications describing quality evaluations and the quality of data from these systems. Data extracted included methodological details of the surveillance systems, methods used to evaluate data quality, and results of these evaluations. Following literature search and review, a total of 15 sports injury surveillance systems were identified. Data relevant to each aim were summarised descriptively. Most systems were found to exist within professional and elite sports. Publications concerning data quality were identified for seven (47%) systems. Validation of system data through comparison with alternate sources has been undertaken for only four systems (27%). This review identified a shortage of ongoing injury surveillance data from amateur and community sport settings and limited information about the quality of data in professional and elite settings. More surveillance systems are needed across a range of sport settings, as are standards for data quality reporting. These efforts will enable better monitoring of sports injury trends and the development of sports safety strategies.

Using QALYs in telehealth evaluations: a systematic review of methodology and transparency.

PubMed

Bergmo, Trine S

2014-08-03

The quality-adjusted life-year (QALY) is a recognised outcome measure in health economic evaluations. QALY incorporates individual preferences and identifies health gains by combining mortality and morbidity into one single index number. A literature review was conducted to examine and discuss the use of QALYs to measure outcomes in telehealth evaluations. Evaluations were identified via a literature search in all relevant databases. Only economic evaluations measuring both costs and QALYs using primary patient level data of two or more alternatives were included. A total of 17 economic evaluations estimating QALYs were identified. All evaluations used validated generic health related-quality of life (HRQoL) instruments to describe health states. They used accepted methods for transforming the quality scores into utility values. The methodology used varied between the evaluations. The evaluations used four different preference measures (EQ-5D, SF-6D, QWB and HUI3), and utility scores were elicited from the general population. Most studies reported the methodology used in calculating QALYs. The evaluations were less transparent in reporting utility weights at different time points and variability around utilities and QALYs. Few made adjustments for differences in baseline utilities. The QALYs gained in the reviewed evaluations varied from 0.001 to 0.118 in implying a small but positive effect of telehealth intervention on patient's health. The evaluations reported mixed cost-effectiveness results. The use of QALYs in telehealth evaluations has increased over the last few years. Different methodologies and utility measures have been used to calculate QALYs. A more harmonised methodology and utility measure is needed to ensure comparability across telehealth evaluations.

Systematic review of the methodological and reporting quality of case series in surgery.

PubMed

Agha, R A; Fowler, A J; Lee, S-Y; Gundogan, B; Whitehurst, K; Sagoo, H K; Jeong, K J L; Altman, D G; Orgill, D P

2016-09-01

Case series are an important and common study type. No guideline exists for reporting case series and there is evidence of key data being missed from such reports. The first step in the process of developing a methodologically sound reporting guideline is a systematic review of literature relevant to the reporting deficiencies of case series. A systematic review of methodological and reporting quality in surgical case series was performed. The electronic search strategy was developed by an information specialist and included MEDLINE, Embase, Cochrane Methods Register, Science Citation Index and Conference Proceedings Citation index, from the start of indexing to 5 November 2014. Independent screening, eligibility assessments and data extraction were performed. Included articles were then analysed for five areas of deficiency: failure to use standardized definitions, missing or selective data (including the omission of whole cases or important variables), transparency or incomplete reporting, whether alternative study designs were considered, and other issues. Database searching identified 2205 records. Through the process of screening and eligibility assessments, 92 articles met inclusion criteria. Frequencies of methodological and reporting issues identified were: failure to use standardized definitions (57 per cent), missing or selective data (66 per cent), transparency or incomplete reporting (70 per cent), whether alternative study designs were considered (11 per cent) and other issues (52 per cent). The methodological and reporting quality of surgical case series needs improvement. The data indicate that evidence-based guidelines for the conduct and reporting of case series may be useful. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Conservative treatment of tibialis posterior tendon dysfunction--a review.

PubMed

Bowring, Beverly; Chockalingam, Nachiappan

2010-03-01

Appropriate conservative treatment is considered essential to address symptoms associated with tibialis posterior tendon dysfunction (TPTD) and prevent its potential long-term disabling consequences. The main aim of this review, undertaken in 2007, was to evaluate the evidence from studies for the effects of conservative treatment modalities in the management of TPTD. This evidence could then be used as a basis for the development of a clinical guideline for the management of the condition. Studies were selected according to specific criteria and evaluated for methodological quality. As preliminary literature searches had identified no randomised controlled trials at the time of the review, studies of lower hierarchy were included. Five uncontrolled observational studies evaluating the outcomes of various orthotic treatments alone or in combination with other therapies were included in the review. Different study designs, methodological quality, population characteristics, interventions and outcome measures were found. Limited and poor quality evidence was found in this review regarding the conservative treatment of TPTD. Thus a cause-effect relationship between intervention and outcome could not be established nor an optimal conservative treatment regime for the condition. Further better quality research is warranted in this area to inform practice, particularly as there is no consensus in the literature regarding treatment of this condition. Copyright (c) 2009 Elsevier Ltd. All rights reserved.

The effectiveness of massage therapy for the treatment of nonspecific low back pain: a systematic review of systematic reviews.

PubMed

Kumar, Saravana; Beaton, Kate; Hughes, Tricia

2013-09-04

The last decade has seen a growth in the utilization of complementary and alternative medicine therapies, and one of the most popular and sought-after complementary and alternative medicine therapies for nonspecific low back pain is massage. Massage may often be perceived as a safe therapeutic modality without any significant risks or side effects. However, despite its popularity, there continues to be ongoing debate on the effectiveness of massage in treating nonspecific low back pain. With a rapidly evolving research evidence base and access to innovative means of synthesizing evidence, it is time to reinvestigate this issue. A systematic, step-by-step approach, underpinned by best practice in reviewing the literature, was utilized as part of the methodology of this umbrella review. A systematic search was conducted in the following databases: Embase, MEDLINE, AMED, ICONDA, Academic Search Premier, Australia/New Zealand Reference Centre, CINAHL, HealthSource, SPORTDiscus, PubMed, The Cochrane Library, Scopus, Web of Knowledge/Web of Science, PsycINFO, and ProQuest Nursing and Allied Health Source, investigating systematic reviews and meta-analyses from January 2000 to December 2012, and restricted to English-language documents. Methodological quality of included reviews was undertaken using the Centre for Evidence Based Medicine critical appraisal tool. Nine systematic reviews were found. The methodological quality of the systematic reviews varied (from poor to excellent) although, overall, the primary research informing these systematic reviews was generally considered to be weak quality. The findings indicate that massage may be an effective treatment option when compared to placebo and some active treatment options (such as relaxation), especially in the short term. There is conflicting and contradictory findings for the effectiveness of massage therapy for the treatment of nonspecific low back pain when compared against other manual therapies (such as mobilization), standard medical care, and acupuncture. There is an emerging body of evidence, albeit small, that supports the effectiveness of massage therapy for the treatment of non-specific low back pain in the short term. Due to common methodological flaws in the primary research, which informed the systematic reviews, recommendations arising from this evidence base should be interpreted with caution.

Static body postural misalignment in individuals with temporomandibular disorders: a systematic review

PubMed Central

Chaves, Thaís C.; Turci, Aline M.; Pinheiro, Carina F.; Sousa, Letícia M.; Grossi, Débora B.

2014-01-01

BACKGROUND: The association between body postural changes and temporomandibular disorders (TMD) has been widely discussed in the literature, however, there is little evidence to support this association. OBJECTIVES: The aim of the present study was to conduct a systematic review to assess the evidence concerning the association between static body postural misalignment and TMD. METHOD: A search was conducted in the PubMed/Medline, Embase, Lilacs, Scielo, Cochrane, and Scopus databases including studies published in English between 1950 and March 2012. Cross-sectional, cohort, case control, and survey studies that assessed body posture in TMD patients were selected. Two reviewers performed each step independently. A methodological checklist was used to evaluate the quality of the selected articles. RESULTS: Twenty studies were analyzed for their methodological quality. Only one study was classified as a moderate quality study and two were classified as strong quality studies. Among all studies considered, only 12 included craniocervical postural assessment, 2 included assessment of craniocervical and shoulder postures,, and 6 included global assessment of body posture. CONCLUSION: There is strong evidence of craniocervical postural changes in myogenous TMD, moderate evidence of cervical postural misalignment in arthrogenous TMD, and no evidence of absence of craniocervical postural misalignment in mixed TMD patients or of global body postural misalignment in patients with TMD. It is important to note the poor methodological quality of the studies, particularly those regarding global body postural misalignment in TMD patients. PMID:25590441

[What is the methodological quality of articles on therapeutic procedures published in Cirugía Española?].

PubMed

Manterola, Carlos; Busquets, Juli; Pascual, Marta; Grande, Luis

2006-02-01

The aim of this study was to determine the methodological quality of articles on therapeutic procedures published in Cirugía Española and to study its association with the publication year, center, and subject-matter. A bibliometric study that included all articles on therapeutic procedures published in Cirugía Española between 2001 and 2004 was performed. All kinds of clinical designs were considered, excluding editorials, review articles, letters to editor, and experimental studies. The variables analyzed were: year of publication, center, design, and methodological quality. Methodological quality was determined by a valid and reliable scale. Descriptive statistics (calculation of means, standard deviation and medians) and analytical statistics (Pearson's chi2, nonparametric, ANOVA and Bonferroni tests) were used. A total of 244 articles were studied (197 case series [81%], 28 cohort studies [12%], 17 clinical trials [7%], 1 cross sectional study and 1 case-control study [0.8%]). The studies were performed mainly in Catalonia and Murcia (22% and 16%, respectively). The most frequent subject areas were soft tissue and hepatobiliopancreatic surgery (23% and 19%, respectively). The mean and median of the methodological quality score calculated for the entire series was 10.2 +/- 3.9 points and 9.5 points, respectively. Methodological quality significantly increased by publication year (p < 0.001). An association between methodological quality and subject area was observed but no association was detected with the center performing the study. The methodological quality of articles on therapeutic procedures published in Cirugía Española between 2001 and 2004 is low. However, a statistically significant trend toward improvement was observed.

Epidemiology, quality, and reporting characteristics of systematic reviews and meta-analyses of nursing interventions published in Chinese journals.

PubMed

Zhang, Juxia; Wang, Jiancheng; Han, Lin; Zhang, Fengwa; Cao, Jianxun; Ma, Yuxia

2015-01-01

Systematic reviews (SRs) and meta-analyses (MAs) of nursing interventions have become increasingly popular in China. This review provides the first examination of epidemiological characteristics of these SRs as well as compliance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses and Assessment of Multiple Systematic Reviews guidelines. The purpose of this study was to examine epidemiologic and reporting characteristics as well as the methodologic quality of SRs and MAs of nursing interventions published in Chinese journals. Four Chinese databases were searched (the Chinese Biomedicine Literature Database, Chinese Scientific Journal Full-text Database, Chinese Journal Full-text Database, and Wanfang Database) for SRs and MAs of nursing intervention from inception through June 2013. Data were extracted into Excel (Microsoft, Redmond, WA). The Assessment of Multiple Systematic Reviews and Preferred Reporting Items for Systematic Reviews and Meta-analyses checklists were used to assess methodologic quality and reporting characteristics, respectively. A total of 144 SRs were identified, most (97.2%) of which used "systematic review" or "meta-analyses" in the titles. None of the reviews had been updated. Nearly half (41%) were written by nurses, and more than half (61%) were reported in specialist journals. The most common conditions studied were endocrine, nutritional and metabolic diseases, and neoplasms. Most (70.8%) reported information about quality assessment, whereas less than half (25%) reported assessing for publication bias. None of the reviews reported a conflict of interest. Although many SRs of nursing interventions have been published in Chinese journals, the quality of these reviews is of concern. As a potential key source of information for nurses and nursing administrators, not only were many of these reviews incomplete in the information they provided, but also some results were misleading. Improving the quality of SRs of nursing interventions conducted and published by nurses in China is urgently needed in order to increase the value of these studies. Copyright © 2015 Elsevier Inc. All rights reserved.

Synthesising quantitative and qualitative research in evidence-based patient information.

PubMed

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-03-01

Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence-based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non-quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg "explain what the test involves") was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review.

Methodological review of the quality of reach out and read: does it "work"?

PubMed

Yeager Pelatti, Christina; Pentimonti, Jill M; Justice, Laura M

2014-04-01

A considerable percentage of American children and adults fail to learn adequate literacy skills and read below a third grade level. Shared book reading is perhaps the single most important activity to prepare young children for success in reading. The primary objective of this manuscript was to critically review the methodological quality of Read Out and Read (ROR), a clinically based literacy program/intervention that teaches parents strategies to incorporate while sharing books with children as a method of preventing reading difficulties and academic struggles. A PubMed search was conducted. Articles that met three criteria were considered. First, the study must be clinically based and include parent contact with a pediatrician. Second, parental counseling ("anticipatory guidance") about the importance of parent-child book reading must be included. Third, only experimental or quasi-experimental studies were included; no additional criteria were used. Published articles from any year and peer-reviewed journal were considered. Study quality was determined using a modified version of the Downs and Black (1998) checklist assessing four categories: (1) Reporting, (2) External Validity, (3) Internal Validity-Bias, and (4) Internal Validity-Confounding. We were also interested in whether quality differed based on study design, children's age, sample size, and study outcome. Eleven studies met the inclusion criteria. The overall quality of evidence was variable across all studies; Reporting and External Validity categories were relatively strong while methodological concerns were found in the area of internal validity. Quality scores differed on the four study characteristics. Implications related to clinical practice and future studies are discussed.

Review: typically-developing students' views and experiences of inclusive education.

PubMed

Bates, Helen; McCafferty, Aileen; Quayle, Ethel; McKenzie, Karen

2015-01-01

The present review aimed to summarize and critique existing qualitative studies that have examined typically-developing students' views of inclusive education (i.e. the policy of teaching students with special educational needs in mainstream settings). Guidelines from the Centre for Reviews and Dissemination were followed, outlining the criteria by which journal articles were identified and critically appraised. Narrative Synthesis was used to summarize findings across studies. Fourteen studies met the review's inclusion criteria and were subjected to quality assessment. Analysis revealed that studies were of variable quality: three were of "good" methodological quality, seven of "medium" quality, and four of "poor" quality. With respect to findings, three overarching themes emerged: students expressed mostly negative attitudes towards peers with disabilities; were confused by the principles and practices of inclusive education; and made a number of recommendations for improving its future provision. A vital determinant of the success of inclusive education is the extent to which it is embraced by typically-developing students. Of concern, this review highlights that students tend not to understand inclusive education, and that this can breed hostility towards it. More qualitative research of high methodological quality is needed in this area. Implications for Rehabilitation Typically-developing students are key to the successful implementation of inclusive education. This review shows that most tend not to understand it, and can react by engaging in avoidance and/or targeted bullying of peers who receive additional support. Schools urgently need to provide teaching about inclusive education, and increase opportunities for contact between students who do and do not receive support (e.g. cooperative learning).

Tailored Communication Within Mobile Apps for Diabetes Self-Management: A Systematic Review

PubMed Central

Wahl, Astrid Klopstad; Cvancarova Småstuen, Milada; Ribu, Lis

2017-01-01

Background The prevalence of diabetes is increasing and with the requirements for self-management and risk of late complications, it remains a challenge for the individual and society. Patients can benefit from support from health care personnel in their self-management, and the traditional communication between patients and health care personnel is changing. Smartphones and apps offer a unique platform for communication, but apps with integrated health care personnel communication based on patient data are yet to be investigated to provide evidence of possible effects. Objective Our goal was to systematically review studies that aimed to evaluate integrated communication within mobile apps for tailored feedback between patients with diabetes and health care personnel in terms of (1) study characteristics, (2) functions, (3) study outcomes, (4) effects, and (5) methodological quality. Methods A systematic literature search was conducted following our International Prospective Register of Systematic Reviews (PROSPERO) protocol, searching for apps with integrated communication for persons with diabetes tested in a controlled trial in the period 2008 to 2016. We searched the databases PubMed, Medical Literature Analysis and Retrieval System Online (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Central, Excerpta Medica database (EMBASE), ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform. The search was closed in September 2016. Reference lists of primary articles and review papers were assessed. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed, and we applied the Cochrane risk of bias tool to assess methodological quality. Results We identified 2822 citations and after duplicate removal, we assessed 1128 citations. A total of 6 papers were included in this systematic review, reporting on data from 431 persons participating in small trials of short duration. The integrated communication features were mostly individualized as written non–real-time feedback. The number of functions varied from 2 to 9, and blood glucose tracking was the most common. HbA1c was the most common primary outcome, but the remaining reported outcomes were not standardized and comparable. Because of both the heterogeneity of the included trials and the poor methodological quality of the studies, a meta-analysis was not possible. A statistically significant improvement in the primary measure of outcome was found in 3 of the 6 included studies, of which 2 were HbA1c and 1 was mean daytime ambulatory blood pressure. Participants in the included trials reported positive usability or feasibility postintervention in 5 out of 6 trials. The overall methodological quality of the trials was, however, scored as an uncertain risk of bias. Conclusions This systematic review highlights the need for more trials of higher methodological quality. Few studies offer an integrated function for communication and feedback from health care personnel, and the research field represents an area of heterogeneity with few studies of highly rigorous methodological quality. This, in combination with a low number of participants and a short follow-up, is making it difficult to provide reliable evidence of effects for stakeholders. PMID:28645890

Quality of Life for Individuals with Disabilities: A Conceptual Framework.

ERIC Educational Resources Information Center

Marinoble, Rita; Hegenauer, Judy

One of the desired outcomes of transition planning for students with disabilities is to enable the students to lead a quality adult life. This report contains a literature review which outlines recent approaches to addressing quality of life issues, including conceptualizations, methodologies, and ethical concerns. A field inquiry report…

Quality Assurance in Distance Learning Libraries

ERIC Educational Resources Information Center

Tripathi, Manorama; Jeevan, V. K. J.

2009-01-01

Purpose: The paper aims to study how the present distance learning libraries can improve upon their existing services and introduce new ones to enhance quality of services to distance learners. Design/methodology/approach: The paper includes a review of literature on quality assurance in open and distance education in general and student support…

E-Learning Quality Assurance: A Process-Oriented Lifecycle Model

ERIC Educational Resources Information Center

Abdous, M'hammed

2009-01-01

Purpose: The purpose of this paper is to propose a process-oriented lifecycle model for ensuring quality in e-learning development and delivery. As a dynamic and iterative process, quality assurance (QA) is intertwined with the e-learning development process. Design/methodology/approach: After reviewing the existing literature, particularly…

The quality of the evidence base for clinical pathway effectiveness: room for improvement in the design of evaluation trials.

PubMed

Rotter, Thomas; Kinsman, Leigh; James, Erica; Machotta, Andreas; Steyerberg, Ewout W

2012-06-18

The purpose of this article is to report on the quality of the existing evidence base regarding the effectiveness of clinical pathway (CPW) research in the hospital setting. The analysis is based on a recently published Cochrane review of the effectiveness of CPWs. An integral component of the review process was a rigorous appraisal of the methodological quality of published CPW evaluations. This allowed the identification of strengths and limitations of the evidence base for CPW effectiveness. We followed the validated Cochrane Effective Practice and Organisation of Care Group (EPOC) criteria for randomized and non-randomized clinical pathway evaluations. In addition, we tested the hypotheses that simple pre-post studies tend to overestimate CPW effects reported. Out of the 260 primary studies meeting CPW content criteria, only 27 studies met the EPOC study design criteria, with the majority of CPW studies (more than 70 %) excluded from the review on the basis that they were simple pre-post evaluations, mostly comparing two or more annual patient cohorts. Methodologically poor study designs are often used to evaluate CPWs and this compromises the quality of the existing evidence base. Cochrane EPOC methodological criteria, including the selection of rigorous study designs along with detailed descriptions of CPW development and implementation processes, are recommended for quantitative evaluations to improve the evidence base for the use of CPWs in hospitals.

Q-SEA – a tool for quality assessment of ethics analyses conducted as part of health technology assessments

PubMed Central

Scott, Anna Mae; Hofmann, Björn; Gutiérrez-Ibarluzea, Iñaki; Bakke Lysdahl, Kristin; Sandman, Lars; Bombard, Yvonne

2017-01-01

Introduction: Assessment of ethics issues is an important part of health technology assessments (HTA). However, in terms of existence of quality assessment tools, ethics for HTA is methodologically underdeveloped in comparison to other areas of HTA, such as clinical or cost effectiveness. Objective: To methodologically advance ethics for HTA by: (1) proposing and elaborating Q-SEA, the first instrument for quality assessment of ethics analyses, and (2) applying Q-SEA to a sample systematic review of ethics for HTA, in order to illustrate and facilitate its use. Methods: To develop a list of items for the Q-SEA instrument, we systematically reviewed the literature on methodology in ethics for HTA, reviewed HTA organizations’ websites, and solicited views from 32 experts in the field of ethics for HTA at two 2-day workshops. We subsequently refined Q-SEA through its application to an ethics analysis conducted for HTA. Results: Q-SEA instrument consists of two domains – the process domain and the output domain. The process domain consists of 5 elements: research question, literature search, inclusion/exclusion criteria, perspective, and ethics framework. The output domain consists of 5 elements: completeness, bias, implications, conceptual clarification, and conflicting values. Conclusion: Q-SEA is the first instrument for quality assessment of ethics analyses in HTA. Further refinements to the instrument to enhance its usability continue. PMID:28326147

Don’t forget the posters! Quality and content variables associated with accepted abstracts at a national trauma meeting

PubMed Central

Dossett, Lesly A.; Fox, Erin E.; del Junco, Deborah J.; Zaydfudim, Victor; Kauffmann, Rondi; Shelton, Julia; Wang, Weiwei; Cioffi, William G.; Holcomb, John B.; Cotton, Bryan A.

2014-01-01

BACKGROUND As a primary venue for presenting research results, abstracts selected for presentation at national meetings should be of the highest scientific merit and research quality. It is uncertain to what degree this is achieved as the methodological quality of abstracts submitted to national surgical meetings has not been previously described. The objective of this study was to evaluate abstracts presented at a leading trauma meeting for methodological quality. METHODS All abstracts accepted for the 2009 American Association for the Surgery of Trauma meeting were reviewed and scored for methodological quality based on 10 criteria (scores, 0–10; 10 being the highest). Criteria were based on nationally published methodology guidelines. Two independent reviewers who were blinded to institution, region, and author reviewed each abstract. RESULTS A total of 187 abstracts were accepted for presentation (67 oral and 120 posters). The most frequent clinical topics were shock/transfusion (23%), abdomen (12%), and nervous system (11%). Shock/transfusion abstracts were more common in the oral presentations (31% vs. 19%; p =0.06). Abstracts from the northeast and south regions were the most common in both oral (26% and 29%) and posters (25% and 24%). Basic science accounted for 12% of accepted studies, while 51% were clinical and 28% were health services/outcomes. Only 8% of abstracts presented randomized data and only 11% reported null findings. Overall abstract scores ranged from 3 to 10 (median, 7; mean, 7.4). Abstracts selected for poster presentation had an overall higher score than those selected for oral presentation (7.4 ±1.7 vs. 6.8 ±1.7; p =0.02). CONCLUSION Although oral presentations traditionally receive the most attention and interest, the methodological quality of abstracts accepted for poster presentation equals (and sometimes exceeds) that of oral abstracts. Attendees of these national meetings should reconsider their time spent in viewing and visiting these poster sessions as with the oral presentations. In light of our findings, we highly encourage that all members and guests attend the American Association for the Surgery of Trauma Poster Rounds at each year’s scientific assembly. PMID:22673278

Don't forget the posters! Quality and content variables associated with accepted abstracts at a national trauma meeting.

PubMed

Dossett, Lesly A; Fox, Erin E; del Junco, Deborah J; Zaydfudim, Victor; Kauffmann, Rondi; Shelton, Julia; Wang, Weiwei; Cioffi, William G; Holcomb, John B; Cotton, Bryan A

2012-05-01

As a primary venue for presenting research results, abstracts selected for presentation at national meetings should be of the highest scientific merit and research quality. It is uncertain to what degree this is achieved as the methodological quality of abstracts submitted to national surgical meetings has not been previously described. The objective of this study was to evaluate abstracts presented at a leading trauma meeting for methodological quality. All abstracts accepted for the 2009 American Association for the Surgery of Trauma meeting were reviewed and scored for methodological quality based on 10 criteria (scores, 0-10; 10 being the highest). Criteria were based on nationally published methodology guidelines. Two independent reviewers who were blinded to institution, region, and author reviewed each abstract. A total of 187 abstracts were accepted for presentation (67 oral and 120 posters). The most frequent clinical topics were shock/transfusion (23%), abdomen (12%), and nervous system (11%). Shock/transfusion abstracts were more common in the oral presentations (31% vs. 19%; p = 0.06). Abstracts from the northeast and south regions were the most common in both oral (26% and 29%) and posters (25% and 24%). Basic science accounted for 12% of accepted studies, while 51% were clinical and 28% were health services/outcomes. Only 8% of abstracts presented randomized data and only 11% reported null findings. Overall abstract scores ranged from 3 to 10 (median, 7; mean, 7.4). Abstracts selected for poster presentation had an overall higher score than those selected for oral presentation (7.4 ± 1.7 vs. 6.8 ± 1.7; p = 0.02). Although oral presentations traditionally receive the most attention and interest, the methodological quality of abstracts accepted for poster presentation equals (and sometimes exceeds) that of oral abstracts. Attendees of these national meetings should reconsider their time spent in viewing and visiting these poster sessions as with the oral presentations. In light of our findings, we highly encourage that all members and guests attend the American Association for the Surgery of Trauma Poster Rounds at each year's scientific assembly.

Measurement properties of patient-reported outcome measures (PROMS) in Patellofemoral Pain Syndrome: a systematic review.

PubMed

Green, Andrew; Liles, Clive; Rushton, Alison; Kyte, Derek G

2014-12-01

This systematic review investigated the measurement properties of disease-specific patient-reported outcome measures used in Patellofemoral Pain Syndrome. Two independent reviewers conducted a systematic search of key databases (MEDLINE, EMBASE, AMED, CINHAL+ and the Cochrane Library from inception to August 2013) to identify relevant studies. A third reviewer mediated in the event of disagreement. Methodological quality was evaluated using the validated COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) tool. Data synthesis across studies determined the level of evidence for each patient-reported outcome measure. The search strategy returned 2177 citations. Following the eligibility review phase, seven studies, evaluating twelve different patient-reported outcome measures, met inclusion criteria. A 'moderate' level of evidence supported the structural validity of several measures: the Flandry Questionnaire, Anterior Knee Pain Scale, Functional Index Questionnaire, Eng and Pierrynowski Questionnaire and Visual Analogue Scales for 'usual' and 'worst' pain. In addition, there was a 'Limited' level of evidence supporting the test-retest reliability and validity (cross-cultural, hypothesis testing) of the Persian version of the Anterior Knee Pain Scale. Other measurement properties were evaluated with poor methodological quality, and many properties were not evaluated in any of the included papers. Current disease-specific outcome measures for Patellofemoral Pain Syndrome require further investigation. Future studies should evaluate all important measurement properties, utilising an appropriate framework such as COSMIN to guide study design, to facilitate optimal methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

Quality Assessment of TPB-Based Questionnaires: A Systematic Review

PubMed Central

Oluka, Obiageli Crystal; Nie, Shaofa; Sun, Yi

2014-01-01

Objective This review is aimed at assessing the quality of questionnaires and their development process based on the theory of planned behavior (TPB) change model. Methods A systematic literature search for studies with the primary aim of TPB-based questionnaire development was conducted in relevant databases between 2002 and 2012 using selected search terms. Ten of 1,034 screened abstracts met the inclusion criteria and were assessed for methodological quality using two different appraisal tools: one for the overall methodological quality of each study and the other developed for the appraisal of the questionnaire content and development process. Both appraisal tools consisted of items regarding the likelihood of bias in each study and were eventually combined to give the overall quality score for each included study. Results 8 of the 10 included studies showed low risk of bias in the overall quality assessment of each study, while 9 of the studies were of high quality based on the quality appraisal of questionnaire content and development process. Conclusion Quality appraisal of the questionnaires in the 10 reviewed studies was successfully conducted, highlighting the top problem areas (including: sample size estimation; inclusion of direct and indirect measures; and inclusion of questions on demographics) in the development of TPB-based questionnaires and the need for researchers to provide a more detailed account of their development process. PMID:24722323

Traditional chinese medicine: an update on clinical evidence.

PubMed

Xue, Charlie C L; Zhang, Anthony L; Greenwood, Kenneth M; Lin, Vivian; Story, David F

2010-03-01

As an alternative medical system, Traditional Chinese Medicine (TCM) has been increasingly used over the last several decades. Such a consumer-driven development has resulted in introduction of education programs for practitioner training, development of product and practitioner regulation systems, and generation of an increasing interest in research. Significant efforts have been made in validating the quality, effectiveness, and safety of TCM interventions evidenced by a growing number of published trials and systematic reviews. Commonly, the results of these studies were inconclusive due to the lack of quality and quantity of the trials to answer specific and answerable clinical questions. The methodology of a randomized clinical trial (RCT) is not free from bias, and the unique features of TCM (such as individualization and holism) further complicate effective execution of RCTs in TCM therapies. Thus, data from limited RCTs and systematic reviews need to be interpreted with great caution. Nevertheless, until new and specific methodology is developed that can adequately address these methodology challenges for RCTs in TCM, evidence from quality RCTs and systematic reviews still holds the credibility of TCM in the scientific community. This article summarizes studies on TCM utilization, and regulatory and educational development with a focus on updating the TCM clinical evidence from RCTs and systematic reviews over the last decade. The key issues and challenges associated with evidence-based TCM developments are also explored.

Bone mass improved effect of icariin for postmenopausal osteoporosis in ovariectomy-induced rats: a meta-analysis and systematic review.

PubMed

Xu, Jin-Hai; Yao, Min; Ye, Jie; Wang, Guo-Dong; Wang, Jing; Cui, Xue-Jun; Mo, Wen

2016-10-01

Ovariectomy (OVX)-induced rats are the most frequently used animal model to research postmenopausal osteoporosis. Our objective was to summarize and critically assess the bone mass improved effect of icariin (ICA) for treatment of postmenopausal osteoporosis in an OVX-induced rat model. The PUBMED, EMBASE, and Chinese databases were searched from their inception date to February 2015. Two reviewers independently selected animal studies that evaluated the bone mass improved effect of ICA compared with control in OVX-induced rats. Extracted data were analyzed by RevMan statistical software, and the methodological quality of each study was assessed. Seven studies with adequate randomization were included in the systematic review. Overall, ICA seemed to significantly improve bone mass as assessed using the bone mineral density (seven studies, n = 169; weighted mean difference, 0.02; 95% CI, 0.01-0.02, I = 77%, P < 0.00001) using a random-effects model. There is no significant difference between ICA and estrogen (E) (six studies, n = 128; weighted mean difference, 0.00; 95% CI, -0.00 to 0.01, I = 54%, P = 0.01). Bone mass improved effect of ICA for postmenopausal osteoporosis was observed in OVX-induced rats. Assessment of the methodological quality of studies involving OVX-induced animal models is required, and good methodological quality should be valued in systematic reviews of animal studies.

Validity and reliability of Internet-based physiotherapy assessment for musculoskeletal disorders: a systematic review.

PubMed

Mani, Suresh; Sharma, Shobha; Omar, Baharudin; Paungmali, Aatit; Joseph, Leonard

2017-04-01

Purpose The purpose of this review is to systematically explore and summarise the validity and reliability of telerehabilitation (TR)-based physiotherapy assessment for musculoskeletal disorders. Method A comprehensive systematic literature review was conducted using a number of electronic databases: PubMed, EMBASE, PsycINFO, Cochrane Library and CINAHL, published between January 2000 and May 2015. The studies examined the validity, inter- and intra-rater reliabilities of TR-based physiotherapy assessment for musculoskeletal conditions were included. Two independent reviewers used the Quality Appraisal Tool for studies of diagnostic Reliability (QAREL) and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool to assess the methodological quality of reliability and validity studies respectively. Results A total of 898 hits were achieved, of which 11 articles based on inclusion criteria were reviewed. Nine studies explored the concurrent validity, inter- and intra-rater reliabilities, while two studies examined only the concurrent validity. Reviewed studies were moderate to good in methodological quality. The physiotherapy assessments such as pain, swelling, range of motion, muscle strength, balance, gait and functional assessment demonstrated good concurrent validity. However, the reported concurrent validity of lumbar spine posture, special orthopaedic tests, neurodynamic tests and scar assessments ranged from low to moderate. Conclusion TR-based physiotherapy assessment was technically feasible with overall good concurrent validity and excellent reliability, except for lumbar spine posture, orthopaedic special tests, neurodynamic testa and scar assessment.

Effectiveness of physical therapy interventions for children with cerebral palsy: A systematic review

PubMed Central

Anttila, Heidi; Autti-Rämö, Ilona; Suoranta, Jutta; Mäkelä, Marjukka; Malmivaara, Antti

2008-01-01

Background To assess the effectiveness of physical therapy (PT) interventions on functioning in children with cerebral palsy (CP). Methods A search was made in Medline, Cinahl, PEDro and the Cochrane library for the period 1990 to February 2007. Only randomized controlled trials (RCTs) on PT interventions in children with diagnosed CP were included. Two reviewers independently assessed the methodological quality and extracted the data. The outcomes measured in the trials were classified using the International Classification of Functioning, Disability and Health (ICF). Results Twenty-two trials were identified. Eight intervention categories were distinguished. Four trials were of high methodological quality. Moderate evidence of effectiveness was established for two intervention categories: effectiveness of upper extremity treatments on attained goals and active supination, and of prehensile hand treatment and neurodevelopmental therapy (NDT) or NDT twice a week on developmental status, and of constraint-induced therapy on amount and quality of hand use. Moderate evidence of ineffectiveness was found of strength training on walking speed and stride length. Conflicting evidence was found for strength training on gross motor function. For the other intervention categories the evidence was limited due to low methodological quality and the statistically insignificant results of the studies. Conclusion Due to limitations in methodological quality and variations in population, interventions and outcomes, mostly limited evidence on the effectiveness of most PT interventions is available through RCTs. Moderate evidence was found for some effectiveness of upper extremity training. Well-designed trials are needed especially for focused PT interventions. PMID:18435840

[Injuries in the Martial Arts Judo, Taekwondo and Wrestling - A Systematic Review].

PubMed

Jäggi, U; Joray, C P; Brülhart, Y; Luijckx, E; Rogan, S

2015-12-01

Martial arts such as judo, taekwondo and wrestling are regulated, usually athletic duels. The aim is to score better than your opponent or to win. As with any type of sport, athletes in martial arts sustain minor and major injuries, which may have many negative consequences. In addition, sports injuries and their rehabilitation generate high costs to the healthcare system. In contrast to the FIFA 11+ warm-up program, no preventive programs have been postulated for injury prevention in these martial arts. Therefore, the aim of this systematic review was to summarise the latest research findings and to evaluate whether initial recommendations can be given for the reduction of injuries in the martial arts judo, wrestling and taekwondo. To gain an overview of the latest research findings, we searched for systematic reviews in PEDro, PubMed, Cochrane and the internet search engine Google Scholar. The methodological quality of these reviews was assessed using the Critical Appraisal Tool for a Systematic Review (CASP), and data was extracted on the risk of injury, injury location and injury type. It was found that all three review articles are of low to moderate methodological quality. Regarding injury location, it became evident that the extremities are particularly vulnerable to injury in all three martial arts. Effusion was observed to be the most common type of injury. Due to the moderate methodological quality and the injury type of effusion, it is not possible to formulate recommendations for injury prevention. Moreover, uniform definitions should be developed to describe sports injuries. © Georg Thieme Verlag KG Stuttgart · New York.

How best to assess quality of life in informal carers of people with dementia; A systematic review of existing outcome measures

PubMed Central

Robinson, Jonah; Robalino, Shannon; Finch, Tracy; McColl, Elaine

2018-01-01

Background In the UK, there are currently 800 000 people living with dementia. This number is expected to double in the next 20 years. Two-thirds of people with dementia live in the community supported by informal carers. Caring for a person with dementia has adverse effects on psychological, physical, social wellbeing and quality of life. The measurement of quality of life of carers of people with dementia is increasingly of interest to health and social care practitioners and commissioners, policymakers, and carers themselves. However, there is lack of consensus on the most suitable instrument(s) for undertaking this. Methods A systematic review of the literature using COSMIN methodology. Searching of electronic databases (Medline, PsycINFO, CINAHL and Web of Science), reference list and citation searching of key papers was undertaken. COSMIN methodology was used to simultaneously extract data from and assess methodological quality of included studies, and make a recommendation for the instrument with the most high quality evidence for its measurement properties. Results Ten instruments were suitable for inclusion in this review. The Carer well-being and support questionnaire (CWS) has the best quality evidence for the greatest number of measurement of properties. The Caregiver Well-Being Scale is also worthy of consideration. There is not presently a measure which could be recommended for use in economic evaluations, however the Impact of Alzheimer’s Disease on the Caregiver questionnaire (IADCQ) could potentially be used following further investigation of its measurement properties in a representative population. Conclusion The CWS is the most appropriate instrument to recommend for the assessment of quality of life in informal carers of people with dementia at present. All instruments included in this review would benefit from more rigorous evaluation of their measurement properties. PMID:29538433

An Umbrella Review of Nuts Intake and Risk of Cardiovascular Disease.

PubMed

Schwingshackl, Lukas; Hoffmann, Georg; Missbach, Benjamin; Stelmach-Mardas, Marta; Boeing, Heiner

2017-01-01

Nuts have been an indispensable component of the human diet for hundreds because of their unique nutrient composition and are thought to play a beneficial part in the prevention of cardiovascular diseases. To evaluate the extent, validity and presence of evidence for studies investigating the impact of nuts intake on biomarkers of cardiovascular disease and cardiovascular events, we performed an umbrella review of all published meta-analyses synthesizing data from both observational studies and randomized controlled trials. PubMed (between 1966 and April 2016) was searched for systematic reviews and meta-analyses. Methodological quality was assessed by applying the AMSTAR score (0-11 points), and the meta-evidence by applying NutriGrade, our recently developed scoring system (0-10 points). In total, 14 meta-analyses were included in the umbrella review. Only 4 out of 14 reported an AMSTAR score ≥8 (high methodological quality), whereas NutriGrade meta-evidence score varied between 2 (very low meta-evidence) and 7.9 (moderate meta-evidence). There is consistent evidence from intervention trials, reporting significant reductions for total cholesterol, and from observational studies that higher intakes of nuts were associated with reduced risk of cardiovascular disease and hypertension. On the other side no effect could be observed for stroke, HDL-cholesterol, and blood pressure in the normal range. In summary, the present umbrella review showed that nuts intake was associated with reduced risk of cardiovascular disease and hypertension, and lower levels of total cholesterol. The observed evidence is limited by the moderate methodological quality and very low to moderate quality of evidence. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Quality of reporting in oncology studies: A systematic analysis of literature reviews and prospects.

PubMed

Rivoirard, Romain; Bourmaud, Aurélie; Oriol, Mathieu; Tinquaut, Fabien; Méry, Benoîte; Langrand-Escure, Julien; Vallard, Alexis; Fournel, Pierre; Magné, Nicolas; Chauvin, Franck

2017-04-01

The present review gives an overview of systematic reviews published in peer reviewed Journals analysing quality of reporting in oncology studies. PUBMED and Cochrane library were searched to identify systematic reviews assessing quality of reporting for randomized controlled trials (RCTs) and observational studies (OBS). Recommendations and primary endpoints used to assess the quality of reporting were described. Intrinsic quality of reporting was analyzed using an Overall Quality Score for literature Reviews (OQSR). Main evaluation themes were overall quality of reporting (20/58) and reporting of Health-Related Quality Of Life (HRQOL) in RCTs (7/58). Reporting recommendations used were not detailed in 56.9% of reviews. Insufficient reporting for the methodological description (randomization, blinding details, and allocation concealment) and the rationale for using specific measure of HRQOL were highlighted. OQSR was significantly higher for reviews published between 2010 and 2014 (after the PRISMA Publication), as compared to those published between 1996-2009 (median OQSR 10 (10-11) versus median OQSR 9 (6-10) respectively, p=0.0053). Intrinsic quality of reporting is satisfactory and has been improved in the last years. Copyright © 2017 Elsevier B.V. All rights reserved.

31P NMR spectroscopy in the quality control and authentication of extra-virgin olive oil: a review of recent progress.

PubMed

Dais, Photis; Spyros, Apostolos

2007-05-01

This review is a brief account on the application of a novel methodology to the quality control and authentication of extra-virgin olive oil. This methodology is based on the derivatization of the labile hydrogens of functional groups, such as hydroxyl and carboxyl groups, of olive oil constituents with the phosphorus reagent 2-chloro-4,4,5,5-tetramethyldioxaphospholane, and the use of the (31)P chemical shifts to identify the phosphitylated compounds. Various experimental aspects such as pertinent instrumentation, sample preparation, acquisition parameters and properties of the phosphorus reagent are reviewed. The strategy to assign the (31)P signals of the phosphitylated model compounds and olive oil constituents by employing 1D and 2D NMR experiments is presented. Finally, the capability of this technique to assess the quality and the genuineness of extra-virgin olive oil and to detect fraud is discussed. Copyright (c) 2007 John Wiley & Sons, Ltd.

The application of quantitative methods for identifying and exploring the presence of bias in systematic reviews: PDE-5 inhibitors for erectile dysfunction.

PubMed

Bekkering, G E; Abou-Setta, A M; Kleijnen, J

2008-01-01

A systematic review of PDE-5 inhibitors for erectile dysfunction was performed to evaluate the utility of quantitative methods for identifying and exploring the influence of bias and study quality on pooled outcomes from meta-analyses. We included 123 randomized controlled trials (RCTs). Methodological quality was poorly reported. All three drugs appeared highly effective. Indirect adjusted analyses showed no differences between the three drugs. Funnel plots and statistical tests showed no evidence of small-study effects for sildenafil whereas there was evidence of such bias for tadalafil and vardenafil. Adjustment for missing studies using trim and fill techniques did not alter the pooled estimates substantially. The exclusion of previous sildenafil nonresponders was associated with larger treatment effects for tadalafil. This investigation was hampered by poor reporting of methodological quality, a low number of studies, heterogeneity and large effect sizes. Despite such limitations, a comprehensive assessment of biases should be a routine in systematic reviews.

The economic burden of patient safety targets in acute care: a systematic review

PubMed Central

Mittmann, Nicole; Koo, Marika; Daneman, Nick; McDonald, Andrew; Baker, Michael; Matlow, Anne; Krahn, Murray; Shojania, Kaveh G; Etchells, Edward

2012-01-01

Background Our objective was to determine the quality of literature in costing of the economic burden of patient safety. Methods We selected 15 types of patient safety targets for our systematic review. We searched the literature published between 2000 and 2010 using the following terms: “costs and cost analysis,” “cost-effectiveness,” “cost,” and “financial management, hospital.” We appraised the methodologic quality of potentially relevant studies using standard economic methods. We recorded results in the original currency, adjusted for inflation, and then converted to 2010 US dollars for comparative purposes (2010 US$1.00 = 2010 €0.76). The quality of each costing study per patient safety target was also evaluated. Results We screened 1948 abstracts, and identified 158 potentially eligible studies, of which only 61 (39%) reported any costing methodology. In these 61 studies, we found wide estimates of the attributable costs of patient safety events ranging from $2830 to $10,074. In general hospital populations, the cost per case of hospital-acquired infection ranged from $2132 to $15,018. Nosocomial bloodstream infection was associated with costs ranging from $2604 to $22,414. Conclusion There are wide variations in the estimates of economic burden due to differences in study methods and methodologic quality. Greater attention to methodologic standards for economic evaluations in patient safety is needed. PMID:23097615

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation.

PubMed

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7-8) versus Group B: 8 (7-9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals.

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation

PubMed Central

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Introduction Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. Methods In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Results Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7–8) versus Group B: 8 (7–9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). Conclusion The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals. PMID:27167982

Quality in physical therapist clinical education: a systematic review.

PubMed

McCallum, Christine A; Mosher, Peter D; Jacobson, Peri J; Gallivan, Sean P; Giuffre, Suzanne M

2013-10-01

Many factors affect student learning throughout the clinical education (CE) component of professional (entry-level) physical therapist education curricula. Physical therapist education programs (PTEPs) manage CE, yet the material and human resources required to provide CE are generally overseen by community-based physical therapist practices. The purposes of this systematic review were: (1) to examine how the construct of quality is defined in CE literature and (2) to determine the methodological rigor of the available evidence on quality in physical therapist CE. This study was a systematic review of English-language journals using the American Physical Therapy Association's Open Door Portal to Evidence-Based Practice as the computer search engine. The search was categorized using terms for physical therapy and quality and for CE pedagogy and models or roles. Summary findings were characterized by 5 primary themes and 14 subthemes using a qualitative-directed content analysis. Fifty-four articles were included in the study. The primary quality themes were: CE framework, CE sites, structure of CE, assessment in CE, and CE faculty. The methodological rigor of the studies was critically appraised using a binary system based on the McMaster appraisal tools. Scores ranged from 3 to 14. Publication bias and outcome reporting bias may be inherent limitations to the results. The review found inconclusive evidence about what constitutes quality or best practice for physical therapist CE. Five key constructs of CE were identified that, when aggregated, could construe quality.

Efficacy of exercise therapy in workers with rotator cuff tendinopathy: a systematic review

PubMed Central

Desmeules, François; Boudreault, Jennifer; Dionne, Clermont E.; Frémont, Pierre; Lowry, Véronique; MacDermid, Joy C.; Roy, Jean-Sébastien

2016-01-01

Objective: To perform a systematic review of randomized controlled trials (RCTs) on the efficacy of therapeutic exercises for workers suffering from rotator cuff (RC) tendinopathy. Methods: A literature search in four bibliographical databases (Pubmed, CINAHL, EMBASE, and PEDro) was conducted from inception up to February 2015. RCTs were included if participants were workers suffering from RC tendinopathy, the outcome measures included work-related outcomes, and at least one of the interventions under study included exercises. The methodological quality of the studies was evaluated with the Cochrane Risk of Bias Assessment tool. Results: The mean methodological score of the ten included studies was 54.4%±17.2%. Types of workers included were often not defined, and work-related outcome measures were heterogeneous and often not validated. Three RCTs of moderate methodological quality concluded that exercises were superior to a placebo or no intervention in terms of function and return-to-work outcomes. No significant difference was found between surgery and exercises based on the results of two studies of low to moderate methodological quality. One study of low methodological quality, comparing a workplace-based exercise program focusing on the participants' work demands to an exercise program delivered in a clinical setting, concluded that the work-based intervention was superior in terms of function and return-to-work outcomes. Conclusion: There is low to moderate-grade evidence that therapeutic exercises provided in a clinical setting are an effective modality to treat workers suffering from RC tendinopathy and to promote return-to-work. Further high quality studies comparing different rehabilitation programs including exercises in different settings with defined workers populations are needed to draw firm conclusions on the optimal program to treat workers. PMID:27488037

Efficacy of exercise therapy in workers with rotator cuff tendinopathy: a systematic review.

PubMed

Desmeules, François; Boudreault, Jennifer; Dionne, Clermont E; Frémont, Pierre; Lowry, Véronique; MacDermid, Joy C; Roy, Jean-Sébastien

2016-09-30

To perform a systematic review of randomized controlled trials (RCTs) on the efficacy of therapeutic exercises for workers suffering from rotator cuff (RC) tendinopathy. A literature search in four bibliographical databases (Pubmed, CINAHL, EMBASE, and PEDro) was conducted from inception up to February 2015. RCTs were included if participants were workers suffering from RC tendinopathy, the outcome measures included work-related outcomes, and at least one of the interventions under study included exercises. The methodological quality of the studies was evaluated with the Cochrane Risk of Bias Assessment tool. The mean methodological score of the ten included studies was 54.4%±17.2%. Types of workers included were often not defined, and work-related outcome measures were heterogeneous and often not validated. Three RCTs of moderate methodological quality concluded that exercises were superior to a placebo or no intervention in terms of function and return-to-work outcomes. No significant difference was found between surgery and exercises based on the results of two studies of low to moderate methodological quality. One study of low methodological quality, comparing a workplace-based exercise program focusing on the participants' work demands to an exercise program delivered in a clinical setting, concluded that the work-based intervention was superior in terms of function and return-to-work outcomes. There is low to moderate-grade evidence that therapeutic exercises provided in a clinical setting are an effective modality to treat workers suffering from RC tendinopathy and to promote return-to-work. Further high quality studies comparing different rehabilitation programs including exercises in different settings with defined workers populations are needed to draw firm conclusions on the optimal program to treat workers.

Screening for oropharyngeal dysphagia in older adults: A systematic review of self-reported questionnaires.

PubMed

Magalhães Junior, Hipólito V; Pernambuco, Leandro de Araújo; Lima, Kenio C; Ferreira, Maria Angela F

2018-04-03

Oropharyngeal dysphagia is a swallowing disorder with signs and symptoms which may be present in older adults, but they are rarely noticed as a health concern by older people. The earliest possible identification of this clinical condition is needed by self-reported population-based screening questionnaire, which are valid and reliable for preventing risks to nutritional status, increased morbidity and mortality. The aim of this systematic review was to identify self-reported screening questionnaires for oropharyngeal dysphagia in older adults to evaluate their methodological quality for population-based studies. An extensive search of electronic databases (PubMed (MEDLINE), Ovid MEDLINE(R), Scopus, Cochrane Library, CINAHL, Web of Science (WOS), PsycINFO (APA), Lilacs and Scielo) was conducted in the period from April to May 2017 using previously established search strategies by the two evaluators. The methodological quality and the psychometric properties of the included studies were evaluated by the COSMIN (Consensus based Standards for the selection of health Measurement Instruments) checklist and the quality criteria of Terwee and colleagues, respectively. The analysed information was extracted from three articles which had conducted studies on the prevalence of oropharyngeal dysphagia by self-reported screening questionnaires, showing poor methodological quality and flaws in the methodological description to demonstrate its psychometric properties. This study did not find any self-reported screening questionnaires for oropharyngeal dysphagia with suitable methodological quality and appropriate evidence in its psychometric properties for elders. Therefore, the self-reported questionnaires within the diagnostic proposal require greater details in its process for obtaining valid and reliable evidence. © 2018 John Wiley & Sons A/S and The Gerodontology Association. Published by John Wiley & Sons Ltd.

Chronic care management for patients with COPD: a critical review of available evidence.

PubMed

Lemmens, Karin M M; Lemmens, Lidwien C; Boom, José H C; Drewes, Hanneke W; Meeuwissen, Jolanda A C; Steuten, Lotte M G; Vrijhoef, Hubertus J M; Baan, Caroline A

2013-10-01

Clinical diversity and methodological heterogeneity exists between studies on chronic care management. This study aimed to examine the effectiveness of chronic care management in chronic obstructive pulmonary disease (COPD) while taking heterogeneity into account, enabling the understanding of and the decision making about such programmes. Three investigated sources of heterogeneity were study quality, length of follow-up, and number of intervention components. We performed a review of previously published reviews and meta-analyses on COPD chronic care management. Their primary studies that were analyzed as statistical, clinical and methodological heterogeneity were present. Meta-regression analyses were performed to explain the variances among the primary studies. Generally, the included reviews showed positive results on quality of life and hospitalizations. Inconclusive effects were found on emergency department visits and no effects on mortality. Pooled effects on hospitalizations, emergency department visits and quality of life of primary studies did not reach significant improvement. No effects were found on mortality. Meta-regression showed that the number of components of chronic care management programmes explained present heterogeneity for hospitalizations and emergency department visits. Four components showed significant effects on hospitalizations, whereas two components had significant effects on emergency department visits. Methodological study quality and length of follow-up did not significantly explain heterogeneity. This study demonstrated that COPD chronic care management has the potential to improve outcomes of care; heterogeneity in outcomes was explained. Further research is needed to elucidate the diversity between COPD chronic care management studies in terms of the effects measured and strengthen the support for chronic care management. © 2011 John Wiley & Sons Ltd.

Critical Appraisal of International Clinical Practice Guidelines in Kidney Transplantation Using the Appraisal of Guidelines for Research and Education (AGREE) II Tool: A Systematic Review.

PubMed

OʼDonoghue, Katriona Jane Marie; Reed, Rhiannon D; Knight, Simon R; O'Callaghan, John M; Ayaz-Shah, Anam A; Hassan, Sevda; Weissenbacher, Annemarie; Morris, Peter J; Pengel, Liset H M

2018-05-22

Whilst Clinical Practice Guidelines (CPGs) are used for the development of local protocols in kidney transplantation (Ktx), the quality of their methodology is variable. This systematic review aimed to critically appraise international CPGs in all aspects of Ktx using the Appraisal of Guidelines for Research and Evaluation (AGREE) II tool. CPGs in Ktx and donation published between 2010 and 2017 were identified from MEDLINE, Embase, National Guideline Clearinghouse, NHS and NICE Evidence Searches, and the websites of transplant societies. Using AGREE II, 3 appraisers assessed the quality of CPGs. Interrater reliability was measured using the intraclass correlation coefficient (ICC). Searches identified 3,168 records and 115 CPGs were included. The highest scoring AGREE II domain was 'Scope and Purpose' (80%; Range 30-100%), followed by 'Clarity of Presentation' (77%; Range 43-98%), 'Editorial independence' (52%; Range 0-94%), 'Rigour of Development' (47%; Range 6-97%) and 'Stakeholder Involvement' (41%; Range 11-85%). The poorest scoring domain was 'Applicability' (31%; Range 3-74%). Most CPGs were recommended for future use either with (63%) or without modifications (18%). A small number were not recommended for future use (14%) or reviewers did not agree on recommending the CPG (5%). The overall mean CPG quality score was 4 out of 7 (Range 2-7). The mean ICC of 0.74 indicated substantial agreement between reviewers. The quality of international CPGs in Ktx was variable, and most CPGs lacked key aspects of methodological robustness and transparency. Improvements in methodology, patient involvement and strategies for implementation are required.

Predictive validity evidence for medical education research study quality instrument scores: quality of submissions to JGIM's Medical Education Special Issue.

PubMed

Reed, Darcy A; Beckman, Thomas J; Wright, Scott M; Levine, Rachel B; Kern, David E; Cook, David A

2008-07-01

Deficiencies in medical education research quality are widely acknowledged. Content, internal structure, and criterion validity evidence support the use of the Medical Education Research Study Quality Instrument (MERSQI) to measure education research quality, but predictive validity evidence has not been explored. To describe the quality of manuscripts submitted to the 2008 Journal of General Internal Medicine (JGIM) medical education issue and determine whether MERSQI scores predict editorial decisions. Cross-sectional study of original, quantitative research studies submitted for publication. Study quality measured by MERSQI scores (possible range 5-18). Of 131 submitted manuscripts, 100 met inclusion criteria. The mean (SD) total MERSQI score was 9.6 (2.6), range 5-15.5. Most studies used single-group cross-sectional (54%) or pre-post designs (32%), were conducted at one institution (78%), and reported satisfaction or opinion outcomes (56%). Few (36%) reported validity evidence for evaluation instruments. A one-point increase in MERSQI score was associated with editorial decisions to send manuscripts for peer review versus reject without review (OR 1.31, 95%CI 1.07-1.61, p = 0.009) and to invite revisions after review versus reject after review (OR 1.29, 95%CI 1.05-1.58, p = 0.02). MERSQI scores predicted final acceptance versus rejection (OR 1.32; 95% CI 1.10-1.58, p = 0.003). The mean total MERSQI score of accepted manuscripts was significantly higher than rejected manuscripts (10.7 [2.5] versus 9.0 [2.4], p = 0.003). MERSQI scores predicted editorial decisions and identified areas of methodological strengths and weaknesses in submitted manuscripts. Researchers, reviewers, and editors might use this instrument as a measure of methodological quality.

Systematic review of economic analyses in patient safety: a protocol designed to measure development in the scope and quality of evidence

PubMed Central

Carter, Alexander W; Mandavia, Rishi; Mayer, Erik; Marti, Joachim; Mossialos, Elias; Darzi, Ara

2017-01-01

Introduction Recent avoidable failures in patient care highlight the ongoing need for evidence to support improvements in patient safety. According to the most recent reviews, there is a dearth of economic evidence related to patient safety. These reviews characterise an evidence gap in terms of the scope and quality of evidence available to support resource allocation decisions. This protocol is designed to update and improve on the reviews previously conducted to determine the extent of methodological progress in economic analyses in patient safety. Methods and analysis A broad search strategy with two core themes for original research (excluding opinion pieces and systematic reviews) in ‘patient safety’ and ‘economic analyses’ has been developed. Medline, Econlit and National Health Service Economic Evaluation Database bibliographic databases will be searched from January 2007 using a combination of medical subject headings terms and research-derived search terms (see table 1). The method is informed by previous reviews on this topic, published in 2012. Screening, risk of bias assessment (using the Cochrane collaboration tool) and economic evaluation quality assessment (using the Drummond checklist) will be conducted by two independent reviewers, with arbitration by a third reviewer as needed. Studies with a low risk of bias will be assessed using the Drummond checklist. High-quality economic evaluations are those that score >20/35. A qualitative synthesis of evidence will be performed using a data collection tool to capture the study design(s) employed, population(s), setting(s), disease area(s), intervention(s) and outcome(s) studied. Methodological quality scores will be compared with previous reviews where possible. Effect size(s) and estimate uncertainty will be captured and used in a quantitative synthesis of high-quality evidence, where possible. Ethics and dissemination Formal ethical approval is not required as primary data will not be collected. The results will be disseminated through a peer-reviewed publication, presentations and social media. Trial registration number CRD42017057853. PMID:28821527

Gaps in the evidence for prevention and treatment of maternal anaemia: a review of systematic reviews.

PubMed

Parker, Jacqui A; Barroso, Filipa; Stanworth, Simon J; Spiby, Helen; Hopewell, Sally; Doree, Carolyn J; Renfrew, Mary J; Allard, Shubha

2012-06-24

Anaemia, in particular due to iron deficiency, is common in pregnancy with associated negative outcomes for mother and infant. However, there is evidence of significant variation in management. The objectives of this review of systematic reviews were to analyse and summarise the evidence base, identify gaps in the evidence and develop a research agenda for this important component of maternity care. Multiple databases were searched, including MEDLINE, EMBASE and The Cochrane Library. All systematic reviews relating to interventions to prevent and treat anaemia in the antenatal and postnatal period were eligible. Two reviewers independently assessed data inclusion, extraction and quality of methodology. 27 reviews were included, all reporting on the prevention and treatment of anaemia in the antenatal (n = 24) and postnatal periods (n = 3). Using AMSTAR as the assessment tool for methodological quality, only 12 of the 27 were rated as high quality reviews. The greatest number of reviews covered antenatal nutritional supplementation for the prevention of anaemia (n = 19). Iron supplementation was the most extensively researched, but with ongoing uncertainty about optimal dose and regimen. Few identified reviews addressed anaemia management post-partum or correlations between laboratory and clinical outcomes, and no reviews reported on clinical symptoms of anaemia. The review highlights evidence gaps including the management of anaemia in the postnatal period, screening for anaemia, and optimal interventions for treatment. Research priorities include developing standardised approaches to reporting of laboratory outcomes, and information on clinical outcomes relevant to the experiences of pregnant women.

Anti-bullying interventions in schools: a systematic literature review.

PubMed

Silva, Jorge Luiz da; Oliveira, Wanderlei Abadio de; Mello, Flávia Carvalho Malta de; Andrade, Luciane Sá de; Bazon, Marina Rezende; Silva, Marta Angélica Iossi

2017-07-01

This paper presents a systematic literature review addressing rigorously planned and assessed interventions intended to reduce school bullying. The search for papers was performed in four databases (Lilacs, Psycinfo, Scielo and Web of Science) and guided by the question: What are the interventions used to reduce bullying in schools? Only case-control studies specifically focusing on school bullying without a time frame were included. The methodological quality of investigations was assessed using the SIGN checklist. A total of 18 papers composed the corpus of analysis and all were considered to have high methodological quality. The interventions conducted in the revised studies were divided into four categories: multi-component or whole-school, social skills training, curricular, and computerized. The review synthesizes knowledge that can be used to contemplate practices and intervention programs in the education and health fields with a multidisciplinary nature.

Proactive telephone counseling for smoking cessation: meta-analyses by recruitment channel and methodological quality.

PubMed

Tzelepis, Flora; Paul, Christine L; Walsh, Raoul A; McElduff, Patrick; Knight, Jenny

2011-06-22

Systematic reviews demonstrated that proactive telephone counseling increases smoking cessation rates. However, these reviews did not differentiate studies by recruitment channel, did not adequately assess methodological quality, and combined different measures of abstinence. Twenty-four randomized controlled trials published before December 31, 2008, included seven of active recruitment, 16 of passive recruitment, and one of mixed recruitment. We rated methodological quality on selection bias, study design, confounders, blinding, data collection methods, withdrawals, and dropouts, according to the Quality Assessment Tool for Quantitative Studies. We conducted random effects meta-analysis to pool the results according to abstinence type and follow-up time for studies overall and segregated by recruitment channel, and methodological quality. The level of statistical heterogeneity was quantified by I(2). All statistical tests were two-sided. Methodological quality ratings indicated two strong, 10 moderate, and 12 weak studies. Overall, compared with self-help materials or no intervention control groups, proactive telephone counseling had a statistically significantly greater effect on point prevalence abstinence (nonsmoking at follow-up or abstinent for at least 24 hours, 7 days before follow-up) at 6-9 months (relative risk [RR] = 1.26, 95% confidence interval [CI] = 1.11 to 1.43, P < .001, I(2) = 21.4%) but not at 12-15 months after recruitment. This pattern also emerged when studies were segregated by recruitment channel (active, passive) or methodological quality (strong/moderate, weak). Overall, the positive effect on prolonged/continuous abstinence (abstinent for 3 months or longer before follow-up) was also statistically significantly greater at 6-9 months (RR = 1.58, CI = 1.26 to 1.98, P < .001, I(2) = 49.1%) and 12-18 months after recruitment (RR = 1.40, CI = 1.23 to 1.60, P < .001, I(2) = 18.5%). With the exception of point prevalence abstinence in the long term, these data support previous results showing that proactive telephone counseling has a positive impact on smoking cessation. Proactive telephone counseling increased prolonged/continuous abstinence long term for both actively and passively recruited smokers.

A Systematic Review of the Prevalence of Psychiatric Disorders in Adults with Intellectual Disability, 2003-2010

ERIC Educational Resources Information Center

Buckles, Jason; Luckasson, Ruth; Keefe, Elizabeth

2013-01-01

Research regarding the prevalence of psychiatric conditions co-occurring with intellectual disability in adults was reviewed. Particular attention was paid to the qualities of sampling and diagnostic methodology, which have been identified as needs in two recent reviews. Sixteen articles published in peer-reviewed journals between 2003 and 2009…

Frequency of data extraction errors and methods to increase data extraction quality: a methodological review.

PubMed

Mathes, Tim; Klaßen, Pauline; Pieper, Dawid

2017-11-28

Our objective was to assess the frequency of data extraction errors and its potential impact on results in systematic reviews. Furthermore, we evaluated the effect of different extraction methods, reviewer characteristics and reviewer training on error rates and results. We performed a systematic review of methodological literature in PubMed, Cochrane methodological registry, and by manual searches (12/2016). Studies were selected by two reviewers independently. Data were extracted in standardized tables by one reviewer and verified by a second. The analysis included six studies; four studies on extraction error frequency, one study comparing different reviewer extraction methods and two studies comparing different reviewer characteristics. We did not find a study on reviewer training. There was a high rate of extraction errors (up to 50%). Errors often had an influence on effect estimates. Different data extraction methods and reviewer characteristics had moderate effect on extraction error rates and effect estimates. The evidence base for established standards of data extraction seems weak despite the high prevalence of extraction errors. More comparative studies are needed to get deeper insights into the influence of different extraction methods.

Quality Measurement Recommendations Relevant to Clinical Guidelines in Germany and the United Kingdom: (What) Can We Learn From Each Other?

PubMed Central

Petzold, Thomas; Deckert, Stefanie; Williamson, Paula R.; Schmitt, Jochen

2018-01-01

We conducted a systematic review of clinical guidelines (CGs) to examine the methodological approaches of quality indicator derivation in CGs, the frequency of quality indicators to check CG recommendations in routine care, and clinimetric properties of quality indicators. We analyzed the publicly available CG databases of the Association of the Scientific Medical Societies in Germany (AWMF) and National Institute for Health and Care Excellence (NICE). Data on the methodology of subsequent quality indicator derivation, the content and definition of recommended quality indicators, and clinimetric properties of measurement instruments were extracted. In Germany, no explicit methodological guidance exists, but 3 different approaches are used. For NICE, a general approach is used for the derivation of quality indicators out of quality standards. Quality indicators were defined in 34 out of 87 CGs (39%) in Germany and for 58 out of 133 (43%) NICE CGs. Statements regarding measurement properties of instruments for quality indicator assessment were missing in German and NICE documents. Thirteen pairs of CGs (32%) have associated quality indicators. Thirty-four quality indicators refer to the same aspect of the quality of care, which corresponds to 27% of the German and 7% of NICE quality indicators. The development of a standardized and internationally accepted methodology for the derivation of quality indicators relevant to CGs is needed to measure and compare quality of care in health care systems. PMID:29591538

Terrorism, Radicalisation, Extremism, Authoritarianism and Fundamentalism: A Systematic Review of the Quality and Psychometric Properties of Assessments

PubMed Central

Scarcella, Akimi; Page, Ruairi; Furtado, Vivek

2016-01-01

Background Currently, terrorism and suicide bombing are global psychosocial processes that attracts a growing number of psychological and psychiatric contributions to enhance practical counter-terrorism measures. The present study is a systematic review that explores the methodological quality reporting and the psychometric soundness of the instruments developed to identify risk factors of terrorism, extremism, radicalisation, authoritarianism and fundamentalism. Method A systematic search strategy was established to identify instruments and studies developed to screen individuals at risk of committing extremist or terrorist offences using 20 different databases across the fields of law, medicine, psychology, sociology and politics. Information extracted was consolidated into two different tables and a 26-item checklist, reporting respectively background information, the psychometric properties of each tool, and the methodological quality markers of these tools. 37 articles met our criteria, which included a total of 4 instruments to be used operationally by professionals, 17 tools developed as research measures, and 9 inventories that have not been generated from a study. Results Just over half of the methodological quality markers required for a transparent methodological description of the instruments were reported. The amount of reported psychological properties was even fewer, with only a third of them available across the different studies. The category presenting the least satisfactory results was that containing the 4 instruments to be used operationally by professionals, which can be explained by the fact that half of them refrained from publishing the major part of their findings and relevant guidelines. Conclusions A great number of flaws have been identified through this systematic review. The authors encourage future researchers to be more thorough, comprehensive and transparent in their methodology. They also recommend the creation of a multi-disciplinary joint working group in order to best tackle this growing contemporary problem. PMID:28002457

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand

PubMed Central

2013-01-01

Background Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. Methods A systematic search of 17 electronic databases and 13 websites for the period 1981–2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Results Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. Conclusions There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise. PMID:23663493

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand.

PubMed

Clifford, Anton C; Doran, Christopher M; Tsey, Komla

2013-05-13

Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. A systematic search of 17 electronic databases and 13 websites for the period 1981-2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise.

Methodology and reporting of diagnostic accuracy studies of automated perimetry in glaucoma: evaluation using a standardised approach.

PubMed

Fidalgo, Bruno M R; Crabb, David P; Lawrenson, John G

2015-05-01

To evaluate methodological and reporting quality of diagnostic accuracy studies of perimetry in glaucoma and to determine whether there had been any improvement since the publication of the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines. A systematic review of English language articles published between 1993 and 2013 reporting the diagnostic accuracy of perimetry in glaucoma. Articles were appraised for methodological quality using the 14-item Quality assessment tool for diagnostic accuracy studies (QUADAS) and evaluated for quality of reporting by applying the STARD checklist. Fifty-eight articles were appraised. Overall methodological quality of these studies was moderate with a median number of QUADAS items rated as 'yes' equal to nine (out of a maximum of 14) (IQR 7-10). The studies were often poorly reported; median score of STARD items fully reported was 11 out of 25 (IQR 10-14). A comparison of the studies published in 10-year periods before and after the publication of the STARD checklist in 2003 found quality of reporting had not substantially improved. Methodological and reporting quality of diagnostic accuracy studies of perimetry is sub-optimal and appears not to have improved substantially following the development of the STARD reporting guidance. This observation is consistent with previous studies in ophthalmology and in other medical specialities. © 2015 The Authors Ophthalmic & Physiological Optics © 2015 The College of Optometrists.

Quality indicators for hip fracture patients: a scoping review protocol

PubMed Central

Pitzul, Kristen B; Munce, Sarah E P; Perrier, Laure; Beaupre, Lauren; Morin, Suzanne N; McGlasson, Rhona; Jaglal, Susan B

2014-01-01

Introduction Hip fractures are a significant cause of morbidity and mortality and care of hip fracture patients places a heavy burden on healthcare systems due to prolonged recovery time. Measuring quality of care delivered to hip fracture patients is important to help target efforts to improve care for patients and efficiency of the health system. The purpose of this study is to synthesise the evidence surrounding quality of care indicators for patients who have sustained a hip fracture. Using a scoping review methodology, the research question that will be addressed is: “What patient, institutional, and system-level indicators are currently in use or proposed for measuring quality of care across the continuum for individuals following a hip fracture?”. Methods and analysis We will employ the methodological frameworks used by Arksey and O'Malley and Levac et al. The synthesis will be limited to quality of care indicators for individuals who suffered low trauma hip fracture. All English peer-reviewed studies published from the year 2000-most recent will be included. Literature search strategies will be developed using medical subject headings and text words related to hip fracture quality indicators and the search will be peer-reviewed. Numerous electronic databases will be searched. Two reviewers will independently screen titles and abstracts for inclusion, followed by screening of the full text of potentially relevant articles to determine final inclusion. Abstracted data will include study characteristics and indicator definitions. Dissemination To improve quality of care for patients and create a more efficient healthcare system, mechanisms for the measurement of quality of care are required. The implementation of quality of care indicators enables stakeholders to target areas for improvement in service delivery. Knowledge translation activities will occur throughout the review with dissemination of the project goals and findings to local, national, and international stakeholders. PMID:25335964

Quality indicators for hip fracture patients: a scoping review protocol.

PubMed

Pitzul, Kristen B; Munce, Sarah E P; Perrier, Laure; Beaupre, Lauren; Morin, Suzanne N; McGlasson, Rhona; Jaglal, Susan B

2014-10-21

Hip fractures are a significant cause of morbidity and mortality and care of hip fracture patients places a heavy burden on healthcare systems due to prolonged recovery time. Measuring quality of care delivered to hip fracture patients is important to help target efforts to improve care for patients and efficiency of the health system. The purpose of this study is to synthesise the evidence surrounding quality of care indicators for patients who have sustained a hip fracture. Using a scoping review methodology, the research question that will be addressed is: "What patient, institutional, and system-level indicators are currently in use or proposed for measuring quality of care across the continuum for individuals following a hip fracture?". We will employ the methodological frameworks used by Arksey and O'Malley and Levac et al. The synthesis will be limited to quality of care indicators for individuals who suffered low trauma hip fracture. All English peer-reviewed studies published from the year 2000-most recent will be included. Literature search strategies will be developed using medical subject headings and text words related to hip fracture quality indicators and the search will be peer-reviewed. Numerous electronic databases will be searched. Two reviewers will independently screen titles and abstracts for inclusion, followed by screening of the full text of potentially relevant articles to determine final inclusion. Abstracted data will include study characteristics and indicator definitions. To improve quality of care for patients and create a more efficient healthcare system, mechanisms for the measurement of quality of care are required. The implementation of quality of care indicators enables stakeholders to target areas for improvement in service delivery. Knowledge translation activities will occur throughout the review with dissemination of the project goals and findings to local, national, and international stakeholders. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Efficacy and safety of Suanzaoren decoction for primary insomnia: a systematic review of randomized controlled trials

PubMed Central

2013-01-01

Background Insomnia is a widespread human health problem, but there currently are the limitations of conventional therapies available. Suanzaoren decoction (SZRD) is a well known classic Chinese herbal prescription for insomnia and has been treating people’s insomnia for more than thousand years. The objective of this study was to evaluate the efficacy and safety of SZRD for insomnia. Methods A systematic literature search was performed for 6 databases up to July of 2012 to identify randomized control trials (RCTs) involving SZRD for insomniac patients. The methodological quality of RCTs was assessed independently using the Cochrane Handbook for Systematic Reviews of Interventions. Results Twelve RCTs with total of 1376 adult participants were identified. The methodological quality of all included trials are no more than 3/8 score. Majority of the RCTs concluded that SZRD was more significantly effective than benzodiazepines for treating insomnia. Despite these positive outcomes, there were many methodological shortcomings in the studies reviewed, including insufficient information about randomization generation and absence of allocation concealment, lack of blinding and no placebo control, absence of intention-to-treat analysis and lack of follow-ups, selective publishing and reporting, and small number of sample sizes. A number of clinical heterogeneity such as diagnosis, intervention, control, and outcome measures were also reviewed. Only 3 trials reported adverse events, whereas the other 9 trials did not provide the safety information. Conclusions Despite the apparent reported positive findings, there is insufficient evidence to support efficacy of SZRD for insomnia due to the poor methodological quality and the small number of trials of the included studies. SZRD seems generally safe, but is insufficient evidence to make conclusions on the safety because fewer studies reported the adverse events. Further large sample-size and well-designed RCTs are needed. PMID:23336848

Social cognition interventions for people with schizophrenia: a systematic review focussing on methodological quality and intervention modality.

PubMed

Grant, Nina; Lawrence, Megan; Preti, Antonio; Wykes, Til; Cella, Matteo

2017-08-01

People with a diagnosis of schizophrenia have significant social and functional difficulties. Social cognition was found to influences these outcomes and in recent years interventions targeting this domain were developed. This paper reviews the existing literature on social cognition interventions for people with a diagnosis of schizophrenia focussing on: i) comparing focussed (i.e. targeting only one social cognitive domain) and global interventions and ii) studies methodological quality. Systematic search was conducted on PubMed and PsycInfo. Studies were included if they were randomised control trials, participants had a diagnosis of schizophrenia or schizoaffective disorder, and the intervention targeted at least one out of four social cognition domains (i.e. theory of mind, affect recognition, social perception and attribution bias). All papers were assessed for methodological quality. Information on the intervention, control condition, study methodology and the main findings from each study were extracted and critically summarised. Data from 32 studies fulfilled the inclusion criteria, considering a total of 1440 participants. Taking part in social cognition interventions produced significant improvements in theory of mind and affect recognition compared to both passive and active control conditions. Results were less clear for social perception and attributional bias. Focussed and global interventions had similar results on outcomes. Overall study methodological quality was modest. There was very limited evidence showing that social cognitive intervention result in functional outcome improvement. The evidence considered suggests that social cognition interventions may be a valuable approach for people with a diagnosis of schizophrenia. However, evidence quality is limited by measure heterogeneity, modest study methodology and short follow-up periods. The findings point to a number of recommendations for future research, including measurement standardisation, appropriately powered studies and investigation of the impact of social cognition improvements on functioning problems. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Assessment of Patient Empowerment - A Systematic Review of Measures

PubMed Central

Barr, Paul J.; Scholl, Isabelle; Bravo, Paulina; Faber, Marjan J.; Elwyn, Glyn; McAllister, Marion

2015-01-01

Background Patient empowerment has gained considerable importance but uncertainty remains about the best way to define and measure it. The validity of empirical findings depends on the quality of measures used. This systematic review aims to provide an overview of studies assessing psychometric properties of questionnaires purporting to capture patient empowerment, evaluate the methodological quality of these studies and assess the psychometric properties of measures identified. Methods Electronic searches in five databases were combined with reference tracking of included articles. Peer-reviewed articles reporting psychometric testing of empowerment measures for adult patients in French, German, English, Portuguese and Spanish were included. Study characteristics, constructs operationalised and psychometric properties were extracted. The quality of study design, methods and reporting was assessed using the COSMIN checklist. The quality of psychometric properties was assessed using Terwee’s 2007 criteria. Findings 30 studies on 19 measures were included. Six measures are generic, while 13 were developed for a specific condition (N=4) or specialty (N=9). Most studies tested measures in English (N=17) or Swedish (N=6). Sample sizes of included studies varied from N=35 to N=8261. A range of patient empowerment constructs was operationalised in included measures. These were classified into four domains: patient states, experiences and capacities; patient actions and behaviours; patient self-determination within the healthcare relationship and patient skills development. Quality assessment revealed several flaws in methodological study quality with COSMIN scores mainly fair or poor. The overall quality of psychometric properties of included measures was intermediate to positive. Certain psychometric properties were not tested for most measures. Discussion Findings provide a basis from which to develop consensus on a core set of patient empowerment constructs and for further work to develop a (set of) appropriately validated measure(s) to capture this. The methodological quality of psychometric studies could be improved by adhering to published quality criteria. PMID:25970618

The quality of dietary intake methodology and reporting in child and adolescent obesity intervention trials: a systematic review.

PubMed

Burrows, T; Golley, R K; Khambalia, A; McNaughton, S A; Magarey, A; Rosenkranz, R R; Alllman-Farinelli, M; Rangan, A M; Truby, H; Collins, C

2012-12-01

Assessing dietary intake is important in evaluating childhood obesity intervention effectiveness. The purpose of this review was to evaluate the dietary intake methods and reporting in intervention studies that included a dietary component to treat overweight or obese children. A systematic review of studies published in the English language, between 1985 and August 2010 in health databases. The search identified 2,295 papers, of which 335 were retrieved and 31 met the inclusion criteria. Twenty-three studies reported energy intake as an outcome measure, 20 reported macronutrient intakes and 10 studies reported food intake outcomes. The most common dietary method employed was the food diary (n = 13), followed by 24-h recall (n = 5), food frequency questionnaire (FFQ) (n = 4) and dietary questionnaire (n = 4). The quality of the dietary intake methods reporting was rated as 'poor' in 15 studies (52%) and only 3 were rated as 'excellent'. The reporting quality of FFQs tended to be higher than food diaries/recalls. Deficiencies in the quality of dietary intake methods reporting in child obesity studies were identified. Use of a dietary intake methods reporting checklist is recommended. This will enable the quality of dietary intake results to be evaluated, and an increased ability to replicate study methodology by other researchers. © 2012 The Authors. obesity reviews © 2012 International Association for the Study of Obesity.

Simulation modeling for stratified breast cancer screening - a systematic review of cost and quality of life assumptions.

PubMed

Arnold, Matthias

2017-12-02

The economic evaluation of stratified breast cancer screening gains momentum, but produces also very diverse results. Systematic reviews so far focused on modeling techniques and epidemiologic assumptions. However, cost and utility parameters received only little attention. This systematic review assesses simulation models for stratified breast cancer screening based on their cost and utility parameters in each phase of breast cancer screening and care. A literature review was conducted to compare economic evaluations with simulation models of personalized breast cancer screening. Study quality was assessed using reporting guidelines. Cost and utility inputs were extracted, standardized and structured using a care delivery framework. Studies were then clustered according to their study aim and parameters were compared within the clusters. Eighteen studies were identified within three study clusters. Reporting quality was very diverse in all three clusters. Only two studies in cluster 1, four studies in cluster 2 and one study in cluster 3 scored high in the quality appraisal. In addition to the quality appraisal, this review assessed if the simulation models were consistent in integrating all relevant phases of care, if utility parameters were consistent and methodological sound and if cost were compatible and consistent in the actual parameters used for screening, diagnostic work up and treatment. Of 18 studies, only three studies did not show signs of potential bias. This systematic review shows that a closer look into the cost and utility parameter can help to identify potential bias. Future simulation models should focus on integrating all relevant phases of care, using methodologically sound utility parameters and avoiding inconsistent cost parameters.

Measures and Indicators of Vgi Quality: AN Overview

NASA Astrophysics Data System (ADS)

Antoniou, V.; Skopeliti, A.

2015-08-01

The evaluation of VGI quality has been a very interesting and popular issue amongst academics and researchers. Various metrics and indicators have been proposed for evaluating VGI quality elements. Various efforts have focused on the use of well-established methodologies for the evaluation of VGI quality elements against authoritative data. In this paper, a number of research papers have been reviewed and summarized in a detailed report on measures for each spatial data quality element. Emphasis is given on the methodology followed and the data used in order to assess and evaluate the quality of the VGI datasets. However, as the use of authoritative data is not always possible many researchers have turned their focus on the analysis of new quality indicators that can function as proxies for the understanding of VGI quality. In this paper, the difficulties in using authoritative datasets are briefly presented and new proposed quality indicators are discussed, as recorded through the literature review. We classify theses new indicators in four main categories that relate with: i) data, ii) demographics, iii) socio-economic situation and iv) contributors. This paper presents a dense, yet comprehensive overview of the research on this field and provides the basis for the ongoing academic effort to create a practical quality evaluation method through the use of appropriate quality indicators.

Quality of life among adult patients with neurofibromatosis 1, neurofibromatosis 2 and schwannomatosis: a systematic review of the literature.

PubMed

Vranceanu, Ana-Maria; Merker, Vanessa L; Park, Elyse; Plotkin, Scott R

2013-09-01

The aim of this study was to review the literature on quality of life among adult patients with neurofibromatosis 1, neurofibromatosis 2 and schwannomatosis, and to identify the specific aspects of quality of life that were studied and reported in this population. We also set out to report predictors of quality of life. Published research reports were included if they described quality of life in this population and met methodological quality according to a list of predefined criteria. Eight studies (7 in NF1, 1 in NF2, 0 in schwannomatosis), conducted between 2001 and 2013, met inclusion criteria. The methodological quality of the eight studies was mostly high according to ratings by predefined criteria. Most studies reported that patients with NF experience decreased quality of life when compared to the general population. Visibility and disease severity were strong predictors of skin-specific quality of life in NF1 patients. However, the majority of findings regarding predictors of quality of life were weak or inconclusive. Given the decreased quality of life in NF patients, it is important to examine more comprehensively the psychosocial factors in this population, especially in patients with NF2 and schwannomatosis. Mind body interventions that address these domains may provide comprehensive and efficacious long term treatment.

A systematic review of economic evaluations of treatments for patients with epilepsy.

PubMed

Wijnen, Ben F M; van Mastrigt, Ghislaine A P G; Evers, Silvia M A A; Gershuni, Olga; Lambrechts, Danielle A J E; Majoie, Marian H J M; Postulart, Debby; Aldenkamp, Bert A P; de Kinderen, Reina J A

2017-05-01

The increasing number of treatment options and the high costs associated with epilepsy have fostered the development of economic evaluations in epilepsy. It is important to examine the availability and quality of these economic evaluations and to identify potential research gaps. As well as looking at both pharmacologic (antiepileptic drugs [AEDs]) and nonpharmacologic (e.g., epilepsy surgery, ketogenic diet, vagus nerve stimulation) therapies, this review examines the methodologic quality of the full economic evaluations included. Literature search was performed in MEDLINE, EMBASE, NHS Economic Evaluation Database (NHS EED), Econlit, Web of Science, and CEA Registry. In addition, Cochrane Reviews, Cochrane DARE and Cochrane Health Technology Assessment Databases were used. To identify relevant studies, predefined clinical search strategies were combined with a search filter designed to identify health economic studies. Specific search strategies were devised for the following topics: (1) AEDs, (2) patients with cognitive deficits, (3) elderly patients, (4) epilepsy surgery, (5) ketogenic diet, (6) vagus nerve stimulation, and (7) treatment of (non)convulsive status epilepticus. A total of 40 publications were included in this review, 29 (73%) of which were articles about pharmacologic interventions. Mean quality score of all articles on the Consensus Health Economic Criteria (CHEC)-extended was 81.8%, the lowest quality score being 21.05%, whereas five studies had a score of 100%. Looking at the Consolidated Health Economic Evaluation Reporting Standards (CHEERS), the average quality score was 77.0%, the lowest being 22.7%, and four studies rated as 100%. There was a substantial difference in methodology in all included articles, which hampered the attempt to combine information meaningfully. Overall, the methodologic quality was acceptable; however, some studies performed significantly worse than others. The heterogeneity between the studies stresses the need to define a reference case (e.g., how should an economic evaluation within epilepsy be performed) and to derive consensus on what constitutes "standard optimal care." Wiley Periodicals, Inc. © 2017 International League Against Epilepsy.

A systematic assessment of Cochrane reviews and systematic reviews published in high-impact medical journals related to cancer.

PubMed

Goldkuhle, Marius; Narayan, Vikram M; Weigl, Aaron; Dahm, Philipp; Skoetz, Nicole

2018-03-25

To compare cancer-related systematic reviews (SRs) published in the Cochrane Database of SRs (CDSR) and high-impact journals, with respect to type, content, quality and citation rates. Methodological SR with assessment and comparison of SRs and meta-analyses. Two authors independently assessed methodological quality using an Assessment of Multiple Systematic Reviews (AMSTAR)-based extraction form. Both authors independently screened search results, extracted content-relevant characteristics and retrieved citation numbers of the included reviews using the Clarivate Analytics Web of Science database. Cancer-related SRs were retrieved from the CDSR, as well as from the 10 journals which publish oncological SRs and had the highest impact factors, using a comprehensive search in both the CDSR and MEDLINE. We included all cancer-related SRs and meta-analyses published from January 2011 to May 2016. Methodological SRs were excluded. We included 346 applicable Cochrane reviews and 215 SRs from high-impact journals. Cochrane reviews consistently met more individual AMSTAR criteria, notably with regard to an a priori design (risk ratio (RR) 3.89; 95% CI 3.10 to 4.88), inclusion of the grey literature and trial registries (RR 3.52; 95% CI 2.84 to 4.37) in their searches, and the reporting of excluded studies (RR 8.80; 95% CI 6.06 to 12.78). Cochrane reviews were less likely to address questions of prognosis (RR 0.04; 95% CI 0.02 to 0.09), use individual patient data (RR 0.03; 95% CI 0.01 to 0.09) or be based on non-randomised controlled trials (RR 0.04; 95% CI 0.02 to 0.09). Citation rates of Cochrane reviews were notably lower than those for high-impact journals (Cochrane reviews: mean number of citations 6.52 (range 0-143); high-impact journal SRs: 74.45 (0-652)). When comparing cancer-related SRs published in the CDSR versus those published in high-impact medical journals, Cochrane reviews were consistently of higher methodological quality, but cited less frequently. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Systematic review of the evidence related to mandated nurse staffing ratios in acute hospitals.

PubMed

Olley, Richard; Edwards, Ian; Avery, Mark; Cooper, Helen

2018-04-17

Objective The purpose of this systematic review was to evaluate and summarise available research on nurse staffing methods and relate these to outcomes under three overarching themes of: (1) management of clinical risk, quality and safety; (2) development of a new or innovative staffing methodology; and (3) equity of nursing workload. Methods The PRISMA method was used. Relevant articles were located by searching via the Griffith University Library electronic catalogue, including articles on PubMed, Cumulative Index to Nursing and Allied Health Literature (CINAHL) and Medline. Only English language publications published between 1 January 2010 and 30 April 2016 focusing on methodologies in acute hospital in-patient units were included in the present review. Results Two of the four staffing methods were found to have evidenced-based articles from empirical studies within the parameters set for inclusion. Of the four staffing methodologies searched, supply and demand returned 10 studies and staffing ratios returned 11. Conclusions There is a need to develop an evidence-based nurse-sensitive outcomes measure upon which staffing for safety, quality and workplace equity, as well as an instrument that reliability and validly projects nurse staffing requirements in a variety of clinical settings. Nurse-sensitive indicators reflect elements of patient care that are directly affected by nursing practice In addition, these measures must take into account patient satisfaction, workload and staffing, clinical risks and other measures of the quality and safety of care and nurses' work satisfaction. i. What is known about the topic? Nurse staffing is a controversial topic that has significant patient safety, quality of care, human resources and financial implications. In acute care services, nursing accounts for approximately 70% of salaries and wages paid by health services budgets, and evidence as to the efficacy and effectiveness of any staffing methodology is required because it has workforce and industrial relations implications. Although there is significant literature available on the topic, there is a paucity of empirical evidence supporting claims of increased patient safety in the acute hospital setting, but some evidence exists relating to equity of workload for nurses. What does this paper add? This paper provides a contemporary qualitative analysis of empirical evidence using PRISMA methodology to conduct a systematic review of the available literature. It demonstrates a significant research gap to support claims of increased patient safety in the acute hospital setting. The paper calls for greatly improved datasets upon which research can be undertaken to determine any associations between mandated patient to nurse ratios and other staffing methodologies and patient safety and quality of care. What are the implications for practitioners? There is insufficient contemporary research to support staffing methodologies for appropriate staffing, balanced workloads and quality, safe care. Such research would include the establishment of nurse-sensitive patient outcomes measures, and more robust datasets are needed for empirical analysis to produce such evidence.

Efficacy of surgery for rotator cuff tendinopathy: a systematic review.

PubMed

Toliopoulos, Panagiota; Desmeules, François; Boudreault, Jennifer; Roy, Jean-Sébastien; Frémont, Pierre; MacDermid, Joy C; Dionne, Clermont E

2014-01-01

The objective of this study is to review randomized controlled trials evaluating the efficacy of surgery for the treatment of rotator cuff (RC) tendinopathy. Studies up to August 2013 were located in the PubMed, Embase, CINAHL, and PEDro databases using relevant keywords. Studies were included if: (1) participants had rotator cuff tendinopathy, (2) the trials were conducted on an adult population (≥18 years old), (3) at least one of the interventions studied was a surgical procedure, (4) study design was a randomized controlled trial (RCT), and (5) the article was written in English or French. Characteristics of the included studies were extracted using a standardized form. Two independent raters reviewed the methodological quality of the studies using the Risk of Bias Assessment tool developed by the Cochrane Collaboration Group. Differences were resolved by consensus. Fifteen trials met our inclusion criteria. After consensus, the mean methodological quality for all studies was 58.9 ± 10.8 %. In three out of four RCTs of moderate or low methodological quality, no significant difference in treatment effectiveness was observed between open or arthroscopic acromioplasty compared to exercises in the treatment of RC tendinopathy. Based on two studies of low or moderate methodological quality, no difference in treatment effectiveness was observed between arthroscopic and open acromioplasty. Two other RCTs of low to moderate quality, however, found that arthroscopic acromioplasty yielded better results in the short-term for shoulder range of motion in flexion but that both procedures were comparable in the long-term. One additional study favored open acromioplasty over arthroscopic acromioplasty for the treatment of RC tendinopathy. Based on low- to moderate-quality evidence, acromioplasty, be it open or arthroscopic, is no more effective than exercises for the treatment of RC tendinopathy. Low-grade evidence also suggests that arthroscopic acromioplasty may yield better results in the short-term for shoulder range of motion in flexion compared to open acromioplasty, but long-term results are comparable between the two types of surgery. More high-quality RCTs are required in order to provide comprehensive treatment guidelines to healthcare providers.

Systematic review of the methodological quality of controlled trials evaluating Chinese herbal medicine in patients with rheumatoid arthritis

PubMed Central

Pan, Xin; Lopez-Olivo, Maria A; Song, Juhee; Pratt, Gregory; Suarez-Almazor, Maria E

2017-01-01

Objectives We appraised the methodological and reporting quality of randomised controlled clinical trials (RCTs) evaluating the efficacy and safety of Chinese herbal medicine (CHM) in patients with rheumatoid arthritis (RA). Design For this systematic review, electronic databases were searched from inception until June 2015. The search was limited to humans and non-case report studies, but was not limited by language, year of publication or type of publication. Two independent reviewers selected RCTs, evaluating CHM in RA (herbals and decoctions). Descriptive statistics were used to report on risk of bias and their adherence to reporting standards. Multivariable logistic regression analysis was performed to determine study characteristics associated with high or unclear risk of bias. Results Out of 2342 unique citations, we selected 119 RCTs including 18 919 patients: 10 108 patients received CHM alone and 6550 received one of 11 treatment combinations. A high risk of bias was observed across all domains: 21% had a high risk for selection bias (11% from sequence generation and 30% from allocation concealment), 85% for performance bias, 89% for detection bias, 4% for attrition bias and 40% for reporting bias. In multivariable analysis, fewer authors were associated with selection bias (allocation concealment), performance bias and attrition bias, and earlier year of publication and funding source not reported or disclosed were associated with selection bias (sequence generation). Studies published in non-English language were associated with reporting bias. Poor adherence to recommended reporting standards (<60% of the studies not providing sufficient information) was observed in 11 of the 23 sections evaluated. Limitations Study quality and data extraction were performed by one reviewer and cross-checked by a second reviewer. Translation to English was performed by one reviewer in 85% of the included studies. Conclusions Studies evaluating CHM often fail to meet expected methodological criteria, and high-quality evidence is lacking. PMID:28249848

Prevalence of Back Pain in Sports: A Systematic Review of the Literature.

PubMed

Trompeter, Katharina; Fett, Daniela; Platen, Petra

2017-06-01

Back pain is a frequent health problem in the general population. The epidemiology of back pain in the general population is well researched, but detailed data on the prevalence and risk factors of back pain in athletes are rare. The primary objective was to review articles about back pain in athletes to provide an overview of its prevalence in different sports and compare its prevalence among various types of sports and the general population. A comprehensive search of articles published through May 2015 was conducted. Two independent reviewers searched six databases from inception (PubMed ® , Embase, MEDLINE ® , Cochrane Library, PsycINFO and PSYNDEX), using specifically developed search strategies, for relevant epidemiological research on back pain in 14- to 40-year-old athletes of Olympic disciplines. The reviewers independently evaluated the methodological quality of reviewed articles meeting the inclusion criteria to identify potential sources of bias. Relevant data were extracted from each study. Forty-three articles were judged to meet the inclusion criteria and were included in the assessment of methodological quality. Of these, 25 were assessed to be of high quality. Lifetime prevalence and point prevalence were the most commonly researched episodes and the lower back was the most common localization of pain. In the high-quality studies, lifetime prevalence of low back pain in athletes was 1-94%, (highest prevalence in rowing and cross-country skiing), and point prevalence of low back pain was 18-65% (lowest prevalence in basketball and highest prevalence in rowing). The methodological heterogeneity of the included studies showed a wide range of prevalence rates and did not enable a detailed comparison of data among different sports, within one discipline, or versus the general population. Based on the results of this review, however, it seems obvious that back pain requires further study in some sports.

Effects of obesity on lung volume and capacity in children and adolescents: a systematic review

PubMed Central

Winck, Aline Dill; Heinzmann-Filho, João Paulo; Soares, Rafaela Borges; da Silva, Juliana Severo; Woszezenki, Cristhiele Taís; Zanatta, Letiane Bueno

2016-01-01

Abstract Objective: To assess the effects of obesity on lung volume and capacity in children and adolescents. Data source: This is a systematic review, carried out in Pubmed, Lilacs, Scielo and PEDro databases, using the following Keywords: Plethysmography; Whole Body OR Lung Volume Measurements OR Total Lung Capacity OR Functional Residual Capacity OR Residual Volume AND Obesity. Observational studies or clinical trials that assessed the effects of obesity on lung volume and capacity in children and adolescents (0-18 years) without any other associated disease; in English; Portuguese and Spanish languages were selected. Methodological quality was assessed by the Agency for Healthcare Research and Quality. Data synthesis: Of the 1,030 articles, only four were included in the review. The studies amounted to 548 participants, predominantly males, with sample size ranging from 45 to 327 individuals. 100% of the studies evaluated nutritional status through BMI (z-score) and 50.0% reported the data on abdominal circumference. All demonstrated that obesity causes negative effects on lung volume and capacity, causing a reduction mainly in functional residual capacity in 75.0% of the studies; in the expiratory reserve volume in 50.0% and in the residual volume in 25.0%. The methodological quality ranged from moderate to high, with 75.0% of the studies classified as having high methodological quality. Conclusions: Obesity causes deleterious effects on lung volume and capacity in children and adolescents, mainly by reducing functional residual capacity, expiratory reserve volume and residual volume. PMID:27130483

Are normative sonographic values of kidney size in children valid and reliable? A systematic review of the methodological quality of ultrasound studies using the Anatomical Quality Assessment (AQUA) tool.

PubMed

Chhapola, Viswas; Tiwari, Soumya; Deepthi, Bobbity; Henry, Brandon Michael; Brar, Rekha; Kanwal, Sandeep Kumar

2018-06-01

A plethora of research is available on ultrasonographic kidney size standards. We performed a systematic review of methodological quality of ultrasound studies aimed at developing normative renal parameters in healthy children, by evaluating the risk of bias (ROB) using the 'Anatomical Quality Assessment (AQUA)' tool. We searched Medline, Scopus, CINAHL, and Google Scholar on June 04 2018, and observational studies measuring kidney size by ultrasonography in healthy children (0-18 years) were included. The ROB of each study was evaluated in five domains using a 20 item coding scheme based on AQUA tool framework. Fifty-four studies were included. Domain 1 (subject characteristics) had a high ROB in 63% of studies due to the unclear description of age, sex, and ethnicity. The performance in Domain 2 (study design) was the best with 85% of studies having a prospective design. Methodological characterization (Domain 3) was poor across the studies (< 10% compliance), with suboptimal performance in the description of patient positioning, operator experience, and assessment of intra/inter-observer reliability. About three-fourth of the studies had a low ROB in Domain 4 (descriptive anatomy). Domain 5 (reporting of results) had a high ROB in approximately half of the studies, the majority reporting results in the form of central tendency measures. Significant deficiencies and heterogeneity were observed in the methodological quality of USG studies performed to-date for measurement of kidney size in children. We hereby provide a framework for the conducting such studies in future. PROSPERO (CRD42017071601).

Tailored Communication Within Mobile Apps for Diabetes Self-Management: A Systematic Review.

PubMed

Holmen, Heidi; Wahl, Astrid Klopstad; Cvancarova Småstuen, Milada; Ribu, Lis

2017-06-23

The prevalence of diabetes is increasing and with the requirements for self-management and risk of late complications, it remains a challenge for the individual and society. Patients can benefit from support from health care personnel in their self-management, and the traditional communication between patients and health care personnel is changing. Smartphones and apps offer a unique platform for communication, but apps with integrated health care personnel communication based on patient data are yet to be investigated to provide evidence of possible effects. Our goal was to systematically review studies that aimed to evaluate integrated communication within mobile apps for tailored feedback between patients with diabetes and health care personnel in terms of (1) study characteristics, (2) functions, (3) study outcomes, (4) effects, and (5) methodological quality. A systematic literature search was conducted following our International Prospective Register of Systematic Reviews (PROSPERO) protocol, searching for apps with integrated communication for persons with diabetes tested in a controlled trial in the period 2008 to 2016. We searched the databases PubMed, Medical Literature Analysis and Retrieval System Online (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Central, Excerpta Medica database (EMBASE), ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform. The search was closed in September 2016. Reference lists of primary articles and review papers were assessed. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed, and we applied the Cochrane risk of bias tool to assess methodological quality. We identified 2822 citations and after duplicate removal, we assessed 1128 citations. A total of 6 papers were included in this systematic review, reporting on data from 431 persons participating in small trials of short duration. The integrated communication features were mostly individualized as written non-real-time feedback. The number of functions varied from 2 to 9, and blood glucose tracking was the most common. HbA 1c was the most common primary outcome, but the remaining reported outcomes were not standardized and comparable. Because of both the heterogeneity of the included trials and the poor methodological quality of the studies, a meta-analysis was not possible. A statistically significant improvement in the primary measure of outcome was found in 3 of the 6 included studies, of which 2 were HbA 1c and 1 was mean daytime ambulatory blood pressure. Participants in the included trials reported positive usability or feasibility postintervention in 5 out of 6 trials. The overall methodological quality of the trials was, however, scored as an uncertain risk of bias. This systematic review highlights the need for more trials of higher methodological quality. Few studies offer an integrated function for communication and feedback from health care personnel, and the research field represents an area of heterogeneity with few studies of highly rigorous methodological quality. This, in combination with a low number of participants and a short follow-up, is making it difficult to provide reliable evidence of effects for stakeholders. ©Heidi Holmen, Astrid Klopstad Wahl, Milada Cvancarova Småstuen, Lis Ribu. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.06.2017.

Interventions for treating pain and disability in adults with complex regional pain syndrome.

PubMed

O'Connell, Neil E; Wand, Benedict M; McAuley, James; Marston, Louise; Moseley, G Lorimer

2013-04-30

There is currently no strong consensus regarding the optimal management of complex regional pain syndrome although a multitude of interventions have been described and are commonly used. To summarise the evidence from Cochrane and non-Cochrane systematic reviews of the effectiveness of any therapeutic intervention used to reduce pain, disability or both in adults with complex regional pain syndrome (CRPS). We identified Cochrane reviews and non-Cochrane reviews through a systematic search of the following databases: Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects (DARE), Ovid MEDLINE, Ovid EMBASE, CINAHL, LILACS and PEDro. We included non-Cochrane systematic reviews where they contained evidence not covered by identified Cochrane reviews. The methodological quality of reviews was assessed using the AMSTAR tool.We extracted data for the primary outcomes pain, disability and adverse events, and the secondary outcomes of quality of life, emotional well being and participants' ratings of satisfaction or improvement. Only evidence arising from randomised controlled trials was considered. We used the GRADE system to assess the quality of evidence. We included six Cochrane reviews and 13 non-Cochrane systematic reviews. Cochrane reviews demonstrated better methodological quality than non-Cochrane reviews. Trials were typically small and the quality variable.There is moderate quality evidence that intravenous regional blockade with guanethidine is not effective in CRPS and that the procedure appears to be associated with the risk of significant adverse events.There is low quality evidence that bisphosphonates, calcitonin or a daily course of intravenous ketamine may be effective for pain when compared with placebo; graded motor imagery may be effective for pain and function when compared with usual care; and that mirror therapy may be effective for pain in post-stroke CRPS compared with a 'covered mirror' control. This evidence should be interpreted with caution. There is low quality evidence that local anaesthetic sympathetic blockade is not effective. Low quality evidence suggests that physiotherapy or occupational therapy are associated with small positive effects that are unlikely to be clinically important at one year follow up when compared with a social work passive attention control.For a wide range of other interventions, there is either no evidence or very low quality evidence available from which no conclusions should be drawn. There is a critical lack of high quality evidence for the effectiveness of most therapies for CRPS. Until further larger trials are undertaken, formulating an evidence-based approach to managing CRPS will remain difficult.

Ultrasound for assessing disease activity in IBD patients: a systematic review of activity scores.

PubMed

Bots, S; Nylund, K; Löwenberg, M; Gecse, K; Gilja, O H; D'Haens, G

2018-04-19

Ultrasound (US) indices for assessing disease activity in IBD patients have never been critically reviewed. We aimed to systematically review the quality and reliability of available ultrasound (US) indices compared with reference standards for grading disease activity in IBD patients. Pubmed, Embase and Medline were searched from 1990 until June 2017. Relevant publications were identified through full text review after initial screening by 2 investigators. Data on methodology and index characteristics were collected. Study quality was assessed with a modified version of the Quadas-2 tool for risk of bias assessment. Of 20 studies with an US index, 11 studies met the inclusion criteria. Out of these 11 studies, 7 and 4 studied CD and UC activity indices, respectively. Parameters that were used in these indices included bowel wall thickness (BWT), Doppler signal (DS), wall layer stratification (WLS), compressibility, peristalsis, haustrations, fatty wrapping, contrast enhancement (CE) and strain pattern. Study quality was graded high in 5 studies, moderate in 3 studies and low in 3 studies. Ileocolonoscopy was used as the reference standard in 9 studies. In 1 study a combined index of ileocolonoscopy and barium contrast radiography and in 1 study histology was used as the reference standard. Only 5 studies used an established endoscopic index for comparison with US. Several US indices for assessing disease activity in IBD are available; however the methodology for development was suboptimal in most studies. For the development of future indices stringent methodological design is required.

Quality of reporting in oncology phase II trials: A 5-year assessment through systematic review.

PubMed

Langrand-Escure, Julien; Rivoirard, Romain; Oriol, Mathieu; Tinquaut, Fabien; Rancoule, Chloé; Chauvin, Frank; Magné, Nicolas; Bourmaud, Aurélie

2017-01-01

Phase II clinical trials are a cornerstone of the development in experimental treatments They work as a "filter" for phase III trials confirmation. Surprisingly the attrition ratio in Phase III trials in oncology is significantly higher than in any other medical specialty. This suggests phase II trials in oncology fail to achieve their goal. Objective The present study aims at estimating the quality of reporting in published oncology phase II clinical trials. A literature review was conducted among all phase II and phase II/III clinical trials published during a 5-year period (2010-2015). All articles electronically published by three randomly-selected oncology journals with Impact-Factors>4 were included: Journal of Clinical Oncology, Annals of Oncology and British Journal of Cancer. Quality of reporting was assessed using the Key Methodological Score. 557 articles were included. 315 trials were single-arm studies (56.6%), 193 (34.6%) were randomized and 49 (8.8%) were non-randomized multiple-arm studies. The Methodological Score was equal to 0 (lowest level), 1, 2, 3 (highest level) respectively for 22 (3.9%), 119 (21.4%), 270 (48.5%) and 146 (26.2%) articles. The primary end point is almost systematically reported (90.5%), while sample size calculation is missing in 66% of the articles. 3 variables were independently associated with reporting of a high standard: presence of statistical design (p-value <0.001), multicenter trial (p-value = 0.012), per-protocol analysis (p-value <0.001). Screening was mainly performed by a sole author. The Key Methodological Score was based on only 3 items, making grey zones difficult to translate. This literature review highlights the existence of gaps concerning the quality of reporting. It therefore raised the question of the suitability of the methodology as well as the quality of these trials, reporting being incomplete in the corresponding articles.

Quality of reporting in oncology phase II trials: A 5-year assessment through systematic review

PubMed Central

Langrand-Escure, Julien; Rivoirard, Romain; Oriol, Mathieu; Tinquaut, Fabien; Rancoule, Chloé; Chauvin, Frank; Magné, Nicolas; Bourmaud, Aurélie

2017-01-01

Background Phase II clinical trials are a cornerstone of the development in experimental treatments They work as a "filter" for phase III trials confirmation. Surprisingly the attrition ratio in Phase III trials in oncology is significantly higher than in any other medical specialty. This suggests phase II trials in oncology fail to achieve their goal. Objective The present study aims at estimating the quality of reporting in published oncology phase II clinical trials. Data sources A literature review was conducted among all phase II and phase II/III clinical trials published during a 5-year period (2010–2015). Study eligibility criteria All articles electronically published by three randomly-selected oncology journals with Impact-Factors>4 were included: Journal of Clinical Oncology, Annals of Oncology and British Journal of Cancer. Intervention Quality of reporting was assessed using the Key Methodological Score. Results 557 articles were included. 315 trials were single-arm studies (56.6%), 193 (34.6%) were randomized and 49 (8.8%) were non-randomized multiple-arm studies. The Methodological Score was equal to 0 (lowest level), 1, 2, 3 (highest level) respectively for 22 (3.9%), 119 (21.4%), 270 (48.5%) and 146 (26.2%) articles. The primary end point is almost systematically reported (90.5%), while sample size calculation is missing in 66% of the articles. 3 variables were independently associated with reporting of a high standard: presence of statistical design (p-value <0.001), multicenter trial (p-value = 0.012), per-protocol analysis (p-value <0.001). Limitations Screening was mainly performed by a sole author. The Key Methodological Score was based on only 3 items, making grey zones difficult to translate. Conclusions & implications of key findings This literature review highlights the existence of gaps concerning the quality of reporting. It therefore raised the question of the suitability of the methodology as well as the quality of these trials, reporting being incomplete in the corresponding articles. PMID:29216190

Crowding measures associated with the quality of emergency department care: a systematic review.

PubMed

Stang, Antonia S; Crotts, Jennifer; Johnson, David W; Hartling, Lisa; Guttmann, Astrid

2015-06-01

Despite the substantial body of literature on emergency department (ED) crowding, to the best of our knowledge, there is no agreement on the measure or measures that should be used to quantify crowding. The objective of this systematic review was to identify existing measures of ED crowding that have been linked to quality of care as defined by the Institute of Medicine (IOM) quality domains (safe, effective, patient-centered, efficient, timely, and equitable). Six major bibliographic databases were searched from January 1980 to January 2012, and hand searches were conducted of relevant journals and conference proceedings. Observational studies (cross-sectional, cohort, and case-control), quality improvement studies, quasi-experimental (e.g., before/after) studies, and randomized controlled trials were considered for inclusion. Studies that did not provide measures of ED crowding were excluded. Studies that did not provide quantitative data on the link between crowding measures and quality of care were also excluded. Two independent reviewers assessed study eligibility, completed data extraction, and assessed study quality using the Newcastle-Ottawa Quality Assessment Scale (NOS) for observational studies and a modified version of the NOS for cross-sectional studies. The search identified 7,413 articles. Thirty-two articles were included in the review: six cross-sectional, one case-control, 23 cohort, and two retrospective reviews of performance improvement data. Methodologic quality was moderate, with weaknesses in the reporting of study design and methodology. Overall, 15 of the crowding measures studied had quantifiable links to quality of care. The three measures most frequently linked to quality of care were the number of patients in the waiting room, ED occupancy (percentage of overall ED beds filled), and the number of admitted patients in the ED awaiting inpatient beds. None of the articles provided data on the link between crowding measures and the IOM domains reflecting equitable and efficient care. The results of this review provide data on the association between ED crowding measures and quality of care. Three simple crowding measures have been linked to quality of care in multiple publications. © 2015 by the Society for Academic Emergency Medicine.

Issues and Advances in the Systematic Review of Single-Case Research: A Commentary on the Exemplars

ERIC Educational Resources Information Center

Manolov, Rumen; Guilera, Georgina; Solanas, Antonio

2017-01-01

The current text comments on three systematic reviews published in the special section "Issues and Advances in the Systematic Review of Single-Case Research: An Update and Exemplars." The commentary is provided in relation to the need to combine the assessment of the methodological quality of the studies included in systematic reviews,…

Changes in clinical trials methodology over time: a systematic review of six decades of research in psychopharmacology.

PubMed

Brunoni, André R; Tadini, Laura; Fregni, Felipe

2010-03-03

There have been many changes in clinical trials methodology since the introduction of lithium and the beginning of the modern era of psychopharmacology in 1949. The nature and importance of these changes have not been fully addressed to date. As methodological flaws in trials can lead to false-negative or false-positive results, the objective of our study was to evaluate the impact of methodological changes in psychopharmacology clinical research over the past 60 years. We performed a systematic review from 1949 to 2009 on MEDLINE and Web of Science electronic databases, and a hand search of high impact journals on studies of seven major drugs (chlorpromazine, clozapine, risperidone, lithium, fluoxetine and lamotrigine). All controlled studies published 100 months after the first trial were included. Ninety-one studies met our inclusion criteria. We analyzed the major changes in abstract reporting, study design, participants' assessment and enrollment, methodology and statistical analysis. Our results showed that the methodology of psychiatric clinical trials changed substantially, with quality gains in abstract reporting, results reporting, and statistical methodology. Recent trials use more informed consent, periods of washout, intention-to-treat approach and parametric tests. Placebo use remains high and unchanged over time. Clinical trial quality of psychopharmacological studies has changed significantly in most of the aspects we analyzed. There was significant improvement in quality reporting and internal validity. These changes have increased study efficiency; however, there is room for improvement in some aspects such as rating scales, diagnostic criteria and better trial reporting. Therefore, despite the advancements observed, there are still several areas that can be improved in psychopharmacology clinical trials.

78 FR 15023 - Office of Health Assessment and Translation Webinar on the Assessment of Data Quality in Animal...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-08

... and Translation Webinar on the Assessment of Data Quality in Animal Studies; Notice of Public Webinar...- based meeting on the assessment of data quality in animal studies. The Office of Health Assessment and... meetings with a focus on methodological issues related to OHAT implementing systematic review. The first...

77 FR 38072 - Submission for OMB Review; Comment Request; The National Diabetes Education Program Survey of the...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-26

... effectively manage their disease to prevent or delay complications and improve quality of life; (3) decrease... behavior change, improved quality of life, and better diabetes outcomes; (3) expanding NDEP reach and... validity of the methodology and assumptions used; (3) Evaluate the quality, utility, and clarity of the...

The effectiveness of massage therapy for the treatment of nonspecific low back pain: a systematic review of systematic reviews

PubMed Central

Kumar, Saravana; Beaton, Kate; Hughes, Tricia

2013-01-01

Introduction The last decade has seen a growth in the utilization of complementary and alternative medicine therapies, and one of the most popular and sought-after complementary and alternative medicine therapies for nonspecific low back pain is massage. Massage may often be perceived as a safe therapeutic modality without any significant risks or side effects. However, despite its popularity, there continues to be ongoing debate on the effectiveness of massage in treating nonspecific low back pain. With a rapidly evolving research evidence base and access to innovative means of synthesizing evidence, it is time to reinvestigate this issue. Methods A systematic, step-by-step approach, underpinned by best practice in reviewing the literature, was utilized as part of the methodology of this umbrella review. A systematic search was conducted in the following databases: Embase, MEDLINE, AMED, ICONDA, Academic Search Premier, Australia/New Zealand Reference Centre, CINAHL, HealthSource, SPORTDiscus, PubMed, The Cochrane Library, Scopus, Web of Knowledge/Web of Science, PsycINFO, and ProQuest Nursing and Allied Health Source, investigating systematic reviews and meta-analyses from January 2000 to December 2012, and restricted to English-language documents. Methodological quality of included reviews was undertaken using the Centre for Evidence Based Medicine critical appraisal tool. Results Nine systematic reviews were found. The methodological quality of the systematic reviews varied (from poor to excellent) although, overall, the primary research informing these systematic reviews was generally considered to be weak quality. The findings indicate that massage may be an effective treatment option when compared to placebo and some active treatment options (such as relaxation), especially in the short term. There is conflicting and contradictory findings for the effectiveness of massage therapy for the treatment of nonspecific low back pain when compared against other manual therapies (such as mobilization), standard medical care, and acupuncture. Conclusion There is an emerging body of evidence, albeit small, that supports the effectiveness of massage therapy for the treatment of non-specific low back pain in the short term. Due to common methodological flaws in the primary research, which informed the systematic reviews, recommendations arising from this evidence base should be interpreted with caution. PMID:24043951

Virtual reality exposure therapy for the treatment of posttraumatic stress disorder: a methodological review using CONSORT guidelines.

PubMed

Motraghi, Terri E; Seim, Richard W; Meyer, Eric C; Morissette, Sandra B

2014-03-01

Virtual reality exposure therapy (VRET) is an extension of traditional exposure therapy and has been used to treat a variety of anxiety disorders. VRET utilizes a computer-generated virtual environment to present fear-relevant stimuli. Recent studies have evaluated the use of VRET for treatment of PTSD; however, a systematic evaluation of the methodological quality of these studies has yet to be conducted. This review aims to (a) identify treatment outcome studies examining the use of VRET for the treatment of PTSD and (b) appraise the methodological quality of each study using the 2010 Consolidating Standards of Reporting Trials (CONSORT) Statement and its 2008 extension for nonpharmacologic interventions. Two independent assessors conducted a database search (PsycINFO, Medline, CINAHL, Google Scholar) of studies published between January 1990 and June 2013 that reported outcome data comparing VRET with another type of treatment or a control condition. Next, a CONSORT quality appraisal of each study was completed. The search yielded nine unique studies. The CONSORT appraisal revealed that the methodological quality of studies examining VRET as a treatment for PTSD was variable. Although preliminary findings suggest some positive results for VRET as a form of exposure treatment for PTSD, additional research using well-specified randomization procedures, assessor blinding, and monitoring of treatment adherence is warranted. Movement toward greater standardization of treatment manuals, virtual environments, and equipment would further facilitate interpretation and consolidation of this literature. © 2013 Wiley Periodicals, Inc.

Methodology of quality improvement projects for the Texas Medicare population.

PubMed

Pendergrass, P W; Abel, R L; Bing, M; Vaughn, R; McCauley, C

1998-07-01

The Texas Medical Foundation, the quality improvement organization for the state of Texas, develops local quality improvement projects for the Medicare population. These projects are developed as part of the Health Care Quality Improvement Program undertaken by the Health Care Financing Administration. The goal of a local quality improvement project is to collaborate with providers to identify and reduce the incidence of unintentional variations in the delivery of care that negatively impact outcomes. Two factors are critical to the success of a quality improvement project. First, as opposed to peer review that is based on implicit criteria, quality improvement must be based on explicit criteria. These criteria represent key steps in the delivery of care that have been shown to improve outcomes for a specific disease. Second, quality improvement must be performed in partnership with the health care community. As such, the health care community must play an integral role in the design and evaluation of a quality improvement project and in the design and implementation of the resulting quality improvement plan. Specifically, this article provides a historical perspective for the transition from peer review to quality improvement. It discusses key steps used in developing and implementing local quality improvement projects including topic selection, quality indicator development, collaborator recruitment, and measurement of performance/improvement. Two Texas Medical Foundation projects are described to highlight the current methodology and to illustrate the impact of quality improvement projects.

Quality of life and related concepts in Parkinson's disease: a systematic review.

PubMed

Den Oudsten, Brenda L; Van Heck, Guus L; De Vries, Jolanda

2007-08-15

Several studies have investigated the quality of life (QOL) of patients with Parkinson's disease (PD). The purpose of this study was to review the conceptual and methodological quality of quality of life (QOL) studies among patients with PD and to identify factors associated with poor (HR)QOL. Computerized bibliographic databases were screened for publications from 1960 to January 2007. According to a list of predefined criteria, the methodological quality of the 61 studies, was moderate. The term 'QOL' was often used inappropriately. In fact, almost all studies in this review actually assessed health status (HS) instead of QOL. The functioning of patients with PD on physical, social, and emotional domains is affected by PD. Their HS seems to be lower when compared to healthy persons or patients with other chronic diseases. HS studies augment the insight in self-perceived functioning. Therefore, HS is conceived as a valuable construct. However, QOL is also an important factor in health care. Attention towards QOL is needed in order to draw valid conclusions regarding a person's subjective experience of well-being in a broad sense. In order to accomplish this, future studies should apply the QOL concept with more rigor, should use an adequate operational definition, and should employ sound measures. Copyright (c) 2007 Movement Disorder Society.

[Systematic review of studies on quality of life indexed on the SciELO database].

PubMed

Landeiro, Graziela Macedo Bastos; Pedrozo, Celine Cristina Raimundo; Gomes, Maria José; Oliveira, Elizabete Regina de Araújo

2011-10-01

Interest in the quality of life construct has increased in the same proportion as the output of instruments to measure it. In order to analyze the scientific literature on the subject to provide a reflection on this construct in Brazil, a systematic review of the SciELO database covering the period from January 2001 to December 2006 was conducted. It was divided into 3 phases: the first involving 180 publications, the second 124, and the third 10. Of the 180 publications, 77.4% consisted of production in the last three years, with growth of 32.4% from 2001 to 2006. Of these, 124 were selected for methodological analysis in accordance with the category of the study: 79 (63.9%) instrument application articles; 25 (20.1%) translation, validation, adaptation and construction of a QOL instrument; 10 (8%) qualitative studies on QOL; 5 (4%) bibliographical review, 5 (4%) on the quality of life concept. The next stage involved the use of questionnaires and/or interview scripts in order to obtain a broader consensus on perceived quality of life from the interviewees. It was seen that there was significant scientific output in the period under scrutiny, with diversification of approaches and methodologies, highlighting the complexity of the quality of life construct.

The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Systematic Review of Human Evidence for PFOA Effects on Fetal Growth

PubMed Central

Sutton, Patrice; Atchley, Dylan S.; Koustas, Erica; Lam, Juleen; Sen, Saunak; Robinson, Karen A.; Axelrad, Daniel A.; Woodruff, Tracey J.

2014-01-01

Background: The Navigation Guide methodology was developed to meet the need for a robust method of systematic and transparent research synthesis in environmental health science. We conducted a case study systematic review to support proof of concept of the method. Objective: We applied the Navigation Guide systematic review methodology to determine whether developmental exposure to perfluorooctanoic acid (PFOA) affects fetal growth in humans. Methods: We applied the first 3 steps of the Navigation Guide methodology to human epidemiological data: 1) specify the study question, 2) select the evidence, and 3) rate the quality and strength of the evidence. We developed a protocol, conducted a comprehensive search of the literature, and identified relevant studies using prespecified criteria. We evaluated each study for risk of bias and conducted meta-analyses on a subset of studies. We rated quality and strength of the entire body of human evidence. Results: We identified 18 human studies that met our inclusion criteria, and 9 of these were combined through meta-analysis. Through meta-analysis, we estimated that a 1-ng/mL increase in serum or plasma PFOA was associated with a –18.9 g (95% CI: –29.8, –7.9) difference in birth weight. We concluded that the risk of bias across studies was low, and we assigned a “moderate” quality rating to the overall body of human evidence. Conclusion: On the basis of this first application of the Navigation Guide systematic review methodology, we concluded that there is “sufficient” human evidence that developmental exposure to PFOA reduces fetal growth. Citation: Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1028–1039; http://dx.doi.org/10.1289/ehp.1307893 PMID:24968388

On the Role of Impact Evaluation of Quality Assurance from the Strategic Perspective of Quality Assurance Agencies in the European Higher Education Area

ERIC Educational Resources Information Center

Damian, Radu; Grifoll, Josep; Rigbers, Anke

2015-01-01

In this paper the current national legislations, the quality assurance approaches and the activities of impact analysis of three quality assurance agencies from Romania, Spain and Germany are described from a strategic perspective. The analysis shows that the general methodologies (comprising, for example, self-evaluation reports, peer reviews,…

A scoping review of scoping reviews: advancing the approach and enhancing the consistency.

PubMed

Pham, Mai T; Rajić, Andrijana; Greig, Judy D; Sargeant, Jan M; Papadopoulos, Andrew; McEwen, Scott A

2014-12-01

The scoping review has become an increasingly popular approach for synthesizing research evidence. It is a relatively new approach for which a universal study definition or definitive procedure has not been established. The purpose of this scoping review was to provide an overview of scoping reviews in the literature. A scoping review was conducted using the Arksey and O'Malley framework. A search was conducted in four bibliographic databases and the gray literature to identify scoping review studies. Review selection and characterization were performed by two independent reviewers using pretested forms. The search identified 344 scoping reviews published from 1999 to October 2012. The reviews varied in terms of purpose, methodology, and detail of reporting. Nearly three-quarter of reviews (74.1%) addressed a health topic. Study completion times varied from 2 weeks to 20 months, and 51% utilized a published methodological framework. Quality assessment of included studies was infrequently performed (22.38%). Scoping reviews are a relatively new but increasingly common approach for mapping broad topics. Because of variability in their conduct, there is a need for their methodological standardization to ensure the utility and strength of evidence. © 2014 The Authors. Research Synthesis Methods published by John Wiley & Sons, Ltd.

Interventions to Promote Physical Activity in Older People with Type 2 Diabetes Mellitus: A Systematic Review

PubMed Central

Sazlina, Shariff-Ghazali; Browning, Colette; Yasin, Shajahan

2013-01-01

Introduction: Type 2 diabetes mellitus (T2DM) among people aged 60 years and above is a growing public health problem. Regular physical activity is one of the key elements in the management of T2DM. Recommendations suggest that older people with T2DM will benefit from regular physical activity for better disease control and delaying complications. Despite the known benefits, many remain sedentary. Hence, this review assessed interventions for promoting physical activity in persons aged 65 years and older with T2DM. Methods: A literature search was conducted using Ovid MEDLINE, PubMed, EMBASE, SPORTDiscus, and CINAHL databases to retrieve articles published between January 2000 and December 2012. Randomized controlled trials and quasi-experimental designs comparing different strategies to increase physical activity level in persons aged 65 years and older with T2DM were included. The methodological quality of studies was assessed. Results: Twenty-one eligible studies were reviewed, only six studies were rated as good quality and only one study specifically targeted persons aged 65 years and older. Personalized coaching, goal setting, peer support groups, use of technology, and physical activity monitors were proven to increase the level of physical activity. Incorporation of health behavior theories and follow-up supports also were successful strategies. However, the methodological quality and type of interventions promoting physical activity of the included studies in this review varied widely across the eligible studies. Conclusion: Strategies that increased level of physical activity in persons with T2DM are evident but most studies focused on middle-aged persons and there was a lack of well-designed trials. Hence, more studies of satisfactory methodological quality with interventions promoting physical activity in older people are required. PMID:24392445

Systematic Review of Integrative Health Care Research: Randomized Control Trials, Clinical Controlled Trials, and Meta-Analysis

PubMed Central

Khorsan, Raheleh; Coulter, Ian D.; Crawford, Cindy; Hsiao, An-Fu

2011-01-01

A systematic review was conducted to assess the level of evidence for integrative health care research. We searched PubMed, Allied and Complementary Medicine (AMED), BIOSIS Previews, EMBASE, the entire Cochrane Library, MANTIS, Social SciSearch, SciSearch Cited Ref Sci, PsychInfo, CINAHL, and NCCAM grantee publications listings, from database inception to May 2009, as well as searches of the “gray literature.” Available studies published in English language were included. Three independent reviewers rated each article and assessed the methodological quality of studies using the Scottish Intercollegiate Guidelines Network (SIGN 50). Our search yielded 11,891 total citations but 6 clinical studies, including 4 randomized, met our inclusion criteria. There are no available systematic reviews/meta-analyses published that met our inclusion criteria. The methodological quality of the included studies was assessed independently using quality checklists of the SIGN 50. Only a small number of RCTs and CCTs with a limited number of patients and lack of adequate control groups assessing integrative health care research are available. These studies provide limited evidence of effective integrative health care on some modalities. However, integrative health care regimen appears to be generally safe. PMID:20953383

Gaps in the evidence for prevention and treatment of maternal anaemia: a review of systematic reviews

PubMed Central

2012-01-01

Background Anaemia, in particular due to iron deficiency, is common in pregnancy with associated negative outcomes for mother and infant. However, there is evidence of significant variation in management. The objectives of this review of systematic reviews were to analyse and summarise the evidence base, identify gaps in the evidence and develop a research agenda for this important component of maternity care. Methods Multiple databases were searched, including MEDLINE, EMBASE and The Cochrane Library. All systematic reviews relating to interventions to prevent and treat anaemia in the antenatal and postnatal period were eligible. Two reviewers independently assessed data inclusion, extraction and quality of methodology. Results 27 reviews were included, all reporting on the prevention and treatment of anaemia in the antenatal (n = 24) and postnatal periods (n = 3). Using AMSTAR as the assessment tool for methodological quality, only 12 of the 27 were rated as high quality reviews. The greatest number of reviews covered antenatal nutritional supplementation for the prevention of anaemia (n = 19). Iron supplementation was the most extensively researched, but with ongoing uncertainty about optimal dose and regimen. Few identified reviews addressed anaemia management post-partum or correlations between laboratory and clinical outcomes, and no reviews reported on clinical symptoms of anaemia. Conclusions The review highlights evidence gaps including the management of anaemia in the postnatal period, screening for anaemia, and optimal interventions for treatment. Research priorities include developing standardised approaches to reporting of laboratory outcomes, and information on clinical outcomes relevant to the experiences of pregnant women. PMID:22727258

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

The exchangeability of self-reports and administrative health care resource use measurements: assessement of the methodological reporting quality.

PubMed

Noben, Cindy Yvonne; de Rijk, Angelique; Nijhuis, Frans; Kottner, Jan; Evers, Silvia

2016-06-01

To assess the exchangeability of self-reported and administrative health care resource use measurements for cost estimation. In a systematic review (NHS EED and MEDLINE), reviewers evaluate, in duplicate, the methodological reporting quality of studies comparing the validation evidence of instruments measuring health care resource use. The appraisal tool Methodological Reporting Quality (MeRQ) is developed by merging aspects form the Guidelines for Reporting Reliability and Agreement Studies and the Standards for Reporting Diagnostic Accuracy. Out of 173 studies, 35 full-text articles are assessed for eligibility. Sixteen articles are included in this study. In seven articles, more than 75% of the reporting criteria assessed by MERQ are considered "good." Most studies score at least "fair" on most of the reporting quality criteria. In the end, six studies score "good" on the minimal criteria for reporting. Varying levels of agreement among the different data sources are found, with correlations ranging from 0.14 up to 0.93 and with occurrences of both random and systematic errors. The validation evidence of the small number of studies with adequate MeRQ cautiously supports the exchangeability of both the self-reported and administrative resource use measurement methods. Copyright © 2016 Elsevier Inc. All rights reserved.

Applications of Quality Management in Language Education

ERIC Educational Resources Information Center

Heyworth, Frank

2013-01-01

This review examines applications of quality management (QM) in language education. QM approaches have been adapted from methodologies developed in industrial and commercial settings, and these are briefly described. Key aspects of QM in language education are the definition of purpose, descriptions of principles and practice, including various…

A Proposal for Six Sigma Integration for Large-Scale Production of Penicillin G and Subsequent Conversion to 6-APA.

PubMed

Nandi, Anirban; Pan, Sharadwata; Potumarthi, Ravichandra; Danquah, Michael K; Sarethy, Indira P

2014-01-01

Six Sigma methodology has been successfully applied to daily operations by several leading global private firms including GE and Motorola, to leverage their net profits. Comparatively, limited studies have been conducted to find out whether this highly successful methodology can be applied to research and development (R&D). In the current study, we have reviewed and proposed a process for a probable integration of Six Sigma methodology to large-scale production of Penicillin G and its subsequent conversion to 6-aminopenicillanic acid (6-APA). It is anticipated that the important aspects of quality control and quality assurance will highly benefit from the integration of Six Sigma methodology in mass production of Penicillin G and/or its conversion to 6-APA.

A Proposal for Six Sigma Integration for Large-Scale Production of Penicillin G and Subsequent Conversion to 6-APA

PubMed Central

Nandi, Anirban; Danquah, Michael K.

2014-01-01

Six Sigma methodology has been successfully applied to daily operations by several leading global private firms including GE and Motorola, to leverage their net profits. Comparatively, limited studies have been conducted to find out whether this highly successful methodology can be applied to research and development (R&D). In the current study, we have reviewed and proposed a process for a probable integration of Six Sigma methodology to large-scale production of Penicillin G and its subsequent conversion to 6-aminopenicillanic acid (6-APA). It is anticipated that the important aspects of quality control and quality assurance will highly benefit from the integration of Six Sigma methodology in mass production of Penicillin G and/or its conversion to 6-APA. PMID:25057428

The association between head and cervical posture and temporomandibular disorders: a systematic review.

PubMed

Olivo, Susan Armijo; Bravo, Jaime; Magee, David J; Thie, Norman M R; Major, Paul W; Flores-Mir, Carlos

2006-01-01

To carry out a systematic review to assess the evidence concerning the association between head and cervical posture and temporomandibular disorders (TMD). A search of Medline, Pubmed, Embase, Web of Science, Lilacs, and Cochrane Library databases was conducted in all languages with the help of a health sciences librarian. Key words used in the search were posture, head posture, cervical spine or neck, vertebrae, cervical lordosis, craniomandibular disorders or temporomandibular disorders, temporomandibular disorders, and orofacial pain or facial pain. Abstracts which appeared to fulfill the initial selection criteria were selected by consensus. The original articles were retrieved and evaluated to ensure they met the inclusion criteria. A methodological checklist was used to evaluate the quality of the selected articles and their references were hand-searched for possible missing articles. Twelve studies met all inclusion criteria and were analyzed in detail for their methodology and information quality. Nine articles that analyzed the association between head posture and TMD included patients with mixed TMD diagnosis; 1 article differentiated among muscular, articular, and mixed symptomatology; and 3 articles analyzed information from patients with only articular problems. Finally, 2 studies evaluated the association between head posture and TMD in patients with muscular TMD. Several methodological defects were noted in the 12 studies. Since most of the studies included in this systematic review were of poor methodological quality, the findings of the studies should be interpreted with caution. The association between intra-articular and muscular TMD and head and cervical posture is still unclear, and better controlled studies with comprehensive TMD diagnoses, greater sample sizes, and objective posture evaluation are necessary.

Dementia training programmes for staff working in general hospital settings - a systematic review of the literature.

PubMed

Scerri, Anthony; Innes, Anthea; Scerri, Charles

2017-08-01

Although literature describing and evaluating training programmes in hospital settings increased in recent years, there are no reviews that summarise these programmes. This review sought to address this, by collecting the current evidence on dementia training programmes directed to staff working in general hospitals. Literature from five databases were searched, based on a number of inclusion criteria. The selected studies were summarised and data was extracted and compared using narrative synthesis based on a set of pre-defined categories. Methodological quality was assessed. Fourteen peer-reviewed studies were identified with the majority being pre-test post-test investigations. No randomised controlled trials were found. Methodological quality was variable with selection bias being the major limitation. There was a great variability in the development and mode of delivery although, interdisciplinary ward based, tailor-made, short sessions using experiential and active learning were the most utilised. The majority of the studies mainly evaluated learning, with few studies evaluating changes in staff behaviour/practices and patients' outcomes. This review indicates that high quality studies are needed that especially evaluate staff behaviours and patient outcomes and their sustainability over time. It also highlights measures that could be used to develop and deliver training programmes in hospital settings.

The relationship between return on investment and quality of study methodology in workplace health promotion programs.

PubMed

Baxter, Siyan; Sanderson, Kristy; Venn, Alison J; Blizzard, C Leigh; Palmer, Andrew J

2014-01-01

To determine the relationship between return on investment (ROI) and quality of study methodology in workplace health promotion programs. Data were obtained through a systematic literature search of National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE), Health Technology Database (HTA), Cost Effectiveness Analysis (CEA) Registry, EconLit, PubMed, Embase, Wiley, and Scopus. Included were articles written in English or German reporting cost(s) and benefit(s) and single or multicomponent health promotion programs on working adults. Return-to-work and workplace injury prevention studies were excluded. Methodological quality was graded using British Medical Journal Economic Evaluation Working Party checklist. Economic outcomes were presented as ROI. ROI was calculated as ROI = (benefits - costs of program)/costs of program. Results were weighted by study size and combined using meta-analysis techniques. Sensitivity analysis was performed using two additional methodological quality checklists. The influences of quality score and important study characteristics on ROI were explored. Fifty-one studies (61 intervention arms) published between 1984 and 2012 included 261,901 participants and 122,242 controls from nine industry types across 12 countries. Methodological quality scores were highly correlated between checklists (r = .84-.93). Methodological quality improved over time. Overall weighted ROI [mean ± standard deviation (confidence interval)] was 1.38 ± 1.97 (1.38-1.39), which indicated a 138% return on investment. When accounting for methodological quality, an inverse relationship to ROI was found. High-quality studies (n = 18) had a smaller mean ROI, 0.26 ± 1.74 (.23-.30), compared to moderate (n = 16) 0.90 ± 1.25 (.90-.91) and low-quality (n = 27) 2.32 ± 2.14 (2.30-2.33) studies. Randomized control trials (RCTs) (n = 12) exhibited negative ROI, -0.22 ± 2.41(-.27 to -.16). Financial returns become increasingly positive across quasi-experimental, nonexperimental, and modeled studies: 1.12 ± 2.16 (1.11-1.14), 1.61 ± 0.91 (1.56-1.65), and 2.05 ± 0.88 (2.04-2.06), respectively. Overall, mean weighted ROI in workplace health promotion demonstrated a positive ROI. Higher methodological quality studies provided evidence of smaller financial returns. Methodological quality and study design are important determinants.

How does study quality affect the results of a diagnostic meta-analysis?

PubMed Central

Westwood, Marie E; Whiting, Penny F; Kleijnen, Jos

2005-01-01

Background The use of systematic literature review to inform evidence based practice in diagnostics is rapidly expanding. Although the primary diagnostic literature is extensive, studies are often of low methodological quality or poorly reported. There has been no rigorously evaluated, evidence based tool to assess the methodological quality of diagnostic studies. The primary objective of this study was to determine the extent to which variations in the quality of primary studies impact the results of a diagnostic meta-analysis and whether this differs with diagnostic test type. A secondary objective was to contribute to the evaluation of QUADAS, an evidence-based tool for the assessment of quality in diagnostic accuracy studies. Methods This study was conducted as part of large systematic review of tests used in the diagnosis and further investigation of urinary tract infection (UTI) in children. All studies included in this review were assessed using QUADAS, an evidence-based tool for the assessment of quality in systematic reviews of diagnostic accuracy studies. The impact of individual components of QUADAS on a summary measure of diagnostic accuracy was investigated using regression analysis. The review divided the diagnosis and further investigation of UTI into the following three clinical stages: diagnosis of UTI, localisation of infection, and further investigation of the UTI. Each stage used different types of diagnostic test, which were considered to involve different quality concerns. Results Many of the studies included in our review were poorly reported. The proportion of QUADAS items fulfilled was similar for studies in different sections of the review. However, as might be expected, the individual items fulfilled differed between the three clinical stages. Regression analysis found that different items showed a strong association with test performance for the different tests evaluated. These differences were observed both within and between the three clinical stages assessed by the review. The results of regression analyses were also affected by whether or not a weighting (by sample size) was applied. Our analysis was severely limited by the completeness of reporting and the differences between the index tests evaluated and the reference standards used to confirm diagnoses in the primary studies. Few tests were evaluated by sufficient studies to allow meaningful use of meta-analytic pooling and investigation of heterogeneity. This meant that further analysis to investigate heterogeneity could only be undertaken using a subset of studies, and that the findings are open to various interpretations. Conclusion Further work is needed to investigate the influence of methodological quality on the results of diagnostic meta-analyses. Large data sets of well-reported primary studies are needed to address this question. Without significant improvements in the completeness of reporting of primary studies, progress in this area will be limited. PMID:15943861

Systematic Reviews in Sports Medicine.

PubMed

DiSilvestro, Kevin J; Tjoumakaris, Fotios P; Maltenfort, Mitchell G; Spindler, Kurt P; Freedman, Kevin B

2016-02-01

The number of systematic reviews published in the orthopaedic literature has increased, and these reviews can help guide clinical decision making. However, the quality of these reviews can affect the reader's ability to use the data to arrive at accurate conclusions and make clinical decisions. To evaluate the methodological and reporting quality of systematic reviews and meta-analyses in the sports medicine literature to determine whether such reviews should be used to guide treatment decisions. The hypothesis was that many systematic reviews in the orthopaedic sports medicine literature may not follow the appropriate reporting guidelines or methodological criteria recommended for systematic reviews. Systematic review. All clinical sports medicine systematic reviews and meta-analyses from 2009 to 2013 published in The American Journal of Sports Medicine (AJSM), The Journal of Bone and Joint Surgery (JBJS), Arthroscopy, Sports Health, and Knee Surgery, Sports Traumatology, Arthroscopy (KSSTA) were reviewed and evaluated for level of evidence according to the guidelines from the Oxford Centre for Evidence-Based Medicine, for reporting quality according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, and for methodological quality according to the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Analysis was performed by year and journal of publication, and the levels of evidence included in the systematic reviews were also analyzed. A total of 200 systematic reviews and meta-analyses were identified over the study period. Of these, 53% included evidence levels 4 and 5 in their analyses, with just 32% including evidence levels 1 and 2 only. There were significant differences in the proportion of articles with high levels of evidence (P < .001) and low levels of evidence (P = .005) by journal. The average PRISMA score was 87% and the average AMSTAR score was 73% among all journals. The average AMSTAR and PRISMA scores were significantly different by journal (P = .002 and .001, respectively) and by year (P = .046 and .019, respectively). Arthroscopy, AJSM, and JBJS all scored higher than Sports Health and KSSTA on the PRISMA and AMSTAR. The average PRISMA score by year varied from 85% to 89%, and the average AMSTAR score varied from 70% to 76%. Systematic reviews and meta-analyses in orthopaedics sports medicine literature relied on evidence levels 4 and 5 in 53% of studies over the 5-year study period. Overall, PRISMA and AMSTAR scores are high and may be better than those in other disciplines. Readers need to be conscious of potential shortcomings when reading systematic reviews and using them in practice. © 2015 The Author(s).

Rapid evidence assessment: increasing the transparency of an emerging methodology.

PubMed

Varker, Tracey; Forbes, David; Dell, Lisa; Weston, Adele; Merlin, Tracy; Hodson, Stephanie; O'Donnell, Meaghan

2015-12-01

Within the field of evidence-based practice, policy makers, health care professionals and consumers require timely reviews to inform decisions on efficacious health care and treatments. Rapid evidence assessment (REA), also known as rapid review, has emerged in recent years as a literature review methodology that fulfils this need. It highlights what is known in a clinical area to the target audience in a relatively short time frame. This article discusses the lack of transparency and limited critical appraisal that can occur in REA, and goes on to propose general principles for conducting a REA. The approach that we describe is consistent with the principles underlying systematic review methodology, but also makes allowances for the rapid delivery of information as required while utilizing explicit and reproducible methods at each stage. Our method for conducting REA includes: developing an explicit research question in consultation with the end-users; clear definition of the components of the research question; development of a thorough and reproducible search strategy; development of explicit evidence selection criteria; and quality assessments and transparent decisions about the level of information to be obtained from each study. In addition, the REA may also include an assessment of the quality of the total body of evidence. Transparent reporting of REA methodologies will provide greater clarity to end-users about how the information is obtained and about the trade-offs that are made between speed and rigour. © 2015 John Wiley & Sons, Ltd.

Behavioural Intervention Practices for Stereotypic and Repetitive Behaviour in Individuals with Autism Spectrum Disorder: A Systematic Review

ERIC Educational Resources Information Center

Patterson, Stephanie Y.; Smith, Veronica; Jelen, Michaela

2010-01-01

Aim: The purpose of this systematic review was to examine the quality of conduct of experimental studies contributing to our empirical understanding of function-based behavioural interventions for stereotypic and repetitive behaviours (SRBs) in individuals with autism spectrum disorders (ASDs). Method: Systematic review methodology was used to…

Effects of aquatic exercise on physical function and fitness among people with spinal cord injury: A systematic review.

PubMed

Li, Chunxiao; Khoo, Selina; Adnan, Athirah

2017-03-01

The aim of this review is to synthesize the evidence on the effects of aquatic exercise interventions on physical function and fitness among people with spinal cord injury. Six major databases were searched from inception till June 2015: MEDLINE, CINAHL, EMBASE, PsychInfo, SPORTDiscus, and Cochrane Center Register of Controlled Trials. Two reviewers independently rated methodological quality using the modified Downs and Black Scale and extracted and synthesized key findings (i.e., participant characteristics, study design, physical function and fitness outcomes, and adverse events). Eight of 276 studies met the inclusion criteria, of which none showed high research quality. Four studies assessed physical function outcomes and 4 studies evaluated aerobic fitness as outcome measures. Significant improvements on these 2 outcomes were generally found. Other physical or fitness outcomes including body composition, muscular strength, and balance were rarely reported. There is weak evidence supporting aquatic exercise training to improve physical function and aerobic fitness among adults with spinal cord injury. Suggestions for future research include reporting details of exercise interventions, evaluating other physical or fitness outcomes, and improving methodological quality.

The effectiveness of manual therapy in treating cervicogenic dizziness: a systematic review.

PubMed

Yaseen, Khalid; Hendrick, Paul; Ismail, Ayah; Felemban, Mohannad; Alshehri, Mansour Abdullah

2018-01-01

[Purpose] This review provides an evaluation of the evidence for the effectiveness of using manual therapy to treat cervicogenic dizziness. [Subjects and Methods] The literature was systematically searched on the May 2, 2016 using the following online databases: Medline, EMBASE, CINAHL and PEDro. This review included randomised controlled trials and compared the efficacy of manual therapy for the treatment of cervicogenic dizziness, compared to other types of intervention. This study measured changes based on dizziness intensity and frequency. [Results] The primary search found 30 articles, but only four articles met the inclusion criteria. Assessment of methodological quality was performed by two researchers using the PEDro scale. The level of evidence was determined using a recognised grading scale. Three out of the four articles were deemed to have high methodological quality, while the fourth was rated as moderate quality. The attributed level of evidence was moderate (level 2). [Conclusion] Manual therapy is potentially effective for managing cervicogenic dizziness. However, due to the heterogeneity of the results and techniques and the low number of studies, further research is recommended to provide conclusive evidence.

Social Support and Supervisory Quality Interventions in the Workplace: A Stakeholder-Centered Best-Evidence Synthesis of Systematic Reviews on Work Outcomes.

PubMed

Wagner, S L; White, M I; Schultz, I Z; Williams-Whitt, K; Koehn, C; Dionne, C E; Koehoorn, M; Harder, H G; Pasca, R; Wärje, O; Hsu, V; McGuire, L; Lama, I; Schulz, W; Kube, D; Wright, M D

2015-10-01

There is controversy surrounding the impact of workplace interventions aimed at improving social support and supervisory quality on absenteeism, productivity and financial outcomes. To determine the value of social support interventions for work outcomes. Databases were searched for systematic reviews between 2000 and 2012 to complete a synthesis of systematic reviews guided by the PRISMA statement and the IOM guidelines for systematic reviews. Assessment of articles for inclusion and methodological quality was conducted independently by at least two researchers, with differences resolved by consensus. The search resulted in 3363 titles of which 3248 were excluded following title/abstract review, leaving 115 articles that were retrieved and underwent full article review. 10 articles met the set inclusion criteria, with 7 focusing on social support, 2 on supervisory quality and 1 on both. We found moderate and limited evidence, respectively, that social support and supervisory quality interventions positively impact workplace outcomes. There is moderate evidence that social support and limited evidence that supervisory quality interventions have a positive effect on work outcomes.

Synthesising quantitative and qualitative research in evidence‐based patient information

PubMed Central

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-01-01

Background Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence‐based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. Aims This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Methods Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non‐quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg “explain what the test involves”) was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. Results 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. Conclusions A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review. PMID:17325406

Methodological Issues in Economic Evaluations Submitted to the Pan-Canadian Oncology Drug Review (pCODR).

PubMed

Masucci, Lisa; Beca, Jaclyn; Sabharwal, Mona; Hoch, Jeffrey S

2017-12-01

Public drug plans are faced with increasingly difficult funding decisions. In Canada, the pan-Canadian Oncology Drug Review (pCODR) makes funding recommendations to the provincial and territorial drug plans responsible for cancer drugs. Assessments of the economic models submitted by pharmaceutical manufacturers are publicly reported. The main objective of this research was to identify recurring methodological issues in economic models submitted to pCODR for funding reviews. The secondary objective was to explore whether there exists any observed relationships between reported methodological issues and funding recommendations made by pCODR's expert review committee. Publicly available Economic Guidance Reports from July 2011 (inception) until June 2014 for drug reviews with a final funding recommendation (N = 34) were independently examined by two authors. Major methodological issues from each review were abstracted and grouped into nine main categories. Each issue was also categorized based on perception of the reviewer's actions to manage it. The most commonly reported issues involved costing (59% of reviews), time horizon (56%), and model structure (36%). Several types of issues were identified that usually could not be resolved, such as quality of clinical data or uncertainty with indirect comparisons. Issues with costing or choice of utility estimates could usually be addressed or explored by reviewers. No statistically significant relationship was found between any methodological issue and funding recommendations from the expert review committee. The findings provide insights that can be used by parties who submit or review economic evidence for continuous improvement and consistency in economic modeling, reporting, and decision making.

The effect of docetaxel on developing oedema in patients with breast cancer: a systematic review.

PubMed

Hugenholtz-Wamsteker, W; Robbeson, C; Nijs, J; Hoelen, W; Meeus, M

2016-03-01

Docetaxel is extensively used in chemotherapy for the treatment of breast cancer. Little attention has been given to oedema as a possible side effect of docetaxel-containing therapies. Until now, no review was conducted to evaluate docetaxel-containing therapies versus docetaxel-free therapies on the magnitude of the risk of developing oedema. In this systematic review, we investigated the risk of developing oedema in patients being treated for breast cancer with or without docetaxel. In this systematic literature review, we searched PubMed and Web of Knowledge for studies on breast cancer patients treated with chemotherapy containing docetaxel. We included clinical trials comparing docetaxel versus docetaxel-free chemotherapy. Oedema had to be reported and measured as a key outcome or an adverse effect. Methodological checklists were used to assess the risk of bias within the selected studies. Seven randomised clinical trials were included. Six trials were of moderate methodological quality. All trials showed an increased rate of oedema in the docetaxel-treatment arm. The trial of weakest methodological quality reported the highest incidence of oedema. The results moderately suggest that adjuvant chemotherapy containing docetaxel is related to a significantly increased risk of developing oedema, compared with docetaxel-free chemotherapy. © 2014 John Wiley & Sons Ltd.

Leininger's Ethnonursing Research Methodology and Studies of Cancer Survivors: A Review.

PubMed

Farren, Arlene T

2015-09-01

The purpose of this article is to present the findings of a literature review regarding the use of Leininger's ethnonursing research methodology (ENRM) in studies addressing adult cancer survivors. It is important to learn about differences and similarities among cancer survivors' experiences so that patient-centered, culturally congruent care can be provided. A review of the literature was conducted using databases such as CINAHL and MEDLINE. Search terms included variations on ENRM and cancer survivors. The results were a small number of published studies that used the ENRM examining breast cancer survivors' perceptions and experiences. A review instrument was developed to estimate study quality based on established criteria. The studies are critiqued in relation to the theory-based methodology, evaluation criteria for qualitative research, and study findings are summarized. The author concludes that although there is a paucity of research using ENRM with adult cancer survivors, the preliminary findings of the included studies contribute to what is known about breast cancer survivors. Implications for research include recommendations to increase the use of ENRM to discover the universal and diverse experiences of care practices in adult cancer survivors and use the evidence to develop patient-centered, culturally congruent, quality care for cancer survivors. © The Author(s) 2014.

[Progress in methodological characteristics of clinical practice guideline for osteoarthritis].

PubMed

Xing, D; Wang, B; Lin, J H

2017-06-01

At present, several clinical practice guidelines for the treatment of osteoarthritis have been developed by institutes or societies. The ultimate purpose of developing clinical practice guidelines is to formulate the process in the treatment of osteoarthritis effectively. However, the methodologies used in developing clinical practice guidelines may place an influence on the transformation and application of that in treating osteoarthritis. The present study summarized the methodological features of individual clinical practice guideline and presented the tools for quality evaluation of clinical practice guideline. The limitations of current osteoarthritis guidelines of China are also indicated. The review article might help relevant institutions improve the quality in developing guide and clinical transformation.

Systematic review of the effectiveness of mirror therapy in upper extremity function.

PubMed

Ezendam, Daniëlle; Bongers, Raoul M; Jannink, Michiel J A

2009-01-01

This review gives an overview of the current state of research regarding the effectiveness of mirror therapy in upper extremity function. A systematic literature search was performed to identify studies concerning mirror therapy in upper extremity. The included journal articles were reviewed according to a structured diagram and the methodological quality was assessed. Fifteen studies were identified and reviewed. Five different patient categories were studied: two studies focussed on mirror therapy after an amputation of the upper limb, five studies focussed on mirror therapy after stroke, five studies focussed on mirror therapy with complex regional pain syndrome type 1 (CRPS1) patients, one study on mirror therapy with complex regional pain syndrome type 2 (CRPS2) and two studies focussed on mirror therapy after hand surgery other than amputation. Most of the evidence for mirror therapy is from studies with weak methodological quality. The present review showed a trend that mirror therapy is effective in upper limb treatment of stroke patients and patients with CRPS, whereas the effectiveness in other patient groups has yet to be determined.

The quality of mental disorder information websites: a review.

PubMed

Reavley, Nicola J; Jorm, Anthony F

2011-11-01

This paper reviews studies assessing the quality of websites providing information about mental disorders. The review included 31 articles identified by searching research databases in March 2010. Topics covered included affective disorders, anxiety disorders, eating disorders, substance use disorders and schizophrenia/psychosis. The largest number of articles (13) reported studies assessing affective disorder information quality. Methodologies varied in site selection and rating methods, with some of limited validity. Most concluded that quality was poor, although quality of affective disorder sites may be improving. There is currently very little understanding of the influence of website quality on user behaviour. Future quality assessments might use the criteria informed by key behaviour change theories. A possible approach to research on websites and user behaviour might be to develop an evaluation framework incorporating strategies from behaviour change models, key mental health literacy elements and health outcomes relevant to mental health promotion. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

A systematic review of etiological and risk factors associated with bruxism.

PubMed

Feu, Daniela; Catharino, Fernanda; Quintão, Catia Cardoso Abdo; Almeida, Marco Antonio de Oliveira

2013-06-01

The aim of the present work was to systematically review the literature and identify all peer-reviewed papers dealing with etiological and risk factors associated with bruxism. Data extraction was carried out according to the standard Cochrane systematic review methodology. The following databases were searched for randomized clinical trials (RCT), controlled clinical trials (CCT) or cohort studies: Cochrane Library, Medline, and Embase from 1980 to 2011. Unpublished literature was searched electronically using ClinicalTrials.gov. The primary outcome was bruxism etiology. Studies should have a standardized method to assess bruxism. Screening of eligible studies, assessment of the methodological quality and data extraction were conducted independently and in duplicate. Two reviewers inspected the references using the same search strategy and then applied the same inclusion criteria to the selected studies. They used criteria for methodological quality that was previously described in the Cochrane Handbook. Among the 1247 related articles that were critically assessed, one randomized clinical trial, one controlled clinical trial and seven longitudinal studies were included in the critical appraisal. Of these studies, five were selected, but reported different outcomes. There is convincing evidence that (sleep-related) bruxism can be induced by esophageal acidification and also that it has an important relationship with smoking in a dose-dependent manner. Disturbances in the central dopaminergic system are also implicated in the etiology of bruxism.

Vitamin D and depression: a systematic review and meta-analysis comparing studies with and without biological flaws.

PubMed

Spedding, Simon

2014-04-11

Efficacy of Vitamin D supplements in depression is controversial, awaiting further literature analysis. Biological flaws in primary studies is a possible reason meta-analyses of Vitamin D have failed to demonstrate efficacy. This systematic review and meta-analysis of Vitamin D and depression compared studies with and without biological flaws. The systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The literature search was undertaken through four databases for randomized controlled trials (RCTs). Studies were critically appraised for methodological quality and biological flaws, in relation to the hypothesis and study design. Meta-analyses were performed for studies according to the presence of biological flaws. The 15 RCTs identified provide a more comprehensive evidence-base than previous systematic reviews; methodological quality of studies was generally good and methodology was diverse. A meta-analysis of all studies without flaws demonstrated a statistically significant improvement in depression with Vitamin D supplements (+0.78 CI +0.24, +1.27). Studies with biological flaws were mainly inconclusive, with the meta-analysis demonstrating a statistically significant worsening in depression by taking Vitamin D supplements (-1.1 CI -0.7, -1.5). Vitamin D supplementation (≥800 I.U. daily) was somewhat favorable in the management of depression in studies that demonstrate a change in vitamin levels, and the effect size was comparable to that of anti-depressant medication.

Methodological issues of genetic association studies.

PubMed

Simundic, Ana-Maria

2010-12-01

Genetic association studies explore the association between genetic polymorphisms and a certain trait, disease or predisposition to disease. It has long been acknowledged that many genetic association studies fail to replicate their initial positive findings. This raises concern about the methodological quality of these reports. Case-control genetic association studies often suffer from various methodological flaws in study design and data analysis, and are often reported poorly. Flawed methodology and poor reporting leads to distorted results and incorrect conclusions. Many journals have adopted guidelines for reporting genetic association studies. In this review, some major methodological determinants of genetic association studies will be discussed.

The Ability of Indonesian EFL Learners in Writing Academic Papers

ERIC Educational Resources Information Center

Husin, M. Said; Nurbayani, Etty

2017-01-01

This study is meant to examine the thesis quality of students of English Department at IAIN Samarinda. Through the descriptive-quantitative research, the thesis quality of students of English Department at IAIN Samarinda is reviewed from the aspects of language, structure, concepts understanding, theoretical framework, methodology, content,…

Quality of Service in Networks Supporting Cultural Multimedia Applications

ERIC Educational Resources Information Center

Kanellopoulos, Dimitris N.

2011-01-01

Purpose: This paper aims to provide an overview of representative multimedia applications in the cultural heritage sector, as well as research results on quality of service (QoS) mechanisms in internet protocol (IP) networks that support such applications. Design/methodology/approach: The paper's approach is a literature review. Findings: Cultural…

Systematically Evaluating the Effectiveness of Quality Assurance Programmes in Leading to Improvements in Institutional Performance

ERIC Educational Resources Information Center

Lillis, Deirdre

2012-01-01

Higher education institutions worldwide invest significant resources in their quality assurance systems. Little empirical evidence exists that demonstrates the effectiveness (or otherwise) of these systems. Methodological approaches for determining effectiveness are also underdeveloped. Self-study-with-peer-review is a widely used model for…

Critical appraisal of clinical trials in multiple system atrophy: Toward better quality.

PubMed

Castro Caldas, Ana; Levin, Johannes; Djaldetti, Ruth; Rascol, Olivier; Wenning, Gregor; Ferreira, Joaquim J

2017-10-01

Multiple system atrophy (MSA) is a rare neurodegenerative disease of undetermined cause. Although many clinical trials have been conducted, there is still no treatment that cures the disease or slows its progression. We sought to assess the clinical trials, methodology, and quality of reporting of clinical trails conducted in MSA patients. We conducted a systematic review of all trials with at least 1 MSA patient subject to any pharmacological/nonpharmacological interventions. Two independent reviewers evaluated the methodological characteristics and quality of reporting of trials. A total of 60 clinical trials were identified, including 1375 MSA patients. Of the trials, 51% (n = 31) were single-arm studies. A total of 28% (n = 17) had a parallel design, half of which (n = 13) were placebo controlled. Of the studies, 8 (13.3%) were conducted in a multicenter setting, 3 of which were responsible for 49.3% (n = 678) of the total included MSA patients. The description of primary outcomes was unclear in 60% (n = 40) of trials. Only 10 (16.7%) clinical trials clearly described the randomization process. Blinding of the participants, personnel, and outcome assessments were at high risk of bias in the majority of studies. The number of dropouts/withdrawals was high (n = 326, 23.4% among the included patients). Overall, the design and quality of reporting of the reviewed studies is unsatisfactory. The most frequent clinical trials were small and single centered. Inadequate reporting was related to the information on the randomization process, sequence generation, allocation concealment, blinding of participants, and sample size calculations. Although improved during the recent years, methodological quality and trial design need to be optimized to generate more informative results. © 2017 International Parkinson and Movement Disorder Society. © 2017 International Parkinson and Movement Disorder Society.

Reporting of health-related quality of life (HRQOL) data in oncology trials: a comparison of the European Organization for Research and Treatment of Cancer Quality of Life (EORTC QLQ-C30) and the Functional Assessment of Cancer Therapy-General (FACT-G).

PubMed

Smith, Adam B; Cocks, Kim; Parry, David; Taylor, Matthew

2014-04-01

The inclusion of patient-reported outcome (PRO) instruments to record patient health-related quality of life (HRQOL) data has virtually become the norm in oncology randomised controlled trials (RCTs). Despite this fact, recent concerns have focused on the quality of reporting of HRQOL. The primary aim of this study was to evaluate the quality of reporting of HRQOL data from two common instruments in oncology RCTs. A meta-review was undertaken of systematic reviews reporting HRQOL data collected using PRO instruments in oncology randomised controlled trials (RCTs). English language articles published between 2000 and 2012 were included and evaluated against a methodology checklist. Four hundred and thirty-five potential articles were identified. Six systematic reviews were included in the analysis. A total of 70,403 patients had completed PROs. The European Organization for Research and Treatment of Cancer QLQ-C30 and Functional Assessment of Cancer Therapy-General questionnaire accounted for 55 % of RCTs. Eighty per cent of RCTs had used psychometrically validated instruments; 70 % reported culturally valid instruments and almost all reported the assessment timing (96 %). Thirty per cent of RCTS reported clinical significance and missing data. In terms of methodological design, only 25 % of RCTs could be categorised as probably robust. The majority of oncology RCTs has shortcomings in terms of reporting HRQOL data when assessed against regulatory and methodology guidelines. These limitations will need to be addressed if HRQOL data are to be used to successfully support clinical decision-making, treatment options and labelling claims in oncology.

Music for medical indications in the neonatal period: a systematic review of randomised controlled trials.

PubMed

Hartling, L; Shaik, M S; Tjosvold, L; Leicht, R; Liang, Y; Kumar, M

2009-09-01

To conduct a systematic review of the efficacy of music for medical indications in term or preterm neonates. We searched 17 electronic databases, subject bibliographies, reference lists and trials registries. Two reviewers independently screened studies for inclusion, assessed methodological quality, and extracted data. Meta-analysis was not feasible due to heterogeneity in outcomes so a qualitative analysis is presented. Nine randomised trials were included. The methodological quality was generally poor (median Jadad score = 1). The outcomes most commonly reported were physiological measures (heart rate (HR), respiratory rate, oxygen saturation (SaO2)), behavioural state and pain. Six studies evaluated music for the painful procedures circumcision (three trials) and heel prick (three trials). For circumcisions, one high quality pilot study (n = 23) showed benefits of music for the outcomes of HR, SaO2 and pain, while two low quality studies showed no difference. For heel prick, three low quality studies provided some evidence that music may be beneficial primarily for measures of behaviour and pain. The remaining studies evaluated the use of music in preterm infants to improve physiological and behavioural parameters (n = 31; benefits observed for behavioural parameters), to reinforce non-nutritive sucking via use of a pacifier activated lullaby (n = 32; significant increase in feeding rates), and to influence physiological stability and behaviours in infants with chronic lung disease (n = 22; no significant differences for outcomes assessed). The heterogeneity in study populations, interventions and outcomes precludes definitive conclusions around efficacy. There is preliminary evidence for some therapeutic benefits of music for specific indications; however, these findings need to be confirmed in methodologically rigorous trials.

Back schools for nonspecific low back pain: a systematic review within the framework of the Cochrane Collaboration Back Review Group.

PubMed

Heymans, M W; van Tulder, M W; Esmail, R; Bombardier, C; Koes, B W

2005-10-01

A systematic review within the Cochrane Collaboration Back Review Group. To assess the effectiveness of back schools for patients with nonspecific low back pain (LBP). Since the introduction of the Swedish back school in 1969, back schools have frequently been used for treating patients with LBP. However, the content of back schools has changed and appears to vary widely today. We searched the MEDLINE and EMBASE databases and the Cochrane Central Register of Controlled Trials to November 2004 for relevant trials reported in English, Dutch, French, or German. We also screened references from relevant reviews and included trials. Randomized controlled trials that reported on any type of back school for nonspecific LBP were included. Four reviewers, blinded to authors, institution, and journal, independently extracted the data and assessed the quality of the trials. We set the high-quality level, a priori, at a trial meeting six or more of 11 internal validity criteria. Because data were clinically and statistically too heterogeneous to perform a meta-analysis, we used a qualitative review (best evidence synthesis) to summarize the results. The evidence was classified into four levels (strong, moderate, limited, or no evidence), taking into account the methodologic quality of the studies. We also evaluated the clinical relevance of the studies. Nineteen randomized controlled trials (3,584 patients) were included in this updated review. Overall, the methodologic quality was low, with only six trials considered to be high-quality. It was not possible to perform relevant subgroup analyses for LBP with radiation versus LBP without radiation. The results indicate that there is moderate evidence suggesting that back schools have better short- and intermediate-term effects on pain and functional status than other treatments for patients with recurrent and chronic LBP. There is moderate evidence suggesting that back schools for chronic LBP in an occupational setting are more effective than other treatments and placebo or waiting list controls on pain, functional status, and return to work during short- and intermediate-term follow-up. In general, the clinical relevance of the studies was rated as insufficient. There is moderate evidence suggesting that back schools, in an occupational setting, reduce pain and improve function and return-to-work status, in the short- and intermediate-term, compared with exercises, manipulation, myofascial therapy, advice, placebo, or waiting list controls, for patients with chronic and recurrent LBP. However, future trials should improve methodologic quality and clinical relevance and evaluate the cost-effectiveness of back schools.

[A Methodological Quality Assessment of South Korean Nursing Research using Structural Equation Modeling in South Korea].

PubMed

Kim, Jung-Hee; Shin, Sujin; Park, Jin-Hwa

2015-04-01

The purpose of this study was to evaluate the methodological quality of nursing studies using structural equation modeling in Korea. Databases of KISS, DBPIA, and National Assembly Library up to March 2014 were searched using the MeSH terms 'nursing', 'structure', 'model'. A total of 152 studies were screened. After removal of duplicates and non-relevant titles, 61 papers were read in full. Of the sixty-one articles retrieved, 14 studies were published between 1992 and 2000, 27, between 2001 and 2010, and 20, between 2011 and March 2014. The methodological quality of the review examined varied considerably. The findings of this study suggest that more rigorous research is necessary to address theoretical identification, two indicator rule, distribution of sample, treatment of missing values, mediator effect, discriminant validity, convergent validity, post hoc model modification, equivalent models issues, and alternative models issues should be undergone. Further research with robust consistent methodological study designs from model identification to model respecification is needed to improve the validity of the research.

The reliability of the Glasgow Coma Scale: a systematic review.

PubMed

Reith, Florence C M; Van den Brande, Ruben; Synnot, Anneliese; Gruen, Russell; Maas, Andrew I R

2016-01-01

The Glasgow Coma Scale (GCS) provides a structured method for assessment of the level of consciousness. Its derived sum score is applied in research and adopted in intensive care unit scoring systems. Controversy exists on the reliability of the GCS. The aim of this systematic review was to summarize evidence on the reliability of the GCS. A literature search was undertaken in MEDLINE, EMBASE and CINAHL. Observational studies that assessed the reliability of the GCS, expressed by a statistical measure, were included. Methodological quality was evaluated with the consensus-based standards for the selection of health measurement instruments checklist and its influence on results considered. Reliability estimates were synthesized narratively. We identified 52 relevant studies that showed significant heterogeneity in the type of reliability estimates used, patients studied, setting and characteristics of observers. Methodological quality was good (n = 7), fair (n = 18) or poor (n = 27). In good quality studies, kappa values were ≥0.6 in 85%, and all intraclass correlation coefficients indicated excellent reliability. Poor quality studies showed lower reliability estimates. Reliability for the GCS components was higher than for the sum score. Factors that may influence reliability include education and training, the level of consciousness and type of stimuli used. Only 13% of studies were of good quality and inconsistency in reported reliability estimates was found. Although the reliability was adequate in good quality studies, further improvement is desirable. From a methodological perspective, the quality of reliability studies needs to be improved. From a clinical perspective, a renewed focus on training/education and standardization of assessment is required.

Measurement properties of tools measuring mental health knowledge: a systematic review.

PubMed

Wei, Yifeng; McGrath, Patrick J; Hayden, Jill; Kutcher, Stan

2016-08-23

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties. We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown". We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools. Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

Does Methodological Guidance Produce Consistency? A Review of Methodological Consistency in Breast Cancer Utility Value Measurement in NICE Single Technology Appraisals.

PubMed

Rose, Micah; Rice, Stephen; Craig, Dawn

2018-06-01

Since 2004, National Institute for Health and Care Excellence (NICE) methodological guidance for technology appraisals has emphasised a strong preference for using the validated EuroQol 5-Dimensions (EQ-5D) quality-of-life instrument, measuring patient health status from patients or carers, and using the general public's preference-based valuation of different health states when assessing health benefits in economic evaluations. The aim of this study was to review all NICE single technology appraisals (STAs) for breast cancer treatments to explore consistency in the use of utility scores in light of NICE methodological guidance. A review of all published breast cancer STAs was undertaken using all publicly available STA documents for each included assessment. Utility scores were assessed for consistency with NICE-preferred methods and original data sources. Furthermore, academic assessment group work undertaken during the STA process was examined to evaluate the emphasis of NICE-preferred quality-of-life measurement methods. Twelve breast cancer STAs were identified, and many STAs used evidence that did not follow NICE's preferred utility score measurement methods. Recent STA submissions show companies using EQ-5D and mapping. Academic assessment groups rarely emphasized NICE-preferred methods, and queries about preferred methods were rare. While there appears to be a trend in recent STA submissions towards following NICE methodological guidance, historically STA guidance in breast cancer has generally not used NICE's preferred methods. Future STAs in breast cancer and reviews of older guidance should ensure that utility measurement methods are consistent with the NICE reference case to help produce consistent, equitable decision making.

Clinical information modeling processes for semantic interoperability of electronic health records: systematic review and inductive analysis.

PubMed

Moreno-Conde, Alberto; Moner, David; Cruz, Wellington Dimas da; Santos, Marcelo R; Maldonado, José Alberto; Robles, Montserrat; Kalra, Dipak

2015-07-01

This systematic review aims to identify and compare the existing processes and methodologies that have been published in the literature for defining clinical information models (CIMs) that support the semantic interoperability of electronic health record (EHR) systems. Following the preferred reporting items for systematic reviews and meta-analyses systematic review methodology, the authors reviewed published papers between 2000 and 2013 that covered that semantic interoperability of EHRs, found by searching the PubMed, IEEE Xplore, and ScienceDirect databases. Additionally, after selection of a final group of articles, an inductive content analysis was done to summarize the steps and methodologies followed in order to build CIMs described in those articles. Three hundred and seventy-eight articles were screened and thirty six were selected for full review. The articles selected for full review were analyzed to extract relevant information for the analysis and characterized according to the steps the authors had followed for clinical information modeling. Most of the reviewed papers lack a detailed description of the modeling methodologies used to create CIMs. A representative example is the lack of description related to the definition of terminology bindings and the publication of the generated models. However, this systematic review confirms that most clinical information modeling activities follow very similar steps for the definition of CIMs. Having a robust and shared methodology could improve their correctness, reliability, and quality. Independently of implementation technologies and standards, it is possible to find common patterns in methods for developing CIMs, suggesting the viability of defining a unified good practice methodology to be used by any clinical information modeler. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Complementary and alternative medicine for lowering blood lipid levels: A systematic review of systematic reviews.

PubMed

Posadzki, Paul; AlBedah, Abdullah M N; Khalil, Mohamed M K; AlQaed, Meshari S

2016-12-01

The aim of this article is to summarize and critically evaluate the evidence from systematic reviews (SRs) of complementary and alternative medicine (CAM) for lowering blood lipid levels (BLL). Eight electronic databases were searched until March 2016. Additionally, all the retrieved references were inspected manually for further relevant papers. Systematic reviews were considered eligible, if they included patients of any age and/or gender with elevated blood lipid levels using any type of CAM. We used the Oxman and AMSTAR criteria to critically appraise the methodological quality of the included SRs. Twenty-seven SRs were included in the analyses. The majority of the SRs were of high methodological quality (mean Oxman score=4.81, SD=4.88; and the mean AMSTAR score=7.22, SD=3.38). The majority of SRs (56%) arrived at equivocal conclusions (of these 8 were of high quality); 7 SRs (37%) arrived at positive conclusions (of these 6 were of high quality), and 2 (7%) arrived at negative conclusions (both were of high quality). There was conflicting evidence regarding the effectiveness of garlic; and promising evidence for yoga. To conclude, the evidence from SRs evaluating the effectiveness of CAM in lowering BLL is predominantly equivocal and confusing. Several limitations exist, such as variety of doses and preparations, confounding effects of diets and lifestyle factors, or heterogeneity of the primary trials among others. Copyright © 2016. Published by Elsevier Ltd.

Web-Based Interventions for Weight Loss or Weight Loss Maintenance in Overweight and Obese People: A Systematic Review of Systematic Reviews

PubMed Central

Sorgente, Angela; Manzoni, Gian Mauro; Re, Federica; Simpson, Susan; Perona, Sara; Rossi, Alessandro; Cattivelli, Roberto; Innamorati, Marco; Jackson, Jeffrey B; Castelnuovo, Gianluca

2017-01-01

Background Weight loss is challenging and maintenance of weight loss is problematic. Web-based programs offer good potential for delivery of interventions for weight loss or weight loss maintenance. However, the precise impact of Web-based weight management programs is still unclear. Objective The purpose of this meta-systematic review was to provide a comprehensive summary of the efficacy of Web-based interventions for weight loss and weight loss maintenance. Methods Electronic databases were searched for systematic reviews and meta-analyses that included at least one study investigating the effect of a Web-based intervention on weight loss and/or weight loss maintenance among samples of overweight and/or obese individuals. Twenty identified reviews met the inclusion criteria. The Revised Assessment of Multiple SysTemAtic Reviews (R-AMSTAR) was used to assess methodological quality of reviews. All included reviews were of sufficient methodological quality (R-AMSTAR score ≥22). Key methodological and outcome data were extracted from each review. Results Web-based interventions for both weight loss and weight loss maintenance were more effective than minimal or control conditions. However, when contrasted with comparable non-Web-based interventions, results were less consistent across reviews. Conclusions Overall, the efficacy of weight loss maintenance interventions was stronger than the efficacy of weight loss interventions, but further evidence is needed to more clearly understand the efficacy of both types of Web-based interventions. Trial Registration PROSPERO 2015: CRD42015029377; http://www.crd.york.ac.uk/PROSPERO/display_record.asp? ID=CRD42015029377 (Archived by WebCite at http://www.webcitation.org/6qkSafdCZ) PMID:28652225

The reliability and validity of cervical auscultation in the diagnosis of dysphagia: a systematic review.

PubMed

Lagarde, Marloes L J; Kamalski, Digna M A; van den Engel-Hoek, Lenie

2016-02-01

To systematically review the available evidence for the reliability and validity of cervical auscultation in diagnosing the several aspects of dysphagia in adults and children suffering from dysphagia. Medline (PubMed), Embase and the Cochrane Library databases. The systematic review was carried out applying the steps of the PRISMA-statement. The methodological quality of the included studies were evaluated using the Dutch 'Cochrane checklist for diagnostic accuracy studies'. A total of 90 articles were identified through the search strategy, and after applying the inclusion and exclusion criteria, six articles were included in this review. In the six studies, 197 patients were assessed with cervical auscultation. Two of the six articles were considered to be of 'good' quality and three studies were of 'moderate' quality. One article was excluded because of a 'poor' methodological quality. Sensitivity ranges from 23%-94% and specificity ranges from 50%-74%. Inter-rater reliability was 'poor' or 'fair' in all studies. The intra-rater reliability shows a wide variance among speech language therapists. In this systematic review, conflicting evidence is found for the validity of cervical auscultation. The reliability of cervical auscultation is insufficient when used as a stand-alone tool in the diagnosis of dysphagia in adults. There is no available evidence for the validity and reliability of cervical auscultation in children. Cervical auscultation should not be used as a stand-alone instrument to diagnose dysphagia. © The Author(s) 2015.

Authentic leadership in healthcare: a scoping review.

PubMed

Malila, Niina; Lunkka, Nina; Suhonen, Marjo

2018-02-05

Purpose The purpose of this paper is to review peer-reviewed original research articles on authentic leadership (AL) in health care to identify potential research gaps and present recommendations for future research. The objectives are to examine and map evidence of the main characteristics, research themes and methodologies in the studies. AL is a leader's non-authoritarian, ethical and transparent behaviour pattern. Design/methodology/approach A scoping review with thematic analysis was conducted. A three-step search strategy was used with database and manual searches. The included studies were composed of English language peer-reviewed original research articles referring to both AL and health care. Findings In total, 29 studies were included. The studies favoured Canadian nurses in acute care hospitals. AL was understood as its original definition. The review identified four research themes: well-being at work, patient care quality, work environment and AL promotion. Quantitative research methodology with the authentic leadership questionnaire and cross-sectional design were prevalent. Research limitations/implications Future research needs more variation in research themes, study populations, settings, organisations, work sectors, geographical origins and theory perspectives. Different research methodologies, such as qualitative and mixed methods research and longitudinal designs, should be used more. Originality/value This is presumably the first literature review to map the research on AL in health care.

Evaluation of the methodological quality of studies of the performance of diagnostic tests for bovine tuberculosis using QUADAS.

PubMed

Downs, Sara H; More, Simon J; Goodchild, Anthony V; Whelan, Adam O; Abernethy, Darrell A; Broughan, Jennifer M; Cameron, Angus; Cook, Alasdair J; Ricardo de la Rua-Domenech, R; Greiner, Matthias; Gunn, Jane; Nuñez-Garcia, Javier; Rhodes, Shelley; Rolfe, Simon; Sharp, Michael; Upton, Paul; Watson, Eamon; Welsh, Michael; Woolliams, John A; Clifton-Hadley, Richard S; Parry, Jessica E

2018-05-01

There has been little assessment of the methodological quality of studies measuring the performance (sensitivity and/or specificity) of diagnostic tests for animal diseases. In a systematic review, 190 studies of tests for bovine tuberculosis (bTB) in cattle (published 1934-2009) were assessed by at least one of 18 reviewers using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies) checklist adapted for animal disease tests. VETQUADAS (VQ) included items measuring clarity in reporting (n = 3), internal validity (n = 9) and external validity (n = 2). A similar pattern for compliance was observed in studies of different diagnostic test types. Compliance significantly improved with year of publication for all items measuring clarity in reporting and external validity but only improved in four of the nine items measuring internal validity (p < 0.05). 107 references, of which 83 had performance data eligible for inclusion in a meta-analysis were reviewed by two reviewers. In these references, agreement between reviewers' responses was 71% for compliance, 32% for unsure and 29% for non-compliance. Mean compliance with reporting items was 2, 5.2 for internal validity and 1.5 for external validity. The index test result was described in sufficient detail in 80.1% of studies and was interpreted without knowledge of the reference standard test result in only 33.1%. Loss to follow-up was adequately explained in only 31.1% of studies. The prevalence of deficiencies observed may be due to inadequate reporting but may also reflect lack of attention to methodological issues that could bias the results of diagnostic test performance estimates. QUADAS was a useful tool for assessing and comparing the quality of studies measuring the performance of diagnostic tests but might be improved further by including explicit assessment of population sampling strategy. Crown Copyright © 2017. Published by Elsevier B.V. All rights reserved.

Is there an "abortion trauma syndrome"? Critiquing the evidence.

PubMed

Robinson, Gail Erlick; Stotland, Nada L; Russo, Nancy Felipe; Lang, Joan A; Occhiogrosso, Mallay

2009-01-01

The objective of this review is to identify and illustrate methodological issues in studies used to support claims that induced abortion results in an "abortion trauma syndrome" or a psychiatric disorder. After identifying key methodological issues to consider when evaluating such research, we illustrate these issues by critically examining recent empirical studies that are widely cited in legislative and judicial testimony in support of the existence of adverse psychiatric sequelae of induced abortion. Recent studies that have been used to assert a causal connection between abortion and subsequent mental disorders are marked by methodological problems that include, but not limited to: poor sample and comparison group selection; inadequate conceptualization and control of relevant variables; poor quality and lack of clinical significance of outcome measures; inappropriateness of statistical analyses; and errors of interpretation, including misattribution of causal effects. By way of contrast, we review some recent major studies that avoid these methodological errors. The most consistent predictor of mental disorders after abortion remains preexisting disorders, which, in turn, are strongly associated with exposure to sexual abuse and intimate violence. Educating researchers, clinicians, and policymakers how to appropriately assess the methodological quality of research about abortion outcomes is crucial. Further, methodologically sound research is needed to evaluate not only psychological outcomes of abortion, but also the impact of existing legislation and the effects of social attitudes and behaviors on women who have abortions.

Systematic review of economic analyses in patient safety: a protocol designed to measure development in the scope and quality of evidence.

PubMed

Carter, Alexander W; Mandavia, Rishi; Mayer, Erik; Marti, Joachim; Mossialos, Elias; Darzi, Ara

2017-08-18

Recent avoidable failures in patient care highlight the ongoing need for evidence to support improvements in patient safety. According to the most recent reviews, there is a dearth of economic evidence related to patient safety. These reviews characterise an evidence gap in terms of the scope and quality of evidence available to support resource allocation decisions. This protocol is designed to update and improve on the reviews previously conducted to determine the extent of methodological progress in economic analyses in patient safety. A broad search strategy with two core themes for original research (excluding opinion pieces and systematic reviews) in 'patient safety' and 'economic analyses' has been developed. Medline, Econlit and National Health Service Economic Evaluation Database bibliographic databases will be searched from January 2007 using a combination of medical subject headings terms and research-derived search terms (see table 1). The method is informed by previous reviews on this topic, published in 2012. Screening, risk of bias assessment (using the Cochrane collaboration tool) and economic evaluation quality assessment (using the Drummond checklist) will be conducted by two independent reviewers, with arbitration by a third reviewer as needed. Studies with a low risk of bias will be assessed using the Drummond checklist. High-quality economic evaluations are those that score >20/35. A qualitative synthesis of evidence will be performed using a data collection tool to capture the study design(s) employed, population(s), setting(s), disease area(s), intervention(s) and outcome(s) studied. Methodological quality scores will be compared with previous reviews where possible. Effect size(s) and estimate uncertainty will be captured and used in a quantitative synthesis of high-quality evidence, where possible. Formal ethical approval is not required as primary data will not be collected. The results will be disseminated through a peer-reviewed publication, presentations and social media. CRD42017057853. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Current Evidence on Heart Rate Variability Biofeedback as a Complementary Anticraving Intervention.

PubMed

Alayan, Nour; Eller, Lucille; Bates, Marsha E; Carmody, Dennis P

2018-05-21

The limited success of conventional anticraving interventions encourages research into new treatment strategies. Heart rate variability biofeedback (HRVB), which is based on slowed breathing, was shown to improve symptom severity in various disorders. HRVB, and certain rates of controlled breathing (CB), may offer therapeutic potential as a complementary drug-free treatment option to help control substance craving. This review evaluated current evidence on the effectiveness of HRVB and CB training as a complementary anticraving intervention, based on guidelines from the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols. Studies that assessed a cardiorespiratory feedback or CB intervention with substance craving as an outcome were selected. Effect sizes were calculated for each study. The Scale for Assessing Scientific Quality of Investigations in Complementary and Alternative Medicine was used to evaluate the quality of each study reviewed. A total of eight articles remained for final review, including controlled studies with or without randomization, as well as noncontrolled trials. Most studies showed positive results with a variety of methodological quality levels and effect size. Current HRVB studies rated moderately on methodological rigor and showed inconsistent magnitudes of calculated effect size (0.074-0.727) across populations. The largest effect size was found in a nonclinical college population of high food cravers utilizing the most intensive HRVB training time of 240 min. Despite the limitations of this review, there is beginning evidence that HRVB and CB training can be of significant therapeutic potential. Larger clinical trials are needed with methodological improvements such as longer treatment duration, adequate control conditions, measures of adherence and compliance, longitudinal examination of craving changes, and more comprehensive methods of craving measurement.

Methodological Considerations in Designing and Evaluating Animal-Assisted Interventions.

PubMed

Stern, Cindy; Chur-Hansen, Anna

2013-02-27

This paper presents a discussion of the literature on animal-assisted interventions and describes limitations surrounding current methodological quality. Benefits to human physical, psychological and social health cannot be empirically confirmed due to the methodological limitations of the existing body of research, and comparisons cannot validly be made across different studies. Without a solid research base animal-assisted interventions will not receive recognition and acceptance as a credible alternative health care treatment. The paper draws on the work of four systematic reviews conducted over April-May 2009, with no date restrictions, focusing exclusively on the use of canine-assisted interventions for older people residing in long-term care. The reviews revealed a lack of good quality studies. Although the literature base has grown in volume since its inception, it predominantly consists of anecdotal accounts and reports. Experimental studies undertaken are often flawed in aspects of design, conduct and reporting. There are few qualitative studies available leading to the inability to draw definitive conclusions. It is clear that due to the complexities associated with these interventions not all weaknesses can be eliminated. However, there are basic methodological weaknesses that can be addressed in future studies in the area. Checklists for quantitative and qualitative research designs to guide future research are offered to help address methodological rigour.

75 FR 71131 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-22

... impacts. To complete this task with scientific rigor, it will be necessary to collect high quality survey... instruments, methodologies, procedures, and analytical techniques for this task. Moreover, they have been pilot tested in 11 States. The tools and techniques were submitted for review, and were approved, by...

A Systematic Review of Depression Treatments in Primary Care for Latino Adults

ERIC Educational Resources Information Center

Cabassa, Leopoldo J.; Hansen, Marissa C.

2007-01-01

Objective: A systematic literature review of randomized clinical trials (RCTs) assessing depression treatments in primary care for Latinos is conducted. The authors rate the methodological quality of studies, examine cultural and linguistic adaptations, summarize clinical outcomes and cost-effectiveness findings, and draw conclusions for improving…

Psychosocial Interventions for Women with HIV/AIDS: A Critical Review

ERIC Educational Resources Information Center

Hernandez, Julieta P.; Macgowan, Mark J.

2015-01-01

Objective: Recent research on psychosocial interventions addressing the well-being of women with HIV/AIDS has brought new options for practitioners. This study critically reviews the treatment features, methodological quality, and efficacy of these interventions. Methods: A comprehensive search between 2000 and 2011 identified 19 studies employing…

Train the Trainer Effectiveness Trials of Behavioral Intervention for Individuals with Autism: A Systematic Review

ERIC Educational Resources Information Center

Shire, Stephanie Yoshiko; Kasari, Connie

2014-01-01

This systematic review examines train the trainer (TTT) effectiveness trials of behavioral interventions for individuals with autism spectrum disorder (ASD). Published methodological quality scales were used to assess studies including participant description, research design, intervention, outcomes, and analysis. Twelve studies including 9 weak…

Mexican American Mothers' Perceptions of Childhood Obesity: A Theory-Guided Systematic Literature Review

ERIC Educational Resources Information Center

Sosa, Erica T.

2012-01-01

Childhood obesity continues to increase, disproportionately affecting Mexican American children. The aims of this review are to (a) assess the literature regarding Mexican American mothers' knowledge and perceptions of childhood obesity, prevention, and their role in prevention; (b) critically evaluate the methodological quality of the research…

Problem-Solving Therapy for Depression in Adults: A Systematic Review

ERIC Educational Resources Information Center

Gellis, Zvi D.; Kenaley, Bonnie

2008-01-01

Objectives: This article presents a systematic review of the evidence on problem-solving therapy (PST) for depressive disorders in noninstitutionalized adults. Method: Intervention studies using randomized controlled designs are included and methodological quality is assessed using a standard set of criteria from the Cochrane Collaborative Review…

Waiting Online: A Review and Research Agenda.

ERIC Educational Resources Information Center

Ryan, Gerard; Valverde, Mireia

2003-01-01

Reviews 21 papers based on 13 separate empirical studies on waiting on the Internet, drawn from the areas of marketing, system response time, and quality of service studies. The article proposes an agenda for future research, including extending the range of research methodologies, broadening the definition of waiting on the Internet, and…

Air Quality Criteria for Ozone and Other Photochemical Oxidants. External Review Draft No 1. Volume III

EPA Science Inventory

This review of the effects of photochemical oxidants on vegetation and the responses of vegetation to photochemical oxidants first discusses the general methodologies used in studies of air pollution effects to provide a basis for understanding the methods, approaches, and experi...

77 FR 55843 - Office of Facilities Management and Program Services; Submission for OMB Review; Background...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-11

... of Facilities Management and Program Services; Submission for OMB Review; Background Investigations... collection of personal data for background investigations for child care workers accessing GSA owned and... assumptions and methodology; ways to enhance the quality, utility, and clarity of the information to be...

Overview of Systematic Reviews: Yoga as a Therapeutic Intervention for Adults with Acute and Chronic Health Conditions

PubMed Central

McCall, Marcy C.; Ward, Alison; Roberts, Nia W.; Heneghan, Carl

2013-01-01

Objectives. Overview the quality, direction, and characteristics of yoga interventions for treatment of acute and chronic health conditions in adult populations. Methods. We searched for systematic reviews in 10 online databases, bibliographic references, and hand-searches in yoga-related journals. Included reviews satisfy Oxman criteria and specify yoga as a primary intervention in one or more randomized controlled trials for treatment in adults. The AMSTAR tool and GRADE approach evaluated the methodological quality of reviews and quality of evidence. Results. We identified 2202 titles, of which 41 full-text articles were assessed for eligibility and 26 systematic reviews satisfied inclusion criteria. Thirteen systematic reviews include quantitative data and six papers include meta-analysis. The quality of evidence is generally low. Sixteen different types of health conditions are included. Eleven reviews show tendency towards positive effects of yoga intervention, 15 reviews report unclear results, and no, reviews report adverse effects of yoga. Yoga appears most effective for reducing symptoms in anxiety, depression, and pain. Conclusion. Although the quality of systematic reviews is high, the quality of supporting evidence is low. Significant heterogeneity and variability in reporting interventions by type of yoga, settings, and population characteristics limit the generalizability of results. PMID:23762174

A Systematic Review of Herbal Medicine for Chemotherapy Induced Peripheral Neuropathy

PubMed Central

Noh, Hyeonseok

2018-01-01

Background Chemotherapy-induced peripheral neuropathy (CIPN) is a common adverse effect in cancer patients. The aim of this review was to assess the effectiveness of herbal medicine in preventing and treating CIPN. Methods Randomised controlled trials were included in this review. Extracting and assessing the data independently, two authors searched 13 databases. Results Twenty-eight trials involving 2174 patients met the inclusion criteria. Although there were some exceptions, the methodological quality was typically low. Seventeen trials reported the incidence rate of CIPN assessed by various tools and 14 showed a significant difference regarding the decrease of the incidence rate between the two groups. For clinical improvement, 12 trials reported it using various tools and 10 showed a significant difference between two groups. Two cases of adverse events occurred in one trial; the other nine trials reported no adverse events. Conclusions We found that herbal medicines in combination with and/or without other therapies potentially have preventive or therapeutic effects on CIPN. However, conclusions cannot be drawn because of the generally low quality of the methodology, the clinical heterogeneity, and the small sample size for each single herbal medicine. Trials that are more rigorous and report sufficient methodological data are needed. PMID:29636782

The association between physical activity and neck and low back pain: a systematic review.

PubMed

Sitthipornvorakul, Ekalak; Janwantanakul, Prawit; Purepong, Nithima; Pensri, Praneet; van der Beek, Allard J

2011-05-01

The effect of physical activity on neck and low back pain is still controversial. No systematic review has been conducted on the association between daily physical activity and neck and low back pain. The objective of this study was to evaluate the association between physical activity and the incidence/prevalence of neck and low back pain. Publications were systematically searched from 1980 to June 2009 in several databases. The following key words were used: neck pain, back pain, physical activity, leisure time activity, daily activity, everyday activity, lifestyle activity, sedentary, and physical inactivity. A hand search of relevant journals was also carried out. Relevant studies were retrieved and assessed for methodological quality by two independent reviewers. The strength of the evidence was based on methodological quality and consistency of the results. Seventeen studies were included in this review, of which 13 were rated as high-quality studies. Of high-quality studies, there was limited evidence for no association between physical activity and neck pain in workers and strong evidence for no association in school children. Conflicting evidence was found for the association between physical activity and low back pain in both general population and school children. Literature with respect to the effect of physical activity on neck and low back pain was too heterogeneous and more research is needed before any final conclusion can be reached.

Reliability of specific physical examination tests for the diagnosis of shoulder pathologies: a systematic review and meta-analysis.

PubMed

Lange, Toni; Matthijs, Omer; Jain, Nitin B; Schmitt, Jochen; Lützner, Jörg; Kopkow, Christian

2017-03-01

Shoulder pain in the general population is common and to identify the aetiology of shoulder pain, history, motion and muscle testing, and physical examination tests are usually performed. The aim of this systematic review was to summarise and evaluate intrarater and inter-rater reliability of physical examination tests in the diagnosis of shoulder pathologies. A comprehensive systematic literature search was conducted using MEDLINE, EMBASE, Allied and Complementary Medicine Database (AMED) and Physiotherapy Evidence Database (PEDro) through 20 March 2015. Methodological quality was assessed using the Quality Appraisal of Reliability Studies (QAREL) tool by 2 independent reviewers. The search strategy revealed 3259 articles, of which 18 finally met the inclusion criteria. These studies evaluated the reliability of 62 test and test variations used for the specific physical examination tests for the diagnosis of shoulder pathologies. Methodological quality ranged from 2 to 7 positive criteria of the 11 items of the QAREL tool. This review identified a lack of high-quality studies evaluating inter-rater as well as intrarater reliability of specific physical examination tests for the diagnosis of shoulder pathologies. In addition, reliability measures differed between included studies hindering proper cross-study comparisons. PROSPERO CRD42014009018. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Methodological quality of economic evaluations of new pharmaceuticals in The Netherlands.

PubMed

Hoomans, Ties; Severens, Johan L; van der Roer, Nicole; Delwel, Gepke O

2012-03-01

In the Netherlands, decisions about the reimbursement of new pharmaceuticals are based on cost effectiveness, as well as therapeutic value and budget impact. Since 1 January 2005, drug manufacturers are formally required to substantiate the cost effectiveness of drugs that have therapeutic added value in comparison with existing ones through pharmacoeconomic evaluations. Dutch guidelines for pharmacoeconomic research provide methods guidance, ensuring consistency in both the evidence and the decision-making process about drug reimbursement. This study reviewed the methodological quality of all 21 formally required pharmacoeconomic evaluations of new pharmaceuticals between 1 January 2005 and 1 October 2008, and verified whether these evaluations complied with pharmacoeconomic guidelines. Data on the quality of the pharmacoeconomic evaluations were extracted from the pharmacoeconomic reports published by the Dutch Health Care Insurance Board (CVZ). The Board's newsletters provided information on the advice to, and reimbursement decisions made by, the Dutch Minister of Health. All data extraction was carried out by two independent reviewers, and descriptive analyses were conducted. The methodological quality was sound in only 8 of the 21 pharmacoeconomic evaluations. In most cases, the perspective of analysis, the comparator drugs, and the reporting of both total and incremental costs and effects were correct. However, drug indication, form (i.e. cost utility/cost effectiveness) and time horizon of the evaluations were frequently flawed. Moreover, the costs and effects of the pharmaceuticals were not always analysed correctly, and modelling studies were often non-transparent. Twelve drugs were reimbursed, and nine were not. The compliance with pharmacoeconomic guidelines in economic evaluations of new pharmaceuticals can be improved. This would improve the methodological quality of the pharmacoeconomic evaluations and ensure consistency in the evidence and the decision-making process for drug reimbursement in the Netherlands.

The effects of group supervision of nurses: a systematic literature review.

PubMed

Francke, Anneke L; de Graaff, Fuusje M

2012-09-01

To gain insight into the existing scientific evidence on the effects of group supervision for nurses. A systematic literature study of original research publications. Searches were performed in February 2010 in PubMed, CINAHL, Cochrane Library, Embase, ERIC, the NIVEL catalogue, and PsycINFO. No limitations were applied regarding date of publication, language or country. Original research publications were eligible for review when they described group supervision programmes directed at nurses; used a control group or a pre-test post-test design; and gave information about the effects of group supervision on nurse or patient outcomes. The two review authors independently assessed studies for inclusion. The methodological quality of included studies was also independently assessed by the review authors, using a check list developed by Van Tulder et al. in collaboration with the Dutch Cochrane Centre. Data related to the original publications were extracted by one review author and checked by a second review author. No statistical pooling of outcomes was performed, because there was large heterogeneity of outcomes. A total of 1087 potentially relevant references were found. After screening of the references, eight studies with a control group and nine with a pre-test post-test design were included. Most of the 17 studies included have serious methodological limitations, but four Swedish publications in the field of dementia care had high methodological quality and all point to positive effects on nurses' attitudes and skills and/or nurse-patient interactions. However, in interpreting these positive results, it must be taken into account that these four high-quality publications concern sub-studies of one 'sliced' research project using the same study sample. Moreover, these four publications combined a group supervision intervention with the introduction of individual care planning, which also hampers conclusions about the effectiveness of group supervision alone. Although there are rather a lot of indications that group supervision of nurses is effective, evidence on the effects is still scarce. Further methodologically sound research is needed. Copyright © 2011 Elsevier Ltd. All rights reserved.

Inventory of Personal Factors Influencing Conditioned Pain Modulation in Healthy People: A Systematic Literature Review.

PubMed

Hermans, Linda; Van Oosterwijck, Jessica; Goubert, Dorien; Goudman, Lisa; Crombez, Geert; Calders, Patrick; Meeus, Mira

2016-07-01

Conditioned pain modulation (CPM) is believed to play an important role in the development and exacerbation of chronic pain, because dysfunction of CPM is associated with a shift in balance between pain facilitation and pain inhibition. In many patients with central sensitization, CPM is less efficacious. Besides that, efficacy of CPM is highly variable in healthy people. Consequently, it seems that several individual variables may influence CPM. A systematic review examining personal factors influencing CPM was conducted. This systematic review follows the PRISMA guidelines. "Pubmed" and "Web of Science" were searched using different synonyms of CPM. Full-text clinical reports addressing the influence of personal factors on CPM in healthy adults were included. Checklists for RCTs and case-control studies provided by the Dutch Institute for Healthcare Improvement (CBO) and the Dutch Cochrane Centre were utilized to assess methodological quality. Levels of evidence and strength of conclusion were assigned using the CBO guidelines. Forty-six articles were identified that reported the influence of personal factors on CPM. Quality assessment revealed 10 studies with a methodological quality less than 50% wherefore they were excluded (21.8%), resulting in a general total methodological quality score of 72.5%. Overall younger adult age, male gender, ovulatory phase, positive expectations, attention to the conditioning stimulus, and carrier of the 5-HTTLPR long allele result in better CPM. It is advised for future studies to take these factors into account. Further research regarding the influence of oral contraceptives, catastrophizing, information about conditioning stimulation, distraction, physical activity, and genetics on CPM magnitude is required. © 2015 World Institute of Pain.

Effects of obesity on lung volume and capacity in children and adolescents: a systematic review.

PubMed

Winck, Aline Dill; Heinzmann-Filho, João Paulo; Soares, Rafaela Borges; da Silva, Juliana Severo; Woszezenki, Cristhiele Taís; Zanatta, Letiane Bueno

2016-12-01

To assess the effects of obesity on lung volume and capacity in children and adolescents. This is a systematic review, carried out in Pubmed, Lilacs, Scielo and PEDro databases, using the following Keywords: Plethysmography; Whole Body OR Lung Volume Measurements OR Total Lung Capacity OR Functional Residual Capacity OR Residual Volume AND Obesity. Observational studies or clinical trials that assessed the effects of obesity on lung volume and capacity in children and adolescents (0-18 years) without any other associated disease; in English; Portuguese and Spanish languages were selected. Methodological quality was assessed by the Agency for Healthcare Research and Quality. Of the 1,030 articles, only four were included in the review. The studies amounted to 548 participants, predominantly males, with sample size ranging from 45 to 327 individuals. 100% of the studies evaluated nutritional status through BMI (z-score) and 50.0% reported the data on abdominal circumference. All demonstrated that obesity causes negative effects on lung volume and capacity, causing a reduction mainly in functional residual capacity in 75.0% of the studies; in the expiratory reserve volume in 50.0% and in the residual volume in 25.0%. The methodological quality ranged from moderate to high, with 75.0% of the studies classified as having high methodological quality. Obesity causes deleterious effects on lung volume and capacity in children and adolescents, mainly by reducing functional residual capacity, expiratory reserve volume and residual volume. Copyright © 2016 Sociedade de Pediatria de São Paulo. Publicado por Elsevier Editora Ltda. All rights reserved.

[Cancer pain management: Systematic review and critical appraisal of clinical practice guidelines].

PubMed

Martínez-Nicolás, I; Ángel-García, D; Saturno, P J; López-Soriano, F

2016-01-01

Although several clinical practice guidelines have been developed in the last decades, cancer pain management is still deficient. The purpose of this work was to carry out a comprehensive and systematic literature review of current clinical practice guidelines on cancer pain management, and critically appraise their methodology and content in order to evaluate their quality and validity to cope with this public health issue. A systematic review was performed in the main databases, using English, French and Spanish as languages, from 2008 to 2013. Reporting and methodological quality was rated with the Appraisal of Guidelines, Research and Evaluation II (AGREE-II) tool, including an inter-rater reliability analysis. Guideline recommendations were extracted and classified into several categories and levels of evidence, aiming to analyse guidelines variability and evidence-based content comprehensiveness. Six guidelines were included. A wide variability was found in both reporting and methodological quality of guidelines, as well as in the content and the level of evidence of their recommendations. The Scottish Intercollegiate Guidelines Network guideline was the best rated using AGREE-II, while the Sociedad Española de Oncología Médica guideline was the worst rated. The Ministry of Health Malaysia guideline was the most comprehensive, and the Scottish Intercollegiate Guidelines Network guideline was the second one. The current guidelines on cancer pain management have limited quality and content. We recommend Ministry of Health Malaysia and Scottish Intercollegiate Guidelines Network guidelines, whilst Sociedad Española de Oncología Médica guideline still needs to improve. Copyright © 2015 SECA. Published by Elsevier Espana. All rights reserved.

Are validated outcome measures used in distal radial fractures truly valid?

PubMed Central

Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

2016-01-01

Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the validity on hypothesis testing are good. There is no evidence for the other measurement properties. Conclusion According to this systematic review, there is, at best, moderate evidence that the responsiveness of the PRWE and DASH are good, as are the reliability and validity of the PRWE. We recommend these PROMs in clinical studies in patients with distal radial fractures; however, more clinimetric studies of higher methodological quality are needed to adequately determine the other measurement properties. Cite this article: Dr Y. V. Kleinlugtenbelt. Are validated outcome measures used in distal radial fractures truly valid?: A critical assessment using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Bone Joint Res 2016;5:153–161. DOI: 10.1302/2046-3758.54.2000462. PMID:27132246

Measuring attitudes towards the dying process: A systematic review of tools.

PubMed

Groebe, Bernadette; Strupp, Julia; Eisenmann, Yvonne; Schmidt, Holger; Schlomann, Anna; Rietz, Christian; Voltz, Raymond

2018-04-01

At the end of life, anxious attitudes concerning the dying process are common in patients in Palliative Care. Measurement tools can identify vulnerabilities, resources and the need for subsequent treatment to relieve suffering and support well-being. To systematically review available tools measuring attitudes towards dying, their operationalization, the method of measurement and the methodological quality including generalizability to different contexts. Systematic review according to the PRISMA Statement. Methodological quality of tools assessed by standardized review criteria. MEDLINE, PsycINFO, PsyndexTests and the Health and Psychosocial Instruments were searched from their inception to April 2017. A total of 94 identified studies reported the development and/or validation of 44 tools. Of these, 37 were questionnaires and 7 alternative measurement methods (e.g. projective measures). In 34 of 37 questionnaires, the emotional evaluation (e.g. anxiety) towards dying is measured. Dying is operationalized in general items ( n = 20), in several specific aspects of dying ( n = 34) and as dying of others ( n = 14). Methodological quality of tools was reported inconsistently. Nine tools reported good internal consistency. Of 37 tools, 4 were validated in a clinical sample (e.g. terminal cancer; Huntington disease), indicating questionable generalizability to clinical contexts for most tools. Many tools exist to measure attitudes towards the dying process using different endpoints. This overview can serve as decision framework on which tool to apply in which contexts. For clinical application, only few tools were available. Further validation of existing tools and potential alternative methods in various populations is needed.

What methods do reviews of normative ethics literature use for search, selection, analysis, and synthesis? In-depth results from a systematic review of reviews.

PubMed

Mertz, Marcel; Strech, Daniel; Kahrass, Hannes

2017-12-19

(Semi-)systematic approaches to finding, analysing, and synthesising ethics literature on medical topics are still in their infancy. However, our recent systematic review showed that the rate of publication of such (semi-)systematic reviews has increased in the last two decades. This is not only true for reviews of empirical ethics literature, but also for reviews of normative ethics literature. In the latter case, there is currently little in the way of standards and guidance available. Therefore, the methods and reporting strategies of such reviews vary greatly. The purpose of the follow-up study we present was to obtain deeper methodological insight into the ways reviews of normative literature are actually conducted and to analyse the methods used. Our search in the PubMed, PhilPapers, and Google Scholar databases led to the identification of 183 reviews of ethics literature published between 1997 and 2015, of which 84 were identified as reviews of normative and mixed literature. Qualitative content analysis was used to extract and synthesise descriptions of search, selection, quality appraisal, analysis, and synthesis methods. We further assessed quantitatively how often certain methods (e.g. search strategies, data analysis procedures) were used by the reviews. The overall reporting quality varies among the analysed reviews and was generally poor even for major criteria regarding the search and selection of literature. For example, only 24 (29%) used a PRISMA flowchart. Also, only 55 (66%) reviews mentioned the information unit they sought to extract, and 12 (14%) stated an ethical approach as the theoretical basis for the analysis. Interpretable information on the synthesis method was given by 47 (60%); the most common methods applied were qualitative methods commonly used in social science research (83%). Reviews which fail to provide sufficient relevant information to readers have reduced methodological transparency regardless of actual methodological quality. In order to increase the internal validity (i.e. reproducibility) as well as the external validity (i.e. utility for the intended audience) of future reviews of normative literature, we suggest more accurate reporting regarding the goal of the review, the definition of the information unit, the ethical approach used, and technical aspects.

Systematic reviews of animal studies; missing link in translational research?

PubMed

van Luijk, Judith; Bakker, Brenda; Rovers, Maroeska M; Ritskes-Hoitinga, Merel; de Vries, Rob B M; Leenaars, Marlies

2014-01-01

The methodological quality of animal studies is an important factor hampering the translation of results from animal studies to a clinical setting. Systematic reviews of animal studies may provide a suitable method to assess and thereby improve their methodological quality. The aims of this study were: 1) to evaluate the risk of bias assessment in animal-based systematic reviews, and 2) to study the internal validity of the primary animal studies included in these systematic reviews. We systematically searched Pubmed and Embase for SRs of preclinical animal studies published between 2005 and 2012. A total of 91 systematic reviews met our inclusion criteria. The risk of bias was assessed in 48 (52.7%) of these 91 systematic reviews. Thirty-three (36.3%) SRs provided sufficient information to evaluate the internal validity of the included studies. Of the evaluated primary studies, 24.6% was randomized, 14.6% reported blinding of the investigator/caretaker, 23.9% blinded the outcome assessment, and 23.1% reported drop-outs. To improve the translation of animal data to clinical practice, systematic reviews of animal studies are worthwhile, but the internal validity of primary animal studies needs to be improved. Furthermore, risk of bias should be assessed by systematic reviews of animal studies to provide insight into the reliability of the available evidence.

Systematic reviews and meta-analyses on treatment of asthma: critical evaluation

PubMed Central

Jadad, Alejandro R; Moher, Michael; Browman, George P; Booker, Lynda; Sigouin, Christopher; Fuentes, Mario; Stevens, Robert

2000-01-01

Objective To evaluate the clinical, methodological, and reporting aspects of systematic reviews and meta-analyses on the treatment of asthma and to compare those published by the Cochrane Collaboration with those published in paper based journals. Design Analysis of studies identified from Medline, CINAHL, HealthSTAR, EMBASE, Cochrane Library, personal collections, and reference lists. Studies Articles describing a systematic review or a meta-analysis of the treatment of asthma that were published as a full report, in any language or format, in a peer reviewed journal or the Cochrane Library. Main outcome measures General characteristics of studies reviewed and methodological characteristics (sources of articles; language restrictions; format, design, and publication status of studies included; type of data synthesis; and methodological quality). Results 50 systematic reviews and meta-analyses were included. More than half were published in the past two years. Twelve reviews were published in the Cochrane Library and 38 were published in 22 peer reviewed journals. Forced expiratory volume in one second was the most frequently used outcome, but few reviews evaluated the effect of treatment on costs or patient preferences. Forty reviews were judged to have serious or extensive flaws. All six reviews associated with industry were in this group. Seven of the 10 most rigorous reviews were published in the Cochrane Library. Conclusions Most reviews published in peer reviewed journals or funded by industry have serious methodological flaws that limit their value to guide decisions. Cochrane reviews are more rigorous and better reported than those published in peer reviewed journals. PMID:10688558

Vaccines are different: A systematic review of budget impact analyses of vaccines.

PubMed

Loze, Priscilla Magalhaes; Nasciben, Luciana Bertholim; Sartori, Ana Marli Christovam; Itria, Alexander; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2017-05-15

Several countries require manufacturers to present a budget impact analysis (BIA), together with a cost-effectiveness analysis, to support national funding requests. However, guidelines for conducting BIA of vaccines are scarce. To analyze the methodological approaches used in published budget impact analysis (BIA) of vaccines, discussing specific methodological issues related to vaccines. This systematic review of the literature on BIA of vaccines was carried out in accordance with the Centre for Reviews and Dissemination - CRD guidelines. We searched multiple databases: MedLine, Embase, Biblioteca Virtual de Saúde (BVS), Cochrane Library, DARE Database, NHS Economic Evaluation Database (NHS EED), HTA Database (via Centre for Reviews and Dissemination - CRD), and grey literature. Two researchers, working independently, selected the studies and extracted the data. The methodology quality of individual studies was assessed using the ISPOR 2012 Budget Impact Analysis Good Practice II Task Force. A qualitative narrative synthesis was conducted. Twenty-two studies were reviewed. The most frequently evaluated vaccines were pneumococcal (41%), influenza (23%) and rotavirus (18%). The target population was stated in 21 studies (95%) and the perspective was clear in 20 (91%). Only 36% reported the calculations used to complete the BIA, 27% informed the total and disaggregated costs for each time period, and 9% showed the change in resource use for each time period. More than half of the studies (55%, n=12) reported less than 50% of the items recommended in the checklist. The production of BIA of vaccines has increased from 2009. The report of the methodological steps was unsatisfactory, making it difficult to assess the validity of the results presented. Vaccines specific issues should be discussed in international guidelines for BIA of vaccines, to improve the quality of the studies. Copyright © 2017 Elsevier Ltd. All rights reserved.

Attached Microfauna.

ERIC Educational Resources Information Center

Waller, W. T.; Lanza, G. R.

1978-01-01

Presents a literature review of microfauna as related to water quality and pollution covering the methodology, and the ecological and toxic effects. A list of 20 references published in 1976 and 1977 is also presented. (HM)

A scoping review of scoping reviews: advancing the approach and enhancing the consistency

PubMed Central

Pham, Mai T; Rajić, Andrijana; Greig, Judy D; Sargeant, Jan M; Papadopoulos, Andrew; McEwen, Scott A

2014-01-01

Background The scoping review has become an increasingly popular approach for synthesizing research evidence. It is a relatively new approach for which a universal study definition or definitive procedure has not been established. The purpose of this scoping review was to provide an overview of scoping reviews in the literature. Methods A scoping review was conducted using the Arksey and O'Malley framework. A search was conducted in four bibliographic databases and the gray literature to identify scoping review studies. Review selection and characterization were performed by two independent reviewers using pretested forms. Results The search identified 344 scoping reviews published from 1999 to October 2012. The reviews varied in terms of purpose, methodology, and detail of reporting. Nearly three-quarter of reviews (74.1%) addressed a health topic. Study completion times varied from 2 weeks to 20 months, and 51% utilized a published methodological framework. Quality assessment of included studies was infrequently performed (22.38%). Conclusions Scoping reviews are a relatively new but increasingly common approach for mapping broad topics. Because of variability in their conduct, there is a need for their methodological standardization to ensure the utility and strength of evidence. © 2014 The Authors. Research Synthesis Methods published by John Wiley & Sons, Ltd. PMID:26052958

Tests examining skill outcomes in sport: a systematic review of measurement properties and feasibility.

PubMed

Robertson, Samuel J; Burnett, Angus F; Cochrane, Jodie

2014-04-01

A high level of participant skill is influential in determining the outcome of many sports. Thus, tests assessing skill outcomes in sport are commonly used by coaches and researchers to estimate an athlete's ability level, to evaluate the effectiveness of interventions or for the purpose of talent identification. The objective of this systematic review was to examine the methodological quality, measurement properties and feasibility characteristics of sporting skill outcome tests reported in the peer-reviewed literature. A search of both SPORTDiscus and MEDLINE databases was undertaken. Studies that examined tests of sporting skill outcomes were reviewed. Only studies that investigated measurement properties of the test (reliability or validity) were included. A total of 22 studies met the inclusion/exclusion criteria. A customised checklist of assessment criteria, based on previous research, was utilised for the purpose of this review. A range of sports were the subject of the 22 studies included in this review, with considerations relating to methodological quality being generally well addressed by authors. A range of methods and statistical procedures were used by researchers to determine the measurement properties of their skill outcome tests. The majority (95%) of the reviewed studies investigated test-retest reliability, and where relevant, inter and intra-rater reliability was also determined. Content validity was examined in 68% of the studies, with most tests investigating multiple skill domains relevant to the sport. Only 18% of studies assessed all three reviewed forms of validity (content, construct and criterion), with just 14% investigating the predictive validity of the test. Test responsiveness was reported in only 9% of studies, whilst feasibility received varying levels of attention. In organised sport, further tests may exist which have not been investigated in this review. This could be due to such tests firstly not being published in the peer-review literature and secondly, not having their measurement properties (i.e., reliability or validity) examined formally. Of the 22 studies included in this review, items relating to test methodological quality were, on the whole, well addressed. Test-retest reliability was determined in all but one of the reviewed studies, whilst most studies investigated at least two aspects of validity (i.e., content, construct or criterion-related validity). Few studies examined predictive validity or responsiveness. While feasibility was addressed in over half of the studies, practicality and test limitations were rarely addressed. Consideration of study quality, measurement properties and feasibility components assessed in this review can assist future researchers when developing or modifying tests of sporting skill outcomes.

Systematic evaluation of clinical practice guidelines for pharmacogenomics.

PubMed

Beckett, Robert D; Kisor, David F; Smith, Thomas; Vonada, Brooke

2018-06-01

To systematically assess methodological quality of pharmacogenomics clinical practice guidelines. Guidelines published through 2017 were reviewed by at least three independent reviewers using the AGREE II instrument, which consists of 23 items grouped into 6 domains and 2 items representing an overall assessment. Items were assessed on a seven-point rating scale, and aggregate quality scores were calculated. 31 articles were included. All guidelines were published as peer-reviewed articles and 90% (n = 28) were endorsed by professional organizations. Mean AGREE II domain scores (maximum score 100%) ranged from 46.6 ± 11.5% ('applicability') to 78.9 ± 11.4% ('clarity of presentation'). Median overall quality score was 72.2% (IQR: 61.1-77.8%). Quality of pharmacogenomics guidelines was generally high, but variable, for most AGREE II domains.

Physical rehabilitation interventions for adult patients with critical illness across the continuum of recovery: an overview of systematic reviews protocol.

PubMed

Connolly, Bronwen; O'Neill, Brenda; Salisbury, Lisa; McDowell, Kathryn; Blackwood, Bronagh

2015-09-29

Patients admitted to the intensive care unit with critical illness often experience significant physical impairments, which typically persist for many years following resolution of the original illness. Physical rehabilitation interventions that enhance restoration of physical function have been evaluated across the continuum of recovery following critical illness including within the intensive care unit, following discharge to the ward and beyond hospital discharge. Multiple systematic reviews have been published appraising the expanding evidence investigating these physical rehabilitation interventions, although there appears to be variability in review methodology and quality. We aim to conduct an overview of existing systematic reviews of physical rehabilitation interventions for adult intensive care patients across the continuum of recovery. This protocol has been developed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocol (PRISMA-P) guidelines. We will search the Cochrane Systematic Review Database, Database of Abstracts of Reviews of Effectiveness, Cochrane Central Register of Controlled Trials, MEDLINE, Excerpta Medica Database and Cumulative Index to Nursing and Allied Health Literature databases. We will include systematic reviews of randomised controlled trials of adult patients, admitted to the intensive care unit and who have received physical rehabilitation interventions at any time point during their recovery. Data extraction will include systematic review aims and rationale, study types, populations, interventions, comparators, outcomes and quality appraisal method. Primary outcomes of interest will focus on findings reflecting recovery of physical function. Quality of reporting and methodological quality will be appraised using the PRISMA checklist and the Assessment of Multiple Systematic Reviews tool. We anticipate the findings from this novel overview of systematic reviews will contribute to the synthesis and interpretation of existing evidence regarding physical rehabilitation interventions and physical recovery in post-critical illness patients across the continuum of recovery. PROSPERO CRD42015001068.

Inflammatory bowel disease-specific health-related quality of life instruments: a systematic review of measurement properties.

PubMed

Chen, Xin-Lin; Zhong, Liang-Huan; Wen, Yi; Liu, Tian-Wen; Li, Xiao-Ying; Hou, Zheng-Kun; Hu, Yue; Mo, Chuan-Wei; Liu, Feng-Bin

2017-09-15

This review aims to critically appraise and compare the measurement properties of inflammatory bowel disease (IBD)-specific health-related quality of life instruments. Medline, EMBASE and ISI Web of Knowledge were searched from their inception to May 2016. IBD-specific instruments for patients with Crohn's disease, ulcerative colitis or IBD were enrolled. The basic characteristics and domains of the instruments were collected. The methodological quality of measurement properties and measurement properties of the instruments were assessed. Fifteen IBD-specific instruments were included, which included twelve instruments for adult IBD patients and three for paediatric IBD patients. All of the instruments were developed in North American and European countries. The following common domains were identified: IBD-related symptoms, physical, emotional and social domain. The methodological quality was satisfactory for content validity; fair in internal consistency, reliability, structural validity, hypotheses testing and criterion validity; and poor in measurement error, cross-cultural validity and responsiveness. For adult IBD patients, the IBDQ-32 and its short version (SIBDQ) had good measurement properties and were the most widely used worldwide. For paediatric IBD patients, the IMPACT-III had good measurement properties and had more translated versions. Most methodological quality should be promoted, especially measurement error, cross-cultural validity and responsiveness. The IBDQ-32 was the most widely used instrument with good reliability and validity, followed by the SIBDQ and IMPACT-III. Further validation studies are necessary to support the use of other instruments.

Balanced Scorecard in Higher Education Institutions: Congruence and Roles to Quality Assurance Practices

ERIC Educational Resources Information Center

Reda, Nigusse W.

2017-01-01

Purpose: The purpose of this paper is twofold: first, to highlight the congruence and roles of the balanced scorecard in the quality assurance practices in higher education institutions, and second, to propose a balanced scorecard model for higher education institutions. Design/methodology/approach: A descriptive literature review was used to…

Measuring Service Quality in Higher Education: Development of a Hierarchical Model (HESQUAL)

ERIC Educational Resources Information Center

Teeroovengadum, Viraiyan; Kamalanabhan, T. J.; Seebaluck, Ashley Keshwar

2016-01-01

Purpose: This paper aims to develop and empirically test a hierarchical model for measuring service quality in higher education. Design/methodology/approach: The first phase of the study consisted of qualitative research methods and a comprehensive literature review, which allowed the development of a conceptual model comprising 53 service quality…

Effect-size measures as descriptors of assay quality in high-content screening: A brief review of some available methodologies

USDA-ARS?s Scientific Manuscript database

The field of high-content screening (HCS) typically uses measures of screen quality conceived for fairly straightforward high-throughput screening (HTS) scenarios. However, in contrast to HTS, image-based HCS systems rely on multidimensional readouts reporting biological responses associated with co...

Adherence of hip and knee arthroplasty studies to RSA standardization guidelines. A systematic review.

PubMed

Madanat, Rami; Mäkinen, Tatu J; Aro, Hannu T; Bragdon, Charles; Malchau, Henrik

2014-09-01

Guidelines for standardization of radiostereometry (RSA) of implants were published in 2005 to facilitate comparison of outcomes between various research groups. In this systematic review, we determined how well studies have adhered to these guidelines. We carried out a literature search to identify all articles published between January 2000 and December 2011 that used RSA in the evaluation of hip or knee prosthesis migration. 2 investigators independently evaluated each of the studies for adherence to the 13 individual guideline items. Since some of the 13 points included more than 1 criterion, studies were assessed on whether each point was fully met, partially met, or not met. 153 studies that met our inclusion criteria were identified. 61 of these were published before the guidelines were introduced (2000-2005) and 92 after the guidelines were introduced (2006-2011). The methodological quality of RSA studies clearly improved from 2000 to 2011. None of the studies fully met all 13 guidelines. Nearly half (43) of the studies published after the guidelines demonstrated a high methodological quality and adhered at least partially to 10 of the 13 guidelines, whereas less than one-fifth (11) of the studies published before the guidelines had the same methodological quality. Commonly unaddressed guideline items were related to imaging methodology, determination of precision from double examinations, and also mean error of rigid-body fitting and condition number cutoff levels. The guidelines have improved methodological reporting in RSA studies, but adherence to these guidelines is still relatively low. There is a need to update and clarify the guidelines for clinical hip and knee arthroplasty RSA studies.

Prevalence of self-medication in the adult population of Brazil: a systematic review

PubMed Central

Domingues, Paulo Henrique Faria; Galvão, Taís Freire; de Andrade, Keitty Regina Cordeiro; de Sá, Pedro Terra Teles; Silva, Marcus Tolentino; Pereira, Mauricio Gomes

2015-01-01

OBJECTIVE To evaluate the prevalence of self-medication in Brazil’s adult population. METHODS Systematic review of cross-sectional population-based studies. The following databases were used: Medline, Embase, Scopus, ISI, CINAHL, Cochrane Library, CRD, Lilacs, SciELO, the Banco de teses brasileiras (Brazilian theses database) (Capes) and files from the Portal Domínio Público (Brazilian Public Domain). In addition, the reference lists from relevant studies were examined to identify potentially eligible articles. There were no applied restrictions in terms of the publication date, language or publication status. Data related to publication, population, methods and prevalence of self-medication were extracted by three independent researchers. Methodological quality was assessed following eight criteria related to sampling, measurement and presentation of results. The prevalences were measured from participants who used at least one medication during the recall period of the studies. RESULTS The literature screening identified 2,778 records, from which 12 were included for analysis. Most studies were conducted in the Southeastern region of Brazil, after 2000 and with a 15-day recall period. Only five studies achieved high methodological quality, of which one study had a 7-day recall period, in which the prevalence of self-medication was 22.9% (95%CI 14.6;33.9). The prevalence of self-medication in three studies of high methodological quality with a 15-day recall period was 35.0% (95%CI 29.0;40.0, I2 = 83.9%) in the adult Brazilian population. CONCLUSIONS Despite differences in the methodologies of the included studies, the results of this systematic review indicate that a significant proportion of the adult Brazilian population self-medicates. It is suggested that future research projects that assess self-medication in Brazil standardize their methods. PMID:26083944

Development and Application of Health-Based Screening Levels for Use in Water-Quality Assessments

USGS Publications Warehouse

Toccalino, Patricia L.

2007-01-01

Health-Based Screening Levels (HBSLs) are non-enforceable water-quality benchmarks that were developed by the U.S. Geological Survey in collaboration with the U.S. Environmental Protection Agency (USEPA) and others. HBSLs supplement existing Federal drinking-water standards and guidelines, thereby providing a basis for a more comprehensive evaluation of contaminant-occurrence data in the context of human health. Since the original methodology used to calculate HBSLs for unregulated contaminants was published in 2003, revisions have been made to the HBSL methodology in order to reflect updates to relevant USEPA policies. These revisions allow for the use of the most recent, USEPA peer-reviewed, publicly available human-health toxicity information in the development of HBSLs. This report summarizes the revisions to the HBSL methodology for unregulated contaminants, and updates the guidance on the use of HBSLs for interpreting water-quality data in the context of human health.

The effectiveness of structured exercise in the south Asian population with type 2 diabetes: a systematic review.

PubMed

Albalawi, Hani; Coulter, Elaine; Ghouri, Nazim; Paul, Lorna

2017-11-01

The impact of exercise interventions on south Asians with type 2 diabetes (T2DM), who have a higher T2DM incidence rate compared to other ethnic groups, is inconclusive. This study aimed to systematically review the effect of exercise interventions in south Asians with T2DM. Five electronic databases were searched up to April 2017 for controlled trials investigating the impact of exercise interventions on south Asian adults with T2DM. The PEDro scale was used to assess the quality of the included studies. Eighteen trials examining the effect of aerobic, resistance, balance or combined exercise programs met the eligibility criteria. All types of exercise were associated with improvements in glycemic control, blood pressure, waist circumference, blood lipids, muscle strength, functional mobility, quality of life or neuropathy progression. The majority of included studies were of poor methodological quality. Few studies compared different types or dose of exercise. In conclusion, this review supports the benefits of exercise for south Asians with T2DM, although it was not possible to identify the most effective exercise prescription. Further studies of good methodological quality are required to determine the most effective dosage and type of exercise to manage T2DM in this population.

Acupuncture for Functional Dyspepsia: What Strength Does It Have? A Systematic Review and Meta-Analysis of Randomized Controlled Trials

PubMed Central

Li, Jing; Li, Bo; Hu, Ya-Cai; Cai, Qiu-Han

2016-01-01

Background. Although the effectiveness of acupuncture therapy on functional dyspepsia (FD) has been systematically reviewed, the available reports are still contradictive and no robust evidence has been provided to date. Objective. To assess the current evidence of high quality on the effects of acupuncture for patients with FD. Methods. A comprehensive literature database search was conducted to identify randomized controlled trials (RCTs) comparing acupuncture therapies (including manual acupuncture and electroacupuncture) to sham acupuncture and medication use. A meta-analysis was performed following a strict methodology. Results. 16 RCTs involving 1436 participants were included. The majority of the trials were determined to be of low quality. Positive results were found for acupuncture in improving the Nepean Dyspepsia Index (NDI) and scores of the MOS 36-Item Short-Form Health Survey (SF-36), as well as in alleviating relevant symptoms (especially postprandial fullness and early satiation) of FD patients. Conclusion. Based on current available evidence, acupuncture therapy achieves statistically significant effect for FD in comparison with sham acupuncture and is superior to medication (prokinetic agents) in improving the symptoms and quality of life of FD patients. Nonetheless, despite stringent methodological analyses, the conclusion of our review still needs to be strengthened by additional RCTs of higher quality. PMID:28119758

Acupuncture and moxibustion for lateral elbow pain: a systematic review of randomized controlled trials

PubMed Central

2014-01-01

Background Acupuncture and moxibustion have widely been used to treat lateral elbow pain (LEP). A comprehensive systematic review of randomized controlled trials (RCTs) including both English and Chinese databases was conducted to assess the efficacy of acupuncture and moxibustion in the treatment of LEP. Methods Revised STRICTA (2010) criteria were used to appraise the acupuncture procedures, the Cochrane risk of bias tool was used to assess the methodological quality of the studies. A total of 19 RCTs that compared acupuncture and/or moxibustion with sham acupuncture, another form of acupuncture, or conventional treatment were included. Results All studies had at least one domain rated as high risk or uncertain risk of bias in the Cochrane risk of bias tool. Results from three RCTs of moderate quality showed that acupuncture was more effective than sham acupuncture. Results from 10 RCTs of mostly low quality showed that acupuncture or moxibustion was superior or equal to conventional treatment, such as local anesthetic injection, local steroid injection, non-steroidal anti- inflammatory drugs, or ultrasound. There were six low quality RCTs that compared acupuncture and moxibustion combined with manual acupuncture alone, and all showed that acupuncture and moxibustion combined was superior to manual acupuncture alone. Conclusion Moderate quality studies suggest that acupuncture is more effective than sham acupuncture. Interpretations of findings regarding acupuncture vs. conventional treatment, and acupuncture and moxibustion combined vs. manual acupuncture alone are limited by the methodological qualities of these studies. Future studies with improved methodological design are warranted to confirm the efficacy of acupuncture and moxibustion for LEP. PMID:24726029

Analyzing the impacts of global trade and investment on non-communicable diseases and risk factors: a critical review of methodological approaches used in quantitative analyses.

PubMed

Cowling, Krycia; Thow, Anne Marie; Pollack Porter, Keshia

2018-05-24

A key mechanism through which globalization has impacted health is the liberalization of trade and investment, yet relatively few studies to date have used quantitative methods to investigate the impacts of global trade and investment policies on non-communicable diseases and risk factors. Recent reviews of this literature have found heterogeneity in results and a range of quality across studies, which may be in part attributable to a lack of conceptual clarity and methodological inconsistencies. This study is a critical review of methodological approaches used in the quantitative literature on global trade and investment and diet, tobacco, alcohol, and related health outcomes, with the objective of developing recommendations and providing resources to guide future robust, policy relevant research. A review of reviews, expert review, and reference tracing were employed to identify relevant studies, which were evaluated using a novel quality assessment tool designed for this research. Eight review articles and 34 quantitative studies were identified for inclusion. Important ways to improve this literature were identified and discussed: clearly defining exposures of interest and not conflating trade and investment; exploring mechanisms of broader relationships; increasing the use of individual-level data; ensuring consensus and consistency in key confounding variables; utilizing more sector-specific versus economy-wide trade and investment indicators; testing and adequately adjusting for autocorrelation and endogeneity when using longitudinal data; and presenting results from alternative statistical models and sensitivity analyses. To guide the development of future analyses, recommendations for international data sources for selected trade and investment indicators, as well as key gaps in the literature, are presented. More methodologically rigorous and consistent approaches in future quantitative studies on the impacts of global trade and investment policies on non-communicable diseases and risk factors can help to resolve inconsistencies of existing research and generate useful information to guide policy decisions.

The methodological quality of diagnostic test accuracy studies for musculoskeletal conditions can be improved.

PubMed

Henschke, Nicholas; Keuerleber, Julia; Ferreira, Manuela; Maher, Christopher G; Verhagen, Arianne P

2014-04-01

To provide an overview of reporting and methodological quality in diagnostic test accuracy (DTA) studies in the musculoskeletal field and evaluate the use of the QUality Assessment of Diagnostic Accuracy Studies (QUADAS) checklist. A literature review identified all systematic reviews that evaluated the accuracy of clinical tests to diagnose musculoskeletal conditions and used the QUADAS checklist. Two authors screened all identified reviews and extracted data on the target condition, index tests, reference standard, included studies, and QUADAS items. A descriptive analysis of the QUADAS checklist was performed, along with Rasch analysis to examine the construct validity and internal reliability. A total of 19 systematic reviews were included, which provided data on individual items of the QUADAS checklist for 392 DTA studies. In the musculoskeletal field, uninterpretable or intermediate test results are commonly not reported, with 175 (45%) studies scoring "no" to this item. The proportion of studies fulfilling certain items varied from 22% (item 11) to 91% (item 3). The interrater reliability of the QUADAS checklist was good and Rasch analysis showed excellent construct validity and internal consistency. This overview identified areas where the reporting and performance of diagnostic studies within the musculoskeletal field can be improved. Copyright © 2014 Elsevier Inc. All rights reserved.

Helicopter mathematical models and control law development for handling qualities research

NASA Technical Reports Server (NTRS)

Chen, Robert T. N.; Lebacqz, J. Victor; Aiken, Edwin W.; Tischler, Mark B.

1988-01-01

Progress made in joint NASA/Army research concerning rotorcraft flight-dynamics modeling, design methodologies for rotorcraft flight-control laws, and rotorcraft parameter identification is reviewed. Research into these interactive disciplines is needed to develop the analytical tools necessary to conduct flying qualities investigations using both the ground-based and in-flight simulators, and to permit an efficient means of performing flight test evaluation of rotorcraft flying qualities for specification compliance. The need for the research is particularly acute for rotorcraft because of their mathematical complexity, high order dynamic characteristics, and demanding mission requirements. The research in rotorcraft flight-dynamics modeling is pursued along two general directions: generic nonlinear models and nonlinear models for specific rotorcraft. In addition, linear models are generated that extend their utilization from 1-g flight to high-g maneuvers and expand their frequency range of validity for the design analysis of high-gain flight control systems. A variety of methods ranging from classical frequency-domain approaches to modern time-domain control methodology that are used in the design of rotorcraft flight control laws is reviewed. Also reviewed is a study conducted to investigate the design details associated with high-gain, digital flight control systems for combat rotorcraft. Parameter identification techniques developed for rotorcraft applications are reviewed.

Herbal Medicine for Hot Flushes Induced by Endocrine Therapy in Women with Breast Cancer: A Systematic Review and Meta-Analysis.

PubMed

Li, Yuanqing; Zhu, Xiaoshu; Bensussan, Alan; Li, Pingping; Moylan, Eugene; Delaney, Geoff; McPherson, Luke

2016-01-01

Objective. This systematic review was conducted to evaluate the clinical effectiveness and safety of herbal medicine (HM) as an alternative management for hot flushes induced by endocrine therapy in breast cancer patients. Methods. Key English and Chinese language databases were searched from inception to July 2015. Randomized Controlled Trials (RCTs) evaluating the effects of HM on hot flushes induced by endocrine therapy in women with breast cancer were retrieved. We conducted data collection and analysis in accordance with the Cochrane Handbook for Systematic Reviews of Interventions. Statistical analysis was performed with the software (Review Manager 5.3). Results. 19 articles were selected from the articles retrieved, and 5 articles met the inclusion criteria for analysis. Some included individual studies showed that HM can relieve hot flushes as well as other menopausal symptoms induced by endocrine therapy among women with breast cancer and improve the quality of life. There are minor side effects related to HM which are well tolerated. Conclusion. Given the small number of included studies and relatively poor methodological quality, there is insufficient evidence to draw positive conclusions regarding the objective benefit of HM. Additional high quality studies are needed with more rigorous methodological approach to answer this question.

Effect of periodontal treatment on preterm birth rate: a systematic review of meta-analyses.

PubMed

López, Néstor J; Uribe, Sergio; Martinez, Benjamín

2015-02-01

Preterm birth is a major cause of neonatal morbidity and mortality in both developed and developing countries. Preterm birth is a highly complex syndrome that includes distinct clinical subtypes in which many different causes may be involved. The results of epidemiological, molecular, microbiological and animal-model studies support a positive association between maternal periodontal disease and preterm birth. However, the results of intervention studies carried out to determine the effect of periodontal treatment on reducing the risk of preterm birth are controversial. This systematic review critically analyzes the methodological issues of meta-analyses of the studies to determine the effect of periodontal treatment to reduce preterm birth. The quality of the individual randomized clinical trials selected is of highest relevance for a systematic review. This article describes the methodological features that should be identified a priori and assessed individually to determine the quality of a randomized controlled trial performed to evaluate the effect of periodontal treatment on pregnancy outcomes. The AMSTAR and the PRISMA checklist tools were used to assess the quality of the six meta-analyses selected, and the bias domain of the Cochrane Collaboration's Tool was applied to evaluate each of the trials included in the meta-analyses. In addition, the methodological characteristics of each clinical trial were assessed. The majority of the trials included in the meta-analyses have significant methodological flaws that threaten their internal validity. The lack of effect of periodontal treatment on preterm birth rate concluded by four meta-analyses, and the positive effect of treatment for reducing preterm birth risk concluded by the remaining two meta-analyses are not based on consistent scientific evidence. Well-conducted randomized controlled trials using rigorous methodology, including appropriate definition of the exposure, adequate control of confounders for preterm birth and application of effective periodontal interventions to eliminate periodontal infection, are needed to confirm the positive association between periodontal disease and preterm birth. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A scoping review on the conduct and reporting of scoping reviews.

PubMed

Tricco, Andrea C; Lillie, Erin; Zarin, Wasifa; O'Brien, Kelly; Colquhoun, Heather; Kastner, Monika; Levac, Danielle; Ng, Carmen; Sharpe, Jane Pearson; Wilson, Katherine; Kenny, Meghan; Warren, Rachel; Wilson, Charlotte; Stelfox, Henry T; Straus, Sharon E

2016-02-09

Scoping reviews are used to identify knowledge gaps, set research agendas, and identify implications for decision-making. The conduct and reporting of scoping reviews is inconsistent in the literature. We conducted a scoping review to identify: papers that utilized and/or described scoping review methods; guidelines for reporting scoping reviews; and studies that assessed the quality of reporting of scoping reviews. We searched nine electronic databases for published and unpublished literature scoping review papers, scoping review methodology, and reporting guidance for scoping reviews. Two independent reviewers screened citations for inclusion. Data abstraction was performed by one reviewer and verified by a second reviewer. Quantitative (e.g. frequencies of methods) and qualitative (i.e. content analysis of the methods) syntheses were conducted. After searching 1525 citations and 874 full-text papers, 516 articles were included, of which 494 were scoping reviews. The 494 scoping reviews were disseminated between 1999 and 2014, with 45% published after 2012. Most of the scoping reviews were conducted in North America (53%) or Europe (38%), and reported a public source of funding (64%). The number of studies included in the scoping reviews ranged from 1 to 2600 (mean of 118). Using the Joanna Briggs Institute methodology guidance for scoping reviews, only 13% of the scoping reviews reported the use of a protocol, 36% used two reviewers for selecting citations for inclusion, 29% used two reviewers for full-text screening, 30% used two reviewers for data charting, and 43% used a pre-defined charting form. In most cases, the results of the scoping review were used to identify evidence gaps (85%), provide recommendations for future research (84%), or identify strengths and limitations (69%). We did not identify any guidelines for reporting scoping reviews or studies that assessed the quality of scoping review reporting. The number of scoping reviews conducted per year has steadily increased since 2012. Scoping reviews are used to inform research agendas and identify implications for policy or practice. As such, improvements in reporting and conduct are imperative. Further research on scoping review methodology is warranted, and in particular, there is need for a guideline to standardize reporting.

Objective impairments of gait and balance in adults living with HIV-1 infection: a systematic review and meta-analysis of observational studies.

PubMed

Berner, Karina; Morris, Linzette; Baumeister, Jochen; Louw, Quinette

2017-08-01

Gait and balance deficits are reported in adults with HIV infection and are associated with reduced quality of life. Current research suggests an increased fall-incidence in this population, with fall rates among middle-aged adults with HIV approximating that in seronegative elderly populations. Gait and postural balance rely on a complex interaction of the motor system, sensory control, and cognitive function. However, due to disease progression and complications related to ongoing inflammation, these systems may be compromised in people with HIV. Consequently, locomotor impairments may result that can contribute to higher-than-expected fall rates. The aim of this review was to synthesize the evidence regarding objective gait and balance impairments in adults with HIV, and to emphasize those which could contribute to increased fall risk. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. An electronic search of published observational studies was conducted in March 2016. Methodological quality was assessed using the NIH Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies. Narrative synthesis of gait and balance outcomes was performed, and meta-analyses where possible. Seventeen studies were included, with fair to low methodological quality. All studies used clinical tests for gait-assessment. Gait outcomes assessed were speed, initiation-time and cadence. No studies assessed kinetics or kinematics. Balance was assessed using both instrumented and clinical tests. Outcomes were mainly related to center of pressure, postural reflex latencies, and timed clinical tests. There is some agreement that adults with HIV walk slower and have increased center of pressure excursions and -long loop postural reflex latencies, particularly under challenging conditions. Gait and balance impairments exist in people with HIV, resembling fall-associated parameters in the elderly. Impairments are more pronounced during challenging conditions, might be associated with disease severity, are not influenced by antiretroviral therapy, and might not be associated with peripheral neuropathy. Results should be interpreted cautiously due to overall poor methodological quality and heterogeneity. Locomotor impairments in adults with HIV are currently insufficiently quantified. Future research involving more methodological uniformity is warranted to better understand such impairments and to inform clinical decision-making, including fall-prevention strategies, in this population.

The quality of systematic reviews of health-related outcome measurement instruments.

PubMed

Terwee, C B; Prinsen, C A C; Ricci Garotti, M G; Suman, A; de Vet, H C W; Mokkink, L B

2016-04-01

Systematic reviews of outcome measurement instruments are important tools for the selection of instruments for research and clinical practice. Our aim was to assess the quality of systematic reviews of health-related outcome measurement instruments and to determine whether the quality has improved since our previous study in 2007. A systematic literature search was performed in MEDLINE and EMBASE between July 1, 2013, and June 19, 2014. The quality of the reviews was rated using a study-specific checklist. A total of 102 reviews were included. In many reviews the search strategy was considered not comprehensive; in only 59 % of the reviews a search was performed in EMBASE and in about half of the reviews there was doubt about the comprehensiveness of the search terms used for type of measurement instruments and measurement properties. In 41 % of the reviews, compared to 30 % in our previous study, the methodological quality of the included studies was assessed. In 58 %, compared to 55 %, the quality of the included instruments was assessed. In 42 %, compared to 7 %, a data synthesis was performed in which the results from multiple studies on the same instrument were somehow combined. Despite a clear improvement in the quality of systematic reviews of outcome measurement instruments in comparison with our previous study in 2007, there is still room for improvement with regard to the search strategy, and especially the quality assessment of the included studies and the included instruments, and the data synthesis.

Physical examination tests for screening and diagnosis of cervicogenic headache: A systematic review.

PubMed

Rubio-Ochoa, J; Benítez-Martínez, J; Lluch, E; Santacruz-Zaragozá, S; Gómez-Contreras, P; Cook, C E

2016-02-01

It has been suggested that differential diagnosis of headaches should consist of a robust subjective examination and a detailed physical examination of the cervical spine. Cervicogenic headache (CGH) is a form of headache that involves referred pain from the neck. To our knowledge, no studies have summarized the reliability and diagnostic accuracy of physical examination tests for CGH. The aim of this study was to summarize the reliability and diagnostic accuracy of physical examination tests used to diagnose CGH. A systematic review following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines was performed in four electronic databases (MEDLINE, Web of Science, Embase and Scopus). Full text reports concerning physical tests for the diagnosis of CGH which reported the clinometric properties for assessment of CGH, were included and screened for methodological quality. Quality Appraisal for Reliability Studies (QAREL) and Quality Assessment of Studies of Diagnostic Accuracy (QUADAS-2) scores were completed to assess article quality. Eight articles were retrieved for quality assessment and data extraction. Studies investigating diagnostic reliability of physical examination tests for CGH scored poorer on methodological quality (higher risk of bias) than those of diagnostic accuracy. There is sufficient evidence showing high levels of reliability and diagnostic accuracy of the selected physical examination tests for the diagnosis of CGH. The cervical flexion-rotation test (CFRT) exhibited both the highest reliability and the strongest diagnostic accuracy for the diagnosis of CGH. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Systematic Method for Reviewing and Analyzing Health Information on Consumer-Oriented Websites.

PubMed

Rew, Lynn; Saenz, Ashley; Walker, Lorraine O

2018-05-29

A discussion of a proposed method for analyzing the quality of consumer-oriented websites that provide health-related information. The quality of health information available to consumers online varies widely in quality. In an effort to improve the quality of online information, experts have undertaken systematic reviews on selected health topics; however, no standardized comprehensive methodology currently exists for such review. An eight-step method is recommended embracing the following steps: (1) select topic; (2) determine the purpose of the analysis; (3) select search terms and engines; (4) develop and apply website inclusion and exclusion criteria; (5) develop processes and tools to manage search results; (6) specify measures of quality; (7) compute readability; (8) evaluate websites. Each of these steps is illustrated in relation to the health topic of gynecomastia, a physical and mental health challenge for many adolescent males and young men. Although most extant analyses of consumer-oriented websites have focused on disease conditions and their treatment, website-analysis methodology would encourage analyses that fall into the nursing care domain. The method outlined in this paper is intended to provide nurses and others who work with specific patient populations with the tools needed for website analytic studies. Such studies provide a foundation for making recommendations about quality websites, as well as identifying gaps in online information for health consumers. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

PacRIM II: A review of AirSAR operations and system performance

NASA Technical Reports Server (NTRS)

Moller, D.; Chu, A.; Lou, Y.; Miller, T.; O'Leary, E.

2001-01-01

In this paper we briefly review the AirSAR system, its expected performance, and quality of data obtained during that mission. We discuss the system hardware calibration methodologies, and present quantitative performance values of radar backscatter and interferometric height errors (random and systematic) from PACRIM II calibration data.

Science Education and Test-Based Accountability: Reviewing Their Relationship and Exploring Implications for Future Policy

ERIC Educational Resources Information Center

Anderson, Kevin J. B.

2012-01-01

Assuming that quality science education plays a role in economic growth within a country, it becomes important to understand how education policy might influence science education teaching and learning. This integrative research review draws on Cooper's methodology (Cooper, 1982; Cooper & Hedges, 2009) to synthesize empirical findings on the…

An Evaluation of Policy-Related Rehabilitation Research.

ERIC Educational Resources Information Center

Berkowitz, Monroe; And Others

The monograph evaluates the methodological quality and the policy utility of research in the area of rehabilitation of the handicapped. Analysis was based on a multidisciplinary review of 477 sample reports from more than 4,000 screened project reports. Chapter 1 delineates the nature of the study; Chapter 2 reviews the Federal/State…

Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol)

PubMed Central

2014-01-01

Background Lean is a set of operating philosophies and methods that help create a maximum value for patients by reducing waste and waits. It emphasizes the consideration of the customer’s needs, employee involvement and continuous improvement. Research on the application and implementation of lean principles in health care has been limited. Methods This is a protocol for a systematic review, following the Cochrane Effective Practice and Organisation of Care (EPOC) methodology. The review aims to document, catalogue and synthesize the existing literature on the effects of lean implementation in health care settings especially the potential effects on professional practice and health care outcomes. We have developed a Medline keyword search strategy, and this focused strategy will be translated into other databases. All search strategies will be provided in the review. The method proposed by the Cochrane EPOC group regarding randomized study designs, non-randomised controlled trials controlled before and after studies and interrupted time series will be followed. In addition, we will also include cohort, case–control studies, and relevant non-comparative publications such as case reports. We will categorize and analyse the review findings according to the study design employed, the study quality (low- versus high-quality studies) and the reported types of implementation in the primary studies. We will present the results of studies in a tabular form. Discussion Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin the implementation of lean activities in health care settings as defined in this protocol. As a result, the review will provide an evidence base for the effectiveness of lean and implementation methodologies reported in health care. Systematic review registration PROSPERO CRD42014008853 PMID:25238974

Systematic review of the methodological quality of controlled trials evaluating Chinese herbal medicine in patients with rheumatoid arthritis.

PubMed

Pan, Xin; Lopez-Olivo, Maria A; Song, Juhee; Pratt, Gregory; Suarez-Almazor, Maria E

2017-03-01

We appraised the methodological and reporting quality of randomised controlled clinical trials (RCTs) evaluating the efficacy and safety of Chinese herbal medicine (CHM) in patients with rheumatoid arthritis (RA). For this systematic review, electronic databases were searched from inception until June 2015. The search was limited to humans and non-case report studies, but was not limited by language, year of publication or type of publication. Two independent reviewers selected RCTs, evaluating CHM in RA (herbals and decoctions). Descriptive statistics were used to report on risk of bias and their adherence to reporting standards. Multivariable logistic regression analysis was performed to determine study characteristics associated with high or unclear risk of bias. Out of 2342 unique citations, we selected 119 RCTs including 18 919 patients: 10 108 patients received CHM alone and 6550 received one of 11 treatment combinations. A high risk of bias was observed across all domains: 21% had a high risk for selection bias (11% from sequence generation and 30% from allocation concealment), 85% for performance bias, 89% for detection bias, 4% for attrition bias and 40% for reporting bias. In multivariable analysis, fewer authors were associated with selection bias (allocation concealment), performance bias and attrition bias, and earlier year of publication and funding source not reported or disclosed were associated with selection bias (sequence generation). Studies published in non-English language were associated with reporting bias. Poor adherence to recommended reporting standards (<60% of the studies not providing sufficient information) was observed in 11 of the 23 sections evaluated. Study quality and data extraction were performed by one reviewer and cross-checked by a second reviewer. Translation to English was performed by one reviewer in 85% of the included studies. Studies evaluating CHM often fail to meet expected methodological criteria, and high-quality evidence is lacking. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Person-centredness in the care of older adults: a systematic review of questionnaire-based scales and their measurement properties.

PubMed

Wilberforce, Mark; Challis, David; Davies, Linda; Kelly, Michael P; Roberts, Chris; Loynes, Nik

2016-03-07

Person-centredness is promoted as a central feature of the long-term care of older adults. Measures are needed to assist researchers, service planners and regulators in assessing this feature of quality. However, no systematic review exists to identify potential instruments and to provide a critical appraisal of their measurement properties. A systematic review of measures of person-centredness was undertaken. Inclusion criteria restricted references to multi-item instruments designed for older adult services, or otherwise with measurement properties tested in an older adult population. A two-stage critical appraisal was conducted. First, the methodological quality of included references was assessed using the COSMIN toolkit. Second, seven measurement properties were rated using widely-recognised thresholds of acceptability. These results were then synthesised to provide an overall appraisal of the strength of evidence for each measurement property for each instrument. Eleven measures tested in 22 references were included. Six instruments were designed principally for use in long-stay residential facilities, and four were for ambulatory hospital or clinic-based services. Only one measure was designed mainly for completion by users of home care services. No measure could be assessed across all seven measurement properties. Despite some instruments having promising measurement properties, this was consistently undermined by the poor methodological quality underpinning them. Testing of hypotheses to support construct validity was of particularly low quality, whilst measurement error was rarely assessed. Two measures were identified as having been the subject of the most rigorous testing. The review is unable to unequivocally recommend any measures of person-centredness for use in older adult care. Researchers are advised to improve methodological rigour when testing instruments. Efforts may be best focused on testing a narrower range of measurement properties but to a higher standard, and ensuring that translations to new languages are resisted until strong measurement properties are demonstrated in the original tongue. Limitations of the review include inevitable semantic and conceptual challenges involved in defining 'person-centredness'. The review protocol was registered with PROSPERO (ref: CRD42014005935).

An overview of systematic review.

PubMed

Baker, Kathy A; Weeks, Susan Mace

2014-12-01

Systematic review is an invaluable tool for the practicing clinician. A well-designed systematic review represents the latest and most complete information available on a particular topic or intervention. This article highlights the key elements of systematic review, what it is and is not, and provides an overview of several reputable organizations supporting the methodological development and conduct of systematic review. Important aspects for evaluating the quality of a systematic review are also included. Copyright © 2014 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

The Effectiveness of Manual Therapy for Relieving Pain, Stiffness, and Dysfunction in Knee Osteoarthritis: A Systematic Review and Meta-Analysis.

PubMed

Xu, Qinguang; Chen, Bei; Wang, Yueyi; Wang, Xuezong; Han, Dapeng; Ding, Daofang; Zheng, Yuxin; Cao, Yuelong; Zhan, Hongsheng; Zhou, Yao

2017-05-01

Knee osteoarthritis (KOA) is the most common form of arthritis, leading to pain disability in seniors and increased health care utilization. Manual therapy is one widely used physical treatment for KOA. To evaluate the effectiveness and adverse events (AEs) of manual therapy compared to other treatments for relieving pain, stiffness, and physical dysfunction in patients with KOA. A systematic review and meta-analysis of manual therapy for KOA. We searched PubMed, EMBASE, the Cochrane Library, and Chinese databases for relevant randomized controlled trials (RCTs) of manual therapy for patients with KOA from the inception to October 2015 without language restrictions. RCTs compared manual therapy to the placebo or other interventional control with an appropriate description of randomization. Two reviewers independently conducted the search results identification, data extraction, and methodological quality assessment. The methodological quality was assessed by PEDro scale. Pooled data was expressed as standard mean difference (SMD), with 95% confident intervals (CIs) in a random effects model. The meta-analysis of manual therapy for KOA on pain, stiffness, and physical function were conducted. Fourteen studies involving 841 KOA participants compared to other treatments were included. The methodological quality of most included RCTs was poor. The mean PEDro scale score was 6.6. The meta-analyses results showed that manual therapy had statistically significant effects on relieving pain (standardized mean difference, SMD = -0.61, 95% CI -0.95 to -0.28, P = 76%), stiffness (SMD = -0.58, 95% CI -0.95 to -0.21, P = 81%), improving physical function (SMD = -0.49, 95% CI -0.76 to -0.22, P = 65%), and total score (SMD = -0.56, 95% CI -0.78 to -0.35, P = 50%). But in the subgroups, manual therapy did not show significant improvements on stiffness and physical function when treatment duration was less than 4 weeks. And the long-term information for manual therapy was insufficient. The limitations of this systematic review include the paucity of literature and inevitable heterogeneity between included studies. The preliminary evidence from our study suggests that manual therapy might be effective and safe for improving pain, stiffness, and physical function in KOA patients and could be treated as complementary and alternative options. However, the evidence may be limited by potential bias and poor methodological quality of included studies. High-quality RCTs with long-term follow-up are warranted to confirm our findings.Key words: Knee osteoarthritis, manual therapy, systematic review.

Characteristics and quality of published animal research in the field of radiology.

PubMed

Yoon, Soo Jeong; Yoon, Dae Young; Cho, Young Kwon; Baek, Sora; Lim, Kyoung Ja; Seo, Young Lan; Yun, Eun Joo

2017-06-01

Background Animal research has played an important role in the field of radiology. Purpose To evaluate the characteristics and quality of published radiological animal research. Material and Methods A PubMed search was performed for radiological animal research articles (defined as studies using animal models with a radiologist as the first author) published in 1994, 2004, and 2014. The following information was extracted from each article: journal name, radiological subspecialty, imaging technique, animal species, number of animals used, number of authors, declared funding, country of origin, methodological quality, and ethical quality. Methodological and ethical quality of studies were assessed with seven-item (sample size calculation, animal age, animal sex, animal weight, inclusion and exclusion criteria, randomization, and blinded outcome assessment) and four-item (ethical review committee approval, anesthesia, pain control, and euthanasia) scales, respectively. Results The numbers of radiological animal studies markedly increased, from 91 in 1994 to 163 in 2004 and to 305 in 2014. One hundred and sixty-two (29.0%) articles focused on the neuroradiology/head and neck subspecialty, 233 (41.7%) used magnetic resonance imaging (MRI), 190 (34.0%) used mice, 254 (45.4%) used 10-30 animals, 297 (53.1%) had 4-7 authors, 392 (70.1%) were funded, and 222 (39.7%) were from the USA. Six of 7 methodological and 3/4 ethical quality items significantly improved over time. Conclusion The quantity and quality of radiological animal research has increased over the last two decades; however, methodological and ethical quality remains suboptimal.

US adolescents’ friendship networks and health risk behaviors: a systematic review of studies using social network analysis and Add Health data

PubMed Central

Goodson, Patricia

2015-01-01

Background. Documented trends in health-related risk behaviors among US adolescents have remained high over time. Studies indicate relationships among mutual friends are a major influence on adolescents’ risky behaviors. Social Network Analysis (SNA) can help understand friendship ties affecting individual adolescents’ engagement in these behaviors. Moreover, a systematic literature review can synthesize findings from a range of studies using SNA, as well as assess these studies’ methodological quality. Review findings also can help health educators and promoters develop more effective programs. Objective. This review systematically examined studies of the influence of friendship networks on adolescents’ risk behaviors, which utilized SNA and the Add Health data (a nationally representative sample). Methods. We employed the Matrix Method to synthesize and evaluate 15 published studies that met our inclusion and exclusion criteria, retrieved from the Add Health website and 3 major databases (Medline, Eric, and PsycINFO). Moreover, we assigned each study a methodological quality score (MQS). Results. In all studies, friendship networks among adolescents promoted their risky behaviors, including drinking alcohol, smoking, sexual intercourse, and marijuana use. The average MQS was 4.6, an indicator of methodological rigor (scale: 1–9). Conclusion. Better understanding of risky behaviors influenced by friends can be useful for health educators and promoters, as programs targeting friendships might be more effective. Additionally, the overall MQ of these reviewed studies was good, as average scores fell above the scale’s mid-point. PMID:26157622

Factors associated with smoking in Asian American adults: a systematic review.

PubMed

Zhang, Jing; Wang, Zhongmiao

2008-05-01

This review systematically examined the factors associated with smoking in Asian American adults (aged > or =17 years). A total of 21 quantitative studies published in peer-reviewed journals from 1997 to 2006 were reviewed and abstracted using the matrix method. Statistically significant factors reported by the studies were summarized. Methodological quality of the studies also was assessed (maximum possible score = 10). Acculturation and education were the most frequently reported factors (n = 10, 47.6%). Acculturation was negatively associated with men's smoking but was positively associated with women's smoking. Education was uniformly found to be negatively related to smoking. Age was reported to have either a positive or a negative relationship with smoking (n = 9, 42.9%). Men were more likely to smoke than women (n = 7, 33.3%). The mean methodological score of the reviewed studies was 4.14 (on a scale of 1-10 points; SD = 1.62; range = 2-8). Health promotion professionals need to consider the summarized factors associated with Asian American adults' smoking behavior when planning smoking prevention programs and when recruiting participants for smoking cessation programs. When addressing acculturation, program planners should design different health education materials and use different strategies for men and women. To identify, understand, and incorporate essential factors into effective interventions, future studies should aim at higher methodological quality by using longitudinal design and increasing the use of theory, the test of data validity and reliability, and the report of effect sizes.

Vitamin D and Depression: A Systematic Review and Meta-Analysis Comparing Studies with and without Biological Flaws

PubMed Central

Spedding, Simon

2014-01-01

Efficacy of Vitamin D supplements in depression is controversial, awaiting further literature analysis. Biological flaws in primary studies is a possible reason meta-analyses of Vitamin D have failed to demonstrate efficacy. This systematic review and meta-analysis of Vitamin D and depression compared studies with and without biological flaws. The systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The literature search was undertaken through four databases for randomized controlled trials (RCTs). Studies were critically appraised for methodological quality and biological flaws, in relation to the hypothesis and study design. Meta-analyses were performed for studies according to the presence of biological flaws. The 15 RCTs identified provide a more comprehensive evidence-base than previous systematic reviews; methodological quality of studies was generally good and methodology was diverse. A meta-analysis of all studies without flaws demonstrated a statistically significant improvement in depression with Vitamin D supplements (+0.78 CI +0.24, +1.27). Studies with biological flaws were mainly inconclusive, with the meta-analysis demonstrating a statistically significant worsening in depression by taking Vitamin D supplements (−1.1 CI −0.7, −1.5). Vitamin D supplementation (≥800 I.U. daily) was somewhat favorable in the management of depression in studies that demonstrate a change in vitamin levels, and the effect size was comparable to that of anti-depressant medication. PMID:24732019

The effect of hand-hygiene interventions on infectious disease-associated absenteeism in elementary schools: A systematic literature review.

PubMed

Wang, Zhangqi; Lapinski, Maria; Quilliam, Elizabeth; Jaykus, Lee-Ann; Fraser, Angela

2017-06-01

Hand-hygiene interventions are widely used in schools but their effect on reducing absenteeism is not well known. The aim of our literature review was to determine whether implementation of a hand-hygiene intervention reduced infectious disease-associated absenteeism in elementary schools. The eligible studies (N = 19), published between 1996 and 2014, were summarized and the methodologic quality of each was assessed. Our review indicated evidence is available to show hand-hygiene interventions had an effect on reducing acute gastrointestinal illness-associated absenteeism but inadequate evidence is available to show an effect on respiratory illness-associated absenteeism. The methodologic quality assessment of eligible studies revealed common design flaws, such as lack of randomization, blinding, and attrition, which must be addressed in future studies to strengthen the evidence base on the effect of hand-hygiene interventions on school absenteeism. Copyright © 2017 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Elsevier Inc. All rights reserved.

Comparative effectiveness research methodology using secondary data: A starting user's guide.

PubMed

Sun, Maxine; Lipsitz, Stuart R

2018-04-01

The use of secondary data, such as claims or administrative data, in comparative effectiveness research has grown tremendously in recent years. We believe that the current review can help investigators relying on secondary data to (1) gain insight into both the methodologies and statistical methods, (2) better understand the necessity of a rigorous planning before initiating a comparative effectiveness investigation, and (3) optimize the quality of their investigations. Specifically, we review concepts of adjusted analyses and confounders, methods of propensity score analyses, and instrumental variable analyses, risk prediction models (logistic and time-to-event), decision-curve analysis, as well as the interpretation of the P value and hypothesis testing. Overall, we hope that the current review article can help research investigators relying on secondary data to perform comparative effectiveness research better understand the necessity of a rigorous planning before study start, and gain better insight in the choice of statistical methods so as to optimize the quality of the research study. Copyright © 2017 Elsevier Inc. All rights reserved.

The effects of massage therapy in hospitalized preterm neonates: A systematic review.

PubMed

Álvarez, María José; Fernández, Daniel; Gómez-Salgado, Juan; Rodríguez-González, Dolores; Rosón, María; Lapeña, Santiago

2017-04-01

The aim of this study was to perform a systematic review to identify, evaluate and summarise studies on the administration of therapeutic massage to preterm neonates during their stay in the NICU, and to assess their methodological quality. systematic review following PRISMA statements guidelines. A comprehensive search was performed including relevant articles between January 2004 and December 2013, using the following electronic databases: Medline, PEDro, Web of Science and Scopus. Two reviewers conducted a review of the selected articles: one evaluated the methodological quality of the studies and performed data extraction and the other performed a cross-check. Divergences of opinion were resolved by discussion with a third reviewer. The studies reviewed implemented a wide variety of interventions and evaluation methods, and therefore it was not possible to perform a meta-analysis. The following data were extracted from each article: year of publication, study design, participants and main measurements of outcomes obtained through the intervention. A non-quantitative synthesis of the extracted data was performed. Level of evidence was graded using the Jadad Scale. A total of 23 articles met the inclusion criteria and were thus included in the review; these presented a methodological quality ranging from 1 to 5 points (with a mean of 3 points). Most studies reported that the administration of various forms of therapeutic massage exerted a beneficial effect on factors related to the growth of preterm infants. The causes indicated by the researchers for these anthropometric benefits included increased vagal activity, increased gastric activity and increased serum insulin levels. Other demonstrated benefits of massage therapy when administered to hospitalised preterm infants included better neurodevelopment, a positive effect on brain development, a reduced risk of neonatal sepsis, a reduction in length of hospital stay and reduced neonatal stress. Although based on a qualitative analysis of heterogeneous data, the present review suggests that a clear benefit is obtained from the administration of massage therapy in hospitalised preterm infants, a finding which should encourage the more generalised use of massotherapy in NICU clinical practice. Copyright © 2017 Elsevier Ltd. All rights reserved.

Wearable sensor use for assessing standing balance and walking stability in people with Parkinson's disease: a systematic review.

PubMed

Hubble, Ryan P; Naughton, Geraldine A; Silburn, Peter A; Cole, Michael H

2015-01-01

Postural instability and gait disability threaten the independence and well-being of people with Parkinson's disease and increase the risk of falls and fall-related injuries. Prospective research has shown that commonly-used clinical assessments of balance and walking lack the sensitivity to accurately and consistently identify those people with Parkinson's disease who are at a higher risk of falling. Wearable sensors provide a portable and affordable alternative for researchers and clinicians who are seeking to objectively assess movements and falls risk in the clinical setting. However, no consensus currently exists on the optimal placements for sensors and the best outcome measures to use for assessing standing balance and walking stability in Parkinson's disease patients. Hence, this systematic review aimed to examine the available literature to establish the best sensor types, locations and outcomes to assess standing balance and walking stability in this population. Papers listed in three electronic databases were searched by title and abstract to identify articles measuring standing balance or walking stability with any kind of wearable sensor among adults diagnosed with PD. To be eligible for inclusion, papers were required to be full-text articles published in English between January 1994 and December 2014 that assessed measures of standing balance or walking stability with wearable sensors in people with PD. Articles were excluded if they; i) did not use any form of wearable sensor to measure variables associated with standing balance or walking stability; ii) did not include a control group or control condition; iii) were an abstract and/or included in the proceedings of a conference; or iv) were a review article or case study. The targeted search of the three electronic databases identified 340 articles that were potentially eligible for inclusion, but following title, abstract and full-text review only 26 articles were deemed to meet the inclusion criteria. Included articles were assessed for methodological quality and relevant data from the papers were extracted and synthesized. Quality assessment of these included articles indicated that 31% were of low methodological quality, while 58% were of moderate methodological quality and 11% were of high methodological quality. All studies adopted a cross-sectional design and used a variety of sensor types and outcome measures to assess standing balance or walking stability in people with Parkinson's disease. Despite the typically low to moderate methodological quality, 81% of the studies reported differences in sensor-based measures of standing balance or walking stability between different groups of Parkinson's disease patients and/or healthy controls. These data support the use of wearable sensors for detecting differences in standing balance and walking stability between people with PD and controls. Further high-quality research is needed to better understand the utility of wearable sensors for the early identification of Parkinson's disease symptoms and for assessing falls risk in this population. CRD42014010838.

Wearable Sensor Use for Assessing Standing Balance and Walking Stability in People with Parkinson’s Disease: A Systematic Review

PubMed Central

Hubble, Ryan P.; Naughton, Geraldine A.; Silburn, Peter A.; Cole, Michael H.

2015-01-01

Background Postural instability and gait disability threaten the independence and well-being of people with Parkinson’s disease and increase the risk of falls and fall-related injuries. Prospective research has shown that commonly-used clinical assessments of balance and walking lack the sensitivity to accurately and consistently identify those people with Parkinson’s disease who are at a higher risk of falling. Wearable sensors provide a portable and affordable alternative for researchers and clinicians who are seeking to objectively assess movements and falls risk in the clinical setting. However, no consensus currently exists on the optimal placements for sensors and the best outcome measures to use for assessing standing balance and walking stability in Parkinson’s disease patients. Hence, this systematic review aimed to examine the available literature to establish the best sensor types, locations and outcomes to assess standing balance and walking stability in this population. Methods Papers listed in three electronic databases were searched by title and abstract to identify articles measuring standing balance or walking stability with any kind of wearable sensor among adults diagnosed with PD. To be eligible for inclusion, papers were required to be full-text articles published in English between January 1994 and December 2014 that assessed measures of standing balance or walking stability with wearable sensors in people with PD. Articles were excluded if they; i) did not use any form of wearable sensor to measure variables associated with standing balance or walking stability; ii) did not include a control group or control condition; iii) were an abstract and/or included in the proceedings of a conference; or iv) were a review article or case study. The targeted search of the three electronic databases identified 340 articles that were potentially eligible for inclusion, but following title, abstract and full-text review only 26 articles were deemed to meet the inclusion criteria. Included articles were assessed for methodological quality and relevant data from the papers were extracted and synthesized. Results Quality assessment of these included articles indicated that 31% were of low methodological quality, while 58% were of moderate methodological quality and 11% were of high methodological quality. All studies adopted a cross-sectional design and used a variety of sensor types and outcome measures to assess standing balance or walking stability in people with Parkinson’s disease. Despite the typically low to moderate methodological quality, 81% of the studies reported differences in sensor-based measures of standing balance or walking stability between different groups of Parkinson’s disease patients and/or healthy controls. Conclusion These data support the use of wearable sensors for detecting differences in standing balance and walking stability between people with PD and controls. Further high-quality research is needed to better understand the utility of wearable sensors for the early identification of Parkinson’s disease symptoms and for assessing falls risk in this population. PROSPERO Registration CRD42014010838 PMID:25894561

The effectiveness of hydrotherapy in the management of rheumatoid arthritis: a systematic review.

PubMed

Al-Qubaeissy, Khamis Y; Fatoye, Francis A; Goodwin, Peter C; Yohannes, Abebaw M

2013-03-01

Hydrotherapy is frequently indicated for the rehabilitation of patients with rheumatoid arthritis (RA); nevertheless, there has been inadequate appraisal of its effectiveness. The potential benefits of hydrotherapy for patients with RA are to improve and/or maintain functional ability and quality of life. The aim of this systematic review was to evaluate the effectiveness of hydrotherapy in the management of patients with RA. AMED, CINAHL, EMBASE, MEDLINE, PubMed, Science Direct and Web of Science were searched between 1988 and May 2011. Keywords used were rheumatoid arthritis, hydrotherapy, aquatic physiotherapy, aqua therapy and water therapy. Searches were supplemented with hand searches of references of selected articles. Randomized controlled trials were assessed for their methodological quality using the Physiotherapy Evidence Database (PEDro) scale. This scale ranks the methodological quality of a study scoring 7 out of 10 as 'high quality', 5-6 as 'moderate quality' and less than 4 as 'poor quality'. Initially, 197 studies were identified. Six studies met the inclusion criteria for further analysis. The average methodological quality for all studies was 6.8 using the PEDro scale. Most of the studies reported favourable outcomes for a hydrotherapy intervention compared with no treatment or other interventions for patients with RA. Improvement was particularly noted in reducing pain, joint tenderness, mood and tension symptoms, and increasing grip strength and patient satisfaction with hydrotherapy treatment in the short term. There is some evidence to suggest that hydrotherapy has a positive role in reducing pain and improving the health status of patients with RA compared with no or other interventions in the short term. However, the long-term benefit is unknown. Further studies are needed. Copyright © 2012 John Wiley & Sons, Ltd.

Yoga and Quality of Life in Women with Primary Dysmenorrhea: A Systematic Review.

PubMed

McGovern, Christina E; Cheung, Corjena

2018-06-14

Primary dysmenorrhea is a prevalent condition causing quality of life (QOL) reduction for many women, resulting from pain as well as parallel social and psychological distress. Yoga reduces pain and sympathetic reactivity, thus promoting QOL. This article reports a systematic review of the evidence for the effectiveness of yoga as a QOL improvement method for women with primary dysmenorrhea. The PRISMA guidelines were used in preparation of this review. Ovid MEDLINE, PsycINFO, CINAHL, Scopus, PubMed, ScienceDirect, Cochrane Database of Systematic Reviews (CDSR), and Cochrane Central Register of Controlled Trials (CENTRAL) were screened through January 2017 using the keywords yoga, meditation, menstrual cycle, dysmenorrhea, pelvic pain, and prostaglandins. English-language randomized controlled trials (RCTs) and quasi-experimental studies regarding yoga, primary dysmenorrhea, and QOL were eligible; all yoga styles were included. Two independent reviewers rated the methodological quality of each study selected for review using the Downs and Black checklist; possible scores ranged from 0 to 32. Ratings were established through consensus. The search yielded a total of 378 articles, of which 14 (age range 13-45 years, N = 1409) met the criteria for final review: 8 RCTs and 6 quasi-experimental studies. Downs and Black ratings were predominantly moderate in quality with moderate risk of bias, ranging from 15 to 23 (RCTs) and 10 to 17 (quasi-experimental studies). Statistically significant improvements along most QOL domains, including physical pain, sleep, concentration, negative feelings, social relationships, work capacity, and overall QOL, were identified after a yoga intervention. Results indicate preliminary evidence for yoga as a safe and effective QOL improvement method for women with primary dysmenorrhea. Practitioners may consider yoga for management of primary dysmenorrhea. However, future research using larger RCTs of high methodological quality is needed to ascertain the magnitude of yoga's clinical significance. © 2018 by the American College of Nurse-Midwives.

Instruments to assess patient comfort during hospitalization: A psychometric review.

PubMed

Lorente, Sonia; Losilla, Josep-Maria; Vives, Jaume

2018-05-01

To analyse the psychometric properties and the utility of instruments used to measure patient comfort, physical, social, psychospiritual and/or environmental, during hospitalization. There are no systematic reviews nor psychometric reviews of instruments used to measure comfort, which is considered an indicator of quality in health care associated with quicker discharges, increased patient satisfaction and better cost-benefit ratios for the institution. Psychometric review. MEDLINE, CINAHL, PsycINFO, Web of Knowledge, ProQuest Thesis&Dissertations, Google. We limited our search to studies published between 1990-2015. The psychometric analysis was performed using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN), along with the Quality Criteria for Measurement Properties. The utility of the instruments was assessed according to their cost-efficiency, acceptability and educational impact. Protocol registration in PROSPERO, CRD42016036290. Instruments reviewed showed moderate methodological quality and their utility was poorly reported. Thus, we cannot recommend any questionnaire without reservations, but the Comfort Scale, the General Comfort Questionnaire and their adaptations in adults and older patients, the Psychosocial Comfort Scale and the Incomfort des Patients de Reanimation are the most recommendable instruments to measure comfort. The methodology of the studies should be more rigorous and authors should adequately report the utility of instruments. This review provides a strategy to select the most suitable instrument to assess patient comfort according to their psychometric properties and utility, which is crucial for nurses, clinicians, researchers and institutions. © 2017 John Wiley & Sons Ltd.

An integrative research review of instruments measuring religious involvement: implications for nursing research with African Americans.

PubMed

Mokel, Melissa Jennifer; Shellman, Juliette M

2013-01-01

Many instruments in which religious involvement is measured often (a) contain unclear, poorly developed constructs; (b) lack methodological rigor in scale development; and (c) contain language and content culturally incongruent with the religious experiences of diverse ethnic groups. The primary aims of this review were to (a) synthesize the research on instruments designed to measure religious involvement, (b) evaluate the methodological quality of instruments that measure religious involvement, and (c) examine these instruments for conceptual congruency with African American religious involvement. An updated integrative research review method guided the process (Whittemore & Knafl, 2005). 152 articles were reviewed and 23 articles retrieved. Only 3 retained instruments were developed under methodologically rigorous conditions. All 3 instruments were congruent with a conceptual model of African American religious involvement. The Fetzer Multidimensional Measure of Religious Involvement and Spirituality (FMMRS; Idler et al., 2003) was found to have favorable characteristics. Further examination and psychometric testing is warranted to determine its acceptability, readability, and cultural sensitivity in an African American population.

A Systematic Review of the Level of Evidence in Economic Evaluations of Medical Devices: The Example of Vertebroplasty and Kyphoplasty.

PubMed

Martelli, Nicolas; Devaux, Capucine; van den Brink, Hélène; Pineau, Judith; Prognon, Patrice; Borget, Isabelle

2015-01-01

Economic evaluations are far less frequently reported for medical devices than for drugs. In addition, little is known about the quality of existing economic evaluations, particularly for innovative devices, such as those used in vertebroplasty and kyphoplasty. To assess the level of evidence provided by the available economic evaluations for vertebroplasty and kyphoplasty. A systematic review of articles in English or French listed in the MEDLINE, PASCAL, COCHRANE and National Health Service Economic Evaluation databases, with limits on publication date (up to the date of the review, March 2014). We included only economic evaluations of vertebroplasty or kyphoplasty. Editorial and methodological articles were excluded. Data were extracted from articles by two authors working independently and using two analysis grids to measure the quality of economic evaluations. Twenty-one studies met our inclusion criteria. All were published between 2008 and 2014. Eighteen (86%) were full economic evaluations. Cost-effectiveness analysis (CEA) was the most frequent type of economic evaluation, and was present in 11 (52%) studies. Only three CEAs complied fully with the British Medical Journal checklist. The quality of the data sources used in the 21 studies was high, but the CEAs conforming to methodological guidelines did not use high-quality data sources for all components of the analysis. This systematic review shows that the level of evidence in economic evaluations of vertebroplasty and kyphoplasty is low, despite the recent publication of a large number of studies. This finding highlights the challenges to be faced to improve the quality of economic evaluations of medical devices.

A systematic review of the collaborative clinical education model to inform speech-language pathology practice.

PubMed

Briffa, Charmaine; Porter, Judi

2013-12-01

A shortage of clinical education placements for allied health students internationally has led to the need to explore innovative models of clinical education. The collaborative model where one clinical educator supervises two or more students completing a clinical placement concurrently is one model enabling expansion of student placements. The aims of this review were to investigate advantages and disadvantages of the collaborative model and to explore its implementation across allied health. A systematic search of the literature was conducted using three electronic databases (CINAHL, Medline, and Embase). Two independent reviewers evaluated studies for methodological quality. Seventeen studies met inclusion/exclusion criteria. Advantages and disadvantages identified were consistent across disciplines. A key advantage of the model was the opportunity afforded for peer learning, whilst a frequently reported disadvantage was reduced time for individual supervision of students. The methodological quality of many included studies was poor, impacting on interpretation of the evidence base. Insufficient data were provided on how the model was implemented across studies. There is a need for high quality research to guide implementation of this model across a wider range of allied health disciplines and to determine educational outcomes using reliable and validated measures.

Measurement Properties of the Functional Rating Index: A systematic Review and Meta-analysis.

PubMed

Bai, Zhongfei; Shu, Tian; Lu, Jiani; Niu, Wenxin

2018-04-13

A systematic review and meta-analysis. To assess the measurement properties of the Functional Rating Index (FRI) and determine whether its measurement properties are comparable with other region-specific questionnaires. In addition to low back pain (LBP) and neck pain (NP), multi-region spinal pain (SP) is a common problem with a considerable prevalence in the general population. The FRI was built to assess physical functioning in patients with SP. However, a systematic review assessing evidence of its measurement properties in separated populations and a comparison with other questionnaires regarding each measurement property is lacking. Articles concerning the FRI's measurement properties or head-to-head comparison with other questionnaires on measurement properties were obtained from MEDLINE, Embase, CINAHL, and PsycINFO. Two reviewers independently reviewed the articles, extracted data, and conducted the methodological quality assessment. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to assess the methodological quality of the included studies. A total of 18 studies evaluating the FRI's measurement properties, including seven that carried out head-to-head comparisons in at least one measurement property with other questionnaires, were included in the current review. Our findings show strong positive evidence for structural validity and internal consistency in patients with SP and LBP. Evidence for most of the FRI's measurement properties is limited, conflicting, or even unknown. The current evidence shows that the FRI is comparable with both the ODI and the NDI in responsiveness. However, relevant information about the majority of the other measurement properties is lacking. Our finding suggests that clinicians and researchers should use the FRI with caution until there are more studies with high methodological quality that support the view that it is positive in all measurement properties, especially in regard to patients with multi-region SP. 1.

Reliability of Real-time Ultrasound Imaging for the Assessment of Trunk Stabilizer Muscles: A Systematic Review of the Literature.

PubMed

Taghipour, Morteza; Mohseni-Bandpei, Mohammad Ali; Behtash, Hamid; Abdollahi, Iraj; Rajabzadeh, Fatemeh; Pourahmadi, Mohammad Reza; Emami, Mahnaz

2018-04-24

Rehabilitative ultrasound (US) imaging is one of the popular methods for investigating muscle morphologic characteristics and dimensions in recent years. The reliability of this method has been investigated in different studies. As studies have been performed with different designs and quality, reported values of rehabilitative US have a wide range. The objective of this study was to systematically review the literature conducted on the reliability of rehabilitative US imaging for the assessment of deep abdominal and lumbar trunk muscle dimensions. The PubMed/MEDLINE, Scopus, Google Scholar, Science Direct, Embase, Physiotherapy Evidence, Ovid, and CINAHL databases were searched to identify original research articles conducted on the reliability of rehabilitative US imaging published from June 2007 to August 2017. The articles were qualitatively assessed; reliability data were extracted; and the methodological quality was evaluated by 2 independent reviewers. Of the 26 included studies, 16 were considered of high methodological quality. Except for 2 studies, all high-quality studies reported intraclass correlation coefficients (ICCs) for intra-rater reliability of 0.70 or greater. Also, ICCs reported for inter-rater reliability in high-quality studies were generally greater than 0.70. Among low-quality studies, reported ICCs ranged from 0.26 to 0.99 and 0.68 to 0.97 for intra- and inter-rater reliability, respectively. Also, the reported standard error of measurement and minimal detectable change for rehabilitative US were generally in an acceptable range. Generally, the results of the reviewed studies indicate that rehabilitative US imaging has good levels of both inter- and intra-rater reliability. © 2018 by the American Institute of Ultrasound in Medicine.

Low level laser therapy (Photobiomodulation therapy) for breast cancer-related lymphedema: a systematic review.

PubMed

Baxter, G David; Liu, Lizhou; Petrich, Simone; Gisselman, Angela Spontelli; Chapple, Cathy; Anders, Juanita J; Tumilty, Steve

2017-12-07

Breast cancer related lymphedema (BCRL) is a prevalent complication secondary to cancer treatments which significantly impacts the physical and psychological health of breast cancer survivors. Previous research shows increasing use of low level laser therapy (LLLT), now commonly referred to as photobiomodulation (PBM) therapy, for BCRL. This systematic review evaluated the effectiveness of LLLT (PBM) in the management of BCRL. Clinical trials were searched in PubMed, AMED, Web of Science, and China National Knowledge Infrastructure up to November 2016. Two reviewers independently assessed the methodological quality and adequacy of LLLT (PBM) in these clinical trials. Primary outcome measures were limb circumference/volume, and secondary outcomes included pain intensity and range of motion. Because data were clinically heterogeneous, best evidence synthesis was performed. Eleven clinical trials were identified, of which seven randomized controlled trials (RCTs) were chosen for analysis. Overall, the methodological quality of included RCTs was high, whereas the reporting of treatment parameters was poor. Results indicated that there is strong evidence (three high quality trials) showing LLLT (PBM) was more effective than sham treatment for limb circumference/volume reduction at a short-term follow-up. There is moderate evidence (one high quality trial) indicating that LLLT (PBM) was more effective than sham laser for short-term pain relief, and limited evidence (one low quality trial) that LLLT (PBM) was more effective than no treatment for decreasing limb swelling at short-term follow-up. Based upon the current systematic review, LLLT (PBM) may be considered an effective treatment approach for women with BCRL. Due to the limited numbers of published trials available, there is a clear need for well-designed high-quality trials in this area. The optimal treatment parameters for clinical application have yet to be elucidated.

Biomechanics of fencing sport: A scoping review

PubMed Central

Chen, Tony Lin-Wei; Wong, Duo Wai-Chi; Wang, Yan; Ren, Sicong; Yan, Fei

2017-01-01

Objectives The aim of our scoping review was to identify and summarize current evidence on the biomechanics of fencing to inform athlete development and injury prevention. Design Scoping review. Method Peer-reviewed research was identified from electronic databases using a structured keyword search. Details regarding experimental design, study group characteristics and measured outcomes were extracted from retrieved studies, summarized and information regrouped under themes for analysis. The methodological quality of the evidence was evaluated. Results Thirty-seven peer-reviewed studies were retrieved, the majority being observational studies conducted with experienced and elite athletes. The methodological quality of the evidence was “fair” due to the limited scope of research. Male fencers were the prevalent group studied, with the lunge and use of a foil weapon being the principal movement evaluated. Motion capture and pedabarography were the most frequently used data collection techniques. Conclusions Elite fencers exhibited sequential coordination of upper and lower limb movements with coherent patterns of muscle activation, compared to novice fencers. These elite features of neuromuscular coordination resulted in higher magnitudes of forward linear velocity of the body center of mass and weapon. Training should focus on explosive power. Sex- and equipment-specific effects could not be evaluated based on available research. PMID:28187164

Effect of Medicinal Herbs on Primary Dysmenorrhoea- a Systematic Review

PubMed Central

Mirabi, Parvaneh; Alamolhoda, Seideh Hanieh; Esmaeilzadeh, Seddigheh; Mojab, Faraz

2014-01-01

Conventional treatment for primary dysmenorrhoea has a failure rate of 20% to 25% and may be contraindicated or not tolerated by some women. Herbal medicine may be a suitable alternative. To determine the efficacy and safety of Iranian herbal medicine for primary dysmenorrhea when compared with placebo, no treatment, and other treatment. Electronic searches of the Cochrane Menstrual Disorders and Dysmenorrhoea Group Register of controlled trials, Scopus, Google Scholar, Medline, Pubmed were performed to identify relevant randomized controlled trials (RCTs). The study abstraction and quality assessment of all studies were undertaken following the detailed descriptions of these categories as described in the JADAD Criteria for Systematic Reviews of Interventions. 25 RCTs involving a total of women were included in the review. The review found promising evidence in the form of RCTs for the use of herbal medicine in the treatment of primary dysmenorrhoea compared with pharmacological treatment. However, the results were limited by methodological flaws. Further rigorous no penetrating placebo-controlled RCTs are warranted. The review found promising evidence supporting the use of herbal medicine for primary dysmenorrhoea; however, results are limited by the poor methodological quality of the included trials. PMID:25276177

Systematic review of measurement properties of self-reported instruments for evaluating self-care in adults.

PubMed

Matarese, Maria; Lommi, Marzia; De Marinis, Maria Grazia

2017-06-01

The aims of this study were as follows: to identify instruments developed to assess self-care in healthy adults; to determine the theory on which they were based; their validity and reliability properties and to synthesize the evidence on their measurement properties. Many instruments have been developed to assess self-care in many different populations and conditions. Clinicians and researchers should select the most appropriate self-care instrument based on the knowledge of their measurement properties. Systematic review of measurement instruments according to the protocol recommended by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. PubMed, Embase, PsycINFO, Scopus and CINAHL databases were searched from inception to December 2015. Studies testing measurement properties of self-report instruments assessing self-care in healthy adults, published in the English language and in peer review journals were selected. Two reviewers independently appraised the methodological quality of the studies with the COSMIN checklist and the quality of results using specific quality criteria. Twenty-six articles were included in the review testing the measurement properties of nine instruments. Seven instruments were based on Orem's Self-care theory. Not all the measurement properties were evaluated for the identified instruments. No self-care instrument showed strong evidence supporting the evaluated measurement properties. Despite the development of several instruments to assess self-care in the adult population, no instrument can be fully recommended to clinical nurses and researchers. Further studies of high methodological quality are needed to confirm the measurement properties of these instruments. © 2016 John Wiley & Sons Ltd.

Are QALYs based on time trade-off comparable?--A systematic review of TTO methodologies.

PubMed

Arnesen, Trude; Trommald, Mari

2005-01-01

A wide range of methods is used to elicit quality-of-life weights of different health states to generate 'Quality-adjusted life years' (QALYs). The comparability between different types of health outcomes at a numerical level is the main advantage of using a 'common currency for health' such as the QALY. It has been warned that results of different methods and perspectives should not be directly compared in QALY league tables. But do we know that QALYs are comparable if they are based on the same method and perspective?The Time trade-off (TTO) consists in a hypothetical trade-off between living shorter and living healthier. We performed a literature review of the TTO methodology used to elicit quality-of-life weights for own, current health. Fifty-six journal articles, with quality-of-life weights assigned to 102 diagnostic groups were included. We found extensive differences in how the TTO question was asked. The time frame varied from 1 month to 30 years, and was not reported for one-fourth of the weights. The samples in which the quality-of-life weights were elicited were generally small with a median size of 53 respondents. Comprehensive inclusion criteria were given for half the diagnostic groups. Co-morbidity was described in less than one-tenth of the groups of respondents. For two-thirds of the quality-of-life weights, there was no discussion of the influence of other factors, such as age, sex, employment and children. The different methodological approaches did not influence the TTO weights in a predictable or clear pattern. Whether or not it is possible to standardise the TTO method and the sampling procedure, and whether or not the TTO will then give valid quality-of-life weights, remains an open question.This review of the TTO elicited on own behalf, shows that limiting cost-utility analysis to include only quality life weights from one method and one perspective is not enough to ensure that QALYs are comparable. Copyright 2004 John Wiley & Sons, Ltd.

Evaluation of the quality of the reporting of phase II clinical trials in oncology: A systematic review.

PubMed

Rivoirard, Romain; Langrand-Escure, Julien; Oriol, Mathieu; Tinquaut, Fabien; Chauvin, Franck; Rancoule, Chloé; Magné, Nicolas; Bourmaud, Aurélie

2018-05-01

To describe the current state of knowledge concerning the quality of reporting in phase II clinical trials in oncology and to describe the various methods published allowing this quality evaluation. databases including MEDLINE and COCHRANE were searched. Reviews and meta-analyses analyzing the quality of the reporting of phase II trials in oncology were included. Descriptive analysis of the results was performed. Thirteen publications were retained. Only 2 publications adopted a systematic approach of evaluation of the quality of reporting by overall scores. The Key Methodological Score (KMS), proposed by Grellety et al., gathering 3 items, seemed adapted for such an evaluation. A score of 3/3 was found in 16.1% of the 156 phase II trials analysed by this score. The other reviews used a qualitative analysis to evaluate the reporting, via an analysis of a single criterion, generally the statistical plan of the study. This item was considered as having been correctly reported in less than 50% of the analysed articles. The quality of reporting in phase II trials in oncology is a field that has been investigated very little (13 publications). When it is studied, the estimated level of quality is not satisfactory, whatever the method employed. The use of an overall score of evaluation is a path which should be pursued, in order to get reliable results. It also seems necessary to propose strong recommendations, which would create a consensus for the methodology and the reporting of these studies. Copyright © 2018 Elsevier B.V. All rights reserved.

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles on Elbow Medial Ulnar Collateral Ligament Surgery.

PubMed

Jack, Robert A; Sochacki, Kyle R; Morehouse, Hannah A; McCulloch, Patrick C; Lintner, David M; Harris, Joshua D

2018-04-01

Several studies have analyzed the most cited articles in shoulder, elbow, pediatrics, and foot and ankle surgery. However, no study has analyzed the quality of the most cited articles in elbow medial ulnar collateral ligament (UCL) surgery. To (1) identify the top 50 most cited articles related to UCL surgery, (2) determine whether there was a correlation between the top cited articles and level of evidence, and (3) determine whether there was a correlation between study methodological quality and the top cited articles. Systematic review. Web of Science and Scopus online databases were searched to identify the top 50 cited articles in UCL surgery. Level of evidence, number of times cited, year of publication, name of journal, country of origin, and study type were recorded for each study. Study methodological quality was analyzed for each article with the Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS). Correlation coefficients were calculated. The 50 most cited articles were published between 1981 and 2015. The number of citations per article ranged from 20 to 301 (mean ± SD, 71 ± 62 citations). Most articles (92%) were from the United States and were level 3 (16%), level 4 (58%), or unclassified (16%) evidence. There were no articles of level 1 evidence quality. The mean MCMS and MINORS scores were 28.1 ± 13.4 (range, 3-52) and 9.2 ± 3.6 (range, 2-19), respectively. There was no significant correlation between the mean number of citations and level of evidence or quality ( r s = -0.01, P = .917), MCMS ( r s = 0.09, P = .571), or MINORS ( r s = -0.26, P = .089). The top 50 cited articles in UCL surgery constitute a low level of evidence and low methodological quality, including no level 1 articles. There was no significant correlation between the mean number of citations and level of evidence or study methodological quality. However, weak correlations were observed for later publication date and improved level of evidence and methodological quality.

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles on Elbow Medial Ulnar Collateral Ligament Surgery

PubMed Central

Jack, Robert A.; Sochacki, Kyle R.; Morehouse, Hannah A.; McCulloch, Patrick C.; Lintner, David M.; Harris, Joshua D.

2018-01-01

Background: Several studies have analyzed the most cited articles in shoulder, elbow, pediatrics, and foot and ankle surgery. However, no study has analyzed the quality of the most cited articles in elbow medial ulnar collateral ligament (UCL) surgery. Purpose: To (1) identify the top 50 most cited articles related to UCL surgery, (2) determine whether there was a correlation between the top cited articles and level of evidence, and (3) determine whether there was a correlation between study methodological quality and the top cited articles. Study Design: Systematic review. Methods: Web of Science and Scopus online databases were searched to identify the top 50 cited articles in UCL surgery. Level of evidence, number of times cited, year of publication, name of journal, country of origin, and study type were recorded for each study. Study methodological quality was analyzed for each article with the Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS). Correlation coefficients were calculated. Results: The 50 most cited articles were published between 1981 and 2015. The number of citations per article ranged from 20 to 301 (mean ± SD, 71 ± 62 citations). Most articles (92%) were from the United States and were level 3 (16%), level 4 (58%), or unclassified (16%) evidence. There were no articles of level 1 evidence quality. The mean MCMS and MINORS scores were 28.1 ± 13.4 (range, 3-52) and 9.2 ± 3.6 (range, 2-19), respectively. There was no significant correlation between the mean number of citations and level of evidence or quality (rs = –0.01, P = .917), MCMS (rs = 0.09, P = .571), or MINORS (rs = –0.26, P = .089). Conclusion: The top 50 cited articles in UCL surgery constitute a low level of evidence and low methodological quality, including no level 1 articles. There was no significant correlation between the mean number of citations and level of evidence or study methodological quality. However, weak correlations were observed for later publication date and improved level of evidence and methodological quality. PMID:29780841

Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria.

PubMed

Lewis, Cara C; Fischer, Sarah; Weiner, Bryan J; Stanick, Cameo; Kim, Mimi; Martinez, Ruben G

2015-11-04

High-quality measurement is critical to advancing knowledge in any field. New fields, such as implementation science, are often beset with measurement gaps and poor quality instruments, a weakness that can be more easily addressed in light of systematic review findings. Although several reviews of quantitative instruments used in implementation science have been published, no studies have focused on instruments that measure implementation outcomes. Proctor and colleagues established a core set of implementation outcomes including: acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, sustainability (Adm Policy Ment Health Ment Health Serv Res 36:24-34, 2009). The Society for Implementation Research Collaboration (SIRC) Instrument Review Project employed an enhanced systematic review methodology (Implement Sci 2: 2015) to identify quantitative instruments of implementation outcomes relevant to mental or behavioral health settings. Full details of the enhanced systematic review methodology are available (Implement Sci 2: 2015). To increase the feasibility of the review, and consistent with the scope of SIRC, only instruments that were applicable to mental or behavioral health were included. The review, synthesis, and evaluation included the following: (1) a search protocol for the literature review of constructs; (2) the literature review of instruments using Web of Science and PsycINFO; and (3) data extraction and instrument quality ratings to inform knowledge synthesis. Our evidence-based assessment rating criteria quantified fundamental psychometric properties as well as a crude measure of usability. Two independent raters applied the evidence-based assessment rating criteria to each instrument to generate a quality profile. We identified 104 instruments across eight constructs, with nearly half (n = 50) assessing acceptability and 19 identified for adoption, with all other implementation outcomes revealing fewer than 10 instruments. Only one instrument demonstrated at least minimal evidence for psychometric strength on all six of the evidence-based assessment criteria. The majority of instruments had no information regarding responsiveness or predictive validity. Implementation outcomes instrumentation is underdeveloped with respect to both the sheer number of available instruments and the psychometric quality of existing instruments. Until psychometric strength is established, the field will struggle to identify which implementation strategies work best, for which organizations, and under what conditions.

A narrative meta-review of a series of systematic and meta-analytic reviews on the intervention outcome for children with developmental co-ordination disorder.

PubMed

Miyahara, M; Lagisz, M; Nakagawa, S; Henderson, S E

2017-09-01

Systematic reviews and meta-analyses are considered to be the 'gold standards' for synthesizing research evidence in particular areas of enquiry. However, such reviews are only useful if they themselves are conducted to a sufficiently high standard. The aim of this study was to conduct a narrative meta-review of existing analyses of the effectiveness of interventions designed for children with developmental co-ordination disorder (DCD). A narrative meta-review of systematic and meta-analytic reviews aimed at evaluating the effectiveness of intervention for children with DCD was conducted on studies published between 1950 and 2014. We identified suitable reviews, using a modification of the Population, Intervention, Comparison, Outcome (PICO) system and evaluated their methodological quality using the Assessment of Multiple Systematic Reviews (AMSTAR). In addition, the consistency of the quality of evidence and classification of intervention approaches was assessed independently by two assessors. The literature search yielded a total of four appropriate reviews published in the selected time span. The Assessment of Multiple Systematic Reviews percentage quality scores assigned to each review ranged from 0% (low quality) to 55% (medium quality). Evaluation of the quality of evidence and classification of intervention approaches yielded a discrepancy rate of 25%. All reviews concluded that some kind of intervention was better than none at all. Although the quality of the reviews progressively improved over the years, the shortcomings identified need to be addressed before concrete evidence regarding the best approach to intervention for children with DCD can be specified. © 2016 John Wiley & Sons Ltd.

Developing methods for systematic reviewing in health services delivery and organisation

PubMed Central

Alborz, Alison; McNally, Rosalind

2007-01-01

Objectives To develop methods to facilitate the ‘systematic’ review of evidence from a range of methodologies on diffuse or ‘soft’ topics, as exemplified by ‘access to healthcare’. Data sources 28 bibliographic databases, research registers, organisational web sites or library catalogues. Reference lists from identified studies. Contact with experts and service users. Current awareness and contents alerting services in the area of learning disabilities. Review methods Inclusion criteria were English language literature from 1980 onwards, relating to people with learning disabilities of any age and all study designs. The main criteria for assessment was relevance to Guillifords’ model of access to health care which was adapted to the circumstances of people with learning disabilities. Selected studies were evaluated for scientific rigour then data was extracted and the results synthesised. Quality assessment was by an initial set of ‘generic’ quality indicators. This enabled further evidence selection before evaluation of findings according to specific criteria for qualitative, quantitative or mixed-method studies. Results 82 studies were fully evaluated. Five studies were rated ‘highly rigorous’, 22 ‘rigorous’, 46 ‘less rigorous’ and 9 ‘poor’ papers were retained as the sole evidence covering aspects of the guiding model. The majority of studies were quantitative but used only descriptive statistics. Most evidence lacked methodological detail, which often lowered final quality ratings. Conclusions The application of a consistent structure to quality evaluation can facilitate data appraisal, extraction and synthesis across a range of methodologies in diffuse or ‘soft’ topics. Synthesis can be facilitated further by using software, such as the Microsoft ‘Access’ database, for managing information. PMID:15606880

Developing methods for systematic reviewing in health services delivery and organization: an example from a review of access to health care for people with learning disabilities. Part 2. Evaluation of the literature--a practical guide.

PubMed

Alborz, Alison; McNally, Rosalind

2004-12-01

To develop methods to facilitate the 'systematic' review of evidence from a range of methodologies on diffuse or 'soft' topics, as exemplified by 'access to health care'. Twenty-eight bibliographic databases, research registers, organizational websites or library catalogues. Reference lists from identified studies. Contact with experts and service users. Current awareness and contents alerting services in the area of learning disabilities. Inclusion criteria were English language literature from 1980 onwards, relating to people with learning disabilities of any age and all study designs. The main criteria for assessment was relevance to Guillifords' model of access to health care which was adapted to the circumstances of people with learning disabilities. Selected studies were evaluated for scientific rigour then data was extracted and the results synthesized. Quality assessment was by an initial set of 'generic' quality indicators. This enabled further evidence selection before evaluation of findings according to specific criteria for qualitative, quantitative or mixed-method studies. Eighty-two studies were fully evaluated. Five studies were rated 'highly rigorous', 22 'rigorous', 46 'less rigorous' and nine 'poor' papers were retained as the sole evidence covering aspects of the guiding model. The majority of studies were quantitative but used only descriptive statistics. Most evidence lacked methodological detail, which often lowered final quality ratings. The application of a consistent structure to quality evaluation can facilitate data appraisal, extraction and synthesis across a range of methodologies in diffuse or 'soft' topics. Synthesis can be facilitated further by using software, such as the microsoft 'access' database, for managing information.

Risk factors for injury in sport climbing and bouldering: a systematic review of the literature.

PubMed

Woollings, Kaikanani Y; McKay, Carly D; Emery, Carolyn A

2015-09-01

Rock climbing is an increasingly popular sport worldwide, as a recreational activity and a competitive sport. Several disciplines including sport climbing and bouldering have developed, each employing specific movements and techniques, leading to specific injuries. To examine risk factors and prevention measures for injury in sport climbing and bouldering, and to assess the methodological quality of existing studies. 12 electronic databases and several other sources were searched systematically using predetermined inclusion and exclusion criteria. Eligible articles were peer-reviewed, based on primary research using original data; outcome measures included injury, morbidity or mortality in rock climbing, and included one or more potential risk factor or injury prevention strategy. Two independent reviewers assessed the methodology of research in each study using the Downs and Black Quality Index. The data extracted is summarised, and appraisals of the articles are presented with respect to the quality of evidence presented. 19 studies met the inclusion criteria, and introduced 35 possible risk factors or injury prevention measures in climbing. Age, increasing years of climbing experience, highest climbing grade achieved (skill level), high climbing intensity score (CIS) and participating in lead climbing are potential risk factors. Results regarding injury prevention measures remain inconclusive. This field is relatively new and, as such, the data are not as robust as for more established sports with a larger research foundation. The key need is establishing modifiable risk factors using prospective studies and high quality methodology, such that injury prevention strategies can be developed. The CIS may be a useful measure in this field of research. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Integrative treatment for low back pain: An exploratory systematic review and meta-analysis of randomized controlled trials.

PubMed

Hu, Xiao-Yang; Chen, Ni-Ni; Chai, Qian-Yun; Yang, Guo-Yan; Trevelyan, Esmé; Lorenc, Ava; Liu, Jian-Ping; Robinson, Nicola

2015-10-26

Low back pain (LBP) is a common musculoskeletal condition often treated using integrative medicine (IM). Most reviews have focused on a single complementary and alternative medicine (CAM) therapy for LBP rather than evaluating wider integrative approaches. This exploratory systematic review aimed to identify randomized controlled trials (RCTs) and provide evidence on the effectiveness, cost effectiveness and adverse effects of integrative treatment for LBP. A literature search was conducted in 12 English and Chinese databases. RCTs evaluating an integrative treatment for musculoskeletal related LBP were included. Reporting, methodological quality and relevant clinical characteristics were assessed and appraised. Metaanalyses were performed for outcomes where trials were sufficiently homogenous. Fifty-six RCTs were identified evaluating integrative treatment for LBP. Although reporting and methodological qualities were poor, meta-analysis showed a favourable effect for integrative treatment over conventional and CAM treatment for back pain and function at 3 months or less follow-up. Two trials investigated costs, reporting £ 5332 per quality adjusted life years with 6 Alexander technique lessons plus exercise at 12 months follow-up; and an increased total costs of $244 when giving an additional up to 15 sessions of CAM package of care at 12 weeks. Sixteen trials mentioned safety; no severe adverse effects were reported. Integrative treatment that combines CAM with conventional therapies appeared to have beneficial effects on pain and function. However, evidence is limited due to heterogeneity, the relatively small numbers available for subgroup analyses and the low methodological quality of the included trials. Identification of studies of true IM was not possible due to lack of reporting of the intervention details (registration No. CRD42013003916).

Relationship between financial speculation and food prices or price volatility: applying the principles of evidence-based medicine to current debates in Germany.

PubMed

Bozorgmehr, Kayvan; Gabrysch, Sabine; Müller, Olaf; Neuhann, Florian; Jordan, Irmgard; Knipper, Michael; Razum, Oliver

2013-10-16

There is an unresolved debate about the potential effects of financial speculation on food prices and price volatility. Germany's largest financial institution and leading global investment bank recently decided to continue investing in agricultural commodities, stating that there is little empirical evidence to support the notion that the growth of agricultural-based financial products has caused price increases or volatility. The statement is supported by a recently published literature review, which concludes that financial speculation does not have an adverse effect on the functioning of the agricultural commodities market. As public health professionals concerned with global food insecurity, we have appraised the methodological quality of the review using a validated and reliable appraisal tool. The appraisal revealed major shortcomings in the methodological quality of the review. These were particularly related to intransparencies in the search strategy and in the selection/presentation of studies and findings; the neglect of the possibility of publication bias; a lack of objective or rigorous criteria for assessing the scientific quality of included studies and for the formulation of conclusions. Based on the results of our appraisal, we conclude that it is not justified to reject the hypothesis that financial speculation might have adverse effects on food prices/price volatility. We hope to initiate reflections about scientific standards beyond the boundaries of disciplines and call for high quality, rigorous systematic reviews on the effects of financial speculation on food prices or price volatility.

The quality of instruments to assess the process of shared decision making: A systematic review

PubMed Central

Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

2018-01-01

Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations. PMID:29447193

Overview of Evidence in Prevention and Aetiology of Food Allergy: A Review of Systematic Reviews

PubMed Central

Lodge, Caroline J.; Allen, Katrina J.; Lowe, Adrian J.; Dharmage, Shyamali C.

2013-01-01

The worldwide prevalence of food allergy appears to be increasing. Early life environmental factors are implicated in the aetiology of this global epidemic. The largest burden of disease is in early childhood, where research efforts aimed at prevention have been focused. Evidence synthesis from good quality systematic reviews is needed. We performed an overview of systematic reviews concerning the prevention and aetiology of food allergy, retrieving 14 systematic reviews, which covered three broad topics: formula (hydrolysed or soy) for the prevention of food allergy or food sensitization; maternal and infant diet and dietary supplements for the prevention of food allergy or food sensitization and hygiene hypothesis-related interventions. Using the AMSTAR criteria for assessment of methodological quality, we found five reviews to be of high quality, seven of medium quality and two of low quality. Overall we found no compelling evidence that any of the interventions that had been systematically reviewed were related to the risk of food allergy. Updating of existing reviews, and production of new systematic reviews, are needed in areas where evidence is emerging for interventions and environmental associations. Furthermore, additional primary studies, with greater numbers of participants and objective food allergy definitions are urgently required. PMID:24192789

Which psychosocial factors are related to chelation adherence in thalassemia? A systematic review.

PubMed

Evangeli, Michael; Mughal, Kulsoom; Porter, John B

2010-06-01

Good adherence to iron chelation therapy in thalassemia is crucial. Although there is evidence that adherence is related to regimen factors, there has been less emphasis on the relationship between psychosocial (psychological, demographic and social) factors and adherence. We present a systematic review of psychosocial correlates of chelation adherence in thalassemia. Nine studies met the inclusion criteria. Information was extracted regarding the study characteristics and the relationship between psychosocial factors and chelation adherence. Methodological quality was rated. The studies took place in a range of countries, were mostly cross sectional in design, and examined adherence to deferoxamine (DFO) only. Sample sizes ranged from 15 to 1573. A variety of psychosocial variables were examined. Definitions of adherence varied between studies and non adherence rates were also variable (9 to 66%). Older age was consistently associated with lower levels of chelation adherence. There were few other consistent findings. The methodological quality of studies was variable. There is a need for more methodologically sophisticated and theoretically informed studies on psychosocial correlates of chelation adherence. We offer specific suggestions.

Systematic review of studies on measurement properties of instruments for adults published in the American Journal of Occupational Therapy, 2009-2013.

PubMed

Yuen, Hon K; Austin, Sarah L

2014-01-01

We describe the methodological quality of recent studies on instrument development and testing published in the American Journal of Occupational Therapy (AJOT). We conducted a systematic review using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist to appraise 48 articles on measurement properties of assessments for adults published in AJOT between 2009 and 2013. Most studies had adequate methodological quality in design and statistical analysis. Common methodological limitations included that methods used to examine internal consistency were not consistently linked to the theoretical constructs underpinning assessments; participants in some test-retest reliability studies were not stable during the interim period; and in several studies of reliability and convergent validity, sample sizes were inadequate. AJOT's dissemination of psychometric research evidence has made important contributions to moving the profession toward the American Occupational Therapy Association's Centennial Vision. This study's results provide a benchmark by which to evaluate future accomplishments. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Factors associated with voice disorders among the elderly: a systematic review.

PubMed

Gois, Amanda Cibelly Brito; Pernambuco, Leandro de Araújo; Lima, Kenio Costa de

2017-12-26

During the aging process, natural modifications occur in the larynx and the structures involved in phonation which explain the specific characteristics found in the voices of elderly persons. When, at any moment, a voice fails and there is interference with communication, a voice disorder has occurred. This can generate disadvantages in communicative efficiency and have a negative impact on quality of life, compromising mechanisms of socialization, the maintenance of autonomy, and the sense of well-being. Nevertheless, there appears to be little clarity about which factors are associated with voice disorders in this population, especially from an epidemiological perspective. The present study is a literature review to identify factors associated with voice disorders among the elderly described in population-based studies. A systematic review of electronic databases was carried out. The methodological quality of the studies was analyzed with the Strengthening the Reporting of Observational Studies in Epidemiology guidelines. The research was conducted independently by two researchers. Although two articles met the eligibility criteria, none fulfilled all the criteria for the evaluation of methodological quality. According to the two studies selected for this review, factors associated with voice disorders among the elderly included both physical and psychosocial aspects. However, the methodological discrepancies between the studies, particularly in relation to sample selection and the instruments used indicate great variability and compromise the reliability of the results. Further prevalence studies and investigations of factors associated with voice disorders in the elderly from an epidemiological perspective, and which involve different cultures, should be carried out. Copyright © 2017 Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial. Published by Elsevier Editora Ltda. All rights reserved.

Dementia ascertainment using existing data in UK longitudinal and cohort studies: a systematic review of methodology.

PubMed

Sibbett, Ruth A; Russ, Tom C; Deary, Ian J; Starr, John M

2017-07-03

Studies investigating the risk factors for or causation of dementia must consider subjects prior to disease onset. To overcome the limitations of prospective studies and self-reported recall of information, the use of existing data is key. This review provides a narrative account of dementia ascertainment methods using sources of existing data. The literature search was performed using: MEDLINE, EMBASE, PsychInfo and Web of Science. Included articles reported a UK-based study of dementia in which cases were ascertained using existing data. Existing data included that which was routinely collected and that which was collected for previous research. After removing duplicates, abstracts were screened and the remaining articles were included for full-text review. A quality tool was used to evaluate the description of the ascertainment methodology. Of the 3545 abstracts screened, 360 articles were selected for full-text review. 47 articles were included for final consideration. Data sources for ascertainment included: death records, national datasets, research databases and hospital records among others. 36 articles used existing data alone for ascertainment, of which 27 used only a single data source. The most frequently used source was a research database. Quality scores ranged from 7/16 to 16/16. Quality scores were better for articles with dementia ascertainment as an outcome. Some papers performed validation studies of dementia ascertainment and most indicated that observed rates of dementia were lower than expected. We identified a lack of consistency in dementia ascertainment methodology using existing data. With no data source identified as a "gold-standard", we suggest the use of multiple sources. Where possible, studies should access records with evidence to confirm the diagnosis. Studies should also calculate the dementia ascertainment rate for the population being studied to enable a comparison with an expected rate.

Data quality and feasibility of the Experience Sampling Method across the spectrum of severe psychiatric disorders: a protocol for a systematic review and meta-analysis.

PubMed

Vachon, Hugo; Rintala, Aki; Viechtbauer, Wolfgang; Myin-Germeys, Inez

2018-01-18

Due to a number of methodological advantages and theoretical considerations, more and more studies in clinical psychology research employ the Experience Sampling Method (ESM) as a data collection technique. Despite this growing interest, the absence of methodological guidelines related to the use of ESM has resulted in a large heterogeneity of designs while the potential effects of the design itself on the response behavior of the participants remain unknown. The objectives of this systematic review are to investigate the associations between the design characteristics and the data quality and feasibility of studies relying on ESM in severe psychiatric disorders. We will search for all published studies using ambulatory assessment with patients suffering from major depressive disorder, bipolar disorder, and psychotic disorder or individuals at high risk for these disorders. Electronic database searches will be performed in PubMed and Web of Science with no restriction on the publication date. Two reviewers will independently screen original studies in a title/abstract phase and a full-text phase based on the inclusion criteria. The information related to the design and sample characteristics, data quality, and feasibility will be extracted. We will provide results in terms of a descriptive synthesis, and when applicable, a meta-analysis of the findings will be conducted. Our results will attempt to highlight how the feasibility and data quality of ambulatory assessment might be related to the methodological characteristics of the study designs in severe psychiatric disorders. We will discuss these associations in different subsamples if sufficient data are available and will examine limitations in the reporting of the methods of ambulatory studies in the current literature. The protocol for this systematic review was registered on PROSPERO (PROSPERO 2017: CRD42017060322 ) and is available in full on the University of York website ( http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42017060322 ).

Methodologic ramifications of paying attention to sex and gender differences in clinical research.

PubMed

Prins, Martin H; Smits, Kim M; Smits, Luc J

2007-01-01

Methodologic standards for studies on sex and gender differences should be developed to improve reporting of studies and facilitate their inclusion in systematic reviews. The essence of these studies lies within the concept of effect modification. This article reviews important methodologic issues in the design and reporting of pharmacogenetic studies. Differences in effect based on sex or gender should preferably be expressed in absolute terms (risk differences) to facilitate clinical decisions on treatment. Information on the distribution of potential effect modifiers or prognostic factors should be available to prevent a biased comparison of differences in effect between genotypes. Other considerations included the possibility of selective nonavailability of biomaterial and the choice of a statistical model to study effect modification. To ensure high study quality, additional methodologic issues should be taken into account when designing and reporting studies on sex and gender differences.

Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol).

PubMed

Lawal, Adegboyega K; Rotter, Thomas; Kinsman, Leigh; Sari, Nazmi; Harrison, Liz; Jeffery, Cathy; Kutz, Mareike; Khan, Mohammad F; Flynn, Rachel

2014-09-19

Lean is a set of operating philosophies and methods that help create a maximum value for patients by reducing waste and waits. It emphasizes the consideration of the customer's needs, employee involvement and continuous improvement. Research on the application and implementation of lean principles in health care has been limited. This is a protocol for a systematic review, following the Cochrane Effective Practice and Organisation of Care (EPOC) methodology. The review aims to document, catalogue and synthesize the existing literature on the effects of lean implementation in health care settings especially the potential effects on professional practice and health care outcomes. We have developed a Medline keyword search strategy, and this focused strategy will be translated into other databases. All search strategies will be provided in the review. The method proposed by the Cochrane EPOC group regarding randomized study designs, non-randomised controlled trials controlled before and after studies and interrupted time series will be followed. In addition, we will also include cohort, case-control studies, and relevant non-comparative publications such as case reports. We will categorize and analyse the review findings according to the study design employed, the study quality (low- versus high-quality studies) and the reported types of implementation in the primary studies. We will present the results of studies in a tabular form. Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin the implementation of lean activities in health care settings as defined in this protocol. As a result, the review will provide an evidence base for the effectiveness of lean and implementation methodologies reported in health care. PROSPERO CRD42014008853.

Arthroscopic repair of lateral ankle ligament complex by suture anchor.

PubMed

Wang, Jingwei; Hua, Yinghui; Chen, Shiyi; Li, Hongyun; Zhang, Jian; Li, Yunxia

2014-06-01

Arthroscopic repair of the lateral ligament complex with suture anchors is increasingly used to treat chronic ankle instability (CAI). Our aims are (1) to analyze and evaluate the literature on arthroscopic suture anchor repair of the anterior talofibular ligament and (2) to conduct a systematic review of the clinical evidence on the reported outcomes and complications of treating CAI with this technique. We performed a systematic review of the literature using PubMed, Ovid, Elsevier ScienceDirect, Web of Science-Conference Proceedings Citation Index, and the Cochrane Database of Systematic Reviews from 1987 to September 2013. Clinical studies using the arthroscopic suture anchor technique to treat CAI were included. Outcome measures consisted of clinical assessment of postoperative ligament stability and complications. In addition, the methodologic quality of the included studies was assessed by use of the modified Coleman Methodology Score. After reviewing 371 studies, we identified 6 studies (5 retrospective case series and 1 prospective case series, all Level IV) that met the inclusion criteria, with a mean Coleman Methodology Score of 71.8 ± 7.52 (range, 63 to 82). In these studies 178 patients (179 ankles) underwent arthroscopic suture anchor repair of the anterior talofibular ligament with a mean follow-up period of 38.9 months (range, 6 to 117.6 months). All patients were reported to have subjective improvement of their ankle instability, with complications in 31 cases. Studies of arthroscopic suture anchor technique to treat CAI are sparse, with moderate mean methodologic quality. The included studies suggest that the arthroscopic technique is a feasible procedure to restore ankle stability; however, on the basis of our review, this technique seems to be associated with a relatively high complication rate. Extensive cadaveric studies, clinical trials, and comparative studies comparing arthroscopic and open repair should be performed in the future. Level IV, systematic review of Level IV studies. Copyright © 2014 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Interventions to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA: a systematic review.

PubMed

Clifford, Anton; McCalman, Janya; Bainbridge, Roxanne; Tsey, Komla

2015-04-01

This article describes the characteristics and reviews the methodological quality of interventions designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA. A total of 17 electronic databases and 13 websites for the period of 2002-13. Studies were included if they evaluated an intervention strategy designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, the USA or Canada. Information on the characteristics and methodological quality of included studies was extracted using standardized assessment tools. Sixteen published evaluations of interventions to improve cultural competency in health care for Indigenous peoples were identified: 11 for Indigenous peoples of the USA and 5 for Indigenous Australians. The main types of intervention strategies were education and training of the health workforce, culturally specific health programs and recruitment of an Indigenous health workforce. Main positive outcomes reported were improvements in health professionals' confidence, and patients' satisfaction with and access to health care. The methodological quality of evaluations and the reporting of key methodological criteria were variable. Particular problems included weak study designs, low or no reporting of consent rates, confounding and non-validated measurement instruments. There is a lack of evidence from rigorous evaluations on the effectiveness of interventions for improving cultural competency in health care for Indigenous peoples. Future evaluations should employ more rigorous study designs and extend their measurement of outcomes beyond those relating to health professionals, to those relating to the health of Indigenous peoples. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.