METHODOLOGICAL QUALITY OF ECONOMIC EVALUATIONS ALONGSIDE TRIALS OF KNEE PHYSIOTHERAPY.

PubMed

García-Pérez, Lidia; Linertová, Renata; Arvelo-Martín, Alejandro; Guerra-Marrero, Carolina; Martínez-Alberto, Carlos Enrique; Cuéllar-Pompa, Leticia; Escobar, Antonio; Serrano-Aguilar, Pedro

2017-01-01

The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis. Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale. All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account. Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

Is Article Methodological Quality Associated With Conflicts of Interest?: An Analysis of the Plastic Surgery Literature.

PubMed

Cho, Brian H; Lopez, Joseph; Means, Jessica; Lopez, Sandra; Milton, Jacqueline; Tufaro, Anthony P; May, James W; Dorafshar, Amir H

2017-12-01

Conflicts of interest (COI) are an emerging area of discussion within the field of plastic surgery. Recently, several reports have found that research studies that disclose COI are associated with publication of positive outcomes. We hypothesize that this association is driven by higher-quality studies receiving industry funding. This study aimed to investigate the association between industry support and study methodological quality. We reviewed all entries in Plastic and Reconstructive Surgery, Annals of Plastic Surgery, and Journal of Plastic, Reconstructive, and Aesthetic Surgery within a 1-year period encompassing 2013. All clinical research articles were analyzed. Studies were evaluated blindly for methodology quality based on a validated scoring system. An ordinal logistic regression model was used to examine the association between methodology score and COI. A total of 1474 articles were reviewed, of which 483 met our inclusion criteria. These articles underwent methodological quality scoring. Conflicts of interest were reported in 28 (5.8%) of these articles. After adjusting for article characteristics in the ordinal logistic regression analysis, there was no significant association between articles with COI and higher methodological scores (P = 0.7636). Plastic surgery studies that disclose COI are not associated with higher methodological quality when compared with studies that do not disclose COI. These findings suggest that although the presence of COI is associated with positive findings, the association is not shown to be driven by higher-quality studies.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool.

PubMed

Ho, Robin S T; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel Y S; Chung, Vincent C H

2015-01-08

Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. To assess the methodological quality of MAs on COPD treatments. A cross-sectional study on MAs of COPD trials. MAs published during 2000-2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool

PubMed Central

Ho, Robin ST; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel YS; Chung, Vincent CH

2015-01-01

Background: Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. Aims: To assess the methodological quality of MAs on COPD treatments. Methods: A cross-sectional study on MAs of COPD trials. MAs published during 2000–2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Results: Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. Conclusions: The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods. PMID:25569783

Development of a Valid and Reliable Knee Articular Cartilage Condition-Specific Study Methodological Quality Score.

PubMed

Harris, Joshua D; Erickson, Brandon J; Cvetanovich, Gregory L; Abrams, Geoffrey D; McCormick, Frank M; Gupta, Anil K; Verma, Nikhil N; Bach, Bernard R; Cole, Brian J

2014-02-01

Condition-specific questionnaires are important components in evaluation of outcomes of surgical interventions. No condition-specific study methodological quality questionnaire exists for evaluation of outcomes of articular cartilage surgery in the knee. To develop a reliable and valid knee articular cartilage-specific study methodological quality questionnaire. Cross-sectional study. A stepwise, a priori-designed framework was created for development of a novel questionnaire. Relevant items to the topic were identified and extracted from a recent systematic review of 194 investigations of knee articular cartilage surgery. In addition, relevant items from existing generic study methodological quality questionnaires were identified. Items for a preliminary questionnaire were generated. Redundant and irrelevant items were eliminated, and acceptable items modified. The instrument was pretested and items weighed. The instrument, the MARK score (Methodological quality of ARticular cartilage studies of the Knee), was tested for validity (criterion validity) and reliability (inter- and intraobserver). A 19-item, 3-domain MARK score was developed. The 100-point scale score demonstrated face validity (focus group of 8 orthopaedic surgeons) and criterion validity (strong correlation to Cochrane Quality Assessment score and Modified Coleman Methodology Score). Interobserver reliability for the overall score was good (intraclass correlation coefficient [ICC], 0.842), and for all individual items of the MARK score, acceptable to perfect (ICC, 0.70-1.000). Intraobserver reliability ICC assessed over a 3-week interval was strong for 2 reviewers (≥0.90). The MARK score is a valid and reliable knee articular cartilage condition-specific study methodological quality instrument. This condition-specific questionnaire may be used to evaluate the quality of studies reporting outcomes of articular cartilage surgery in the knee.

Methological quality of systematic reviews and meta-analyses on acupuncture for stroke: A review of review.

PubMed

Chen, Xin-Lin; Mo, Chuan-Wei; Lu, Li-Ya; Gao, Ri-Yang; Xu, Qian; Wu, Min-Feng; Zhou, Qian-Yi; Hu, Yue; Zhou, Xuan; Li, Xian-Tao

2017-11-01

To assess the methodological quality of systematic reviews and meta-analyses regarding acupuncture intervention for stroke and the primary studies within them. Two researchers searched PubMed, Cumulative index to Nursing and Allied Health Literature, Embase, ISI Web of Knowledge, Cochrane, Allied and Complementary Medicine, Ovid Medline, Chinese Biomedical Literature Database, China National Knowledge Infrastructure, Wanfang and Traditional Chinese Medical Database to identify systematic reviews and meta-analyses about acupuncture for stroke published from the inception to December 2016. Review characteristics and the criteria for assessing the primary studies within reviews were extracted. The methodological quality of the reviews was assessed using adapted Oxman and Guyatt Scale. The methodological quality of primary studies was also assessed. Thirty-two eligible reviews were identified, 15 in English and 17 in Chinese. The English reviews were scored higher than the Chinese reviews (P=0.025), especially in criteria for avoiding bias and the scope of search. All reviews used the quality criteria to evaluate the methodological quality of primary studies, but some criteria were not comprehensive. The primary studies, in particular the Chinese reviews, had problems with randomization, allocation concealment, blinding, dropouts and withdrawals, intent-to-treat analysis and adverse events. Important methodological flaws were found in Chinese systematic reviews and primary studies. It was necessary to improve the methodological quality and reporting quality of both the systematic reviews published in China and primary studies on acupuncture for stroke.

Methodological quality of systematic reviews on influenza vaccination.

PubMed

Remschmidt, Cornelius; Wichmann, Ole; Harder, Thomas

2014-03-26

There is a growing body of evidence on the risks and benefits of influenza vaccination in various target groups. Systematic reviews are of particular importance for policy decisions. However, their methodological quality can vary considerably. To investigate the methodological quality of systematic reviews on influenza vaccination (efficacy, effectiveness, safety) and to identify influencing factors. A systematic literature search on systematic reviews on influenza vaccination was performed, using MEDLINE, EMBASE and three additional databases (1990-2013). Review characteristics were extracted and the methodological quality of the reviews was evaluated using the assessment of multiple systematic reviews (AMSTAR) tool. U-test, Kruskal-Wallis test, chi-square test, and multivariable linear regression analysis were used to assess the influence of review characteristics on AMSTAR-score. Fourty-six systematic reviews fulfilled the inclusion criteria. Average methodological quality was high (median AMSTAR-score: 8), but variability was large (AMSTAR range: 0-11). Quality did not differ significantly according to vaccination target group. Cochrane reviews had higher methodological quality than non-Cochrane reviews (p=0.001). Detailed analysis showed that this was due to better study selection and data extraction, inclusion of unpublished studies, and better reporting of study characteristics (all p<0.05). In the adjusted analysis, no other factor, including industry sponsorship or journal impact factor had an influence on AMSTAR score. Systematic reviews on influenza vaccination showed large differences regarding their methodological quality. Reviews conducted by the Cochrane collaboration were of higher quality than others. When using systematic reviews to guide the development of vaccination recommendations, the methodological quality of a review in addition to its content should be considered. Copyright © 2014 Elsevier Ltd. All rights reserved.

Methodological quality and scientific impact of quantitative nursing education research over 18 months.

PubMed

Yucha, Carolyn B; Schneider, Barbara St Pierre; Smyer, Tish; Kowalski, Susan; Stowers, Eva

2011-01-01

The methodological quality of nursing education research has not been rigorously studied. The purpose of this study was to evaluate the methodological quality and scientific impact of nursing education research reports. The methodological quality of 133 quantitative nursing education research articles published between July 2006 and December 2007 was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).The mean (+/- SD) MERSQI score was 9.8 +/- 2.2. It correlated (p < .05) with several scientific impact indicators: citation counts from Scopus (r = .223), Google Scholar (r = .224), and journal impact factor (r = .216); it was not associated with Web of Science citation count, funding, or h Index. The similarities between this study's MERSQI ratings for nursing literature and those reported for the medical literature, coupled with the association with citation counts, suggest that the MERSQI is an appropriate instrument to evaluate the quality of nursing education research.

Methodological quality and reporting of systematic reviews in hand and wrist pathology.

PubMed

Wasiak, J; Shen, A Y; Ware, R; O'Donohoe, T J; Faggion, C M

2017-10-01

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions. I.

Most systematic reviews of high methodological quality on psoriasis interventions are classified as high risk of bias using ROBIS tool.

PubMed

Gómez-García, Francisco; Ruano, Juan; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Sanz-Cabanillas, Juan Luis; Alcalde-Mellado, Patricia; Maestre-López, Beatriz; Carmona-Fernández, Pedro Jesús; González-Padilla, Marcelino; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-01

No gold standard exists to assess methodological quality of systematic reviews (SRs). Although Assessing the Methodological Quality of Systematic Reviews (AMSTAR) is widely accepted for analyzing quality, the ROBIS instrument has recently been developed. This study aimed to compare the capacity of both instruments to capture the quality of SRs concerning psoriasis interventions. Systematic literature searches were undertaken on relevant databases. For each review, methodological quality and bias risk were evaluated using the AMSTAR and ROBIS tools. Descriptive and principal component analyses were conducted to describe similarities and discrepancies between both assessment tools. We classified 139 intervention SRs as displaying high/moderate/low methodological quality and as high/low risk of bias. A high risk of bias was detected for most SRs classified as displaying high or moderate methodological quality by AMSTAR. When comparing ROBIS result profiles, responses to domain 4 signaling questions showed the greatest differences between bias risk assessments, whereas domain 2 items showed the least. When considering SRs published about psoriasis, methodological quality remains suboptimal, and the risk of bias is elevated, even for SRs exhibiting high methodological quality. Furthermore, the AMSTAR and ROBIS tools may be considered as complementary when conducting quality assessment of SRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Methodological and Reporting Quality of Comparative Studies Evaluating Health-Related Quality of Life of Colorectal Cancer Patients and Controls: A Systematic Review.

PubMed

Wong, Carlos K H; Guo, Vivian Y W; Chen, Jing; Lam, Cindy L K

2016-11-01

Health-related quality of life is an important outcome measure in patients with colorectal cancer. Comparison with normative data has been increasingly undertaken to assess the additional impact of colorectal cancer on health-related quality of life. This review aimed to critically appraise the methodological details and reporting characteristics of comparative studies evaluating differences in health-related quality of life between patients and controls. A systematic search of English-language literature published between January 1985 and May 2014 was conducted through a database search of PubMed, Web of Science, Embase, and Medline. Comparative studies reporting health-related quality-of-life outcomes among patients who have colorectal cancer and controls were selected. Methodological and reporting quality per comparison study was evaluated based on a 11-item methodological checklist proposed by Efficace in 2003 and a set of criteria predetermined by reviewers. Thirty-one comparative studies involving >10,000 patients and >10,000 controls were included. Twenty-three studies (74.2%) originated from European countries, with the largest number from the Netherlands (n = 6). Twenty-eight studies (90.3%) compared the health-related quality of life of patients with normative data published elsewhere, whereas the remaining studies recruited a group of patients who had colorectal cancer and a group of control patients within the same studies. The European Organisation for Research and Treatment of Cancer Quality-of-Life Questionnaire Core 30 was the most extensively used instrument (n = 16; 51.6%). Eight studies (25.8%) were classified as "probably robust" for clinical decision making according to the Efficace standard methodological checklist. Our further quality assessment revealed the lack of score differences reported (61.3%), contemporary comparisons (36.7%), statistical significance tested (38.7%), and matching of control group (58.1%), possibly leading to inappropriate control groups for fair comparisons. Meta-analysis of differences between the 2 groups was not available. In general, one-fourth of comparative studies that evaluated health-related quality of life of patients who had colorectal cancer achieved high quality in reporting characteristics and methodological details. Future studies are encouraged to undertake health-related quality-of-life measurement and adhere to a methodological checklist in comparison with controls.

Evolution of the methodological quality of controlled clinical trials for myofascial trigger point treatments for the period 1978-2015: A systematic review.

PubMed

Stoop, Rahel; Clijsen, Ron; Leoni, Diego; Soldini, Emiliano; Castellini, Greta; Redaelli, Valentina; Barbero, Marco

2017-08-01

The methodological quality of controlled clinical trials (CCTs) of physiotherapeutic treatment modalities for myofascial trigger points (MTrP) has not been investigated yet. To detect the methodological quality of CCTs for physiotherapy treatments of MTrPs and demonstrating the possible increase over time. Systematic review. A systematic search was conducted in two databases, Physiotherapy Evidence Database (PEDro) and Medicine Medical Literature Analysis and Retrieval System online (MEDLINE), using the same keywords and selection procedure corresponding to pre-defined inclusion criteria. The methodological quality, assessed by the 11-item PEDro scale, served as outcome measure. The CCTs had to compare at least two interventions, where one intervention had to lay within the scope of physiotherapy. Participants had to be diagnosed with myofascial pain syndrome or trigger points (active or latent). A total of n = 230 studies was analysed. The cervico-thoracic region was the most frequently treated body part (n = 143). Electrophysical agent applications was the most frequent intervention. The average methodological quality reached 5.5 on the PEDro scale. A total of n = 6 studies scored the value of 9. The average PEDro score increased by 0.7 points per decade between 1978 and 2015. The average PEDro score of CCTs for MTrP treatments does not reach the cut-off of 6 proposed for moderate to high methodological quality. Nevertheless, a promising trend towards an increase of the average methodological quality of CCTs for MTrPs was recorded. More high-quality CCT studies with thorough research procedures are recommended to enhance methodological quality. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Reporting and Methodological Quality of Randomised Controlled Trials in Vascular and Endovascular Surgery.

PubMed

Hajibandeh, S; Hajibandeh, S; Antoniou, G A; Green, P A; Maden, M; Torella, F

2015-11-01

Randomised controlled trials (RCTs) are subject to bias if they lack methodological quality. Moreover, optimal and transparent reporting of RCT findings aids their critical appraisal and interpretation. The aim of this study was to ascertain whether the methodological and reporting quality of RCTs in vascular and endovascular surgery is improving. The most recent 75 and oldest 75 RCTs published in leading journals over a 10-year period (2003-2012) were identified. The reporting quality and methodological quality data of the old and new RCTs were extracted and compared. The former was analysed using the Consolidated Standards of Reporting Trials (CONSORT) statement, the latter with the Scottish Intercollegiate Guidelines Network (SIGN) checklist. Reporting quality measured by CONSORT was better in the new studies than in the old studies (0.68 [95% CI, 0.66-0.7] vs. 0.60 [95% CI, 0.58-0.62], p < .001); however, both new and old studies had similar methodological quality measured by SIGN (0.9 [IQR 0.1] vs. .09 [IQR: 0.2], p = .787). Unlike clinical items, the methodological items of the CONSORT statement were not well reported in old and new RCTs. More trials in the new group were endovascular related (33.33% vs. 17.33%, p = .038) and industry sponsored (28% vs. 6.67%, p = .001). Despite some progress, there remains room for improvement in the reporting quality of RCTs in vascular and endovascular surgery. The methodological quality of recent RCTs is similar to that of trials performed >10 years ago. Copyright © 2015 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Methodology and reporting of diagnostic accuracy studies of automated perimetry in glaucoma: evaluation using a standardised approach.

PubMed

Fidalgo, Bruno M R; Crabb, David P; Lawrenson, John G

2015-05-01

To evaluate methodological and reporting quality of diagnostic accuracy studies of perimetry in glaucoma and to determine whether there had been any improvement since the publication of the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines. A systematic review of English language articles published between 1993 and 2013 reporting the diagnostic accuracy of perimetry in glaucoma. Articles were appraised for methodological quality using the 14-item Quality assessment tool for diagnostic accuracy studies (QUADAS) and evaluated for quality of reporting by applying the STARD checklist. Fifty-eight articles were appraised. Overall methodological quality of these studies was moderate with a median number of QUADAS items rated as 'yes' equal to nine (out of a maximum of 14) (IQR 7-10). The studies were often poorly reported; median score of STARD items fully reported was 11 out of 25 (IQR 10-14). A comparison of the studies published in 10-year periods before and after the publication of the STARD checklist in 2003 found quality of reporting had not substantially improved. Methodological and reporting quality of diagnostic accuracy studies of perimetry is sub-optimal and appears not to have improved substantially following the development of the STARD reporting guidance. This observation is consistent with previous studies in ophthalmology and in other medical specialities. © 2015 The Authors Ophthalmic & Physiological Optics © 2015 The College of Optometrists.

Methodological Quality of Randomized Clinical Trials of Respiratory Physiotherapy in Coronary Artery Bypass Grafting Patients in the Intensive Care Unit: a Systematic Review

PubMed Central

Lorscheitter, Jaqueline; Stein, Cinara; Plentz, Rodrigo Della Méa

2017-01-01

Objective To assess methodological quality of the randomized controlled trials of physiotherapy in patients undergoing coronary artery bypass grafting in the intensive care unit. Methods The studies published until May 2015, in MEDLINE, Cochrane and PEDro were included. The primary outcome extracted was proper filling of the Cochrane Collaboration's tool's items and the secondary was suitability to the requirements of the CONSORT Statement and its extension. Results From 807 studies identified, 39 were included. Most at CONSORT items showed a better adequacy after the statement's publication. Studies with positive outcomes presented better methodological quality. Conclusion The methodological quality of the studies has been improving over the years. However, many aspects can still be better designed. PMID:28977205

Comparison of methodologic quality and study/report characteristics between quantitative clinical nursing and nursing education research articles.

PubMed

Schneider, Barbara St Pierre; Nicholas, Jennifer; Kurrus, Jeffrey E

2013-01-01

To compare the methodologic quality and study/report characteristics between quantitative clinical nursing and nursing education research articles. The methodologic quality of quantitative nursing education research needs to advance to a higher level. Clinical research can provide guidance for nursing education to reach this level. One hundred quantitative clinical research articles from-high impact journals published in 2007 and 37 education research articles from high impact journals published in 2006 to 2007 were chosen for analysis. Clinical articles had significantly higher quality scores than education articles in three domains: number of institutions studied, type of data, and outcomes. The findings indicate three ways in which nursing education researchers can strengthen the methodologic quality of their quantitative research. With this approach, greater funding may be secured for advancing the science of nursing education.

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated. Clinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement. Copyright © 2017 Elsevier Ltd. All rights reserved.

Methodological quality of systematic reviews addressing femoroacetabular impingement.

PubMed

Kowalczuk, Marcin; Adamich, John; Simunovic, Nicole; Farrokhyar, Forough; Ayeni, Olufemi R

2015-09-01

As the body of literature on femoroacetabular impingement (FAI) continues to grow, clinicians turn to systematic reviews to remain current with the best available evidence. The quality of systematic reviews in the FAI literature is currently unknown. The goal of this study was to assess the quality of the reporting of systematic reviews addressing FAI over the last 11 years (2003-2014) and to identify the specific methodological shortcomings and strengths. A search of the electronic databases, MEDLINE, EMBASE and PubMed, was performed to identify relevant systematic reviews. Methodological quality was assessed by two reviewers using the revised assessment of multiple systematic reviews (R-AMSTAR) scoring tool. An intraclass correlation coefficient (ICC) with 95 % confidence intervals (CI) was used to determine agreement between reviewers on R-AMSTAR quality scores. A total of 22 systematic reviews were assessed for methodological quality. The mean consensus R-AMSTAR score across all studies was 26.7 out of 40.0, indicating fair methodological quality. An ICC of 0.931, 95 % CI 0.843-0.971 indicated excellent agreement between reviewers during the scoring process. The systematic reviews addressing FAI are generally of fair methodological quality. Use of tools such as the R-AMSTAR score or PRISMA guidelines while designing future systematic reviews can assist in eliminating methodological shortcomings identified in this review. These shortcomings need to be kept in mind by clinicians when applying the current literature to their patient populations and making treatment decisions. Systematic reviews of highest methodological quality should be used by clinicians when possible to answer clinical questions.

A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews.

PubMed

Pluye, Pierre; Gagnon, Marie-Pierre; Griffiths, Frances; Johnson-Lafleur, Janique

2009-04-01

A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies. To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components. A three-step critical review was conducted. 2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic. Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs). Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality. A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.

Abstract analysis method facilitates filtering low-methodological quality and high-bias risk systematic reviews on psoriasis interventions.

PubMed

Gómez-García, Francisco; Ruano, Juan; Aguilar-Luque, Macarena; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesús; Hernández-Romero, José Luis; Sanz-Cabanillas, Juan Luis; Maestre-López, Beatriz; González-Padilla, Marcelino; Carmona-Fernández, Pedro J; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-29

Article summaries' information and structure may influence researchers/clinicians' decisions to conduct deeper full-text analyses. Specifically, abstracts of systematic reviews (SRs) and meta-analyses (MA) should provide structured summaries for quick assessment. This study explored a method for determining the methodological quality and bias risk of full-text reviews using abstract information alone. Systematic literature searches for SRs and/or MA about psoriasis were undertaken on MEDLINE, EMBASE, and Cochrane database. For each review, quality, abstract-reporting completeness, full-text methodological quality, and bias risk were evaluated using Preferred Reporting Items for Systematic Reviews and Meta-analyses for abstracts (PRISMA-A), Assessing the Methodological Quality of Systematic Reviews (AMSTAR), and ROBIS tools, respectively. Article-, author-, and journal-derived metadata were systematically extracted from eligible studies using a piloted template, and explanatory variables concerning abstract-reporting quality were assessed using univariate and multivariate-regression models. Two classification models concerning SRs' methodological quality and bias risk were developed based on per-item and total PRISMA-A scores and decision-tree algorithms. This work was supported, in part, by project ICI1400136 (JR). No funding was received from any pharmaceutical company. This study analysed 139 SRs on psoriasis interventions. On average, they featured 56.7% of PRISMA-A items. The mean total PRISMA-A score was significantly higher for high-methodological-quality SRs than for moderate- and low-methodological-quality reviews. SRs with low-bias risk showed higher total PRISMA-A values than reviews with high-bias risk. In the final model, only 'authors per review > 6' (OR: 1.098; 95%CI: 1.012-1.194), 'academic source of funding' (OR: 3.630; 95%CI: 1.788-7.542), and 'PRISMA-endorsed journal' (OR: 4.370; 95%CI: 1.785-10.98) predicted PRISMA-A variability. Reviews with a total PRISMA-A score < 6, lacking identification as SR or MA in the title, and lacking explanation concerning bias risk assessment methods were classified as low-methodological quality. Abstracts with a total PRISMA-A score ≥ 9, including main outcomes results and explanation bias risk assessment method were classified as having low-bias risk. The methodological quality and bias risk of SRs may be determined by abstract's quality and completeness analyses. Our proposal aimed to facilitate synthesis of evidence evaluation by clinical professionals lacking methodological skills. External validation is necessary.

Methodological issues in genetic association studies of inherited thrombophilia: original report of recent practice.

PubMed

Simundic, Ana-Maria; Nikolac, Nora; Topic, Elizabeta

2009-01-01

The aims of this article are to evaluate the methodological quality of genetic association studies on the inherited thrombophilia published during 2003 to 2005, to identify the most common mistakes made by authors of those studies, and to examine if overall quality of the article correlates with the quality of the journal. Articles were evaluated by 2 independent reviewers using the checklist of 16 items. A total of 58 eligible studies were identified. Average total score was 7.59 +/- 1.96. Total article score did not correlate with the journal impact factor (r = 0.3971; 95% confidence interval [CI], 0.1547-0.5944, P = .002). Total score did not differ across years (P = .624). Finally, it is concluded that methodological quality of genetic association studies is not optimal, and it does not depend on the quality of the journal. Journals should adopt methodological criteria for reporting the genetic association studies, and editors should encourage authors to strictly adhere to those criteria.

Guidance on assessing the methodological and reporting quality of toxicologically relevant studies: A scoping review.

PubMed

Samuel, Gbeminiyi O; Hoffmann, Sebastian; Wright, Robert A; Lalu, Manoj Mathew; Patlewicz, Grace; Becker, Richard A; DeGeorge, George L; Fergusson, Dean; Hartung, Thomas; Lewis, R Jeffrey; Stephens, Martin L

2016-01-01

Assessments of methodological and reporting quality are critical to adequately judging the credibility of a study's conclusions and to gauging its potential reproducibility. To aid those seeking to assess the methodological or reporting quality of studies relevant to toxicology, we conducted a scoping review of the available guidance with respect to four types of studies: in vivo and in vitro, (quantitative) structure-activity relationships ([Q]SARs), physico-chemical, and human observational studies. Our aims were to identify the available guidance in this diverse literature, briefly summarize each document, and distill the common elements of these documents for each study type. In general, we found considerable guidance for in vivo and human studies, but only one paper addressed in vitro studies exclusively. The guidance for (Q)SAR studies and physico-chemical studies was scant but authoritative. There was substantial overlap across guidance documents in the proposed criteria for both methodological and reporting quality. Some guidance documents address toxicology research directly, whereas others address preclinical research generally or clinical research and therefore may not be fully applicable to the toxicology context without some translation. Another challenge is the degree to which assessments of methodological quality in toxicology should focus on risk of bias - as in clinical medicine and healthcare - or be broadened to include other quality measures, such as confirming the identity of test substances prior to exposure. Our review is intended primarily for those in toxicology and risk assessment seeking an entry point into the extensive and diverse literature on methodological and reporting quality applicable to their work. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

The methodological quality of systematic reviews of animal studies in dentistry.

PubMed

Faggion, C M; Listl, S; Giannakopoulos, N N

2012-05-01

Systematic reviews and meta-analyses of animal studies are important for improving estimates of the effects of treatment and for guiding future clinical studies on humans. The purpose of this systematic review was to assess the methodological quality of systematic reviews and meta-analyses of animal studies in dentistry through using a validated checklist. A literature search was conducted independently and in duplicate in the PubMed and LILACS databases. References in selected systematic reviews were assessed to identify other studies not captured by the electronic searches. The methodological quality of studies was assessed independently and in duplicate by using the AMSTAR checklist; the quality was scored as low, moderate, or high. The reviewers were calibrated before the assessment and agreement between them was assessed using Cohen's Kappa statistic. Of 444 studies retrieved, 54 systematic reviews were selected after full-text assessment. Agreement between the reviewers was regarded as excellent. Only two studies were scored as high quality; 17 and 35 studies were scored as medium and low quality, respectively. There is room for improvement of the methodological quality of systematic reviews of animal studies in dentistry. Checklists, such as AMSTAR, can guide researchers in planning and executing systematic reviews and meta-analyses. For determining the need for additional investigations in animals and in order to provide good data for potential application in human, such reviews should be based on animal experiments performed according to sound methodological principles. Copyright © 2011 Elsevier Ltd. All rights reserved.

DPP-4 inhibitors for the treatment of type 2 diabetes: a methodology overview of systematic reviews.

PubMed

Ling, Juan; Ge, Long; Zhang, Ding-Hua; Wang, Yong-Feng; Xie, Zhuo-Lin; Tian, Jin-Hui; Xiao, Xiao-Hui; Yang, Ke-Hu

2018-06-01

To evaluate the methodological quality of systematic reviews (SRs), and summarize evidence of important outcomes from dipeptidyl peptidase-4 inhibitors (DPP4-I) in treating type 2 diabetes mellitus (T2DM). We included SRs of DPP4-I for the treatment of T2DM until January, 2018 by searching the Cochrane Library, PubMed, EMBASE and three Chinese databases. We evaluated the methodological qualities with the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool and the GRADE (The Grading of Recommendations Assessment, Development and Evaluation) approach. Sixty-three SRs (a total of 2,603,140 participants) receiving DPP4-I for the treatment of T2DM were included. The results of AMSTAR showed that the lowest quality was "a list of studies (included and excluded) item" with only one (1.6%) study provided, followed by the "providing a priori design" item with only four (6.3%) studies conforming to this item, the next were "the status of publication (gray literature) used as an inclusion criterion item", with only 18 (28.9%) studies conforming to these items. Only seven (11.1%) studies scored more than nine points in AMSTAR, indicating high methodological quality. For GRADE, of the 128 outcomes, high quality evidence was provided in only 28 (21.9%), moderate in 70 (54.7%), low in 27 (21.1%), and very low in three (2.3%). The methodological quality of SRs of DPP4-I for type 2 diabetes mellitus is not high and there are common areas for improvement. Furthermore, the quality of evidence level is moderate and more high quality evidence is needed.

Quality of systematic reviews in pediatric oncology--a systematic review.

PubMed

Lundh, Andreas; Knijnenburg, Sebastiaan L; Jørgensen, Anders W; van Dalen, Elvira C; Kremer, Leontien C M

2009-12-01

To ensure evidence-based decision making in pediatric oncology systematic reviews are necessary. The objective of our study was to evaluate the methodological quality of all currently existing systematic reviews in pediatric oncology. We identified eligible systematic reviews through a systematic search of the literature. Data on clinical and methodological characteristics of the included systematic reviews were extracted. The methodological quality of the included systematic reviews was assessed using the overview quality assessment questionnaire, a validated 10-item quality assessment tool. We compared the methodological quality of systematic reviews published in regular journals with that of Cochrane systematic reviews. We included 117 systematic reviews, 99 systematic reviews published in regular journals and 18 Cochrane systematic reviews. The average methodological quality of systematic reviews was low for all ten items, but the quality of Cochrane systematic reviews was significantly higher than systematic reviews published in regular journals. On a 1-7 scale, the median overall quality score for all systematic reviews was 2 (range 1-7), with a score of 1 (range 1-7) for systematic reviews in regular journals compared to 6 (range 3-7) in Cochrane systematic reviews (p<0.001). Most systematic reviews in the field of pediatric oncology seem to have serious methodological flaws leading to a high risk of bias. While Cochrane systematic reviews were of higher methodological quality than systematic reviews in regular journals, some of them also had methodological problems. Therefore, the methodology of each individual systematic review should be scrutinized before accepting its results.

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles on Elbow Medial Ulnar Collateral Ligament Surgery

PubMed Central

Jack, Robert A.; Sochacki, Kyle R.; Morehouse, Hannah A.; McCulloch, Patrick C.; Lintner, David M.; Harris, Joshua D.

2018-01-01

Background: Several studies have analyzed the most cited articles in shoulder, elbow, pediatrics, and foot and ankle surgery. However, no study has analyzed the quality of the most cited articles in elbow medial ulnar collateral ligament (UCL) surgery. Purpose: To (1) identify the top 50 most cited articles related to UCL surgery, (2) determine whether there was a correlation between the top cited articles and level of evidence, and (3) determine whether there was a correlation between study methodological quality and the top cited articles. Study Design: Systematic review. Methods: Web of Science and Scopus online databases were searched to identify the top 50 cited articles in UCL surgery. Level of evidence, number of times cited, year of publication, name of journal, country of origin, and study type were recorded for each study. Study methodological quality was analyzed for each article with the Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS). Correlation coefficients were calculated. Results: The 50 most cited articles were published between 1981 and 2015. The number of citations per article ranged from 20 to 301 (mean ± SD, 71 ± 62 citations). Most articles (92%) were from the United States and were level 3 (16%), level 4 (58%), or unclassified (16%) evidence. There were no articles of level 1 evidence quality. The mean MCMS and MINORS scores were 28.1 ± 13.4 (range, 3-52) and 9.2 ± 3.6 (range, 2-19), respectively. There was no significant correlation between the mean number of citations and level of evidence or quality (rs = –0.01, P = .917), MCMS (rs = 0.09, P = .571), or MINORS (rs = –0.26, P = .089). Conclusion: The top 50 cited articles in UCL surgery constitute a low level of evidence and low methodological quality, including no level 1 articles. There was no significant correlation between the mean number of citations and level of evidence or study methodological quality. However, weak correlations were observed for later publication date and improved level of evidence and methodological quality. PMID:29780841

A Methodological Analysis of Randomized Clinical Trials of Computer-Assisted Therapies for Psychiatric Disorders: Toward Improved Standards for an Emerging Field

PubMed Central

Kiluk, Brian D.; Sugarman, Dawn E.; Nich, Charla; Gibbons, Carly J.; Martino, Steve; Rounsaville, Bruce J.; Carroll, Kathleen M.

2013-01-01

Objective Computer-assisted therapies offer a novel, cost-effective strategy for providing evidence-based therapies to a broad range of individuals with psychiatric disorders. However, the extent to which the growing body of randomized trials evaluating computer-assisted therapies meets current standards of methodological rigor for evidence-based interventions is not clear. Method A methodological analysis of randomized clinical trials of computer-assisted therapies for adult psychiatric disorders, published between January 1990 and January 2010, was conducted. Seventy-five studies that examined computer-assisted therapies for a range of axis I disorders were evaluated using a 14-item methodological quality index. Results Results indicated marked heterogeneity in study quality. No study met all 14 basic quality standards, and three met 13 criteria. Consistent weaknesses were noted in evaluation of treatment exposure and adherence, rates of follow-up assessment, and conformity to intention-to-treat principles. Studies utilizing weaker comparison conditions (e.g., wait-list controls) had poorer methodological quality scores and were more likely to report effects favoring the computer-assisted condition. Conclusions While several well-conducted studies have indicated promising results for computer-assisted therapies, this emerging field has not yet achieved a level of methodological quality equivalent to those required for other evidence-based behavioral therapies or pharmacotherapies. Adoption of more consistent standards for methodological quality in this field, with greater attention to potential adverse events, is needed before computer-assisted therapies are widely disseminated or marketed as evidence based. PMID:21536689

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles on Elbow Medial Ulnar Collateral Ligament Surgery.

PubMed

Jack, Robert A; Sochacki, Kyle R; Morehouse, Hannah A; McCulloch, Patrick C; Lintner, David M; Harris, Joshua D

2018-04-01

Several studies have analyzed the most cited articles in shoulder, elbow, pediatrics, and foot and ankle surgery. However, no study has analyzed the quality of the most cited articles in elbow medial ulnar collateral ligament (UCL) surgery. To (1) identify the top 50 most cited articles related to UCL surgery, (2) determine whether there was a correlation between the top cited articles and level of evidence, and (3) determine whether there was a correlation between study methodological quality and the top cited articles. Systematic review. Web of Science and Scopus online databases were searched to identify the top 50 cited articles in UCL surgery. Level of evidence, number of times cited, year of publication, name of journal, country of origin, and study type were recorded for each study. Study methodological quality was analyzed for each article with the Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS). Correlation coefficients were calculated. The 50 most cited articles were published between 1981 and 2015. The number of citations per article ranged from 20 to 301 (mean ± SD, 71 ± 62 citations). Most articles (92%) were from the United States and were level 3 (16%), level 4 (58%), or unclassified (16%) evidence. There were no articles of level 1 evidence quality. The mean MCMS and MINORS scores were 28.1 ± 13.4 (range, 3-52) and 9.2 ± 3.6 (range, 2-19), respectively. There was no significant correlation between the mean number of citations and level of evidence or quality ( r s = -0.01, P = .917), MCMS ( r s = 0.09, P = .571), or MINORS ( r s = -0.26, P = .089). The top 50 cited articles in UCL surgery constitute a low level of evidence and low methodological quality, including no level 1 articles. There was no significant correlation between the mean number of citations and level of evidence or study methodological quality. However, weak correlations were observed for later publication date and improved level of evidence and methodological quality.

Methodological quality of systematic reviews in subfertility: a comparison of Cochrane and non-Cochrane systematic reviews in assisted reproductive technologies.

PubMed

Windsor, B; Popovich, I; Jordan, V; Showell, M; Shea, B; Farquhar, C

2012-12-01

Are there differences in the methodological quality of Cochrane systematic reviews (CRs) and non-Cochrane systematic reviews (NCRs) of assisted reproductive technologies? CRs on assisted reproduction are of higher methodological quality than similar reviews published in other journals. The quality of systematic reviews varies. This was a cross-sectional study of 30 CR and 30 NCR systematic reviews that were randomly selected from the eligible reviews identified from a literature search for the years 2007-2011. We extracted data on the reporting and methodological characteristics of the included systematic reviews. We assessed the methodological quality of the reviews using the 11-domain Measurement Tool to Assess the Methodological Quality of Systematic Reviews (AMSTAR) tool and subsequently compared CR and NCR systematic reviews. The AMSTAR quality assessment found that CRs were superior to NCRs. For 10 of 11 AMSTAR domains, the requirements were met in >50% of CRs, but only 4 of 11 domains showed requirements being met in >50% of NCRs. The strengths of CRs are the a priori study design, comprehensive literature search, explicit lists of included and excluded studies and assessments of internal validity. Significant failings in the CRs were found in duplicate study selection and data extraction (67% meeting requirements), assessment for publication bias (53% meeting requirements) and reporting of conflicts of interest (47% meeting requirements). NCRs were more likely to contain methodological weaknesses as the majority of the domains showed <40% of reviews meeting requirements, e.g. a priori study design (17%), duplicate study selection and data extraction (17%), assessment of study quality (27%), study quality in the formulation of conclusions (23%) and reporting of conflict of interests (10%). The AMSTAR assessment can only judge what is reported by authors. Although two of the five authors are involved in the production of CRs, the risk of bias was reduced by not involving these authors in the assessment of the systematic review quality. Not all systematic reviews are equal. The reader needs to consider the quality of the systematic review when they consider the results and the conclusions of a systematic review. There are no conflicts with any commercial organization. Funding was provided for the students by the summer studentship programme of the Faculty of Medical and Health Sciences of the University of Auckland.

Sugar-Sweetened Beverages and Obesity Risk in Children and Adolescents: A Systematic Analysis on How Methodological Quality May Influence Conclusions.

PubMed

Bucher Della Torre, Sophie; Keller, Amélie; Laure Depeyre, Jocelyne; Kruseman, Maaike

2016-04-01

In the context of a worldwide high prevalence of childhood obesity, the role of sugar-sweetened beverage (SSB) consumption as a cause of excess weight gain remains controversial. Conflicting results may be due to methodological issues in original studies and in reviews. The aim of this review was to systematically analyze the methodology of studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents, and the studies' ability to answer this research question. A systematic review of cohort and experimental studies published until December 2013 in peer-reviewed journals was performed on Medline, CINAHL, Web of Knowledge, and ClinicalTrials.gov. Studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents were included, and methodological quality to answer this question was assessed independently by two investigators using the Academy of Nutrition and Dietetics Quality Criteria Checklist. Among the 32 identified studies, nine had positive quality ratings and 23 studies had at least one major methodological issue. Main methodological issues included SSB definition and inadequate measurement of exposure. Studies with positive quality ratings found an association between SSB consumption and risk of obesity or obesity (n=5) (ie, when SSB consumption increased so did obesity) or mixed results (n=4). Studies with a neutral quality rating found a positive association (n=7), mixed results (n=9), or no association (n=7). The present review shows that the majority of studies with strong methodology indicated a positive association between SSB consumption and risk of obesity or obesity, especially among overweight children. In addition, study findings highlight the need for the careful and precise measurement of the consumption of SSBs and of important confounders. Copyright © 2016 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

"Assessing the methodological quality of systematic reviews in radiation oncology: A systematic review".

PubMed

Hasan, Haroon; Muhammed, Taaha; Yu, Jennifer; Taguchi, Kelsi; Samargandi, Osama A; Howard, A Fuchsia; Lo, Andrea C; Olson, Robert; Goddard, Karen

2017-10-01

The objective of our study was to evaluate the methodological quality of systematic reviews and meta-analyses in Radiation Oncology. A systematic literature search was conducted for all eligible systematic reviews and meta-analyses in Radiation Oncology from 1966 to 2015. Methodological characteristics were abstracted from all works that satisfied the inclusion criteria and quality was assessed using the critical appraisal tool, AMSTAR. Regression analyses were performed to determine factors associated with a higher score of quality. Following exclusion based on a priori criteria, 410 studies (157 systematic reviews and 253 meta-analyses) satisfied the inclusion criteria. Meta-analyses were found to be of fair to good quality while systematic reviews were found to be of less than fair quality. Factors associated with higher scores of quality in the multivariable analysis were including primary studies consisting of randomized control trials, performing a meta-analysis, and applying a recommended guideline related to establishing a systematic review protocol and/or reporting. Systematic reviews and meta-analyses may introduce a high risk of bias if applied to inform decision-making based on AMSTAR. We recommend that decision-makers in Radiation Oncology scrutinize the methodological quality of systematic reviews and meta-analyses prior to assessing their utility to inform evidence-based medicine and researchers adhere to methodological standards outlined in validated guidelines when embarking on a systematic review. Copyright © 2017 Elsevier Ltd. All rights reserved.

Methodological quality of randomized trials published in the Journal of the American Podiatric Medical Association, 1999-2013.

PubMed

Landorf, Karl B; Menz, Hylton B; Armstrong, David G; Herbert, Robert D

2015-07-01

Randomized trials must be of high methodological quality to yield credible, actionable findings. The main aim of this project was to evaluate whether there has been an improvement in the methodological quality of randomized trials published in the Journal of the American Podiatric Medical Association (JAPMA). Randomized trials published in JAPMA during a 15-year period (January 1999 to December 2013) were evaluated. The methodological quality of randomized trials was evaluated using the PEDro scale (scores range from 0 to 10, with 0 being lowest quality). Linear regression was used to assess changes in methodological quality over time. A total of 1,143 articles were published in JAPMA between January 1999 and December 2013. Of these, 44 articles were reports of randomized trials. Although the number of randomized trials published each year increased, there was only minimal improvement in their methodological quality (mean rate of improvement = 0.01 points per year). The methodological quality of the trials studied was typically moderate, with a mean ± SD PEDro score of 5.1 ± 1.5. Although there were a few high-quality randomized trials published in the journal, most (84.1%) scored between 3 and 6. Although there has been an increase in the number of randomized trials published in JAPMA, there is substantial opportunity for improvement in the methodological quality of trials published in the journal. Researchers seeking to publish reports of randomized trials should seek to meet current best-practice standards in the conduct and reporting of their trials.

Methodological quality assessment of paper-based systematic reviews published in oral health.

PubMed

Wasiak, J; Shen, A Y; Tan, H B; Mahar, R; Kan, G; Khoo, W R; Faggion, C M

2016-04-01

This study aimed to conduct a methodological assessment of paper-based systematic reviews (SR) published in oral health using a validated checklist. A secondary objective was to explore temporal trends on methodological quality. Two electronic databases (OVID Medline and OVID EMBASE) were searched for paper-based SR of interventions published in oral health from inception to October 2014. Manual searches of the reference lists of paper-based SR were also conducted. Methodological quality of included paper-based SR was assessed using an 11-item questionnaire, Assessment of Multiple Systematic Reviews (AMSTAR) checklist. Methodological quality was summarized using the median and inter-quartile range (IQR) of the AMSTAR score over different categories and time periods. A total of 643 paper-based SR were included. The overall median AMSTAR score was 4 (IQR 2-6). The highest median score (5) was found in the pain dentistry and periodontology fields, while the lowest median score (3) was found in implant dentistry, restorative dentistry, oral medicine, and prosthodontics. The number of paper-based SR per year and the median AMSTAR score increased over time (median score in 1990s was 2 (IQR 2-3), 2000s was 4 (IQR 2-5), and 2010 onwards was 5 (IQR 3-6)). Although the methodological quality of paper-based SR published in oral health has improved in the last few years, there is still scope for improving quality in most evaluated dental specialties. Large-scale assessment of methodological quality of dental SR highlights areas of methodological strengths and weaknesses that can be targeted in future publications to encourage better quality review methodology.

Systematic review adherence to methodological or reporting quality.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-07-19

Guidelines for assessing methodological and reporting quality of systematic reviews (SRs) were developed to contribute to implementing evidence-based health care and the reduction of research waste. As SRs assessing a cohort of SRs is becoming more prevalent in the literature and with the increased uptake of SR evidence for decision-making, methodological quality and standard of reporting of SRs is of interest. The objective of this study is to evaluate SR adherence to the Quality of Reporting of Meta-analyses (QUOROM) and PRISMA reporting guidelines and the A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Overview Quality Assessment Questionnaire (OQAQ) quality assessment tools as evaluated in methodological overviews. The Cochrane Library, MEDLINE®, and EMBASE® databases were searched from January 1990 to October 2014. Title and abstract screening and full-text screening were conducted independently by two reviewers. Reports assessing the quality or reporting of a cohort of SRs of interventions using PRISMA, QUOROM, OQAQ, or AMSTAR were included. All results are reported as frequencies and percentages of reports and SRs respectively. Of the 20,765 independent records retrieved from electronic searching, 1189 reports were reviewed for eligibility at full text, of which 56 reports (5371 SRs in total) evaluating the PRISMA, QUOROM, AMSTAR, and/or OQAQ tools were included. Notable items include the following: of the SRs using PRISMA, over 85% (1532/1741) provided a rationale for the review and less than 6% (102/1741) provided protocol information. For reports using QUOROM, only 9% (40/449) of SRs provided a trial flow diagram. However, 90% (402/449) described the explicit clinical problem and review rationale in the introduction section. Of reports using AMSTAR, 30% (534/1794) used duplicate study selection and data extraction. Conversely, 80% (1439/1794) of SRs provided study characteristics of included studies. In terms of OQAQ, 37% (499/1367) of the SRs assessed risk of bias (validity) in the included studies, while 80% (1112/1387) reported the criteria for study selection. Although reporting guidelines and quality assessment tools exist, reporting and methodological quality of SRs are inconsistent. Mechanisms to improve adherence to established reporting guidelines and methodological assessment tools are needed to improve the quality of SRs.

Relationships between abstract features and methodological quality explained variations of social media activity derived from systematic reviews about psoriasis interventions.

PubMed

Ruano, J; Aguilar-Luque, M; Isla-Tejera, B; Alcalde-Mellado, P; Gay-Mimbrera, J; Hernandez-Romero, José Luis; Sanz-Cabanillas, J L; Maestre-López, B; González-Padilla, M; Carmona-Fernández, P J; Gómez-García, F; García-Nieto, A Vélez

2018-05-24

The aim of this study was to describe the relationship among abstract structure, readability, and completeness, and how these features may influence social media activity and bibliometric results, considering systematic reviews (SRs) about interventions in psoriasis classified by methodological quality. Systematic literature searches about psoriasis interventions were undertaken on relevant databases. For each review, methodological quality was evaluated using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Abstract extension, structure, readability, and quality and completeness of reporting were analyzed. Social media activity, which consider Twitter and Facebook mention counts, as well as Mendeley readers and Google scholar citations were obtained for each article. Analyses were conducted to describe any potential influence of abstract characteristics on review's social media diffusion. We classified 139 intervention SRs as displaying high/moderate/low methodological quality. We observed that abstract readability of SRs has been maintained high for last 20 years, although there are some differences based on their methodological quality. Free-format abstracts were most sensitive to the increase of text readability as compared with more structured abstracts (IMRAD or 8-headings), yielding opposite effects on their quality and completeness depending on the methodological quality: a worsening in low quality reviews and an improvement in those of high-quality. Both readability indices and PRISMA for Abstract total scores showed an inverse relationship with social media activity and bibliometric results in high methodological quality reviews but not in those of lower quality. Our results suggest that increasing abstract readability must be specially considered when writing free-format summaries of high-quality reviews, because this fact correlates with an improvement of their completeness and quality, and this may help to achieve broader social media visibility and article usage. Copyright © 2018 Elsevier Inc. All rights reserved.

Methodological Validation of Quality of Life Questionnaire for Coal Mining Groups-Indian Scenario

ERIC Educational Resources Information Center

Sen, Sayanti; Sen, Goutam; Tewary, B. K.

2012-01-01

Maslow's hierarchy-of-needs theory has been used to predict development of Quality of Life (QOL) in countries over time. In this paper an attempt has been taken to derive a methodological validation of quality of life questionnaire which have been prepared for the study area. The objective of the study is to standardize a questionnaire tool to…

Improving the Quality of Experience Journals: Training Educational Psychology Students in Basic Qualitative Methodology

ERIC Educational Resources Information Center

Reynolds-Keefer, Laura

2010-01-01

This study evaluates the impact of teaching basic qualitative methodology to preservice teachers enrolled in an educational psychology course in the quality of observation journals. Preservice teachers enrolled in an educational psychology course requiring 45 hr of field experience were given qualitative methodological training as a part of the…

Quality and methodological challenges in Internet-based mental health trials.

PubMed

Ye, Xibiao; Bapuji, Sunita Bayyavarapu; Winters, Shannon; Metge, Colleen; Raynard, Mellissa

2014-08-01

To review the quality of Internet-based mental health intervention studies and their methodological challenges. We searched multiple literature databases to identify relevant studies according to the Population, Interventions, Comparators, Outcomes, and Study Design framework. Two reviewers independently assessed selection bias, allocation bias, confounding bias, blinding, data collection methods, and withdrawals/dropouts, using the Quality Assessment Tool for Quantitative Studies. We rated each component as strong, moderate, or weak and assigned a global rating (strong, moderate, or weak) to each study. We discussed methodological issues related to the study quality. Of 122 studies included, 31 (25%), 44 (36%), and 47 (39%) were rated strong, moderate, and weak, respectively. Only five studies were rated strong for all of the six quality components (three of them were published by the same group). Lack of blinding, selection bias, and low adherence were the top three challenges in Internet-based mental health intervention studies. The overall quality of Internet-based mental health intervention needs to improve. In particular, studies need to improve sample selection, intervention allocation, and blinding.

Methodological quality of behavioural weight loss studies: a systematic review

PubMed Central

Lemon, S. C.; Wang, M. L.; Haughton, C. F.; Estabrook, D. P.; Frisard, C. F.; Pagoto, S. L.

2018-01-01

Summary This systematic review assessed the methodological quality of behavioural weight loss intervention studies conducted among adults and associations between quality and statistically significant weight loss outcome, strength of intervention effectiveness and sample size. Searches for trials published between January, 2009 and December, 2014 were conducted using PUBMED, MEDLINE and PSYCINFO and identified ninety studies. Methodological quality indicators included study design, anthropometric measurement approach, sample size calculations, intent-to-treat (ITT) analysis, loss to follow-up rate, missing data strategy, sampling strategy, report of treatment receipt and report of intervention fidelity (mean = 6.3). Indicators most commonly utilized included randomized design (100%), objectively measured anthropometrics (96.7%), ITT analysis (86.7%) and reporting treatment adherence (76.7%). Most studies (62.2%) had a follow-up rate >75% and reported a loss to follow-up analytic strategy or minimal missing data (69.9%). Describing intervention fidelity (34.4%) and sampling from a known population (41.1%) were least common. Methodological quality was not associated with reporting a statistically significant result, effect size or sample size. This review found the published literature of behavioural weight loss trials to be of high quality for specific indicators, including study design and measurement. Identified for improvement include utilization of more rigorous statistical approaches to loss to follow up and better fidelity reporting. PMID:27071775

Clinical trials in palliative care: a systematic review of their methodological characteristics and of the quality of their reporting.

PubMed

Bouça-Machado, Raquel; Rosário, Madalena; Alarcão, Joana; Correia-Guedes, Leonor; Abreu, Daisy; Ferreira, Joaquim J

2017-01-25

Over the past decades there has been a significant increase in the number of published clinical trials in palliative care. However, empirical evidence suggests that there are methodological problems in the design and conduct of studies, which raises questions about the validity and generalisability of the results and of the strength of the available evidence. We sought to evaluate the methodological characteristics and assess the quality of reporting of clinical trials in palliative care. We performed a systematic review of published clinical trials assessing therapeutic interventions in palliative care. Trials were identified using MEDLINE (from its inception to February 2015). We assessed methodological characteristics and describe the quality of reporting using the Cochrane Risk of Bias tool. We retrieved 107 studies. The most common medical field studied was oncology, and 43.9% of trials evaluated pharmacological interventions. Symptom control and physical dimensions (e.g. intervention on pain, breathlessness, nausea) were the palliative care-specific issues most studied. We found under-reporting of key information in particular on random sequence generation, allocation concealment, and blinding. While the number of clinical trials in palliative care has increased over time, methodological quality remains suboptimal. This compromises the quality of studies. Therefore, a greater effort is needed to enable the appropriate performance of future studies and increase the robustness of evidence-based medicine in this important field.

Measurement properties of rheumatoid arthritis-specific quality-of-life questionnaires: systematic review of the literature.

PubMed

Lee, Jiyeon; Kim, Soo Hyun; Moon, Seung Hei; Lee, Eun-Hyun

2014-12-01

This study conducted a systematic review of the methodological quality of the psychometric evaluation process and the quality of measurement properties of rheumatoid arthritis (RA)-specific health-related quality-of-life (HRQOL) questionnaires with the purpose of obtaining the best evidence to help in the selection of the most appropriate instrument for measuring HRQOL in RA patients. A systematic literature search was performed to identify RA-specific HRQOL questionnaires in databases. The methodological quality of the studies was assessed using the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. The quality of the measurement properties was assessed using quality criteria. The evidence regarding the measurement properties was pooled using best-evidence synthesis, with considerations of the number and methodological quality of the studies, and the consistency of their findings in terms of the quality of the measurement properties. The search identified 37 studies describing 9 instruments. Best-evidence synthesis suggested that the Rheumatoid Arthritis Quality of Life (RAQoL) questionnaire had the strongest positive evidence, especially with respect to reliability, measurement error, and content validity, and moderate positive evidence with respect to hypothesis testing and responsiveness. The current evidence suggests that the best-validated instrument among the RA-specific HRQOL measures is the RAQoL questionnaire in terms of both methodological quality in the process of psychometric evaluation and the quality of the measurement properties. However, there is limited evidence regarding internal consistency and structural validity of the RAQoL. Further efforts are warranted to establish the psychometric quality of this questionnaire.

The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature.

PubMed

Pölkki, Tarja; Kanste, Outi; Kääriäinen, Maria; Elo, Satu; Kyngäs, Helvi

2014-02-01

To analyse systematic review articles published in the top 10 nursing journals to determine the quality of the methods employed within them. Systematic review is defined as a scientific research method that synthesises high-quality scientific knowledge on a given topic. The number of such reviews in nursing science has increased dramatically during recent years, but their methodological quality has not previously been assessed. A review of the literature using a narrative approach. Ranked impact factor scores for nursing journals were obtained from the Journal Citation Report database of the Institute of Scientific Information (ISI Web of Knowledge). All issues from the years 2009 and 2010 of the top 10 ranked journals were included. CINAHL and MEDLINE databases were searched to locate studies using the search terms 'systematic review' and 'systematic literature review'. A total of 39 eligible studies were identified. Their methodological quality was evaluated through the specific criteria of quality assessment, description of synthesis and strengths and weaknesses reported in the included studies. Most of the eligible systematic reviews included several different designs or types of quantitative study. The majority included a quality assessment, and a total of 17 different criteria were identified. The method of synthesis was mentioned in about half of the reviews, the most common being narrative synthesis. The weaknesses of reviews were discussed, while strengths were rarely highlighted. The methodological quality of the systematic reviews examined varied considerably, although they were all published in nursing journals with a high-impact factor. Despite the fact that systematic reviews are considered the most robust source of research evidence, they vary in methodological quality. This point is important to consider in clinical practice when applying the results to patient care. © 2013 Blackwell Publishing Ltd.

Poor methodological quality and reporting standards of systematic reviews in burn care management.

PubMed

Wasiak, Jason; Tyack, Zephanie; Ware, Robert; Goodwin, Nicholas; Faggion, Clovis M

2017-10-01

The methodological and reporting quality of burn-specific systematic reviews has not been established. The aim of this study was to evaluate the methodological quality of systematic reviews in burn care management. Computerised searches were performed in Ovid MEDLINE, Ovid EMBASE and The Cochrane Library through to February 2016 for systematic reviews relevant to burn care using medical subject and free-text terms such as 'burn', 'systematic review' or 'meta-analysis'. Additional studies were identified by hand-searching five discipline-specific journals. Two authors independently screened papers, extracted and evaluated methodological quality using the 11-item A Measurement Tool to Assess Systematic Reviews (AMSTAR) tool and reporting quality using the 27-item Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist. Characteristics of systematic reviews associated with methodological and reporting quality were identified. Descriptive statistics and linear regression identified features associated with improved methodological quality. A total of 60 systematic reviews met the inclusion criteria. Six of the 11 AMSTAR items reporting on 'a priori' design, duplicate study selection, grey literature, included/excluded studies, publication bias and conflict of interest were reported in less than 50% of the systematic reviews. Of the 27 items listed for PRISMA, 13 items reporting on introduction, methods, results and the discussion were addressed in less than 50% of systematic reviews. Multivariable analyses showed that systematic reviews associated with higher methodological or reporting quality incorporated a meta-analysis (AMSTAR regression coefficient 2.1; 95% CI: 1.1, 3.1; PRISMA regression coefficient 6·3; 95% CI: 3·8, 8·7) were published in the Cochrane library (AMSTAR regression coefficient 2·9; 95% CI: 1·6, 4·2; PRISMA regression coefficient 6·1; 95% CI: 3·1, 9·2) and included a randomised control trial (AMSTAR regression coefficient 1·4; 95%CI: 0·4, 2·4; PRISMA regression coefficient 3·4; 95% CI: 0·9, 5·8). The methodological and reporting quality of systematic reviews in burn care requires further improvement with stricter adherence by authors to the PRISMA checklist and AMSTAR tool. © 2016 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

Instruments to assess patients with rotator cuff pathology: a systematic review of measurement properties.

PubMed

Longo, Umile Giuseppe; Saris, Daniël; Poolman, Rudolf W; Berton, Alessandra; Denaro, Vincenzo

2012-10-01

The aims of this study were to obtain an overview of the methodological quality of studies on the measurement properties of rotator cuff questionnaires and to describe how well various aspects of the design and statistical analyses of studies on measurement properties are performed. A systematic review of published studies on the measurement properties of rotator cuff questionnaires was performed. Two investigators independently rated the quality of the studies using the Consensus-based Standards for the selection of health Measurement Instruments checklist. This checklist was developed in an international Delphi consensus study. Sixteen studies were included, in which two measurement instruments were evaluated, namely the Western Ontario Rotator Cuff Index and the Rotator Cuff Quality-of-Life Measure. The methodological quality of the included studies was adequate on some properties (construct validity, reliability, responsiveness, internal consistency, and translation) but need to be improved on other aspects. The most important methodological aspects that need to be developed are as follows: measurement error, content validity, structural validity, cross-cultural validity, criterion validity, and interpretability. Considering the importance of adequate measurement properties, it is concluded that, in the field of rotator cuff pathology, there is room for improvement in the methodological quality of studies measurement properties. II.

Cognitive remediation in schizophrenia: A methodological appraisal of systematic reviews and meta-analyses.

PubMed

Bryce, Shayden; Sloan, Elise; Lee, Stuart; Ponsford, Jennie; Rossell, Susan

2016-04-01

Systematic reviews and meta-analyses are a primary source of evidence when evaluating the benefit(s) of cognitive remediation (CR) in schizophrenia. These studies are designed to rigorously synthesize scientific literature; however, cannot be assumed to be of high methodological quality. The aims of this report were to: 1) review the use of systematic reviews and meta-analyses regarding CR in schizophrenia; 2) conduct a systematic methodological appraisal of published reports examining the benefits of this intervention on core outcome domains; and 3) compare the correspondence between methodological and reporting quality. Electronic databases were searched for relevant articles. Twenty-one reviews met inclusion criteria and were scored according to the AMSTAR checklist-a validated scale of methodological quality. Five meta-analyses were also scored according to PRISMA statement to compare 'quality of conduct' with 'quality of reporting'. Most systematic reviews and meta-analyses shared strengths and fell within a 'medium' level of methodological quality. Nevertheless, there were consistent areas of potential weakness that were not addressed by most reviews. These included the lack of protocol registration, uncertainty regarding independent data extraction and consensus procedures, and the minimal assessment of publication bias. Moreover, quality of conduct may not necessarily parallel quality of reporting, suggesting that consideration of these methods independently may be important. Reviews concerning CR for schizophrenia are a valuable source of evidence. However, the methodological quality of these reports may require additional consideration. Enhancing quality of conduct is essential for enabling research literature to be interpreted with confidence. Copyright © 2016 Elsevier Ltd. All rights reserved.

The methodological quality of nurse-sensitive indicators in Dutch hospitals: A descriptive exploratory research study.

PubMed

Kieft, R A M M; Stalpers, D; Jansen, A P M; Francke, A L; Delnoij, D M J

2018-06-01

Nurse-sensitive indicators (NSIs) are increasingly being developed and used to establish quality of nursing care in Western countries. The objective was to gain insights into the methodological quality of mandatory NSIs in Dutch hospitals, including indicators for pain, wound care, malnutrition and delirium. A descriptive exploratory design was used, starting with desk research into publicly available documents and reports describing the development of the NSIs included in this study. We used the validated Appraisal of Indicators through Research and Evaluation (AIRE) instrument to evaluate the methodological quality. Although the purpose and relevance of each individual NSI have been described, no detailed information about the criteria for selecting these topics is available. It is not clear which specific stakeholders participated and how their input was used. We found no information about the process of collecting and compiling scientific evidence. It is unclear whether and to what extent the usability of NSIs has been tested. The methodological quality of NSIs used in Dutch hospitals is less than optimal in various ways and it is therefore questionable if the indicators are accurate enough to identify changes or improve nursing practice. Our study also provides an example of how the methodological quality of NSIs can be assessed systematically, which is relevant considering the increasing use of NSIs in various countries. Copyright © 2018 Elsevier B.V. All rights reserved.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed

Lexchin, J; Holbrook, A

1994-07-01

To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). Analytic study. All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed Central

Lexchin, J; Holbrook, A

1994-01-01

OBJECTIVE: To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). DESIGN: Analytic study. DATA SOURCE: All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. MAIN OUTCOME MEASURES: Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. MAIN RESULTS: Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. CONCLUSIONS: Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion. PMID:8004560

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

E-therapy for mental health problems: a systematic review.

PubMed

Postel, Marloes G; de Haan, Hein A; De Jong, Cor A J

2008-09-01

The widespread availability of the Internet offers opportunities for improving access to therapy for people with mental health problems. There is a seemingly infinite supply of Internet-based interventions available on the World Wide Web. The aim of the present study is to systematically assess the methodological quality of randomized controlled trials (RCTs) concerning e-therapy for mental health problems. Two reviewers independently assessed the methodological quality of the RCTs, based on a list of criteria for the methodological quality assessment as recommended by the Cochrane Back Review Group. The search yielded 14 papers that reported RCTs concerning e-therapy for mental-health problems. The methodological quality of studies included in this review was generally low. It is concluded that e-therapy may turn out to be an appropriate therapeutic entity, but the evidence needs to be more convincing. Recommendations are made concerning the method of reporting RCTs and the need to add some content items to an e-therapy study.

Methodological quality of randomized controlled trials of spinal manipulation and mobilization in tension-type headache, migraine, and cervicogenic headache.

PubMed

Fernández-de-las-Peñas, César; Alonso-Blanco, Cristina; San-Roman, Jesús; Miangolarra-Page, Juan C

2006-03-01

Literature review of quality of clinical trials. To determine the methodological quality of published randomized controlled trials that used spinal manipulation and/or mobilization to treat patients with tension-type headache (TTH), cervicogenic headache (CeH), and migraine (M) in the last decade. TTH, CeH, and M are the most prevalent types of headaches seen in adults. Individuals who have headaches frequently use physical therapy, manual therapy, or chiropractic care. Randomized controlled trials are considered an optimal method with which to assess the efficacy of any intervention. Computerized literature searches were performed in MEDLINE, EMBASE, COCHRANE, AMED, MANTIS, CINHAL, and PEDro databases. Randomized controlled trials in which spinal manipulation and/or mobilization had been used for TTH, CeH, and M published in a peer-reviewed journal as full text, and with at least 1 clinically relevant outcome measure (ie, headache intensity, duration, or frequency) were reviewed. The methodological quality of the studies was assessed independently by 2 reviewers using a set of predefined criteria. Only 8 studies met all the inclusion criteria. One clinical trial evaluated spinal manipulation and mobilization together, and the remaining 7 assessed spinal manipulative therapy. No controlled trials analyzing exclusively the effects of spinal mobilization were found. Methodological scores ranged from 35 to 56 points out of a theoretical maximum of 100 points, indicating an overall poor methodology of the studies. Only 2 studies obtained a high-quality score (greater than 50 points). No significant differences in quality scores were found based on the type of headache investigated. Methodological quality was not associated with the year of publication (before 2000, or later) nor with the results (positive, neutral, negative) reported in the studies. The most common flaws were a small sample size, the absence of a placebo control group, lack of blinded patients, and no description of the manipulative procedure. There are few published randomized controlled trials analyzing the effectiveness of spinal manipulation and/or mobilization for TTH, CeH, and M in the last decade. In addition, the methodological quality of these papers is typically low. Clearly, there is a need for high-quality randomized controlled trials assessing the effectiveness of these interventions in these headache disorders.

About subjective evaluation of adaptive video streaming

NASA Astrophysics Data System (ADS)

Tavakoli, Samira; Brunnström, Kjell; Garcia, Narciso

2015-03-01

The usage of HTTP Adaptive Streaming (HAS) technology by content providers is increasing rapidly. Having available the video content in multiple qualities, using HAS allows to adapt the quality of downloaded video to the current network conditions providing smooth video-playback. However, the time-varying video quality by itself introduces a new type of impairment. The quality adaptation can be done in different ways. In order to find the best adaptation strategy maximizing users perceptual quality it is necessary to investigate about the subjective perception of adaptation-related impairments. However, the novelties of these impairments and their comparably long time duration make most of the standardized assessment methodologies fall less suited for studying HAS degradation. Furthermore, in traditional testing methodologies, the quality of the video in audiovisual services is often evaluated separated and not in the presence of audio. Nevertheless, the requirement of jointly evaluating the audio and the video within a subjective test is a relatively under-explored research field. In this work, we address the research question of determining the appropriate assessment methodology to evaluate the sequences with time-varying quality due to the adaptation. This was done by studying the influence of different adaptation related parameters through two different subjective experiments using a methodology developed to evaluate long test sequences. In order to study the impact of audio presence on quality assessment by the test subjects, one of the experiments was done in the presence of audio stimuli. The experimental results were subsequently compared with another experiment using the standardized single stimulus Absolute Category Rating (ACR) methodology.

Methods for the guideline-based development of quality indicators--a systematic review

PubMed Central

2012-01-01

Background Quality indicators (QIs) are used in many healthcare settings to measure, compare, and improve quality of care. For the efficient development of high-quality QIs, rigorous, approved, and evidence-based development methods are needed. Clinical practice guidelines are a suitable source to derive QIs from, but no gold standard for guideline-based QI development exists. This review aims to identify, describe, and compare methodological approaches to guideline-based QI development. Methods We systematically searched medical literature databases (Medline, EMBASE, and CINAHL) and grey literature. Two researchers selected publications reporting methodological approaches to guideline-based QI development. In order to describe and compare methodological approaches used in these publications, we extracted detailed information on common steps of guideline-based QI development (topic selection, guideline selection, extraction of recommendations, QI selection, practice test, and implementation) to predesigned extraction tables. Results From 8,697 hits in the database search and several grey literature documents, we selected 48 relevant references. The studies were of heterogeneous type and quality. We found no randomized controlled trial or other studies comparing the ability of different methodological approaches to guideline-based development to generate high-quality QIs. The relevant publications featured a wide variety of methodological approaches to guideline-based QI development, especially regarding guideline selection and extraction of recommendations. Only a few studies reported patient involvement. Conclusions Further research is needed to determine which elements of the methodological approaches identified, described, and compared in this review are best suited to constitute a gold standard for guideline-based QI development. For this research, we provide a comprehensive groundwork. PMID:22436067

Macroergonomic analysis and design for improved safety and quality performance.

PubMed

Kleiner, B M

1999-01-01

Macroergonomics, which emerged historically after sociotechnical systems theory, quality management, and ergonomics, is presented as the basis for a needed integrative methodology. A macroergonomics methodology was presented in some detail to demonstrate how aspects of microergonomics, total quality management (TQM), and sociotechnical systems (STS) can be triangulated in a common approach. In the context of this methodology, quality and safety were presented as 2 of several important performance criteria. To demonstrate aspects of the methodology, 2 case studies were summarized with safety and quality performance results where available. The first case manipulated both personnel and technical factors to achieve a "safety culture" at a nuclear site. The concept of safety culture is defined in INSAG-4 (International Atomic Energy Agency, 1991). as "that assembly of characteristics and attitudes in organizations and individuals which establishes that, as an overriding priority, nuclear plant safety issues receive the attention warranted by their significance." The second case described a tire manufacturing intervention to improve quality (as defined by Sink and Tuttle, 1989) through joint consideration of technical and social factors. It was suggested that macroergonomics can yield greater performance than can be achieved through ergonomic intervention alone. Whereas case studies help to make the case, more rigorous formative and summative research is needed to refine and validate the proposed methodology respectively.

Systematic review and quality assessment of cost-effectiveness analysis of pharmaceutical therapies for advanced colorectal cancer.

PubMed

Leung, Henry W C; Chan, Agnes L F; Leung, Matthew S H; Lu, Chin-Li

2013-04-01

To systematically review and assess the quality of cost-effectiveness analyses (CEAs) of pharmaceutical therapies for metastatic colorectal cancer (mCRC). The MEDLINE, EMBASE, Cochrane, and EconLit databases were searched for the Medical Subject Headings or text key words quality-adjusted, QALY, life-year gained (LYG), and cost-effectiveness (January 1, 1999-December 31, 2009). Original CEAs of mCRC pharmacotherapy published in English were included. CEAs that measured health effects in units other than quality-adjusted life years or LYG and letters to the editor, case reports, posters, and editorials were excluded. Each article was independently assessed by 2 trained reviewers according to a quality checklist created by the Panel on Cost-Effectiveness in Health and Medicine. Twenty-four CEA studies pertaining to pharmaceutical therapies for mCRC were identified. All studies showed a wide variation in methodologic approaches, which resulted in a different range of incremental cost-effectiveness ratios reported for each regimen. We found common methodologic flaws in a significant number of CEA studies, including lack of clear description for critique of data quality; lack of method for adjusting costs for inflation and methods for obtaining expert judgment; no results of model validation; wide differences in the types of perspective, time horizon, study design, cost categories, and effect outcomes; and no quality assessment of data (cost and effectiveness) for the interventions evaluation. This study has shown a wide variation in the methodology and quality of cost-effectiveness analysis for mCRC. Improving quality and harmonization of CEA for cancer treatment is needed. Further study is suggested to assess the quality of CEA methodology outside the mCRC disease state.

Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare.

PubMed

Nicolay, C R; Purkayastha, S; Greenhalgh, A; Benn, J; Chaturvedi, S; Phillips, N; Darzi, A

2012-03-01

The demand for the highest-quality patient care coupled with pressure on funding has led to the increasing use of quality improvement (QI) methodologies from the manufacturing industry. The aim of this systematic review was to identify and evaluate the application and effectiveness of these QI methodologies to the field of surgery. MEDLINE, the Cochrane Database, Allied and Complementary Medicine Database, British Nursing Index, Cumulative Index to Nursing and Allied Health Literature, Embase, Health Business(™) Elite, the Health Management Information Consortium and PsycINFO(®) were searched according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement. Empirical studies were included that implemented a described QI methodology to surgical care and analysed a named outcome statistically. Some 34 of 1595 articles identified met the inclusion criteria after consensus from two independent investigators. Nine studies described continuous quality improvement (CQI), five Six Sigma, five total quality management (TQM), five plan-do-study-act (PDSA) or plan-do-check-act (PDCA) cycles, five statistical process control (SPC) or statistical quality control (SQC), four Lean and one Lean Six Sigma; 20 of the studies were undertaken in the USA. The most common aims were to reduce complications or improve outcomes (11), to reduce infection (7), and to reduce theatre delays (7). There was one randomized controlled trial. QI methodologies from industry can have significant effects on improving surgical care, from reducing infection rates to increasing operating room efficiency. The evidence is generally of suboptimal quality, and rigorous randomized multicentre studies are needed to bring evidence-based management into the same league as evidence-based medicine. Copyright © 2011 British Journal of Surgery Society Ltd. Published by John Wiley & Sons, Ltd.

Use of methodological tools for assessing the quality of studies in periodontology and implant dentistry: a systematic review.

PubMed

Faggion, Clovis M; Huda, Fahd; Wasiak, Jason

2014-06-01

To evaluate the methodological approaches used to assess the quality of studies included in systematic reviews (SRs) in periodontology and implant dentistry. Two electronic databases (PubMed and Cochrane Database of Systematic Reviews) were searched independently to identify SRs examining interventions published through 2 September 2013. The reference lists of included SRs and records of 10 specialty dental journals were searched manually. Methodological approaches were assessed using seven criteria based on the Cochrane Handbook for Systematic Reviews of Interventions. Temporal trends in methodological quality were also explored. Of the 159 SRs with meta-analyses included in the analysis, 44 (28%) reported the use of domain-based tools, 15 (9%) reported the use of checklists and 7 (4%) reported the use of scales. Forty-two (26%) SRs reported use of more than one tool. Criteria were met heterogeneously; authors of 15 (9%) publications incorporated the quality of evidence of primary studies into SRs, whereas 69% of SRs reported methodological approaches in the Materials/Methods section. Reporting of four criteria was significantly better in recent (2010-2013) than in previous publications. The analysis identified several methodological limitations of approaches used to assess evidence in studies included in SRs in periodontology and implant dentistry. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Systematic reviews identify important methodological flaws in stroke rehabilitation therapy primary studies: review of reviews.

PubMed

Santaguida, Pasqualina; Oremus, Mark; Walker, Kathryn; Wishart, Laurie R; Siegel, Karen Lohmann; Raina, Parminder

2012-04-01

A "review of reviews" was undertaken to assess methodological issues in studies evaluating nondrug rehabilitation interventions in stroke patients. MEDLINE, CINAHL, PsycINFO, and the Cochrane Database of Systematic Reviews were searched from January 2000 to January 2008 within the stroke rehabilitation setting. Electronic searches were supplemented by reviews of reference lists and citations identified by experts. Eligible studies were systematic reviews; excluded citations were narrative reviews or reviews of reviews. Review characteristics and criteria for assessing methodological quality of primary studies within them were extracted. The search yielded 949 English-language citations. We included a final set of 38 systematic reviews. Cochrane reviews, which have a standardized methodology, were generally of higher methodological quality than non-Cochrane reviews. Most systematic reviews used standardized quality assessment criteria for primary studies, but not all were comprehensive. Reviews showed that primary studies had problems with randomization, allocation concealment, and blinding. Baseline comparability, adverse events, and co-intervention or contamination were not consistently assessed. Blinding of patients and providers was often not feasible and was not evaluated as a source of bias. The eligible systematic reviews identified important methodological flaws in the evaluated primary studies, suggesting the need for improvement of research methods and reporting. Copyright © 2012 Elsevier Inc. All rights reserved.

Methodological Quality Assessment of Meta-Analyses and Systematic Reviews of Probiotics in Inflammatory Bowel Disease and Pouchitis.

PubMed

Dong, Jinpei; Teng, Guigen; Wei, Tiantong; Gao, Wen; Wang, Huahong

2016-01-01

Probiotics are widely used for the induction and maintenance of remission in inflammatory bowel disease (IBD) and pouchitis. There are a large number of meta-analyses (MAs)/ systematic reviews (SRs) on this subject, the methodological quality of which has not been evaluated. This study aimed to evaluate the methodological quality of and summarize the evidence obtained from MAs/SRs of probiotic treatments for IBD and pouchitis patients. The PubMed, EMBASE, Cochrane Library and China National Knowledge Infrastructure (CNKI) databases were searched to identify Chinese and English language MAs/SRs of the use of probiotics for IBD and pouchitis. The Assessment of Multiple Systematic Reviews (AMSTAR) scale was used to assess the methodological quality of the studies. A total of 36 MAs/SRs were evaluated. The AMSTAR scores of the included studies ranged from 1 to 10, and the average score was 5.81. According to the Canadian Agency for Drugs and Technologies in Health, 4 articles were classified as high quality, 24 articles were classified as moderate quality, and 8 articles were classified as low quality. Most of the MAs/SRs suggested that probiotics had potential benefits for patients with ulcerative colitis (UC), but failed to show effectiveness in the induction and maintenance of remission in Crohn's disease (CD). The probiotic preparation VSL#3 may play a beneficial role in pouchitis. The overall methodological quality of the current MAs/SRs in the field of probiotics for IBD and pouchitis was found to be low to moderate. More MAs/SRs of high quality are required to support using probiotics to treat IBD and pouchitis.

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews

PubMed Central

2013-01-01

Background Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. Methods This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. Results A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. Conclusion There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words) PMID:23331384

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews.

PubMed

Wells, Cherie; Kolt, Gregory S; Marshall, Paul; Hill, Bridget; Bialocerkowski, Andrea

2013-01-19

Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words).

[A Methodological Quality Assessment of South Korean Nursing Research using Structural Equation Modeling in South Korea].

PubMed

Kim, Jung-Hee; Shin, Sujin; Park, Jin-Hwa

2015-04-01

The purpose of this study was to evaluate the methodological quality of nursing studies using structural equation modeling in Korea. Databases of KISS, DBPIA, and National Assembly Library up to March 2014 were searched using the MeSH terms 'nursing', 'structure', 'model'. A total of 152 studies were screened. After removal of duplicates and non-relevant titles, 61 papers were read in full. Of the sixty-one articles retrieved, 14 studies were published between 1992 and 2000, 27, between 2001 and 2010, and 20, between 2011 and March 2014. The methodological quality of the review examined varied considerably. The findings of this study suggest that more rigorous research is necessary to address theoretical identification, two indicator rule, distribution of sample, treatment of missing values, mediator effect, discriminant validity, convergent validity, post hoc model modification, equivalent models issues, and alternative models issues should be undergone. Further research with robust consistent methodological study designs from model identification to model respecification is needed to improve the validity of the research.

Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist.

PubMed

Terwee, Caroline B; Mokkink, Lidwine B; Knol, Dirk L; Ostelo, Raymond W J G; Bouter, Lex M; de Vet, Henrica C W

2012-05-01

The COSMIN checklist is a standardized tool for assessing the methodological quality of studies on measurement properties. It contains 9 boxes, each dealing with one measurement property, with 5-18 items per box about design aspects and statistical methods. Our aim was to develop a scoring system for the COSMIN checklist to calculate quality scores per measurement property when using the checklist in systematic reviews of measurement properties. The scoring system was developed based on discussions among experts and testing of the scoring system on 46 articles from a systematic review. Four response options were defined for each COSMIN item (excellent, good, fair, and poor). A quality score per measurement property is obtained by taking the lowest rating of any item in a box ("worst score counts"). Specific criteria for excellent, good, fair, and poor quality for each COSMIN item are described. In defining the criteria, the "worst score counts" algorithm was taken into consideration. This means that only fatal flaws were defined as poor quality. The scores of the 46 articles show how the scoring system can be used to provide an overview of the methodological quality of studies included in a systematic review of measurement properties. Based on experience in testing this scoring system on 46 articles, the COSMIN checklist with the proposed scoring system seems to be a useful tool for assessing the methodological quality of studies included in systematic reviews of measurement properties.

Interventional Radiology Clinical Practice Guideline Recommendations for Neurovascular Disorders Are Not Based on High-Quality Systematic Reviews.

PubMed

Chong, A B; Taylor, M; Schubert, G; Vassar, M

2017-04-01

In recent years, clinical practice guidelines have been criticized for biased interpretations of research evidence, and interventional radiology is no exception. Our aim was to evaluate the methodologic quality and transparency of reporting in systematic reviews used as evidence in interventional radiology clinical practice guidelines for neurovascular disorders from the Society of Interventional Radiology. Our sources were 9 neurovascular disorder clinical practice guidelines from the Society of Interventional Radiology. We selected 65 systematic reviews and meta-analyses. A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) tools were used to assess the methodologic quality and reporting transparency of systematic reviews. Radial plots were created on the basis of average scores for PRISMA and AMSTAR items. On the basis of AMSTAR scores, 3 (4.62%) reviews were high-quality, 28 reviews (43.08%) were moderate-quality, and 34 reviews (52.31%) were low-quality, with an average quality score of 3.66 (34.32%; minimum, 0%; maximum, 81.82%). The average PRISMA score was 18.18 (69.41%). We were unable to obtain previous versions for 8 reviews, 7 of which were from the Cochrane Database of Systematic Reviews. The methodologic quality of systematic reviews needs to be improved. Although reporting clarity was much better than the methodologic quality, it still has room for improvement. The methodologic quality and transparency of reporting did not vary much among clinical practice guidelines. This study can also be applied to other medical specialties to examine the quality of studies used as evidence in their own clinical practice guidelines. © 2017 by American Journal of Neuroradiology.

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Sensory re-education after nerve injury of the upper limb: a systematic review.

PubMed

Oud, Tanja; Beelen, Anita; Eijffinger, Elianne; Nollet, Frans

2007-06-01

To systematically review the available evidence for the effectiveness of sensory re-education to improve the sensibility of the hand in patients with a peripheral nerve injury of the upper limb. Studies were identified by an electronic search in the databases MEDLINE, Cumulative Index to Nursing & Allied Health Literature (CINAHL), EMBASE, the Cochrane Library, the Physiotherapy Evidence Database (PEDro), and the database of the Dutch National Institute of Allied Health Professions (Doconline) and by screening the reference lists of relevant articles. Two reviewers selected studies that met the following inclusion criteria: all designs except case reports, adults with impaired sensibility of the hand due to a peripheral nerve injury of the upper limb, and sensibility and functional sensibility as outcome measures. The methodological quality of the included studies was independently assessed by two reviewers. A best-evidence synthesis was performed, based on design, methodological quality and significant findings on outcome measures. Seven studies, with sample sizes ranging from 11 to 49, were included in the systematic review and appraised for content. Five of these studies were of poor methodological quality. One uncontrolled study (N = 1 3 ) was considered to be of sufficient methodological quality, and one randomized controlled trial (N = 49) was of high methodological quality. Best-evidence synthesis showed that there is limited evidence for the effectiveness of sensory re-education, provided by a statistically significant improvement in sensibility found in one high-quality randomized controlled trial. There is a need for further well-defined clinical trials to assess the effectiveness of sensory re-education of patients with impaired sensibility of the hand due to a peripheral nerve injury.

Epidemiological characteristics and methodological quality of meta-analyses on diabetes mellitus treatment: a systematic review.

PubMed

Wu, Xin Yin; Lam, Victor C K; Yu, Yue Feng; Ho, Robin S T; Feng, Ye; Wong, Charlene H L; Yip, Benjamin H K; Tsoi, Kelvin K F; Wong, Samuel Y S; Chung, Vincent C H

2016-11-01

Well-conducted meta-analyses (MAs) are considered as one of the best sources of clinical evidence for treatment decision. MA with methodological flaws may introduce bias and mislead evidence users. The aim of this study is to investigate the characteristics and methodological quality of MAs on diabetes mellitus (DM) treatments. Systematic review. Cochrane Database of Systematic Review and Database of Abstract of Reviews of Effects were searched for relevant MAs. Assessing methodological quality of systematic reviews (AMSTAR) tool was used to evaluate the methodological quality of included MAs. Logistic regression analysis was used to identify association between characteristics of MA and AMSTAR results. A total of 252 MAs including 4999 primary studies and 13,577,025 patients were included. Over half of the MAs (65.1%) only included type 2 DM patients and 160 MAs (63.5%) focused on pharmacological treatments. About 89.7% MAs performed comprehensive literature search and 89.3% provided characteristics of included studies. Included MAs generally had poor performance on the remaining AMSTAR items, especially in assessing publication bias (39.3%), providing lists of studies (19.0%) and declaring source of support comprehensively (7.5%). Only 62.7% MAs mentioned about harm of interventions. MAs with corresponding author from Asia performed less well in providing MA protocol than those from Europe. Methodological quality of MA on DM treatments was unsatisfactory. There is considerable room for improvement, especially in assessing publication bias, providing lists of studies and declaring source of support comprehensively. Also, there is an urgent need for MA authors to report treatment harm comprehensively. © 2016 European Society of Endocrinology.

Tracer methodology: an appropriate tool for assessing compliance with accreditation standards?

PubMed

Bouchard, Chantal; Jean, Olivier

2017-10-01

Tracer methodology has been used by Accreditation Canada since 2008 to collect evidence on the quality and safety of care and services, and to assess compliance with accreditation standards. Given the importance of this methodology in the accreditation program, the objective of this study is to assess the quality of the methodology and identify its strengths and weaknesses. A mixed quantitative and qualitative approach was adopted to evaluate consistency, appropriateness, effectiveness and stakeholder synergy in applying the methodology. An online questionnaire was sent to 468 Accreditation Canada surveyors. According to surveyors' perceptions, tracer methodology is an effective tool for collecting useful, credible and reliable information to assess compliance with Qmentum program standards and priority processes. The results show good coherence between methodology components (appropriateness of the priority processes evaluated, activities to evaluate a tracer, etc.). The main weaknesses are the time constraints faced by surveyors and management's lack of cooperation during the evaluation of tracers. The inadequate amount of time allowed for the methodology to be applied properly raises questions about the quality of the information obtained. This study paves the way for a future, more in-depth exploration of the identified weaknesses to help the accreditation organization make more targeted improvements to the methodology. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Specific guidelines for assessing and improving the methodological quality of economic evaluations of newborn screening

PubMed Central

2012-01-01

Background Economic evaluation of newborn screening poses specific methodological challenges. Amongst others, these challenges refer to the use of quality adjusted life years (QALYs) in newborns, and which costs and outcomes need to be considered in a full evaluation of newborn screening programmes. Because of the increasing scale and scope of such programmes, a better understanding of the methods of high-quality economic evaluations may be crucial for both producers/authors and consumers/reviewers of newborn screening-related economic evaluations. The aim of this study was therefore to develop specific guidelines designed to assess and improve the methodological quality of economic evaluations in newborn screening. Methods To develop the guidelines, existing guidelines for assessing the quality of economic evaluations were identified through a literature search, and were reviewed and consolidated using a deductive iterative approach. In a subsequent test phase, these guidelines were applied to various economic evaluations which acted as case studies. Results The guidelines for assessing and improving the methodological quality of economic evaluations in newborn screening are organized into 11 categories: “bibliographic details”, “study question and design”, “modelling”, “health outcomes”, “costs”, “discounting”, “presentation of results”, “sensitivity analyses”, “discussion”, “conclusions”, and “commentary”. Conclusions The application of the guidelines highlights important issues regarding newborn screening-related economic evaluations, and underscores the need for such issues to be afforded greater consideration in future economic evaluations. The variety in methodological quality detected by this study reveals the need for specific guidelines on the appropriate methods for conducting sound economic evaluations in newborn screening. PMID:22947299

Importance of methodology on (99m)technetium dimercapto-succinic acid scintigraphic image quality: imaging pilot study for RIVUR (Randomized Intervention for Children With Vesicoureteral Reflux) multicenter investigation.

PubMed

Ziessman, Harvey A; Majd, Massoud

2009-07-01

We reviewed our experience with (99m)technetium dimercapto-succinic acid scintigraphy obtained during an imaging pilot study for a multicenter investigation (Randomized Intervention for Children With Vesicoureteral Reflux) of the effectiveness of daily antimicrobial prophylaxis for preventing recurrent urinary tract infection and renal scarring. We analyzed imaging methodology and its relation to diagnostic image quality. (99m)Technetium dimercapto-succinic acid imaging guidelines were provided to participating sites. High-resolution planar imaging with parallel hole or pinhole collimation was required. Two core reviewers evaluated all submitted images. Analysis included appropriate views, presence or lack of patient motion, adequate magnification, sufficient counts and diagnostic image quality. Inter-reader agreement was evaluated. We evaluated 70, (99m)technetium dimercapto-succinic acid studies from 14 institutions. Variability was noted in methodology and image quality. Correlation (r value) between dose administered and patient age was 0.780. For parallel hole collimator imaging good correlation was noted between activity administered and counts (r = 0.800). For pinhole imaging the correlation was poor (r = 0.110). A total of 10 studies (17%) were rejected for quality issues of motion, kidney overlap, inadequate magnification, inadequate counts and poor quality images. The submitting institution was informed and provided with recommendations for improving quality, and resubmission of another study was required. Only 4 studies (6%) were judged differently by the 2 reviewers, and the differences were minor. Methodology and image quality for (99m)technetium dimercapto-succinic acid scintigraphy varied more than expected between institutions. The most common reason for poor image quality was inadequate count acquisition with insufficient attention to the tradeoff between administered dose, length of image acquisition, start time of imaging and resulting image quality. Inter-observer core reader agreement was high. The pilot study ensured good diagnostic quality standardized images for the Randomized Intervention for Children With Vesicoureteral Reflux investigation.

Epidemiology, methodological and reporting characteristics of systematic reviews of nursing interventions published in China.

PubMed

Shi, Chunhu; Zhu, Lin; Wang, Xue; Qin, Chunxia; Xu, Qi; Tian, Jinhui

2014-12-01

The importance of systematic reviews (SRs) of nursing interventions' impact on practice makes their methodological quality and reporting characteristics especially important as it directly influence their utility for clinicians, patients and policy makers.The study aims to assess the methodological quality and reporting characteristics of SRs of nursing interventions in Chinese nursing journals. Three Chinese databases were searched for SRs of nursing interventions from inception to October 2011. The assessment of multiple systematic reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) statements were used to assess methodological quality and reporting characteristics. Seventy-four SRs were included. The proportion of SRs complying with AMSTAR checklist items ranged from 0% to 82.4%. No SRs reported an 'a priori' design or conflict of interest. Only four items were found to be reported in more than 50% of the SRs: a list of included and excluded studies, the scientific quality of included studies, the appropriate use of methods to combine findings, and formulating conclusions appropriately. The majority of SRs of nursing interventions in China had major methodological and reporting flaws that limited their value to guide decisions. Chinese authors and journals should adopt and keep up with the AMSTAR and PRISMA statements to improve the quality of SRs in this field. © 2014 Wiley Publishing Asia Pty Ltd.

Using Six Sigma for Performance Improvement in Business Curriculum: A Case Study

ERIC Educational Resources Information Center

Kukreja, Anil; Ricks, Joe M., Jr.; Meyer, Jean A.

2009-01-01

During the last few decades, a number of quality improvement methodologies have been used by organizations. This article provides a brief review of the quality improvement literature related to academia and a case study using Six Sigma methodology to analyze students' performance in a standardized examination. We found Six Sigma to be an effective…

Quality in the Basic Grant Delivery System: Volume 3, Methodology.

ERIC Educational Resources Information Center

Advanced Technology, Inc., McLean, VA.

The research methodology of a study to assess 1980-1981 award accuracy of the Basic Educational Opportunity Grants (BEOG), or Pell grants, is described. The study is the first stage of a three-stage quality control project. During the spring of 1981 a nationally representative sample of 305 public, private, and proprietary institutions was…

Effectiveness of the Comprehensive Approach to Rehabilitation (CARe) methodology: design of a cluster randomized controlled trial.

PubMed

Bitter, Neis A; Roeg, Diana P K; van Nieuwenhuizen, Chijs; van Weeghel, Jaap

2015-07-22

There is an increasing amount of evidence for the effectiveness of rehabilitation interventions for people with severe mental illness (SMI). In the Netherlands, a rehabilitation methodology that is well known and often applied is the Comprehensive Approach to Rehabilitation (CARe) methodology. The overall goal of the CARe methodology is to improve the client's quality of life by supporting the client in realizing his/her goals and wishes, handling his/her vulnerability and improving the quality of his/her social environment. The methodology is strongly influenced by the concept of 'personal recovery' and the 'strengths case management model'. No controlled effect studies have been conducted hitherto regarding the CARe methodology. This study is a two-armed cluster randomized controlled trial (RCT) that will be executed in teams from three organizations for sheltered and supported housing, which provide services to people with long-term severe mental illness. Teams in the intervention group will receive the multiple-day CARe methodology training from a specialized institute and start working according the CARe Methodology guideline. Teams in the control group will continue working in their usual way. Standardized questionnaires will be completed at baseline (T0), and 10 (T1) and 20 months (T2) post baseline. Primary outcomes are recovery, social functioning and quality of life. The model fidelity of the CARe methodology will be assessed at T1 and T2. This study is the first controlled effect study on the CARe methodology and one of the few RCTs on a broad rehabilitation method or strength-based approach. This study is relevant because mental health care organizations have become increasingly interested in recovery and rehabilitation-oriented care. The trial registration number is ISRCTN77355880 .

Traditional Chinese medicine for knee osteoarthritis: An overview of systematic review.

PubMed

Yang, Min; Jiang, Li; Wang, Qing; Chen, Hao; Xu, Guihua

2017-01-01

Traditional Chinese medicine (TCM) has been accepted as a complementary therapy for knee osteoarthritis. However, the efficacy and safety of the intervention were still conflicting and uncertain. Meanwhile, the quality of methodology and evidence in the field was unknown. To summarize the characteristics and critically evaluate the quality of methodology, as well as the evidence of systematic reviews (SRs) on TCM for knee osteoarthritis. Five electronic databases were searched from inception to April 2016. The methodological quality of the included studies was assessed by AMSTAR and ROBIS. The quality of the evidence was determined using the GRADE approach. Ten SRs were included. The conclusions suggest that TCM provides potential benefits for patients with knee osteoarthritis. These benefits include pain relief, functional improvement, and presence of few adverse events. Limitations of the methodological quality mainly included the lack of a-priori protocol or protocol registration and incomprehensive literature search. A list of excluded studies was also not provided. The overall quality of evidence in the SRs was poor, ranging from "very low" to "low," mainly because of the serious risk of bias of original trials, inconsistencies, and imprecision in the outcomes. TCM generally appears to be effective for knee osteoarthritis treatment. However, the evidence is not robust enough because of the methodological flaws in SRs. Hence, these conclusions on available SRs should be treated with caution for clinical practice.

Proactive telephone counseling for smoking cessation: meta-analyses by recruitment channel and methodological quality.

PubMed

Tzelepis, Flora; Paul, Christine L; Walsh, Raoul A; McElduff, Patrick; Knight, Jenny

2011-06-22

Systematic reviews demonstrated that proactive telephone counseling increases smoking cessation rates. However, these reviews did not differentiate studies by recruitment channel, did not adequately assess methodological quality, and combined different measures of abstinence. Twenty-four randomized controlled trials published before December 31, 2008, included seven of active recruitment, 16 of passive recruitment, and one of mixed recruitment. We rated methodological quality on selection bias, study design, confounders, blinding, data collection methods, withdrawals, and dropouts, according to the Quality Assessment Tool for Quantitative Studies. We conducted random effects meta-analysis to pool the results according to abstinence type and follow-up time for studies overall and segregated by recruitment channel, and methodological quality. The level of statistical heterogeneity was quantified by I(2). All statistical tests were two-sided. Methodological quality ratings indicated two strong, 10 moderate, and 12 weak studies. Overall, compared with self-help materials or no intervention control groups, proactive telephone counseling had a statistically significantly greater effect on point prevalence abstinence (nonsmoking at follow-up or abstinent for at least 24 hours, 7 days before follow-up) at 6-9 months (relative risk [RR] = 1.26, 95% confidence interval [CI] = 1.11 to 1.43, P < .001, I(2) = 21.4%) but not at 12-15 months after recruitment. This pattern also emerged when studies were segregated by recruitment channel (active, passive) or methodological quality (strong/moderate, weak). Overall, the positive effect on prolonged/continuous abstinence (abstinent for 3 months or longer before follow-up) was also statistically significantly greater at 6-9 months (RR = 1.58, CI = 1.26 to 1.98, P < .001, I(2) = 49.1%) and 12-18 months after recruitment (RR = 1.40, CI = 1.23 to 1.60, P < .001, I(2) = 18.5%). With the exception of point prevalence abstinence in the long term, these data support previous results showing that proactive telephone counseling has a positive impact on smoking cessation. Proactive telephone counseling increased prolonged/continuous abstinence long term for both actively and passively recruited smokers.

The methodological quality of health economic evaluations for the management of hip fractures: A systematic review of the literature.

PubMed

Sabharwal, Sanjeeve; Carter, Alexander; Darzi, Lord Ara; Reilly, Peter; Gupte, Chinmay M

2015-06-01

Approximately 76,000 people a year sustain a hip fracture in the UK and the estimated cost to the NHS is £1.4 billion a year. Health economic evaluations (HEEs) are one of the methods employed by decision makers to deliver healthcare policy supported by clinical and economic evidence. The objective of this study was to (1) identify and characterize HEEs for the management of patients with hip fractures, and (2) examine their methodological quality. A literature search was performed in MEDLINE, EMBASE and the NHS Economic Evaluation Database. Studies that met the specified definition for a HEE and evaluated hip fracture management were included. Methodological quality was assessed using the Consensus on Health Economic Criteria (CHEC). Twenty-seven publications met the inclusion criteria of this study and were included in our descriptive and methodological analysis. Domains of methodology that performed poorly included use of an appropriate time horizon (66.7% of studies), incremental analysis of costs and outcomes (63%), future discounting (44.4%), sensitivity analysis (40.7%), declaration of conflicts of interest (37%) and discussion of ethical considerations (29.6%). HEEs for patients with hip fractures are increasing in publication in recent years. Most of these studies fail to adopt a societal perspective and key aspects of their methodology are poor. The development of future HEEs in this field must adhere to established principles of methodology, so that better quality research can be used to inform health policy on the management of patients with a hip fracture. Copyright © 2014 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome

PubMed Central

Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety. PMID:26246841

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome.

PubMed

Lauche, Romy; Cramer, Holger; Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety.

Q methodology, risk training and quality management.

PubMed

McKeown, M; Hinks, M; Stowell-Smith, M; Mercer, D; Forster, J

1999-01-01

The results of a Q methodological study of professional understandings of the notion of risk in mental health services within the UK are discussed in relation to the relevance for staff training and quality assurance. The study attempted to access the diversity of understandings of risk issues amongst a multi-professional group of staff (n = 60) attending inter-agency risk training workshops in 1998. Q methodology is presented as both an appropriate means for such inquiry and as a novel experiential technique for training purposes. A tentative argument is advanced that the qualitative accounts generated by Q research could assist in systematic reviews of quality, complementing the singularly quantitative approaches typically represented in the audit process.

Characteristics and quality of published animal research in the field of radiology.

PubMed

Yoon, Soo Jeong; Yoon, Dae Young; Cho, Young Kwon; Baek, Sora; Lim, Kyoung Ja; Seo, Young Lan; Yun, Eun Joo

2017-06-01

Background Animal research has played an important role in the field of radiology. Purpose To evaluate the characteristics and quality of published radiological animal research. Material and Methods A PubMed search was performed for radiological animal research articles (defined as studies using animal models with a radiologist as the first author) published in 1994, 2004, and 2014. The following information was extracted from each article: journal name, radiological subspecialty, imaging technique, animal species, number of animals used, number of authors, declared funding, country of origin, methodological quality, and ethical quality. Methodological and ethical quality of studies were assessed with seven-item (sample size calculation, animal age, animal sex, animal weight, inclusion and exclusion criteria, randomization, and blinded outcome assessment) and four-item (ethical review committee approval, anesthesia, pain control, and euthanasia) scales, respectively. Results The numbers of radiological animal studies markedly increased, from 91 in 1994 to 163 in 2004 and to 305 in 2014. One hundred and sixty-two (29.0%) articles focused on the neuroradiology/head and neck subspecialty, 233 (41.7%) used magnetic resonance imaging (MRI), 190 (34.0%) used mice, 254 (45.4%) used 10-30 animals, 297 (53.1%) had 4-7 authors, 392 (70.1%) were funded, and 222 (39.7%) were from the USA. Six of 7 methodological and 3/4 ethical quality items significantly improved over time. Conclusion The quantity and quality of radiological animal research has increased over the last two decades; however, methodological and ethical quality remains suboptimal.

Social cognition interventions for people with schizophrenia: a systematic review focussing on methodological quality and intervention modality.

PubMed

Grant, Nina; Lawrence, Megan; Preti, Antonio; Wykes, Til; Cella, Matteo

2017-08-01

People with a diagnosis of schizophrenia have significant social and functional difficulties. Social cognition was found to influences these outcomes and in recent years interventions targeting this domain were developed. This paper reviews the existing literature on social cognition interventions for people with a diagnosis of schizophrenia focussing on: i) comparing focussed (i.e. targeting only one social cognitive domain) and global interventions and ii) studies methodological quality. Systematic search was conducted on PubMed and PsycInfo. Studies were included if they were randomised control trials, participants had a diagnosis of schizophrenia or schizoaffective disorder, and the intervention targeted at least one out of four social cognition domains (i.e. theory of mind, affect recognition, social perception and attribution bias). All papers were assessed for methodological quality. Information on the intervention, control condition, study methodology and the main findings from each study were extracted and critically summarised. Data from 32 studies fulfilled the inclusion criteria, considering a total of 1440 participants. Taking part in social cognition interventions produced significant improvements in theory of mind and affect recognition compared to both passive and active control conditions. Results were less clear for social perception and attributional bias. Focussed and global interventions had similar results on outcomes. Overall study methodological quality was modest. There was very limited evidence showing that social cognitive intervention result in functional outcome improvement. The evidence considered suggests that social cognition interventions may be a valuable approach for people with a diagnosis of schizophrenia. However, evidence quality is limited by measure heterogeneity, modest study methodology and short follow-up periods. The findings point to a number of recommendations for future research, including measurement standardisation, appropriately powered studies and investigation of the impact of social cognition improvements on functioning problems. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Integrating automated support for a software management cycle into the TAME system

NASA Technical Reports Server (NTRS)

Sunazuka, Toshihiko; Basili, Victor R.

1989-01-01

Software managers are interested in the quantitative management of software quality, cost and progress. An integrated software management methodology, which can be applied throughout the software life cycle for any number purposes, is required. The TAME (Tailoring A Measurement Environment) methodology is based on the improvement paradigm and the goal/question/metric (GQM) paradigm. This methodology helps generate a software engineering process and measurement environment based on the project characteristics. The SQMAR (software quality measurement and assurance technology) is a software quality metric system and methodology applied to the development processes. It is based on the feed forward control principle. Quality target setting is carried out before the plan-do-check-action activities are performed. These methodologies are integrated to realize goal oriented measurement, process control and visual management. A metric setting procedure based on the GQM paradigm, a management system called the software management cycle (SMC), and its application to a case study based on NASA/SEL data are discussed. The expected effects of SMC are quality improvement, managerial cost reduction, accumulation and reuse of experience, and a highly visual management reporting system.

Psychometric evaluation of commonly used game-specific skills tests in rugby: A systematic review

PubMed Central

Oorschot, Sander; Chiwaridzo, Matthew; CM Smits-Engelsman, Bouwien

2017-01-01

Objectives To (1) give an overview of commonly used game-specific skills tests in rugby and (2) evaluate available psychometric information of these tests. Methods The databases PubMed, MEDLINE CINAHL and Africa Wide information were systematically searched for articles published between January 1995 and March 2017. First, commonly used game-specific skills tests were identified. Second, the available psychometrics of these tests were evaluated and the methodological quality of the studies assessed using the Consensus-based Standards for the selection of health Measurement Instruments checklist. Studies included in the first step had to report detailed information on the construct and testing procedure of at least one game-specific skill, and studies included in the second step had additionally to report at least one psychometric property evaluating reliability, validity or responsiveness. Results 287 articles were identified in the first step, of which 30 articles met the inclusion criteria and 64 articles were identified in the second step of which 10 articles were included. Reactive agility, tackling and simulated rugby games were the most commonly used tests. All 10 studies reporting psychometrics reported reliability outcomes, revealing mainly strong evidence. However, all studies scored poor or fair on methodological quality. Four studies reported validity outcomes in which mainly moderate evidence was indicated, but all articles had fair methodological quality. Conclusion Game-specific skills tests indicated mainly high reliability and validity evidence, but the studies lacked methodological quality. Reactive agility seems to be a promising domain, but the specific tests need further development. Future high methodological quality studies are required in order to develop valid and reliable test batteries for rugby talent identification. Trial registration number PROSPERO CRD42015029747. PMID:29259812

[Methodological quality of an article on the treatment of gastric cancer adopted as protocol by some Chilean hospitals].

PubMed

Manterola, Carlos; Torres, Rodrigo; Burgos, Luis; Vial, Manuel; Pineda, Viviana

2006-07-01

Surgery is a curative treatment for gastric cancer (GC). As relapse is frequent, adjuvant therapies such as postoperative chemo radiotherapy have been tried. In Chile, some hospitals adopted Macdonald's study as a protocol for the treatment of GC. To determine methodological quality and internal and external validity of the Macdonald study. Three instruments were applied that assess methodological quality. A critical appraisal was done and the internal and external validity of the methodological quality was analyzed with two scales: MINCIR (Methodology and Research in Surgery), valid for therapy studies and CONSORT (Consolidated Standards of Reporting Trials), valid for randomized controlled trials (RCT). Guides and scales were applied by 5 researchers with training in clinical epidemiology. The reader's guide verified that the Macdonald study was not directed to answer a clearly defined question. There was random assignment, but the method used is not described and the patients were not considered until the end of the study (36% of the group with surgery plus chemo radiotherapy did not complete treatment). MINCIR scale confirmed a multicentric RCT, not blinded, with an unclear randomized sequence, erroneous sample size estimation, vague objectives and no exclusion criteria. CONSORT system proved the lack of working hypothesis and specific objectives as well as an absence of exclusion criteria and identification of the primary variable, an imprecise estimation of sample size, ambiguities in the randomization process, no blinding, an absence of statistical adjustment and the omission of a subgroup analysis. The instruments applied demonstrated methodological shortcomings that compromise the internal and external validity of the.

Epidemiology characteristics, reporting characteristics, and methodological quality of systematic reviews and meta-analyses on traditional Chinese medicine nursing interventions published in Chinese journals.

PubMed

Yang, Min; Jiang, Li; Wang, Aihong; Xu, Guihua

2017-02-01

To evaluate the epidemiological characteristics, reporting characteristics, and methodological quality of systematic reviews in the traditional Chinese medicine nursing field published in Chinese journals. The number of systematic reviews in the traditional Chinese medicine nursing field has increased, but their epidemiology, quality, and reporting characteristics have not been assessed completely. We generated an overview of reviews using a narrative approach. Four Chinese databases were searched for systematic reviews from inception to December 2015. The Preferred Reporting Items of Systematic Reviews and Meta-analyses and the Assessment of Multiple Systematic Reviews checklists were adopted to evaluate reporting and methodological quality, respectively. A total of 73 eligible systematic reviews, published from 2005 to 2015, were included. The deficiencies in reporting characteristics mainly lay in the lack of structured abstract or protocol, incomplete reporting of search strategies, study selection, and risk of bias. The deficiencies in methodological quality were reflected in the lack of a priori design and conflict of interest, incomplete literature searches, and assessment of publication bias. The quality of the evaluated reviews was unsatisfactory; attention should be paid to the improvement of reporting and methodological quality in the conduct of systematic reviews. © 2016 John Wiley & Sons Australia, Ltd.

A systematic review of grounded theory studies in physiotherapy.

PubMed

Ali, Nancy; May, Stephen; Grafton, Kate

2018-05-23

This systematic review aimed at appraising the methodological rigor of grounded theory research published in the field of physiotherapy to assess how the methodology is understood and applied. A secondary aim was to provide research implications drawn from the findings to guide future grounded theory methodology (GTM) research. A systematic search was conducted in MEDLINE, CINHAL, SPORT Discus, Science Direct, PubMed, Scopus, and Web of Science to identify studies in the field of physiotherapy that reported using GTM and/or methods in the study title and/or abstract. The descriptive characteristics and methodological quality of eligible studies were examined using grounded theory methodology assessment guidelines. The review included 68 studies conducted between 1998 and 2017. The findings showed that GTM is becoming increasingly used by physiotherapy researchers. Thirty-six studies (53%) demonstrated a good understanding and appropriate application of GTM. Thirty-two studies (47%) presented descriptive findings and were considered to be of poor methodological quality. There are several key tenets of GTM that are integral to the iterative process of qualitative theorizing and need to be applied throughout all research practices including sampling, data collection, and analysis.

Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.

PubMed

Dosenovic, Svjetlana; Jelicic Kadic, Antonia; Vucic, Katarina; Markovina, Nikolina; Pieper, Dawid; Puljak, Livia

2018-05-08

Systematic reviews (SRs) in the field of neuropathic pain (NeuP) are increasingly important for decision-making. However, methodological flaws in SRs can reduce the validity of conclusions. Hence, it is important to assess the methodological quality of NeuP SRs critically. Additionally, it remains unclear which assessment tool should be used. We studied the methodological quality of SRs published in the field of NeuP and compared two assessment tools. We systematically searched 5 electronic databases to identify SRs of randomized controlled trials of interventions for NeuP available up to March 2015. Two independent reviewers assessed the methodological quality of the studies using the Assessment of Multiple Systematic Reviews (AMSTAR) and the revised AMSTAR (R-AMSTAR) tools. The scores were converted to percentiles and ranked into 4 grades to allow comparison between the two checklists. Gwet's AC1 coefficient was used for interrater reliability assessment. The 97 included SRs had a wide range of methodological quality scores (AMSTAR median (IQR): 6 (5-8) vs. R-AMSTAR median (IQR): 30 (26-35)). The overall agreement score between the 2 raters was 0.62 (95% CI 0.39-0.86) for AMSTAR and 0.62 (95% CI 0.53-0.70) for R-AMSTAR. The 31 Cochrane systematic reviews (CSRs) were consistently ranked higher than the 66 non-Cochrane systematic reviews (NCSRs). The analysis of individual domains showed the best compliance in a comprehensive literature search (item 3) on both checklists. The results for the domain that was the least compliant differed: conflict of interest (item 11) was the item most poorly reported on AMSTAR vs. publication bias assessment (item 10) on R-AMSTAR. A high positive correlation between the total AMSTAR and R-AMSTAR scores for all SRs, as well as for CSRs and NCSRs, was observed. The methodological quality of analyzed SRs in the field of NeuP was not optimal, and CSRs had a higher quality than NCSRs. Both AMSTAR and R-AMSTAR tools produced comparable quality ratings. Our results point out to weaknesses in the methodology of existing SRs on interventions for the management NeuP and call for future improvement by better adherence to analyzed quality checklists, either AMSTAR or R-AMSTAR.

Appendix C: Background and Methodology for Alternative Certification Pilot. [2014 Teacher Prep Review

ERIC Educational Resources Information Center

Greenberg, Julie; Walsh, Kate; McKee, Arthur

2014-01-01

The "NCTQ Teacher Prep Review" evaluates the quality of programs that provide preservice preparation of public school teachers. As part of the "Review," this appendix reports on a pilot study of new standards for assessing the quality of alternative certification programs. Background and methodology for alternative…

Qualitative case study methodology in nursing research: an integrative review.

PubMed

Anthony, Susan; Jack, Susan

2009-06-01

This paper is a report of an integrative review conducted to critically analyse the contemporary use of qualitative case study methodology in nursing research. Increasing complexity in health care and increasing use of case study in nursing research support the need for current examination of this methodology. In 2007, a search for case study research (published 2005-2007) indexed in the CINAHL, MEDLINE, EMBASE, PsychINFO, Sociological Abstracts and SCOPUS databases was conducted. A sample of 42 case study research papers met the inclusion criteria. Whittemore and Knafl's integrative review method guided the analysis. Confusion exists about the name, nature and use of case study. This methodology, including terminology and concepts, is often invisible in qualitative study titles and abstracts. Case study is an exclusive methodology and an adjunct to exploring particular aspects of phenomena under investigation in larger or mixed-methods studies. A high quality of case study exists in nursing research. Judicious selection and diligent application of literature review methods promote the development of nursing science. Case study is becoming entrenched in the nursing research lexicon as a well-accepted methodology for studying phenomena in health and social care, and its growing use warrants continued appraisal to promote nursing knowledge development. Attention to all case study elements, process and publication is important in promoting authenticity, methodological quality and visibility.

How to Select a Questionnaire with a Good Methodological Quality?

PubMed

Paiva, Saul Martins; Perazzo, Matheus de França; Ortiz, Fernanda Ruffo; Pordeus, Isabela Almeida; Martins-Júnior, Paulo Antônio

2018-01-01

In the last decades, several instruments have been used to evaluate the impact of oral health problems on the oral health-related quality of life (OHRQoL) of individuals. However, some instruments lack thorough methodological validation or present conceptual differences that hinder comparisons with instruments. Thus, it can be difficult to clinicians and researchers to select a questionnaire that accurately reflect what are really meaningful to individuals. This short communication aimed to discuss the importance of use an appropriate checklist to select an instrument with a good methodological quality. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was developed to provide tools for evidence-based instrument selection. The COSMIN checklist comprises ten boxes that evaluate whether a study meets the standard for good methodological quality and two additional boxes to meet studies that use the Item Response Theory method and general requirements for results generalization, resulting in four steps to be followed. In this way, it is required at least some expertise in psychometrics or clinimetrics to a wide-ranging use of this checklist. The COSMIN applications include its use to ensure the standardization of cross-cultural adaptations and safer comparisons between measurement studies and evaluation of methodological quality of systematic reviews of measurement properties. Also, it can be used by students when training about measurement properties and by editors and reviewers when revising manuscripts on this topic. The popularization of COSMIN checklist is therefore necessary to improve the selection and evaluation of health measurement instruments.

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students’ academic success. PMID:27031506

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

How to do a grounded theory study: a worked example of a study of dental practices

PubMed Central

2011-01-01

Background Qualitative methodologies are increasingly popular in medical research. Grounded theory is the methodology most-often cited by authors of qualitative studies in medicine, but it has been suggested that many 'grounded theory' studies are not concordant with the methodology. In this paper we provide a worked example of a grounded theory project. Our aim is to provide a model for practice, to connect medical researchers with a useful methodology, and to increase the quality of 'grounded theory' research published in the medical literature. Methods We documented a worked example of using grounded theory methodology in practice. Results We describe our sampling, data collection, data analysis and interpretation. We explain how these steps were consistent with grounded theory methodology, and show how they related to one another. Grounded theory methodology assisted us to develop a detailed model of the process of adapting preventive protocols into dental practice, and to analyse variation in this process in different dental practices. Conclusions By employing grounded theory methodology rigorously, medical researchers can better design and justify their methods, and produce high-quality findings that will be more useful to patients, professionals and the research community. PMID:21902844

How to do a grounded theory study: a worked example of a study of dental practices.

PubMed

Sbaraini, Alexandra; Carter, Stacy M; Evans, R Wendell; Blinkhorn, Anthony

2011-09-09

Qualitative methodologies are increasingly popular in medical research. Grounded theory is the methodology most-often cited by authors of qualitative studies in medicine, but it has been suggested that many 'grounded theory' studies are not concordant with the methodology. In this paper we provide a worked example of a grounded theory project. Our aim is to provide a model for practice, to connect medical researchers with a useful methodology, and to increase the quality of 'grounded theory' research published in the medical literature. We documented a worked example of using grounded theory methodology in practice. We describe our sampling, data collection, data analysis and interpretation. We explain how these steps were consistent with grounded theory methodology, and show how they related to one another. Grounded theory methodology assisted us to develop a detailed model of the process of adapting preventive protocols into dental practice, and to analyse variation in this process in different dental practices. By employing grounded theory methodology rigorously, medical researchers can better design and justify their methods, and produce high-quality findings that will be more useful to patients, professionals and the research community.

Are normative sonographic values of kidney size in children valid and reliable? A systematic review of the methodological quality of ultrasound studies using the Anatomical Quality Assessment (AQUA) tool.

PubMed

Chhapola, Viswas; Tiwari, Soumya; Deepthi, Bobbity; Henry, Brandon Michael; Brar, Rekha; Kanwal, Sandeep Kumar

2018-06-01

A plethora of research is available on ultrasonographic kidney size standards. We performed a systematic review of methodological quality of ultrasound studies aimed at developing normative renal parameters in healthy children, by evaluating the risk of bias (ROB) using the 'Anatomical Quality Assessment (AQUA)' tool. We searched Medline, Scopus, CINAHL, and Google Scholar on June 04 2018, and observational studies measuring kidney size by ultrasonography in healthy children (0-18 years) were included. The ROB of each study was evaluated in five domains using a 20 item coding scheme based on AQUA tool framework. Fifty-four studies were included. Domain 1 (subject characteristics) had a high ROB in 63% of studies due to the unclear description of age, sex, and ethnicity. The performance in Domain 2 (study design) was the best with 85% of studies having a prospective design. Methodological characterization (Domain 3) was poor across the studies (< 10% compliance), with suboptimal performance in the description of patient positioning, operator experience, and assessment of intra/inter-observer reliability. About three-fourth of the studies had a low ROB in Domain 4 (descriptive anatomy). Domain 5 (reporting of results) had a high ROB in approximately half of the studies, the majority reporting results in the form of central tendency measures. Significant deficiencies and heterogeneity were observed in the methodological quality of USG studies performed to-date for measurement of kidney size in children. We hereby provide a framework for the conducting such studies in future. PROSPERO (CRD42017071601).

Efficacy of exercise therapy in workers with rotator cuff tendinopathy: a systematic review

PubMed Central

Desmeules, François; Boudreault, Jennifer; Dionne, Clermont E.; Frémont, Pierre; Lowry, Véronique; MacDermid, Joy C.; Roy, Jean-Sébastien

2016-01-01

Objective: To perform a systematic review of randomized controlled trials (RCTs) on the efficacy of therapeutic exercises for workers suffering from rotator cuff (RC) tendinopathy. Methods: A literature search in four bibliographical databases (Pubmed, CINAHL, EMBASE, and PEDro) was conducted from inception up to February 2015. RCTs were included if participants were workers suffering from RC tendinopathy, the outcome measures included work-related outcomes, and at least one of the interventions under study included exercises. The methodological quality of the studies was evaluated with the Cochrane Risk of Bias Assessment tool. Results: The mean methodological score of the ten included studies was 54.4%±17.2%. Types of workers included were often not defined, and work-related outcome measures were heterogeneous and often not validated. Three RCTs of moderate methodological quality concluded that exercises were superior to a placebo or no intervention in terms of function and return-to-work outcomes. No significant difference was found between surgery and exercises based on the results of two studies of low to moderate methodological quality. One study of low methodological quality, comparing a workplace-based exercise program focusing on the participants' work demands to an exercise program delivered in a clinical setting, concluded that the work-based intervention was superior in terms of function and return-to-work outcomes. Conclusion: There is low to moderate-grade evidence that therapeutic exercises provided in a clinical setting are an effective modality to treat workers suffering from RC tendinopathy and to promote return-to-work. Further high quality studies comparing different rehabilitation programs including exercises in different settings with defined workers populations are needed to draw firm conclusions on the optimal program to treat workers. PMID:27488037

Efficacy of exercise therapy in workers with rotator cuff tendinopathy: a systematic review.

PubMed

Desmeules, François; Boudreault, Jennifer; Dionne, Clermont E; Frémont, Pierre; Lowry, Véronique; MacDermid, Joy C; Roy, Jean-Sébastien

2016-09-30

To perform a systematic review of randomized controlled trials (RCTs) on the efficacy of therapeutic exercises for workers suffering from rotator cuff (RC) tendinopathy. A literature search in four bibliographical databases (Pubmed, CINAHL, EMBASE, and PEDro) was conducted from inception up to February 2015. RCTs were included if participants were workers suffering from RC tendinopathy, the outcome measures included work-related outcomes, and at least one of the interventions under study included exercises. The methodological quality of the studies was evaluated with the Cochrane Risk of Bias Assessment tool. The mean methodological score of the ten included studies was 54.4%±17.2%. Types of workers included were often not defined, and work-related outcome measures were heterogeneous and often not validated. Three RCTs of moderate methodological quality concluded that exercises were superior to a placebo or no intervention in terms of function and return-to-work outcomes. No significant difference was found between surgery and exercises based on the results of two studies of low to moderate methodological quality. One study of low methodological quality, comparing a workplace-based exercise program focusing on the participants' work demands to an exercise program delivered in a clinical setting, concluded that the work-based intervention was superior in terms of function and return-to-work outcomes. There is low to moderate-grade evidence that therapeutic exercises provided in a clinical setting are an effective modality to treat workers suffering from RC tendinopathy and to promote return-to-work. Further high quality studies comparing different rehabilitation programs including exercises in different settings with defined workers populations are needed to draw firm conclusions on the optimal program to treat workers.

Measuring e-Commerce service quality from online customer review using sentiment analysis

NASA Astrophysics Data System (ADS)

Kencana Sari, Puspita; Alamsyah, Andry; Wibowo, Sulistyo

2018-03-01

The biggest e-Commerce challenge to understand their market is to chart their level of service quality according to customer perception. The opportunities to collect user perception through online user review is considered faster methodology than conducting direct sampling methodology. To understand the service quality level, sentiment analysis methodology is used to classify the reviews into positive and negative sentiment for five dimensions of electronic service quality (e-Servqual). As case study in this research, we use Tokopedia, one of the biggest e-Commerce service in Indonesia. We obtain the online review comments about Tokopedia service quality during several month observations. The Naïve Bayes classification methodology is applied for the reason of its high-level accuracy and support large data processing. The result revealed that personalization and reliability dimension required more attention because have high negative sentiment. Meanwhile, trust and web design dimension have high positive sentiments that means it has very good services. The responsiveness dimension have balance sentiment positive and negative.

Traditional Chinese medicine for knee osteoarthritis: An overview of systematic review

PubMed Central

Wang, Qing; Chen, Hao

2017-01-01

Background Traditional Chinese medicine (TCM) has been accepted as a complementary therapy for knee osteoarthritis. However, the efficacy and safety of the intervention were still conflicting and uncertain. Meanwhile, the quality of methodology and evidence in the field was unknown. Objective To summarize the characteristics and critically evaluate the quality of methodology, as well as the evidence of systematic reviews (SRs) on TCM for knee osteoarthritis. Methods Five electronic databases were searched from inception to April 2016. The methodological quality of the included studies was assessed by AMSTAR and ROBIS. The quality of the evidence was determined using the GRADE approach. Results Ten SRs were included. The conclusions suggest that TCM provides potential benefits for patients with knee osteoarthritis. These benefits include pain relief, functional improvement, and presence of few adverse events. Limitations of the methodological quality mainly included the lack of a-priori protocol or protocol registration and incomprehensive literature search. A list of excluded studies was also not provided. The overall quality of evidence in the SRs was poor, ranging from “very low” to “low,” mainly because of the serious risk of bias of original trials, inconsistencies, and imprecision in the outcomes. Conclusions TCM generally appears to be effective for knee osteoarthritis treatment. However, the evidence is not robust enough because of the methodological flaws in SRs. Hence, these conclusions on available SRs should be treated with caution for clinical practice. PMID:29267324

Identifying Items to Assess Methodological Quality in Physical Therapy Trials: A Factor Analysis

PubMed Central

Cummings, Greta G.; Fuentes, Jorge; Saltaji, Humam; Ha, Christine; Chisholm, Annabritt; Pasichnyk, Dion; Rogers, Todd

2014-01-01

Background Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. Objective The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). Design A methodological research design was used, and an EFA was performed. Methods Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. Results Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. Limitation Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. Conclusions To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items. PMID:24786942

Identifying items to assess methodological quality in physical therapy trials: a factor analysis.

PubMed

Armijo-Olivo, Susan; Cummings, Greta G; Fuentes, Jorge; Saltaji, Humam; Ha, Christine; Chisholm, Annabritt; Pasichnyk, Dion; Rogers, Todd

2014-09-01

Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). A methodological research design was used, and an EFA was performed. Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items. © 2014 American Physical Therapy Association.

Anti-tobacco mass media and socially disadvantaged groups: a systematic and methodological review.

PubMed

Guillaumier, Ashleigh; Bonevski, Billie; Paul, Chris

2012-07-01

Only a limited amount of research has been conducted to explore whether there are socioeconomic status differences in responses to mass media. However, the methodological quality of this evidence has not been assessed, limiting confidence in conclusions that can be drawn regarding study outcomes. A systematic review of the effectiveness of anti-tobacco mass media campaigns with socially disadvantaged groups was conducted, and the methodological quality of included studies was assessed. Medline, The Cochrane Library, PsycInfo, Embase and Web of Science were searched using MeSH and keywords for quantitative studies conducted in Western countries prior to March 2012. A methodological quality assessment and narrative analysis of included studies was undertaken. Seventeen relevant studies (reported in 18 papers) were identified; however, weak study designs and selection bias were common characteristics, limiting strong conclusions about effectiveness. Using predominantly non-cessation related outcome measures reviewed papers indicated mixed results for mass media tobacco control campaign effectiveness among various social groups. Most studies assessed mass media impact on low socioeconomic status groups rather than highly socially disadvantaged groups. Methodological rigour of evaluations in this field must be improved to aid understanding regarding the effectiveness of mass media campaigns in driving cessation among disadvantaged groups. The results of this review indicate a gap in methodologically rigorous research into the effectiveness of mass media campaigns among socially disadvantaged groups, particularly the highly disadvantaged. © 2012 Australasian Professional Society on Alcohol and other Drugs.

Methodological issues of genetic association studies.

PubMed

Simundic, Ana-Maria

2010-12-01

Genetic association studies explore the association between genetic polymorphisms and a certain trait, disease or predisposition to disease. It has long been acknowledged that many genetic association studies fail to replicate their initial positive findings. This raises concern about the methodological quality of these reports. Case-control genetic association studies often suffer from various methodological flaws in study design and data analysis, and are often reported poorly. Flawed methodology and poor reporting leads to distorted results and incorrect conclusions. Many journals have adopted guidelines for reporting genetic association studies. In this review, some major methodological determinants of genetic association studies will be discussed.

A review of economic evaluations of behavior change interventions: setting an agenda for research methods and practice.

PubMed

Alayli-Goebbels, Adrienne F G; Evers, Silvia M A A; Alexeeva, Daria; Ament, André J H A; de Vries, Nanne K; Tilly, Jan C; Severens, Johan L

2014-06-01

The objective of this study was to review methodological quality of economic evaluations of lifestyle behavior change interventions (LBCIs) and to examine how they address methodological challenges for public health economic evaluation identified in the literature. Pubmed and the NHS economic evaluation database were searched for published studies in six key areas for behavior change: smoking, physical activity, dietary behavior, (illegal) drug use, alcohol use and sexual behavior. From included studies (n = 142), we extracted data on general study characteristics, characteristics of the LBCIs, methodological quality and handling of methodological challenges. Economic evaluation evidence for LBCIs showed a number of weaknesses: methods, study design and characteristics of evaluated interventions were not well reported; methodological quality showed several shortcomings and progress with addressing methodological challenges remained limited. Based on the findings of this review we propose an agenda for improving future evidence to support decision-making. Recommendations for practice include improving reporting of essential study details and increasing adherence with good practice standards. Recommendations for research methods focus on mapping out complex causal pathways for modeling, developing measures to capture broader domains of wellbeing and community outcomes, testing methods for considering equity, identifying relevant non-health sector costs and advancing methods for evidence synthesis. © The Author 2013. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

[Quality analysis of the statistical used resources (material and methods section) in thesis projects of a university department].

PubMed

Regojo Zapata, O; Lamata Hernández, F; Sánchez Zalabardo, J M; Elizalde Benito, A; Navarro Gil, J; Valdivia Uría, J G

2004-09-01

Studies about quality in thesis and investigation projects in biomedical sciences are unusual, but very important in university teaching because is necessary to improve the quality elaboration of the thesis. The objectives the study were to determine the project's quality of thesis in our department, according to the fulfillment of the scientific methodology and to establish, if it exists, a relation between the global quality of the project and the statistical used resources. Descriptive study of 273 thesis projects performed between 1995-2002 in surgery department of the Zaragoza University. The review realized for 15 observers that they analyzed 28 indicators of every project. Giving a value to each of the indicators, the projects qualified in a scale from 1 to 10 according to the quality in the fulfillment of the scientific methodology. The mean of the project's quality was 5.53 (D.E: 1.77). In 13.9% the thesis projects was concluded with the reading of the work. The three indicators of statistical used resources had a significant difference with the value of the quality projects. The quality of the statistical resources is very important when a project of thesis wants to be realized by good methodology, because it assures to come to certain conclusions. In our study we have thought that more of the third part of the variability in the quality of the project of thesis explains for three statistical above-mentioned articles.

What is the effectiveness of obesity related interventions at retail grocery stores and supermarkets? -a systematic review.

PubMed

Adam, Abdulfatah; Jensen, Jørgen D

2016-12-28

The Prevalence of obesity and overweight has been increasing in many countries. Many factors have been identified as contributing to obesity including the food environment, especially the access, availability and affordability of healthy foods in grocery stores and supermarkets. Several interventions have been carried out in retail grocery/supermarket settings as part of an effort to understand and influence consumption of healthful foods. The review's key outcome variable is sale/purchase of healthy foods as a result of the interventions. This systematic review sheds light on the effectiveness of food store interventions intended to promote the consumption of healthy foods and the methodological quality of studies reporting them. Systematic literature search spanning from 2003 to 2015 (inclusive both years), and confined to papers in the English language was conducted. Studies fulfilling search criteria were identified and critically appraised. Studies included in this review report health interventions at physical food stores including supermarkets and corner stores, and with outcome variable of adopting healthier food purchasing/consumption behavior. The methodological quality of all included articles has been determined using a validated 16-item quality assessment tool (QATSDD). The literature search identified 1580 publications, of which 42 met the inclusion criteria. Most interventions used a combination of information (e.g. awareness raising through food labeling, promotions, campaigns, etc.) and increasing availability of healthy foods such as fruits and vegetables. Few used price interventions. The average quality score for all papers is 65.0%, or an overall medium methodological quality. Apart from few studies, most studies reported that store interventions were effective in promoting purchase of healthy foods. Given the diverse study settings and despite the challenges of methodological quality for some papers, we find efficacy of in-store healthy food interventions in terms of increased purchase of healthy foods. Researchers need to take risk of bias and methodological quality into account when designing future studies that should guide policy makers. Interventions which combine price, information and easy access to and availability of healthy foods with interactive and engaging nutrition information, if carefully designed can help customers of food stores to buy and consume more healthy foods.

Reporting and methodological quality of meta-analyses in urological literature.

PubMed

Xia, Leilei; Xu, Jing; Guzzo, Thomas J

2017-01-01

To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, " a priori " design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and " a priori " design were associated with superior reporting quality, following PRISMA guideline and " a priori " design were associated with superior methodological quality. Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having " a priori " protocol.

Methodological quality of quantitative lesbian, gay, bisexual, and transgender nursing research from 2000 to 2010.

PubMed

Johnson, Michael; Smyer, Tish; Yucha, Carolyn

2012-01-01

The purpose of this study was to evaluate the methodological quality of quantitative lesbian, gay, bisexual, and transgender nursing research from 2000 to 2010. Using a key word search in Cumulative Index to Nursing and Allied Health Literature, 188 studies were identified and 40 met the criteria, which included descriptive, experimental, quasi-experimental, or observational (case control, cohort, and cross-sectional) design. The methodological quality of these studies was similar to that reported for medical and nursing educational research. The foci of these lesbian, gay, bisexual, and transgender studies were biased toward human immunodeficiency virus, acquired immunodeficiency syndrome, and sexually transmitted diseases, and 58.5% of the funded research was related to human immunodeficiency virus or acquired immunodeficiency syndrome. To provide evidence-based health care to these populations, an understanding of the current state of research is crucial.

Social exclusion in academia through biases in methodological quality evaluation: On the situation of women in science and philosophy.

PubMed

Leuschner, Anna

2015-12-01

Empirical studies show that academia is socially exclusive. I argue that this social exclusion works, at least partly, through the systematic methodological disqualification of contributions from members of underrepresented social groups. As methodological quality criteria are underdetermined their interpretation and weighting can be biased with relation to gender, race, social background, etc. Such biased quality evaluation can take place on a local or global level. The current situation of women in academic philosophy illuminates this. I conclude that only mechanical solutions can effectively change the situation. Copyright © 2015 Elsevier Ltd. All rights reserved.

Changes in clinical trials methodology over time: a systematic review of six decades of research in psychopharmacology.

PubMed

Brunoni, André R; Tadini, Laura; Fregni, Felipe

2010-03-03

There have been many changes in clinical trials methodology since the introduction of lithium and the beginning of the modern era of psychopharmacology in 1949. The nature and importance of these changes have not been fully addressed to date. As methodological flaws in trials can lead to false-negative or false-positive results, the objective of our study was to evaluate the impact of methodological changes in psychopharmacology clinical research over the past 60 years. We performed a systematic review from 1949 to 2009 on MEDLINE and Web of Science electronic databases, and a hand search of high impact journals on studies of seven major drugs (chlorpromazine, clozapine, risperidone, lithium, fluoxetine and lamotrigine). All controlled studies published 100 months after the first trial were included. Ninety-one studies met our inclusion criteria. We analyzed the major changes in abstract reporting, study design, participants' assessment and enrollment, methodology and statistical analysis. Our results showed that the methodology of psychiatric clinical trials changed substantially, with quality gains in abstract reporting, results reporting, and statistical methodology. Recent trials use more informed consent, periods of washout, intention-to-treat approach and parametric tests. Placebo use remains high and unchanged over time. Clinical trial quality of psychopharmacological studies has changed significantly in most of the aspects we analyzed. There was significant improvement in quality reporting and internal validity. These changes have increased study efficiency; however, there is room for improvement in some aspects such as rating scales, diagnostic criteria and better trial reporting. Therefore, despite the advancements observed, there are still several areas that can be improved in psychopharmacology clinical trials.

Rating methodological quality: toward improved assessment and investigation.

PubMed

Moyer, Anne; Finney, John W

2005-01-01

Assessing methodological quality is considered essential in deciding what investigations to include in research syntheses and in detecting potential sources of bias in meta-analytic results. Quality assessment is also useful in characterizing the strengths and limitations of the research in an area of study. Although numerous instruments to measure research quality have been developed, they have lacked empirically-supported components. In addition, different summary quality scales have yielded different findings when they were used to weight treatment effect estimates for the same body of research. Suggestions for developing improved quality instruments include: distinguishing distinct domains of quality, such as internal validity, external validity, the completeness of the study report, and adherence to ethical practices; focusing on individual aspects, rather than domains of quality; and focusing on empirically-verified criteria. Other ways to facilitate the constructive use of quality assessment are to improve and standardize the reporting of research investigations, so that the quality of studies can be more equitably and thoroughly compared, and to identify optimal methods for incorporating study quality ratings into meta-analyses.

Evidence and practice in spine registries

PubMed Central

van Hooff, Miranda L; Jacobs, Wilco C H; Willems, Paul C; Wouters, Michel W J M; de Kleuver, Marinus; Peul, Wilco C; Ostelo, Raymond W J G; Fritzell, Peter

2015-01-01

Background and purpose We performed a systematic review and a survey in order to (1) evaluate the evidence for the impact of spine registries on the quality of spine care, and with that, on patient-related outcomes, and (2) evaluate the methodology used to organize, analyze, and report the “quality of spine care” from spine registries. Methods To study the impact, the literature on all spinal disorders was searched. To study methodology, the search was restricted to degenerative spinal disorders. The risk of bias in the studies included was assessed with the Newcastle-Ottawa scale. Additionally, a survey among registry representatives was performed to acquire information about the methodology and practice of existing registries. Results 4,273 unique references up to May 2014 were identified, and 1,210 were eligible for screening and assessment. No studies on impact were identified, but 34 studies were identified to study the methodology. Half of these studies (17 of the 34) were judged to have a high risk of bias. The survey identified 25 spine registries, representing 14 countries. The organization of these registries, methods used, analytical approaches, and dissemination of results are presented. Interpretation We found a lack of evidence that registries have had an impact on the quality of spine care, regardless of whether intervention was non-surgical and/or surgical. To improve the quality of evidence published with registry data, we present several recommendations. Application of these recommendations could lead to registries showing trends, monitoring the quality of spine care given, and ultimately improving the value of the care given to patients with degenerative spinal disorders. PMID:25909475

A systematic review of the association between radiographic and clinical osteoarthritis of hip and knee.

PubMed

Kinds, M B; Welsing, P M J; Vignon, E P; Bijlsma, J W J; Viergever, M A; Marijnissen, A C A; Lafeber, F P J G

2011-07-01

There is ongoing debate on whether an association between radiographic and clinical osteoarthritis (OA) exists. We hypothesized that the inconsistency in the detection of an association might be caused by different definitions of OA, by different radiographic protocols, and by scoring methods for radiographic damage and symptoms. The goal of this study was to evaluate which methodological criteria are important to detect an association between radiographic and clinical OA of hip and knee. A literature search was performed with the keywords 'OA', 'hip', 'knee', 'radiographic', and 'clinical' and results were screened for relevant studies. Quality criteria for study characteristics and methodology were developed. Studies were classified according to these criteria and the presence of an association between radiographic and clinical OA was scored. The importance of methodological quality and patient characteristics on the presence of an association was evaluated. The literature search resulted in 39 studies describing an association between radiographic and clinical OA. The frequency of an association between radiographic and clinical OA outcome measures diminished when less quality criteria were fulfilled. Specifically the criterion for standardized outcome measures appeared important in the detection of an association. The association was not influenced by patient characteristics. Only four studies were identified that fulfilled all quality criteria and in these studies an association was found for the knee joint and an inconsistent association was found for the hip joint. Methodological quality criteria are of importance to reveal an association between radiographic and clinical OA. Copyright © 2011 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

SERVQUAL Application and Adaptation for Educational Service Quality Assessments in Russian Higher Education

ERIC Educational Resources Information Center

Galeeva, Railya B.

2016-01-01

Purpose: The purpose of this study is to demonstrate an adaptation of the SERVQUAL survey method for measuring the quality of higher educational services in a Russian university context. We use a new analysis and a graphical technique for presentation of results. Design/methodology/approach: The methodology of this research follows the classic…

Evaluation of the Factors That Determine Quality in Higher Education: An Empirical Study

ERIC Educational Resources Information Center

Tsinidou, Maria; Gerogiannis, Vassilis; Fitsilis, Panos

2010-01-01

Purpose: The aim of this paper is to identify the quality determinants for education services provided by higher education institutions (HEIs) in Greece and to measure their relative importance from the students' points of view. Design/methodology/approach: A multi-criteria decision-making methodology was used for assessing the relative importance…

Methodological quality of randomised controlled trials in burns care. A systematic review.

PubMed

Danilla, Stefan; Wasiak, Jason; Searle, Susana; Arriagada, Cristian; Pedreros, Cesar; Cleland, Heather; Spinks, Anneliese

2009-11-01

To evaluate the methodological quality of published randomised controlled trials (RCTs) in burn care treatment and management. Using a predetermined search strategy we searched Ovid MEDLINE (1950 to January 2008) database to identify all English RCTs related to burn care. Full text studies identified were reviewed for key demographic and methodological characteristics. Methodological trial quality was assessed using the Jadad scale. A total of 257 studies involving 14,535 patients met the inclusion criteria. The median Jadad score was 2 (out of a best possible score of 5). Information was given in the introduction and discussion sections of most RCTs, although insufficient detail was provided on randomisation, allocation concealment, and blinding. The number of RCTs increased between 1950 and 2008 (Spearman's rho=0.6129, P<0.001), although the reporting quality did not improve over the same time period (P=0.1896) and was better in RCTs with larger sample sizes (median Jadad score, 4 vs. 2 points, P<0.0001). Methodological quality did not correlate with journal impact factor (P=0.2371). The reporting standards of RCTs are highly variable and less than optimal in most cases. The advent of evidence-based medicine heralds a new approach to burns care and systematic steps are needed to improve the quality of RCTs in this field. Identifying and reviewing the existing number of RCTs not only highlights the need for burn clinicians to conduct more trials, but may also encourage burn health clinicians to consider the importance of conducting trials that follow appropriate, evidence-based standards.

Measurement properties of translated versions of neck-specific questionnaires: a systematic review

PubMed Central

2011-01-01

Background Several disease-specific questionnaires to measure pain and disability in patients with neck pain have been translated. However, a simple translation of the original version doesn't guarantee similar measurement properties. The objective of this study is to critically appraise the quality of the translation process, cross-cultural validation and the measurement properties of translated versions of neck-specific questionnaires. Methods Bibliographic databases were searched for articles concerning the translation or evaluation of the measurement properties of a translated version of a neck-specific questionnaire. The methodological quality of the selected studies and the results of the measurement properties were critically appraised and rated using the COSMIN checklist and criteria for measurement properties. Results The search strategy resulted in a total of 3641 unique hits, of which 27 articles, evaluating 6 different questionnaires in 15 different languages, were included in this study. Generally the methodological quality of the translation process is poor and none of the included studies performed a cross-cultural adaptation. A substantial amount of information regarding the measurement properties of translated versions of the different neck-specific questionnaires is lacking. Moreover, the evidence for the quality of measurement properties of the translated versions is mostly limited or assessed in studies of poor methodological quality. Conclusions Until results from high quality studies are available, we advise to use the Catalan, Dutch, English, Iranian, Korean, Spanish and Turkish version of the NDI, the Chinese version of the NPQ, and the Finnish, German and Italian version of the NPDS. The Greek NDI needs cross-cultural validation and there is no methodologically sound information for the Swedish NDI. For all other languages we advise to translate the original version of the NDI. PMID:21645355

Measurement properties of translated versions of neck-specific questionnaires: a systematic review.

PubMed

Schellingerhout, Jasper M; Heymans, Martijn W; Verhagen, Arianne P; de Vet, Henrica C; Koes, Bart W; Terwee, Caroline B

2011-06-06

Several disease-specific questionnaires to measure pain and disability in patients with neck pain have been translated. However, a simple translation of the original version doesn't guarantee similar measurement properties. The objective of this study is to critically appraise the quality of the translation process, cross-cultural validation and the measurement properties of translated versions of neck-specific questionnaires. Bibliographic databases were searched for articles concerning the translation or evaluation of the measurement properties of a translated version of a neck-specific questionnaire. The methodological quality of the selected studies and the results of the measurement properties were critically appraised and rated using the COSMIN checklist and criteria for measurement properties. The search strategy resulted in a total of 3641 unique hits, of which 27 articles, evaluating 6 different questionnaires in 15 different languages, were included in this study. Generally the methodological quality of the translation process is poor and none of the included studies performed a cross-cultural adaptation. A substantial amount of information regarding the measurement properties of translated versions of the different neck-specific questionnaires is lacking. Moreover, the evidence for the quality of measurement properties of the translated versions is mostly limited or assessed in studies of poor methodological quality. Until results from high quality studies are available, we advise to use the Catalan, Dutch, English, Iranian, Korean, Spanish and Turkish version of the NDI, the Chinese version of the NPQ, and the Finnish, German and Italian version of the NPDS. The Greek NDI needs cross-cultural validation and there is no methodologically sound information for the Swedish NDI. For all other languages we advise to translate the original version of the NDI.

Screening for oropharyngeal dysphagia in older adults: A systematic review of self-reported questionnaires.

PubMed

Magalhães Junior, Hipólito V; Pernambuco, Leandro de Araújo; Lima, Kenio C; Ferreira, Maria Angela F

2018-04-03

Oropharyngeal dysphagia is a swallowing disorder with signs and symptoms which may be present in older adults, but they are rarely noticed as a health concern by older people. The earliest possible identification of this clinical condition is needed by self-reported population-based screening questionnaire, which are valid and reliable for preventing risks to nutritional status, increased morbidity and mortality. The aim of this systematic review was to identify self-reported screening questionnaires for oropharyngeal dysphagia in older adults to evaluate their methodological quality for population-based studies. An extensive search of electronic databases (PubMed (MEDLINE), Ovid MEDLINE(R), Scopus, Cochrane Library, CINAHL, Web of Science (WOS), PsycINFO (APA), Lilacs and Scielo) was conducted in the period from April to May 2017 using previously established search strategies by the two evaluators. The methodological quality and the psychometric properties of the included studies were evaluated by the COSMIN (Consensus based Standards for the selection of health Measurement Instruments) checklist and the quality criteria of Terwee and colleagues, respectively. The analysed information was extracted from three articles which had conducted studies on the prevalence of oropharyngeal dysphagia by self-reported screening questionnaires, showing poor methodological quality and flaws in the methodological description to demonstrate its psychometric properties. This study did not find any self-reported screening questionnaires for oropharyngeal dysphagia with suitable methodological quality and appropriate evidence in its psychometric properties for elders. Therefore, the self-reported questionnaires within the diagnostic proposal require greater details in its process for obtaining valid and reliable evidence. © 2018 John Wiley & Sons A/S and The Gerodontology Association. Published by John Wiley & Sons Ltd.

An Application of Six Sigma to Reduce Supplier Quality Cost

NASA Astrophysics Data System (ADS)

Gaikwad, Lokpriya Mohanrao; Teli, Shivagond Nagappa; Majali, Vijay Shashikant; Bhushi, Umesh Mahadevappa

2016-01-01

This article presents an application of Six Sigma to reduce supplier quality cost in manufacturing industry. Although there is a wider acceptance of Six Sigma in many organizations today, there is still a lack of in-depth case study of Six Sigma. For the present research the case study methodology was used. The company decided to reduce quality cost and improve selected processes using Six Sigma methodologies. Regarding the fact that there is a lack of case studies dealing with Six Sigma especially in individual manufacturing organization this article could be of great importance also for the practitioners. This paper discusses the quality and productivity improvement in a supplier enterprise through a case study. The paper deals with an application of Six Sigma define-measure-analyze-improve-control methodology in an industry which provides a framework to identify, quantify and eliminate sources of variation in an operational process in question, to optimize the operation variables, improve and sustain performance viz. process yield with well-executed control plans. Six Sigma improves the process performance (process yield) of the critical operational process, leading to better utilization of resources, decreases variations and maintains consistent quality of the process output.

Identifying individual changes in performance with composite quality indicators while accounting for regression to the mean.

PubMed

Gajewski, Byron J; Dunton, Nancy

2013-04-01

Almost a decade ago Morton and Torgerson indicated that perceived medical benefits could be due to "regression to the mean." Despite this caution, the regression to the mean "effects on the identification of changes in institutional performance do not seem to have been considered previously in any depth" (Jones and Spiegelhalter). As a response, Jones and Spiegelhalter provide a methodology to adjust for regression to the mean when modeling recent changes in institutional performance for one-variable quality indicators. Therefore, in our view, Jones and Spiegelhalter provide a breakthrough methodology for performance measures. At the same time, in the interests of parsimony, it is useful to aggregate individual quality indicators into a composite score. Our question is, can we develop and demonstrate a methodology that extends the "regression to the mean" literature to allow for composite quality indicators? Using a latent variable modeling approach, we extend the methodology to the composite indicator case. We demonstrate the approach on 4 indicators collected by the National Database of Nursing Quality Indicators. A simulation study further demonstrates its "proof of concept."

Methodological quality of systematic reviews analyzing the use of laser therapy in restorative dentistry.

PubMed

Salmos, Janaina; Gerbi, Marleny E M M; Braz, Rodivan; Andrade, Emanuel S S; Vasconcelos, Belmiro C E; Bessa-Nogueira, Ricardo V

2010-01-01

The purpose of this study was to identify systematic reviews (SRs) that compared laser with other dental restorative procedures and to evaluate their methodological quality. A search strategy was developed and implemented for MEDLINE, the Cochrane Library, LILACS, and the Brazilian Dentistry Bibliography (1966- 2007). Inclusion criteria were: the article had to be an SR (+/- meta-analysis); primary focus was the use of laser in restorative dentistry; published in English, Spanish, Portuguese, Italian, German. Two investigators independently selected and evaluated the SRs. The overview quality assessment questionnaire (OQAQ) was used to evaluate methodological quality, and the results were averaged. There were 145 references identified, of which seven were SRs that met the inclusion criteria (kappa=0.81). Of the SRs, 71.4% appraised lasers in dental caries diagnosis. The mean overall OQAQ score was 4.4 [95% confidence interval (CI) 2.4- 6.5]. Of the SRs, 57.1% had major flaws, scoring < or = 4. SR methodological quality is low; therefore, clinicians should critically appraise them prior to considering their recommendations to guide patient care.

The economic burden of patient safety targets in acute care: a systematic review

PubMed Central

Mittmann, Nicole; Koo, Marika; Daneman, Nick; McDonald, Andrew; Baker, Michael; Matlow, Anne; Krahn, Murray; Shojania, Kaveh G; Etchells, Edward

2012-01-01

Background Our objective was to determine the quality of literature in costing of the economic burden of patient safety. Methods We selected 15 types of patient safety targets for our systematic review. We searched the literature published between 2000 and 2010 using the following terms: “costs and cost analysis,” “cost-effectiveness,” “cost,” and “financial management, hospital.” We appraised the methodologic quality of potentially relevant studies using standard economic methods. We recorded results in the original currency, adjusted for inflation, and then converted to 2010 US dollars for comparative purposes (2010 US$1.00 = 2010 €0.76). The quality of each costing study per patient safety target was also evaluated. Results We screened 1948 abstracts, and identified 158 potentially eligible studies, of which only 61 (39%) reported any costing methodology. In these 61 studies, we found wide estimates of the attributable costs of patient safety events ranging from $2830 to $10,074. In general hospital populations, the cost per case of hospital-acquired infection ranged from $2132 to $15,018. Nosocomial bloodstream infection was associated with costs ranging from $2604 to $22,414. Conclusion There are wide variations in the estimates of economic burden due to differences in study methods and methodologic quality. Greater attention to methodologic standards for economic evaluations in patient safety is needed. PMID:23097615

A Methodology for Anatomic Ultrasound Image Diagnostic Quality Assessment.

PubMed

Hemmsen, Martin Christian; Lange, Theis; Brandt, Andreas Hjelm; Nielsen, Michael Bachmann; Jensen, Jorgen Arendt

2017-01-01

This paper discusses the methods for the assessment of ultrasound image quality based on our experiences with evaluating new methods for anatomic imaging. It presents a methodology to ensure a fair assessment between competing imaging methods using clinically relevant evaluations. The methodology is valuable in the continuing process of method optimization and guided development of new imaging methods. It includes a three phased study plan covering from initial prototype development to clinical assessment. Recommendations to the clinical assessment protocol, software, and statistical analysis are presented. Earlier uses of the methodology has shown that it ensures validity of the assessment, as it separates the influences between developer, investigator, and assessor once a research protocol has been established. This separation reduces confounding influences on the result from the developer to properly reveal the clinical value. This paper exemplifies the methodology using recent studies of synthetic aperture sequential beamforming tissue harmonic imaging.

Virtual reality exposure therapy for the treatment of posttraumatic stress disorder: a methodological review using CONSORT guidelines.

PubMed

Motraghi, Terri E; Seim, Richard W; Meyer, Eric C; Morissette, Sandra B

2014-03-01

Virtual reality exposure therapy (VRET) is an extension of traditional exposure therapy and has been used to treat a variety of anxiety disorders. VRET utilizes a computer-generated virtual environment to present fear-relevant stimuli. Recent studies have evaluated the use of VRET for treatment of PTSD; however, a systematic evaluation of the methodological quality of these studies has yet to be conducted. This review aims to (a) identify treatment outcome studies examining the use of VRET for the treatment of PTSD and (b) appraise the methodological quality of each study using the 2010 Consolidating Standards of Reporting Trials (CONSORT) Statement and its 2008 extension for nonpharmacologic interventions. Two independent assessors conducted a database search (PsycINFO, Medline, CINAHL, Google Scholar) of studies published between January 1990 and June 2013 that reported outcome data comparing VRET with another type of treatment or a control condition. Next, a CONSORT quality appraisal of each study was completed. The search yielded nine unique studies. The CONSORT appraisal revealed that the methodological quality of studies examining VRET as a treatment for PTSD was variable. Although preliminary findings suggest some positive results for VRET as a form of exposure treatment for PTSD, additional research using well-specified randomization procedures, assessor blinding, and monitoring of treatment adherence is warranted. Movement toward greater standardization of treatment manuals, virtual environments, and equipment would further facilitate interpretation and consolidation of this literature. © 2013 Wiley Periodicals, Inc.

Methodologic quality of meta-analyses and systematic reviews on the Mediterranean diet and cardiovascular disease outcomes: a review.

PubMed

Huedo-Medina, Tania B; Garcia, Marissa; Bihuniak, Jessica D; Kenny, Anne; Kerstetter, Jane

2016-03-01

Several systematic reviews/meta-analyses published within the past 10 y have examined the associations of Mediterranean-style diets (MedSDs) on cardiovascular disease (CVD) risk. However, these reviews have not been evaluated for satisfying contemporary methodologic quality standards. This study evaluated the quality of recent systematic reviews/meta-analyses on MedSD and CVD risk outcomes by using an established methodologic quality scale. The relation between review quality and impact per publication value of the journal in which the article had been published was also evaluated. To assess compliance with current standards, we applied a modified version of the Assessment of Multiple Systematic Reviews (AMSTARMedSD) quality scale to systematic reviews/meta-analyses retrieved from electronic databases that had met our selection criteria: 1) used systematic or meta-analytic procedures to review the literature, 2) examined MedSD trials, and 3) had MedSD interventions independently or combined with other interventions. Reviews completely satisfied from 8% to 75% of the AMSTARMedSD items (mean ± SD: 31.2% ± 19.4%), with those published in higher-impact journals having greater quality scores. At a minimum, 60% of the 24 reviews did not disclose full search details or apply appropriate statistical methods to combine study findings. Only 5 of the reviews included participant or study characteristics in their analyses, and none evaluated MedSD diet characteristics. These data suggest that current meta-analyses/systematic reviews evaluating the effect of MedSD on CVD risk do not fully comply with contemporary methodologic quality standards. As a result, there are more research questions to answer to enhance our understanding of how MedSD affects CVD risk or how these effects may be modified by the participant or MedSD characteristics. To clarify the associations between MedSD and CVD risk, future meta-analyses and systematic reviews should not only follow methodologic quality standards but also include more statistical modeling results when data allow. © 2016 American Society for Nutrition.

Methodological quality and descriptive characteristics of prosthodontic-related systematic reviews.

PubMed

Aziz, T; Compton, S; Nassar, U; Matthews, D; Ansari, K; Flores-Mir, C

2013-04-01

Ideally, healthcare systematic reviews (SRs) should be beneficial to practicing professionals in making evidence-based clinical decisions. However, the conclusions drawn from SRs are directly related to the quality of the SR and of the included studies. The aim was to investigate the methodological quality and key descriptive characteristics of SRs published in prosthodontics. Methodological quality was analysed using the Assessment of Multiple Reviews (AMSTAR) tool. Several electronic resources (MEDLINE, EMBASE, Web of Science and American Dental Association's Evidence-based Dentistry website) were searched. In total 106 SRs were located. Key descriptive characteristics and methodological quality features were gathered and assessed, and descriptive and inferential statistical testing performed. Most SRs in this sample originated from the European continent followed by North America. Two to five authors conducted most SRs; the majority was affiliated with academic institutions and had prior experience publishing SRs. The majority of SRs were published in specialty dentistry journals, with implant or implant-related topics, the primary topics of interest for most. According to AMSTAR, most quality aspects were adequately fulfilled by less than half of the reviews. Publication bias and grey literature searches were the most poorly adhered components. Overall, the methodological quality of the prosthodontic-related systematic was deemed limited. Future recommendations would include authors to have prior training in conducting SRs and for journals to include a universal checklist that should be adhered to address all key characteristics of an unbiased SR process. © 2013 Blackwell Publishing Ltd.

Systematic Review of the Application of Lean and Six Sigma Quality Improvement Methodologies in Radiology.

PubMed

Amaratunga, Thelina; Dobranowski, Julian

2016-09-01

Preventable yet clinically significant rates of medical error remain systemic, while health care spending is at a historic high. Industry-based quality improvement (QI) methodologies show potential for utility in health care and radiology because they use an empirical approach to reduce variability and improve workflow. The aim of this review was to systematically assess the literature with regard to the use and efficacy of Lean and Six Sigma (the most popular of the industrial QI methodologies) within radiology. MEDLINE, the Allied & Complementary Medicine Database, Embase Classic + Embase, Health and Psychosocial Instruments, and the Ovid HealthStar database, alongside the Cochrane Library databases, were searched on June 2015. Empirical studies in peer-reviewed journals were included if they assessed the use of Lean, Six Sigma, or Lean Six Sigma with regard to their ability to improve a variety of quality metrics in a radiology-centered clinical setting. Of the 278 articles returned, 23 studies were suitable for inclusion. Of these, 10 assessed Six Sigma, 7 assessed Lean, and 6 assessed Lean Six Sigma. The diverse range of measured outcomes can be organized into 7 common aims: cost savings, reducing appointment wait time, reducing in-department wait time, increasing patient volume, reducing cycle time, reducing defects, and increasing staff and patient safety and satisfaction. All of the included studies demonstrated improvements across a variety of outcomes. However, there were high rates of systematic bias and imprecision as per the Grading of Recommendations Assessment, Development and Evaluation guidelines. Lean and Six Sigma QI methodologies have the potential to reduce error and costs and improve quality within radiology. However, there is a pressing need to conduct high-quality studies in order to realize the true potential of these QI methodologies in health care and radiology. Recommendations on how to improve the quality of the literature are proposed. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Systematic reviews and meta-analyses on psoriasis: role of funding sources, conflict of interest and bibliometric indices as predictors of methodological quality.

PubMed

Gómez-García, F; Ruano, J; Aguilar-Luque, M; Gay-Mimbrera, J; Maestre-Lopez, B; Sanz-Cabanillas, J L; Carmona-Fernández, P J; González-Padilla, M; Vélez García-Nieto, A; Isla-Tejera, B

2017-06-01

The quality of systematic reviews and meta-analyses on psoriasis, a chronic inflammatory skin disease that severely impairs quality of life and is associated with high costs, remains unknown. To assess the methodological quality of systematic reviews published on psoriasis. After a comprehensive search in MEDLINE, Embase and the Cochrane Database (PROSPERO: CDR42016041611), the quality of studies was assessed by two raters using the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Article metadata and journal-related bibliometric indices were also obtained. Systematic reviews were classified as low (0-4), moderate (5-8) or high (9-11) quality. A prediction model for methodological quality was fitted using principal component and multivariate ordinal logistic regression analyses. We classified 220 studies as high (17·2%), moderate (55·0%) or low (27·8%) quality. Lower compliance rates were found for AMSTAR question (Q)5 (list of studies provided, 11·4%), Q10 (publication bias assessed, 27·7%), Q4 (status of publication included, 39·5%) and Q1 (a priori design provided, 40·9%). Factors such as meta-analysis inclusion [odds ratio (OR) 6·22; 95% confidence interval (CI) 2·78-14·86], funding by academic institutions (OR 2·90, 95% CI 1·11-7·89), Article Influence score (OR 2·14, 95% CI 1·05-6·67), 5-year impact factor (OR 1·34, 95% CI 1·02-1·40) and article page count (OR 1·08, 95% CI 1·02-1·15) significantly predicted higher quality. A high number of authors with a conflict of interest (OR 0·90, 95% CI 0·82-0·99) was significantly associated with lower quality. The methodological quality of systematic reviews published about psoriasis remains suboptimal. The type of funding sources and author conflicts may compromise study quality, increasing the risk of bias. © 2017 British Association of Dermatologists.

Reporting and methodological quality of meta-analyses in urological literature

PubMed Central

Xu, Jing

2017-01-01

Purpose To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. Materials and Methods We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. Results A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, “a priori” design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and “a priori” design were associated with superior reporting quality, following PRISMA guideline and “a priori” design were associated with superior methodological quality. Conclusions Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having “a priori” protocol. PMID:28439452

A Proposal for Six Sigma Integration for Large-Scale Production of Penicillin G and Subsequent Conversion to 6-APA.

PubMed

Nandi, Anirban; Pan, Sharadwata; Potumarthi, Ravichandra; Danquah, Michael K; Sarethy, Indira P

2014-01-01

Six Sigma methodology has been successfully applied to daily operations by several leading global private firms including GE and Motorola, to leverage their net profits. Comparatively, limited studies have been conducted to find out whether this highly successful methodology can be applied to research and development (R&D). In the current study, we have reviewed and proposed a process for a probable integration of Six Sigma methodology to large-scale production of Penicillin G and its subsequent conversion to 6-aminopenicillanic acid (6-APA). It is anticipated that the important aspects of quality control and quality assurance will highly benefit from the integration of Six Sigma methodology in mass production of Penicillin G and/or its conversion to 6-APA.

A Proposal for Six Sigma Integration for Large-Scale Production of Penicillin G and Subsequent Conversion to 6-APA

PubMed Central

Nandi, Anirban; Danquah, Michael K.

2014-01-01

Six Sigma methodology has been successfully applied to daily operations by several leading global private firms including GE and Motorola, to leverage their net profits. Comparatively, limited studies have been conducted to find out whether this highly successful methodology can be applied to research and development (R&D). In the current study, we have reviewed and proposed a process for a probable integration of Six Sigma methodology to large-scale production of Penicillin G and its subsequent conversion to 6-aminopenicillanic acid (6-APA). It is anticipated that the important aspects of quality control and quality assurance will highly benefit from the integration of Six Sigma methodology in mass production of Penicillin G and/or its conversion to 6-APA. PMID:25057428

The reliability of physical examination tests for the diagnosis of anterior cruciate ligament rupture--A systematic review.

PubMed

Lange, Toni; Freiberg, Alice; Dröge, Patrik; Lützner, Jörg; Schmitt, Jochen; Kopkow, Christian

2015-06-01

Systematic literature review. Despite their frequent application in routine care, a systematic review on the reliability of clinical examination tests to evaluate the integrity of the ACL is missing. To summarize and evaluate intra- and interrater reliability research on physical examination tests used for the diagnosis of ACL tears. A comprehensive systematic literature search was conducted in MEDLINE, EMBASE and AMED until May 30th 2013. Studies were included if they assessed the intra- and/or interrater reliability of physical examination tests for the integrity of the ACL. Methodological quality was evaluated with the Quality Appraisal of Reliability Studies (QAREL) tool by two independent reviewers. 110 hits were achieved of which seven articles finally met the inclusion criteria. These studies examined the reliability of four physical examination tests. Intrarater reliability was assessed in three studies and ranged from fair to almost perfect (Cohen's k = 0.22-1.00). Interrater reliability was assessed in all included studies and ranged from slight to almost perfect (Cohen's k = 0.02-0.81). The Lachman test is the physical tests with the highest intrarater reliability (Cohen's k = 1.00), the Lachman test performed in prone position the test with the highest interrater reliability (Cohen's k = 0.81). Included studies were partly of low methodological quality. A meta-analysis could not be performed due to the heterogeneity in study populations, reliability measures and methodological quality of included studies. Systematic investigations on the reliability of physical examination tests to assess the integrity of the ACL are scarce and of varying methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

Information security system quality assessment through the intelligent tools

NASA Astrophysics Data System (ADS)

Trapeznikov, E. V.

2018-04-01

The technology development has shown the automated system information security comprehensive analysis necessity. The subject area analysis indicates the study relevance. The research objective is to develop the information security system quality assessment methodology based on the intelligent tools. The basis of the methodology is the information security assessment model in the information system through the neural network. The paper presents the security assessment model, its algorithm. The methodology practical implementation results in the form of the software flow diagram are represented. The practical significance of the model being developed is noted in conclusions.

The reliability of the Glasgow Coma Scale: a systematic review.

PubMed

Reith, Florence C M; Van den Brande, Ruben; Synnot, Anneliese; Gruen, Russell; Maas, Andrew I R

2016-01-01

The Glasgow Coma Scale (GCS) provides a structured method for assessment of the level of consciousness. Its derived sum score is applied in research and adopted in intensive care unit scoring systems. Controversy exists on the reliability of the GCS. The aim of this systematic review was to summarize evidence on the reliability of the GCS. A literature search was undertaken in MEDLINE, EMBASE and CINAHL. Observational studies that assessed the reliability of the GCS, expressed by a statistical measure, were included. Methodological quality was evaluated with the consensus-based standards for the selection of health measurement instruments checklist and its influence on results considered. Reliability estimates were synthesized narratively. We identified 52 relevant studies that showed significant heterogeneity in the type of reliability estimates used, patients studied, setting and characteristics of observers. Methodological quality was good (n = 7), fair (n = 18) or poor (n = 27). In good quality studies, kappa values were ≥0.6 in 85%, and all intraclass correlation coefficients indicated excellent reliability. Poor quality studies showed lower reliability estimates. Reliability for the GCS components was higher than for the sum score. Factors that may influence reliability include education and training, the level of consciousness and type of stimuli used. Only 13% of studies were of good quality and inconsistency in reported reliability estimates was found. Although the reliability was adequate in good quality studies, further improvement is desirable. From a methodological perspective, the quality of reliability studies needs to be improved. From a clinical perspective, a renewed focus on training/education and standardization of assessment is required.

Measurement properties of tools measuring mental health knowledge: a systematic review.

PubMed

Wei, Yifeng; McGrath, Patrick J; Hayden, Jill; Kutcher, Stan

2016-08-23

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties. We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown". We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools. Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

Methodological and Reporting Quality of Systematic Reviews and Meta-analyses in Endodontics.

PubMed

Nagendrababu, Venkateshbabu; Pulikkotil, Shaju Jacob; Sultan, Omer Sheriff; Jayaraman, Jayakumar; Peters, Ove A

2018-06-01

The aim of this systematic review (SR) was to evaluate the quality of SRs and meta-analyses (MAs) in endodontics. A comprehensive literature search was conducted to identify relevant articles in the electronic databases from January 2000 to June 2017. Two reviewers independently assessed the articles for eligibility and data extraction. SRs and MAs on interventional studies with a minimum of 2 therapeutic strategies in endodontics were included in this SR. Methodologic and reporting quality were assessed using A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA), respectively. The interobserver reliability was calculated using the Cohen kappa statistic. Statistical analysis with the level of significance at P < .05 was performed using Kruskal-Wallis tests and simple linear regression analysis. A total of 30 articles were selected for the current SR. Using AMSTAR, the item related to the scientific quality of studies used in conclusion was adhered by less than 40% of studies. Using PRISMA, 3 items were reported by less than 40% of studies, which were on objectives, protocol registration, and funding. No association was evident comparing the number of authors and country with quality. Statistical significance was observed when quality was compared among journals, with studies published as Cochrane reviews superior to those published in other journals. AMSTAR and PRISMA scores were significantly related. SRs in endodontics showed variability in both methodologic and reporting quality. Copyright © 2018 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina.

PubMed

Zhang, Xiaoxia; Wang, Hui; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina

PubMed Central

Zhang, Xiaoxia; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved. PMID:26539221

Prediction of ground water quality index to assess suitability for drinking purposes using fuzzy rule-based approach

NASA Astrophysics Data System (ADS)

Gorai, A. K.; Hasni, S. A.; Iqbal, Jawed

2016-11-01

Groundwater is the most important natural resource for drinking water to many people around the world, especially in rural areas where the supply of treated water is not available. Drinking water resources cannot be optimally used and sustained unless the quality of water is properly assessed. To this end, an attempt has been made to develop a suitable methodology for the assessment of drinking water quality on the basis of 11 physico-chemical parameters. The present study aims to select the fuzzy aggregation approach for estimation of the water quality index of a sample to check the suitability for drinking purposes. Based on expert's opinion and author's judgement, 11 water quality (pollutant) variables (Alkalinity, Dissolved Solids (DS), Hardness, pH, Ca, Mg, Fe, Fluoride, As, Sulphate, Nitrates) are selected for the quality assessment. The output results of proposed methodology are compared with the output obtained from widely used deterministic method (weighted arithmetic mean aggregation) for the suitability of the developed methodology.

78 FR 40149 - Scientific Information Request on Chronic Urinary Retention (CUR) Treatment

Federal Register 2010, 2011, 2012, 2013, 2014

2013-07-03

... improve the quality of this review. AHRQ is conducting this comparative effectiveness review pursuant to..., study period, design, methodology, indication and diagnosis, proper use instructions, inclusion and... study number, the study period, design, methodology, indication and diagnosis, proper use instructions...

Methodological quality evaluation of systematic reviews or meta-analyses on ERCC1 in non-small cell lung cancer: a systematic review.

PubMed

Tao, Huan; Zhang, Yueyuan; Li, Qian; Chen, Jin

2017-11-01

To assess the methodological quality of systematic reviews (SRs) or meta-analysis concerning the predictive value of ERCC1 in platinum chemotherapy of non-small cell lung cancer. We searched the PubMed, EMbase, Cochrane library, international prospective register of systematic reviews, Chinese BioMedical Literature Database, China National Knowledge Infrastructure, Wan Fang and VIP database for SRs or meta-analysis. The methodological quality of included literatures was evaluated by risk of bias in systematic review (ROBIS) scale. Nineteen eligible SRs/meta-analysis were included. The most frequently searched databases were EMbase (74%), PubMed, Medline and CNKI. Fifteen SRs did additional retrieval manually, but none of them retrieved the registration platform. 47% described the two-reviewers model in the screening for eligible original articles, and seven SRs described the two reviewers to extract data. In methodological quality assessment, inter-rater reliability Kappa was 0.87 between two reviewers. Research question were well related to all SRs in phase 1 and the eligibility criteria was suitable for each SR, and rated as 'low' risk bias. But the 'high' risk bias existed in all the SRs regarding methods used to identify and/or select studies, and data collection and study appraisal. More than two-third of SRs or meta-analysis were finished with high risk of bias in the synthesis, findings and the final phase. The study demonstrated poor methodological quality of SRs/meta-analysis assessing the predictive value of ERCC1 in chemotherapy among the NSCLC patients, especially the high performance bias. Registration or publishing the protocol is recommended in future research.

Education in cardiopulmonary resuscitation in Russia: A systematic review of the available evidence

PubMed Central

Birkun, Alexei; Glotov, Maksim

2017-01-01

BACKGROUND: To summarise and appraise cumulative published scientific evidence relevant to cardiopulmonary resuscitation (CPR) education in Russia. DATA RESOURCES: We searched Medline, Scopus, Science Direct and Russian Science Citation Index databases from December 1991 to December 2016 to identify studies pertaining to the field of CPR education that were carried out by Russian researchers and/or investigated the topic of interest for Russia/Russian population. Reference lists of eligible publications, contents pages of relevant Russian journals and Google Scholar were also searched. There was no limitation based on publication language or study design. RESULTS: Of 7 964 unique citations identified, 22 studies were included. All studies were published from 2009 to 2016, mainly in Russian. Only three studies were reported to be randomized controlled. Non-medical individuals constituted 17% of studied populations. Most of the studies aimed to assess effects of CPR educational interventions, generally suggesting positive influence of the training conducted. The studies were highly heterogeneous as for methodological approaches, structure and duration of educational interventions, evaluation methods and criteria being used. Methodological quality was generally poor, with >40% publications not passing quality screening and only 2 studies meeting the criteria of moderate high quality. CONCLUSION: The results suggest paucity, low population coverage, high thematic and methodological heterogeneity and low quality of the studies addressing CPR education, which were carried out in the Russian Federation. There is a critical need in conducting methodologically consistent, large-scale, randomized, controlled studies evaluating and comparing efficiency of educational interventions for teaching CPR in different population categories of Russia. PMID:29123601

Methodological quality of systematic reviews referenced in clinical practice guidelines for the treatment of opioid use disorder.

PubMed

Ross, Andrew; Rankin, Justin; Beaman, Jason; Murray, Kelly; Sinnett, Philip; Riddle, Ross; Haskins, Jordan; Vassar, Matt

2017-01-01

With efforts to combat opioid use disorder, there is an increased interest in clinical practice guidelines (CPGs) for opioid use disorder treatments. No literature exists examining the quality of systematic reviews used in opioid use disorder CPGs. This study aims to describe the methodological quality and reporting clarity of systematic reviews (SRs) used to create CPGs for opioid use disorder. From June to July 2016 guideline clearinghouses and medical literature databases were searched for relevant CPGs used in the treatment of opioid use disorder. Included CPGs must have been recognized by a national organization. SRs from the reference section of each CPG was scored by using AMSTAR (a measurement tool to assess the methodological quality of systematic reviews) tool and PRISMA (preferred reporting items for systematic reviews and meta-analyses) checklist. Seventeen CPGs from 2006-2016 were included in the review. From these, 57 unique SRs were extracted. SRS comprised 0.28% to 17.92% of all references found in the CPGs. All SRs obtained moderate or high methodological quality score on the AMSTAR tool. All reviews met at least 70% of PRISMA criteria. In PRISMA, underperforming areas included accurate title labeling, protocol registration, and risk of bias. Underperforming areas in AMSTAR included conflicts of interest, funding, and publication bias. A positive correlation was found between AMSTAR and PRISMA scores (r = .79). Although the SRs in the CPGs were of good quality, there are still areas for improvement. Systematic reviewers should consult PRISMA and AMSTAR when conducting and reporting reviews. It is important for CPG developers to consider methodological quality as a factor when developing CPG recommendations, recognizing that the quality of systematic reviews underpinning guidelines does not necessarily correspond to the quality of the guideline itself.

Forty years of quality-of-life research in congenital heart disease: Temporal trends in conceptual and methodological rigor.

PubMed

Bratt, Ewa-Lena; Moons, Philip

2015-09-15

The first study on quality of life (QoL) in patients with congenital heart disease was published 40 years ago. Since then, the number of QoL articles on these patients has grown exponentially. We conducted a systematic literature review of all empirical studies on QoL in patients with congenital heart disease published since 1974, with the aim of determining the range of conceptual and methodological rigor of studies and identifying temporal trends in these parameters. PubMed, Embase, and Cinahl were searched for empirical studies addressing QoL in children, adolescents, or adults with congenital heart disease, published between January 1, 1974, and December 31, 2014. We applied 10 review criteria that were previously developed by Gill and Feinstein in 1994 and further refined by Moons et al. in 2004. Overall, 234 articles were reviewed. We found slight but non-significant temporal improvements in conceptual and methodological rigor and in use of assessment methods. This indicates a trend toward a more professional and exacting approach in QoL assessments. However, the majority of articles still had substantial conceptual and methodological deficits. Furthermore, we observed that citation of the publications of Gill and Feinstein and Moons et al. in published QoL research is associated with higher quality scores, suggesting that these articles have a positive impact on conceptual and methodological caliber. Despite 40 years of QoL research in this field, this review shows that major weaknesses in methodological rigor remain highly prevalent, which may make QoL studies inconclusive. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

The quality of quality of life publications in the spinal literature: are we getting any better?

PubMed

Street, John; Lenehan, Brian; Fisher, Charles

2009-11-01

Criteria for methodological quality have been widely accepted in many fields of surgical practice. These criteria include those of Velanovich and Gill and Feinstein. No such analysis of the spine surgery literature has ever been reported. This study is a systematic review of the quality of life (QOL) publications to determine if the recent interest in QOL measurements following spinal surgery has been accompanied by an improvement in the quality of the papers published. The archives of the journals Journal of Neurosurgery: Spine, Spine, Journal of Spinal Disorders & Techniques, European Spine Journal, and The Spine Journal, for the years 2000-2004 inclusive, were examined, and all publications reporting QOL outcomes were analyzed. Each paper was scored according to the criteria of Velanovich and Gill and Feinstein, and the methodological quality of these manuscripts-and any time-dependent changes-were determined. During the study period, the total number of articles published increased by 36%, while the number of QOL articles increased by 102%. According to the criteria of Velanovich, there was a statistically significant improvement in the quality of the publications over the study period (p = 0.0394). In 2000, only 27% of outcome measures were disease specific, 77% were valid, and 77% were appropriate for the study design. In 2004, 43% were disease specific, 88% were valid, and 89% were appropriate. In 2000, 53% of studies used appropriate statistical analysis compared with 100 and 96% for 2003 and 2004, respectively. There was no demonstrable improvement in the fulfillment of the more rigorous Gill and Feinstein criteria for any of the 5 journals over the period of the study. The authors' study illustrates a moderate improvement in the quality of these publications over the study period but much methodological improvement is required.

Assessing medical professionalism: A systematic review of instruments and their measurement properties.

PubMed

Li, Honghe; Ding, Ning; Zhang, Yuanyuan; Liu, Yang; Wen, Deliang

2017-01-01

Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments' measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990-2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument's usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee's criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar's instrument for nursing students, Nurse Practitioners' Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies.

Retinal Image Quality Assessment for Spaceflight-Induced Vision Impairment Study

NASA Technical Reports Server (NTRS)

Vu, Amanda Cadao; Raghunandan, Sneha; Vyas, Ruchi; Radhakrishnan, Krishnan; Taibbi, Giovanni; Vizzeri, Gianmarco; Grant, Maria; Chalam, Kakarla; Parsons-Wingerter, Patricia

2015-01-01

Long-term exposure to space microgravity poses significant risks for visual impairment. Evidence suggests such vision changes are linked to cephalad fluid shifts, prompting a need to directly quantify microgravity-induced retinal vascular changes. The quality of retinal images used for such vascular remodeling analysis, however, is dependent on imaging methodology. For our exploratory study, we hypothesized that retinal images captured using fluorescein imaging methodologies would be of higher quality in comparison to images captured without fluorescein. A semi-automated image quality assessment was developed using Vessel Generation Analysis (VESGEN) software and MATLAB® image analysis toolboxes. An analysis of ten images found that the fluorescein imaging modality provided a 36% increase in overall image quality (two-tailed p=0.089) in comparison to nonfluorescein imaging techniques.

Improving Mathematics Performance among Secondary Students with EBD: A Methodological Review

ERIC Educational Resources Information Center

Mulcahy, Candace A.; Krezmien, Michael P.; Travers, Jason

2016-01-01

In this methodological review, the authors apply special education research quality indicators and standards for single case design to analyze mathematics intervention studies for secondary students with emotional and behavioral disorders (EBD). A systematic methodological review of literature from 1975 to December 2012 yielded 19 articles that…

Adherence of hip and knee arthroplasty studies to RSA standardization guidelines. A systematic review.

PubMed

Madanat, Rami; Mäkinen, Tatu J; Aro, Hannu T; Bragdon, Charles; Malchau, Henrik

2014-09-01

Guidelines for standardization of radiostereometry (RSA) of implants were published in 2005 to facilitate comparison of outcomes between various research groups. In this systematic review, we determined how well studies have adhered to these guidelines. We carried out a literature search to identify all articles published between January 2000 and December 2011 that used RSA in the evaluation of hip or knee prosthesis migration. 2 investigators independently evaluated each of the studies for adherence to the 13 individual guideline items. Since some of the 13 points included more than 1 criterion, studies were assessed on whether each point was fully met, partially met, or not met. 153 studies that met our inclusion criteria were identified. 61 of these were published before the guidelines were introduced (2000-2005) and 92 after the guidelines were introduced (2006-2011). The methodological quality of RSA studies clearly improved from 2000 to 2011. None of the studies fully met all 13 guidelines. Nearly half (43) of the studies published after the guidelines demonstrated a high methodological quality and adhered at least partially to 10 of the 13 guidelines, whereas less than one-fifth (11) of the studies published before the guidelines had the same methodological quality. Commonly unaddressed guideline items were related to imaging methodology, determination of precision from double examinations, and also mean error of rigid-body fitting and condition number cutoff levels. The guidelines have improved methodological reporting in RSA studies, but adherence to these guidelines is still relatively low. There is a need to update and clarify the guidelines for clinical hip and knee arthroplasty RSA studies.

Cost-effectiveness analyses of hepatitis A vaccine: a systematic review to explore the effect of methodological quality on the economic attractiveness of vaccination strategies.

PubMed

Anonychuk, Andrea M; Tricco, Andrea C; Bauch, Chris T; Pham, Ba'; Gilca, Vladimir; Duval, Bernard; John-Baptiste, Ava; Woo, Gloria; Krahn, Murray

2008-01-01

Hepatitis A vaccines have been available for more than a decade. Because the burden of hepatitis A virus has fallen in developed countries, the appropriate role of vaccination programmes, especially universal vaccination strategies, remains unclear. Cost-effectiveness analysis is a useful method of relating the costs of vaccination to its benefits, and may inform policy. This article systematically reviews the evidence on the cost effectiveness of hepatitis A vaccination in varying populations, and explores the effects of methodological quality and key modelling issues on the cost-effectiveness ratios.Cost-effectiveness/cost-utility studies of hepatitis A vaccine were identified via a series of literature searches (MEDLINE, EMBASE, HSTAR and SSCI). Citations and full-text articles were reviewed independently by two reviewers. Reference searching, author searches and expert consultation ensured literature saturation. Incremental cost-effectiveness ratios (ICERs) were abstracted for base-case analyses, converted to $US, year 2005 values, and categorised to reflect various levels of cost effectiveness. Quality of reporting, methodological issues and key modelling issues were assessed using frameworks published in the literature.Thirty-one cost-effectiveness studies (including 12 cost-utility analyses) were included from full-text article review (n = 58) and citation screening (n = 570). These studies evaluated universal mass vaccination (n = 14), targeted vaccination (n = 17) and vaccination of susceptibles (i.e. individuals initially screened for antibody and, if susceptible, vaccinated) [n = 13]. For universal vaccination, 50% of the ICERs were <$US20 000 per QALY or life-year gained. Analyses evaluating vaccination in children, particularly in high incidence areas, produced the most attractive ICERs. For targeted vaccination, cost effectiveness was highly dependent on the risk of infection.Incidence, vaccine cost and discount rate were the most influential parameters in sensitivity analyses. Overall, analyses that evaluated the combined hepatitis A/hepatitis B vaccine, adjusted incidence for under-reporting, included societal costs and that came from studies of higher methodological quality tended to have more attractive cost-effectiveness ratios. Methodological quality varied across studies. Major methodological flaws included inappropriate model type, comparator, incidence estimate and inclusion/exclusion of costs.

Student Involvement in the Egyptian Quality Assurance System

ERIC Educational Resources Information Center

Elassy, Noha

2015-01-01

Purpose: The purpose of this paper is to study the extent and the quality of student involvement in the quality assurance process (QAP) in Egyptian higher education institutions (HEIs). Design/methodology/approach: In this study, two qualitative methods were used to explore the extent and the quality of student involvement; these were focus groups…

Benchmarking Potential Factors Leading to Education Quality: A Study of Cambodian Higher Education

ERIC Educational Resources Information Center

Chen, Ching-Yaw; Sok, Phyra; Sok, Keomony

2007-01-01

Purpose: To study the quality in higher education in Cambodia and explore the potential factors leading to quality in Cambodian higher education. Design/methodology/approach: Five main factors that were deemed relevant in providing quality in Cambodian higher education were proposed: academic curriculum and extra-curricular activities, teachers'…

Methodology in diagnostic laboratory test research in clinical chemistry and clinical chemistry and laboratory medicine.

PubMed

Lumbreras-Lacarra, Blanca; Ramos-Rincón, José Manuel; Hernández-Aguado, Ildefonso

2004-03-01

The application of epidemiologic principles to clinical diagnosis has been less developed than in other clinical areas. Knowledge of the main flaws affecting diagnostic laboratory test research is the first step for improving its quality. We assessed the methodologic aspects of articles on laboratory tests. We included articles that estimated indexes of diagnostic accuracy (sensitivity and specificity) and were published in Clinical Chemistry or Clinical Chemistry and Laboratory Medicine in 1996, 2001, and 2002. Clinical Chemistry has paid special attention to this field of research since 1996 by publishing recommendations, checklists, and reviews. Articles were identified through electronic searches in Medline. The strategy combined the Mesh term "sensitivity and specificity" (exploded) with the text words "specificity", "false negative", and "accuracy". We examined adherence to seven methodologic criteria used in the study by Reid et al. (JAMA1995;274:645-51) of papers published in general medical journals. Three observers evaluated each article independently. Seventy-nine articles fulfilled the inclusion criteria. The percentage of studies that satisfied each criterion improved from 1996 to 2002. Substantial improvement was observed in reporting of the statistical uncertainty of indices of diagnostic accuracy, in criteria based on clinical information from the study population (spectrum composition), and in avoidance of workup bias. Analytical reproducibility was reported frequently (68%), whereas information about indeterminate results was rarely provided. The mean number of methodologic criteria satisfied showed a statistically significant increase over the 3 years in Clinical Chemistry but not in Clinical Chemistry and Laboratory Medicine. The methodologic quality of the articles on diagnostic test research published in Clinical Chemistry and Clinical Chemistry and Laboratory Medicine is comparable to the quality observed in the best general medical journals. The methodologic aspects that most need improvement are those linked to the clinical information of the populations studied. Editorial actions aimed to increase the quality of reporting of diagnostic studies could have a relevant positive effect, as shown by the improvement observed in Clinical Chemistry.

Journal impact factor and methodological quality of surgical randomized controlled trials: an empirical study.

PubMed

Ahmed Ali, Usama; Reiber, Beata M M; Ten Hove, Joren R; van der Sluis, Pieter C; Gooszen, Hein G; Boermeester, Marja A; Besselink, Marc G

2017-11-01

The journal impact factor (IF) is often used as a surrogate marker for methodological quality. The objective of this study is to evaluate the relation between the journal IF and methodological quality of surgical randomized controlled trials (RCTs). Surgical RCTs published in PubMed in 1999 and 2009 were identified. According to IF, RCTs were divided into groups of low (<2), median (2-3) and high IF (>3), as well as into top-10 vs all other journals. Methodological quality characteristics and factors concerning funding, ethical approval and statistical significance of outcomes were extracted and compared between the IF groups. Additionally, a multivariate regression was performed. The median IF was 2.2 (IQR 2.37). The percentage of 'low-risk of bias' RCTs was 13% for top-10 journals vs 4% for other journals in 1999 (P < 0.02), and 30 vs 12% in 2009 (P < 0.02). Similar results were observed for high vs low IF groups. The presence of sample-size calculation, adequate generation of allocation and intention-to-treat analysis were independently associated with publication in higher IF journals; as were multicentre trials and multiple authors. Publication of RCTs in high IF journals is associated with moderate improvement in methodological quality compared to RCTs published in lower IF journals. RCTs with adequate sample-size calculation, generation of allocation or intention-to-treat analysis were associated with publication in a high IF journal. On the other hand, reporting a statistically significant outcome and being industry funded were not independently associated with publication in a higher IF journal.

[Systematic Review of the Methodology Quality in Lung Cancer Screening Guidelines].

PubMed

Li, Jiang; Su, Kai; Li, Fang; Tang, Wei; Huang, Yao; Wang, Le; Huang, Huiyao; Shi, Jufang; Dai, Min

2016-10-20

Lung cancer is the most common malignancy and screening can decrease the mortality. High quality screening guideline is necessary and important for effective work. Our study is to review and evaluate the basic characteristics and methodology quality of the current global lung cancer screening guidelines so as to provide useful information for domestic study in the future. Electronic searches were done in English and Chinese databases including PubMed, the Cochrane Library, Web of Science, Embase, CNKI, CBM, Wanfang, and some cancer official websites. Articles were screened according to the predefined inclusion and exclusion criteria by two researchers. The quality of guidelines was assessed by AGREE II. At last, a total of 11 guidelines with methodology were included. The guidelines were issued mainly by USA (81%). Canada and China developed one, respectively. As for quality, the average score in the "Scale and objective" of all guidelines was 80, the average score in the "Participants" was 52, the average score in the "rigorism" was 50, the average score in the "clarity" was 76, the average score in the "application" was 43 and the average score in the "independence" was 59. The highest average score was found in 2013 and 2015. Canada guideline had higher quality in six domains. 7 guidelines were evaluated as A level. The number of clinical guidelines showed an increasing trend. Most guidelines were issued by developed countries with heavy burden. Multi-country contribution to one guideline was another trend. Evidence-based methodology was accepted globally in the guideline development.

Efficacy of surgery for rotator cuff tendinopathy: a systematic review.

PubMed

Toliopoulos, Panagiota; Desmeules, François; Boudreault, Jennifer; Roy, Jean-Sébastien; Frémont, Pierre; MacDermid, Joy C; Dionne, Clermont E

2014-01-01

The objective of this study is to review randomized controlled trials evaluating the efficacy of surgery for the treatment of rotator cuff (RC) tendinopathy. Studies up to August 2013 were located in the PubMed, Embase, CINAHL, and PEDro databases using relevant keywords. Studies were included if: (1) participants had rotator cuff tendinopathy, (2) the trials were conducted on an adult population (≥18 years old), (3) at least one of the interventions studied was a surgical procedure, (4) study design was a randomized controlled trial (RCT), and (5) the article was written in English or French. Characteristics of the included studies were extracted using a standardized form. Two independent raters reviewed the methodological quality of the studies using the Risk of Bias Assessment tool developed by the Cochrane Collaboration Group. Differences were resolved by consensus. Fifteen trials met our inclusion criteria. After consensus, the mean methodological quality for all studies was 58.9 ± 10.8 %. In three out of four RCTs of moderate or low methodological quality, no significant difference in treatment effectiveness was observed between open or arthroscopic acromioplasty compared to exercises in the treatment of RC tendinopathy. Based on two studies of low or moderate methodological quality, no difference in treatment effectiveness was observed between arthroscopic and open acromioplasty. Two other RCTs of low to moderate quality, however, found that arthroscopic acromioplasty yielded better results in the short-term for shoulder range of motion in flexion but that both procedures were comparable in the long-term. One additional study favored open acromioplasty over arthroscopic acromioplasty for the treatment of RC tendinopathy. Based on low- to moderate-quality evidence, acromioplasty, be it open or arthroscopic, is no more effective than exercises for the treatment of RC tendinopathy. Low-grade evidence also suggests that arthroscopic acromioplasty may yield better results in the short-term for shoulder range of motion in flexion compared to open acromioplasty, but long-term results are comparable between the two types of surgery. More high-quality RCTs are required in order to provide comprehensive treatment guidelines to healthcare providers.

Tracking of childhood overweight into adulthood: a systematic review of the literature.

PubMed

Singh, A S; Mulder, C; Twisk, J W R; van Mechelen, W; Chinapaw, M J M

2008-09-01

Overweight and obesity in youth are important public health concerns and are of particular interest because of possible long-term associations with adult weight status and morbidity. The aim of this study was to systematically review the literature and update evidence concerning persistence of childhood overweight. A computerized bibliographical search--restricted to studies with a prospective or retrospective longitudinal design--was conducted. Two authors independently extracted data and assessed the methodological quality of the included studies in four dimensions (i) study population and participation rate; (ii) study attrition; (iii) data collection and (iv) data analysis. Conclusions were based on a rating system of three levels of evidence. A total of 25 publications were selected for inclusion in this review. According to a methodological quality assessment, 13 studies were considered to be of high quality. The majority of these high-quality studies were published after 2001, indicating that recently published data, in particular, provide us with reliable information. All included studies consistently report an increased risk of overweight and obese youth becoming overweight adults, suggesting that the likelihood of persistence of overweight into adulthood is moderate for overweight and obese youth. However, predictive values varied considerably. Limiting aspects with respect to generalizability and methodological issues are discussed.

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

Is there relationship between temporomandibular disorders and head and cervical posture? A systematic review.

PubMed

Rocha, C P; Croci, C S; Caria, P H F

2013-11-01

The objective of this systematic review was to find sufficient evidence to deny or accept the association between the head and cervical posture and temporomandibular disorders (TMDs), and thus assist health professionals in the evaluation and treatment of patients with TMDs. A search was conducted through all publications written in English about this topic using the databases from Medline, ISI Web of Science, EMBASE, PubMed and Lilacs. The abstracts that fulfilled the initial guideline were retrieved and evaluated to ensure they met the inclusion criteria. To assess the methodological quality of the studies, we developed a questionnaire considering the following criteria: participant's eligibility, control group, diagnosis of TMDs, posture diagnosis and randomisation. Twenty-two studies were selected as potential studies based on their abstracts. Only seventeen studies actually fulfilled the inclusion criteria. The search provided information about the methodological quality of the studies, in which several methodological defects were found. The evidence presented in this systematic review shows that the relation between TMDs and the head and neck posture is still controversial and unclear. The insufficient number of articles considered of excellent methodological quality is a factor that hinders the acceptance or denial of this association. © 2013 John Wiley & Sons Ltd.

Effects of Regular Classes in Outdoor Education Settings: A Systematic Review on Students’ Learning, Social and Health Dimensions

PubMed Central

Becker, Christoph; Lauterbach, Gabriele; Spengler, Sarah; Dettweiler, Ulrich; Mess, Filip

2017-01-01

Background: Participants in Outdoor Education Programmes (OEPs) presumably benefit from these programmes in terms of their social and personal development, academic achievement and physical activity (PA). The aim of this systematic review was to identify studies about regular compulsory school- and curriculum-based OEPs, to categorise and evaluate reported outcomes, to assess the methodological quality, and to discuss possible benefits for students. Methods: We searched online databases to identify English- and German-language peer-reviewed journal articles that reported any outcomes on a student level. Two independent reviewers screened studies identified for eligibility and assessed the methodological quality. Results: Thirteen studies were included for analysis. Most studies used a case-study design, the average number of participants was moderate (mean valued (M) = 62.17; standard deviation (SD) = 64.12), and the methodological quality was moderate on average for qualitative studies (M = 0.52; SD = 0.11), and low on average for quantitative studies (M = 0.18; SD = 0.42). Eight studies described outcomes in terms of social dimensions, seven studies in learning dimensions and four studies were subsumed under additional outcomes, i.e., PA and health. Eleven studies reported positive, one study positive as well as negative, and one study reported negative effects. PA and mental health as outcomes were underrepresented. Conclusion: Tendencies were detected that regular compulsory school- and curriculum-based OEPs can promote students in respect of social, academic, physical and psychological dimensions. Very little is known concerning students’ PA or mental health. We recommend conducting more quasi-experimental design and longitudinal studies with a greater number of participants, and a high methodological quality to further investigate these tendencies. PMID:28475167

Effects of Regular Classes in Outdoor Education Settings: A Systematic Review on Students' Learning, Social and Health Dimensions.

PubMed

Becker, Christoph; Lauterbach, Gabriele; Spengler, Sarah; Dettweiler, Ulrich; Mess, Filip

2017-05-05

Participants in Outdoor Education Programmes (OEPs) presumably benefit from these programmes in terms of their social and personal development, academic achievement and physical activity (PA). The aim of this systematic review was to identify studies about regular compulsory school- and curriculum-based OEPs, to categorise and evaluate reported outcomes, to assess the methodological quality, and to discuss possible benefits for students. We searched online databases to identify English- and German-language peer-reviewed journal articles that reported any outcomes on a student level. Two independent reviewers screened studies identified for eligibility and assessed the methodological quality. Thirteen studies were included for analysis. Most studies used a case-study design, the average number of participants was moderate (mean valued (M) = 62.17; standard deviation (SD) = 64.12), and the methodological quality was moderate on average for qualitative studies (M = 0.52; SD = 0.11), and low on average for quantitative studies (M = 0.18; SD = 0.42). Eight studies described outcomes in terms of social dimensions, seven studies in learning dimensions and four studies were subsumed under additional outcomes, i.e., PA and health. Eleven studies reported positive, one study positive as well as negative, and one study reported negative effects. PA and mental health as outcomes were underrepresented. Tendencies were detected that regular compulsory school- and curriculum-based OEPs can promote students in respect of social, academic, physical and psychological dimensions. Very little is known concerning students' PA or mental health. We recommend conducting more quasi-experimental design and longitudinal studies with a greater number of participants, and a high methodological quality to further investigate these tendencies.

Funding source and the quality of reports of chronic wounds trials: 2004 to 2011

PubMed Central

2014-01-01

Background Critical commentaries suggest that wound care randomised controlled trials (RCTs) are often poorly reported with many methodological flaws. Furthermore, interventions in chronic wounds, rather than being drugs, are often medical devices for which there are no requirements for RCTs to bring products to market. RCTs in wounds trials therefore potentially represent a form of marketing. This study presents a methodological overview of chronic wound trials published between 2004 and 2011 and investigates the influence of industry funding on methodological quality. Methods A systematic search for RCTs for the treatment of chronic wounds published in the English language between 2004 and 2011 (inclusive) in the Cochrane Wounds Group Specialised Register of Trials was carried out. Data were extracted on aspects of trial design, conduct and quality including sample size, duration of follow-up, specification of a primary outcome, use of surrogate outcomes, and risks of bias. In addition, the prevalence of industry funding was assessed and its influence on the above aspects of trial design, conduct and quality was assessed. Results A total of 167 RCTs met our inclusion criteria. We found chronic wound trials often have short durations of follow-up (median 12 weeks), small sample sizes (median 63), fail to define a primary outcome in 41% of cases, and those that do define a primary outcome, use surrogate measures of healing in 40% of cases. Only 40% of trials used appropriate methods of randomisation, 25% concealed allocation and 34% blinded outcome assessors. Of the included trials, 41% were wholly or partially funded by industry, 33% declared non-commercial funding and 26% did not report a funding source. Industry funding was not statistically significantly associated with any measure of methodological quality, though this analysis was probably underpowered. Conclusions This overview confirms concerns raised about the methodological quality of RCTs in wound care and illustrates that greater efforts must be made to follow international standards for conducting and reporting RCTs. There is currently minimal evidence of an influence of industry funding on methodological quality although analyses had limited power and funding source was not reported for a quarter of studies. PMID:24422753

Funding source and the quality of reports of chronic wounds trials: 2004 to 2011.

PubMed

Hodgson, Robert; Allen, Richard; Broderick, Ellen; Bland, J Martin; Dumville, Jo C; Ashby, Rebecca; Bell-Syer, Sally; Foxlee, Ruth; Hall, Jill; Lamb, Karen; Madden, Mary; O'Meara, Susan; Stubbs, Nikki; Cullum, Nicky

2014-01-14

Critical commentaries suggest that wound care randomised controlled trials (RCTs) are often poorly reported with many methodological flaws. Furthermore, interventions in chronic wounds, rather than being drugs, are often medical devices for which there are no requirements for RCTs to bring products to market. RCTs in wounds trials therefore potentially represent a form of marketing. This study presents a methodological overview of chronic wound trials published between 2004 and 2011 and investigates the influence of industry funding on methodological quality. A systematic search for RCTs for the treatment of chronic wounds published in the English language between 2004 and 2011 (inclusive) in the Cochrane Wounds Group Specialised Register of Trials was carried out.Data were extracted on aspects of trial design, conduct and quality including sample size, duration of follow-up, specification of a primary outcome, use of surrogate outcomes, and risks of bias. In addition, the prevalence of industry funding was assessed and its influence on the above aspects of trial design, conduct and quality was assessed. A total of 167 RCTs met our inclusion criteria. We found chronic wound trials often have short durations of follow-up (median 12 weeks), small sample sizes (median 63), fail to define a primary outcome in 41% of cases, and those that do define a primary outcome, use surrogate measures of healing in 40% of cases. Only 40% of trials used appropriate methods of randomisation, 25% concealed allocation and 34% blinded outcome assessors. Of the included trials, 41% were wholly or partially funded by industry, 33% declared non-commercial funding and 26% did not report a funding source. Industry funding was not statistically significantly associated with any measure of methodological quality, though this analysis was probably underpowered. This overview confirms concerns raised about the methodological quality of RCTs in wound care and illustrates that greater efforts must be made to follow international standards for conducting and reporting RCTs. There is currently minimal evidence of an influence of industry funding on methodological quality although analyses had limited power and funding source was not reported for a quarter of studies.

Methodological review of the quality of reach out and read: does it "work"?

PubMed

Yeager Pelatti, Christina; Pentimonti, Jill M; Justice, Laura M

2014-04-01

A considerable percentage of American children and adults fail to learn adequate literacy skills and read below a third grade level. Shared book reading is perhaps the single most important activity to prepare young children for success in reading. The primary objective of this manuscript was to critically review the methodological quality of Read Out and Read (ROR), a clinically based literacy program/intervention that teaches parents strategies to incorporate while sharing books with children as a method of preventing reading difficulties and academic struggles. A PubMed search was conducted. Articles that met three criteria were considered. First, the study must be clinically based and include parent contact with a pediatrician. Second, parental counseling ("anticipatory guidance") about the importance of parent-child book reading must be included. Third, only experimental or quasi-experimental studies were included; no additional criteria were used. Published articles from any year and peer-reviewed journal were considered. Study quality was determined using a modified version of the Downs and Black (1998) checklist assessing four categories: (1) Reporting, (2) External Validity, (3) Internal Validity-Bias, and (4) Internal Validity-Confounding. We were also interested in whether quality differed based on study design, children's age, sample size, and study outcome. Eleven studies met the inclusion criteria. The overall quality of evidence was variable across all studies; Reporting and External Validity categories were relatively strong while methodological concerns were found in the area of internal validity. Quality scores differed on the four study characteristics. Implications related to clinical practice and future studies are discussed.

Sexual health education interventions for young people: a methodological review.

PubMed Central

Oakley, A.; Fullerton, D.; Holland, J.; Arnold, S.; France-Dawson, M.; Kelley, P.; McGrellis, S.

1995-01-01

OBJECTIVES--To locate reports of sexual health education interventions for young people, assess the methodological quality of evaluations, identify the subgroup with a methodologically sound design, and assess the evidence with respect to the effectiveness of different approaches to promoting young people's sexual health. DESIGN--Survey of reports in English by means of electronic databases and hand searches for relevant studies conducted in the developed world since 1982. Papers were reviewed for eight methodological qualities. The evidence on effectiveness generated by studies meeting four core criteria was assessed. Judgments on effectiveness by reviewers and authors were compared. PAPERS--270 papers reporting sexual health interventions. MAIN OUTCOME MEASURE--The methodological quality of evaluations. RESULTS--73 reports of evaluations of sexual health interventions examining the effectiveness of these interventions in changing knowledge, attitudes, or behavioural outcomes were identified, of which 65 were separate outcome evaluations. Of these studies, 45 (69%) lacked random control groups, 44 (68%) failed to present preintervention and 38 (59%) postintervention data, and 26 (40%) omitted to discuss the relevance of loss of data caused by drop outs. Only 12 (18%) of the 65 outcome evaluations were judged to be methodologically sound. Academic reviewers were more likely than authors to judge studies as unclear because of design faults. Only two of the sound evaluations recorded interventions which were effective in showing an impact on young people's sexual behaviour. CONCLUSIONS--The design of evaluations in sexual health intervention needs to be improved so that reliable evidence of the effectiveness of different approaches to promoting young people's sexual health may be generated. PMID:7833754

78 FR 52929 - Scientific Information Request on Imaging Tests for the Diagnosis and Staging of Pancreatic...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-27

... improve the quality of this review. AHRQ is conducting this comparative effectiveness review pursuant to..., study period, design, methodology, indication and diagnosis, proper use instructions, inclusion and... including a study number, the study period, design, methodology, indication and diagnosis, proper use...

Quality of life among adult patients with neurofibromatosis 1, neurofibromatosis 2 and schwannomatosis: a systematic review of the literature.

PubMed

Vranceanu, Ana-Maria; Merker, Vanessa L; Park, Elyse; Plotkin, Scott R

2013-09-01

The aim of this study was to review the literature on quality of life among adult patients with neurofibromatosis 1, neurofibromatosis 2 and schwannomatosis, and to identify the specific aspects of quality of life that were studied and reported in this population. We also set out to report predictors of quality of life. Published research reports were included if they described quality of life in this population and met methodological quality according to a list of predefined criteria. Eight studies (7 in NF1, 1 in NF2, 0 in schwannomatosis), conducted between 2001 and 2013, met inclusion criteria. The methodological quality of the eight studies was mostly high according to ratings by predefined criteria. Most studies reported that patients with NF experience decreased quality of life when compared to the general population. Visibility and disease severity were strong predictors of skin-specific quality of life in NF1 patients. However, the majority of findings regarding predictors of quality of life were weak or inconclusive. Given the decreased quality of life in NF patients, it is important to examine more comprehensively the psychosocial factors in this population, especially in patients with NF2 and schwannomatosis. Mind body interventions that address these domains may provide comprehensive and efficacious long term treatment.

The exchangeability of self-reports and administrative health care resource use measurements: assessement of the methodological reporting quality.

PubMed

Noben, Cindy Yvonne; de Rijk, Angelique; Nijhuis, Frans; Kottner, Jan; Evers, Silvia

2016-06-01

To assess the exchangeability of self-reported and administrative health care resource use measurements for cost estimation. In a systematic review (NHS EED and MEDLINE), reviewers evaluate, in duplicate, the methodological reporting quality of studies comparing the validation evidence of instruments measuring health care resource use. The appraisal tool Methodological Reporting Quality (MeRQ) is developed by merging aspects form the Guidelines for Reporting Reliability and Agreement Studies and the Standards for Reporting Diagnostic Accuracy. Out of 173 studies, 35 full-text articles are assessed for eligibility. Sixteen articles are included in this study. In seven articles, more than 75% of the reporting criteria assessed by MERQ are considered "good." Most studies score at least "fair" on most of the reporting quality criteria. In the end, six studies score "good" on the minimal criteria for reporting. Varying levels of agreement among the different data sources are found, with correlations ranging from 0.14 up to 0.93 and with occurrences of both random and systematic errors. The validation evidence of the small number of studies with adequate MeRQ cautiously supports the exchangeability of both the self-reported and administrative resource use measurement methods. Copyright © 2016 Elsevier Inc. All rights reserved.

Teaching mathematical word problem solving: the quality of evidence for strategy instruction priming the problem structure.

PubMed

Jitendra, Asha K; Petersen-Brown, Shawna; Lein, Amy E; Zaslofsky, Anne F; Kunkel, Amy K; Jung, Pyung-Gang; Egan, Andrea M

2015-01-01

This study examined the quality of the research base related to strategy instruction priming the underlying mathematical problem structure for students with learning disabilities and those at risk for mathematics difficulties. We evaluated the quality of methodological rigor of 18 group research studies using the criteria proposed by Gersten et al. and 10 single case design (SCD) research studies using criteria suggested by Horner et al. and the What Works Clearinghouse. Results indicated that 14 group design studies met the criteria for high-quality or acceptable research, whereas SCD studies did not meet the standards for an evidence-based practice. Based on these findings, strategy instruction priming the mathematics problem structure is considered an evidence-based practice using only group design methodological criteria. Implications for future research and for practice are discussed. © Hammill Institute on Disabilities 2013.

Investigation of Malaysian Higher Education Quality Culture and Workforce Performance

ERIC Educational Resources Information Center

Ali, Hairuddin Mohd; Musah, Mohammed Borhandden

2012-01-01

Purpose: The purpose of this study is to examine the relationship between the quality culture and workforce performance in the Malaysian higher education sector. The study also aims to test and validate the psychometric properties of the quality culture and workforce performance instruments used in the study. Design/methodology/approach: A total…

[Method for the quality assessment of data collection processes in epidemiological studies].

PubMed

Schöne, G; Damerow, S; Hölling, H; Houben, R; Gabrys, L

2017-10-01

For a quantitative evaluation of primary data collection processes in epidemiological surveys based on accompaniments and observations (in the field), there is no description of test criteria and methodologies in relevant literature and thus no known application in practice. Therefore, methods need to be developed and existing procedures adapted. The aim was to identify quality-relevant developments within quality dimensions by means of inspection points (quality indicators) during the process of data collection. As a result we seek to implement and establish a methodology for the assessment of overall survey quality supplementary to standardized data analyses. Monitors detect deviations from standard primary data collection during site visits by applying standardized checklists. Quantitative results - overall and for each dimension - are obtained by numerical calculation of quality indicators. Score results are categorized and color coded. This visual prioritization indicates necessity for intervention. The results obtained give clues regarding the current quality of data collection. This allows for the identification of such sections where interventions for quality improvement are needed. In addition, process quality development can be shown over time on an intercomparable basis. This methodology for the evaluation of data collection quality can identify deviations from norms, focalize quality analyses and help trace causes for significant deviations.

Applying Statistical Process Quality Control Methodology to Educational Settings.

ERIC Educational Resources Information Center

Blumberg, Carol Joyce

A subset of Statistical Process Control (SPC) methodology known as Control Charting is introduced. SPC methodology is a collection of graphical and inferential statistics techniques used to study the progress of phenomena over time. The types of control charts covered are the null X (mean), R (Range), X (individual observations), MR (moving…

A Survey of Mathematics Education Technology Dissertation Scope and Quality: 1968-2009

ERIC Educational Resources Information Center

Ronau, Robert N.; Rakes, Christopher R.; Bush, Sarah B.; Driskell, Shannon O.; Niess, Margaret L.; Pugalee, David K.

2014-01-01

We examined 480 dissertations on the use of technology in mathematics education and developed a Quality Framework (QF) that provided structure to consistently define and measure quality. Dissertation studies earned an average of 64.4% of the possible quality points across all methodology types, compared to studies in journals that averaged 47.2%.…

"The Road Less Traveled": Combining Disability Studies and Quantitative Analysis with Medium and Large Data Sets

ERIC Educational Resources Information Center

Cosier, Meghan

2012-01-01

Historically, researchers focused on individuals with severe disabilities have utilized single-subject research methodologies to study the application of the behavioral theory to learning. In contrast, disability studies scholars have primarily used qualitative research methodologies to study quality of life or policy issues related to individuals…

Development of fuzzy air quality index using soft computing approach.

PubMed

Mandal, T; Gorai, A K; Pathak, G

2012-10-01

Proper assessment of air quality status in an atmosphere based on limited observations is an essential task for meeting the goals of environmental management. A number of classification methods are available for estimating the changing status of air quality. However, a discrepancy frequently arises from the quality criteria of air employed and vagueness or fuzziness embedded in the decision making output values. Owing to inherent imprecision, difficulties always exist in some conventional methodologies like air quality index when describing integrated air quality conditions with respect to various pollutants parameters and time of exposure. In recent years, the fuzzy logic-based methods have demonstrated to be appropriated to address uncertainty and subjectivity in environmental issues. In the present study, a methodology based on fuzzy inference systems (FIS) to assess air quality is proposed. This paper presents a comparative study to assess status of air quality using fuzzy logic technique and that of conventional technique. The findings clearly indicate that the FIS may successfully harmonize inherent discrepancies and interpret complex conditions.

Terrorism, Radicalisation, Extremism, Authoritarianism and Fundamentalism: A Systematic Review of the Quality and Psychometric Properties of Assessments.

PubMed

Scarcella, Akimi; Page, Ruairi; Furtado, Vivek

2016-01-01

Currently, terrorism and suicide bombing are global psychosocial processes that attracts a growing number of psychological and psychiatric contributions to enhance practical counter-terrorism measures. The present study is a systematic review that explores the methodological quality reporting and the psychometric soundness of the instruments developed to identify risk factors of terrorism, extremism, radicalisation, authoritarianism and fundamentalism. A systematic search strategy was established to identify instruments and studies developed to screen individuals at risk of committing extremist or terrorist offences using 20 different databases across the fields of law, medicine, psychology, sociology and politics. Information extracted was consolidated into two different tables and a 26-item checklist, reporting respectively background information, the psychometric properties of each tool, and the methodological quality markers of these tools. 37 articles met our criteria, which included a total of 4 instruments to be used operationally by professionals, 17 tools developed as research measures, and 9 inventories that have not been generated from a study. Just over half of the methodological quality markers required for a transparent methodological description of the instruments were reported. The amount of reported psychological properties was even fewer, with only a third of them available across the different studies. The category presenting the least satisfactory results was that containing the 4 instruments to be used operationally by professionals, which can be explained by the fact that half of them refrained from publishing the major part of their findings and relevant guidelines. A great number of flaws have been identified through this systematic review. The authors encourage future researchers to be more thorough, comprehensive and transparent in their methodology. They also recommend the creation of a multi-disciplinary joint working group in order to best tackle this growing contemporary problem.

Static body postural misalignment in individuals with temporomandibular disorders: a systematic review

PubMed Central

Chaves, Thaís C.; Turci, Aline M.; Pinheiro, Carina F.; Sousa, Letícia M.; Grossi, Débora B.

2014-01-01

BACKGROUND: The association between body postural changes and temporomandibular disorders (TMD) has been widely discussed in the literature, however, there is little evidence to support this association. OBJECTIVES: The aim of the present study was to conduct a systematic review to assess the evidence concerning the association between static body postural misalignment and TMD. METHOD: A search was conducted in the PubMed/Medline, Embase, Lilacs, Scielo, Cochrane, and Scopus databases including studies published in English between 1950 and March 2012. Cross-sectional, cohort, case control, and survey studies that assessed body posture in TMD patients were selected. Two reviewers performed each step independently. A methodological checklist was used to evaluate the quality of the selected articles. RESULTS: Twenty studies were analyzed for their methodological quality. Only one study was classified as a moderate quality study and two were classified as strong quality studies. Among all studies considered, only 12 included craniocervical postural assessment, 2 included assessment of craniocervical and shoulder postures,, and 6 included global assessment of body posture. CONCLUSION: There is strong evidence of craniocervical postural changes in myogenous TMD, moderate evidence of cervical postural misalignment in arthrogenous TMD, and no evidence of absence of craniocervical postural misalignment in mixed TMD patients or of global body postural misalignment in patients with TMD. It is important to note the poor methodological quality of the studies, particularly those regarding global body postural misalignment in TMD patients. PMID:25590441

Investigating the application of AOP methodology in development of Financial Accounting Software using Eclipse-AJDT Environment

NASA Astrophysics Data System (ADS)

Sharma, Amita; Sarangdevot, S. S.

2010-11-01

Aspect-Oriented Programming (AOP) methodology has been investigated in development of real world business application software—Financial Accounting Software. Eclipse-AJDT environment has been used as open source enhanced IDE support for programming in AOP language—Aspect J. Crosscutting concerns have been identified and modularized as aspects. This reduces the complexity of the design considerably due to elimination of code scattering and tangling. Improvement in modularity, quality and performance is achieved. The study concludes that AOP methodology in Eclipse-AJDT environment offers powerful support for modular design and implementation of real world quality business software.

A systematic tale of two differing reviews: evaluating the evidence on public and private sector quality of primary care in low and middle income countries.

PubMed

Coarasa, Jorge; Das, Jishnu; Gummerson, Elizabeth; Bitton, Asaf

2017-04-12

Systematic reviews are powerful tools for summarizing vast amounts of data in controversial areas; but their utility is limited by methodological choices and assumptions. Two systematic reviews of literature on the quality of private sector primary care in low and middle income countries (LMIC), published in the same journal within a year, reached conflicting conclusions. The difference in findings reflects different review methodologies, but more importantly, a weak underlying body of literature. A detailed examination of the literature cited in both reviews shows that only one of the underlying studies met the gold standard for methodological robustness. Given the current policy momentum on universal health coverage and primary health care reform across the globe, there is an urgent need for high quality empirical evidence on the quality of private versus public sector primary health care in LMIC.

Articulation of Quality Teaching: A Comparative Study

ERIC Educational Resources Information Center

Sakarneh, Mohammad

2015-01-01

The aim of this study is to describe and then contrast the New South Wales Department of Education and Training's model of quality teaching with the Jordanian Ministry of Education's conception of quality teaching, looking particularly at potential differences in interpretation. A content analysis methodology was used. Each perspective has been…

Understanding Quality Assurance: A Cross Country Case Study

ERIC Educational Resources Information Center

Choon Boey Lim, Fion

2008-01-01

Purpose: The purpose of this paper is to examine the level of understanding between an Australian university and its offshore partner institution, on quality assurance. It attempts to highlight the dynamics of quality assurance policy implementation within and across institutions for an offshore degree. Design/methodology/approach: The study used…

Beyond Technology Transfer: Quality of Life Impacts from R&D Outcomes

ERIC Educational Resources Information Center

Stone, Vathsala I.; Lockett, Michelle; Usiak, Douglas J.; Arthanat, Sajay

2010-01-01

This paper presents methodology and findings from three product efficacy studies that verify the quality of life benefits resulting from prior research, development, and transfer activities. The paper then discusses key lessons learned with implications for product evaluation practice. The studies assessed the quality of three assistive technology…

Implementing meta-analysis from genome-wide association studies for pork quality traits

USDA-ARS?s Scientific Manuscript database

Pork quality plays an important role in the meat processing industry, thus different methodologies have been implemented to elucidate the genetic architecture of traits affecting meat quality. One of the most common and widely used approaches is to perform genome-wide association (GWA) studies. Howe...

Towards Quality Assessment in an EFL Programme

ERIC Educational Resources Information Center

Ali, Holi Ibrahim Holi; Al Ajmi, Ahmed Ali Saleh

2013-01-01

Assessment is central in education and the teaching-learning process. This study attempts to explore the perspectives and views about quality assessment among teachers of English as a Foreign Language (EFL), and to find ways of promoting quality assessment. Quantitative methodology was used to collect data. To answer the study questions, a…

Assessment of Patient Empowerment - A Systematic Review of Measures

PubMed Central

Barr, Paul J.; Scholl, Isabelle; Bravo, Paulina; Faber, Marjan J.; Elwyn, Glyn; McAllister, Marion

2015-01-01

Background Patient empowerment has gained considerable importance but uncertainty remains about the best way to define and measure it. The validity of empirical findings depends on the quality of measures used. This systematic review aims to provide an overview of studies assessing psychometric properties of questionnaires purporting to capture patient empowerment, evaluate the methodological quality of these studies and assess the psychometric properties of measures identified. Methods Electronic searches in five databases were combined with reference tracking of included articles. Peer-reviewed articles reporting psychometric testing of empowerment measures for adult patients in French, German, English, Portuguese and Spanish were included. Study characteristics, constructs operationalised and psychometric properties were extracted. The quality of study design, methods and reporting was assessed using the COSMIN checklist. The quality of psychometric properties was assessed using Terwee’s 2007 criteria. Findings 30 studies on 19 measures were included. Six measures are generic, while 13 were developed for a specific condition (N=4) or specialty (N=9). Most studies tested measures in English (N=17) or Swedish (N=6). Sample sizes of included studies varied from N=35 to N=8261. A range of patient empowerment constructs was operationalised in included measures. These were classified into four domains: patient states, experiences and capacities; patient actions and behaviours; patient self-determination within the healthcare relationship and patient skills development. Quality assessment revealed several flaws in methodological study quality with COSMIN scores mainly fair or poor. The overall quality of psychometric properties of included measures was intermediate to positive. Certain psychometric properties were not tested for most measures. Discussion Findings provide a basis from which to develop consensus on a core set of patient empowerment constructs and for further work to develop a (set of) appropriately validated measure(s) to capture this. The methodological quality of psychometric studies could be improved by adhering to published quality criteria. PMID:25970618

A Systematic Review of Economic Evaluation Methodologies Between Resource-Limited and Resource-Rich Countries: A Case of Rotavirus Vaccines.

PubMed

Thiboonboon, Kittiphong; Santatiwongchai, Benjarin; Chantarastapornchit, Varit; Rattanavipapong, Waranya; Teerawattananon, Yot

2016-12-01

For more than three decades, the number and influence of economic evaluations of healthcare interventions have been increasing and gaining attention from a policy level. However, concerns about the credibility of these studies exist, particularly in studies from low- and middle- income countries (LMICs). This analysis was performed to explore economic evaluations conducted in LMICs in terms of methodological variations, quality of reporting and evidence used for the analyses. These results were compared with those studies conducted in high-income countries (HICs). Rotavirus vaccine was selected as a case study, as it is one of the interventions that many studies in both settings have explored. The search to identify individual studies on rotavirus vaccines was performed in March 2014 using MEDLINE and the National Health Service Economic Evaluation Database. Only full economic evaluations, comparing cost and outcomes of at least two alternatives, were included for review. Selected criteria were applied to assess methodological variation, quality of reporting and quality of evidence used. Eighty-five studies were included, consisting of 45 studies in HICs and 40 studies in LMICs. Seventy-five percent of the studies in LMICs were published by researchers from HICs. Compared with studies in HICs, the LMIC studies showed less methodological variety. In terms of the quality of reporting, LMICs had a high adherence to technical criteria, but HICs ultimately proved to be better. The same trend applied for the quality of evidence used. Although the quality of economic evaluations in LMICs was not as high as those from HICs, it is of an acceptable level given several limitations that exist in these settings. However, the results of this study may not reflect the fact that LMICs have developed a better research capacity in the domain of health economics, given that most of the studies were in theory led by researchers from HICs. Putting more effort into fostering the development of both research infrastructure and capacity building as well as encouraging local engagement in LMICs is thus necessary.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond's Checklist: A Narrative Review.

PubMed

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-09-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond's checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles' structure was analyzed by Drummond's standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond's criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond’s Checklist: A Narrative Review

PubMed Central

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-01-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond’s checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles’ structure was analyzed by Drummond’s standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond’s criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies. PMID:29234174

Physical activity interventions for people with mental illness: a systematic review and meta-analysis.

PubMed

Rosenbaum, Simon; Tiedemann, Anne; Sherrington, Catherine; Curtis, Jackie; Ward, Philip B

2014-09-01

To determine effects of physical activity on depressive symptoms (primary objective), symptoms of schizophrenia, anthropometric measures, aerobic capacity, and quality of life (secondary objectives) in people with mental illness and explore between-study heterogeneity. MEDLINE, Cochrane Controlled Trials Register, PsycINFO, CINAHL, Embase, and the Physiotherapy Evidence Database (PEDro) were searched from earliest record to 2013. Randomized controlled trials of adults with a DSM-IV-TR, ICD-10, or clinician-confirmed diagnosis of a mental illness other than dysthymia or eating disorders were selected. Interventions included exercise programs, exercise counseling, lifestyle interventions, tai chi, or physical yoga. Study methodological quality and intervention compliance with American College of Sports Medicine (ACSM) guidelines were also assessed. Two investigators extracted data. Data were pooled using random-effects meta-analysis. Meta-regression was used to examine sources of between-study heterogeneity. Thirty-nine eligible trials were identified. The primary meta-analysis found a large effect of physical activity on depressive symptoms (n = 20; standardized mean difference (SMD) = 0.80). The effect size in trial interventions that met ACSM guidelines for aerobic exercise did not differ significantly from those that did not meet these guidelines. The effect for trials with higher methodological quality was smaller than that observed for trials with lower methodological quality (SMD = 0.39 vs 1.35); however, the difference was not statistically significant. A large effect was found for schizophrenia symptoms (SMD = 1.0), a small effect was found for anthropometry (SMD = 0.24), and moderate effects were found for aerobic capacity (SMD = 0.63) and quality of life (SMD = 0.64). Physical activity reduced depressive symptoms in people with mental illness. Larger effects were seen in studies of poorer methodological quality. Physical activity reduced symptoms of schizophrenia and improved anthropometric measures, aerobic capacity, and quality of life among people with mental illness. PROSPERO registration #CRD42012002012. © Copyright 2014 Physicians Postgraduate Press, Inc.

The Statistical point of view of Quality: the Lean Six Sigma methodology

PubMed Central

Viti, Andrea; Terzi, Alberto

2015-01-01

Six Sigma and Lean are two quality improvement methodologies. The Lean Six Sigma methodology is applicable to repetitive procedures. Therefore, the use of this methodology in the health-care arena has focused mainly on areas of business operations, throughput, and case management and has focused on efficiency outcomes. After the revision of methodology, the paper presents a brief clinical example of the use of Lean Six Sigma as a quality improvement method in the reduction of the complications during and after lobectomies. Using Lean Six Sigma methodology, the multidisciplinary teams could identify multiple modifiable points across the surgical process. These process improvements could be applied to different surgical specialties and could result in a measurement, from statistical point of view, of the surgical quality. PMID:25973253

The Statistical point of view of Quality: the Lean Six Sigma methodology.

PubMed

Bertolaccini, Luca; Viti, Andrea; Terzi, Alberto

2015-04-01

Six Sigma and Lean are two quality improvement methodologies. The Lean Six Sigma methodology is applicable to repetitive procedures. Therefore, the use of this methodology in the health-care arena has focused mainly on areas of business operations, throughput, and case management and has focused on efficiency outcomes. After the revision of methodology, the paper presents a brief clinical example of the use of Lean Six Sigma as a quality improvement method in the reduction of the complications during and after lobectomies. Using Lean Six Sigma methodology, the multidisciplinary teams could identify multiple modifiable points across the surgical process. These process improvements could be applied to different surgical specialties and could result in a measurement, from statistical point of view, of the surgical quality.

The use of grounded theory in studies of nurses and midwives' coping processes: a systematic literature search.

PubMed

Cheer, Karen; MacLaren, David; Tsey, Komla

2015-01-01

Researchers are increasingly using grounded theory methodologies to study the professional experience of nurses and midwives. To review common grounded theory characteristics and research design quality as described in grounded theory studies of coping strategies used by nurses and midwives. A systematic database search for 2005-2015 identified and assessed grounded theory characteristics from 16 studies. Study quality was assessed using a modified Critical Appraisal Skills Programme tool. Grounded theory was considered a methodology or a set of methods, able to be used within different nursing and midwifery contexts. Specific research requirements determined the common grounded theory characteristics used in different studies. Most researchers did not clarify their epistemological and theoretical perspectives. To improve research design and trustworthiness of grounded theory studies in nursing and midwifery, researchers need to state their theoretical stance and clearly articulate their use of grounded theory methodology and characteristics in research reporting.

Systematic review of the cost effectiveness of prophylactic treatments in the prevention of gastropathy in patients with rheumatoid arthritis or osteoarthritis taking non-steroidal anti-inflammatory drugs

PubMed Central

van Dieten, H. E M; Bos, I.; van Tulder, M. W; Lems, W.; Dijkmans, B.; Boers, M.

2000-01-01

A systematic review on the cost effectiveness of prophylactic treatments of non-steroidal anti-inflammatory drug (NSAID) induced gastropathy in patients with osteoarthritis or rheumatoid arthritis was conducted. Two reviewers conducted the literature search and the review. Both full and partial economic evaluations published in English, Dutch, or German were included. The criteria list published in the textbook of Drummond was used to determine the quality of the economic evaluations. The methodological quality of three randomised controlled trials (RCTs) in which the economic evaluations obtained probability estimates of NSAID induced gastropathy and adverse events was assessed by a list of internal validity criteria. The conclusions were based on a rating system consisting of four levels of evidence.
  Ten economic evaluations were included; three were based on RCTs. All evaluations studied misoprostol as prophylactic treatment: in one evaluation misoprostol was studied as a fixed component in a combination with diclofenac (Arthrotec). All economic evaluations comprised analytical studies containing a decision tree. The three trials were of high methodological quality. Nine economic evaluations were considered high quality and one economic evaluation was considered of low methodological quality. There is strong evidence (level "A") that the use of misoprostol for the prevention of NSAID induced gastropathy is cost effective, and limited evidence (level "C") that the use of Arthrotec is cost effective. Although the levels of evidence used in this review are arbitrary, it is believed that a qualitative analysis is useful: quantitative analyses in this field are hampered by the heterogeneity of economic evaluations. Existing criteria to evaluate the methodological quality of economic evaluations may need refinement for use in systematic reviews.

 PMID:11005773

Systematic review of the cost effectiveness of prophylactic treatments in the prevention of gastropathy in patients with rheumatoid arthritis or osteoarthritis taking non-steroidal anti-inflammatory drugs.

PubMed

van Dieten, H E; Korthals-de Bos, I B; van Tulder, M W; Lems, W F; Dijkmans, B A; Boers, M

2000-10-01

A systematic review on the cost effectiveness of prophylactic treatments of non-steroidal anti-inflammatory drug (NSAID) induced gastropathy in patients with osteoarthritis or rheumatoid arthritis was conducted. Two reviewers conducted the literature search and the review. Both full and partial economic evaluations published in English, Dutch, or German were included. The criteria list published in the textbook of Drummond was used to determine the quality of the economic evaluations. The methodological quality of three randomised controlled trials (RCTs) in which the economic evaluations obtained probability estimates of NSAID induced gastropathy and adverse events was assessed by a list of internal validity criteria. The conclusions were based on a rating system consisting of four levels of evidence. Ten economic evaluations were included; three were based on RCTs. All evaluations studied misoprostol as prophylactic treatment: in one evaluation misoprostol was studied as a fixed component in a combination with diclofenac (Arthrotec). All economic evaluations comprised analytical studies containing a decision tree. The three trials were of high methodological quality. Nine economic evaluations were considered high quality and one economic evaluation was considered of low methodological quality. There is strong evidence (level "A") that the use of misoprostol for the prevention of NSAID induced gastropathy is cost effective, and limited evidence (level "C") that the use of Arthrotec is cost effective. Although the levels of evidence used in this review are arbitrary, it is believed that a qualitative analysis is useful: quantitative analyses in this field are hampered by the heterogeneity of economic evaluations. Existing criteria to evaluate the methodological quality of economic evaluations may need refinement for use in systematic reviews.

Systematic Reviews and Meta-Analyses of Home Telemonitoring Interventions for Patients With Chronic Diseases: A Critical Assessment of Their Methodological Quality

PubMed Central

2013-01-01

Background Systematic reviews and meta-analyses of home telemonitoring interventions for patients with chronic diseases have increased over the past decade and become increasingly important to a wide range of clinicians, policy makers, and other health care stakeholders. While a few criticisms about their methodological rigor and synthesis approaches have recently appeared, no formal appraisal of their quality has been conducted yet. Objective The primary aim of this critical review was to evaluate the methodology, quality, and reporting characteristics of prior reviews that have investigated the effects of home telemonitoring interventions in the context of chronic diseases. Methods Ovid MEDLINE, the Database of Abstract of Reviews of Effects (DARE), and Health Technology Assessment Database (HTA) of the Cochrane Library were electronically searched to find relevant systematic reviews, published between January 1966 and December 2012. Potential reviews were screened and assessed for inclusion independently by three reviewers. Data pertaining to the methods used were extracted from each included review and examined for accuracy by two reviewers. A validated quality assessment instrument, R-AMSTAR, was used as a framework to guide the assessment process. Results Twenty-four reviews, nine of which were meta-analyses, were identified from more than 200 citations. The bibliographic search revealed that the number of published reviews has increased substantially over the years in this area and although most reviews focus on studying the effects of home telemonitoring on patients with congestive heart failure, researcher interest has extended to other chronic diseases as well, such as diabetes, hypertension, chronic obstructive pulmonary disease, and asthma. Nevertheless, an important number of these reviews appear to lack optimal scientific rigor due to intrinsic methodological issues. Also, the overall quality of reviews does not appear to have improved over time. While several criteria were met satisfactorily by either all or nearly all reviews, such as the establishment of an a priori design with inclusion and exclusion criteria, use of electronic searches on multiple databases, and reporting of studies characteristics, there were other important areas that needed improvement. Duplicate data extraction, manual searches of highly relevant journals, inclusion of gray and non-English literature, assessment of the methodological quality of included studies and quality of evidence were key methodological procedures that were performed infrequently. Furthermore, certain methodological limitations identified in the synthesis of study results have affected the results and conclusions of some reviews. Conclusions Despite the availability of methodological guidelines that can be utilized to guide the proper conduct of systematic reviews and meta-analyses and eliminate potential risks of bias, this knowledge has not yet been fully integrated in the area of home telemonitoring. Further efforts should be made to improve the design, conduct, reporting, and publication of systematic reviews and meta-analyses in this area. PMID:23880072

Methodological Quality of Consensus Guidelines in Implant Dentistry.

PubMed

Faggion, Clovis Mariano; Apaza, Karol; Ariza-Fritas, Tania; Málaga, Lilian; Giannakopoulos, Nikolaos Nikitas; Alarcón, Marco Antonio

2017-01-01

Consensus guidelines are useful to improve clinical decision making. Therefore, the methodological evaluation of these guidelines is of paramount importance. Low quality information may guide to inadequate or harmful clinical decisions. To evaluate the methodological quality of consensus guidelines published in implant dentistry using a validated methodological instrument. The six implant dentistry journals with impact factors were scrutinised for consensus guidelines related to implant dentistry. Two assessors independently selected consensus guidelines, and four assessors independently evaluated their methodological quality using the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument. Disagreements in the selection and evaluation of guidelines were resolved by consensus. First, the consensus guidelines were analysed alone. Then, systematic reviews conducted to support the guidelines were included in the analysis. Non-parametric statistics for dependent variables (Wilcoxon signed rank test) was used to compare both groups. Of 258 initially retrieved articles, 27 consensus guidelines were selected. Median scores in four domains (applicability, rigour of development, stakeholder involvement, and editorial independence), expressed as percentages of maximum possible domain scores, were below 50% (median, 26%, 30.70%, 41.70%, and 41.70%, respectively). The consensus guidelines and consensus guidelines + systematic reviews data sets could be compared for 19 guidelines, and the results showed significant improvements in all domain scores (p < 0.05). Methodological improvement of consensus guidelines published in major implant dentistry journals is needed. The findings of the present study may help researchers to better develop consensus guidelines in implant dentistry, which will improve the quality and trust of information needed to make proper clinical decisions.

Methodological Quality of Consensus Guidelines in Implant Dentistry

PubMed Central

Faggion, Clovis Mariano; Apaza, Karol; Ariza-Fritas, Tania; Málaga, Lilian; Giannakopoulos, Nikolaos Nikitas; Alarcón, Marco Antonio

2017-01-01

Background Consensus guidelines are useful to improve clinical decision making. Therefore, the methodological evaluation of these guidelines is of paramount importance. Low quality information may guide to inadequate or harmful clinical decisions. Objective To evaluate the methodological quality of consensus guidelines published in implant dentistry using a validated methodological instrument. Methods The six implant dentistry journals with impact factors were scrutinised for consensus guidelines related to implant dentistry. Two assessors independently selected consensus guidelines, and four assessors independently evaluated their methodological quality using the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument. Disagreements in the selection and evaluation of guidelines were resolved by consensus. First, the consensus guidelines were analysed alone. Then, systematic reviews conducted to support the guidelines were included in the analysis. Non-parametric statistics for dependent variables (Wilcoxon signed rank test) was used to compare both groups. Results Of 258 initially retrieved articles, 27 consensus guidelines were selected. Median scores in four domains (applicability, rigour of development, stakeholder involvement, and editorial independence), expressed as percentages of maximum possible domain scores, were below 50% (median, 26%, 30.70%, 41.70%, and 41.70%, respectively). The consensus guidelines and consensus guidelines + systematic reviews data sets could be compared for 19 guidelines, and the results showed significant improvements in all domain scores (p < 0.05). Conclusions Methodological improvement of consensus guidelines published in major implant dentistry journals is needed. The findings of the present study may help researchers to better develop consensus guidelines in implant dentistry, which will improve the quality and trust of information needed to make proper clinical decisions. PMID:28107405

Meat in context. On the relation between perceptions and contexts.

PubMed

Korzen, Sara; Lassen, Jesper

2010-04-01

Studies of the public perception of specific food qualities often report conflicting findings, and it is well known that actual market behaviour frequently deviates from the perceptions of food quality expressed in interviews or surveys. Rather than treating these kinds of disparity as the result of data being self-contradictory, this paper, which builds on sociological theories and an empirical study, suggests that the concept of context can contribute to a better understanding of the threatened paradoxes. First, the paper introduces and discusses context as a theoretical and methodological approach in studies of public perceptions of food quality. Second, a case study of the importance of different contexts for Danish public perceptions of meat quality is reported. The study involved a series of focus-group interviews with Danes. Its results demonstrate that public concerns about meat quality vary, depending on whether they relate to meat in an everyday context or production context. It is concluded that the deployment of context as a methodological and interpretive frame improves our understanding of disparities in the reporting of public perceptions of food qualities. Copyright 2009 Elsevier Ltd. All rights reserved.

Elevated guideway cost-ride quality studies for group rapid transit systems

DOT National Transportation Integrated Search

1977-10-01

A methodology is developed for relating cost to ride quality in elevated guideway : system design, based upon directly relating guideway structural properties and : construction tolerances to both cost and ride quality. It is illustrated in detail : ...

Assessing medical professionalism: A systematic review of instruments and their measurement properties

PubMed Central

Li, Honghe; Liu, Yang; Wen, Deliang

2017-01-01

Background Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments’ measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. Methods A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990–2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument’s usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee’s criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. Results After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar’s instrument for nursing students, Nurse Practitioners’ Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Conclusion Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies. PMID:28498838

Adherence of hip and knee arthroplasty studies to RSA standardization guidelines

PubMed Central

Mäkinen, Tatu J; Aro, Hannu T; Bragdon, Charles; Malchau, Henrik

2014-01-01

Background and purpose Guidelines for standardization of radiostereometry (RSA) of implants were published in 2005 to facilitate comparison of outcomes between various research groups. In this systematic review, we determined how well studies have adhered to these guidelines. Methods We carried out a literature search to identify all articles published between January 2000 and December 2011 that used RSA in the evaluation of hip or knee prosthesis migration. 2 investigators independently evaluated each of the studies for adherence to the 13 individual guideline items. Since some of the 13 points included more than 1 criterion, studies were assessed on whether each point was fully met, partially met, or not met. Results 153 studies that met our inclusion criteria were identified. 61 of these were published before the guidelines were introduced (2000–2005) and 92 after the guidelines were introduced (2006–2011). The methodological quality of RSA studies clearly improved from 2000 to 2011. None of the studies fully met all 13 guidelines. Nearly half (43) of the studies published after the guidelines demonstrated a high methodological quality and adhered at least partially to 10 of the 13 guidelines, whereas less than one-fifth (11) of the studies published before the guidelines had the same methodological quality. Commonly unaddressed guideline items were related to imaging methodology, determination of precision from double examinations, and also mean error of rigid-body fitting and condition number cutoff levels. Interpretation The guidelines have improved methodological reporting in RSA studies, but adherence to these guidelines is still relatively low. There is a need to update and clarify the guidelines for clinical hip and knee arthroplasty RSA studies. PMID:24954489

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Experienced quality factors: qualitative evaluation approach to audiovisual quality

NASA Astrophysics Data System (ADS)

Jumisko-Pyykkö, Satu; Häkkinen, Jukka; Nyman, Göte

2007-02-01

Subjective evaluation is used to identify impairment factors of multimedia quality. The final quality is often formulated via quantitative experiments, but this approach has its constraints, as subject's quality interpretations, experiences and quality evaluation criteria are disregarded. To identify these quality evaluation factors, this study examined qualitatively the criteria participants used to evaluate audiovisual video quality. A semi-structured interview was conducted with 60 participants after a subjective audiovisual quality evaluation experiment. The assessment compared several, relatively low audio-video bitrate ratios with five different television contents on mobile device. In the analysis, methodological triangulation (grounded theory, Bayesian networks and correspondence analysis) was applied to approach the qualitative quality. The results showed that the most important evaluation criteria were the factors of visual quality, contents, factors of audio quality, usefulness - followability and audiovisual interaction. Several relations between the quality factors and the similarities between the contents were identified. As a research methodological recommendation, the focus on content and usage related factors need to be further examined to improve the quality evaluation experiments.

Quality and Rigor of the Concept Mapping Methodology: A Pooled Study Analysis

ERIC Educational Resources Information Center

Rosas, Scott R.; Kane, Mary

2012-01-01

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative…

[Strengthening the methodology of study designs in scientific researches].

PubMed

Ren, Ze-qin

2010-06-01

Many problems in study designs have affected the validity of scientific researches seriously. We must understand the methodology of research, especially clinical epidemiology and biostatistics, and recognize the urgency in selection and implement of right study design. Thereafter we can promote the research capability and improve the overall quality of scientific researches.

Systematic review of the methodological quality of clinical guideline development for the management of chronic disease in Europe.

PubMed

Knai, Cécile; Brusamento, Serena; Legido-Quigley, Helena; Saliba, Vanessa; Panteli, Dimitra; Turk, Eva; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

The use of evidence-based clinical guidelines is an essential component of chronic disease management. However, there is well-documented concern about variability in the quality of clinical guidelines, with evidence of persisting methodological shortcomings. The most widely accepted approach to assessing the quality of guidelines is the Appraisal of Guidelines for Research and Evaluation (AGREE) instrument. We have conducted a systematic review of the methodological quality (as assessed by AGREE) of clinical guidelines developed in Europe for the management of chronic diseases published since 2000. The systematic review was undertaken in accordance with the Cochrane methodology. The inclusion criteria were that studies should have appraised European clinical guidelines for certain selected chronic disorders using the AGREE instrument. We searched five databases (Cab Abstracts, EMBASE, MEDLINE, Trip and EPPI). Nine studies reported in 10 papers, analysing a total of 28 European guidelines from eight countries as well as pan-European, were included. There was considerable variation in the quality of clinical guidelines across the AGREE domains. The least well addressed domains were 'editorial independence' (with a mean domain score of 41%), 'applicability' (44%), 'stakeholder involvement' (55%), and 'rigour of development' (64%), while 'clarity of presentation' (80%) and 'scope and purpose' (84%) were less problematic. This review indicates that there is considerable scope for improvement in the methods used to develop clinical guidelines for the prevention, management and treatment of chronic diseases in Europe. Given the importance of decision support strategies such as clinical guidelines in chronic disease management, improvement measures should include the explicit and transparent involvement of key stakeholders (especially scientific experts, guideline users and methodological specialists) and consideration of the implications for guideline implementation and applicability early on in the process. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Methodological reporting of randomized controlled trials in major hepato-gastroenterology journals in 2008 and 1998: a comparative study

PubMed Central

2011-01-01

Background It was still unclear whether the methodological reporting quality of randomized controlled trials (RCTs) in major hepato-gastroenterology journals improved after the Consolidated Standards of Reporting Trials (CONSORT) Statement was revised in 2001. Methods RCTs in five major hepato-gastroenterology journals published in 1998 or 2008 were retrieved from MEDLINE using a high sensitivity search method and their reporting quality of methodological details were evaluated based on the CONSORT Statement and Cochrane Handbook for Systematic Reviews of interventions. Changes of the methodological reporting quality between 2008 and 1998 were calculated by risk ratios with 95% confidence intervals. Results A total of 107 RCTs published in 2008 and 99 RCTs published in 1998 were found. Compared to those in 1998, the proportion of RCTs that reported sequence generation (RR, 5.70; 95%CI 3.11-10.42), allocation concealment (RR, 4.08; 95%CI 2.25-7.39), sample size calculation (RR, 3.83; 95%CI 2.10-6.98), incomplete outecome data addressed (RR, 1.81; 95%CI, 1.03-3.17), intention-to-treat analyses (RR, 3.04; 95%CI 1.72-5.39) increased in 2008. Blinding and intent-to-treat analysis were reported better in multi-center trials than in single-center trials. The reporting of allocation concealment and blinding were better in industry-sponsored trials than in public-funded trials. Compared with historical studies, the methodological reporting quality improved with time. Conclusion Although the reporting of several important methodological aspects improved in 2008 compared with those published in 1998, which may indicate the researchers had increased awareness of and compliance with the revised CONSORT statement, some items were still reported badly. There is much room for future improvement. PMID:21801429

Decision to abort after a prenatal diagnosis of sex chromosome abnormality: a systematic review of the literature.

PubMed

Jeon, Kwon Chan; Chen, Lei-Shih; Goodson, Patricia

2012-01-01

We performed a systematic review of factors affecting parental decisions to continue or terminate a pregnancy after prenatal diagnosis of a sex chromosome abnormality, as reported in published studies from 1987 to May 2011. Based on the Matrix Method for systematic reviews, 19 studies were found in five electronic databases, meeting specific inclusion/exclusion criteria. Abstracted data were organized in a matrix. Alongside the search for factors influencing parental decisions, each study was judged on its methodological quality and assigned a methodological quality score. Decisions either to terminate or to continue a sex chromosome abnormality-affected pregnancy shared five similar factors: specific type of sex chromosome abnormality, gestational week at diagnosis, parents' age, providers' genetic expertise, and number of children/desire for (more) children. Factors unique to termination decisions included parents' fear/anxiety and directive counseling. Factors uniquely associated with continuation decisions were parents' socioeconomic status and ethnicity. The studies' average methodological quality score was 10.6 (SD = 1.67; range, 8-14). Findings from this review can be useful in adapting and modifying guidelines for genetic counseling after prenatal diagnosis of a sex chromosome abnormality. Moreover, improving the quality of future studies on this topic may allow clearer understanding of the most influential factors affecting parental decisions.

The Impact of ISO Quality Management Systems on Primary and Secondary Schools in Spain

ERIC Educational Resources Information Center

Arribas Díaz, Jorge Antonio; Martínez-Mediano, Catalina

2018-01-01

Purpose: The purpose of this study is to evaluate the application of quality management systems (QMS) based on international standards of quality in education (ISO 9001:2008) and ascertain the influence of this quality model on primary and secondary schools in Spain. Design/methodology/approach: The study was conducted in 26 publicly funded,…

Occupational Noise and Ischemic Heart Disease: A Systematic Review

PubMed Central

Dzhambov, Angel M; Dimitrova, Donka D

2016-01-01

Noise exposure might be a risk factor for ischemic heart disease (IHD). Unlike residential exposure, however, evidence for occupational noise is limited. Given that high-quality quantitative synthesis of existing data is highly warranted for occupational safety and policy, we aimed at conducting a systematic review and meta-analysis of the risks of IHD morbidity and mortality because of occupational noise exposure. We carried out a systematic search in MEDLINE, EMBASE, and on the Internet since April 2, 2015, in English, Spanish, Russian, and Bulgarian. A quality-scoring checklist was developed a priori to assess different sources of methodological bias. A qualitative data synthesis was performed. Conservative assumptions were applied when appropriate. A meta-analysis was not feasible because of unresolvable methodological discrepancies between the studies. On the basis of five studies, there was some evidence to suggest higher risk of IHD among workers exposed to objectively assessed noise >75–80 dB for <20 years (supported by one high, one moderate, and one low quality study, opposed by one high and one moderate quality study). Three moderate and two low quality studies out of six found self-rated exposure to be associated with higher risk of IHD, and only one moderate quality study found no effect. Out of four studies, a higher mortality risk was suggested by one moderate quality study relying on self-rated exposure and one of high-quality study using objective exposure. Sensitivity analyses showed that at higher exposures and in some vulnerable subgroups, such as women, the adverse effects were considerably stronger. Despite methodological discrepancies and limitations of the included studies, occupational noise appeared to be a risk factor for IHD morbidity. Results suggested higher risk for IHD mortality only among vulnerable subgroups. Workers exposed to high occupational noise should be considered at higher overall risk of IHD. PMID:27569404

[Audit and feedback, and continuous quality improvement strategies to improve the quality of care for type 2 diabetes: a systematic review of literature].

PubMed

Vecchi, Simona; Agabiti, Nera; Mitrova, Susanna; Cacciani, Laura; Amato, Laura; Davoli, Marina; Bargagli, Anna Maria

2016-01-01

we analysed evidence on effective interventions to improve the quality of care and management in patients with diabetes type 2. This review focuses particularly on audit and feedback intervention, targeted to healthcare providers, and continuous quality improvement (CQI) involving health professionals and health care systems, respectively. we searched The Cochrane Library, PubMed, and EMBASE (search period: January 2005-December 2015) to identify systematic reviews (SR) and randomized controlled trials (RCTs) considering patients' outcomes and process measures as quality indicators in diabetes care. Selection of studies and data extraction were carried out independently by two reviewers. Methodological quality of individual studies was assessed using the checklist «Assessment of methodological quality of systematic review» (AMSTAR) and the Cochrane's tool, respectively. We produced summaries of results for each study design. the search process resulted in 810 citations. One SR and 7 RCTs that compared any intervention in which audit and feedback and CQI was a component vs. other interventions were selected. The SR found that audit and feedback activity was associated with improvements of glycaemic (mean difference: 0.26; 95%CI 0.08;0.44) and cholesterol control (mean difference: 0.03; 95%CI -0.04;0.10). CQI interventions were not associated with an improvement of quality of diabetes care. The RCTs considered in this review compared a broad range of interventions including feedback as unique activity or as part of more complex strategies. The methodological quality was generally poor in all the included trials. the available evidence suggests that audit and feedback and CQI improve quality of care in diabetic patients, although the effect is small and heterogeneous among process and outcomes indicators.

Evaluation of global water quality - the potential of a data- and model-driven analysis

NASA Astrophysics Data System (ADS)

Bärlund, Ilona; Flörke, Martina; Alcamo, Joseph; Völker, Jeanette; Malsy, Marcus; Kaus, Andrew; Reder, Klara; Büttner, Olaf; Katterfeld, Christiane; Dietrich, Désirée; Borchardt, Dietrich

2016-04-01

The ongoing socio-economic development presents a new challenge for water quality worldwide, especially in developing and emerging countries. It is estimated that due to population growth and the extension of water supply networks, the amount of waste water will rise sharply. This can lead to an increased risk of surface water quality degradation, if the wastewater is not sufficiently treated. This development has impacts on ecosystems and human health, as well as food security. The United Nations Member States have adopted targets for sustainable development. They include, inter alia, sustainable protection of water quality and sustainable use of water resources. To achieve these goals, appropriate monitoring strategies and the development of indicators for water quality are required. Within the pre-study for a 'World Water Quality Assessment' (WWQA) led by United Nations Environment Programme (UNEP), a methodology for assessing water quality, taking into account the above-mentioned objectives has been developed. The novelty of this methodology is the linked model- and data-driven approach. The focus is on parameters reflecting the key water quality issues, such as increased waste water pollution, salinization or eutrophication. The results from the pre-study show, for example, that already about one seventh of all watercourses in Latin America, Africa and Asia show high organic pollution. This is of central importance for inland fisheries and associated food security. In addition, it could be demonstrated that global water quality databases have large gaps. These must be closed in the future in order to obtain an overall picture of global water quality and to target measures more efficiently. The aim of this presentation is to introduce the methodology developed within the WWQA pre-study and to show selected examples of application in Latin America, Africa and Asia.

The effectiveness of hydrotherapy in the management of rheumatoid arthritis: a systematic review.

PubMed

Al-Qubaeissy, Khamis Y; Fatoye, Francis A; Goodwin, Peter C; Yohannes, Abebaw M

2013-03-01

Hydrotherapy is frequently indicated for the rehabilitation of patients with rheumatoid arthritis (RA); nevertheless, there has been inadequate appraisal of its effectiveness. The potential benefits of hydrotherapy for patients with RA are to improve and/or maintain functional ability and quality of life. The aim of this systematic review was to evaluate the effectiveness of hydrotherapy in the management of patients with RA. AMED, CINAHL, EMBASE, MEDLINE, PubMed, Science Direct and Web of Science were searched between 1988 and May 2011. Keywords used were rheumatoid arthritis, hydrotherapy, aquatic physiotherapy, aqua therapy and water therapy. Searches were supplemented with hand searches of references of selected articles. Randomized controlled trials were assessed for their methodological quality using the Physiotherapy Evidence Database (PEDro) scale. This scale ranks the methodological quality of a study scoring 7 out of 10 as 'high quality', 5-6 as 'moderate quality' and less than 4 as 'poor quality'. Initially, 197 studies were identified. Six studies met the inclusion criteria for further analysis. The average methodological quality for all studies was 6.8 using the PEDro scale. Most of the studies reported favourable outcomes for a hydrotherapy intervention compared with no treatment or other interventions for patients with RA. Improvement was particularly noted in reducing pain, joint tenderness, mood and tension symptoms, and increasing grip strength and patient satisfaction with hydrotherapy treatment in the short term. There is some evidence to suggest that hydrotherapy has a positive role in reducing pain and improving the health status of patients with RA compared with no or other interventions in the short term. However, the long-term benefit is unknown. Further studies are needed. Copyright © 2012 John Wiley & Sons, Ltd.

Using Quality Tools and Methodologies to Improve a Hospital's Quality Position.

PubMed

Branco, Daniel; Wicks, Angela M; Visich, John K

2017-01-01

The authors identify the quality tools and methodologies most frequently used by quality-positioned hospitals versus nonquality hospitals. Northeastern U.S. hospitals in both groups received a brief, 12-question survey. The authors found that 93.75% of the quality hospitals and 81.25% of the nonquality hospitals used some form of process improvement methodologies. However, there were significant differences between the groups regarding the impact of quality improvement initiatives on patients. The findings indicate that in quality hospitals the use of quality improvement initiatives had a significantly greater positive impact on patient satisfaction and patient outcomes when compared to nonquality hospitals.

Methodological aspects of clinical trials in tinnitus: A proposal for an international standard

PubMed Central

Landgrebe, Michael; Azevedo, Andréia; Baguley, David; Bauer, Carol; Cacace, Anthony; Coelho, Claudia; Dornhoffer, John; Figueiredo, Ricardo; Flor, Herta; Hajak, Goeran; van de Heyning, Paul; Hiller, Wolfgang; Khedr, Eman; Kleinjung, Tobias; Koller, Michael; Lainez, Jose Miguel; Londero, Alain; Martin, William H.; Mennemeier, Mark; Piccirillo, Jay; De Ridder, Dirk; Rupprecht, Rainer; Searchfield, Grant; Vanneste, Sven; Zeman, Florian; Langguth, Berthold

2013-01-01

Chronic tinnitus is a common condition with a high burden of disease. While many different treatments are used in clinical practice, the evidence for the efficacy of these treatments is low and the variance of treatment response between individuals is high. This is most likely due to the great heterogeneity of tinnitus with respect to clinical features as well as underlying pathophysiological mechanisms. There is a clear need to find effective treatment options in tinnitus, however, clinical trials differ substantially with respect to methodological quality and design. Consequently, the conclusions that can be derived from these studies are limited and jeopardize comparison between studies. Here, we discuss our view of the most important aspects of trial design in clinical studies in tinnitus and make suggestions for an international methodological standard in tinnitus trials. We hope that the proposed methodological standard will stimulate scientific discussion and will help to improve the quality of trials in tinnitus. PMID:22789414

Methodological quality of systematic reviews on treatments for depression: a cross-sectional study.

PubMed

Chung, V C H; Wu, X Y; Feng, Y; Ho, R S T; Wong, S Y S; Threapleton, D

2017-05-02

Depression is one of the most common mental disorders and identifying effective treatment strategies is crucial for the control of depression. Well-conducted systematic reviews (SRs) and meta-analyses can provide the best evidence for supporting treatment decision-making. Nevertheless, the trustworthiness of conclusions can be limited by lack of methodological rigour. This study aims to assess the methodological quality of a representative sample of SRs on depression treatments. A cross-sectional study on the bibliographical and methodological characteristics of SRs published on depression treatments trials was conducted. Two electronic databases (the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects) were searched for potential SRs. SRs with at least one meta-analysis on the effects of depression treatments were considered eligible. The methodological quality of included SRs was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. The associations between bibliographical characteristics and scoring on AMSTAR items were analysed using logistic regression analysis. A total of 358 SRs were included and appraised. Over half of included SRs (n = 195) focused on non-pharmacological treatments and harms were reported in 45.5% (n = 163) of all studies. Studies varied in methods and reporting practices: only 112 (31.3%) took the risk of bias among primary studies into account when formulating conclusions; 245 (68.4%) did not fully declare conflict of interests; 93 (26.0%) reported an 'a priori' design and 104 (29.1%) provided lists of both included and excluded studies. Results from regression analyses showed: more recent publications were more likely to report 'a priori' designs [adjusted odds ratio (AOR) 1.31, 95% confidence interval (CI) 1.09-1.57], to describe study characteristics fully (AOR 1.16, 95% CI 1.06-1.28), and to assess presence of publication bias (AOR 1.13, 95% CI 1.06-1.19), but were less likely to list both included and excluded studies (AOR 0.86, 95% CI 0.81-0.92). SRs published in journals with higher impact factor (AOR 1.14, 95% CI 1.04-1.25), completed by more review authors (AOR 1.12, 95% CI 1.01-1.24) and SRs on non-pharmacological treatments (AOR 1.62, 95% CI 1.01-2.59) were associated with better performance in publication bias assessment. The methodological quality of included SRs is disappointing. Future SRs should strive to improve rigour by considering of risk of bias when formulating conclusions, reporting conflict of interests and authors should explicitly describe harms. SR authors should also use appropriate methods to combine the results, prevent language and publication biases, and ensure timely updates.

Quality and reporting of diagnostic accuracy studies in TB, HIV and malaria: evaluation using QUADAS and STARD standards.

PubMed

Fontela, Patricia Scolari; Pant Pai, Nitika; Schiller, Ian; Dendukuri, Nandini; Ramsay, Andrew; Pai, Madhukar

2009-11-13

Poor methodological quality and reporting are known concerns with diagnostic accuracy studies. In 2003, the QUADAS tool and the STARD standards were published for evaluating the quality and improving the reporting of diagnostic studies, respectively. However, it is unclear whether these tools have been applied to diagnostic studies of infectious diseases. We performed a systematic review on the methodological and reporting quality of diagnostic studies in TB, malaria and HIV. We identified diagnostic accuracy studies of commercial tests for TB, malaria and HIV through a systematic search of the literature using PubMed and EMBASE (2004-2006). Original studies that reported sensitivity and specificity data were included. Two reviewers independently extracted data on study characteristics and diagnostic accuracy, and used QUADAS and STARD to evaluate the quality of methods and reporting, respectively. Ninety (38%) of 238 articles met inclusion criteria. All studies had design deficiencies. Study quality indicators that were met in less than 25% of the studies included adequate description of withdrawals (6%) and reference test execution (10%), absence of index test review bias (19%) and reference test review bias (24%), and report of uninterpretable results (22%). In terms of quality of reporting, 9 STARD indicators were reported in less than 25% of the studies: methods for calculation and estimates of reproducibility (0%), adverse effects of the diagnostic tests (1%), estimates of diagnostic accuracy between subgroups (10%), distribution of severity of disease/other diagnoses (11%), number of eligible patients who did not participate in the study (14%), blinding of the test readers (16%), and description of the team executing the test and management of indeterminate/outlier results (both 17%). The use of STARD was not explicitly mentioned in any study. Only 22% of 46 journals that published the studies included in this review required authors to use STARD. Recently published diagnostic accuracy studies on commercial tests for TB, malaria and HIV have moderate to low quality and are poorly reported. The more frequent use of tools such as QUADAS and STARD may be necessary to improve the methodological and reporting quality of future diagnostic accuracy studies in infectious diseases.

Quality and Reporting of Diagnostic Accuracy Studies in TB, HIV and Malaria: Evaluation Using QUADAS and STARD Standards

PubMed Central

Fontela, Patricia Scolari; Pant Pai, Nitika; Schiller, Ian; Dendukuri, Nandini; Ramsay, Andrew; Pai, Madhukar

2009-01-01

Background Poor methodological quality and reporting are known concerns with diagnostic accuracy studies. In 2003, the QUADAS tool and the STARD standards were published for evaluating the quality and improving the reporting of diagnostic studies, respectively. However, it is unclear whether these tools have been applied to diagnostic studies of infectious diseases. We performed a systematic review on the methodological and reporting quality of diagnostic studies in TB, malaria and HIV. Methods We identified diagnostic accuracy studies of commercial tests for TB, malaria and HIV through a systematic search of the literature using PubMed and EMBASE (2004–2006). Original studies that reported sensitivity and specificity data were included. Two reviewers independently extracted data on study characteristics and diagnostic accuracy, and used QUADAS and STARD to evaluate the quality of methods and reporting, respectively. Findings Ninety (38%) of 238 articles met inclusion criteria. All studies had design deficiencies. Study quality indicators that were met in less than 25% of the studies included adequate description of withdrawals (6%) and reference test execution (10%), absence of index test review bias (19%) and reference test review bias (24%), and report of uninterpretable results (22%). In terms of quality of reporting, 9 STARD indicators were reported in less than 25% of the studies: methods for calculation and estimates of reproducibility (0%), adverse effects of the diagnostic tests (1%), estimates of diagnostic accuracy between subgroups (10%), distribution of severity of disease/other diagnoses (11%), number of eligible patients who did not participate in the study (14%), blinding of the test readers (16%), and description of the team executing the test and management of indeterminate/outlier results (both 17%). The use of STARD was not explicitly mentioned in any study. Only 22% of 46 journals that published the studies included in this review required authors to use STARD. Conclusion Recently published diagnostic accuracy studies on commercial tests for TB, malaria and HIV have moderate to low quality and are poorly reported. The more frequent use of tools such as QUADAS and STARD may be necessary to improve the methodological and reporting quality of future diagnostic accuracy studies in infectious diseases. PMID:19915664

Improving the Quality of Services in Residential Treatment Facilities: A Strength-Based Consultative Review Process

ERIC Educational Resources Information Center

Pavkov, Thomas W.; Lourie, Ira S.; Hug, Richard W.; Negash, Sesen

2010-01-01

This descriptive case study reports on the positive impact of a consultative review methodology used to conduct quality assurance reviews as part of the Residential Treatment Center Evaluation Project. The study details improvement in the quality of services provided to youth in unmonitored residential treatment facilities. Improvements were…

Performance-Based Service Quality Model: An Empirical Study on Japanese Universities

ERIC Educational Resources Information Center

Sultan, Parves; Wong, Ho

2010-01-01

Purpose: This paper aims to develop and empirically test the performance-based higher education service quality model. Design/methodology/approach: The study develops 67-item instrument for measuring performance-based service quality with a particular focus on the higher education sector. Scale reliability is confirmed using the Cronbach's alpha.…

Quality Assessment of TPB-Based Questionnaires: A Systematic Review

PubMed Central

Oluka, Obiageli Crystal; Nie, Shaofa; Sun, Yi

2014-01-01

Objective This review is aimed at assessing the quality of questionnaires and their development process based on the theory of planned behavior (TPB) change model. Methods A systematic literature search for studies with the primary aim of TPB-based questionnaire development was conducted in relevant databases between 2002 and 2012 using selected search terms. Ten of 1,034 screened abstracts met the inclusion criteria and were assessed for methodological quality using two different appraisal tools: one for the overall methodological quality of each study and the other developed for the appraisal of the questionnaire content and development process. Both appraisal tools consisted of items regarding the likelihood of bias in each study and were eventually combined to give the overall quality score for each included study. Results 8 of the 10 included studies showed low risk of bias in the overall quality assessment of each study, while 9 of the studies were of high quality based on the quality appraisal of questionnaire content and development process. Conclusion Quality appraisal of the questionnaires in the 10 reviewed studies was successfully conducted, highlighting the top problem areas (including: sample size estimation; inclusion of direct and indirect measures; and inclusion of questions on demographics) in the development of TPB-based questionnaires and the need for researchers to provide a more detailed account of their development process. PMID:24722323

A critical methodological review of discourse and conversation analysis studies of family therapy.

PubMed

Tseliou, Eleftheria

2013-12-01

Discourse (DA) and conversation (CA) analysis, two qualitative research methods, have been recently suggested as potentially promising for the study of family therapy due to common epistemological adherences and their potential for an in situ study of therapeutic dialog. However, to date, there is no systematic methodological review of the few existing DA and CA studies of family therapy. This study aims at addressing this lack by critically reviewing published DA and CA studies of family therapy on methodological grounds. Twenty-eight articles in total are reviewed in relation to certain methodological axes identified in the relevant literature. These include choice of method, framing of research question(s), data/sampling, type of analysis, epistemological perspective, content/type of knowledge claims, and attendance to criteria for good quality practice. It is argued that the reviewed studies show "glimpses" of the methods' potential for family therapy research despite the identification of certain "shortcomings" regarding their methodological rigor. These include unclearly framed research questions and the predominance of case study designs. They also include inconsistencies between choice of method, stated or unstated epistemological orientations and knowledge claims, and limited attendance to criteria for good quality practice. In conclusion, it is argued that DA and CA can add to the existing quantitative and qualitative methods for family therapy research. They can both offer unique ways for a detailed study of the actual therapeutic dialog, provided that future attempts strive for a methodologically rigorous practice and against their uncritical deployment. © FPI, Inc.

[Definition of low threshold volumes for quality assurance: conceptual and methodological issues involved in the definition and evaluation of thresholds for volume outcome relations in clinical care].

PubMed

Wetzel, Hermann

2006-01-01

In a large number of mostly retrospective association studies, a statistical relationship between volume and quality of health care has been reported. However, the relevance of these results is frequently limited by methodological shortcomings. In this article, criteria for the evidence and definition of thresholds for volume-outcome relations are proposed, e.g. the specification of relevant outcomes for quality indicators, analysis of volume as a continuous variable with an adequate case-mix and risk adjustment, accounting for cluster effects and considering mathematical models for the derivation of cut-off values. Moreover, volume thresholds are regarded as surrogate parameters for the indirect classification of the quality of care, whose diagnostic validity and effectiveness in improving health care quality need to be evaluated in prospective studies.

A new approach to subjectively assess quality of plenoptic content

NASA Astrophysics Data System (ADS)

Viola, Irene; Řeřábek, Martin; Ebrahimi, Touradj

2016-09-01

Plenoptic content is becoming increasingly popular thanks to the availability of acquisition and display devices. Thanks to image-based rendering techniques, a plenoptic content can be rendered in real time in an interactive manner allowing virtual navigation through the captured scenes. This way of content consumption enables new experiences, and therefore introduces several challenges in terms of plenoptic data processing, transmission and consequently visual quality evaluation. In this paper, we propose a new methodology to subjectively assess the visual quality of plenoptic content. We also introduce a prototype software to perform subjective quality assessment according to the proposed methodology. The proposed methodology is further applied to assess the visual quality of a light field compression algorithm. Results show that this methodology can be successfully used to assess the visual quality of plenoptic content.

Epidemiology, quality and reporting characteristics of meta-analyses of observational studies published in Chinese journals.

PubMed

Zhang, Zhe-wen; Cheng, Juan; Liu, Zhuan; Ma, Ji-chun; Li, Jin-long; Wang, Jing; Yang, Ke-hu

2015-12-07

The aim of this study was to examine the epidemiological and reporting characteristics as well as the methodological quality of meta-analyses (MAs) of observational studies published in Chinese journals. 5 Chinese databases were searched for MAs of observational studies published from January 1978 to May 2014. Data were extracted into Excel spreadsheets, and Meta-analysis of Observational Studies in Epidemiology (MOOSE) and Assessment of Multiple Systematic Reviews (AMSTAR) checklists were used to assess reporting characteristics and methodological quality, respectively. A total of 607 MAs were included. Only 52.2% of the MAs assessed the quality of the included primary studies, and the retrieval information was not comprehensive in more than half (85.8%) of the MAs. In addition, 50 (8.2%) MAs did not search any Chinese databases, while 126 (20.8%) studies did not search any English databases. Approximately 41.2% of the MAs did not describe the statistical methods in sufficient details, and most (95.5%) MAs did not report on conflicts of interest. However, compared with the before publication of the MOOSE Checklist, the quality of reporting improved significantly for 20 subitems after publication of the MOOSE Checklist, and 7 items of the included MAs demonstrated significant improvement after publication of the AMSTAR Checklist (p<0.05). Although many MAs of observational studies have been published in Chinese journals, the reporting quality is questionable. Thus, there is an urgent need to increase the use of reporting guidelines and methodological tools in China; we recommend that Chinese journals adopt the MOOSE and AMSTAR criteria. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

The quality of the evidence base for clinical pathway effectiveness: room for improvement in the design of evaluation trials.

PubMed

Rotter, Thomas; Kinsman, Leigh; James, Erica; Machotta, Andreas; Steyerberg, Ewout W

2012-06-18

The purpose of this article is to report on the quality of the existing evidence base regarding the effectiveness of clinical pathway (CPW) research in the hospital setting. The analysis is based on a recently published Cochrane review of the effectiveness of CPWs. An integral component of the review process was a rigorous appraisal of the methodological quality of published CPW evaluations. This allowed the identification of strengths and limitations of the evidence base for CPW effectiveness. We followed the validated Cochrane Effective Practice and Organisation of Care Group (EPOC) criteria for randomized and non-randomized clinical pathway evaluations. In addition, we tested the hypotheses that simple pre-post studies tend to overestimate CPW effects reported. Out of the 260 primary studies meeting CPW content criteria, only 27 studies met the EPOC study design criteria, with the majority of CPW studies (more than 70 %) excluded from the review on the basis that they were simple pre-post evaluations, mostly comparing two or more annual patient cohorts. Methodologically poor study designs are often used to evaluate CPWs and this compromises the quality of the existing evidence base. Cochrane EPOC methodological criteria, including the selection of rigorous study designs along with detailed descriptions of CPW development and implementation processes, are recommended for quantitative evaluations to improve the evidence base for the use of CPWs in hospitals.

Acupuncture and moxibustion for lateral elbow pain: a systematic review of randomized controlled trials

PubMed Central

2014-01-01

Background Acupuncture and moxibustion have widely been used to treat lateral elbow pain (LEP). A comprehensive systematic review of randomized controlled trials (RCTs) including both English and Chinese databases was conducted to assess the efficacy of acupuncture and moxibustion in the treatment of LEP. Methods Revised STRICTA (2010) criteria were used to appraise the acupuncture procedures, the Cochrane risk of bias tool was used to assess the methodological quality of the studies. A total of 19 RCTs that compared acupuncture and/or moxibustion with sham acupuncture, another form of acupuncture, or conventional treatment were included. Results All studies had at least one domain rated as high risk or uncertain risk of bias in the Cochrane risk of bias tool. Results from three RCTs of moderate quality showed that acupuncture was more effective than sham acupuncture. Results from 10 RCTs of mostly low quality showed that acupuncture or moxibustion was superior or equal to conventional treatment, such as local anesthetic injection, local steroid injection, non-steroidal anti- inflammatory drugs, or ultrasound. There were six low quality RCTs that compared acupuncture and moxibustion combined with manual acupuncture alone, and all showed that acupuncture and moxibustion combined was superior to manual acupuncture alone. Conclusion Moderate quality studies suggest that acupuncture is more effective than sham acupuncture. Interpretations of findings regarding acupuncture vs. conventional treatment, and acupuncture and moxibustion combined vs. manual acupuncture alone are limited by the methodological qualities of these studies. Future studies with improved methodological design are warranted to confirm the efficacy of acupuncture and moxibustion for LEP. PMID:24726029

[Methodological quality and reporting quality evaluation of randomized controlled trials published in China Journal of Chinese Materia Medica].

PubMed

Yu, Dan-Dan; Xie, Yan-Ming; Liao, Xing; Zhi, Ying-Jie; Jiang, Jun-Jie; Chen, Wei

2018-02-01

To evaluate the methodological quality and reporting quality of randomized controlled trials(RCTs) published in China Journal of Chinese Materia Medica, we searched CNKI and China Journal of Chinese Materia webpage to collect RCTs since the establishment of the magazine. The Cochrane risk of bias assessment tool was used to evaluate the methodological quality of RCTs. The CONSORT 2010 list was adopted as reporting quality evaluating tool. Finally, 184 RCTs were included and evaluated methodologically, of which 97 RCTs were evaluated with reporting quality. For the methodological evaluating, 62 trials(33.70%) reported the random sequence generation; 9(4.89%) trials reported the allocation concealment; 25(13.59%) trials adopted the method of blinding; 30(16.30%) trials reported the number of patients withdrawing, dropping out and those lost to follow-up;2 trials （1.09%） reported trial registration and none of the trial reported the trial protocol; only 8(4.35%) trials reported the sample size estimation in details. For reporting quality appraising, 3 reporting items of 25 items were evaluated with high-quality,including: abstract, participants qualified criteria, and statistical methods; 4 reporting items with medium-quality, including purpose, intervention, random sequence method, and data collection of sites and locations; 9 items with low-quality reporting items including title, backgrounds, random sequence types, allocation concealment, blindness, recruitment of subjects, baseline data, harms, and funding;the rest of items were of extremely low quality(the compliance rate of reporting item<10%). On the whole, the methodological and reporting quality of RCTs published in the magazine are generally low. Further improvement in both methodological and reporting quality for RCTs of traditional Chinese medicine are warranted. It is recommended that the international standards and procedures for RCT design should be strictly followed to conduct high-quality trials. At the same time, in order to improve the reporting quality of randomized controlled trials, CONSORT standards should be adopted in the preparation of research reports and submissions. Copyright© by the Chinese Pharmaceutical Association.

Volume and methodological quality of randomized controlled trials in laparoscopic surgery: assessment over a 10-year period.

PubMed

Antoniou, Stavros A; Andreou, Alexandros; Antoniou, George A; Koch, Oliver O; Köhler, Gernot; Luketina, Ruzica-R; Bertsias, Antonios; Pointner, Rudolph; Granderath, Frank-Alexander

2015-11-01

Measures have been taken to improve methodological quality of randomized controlled trials (RCTs). This review systematically assessed the trends in volume and methodological quality of RCTs on minimally invasive surgery within a 10-year period. RCTs on minimally invasive surgery were searched in the 10 most cited general surgical journals and the 5 most cited journals of laparoscopic interest for the years 2002 and 2012. Bibliometric and methodological quality components were abstracted using the Scottish Intercollegiate Guidelines Network. The pooled number of RCTs from low-contribution regions demonstrated an increasing proportion of the total published RCTs, compensating for a concomitant decrease of the respective contributions from Europe and North America. International collaborations were more frequent in 2012. Acceptable or high quality RCTs accounted for 37.9% and 54.4% of RCTs published in 2002 and 2012, respectively. Components of external validity were poorly reported. Both the volume and the reporting quality of laparoscopic RCTs have increased from 2002 to 2012, but there seems to be ample room for improvement of methodological quality. Copyright © 2015 Elsevier Inc. All rights reserved.

Using Plant Clinic Registers to Assess the Quality of Diagnoses and Advice Given to Farmers: A Case Study from Uganda

ERIC Educational Resources Information Center

Danielsen, Solveig; Boa, Eric; Mafabi, Moses; Mutebi, Emmanuel; Reeder, Robert; Kabeere, Flavia; Karyeija, Robert

2013-01-01

Purpose: This study developed a framework for quality assessment of diagnoses and advice given at plant clinics. Design/methodology/approach: Clinic registers from five plant clinics in Uganda (2006-2010) were used to develop quality assessment protocols for diagnoses and advice given by plant doctors. Assessment of quality of diagnoses was based…

Dissemination of Periodontal Pathogens in the Bloodstream after Periodontal Procedures: A Systematic Review

PubMed Central

Horliana, Anna Carolina Ratto Tempestini; Chambrone, Leandro; Foz, Adriana Moura; Artese, Hilana Paula Carillo; Rabelo, Mariana de Sousa; Pannuti, Cláudio Mendes; Romito, Giuseppe Alexandre

2014-01-01

Background To date, there is no compilation of evidence-based information associating bacteremia and periodontal procedures. This systematic review aims to assess magnitude, duration, prevalence and nature of bacteremia caused by periodontal procedures. Study Design Systematic Review Types of Studies Reviewed MEDLINE, EMBASE and LILACS databases were searched in duplicate through August, 2013 without language restriction. Observational studies were included if blood samples were collected before, during or after periodontal procedures of patients with periodontitis. The methodological quality was assessed in duplicate using the modified Newcastle-Ottawa scale (NOS). Results Search strategy identified 509 potentially eligible articles and nine were included. Only four studies demonstrated high methodological quality, whereas five were of medium or low methodological quality. The study characteristics were considered too heterogeneous to conduct a meta-analysis. Among 219 analyzed patients, 106 (49.4%) had positive bacteremia. More frequent bacteria were S. viridans, A. actinomycetemcomitans P. gingivalis, M. micros and species Streptococcus and Actinomyces, although identification methods of microbiologic assays were different among studies. Clinical Implications Although half of the patients presented positive bacteremia after periodontal procedures, accurate results regarding the magnitude, duration and nature of bacteremia could not be confidentially assessed. PMID:24870125

Twenty years of meta-analyses in orthopaedic surgery: has quality kept up with quantity?

PubMed

Dijkman, Bernadette G; Abouali, Jihad A K; Kooistra, Bauke W; Conter, Henry J; Poolman, Rudolf W; Kulkarni, Abhaya V; Tornetta, Paul; Bhandari, Mohit

2010-01-01

As the number of studies in the literature is increasing, orthopaedic surgeons highly depend on meta-analyses as their primary source of scientific evidence. The objectives of this review were to assess the scientific quality and number of published meta-analyses on orthopaedics-related topics over time. We conducted, in duplicate and independently, a systematic review of published meta-analyses in orthopaedics in the years 2005 and 2008 and compared them with a previous systematic review of meta-analyses from 1969 to 1999. A search of electronic databases (MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews) was performed to identify meta-analyses published in 2005 and 2008. We searched bibliographies and contacted content experts to identify additional relevant studies. Two investigators independently assessed the quality of the studies, using the Oxman and Guyatt index, and abstracted relevant data. We included forty-five and forty-four meta-analyses from 2005 and 2008, respectively. While the number of meta-analyses increased fivefold from 1999 to 2008, the mean quality score did not change significantly over time (p = 0.067). In the later years, a significantly lower proportion of meta-analyses had methodological flaws (56% in 2005 and 68% in 2008) compared with meta-analyses published prior to 2000 (88%) (p = 0.006). In 2005 and 2008, respectively, 18% and 30% of the meta-analyses had major to extensive flaws in their methodology. Studies from 2008 with positive conclusions used and described appropriate criteria for the validity assessment less often than did those with negative results. The use of random-effects and fixed-effects models as pooling methods became more popular toward 2008. Although the methodological quality of orthopaedic meta-analyses has increased in the past twenty years, a substantial proportion continues to show major to extensive flaws. As the number of published meta-analyses is increasing, a routine checklist for scientific quality should be used in the peer-review process to ensure methodological standards for publication.

Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review.

PubMed

Eysenbach, Gunther; Powell, John; Kuss, Oliver; Sa, Eun-Ryoung

The quality of consumer health information on the World Wide Web is an important issue for medicine, but to date no systematic and comprehensive synthesis of the methods and evidence has been performed. To establish a methodological framework on how quality on the Web is evaluated in practice, to determine the heterogeneity of the results and conclusions, and to compare the methodological rigor of these studies, to determine to what extent the conclusions depend on the methodology used, and to suggest future directions for research. We searched MEDLINE and PREMEDLINE (1966 through September 2001), Science Citation Index (1997 through September 2001), Social Sciences Citation Index (1997 through September 2001), Arts and Humanities Citation Index (1997 through September 2001), LISA (1969 through July 2001), CINAHL (1982 through July 2001), PsychINFO (1988 through September 2001), EMBASE (1988 through June 2001), and SIGLE (1980 through June 2001). We also conducted hand searches, general Internet searches, and a personal bibliographic database search. We included published and unpublished empirical studies in any language in which investigators searched the Web systematically for specific health information, evaluated the quality of Web sites or pages, and reported quantitative results. We screened 7830 citations and retrieved 170 potentially eligible full articles. A total of 79 distinct studies met the inclusion criteria, evaluating 5941 health Web sites and 1329 Web pages, and reporting 408 evaluation results for 86 different quality criteria. Two reviewers independently extracted study characteristics, medical domains, search strategies used, methods and criteria of quality assessment, results (percentage of sites or pages rated as inadequate pertaining to a quality criterion), and quality and rigor of study methods and reporting. Most frequently used quality criteria used include accuracy, completeness, readability, design, disclosures, and references provided. Fifty-five studies (70%) concluded that quality is a problem on the Web, 17 (22%) remained neutral, and 7 studies (9%) came to a positive conclusion. Positive studies scored significantly lower in search (P =.02) and evaluation (P =.04) methods. Due to differences in study methods and rigor, quality criteria, study population, and topic chosen, study results and conclusions on health-related Web sites vary widely. Operational definitions of quality criteria are needed.

Identifying approaches for assessing methodological and reporting quality of systematic reviews: a descriptive study.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-06-19

The methodological quality and completeness of reporting of the systematic reviews (SRs) is fundamental to optimal implementation of evidence-based health care and the reduction of research waste. Methods exist to appraise SRs yet little is known about how they are used in SRs or where there are potential gaps in research best-practice guidance materials. The aims of this study are to identify reports assessing the methodological quality (MQ) and/or reporting quality (RQ) of a cohort of SRs and to assess their number, general characteristics, and approaches to 'quality' assessment over time. The Cochrane Library, MEDLINE®, and EMBASE® were searched from January 1990 to October 16, 2014, for reports assessing MQ and/or RQ of SRs. Title, abstract, and full-text screening of all reports were conducted independently by two reviewers. Reports assessing the MQ and/or RQ of a cohort of ten or more SRs of interventions were included. All results are reported as frequencies and percentages of reports. Of 20,765 unique records retrieved, 1189 of them were reviewed for full-text review, of which 76 reports were included. Eight previously published approaches to assessing MQ or reporting guidelines used as proxy to assess RQ were used in 80% (61/76) of identified reports. These included two reporting guidelines (PRISMA and QUOROM) and five quality assessment tools (AMSTAR, R-AMSTAR, OQAQ, Mulrow, Sacks) and GRADE criteria. The remaining 24% (18/76) of reports developed their own criteria. PRISMA, OQAQ, and AMSTAR were the most commonly used published tools to assess MQ or RQ. In conjunction with other approaches, published tools were used in 29% (22/76) of reports, with 36% (8/22) assessing adherence to both PRISMA and AMSTAR criteria and 26% (6/22) using QUOROM and OQAQ. The methods used to assess quality of SRs are diverse, and none has become universally accepted. The most commonly used quality assessment tools are AMSTAR, OQAQ, and PRISMA. As new tools and guidelines are developed to improve both the MQ and RQ of SRs, authors of methodological studies are encouraged to put thoughtful consideration into the use of appropriate tools to assess quality and reporting.

Promoting quality and safety in women's health through the use of transdisciplinary clinical simulation educational modules: methodology and a pilot trial.

PubMed

Montgomery, Kymberlee; Morse, Catherine; Smith-Glasgow, Mary Ellen; Posmontier, Bobbie; Follen, Michele

2012-02-01

This manuscript presents the methodology used to assess the impact of a clinical simulation module used for training providers specializing in women's health. The methodology presented here will be used for a quantitative study in the future. Copyright © 2012 Elsevier HS Journals, Inc. All rights reserved.

Cross-cultural adaptation and measurement properties of generic and cancer-related patient-reported outcome measures (PROMs) for use with cancer patients in Brazil: a systematic review.

PubMed

Albach, Carlos Augusto; Wagland, Richard; Hunt, Katherine J

2018-04-01

This systematic review (1) identifies the current generic and cancer-related patient-reported outcome measures (PROMs) that have been cross-culturally adapted to Brazilian Portuguese and applied to cancer patients and (2) critically evaluates their cross-cultural adaptation (CCA) and measurement properties. Seven databases were searched for articles regarding the translation and evaluation of measurement properties of generic and cancer-related PROMs cross-culturally adapted to Brazilian Portuguese that are applied in adult (≥18 years old) cancer patients. The methodological quality of included studies was assessed using the COSMIN checklist. The bibliographic search retrieved 1674 hits, of which seven studies analysing eight instruments were included in this review. Data on the interpretability of scores were poorly reported. Overall, the quality of the CCA process was inconsistent throughout the studies. None of the included studies performed a cross-cultural validation. The evidence concerning the quality of measurement properties is limited by poor or fair methodological quality. Moreover, limited information regarding measurement properties was provided within the included papers. This review aids the selection process of Brazilian Portuguese PROMs for use in cancer patients. After acknowledging the methodological caveats and strengths of each tool, our opinion is that for quality of life and symptoms assessment the adapted FACT-G version and the ESAS could be recommended, respectively. Future research should rely on the already accepted standards of CCA and validation studies.

Randomized clinical trials in dentistry: Risks of bias, risks of random errors, reporting quality, and methodologic quality over the years 1955–2013

PubMed Central

Armijo-Olivo, Susan; Cummings, Greta G.; Amin, Maryam; Flores-Mir, Carlos

2017-01-01

Objectives To examine the risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions and the development of these aspects over time. Methods We included 540 randomized clinical trials from 64 selected systematic reviews. We extracted, in duplicate, details from each of the selected randomized clinical trials with respect to publication and trial characteristics, reporting and methodologic characteristics, and Cochrane risk of bias domains. We analyzed data using logistic regression and Chi-square statistics. Results Sequence generation was assessed to be inadequate (at unclear or high risk of bias) in 68% (n = 367) of the trials, while allocation concealment was inadequate in the majority of trials (n = 464; 85.9%). Blinding of participants and blinding of the outcome assessment were judged to be inadequate in 28.5% (n = 154) and 40.5% (n = 219) of the trials, respectively. A sample size calculation before the initiation of the study was not performed/reported in 79.1% (n = 427) of the trials, while the sample size was assessed as adequate in only 17.6% (n = 95) of the trials. Two thirds of the trials were not described as double blinded (n = 358; 66.3%), while the method of blinding was appropriate in 53% (n = 286) of the trials. We identified a significant decrease over time (1955–2013) in the proportion of trials assessed as having inadequately addressed methodological quality items (P < 0.05) in 30 out of the 40 quality criteria, or as being inadequate (at high or unclear risk of bias) in five domains of the Cochrane risk of bias tool: sequence generation, allocation concealment, incomplete outcome data, other sources of bias, and overall risk of bias. Conclusions The risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions have improved over time; however, further efforts that contribute to the development of more stringent methodology and detailed reporting of trials are still needed. PMID:29272315

Randomized clinical trials in dentistry: Risks of bias, risks of random errors, reporting quality, and methodologic quality over the years 1955-2013.

PubMed

Saltaji, Humam; Armijo-Olivo, Susan; Cummings, Greta G; Amin, Maryam; Flores-Mir, Carlos

2017-01-01

To examine the risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions and the development of these aspects over time. We included 540 randomized clinical trials from 64 selected systematic reviews. We extracted, in duplicate, details from each of the selected randomized clinical trials with respect to publication and trial characteristics, reporting and methodologic characteristics, and Cochrane risk of bias domains. We analyzed data using logistic regression and Chi-square statistics. Sequence generation was assessed to be inadequate (at unclear or high risk of bias) in 68% (n = 367) of the trials, while allocation concealment was inadequate in the majority of trials (n = 464; 85.9%). Blinding of participants and blinding of the outcome assessment were judged to be inadequate in 28.5% (n = 154) and 40.5% (n = 219) of the trials, respectively. A sample size calculation before the initiation of the study was not performed/reported in 79.1% (n = 427) of the trials, while the sample size was assessed as adequate in only 17.6% (n = 95) of the trials. Two thirds of the trials were not described as double blinded (n = 358; 66.3%), while the method of blinding was appropriate in 53% (n = 286) of the trials. We identified a significant decrease over time (1955-2013) in the proportion of trials assessed as having inadequately addressed methodological quality items (P < 0.05) in 30 out of the 40 quality criteria, or as being inadequate (at high or unclear risk of bias) in five domains of the Cochrane risk of bias tool: sequence generation, allocation concealment, incomplete outcome data, other sources of bias, and overall risk of bias. The risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions have improved over time; however, further efforts that contribute to the development of more stringent methodology and detailed reporting of trials are still needed.

Integrating Kano’s Model into Quality Function Deployment for Product Design: A Comprehensive Review

NASA Astrophysics Data System (ADS)

Ginting, Rosnani; Hidayati, Juliza; Siregar, Ikhsan

2018-03-01

Many methods and techniques are adopted by some companies to improve the competitiveness through the fulfillment of customer satisfaction by enhancement and improvement the product design quality. Over the past few years, several researcher have studied extensively combining Quality Function Deployment and Kano’s model as design techniques by focusing on translating consumer desires into a product design. This paper presents a review and analysis of several literatures that associated to the integration methodology of Kano into the QFD process. Various of international journal articles were selected, collected and analyzed through a number of relevant scientific publications. In-depth analysis was performed, and focused in this paper on the results, advantages and drawbacks of its methodology. In addition, this paper also provides the analysis that acquired in this study related to the development of the methodology. It is hopedd this paper can be a reference for other researchers and manufacturing companies to implement the integration method of QFD- Kano for product design.

Sensory stimulation for persons with dementia: a review of the literature.

PubMed

Strøm, Benedicte S; Ytrehus, Siri; Grov, Ellen-Karine

2016-07-01

To provide an overview of available sensory stimulation interventions, and their effect on persons with dementia and to present theoretical and methodological characteristics of the studies included. Different sensory stimulation interventions are used for persons with dementia to increase alertness, reduce agitation and improve quality of life. However, the effect of these interventions is not clear, neither are their characteristics. A systematic search and review of the literature with description of the content and an evaluation of theoretical and methodological approaches. Systematic searches in CINAHL, PubMed (Medline), The Cochrane library and PsycINFO. Studies included have been subject to quality assessment by means of Critical Appraisal Skills Programme. Fifty-five studies were included and thirty of these documented significant effect. The effect of the sensory stimulation interventions mainly reported on negative behaviours, except from five studies assessing quality of life and well-being. The majority of the studies had methodological limitations. The different sensory stimulation interventions were organised into eight categories: music, light therapy, acupressure/reflexology, massage/aromatherapy and doll therapy/pet therapy/toy therapy, the Sonas programme and Snoezelen. More studies are needed to clarify appropriate substantial background for the specific interventions. However, most of the studies based their interventions on a theoretical foundation. Furthermore, more research is needed to measure the effect of sensory stimulation on communication as well as quality of life. In addition, studies are to focus on whether the effect depends on the stage of dementia. Nurses are to be aware of sensory stimulation as a possible intervention to improve persons' quality of life. © 2016 John Wiley & Sons Ltd.

Systematic reviews addressing microsurgical head and neck reconstruction.

PubMed

Momeni, Arash; Jacobson, Joshua Y; Lee, Gordon K

2015-01-01

Systematic reviews frequently form the basis for clinical decision making and guideline development. Yet, the quality of systematic reviews has been variable, thus raising concerns about the validity of their conclusions. In the current study, a quality analysis of systematic reviews was performed, addressing microsurgical head and neck reconstruction. A PubMed search was performed to identify all systematic reviews published up to and including December 2012 in 12 surgical journals. Two authors independently reviewed the literature and extracted data from the included reviews. Discrepancies were resolved by consensus. Quality assessment was performed using AMSTAR. The initial search retrieved 1020 articles. After screening titles and abstracts, 987 articles were excluded. Full-text review of the remaining 33 articles resulted in further exclusion of 18 articles, leaving 15 systematic reviews for final analysis. A marked increase in the number of published systematic reviews over time was noted (P = 0.07). The median AMSTAR score was 5, thus reflecting a "fair" quality. No evidence for improvement in methodological quality over time was noted. The trend to publish more systematic reviews in microsurgical head and neck reconstruction is encouraging. However, efforts are indicated to improve the methodological quality of systematic reviews. Familiarity with criteria of methodological quality is critical to ensure future improvements in the quality of systematic reviews conducted in microsurgery.

Health-Related Quality of Life in Non–Small-Cell Lung Cancer: An Update of a Systematic Review on Methodologic Issues in Randomized Controlled Trials

PubMed Central

Claassens, Lily; van Meerbeeck, Jan; Coens, Corneel; Quinten, Chantal; Ghislain, Irina; Sloan, Elizabeth K.; Wang, Xin Shelly; Velikova, Galina; Bottomley, Andrew

2011-01-01

Purpose This study is an update of a systematic review of health-related quality-of-life (HRQOL) methodology reporting in non–small-cell lung cancer (NSCLC) randomized controlled trials (RCTs). The objective was to evaluate HRQOL methodology reporting over the last decade and its benefit for clinical decision making. Methods A MEDLINE systematic literature review was performed. Eligible RCTs implemented patient-reported HRQOL assessments and regular oncology treatments for newly diagnosed adult patients with NSCLC. Included studies were published in English from August 2002 to July 2010. Two independent reviewers evaluated all included RCTs. Results Fifty-three RCTs were assessed. Of the 53 RCTs, 81% reported that there was no significant difference in overall survival (OS). However, 50% of RCTs that were unable to find OS differences reported a significant difference in HRQOL scores. The quality of HRQOL reporting has improved; both reporting of clinically significant differences and statistical testing of HRQOL have improved. A European Organisation for Research and Treatment of Cancer HRQOL questionnaire was used in 57% of the studies. However, reporting of HRQOL hypotheses and rationales for choosing HRQOL instruments were significantly less than before 2002 (P < .05). Conclusion The number of NSCLC RCTs incorporating HRQOL assessments has considerably increased. HRQOL continues to demonstrate its importance in RCTs, especially in those studies in which no OS difference is found. Despite the improved quality of HRQOL methodology reporting, certain aspects remain underrepresented. Our findings suggest need for an international standardization of HRQOL reporting similar to the CONSORT guidelines for clinical findings. PMID:21464420

Vending machine assessment methodology. A systematic review.

PubMed

Matthews, Melissa A; Horacek, Tanya M

2015-07-01

The nutritional quality of food and beverage products sold in vending machines has been implicated as a contributing factor to the development of an obesogenic food environment. How comprehensive, reliable, and valid are the current assessment tools for vending machines to support or refute these claims? A systematic review was conducted to summarize, compare, and evaluate the current methodologies and available tools for vending machine assessment. A total of 24 relevant research studies published between 1981 and 2013 met inclusion criteria for this review. The methodological variables reviewed in this study include assessment tool type, study location, machine accessibility, product availability, healthfulness criteria, portion size, price, product promotion, and quality of scientific practice. There were wide variations in the depth of the assessment methodologies and product healthfulness criteria utilized among the reviewed studies. Of the reviewed studies, 39% evaluated machine accessibility, 91% evaluated product availability, 96% established healthfulness criteria, 70% evaluated portion size, 48% evaluated price, 52% evaluated product promotion, and 22% evaluated the quality of scientific practice. Of all reviewed articles, 87% reached conclusions that provided insight into the healthfulness of vended products and/or vending environment. Product healthfulness criteria and complexity for snack and beverage products was also found to be variable between the reviewed studies. These findings make it difficult to compare results between studies. A universal, valid, and reliable vending machine assessment tool that is comprehensive yet user-friendly is recommended. Copyright © 2015 Elsevier Ltd. All rights reserved.

Outpatient Interventions for Adolescent Substance Abuse: A Quality of Evidence Review

ERIC Educational Resources Information Center

Becker, Sara J.; Curry, John F.

2008-01-01

Previous reviews of outpatient interventions for adolescent substance abuse have been limited in the extent to which they considered the methodological quality of individual studies. The authors assessed 31 randomized trials of outpatient interventions for adolescent substance abuse on 14 attributes of trial quality. A quality of evidence score…

40 CFR Appendix C to Part 132 - Great Lakes Water Quality Initiative Methodologies for Development of Human Health Criteria and...

Code of Federal Regulations, 2011 CFR

2011-07-01

... LAKES SYSTEM Pt. 132, App. C Appendix C to Part 132—Great Lakes Water Quality Initiative Methodologies...; or consuming fish from the water, and water-related recreation activities using the Methodologies for... 40 Protection of Environment 22 2011-07-01 2011-07-01 false Great Lakes Water Quality Initiative...

40 CFR Appendix C to Part 132 - Great Lakes Water Quality Initiative Methodologies for Development of Human Health Criteria and...

Code of Federal Regulations, 2010 CFR

2010-07-01

... LAKES SYSTEM Pt. 132, App. C Appendix C to Part 132—Great Lakes Water Quality Initiative Methodologies...; or consuming fish from the water, and water-related recreation activities using the Methodologies for... 40 Protection of Environment 21 2010-07-01 2010-07-01 false Great Lakes Water Quality Initiative...

Methodological issues in the quantitative assessment of quality of life.

PubMed

Panagiotakos, Demosthenes B; Yfantopoulos, John N

2011-10-01

The term quality of life can be identified in Aristotle's classical writings of 330 BC. In his Nichomachian ethics he recognises the multiple relationships between happiness, well-being, "eudemonia" and quality of life. Historically the concept of quality of life has undergone various interpretations. It involves personal experience, perceptions and beliefs, attitudes concerning philosophical, cultural, spiritual, psychological, political, and financial aspects of everyday living. Quality of life has been extensively used both as an outcome and an explanatory factor in relation to human health, in various clinical trials, epidemiologic studies and health interview surveys. Because of the variations in the definition of quality of life, both in theory and in practice, there are also a wide range of procedures that are used to assess quality of life. In this paper several methodological issues regarding the tools used to evaluate quality of life is discussed. In summary, the use of components consisted of large number of classes, as well as the use of specific weights for each scale component, and the low-to-moderate inter-correlation level between the components, is evident from simulated and empirical studies.

Methodological Considerations in Designing and Evaluating Animal-Assisted Interventions.

PubMed

Stern, Cindy; Chur-Hansen, Anna

2013-02-27

This paper presents a discussion of the literature on animal-assisted interventions and describes limitations surrounding current methodological quality. Benefits to human physical, psychological and social health cannot be empirically confirmed due to the methodological limitations of the existing body of research, and comparisons cannot validly be made across different studies. Without a solid research base animal-assisted interventions will not receive recognition and acceptance as a credible alternative health care treatment. The paper draws on the work of four systematic reviews conducted over April-May 2009, with no date restrictions, focusing exclusively on the use of canine-assisted interventions for older people residing in long-term care. The reviews revealed a lack of good quality studies. Although the literature base has grown in volume since its inception, it predominantly consists of anecdotal accounts and reports. Experimental studies undertaken are often flawed in aspects of design, conduct and reporting. There are few qualitative studies available leading to the inability to draw definitive conclusions. It is clear that due to the complexities associated with these interventions not all weaknesses can be eliminated. However, there are basic methodological weaknesses that can be addressed in future studies in the area. Checklists for quantitative and qualitative research designs to guide future research are offered to help address methodological rigour.

Improving guideline adherence through intensive quality improvement and the use of a National Quality Register in Sweden for acute myocardial infarction.

PubMed

Peterson, Anette; Carlhed, Rickard; Lindahl, Bertil; Lindström, Gunilla; Aberg, Christina; Andersson-Gäre, Boel; Bojestig, Mats

2007-01-01

Data from the Swedish National Register in Cardiac Care have shown over the last 10 years an enduring gap between optimal treatment of acute myocardial infarction (AMI) according to current guidelines and the treatment actually given. We performed a controlled, prospective study in order to evaluate the effects of applying a multidisciplinary team-based improvement methodology to the use of evidence-based treatments in AMI, together with the use of a modified National Quality Register. The project engaged 25% of the Swedish hospitals. Multidisciplinary teams from 20 hospitals participating in the National Register in Cardiac Care, ranging from small to large hospitals, were trained in continuous quality improvement methodology. Twenty matched hospitals served as controls. Our efforts were focused on finding and applying tools and methods to increase adherence to the national guidelines for 5 different treatments for AMI. For measurement, specially designed quality control charts were made available in the National Register for Cardiac Care. To close the gap, an important issue for the teams was to get all 5 treatments in place. Ten of the hospitals in the study group reduced the gap in 5 of 5 treatments by 50%, while none of the control hospitals did so. This first, controlled prospective study of a registry supported by multidisciplinary team-based improvement methodology showed that this approach led to rapidly improved adherence to AMI guidelines in a broad spectrum of hospitals and that National Quality Registers can be helpful tools.

Teaching Mathematical Word Problem Solving: The Quality of Evidence for Strategy Instruction Priming the Problem Structure

ERIC Educational Resources Information Center

Jitendra, Asha K.; Petersen-Brown, Shawna; Lein, Amy E.; Zaslofsky, Anne F.; Kunkel, Amy K.; Jung, Pyung-Gang; Egan, Andrea M.

2015-01-01

This study examined the quality of the research base related to strategy instruction priming the underlying mathematical problem structure for students with learning disabilities and those at risk for mathematics difficulties. We evaluated the quality of methodological rigor of 18 group research studies using the criteria proposed by Gersten et…

78 FR 15023 - Office of Health Assessment and Translation Webinar on the Assessment of Data Quality in Animal...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-08

... and Translation Webinar on the Assessment of Data Quality in Animal Studies; Notice of Public Webinar...- based meeting on the assessment of data quality in animal studies. The Office of Health Assessment and... meetings with a focus on methodological issues related to OHAT implementing systematic review. The first...

Forum Quality or Quantity: What is Driving Student Engagement Online?

ERIC Educational Resources Information Center

Shaw, Cassandra S.; Irwin, Kathleen C.

2017-01-01

The purpose of this study was to determine the relationship between forum quality and student engagement. It was hypothesized when the forum prompt was of expected quality it would be a driver of student engagement and examined the length of the forum prompt in relation to student engagement. The methodology adopted for this study was…

The methodological and reporting quality of systematic reviews from China and the USA are similar.

PubMed

Tian, Jinhui; Zhang, Jun; Ge, Long; Yang, Kehu; Song, Fujian

2017-05-01

To compare the methodological and reporting quality of systematic reviews by authors from China and those from the United States (USA). From systematic reviews of randomized trials published in 2014 in English, we randomly selected 100 from China and 100 from the USA. The methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool, and reporting quality assessed using the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) tool. Compared with systematic reviews from the USA, those from China were more likely to be a meta-analysis, published in low-impact journals, and a non-Cochrane review. The mean summary Assessing the Methodological Quality of Systematic Reviews score was 6.7 (95% confidence interval: 6.5, 7.0) for reviews from China and 6.6 (6.1, 7.1) for reviews from the USA, and the mean summary Preferred Reporting Items for Systematic Reviews and Meta-analyses score was 21.2 (20.7, 21.6) for reviews from China and 20.6 (19.9, 21.3) for reviews from the USA. The differences in summary quality scores between China and the USA were statistically nonsignificant after adjusting for multiple review factors. The overall methodological and reporting quality of systematic reviews by authors from China are similar to those from the USA, although the quality of systematic reviews from both countries could be further improved. Copyright © 2017 The Author(s). Published by Elsevier Inc. All rights reserved.

Combining natural background levels (NBLs) assessment with indicator kriging analysis to improve groundwater quality data interpretation and management.

PubMed

Ducci, Daniela; de Melo, M Teresa Condesso; Preziosi, Elisabetta; Sellerino, Mariangela; Parrone, Daniele; Ribeiro, Luis

2016-11-01

The natural background level (NBL) concept is revisited and combined with indicator kriging method to analyze the spatial distribution of groundwater quality within a groundwater body (GWB). The aim is to provide a methodology to easily identify areas with the same probability of exceeding a given threshold (which may be a groundwater quality criteria, standards, or recommended limits for selected properties and constituents). Three case studies with different hydrogeological settings and located in two countries (Portugal and Italy) are used to derive NBL using the preselection method and validate the proposed methodology illustrating its main advantages over conventional statistical water quality analysis. Indicator kriging analysis was used to create probability maps of the three potential groundwater contaminants. The results clearly indicate the areas within a groundwater body that are potentially contaminated because the concentrations exceed the drinking water standards or even the local NBL, and cannot be justified by geogenic origin. The combined methodology developed facilitates the management of groundwater quality because it allows for the spatial interpretation of NBL values. Copyright © 2016 Elsevier B.V. All rights reserved.

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Epidemiology Characteristics, Methodological Assessment and Reporting of Statistical Analysis of Network Meta-Analyses in the Field of Cancer

PubMed Central

Ge, Long; Tian, Jin-hui; Li, Xiu-xia; Song, Fujian; Li, Lun; Zhang, Jun; Li, Ge; Pei, Gai-qin; Qiu, Xia; Yang, Ke-hu

2016-01-01

Because of the methodological complexity of network meta-analyses (NMAs), NMAs may be more vulnerable to methodological risks than conventional pair-wise meta-analysis. Our study aims to investigate epidemiology characteristics, conduction of literature search, methodological quality and reporting of statistical analysis process in the field of cancer based on PRISMA extension statement and modified AMSTAR checklist. We identified and included 102 NMAs in the field of cancer. 61 NMAs were conducted using a Bayesian framework. Of them, more than half of NMAs did not report assessment of convergence (60.66%). Inconsistency was assessed in 27.87% of NMAs. Assessment of heterogeneity in traditional meta-analyses was more common (42.62%) than in NMAs (6.56%). Most of NMAs did not report assessment of similarity (86.89%) and did not used GRADE tool to assess quality of evidence (95.08%). 43 NMAs were adjusted indirect comparisons, the methods used were described in 53.49% NMAs. Only 4.65% NMAs described the details of handling of multi group trials and 6.98% described the methods of similarity assessment. The median total AMSTAR-score was 8.00 (IQR: 6.00–8.25). Methodological quality and reporting of statistical analysis did not substantially differ by selected general characteristics. Overall, the quality of NMAs in the field of cancer was generally acceptable. PMID:27848997

A systematic review of model-based economic evaluations of diagnostic and therapeutic strategies for lower extremity artery disease.

PubMed

Vaidya, Anil; Joore, Manuela A; ten Cate-Hoek, Arina J; Kleinegris, Marie-Claire; ten Cate, Hugo; Severens, Johan L

2014-01-01

Lower extremity artery disease (LEAD) is a sign of wide spread atherosclerosis also affecting coronary, cerebral and renal arteries and is associated with increased risk of cardiovascular events. Many economic evaluations have been published for LEAD due to its clinical, social and economic importance. The aim of this systematic review was to assess modelling methods used in published economic evaluations in the field of LEAD. Our review appraised and compared the general characteristics, model structure and methodological quality of published models. Electronic databases MEDLINE and EMBASE were searched until February 2013 via OVID interface. Cochrane database of systematic reviews, Health Technology Assessment database hosted by National Institute for Health research and National Health Services Economic Evaluation Database (NHSEED) were also searched. The methodological quality of the included studies was assessed by using the Philips' checklist. Sixteen model-based economic evaluations were identified and included. Eleven models compared therapeutic health technologies; three models compared diagnostic tests and two models compared a combination of diagnostic and therapeutic options for LEAD. Results of this systematic review revealed an acceptable to low methodological quality of the included studies. Methodological diversity and insufficient information posed a challenge for valid comparison of the included studies. In conclusion, there is a need for transparent, methodologically comparable and scientifically credible model-based economic evaluations in the field of LEAD. Future modelling studies should include clinically and economically important cardiovascular outcomes to reflect the wider impact of LEAD on individual patients and on the society.

Is there an "abortion trauma syndrome"? Critiquing the evidence.

PubMed

Robinson, Gail Erlick; Stotland, Nada L; Russo, Nancy Felipe; Lang, Joan A; Occhiogrosso, Mallay

2009-01-01

The objective of this review is to identify and illustrate methodological issues in studies used to support claims that induced abortion results in an "abortion trauma syndrome" or a psychiatric disorder. After identifying key methodological issues to consider when evaluating such research, we illustrate these issues by critically examining recent empirical studies that are widely cited in legislative and judicial testimony in support of the existence of adverse psychiatric sequelae of induced abortion. Recent studies that have been used to assert a causal connection between abortion and subsequent mental disorders are marked by methodological problems that include, but not limited to: poor sample and comparison group selection; inadequate conceptualization and control of relevant variables; poor quality and lack of clinical significance of outcome measures; inappropriateness of statistical analyses; and errors of interpretation, including misattribution of causal effects. By way of contrast, we review some recent major studies that avoid these methodological errors. The most consistent predictor of mental disorders after abortion remains preexisting disorders, which, in turn, are strongly associated with exposure to sexual abuse and intimate violence. Educating researchers, clinicians, and policymakers how to appropriately assess the methodological quality of research about abortion outcomes is crucial. Further, methodologically sound research is needed to evaluate not only psychological outcomes of abortion, but also the impact of existing legislation and the effects of social attitudes and behaviors on women who have abortions.

Chinese herbal medicine for the treatment of primary hypertension: a methodology overview of systematic reviews.

PubMed

Xinke, Zhao; Yingdong, Li; Mingxia, Feng; Kai, Liu; Kaibing, Chen; Yuqing, Lu; Shaobo, Sun; Peng, Song; Bin, Liu

2016-10-20

Chinese herbal medicine has been used to treat hypertension in China and East Asia since centuries. In this study, we conduct an overview of systematic reviews of Chinese herbal medicine in the treatment of primary hypertension to 1) summarize the conclusions of these reviews, 2) evaluate the methodological quality of these reviews, and 3) rate the confidence in the effect on each outcome. We comprehensively searched six databases to retrieve systematic reviews of Chinese herbal medicine for primary hypertension from inception to December 31, 2015. We used AMSTAR to evaluate the methodological quality of included reviews, and we classified the quality of evidence for each outcome in included reviews using the GRADE approach. A total of 12 systematic reviews with 31 outcomes were included, among which 11 systematic reviews focus on the therapeutic effect of Chinese herbal medicine combined with conventional medicine or simple Chinese herbal medicine versus simple conventional medicine. Among the 11 items of AMSTAR, the lowest quality was "providing a priori design" item, none review conformed to this item, the next was "stating the conflict of interest" item, only three reviews conformed to this item. Five reviews scored less than seven in AMSTAR, which means that the overall methodological quality was fairly poor. For GRADE, of the 31 outcomes, the quality of evidence was high in none (0 %), moderate in three (10 %), low in 19 (61 %), and very low in nine (29 %). Of the five downgrading factors, risk of bias (100 %) was the most common downgrading factor in the included reviews, followed by imprecision (42 %), inconsistency (39 %), publication bias (39 %), and indirectness (0 %). The methodological quality of systematic reviews about Chinese herbal medicine for primary hypertension is fairly poor, and the quality of evidence level is low. Physicians should be cautious when applying the interventions in these reviews for primary hypertension patients in clinical practice.

Deliverology

ERIC Educational Resources Information Center

Nordstrum, Lee E.; LeMahieu, Paul G.; Dodd, Karen

2017-01-01

Purpose: This paper is one of seven in this volume elaborating different approaches to quality improvement in education. This paper aims to delineate a methodology called Deliverology. Design/methodology/approach: The paper presents the origins, theoretical foundations, core principles and a case study showing an application of Deliverology in the…

[Evaluation of quality of service in Early Intervention: A systematic review].

PubMed

Jemes Campaña, Inmaculada Concepción; Romero-Galisteo, Rita Pilar; Labajos Manzanares, María Teresa; Moreno Morales, Noelia

2018-06-07

Early Intervention (EI), as a paediatric service, has the duty of quantifying the results and the quality of its services provided. The accessibility of valid and reliable tools allows professionals to evaluate the quality of these services. The aim of this study is to review the scientific literature on tools used to measure the methodological and service quality in EI. A search was made in different databases: Medline (from PubMed), Web of Science, PsycINFO, Cochrane, Scopus, ERIC and Scielo. The methodological quality of the studies was tested using the COSMIN scale. A total of 13 manuscripts met the criteria to be included in this review. Ten of them received a "good" or "reasonable" score based on the COSMIN scale. Despite its importance, there is no consensus among authors on the measurement of service quality in EI. It is often the family of the children attended in EI that are considered the target to study, although the opinion of professionals carries more weight and completes the information. Copyright © 2018. Publicado por Elsevier España, S.L.U.

Systematic Review of Knowledge Translation Strategies to Promote Research Uptake in Child Health Settings.

PubMed

Albrecht, Lauren; Archibald, Mandy; Snelgrove-Clarke, Erna; Scott, Shannon D

2016-01-01

Strategies to assist evidence-based decision-making for healthcare professionals are crucial to ensure high quality patient care and outcomes. The goal of this systematic review was to identify and synthesize the evidence on knowledge translation interventions aimed at putting explicit research evidence into child health practice. A comprehensive search of thirteen electronic databases was conducted, restricted by date (1985-2011) and language (English). Articles were included if: 1) studies were randomized controlled trials (RCT), controlled clinical trials (CCT), or controlled before-and-after (CBA) studies; 2) target population was child health professionals; 3) interventions implemented research in child health practice; and 4) outcomes were measured at the professional/process, patient, or economic level. Two reviewers independently extracted data and assessed methodological quality. Study data were aggregated and analyzed using evidence tables. Twenty-one studies (13 RCT, 2 CCT, 6 CBA) were included. The studies employed single (n=9) and multiple interventions (n=12). The methodological quality of the included studies was largely moderate (n=8) or weak (n=11). Of the studies with moderate to strong methodological quality ratings, three demonstrated consistent, positive effect(s) on the primary outcome(s); effective knowledge translation interventions were two single, non-educational interventions and one multiple, educational intervention. This multidisciplinary systematic review in child health setting identified effective knowledge translation strategies assessed by the most rigorous research designs. Given the overall poor quality of the research literature, specific recommendations were made to improve knowledge translation efforts in child health. Copyright © 2016 Elsevier Inc. All rights reserved.

Systematic Review of Childhood Sedentary Behavior Questionnaires: What do We Know and What is Next?

PubMed

Hidding, Lisan M; Altenburg, Teatske M; Mokkink, Lidwine B; Terwee, Caroline B; Chinapaw, Mai J M

2017-04-01

Accurate measurement of child sedentary behavior is necessary for monitoring trends, examining health effects, and evaluating the effectiveness of interventions. We therefore aimed to summarize studies examining the measurement properties of self-report or proxy-report sedentary behavior questionnaires for children and adolescents under the age of 18 years. Additionally, we provided an overview of the characteristics of the evaluated questionnaires. We performed systematic literature searches in the EMBASE, PubMed, and SPORTDiscus electronic databases. Studies had to report on at least one measurement property of a questionnaire assessing sedentary behavior. Questionnaire data were extracted using a standardized checklist, i.e. the Quality Assessment of Physical Activity Questionnaire (QAPAQ) checklist, and the methodological quality of the included studies was rated using a standardized tool, i.e. the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Forty-six studies on 46 questionnaires met our inclusion criteria, of which 33 examined test-retest reliability, nine examined measurement error, two examined internal consistency, 22 examined construct validity, eight examined content validity, and two examined structural validity. The majority of the included studies were of fair or poor methodological quality. Of the studies with at least a fair methodological quality, six scored positive on test-retest reliability, and two scored positive on construct validity. None of the questionnaires included in this review were considered as both valid and reliable. High-quality studies on the most promising questionnaires are required, with more attention to the content validity of the questionnaires. PROSPERO registration number: CRD42016035963.

Interventions to Improve Parental Communication About Sex: A Systematic Review

PubMed Central

Holland, Cynthia L.; Bost, James

2011-01-01

CONTEXT: The relative effectiveness of interventions to improve parental communication with adolescents about sex is not known. OBJECTIVE: To compare the effectiveness and methodologic quality of interventions for improving parental communication with adolescents about sex. METHODS: We searched 6 databases: OVID/Medline, PsychInfo, ERIC, Cochrane Review, Communication and Mass Media, and the Cumulative Index to Nursing and Allied Health Literature. We included studies published between 1980 and July 2010 in peer-reviewed English-language journals that targeted US parents of adolescents aged 11 to 18 years, used an experimental or quasi-experimental design, included a control group, and had a pretest/posttest design. We abstracted data on multiple communication outcomes defined by the integrative conceptual model (communication frequency, content, skills, intentions, self-efficacy, perceived environmental barriers/facilitators, perceived social norms, attitudes, outcome expectations, knowledge, and beliefs). Methodologic quality was assessed using the 11-item methodologic quality score. RESULTS: Twelve studies met inclusion criteria. Compared with controls, parents who participated in these interventions experienced improvements in multiple communication domains including the frequency, quality, intentions, comfort, and self-efficacy for communicating. We noted no effects on parental attitudes toward communicating or the outcomes they expected to occur as a result of communicating. Four studies were of high quality, 7 were of medium quality, and 1 was of lower quality. CONCLUSIONS: Our review was limited by the lack of standardized measures for assessing parental communication. Still, interventions for improving parent-adolescent sex communication are well designed and have some targeted effects. Wider dissemination could augment efforts by schools, clinicians, and health educators. PMID:21321027

Interventions to improve parental communication about sex: a systematic review.

PubMed

Akers, Aletha Y; Holland, Cynthia L; Bost, James

2011-03-01

The relative effectiveness of interventions to improve parental communication with adolescents about sex is not known. To compare the effectiveness and methodologic quality of interventions for improving parental communication with adolescents about sex. We searched 6 databases: OVID/Medline, PsychInfo, ERIC, Cochrane Review, Communication and Mass Media, and the Cumulative Index to Nursing and Allied Health Literature. We included studies published between 1980 and July 2010 in peer-reviewed English-language journals that targeted US parents of adolescents aged 11 to 18 years, used an experimental or quasi-experimental design, included a control group, and had a pretest/posttest design. We abstracted data on multiple communication outcomes defined by the integrative conceptual model (communication frequency, content, skills, intentions, self-efficacy, perceived environmental barriers/facilitators, perceived social norms, attitudes, outcome expectations, knowledge, and beliefs). Methodologic quality was assessed using the 11-item methodologic quality score. Twelve studies met inclusion criteria. Compared with controls, parents who participated in these interventions experienced improvements in multiple communication domains including the frequency, quality, intentions, comfort, and self-efficacy for communicating. We noted no effects on parental attitudes toward communicating or the outcomes they expected to occur as a result of communicating. Four studies were of high quality, 7 were of medium quality, and 1 was of lower quality. Our review was limited by the lack of standardized measures for assessing parental communication. Still, interventions for improving parent-adolescent sex communication are well designed and have some targeted effects. Wider dissemination could augment efforts by schools, clinicians, and health educators.

Research across the disciplines: a road map for quality criteria in empirical ethics research.

PubMed

Mertz, Marcel; Inthorn, Julia; Renz, Günter; Rothenberger, Lillian Geza; Salloch, Sabine; Schildmann, Jan; Wöhlke, Sabine; Schicktanz, Silke

2014-03-01

Research in the field of Empirical Ethics (EE) uses a broad variety of empirical methodologies, such as surveys, interviews and observation, developed in disciplines such as sociology, anthropology, and psychology. Whereas these empirical disciplines see themselves as purely descriptive, EE also aims at normative reflection. Currently there is literature about the quality of empirical research in ethics, but little or no reflection on specific methodological aspects that must be considered when conducting interdisciplinary empirical ethics. Furthermore, poor methodology in an EE study results in misleading ethical analyses, evaluations or recommendations. This not only deprives the study of scientific and social value, but also risks ethical misjudgement. While empirical and normative-ethical research projects have quality criteria in their own right, we focus on the specific quality criteria for EE research. We develop a tentative list of quality criteria--a "road map"--tailored to interdisciplinary research in EE, to guide assessments of research quality. These quality criteria fall into the categories of primary research question, theoretical framework and methods, relevance, interdisciplinary research practice and research ethics and scientific ethos. EE research is an important and innovative development in bioethics. However, a lack of standards has led to concerns about and even rejection of EE by various scholars. Our suggested orientation list of criteria, presented in the form of reflective questions, cannot be considered definitive, but serves as a tool to provoke systematic reflection during the planning and composition of an EE research study. These criteria need to be tested in different EE research settings and further refined.

Research across the disciplines: a road map for quality criteria in empirical ethics research

PubMed Central

2014-01-01

Background Research in the field of Empirical Ethics (EE) uses a broad variety of empirical methodologies, such as surveys, interviews and observation, developed in disciplines such as sociology, anthropology, and psychology. Whereas these empirical disciplines see themselves as purely descriptive, EE also aims at normative reflection. Currently there is literature about the quality of empirical research in ethics, but little or no reflection on specific methodological aspects that must be considered when conducting interdisciplinary empirical ethics. Furthermore, poor methodology in an EE study results in misleading ethical analyses, evaluations or recommendations. This not only deprives the study of scientific and social value, but also risks ethical misjudgement. Discussion While empirical and normative-ethical research projects have quality criteria in their own right, we focus on the specific quality criteria for EE research. We develop a tentative list of quality criteria – a “road map” – tailored to interdisciplinary research in EE, to guide assessments of research quality. These quality criteria fall into the categories of primary research question, theoretical framework and methods, relevance, interdisciplinary research practice and research ethics and scientific ethos. Summary EE research is an important and innovative development in bioethics. However, a lack of standards has led to concerns about and even rejection of EE by various scholars. Our suggested orientation list of criteria, presented in the form of reflective questions, cannot be considered definitive, but serves as a tool to provoke systematic reflection during the planning and composition of an EE research study. These criteria need to be tested in different EE research settings and further refined. PMID:24580847

The quality of instruments to assess the process of shared decision making: A systematic review

PubMed Central

Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

2018-01-01

Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations. PMID:29447193

Security Quality Requirements Engineering (SQUARE) Methodology

DTIC Science & Technology

2005-11-01

such as Joint Application Development and the Accelerated Requirements Method [Wood 89, Hubbard 99] • Soft Systems Methodology [Checkland 89...investigated were misuse cases [Jacobson 92], Soft Systems Methodology (SSM) [Checkland 89], Quality Function Deployment (QFD) [QFD 05], Con- trolled...html (2005). [Checkland 89] Checkland, Peter. Soft Systems Methodology . Rational Analysis for a Problematic World. New York, NY: John Wiley & Sons

How Methodologic Differences Affect Results of Economic Analyses: A Systematic Review of Interferon Gamma Release Assays for the Diagnosis of LTBI

PubMed Central

Oxlade, Olivia; Pinto, Marcia; Trajman, Anete; Menzies, Dick

2013-01-01

Introduction Cost effectiveness analyses (CEA) can provide useful information on how to invest limited funds, however they are less useful if different analysis of the same intervention provide unclear or contradictory results. The objective of our study was to conduct a systematic review of methodologic aspects of CEA that evaluate Interferon Gamma Release Assays (IGRA) for the detection of Latent Tuberculosis Infection (LTBI), in order to understand how differences affect study results. Methods A systematic review of studies was conducted with particular focus on study quality and the variability in inputs used in models used to assess cost-effectiveness. A common decision analysis model of the IGRA versus Tuberculin Skin Test (TST) screening strategy was developed and used to quantify the impact on predicted results of observed differences of model inputs taken from the studies identified. Results Thirteen studies were ultimately included in the review. Several specific methodologic issues were identified across studies, including how study inputs were selected, inconsistencies in the costing approach, the utility of the QALY (Quality Adjusted Life Year) as the effectiveness outcome, and how authors choose to present and interpret study results. When the IGRA versus TST test strategies were compared using our common decision analysis model predicted effectiveness largely overlapped. Implications Many methodologic issues that contribute to inconsistent results and reduced study quality were identified in studies that assessed the cost-effectiveness of the IGRA test. More specific and relevant guidelines are needed in order to help authors standardize modelling approaches, inputs, assumptions and how results are presented and interpreted. PMID:23505412

Spatial prediction of water quality variables along a main river channel, in presence of pollution hotspots.

PubMed

Rizo-Decelis, L D; Pardo-Igúzquiza, E; Andreo, B

2017-12-15

In order to treat and evaluate the available data of water quality and fully exploit monitoring results (e.g. characterize regional patterns, optimize monitoring networks, infer conditions at unmonitored locations, etc.), it is crucial to develop improved and efficient methodologies. Accordingly, estimation of water quality along fluvial ecosystems is a frequent task in environment studies. In this work, a particular case of this problem is examined, namely, the estimation of water quality along a main stem of a large basin (where most anthropic activity takes place), from observational data measured along this river channel. We adapted topological kriging to this case, where each watershed contains all the watersheds of the upstream observed data ("nested support effect"). Data analysis was additionally extended by taking into account the upstream distance to the closest contamination hotspot as an external drift. We propose choosing the best estimation method by cross-validation. The methodological approach in spatial variability modeling may be used for optimizing the water quality monitoring of a given watercourse. The methodology presented is applied to 28 water quality variables measured along the Santiago River in Western Mexico. Copyright © 2017 Elsevier B.V. All rights reserved.

78 FR 5810 - AHRQ Standing Workgroup for Quality Indicator Measure Specification

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-28

... AHRQ Quality Indicators (QIs), their technical specifications, and associated methodological issues.... The time- limited workgroup is more restricted to specific clinical or methodological issues, while..., data enhancements, and methodological advances. The standing workgroup may potentially provide guidance...

78 FR 22883 - AHRQ Standing Workgroup for Quality Indicator Measure Specification

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-17

... Quality Indicators (QIs), their technical specifications, and associated methodological issues. The...-limited workgroup is more restricted to specific clinical or methodological issues, while the standing... enhancements, and methodological advances. The standing workgroup may potentially provide guidance for the...

Advancing High-Quality Literacy Research in Juvenile Justice: Methodological and Practical Considerations

ERIC Educational Resources Information Center

Houchins, David E.; Jolivette, Kristine; Shippen, Margaret E.; Lambert, Richard

2010-01-01

Special education researchers have made noteworthy progress toward conceptualizing literacy research questions, designing quality studies, and disseminating the results of their research. These advancements have been made through the establishment and refinement of quality research indicators. Unfortunately, this progress has mostly eluded the…

Methods of Quality Appraisal for Studies Reviewed by Evidence Clearinghouses

ERIC Educational Resources Information Center

Wilson, Sandra Jo; Tanner-Smith, Emily

2015-01-01

This presentation will discuss quality appraisal methods for assessing research studies used in systematic reviews, research syntheses, and evidence-based practice repositories such as the What Works Clearinghouse. The different ways that the methodological rigor and risk of bias of primary studies included in syntheses is assessed means that…

40 CFR Appendix A to Part 132 - Great Lakes Water Quality Initiative Methodologies for Development of Aquatic Life Criteria and...

Code of Federal Regulations, 2010 CFR

2010-07-01

... LAKES SYSTEM Pt. 132, App. A Appendix A to Part 132—Great Lakes Water Quality Initiative Methodologies... 40 Protection of Environment 21 2010-07-01 2010-07-01 false Great Lakes Water Quality Initiative Methodologies for Development of Aquatic Life Criteria and Values A Appendix A to Part 132 Protection of...

40 CFR Appendix A to Part 132 - Great Lakes Water Quality Initiative Methodologies for Development of Aquatic Life Criteria and...

Code of Federal Regulations, 2011 CFR

2011-07-01

... LAKES SYSTEM Pt. 132, App. A Appendix A to Part 132—Great Lakes Water Quality Initiative Methodologies... 40 Protection of Environment 22 2011-07-01 2011-07-01 false Great Lakes Water Quality Initiative Methodologies for Development of Aquatic Life Criteria and Values A Appendix A to Part 132 Protection of...

Application of quality improvement analytic methodology in emergency medicine research: A comparative evaluation.

PubMed

Harries, Bruce; Filiatrault, Lyne; Abu-Laban, Riyad B

2018-05-30

Quality improvement (QI) analytic methodology is rarely encountered in the emergency medicine literature. We sought to comparatively apply QI design and analysis techniques to an existing data set, and discuss these techniques as an alternative to standard research methodology for evaluating a change in a process of care. We used data from a previously published randomized controlled trial on triage-nurse initiated radiography using the Ottawa ankle rules (OAR). QI analytic tools were applied to the data set from this study and evaluated comparatively against the original standard research methodology. The original study concluded that triage nurse-initiated radiographs led to a statistically significant decrease in mean emergency department length of stay. Using QI analytic methodology, we applied control charts and interpreted the results using established methods that preserved the time sequence of the data. This analysis found a compelling signal of a positive treatment effect that would have been identified after the enrolment of 58% of the original study sample, and in the 6th month of this 11-month study. Our comparative analysis demonstrates some of the potential benefits of QI analytic methodology. We found that had this approach been used in the original study, insights regarding the benefits of nurse-initiated radiography using the OAR would have been achieved earlier, and thus potentially at a lower cost. In situations where the overarching aim is to accelerate implementation of practice improvement to benefit future patients, we believe that increased consideration should be given to the use of QI analytic methodology.

Longitudinal analysis of reporting and quality of systematic reviews in high-impact surgical journals.

PubMed

Chapman, S J; Drake, T M; Bolton, W S; Barnard, J; Bhangu, A

2017-02-01

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement aims to optimize the reporting of systematic reviews. The performance of the PRISMA Statement in improving the reporting and quality of surgical systematic reviews remains unclear. Systematic reviews published in five high-impact surgical journals between 2007 and 2015 were identified from online archives. Manuscripts blinded to journal, publication year and authorship were assessed according to 27 reporting criteria described by the PRISMA Statement and scored using a validated quality appraisal tool (AMSTAR, Assessing the Methodological Quality of Systematic Reviews). Comparisons were made between studies published before (2007-2009) and after (2011-2015) its introduction. The relationship between reporting and study quality was measured using Spearman's rank test. Of 281 eligible manuscripts, 80 were published before the PRISMA Statement and 201 afterwards. Most manuscripts (208) included a meta-analysis, with the remainder comprising a systematic review only. There was no meaningful change in median compliance with the PRISMA Statement (19 (i.q.r. 16-21) of 27 items before versus 19 (17-22) of 27 after introduction of PRISMA) despite achieving statistical significance (P = 0·042). Better reporting compliance was associated with higher methodological quality (r s  = 0·70, P < 0·001). The PRISMA Statement has had minimal impact on the reporting of surgical systematic reviews. Better compliance was associated with higher-quality methodology. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Quality indicators for hip fracture care, a systematic review.

PubMed

Voeten, S C; Krijnen, P; Voeten, D M; Hegeman, J H; Wouters, M W J M; Schipper, I B

2018-05-17

Quality indicators are used to measure quality of care and enable benchmarking. An overview of all existing hip fracture quality indicators is lacking. The primary aim was to identify quality indicators for hip fracture care reported in literature, hip fracture audits, and guidelines. The secondary aim was to compose a set of methodologically sound quality indicators for the evaluation of hip fracture care in clinical practice. A literature search according to the PRISMA guidelines and an internet search were performed to identify hip fracture quality indicators. The indicators were subdivided into process, structure, and outcome indicators. The methodological quality of the indicators was judged using the Appraisal of Indicators through Research and Evaluation (AIRE) instrument. For structure and process indicators, the construct validity was assessed. Sixteen publications, nine audits and five guidelines were included. In total, 97 unique quality indicators were found: 9 structure, 63 process, and 25 outcome indicators. Since detailed methodological information about the indicators was lacking, the AIRE instrument could not be applied. Seven indicators correlated with an outcome measure. A set of nine quality indicators was extracted from the literature, audits, and guidelines. Many quality indicators are described and used. Not all of them correlate with outcomes of care and have been assessed methodologically. As methodological evidence is lacking, we recommend the extracted set of nine indicators to be used as the starting point for further clinical research. Future research should focus on assessing the clinimetric properties of the existing quality indicators.

Analytical and simulator study of advanced transport

NASA Technical Reports Server (NTRS)

Levison, W. H.; Rickard, W. W.

1982-01-01

An analytic methodology, based on the optimal-control pilot model, was demonstrated for assessing longitidunal-axis handling qualities of transport aircraft in final approach. Calibration of the methodology is largely in terms of closed-loop performance requirements, rather than specific vehicle response characteristics, and is based on a combination of published criteria, pilot preferences, physical limitations, and engineering judgment. Six longitudinal-axis approach configurations were studied covering a range of handling qualities problems, including the presence of flexible aircraft modes. The analytical procedure was used to obtain predictions of Cooper-Harper ratings, a solar quadratic performance index, and rms excursions of important system variables.

Prevalence and risk factors associated with musculoskeletal complaints among users of mobile handheld devices: A systematic review.

PubMed

Xie, Yanfei; Szeto, Grace; Dai, Jie

2017-03-01

This systematic review aimed at evaluating the prevalence and risk factors for musculoskeletal complaints associated with mobile handheld device use. Pubmed, Medline, Web of Science, CINAHL and Embase were searched. The methodological quality of included studies was assessed. Strength of evidence for risk factors was determined based on study designs, methodological quality and consistency of results. Five high-quality, eight acceptable-quality and two low-quality peer-reviewed articles were included. This review demonstrates that the prevalence of musculoskeletal complaints among mobile device users ranges from 1.0% to 67.8% and neck complaints have the highest prevalence rates ranging from 17.3% to 67.8%. This study also finds some evidence for neck flexion, frequency of phone calls, texting and gaming in relation to musculoskeletal complaints among mobile device users. Inconclusive evidence is shown for other risk factors such as duration of use and human-device interaction techniques due to inconsistent results or a limited number of studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

[Quality of clinical studies published in the RBGO over one decade (1999-2009): methodological and ethical aspects and statistical procedures].

PubMed

de Sá, Joceline Cássia Ferezini; Marini, Gabriela; Gelaleti, Rafael Bottaro; da Silva, João Batista; de Azevedo, George Gantas; Rudge, Marilza Vieira Cunha

2013-11-01

To evaluate the methodological and statistical design evolution of the publications in the Brazilian Journal of Gynecology and Obstetrics (RBGO) from resolution 196/96. A review of 133 articles published in 1999 (65) and 2009 (68) was performed by two independent reviewers with training in clinical epidemiology and methodology of scientific research. We included all original clinical articles, case and series reports and excluded editorials, letters to the editor, systematic reviews, experimental studies, opinion articles, besides abstracts of theses and dissertations. Characteristics related to the methodological quality of the studies were analyzed in each article using a checklist that evaluated two criteria: methodological aspects and statistical procedures. We used descriptive statistics and the χ2 test for comparison of the two years. There was a difference between 1999 and 2009 regarding the study and statistical design, with more accuracy in the procedures and the use of more robust tests between 1999 and 2009. In RBGO, we observed an evolution in the methods of published articles and a more in-depth use of the statistical analyses, with more sophisticated tests such as regression and multilevel analyses, which are essential techniques for the knowledge and planning of health interventions, leading to fewer interpretation errors.

A web based health technology assessment in tele-echocardiography: the experience within an Italian project.

PubMed

Giansanti, Daniele; Morelli, Sandra; Maccioni, Giovanni; Guerriero, Lorenzo; Bedini, Remo; Pepe, Gennaro; Colombo, Cesare; Borghi, Gabriella; Macellari, Velio

2009-01-01

Due to major advances in the information technology, telemedicine applications are ready for a widespread use. Nonetheless, to allow their diffusion in National Health Care Systems (NHCSs) specific methodologies of health technology assessment (HTA) should be used to assess the standardization, the overall quality, the interoperability, the addressing to legal, economic and cost benefit aspects. One of the limits to the diffusion of the digital tele-echocardiography (T-E) applications in the NHCS lacking of a specific methodology for the HTA. In the present study, a solution offering a structured HTA of T-E products was designed. The methodology assured also the definition of standardized quality levels for the application. The first level represents the minimum level of acceptance; the other levels are accessory levels useful for a more accurate assessment of the product. The methodology showed to be useful to rationalize the process of standardization and has received a high degree of acceptance by the subjects involved in the study.

Minimum reporting standards for clinical research on groin pain in athletes

PubMed Central

Delahunt, Eamonn; Thorborg, Kristian; Khan, Karim M; Robinson, Philip; Hölmich, Per; Weir, Adam

2015-01-01

Groin pain in athletes is a priority area for sports physiotherapy and sports medicine research. Heterogeneous studies with low methodological quality dominate research related to groin pain in athletes. Low-quality studies undermine the external validity of research findings and limit the ability to generalise findings to the target patient population. Minimum reporting standards for research on groin pain in athletes are overdue. We propose a set of minimum reporting standards based on best available evidence to be utilised in future research on groin pain in athletes. Minimum reporting standards are provided in relation to: (1) study methodology, (2) study participants and injury history, (3) clinical examination, (4) clinical assessment and (5) radiology. Adherence to these minimum reporting standards will strengthen the quality and transparency of research conducted on groin pain in athletes. This will allow an easier comparison of outcomes across studies in the future. PMID:26031644

[Progress in methodological characteristics of clinical practice guideline for osteoarthritis].

PubMed

Xing, D; Wang, B; Lin, J H

2017-06-01

At present, several clinical practice guidelines for the treatment of osteoarthritis have been developed by institutes or societies. The ultimate purpose of developing clinical practice guidelines is to formulate the process in the treatment of osteoarthritis effectively. However, the methodologies used in developing clinical practice guidelines may place an influence on the transformation and application of that in treating osteoarthritis. The present study summarized the methodological features of individual clinical practice guideline and presented the tools for quality evaluation of clinical practice guideline. The limitations of current osteoarthritis guidelines of China are also indicated. The review article might help relevant institutions improve the quality in developing guide and clinical transformation.

Controlled Trials in Children: Quantity, Methodological Quality and Descriptive Characteristics of Pediatric Controlled Trials Published 1948-2006

PubMed Central

Thomson, Denise; Hartling, Lisa; Cohen, Eyal; Vandermeer, Ben; Tjosvold, Lisa; Klassen, Terry P.

2010-01-01

Background The objective of this study was to describe randomized controlled trials (RCTs) and controlled clinical trials (CCTs) in child health published between 1948 and 2006, in terms of quantity, methodological quality, and publication and trial characteristics. We used the Trials Register of the Cochrane Child Health Field for overall trends and a sample from this to explore trial characteristics in more detail. Methodology/Principal Findings We extracted descriptive data on a random sample of 578 trials. Ninety-six percent of the trials were published in English; the percentage of child-only trials was 90.5%. The most frequent diagnostic categories were infectious diseases (13.2%), behavioural and psychiatric disorders (11.6%), neonatal critical care (11.4%), respiratory disorders (8.9%), non-critical neonatology (7.9%), and anaesthesia (6.5%). There were significantly fewer child-only studies (i.e., more mixed child and adult studies) over time (P = 0.0460). The proportion of RCTs to CCTs increased significantly over time (P<0.0001), as did the proportion of multicentre trials (P = 0.002). Significant increases over time were found in methodological quality (Jadad score) (P<0.0001), the proportion of double-blind studies (P<0.0001), and studies with adequate allocation concealment (P<0.0001). Additionally, we found an improvement in reporting over time: adequate description of withdrawals and losses to follow-up (P<0.0001), sample size calculations (P<0.0001), and intention-to-treat analysis (P<0.0001). However, many trials still do not describe their level of blinding, and allocation concealment was inadequately reported in the majority of studies across the entire time period. The proportion of studies with industry funding decreased slightly over time (P = 0.003), and these studies were more likely to report positive conclusions (P = 0.028). Conclusions/Significance The quantity and quality of pediatric controlled trials has increased over time; however, much work remains to be done, particularly in improving methodological issues around conduct and reporting of trials. PMID:20927344

Terrorism, Radicalisation, Extremism, Authoritarianism and Fundamentalism: A Systematic Review of the Quality and Psychometric Properties of Assessments

PubMed Central

Scarcella, Akimi; Page, Ruairi; Furtado, Vivek

2016-01-01

Background Currently, terrorism and suicide bombing are global psychosocial processes that attracts a growing number of psychological and psychiatric contributions to enhance practical counter-terrorism measures. The present study is a systematic review that explores the methodological quality reporting and the psychometric soundness of the instruments developed to identify risk factors of terrorism, extremism, radicalisation, authoritarianism and fundamentalism. Method A systematic search strategy was established to identify instruments and studies developed to screen individuals at risk of committing extremist or terrorist offences using 20 different databases across the fields of law, medicine, psychology, sociology and politics. Information extracted was consolidated into two different tables and a 26-item checklist, reporting respectively background information, the psychometric properties of each tool, and the methodological quality markers of these tools. 37 articles met our criteria, which included a total of 4 instruments to be used operationally by professionals, 17 tools developed as research measures, and 9 inventories that have not been generated from a study. Results Just over half of the methodological quality markers required for a transparent methodological description of the instruments were reported. The amount of reported psychological properties was even fewer, with only a third of them available across the different studies. The category presenting the least satisfactory results was that containing the 4 instruments to be used operationally by professionals, which can be explained by the fact that half of them refrained from publishing the major part of their findings and relevant guidelines. Conclusions A great number of flaws have been identified through this systematic review. The authors encourage future researchers to be more thorough, comprehensive and transparent in their methodology. They also recommend the creation of a multi-disciplinary joint working group in order to best tackle this growing contemporary problem. PMID:28002457

An Empirical Review of Internet Addiction Outcome Studies in China

ERIC Educational Resources Information Center

Liu, Chennan; Liao, Minli; Smith, Douglas C.

2012-01-01

Objectives: The authors systematically reviewed the outcomes and methodological quality of 24 Internet addiction (IA) treatment outcome studies in China. Method: The authors used 15 attributes from the quality of evidence scores to evaluate 24 outcome studies. These studies came from both English and Chinese academic databases from 2000 to 2010.…

Can weekly noise levels of urban road traffic, as predominant noise source, estimate annual ones?

PubMed

Prieto Gajardo, Carlos; Barrigón Morillas, Juan Miguel; Rey Gozalo, Guillermo; Vílchez-Gómez, Rosendo

2016-11-01

The effects of noise pollution on human quality of life and health were recognised by the World Health Organisation a long time ago. There is a crucial dilemma for the study of urban noise when one is looking for proven methodologies that can allow, on the one hand, an increase in the quality of predictions, and on the other hand, saving resources in the spatial and temporal sampling. The temporal structure of urban noise is studied in this work from a different point of view. This methodology, based on Fourier analysis, is applied to several measurements of urban noise, mainly from road traffic and one-week long, carried out in two cities located on different continents and with different sociological life styles (Cáceres, Spain and Talca, Chile). Its capacity to predict annual noise levels from weekly measurements is studied. The relation between this methodology and the categorisation method is also analysed.

Ensuring Quality in Online Courses: Applying the AACSB International's Distance Learning Quality Issues

ERIC Educational Resources Information Center

Gaytan, Jorge

2013-01-01

The purpose of this qualitative study was to examine the Distance Learning Quality Issues published by the American Assembly of Collegiate Schools of Business International (AACSB-International) to document the various characteristics that high-quality online courses must possess. A content analysis methodology was employed to examine the seven…

Quality Indicators for Single-Case Research on Social Skill Interventions for Children with Autistic Spectrum Disorder

ERIC Educational Resources Information Center

Wang, Shin-Yi; Parrila, Rauno

2008-01-01

In this paper, we describe a quality checklist that parents, teachers, clinicians, and policy-makers with basic research skills can use to systematically evaluate the methodological quality of single-case studies on social skill training of children with autistic spectrum disorder (ASD). We provide a rationale for included quality indicators, and…

Students' Perception of Quality for a Business Program Delivered in Canada and China

ERIC Educational Resources Information Center

Hohner, Margaret; Tsigaris, Panagiotis

2012-01-01

Purpose: The purpose of this paper is to investigate the beliefs of undergraduate business students studying in Canada and partners in China about the quality of the program; what they consider effective signals of quality; and their willingness to pay to improve the quality. Design/methodology/approach: A survey was designed and distributed to…

MASQOT: a method for cDNA microarray spot quality control

PubMed Central

Bylesjö, Max; Eriksson, Daniel; Sjödin, Andreas; Sjöström, Michael; Jansson, Stefan; Antti, Henrik; Trygg, Johan

2005-01-01

Background cDNA microarray technology has emerged as a major player in the parallel detection of biomolecules, but still suffers from fundamental technical problems. Identifying and removing unreliable data is crucial to prevent the risk of receiving illusive analysis results. Visual assessment of spot quality is still a common procedure, despite the time-consuming work of manually inspecting spots in the range of hundreds of thousands or more. Results A novel methodology for cDNA microarray spot quality control is outlined. Multivariate discriminant analysis was used to assess spot quality based on existing and novel descriptors. The presented methodology displays high reproducibility and was found superior in identifying unreliable data compared to other evaluated methodologies. Conclusion The proposed methodology for cDNA microarray spot quality control generates non-discrete values of spot quality which can be utilized as weights in subsequent analysis procedures as well as to discard spots of undesired quality using the suggested threshold values. The MASQOT approach provides a consistent assessment of spot quality and can be considered an alternative to the labor-intensive manual quality assessment process. PMID:16223442

Advancing scoping study methodology: a web-based survey and consultation of perceptions on terminology, definition and methodological steps.

PubMed

O'Brien, Kelly K; Colquhoun, Heather; Levac, Danielle; Baxter, Larry; Tricco, Andrea C; Straus, Sharon; Wickerson, Lisa; Nayar, Ayesha; Moher, David; O'Malley, Lisa

2016-07-26

Scoping studies (or reviews) are a method used to comprehensively map evidence across a range of study designs in an area, with the aim of informing future research practice, programs and policy. However, no universal agreement exists on terminology, definition or methodological steps. Our aim was to understand the experiences of, and considerations for conducting scoping studies from the perspective of academic and community partners. Primary objectives were to 1) describe experiences conducting scoping studies including strengths and challenges; and 2) describe perspectives on terminology, definition, and methodological steps. We conducted a cross-sectional web-based survey with clinicians, educators, researchers, knowledge users, representatives from community-based organizations, graduate students, and policy stakeholders with experience and/or interest in conducting scoping studies to gain an understanding of experiences and perspectives on the conduct and reporting of scoping studies. We administered an electronic self-reported questionnaire comprised of 22 items related to experiences with scoping studies, strengths and challenges, opinions on terminology, and methodological steps. We analyzed questionnaire data using descriptive statistics and content analytical techniques. Survey results were discussed during a multi-stakeholder consultation to identify key considerations in the conduct and reporting of scoping studies. Of the 83 invitations, 54 individuals (65 %) completed the scoping questionnaire, and 48 (58 %) attended the scoping study meeting from Canada, the United Kingdom and United States. Many scoping study strengths were dually identified as challenges including breadth of scope, and iterative process. No consensus on terminology emerged, however key defining features that comprised a working definition of scoping studies included the exploratory mapping of literature in a field; iterative process, inclusion of grey literature; no quality assessment of included studies, and an optional consultation phase. We offer considerations for the conduct and reporting of scoping studies for researchers, clinicians and knowledge users engaging in this methodology. Lack of consensus on scoping terminology, definition and methodological steps persists. Reasons for this may be attributed to diversity of disciplines adopting this methodology for differing purposes. Further work is needed to establish guidelines on the reporting and methodological quality assessment of scoping studies.

Factors Associated with the Utilization and Quality of Prenatal Care in Western Rural Regions of China

ERIC Educational Resources Information Center

Dongxu, Wang; Yuhui, Shi; Stewart, Donald; Chun, Chang; Chaoyang, Li

2012-01-01

Purpose: The paper seeks to identify key features of prenatal care utilization and quality in western regions of China and to determine the factors affecting the quality of prenatal care. Design/methodology/approach: A descriptive, cross-sectional study was conducted. The instrument for the study was a 10-stem respondent-administered, structured…

Organisational Learning for School Quality and Health

ERIC Educational Resources Information Center

Lagrosen, Yvonne; Lagrosen, Stefan

2012-01-01

Purpose: The purpose of this paper is to shed light upon the connections between quality management, employee health and organisational learning in a school setting. Design/methodology/approach: The study is based on a quantitative survey. Items measuring health status and values of quality management were included in a questionnaire addressed to…

Investigating Relationships among Quality Dimensions in Higher Education

ERIC Educational Resources Information Center

Ardi, Romadhani; Hidayatno, Akhmad; Zagloel, Teuku Yuri M.

2012-01-01

Purpose: This study aims to assess the relationships among quality dimensions in higher education (HE) and to determine the effect of each quality dimension on students' satisfaction. Design/methodology/approach: A questionnaire was developed and distributed to 270 final year students of an engineering faculty in an Indonesian state university.…

Quality Assurance in Distance Learning Libraries

ERIC Educational Resources Information Center

Tripathi, Manorama; Jeevan, V. K. J.

2009-01-01

Purpose: The paper aims to study how the present distance learning libraries can improve upon their existing services and introduce new ones to enhance quality of services to distance learners. Design/methodology/approach: The paper includes a review of literature on quality assurance in open and distance education in general and student support…

Quality Assurance Strategies in Higher Education: The Case of Ghanaian Polytechnics

ERIC Educational Resources Information Center

Swanzy, Patrick; Potts, Anthony

2017-01-01

This study investigated the internal quality assurance strategies Ghanaian polytechnics enacted in order to improve graduate outcomes. A qualitative methodological approach via in-depth interviewing of twenty key informants and document analysis was used to establish how polytechnics in Ghana addressed problematic situations in quality assurance.…

The Association between Learning Styles and Perception of Teaching Quality

ERIC Educational Resources Information Center

Jepsen, Denise M.; Varhegyi, Melinda M.; Teo, Stephen T. T.

2015-01-01

Purpose: Although learning styles and teaching quality have been studied separately, the association between the association between the two has yet to be identified. The purpose of this paper is to establish the relationship between students' learning styles with students' perceptions of teaching quality. Design/methodology/approach: The study…

[Clinical practice guidelines in Peru: evaluation of its quality using the AGREE II instrument].

PubMed

Canelo-Aybar, Carlos; Balbin, Graciela; Perez-Gomez, Ángela; Florez, Iván D

2016-01-01

To evaluate the methodological quality of clinical practice guidelines (CPGs) put into practice by the Peruvian Ministry of Health (MINSA), 17 CPGs from the ministry, published between 2009 and 2014, were independently evaluated by three methodologic experts using the AGREE II instrument. The score of AGREE II domains was low and very low in all CPGs: scope and purpose (medium, 44%), clarity of presentation (medium, 47%), participation of decision-makers (medium, 8%), methodological rigor (medium, 5%), applicability (medium, 5%), and editorial independence (medium, 8%). In conclusion, the methodological quality of CPGs implemented by the MINSA is low. Consequently, its use could not be recommended. The implementation of the methodology for the development of CPGs described in the recentlypublished CPG methodological preparation manual in Peru is a pressing need.

Navigating Survival: Quality of Life Following Bone Marrow Transplantation.

DTIC Science & Technology

1991-01-01

This study explored the quality of life of adult Bone Marrow Transplantation (BMT) survivors and processes involved in maintaining or enhancing life...quality were identified. Ground theory methodology was used to explore quality of life from the survivor’s perspective. Five adults, 87 to 578 days...processes employed by BMT survivors to manage quality of life disruptions. BMT survivors identified disruptions in quality of life during the rapid

A Systematic Scoping Review of Yoga Intervention Components and Study Quality

PubMed Central

Elwy, A. Rani; Groessl, Erik J.; Eisen, Susan V.; Riley, Kristen; Maiya, Meghan; Lee, Jennifer P.; Sarkin, Andrew; Park, Crystal L.

2014-01-01

Context The scientific study of yoga requires rigorous methodology. This review aimed to systematically assess all studies of yoga interventions to: (1) determine yoga intervention characteristics; (2) examine methodologic quality of the subset of RCTs; and (3) explore how well these interventions are reported. Evidence acquisition Searches were conducted through April 2012 in PubMed, PsycInfo, Ageline, and Ovid’s Alternative and Complementary Medicine database using the text term yoga, and through handsearching five journals. Original studies were included if the intervention: (1) consisted of at least one yoga session with some type of health assessment; (2) targeted adults age ≥18 years; (3) was published in an English language peer–reviewed journal; and (4) was available for review. Evidence synthesis Of 3,062 studies identified, 465 studies in 30 countries were included. Analyses were conducted through 2013. Most interventions took place in India (n=228) or the U.S. (n=124), with intensity ranging from a single yoga session up to two sessions per day. Intervention lengths ranged from one session to 2 years. Asanas (poses) were mentioned as yoga components in 369 (79%) interventions, but were either minimally or not at all described in 200 (54%) of these. Most interventions (74%, n=336) did not include home practice. Of the included studies, 151 were RCTs. RCT quality was rated as poor. Conclusions This review highlights the inadequate reporting and methodologic limitations of current yoga intervention research, which limits study interpretation and comparability. Recommendations for future methodology and reporting are discussed. PMID:24996759

Review of reviews on exposures to synthetic organic chemicals and children's neurodevelopment: Methodological and interpretation challenges.

PubMed

LaKind, Judy S; Anthony, Laura G; Goodman, Michael

2017-01-01

Environmental epidemiology data are becoming increasingly important in public health decision making, which commonly incorporates a systematic review of multiple studies. This review addresses two fundamental questions: What is the quality of available reviews on associations between exposure to synthetic organic chemicals and neurodevelopmental outcomes? What is the value (e.g., quality and consistency) of the underlying literature? Published reviews on associations between synthetic organic environmental chemical exposures and neurodevelopmental outcomes in children were systematically evaluated. Seventy-four relevant reviews were identified, and these were evaluated with respect to four methodological characteristics: (1) systematic inclusion/exclusion criteria and reproducible methods for search and retrieval of studies; (2) structured evaluation of underlying data quality; (3) systematic assessment of consistency across specific exposure-outcome associations; and (4) evaluation of reporting/publication bias. None of the 74 reviews fully met the criteria for all four methodological characteristics. Only four reviews met two criteria, and six reviews fulfilled only one criterion. Perhaps more importantly, the higher quality reviews were not able to meet all of the criteria owing to the shortcomings of underlying studies, which lacked comparability in terms of specific research question of interest, overall design, exposure assessment, outcome ascertainment, and analytic methods. Thus, even the most thoughtful and rigorous review may be of limited value if the underlying literature includes investigations that address different hypotheses and are beset by methodological inconsistencies and limitations. Issues identified in this review of reviews illustrate considerable challenges that are facing assessments of epidemiological evidence.

A Narrative Review of High-Quality Literature on the Effects of Resident Duty Hours Reforms.

PubMed

Lin, Henry; Lin, Emery; Auditore, Stephanie; Fanning, Jon

2016-01-01

To summarize current high-quality studies evaluating the effect and efficacy of resident duty hours reforms (DHRs) on patient safety and resident education and well-being. The authors searched PubMed and Medline in August 2012 and again in May 2013 for literature (1987-2013) about the effects of DHRs. They assessed the quality of articles using the Medical Education Research Study Quality Instrument (MERSQI) scoring system. They considered randomized controlled trials (RCTs), partial RCTs, and all studies with a MERSQI score ≥ 14 to be "high-quality" methodology studies. A total of 72 high-quality studies met inclusion criteria. Most studies showed no change or slight improvement in mortality and complication rates after DHRs. Resident well-being was generally improved, but there was a perceived negative impact on education (knowledge acquisition, skills, and cognitive performance) following DHRs. Eleven high-quality studies assessed the impact of DHR interventions; all reported a neutral to positive impact. Seven high-quality studies assessed costs associated with DHRs and demonstrated an increase in hospital costs. The results of most studies that allow enough time for DHR interventions to take effect suggest a benefit to patient safety and resident well-being, but the effect on the quality of training remains unknown. Additional methodologically sound studies on the impact of DHRs are necessary. Priorities for future research include approaches to optimizing education and clinical proficiency and studies on the effect of intervention strategies on both education and patient safety. Such studies will provide additional information to help improve duty hours policies.

Evaluating the statistical methodology of randomized trials on dentin hypersensitivity management.

PubMed

Matranga, Domenica; Matera, Federico; Pizzo, Giuseppe

2017-12-27

The present study aimed to evaluate the characteristics and quality of statistical methodology used in clinical studies on dentin hypersensitivity management. An electronic search was performed for data published from 2009 to 2014 by using PubMed, Ovid/MEDLINE, and Cochrane Library databases. The primary search terms were used in combination. Eligibility criteria included randomized clinical trials that evaluated the efficacy of desensitizing agents in terms of reducing dentin hypersensitivity. A total of 40 studies were considered eligible for assessment of quality statistical methodology. The four main concerns identified were i) use of nonparametric tests in the presence of large samples, coupled with lack of information about normality and equality of variances of the response; ii) lack of P-value adjustment for multiple comparisons; iii) failure to account for interactions between treatment and follow-up time; and iv) no information about the number of teeth examined per patient and the consequent lack of cluster-specific approach in data analysis. Owing to these concerns, statistical methodology was judged as inappropriate in 77.1% of the 35 studies that used parametric methods. Additional studies with appropriate statistical analysis are required to obtain appropriate assessment of the efficacy of desensitizing agents.

Lean for Education

ERIC Educational Resources Information Center

LeMahieu, Paul G.; Nordstrum, Lee E.; Greco, Patricia

2017-01-01

Purpose: This paper is one of seven in this volume that aims to elaborate different approaches to quality improvement in education. It delineates a methodology called Lean for Education. Design/methodology/approach: The paper presents the origins, theoretical foundations, core concepts and a case study demonstrating an application in US education,…

Methodological adequacy of articles published in two open-access Brazilian cardiology periodicals.

PubMed

Macedo, Cristiane Rufino; Silva, Davi Leite da; Puga, Maria Eduarda

2010-01-01

The use of rigorous scientific methods has contributed towards developing scientific articles of excellent methodological quality. This has made it possible to promote their citation and increase the impact factor. Brazilian periodicals have had to adapt to certain quality standards demanded by these indexing organizations, such as the content and the number of original articles published in each issue. This study aimed to evaluate the methodological adequacy of two Brazilian periodicals within the field of cardiology that are indexed in several databases and freely accessible through the Scientific Electronic Library Online (SciELO), and which are now indexed by the Web of Science (Institute for Scientific Information, ISI). Descriptive study at Brazilian Cochrane Center. All the published articles were evaluated according to merit assessment (content) and form assessment (performance). Ninety-six percent of the articles analyzed presented study designs that were adequate for answering the objectives. These two Brazilian periodicals within the field of cardiology published methodologically adequate articles, since they followed the quality standards. Thus, these periodicals can be considered both for consultation and as vehicles for publishing future articles. For further analyses, it is essential to apply other indicators of scientific activity such as bibliometrics, which evaluates quantitative aspects of the production, dissemination and use of information, and scientometrics, which is also concerned with the development of science policies, within which it is often superimposed on bibliometrics.

Surgical interventions for gastric cancer: a review of systematic reviews.

PubMed

He, Weiling; Tu, Jian; Huo, Zijun; Li, Yuhuang; Peng, Jintao; Qiu, Zhenwen; Luo, Dandong; Ke, Zunfu; Chen, Xinlin

2015-01-01

To evaluate methodological quality and the extent of concordance among meta-analysis and/or systematic reviews on surgical interventions for gastric cancer (GC). A comprehensive search of PubMed, Medline, EMBASE, the Cochrane library and the DARE database was conducted to identify the reviews comparing different surgical interventions for GC prior to April 2014. After applying included criteria, available data were summarized and appraised by the Oxman and Guyatt scale. Fifty six reviews were included. Forty five reviews (80.4%) were well conducted, with scores of adapted Oxman and Guyatt scale ≥ 14. The reviews differed in criteria for avoiding bias and assessing the validity of the primary studies. Many primary studies displayed major methodological flaws, such as randomization, allocation concealment, and dropouts and withdrawals. According to the concordance assessment, laparoscopy-assisted gastrectomy (LAG) was superior to open gastrectomy, and laparoscopy-assisted distal gastrectomy was superior to open distal gastrectomy in short-term outcomes. However, the concordance regarding other surgical interventions, such as D1 vs. D2 lymphadenectomy, and robotic gastrectomy vs. LAG were absent. Systematic reviews on surgical interventions for GC displayed relatively high methodological quality. The improvement of methodological quality and reporting was necessary for primary studies. The superiority of laparoscopic over open surgery was demonstrated. But concordance on other surgical interventions was rare, which needed more well-designed RCTs and systematic reviews.

Systematic review of the methodological and reporting quality of case series in surgery.

PubMed

Agha, R A; Fowler, A J; Lee, S-Y; Gundogan, B; Whitehurst, K; Sagoo, H K; Jeong, K J L; Altman, D G; Orgill, D P

2016-09-01

Case series are an important and common study type. No guideline exists for reporting case series and there is evidence of key data being missed from such reports. The first step in the process of developing a methodologically sound reporting guideline is a systematic review of literature relevant to the reporting deficiencies of case series. A systematic review of methodological and reporting quality in surgical case series was performed. The electronic search strategy was developed by an information specialist and included MEDLINE, Embase, Cochrane Methods Register, Science Citation Index and Conference Proceedings Citation index, from the start of indexing to 5 November 2014. Independent screening, eligibility assessments and data extraction were performed. Included articles were then analysed for five areas of deficiency: failure to use standardized definitions, missing or selective data (including the omission of whole cases or important variables), transparency or incomplete reporting, whether alternative study designs were considered, and other issues. Database searching identified 2205 records. Through the process of screening and eligibility assessments, 92 articles met inclusion criteria. Frequencies of methodological and reporting issues identified were: failure to use standardized definitions (57 per cent), missing or selective data (66 per cent), transparency or incomplete reporting (70 per cent), whether alternative study designs were considered (11 per cent) and other issues (52 per cent). The methodological and reporting quality of surgical case series needs improvement. The data indicate that evidence-based guidelines for the conduct and reporting of case series may be useful. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Interventions to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA: a systematic review.

PubMed

Clifford, Anton; McCalman, Janya; Bainbridge, Roxanne; Tsey, Komla

2015-04-01

This article describes the characteristics and reviews the methodological quality of interventions designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA. A total of 17 electronic databases and 13 websites for the period of 2002-13. Studies were included if they evaluated an intervention strategy designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, the USA or Canada. Information on the characteristics and methodological quality of included studies was extracted using standardized assessment tools. Sixteen published evaluations of interventions to improve cultural competency in health care for Indigenous peoples were identified: 11 for Indigenous peoples of the USA and 5 for Indigenous Australians. The main types of intervention strategies were education and training of the health workforce, culturally specific health programs and recruitment of an Indigenous health workforce. Main positive outcomes reported were improvements in health professionals' confidence, and patients' satisfaction with and access to health care. The methodological quality of evaluations and the reporting of key methodological criteria were variable. Particular problems included weak study designs, low or no reporting of consent rates, confounding and non-validated measurement instruments. There is a lack of evidence from rigorous evaluations on the effectiveness of interventions for improving cultural competency in health care for Indigenous peoples. Future evaluations should employ more rigorous study designs and extend their measurement of outcomes beyond those relating to health professionals, to those relating to the health of Indigenous peoples. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

How effective is the comprehensive approach to rehabilitation (CARe) methodology? A cluster randomized controlled trial.

PubMed

Bitter, Neis; Roeg, Diana; van Assen, Marcel; van Nieuwenhuizen, Chijs; van Weeghel, Jaap

2017-12-11

The CARe methodology aims to improve the quality of life of people with severe mental illness by supporting them in realizing their goals, handling their vulnerability and improving the quality of their social environment. This study aims to investigate the effectiveness of the CARe methodology for people with severe mental illness on their quality of life, personal recovery, participation, hope, empowerment, self-efficacy beliefs and unmet needs. A cluster Randomized Controlled Trial (RCT) was conducted in 14 teams of three organizations for sheltered and supported housing in the Netherlands. Teams in the intervention group received training in the CARe methodology. Teams in the control group continued working according to care as usual. Questionnaires were filled out at baseline, after 10 months and after 20 months. A total of 263 clients participated in the study. Quality of life increased in both groups, however, no differences between the intervention and control group were found. Recovery and social functioning did not change over time. Regarding the secondary outcomes, the number of unmet needs decreased in both groups. All intervention teams received the complete training program. The model fidelity at T1 was 53.4% for the intervention group and 33.4% for the control group. At T2 this was 50.6% for the intervention group and 37.2% for the control group. All clients improved in quality of life. However we did not find significant differences between the clients of the both conditions on any outcome measure. Possible explanations of these results are: the difficulty to implement rehabilitation-supporting practice, the content of the methodology and the difficulty to improve the lives of a group of people with longstanding and severe impairments in a relatively short period. More research is needed on how to improve effects of rehabilitation trainings in practice and on outcome level. ISRCTN77355880 , retrospectively registered (05/07/2013).

[Education for patients with fibromyalgia. A systematic review of randomised clinical trials].

PubMed

Elizagaray-Garcia, Ignacio; Muriente-Gonzalez, Jorge; Gil-Martinez, Alfonso

2016-01-16

To analyse the effectiveness of education about pain, quality of life and functionality in patients with fibromyalgia. The search for articles was carried out in electronic databases. Eligibility criteria were: controlled randomised clinical trials (RCT), published in English and Spanish, that had been conducted on patients with fibromyalgia, in which the therapeutic procedure was based on patient education. Two independent reviewers analysed the methodological quality using the PEDro scale. Five RCT were selected, of which four offered good methodological quality. In three of the studies, patient education, in combination with another intervention based on therapeutic exercise, improved the outcomes in the variables assessing pain and quality of life as compared with the same procedures performed separately. Moreover, an RCT with a high quality methodology showed that patient education activated inhibitory neural pathways capable of lowering the level of pain. The quantitative analysis yields strong-moderate evidence that patient education, in combination with other therapeutic exercise procedures, offers positive results in the variables pain, quality of life and functionality. Patient education in itself has not proved to be effective for pain, quality of life or functionality in patients with fibromyalgia. There is strong evidence, however, of the effectiveness of combining patient education with exercise and active strategies for coping with pain, quality of life and functionality in the short, medium and long term in patients with fibromyalgia.

A checklist is associated with increased quality of reporting preclinical biomedical research: A systematic review

PubMed Central

Olonisakin, Tolani F.; Pribis, John P.; Zupetic, Jill; Yoon, Joo Heung; Holleran, Kyle M.; Jeong, Kwonho; Shaikh, Nader; Rubio, Doris M.; Lee, Janet S.

2017-01-01

Irreproducibility of preclinical biomedical research has gained recent attention. It is suggested that requiring authors to complete a checklist at the time of manuscript submission would improve the quality and transparency of scientific reporting, and ultimately enhance reproducibility. Whether a checklist enhances quality and transparency in reporting preclinical animal studies, however, has not been empirically studied. Here we searched two highly cited life science journals, one that requires a checklist at submission (Nature) and one that does not (Cell), to identify in vivo animal studies. After screening 943 articles, a total of 80 articles were identified in 2013 (pre-checklist) and 2015 (post-checklist), and included for the detailed evaluation of reporting methodological and analytical information. We compared the quality of reporting preclinical animal studies between the two journals, accounting for differences between journals and changes over time in reporting. We find that reporting of randomization, blinding, and sample-size estimation significantly improved when comparing Nature to Cell from 2013 to 2015, likely due to implementation of a checklist. Specifically, improvement in reporting of the three methodological information was at least three times greater when a mandatory checklist was implemented than when it was not. Reporting the sex of animals and the number of independent experiments performed also improved from 2013 to 2015, likely from factors not related to a checklist. Our study demonstrates that completing a checklist at manuscript submission is associated with improved reporting of key methodological information in preclinical animal studies. PMID:28902887

Systematic Review of Measurement Property Evidence for 8 Financial Management Instruments in Populations With Acquired Cognitive Impairment.

PubMed

Engel, Lisa; Chui, Adora; Beaton, Dorcas E; Green, Robin E; Dawson, Deirdre R

2018-03-07

To critically appraise the measurement property evidence (ie, psychometric) for 8 observation-based financial management assessment instruments. Seven databases were searched in May 2015. Two reviewers used an independent decision-agreement process to select studies of measurement property evidence relevant to populations with adulthood acquired cognitive impairment, appraise the quality of the evidence, and extract data. Twenty-one articles were selected. This review used the COnsensus-based Standards for the selection of health Measurement Instruments review guidelines and 4-point tool to appraise evidence. After appraising the methodologic quality, the adequacy of results and volume of evidence per instrument were synthesized. Measurement property evidence with high risk of bias was excluded from the synthesis. The volume of measurement property evidence per instrument is low; most instruments had 1 to 3 included studies. Many included studies had poor methodologic quality per measurement property evidence area examined. Six of the 8 instruments reviewed had supporting construct validity/hypothesis-testing evidence of fair methodologic quality. There is a dearth of acceptable quality content validity, reliability, and responsiveness evidence for all 8 instruments. Rehabilitation practitioners assess financial management functions in adults with acquired cognitive impairments. However, there is limited published evidence to support using any of the reviewed instruments. Practitioners should exercise caution when interpreting the results of these instruments. This review highlights the importance of appraising the quality of measurement property evidence before examining the adequacy of the results and synthesizing the evidence. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Quality of reporting in oncology phase II trials: A 5-year assessment through systematic review

PubMed Central

Langrand-Escure, Julien; Rivoirard, Romain; Oriol, Mathieu; Tinquaut, Fabien; Rancoule, Chloé; Chauvin, Frank; Magné, Nicolas; Bourmaud, Aurélie

2017-01-01

Background Phase II clinical trials are a cornerstone of the development in experimental treatments They work as a "filter" for phase III trials confirmation. Surprisingly the attrition ratio in Phase III trials in oncology is significantly higher than in any other medical specialty. This suggests phase II trials in oncology fail to achieve their goal. Objective The present study aims at estimating the quality of reporting in published oncology phase II clinical trials. Data sources A literature review was conducted among all phase II and phase II/III clinical trials published during a 5-year period (2010–2015). Study eligibility criteria All articles electronically published by three randomly-selected oncology journals with Impact-Factors>4 were included: Journal of Clinical Oncology, Annals of Oncology and British Journal of Cancer. Intervention Quality of reporting was assessed using the Key Methodological Score. Results 557 articles were included. 315 trials were single-arm studies (56.6%), 193 (34.6%) were randomized and 49 (8.8%) were non-randomized multiple-arm studies. The Methodological Score was equal to 0 (lowest level), 1, 2, 3 (highest level) respectively for 22 (3.9%), 119 (21.4%), 270 (48.5%) and 146 (26.2%) articles. The primary end point is almost systematically reported (90.5%), while sample size calculation is missing in 66% of the articles. 3 variables were independently associated with reporting of a high standard: presence of statistical design (p-value <0.001), multicenter trial (p-value = 0.012), per-protocol analysis (p-value <0.001). Limitations Screening was mainly performed by a sole author. The Key Methodological Score was based on only 3 items, making grey zones difficult to translate. Conclusions & implications of key findings This literature review highlights the existence of gaps concerning the quality of reporting. It therefore raised the question of the suitability of the methodology as well as the quality of these trials, reporting being incomplete in the corresponding articles. PMID:29216190

Measurement properties of patient reported outcome measures for spondyloarthritis: A systematic review.

PubMed

Png, Kelly; Kwan, Yu Heng; Leung, Ying Ying; Phang, Jie Kie; Lau, Jia Qi; Lim, Ka Keat; Chew, Eng Hui; Low, Lian Leng; Tan, Chuen Seng; Thumboo, Julian; Fong, Warren; Østbye, Truls

2018-03-21

This systematic review aimed to identify studies investigating measurement properties of patient reported outcome measures (PROMs) for spondyloarthritis (SpA), and to evaluate their methodological quality and level of evidence relating to the measurement properties of PROMs. This systematic review was guided by the preferred reporting items for systematic review and meta-analysis (PRISMA). Articles published before 30 June 2017 were retrieved from PubMed ® , Embase ® , and PsychINFO ® (Ovid). Methodological quality and level of evidence were evaluated according to recommendations from the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). We identified 60 unique PROMs from 125 studies in 39 countries. Twenty-one PROMs were validated for two or more SpA subtypes. The literature examined hypothesis testing (82.4%) most frequently followed by reliability (60.0%). A percentage of 77.7% and 42.7% of studies that assessed PROMs for hypothesis testing and reliability, respectively had "fair" or better methodological quality. Among the PROMs identified, 41.7% were studied in ankylosing spondylitis (AS) only and 23.3% were studied in psoriatic arthritis (PsA) only. The more extensively assessed PROMs included the ankylosing spondylitis quality of life (ASQoL) and bath ankylosing spondylitis functional index (BASFI) for ankylosing spondylitis, and the psoriatic arthritis quality of life questionnaire (VITACORA-19) for psoriatic arthritis. This study identified 60 unique PROMs through a systematic review and synthesized evidence of the measurement properties of the PROMs. There is a lack of validation of PROMs for use across SpA subtypes. Future studies may consider validating PROMs for use across different SpA subtypes. Copyright © 2018 Elsevier Inc. All rights reserved.

Music for medical indications in the neonatal period: a systematic review of randomised controlled trials.

PubMed

Hartling, L; Shaik, M S; Tjosvold, L; Leicht, R; Liang, Y; Kumar, M

2009-09-01

To conduct a systematic review of the efficacy of music for medical indications in term or preterm neonates. We searched 17 electronic databases, subject bibliographies, reference lists and trials registries. Two reviewers independently screened studies for inclusion, assessed methodological quality, and extracted data. Meta-analysis was not feasible due to heterogeneity in outcomes so a qualitative analysis is presented. Nine randomised trials were included. The methodological quality was generally poor (median Jadad score = 1). The outcomes most commonly reported were physiological measures (heart rate (HR), respiratory rate, oxygen saturation (SaO2)), behavioural state and pain. Six studies evaluated music for the painful procedures circumcision (three trials) and heel prick (three trials). For circumcisions, one high quality pilot study (n = 23) showed benefits of music for the outcomes of HR, SaO2 and pain, while two low quality studies showed no difference. For heel prick, three low quality studies provided some evidence that music may be beneficial primarily for measures of behaviour and pain. The remaining studies evaluated the use of music in preterm infants to improve physiological and behavioural parameters (n = 31; benefits observed for behavioural parameters), to reinforce non-nutritive sucking via use of a pacifier activated lullaby (n = 32; significant increase in feeding rates), and to influence physiological stability and behaviours in infants with chronic lung disease (n = 22; no significant differences for outcomes assessed). The heterogeneity in study populations, interventions and outcomes precludes definitive conclusions around efficacy. There is preliminary evidence for some therapeutic benefits of music for specific indications; however, these findings need to be confirmed in methodologically rigorous trials.

An Improvement in Instructional Quality: Can Evaluation of Teaching Effectiveness Make a Difference?

ERIC Educational Resources Information Center

Ngware, Moses Waithanji; Ndirangu, Mwangi

2005-01-01

Purpose: To report study findings on teaching effectiveness and feedback mechanisms in Kenyan universities, which can guide management in developing a comprehensive quality control policy. Design/methodology/approach: The study adopted an exploratory descriptive design. Three public and two private universities were randomly selected to…

Controlled trials in children: quantity, methodological quality and descriptive characteristics of pediatric controlled trials published 1948-2006.

PubMed

Thomson, Denise; Hartling, Lisa; Cohen, Eyal; Vandermeer, Ben; Tjosvold, Lisa; Klassen, Terry P

2010-09-30

The objective of this study was to describe randomized controlled trials (RCTs) and controlled clinical trials (CCTs) in child health published between 1948 and 2006, in terms of quantity, methodological quality, and publication and trial characteristics. We used the Trials Register of the Cochrane Child Health Field for overall trends and a sample from this to explore trial characteristics in more detail. We extracted descriptive data on a random sample of 578 trials. Ninety-six percent of the trials were published in English; the percentage of child-only trials was 90.5%. The most frequent diagnostic categories were infectious diseases (13.2%), behavioural and psychiatric disorders (11.6%), neonatal critical care (11.4%), respiratory disorders (8.9%), non-critical neonatology (7.9%), and anaesthesia (6.5%). There were significantly fewer child-only studies (i.e., more mixed child and adult studies) over time (P = 0.0460). The proportion of RCTs to CCTs increased significantly over time (P<0.0001), as did the proportion of multicentre trials (P = 0.002). Significant increases over time were found in methodological quality (Jadad score) (P<0.0001), the proportion of double-blind studies (P<0.0001), and studies with adequate allocation concealment (P<0.0001). Additionally, we found an improvement in reporting over time: adequate description of withdrawals and losses to follow-up (P<0.0001), sample size calculations (P<0.0001), and intention-to-treat analysis (P<0.0001). However, many trials still do not describe their level of blinding, and allocation concealment was inadequately reported in the majority of studies across the entire time period. The proportion of studies with industry funding decreased slightly over time (P = 0.003), and these studies were more likely to report positive conclusions (P = 0.028). The quantity and quality of pediatric controlled trials has increased over time; however, much work remains to be done, particularly in improving methodological issues around conduct and reporting of trials.

Road-corridor planning in the EIA procedure in Spain. A review of case studies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Loro, Manuel, E-mail: manuel.loro@upm.es; Transport Research Centre; Centro de investigación del transporte, TRANSyT-UPM, ETSI Caminos, Canales y Puertos, Universidad Politécnica de Madrid, Prof. Aranguren s/n, 28040 Madrid

The assessment of different alternatives in road-corridor planning must be based on a number of well-defined territorial variables that serve as decision making criteria, and this requires a high-quality preliminary environmental assessment study. In Spain the formal specifications for the technical requirements stipulate the constraints that must be considered in the early stages of defining road corridors, but not how they should be analyzed and ranked. As part of the feasibility study of a new road definition, the most common methodology is to establish different levels of Territorial Carrying Capacity (TCC) in the study area in order to summarize themore » territorial variables on thematic maps and to ease the tracing process of road-corridor layout alternatives. This paper explores the variables used in 22 road-construction projects conducted by the Ministry of Public Works that were subject to the Spanish EIA regulation and published between 2006 and 2008. The aim was to evaluate the quality of the methods applied and the homogeneity and suitability of the variables used for defining the TCC. The variables were clustered into physical, environmental, land-use and cultural constraints for the purpose of comparing the TCC values assigned in the studies reviewed. We found the average quality of the studies to be generally acceptable in terms of the justification of the methodology, the weighting and classification of the variables, and the creation of a synthesis map. Nevertheless, the methods for assessing the TCC are not sufficiently standardized; there is a lack of uniformity in the cartographic information sources and methodologies for the TCC valuation. -- Highlights: • We explore 22 road-corridor planning studies subjected to the Spanish EIA regulation. • We analyze the variables selected for defining territorial carrying capacity. • The quality of the studies is acceptable (methodology, variable weighting, mapping). • There is heterogeneity in the methods for territorial carrying capacity valuation.« less

Rapid Prototyping Methodology in Action: A Developmental Study.

ERIC Educational Resources Information Center

Jones, Toni Stokes; Richey, Rita C.

2000-01-01

Investigated the use of rapid prototyping methodologies in two projects conducted in a natural work setting to determine the nature of its use by designers and customers and the extent to which its use enhances traditional instructional design. Discusses design and development cycle-time reduction, product quality, and customer and designer…

Six Sigma in Education

ERIC Educational Resources Information Center

LeMahieu, Paul G.; Nordstrum, Lee E.; Cudney, Elizabeth A.

2017-01-01

Purpose: This paper is one of seven in this volume that aims to elaborate different approaches to quality improvement in education. It delineates a methodology called Six Sigma. Design/methodology/approach: The paper presents the origins, theoretical foundations, core principles and a case study demonstrating an application of Six Sigma in a…

Positive Deviance: Learning from Positive Anomalies

ERIC Educational Resources Information Center

LeMahieu, Paul G.; Nordstrum, Lee E.; Gale, Dick

2017-01-01

Purpose: This paper is one of seven in this volume, each elaborating different approaches to quality improvement in education. The purpose of this paper is to delineate a methodology called positive deviance. Design/methodology/approach: The paper presents the origins, theoretical foundations, core principles and a case study demonstrating an…

Intra-Articular Cellular Therapy for Osteoarthritis and Focal Cartilage Defects of the Knee: A Systematic Review of the Literature and Study Quality Analysis.

PubMed

Chahla, Jorge; Piuzzi, Nicolas S; Mitchell, Justin J; Dean, Chase S; Pascual-Garrido, Cecilia; LaPrade, Robert F; Muschler, George F

2016-09-21

Intra-articular cellular therapy injections constitute an appealing strategy that may modify the intra-articular milieu or regenerate cartilage in the settings of osteoarthritis and focal cartilage defects. However, little consensus exists regarding the indications for cellular therapies, optimal cell sources, methods of preparation and delivery, or means by which outcomes should be reported. We present a systematic review of the current literature regarding the safety and efficacy of cellular therapy delivered by intra-articular injection in the knee that provided a Level of Evidence of III or higher. A total of 420 papers were screened. Methodological quality was assessed using a modified Coleman methodology score. Only 6 studies (4 Level II and 2 Level III) met the criteria to be included in this review; 3 studies were on treatment of osteoarthritis and 3 were on treatment of focal cartilage defects. These included 4 randomized controlled studies without blinding, 1 prospective cohort study, and 1 retrospective therapeutic case-control study. The studies varied widely with respect to cell sources, cell characterization, adjuvant therapies, and assessment of outcomes. Outcome was reported in a total of 300 knees (124 in the osteoarthritis studies and 176 in the cartilage defect studies). Mean follow-up was 21.0 months (range, 12 to 36 months). All studies reported improved outcomes with intra-articular cellular therapy and no major adverse events. The mean modified Coleman methodology score was 59.1 ± 16 (range, 32 to 82). The studies of intra-articular cellular therapy injections for osteoarthritis and focal cartilage defects in the human knee suggested positive results with respect to clinical improvement and safety. However, the improvement was modest and a placebo effect cannot be disregarded. The overall quality of the literature was poor, and the methodological quality was fair, even among Level-II and III studies. Effective clinical assessment and optimization of injection therapies will demand greater attention to study methodology, including blinding; standardized quantitative methods for cell harvesting, processing, characterization, and delivery; and standardized reporting of clinical and structural outcomes. Therapeutic Level III. See Instructions for Authors for a complete description of levels of evidence. Copyright © 2016 by The Journal of Bone and Joint Surgery, Incorporated.

Risk of bias in overviews of reviews: a scoping review of methodological guidance and four-item checklist.

PubMed

Ballard, Madeleine; Montgomery, Paul

2017-03-01

To assess the conditions under which employing an overview of systematic reviews is likely to lead to a high risk of bias. To synthesise existing guidance concerning overview practice, a scoping review was conducted. Four electronic databases were searched with a pre-specified strategy (PROSPERO 2015:CRD42015027592) ending October 2015. Included studies needed to describe or develop overview methodology. Data were narratively synthesised to delineate areas highlighted as outstanding challenges or where methodological recommendations conflict. Twenty-four papers met the inclusion criteria. There is emerging debate regarding overlapping systematic reviews; systematic review scope; quality of included research; updating; and synthesizing and reporting results. While three functions for overviews have been proposed-identify gaps, explore heterogeneity, summarize evidence-overviews cannot perform the first; are unlikely to achieve the second and third simultaneously; and can only perform the third under specific circumstances. Namely, when identified systematic reviews meet the following four conditions: (1) include primary trials that do not substantially overlap, (2) match overview scope, (3) are of high methodological quality, and (4) are up-to-date. Considering the intended function of proposed overviews with the corresponding methodological conditions may improve the quality of this burgeoning publication type. Copyright © 2017 John Wiley & Sons, Ltd. Copyright © 2017 John Wiley & Sons, Ltd.

Implementing Quality Criteria in Designing and Conducting a Sequential Quan [right arrow] Qual Mixed Methods Study of Student Engagement with Learning Applied Research Methods Online

ERIC Educational Resources Information Center

Ivankova, Nataliya V.

2014-01-01

In spite of recent methodological developments related to quality assurance in mixed methods research, practical examples of how to implement quality criteria in designing and conducting sequential QUAN [right arrow] QUAL mixed methods studies to ensure the process is systematic and rigorous remain scarce. This article discusses a three-step…

TAPping into argumentation: Developments in the application of Toulmin's Argument Pattern for studying science discourse

NASA Astrophysics Data System (ADS)

Erduran, Sibel; Simon, Shirley; Osborne, Jonathan

2004-11-01

This paper reports some methodological approaches to the analysis of argumentation discourse developed as part of the two-and-a-half year project titled Enhancing the Quality of Argument in School Scienc'' supported by the Economic and Social Research Council in the United Kingdom. In this project researchers collaborated with middle-school science teachers to develop models of instructional activities in an effort to make argumentation a component of instruction. We begin the paper with a brief theoretical justification for why we consider argumentation to be of significance to science education. We then contextualize the use of Toulmin's Argument Pattern in the study of argumentation discourse and provide a justification for the methodological outcomes our approach generates. We illustrate how our work refines and develops research methodologies in argumentation analysis. In particular, we present two methodological approaches to the analysis of argumentation resulting in whole-class as well as small-group student discussions. For each approach, we illustrate our coding scheme and some results as well as how our methodological approach has enabled our inquiry into the quality of argumentation in the classroom. We conclude with some implications for future research in argumentation in science education.

The association between head and cervical posture and temporomandibular disorders: a systematic review.

PubMed

Olivo, Susan Armijo; Bravo, Jaime; Magee, David J; Thie, Norman M R; Major, Paul W; Flores-Mir, Carlos

2006-01-01

To carry out a systematic review to assess the evidence concerning the association between head and cervical posture and temporomandibular disorders (TMD). A search of Medline, Pubmed, Embase, Web of Science, Lilacs, and Cochrane Library databases was conducted in all languages with the help of a health sciences librarian. Key words used in the search were posture, head posture, cervical spine or neck, vertebrae, cervical lordosis, craniomandibular disorders or temporomandibular disorders, temporomandibular disorders, and orofacial pain or facial pain. Abstracts which appeared to fulfill the initial selection criteria were selected by consensus. The original articles were retrieved and evaluated to ensure they met the inclusion criteria. A methodological checklist was used to evaluate the quality of the selected articles and their references were hand-searched for possible missing articles. Twelve studies met all inclusion criteria and were analyzed in detail for their methodology and information quality. Nine articles that analyzed the association between head posture and TMD included patients with mixed TMD diagnosis; 1 article differentiated among muscular, articular, and mixed symptomatology; and 3 articles analyzed information from patients with only articular problems. Finally, 2 studies evaluated the association between head posture and TMD in patients with muscular TMD. Several methodological defects were noted in the 12 studies. Since most of the studies included in this systematic review were of poor methodological quality, the findings of the studies should be interpreted with caution. The association between intra-articular and muscular TMD and head and cervical posture is still unclear, and better controlled studies with comprehensive TMD diagnoses, greater sample sizes, and objective posture evaluation are necessary.

Don’t forget the posters! Quality and content variables associated with accepted abstracts at a national trauma meeting

PubMed Central

Dossett, Lesly A.; Fox, Erin E.; del Junco, Deborah J.; Zaydfudim, Victor; Kauffmann, Rondi; Shelton, Julia; Wang, Weiwei; Cioffi, William G.; Holcomb, John B.; Cotton, Bryan A.

2014-01-01

BACKGROUND As a primary venue for presenting research results, abstracts selected for presentation at national meetings should be of the highest scientific merit and research quality. It is uncertain to what degree this is achieved as the methodological quality of abstracts submitted to national surgical meetings has not been previously described. The objective of this study was to evaluate abstracts presented at a leading trauma meeting for methodological quality. METHODS All abstracts accepted for the 2009 American Association for the Surgery of Trauma meeting were reviewed and scored for methodological quality based on 10 criteria (scores, 0–10; 10 being the highest). Criteria were based on nationally published methodology guidelines. Two independent reviewers who were blinded to institution, region, and author reviewed each abstract. RESULTS A total of 187 abstracts were accepted for presentation (67 oral and 120 posters). The most frequent clinical topics were shock/transfusion (23%), abdomen (12%), and nervous system (11%). Shock/transfusion abstracts were more common in the oral presentations (31% vs. 19%; p =0.06). Abstracts from the northeast and south regions were the most common in both oral (26% and 29%) and posters (25% and 24%). Basic science accounted for 12% of accepted studies, while 51% were clinical and 28% were health services/outcomes. Only 8% of abstracts presented randomized data and only 11% reported null findings. Overall abstract scores ranged from 3 to 10 (median, 7; mean, 7.4). Abstracts selected for poster presentation had an overall higher score than those selected for oral presentation (7.4 ±1.7 vs. 6.8 ±1.7; p =0.02). CONCLUSION Although oral presentations traditionally receive the most attention and interest, the methodological quality of abstracts accepted for poster presentation equals (and sometimes exceeds) that of oral abstracts. Attendees of these national meetings should reconsider their time spent in viewing and visiting these poster sessions as with the oral presentations. In light of our findings, we highly encourage that all members and guests attend the American Association for the Surgery of Trauma Poster Rounds at each year’s scientific assembly. PMID:22673278

Don't forget the posters! Quality and content variables associated with accepted abstracts at a national trauma meeting.

PubMed

Dossett, Lesly A; Fox, Erin E; del Junco, Deborah J; Zaydfudim, Victor; Kauffmann, Rondi; Shelton, Julia; Wang, Weiwei; Cioffi, William G; Holcomb, John B; Cotton, Bryan A

2012-05-01

As a primary venue for presenting research results, abstracts selected for presentation at national meetings should be of the highest scientific merit and research quality. It is uncertain to what degree this is achieved as the methodological quality of abstracts submitted to national surgical meetings has not been previously described. The objective of this study was to evaluate abstracts presented at a leading trauma meeting for methodological quality. All abstracts accepted for the 2009 American Association for the Surgery of Trauma meeting were reviewed and scored for methodological quality based on 10 criteria (scores, 0-10; 10 being the highest). Criteria were based on nationally published methodology guidelines. Two independent reviewers who were blinded to institution, region, and author reviewed each abstract. A total of 187 abstracts were accepted for presentation (67 oral and 120 posters). The most frequent clinical topics were shock/transfusion (23%), abdomen (12%), and nervous system (11%). Shock/transfusion abstracts were more common in the oral presentations (31% vs. 19%; p = 0.06). Abstracts from the northeast and south regions were the most common in both oral (26% and 29%) and posters (25% and 24%). Basic science accounted for 12% of accepted studies, while 51% were clinical and 28% were health services/outcomes. Only 8% of abstracts presented randomized data and only 11% reported null findings. Overall abstract scores ranged from 3 to 10 (median, 7; mean, 7.4). Abstracts selected for poster presentation had an overall higher score than those selected for oral presentation (7.4 ± 1.7 vs. 6.8 ± 1.7; p = 0.02). Although oral presentations traditionally receive the most attention and interest, the methodological quality of abstracts accepted for poster presentation equals (and sometimes exceeds) that of oral abstracts. Attendees of these national meetings should reconsider their time spent in viewing and visiting these poster sessions as with the oral presentations. In light of our findings, we highly encourage that all members and guests attend the American Association for the Surgery of Trauma Poster Rounds at each year's scientific assembly.

Does Case-Study Methodology Lack Rigour? The Need for Quality Criteria for Sound Case-Study Research, as Illustrated by a Recent Case in Secondary and Higher Education

ERIC Educational Resources Information Center

Kyburz-Graber, Regula

2004-01-01

There is a tendency to use case-study research methodology for research issues aiming at simply describing a complex situation, and to draw conclusions with insufficient rigour. Sound case-study research, however, follows discriminate rules which can be described in all the dimensions of a full case-study research process. This paper examines…

Chronic care management for patients with COPD: a critical review of available evidence.

PubMed

Lemmens, Karin M M; Lemmens, Lidwien C; Boom, José H C; Drewes, Hanneke W; Meeuwissen, Jolanda A C; Steuten, Lotte M G; Vrijhoef, Hubertus J M; Baan, Caroline A

2013-10-01

Clinical diversity and methodological heterogeneity exists between studies on chronic care management. This study aimed to examine the effectiveness of chronic care management in chronic obstructive pulmonary disease (COPD) while taking heterogeneity into account, enabling the understanding of and the decision making about such programmes. Three investigated sources of heterogeneity were study quality, length of follow-up, and number of intervention components. We performed a review of previously published reviews and meta-analyses on COPD chronic care management. Their primary studies that were analyzed as statistical, clinical and methodological heterogeneity were present. Meta-regression analyses were performed to explain the variances among the primary studies. Generally, the included reviews showed positive results on quality of life and hospitalizations. Inconclusive effects were found on emergency department visits and no effects on mortality. Pooled effects on hospitalizations, emergency department visits and quality of life of primary studies did not reach significant improvement. No effects were found on mortality. Meta-regression showed that the number of components of chronic care management programmes explained present heterogeneity for hospitalizations and emergency department visits. Four components showed significant effects on hospitalizations, whereas two components had significant effects on emergency department visits. Methodological study quality and length of follow-up did not significantly explain heterogeneity. This study demonstrated that COPD chronic care management has the potential to improve outcomes of care; heterogeneity in outcomes was explained. Further research is needed to elucidate the diversity between COPD chronic care management studies in terms of the effects measured and strengthen the support for chronic care management. © 2011 John Wiley & Sons Ltd.

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Non-pharmacological sleep interventions for youth with chronic health conditions: a critical review of the methodological quality of the evidence.

PubMed

Brown, Cary A; Kuo, Melissa; Phillips, Leah; Berry, Robyn; Tan, Maria

2013-07-01

Restorative sleep is clearly linked with well-being in youth with chronic health conditions. This review addresses the methodological quality of non-pharmacological sleep intervention (NPSI) research for youth with chronic health conditions. The Guidelines for Critical Review (GCR) and the Effective Public Health Practice Project Quality Assessment Tool (EPHPP) were used in the review. The search yielded 31 behavioural and 10 non-behavioural NPSI for review. Most studies had less than 10 participants. Autism spectrum disorders, attention deficit/hyperactivity disorders, down syndrome, intellectual disabilities, and visual impairments were the conditions that most studies focused upon. The global EPHPP scores indicated most reviewed studies were of weak quality. Only 7 studies were rated as moderate, none were strong. Studies rated as weak quality frequently had recruitment issues; non-blinded participants/parents and/or researchers; and used outcome measures without sound psychometric properties. Little conclusive evidence exists for NPSIs in this population. However, NPSIs are widely used and these preliminary studies demonstrate promising outcomes. There have not been any published reports of negative outcomes that would preclude application of the different NPSIs on a case-by-case basis guided by clinical judgement. These findings support the need for more rigorous, applied research. • Methodological Quality of Sleep Research • Disordered sleep (DS) in youth with chronic health conditions is pervasive and is important to rehabilitation therapists because DS contributes to significant functional problems across psychological, physical and emotional domains. • Rehabilitation therapists and other healthcare providers receive little education about disordered sleep and are largely unaware of the range of assessment and non-pharmacological intervention strategies that exist. An evidence-based website of pediatric sleep resources can be found at http://www.SleepRight.ualberta.ca • The current research on non-pharmacological sleep interventions (NPSI) for youth with health conditions is methodologically weak. However, consistently positive outcomes reported in the literature demonstrate that pragmatic interventions such as bright light therapy, activity, massage and behavioral interventions are promising areas. No studies found reasons that a trail of a NPSI matched to the youth's context and condition should not attempted. More rigorous clinically relevant study of pragmatic non-pharmacological interventions appropriate for therapists' and parents' needs is required.

Methodological Quality Assessment of Meta-analyses in Endodontics.

PubMed

Kattan, Sereen; Lee, Su-Min; Kohli, Meetu R; Setzer, Frank C; Karabucak, Bekir

2018-01-01

The objectives of this review were to assess the methodological quality of published meta-analyses related to endodontics using the assessment of multiple systematic reviews (AMSTAR) tool and to provide a follow-up to previously published reviews. Three electronic databases were searched for eligible studies according to the inclusion and exclusion criteria: Embase via Ovid, The Cochrane Library, and Scopus. The electronic search was amended by a hand search of 6 dental journals (International Endodontic Journal; Journal of Endodontics; Australian Endodontic Journal; Oral Surgery, Oral Medicine, Oral Pathology, Oral Radiology; Endodontics and Dental Traumatology; and Journal of Dental Research). The searches were conducted to include articles published after July 2009, and the deadline for inclusion of the meta-analyses was November 30, 2016. The AMSTAR assessment tool was used to evaluate the methodological quality of all included studies. A total of 36 reports of meta-analyses were included. The overall quality of the meta-analyses reports was found to be medium, with an estimated mean overall AMSTAR score of 7.25 (95% confidence interval, 6.59-7.90). The most poorly assessed areas were providing an a priori design, the assessment of the status of publication, and publication bias. In recent publications in the field of endodontics, the overall quality of the reported meta-analyses is medium according to AMSTAR. Copyright © 2017 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Worldwide trends in volume and quality of published protocols of randomized controlled trials

PubMed Central

Alldinger, Ingo; Cieslak, Kasia P.; Wennink, Roos; Clarke, Mike; Ali, Usama Ahmed; Besselink, Marc G. H.

2017-01-01

Introduction Publishing protocols of randomized controlled trials (RCT) facilitates a more detailed description of study rational, design, and related ethical and safety issues, which should promote transparency. Little is known about how the practice of publishing protocols developed over time. Therefore, this study describes the worldwide trends in volume and methodological quality of published RCT protocols. Methods A systematic search was performed in PubMed and EMBASE, identifying RCT protocols published over a decade from 1 September 2001. Data were extracted on quality characteristics of RCT protocols. The primary outcome, methodological quality, was assessed by individual methodological characteristics (adequate generation of allocation, concealment of allocation and intention-to-treat analysis). A comparison was made by publication period (First, September 2001- December 2004; Second, January 2005-May 2008; Third, June 2008-September 2011), geographical region and medical specialty. Results The number of published RCT protocols increased from 69 in the first, to 390 in the third period (p<0.0001). Internal medicine and paediatrics were the most common specialty topics. Whereas most published RCT protocols in the first period originated from North America (n = 30, 44%), in the second and third period this was Europe (respectively, n = 65, 47% and n = 190, 48%, p = 0.02). Quality of RCT protocols was higher in Europe and Australasia, compared to North America (OR = 0.63, CI = 0.40–0.99, p = 0.04). Adequate generation of allocation improved with time (44%, 58%, 67%, p = 0.001), as did concealment of allocation (38%, 53%, 55%, p = 0.03). Surgical protocols had the highest quality among the three specialty topics used in this study (OR = 1.94, CI = 1.09–3.45, p = 0.02). Conclusion Publishing RCT protocols has become popular, with a five-fold increase in the past decade. The quality of published RCT protocols also improved, although variation between geographical regions and across medical specialties was seen. This emphasizes the importance of international standards of comprehensive training in RCT methodology. PMID:28296925

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand

PubMed Central

2013-01-01

Background Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. Methods A systematic search of 17 electronic databases and 13 websites for the period 1981–2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Results Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. Conclusions There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise. PMID:23663493

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand.

PubMed

Clifford, Anton C; Doran, Christopher M; Tsey, Komla

2013-05-13

Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. A systematic search of 17 electronic databases and 13 websites for the period 1981-2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise.

Methodological quality of economic evaluations of new pharmaceuticals in The Netherlands.

PubMed

Hoomans, Ties; Severens, Johan L; van der Roer, Nicole; Delwel, Gepke O

2012-03-01

In the Netherlands, decisions about the reimbursement of new pharmaceuticals are based on cost effectiveness, as well as therapeutic value and budget impact. Since 1 January 2005, drug manufacturers are formally required to substantiate the cost effectiveness of drugs that have therapeutic added value in comparison with existing ones through pharmacoeconomic evaluations. Dutch guidelines for pharmacoeconomic research provide methods guidance, ensuring consistency in both the evidence and the decision-making process about drug reimbursement. This study reviewed the methodological quality of all 21 formally required pharmacoeconomic evaluations of new pharmaceuticals between 1 January 2005 and 1 October 2008, and verified whether these evaluations complied with pharmacoeconomic guidelines. Data on the quality of the pharmacoeconomic evaluations were extracted from the pharmacoeconomic reports published by the Dutch Health Care Insurance Board (CVZ). The Board's newsletters provided information on the advice to, and reimbursement decisions made by, the Dutch Minister of Health. All data extraction was carried out by two independent reviewers, and descriptive analyses were conducted. The methodological quality was sound in only 8 of the 21 pharmacoeconomic evaluations. In most cases, the perspective of analysis, the comparator drugs, and the reporting of both total and incremental costs and effects were correct. However, drug indication, form (i.e. cost utility/cost effectiveness) and time horizon of the evaluations were frequently flawed. Moreover, the costs and effects of the pharmaceuticals were not always analysed correctly, and modelling studies were often non-transparent. Twelve drugs were reimbursed, and nine were not. The compliance with pharmacoeconomic guidelines in economic evaluations of new pharmaceuticals can be improved. This would improve the methodological quality of the pharmacoeconomic evaluations and ensure consistency in the evidence and the decision-making process for drug reimbursement in the Netherlands.

A flood tide of systematic reviews on endodontic posts: methodological assessment using of R-AMSTAR.

PubMed

Schmitter, M; Sterzenbach, G; Faggion, C M; Krastl, G

2013-06-01

To help the dental practitioner solve a specific clinical problem, systematic reviews (SRs) are seen as the best guide. In addition to the unmanageable quantity of SRs, however, one should be aware of their variable quality. The present review describes the methodological quality of SRs on postendodontic restorations to work out the value of these reviews for the dental practitioner. SRs were searched in April 2012, independently and in triplicate. Post survival was used as measure of outcome. The methodological quality of included SRs was assessed with the Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) checklist. Kappa statistics were used to assess reviewer agreement. Three hundred sixty-three papers were retrieved from the initial search. Ten SRs were included. One SR achieved a high R-AMSTAR score, whereas the other nine SRs achieved scores that indicate a substantial lack of methodological quality. Especially the items "grey literature," "combination of findings," "likelihood of publication bias," and conflict of interest" showed low R-AMSTAR scores. The three reviews with the highest R-AMSTAR scores tended to conclude that fewer failures occurred when using nonmetal posts. The reviewer agreement was excellent (kappa ranged from 0.79 to 0.85) in the R-AMSTAR classification. The approach presented revealed a lack of SRs with high methodological quality. Thus, no decisive conclusion can be drawn with respect to this topic. It appears that there is a trend for the superiority of fiber-reinforced posts. SRs must be of high methodological quality. This can be achieved by taking into consideration the results of this review. Improved methodological quality would make SRs more supportive for the general practitioner.

The use of cost per life year gained as a measurement of cost-effectiveness in Spain: a systematic review of recent publications.

PubMed

Rodríguez Barrios, José Manuel; Pérez Alcántara, Ferran; Crespo Palomo, Carlos; González García, Paloma; Antón De Las Heras, Enrique; Brosa Riestra, Max

2012-12-01

The objective of this study was to evaluate the methodological characteristics of cost-effectiveness evaluations carried out in Spain, since 1990, which include LYG as an outcome to measure the incremental cost-effectiveness ratio. A systematic review of published studies was conducted describing their characteristics and methodological quality. We analyse the cost per LYG results in relation with a commonly accepted Spanish cost-effectiveness threshold and the possible relation with the cost per quality adjusted life year (QALY) gained when they both were calculated for the same economic evaluation. A total of 62 economic evaluations fulfilled the selection criteria, 24 of them including the cost per QALY gained result as well. The methodological quality of the studies was good (55%) or very good (26%). A total of 124 cost per LYG results were obtained with a mean ratio of 49,529 and a median of 11,490 (standard deviation of 183,080). Since 2003, a commonly accepted Spanish threshold has been referenced by 66% of studies. A significant correlation was found between the cost per LYG and cost per QALY gained results (0.89 Spearman-Rho, 0.91 Pearson). There is an increasing interest for economic health care evaluations in Spain, and the quality of the studies is also improving. Although a commonly accepted threshold exists, further information is needed for decision-making as well as to identify the relationship between the costs per LYG and per QALY gained.

Effects of obesity on lung volume and capacity in children and adolescents: a systematic review

PubMed Central

Winck, Aline Dill; Heinzmann-Filho, João Paulo; Soares, Rafaela Borges; da Silva, Juliana Severo; Woszezenki, Cristhiele Taís; Zanatta, Letiane Bueno

2016-01-01

Abstract Objective: To assess the effects of obesity on lung volume and capacity in children and adolescents. Data source: This is a systematic review, carried out in Pubmed, Lilacs, Scielo and PEDro databases, using the following Keywords: Plethysmography; Whole Body OR Lung Volume Measurements OR Total Lung Capacity OR Functional Residual Capacity OR Residual Volume AND Obesity. Observational studies or clinical trials that assessed the effects of obesity on lung volume and capacity in children and adolescents (0-18 years) without any other associated disease; in English; Portuguese and Spanish languages were selected. Methodological quality was assessed by the Agency for Healthcare Research and Quality. Data synthesis: Of the 1,030 articles, only four were included in the review. The studies amounted to 548 participants, predominantly males, with sample size ranging from 45 to 327 individuals. 100% of the studies evaluated nutritional status through BMI (z-score) and 50.0% reported the data on abdominal circumference. All demonstrated that obesity causes negative effects on lung volume and capacity, causing a reduction mainly in functional residual capacity in 75.0% of the studies; in the expiratory reserve volume in 50.0% and in the residual volume in 25.0%. The methodological quality ranged from moderate to high, with 75.0% of the studies classified as having high methodological quality. Conclusions: Obesity causes deleterious effects on lung volume and capacity in children and adolescents, mainly by reducing functional residual capacity, expiratory reserve volume and residual volume. PMID:27130483

Accuracy of the Canadian C-spine rule and NEXUS to screen for clinically important cervical spine injury in patients following blunt trauma: a systematic review

PubMed Central

Michaleff, Zoe A.; Maher, Chris G.; Verhagen, Arianne P.; Rebbeck, Trudy; Lin, Chung-Wei Christine

2012-01-01

Background: There is uncertainty about the optimal approach to screen for clinically important cervical spine (C-spine) injury following blunt trauma. We conducted a systematic review to investigate the diagnostic accuracy of the Canadian C-spine rule and the National Emergency X-Radiography Utilization Study (NEXUS) criteria, 2 rules that are available to assist emergency physicians to assess the need for cervical spine imaging. Methods: We identified studies by an electronic search of CINAHL, Embase and MEDLINE. We included articles that reported on a cohort of patients who experienced blunt trauma and for whom clinically important cervical spine injury detectable by diagnostic imaging was the differential diagnosis; evaluated the diagnostic accuracy of the Canadian C-spine rule or NEXUS or both; and used an adequate reference standard. We assessed the methodologic quality using the Quality Assessment of Diagnostic Accuracy Studies criteria. We used the extracted data to calculate sensitivity, specificity, likelihood ratios and post-test probabilities. Results: We included 15 studies of modest methodologic quality. For the Canadian C-spine rule, sensitivity ranged from 0.90 to 1.00 and specificity ranged from 0.01 to 0.77. For NEXUS, sensitivity ranged from 0.83 to 1.00 and specificity ranged from 0.02 to 0.46. One study directly compared the accuracy of these 2 rules using the same cohort and found that the Canadian C-spine rule had better accuracy. For both rules, a negative test was more informative for reducing the probability of a clinically important cervical spine injury. Interpretation: Based on studies with modest methodologic quality and only one direct comparison, we found that the Canadian C-spine rule appears to have better diagnostic accuracy than the NEXUS criteria. Future studies need to follow rigorous methodologic procedures to ensure that the findings are as free of bias as possible. PMID:23048086

Effectiveness of mirror therapy, motor imagery, and virtual feedback on phantom limb pain following amputation: A systematic review.

PubMed

Herrador Colmenero, Laura; Perez Marmol, Jose Manuel; Martí-García, Celia; Querol Zaldivar, María de Los Ángeles; Tapia Haro, Rosa María; Castro Sánchez, Adelaida María; Aguilar-Ferrándiz, María Encarnación

2018-06-01

Phantom limb pain is reported in 50%-85% of people with amputation. Clinical interventions in treating central pain, such as mirror therapy, motor imagery, or virtual visual feedback, could redound in benefits to amputee patients with phantom limb pain. To provide an overview of the effectiveness of different techniques for treating phantom limb pain in amputee patients. Systematic review. A computerized literature search up to April 2017 was performed using the following databases: PubMed, Scopus, CINAHL, MEDLINE, ProQuest, PEDro, EBSCOhost, and Cochrane Plus. Methodological quality and internal validity score of each study were assessed using PEDro scale. For data synthesis, qualitative methods from the Cochrane Back Review Group were applied. In all, 12 studies met our inclusion criteria, where 9 were rated as low methodological quality and 3 rated moderate quality. All studies showed a significant reduction in pain, but there was heterogeneity among subjects and methodologies and any high-quality clinical trial (PEDro score ≤8; internal validity score ≤5) was not found. Mirror therapy, motor imaginary, and virtual visual feedback reduce phantom limb pain; however, there is limited scientific evidence supporting their effectiveness. Future studies should include designs with more solid research methods, exploring short- and long-term benefits of these therapies. Clinical relevance This systematic review investigates the effectiveness of mirror therapy, motor imagery, and virtual visual feedback on phantom limb pain, summarizing the currently published trials and evaluating the research quality. Although these interventions have positive benefits in phantom limb pain, there is still a lack of evidence for supporting their effectiveness.

Are validated outcome measures used in distal radial fractures truly valid?

PubMed Central

Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

2016-01-01

Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the validity on hypothesis testing are good. There is no evidence for the other measurement properties. Conclusion According to this systematic review, there is, at best, moderate evidence that the responsiveness of the PRWE and DASH are good, as are the reliability and validity of the PRWE. We recommend these PROMs in clinical studies in patients with distal radial fractures; however, more clinimetric studies of higher methodological quality are needed to adequately determine the other measurement properties. Cite this article: Dr Y. V. Kleinlugtenbelt. Are validated outcome measures used in distal radial fractures truly valid?: A critical assessment using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Bone Joint Res 2016;5:153–161. DOI: 10.1302/2046-3758.54.2000462. PMID:27132246

Use of Terrestrial Laser Scanning Technology for Long Term High Precision Deformation Monitoring

PubMed Central

Vezočnik, Rok; Ambrožič, Tomaž; Sterle, Oskar; Bilban, Gregor; Pfeifer, Norbert; Stopar, Bojan

2009-01-01

The paper presents a new methodology for high precision monitoring of deformations with a long term perspective using terrestrial laser scanning technology. In order to solve the problem of a stable reference system and to assure the high quality of possible position changes of point clouds, scanning is integrated with two complementary surveying techniques, i.e., high quality static GNSS positioning and precise tacheometry. The case study object where the proposed methodology was tested is a high pressure underground pipeline situated in an area which is geologically unstable. PMID:22303152

Dissemination Bias in Systematic Reviews of Animal Research: A Systematic Review

PubMed Central

Mueller, Katharina F.; Briel, Matthias; Strech, Daniel; Meerpohl, Joerg J.; Lang, Britta; Motschall, Edith; Gloy, Viktoria; Lamontagne, Francois; Bassler, Dirk

2014-01-01

Background Systematic reviews of preclinical studies, in vivo animal experiments in particular, can influence clinical research and thus even clinical care. Dissemination bias, selective dissemination of positive or significant results, is one of the major threats to validity in systematic reviews also in the realm of animal studies. We conducted a systematic review to determine the number of published systematic reviews of animal studies until present, to investigate their methodological features especially with respect to assessment of dissemination bias, and to investigate the citation of preclinical systematic reviews on clinical research. Methods Eligible studies for this systematic review constitute systematic reviews that summarize in vivo animal experiments whose results could be interpreted as applicable to clinical care. We systematically searched Ovid Medline, Embase, ToxNet, and ScienceDirect from 1st January 2009 to 9th January 2013 for eligible systematic reviews without language restrictions. Furthermore we included articles from two previous systematic reviews by Peters et al. and Korevaar et al. Results The literature search and screening process resulted in 512 included full text articles. We found an increasing number of published preclinical systematic reviews over time. The methodological quality of preclinical systematic reviews was low. The majority of preclinical systematic reviews did not assess methodological quality of the included studies (71%), nor did they assess heterogeneity (81%) or dissemination bias (87%). Statistics quantifying the importance of clinical research citing systematic reviews of animal studies showed that clinical studies referred to the preclinical research mainly to justify their study or a future study (76%). Discussion Preclinical systematic reviews may have an influence on clinical research but their methodological quality frequently remains low. Therefore, systematic reviews of animal research should be critically appraised before translating them to a clinical context. PMID:25541734

The relationship between ground conditions and injury: what level of evidence do we have?

PubMed

Petrass, Lauren A; Twomey, Dara M

2013-03-01

To identify studies which address the relationship between ground conditions and injury, in a sporting context and to evaluate current practice and provide recommendations for future studies that measure ground conditions and injury risk. Systematic review. A comprehensive search of electronic databases from the earliest records available until the end of 2011, and supplemental hand searching was conducted to identify relevant studies. A classification scale was used to rate the methodological quality of studies. 79 potentially relevant articles were identified, and 27 met all inclusion criteria. They varied in methodological quality, with analytical observational studies the most common design, although four descriptive observational studies, considered to be of lower quality were also identified. Only five studies objectively measured ground conditions, and of studies that used subjective assessment, only one provided descriptors to explain their classifications. It appears that harder/drier grounds are associated with an increased injury risk but the presence of major limitations necessitates cautious interpretation of many key findings. There is limited high quality evidence of the relationship between injury risk and ground conditions. Further research with high quality designs, and measurement of ground conditions are required to draw more definitive conclusions regarding this relationship. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.

Lessons Learned From Methodological Validation Research in E-Epidemiology.

PubMed

Kesse-Guyot, Emmanuelle; Assmann, Karen; Andreeva, Valentina; Castetbon, Katia; Méjean, Caroline; Touvier, Mathilde; Salanave, Benoît; Deschamps, Valérie; Péneau, Sandrine; Fezeu, Léopold; Julia, Chantal; Allès, Benjamin; Galan, Pilar; Hercberg, Serge

2016-10-18

Traditional epidemiological research methods exhibit limitations leading to high logistics, human, and financial burden. The continued development of innovative digital tools has the potential to overcome many of the existing methodological issues. Nonetheless, Web-based studies remain relatively uncommon, partly due to persistent concerns about validity and generalizability. The objective of this viewpoint is to summarize findings from methodological studies carried out in the NutriNet-Santé study, a French Web-based cohort study. On the basis of the previous findings from the NutriNet-Santé e-cohort (>150,000 participants are currently included), we synthesized e-epidemiological knowledge on sample representativeness, advantageous recruitment strategies, and data quality. Overall, the reported findings support the usefulness of Web-based studies in overcoming common methodological deficiencies in epidemiological research, in particular with regard to data quality (eg, the concordance for body mass index [BMI] classification was 93%), reduced social desirability bias, and access to a wide range of participant profiles, including the hard-to-reach subgroups such as young (12.30% [15,118/122,912], <25 years) and old people (6.60% [8112/122,912], ≥65 years), unemployed or homemaker (12.60% [15,487/122,912]), and low educated (38.50% [47,312/122,912]) people. However, some selection bias remained (78.00% (95,871/122,912) of the participants were women, and 61.50% (75,590/122,912) had postsecondary education), which is an inherent aspect of cohort study inclusion; other specific types of bias may also have occurred. Given the rapidly growing access to the Internet across social strata, the recruitment of participants with diverse socioeconomic profiles and health risk exposures was highly feasible. Continued efforts concerning the identification of specific biases in e-cohorts and the collection of comprehensive and valid data are still needed. This summary of methodological findings from the NutriNet-Santé cohort may help researchers in the development of the next generation of high-quality Web-based epidemiological studies.

Quality Measurement Recommendations Relevant to Clinical Guidelines in Germany and the United Kingdom: (What) Can We Learn From Each Other?

PubMed Central

Petzold, Thomas; Deckert, Stefanie; Williamson, Paula R.; Schmitt, Jochen

2018-01-01

We conducted a systematic review of clinical guidelines (CGs) to examine the methodological approaches of quality indicator derivation in CGs, the frequency of quality indicators to check CG recommendations in routine care, and clinimetric properties of quality indicators. We analyzed the publicly available CG databases of the Association of the Scientific Medical Societies in Germany (AWMF) and National Institute for Health and Care Excellence (NICE). Data on the methodology of subsequent quality indicator derivation, the content and definition of recommended quality indicators, and clinimetric properties of measurement instruments were extracted. In Germany, no explicit methodological guidance exists, but 3 different approaches are used. For NICE, a general approach is used for the derivation of quality indicators out of quality standards. Quality indicators were defined in 34 out of 87 CGs (39%) in Germany and for 58 out of 133 (43%) NICE CGs. Statements regarding measurement properties of instruments for quality indicator assessment were missing in German and NICE documents. Thirteen pairs of CGs (32%) have associated quality indicators. Thirty-four quality indicators refer to the same aspect of the quality of care, which corresponds to 27% of the German and 7% of NICE quality indicators. The development of a standardized and internationally accepted methodology for the derivation of quality indicators relevant to CGs is needed to measure and compare quality of care in health care systems. PMID:29591538

Choosing Wisely: assessment of current US top five list recommendations’ trustworthiness using a pragmatic approach

PubMed Central

Horvath, Karl; Semlitsch, Thomas; Jeitler, Klaus; Abuzahra, Muna E; Posch, Nicole; Domke, Andreas; Siebenhofer, Andrea

2016-01-01

Objectives Identification of sufficiently trustworthy top 5 list recommendations from the US Choosing Wisely campaign. Setting Not applicable. Participants All top 5 list recommendations available from the American Board of Internal Medicine Foundation website. Main outcome measures/interventions Compilation of US top 5 lists and search for current German highly trustworthy (S3) guidelines. Extraction of guideline recommendations, including grade of recommendation (GoR), for suggestions comparable to top 5 list recommendations. For recommendations without guideline equivalents, the methodological quality of the top 5 list development process was assessed using criteria similar to that used to judge guidelines, and relevant meta-literature was identified in cited references. Judgement of sufficient trustworthiness of top 5 list recommendations was based either on an ‘A’ GoR of guideline equivalents or on high methodological quality and citation of relevant meta-literature. Results 412 top 5 list recommendations were identified. For 75 (18%), equivalents were found in current German S3 guidelines. 44 of these recommendations were associated with an ‘A’ GoR, or a strong recommendation based on strong evidence, and 26 had a ‘B’ or a ‘C’ GoR. No GoR was provided for 5 recommendations. 337 recommendations had no equivalent in the German S3 guidelines. The methodological quality of the development process was high and relevant meta-literature was cited for 87 top 5 list recommendations. For a further 36, either the methodological quality was high without any meta-literature citations or meta-literature citations existed but the methodological quality was lacking. For the remaining 214 recommendations, either the methodological quality was lacking and no literature was cited or the methodological quality was generally unsatisfactory. Conclusions 131 of current US top 5 list recommendations were found to be sufficiently trustworthy. For a substantial number of current US top 5 list recommendations, their trustworthiness remains unclear. Methodological requirements for developing top 5 lists are recommended. PMID:27855098

HOLA: Human-like Orthogonal Network Layout.

PubMed

Kieffer, Steve; Dwyer, Tim; Marriott, Kim; Wybrow, Michael

2016-01-01

Over the last 50 years a wide variety of automatic network layout algorithms have been developed. Some are fast heuristic techniques suitable for networks with hundreds of thousands of nodes while others are multi-stage frameworks for higher-quality layout of smaller networks. However, despite decades of research currently no algorithm produces layout of comparable quality to that of a human. We give a new "human-centred" methodology for automatic network layout algorithm design that is intended to overcome this deficiency. User studies are first used to identify the aesthetic criteria algorithms should encode, then an algorithm is developed that is informed by these criteria and finally, a follow-up study evaluates the algorithm output. We have used this new methodology to develop an automatic orthogonal network layout method, HOLA, that achieves measurably better (by user study) layout than the best available orthogonal layout algorithm and which produces layouts of comparable quality to those produced by hand.

Quality and rigor of the concept mapping methodology: a pooled study analysis.

PubMed

Rosas, Scott R; Kane, Mary

2012-05-01

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed. Copyright © 2011 Elsevier Ltd. All rights reserved.

[Reevaluation of the methodological quality in meta-analyses of accelerated rehabilitation on recovery after surgery for colorectal cancer].

PubMed

Ding, S N; Pan, H Y; Zhang, J G

2017-03-14

Objective: To evaluate the methodological quality and impacts on outcomes for systematic reviews (SRs) of accelerated rehabilitation versus traditional control for colorectal surgery. Methods: We comprehensively searched six databases and additional websites to collect SRs, or meta-analysis from inception to July 2016. The Overview Quality Assessment Questionnaire (OQAQ) was applied for quality assessment of the included studies, the tools recommended by the Cochrane Collaboration was applied for quality assessment for RCT and CCT and the Newcastle-Ottawa Scale (NOS) was applied to assess observational study. The relative ratios (RRs) and 95% confidence intervals (CIs) were integrated using Review Manager 5.3 software. Results: Fourteen meta-analyses were included in total. The mean OQAQ score was 3.8 with 95% CI 3.2 to 4.3. Only three meta-analyses were assessed as good quality. Two studies misused statistical models. A total of 42 primary studies referenced by meta-analyses were included, of which, 25 RCTs were levelled grade B and 1 CCT was levelled grade C. An estimated mean NOS score of 16 observation studies was 6.75 (totally scored 9 with 95% CI 6.4 to 7.1), of which, 10 studies scored ≥7 were high quality, 6 studies scored 6 were moderate quality. Conclusions: Currently, the overall quality of meta-analyses about comparing the effects and safety between accelerated rehabilitation and traditional control for colorectal surgery is fairly poor and the evidence level is lower. Health providers should apply the evidence with caution in clinical practice.

Methodological quality of guidelines in gastroenterology.

PubMed

Malheiro, Rui; de Monteiro-Soares, Matilde; Hassan, Cesare; Dinis-Ribeiro, Mário

2014-06-01

Clinical guidelines are a common feature in modern endoscopy practice and they are being produced faster than ever. However, their methodological quality is rarely assessed. This study evaluated the methodological quality of current clinical guidelines in the field of gastroenterology, with an emphasis on endoscopy. Practice guidelines published by the American College of Gastroenterology (ACG), American Gastroenterological Association (AGA), American Society for Gastrointestinal Endoscopy (ASGE), European Society of Gastrointestinal Endoscopy (ESGE), British Society of Gastroenterology (BSG), National Institute for Health and Care Excellence (NICE), and the Scottish Intercollegiate Guidelines Network (SIGN) were searched between September and October 2012 and evaluated using the AGREE II (Appraisal of Guidelines for Research and Evaluation) instrument (23 items, scores 1 - 7 for each item; higher scores mean better quality). A total of 100 guidelines were assessed. The mean number of items scoring 6 or 7 per guideline was 9.2 (out of 23 items). Overall, 99 % of guidelines failed to include the target population in the development process, and 96 % did not report facilitators and barriers to guideline application. In addition, 86 % did not include advice or tools, and 94 % did not present monitoring or auditing criteria. The global methodological quality of clinical guidelines in the field of gastroenterology is poor, particularly regarding involvement of the target population in the development of guidelines and in the provision of clear suggestions to practitioners. © Georg Thieme Verlag KG Stuttgart · New York.

Effectiveness of physical therapy interventions for children with cerebral palsy: A systematic review

PubMed Central

Anttila, Heidi; Autti-Rämö, Ilona; Suoranta, Jutta; Mäkelä, Marjukka; Malmivaara, Antti

2008-01-01

Background To assess the effectiveness of physical therapy (PT) interventions on functioning in children with cerebral palsy (CP). Methods A search was made in Medline, Cinahl, PEDro and the Cochrane library for the period 1990 to February 2007. Only randomized controlled trials (RCTs) on PT interventions in children with diagnosed CP were included. Two reviewers independently assessed the methodological quality and extracted the data. The outcomes measured in the trials were classified using the International Classification of Functioning, Disability and Health (ICF). Results Twenty-two trials were identified. Eight intervention categories were distinguished. Four trials were of high methodological quality. Moderate evidence of effectiveness was established for two intervention categories: effectiveness of upper extremity treatments on attained goals and active supination, and of prehensile hand treatment and neurodevelopmental therapy (NDT) or NDT twice a week on developmental status, and of constraint-induced therapy on amount and quality of hand use. Moderate evidence of ineffectiveness was found of strength training on walking speed and stride length. Conflicting evidence was found for strength training on gross motor function. For the other intervention categories the evidence was limited due to low methodological quality and the statistically insignificant results of the studies. Conclusion Due to limitations in methodological quality and variations in population, interventions and outcomes, mostly limited evidence on the effectiveness of most PT interventions is available through RCTs. Moderate evidence was found for some effectiveness of upper extremity training. Well-designed trials are needed especially for focused PT interventions. PMID:18435840

Rating the methodological quality of single-subject designs and n-of-1 trials: introducing the Single-Case Experimental Design (SCED) Scale.

PubMed

Tate, Robyn L; McDonald, Skye; Perdices, Michael; Togher, Leanne; Schultz, Regina; Savage, Sharon

2008-08-01

Rating scales that assess methodological quality of clinical trials provide a means to critically appraise the literature. Scales are currently available to rate randomised and non-randomised controlled trials, but there are none that assess single-subject designs. The Single-Case Experimental Design (SCED) Scale was developed for this purpose and evaluated for reliability. Six clinical researchers who were trained and experienced in rating methodological quality of clinical trials developed the scale and participated in reliability studies. The SCED Scale is an 11-item rating scale for single-subject designs, of which 10 items are used to assess methodological quality and use of statistical analysis. The scale was developed and refined over a 3-year period. Content validity was addressed by identifying items to reduce the main sources of bias in single-case methodology as stipulated by authorities in the field, which were empirically tested against 85 published reports. Inter-rater reliability was assessed using a random sample of 20/312 single-subject reports archived in the Psychological Database of Brain Impairment Treatment Efficacy (PsycBITE). Inter-rater reliability for the total score was excellent, both for individual raters (overall ICC = 0.84; 95% confidence interval 0.73-0.92) and for consensus ratings between pairs of raters (overall ICC = 0.88; 95% confidence interval 0.78-0.95). Item reliability was fair to excellent for consensus ratings between pairs of raters (range k = 0.48 to 1.00). The results were replicated with two independent novice raters who were trained in the use of the scale (ICC = 0.88, 95% confidence interval 0.73-0.95). The SCED Scale thus provides a brief and valid evaluation of methodological quality of single-subject designs, with the total score demonstrating excellent inter-rater reliability using both individual and consensus ratings. Items from the scale can also be used as a checklist in the design, reporting and critical appraisal of single-subject designs, thereby assisting to improve standards of single-case methodology.

Development of Innovative Business Model of Modern Manager's Qualities

ERIC Educational Resources Information Center

Yashkova, Elena V.; Sineva, Nadezda L.; Shkunova, Angelika A.; Bystrova, Natalia V.; Smirnova, Zhanna V.; Kolosova, Tatyana V.

2016-01-01

The paper defines a complex of manager's qualities based on theoretical and methodological analysis and synthesis methods, available national and world literature, research papers and publications. The complex approach methodology was used, which provides an innovative view of the development of modern manager's qualities. The methodological…

Prevalence of self-medication in the adult population of Brazil: a systematic review

PubMed Central

Domingues, Paulo Henrique Faria; Galvão, Taís Freire; de Andrade, Keitty Regina Cordeiro; de Sá, Pedro Terra Teles; Silva, Marcus Tolentino; Pereira, Mauricio Gomes

2015-01-01

OBJECTIVE To evaluate the prevalence of self-medication in Brazil’s adult population. METHODS Systematic review of cross-sectional population-based studies. The following databases were used: Medline, Embase, Scopus, ISI, CINAHL, Cochrane Library, CRD, Lilacs, SciELO, the Banco de teses brasileiras (Brazilian theses database) (Capes) and files from the Portal Domínio Público (Brazilian Public Domain). In addition, the reference lists from relevant studies were examined to identify potentially eligible articles. There were no applied restrictions in terms of the publication date, language or publication status. Data related to publication, population, methods and prevalence of self-medication were extracted by three independent researchers. Methodological quality was assessed following eight criteria related to sampling, measurement and presentation of results. The prevalences were measured from participants who used at least one medication during the recall period of the studies. RESULTS The literature screening identified 2,778 records, from which 12 were included for analysis. Most studies were conducted in the Southeastern region of Brazil, after 2000 and with a 15-day recall period. Only five studies achieved high methodological quality, of which one study had a 7-day recall period, in which the prevalence of self-medication was 22.9% (95%CI 14.6;33.9). The prevalence of self-medication in three studies of high methodological quality with a 15-day recall period was 35.0% (95%CI 29.0;40.0, I2 = 83.9%) in the adult Brazilian population. CONCLUSIONS Despite differences in the methodologies of the included studies, the results of this systematic review indicate that a significant proportion of the adult Brazilian population self-medicates. It is suggested that future research projects that assess self-medication in Brazil standardize their methods. PMID:26083944

Quality of life and related concepts in Parkinson's disease: a systematic review.

PubMed

Den Oudsten, Brenda L; Van Heck, Guus L; De Vries, Jolanda

2007-08-15

Several studies have investigated the quality of life (QOL) of patients with Parkinson's disease (PD). The purpose of this study was to review the conceptual and methodological quality of quality of life (QOL) studies among patients with PD and to identify factors associated with poor (HR)QOL. Computerized bibliographic databases were screened for publications from 1960 to January 2007. According to a list of predefined criteria, the methodological quality of the 61 studies, was moderate. The term 'QOL' was often used inappropriately. In fact, almost all studies in this review actually assessed health status (HS) instead of QOL. The functioning of patients with PD on physical, social, and emotional domains is affected by PD. Their HS seems to be lower when compared to healthy persons or patients with other chronic diseases. HS studies augment the insight in self-perceived functioning. Therefore, HS is conceived as a valuable construct. However, QOL is also an important factor in health care. Attention towards QOL is needed in order to draw valid conclusions regarding a person's subjective experience of well-being in a broad sense. In order to accomplish this, future studies should apply the QOL concept with more rigor, should use an adequate operational definition, and should employ sound measures. Copyright (c) 2007 Movement Disorder Society.

Association between body composition and disease activity in rheumatoid arthritis. A systematic review.

PubMed

Alvarez-Nemegyei, José; Buenfil-Rello, Fátima Annai; Pacheco-Pantoja, Elda Leonor

2016-01-01

Reports regarding the association between body composition and inflammatory activity in rheumatoid arthritis (RA) have consistently yielded contradictory results. To perform a systematic review on the association between overweight/obesity and inflammatory activity in RA. FAST approach: Article search (Medline, EBSCO, Cochrane Library), followed by abstract retrieval, full text review and blinded assessment of methodological quality for final inclusion. Because of marked heterogeneity in statistical approach and RA activity assessment method, a meta-analysis could not be done. Results are presented as qualitative synthesis. One hundred and nineteen reports were found, 16 of them qualified for full text review. Eleven studies (8,147 patients; n range: 37-5,161) approved the methodological quality filter and were finally included. Interobserver agreement for methodological quality score (ICC: 0.93; 95% CI: 0.82-0.98; P<.001) and inclusion/rejection decision (k 1.00, P>.001) was excellent. In all reports body composition was assessed by BMI; however a marked heterogeneity was found in the method used for RA activity assessment. A significant association between BMI and RA activity was found in 6 reports having larger mean sample size: 1,274 (range: 140-5,161). On the other hand, this association was not found in 5 studies having lower mean sample size: 100 (range: 7-150). The modulation of RA clinical status by body fat mass is suggested because a significant association was found between BMI and inflammatory activity in those reports with a trend toward higher statistical power. The relationship between body composition and clinical activity in RA requires be approached with further studies with higher methodological quality. Copyright © 2015 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

A quality evaluation methodology of health web-pages for non-professionals.

PubMed

Currò, Vincenzo; Buonuomo, Paola Sabrina; Onesimo, Roberta; de Rose, Paola; Vituzzi, Andrea; di Tanna, Gian Luca; D'Atri, Alessandro

2004-06-01

The proposal of an evaluation methodology for determining the quality of healthcare web sites for the dissemination of medical information to non-professionals. Three (macro) factors are considered for the quality evaluation: medical contents, accountability of the authors, and usability of the web site. Starting from two results in the literature the problem of whether or not to introduce a weighting function has been investigated. This methodology has been validated on a specialized information content, i.e., sore throats, due to the large interest such a topic enjoys with target users. The World Wide Web was accessed using a meta-search system merging several search engines. A statistical analysis was made to compare the proposed methodology with the obtained ranks of the sample web pages. The statistical analysis confirms that the variables examined (per item and sub factor) show substantially similar ranks and are capable of contributing to the evaluation of the main quality macro factors. A comparison between the aggregation functions in the proposed methodology (non-weighted averages) and the weighting functions, derived from the literature, allowed us to verify the suitability of the method. The proposed methodology suggests a simple approach which can quickly award an overall quality score for medical web sites oriented to non-professionals.

Perceptions of International Students on Service Quality Delivery in a Malaysian Public University

ERIC Educational Resources Information Center

Njie, Baboucarr; Asimiran, Soaib; Baki, Roselan

2012-01-01

Purpose: The purpose of this study is to explore the perceptions of international students of service quality delivery (SQD) in a Malaysian public university. Design/methodology/approach: The study was limited to the University's immediate physical environment and its associated human and systems-based services. The physical environment in this…

A Review of Singapore Principals' Leadership Qualities, Styles, and Roles

ERIC Educational Resources Information Center

Ng, David Foo Seong; Nguyen, Dong Thanh; Wong, Benjamin Koon Siak; Choy, William Kim Weng

2015-01-01

Purpose: The purpose of this paper is to present a review of empirical studies on principal leadership in Singapore. It seeks to provide a general picture of Singapore principals' leadership qualities, styles, and roles. Design/methodology/approach: This is a systematic review of empirical studies, using a "bounded" approach with a focus…

Total Quality Management Practices in Turkish Primary Schools

ERIC Educational Resources Information Center

Toremen, Fatih; Karakus, Mehmet; Yasan, Tezcan

2009-01-01

Purpose: The purpose of this paper is to determine the extent of total quality management (TQM) practices in primary schools based on teachers' perceptions, and how their perceptions are related to different variables. Design/methodology/approach: In this study, a survey based descriptive scanning model was used. This study was carried out in…

Managing the Quality of Cross-Border Higher Education in Zimbabwe

ERIC Educational Resources Information Center

Garwe, Evelyn Chiyevo

2015-01-01

A study on investigating the issues of quality associated with cross-border higher education was carried out using the case study approach focusing on Zimbabwe. The methodology involved document analysis of the cases of regulation and accreditation of cross-border higher education providers and assessment of qualifications acquired from foreign…

Development of Chemical Engineering Course Methods Using Action Research: Case Study

ERIC Educational Resources Information Center

Virkki-Hatakka, Terhi; Tuunila, Ritva; Nurkka, Niina

2013-01-01

This paper reports on the systematic development of a teaching methodology for two chemical engineering courses. The aim was to improve the quality of teaching to achieve expected learning outcomes more effectively. The development was carried out over a period of several years based on an action research methodology with data systematically…

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

Quality of meta-analyses in major leading gastroenterology and hepatology journals: A systematic review.

PubMed

Liu, Pengfei; Qiu, Yuanyu; Qian, Yuting; Chen, Xiao; Wang, Yiran; Cui, Jin; Zhai, Xiao

2017-01-01

To appraise the current reporting methodological quality of meta-analyses in five leading gastroenterology and hepatology journals, and to identify the variables associated with the reporting quality. We systematically searched the literature of meta-analyses in Gastroenterology, Gut, Hepatology, Journal of Hepatology (J HEPATOL) and American Journal of Gastroenterology (AM J GASTROENTEROL) from 2006 to 2008 and from 2012 to 2014. Characteristics were extracted based on the PRISMA statement and the AMSTAR tool. Country, number of patients, funding source were also revealed and descriptively reported. A total of 127 meta-analyses were enrolled in this study and were compared among journals, study years, and other characters. Compliances with the PRISMA statement and the AMSTAR checklist were 20.8 ± 4.2 out of a maximum of 27 and 7.6 ± 2.4 out of a maximum of 11, respectively. Some domains were poorly reported including describing a protocol and/or registration (item 5, 0.0%), describing methods, and giving results of additional analyses (item 16, 45.7% and item 23, 48.0%) for PRISMA and duplicating study selection and data extraction (item 2, 53.5%), and providing a list of included and excluded studies (item 5, 14.2%) for AMSTAR. Publication in recent years showed a significantly better methodological quality than those published in previous years. This study shows that methodological reporting quality of MAs in the major gastroenterology and hepatology journals has improved in recent years after the publication of the developed PRISMA statement, and it can be further improved. © 2016 Journal of Gastroenterology and Hepatology Foundation and John Wiley & Sons Australia, Ltd.

Nonlinear Flying Qualities Criteria for Large-Amplitude Maneuvers

DTIC Science & Technology

1984-12-01

theory which are pertinent to the formation of a nonlinear flying qualities methodology. This report surveys nonlinear system theory and describes...the development of an applied flying qualities methodology based on a canonical system theory and using research in relative controllability...The Nonlinear Flying Qualities (NFQ) for Large-Amplitude Maneuvers Program examined promising techniques from nonlinear analysis and nonlinear system

Economic Evaluation of Obesity Prevention in Early Childhood: Methods, Limitations and Recommendations.

PubMed

Döring, Nora; Mayer, Susanne; Rasmussen, Finn; Sonntag, Diana

2016-09-13

Despite methodological advances in the field of economic evaluations of interventions, economic evaluations of obesity prevention programmes in early childhood are seldom conducted. The aim of the present study was to explore existing methods and applications of economic evaluations, examining their limitations and making recommendations for future cost-effectiveness assessments. A systematic literature search was conducted using PubMed, Cochrane Library, the British National Health Service Economic Evaluation Databases and EconLit. Eligible studies included trial-based or simulation-based cost-effectiveness analyses of obesity prevention programmes targeting preschool children and/or their parents. The quality of included studies was assessed. Of the six studies included, five were intervention studies and one was based on a simulation approach conducted on secondary data. We identified three main conceptual and methodological limitations of their economic evaluations: Insufficient conceptual approach considering the complexity of childhood obesity, inadequate measurement of effects of interventions, and lack of valid instruments to measure child-related quality of life and costs. Despite the need for economic evaluations of obesity prevention programmes in early childhood, only a few studies of varying quality have been conducted. Moreover, due to methodological and conceptual weaknesses, they offer only limited information for policy makers and intervention providers. We elaborate reasons for the limitations of these studies and offer guidance for designing better economic evaluations of early obesity prevention.

Economic Evaluation of Obesity Prevention in Early Childhood: Methods, Limitations and Recommendations

PubMed Central

Döring, Nora; Mayer, Susanne; Rasmussen, Finn; Sonntag, Diana

2016-01-01

Despite methodological advances in the field of economic evaluations of interventions, economic evaluations of obesity prevention programmes in early childhood are seldom conducted. The aim of the present study was to explore existing methods and applications of economic evaluations, examining their limitations and making recommendations for future cost-effectiveness assessments. A systematic literature search was conducted using PubMed, Cochrane Library, the British National Health Service Economic Evaluation Databases and EconLit. Eligible studies included trial-based or simulation-based cost-effectiveness analyses of obesity prevention programmes targeting preschool children and/or their parents. The quality of included studies was assessed. Of the six studies included, five were intervention studies and one was based on a simulation approach conducted on secondary data. We identified three main conceptual and methodological limitations of their economic evaluations: Insufficient conceptual approach considering the complexity of childhood obesity, inadequate measurement of effects of interventions, and lack of valid instruments to measure child-related quality of life and costs. Despite the need for economic evaluations of obesity prevention programmes in early childhood, only a few studies of varying quality have been conducted. Moreover, due to methodological and conceptual weaknesses, they offer only limited information for policy makers and intervention providers. We elaborate reasons for the limitations of these studies and offer guidance for designing better economic evaluations of early obesity prevention. PMID:27649218

Bone mass improved effect of icariin for postmenopausal osteoporosis in ovariectomy-induced rats: a meta-analysis and systematic review.

PubMed

Xu, Jin-Hai; Yao, Min; Ye, Jie; Wang, Guo-Dong; Wang, Jing; Cui, Xue-Jun; Mo, Wen

2016-10-01

Ovariectomy (OVX)-induced rats are the most frequently used animal model to research postmenopausal osteoporosis. Our objective was to summarize and critically assess the bone mass improved effect of icariin (ICA) for treatment of postmenopausal osteoporosis in an OVX-induced rat model. The PUBMED, EMBASE, and Chinese databases were searched from their inception date to February 2015. Two reviewers independently selected animal studies that evaluated the bone mass improved effect of ICA compared with control in OVX-induced rats. Extracted data were analyzed by RevMan statistical software, and the methodological quality of each study was assessed. Seven studies with adequate randomization were included in the systematic review. Overall, ICA seemed to significantly improve bone mass as assessed using the bone mineral density (seven studies, n = 169; weighted mean difference, 0.02; 95% CI, 0.01-0.02, I = 77%, P < 0.00001) using a random-effects model. There is no significant difference between ICA and estrogen (E) (six studies, n = 128; weighted mean difference, 0.00; 95% CI, -0.00 to 0.01, I = 54%, P = 0.01). Bone mass improved effect of ICA for postmenopausal osteoporosis was observed in OVX-induced rats. Assessment of the methodological quality of studies involving OVX-induced animal models is required, and good methodological quality should be valued in systematic reviews of animal studies.

Development and Field Test of an Audit Tool and Tracer Methodology for Clinician Assessment of Quality in End-of-Life Care.

PubMed

Bookbinder, Marilyn; Hugodot, Amandine; Freeman, Katherine; Homel, Peter; Santiago, Elisabeth; Riggs, Alexa; Gavin, Maggie; Chu, Alice; Brady, Ellen; Lesage, Pauline; Portenoy, Russell K

2018-02-01

Quality improvement in end-of-life care generally acquires data from charts or caregivers. "Tracer" methodology, which assesses real-time information from multiple sources, may provide complementary information. The objective of this study was to develop a valid brief audit tool that can guide assessment and rate care when used in a clinician tracer to evaluate the quality of care for the dying patient. To identify items for a brief audit tool, 248 items were created to evaluate overall quality, quality in specific content areas (e.g., symptom management), and specific practices. Collected into three instruments, these items were used to interview professional caregivers and evaluate the charts of hospitalized patients who died. Evidence that this information could be validly captured using a small number of items was obtained through factor analyses, canonical correlations, and group comparisons. A nurse manager field tested tracer methodology using candidate items to evaluate the care provided to other patients who died. The survey of 145 deaths provided chart data and data from 445 interviews (26 physicians, 108 nurses, 18 social workers, and nine chaplains). The analyses yielded evidence of construct validity for a small number of items, demonstrating significant correlations between these items and content areas identified as latent variables in factor analyses. Criterion validity was suggested by significant differences in the ratings on these items between the palliative care unit and other units. The field test evaluated 127 deaths, demonstrated the feasibility of tracer methodology, and informed reworking of the candidate items into the 14-item Tracer EoLC v1. The Tracer EoLC v1 can be used with tracer methodology to guide the assessment and rate the quality of end-of-life care. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Does updating improve the methodological and reporting quality of systematic reviews?

PubMed

Shea, Beverley; Boers, Maarten; Grimshaw, Jeremy M; Hamel, Candyce; Bouter, Lex M

2006-06-13

Systematic reviews (SRs) must be of high quality. The purpose of our research was to compare the methodological and reporting quality of original versus updated Cochrane SRs to determine whether updating had improved these two quality dimensions. We identified updated Cochrane SRs published in issue 4, 2002 of the Cochrane Library. We assessed the updated and original versions of the SRs using two instruments: the 10 item enhanced Overview Quality Assessment Questionnaire (OQAQ), and an 18-item reporting quality checklist and flow chart based upon the Quality of Reporting of Meta-analyses (QUOROM) statement. At least two reviewers extracted data and assessed quality. We calculated the percentage (with a 95% confidence interval) of 'yes' answers to each question. We calculated mean differences in percentage, 95% confidence intervals and p-values for each of the individual items and the overall methodological quality score of the updated and pre-updated versions using OQAQ. We assessed 53 SRs. There was no significant improvement in the global quality score of the OQAQ (mean difference 0.11 (-0.28; 0.70 p = 0.52)). Updated reviews showed a significant improvement of 18.9 (7.2; 30.6 p < .01) on the OQAQ item assessing whether the conclusions drawn by the author(s) were supported by the data and/or analysis presented in the SR. The QUOROM statement showed that the quality of reporting of Cochrane reviews improved in some areas with updating. Improvements were seen on the items relating to data sources reported in the abstract, with a significant difference of 17.0 (9.8; 28.7 p = 0.01), review methods, reported in the abstract 35 (24.1; 49.1 p = 0.00), searching methods 18.9 (9.7; 31.6 p = 0.01), and data abstraction 18.9 (11.7; 30.9 p = 0.00). The overall quality of Cochrane SRs is fair-to-good. Although reporting quality improved on certain individual items there was no overall improvement seen with updating and methodological quality remained unchanged. Further improvement of quality of reporting is possible. There is room for improvement of methodological quality as well. Authors updating reviews should address identified methodological or reporting weaknesses. We recommend to give full attention to both quality domains when updating SRs.

Which psychosocial factors are related to chelation adherence in thalassemia? A systematic review.

PubMed

Evangeli, Michael; Mughal, Kulsoom; Porter, John B

2010-06-01

Good adherence to iron chelation therapy in thalassemia is crucial. Although there is evidence that adherence is related to regimen factors, there has been less emphasis on the relationship between psychosocial (psychological, demographic and social) factors and adherence. We present a systematic review of psychosocial correlates of chelation adherence in thalassemia. Nine studies met the inclusion criteria. Information was extracted regarding the study characteristics and the relationship between psychosocial factors and chelation adherence. Methodological quality was rated. The studies took place in a range of countries, were mostly cross sectional in design, and examined adherence to deferoxamine (DFO) only. Sample sizes ranged from 15 to 1573. A variety of psychosocial variables were examined. Definitions of adherence varied between studies and non adherence rates were also variable (9 to 66%). Older age was consistently associated with lower levels of chelation adherence. There were few other consistent findings. The methodological quality of studies was variable. There is a need for more methodologically sophisticated and theoretically informed studies on psychosocial correlates of chelation adherence. We offer specific suggestions.

Systematic review of studies on measurement properties of instruments for adults published in the American Journal of Occupational Therapy, 2009-2013.

PubMed

Yuen, Hon K; Austin, Sarah L

2014-01-01

We describe the methodological quality of recent studies on instrument development and testing published in the American Journal of Occupational Therapy (AJOT). We conducted a systematic review using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist to appraise 48 articles on measurement properties of assessments for adults published in AJOT between 2009 and 2013. Most studies had adequate methodological quality in design and statistical analysis. Common methodological limitations included that methods used to examine internal consistency were not consistently linked to the theoretical constructs underpinning assessments; participants in some test-retest reliability studies were not stable during the interim period; and in several studies of reliability and convergent validity, sample sizes were inadequate. AJOT's dissemination of psychometric research evidence has made important contributions to moving the profession toward the American Occupational Therapy Association's Centennial Vision. This study's results provide a benchmark by which to evaluate future accomplishments. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Developing and executing quality improvement projects (concept, methods, and evaluation).

PubMed

Likosky, Donald S

2014-03-01

Continuous quality improvement, quality assurance, cycles of change--these words of often used to express the process of using data to inform and improve clinical care. Although many of us have been exposed to theories and practice of experimental work (e.g., randomized trial), few of us have been similarly exposed to the science underlying quality improvement. Through the lens of a single-center quality improvement study, this article exposes the reader to methodology for conducting such studies. The reader will gain an understanding of these methods required to embark on such a study.

Impact Evaluation of Quality Assurance in Higher Education: Methodology and Causal Designs

ERIC Educational Resources Information Center

Leiber, Theodor; Stensaker, Bjørn; Harvey, Lee

2015-01-01

In this paper, the theoretical perspectives and general methodological elements of impact evaluation of quality assurance in higher education institutions are discussed, which should be a cornerstone of quality development in higher education and contribute to improving the knowledge about the effectiveness (or ineffectiveness) of quality…

Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools

ERIC Educational Resources Information Center

Wendt, Oliver; Miller, Bridget

2012-01-01

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

Student Perceptions of Service Quality in a Multi-Campus Higher Education System in Spain

ERIC Educational Resources Information Center

Gallifa, Josep; Batalle, Pere

2010-01-01

Purpose: This paper aims to present an in-depth case study with student perceptions of service quality, discussing the relevance of these perceptions for the important issue of quality improvement in higher education. Design/methodology/approach: The paper presents institutional research carried out in a multi-campus system in Spain made up of…

Quality Assurance in Post-Secondary Education: The Student Experience

ERIC Educational Resources Information Center

Law, Dennis Chung Sea

2010-01-01

Purpose: A major focus of the recent research into the quality of post-secondary education is the centrality of the student experience. The purpose of this paper is to review the literature on studies addressing such a focus to shed light on how quality assurance (QA) practices can be improved. Design/methodology/approach: The paper reviews some…

How Do Management Students Perceive the Quality of Education in Public Institutions?

ERIC Educational Resources Information Center

Narang, Ritu

2012-01-01

Purpose: Keeping in mind the urgent need to deliver quality education in higher education institutes, the current paper seeks to measure the quality perception of management students in India. Design/methodology/approach: Based on an exploratory study a modified version of SERVQUAL was employed as the research instrument. Data were collected from…

Methodological Quality of Meta-Analyses: Matched-Pairs Comparison over Time and between Industry-Sponsored and Academic-Sponsored Reports

ERIC Educational Resources Information Center

Lane, Peter W.; Higgins, Julian P. T.; Anagnostelis, Betsy; Anzures-Cabrera, Judith; Baker, Nigel F.; Cappelleri, Joseph C.; Haughie, Scott; Hollis, Sally; Lewis, Steff C.; Moneuse, Patrick; Whitehead, Anne

2013-01-01

Context: Meta-analyses are regularly used to inform healthcare decisions. Concerns have been expressed about the quality of meta-analyses and, in particular, about those supported by the pharmaceutical industry. Objective: The objective of this study is to compare the quality of pharmaceutical-industry-supported meta-analyses with academic…

A Conceptual Framework to Help Evaluate the Quality of Institutional Performance

ERIC Educational Resources Information Center

Kettunen, Juha

2008-01-01

Purpose: This study aims to present a general conceptual framework which can be used to evaluate quality and institutional performance in higher education. Design/methodology/approach: The quality of higher education is at the heart of the setting up of the European Higher Education Area. Strategic management is widely used in higher education…

Applying Quality Indicators to Single-Case Research Designs Used in Special Education: A Systematic Review

ERIC Educational Resources Information Center

Moeller, Jeremy D.; Dattilo, John; Rusch, Frank

2015-01-01

This study examined how specific guidelines and heuristics have been used to identify methodological rigor associated with single-case research designs based on quality indicators developed by Horner et al. Specifically, this article describes how literature reviews have applied Horner et al.'s quality indicators and evidence-based criteria.…

Quality of reporting in oncology phase II trials: A 5-year assessment through systematic review.

PubMed

Langrand-Escure, Julien; Rivoirard, Romain; Oriol, Mathieu; Tinquaut, Fabien; Rancoule, Chloé; Chauvin, Frank; Magné, Nicolas; Bourmaud, Aurélie

2017-01-01

Phase II clinical trials are a cornerstone of the development in experimental treatments They work as a "filter" for phase III trials confirmation. Surprisingly the attrition ratio in Phase III trials in oncology is significantly higher than in any other medical specialty. This suggests phase II trials in oncology fail to achieve their goal. Objective The present study aims at estimating the quality of reporting in published oncology phase II clinical trials. A literature review was conducted among all phase II and phase II/III clinical trials published during a 5-year period (2010-2015). All articles electronically published by three randomly-selected oncology journals with Impact-Factors>4 were included: Journal of Clinical Oncology, Annals of Oncology and British Journal of Cancer. Quality of reporting was assessed using the Key Methodological Score. 557 articles were included. 315 trials were single-arm studies (56.6%), 193 (34.6%) were randomized and 49 (8.8%) were non-randomized multiple-arm studies. The Methodological Score was equal to 0 (lowest level), 1, 2, 3 (highest level) respectively for 22 (3.9%), 119 (21.4%), 270 (48.5%) and 146 (26.2%) articles. The primary end point is almost systematically reported (90.5%), while sample size calculation is missing in 66% of the articles. 3 variables were independently associated with reporting of a high standard: presence of statistical design (p-value <0.001), multicenter trial (p-value = 0.012), per-protocol analysis (p-value <0.001). Screening was mainly performed by a sole author. The Key Methodological Score was based on only 3 items, making grey zones difficult to translate. This literature review highlights the existence of gaps concerning the quality of reporting. It therefore raised the question of the suitability of the methodology as well as the quality of these trials, reporting being incomplete in the corresponding articles.

Ultrasound for assessing disease activity in IBD patients: a systematic review of activity scores.

PubMed

Bots, S; Nylund, K; Löwenberg, M; Gecse, K; Gilja, O H; D'Haens, G

2018-04-19

Ultrasound (US) indices for assessing disease activity in IBD patients have never been critically reviewed. We aimed to systematically review the quality and reliability of available ultrasound (US) indices compared with reference standards for grading disease activity in IBD patients. Pubmed, Embase and Medline were searched from 1990 until June 2017. Relevant publications were identified through full text review after initial screening by 2 investigators. Data on methodology and index characteristics were collected. Study quality was assessed with a modified version of the Quadas-2 tool for risk of bias assessment. Of 20 studies with an US index, 11 studies met the inclusion criteria. Out of these 11 studies, 7 and 4 studied CD and UC activity indices, respectively. Parameters that were used in these indices included bowel wall thickness (BWT), Doppler signal (DS), wall layer stratification (WLS), compressibility, peristalsis, haustrations, fatty wrapping, contrast enhancement (CE) and strain pattern. Study quality was graded high in 5 studies, moderate in 3 studies and low in 3 studies. Ileocolonoscopy was used as the reference standard in 9 studies. In 1 study a combined index of ileocolonoscopy and barium contrast radiography and in 1 study histology was used as the reference standard. Only 5 studies used an established endoscopic index for comparison with US. Several US indices for assessing disease activity in IBD are available; however the methodology for development was suboptimal in most studies. For the development of future indices stringent methodological design is required.

Association of journal quality indicators with methodological quality of clinical research articles.

PubMed

Lee, Kirby P; Schotland, Marieka; Bacchetti, Peter; Bero, Lisa A

2002-06-05

The ability to identify scientific journals that publish high-quality research would help clinicians, scientists, and health-policy analysts to select the most up-to-date medical literature to review. To assess whether journal characteristics of (1) peer-review status, (2) citation rate, (3) impact factor, (4) circulation, (5) manuscript acceptance rate, (6) MEDLINE indexing, and (7) Brandon/Hill Library List indexing are predictors of methodological quality of research articles, we conducted a cross-sectional study of 243 original research articles involving human subjects published in general internal medical journals. The mean (SD) quality score of the 243 articles was 1.37 (0.22). All journals reported a peer-review process and were indexed on MEDLINE. In models that controlled for article type (randomized controlled trial [RCT] or non-RCT), journal citation rate was the most statistically significant predictor (0.051 increase per doubling; 95% confidence interval [CI], 0.037-0.065; P<.001). In separate analyses by article type, acceptance rate was the strongest predictor for RCT quality (-0.113 per doubling; 95% CI, -0.148 to -0.078; P<.001), while journal citation rate was the most predictive factor for non-RCT quality (0.051 per doubling; 95% CI, 0.044-0.059; P<.001). High citation rates, impact factors, and circulation rates, and low manuscript acceptance rates and indexing on Brandon/Hill Library List appear to be predictive of higher methodological quality scores for journal articles.

Recommendations for research design and reporting in computer-assisted diagnosis to facilitate meta-analysis.

PubMed

Eadie, Leila H; Taylor, Paul; Gibson, Adam P

2012-04-01

Computer-assisted diagnosis (CAD) describes a diverse, heterogeneous range of applications rather than a single entity. The aims and functions of CAD systems vary considerably and comparing studies and systems is challenging due to methodological and design differences. In addition, poor study quality and reporting can reduce the value of some publications. Meta-analyses of CAD are therefore difficult and may not provide reliable conclusions. Aiming to determine the major sources of heterogeneity and thereby what CAD researchers could change to allow this sort of assessment, this study reviews a sample of 147 papers concerning CAD used with imaging for cancer diagnosis. It discusses sources of variability, including the goal of the CAD system, learning methodology, study population, design, outcome measures, inclusion of radiologists, and study quality. Based upon this evidence, recommendations are made to help researchers optimize the quality and comparability of their trial design and reporting. Copyright © 2011 Elsevier Inc. All rights reserved.

[Evaluation of the methodological quality of the Rémic (microbiology guidelines - bacteriology and mycology) of the Société française de microbiologie].

PubMed

Fonfrède, Michèle; Couaillac, Jean Paul; Augereau, Christine; De Moüy, Danny; Lepargneur, Jean Pierre; Szymanowicz, Anton; Watine, Joseph

2011-01-01

We have evaluated the methodological quality of the Rémic (microbiology guidelines - bacteriology and mycology) of the Société française de microbiologie (edition2007), using to AGREE criteria, which are consensual at an international level, in particular at the the World Health Organisation (WHO) and at the European Union. The methodological quality of the Rémic appears to be sub-optimal. These shortcomings in quality are mainly observed in AGREE domain n° 5 (applicability), in AGREE item n° 5 (patients' opinions were not considered), and in AGREE item n° 23 (conflicts of interest were not declared). The users of the Rémic must be aware of these few methodological shortcomings in order for them to be careful before they put its recommendation in practice. In conclusion, we advise the editors of the Rémic to insert at least a methodological chapter in their next edition.

Appraising the methodological quality of the clinical practice guideline for diabetes mellitus using the AGREE II instrument: a methodological evaluation.

PubMed

Radwan, Mahmoud; Akbari Sari, Ali; Rashidian, Arash; Takian, Amirhossein; Abou-Dagga, Sanaa; Elsous, Aymen

2017-02-01

To evaluate the methodological quality of the Palestinian Clinical Practice Guideline for Diabetes Mellitus using the Translated Arabic Version of the AGREE II. Methodological evaluation. A cross-cultural adaptation framework was followed to translate and develop a standardised Translated Arabic Version of the AGREE II. Palestinian Primary Healthcare Centres. Sixteen appraisers independently evaluated the Clinical Practice Guideline for Diabetes Mellitus using the Translated Arabic Version of the AGREE II. Methodological quality of diabetic guideline. The Translated Arabic Version of the AGREE II showed an acceptable reliability and validity. Internal consistency ranged between 0.67 and 0.88 (Cronbach's α). Intra-class coefficient among appraisers ranged between 0.56 and 0.88. The quality of this guideline is low. Both domains 'Scope and Purpose' and 'Clarity of Presentation' had the highest quality scores (66.7% and 61.5%, respectively), whereas the scores for 'Applicability', 'Stakeholder Involvement', 'Rigour of Development' and 'Editorial Independence' were the lowest (27%, 35%, 36.5%, and 40%, respectively). The findings suggest that the quality of this Clinical Practice Guideline is disappointingly low. To improve the quality of current and future guidelines, the AGREE II instrument is extremely recommended to be incorporated as a gold standard for developing, evaluating or updating the Palestinian Clinical Practice Guidelines. Future guidelines can be improved by setting specific strategies to overcome implementation barriers with respect to economic considerations, engaging of all relevant end-users and patients, ensuring a rigorous methodology for searching, selecting and synthesising the evidences and recommendations, and addressing potential conflict of interests within the development group.

The temporal structure of pollution levels in developed cities.

PubMed

Barrigón Morillas, Juan Miguel; Ortiz-Caraballo, Carmen; Prieto Gajardo, Carlos

2015-06-01

Currently, the need for mobility can cause significant pollution levels in cities, with important effects on health and quality of life. Any approach to the study of urban pollution and its effects requires an analysis of spatial distribution and temporal variability. It is a crucial dilemma to obtain proven methodologies that allow an increase in the quality of the prediction and the saving of resources in the spatial and temporal sampling. This work proposes a new analytical methodology in the study of temporal structure. As a result, a model for estimating annual levels of urban traffic noise was proposed. The average errors are less than one decibel in all acoustics indicators. A new working methodology of urban noise has begun. Additionally, a general application can be found for the study of the impacts of pollution associated with traffic, with implications for urban design and possibly in economic and sociological aspects. Copyright © 2015 Elsevier B.V. All rights reserved.

Lean interventions in healthcare: do they actually work? A systematic literature review

PubMed Central

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-01-01

Purpose Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. Data sources We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Study selection Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data extraction Data on design, methods, interventions and key outcomes were extracted and collated. Results of data synthesis Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. Conclusion While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. PMID:26811118

A systematic review of economic evaluations of treatments for patients with epilepsy.

PubMed

Wijnen, Ben F M; van Mastrigt, Ghislaine A P G; Evers, Silvia M A A; Gershuni, Olga; Lambrechts, Danielle A J E; Majoie, Marian H J M; Postulart, Debby; Aldenkamp, Bert A P; de Kinderen, Reina J A

2017-05-01

The increasing number of treatment options and the high costs associated with epilepsy have fostered the development of economic evaluations in epilepsy. It is important to examine the availability and quality of these economic evaluations and to identify potential research gaps. As well as looking at both pharmacologic (antiepileptic drugs [AEDs]) and nonpharmacologic (e.g., epilepsy surgery, ketogenic diet, vagus nerve stimulation) therapies, this review examines the methodologic quality of the full economic evaluations included. Literature search was performed in MEDLINE, EMBASE, NHS Economic Evaluation Database (NHS EED), Econlit, Web of Science, and CEA Registry. In addition, Cochrane Reviews, Cochrane DARE and Cochrane Health Technology Assessment Databases were used. To identify relevant studies, predefined clinical search strategies were combined with a search filter designed to identify health economic studies. Specific search strategies were devised for the following topics: (1) AEDs, (2) patients with cognitive deficits, (3) elderly patients, (4) epilepsy surgery, (5) ketogenic diet, (6) vagus nerve stimulation, and (7) treatment of (non)convulsive status epilepticus. A total of 40 publications were included in this review, 29 (73%) of which were articles about pharmacologic interventions. Mean quality score of all articles on the Consensus Health Economic Criteria (CHEC)-extended was 81.8%, the lowest quality score being 21.05%, whereas five studies had a score of 100%. Looking at the Consolidated Health Economic Evaluation Reporting Standards (CHEERS), the average quality score was 77.0%, the lowest being 22.7%, and four studies rated as 100%. There was a substantial difference in methodology in all included articles, which hampered the attempt to combine information meaningfully. Overall, the methodologic quality was acceptable; however, some studies performed significantly worse than others. The heterogeneity between the studies stresses the need to define a reference case (e.g., how should an economic evaluation within epilepsy be performed) and to derive consensus on what constitutes "standard optimal care." Wiley Periodicals, Inc. © 2017 International League Against Epilepsy.

Guidelines for reporting evaluations based on observational methodology.

PubMed

Portell, Mariona; Anguera, M Teresa; Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana

2015-01-01

Observational methodology is one of the most suitable research designs for evaluating fidelity of implementation, especially in complex interventions. However, the conduct and reporting of observational studies is hampered by the absence of specific guidelines, such as those that exist for other evaluation designs. This lack of specific guidance poses a threat to the quality and transparency of these studies and also constitutes a considerable publication hurdle. The aim of this study thus was to draw up a set of proposed guidelines for reporting evaluations based on observational methodology. The guidelines were developed by triangulating three sources of information: observational studies performed in different fields by experts in observational methodology, reporting guidelines for general studies and studies with similar designs to observational studies, and proposals from experts in observational methodology at scientific meetings. We produced a list of guidelines grouped into three domains: intervention and expected outcomes, methods, and results. The result is a useful, carefully crafted set of simple guidelines for conducting and reporting observational studies in the field of program evaluation.

Evaluation of AMSTAR to assess the methodological quality of systematic reviews in overviews of reviews of healthcare interventions.

PubMed

Pollock, Michelle; Fernandes, Ricardo M; Hartling, Lisa

2017-03-23

Overviews of reviews (overviews) compile information from multiple systematic reviews (SRs) to provide a single synthesis of relevant evidence for decision-making. It is recommended that authors assess and report the methodological quality of SRs in overviews-for example, using A MeaSurement Tool to Assess systematic Reviews (AMSTAR). Currently, there is variation in whether and how overview authors assess and report SR quality, and limited guidance is available. Our objectives were to: examine methodological considerations involved in using AMSTAR to assess the quality of Cochrane and non-Cochrane SRs in overviews of healthcare interventions; identify challenges (and develop potential decision rules) when using AMSTAR in overviews; and examine the potential impact of considering methodological quality when making inclusion decisions in overviews. We selected seven overviews of healthcare interventions and included all SRs meeting each overview's inclusion criteria. For each SR, two reviewers independently conducted AMSTAR assessments with consensus and discussed challenges encountered. We also examined the correlation between AMSTAR assessments and SR results/conclusions. Ninety-five SRs were included (30 Cochrane, 65 non-Cochrane). Mean AMSTAR assessments (9.6/11 vs. 5.5/11; p < 0.001) and inter-rater reliability (AC1 statistic: 0.84 vs. 0.69; "almost perfect" vs. "substantial" using the Landis & Koch criteria) were higher for Cochrane compared to non-Cochrane SRs. Four challenges were identified when applying AMSTAR in overviews: the scope of the SRs and overviews often differed; SRs examining similar topics sometimes made different methodological decisions; reporting of non-Cochrane SRs was sometimes poor; and some non-Cochrane SRs included other SRs as well as primary studies. Decision rules were developed to address each challenge. We found no evidence that AMSTAR assessments were correlated with SR results/conclusions. Results indicate that the AMSTAR tool can be used successfully in overviews that include Cochrane and non-Cochrane SRs, though decision rules may be useful to circumvent common challenges. Findings support existing recommendations that quality assessments of SRs in overviews be conducted independently, in duplicate, with a process for consensus. Results also suggest that using methodological quality to guide inclusion decisions (e.g., to exclude poorly conducted and reported SRs) may not introduce bias into the overview process.

Assessment of reproductive and developmental effects of DINP, DnHP and DCHP using quantitative weight of evidence.

PubMed

Dekant, Wolfgang; Bridges, James

2016-11-01

Quantitative weight of evidence (QWoE) methodology utilizes detailed scoring sheets to assess the quality/reliability of each publication on toxicity of a chemical and gives numerical scores for quality and observed toxicity. This QWoE-methodology was applied to the reproductive toxicity data on diisononylphthalate (DINP), di-n-hexylphthalate (DnHP), and dicyclohexylphthalate (DCHP) to determine if the scientific evidence for adverse effects meets the requirements for classification as reproductive toxicants. The scores for DINP were compared to those when applying the methodology DCHP and DnHP that have harmonized classifications. Based on the quality/reliability scores, application of the QWoE shows that the three databases are of similar quality; but effect scores differ widely. Application of QWoE to DINP studies resulted in an overall score well below the benchmark required to trigger classification. For DCHP, the QWoE also results in low scores. The high scores from the application of the QWoE methodology to the toxicological data for DnHP represent clear evidence for adverse effects and justify a classification of DnHP as category 1B for both development and fertility. The conclusions on classification based on the QWoE are well supported using a narrative assessment of consistency and biological plausibility. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Impact of voice- and knowledge-enabled clinical reporting--US example.

PubMed

Bushko, Renata G; Havlicek, Penny L; Deppert, Edward; Epner, Stephen

2002-01-01

This study shows qualitative and quantitative estimates of the national and the clinic level impact of utilizing voice and knowledge enabled clinical reporting systems. Using common sense estimation methodology, we show that the delivery of health care can experience a dramatic improvement in four areas as a result of the broad use of voice and knowledge enabled clinical reporting: (1) Process Quality as measured by cost savings, (2) Organizational Quality as measured by compliance, (3) Clinical Quality as measured by clinical outcomes and (4) Service Quality as measured by patient satisfaction. If only 15 percent of US physicians replaced transcription with modem clinical reporting voice-based methodology, about one half billion dollars could be saved. $6.7 Billion could be saved annually if all medical reporting currently transcribed was handled with voice-and knowledge-enabled dictation and reporting systems.

Randomized controlled trials of simulation-based interventions in Emergency Medicine: a methodological review.

PubMed

Chauvin, Anthony; Truchot, Jennifer; Bafeta, Aida; Pateron, Dominique; Plaisance, Patrick; Yordanov, Youri

2018-04-01

The number of trials assessing Simulation-Based Medical Education (SBME) interventions has rapidly expanded. Many studies show that potential flaws in design, conduct and reporting of randomized controlled trials (RCTs) can bias their results. We conducted a methodological review of RCTs assessing a SBME in Emergency Medicine (EM) and examined their methodological characteristics. We searched MEDLINE via PubMed for RCT that assessed a simulation intervention in EM, published in 6 general and internal medicine and in the top 10 EM journals. The Cochrane Collaboration risk of Bias tool was used to assess risk of bias, intervention reporting was evaluated based on the "template for intervention description and replication" checklist, and methodological quality was evaluated by the Medical Education Research Study Quality Instrument. Reports selection and data extraction was done by 2 independents researchers. From 1394 RCTs screened, 68 trials assessed a SBME intervention. They represent one quarter of our sample. Cardiopulmonary resuscitation (CPR) is the most frequent topic (81%). Random sequence generation and allocation concealment were performed correctly in 66 and 49% of trials. Blinding of participants and assessors was performed correctly in 19 and 68%. Risk of attrition bias was low in three-quarters of the studies (n = 51). Risk of selective reporting bias was unclear in nearly all studies. The mean MERQSI score was of 13.4/18.4% of the reports provided a description allowing the intervention replication. Trials assessing simulation represent one quarter of RCTs in EM. Their quality remains unclear, and reproducing the interventions appears challenging due to reporting issues.

F-15 inlet/engine test techniques and distortion methodologies studies. Volume 2: Time variant data quality analysis plots

NASA Technical Reports Server (NTRS)

Stevens, C. H.; Spong, E. D.; Hammock, M. S.

1978-01-01

Time variant data quality analysis plots were used to determine if peak distortion data taken from a subscale inlet model can be used to predict peak distortion levels for a full scale flight test vehicle.

Congestion Mitigation and Air Quality (CMAQ) Improvement Program: Cost-Effectiveness Tables Development and Methodology

DOT National Transportation Integrated Search

2015-05-01

This document presents summary and detailed findings from a research effort to develop estimates of the cost-effectiveness of a range of project types funded under the Congestion Mitigation and Air Quality (CMAQ) Improvement Program. In this study, c...

Cochrane Systematic Reviews of Chinese Herbal Medicines: An Overview

PubMed Central

Hu, Jing; Zhang, Junhua; Zhao, Wei; Zhang, Yongling; Zhang, Li; Shang, Hongcai

2011-01-01

Objectives Our study had two objectives: a) to systematically identify all existing systematic reviews of Chinese herbal medicines (CHM) published in Cochrane Library; b) to assess the methodological quality of included reviews. Methodology/Principal Findings We performed a systematic search of the Cochrane Database of Systematic Reviews (CDSR, Issue 5, 2010) to identify all reviews of CHM. A total of fifty-eight reviews were eligible for our study. Twenty-one of the included reviews had at least one Traditional Chinese Medicine (TCM) practitioner as its co-author. 7 reviews didn't include any primary study, the remaining reviews (n = 51) included a median of 9 studies and 936 participants. 50% of reviews were last assessed as up-to-date prior to 2008. The questions addressed by 39 reviews were broad in scope, in which 9 reviews combined studies with different herbal medicines. For OQAQ, the mean of overall quality score (item 10) was 5.05 (95% CI; 4.58-5.52). All reviews assessed the methodological quality of primary studies, 16% of included primary studies used adequate sequence generation and 7% used adequate allocation concealment. Of the 51 nonempty reviews, 23 reviews were reported as being inconclusive, while 27 concluded that there might be benefit of CHM, which was limited by the poor quality or inadequate quantity of included studies. 58 reviews reported searching a median of seven electronic databases, while 10 reviews did not search any Chinese database. Conclusions Now CDSR has included large numbers of CHM reviews, our study identified some areas which could be improved, such as almost half of included reviews did not have the participation of TCM practitioners and were not up-to-date according to Cochrane criteria, some reviews pooled the results of different herbal medicines and ignored the searching of Chinese databases. PMID:22174870

Application of Autonomous Smart Inverter Volt-VAR Function for Voltage Reduction Energy Savings and Power Quality in Electric Distribution Systems: Preprint

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ding, Fei; Nagarajan, Adarsh; Baggu, Murali

This paper evaluated the impact of smart inverter Volt-VAR function on voltage reduction energy saving and power quality in electric power distribution systems. A methodology to implement the voltage reduction optimization was developed by controlling the substation LTC and capacitor banks, and having smart inverters participate through their autonomous Volt-VAR control. In addition, a power quality scoring methodology was proposed and utilized to quantify the effect on power distribution system power quality. All of these methodologies were applied to a utility distribution system model to evaluate the voltage reduction energy saving and power quality under various PV penetrations and smartmore » inverter densities.« less

Improving Operational Readiness through Total Quality Management

DTIC Science & Technology

1991-06-21

DTIC AD-A236 611 EL CT F NAVAL WAR COLL GE C Newport, R. I. IMPROVING OPERATIONAL READINESS THROUGH TOTAL QUALITY MANAGEMENT by Herb Westphal Defense...IMPROVING OPERATIONAL READINESS THROUGH TOTAL QUALITY MANAGEMENT (TQM) A Case Study: The Defense Mapping Agency Combat Support Center (DMACSC) initiated a...of the Defense Mapping Agency Combat Support Center’s (DMACSC) Total Quality Management (TQM) improvement methodology. This allows the reader to

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Six Sigma arises from the ashes of TQM with a twist.

PubMed

Black, Ken; Revere, Lee

2006-01-01

This paper sets out to analyse the use of the Six Sigma methodology to improve quality in healthcare. It looks at how Six Sigma grew out of the concept of Total Quality Management (TQM). Six Sigma is a quality improvement methodology that has been widely adopted by companies since the early 1990s and has grown exponentially in the healthcare industry during the past five years. Some of the main tenets of Six Sigma have emerged from the principles of TQM, including the notion that the entire organization must support the quality effort; that there should be a vigorous education effort; and that a quality improvement process should emphasize root cause analysis. In spite of its early success, TQM "crashed and burned" for several reasons including the fact that financial benefits were difficult to assign to TQM efforts, root cause was not always determined resulting in recurring errors, there was no common metric to measure the level of quality attained, and quality efforts were sometimes aimed at processes or operations that were not critical to the customer. Six Sigma filled the vacuums created by these TQM failures in several ways. Under the Six Sigma methodology, quality improvement projects are carefully defined so that they can be successfully completed within a relatively short time frame. Financials are applied to each completed project so that management knows how much the project saves the institution. On each project, intense study is used to determine root cause analysis; and in the end, a metric known as "sigma level" can be assigned to signify the level of quality. Six Sigma has a "critical to quality" dimension that keeps the quality effort focused on improving only those things that really matter to the customer.

Preventing Harm in the ICU-Building a Culture of Safety and Engaging Patients and Families.

PubMed

Thornton, Kevin C; Schwarz, Jennifer J; Gross, A Kendall; Anderson, Wendy G; Liu, Kathleen D; Romig, Mark C; Schell-Chaple, Hildy; Pronovost, Peter J; Sapirstein, Adam; Gropper, Michael A; Lipshutz, Angela K M

2017-09-01

Preventing harm remains a persistent challenge in the ICU despite evidence-based practices known to reduce the prevalence of adverse events. This review seeks to describe the critical role of safety culture and patient and family engagement in successful quality improvement initiatives in the ICU. We review the evidence supporting the impact of safety culture and provide practical guidance for those wishing to implement initiatives aimed at improving safety culture and more effectively integrate patients and families in such efforts. Literature review using PubMed including evaluation of key studies assessing large-scale quality improvement efforts in the ICU, impact of safety culture on patient outcomes, methodologies for quality improvement commonly used in healthcare, and patient and family engagement. Print and web-based resources from leading patient safety organizations were also searched. Our group completed a review of original studies, review articles, book chapters, and recommendations from leading patient safety organizations. Our group determined by consensus which resources would best inform this review. A strong safety culture is associated with reduced adverse events, lower mortality rates, and lower costs. Quality improvement efforts have been shown to be more effective and sustainable when paired with a strong safety culture. Different methodologies exist for quality improvement in the ICU; a thoughtful approach to implementation that engages frontline providers and administrative leadership is essential for success. Efforts to substantively include patients and families in the processes of quality improvement work in the ICU should be expanded. Efforts to establish a culture of safety and meaningfully engage patients and families should form the foundation for all safety interventions in the ICU. This review describes an approach that integrates components of several proven quality improvement methodologies to enhance safety culture in the ICU and highlights opportunities to include patients and families.

Lean interventions in healthcare: do they actually work? A systematic literature review.

PubMed

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-04-01

Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data on design, methods, interventions and key outcomes were extracted and collated. Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Quality Assurance and Its Impact from Higher Education Institutions' Perspectives: Methodological Approaches, Experiences and Expectations

ERIC Educational Resources Information Center

Bejan, Stelian Andrei; Janatuinen, Tero; Jurvelin, Jouni; Klöpping, Susanne; Malinen, Heikki; Minke, Bernhard; Vacareanu, Radu

2015-01-01

This paper reports on methodological approaches, experiences and expectations referring to impact analysis of quality assurance from the perspective of three higher education institutions (students, teaching staff, quality managers) from Germany, Finland and Romania. The presentations of the three sample institutions focus on discussing the core…

A Synthesis of a Quality Management Model for Education in Universities

ERIC Educational Resources Information Center

Srikanthan, G.; Dalrymple, John

2004-01-01

The paper attempts to synthesise the features of the model for quality management in education based on the approaches spelt out in four well-articulated methodologies for the practice of quality in higher education. Each methodology contributes to different views of education from the learners' and the institution's perspectives, providing…

What is covered by "cancer rehabilitation" in PubMed? A review of randomized controlled trials 1990-2011.

PubMed

Gudbergsson, Sævar Berg; Dahl, Alv A; Loge, Jon Håvard; Thorsen, Lene; Oldervoll, Line M; Grov, Ellen K

2015-02-01

This focused review examines randomized controlled studies included by the term "cancer rehabilitation" in PubMed. The research questions concern the type of interventions performed and their methodological quality. Using the Medical Subject Headings (MeSH) terms: neoplasm AND rehabilitation, all articles with randomized controlled studies that included adult cancer patients, written in English, were extracted from PubMed. Papers covering physical exercise, psychiatric/psychological treatment or social support only were excluded as they had been reviewed recently. Abstracts and papers were assessed by 3 pairs of reviewers, and descriptive information was extracted systematically. Methodological quality was rated on a 10-item index scale, and the cut-off for acceptable quality was set at ≥ 8. A total of 132 (19%) of the 683 identified papers met the eligibility criteria and were assessed in detail. The papers were grouped into 5 thematic categories: 44 physical; 15 art and expressive; 47 psycho-educative; 21 emotionally supportive; and 5 others. Good quality of design was observed in 32 studies, 18 of them uni-dimensional and 14 multi-dimensional. Published randomized controlled studies on cancer rehabilitation are heterogeneous in terms of content and samples, and are mostly characterized by suboptimal design quality. Future studies should be more specific and well-designed with sufficient statistical strength.

Critical appraisal of clinical trials in multiple system atrophy: Toward better quality.

PubMed

Castro Caldas, Ana; Levin, Johannes; Djaldetti, Ruth; Rascol, Olivier; Wenning, Gregor; Ferreira, Joaquim J

2017-10-01

Multiple system atrophy (MSA) is a rare neurodegenerative disease of undetermined cause. Although many clinical trials have been conducted, there is still no treatment that cures the disease or slows its progression. We sought to assess the clinical trials, methodology, and quality of reporting of clinical trails conducted in MSA patients. We conducted a systematic review of all trials with at least 1 MSA patient subject to any pharmacological/nonpharmacological interventions. Two independent reviewers evaluated the methodological characteristics and quality of reporting of trials. A total of 60 clinical trials were identified, including 1375 MSA patients. Of the trials, 51% (n = 31) were single-arm studies. A total of 28% (n = 17) had a parallel design, half of which (n = 13) were placebo controlled. Of the studies, 8 (13.3%) were conducted in a multicenter setting, 3 of which were responsible for 49.3% (n = 678) of the total included MSA patients. The description of primary outcomes was unclear in 60% (n = 40) of trials. Only 10 (16.7%) clinical trials clearly described the randomization process. Blinding of the participants, personnel, and outcome assessments were at high risk of bias in the majority of studies. The number of dropouts/withdrawals was high (n = 326, 23.4% among the included patients). Overall, the design and quality of reporting of the reviewed studies is unsatisfactory. The most frequent clinical trials were small and single centered. Inadequate reporting was related to the information on the randomization process, sequence generation, allocation concealment, blinding of participants, and sample size calculations. Although improved during the recent years, methodological quality and trial design need to be optimized to generate more informative results. © 2017 International Parkinson and Movement Disorder Society. © 2017 International Parkinson and Movement Disorder Society.

The application of quantitative methods for identifying and exploring the presence of bias in systematic reviews: PDE-5 inhibitors for erectile dysfunction.

PubMed

Bekkering, G E; Abou-Setta, A M; Kleijnen, J

2008-01-01

A systematic review of PDE-5 inhibitors for erectile dysfunction was performed to evaluate the utility of quantitative methods for identifying and exploring the influence of bias and study quality on pooled outcomes from meta-analyses. We included 123 randomized controlled trials (RCTs). Methodological quality was poorly reported. All three drugs appeared highly effective. Indirect adjusted analyses showed no differences between the three drugs. Funnel plots and statistical tests showed no evidence of small-study effects for sildenafil whereas there was evidence of such bias for tadalafil and vardenafil. Adjustment for missing studies using trim and fill techniques did not alter the pooled estimates substantially. The exclusion of previous sildenafil nonresponders was associated with larger treatment effects for tadalafil. This investigation was hampered by poor reporting of methodological quality, a low number of studies, heterogeneity and large effect sizes. Despite such limitations, a comprehensive assessment of biases should be a routine in systematic reviews.

Does Higher Education Service Quality Effect Student Satisfaction, Image and Loyalty? A Study of International Students in Malaysian Public Universities

ERIC Educational Resources Information Center

Ali, Faizan; Zhou, Yuan; Hussain, Kashif; Nair, Pradeep Kumar; Ragavan, Neethiahnanthan Ari

2016-01-01

Purpose: The purpose of this study is to investigate the effect of Malaysian public universities' service quality on international student satisfaction, institutional image and loyalty. Design/methodology/approach: A total number of 400 questionnaires were distributed to international students, selected using convenience sampling technique, at…

Towards a Predictive Model of Quality in Canadian Child Care Centers

ERIC Educational Resources Information Center

Goelman, Hillel; Forer, Barry; Kershaw, Paul; Doherty, Gillian; Lero, Donna; LaGrange, Annette

2006-01-01

This paper reports on the design, methodology, and results of a study of quality in 326 classrooms in 239 Canadian child care centers. This study, the largest and most extensive ever undertaken in Canada, used the Caregiver Interaction Scale (CIS) to rate the adult-child interactions in the classrooms and the Infant-Toddler Environment Rating…

Evaluating Service Quality in Universities: A Service Department Perspective

ERIC Educational Resources Information Center

Smith, Gareth; Smith, Alison; Clarke, Alison

2007-01-01

Purpose: The purpose of the study is to report on an in-depth exploration of service quality in an Information Technology service department in a Higher Education Institute (HEI) and to evaluate the instrument used. Design/methodology/approach: The study surveys customers using the SERVQUAL instrument, which is one of the most widely used and…

Determinants of Quality Education in Private Universities from Student Perspectives: A Case Study in Bangladesh

ERIC Educational Resources Information Center

Ashraf, Mohammad A.; Osman, Abu Zafar Rashed; Ratan, Sarker Rafij Ahmed

2016-01-01

Purpose: The purpose of the present study is to identify the determinants that potentially influence quality education in private universities in Bangladesh. Design/methodology/approach: To attain this objective, 234 data were collected through face-to-face interviews on campus during February-March 2013 from Bachelor of Business Administration…

Principals' Influence on Instructional Quality: Insights from US Schools

ERIC Educational Resources Information Center

Printy, Susan

2010-01-01

This article seeks to explain the ways in which leadership makes a difference to the quality of instruction in US schools by reviewing research published since 2000. The review of research is presented in three major sections, organised according to the methodology used in each study. The first section looks into quantitative studies that probe…

Quantitative Research Methods, Study Quality, and Outcomes: The Case of Interaction Research

ERIC Educational Resources Information Center

Plonsky, Luke; Gass, Susan

2011-01-01

This article constitutes the first empirical assessment of methodological quality in second language acquisition (SLA). We surveyed a corpus of 174 studies (N = 7,951) within the tradition of research on second-language interaction, one of the longest and most influential traditions of inquiry in SLA. Each report was coded for methodological…

Variations in Student Perceptions of Service Quality of Higher Education Institutions in Brazil: A Longitudinal Study

ERIC Educational Resources Information Center

Campos, Domingos Fernandes; dos Santos, Guido Salvi; Castro, Felipe Nalon

2017-01-01

Purpose: The purpose of this paper is to examine, through a longitudinal study, undergraduate student perceptions of service expectations, priorities and quality of the higher education institution that they attend, using an importance-performance rating matrix. Design/methodology/approach: This research was carried out with students exposed to a…

Patient-reported outcomes in randomised controlled trials of prostate cancer: methodological quality and impact on clinical decision making.

PubMed

Efficace, Fabio; Feuerstein, Michael; Fayers, Peter; Cafaro, Valentina; Eastham, James; Pusic, Andrea; Blazeby, Jane

2014-09-01

Patient-reported outcomes (PRO) data from randomised controlled trials (RCTs) are increasingly used to inform patient-centred care as well as clinical and health policy decisions. The main objective of this study was to investigate the methodological quality of PRO assessment in RCTs of prostate cancer (PCa) and to estimate the likely impact of these studies on clinical decision making. A systematic literature search of studies was undertaken on main electronic databases to retrieve articles published between January 2004 and March 2012. RCTs were evaluated on a predetermined extraction form, including (1) basic trial demographics and clinical and PRO characteristics; (2) level of PRO reporting based on the recently published recommendations by the International Society for Quality of Life Research; and (3) bias, assessed using the Cochrane Risk of Bias tool. Studies were systematically analysed to evaluate their relevance for supporting clinical decision making. Sixty-five RCTs enrolling a total of 22 071 patients were evaluated, with 31 (48%) in patients with nonmetastatic disease. When a PRO difference between treatments was found, it related in most cases to symptoms only (n=29, 58%). Although the extent of missing data was generally documented (72% of RCTs), few reported details on statistical handling of this data (18%) and reasons for dropout (35%). Improvements in key methodological aspects over time were found. Thirteen (20%) RCTs were judged as likely to be robust in informing clinical decision making. Higher-quality PRO studies were generally associated with those RCTs that had higher internal validity. Including PRO in RCTs of PCa patients is critical for better evaluating the treatment effectiveness of new therapeutic approaches. Marked improvements in PRO quality reporting over time were found, and it is estimated that at least one-fifth of PRO RCTs have provided sufficient details to allow health policy makers and physicians to make critical appraisals of results. In this report, we have investigated the methodological quality of PCa trials that have included a PRO assessment. We conclude that including PRO is critical to better evaluating the treatment effectiveness of new therapeutic approaches from the patient's perspective. Also, at least one-fifth of PRO RCTs in PCa have provided sufficient details to allow health policy makers and physicians to make a critical appraisal of results. Copyright © 2013. Published by Elsevier B.V.

Effects of muscle stretching exercises in the treatment of fibromyalgia: a systematic review.

PubMed

Lorena, Suélem Barros de; Lima, Maria do Carmo Correia de; Ranzolin, Aline; Duarte, Ângela Luiza Branco Pinto

2015-01-01

This study has the objective to systematize scientific evidences about the use of muscle stretching exercises in the treatment of FM. It was performed from retrospective research without chronological and linguistic limits, at databases of MEDLINE, LILACS, SciELO and PEDro, as well as at PubMed search tool. Data collection was performed by two independent reviewers in October 2012, with the search strategy formulated by crossing descriptors and relevant terms to the topic in English, Portuguese and Spanish languages. Randomized clinical trials, only with patients with a clinical diagnosis of fibromyalgia and muscle stretching exercises as a therapeutic measure at least in one of the intervention groups were included. Included studies were assessed for methodological quality using PEDro scale and their references analyzed to highlight additional sources. The search amounted to an average of 6,794 items. Only five articles were selected, one being excluded because of its low methodological quality. Pain was assessed unanimously. The method and timing of interventions varied widely, there was poor mention of the parameters used in the stretches and absence of specific physical examinations. There was significant improvement in all studies regarding pain, besides as related to quality of life and physical condition. It is clear the importance of muscle stretching in the treatment of FM, however, there is a need for further studies to establish the real benefits of the technique, because the majority of published studies shows low methodological quality and there is a lack of standardization regarding the use of this resource. Copyright © 2014 Elsevier Editora Ltda. All rights reserved.

Effects of obesity on lung volume and capacity in children and adolescents: a systematic review.

PubMed

Winck, Aline Dill; Heinzmann-Filho, João Paulo; Soares, Rafaela Borges; da Silva, Juliana Severo; Woszezenki, Cristhiele Taís; Zanatta, Letiane Bueno

2016-12-01

To assess the effects of obesity on lung volume and capacity in children and adolescents. This is a systematic review, carried out in Pubmed, Lilacs, Scielo and PEDro databases, using the following Keywords: Plethysmography; Whole Body OR Lung Volume Measurements OR Total Lung Capacity OR Functional Residual Capacity OR Residual Volume AND Obesity. Observational studies or clinical trials that assessed the effects of obesity on lung volume and capacity in children and adolescents (0-18 years) without any other associated disease; in English; Portuguese and Spanish languages were selected. Methodological quality was assessed by the Agency for Healthcare Research and Quality. Of the 1,030 articles, only four were included in the review. The studies amounted to 548 participants, predominantly males, with sample size ranging from 45 to 327 individuals. 100% of the studies evaluated nutritional status through BMI (z-score) and 50.0% reported the data on abdominal circumference. All demonstrated that obesity causes negative effects on lung volume and capacity, causing a reduction mainly in functional residual capacity in 75.0% of the studies; in the expiratory reserve volume in 50.0% and in the residual volume in 25.0%. The methodological quality ranged from moderate to high, with 75.0% of the studies classified as having high methodological quality. Obesity causes deleterious effects on lung volume and capacity in children and adolescents, mainly by reducing functional residual capacity, expiratory reserve volume and residual volume. Copyright © 2016 Sociedade de Pediatria de São Paulo. Publicado por Elsevier Editora Ltda. All rights reserved.

Interventions to Promote Physical Activity in Older People with Type 2 Diabetes Mellitus: A Systematic Review

PubMed Central

Sazlina, Shariff-Ghazali; Browning, Colette; Yasin, Shajahan

2013-01-01

Introduction: Type 2 diabetes mellitus (T2DM) among people aged 60 years and above is a growing public health problem. Regular physical activity is one of the key elements in the management of T2DM. Recommendations suggest that older people with T2DM will benefit from regular physical activity for better disease control and delaying complications. Despite the known benefits, many remain sedentary. Hence, this review assessed interventions for promoting physical activity in persons aged 65 years and older with T2DM. Methods: A literature search was conducted using Ovid MEDLINE, PubMed, EMBASE, SPORTDiscus, and CINAHL databases to retrieve articles published between January 2000 and December 2012. Randomized controlled trials and quasi-experimental designs comparing different strategies to increase physical activity level in persons aged 65 years and older with T2DM were included. The methodological quality of studies was assessed. Results: Twenty-one eligible studies were reviewed, only six studies were rated as good quality and only one study specifically targeted persons aged 65 years and older. Personalized coaching, goal setting, peer support groups, use of technology, and physical activity monitors were proven to increase the level of physical activity. Incorporation of health behavior theories and follow-up supports also were successful strategies. However, the methodological quality and type of interventions promoting physical activity of the included studies in this review varied widely across the eligible studies. Conclusion: Strategies that increased level of physical activity in persons with T2DM are evident but most studies focused on middle-aged persons and there was a lack of well-designed trials. Hence, more studies of satisfactory methodological quality with interventions promoting physical activity in older people are required. PMID:24392445

Visual sensitivity of river recreation to power plants

Treesearch

David H. Blau; Michael C. Bowie

1979-01-01

The consultants were asked by the Power Plant Siting Staff of the Minnesota Environmental Quality Council to develop a methodology for evaluating the sensitivity of river-related recreational activities to visual intrusion by large coal-fired power plants. The methodology, which is applicable to any major stream in the state, was developed and tested on a case study...

Couple Attachment and Relationship Duration in Psychotherapy Patients: Exploring a New Methodology of Assessment

ERIC Educational Resources Information Center

Sochos, Antigonos

2014-01-01

The couple relationship is an essential source of support for individuals undergoing psychological treatment and the aim of this study was to apply a new methodology in assessing the quality of such support. A theoretically informed thematic analysis of interview transcripts was conducted, triangulated by quantitative data. Twenty-one brief…

Application of a health risk assessment model for cattle exposed to pesticides in contaminated drinking waters: A study case from the Pampas region, Argentina.

PubMed

Dubny, Sabrina; Peluso, Fabio; Masson, Ignacio; Othax, Natalia; González Castelain, José

2018-04-01

Using the USEPA methodology we estimated the probabilistic chronic risks for calves and adult cows due to pesticide exposure through oral intake of contaminated surface and ground waters in Tres Arroyos County (Argentina). Because published data on pesticide toxicity endpoints for cows are scarce, we used threshold levels based on interspecies extrapolation methods. The studied waters showed acceptable quality for cattle production since none of the pesticides were present at high-enough concentrations to potentially affect cow health. Moreover, ground waters had better quality than surface waters, with dieldrin and deltamethrin being the pesticides associated with the highest risk values in the former and the latter water compartments, respectively. Our study presents a novel use of the USEPA risk methodology proving it is useful for water quality evaluation in terms of pesticide toxicity for cattle production. This approach represents an alternative tool for water quality management in the absence of specific cattle pesticide regulatory limits. Copyright © 2018 Elsevier Ltd. All rights reserved.

Tailored Communication Within Mobile Apps for Diabetes Self-Management: A Systematic Review

PubMed Central

Wahl, Astrid Klopstad; Cvancarova Småstuen, Milada; Ribu, Lis

2017-01-01

Background The prevalence of diabetes is increasing and with the requirements for self-management and risk of late complications, it remains a challenge for the individual and society. Patients can benefit from support from health care personnel in their self-management, and the traditional communication between patients and health care personnel is changing. Smartphones and apps offer a unique platform for communication, but apps with integrated health care personnel communication based on patient data are yet to be investigated to provide evidence of possible effects. Objective Our goal was to systematically review studies that aimed to evaluate integrated communication within mobile apps for tailored feedback between patients with diabetes and health care personnel in terms of (1) study characteristics, (2) functions, (3) study outcomes, (4) effects, and (5) methodological quality. Methods A systematic literature search was conducted following our International Prospective Register of Systematic Reviews (PROSPERO) protocol, searching for apps with integrated communication for persons with diabetes tested in a controlled trial in the period 2008 to 2016. We searched the databases PubMed, Medical Literature Analysis and Retrieval System Online (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Central, Excerpta Medica database (EMBASE), ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform. The search was closed in September 2016. Reference lists of primary articles and review papers were assessed. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed, and we applied the Cochrane risk of bias tool to assess methodological quality. Results We identified 2822 citations and after duplicate removal, we assessed 1128 citations. A total of 6 papers were included in this systematic review, reporting on data from 431 persons participating in small trials of short duration. The integrated communication features were mostly individualized as written non–real-time feedback. The number of functions varied from 2 to 9, and blood glucose tracking was the most common. HbA1c was the most common primary outcome, but the remaining reported outcomes were not standardized and comparable. Because of both the heterogeneity of the included trials and the poor methodological quality of the studies, a meta-analysis was not possible. A statistically significant improvement in the primary measure of outcome was found in 3 of the 6 included studies, of which 2 were HbA1c and 1 was mean daytime ambulatory blood pressure. Participants in the included trials reported positive usability or feasibility postintervention in 5 out of 6 trials. The overall methodological quality of the trials was, however, scored as an uncertain risk of bias. Conclusions This systematic review highlights the need for more trials of higher methodological quality. Few studies offer an integrated function for communication and feedback from health care personnel, and the research field represents an area of heterogeneity with few studies of highly rigorous methodological quality. This, in combination with a low number of participants and a short follow-up, is making it difficult to provide reliable evidence of effects for stakeholders. PMID:28645890

The role of the therapeutic alliance on pain relief in musculoskeletal rehabilitation: A systematic review.

PubMed

Taccolini Manzoni, Ana Carolina; Bastos de Oliveira, Naiane Teixeira; Nunes Cabral, Cristina Maria; Aquaroni Ricci, Natalia

2018-02-05

The aim of this systematic review was to investigate the role of therapeutic alliance in pain relief in patients with musculoskeletal disorders treated by physiotherapy. Manual and database searches (Medline, Embase, ISI Web of Knowledge, CINAHL, PEDro, Lilacs, Cochrane Library, and PsycINFO) were performed with no restrictions of language and publication date. We included prospective studies with samples of patients undergoing physiotherapy for musculoskeletal conditions, with one measure of therapeutic alliance and the outcome pain. Methodological quality was assessed by the Methodological Index for Nonrandomized Studies and the Cochrane tool for risk of bias. Six articles from four studies were included out of the 936 manuscripts identified. All studies used samples composed of patients with chronic low back pain. Two studies applied therapeutic alliance incentive measures during treatment and reported significant improvement in pain. The remaining studies, without alliance incentives, showed divergence regarding the relationship between the therapeutic alliance and pain. Methodological quality analysis determined low risk of bias of the studies. A lack of studies on the therapeutic alliance regarding musculoskeletal physiotherapy was verified. Existing studies fail to provide evidence of a strong relationship between the therapeutic alliance and pain relief.

What Are the Strength of Recommendations and Methodologic Reporting in Health Economic Studies in Orthopaedic Surgery?

PubMed

Makhni, Eric C; Steinhaus, Michael E; Swart, Eric; Bozic, Kevin J

2015-10-01

Cost-effectiveness research is an increasingly used tool in evaluating treatments in orthopaedic surgery. Without high-quality primary-source data, the results of a cost-effectiveness study are either unreliable or heavily dependent on sensitivity analyses of the findings from the source studies. However, to our knowledge, the strength of recommendations provided by these studies in orthopaedics has not been studied. We asked: (1) What are the strengths of recommendations in recent orthopaedic cost-effectiveness studies? (2) What are the reasons authors cite for weak recommendations? (3) What are the methodologic reporting practices used by these studies? The titles of all articles published in six different orthopaedic journals from January 1, 2004, through April 1, 2014, were scanned for original health economics studies comparing two different types of treatment or intervention. The full texts of included studies were reviewed to determine the strength of recommendations determined subjectively by our study team, with studies providing equivocal conclusions stemming from a lack or uncertainty surrounding key primary data classified as weak and those with definitive conclusions not lacking in high-quality primary data classified as strong. The reasons underlying a weak designation were noted, and methodologic practices reported in each of the studies were examined using a validated instrument. A total of 79 articles met our prespecified inclusion criteria and were evaluated in depth. Of the articles included, 50 (63%) provided strong recommendations, whereas 29 (37%) provided weak recommendations. Of the 29 studies, clinical outcomes data were cited in 26 references as being insufficient to provide definitive conclusions, whereas cost and utility data were cited in 13 and seven articles, respectively. Methodologic reporting practices varied greatly, with mixed adherence to framing, costs, and results reporting. The framing variables included clearly defined intervention, adequate description of a comparator, study perspective clearly stated, and reported discount rate for future costs and quality-adjusted life years. Reporting costs variables included economic data collected alongside a clinical trial or another primary source and clear statement of the year of monetary units. Finally, results reporting included whether a sensitivity analysis was performed. Given that a considerable portion of orthopaedic cost-effectiveness studies provide weak recommendations and that methodologic reporting practices varied greatly among strong and weak studies, we believe that clinicians should exercise great caution when considering the conclusions of cost-effectiveness studies. Future research could assess the effect of such cost-effectiveness studies in clinical practice, and whether the strength of recommendations of a study's conclusions has any effect on practice patterns. Given the increasing use of cost-effectiveness studies in orthopaedic surgery, understanding the quality of these studies and the reasons that limit the ability of studies to provide more definitive recommendations is critical. Highlighting the heterogeneity of methodologic reporting practices will aid clinicians in interpreting the conclusions of cost-effectiveness studies and improve future research efforts.

Methodological and reporting quality of systematic reviews on tuberculosis.

PubMed

Nicolau, I; Ling, D; Tian, L; Lienhardt, C; Pai, M

2013-09-01

Systematic reviews are used to inform tuberculosis (TB) guidelines. However, there are no data on whether TB systematic reviews are conducted well and reported transparently. We searched four databases for reviews published between 2005 and 2010. Methodological quality was evaluated using AMSTAR and quality of reporting was assessed using PRISMA. Of 152 articles, 137 (90%) met the inclusion criteria. Only 3 of 11 AMSTAR quality items were met in most reviews: appropriate methods to combine findings (67%), comprehensive literature search (72%) and presentation of characteristics of included studies (90%). The other eight items were met in 4-53% of the reviews. Only 4% of the reviews disclosed conflicts of interest. The majority of the PRISMA items were reported in more than 60-76% of the reviews. Only nine items were reported in less than 55% of the reviews, the lowest being the full-search strategy (30%), risk of bias across studies in the Methods (27%) and Results (21%) sections, and indication of a review protocol (15%). Systematic reviews in our survey were well reported but generally of moderate to low quality. Better training, use of reporting guidelines and registration of systematic reviews could improve the quality of TB reviews.

[Methodological problems in the scientific research on HIV /AIDS in Bolivia].

PubMed

Hita, Susana Ramírez

2013-05-01

This paper discusses the methodological problems in the scientific research on HIV/AIDS in Bolivia, both in the areas of epidemiology and social sciences. Studies associated with this research served as the basis for the implementation of health programs run by The Global Fund, The Pan-American Health Organization, International Cooperation, Non-Governmental Organizations and the Bolivian Ministry of Health and Sports. An analysis of the methodological contradictions and weaknesses was made by reviewing the bibliography of the studies and by conducting qualitative methodological research, that was focused on the quality of health care available to people living with HIV/AIDS in public hospitals and health centers, and looked at how programs targeted at this sector of the population are designed and delivered. In this manner, it was possible to observe the shortcomings of the methodological design in the epidemiological and social science studies which serve as the basis for the implementation of these health programs.

Feedback Effects of Teaching Quality Assessment: Macro and Micro Evidence

ERIC Educational Resources Information Center

Bianchini, Stefano

2014-01-01

This study investigates the feedback effects of teaching quality assessment. Previous literature looked separately at the evolution of individual and aggregate scores to understand whether instructors and university performance depends on its past evaluation. I propose a new quantitative-based methodology, combining statistical distributions and…

The quality of dietary intake methodology and reporting in child and adolescent obesity intervention trials: a systematic review.

PubMed

Burrows, T; Golley, R K; Khambalia, A; McNaughton, S A; Magarey, A; Rosenkranz, R R; Alllman-Farinelli, M; Rangan, A M; Truby, H; Collins, C

2012-12-01

Assessing dietary intake is important in evaluating childhood obesity intervention effectiveness. The purpose of this review was to evaluate the dietary intake methods and reporting in intervention studies that included a dietary component to treat overweight or obese children. A systematic review of studies published in the English language, between 1985 and August 2010 in health databases. The search identified 2,295 papers, of which 335 were retrieved and 31 met the inclusion criteria. Twenty-three studies reported energy intake as an outcome measure, 20 reported macronutrient intakes and 10 studies reported food intake outcomes. The most common dietary method employed was the food diary (n = 13), followed by 24-h recall (n = 5), food frequency questionnaire (FFQ) (n = 4) and dietary questionnaire (n = 4). The quality of the dietary intake methods reporting was rated as 'poor' in 15 studies (52%) and only 3 were rated as 'excellent'. The reporting quality of FFQs tended to be higher than food diaries/recalls. Deficiencies in the quality of dietary intake methods reporting in child obesity studies were identified. Use of a dietary intake methods reporting checklist is recommended. This will enable the quality of dietary intake results to be evaluated, and an increased ability to replicate study methodology by other researchers. © 2012 The Authors. obesity reviews © 2012 International Association for the Study of Obesity.

Methodologic ramifications of paying attention to sex and gender differences in clinical research.

PubMed

Prins, Martin H; Smits, Kim M; Smits, Luc J

2007-01-01

Methodologic standards for studies on sex and gender differences should be developed to improve reporting of studies and facilitate their inclusion in systematic reviews. The essence of these studies lies within the concept of effect modification. This article reviews important methodologic issues in the design and reporting of pharmacogenetic studies. Differences in effect based on sex or gender should preferably be expressed in absolute terms (risk differences) to facilitate clinical decisions on treatment. Information on the distribution of potential effect modifiers or prognostic factors should be available to prevent a biased comparison of differences in effect between genotypes. Other considerations included the possibility of selective nonavailability of biomaterial and the choice of a statistical model to study effect modification. To ensure high study quality, additional methodologic issues should be taken into account when designing and reporting studies on sex and gender differences.

A systematic review of the quality of homeopathic pathogenetic trials published from 1945 to 1995.

PubMed

Dantas, F; Fisher, P; Walach, H; Wieland, F; Rastogi, D P; Teixeira, H; Koster, D; Jansen, J P; Eizayaga, J; Alvarez, M E P; Marim, M; Belon, P; Weckx, L L M

2007-01-01

The quality of information gathered from homeopathic pathogenetic trials (HPTs), also known as 'provings', is fundamental to homeopathy. We systematically reviewed HPTs published in six languages (English, German, Spanish, French, Portuguese and Dutch) from 1945 to 1995, to assess their quality in terms of the validity of the information they provide. The literature was comprehensively searched, only published reports of HPTs were included. Information was extracted by two reviewers per trial using a form with 87 items. Information on: medicines, volunteers, ethical aspects, blinding, randomization, use of placebo, adverse effects, assessments, presentation of data and number of claimed findings were recorded. Methodological quality was assessed by an index including indicators of internal and external validity, personal judgement and comments of reviewers for each study. 156 HPTs on 143 medicines, involving 2815 volunteers, produced 20,538 pathogenetic effects (median 6.5 per volunteer). There was wide variation in methods and results. Sample size (median 15, range 1-103) and trial duration (mean 34 days) were very variable. Most studies had design flaws, particularly absence of proper randomization, blinding, placebo control and criteria for analysis of outcomes. Mean methodological score was 5.6 (range 4-16). More symptoms were reported from HPTs of poor quality than from better ones. In 56% of trials volunteers took placebo. Pathogenetic effects were claimed in 98% of publications. On average about 84% of volunteers receiving active treatment developed symptoms. The quality of reports was in general poor, and much important information was not available. The HPTs were generally of low methodological quality. There is a high incidence of pathogenetic effects in publications and volunteers but this could be attributable to design flaws. Homeopathic medicines, tested in HPTs, appear safe. The central question of whether homeopathic medicines in high dilutions can provoke effects in healthy volunteers has not yet been definitively answered, because of methodological weaknesses of the reports. Improvement of the method and reporting of results of HPTs are required. References to all included RCTs are available on-line at.

Introduction: the Interdisciplinary Nursing Quality Research Initiative.

PubMed

Naylor, Mary D; Lustig, Adam; Kelley, Heather J; Volpe, Ellen M; Melichar, Lori; Pauly, Mark V

2013-04-01

The Robert Wood Johnson Foundation launched the Interdisciplinary Nursing Quality Research Initiative (INQRI) program in 2005 to generate, disseminate, and translate research to understand how nurses contribute to and can improve patient care quality. This special edition of Medical Care provides an overview of the program's strategy, goals, and impact, highlighting cross-cutting issues addressed by the initiative. INQRI's leadership and select grantees discuss the implications of a collection of studies on the following: advances in the science of nursing's contribution to quality, measurement of quality, interdisciplinary collaboration, implementation methodology, dissemination and translation of findings, and the business case for nursing. A comprehensive review of the scholarly literature published in 2004 and 2009 found that the evidence linking nursing to quality of care has grown. The second paper discusses INQRI's work on measurement of quality of care, revealing the need for additional comprehensive measures. The third paper examines INQRI's focus on interdisciplinary collaboration, finding that it can enhance methodological approaches and result in substantive changes in health delivery systems. The fourth paper presents methodological challenges faced in health care implementation, emphasizing the need for standardized terms and research designs. The fifth paper addresses INQRI's commitment to translating research into practice, illustrating dissemination strategies and lessons learned. The final paper discusses how the INQRI program has contributed to the current evidence regarding the business case for nursing. This supplement describes the accomplishments of the INQRI program, discusses current issues in research design and implementation, and places INQRI research within the larger context regarding advances in nursing science.

Social and behavioral interventions for improving quality of life of HIV infected people receiving antiretroviral therapy: a systematic review and meta-analysis.

PubMed

Bhatta, Dharma Nand; Liabsuetrakul, Tippawan; McNeil, Edward B

2017-04-24

Improvement in quality of life is crucial for HIV infected people. Social and behavioral interventions have been implemented in different contexts to improve the quality of life among HIV infected people. This review appraises the evidence for available interventions that focused on quality of life of HIV infected people receiving antiretroviral therapy (ART). We searched electronic databases for randomized controlled trials of interventions to improve the quality of life of HIV infected people receiving ART. We searched PUBMED and the Cochrane Centre Register of Controlled Trials (CENTRAL) with the terms "social", "behavioral", "educational", "quality of life", "HIV", and "RCT". Searches were conducted for articles published from 1980 to December 16, 2015. Standardized data abstraction methods and searching steps were applied. Twenty-eight studies reported the impact of social or behavioral interventions in quality of life among HIV infected people, of which 15 were conducted in United States of America. A total of 4136 participants were enrolled. Of the 28 studies, four studies included females, two studies included males and remaining studies excluded both males and females. The overall reported methodological quality of the studies was subject to a high risk of bias and the study criteria were unclear in most studies. Twenty-one studies reported a significant intervention effect on at least one quality of life domain. Meta-analyses showed significant improvement in general health, mental health, physical function and environment domains of quality of life among intervention groups. However, the expected impact of the intervention was low to moderate because the rigorousness of the studies was low, information was limited, the sample sizes were small and other the quality of the study designs were poor. Although the available evidence suggests that existing social and behavioral interventions can improve some quality of life domains, the quality of evidence was insufficient to support the notion that these interventions can improve the overall quality of life of HIV infected people receiving ART. Well-designed and rigorous randomized controlled trials with high methodological quality are required.

MetaCAA: A clustering-aided methodology for efficient assembly of metagenomic datasets.

PubMed

Reddy, Rachamalla Maheedhar; Mohammed, Monzoorul Haque; Mande, Sharmila S

2014-01-01

A key challenge in analyzing metagenomics data pertains to assembly of sequenced DNA fragments (i.e. reads) originating from various microbes in a given environmental sample. Several existing methodologies can assemble reads originating from a single genome. However, these methodologies cannot be applied for efficient assembly of metagenomic sequence datasets. In this study, we present MetaCAA - a clustering-aided methodology which helps in improving the quality of metagenomic sequence assembly. MetaCAA initially groups sequences constituting a given metagenome into smaller clusters. Subsequently, sequences in each cluster are independently assembled using CAP3, an existing single genome assembly program. Contigs formed in each of the clusters along with the unassembled reads are then subjected to another round of assembly for generating the final set of contigs. Validation using simulated and real-world metagenomic datasets indicates that MetaCAA aids in improving the overall quality of assembly. A software implementation of MetaCAA is available at https://metagenomics.atc.tcs.com/MetaCAA. Copyright © 2014 Elsevier Inc. All rights reserved.

Methodological considerations for designing a community water fluoridation cessation study.

PubMed

Singhal, Sonica; Farmer, Julie; McLaren, Lindsay

2017-06-01

High-quality, up-to-date research on community water fluoridation (CWF), and especially on the implications of CWF cessation for dental health, is limited. Although CWF cessation studies have been conducted, they are few in number; one of the major reasons is the methodological complexity of conducting such a study. This article draws on a systematic review of existing cessation studies (n=15) to explore methodological considerations of conducting CWF cessation studies in future. We review nine important methodological aspects (study design, comparison community, target population, time frame, sampling strategy, clinical indicators, assessment criteria, covariates and biomarkers) and provide recommendations for planning future CWF cessation studies that examine effects on dental caries. There is no one ideal study design to answer a research question. However, recommendations proposed regarding methodological aspects to conduct an epidemiological study to observe the effects of CWF cessation on dental caries, coupled with our identification of important methodological gaps, will be useful for researchers who are looking to optimize resources to conduct such a study with standards of rigour. © 2017 Her Majesty the Queen in Right of Canada. Community Dentistry and Oral Epidemiology © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Effects of image processing on the detective quantum efficiency

NASA Astrophysics Data System (ADS)

Park, Hye-Suk; Kim, Hee-Joung; Cho, Hyo-Min; Lee, Chang-Lae; Lee, Seung-Wan; Choi, Yu-Na

2010-04-01

Digital radiography has gained popularity in many areas of clinical practice. This transition brings interest in advancing the methodologies for image quality characterization. However, as the methodologies for such characterizations have not been standardized, the results of these studies cannot be directly compared. The primary objective of this study was to standardize methodologies for image quality characterization. The secondary objective was to evaluate affected factors to Modulation transfer function (MTF), noise power spectrum (NPS), and detective quantum efficiency (DQE) according to image processing algorithm. Image performance parameters such as MTF, NPS, and DQE were evaluated using the international electro-technical commission (IEC 62220-1)-defined RQA5 radiographic techniques. Computed radiography (CR) images of hand posterior-anterior (PA) for measuring signal to noise ratio (SNR), slit image for measuring MTF, white image for measuring NPS were obtained and various Multi-Scale Image Contrast Amplification (MUSICA) parameters were applied to each of acquired images. In results, all of modified images were considerably influence on evaluating SNR, MTF, NPS, and DQE. Modified images by the post-processing had higher DQE than the MUSICA=0 image. This suggests that MUSICA values, as a post-processing, have an affect on the image when it is evaluating for image quality. In conclusion, the control parameters of image processing could be accounted for evaluating characterization of image quality in same way. The results of this study could be guided as a baseline to evaluate imaging systems and their imaging characteristics by measuring MTF, NPS, and DQE.

Best evidence on the educational effects of undergraduate portfolios.

PubMed

Buckley, Sharon; Coleman, Jamie; Khan, Khalid

2010-09-01

The great variety of portfolio types and schemes used in the education of health professionals is reflected in the extensive and diverse educational literature relating to portfolio use. We have recently completed a Best Evidence Medical Education (BEME) systematic review of the literature relating to the use of portfolios in the undergraduate setting that offers clinical teachers insights into both their effects on learning and issues to consider in portfolio implementation. Using a methodology based on BEME recommendations, we searched the literature relating to a range of health professions, identifying evidence for the effects of portfolios on undergraduate student learning, and assessing the methodological quality of each study. The higher quality studies in our review report that, when implemented appropriately, portfolios can improve students' ability to integrate theory with practice, can encourage their self-awareness and reflection, and can offer support for students facing difficult emotional situations. Portfolios can also enhance student-tutor relationships and prepare students for the rigours of postgraduate training. However, the time required to complete a portfolio may detract from students' clinical learning. An analysis of methodological quality against year of publication suggests that, across a range of health professions, the quality of the literature relating to the educational effects of portfolios is improving. However, further work is still required to build the evidence base for the educational effects of portfolios, particularly comparative studies that assess effects on learning directly. Our findings have implications for the design and implementation of portfolios in the undergraduate setting. © Blackwell Publishing Ltd 2010.

Developing methods for systematic reviewing in health services delivery and organisation

PubMed Central

Alborz, Alison; McNally, Rosalind

2007-01-01

Objectives To develop methods to facilitate the ‘systematic’ review of evidence from a range of methodologies on diffuse or ‘soft’ topics, as exemplified by ‘access to healthcare’. Data sources 28 bibliographic databases, research registers, organisational web sites or library catalogues. Reference lists from identified studies. Contact with experts and service users. Current awareness and contents alerting services in the area of learning disabilities. Review methods Inclusion criteria were English language literature from 1980 onwards, relating to people with learning disabilities of any age and all study designs. The main criteria for assessment was relevance to Guillifords’ model of access to health care which was adapted to the circumstances of people with learning disabilities. Selected studies were evaluated for scientific rigour then data was extracted and the results synthesised. Quality assessment was by an initial set of ‘generic’ quality indicators. This enabled further evidence selection before evaluation of findings according to specific criteria for qualitative, quantitative or mixed-method studies. Results 82 studies were fully evaluated. Five studies were rated ‘highly rigorous’, 22 ‘rigorous’, 46 ‘less rigorous’ and 9 ‘poor’ papers were retained as the sole evidence covering aspects of the guiding model. The majority of studies were quantitative but used only descriptive statistics. Most evidence lacked methodological detail, which often lowered final quality ratings. Conclusions The application of a consistent structure to quality evaluation can facilitate data appraisal, extraction and synthesis across a range of methodologies in diffuse or ‘soft’ topics. Synthesis can be facilitated further by using software, such as the Microsoft ‘Access’ database, for managing information. PMID:15606880

Developing methods for systematic reviewing in health services delivery and organization: an example from a review of access to health care for people with learning disabilities. Part 2. Evaluation of the literature--a practical guide.

PubMed

Alborz, Alison; McNally, Rosalind

2004-12-01

To develop methods to facilitate the 'systematic' review of evidence from a range of methodologies on diffuse or 'soft' topics, as exemplified by 'access to health care'. Twenty-eight bibliographic databases, research registers, organizational websites or library catalogues. Reference lists from identified studies. Contact with experts and service users. Current awareness and contents alerting services in the area of learning disabilities. Inclusion criteria were English language literature from 1980 onwards, relating to people with learning disabilities of any age and all study designs. The main criteria for assessment was relevance to Guillifords' model of access to health care which was adapted to the circumstances of people with learning disabilities. Selected studies were evaluated for scientific rigour then data was extracted and the results synthesized. Quality assessment was by an initial set of 'generic' quality indicators. This enabled further evidence selection before evaluation of findings according to specific criteria for qualitative, quantitative or mixed-method studies. Eighty-two studies were fully evaluated. Five studies were rated 'highly rigorous', 22 'rigorous', 46 'less rigorous' and nine 'poor' papers were retained as the sole evidence covering aspects of the guiding model. The majority of studies were quantitative but used only descriptive statistics. Most evidence lacked methodological detail, which often lowered final quality ratings. The application of a consistent structure to quality evaluation can facilitate data appraisal, extraction and synthesis across a range of methodologies in diffuse or 'soft' topics. Synthesis can be facilitated further by using software, such as the microsoft 'access' database, for managing information.

75 FR 5589 - Science Advisory Board Staff Office; Request for Public Nominations of Experts To Conduct a Peer...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-03

... Conductivity Using Field Data: An Adaptation of the U.S. EPA's Standard Methodology for Deriving Water Quality... Adaptation of the U.S. EPA's Standard Methodology for Deriving Water Quality Criteria'' DATES: Nominations... Deriving Water Quality Criteria'' should be directed to Dr. Michael Slimak, ORD's Associate Director of...

Interpreting drinking water quality in the distribution system using Dempster-Shafer theory of evidence.

PubMed

Sadiq, Rehan; Rodriguez, Manuel J

2005-04-01

Interpreting water quality data routinely generated for control and monitoring purposes in water distribution systems is a complicated task for utility managers. In fact, data for diverse water quality indicators (physico-chemical and microbiological) are generated at different times and at different locations in the distribution system. To simplify and improve the understanding and the interpretation of water quality, methodologies for aggregation and fusion of data must be developed. In this paper, the Dempster-Shafer theory also called theory of evidence is introduced as a potential methodology for interpreting water quality data. The conceptual basis of this methodology and the process for its implementation are presented by two applications. The first application deals with the interpretation of spatial water quality data fusion, while the second application deals with the development of water quality index based on key monitored indicators. Based on the obtained results, the authors discuss the potential contribution of theory of evidence as a decision-making tool for water quality management.

A framework for evaluating e-health: Systematic review of studies assessing the quality of health information and services for patients on the Internet

PubMed Central

Eysenbach, Gunther

2000-01-01

Context A recent concern and topic of many publications in the last three years has been the quality of health information and services for the public on the Internet. Objectives To identify and summarize studies published in the peer-reviewed literature evaluating the quality of information and services for consumers on the Internet, including information published on web sites, information on newsgroups and mailing lists and other venues such as email contacts with doctors, as well as studies evaluating the quality of ehealth services such as cyberdoctors and cyberpharmacies. Data Sources MEDLINE and PREMEDLINE (1966 - May 2000), Science Citation Index (1992-May 2000), Social Sciences Citation Index (1992- May 2000), Arts and Humanities Citation Index (1992-May 2000) and a personal bibliographic database. Study Selection We included empirical studies where investigators searched the Internet systematically for specific health information or clearly define a set of specific services to be included, evaluated the quality of information or services found, and reported quantitative data. Data Extraction Study characteristics, medical domain, search strategies used, quality criteria and methodology of quality assessment, results (number of sites rated as sufficient pertaining to a quality), quality and rigor of study methodology and reporting. Data Synthesis A total of 41 studies met the inclusion criteria, dealing either with content of websites, information on e-commerce sites, quality of online-care or community venues. A) Content: 29 evaluated information on websites, of those 5 evaluated information on websites from the field of pediatrics, 3 from oncology, 3 pharmacology information, 2 nutrition information, 4 general clinical information and 12 specific information from other clinical disciplines. Studies varied widely in methodology, quality and results. Among the 29 studies dealing with quality of health information on websites, one study evaluated the authority of source, 19 studies checked sites for presence or absences of technical criteria (such as disclosure of sponsorship, authorship, presence of references or last update), three evaluated readability, 20 evaluated the accuracy of information, and 12 content completeness. B) E-Commerce: Three studies dealt with drug information on e-commerce sites. To evaluate the quality authors extracted prices, checked for completeness of online-history taking and/or information provided on the site e.g. pertaining to contraindications or the presence/absence of disclaimers and/or liability waivers. Only one of these three studies actually used the service by ordering drugs, allowing to evaluate quality of online-advice, qualification of cyberdocs, delivery time, reasons for non-delivery. C) Care: Five studies dealt with the quality of online consultations, of them one dealt with advice given by ordinary physicians in response to a unsolicited fictionous patient request, two evaluated the responses of cyberdocs soliciting patient requests, and two evaluated advice given in response to a request for an online prescription directed to drug e-commerce sites. D) Community: Seven studies evaluated messages on mailing lists or usenet newsgroups. Two studies collected messages from a venue and evaluated them for accuracy, two studies posted a "test" message on a newsgroup and evaluated the accuracy of responses. In three studies authors used the cumulative impact factor of the published research of the mailing list contributors as an indicator for the qualification of the authors and thus as quality indicator of the mailing list. Of the 23 studies evaluating accuracy and/or completeness of information provided on websites, 10 used guidelines as gold standard (all of the to extract a-priori criteria), five used peer-reviewed literature (all to compare information a posteriori), two used textbooks, one used consensus among the raters and three used the personal experience or opinion of the author. All three studies which compared information against personal opinion came to a positive conclusion regarding the accuracy of information, while all of the more rigorous studies comparing information against guidelines concluded that much of the information found on the web were of low quality. In two cases it was not reported where the gold standard comes from. 9 studies used more than one rater to assess a website, 6 of them provided some sort of information on inter-observer variability. Conclusions Methodology, results and conclusions of investigators vary widely. There is a wide variability even regarding the evaluation of formal criteria such as authorship and references. Differences in study conclusions regarding the quality of Internet information are likely a result of difference in study rigor, evaluation criteria and topic chosen. All but five studies concluded that quality is a problem on the Internet. The rigor of these five studies coming to a more positive conclusion as expressed in a "assessment quality score" was significantly inferior to the remaining studies. Although there were two comparative studies of the quality of information on the Internet compared with information found outside of the Internet, there is little evidence that health information found on the Internet is worse than health information in traditional media. A conceptual and methodological framework is presented for describing, comparing, and analyzing the structure and quality of e-health, based on Donabedians quality measures of structure, process and outcome.

National Water Quality Laboratory - A Profile

USGS Publications Warehouse

Raese, Jon W.

2001-01-01

The U.S. Geological Survey (USGS) National Water Quality Laboratory (NWQL) is a full-service laboratory that specializes in environmental analytical chemistry. The NWQL's primary mission is to support USGS programs requiring environmental analyses that provide consistent methodology for national assessment and trends analysis. The NWQL provides the following: high-quality chemical data; consistent, published, state-of-the-art methodology; extremely low-detection levels; high-volume capability; biological unit for identifying benthic invertebrates; quality assurance for determining long-term water-quality trends; and a professional staff.

Assessing the Methodological Quality of Glaucoma Clinical Practice Guidelines and Their Recommendations on Microinvasive Glaucoma Surgery: A Systematic Review.

PubMed

Michaelov, Evan; Armstrong, James J; Nguyen, Mary; Instrum, Bridget; Lam, Tracey; Denstedt, James; Hutnik, Cindy M L

2018-02-01

Clinical practice guidelines (CPG) are regarded by many as critical communications providing guidance within specific medical fields. Over a decade ago, the first microinvasive glaucoma surgical (MIGS) procedures were introduced. Since then, a number of these novel intraocular pressure controlling surgical options have been approved worldwide. Governing bodies and health care administration often utilize CPGs when considering funding for newer technologies. This highlights the importance of well-written, accurate, and up-to-date CPGs in the rapidly evolving field of MIGS. If CPGs are unable to fill this role, their use in treatment decision-making is doing a disservice to patients, who will be denied currently available and potentially superior care. To determine the overall value of a CPG, the methodological quality with which it was developed, in addition to the current relevance and appropriateness of its recommendations, should be evaluated. The objective of the present study was to assess the methodological quality of currently available international glaucoma CPGs, as well as their coverage of MIGS as a surrogate marker of relevance and appropriateness to policy-makers and ophthalmologists alike. To identify potentially relevant CPGs, a predefined search strategy was used to search the following databases: Medline, EMBASE, BIOSIS, and Web of Science. All CPGs related to adult glaucoma and published in English were included. CPG methodological quality was assessed by 3 individuals using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool. Studies were then assessed for coverage of MIGS devices and procedures. Search strategy and subsequent screening identified 11 CPGs for analysis. Eight were of high quality according to the AGREE II criteria. Three included basic information on MIGS, but none provided specific recommendations regarding their indications or which patient populations would benefit most. Many international glaucoma CPGs are of high methodological quality. However, coverage of MIGS is sparse, nonspecific and in many instances, absent. This causes CPGs to be a suboptimal source in guiding physicians and health policy-makers in areas characterized by novel and/or rapidly evolving technologies. Mechanisms to incorporate updated evidence in CPGs would have to be considered before they can be used as a source of contemporary clinical decision-making.

A Systematic and Transparent Approach for Assessing the Methodological Quality of Intervention Effectiveness Research: The Study Design and Implementation Assessment Device (Study DIAD)

ERIC Educational Resources Information Center

Valentine, Jeffrey C.; Cooper, Harris

2008-01-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of…

Methodological Quality of National Guidelines for Pediatric Inpatient Conditions

PubMed Central

Hester, Gabrielle; Nelson, Katherine; Mahant, Sanjay; Eresuma, Emily; Keren, Ron; Srivastava, Rajendu

2014-01-01

Background Guidelines help inform standardization of care for quality improvement (QI). The Pediatric Research in Inpatient Settings (PRIS) network published a prioritization list of inpatient conditions with high prevalence, cost, and variation in resource utilization across children’s hospitals. The methodological quality of guidelines for priority conditions is unknown. Objective To rate the methodological quality of national guidelines for 20 priority pediatric inpatient conditions. Design We searched sources including PubMed for national guidelines published 2002–2012. Guidelines specific to one organism, test or treatment, or institution were excluded. Guidelines were rated by two raters using a validated tool (AGREE II) with an overall rating on a 7-point scale (7–highest). Inter-rater reliability was measured with a weighted kappa coefficient. Results 17 guidelines met inclusion criteria for 13 conditions, 7 conditions yielded no relevant national guidelines. The highest methodological quality guidelines were for asthma, tonsillectomy, and bronchiolitis (mean overall rating 7, 6.5 and 6.5 respectively); the lowest were for sickle cell disease (2 guidelines) and dental caries (mean overall rating 4, 3.5, and 3 respectively). The overall weighted kappa was 0.83 (95% confidence interval 0.78–0.87). Conclusions We identified a group of moderate to high methodological quality national guidelines for priority pediatric inpatient conditions. Hospitals should consider these guidelines to inform QI initiatives. PMID:24677729

A systematic review of the therapeutic effects of Reiki.

PubMed

vanderVaart, Sondra; Gijsen, Violette M G J; de Wildt, Saskia N; Koren, Gideon

2009-11-01

Reiki is an ancient form of Japanese healing. While this healing method is widely used for a variety of psychologic and physical symptoms, evidence of its effectiveness is scarce and conflicting. The purpose of this systematic review was to try to evaluate whether Reiki produces a significant treatment effect. Studies were identified using an electronic search of Medline, EMBASE, Cochrane Library, and Google Scholar. Quality of reporting was evaluated using a modified CONSORT Criteria for Herbal Interventions, while methodological quality was assessed using the Jadad Quality score. Two (2) researchers selected articles based on the following features: placebo or other adequate control, clinical investigation on humans, intervention using a Reiki practitioner, and published in English. They independently extracted data on study design, inclusion criteria, type of control, sample size, result, and nature of outcome measures. The modified CONSORT Criteria indicated that all 12 trials meeting the inclusion criteria were lacking in at least one of the three key areas of randomization, blinding, and accountability of all patients, indicating a low quality of reporting. Nine (9) of the 12 trials detected a significant therapeutic effect of the Reiki intervention; however, using the Jadad Quality score, 11 of the 12 studies ranked "poor." The serious methodological and reporting limitations of limited existing Reiki studies preclude a definitive conclusion on its effectiveness. High-quality randomized controlled trials are needed to address the effectiveness of Reiki over placebo.

Assessment of air quality in Haora River basin using fuzzy multiple-attribute decision making techniques.

PubMed

Singh, Ajit Pratap; Chakrabarti, Sumanta; Kumar, Sumit; Singh, Anjaney

2017-08-01

This paper deals with assessment of air quality in Haora River basin using two techniques. Initially, air quality indices were evaluated using a modified EPA method. The indices were also evaluated using a fuzzy comprehensive assessment (FCA) method. The results obtained from the fuzzy comprehensive assessment method were compared to that obtained from the modified EPA method. To illustrate the applicability of the methodology proposed herein, a case study has been presented. Air samples have been collected at 10 sampling sites located along Haora River. Six important air pollutants, namely, carbon monoxide, sulfur dioxide, nitrogen dioxide, suspended particulate matter (SPM), PM 10 , and lead, were monitored continuously, and air quality maps were generated on the GIS platform. Comparison of the methodologies has clearly highlighted superiority and robustness of the fuzzy comprehensive assessment method in determining air quality indices under study. It has effectively addressed the inherent uncertainties involved in the evaluation, modeling, and interpretation of sampling data, which was beyond the scope of the traditional weighted approaches employed otherwise. The FCA method is robust and prepares a credible platform of air quality evaluation and identification, in face of the uncertainties that remain eclipsed in the traditional approaches like the modified EPA method. The insights gained through the present study are believed to be of pivotal significance in guiding the development and implementation of effective environmental remedial action plans in the study area.

Methodological issues and recommendations for systematic reviews of prognostic studies: an example from cardiovascular disease.

PubMed

Dretzke, Janine; Ensor, Joie; Bayliss, Sue; Hodgkinson, James; Lordkipanidzé, Marie; Riley, Richard D; Fitzmaurice, David; Moore, David

2014-12-03

Prognostic factors are associated with the risk of future health outcomes in individuals with a particular health condition. The prognostic ability of such factors is increasingly being assessed in both primary research and systematic reviews. Systematic review methodology in this area is continuing to evolve, reflected in variable approaches to key methodological aspects. The aim of this article was to (i) explore and compare the methodology of systematic reviews of prognostic factors undertaken for the same clinical question, (ii) to discuss implications for review findings, and (iii) to present recommendations on what might be considered to be 'good practice' approaches. The sample was comprised of eight systematic reviews addressing the same clinical question, namely whether 'aspirin resistance' (a potential prognostic factor) has prognostic utility relative to future vascular events in patients on aspirin therapy for secondary prevention. A detailed comparison of methods around study identification, study selection, quality assessment, approaches to analysis, and reporting of findings was undertaken and the implications discussed. These were summarised into key considerations that may be transferable to future systematic reviews of prognostic factors. Across systematic reviews addressing the same clinical question, there were considerable differences in the numbers of studies identified and overlap between included studies, which could only partially be explained by different study eligibility criteria. Incomplete reporting and differences in terminology within primary studies hampered study identification and selection process across reviews. Quality assessment was highly variable and only one systematic review considered a checklist for studies of prognostic questions. There was inconsistency between reviews in approaches towards analysis, synthesis, addressing heterogeneity and reporting of results. Different methodological approaches may ultimately affect the findings and interpretation of systematic reviews of prognostic research, with implications for clinical decision-making.

The Ability of Indonesian EFL Learners in Writing Academic Papers

ERIC Educational Resources Information Center

Husin, M. Said; Nurbayani, Etty

2017-01-01

This study is meant to examine the thesis quality of students of English Department at IAIN Samarinda. Through the descriptive-quantitative research, the thesis quality of students of English Department at IAIN Samarinda is reviewed from the aspects of language, structure, concepts understanding, theoretical framework, methodology, content,…

A New Admission System Model for Teacher Colleges

ERIC Educational Resources Information Center

Katz, Sara; Frish, Yehiel

2016-01-01

Purpose: Aspects of intellectual competence would not be sufficient for quality teaching that requires a mix of intellectual and personal qualities. The purpose of this paper was to elicit personal attributes of teachers' college applicants. Design/methodology/approach: This qualitative case study consisted of 99 participants aged 20-24 years of…

TQM Paradigm for Higher Education in the Philippines

ERIC Educational Resources Information Center

Rodriguez, Janette; Valenzuela, Madonna; Ayuyao, Nunilon

2018-01-01

Purpose: Critical success factors (CSFs) in total quality management (TQM) implementation are vital to the quality improvement of organizations, including higher education institutions (HEIs). The present study aims to attempt to develop a TQM paradigm contextualized to HEIs in the Philippine setting. Design/methodology/approach: A total of 309…

Systematically Evaluating the Effectiveness of Quality Assurance Programmes in Leading to Improvements in Institutional Performance

ERIC Educational Resources Information Center

Lillis, Deirdre

2012-01-01

Higher education institutions worldwide invest significant resources in their quality assurance systems. Little empirical evidence exists that demonstrates the effectiveness (or otherwise) of these systems. Methodological approaches for determining effectiveness are also underdeveloped. Self-study-with-peer-review is a widely used model for…

Identifying Quality in Preschool Education: Progress and Challenge

ERIC Educational Resources Information Center

Hughes, Jan N.

2010-01-01

In this article, the author comments on Dominguez, Vitiello, Maier, and Greenfield's (2010) article on identifying quality in preschool education. Dominguez et al. have conducted a methodologically sophisticated study describing the growth of learning behavior among Head Start children. By doing so, they contribute to a growing body of evidence…

Stakeholder Perceptions of Secondary Education Quality in Sokoto State, Nigeria

ERIC Educational Resources Information Center

Ibrahim, Yaro; Arshad, Rozita; Salleh, Dani

2017-01-01

Purpose: This study aims to obtain stakeholder perceptions of secondary education quality in Sokoto State, Nigeria. Design/methodology/approach: A qualitative research approach was used by conducting interviews. Data were purposively collected from a sample of 15 education stakeholders in Sokoto State, and analyzed to extract major themes using…

A systematic and transparent approach for assessing the methodological quality of intervention effectiveness research: the Study Design and Implementation Assessment Device (Study DIAD).

PubMed

Valentine, Jeffrey C; Cooper, Harris

2008-06-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of studies. These tools tend to (a) be insufficiently operational, (b) rely on arbitrary post-hoc decision rules, and (c) result in a single number to represent a multidimensional construct. In response to these limitations, a multilevel and hierarchical instrument was developed in consultation with a wide range of methodological and statistical experts. The instrument focuses on the operational details of studies and results in a profile of scores instead of a single score to represent study quality. A pilot test suggested that satisfactory between-judge agreement can be obtained using well-trained raters working in naturalistic conditions. Limitations of the instrument are discussed, but these are inherent in making decisions about study quality given incomplete reporting and in the absence of strong, contextually based information about the effects of design flaws on study outcomes. (PsycINFO Database Record (c) 2008 APA, all rights reserved).

[Satisfaction and perceived quality of people insured by the Social Health Protection in Mexico. Methodological foundations].

PubMed

Saturno-Hernández, Pedro J; Gutiérrez-Reyes, Juan Pablo; Vieyra-Romero, Waldo Ivan; Romero-Martínez, Martín; O'Shea-Cuevas, Gabriel Jaime; Lozano-Herrera, Javier; Tavera-Martínez, Sonia; Hernández-Ávila, Mauricio

2016-01-01

To describe the conceptual framework and methods for implementation and analysis of the satisfaction survey of the Mexican System for Social Protection in Health. We analyze the methodological elements of the 2013, 2014 and 2015 surveys, including the instrument, sampling method and study design, conceptual framework, and characteristics and indicators of the analysis. The survey captures information on perceived quality and satisfaction. Sampling has national and State representation. Simple and composite indicators (index of satisfaction and rate of reported quality problems) are built and described. The analysis is completed using Pareto diagrams, correlation between indicators and association with satisfaction by means of multivariate models. The measurement of satisfaction and perceived quality is a complex but necessary process to comply with regulations and to identify strategies for improvement. The described survey presents a design and rigorous analysis focused on its utility for improving.

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation.

PubMed

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7-8) versus Group B: 8 (7-9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals.

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation

PubMed Central

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Introduction Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. Methods In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Results Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7–8) versus Group B: 8 (7–9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). Conclusion The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals. PMID:27167982

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

Assessing the quality of the volume-outcome relationship in uro-oncology.

PubMed

Mayer, Erik K; Purkayastha, Sanjay; Athanasiou, Thanos; Darzi, Ara; Vale, Justin A

2009-02-01

To assess systematically the quality of evidence for the volume-outcome relationship in uro-oncology, and thus facilitate the formulating of health policy within this speciality, as 'Implementation of Improving Outcome Guidance' has led to centralization of uro-oncology based on published studies that have supported a 'higher volume-better outcome' relationship, but improved awareness of methodological drawbacks in health service research has questioned the strength of this proposed volume-outcome relationship. We systematically searched previous relevant reports and extracted all articles from 1980 onwards assessing the volume-outcome relationship for cystectomy, prostatectomy and nephrectomy at the institution and/or surgeon level. Studies were assessed for their methodological quality using a previously validated rating system. Where possible, meta-analytical methods were used to calculate overall differences in outcome measures between low and high volume healthcare providers. In all, 22 studies were included in the final analysis; 19 of these were published in the last 5 years. Only four studies appropriately explored the effect of both the institution and surgeon volume on outcome measures. Mortality and length of stay were the most frequently measured outcomes. The median total quality scores within each of the operation types were 8.5, 9 and 8 for cystectomy, prostatectomy and nephrectomy, respectively (possible maximum score 18). Random-effects modelling showed a higher risk of mortality in low-volume institutions than in higher-volume institutions for both cystectomy and nephrectomy (odds ratio 1.88, 95% confidence interval 1.54-2.29, and 1.28, 1.10-1.49, respectively). The methodological quality of volume-outcome research as applied to cystectomy, prostatectomy and nephrectomy is only modest at best. Accepting several limitations, pooled analysis confirms a higher-volume, lower-mortality relationship for cystectomy and nephrectomy. Future research should focus on the development of a quality framework with a validated scoring system for the bench-marking of data to improve validity and facilitate rational policy-making within the speciality of uro-oncology.

Symptomatic spinal metastasis: A systematic literature review of the preoperative prognostic factors for survival, neurological, functional and quality of life in surgically treated patients and methodological recommendations for prognostic studies

PubMed Central

Nater, Anick; Martin, Allan R.; Sahgal, Arjun; Choi, David

2017-01-01

Purpose While several clinical prediction rules (CPRs) of survival exist for patients with symptomatic spinal metastasis (SSM), these have variable prognostic ability and there is no recognized CPR for health related quality of life (HRQoL). We undertook a critical appraisal of the literature to identify key preoperative prognostic factors of clinical outcomes in patients with SSM who were treated surgically. The results of this study could be used to modify existing or develop new CPRs. Methods Seven electronic databases were searched (1990–2015), without language restriction, to identify studies that performed multivariate analysis of preoperative predictors of survival, neurological, functional and HRQoL outcomes in surgical patients with SSM. Individual studies were assessed for class of evidence. The strength of the overall body of evidence was evaluated using GRADE for each predictor. Results Among 4,818 unique citations, 17 were included; all were in English, rated Class III and focused on survival, revealing a total of 46 predictors. The strength of the overall body of evidence was very low for 39 and low for 7 predictors. Due to considerable heterogeneity in patient samples and prognostic factors investigated as well as several methodological issues, our results had a moderately high risk of bias and were difficult to interpret. Conclusions The quality of evidence for predictors of survival was, at best, low. We failed to identify studies that evaluated preoperative prognostic factors for neurological, functional, or HRQoL outcomes in surgical patients with SSM. We formulated methodological recommendations for prognostic studies to promote acquiring high-quality evidence to better estimate predictor effect sizes to improve patient education, surgical decision-making and development of CPRs. PMID:28225772

Trial-Based Economic Evaluations in Occupational Health

PubMed Central

van Wier, Marieke F.; Tompa, Emile; Bongers, Paulien M.; van der Beek, Allard J.; van Tulder, Maurits W.; Bosmans, Judith E.

2014-01-01

To allocate available resources as efficiently as possible, decision makers need information on the relative economic merits of occupational health and safety (OHS) interventions. Economic evaluations can provide this information by comparing the costs and consequences of alternatives. Nevertheless, only a few of the studies that consider the effectiveness of OHS interventions take the extra step of considering their resource implications. Moreover, the methodological quality of those that do is generally poor. Therefore, this study aims to help occupational health researchers conduct high-quality trial-based economic evaluations by discussing the theory and methodology that underlie them, and by providing recommendations for good practice regarding their design, analysis, and reporting. This study also helps consumers of this literature with understanding and critically appraising trial-based economic evaluations of OHS interventions. PMID:24854249

Trial-based economic evaluations in occupational health: principles, methods, and recommendations.

PubMed

van Dongen, Johanna M; van Wier, Marieke F; Tompa, Emile; Bongers, Paulien M; van der Beek, Allard J; van Tulder, Maurits W; Bosmans, Judith E

2014-06-01

To allocate available resources as efficiently as possible, decision makers need information on the relative economic merits of occupational health and safety (OHS) interventions. Economic evaluations can provide this information by comparing the costs and consequences of alternatives. Nevertheless, only a few of the studies that consider the effectiveness of OHS interventions take the extra step of considering their resource implications. Moreover, the methodological quality of those that do is generally poor. Therefore, this study aims to help occupational health researchers conduct high-quality trial-based economic evaluations by discussing the theory and methodology that underlie them, and by providing recommendations for good practice regarding their design, analysis, and reporting. This study also helps consumers of this literature with understanding and critically appraising trial-based economic evaluations of OHS interventions.

Methodological Quality of Systematic Reviews Published in the Urological Literature from 1998 to 2012.

PubMed

Corbyons, Katherine; Han, Julia; Neuberger, Molly M; Dahm, Philipp

2015-11-01

Systematic reviews synthesize the current best evidence to address a clinical question. Given the growing emphasis on evidence-based clinical practice, systematic reviews are being increasingly sought after and published. We previously reported limitations in the methodological quality of 57 individual systematic reviews published from 1998 to 2008. We provide an update to our previous study, adding systematic reviews published from 2009 to 2012. We systematically searched PubMed® and hand searched the table of contents of 4 major urological journals to identify systematic reviews related to questions of prevention and therapy. Two independent reviewers with prior formal evidence-based medicine training assessed the methodological quality using the validated 11-point AMSTAR (A Measurement Tool to Assess Systematic Reviews) instrument. We performed predefined statistical hypothesis testing for differences by publication period (1998 to 2008 vs 2009 to 2012) and journal of publication. We performed statistical testing using SPSS®, version 23.0 with a 2-sided α of 0.05 using the Student t-test, ANOVA and the chi-square test. A total of 113 systematic reviews published from 2009 to 2012 met study inclusion criteria. The most common topics were oncology (44 reviews or 38.9%), voiding dysfunction (26 or 23.0%) and stones/endourology (13 or 11.5%). The largest contributor was European Urology (46 reviews or 40.7%), followed by BJU International (31 or 27.4%) and The Journal of Urology® (22 or 19.5%). The mean ± SD AMSTAR score for the 2009 to 2012 period was 5.3 ± 2.3 compared to 4.8 ± 2.0 for 1998 to 2008 with a mean difference of 0.5 (95% CI 0.2 to 1.2, p = 0.133). While the number of systematic reviews published in the urological literature has increased substantially, the methodological quality of these studies remains suboptimal. Systematic review authors and editors should make every effort to adhere to well established methodological standards to enhance the impact of their research efforts. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Social Skills Interventions for Students with Challenging Behavior: Evaluating the Quality of the Evidence Base

ERIC Educational Resources Information Center

Hutchins, Nancy S.; Burke, Mack D.; Hatton, Heather; Bowman-Perrott, Lisa

2017-01-01

This study provides results on a methodological quality review of the single-case research literature from 1998 to 2014 on the use of social skills interventions for students with challenging behavior. A systematic review of the social skills literature was conducted with the intent of updating the Mathur et al. study of social skills…

Implementing a Quality Management Framework in a Higher Education Organisation: A Case Study

ERIC Educational Resources Information Center

O'Mahony, Kim; Garavan, Thomas N.

2012-01-01

Purpose: This paper aims to report and analyse the lessons learned from a case study on the implementation of a quality management system within an IT Division in a higher education (HE) organisation. Design/methodology/approach: The paper is based on a review of the relevant literatures and the use of primary sources such as document analysis,…

Does Online Learning Deliver? A Comparison of Student Teacher Outcomes from Candidates in Face-to-Face and Online Program Pathways

ERIC Educational Resources Information Center

Mollenkopf, Dawn; Vu, Phu; Crow, Sherry; Black, Chilene

2017-01-01

Although a growing number of students are accessing online learning programs, there are concerns about the quality of these programs. Multiple reports examined online program quality, but many of those studies had methodology and design issues that make it difficult to interpret the findings conclusively. This study attempted to address the…

How to Enhance the Impact of Training on Service Quality? Evidence from Malaysian Public Sector Context

ERIC Educational Resources Information Center

Zumrah, Abdul Rahim

2015-01-01

Purpose: The purpose of this study is to highlight the importance role of transfer of training as a mediator in the relationship between training and service quality. Design/methodology/approach: The data of this study were collected from three sources: the employees of public sector organizations in Malaysia who participated in a Basic Financial…