The methodological quality of systematic reviews of animal studies in dentistry.

PubMed

Faggion, C M; Listl, S; Giannakopoulos, N N

2012-05-01

Systematic reviews and meta-analyses of animal studies are important for improving estimates of the effects of treatment and for guiding future clinical studies on humans. The purpose of this systematic review was to assess the methodological quality of systematic reviews and meta-analyses of animal studies in dentistry through using a validated checklist. A literature search was conducted independently and in duplicate in the PubMed and LILACS databases. References in selected systematic reviews were assessed to identify other studies not captured by the electronic searches. The methodological quality of studies was assessed independently and in duplicate by using the AMSTAR checklist; the quality was scored as low, moderate, or high. The reviewers were calibrated before the assessment and agreement between them was assessed using Cohen's Kappa statistic. Of 444 studies retrieved, 54 systematic reviews were selected after full-text assessment. Agreement between the reviewers was regarded as excellent. Only two studies were scored as high quality; 17 and 35 studies were scored as medium and low quality, respectively. There is room for improvement of the methodological quality of systematic reviews of animal studies in dentistry. Checklists, such as AMSTAR, can guide researchers in planning and executing systematic reviews and meta-analyses. For determining the need for additional investigations in animals and in order to provide good data for potential application in human, such reviews should be based on animal experiments performed according to sound methodological principles. Copyright © 2011 Elsevier Ltd. All rights reserved.

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.

PubMed

Dosenovic, Svjetlana; Jelicic Kadic, Antonia; Vucic, Katarina; Markovina, Nikolina; Pieper, Dawid; Puljak, Livia

2018-05-08

Systematic reviews (SRs) in the field of neuropathic pain (NeuP) are increasingly important for decision-making. However, methodological flaws in SRs can reduce the validity of conclusions. Hence, it is important to assess the methodological quality of NeuP SRs critically. Additionally, it remains unclear which assessment tool should be used. We studied the methodological quality of SRs published in the field of NeuP and compared two assessment tools. We systematically searched 5 electronic databases to identify SRs of randomized controlled trials of interventions for NeuP available up to March 2015. Two independent reviewers assessed the methodological quality of the studies using the Assessment of Multiple Systematic Reviews (AMSTAR) and the revised AMSTAR (R-AMSTAR) tools. The scores were converted to percentiles and ranked into 4 grades to allow comparison between the two checklists. Gwet's AC1 coefficient was used for interrater reliability assessment. The 97 included SRs had a wide range of methodological quality scores (AMSTAR median (IQR): 6 (5-8) vs. R-AMSTAR median (IQR): 30 (26-35)). The overall agreement score between the 2 raters was 0.62 (95% CI 0.39-0.86) for AMSTAR and 0.62 (95% CI 0.53-0.70) for R-AMSTAR. The 31 Cochrane systematic reviews (CSRs) were consistently ranked higher than the 66 non-Cochrane systematic reviews (NCSRs). The analysis of individual domains showed the best compliance in a comprehensive literature search (item 3) on both checklists. The results for the domain that was the least compliant differed: conflict of interest (item 11) was the item most poorly reported on AMSTAR vs. publication bias assessment (item 10) on R-AMSTAR. A high positive correlation between the total AMSTAR and R-AMSTAR scores for all SRs, as well as for CSRs and NCSRs, was observed. The methodological quality of analyzed SRs in the field of NeuP was not optimal, and CSRs had a higher quality than NCSRs. Both AMSTAR and R-AMSTAR tools produced comparable quality ratings. Our results point out to weaknesses in the methodology of existing SRs on interventions for the management NeuP and call for future improvement by better adherence to analyzed quality checklists, either AMSTAR or R-AMSTAR.

METHODOLOGICAL QUALITY OF ECONOMIC EVALUATIONS ALONGSIDE TRIALS OF KNEE PHYSIOTHERAPY.

PubMed

García-Pérez, Lidia; Linertová, Renata; Arvelo-Martín, Alejandro; Guerra-Marrero, Carolina; Martínez-Alberto, Carlos Enrique; Cuéllar-Pompa, Leticia; Escobar, Antonio; Serrano-Aguilar, Pedro

2017-01-01

The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis. Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale. All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account. Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

Author-paper affiliation network architecture influences the methodological quality of systematic reviews and meta-analyses of psoriasis.

PubMed

Sanz-Cabanillas, Juan Luis; Ruano, Juan; Gomez-Garcia, Francisco; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Maestre-Lopez, Beatriz; Gonzalez-Padilla, Marcelino; Carmona-Fernandez, Pedro J; Velez Garcia-Nieto, Antonio; Isla-Tejera, Beatriz

2017-01-01

Moderate-to-severe psoriasis is associated with significant comorbidity, an impaired quality of life, and increased medical costs, including those associated with treatments. Systematic reviews (SRs) and meta-analyses (MAs) of randomized clinical trials are considered two of the best approaches to the summarization of high-quality evidence. However, methodological bias can reduce the validity of conclusions from these types of studies and subsequently impair the quality of decision making. As co-authorship is among the most well-documented forms of research collaboration, the present study aimed to explore whether authors' collaboration methods might influence the methodological quality of SRs and MAs of psoriasis. Methodological quality was assessed by two raters who extracted information from full articles. After calculating total and per-item Assessment of Multiple Systematic Reviews (AMSTAR) scores, reviews were classified as low (0-4), medium (5-8), or high (9-11) quality. Article metadata and journal-related bibliometric indices were also obtained. A total of 741 authors from 520 different institutions and 32 countries published 220 reviews that were classified as high (17.2%), moderate (55%), or low (27.7%) methodological quality. The high methodological quality subnetwork was larger but had a lower connection density than the low and moderate methodological quality subnetworks; specifically, the former contained relatively fewer nodes (authors and reviews), reviews by authors, and collaborators per author. Furthermore, the high methodological quality subnetwork was highly compartmentalized, with several modules representing few poorly interconnected communities. In conclusion, structural differences in author-paper affiliation network may influence the methodological quality of SRs and MAs on psoriasis. As the author-paper affiliation network structure affects study quality in this research field, authors who maintain an appropriate balance between scientific quality and productivity are more likely to develop higher quality reviews.

Guidance on assessing the methodological and reporting quality of toxicologically relevant studies: A scoping review.

PubMed

Samuel, Gbeminiyi O; Hoffmann, Sebastian; Wright, Robert A; Lalu, Manoj Mathew; Patlewicz, Grace; Becker, Richard A; DeGeorge, George L; Fergusson, Dean; Hartung, Thomas; Lewis, R Jeffrey; Stephens, Martin L

2016-01-01

Assessments of methodological and reporting quality are critical to adequately judging the credibility of a study's conclusions and to gauging its potential reproducibility. To aid those seeking to assess the methodological or reporting quality of studies relevant to toxicology, we conducted a scoping review of the available guidance with respect to four types of studies: in vivo and in vitro, (quantitative) structure-activity relationships ([Q]SARs), physico-chemical, and human observational studies. Our aims were to identify the available guidance in this diverse literature, briefly summarize each document, and distill the common elements of these documents for each study type. In general, we found considerable guidance for in vivo and human studies, but only one paper addressed in vitro studies exclusively. The guidance for (Q)SAR studies and physico-chemical studies was scant but authoritative. There was substantial overlap across guidance documents in the proposed criteria for both methodological and reporting quality. Some guidance documents address toxicology research directly, whereas others address preclinical research generally or clinical research and therefore may not be fully applicable to the toxicology context without some translation. Another challenge is the degree to which assessments of methodological quality in toxicology should focus on risk of bias - as in clinical medicine and healthcare - or be broadened to include other quality measures, such as confirming the identity of test substances prior to exposure. Our review is intended primarily for those in toxicology and risk assessment seeking an entry point into the extensive and diverse literature on methodological and reporting quality applicable to their work. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

A flood tide of systematic reviews on endodontic posts: methodological assessment using of R-AMSTAR.

PubMed

Schmitter, M; Sterzenbach, G; Faggion, C M; Krastl, G

2013-06-01

To help the dental practitioner solve a specific clinical problem, systematic reviews (SRs) are seen as the best guide. In addition to the unmanageable quantity of SRs, however, one should be aware of their variable quality. The present review describes the methodological quality of SRs on postendodontic restorations to work out the value of these reviews for the dental practitioner. SRs were searched in April 2012, independently and in triplicate. Post survival was used as measure of outcome. The methodological quality of included SRs was assessed with the Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) checklist. Kappa statistics were used to assess reviewer agreement. Three hundred sixty-three papers were retrieved from the initial search. Ten SRs were included. One SR achieved a high R-AMSTAR score, whereas the other nine SRs achieved scores that indicate a substantial lack of methodological quality. Especially the items "grey literature," "combination of findings," "likelihood of publication bias," and conflict of interest" showed low R-AMSTAR scores. The three reviews with the highest R-AMSTAR scores tended to conclude that fewer failures occurred when using nonmetal posts. The reviewer agreement was excellent (kappa ranged from 0.79 to 0.85) in the R-AMSTAR classification. The approach presented revealed a lack of SRs with high methodological quality. Thus, no decisive conclusion can be drawn with respect to this topic. It appears that there is a trend for the superiority of fiber-reinforced posts. SRs must be of high methodological quality. This can be achieved by taking into consideration the results of this review. Improved methodological quality would make SRs more supportive for the general practitioner.

Information security system quality assessment through the intelligent tools

NASA Astrophysics Data System (ADS)

Trapeznikov, E. V.

2018-04-01

The technology development has shown the automated system information security comprehensive analysis necessity. The subject area analysis indicates the study relevance. The research objective is to develop the information security system quality assessment methodology based on the intelligent tools. The basis of the methodology is the information security assessment model in the information system through the neural network. The paper presents the security assessment model, its algorithm. The methodology practical implementation results in the form of the software flow diagram are represented. The practical significance of the model being developed is noted in conclusions.

Quality indicators for hip fracture care, a systematic review.

PubMed

Voeten, S C; Krijnen, P; Voeten, D M; Hegeman, J H; Wouters, M W J M; Schipper, I B

2018-05-17

Quality indicators are used to measure quality of care and enable benchmarking. An overview of all existing hip fracture quality indicators is lacking. The primary aim was to identify quality indicators for hip fracture care reported in literature, hip fracture audits, and guidelines. The secondary aim was to compose a set of methodologically sound quality indicators for the evaluation of hip fracture care in clinical practice. A literature search according to the PRISMA guidelines and an internet search were performed to identify hip fracture quality indicators. The indicators were subdivided into process, structure, and outcome indicators. The methodological quality of the indicators was judged using the Appraisal of Indicators through Research and Evaluation (AIRE) instrument. For structure and process indicators, the construct validity was assessed. Sixteen publications, nine audits and five guidelines were included. In total, 97 unique quality indicators were found: 9 structure, 63 process, and 25 outcome indicators. Since detailed methodological information about the indicators was lacking, the AIRE instrument could not be applied. Seven indicators correlated with an outcome measure. A set of nine quality indicators was extracted from the literature, audits, and guidelines. Many quality indicators are described and used. Not all of them correlate with outcomes of care and have been assessed methodologically. As methodological evidence is lacking, we recommend the extracted set of nine indicators to be used as the starting point for further clinical research. Future research should focus on assessing the clinimetric properties of the existing quality indicators.

Assessment of Methodological Quality of Economic Evaluations in Belgian Drug Reimbursement Applications

PubMed Central

Simoens, Steven

2013-01-01

Objectives This paper aims to assess the methodological quality of economic evaluations included in Belgian reimbursement applications for Class 1 drugs. Materials and Methods For 19 reimbursement applications submitted during 2011 and Spring 2012, a descriptive analysis assessed the methodological quality of the economic evaluation, evaluated the assessment of that economic evaluation by the Drug Reimbursement Committee and the response to that assessment by the company. Compliance with methodological guidelines issued by the Belgian Healthcare Knowledge Centre was assessed using a detailed checklist of 23 methodological items. The rate of compliance was calculated based on the number of economic evaluations for which the item was applicable. Results Economic evaluations tended to comply with guidelines regarding perspective, target population, subgroup analyses, comparator, use of comparative clinical data and final outcome measures, calculation of costs, incremental analysis, discounting and time horizon. However, more attention needs to be paid to the description of limitations of indirect comparisons, the choice of an appropriate analytic technique, the expression of unit costs in values for the current year, the estimation and valuation of outcomes, the presentation of results of sensitivity analyses, and testing the face validity of model inputs and outputs. Also, a large variation was observed in the scope and depth of the quality assessment by the Drug Reimbursement Committee. Conclusions Although general guidelines exist, pharmaceutical companies and the Drug Reimbursement Committee would benefit from the existence of a more detailed checklist of methodological items that need to be reported in an economic evaluation. PMID:24386474

Assessment of methodological quality of economic evaluations in belgian drug reimbursement applications.

PubMed

Simoens, Steven

2013-01-01

This paper aims to assess the methodological quality of economic evaluations included in Belgian reimbursement applications for Class 1 drugs. For 19 reimbursement applications submitted during 2011 and Spring 2012, a descriptive analysis assessed the methodological quality of the economic evaluation, evaluated the assessment of that economic evaluation by the Drug Reimbursement Committee and the response to that assessment by the company. Compliance with methodological guidelines issued by the Belgian Healthcare Knowledge Centre was assessed using a detailed checklist of 23 methodological items. The rate of compliance was calculated based on the number of economic evaluations for which the item was applicable. Economic evaluations tended to comply with guidelines regarding perspective, target population, subgroup analyses, comparator, use of comparative clinical data and final outcome measures, calculation of costs, incremental analysis, discounting and time horizon. However, more attention needs to be paid to the description of limitations of indirect comparisons, the choice of an appropriate analytic technique, the expression of unit costs in values for the current year, the estimation and valuation of outcomes, the presentation of results of sensitivity analyses, and testing the face validity of model inputs and outputs. Also, a large variation was observed in the scope and depth of the quality assessment by the Drug Reimbursement Committee. Although general guidelines exist, pharmaceutical companies and the Drug Reimbursement Committee would benefit from the existence of a more detailed checklist of methodological items that need to be reported in an economic evaluation.

Tracer methodology: an appropriate tool for assessing compliance with accreditation standards?

PubMed

Bouchard, Chantal; Jean, Olivier

2017-10-01

Tracer methodology has been used by Accreditation Canada since 2008 to collect evidence on the quality and safety of care and services, and to assess compliance with accreditation standards. Given the importance of this methodology in the accreditation program, the objective of this study is to assess the quality of the methodology and identify its strengths and weaknesses. A mixed quantitative and qualitative approach was adopted to evaluate consistency, appropriateness, effectiveness and stakeholder synergy in applying the methodology. An online questionnaire was sent to 468 Accreditation Canada surveyors. According to surveyors' perceptions, tracer methodology is an effective tool for collecting useful, credible and reliable information to assess compliance with Qmentum program standards and priority processes. The results show good coherence between methodology components (appropriateness of the priority processes evaluated, activities to evaluate a tracer, etc.). The main weaknesses are the time constraints faced by surveyors and management's lack of cooperation during the evaluation of tracers. The inadequate amount of time allowed for the methodology to be applied properly raises questions about the quality of the information obtained. This study paves the way for a future, more in-depth exploration of the identified weaknesses to help the accreditation organization make more targeted improvements to the methodology. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Comparison of methodological quality of positive versus negative comparative studies published in Indian medical journals: a systematic review

PubMed Central

Charan, Jaykaran; Chaudhari, Mayur; Jackson, Ryan; Mhaskar, Rahul; Reljic, Tea; Kumar, Ambuj

2015-01-01

Objectives Published negative studies should have the same rigour of methodological quality as studies with positive findings. However, the methodological quality of negative versus positive studies is not known. The objective was to assess the reported methodological quality of positive versus negative studies published in Indian medical journals. Design A systematic review (SR) was performed of all comparative studies published in Indian medical journals with a clinical science focus and impact factor >1 between 2011 and 2013. The methodological quality of randomised controlled trials (RCTs) was assessed using the Cochrane risk of bias tool, and the Newcastle-Ottawa scale for observational studies. The results were considered positive if the primary outcome was statistically significant and negative otherwise. When the primary outcome was not specified, we used data on the first outcome reported in the history followed by the results section. Differences in various methodological quality domains between positive versus negative studies were assessed by Fisher's exact test. Results Seven journals with 259 comparative studies were included in this SR. 24% (63/259) were RCTs, 24% (63/259) cohort studies, and 49% (128/259) case–control studies. 53% (137/259) of studies explicitly reported the primary outcome. Five studies did not report sufficient data to enable us to determine if results were positive or negative. Statistical significance was determined by p value in 78.3% (199/254), CI in 2.8% (7/254), both p value and CI in 11.8% (30/254), and only descriptive in 6.3% (16/254) of studies. The overall methodological quality was poor and no statistically significant differences between reporting of methodological quality were detected between studies with positive versus negative findings. Conclusions There was no difference in the reported methodological quality of positive versus negative studies. However, the uneven reporting of positive versus negative studies (72% vs 28%) indicates a publication bias in Indian medical journals with an impact factor of >1. PMID:26109118

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews

PubMed Central

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-01-01

Objective To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines—for example, in enemas, foot massage and compressing the umbilicus. Design A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. Result We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. Conclusions There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. PMID:28186925

Epidemiology characteristics, reporting characteristics, and methodological quality of systematic reviews and meta-analyses on traditional Chinese medicine nursing interventions published in Chinese journals.

PubMed

Yang, Min; Jiang, Li; Wang, Aihong; Xu, Guihua

2017-02-01

To evaluate the epidemiological characteristics, reporting characteristics, and methodological quality of systematic reviews in the traditional Chinese medicine nursing field published in Chinese journals. The number of systematic reviews in the traditional Chinese medicine nursing field has increased, but their epidemiology, quality, and reporting characteristics have not been assessed completely. We generated an overview of reviews using a narrative approach. Four Chinese databases were searched for systematic reviews from inception to December 2015. The Preferred Reporting Items of Systematic Reviews and Meta-analyses and the Assessment of Multiple Systematic Reviews checklists were adopted to evaluate reporting and methodological quality, respectively. A total of 73 eligible systematic reviews, published from 2005 to 2015, were included. The deficiencies in reporting characteristics mainly lay in the lack of structured abstract or protocol, incomplete reporting of search strategies, study selection, and risk of bias. The deficiencies in methodological quality were reflected in the lack of a priori design and conflict of interest, incomplete literature searches, and assessment of publication bias. The quality of the evaluated reviews was unsatisfactory; attention should be paid to the improvement of reporting and methodological quality in the conduct of systematic reviews. © 2016 John Wiley & Sons Australia, Ltd.

A Methodology for Anatomic Ultrasound Image Diagnostic Quality Assessment.

PubMed

Hemmsen, Martin Christian; Lange, Theis; Brandt, Andreas Hjelm; Nielsen, Michael Bachmann; Jensen, Jorgen Arendt

2017-01-01

This paper discusses the methods for the assessment of ultrasound image quality based on our experiences with evaluating new methods for anatomic imaging. It presents a methodology to ensure a fair assessment between competing imaging methods using clinically relevant evaluations. The methodology is valuable in the continuing process of method optimization and guided development of new imaging methods. It includes a three phased study plan covering from initial prototype development to clinical assessment. Recommendations to the clinical assessment protocol, software, and statistical analysis are presented. Earlier uses of the methodology has shown that it ensures validity of the assessment, as it separates the influences between developer, investigator, and assessor once a research protocol has been established. This separation reduces confounding influences on the result from the developer to properly reveal the clinical value. This paper exemplifies the methodology using recent studies of synthetic aperture sequential beamforming tissue harmonic imaging.

Prediction of ground water quality index to assess suitability for drinking purposes using fuzzy rule-based approach

NASA Astrophysics Data System (ADS)

Gorai, A. K.; Hasni, S. A.; Iqbal, Jawed

2016-11-01

Groundwater is the most important natural resource for drinking water to many people around the world, especially in rural areas where the supply of treated water is not available. Drinking water resources cannot be optimally used and sustained unless the quality of water is properly assessed. To this end, an attempt has been made to develop a suitable methodology for the assessment of drinking water quality on the basis of 11 physico-chemical parameters. The present study aims to select the fuzzy aggregation approach for estimation of the water quality index of a sample to check the suitability for drinking purposes. Based on expert's opinion and author's judgement, 11 water quality (pollutant) variables (Alkalinity, Dissolved Solids (DS), Hardness, pH, Ca, Mg, Fe, Fluoride, As, Sulphate, Nitrates) are selected for the quality assessment. The output results of proposed methodology are compared with the output obtained from widely used deterministic method (weighted arithmetic mean aggregation) for the suitability of the developed methodology.

Does updating improve the methodological and reporting quality of systematic reviews?

PubMed

Shea, Beverley; Boers, Maarten; Grimshaw, Jeremy M; Hamel, Candyce; Bouter, Lex M

2006-06-13

Systematic reviews (SRs) must be of high quality. The purpose of our research was to compare the methodological and reporting quality of original versus updated Cochrane SRs to determine whether updating had improved these two quality dimensions. We identified updated Cochrane SRs published in issue 4, 2002 of the Cochrane Library. We assessed the updated and original versions of the SRs using two instruments: the 10 item enhanced Overview Quality Assessment Questionnaire (OQAQ), and an 18-item reporting quality checklist and flow chart based upon the Quality of Reporting of Meta-analyses (QUOROM) statement. At least two reviewers extracted data and assessed quality. We calculated the percentage (with a 95% confidence interval) of 'yes' answers to each question. We calculated mean differences in percentage, 95% confidence intervals and p-values for each of the individual items and the overall methodological quality score of the updated and pre-updated versions using OQAQ. We assessed 53 SRs. There was no significant improvement in the global quality score of the OQAQ (mean difference 0.11 (-0.28; 0.70 p = 0.52)). Updated reviews showed a significant improvement of 18.9 (7.2; 30.6 p < .01) on the OQAQ item assessing whether the conclusions drawn by the author(s) were supported by the data and/or analysis presented in the SR. The QUOROM statement showed that the quality of reporting of Cochrane reviews improved in some areas with updating. Improvements were seen on the items relating to data sources reported in the abstract, with a significant difference of 17.0 (9.8; 28.7 p = 0.01), review methods, reported in the abstract 35 (24.1; 49.1 p = 0.00), searching methods 18.9 (9.7; 31.6 p = 0.01), and data abstraction 18.9 (11.7; 30.9 p = 0.00). The overall quality of Cochrane SRs is fair-to-good. Although reporting quality improved on certain individual items there was no overall improvement seen with updating and methodological quality remained unchanged. Further improvement of quality of reporting is possible. There is room for improvement of methodological quality as well. Authors updating reviews should address identified methodological or reporting weaknesses. We recommend to give full attention to both quality domains when updating SRs.

Epidemiology Characteristics, Methodological Assessment and Reporting of Statistical Analysis of Network Meta-Analyses in the Field of Cancer

PubMed Central

Ge, Long; Tian, Jin-hui; Li, Xiu-xia; Song, Fujian; Li, Lun; Zhang, Jun; Li, Ge; Pei, Gai-qin; Qiu, Xia; Yang, Ke-hu

2016-01-01

Because of the methodological complexity of network meta-analyses (NMAs), NMAs may be more vulnerable to methodological risks than conventional pair-wise meta-analysis. Our study aims to investigate epidemiology characteristics, conduction of literature search, methodological quality and reporting of statistical analysis process in the field of cancer based on PRISMA extension statement and modified AMSTAR checklist. We identified and included 102 NMAs in the field of cancer. 61 NMAs were conducted using a Bayesian framework. Of them, more than half of NMAs did not report assessment of convergence (60.66%). Inconsistency was assessed in 27.87% of NMAs. Assessment of heterogeneity in traditional meta-analyses was more common (42.62%) than in NMAs (6.56%). Most of NMAs did not report assessment of similarity (86.89%) and did not used GRADE tool to assess quality of evidence (95.08%). 43 NMAs were adjusted indirect comparisons, the methods used were described in 53.49% NMAs. Only 4.65% NMAs described the details of handling of multi group trials and 6.98% described the methods of similarity assessment. The median total AMSTAR-score was 8.00 (IQR: 6.00–8.25). Methodological quality and reporting of statistical analysis did not substantially differ by selected general characteristics. Overall, the quality of NMAs in the field of cancer was generally acceptable. PMID:27848997

Volume and methodological quality of randomized controlled trials in laparoscopic surgery: assessment over a 10-year period.

PubMed

Antoniou, Stavros A; Andreou, Alexandros; Antoniou, George A; Koch, Oliver O; Köhler, Gernot; Luketina, Ruzica-R; Bertsias, Antonios; Pointner, Rudolph; Granderath, Frank-Alexander

2015-11-01

Measures have been taken to improve methodological quality of randomized controlled trials (RCTs). This review systematically assessed the trends in volume and methodological quality of RCTs on minimally invasive surgery within a 10-year period. RCTs on minimally invasive surgery were searched in the 10 most cited general surgical journals and the 5 most cited journals of laparoscopic interest for the years 2002 and 2012. Bibliometric and methodological quality components were abstracted using the Scottish Intercollegiate Guidelines Network. The pooled number of RCTs from low-contribution regions demonstrated an increasing proportion of the total published RCTs, compensating for a concomitant decrease of the respective contributions from Europe and North America. International collaborations were more frequent in 2012. Acceptable or high quality RCTs accounted for 37.9% and 54.4% of RCTs published in 2002 and 2012, respectively. Components of external validity were poorly reported. Both the volume and the reporting quality of laparoscopic RCTs have increased from 2002 to 2012, but there seems to be ample room for improvement of methodological quality. Copyright © 2015 Elsevier Inc. All rights reserved.

"Assessing the methodological quality of systematic reviews in radiation oncology: A systematic review".

PubMed

Hasan, Haroon; Muhammed, Taaha; Yu, Jennifer; Taguchi, Kelsi; Samargandi, Osama A; Howard, A Fuchsia; Lo, Andrea C; Olson, Robert; Goddard, Karen

2017-10-01

The objective of our study was to evaluate the methodological quality of systematic reviews and meta-analyses in Radiation Oncology. A systematic literature search was conducted for all eligible systematic reviews and meta-analyses in Radiation Oncology from 1966 to 2015. Methodological characteristics were abstracted from all works that satisfied the inclusion criteria and quality was assessed using the critical appraisal tool, AMSTAR. Regression analyses were performed to determine factors associated with a higher score of quality. Following exclusion based on a priori criteria, 410 studies (157 systematic reviews and 253 meta-analyses) satisfied the inclusion criteria. Meta-analyses were found to be of fair to good quality while systematic reviews were found to be of less than fair quality. Factors associated with higher scores of quality in the multivariable analysis were including primary studies consisting of randomized control trials, performing a meta-analysis, and applying a recommended guideline related to establishing a systematic review protocol and/or reporting. Systematic reviews and meta-analyses may introduce a high risk of bias if applied to inform decision-making based on AMSTAR. We recommend that decision-makers in Radiation Oncology scrutinize the methodological quality of systematic reviews and meta-analyses prior to assessing their utility to inform evidence-based medicine and researchers adhere to methodological standards outlined in validated guidelines when embarking on a systematic review. Copyright © 2017 Elsevier Ltd. All rights reserved.

Methodological quality and implications for practice of systematic Cochrane reviews in pediatric oral health: a critical assessment

PubMed Central

2014-01-01

Background To ensure evidence-based decision-making in pediatric oral health, Cochrane systematic reviews that address topics pertinent to this field are necessary. We aimed to identify all systematic reviews of paediatric dentistry and oral health by the Cochrane Oral Health Group (COHG), summarize their characteristics and assess their methodological quality. Our second objective was to assess implications for practice in the review conclusions and provide an overview of clinical implications about the usefulness of paediatric oral health interventions in practice. Methods We conducted a methodological survey including all paediatric dentistry reviews from the COHG. We extracted data on characteristics of included reviews, then assessed the methodological quality using a validated 11-item quality assessment tool (AMSTAR). Finally, we coded each review to indicate whether its authors concluded that an intervention should be implemented in practice, was not supported or was refuted by the evidence, or should be used only in research (inconclusive evidence). Results We selected 37 reviews; most concerned the prevention of caries. The methodological quality was high, except for the assessment of reporting bias. In 7 reviews (19%), the research showed that benefits outweighed harms; in 1, the experimental intervention was found ineffective; and in 29 (78%), evidence was insufficient to assess benefits and harms. In the 7 reviews, topical fluoride treatments (with toothpaste, gel or varnish) were found effective for permanent and deciduous teeth in children and adolescents, and sealants for occlusal tooth surfaces of permanent molars. Conclusions Cochrane reviews of paediatric dentistry were of high quality. They provided strong evidence that topical fluoride treatments and sealants are effective for children and adolescents and thus should be implemented in practice. However, a substantial number of reviews yielded inconclusive evidence. PMID:24716532

Author-paper affiliation network architecture influences the methodological quality of systematic reviews and meta-analyses of psoriasis

PubMed Central

Gomez-Garcia, Francisco; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Maestre-Lopez, Beatriz; Gonzalez-Padilla, Marcelino; Carmona-Fernandez, Pedro J.; Velez Garcia-Nieto, Antonio; Isla-Tejera, Beatriz

2017-01-01

Moderate-to-severe psoriasis is associated with significant comorbidity, an impaired quality of life, and increased medical costs, including those associated with treatments. Systematic reviews (SRs) and meta-analyses (MAs) of randomized clinical trials are considered two of the best approaches to the summarization of high-quality evidence. However, methodological bias can reduce the validity of conclusions from these types of studies and subsequently impair the quality of decision making. As co-authorship is among the most well-documented forms of research collaboration, the present study aimed to explore whether authors’ collaboration methods might influence the methodological quality of SRs and MAs of psoriasis. Methodological quality was assessed by two raters who extracted information from full articles. After calculating total and per-item Assessment of Multiple Systematic Reviews (AMSTAR) scores, reviews were classified as low (0-4), medium (5-8), or high (9-11) quality. Article metadata and journal-related bibliometric indices were also obtained. A total of 741 authors from 520 different institutions and 32 countries published 220 reviews that were classified as high (17.2%), moderate (55%), or low (27.7%) methodological quality. The high methodological quality subnetwork was larger but had a lower connection density than the low and moderate methodological quality subnetworks; specifically, the former contained relatively fewer nodes (authors and reviews), reviews by authors, and collaborators per author. Furthermore, the high methodological quality subnetwork was highly compartmentalized, with several modules representing few poorly interconnected communities. In conclusion, structural differences in author-paper affiliation network may influence the methodological quality of SRs and MAs on psoriasis. As the author-paper affiliation network structure affects study quality in this research field, authors who maintain an appropriate balance between scientific quality and productivity are more likely to develop higher quality reviews. PMID:28403245

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students’ academic success. PMID:27031506

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

A Methodological Proposal for Learning Games Selection and Quality Assessment

ERIC Educational Resources Information Center

Dondi, Claudio; Moretti, Michela

2007-01-01

This paper presents a methodological proposal elaborated in the framework of two European projects dealing with game-based learning, both of which have focused on "quality" aspects in order to create suitable tools that support European educators, practitioners and lifelong learners in selecting and assessing learning games for use in…

Identifying approaches for assessing methodological and reporting quality of systematic reviews: a descriptive study.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-06-19

The methodological quality and completeness of reporting of the systematic reviews (SRs) is fundamental to optimal implementation of evidence-based health care and the reduction of research waste. Methods exist to appraise SRs yet little is known about how they are used in SRs or where there are potential gaps in research best-practice guidance materials. The aims of this study are to identify reports assessing the methodological quality (MQ) and/or reporting quality (RQ) of a cohort of SRs and to assess their number, general characteristics, and approaches to 'quality' assessment over time. The Cochrane Library, MEDLINE®, and EMBASE® were searched from January 1990 to October 16, 2014, for reports assessing MQ and/or RQ of SRs. Title, abstract, and full-text screening of all reports were conducted independently by two reviewers. Reports assessing the MQ and/or RQ of a cohort of ten or more SRs of interventions were included. All results are reported as frequencies and percentages of reports. Of 20,765 unique records retrieved, 1189 of them were reviewed for full-text review, of which 76 reports were included. Eight previously published approaches to assessing MQ or reporting guidelines used as proxy to assess RQ were used in 80% (61/76) of identified reports. These included two reporting guidelines (PRISMA and QUOROM) and five quality assessment tools (AMSTAR, R-AMSTAR, OQAQ, Mulrow, Sacks) and GRADE criteria. The remaining 24% (18/76) of reports developed their own criteria. PRISMA, OQAQ, and AMSTAR were the most commonly used published tools to assess MQ or RQ. In conjunction with other approaches, published tools were used in 29% (22/76) of reports, with 36% (8/22) assessing adherence to both PRISMA and AMSTAR criteria and 26% (6/22) using QUOROM and OQAQ. The methods used to assess quality of SRs are diverse, and none has become universally accepted. The most commonly used quality assessment tools are AMSTAR, OQAQ, and PRISMA. As new tools and guidelines are developed to improve both the MQ and RQ of SRs, authors of methodological studies are encouraged to put thoughtful consideration into the use of appropriate tools to assess quality and reporting.

Evaluation of AMSTAR to assess the methodological quality of systematic reviews in overviews of reviews of healthcare interventions.

PubMed

Pollock, Michelle; Fernandes, Ricardo M; Hartling, Lisa

2017-03-23

Overviews of reviews (overviews) compile information from multiple systematic reviews (SRs) to provide a single synthesis of relevant evidence for decision-making. It is recommended that authors assess and report the methodological quality of SRs in overviews-for example, using A MeaSurement Tool to Assess systematic Reviews (AMSTAR). Currently, there is variation in whether and how overview authors assess and report SR quality, and limited guidance is available. Our objectives were to: examine methodological considerations involved in using AMSTAR to assess the quality of Cochrane and non-Cochrane SRs in overviews of healthcare interventions; identify challenges (and develop potential decision rules) when using AMSTAR in overviews; and examine the potential impact of considering methodological quality when making inclusion decisions in overviews. We selected seven overviews of healthcare interventions and included all SRs meeting each overview's inclusion criteria. For each SR, two reviewers independently conducted AMSTAR assessments with consensus and discussed challenges encountered. We also examined the correlation between AMSTAR assessments and SR results/conclusions. Ninety-five SRs were included (30 Cochrane, 65 non-Cochrane). Mean AMSTAR assessments (9.6/11 vs. 5.5/11; p < 0.001) and inter-rater reliability (AC1 statistic: 0.84 vs. 0.69; "almost perfect" vs. "substantial" using the Landis & Koch criteria) were higher for Cochrane compared to non-Cochrane SRs. Four challenges were identified when applying AMSTAR in overviews: the scope of the SRs and overviews often differed; SRs examining similar topics sometimes made different methodological decisions; reporting of non-Cochrane SRs was sometimes poor; and some non-Cochrane SRs included other SRs as well as primary studies. Decision rules were developed to address each challenge. We found no evidence that AMSTAR assessments were correlated with SR results/conclusions. Results indicate that the AMSTAR tool can be used successfully in overviews that include Cochrane and non-Cochrane SRs, though decision rules may be useful to circumvent common challenges. Findings support existing recommendations that quality assessments of SRs in overviews be conducted independently, in duplicate, with a process for consensus. Results also suggest that using methodological quality to guide inclusion decisions (e.g., to exclude poorly conducted and reported SRs) may not introduce bias into the overview process.

E-therapy for mental health problems: a systematic review.

PubMed

Postel, Marloes G; de Haan, Hein A; De Jong, Cor A J

2008-09-01

The widespread availability of the Internet offers opportunities for improving access to therapy for people with mental health problems. There is a seemingly infinite supply of Internet-based interventions available on the World Wide Web. The aim of the present study is to systematically assess the methodological quality of randomized controlled trials (RCTs) concerning e-therapy for mental health problems. Two reviewers independently assessed the methodological quality of the RCTs, based on a list of criteria for the methodological quality assessment as recommended by the Cochrane Back Review Group. The search yielded 14 papers that reported RCTs concerning e-therapy for mental-health problems. The methodological quality of studies included in this review was generally low. It is concluded that e-therapy may turn out to be an appropriate therapeutic entity, but the evidence needs to be more convincing. Recommendations are made concerning the method of reporting RCTs and the need to add some content items to an e-therapy study.

Methodological quality of systematic reviews on influenza vaccination.

PubMed

Remschmidt, Cornelius; Wichmann, Ole; Harder, Thomas

2014-03-26

There is a growing body of evidence on the risks and benefits of influenza vaccination in various target groups. Systematic reviews are of particular importance for policy decisions. However, their methodological quality can vary considerably. To investigate the methodological quality of systematic reviews on influenza vaccination (efficacy, effectiveness, safety) and to identify influencing factors. A systematic literature search on systematic reviews on influenza vaccination was performed, using MEDLINE, EMBASE and three additional databases (1990-2013). Review characteristics were extracted and the methodological quality of the reviews was evaluated using the assessment of multiple systematic reviews (AMSTAR) tool. U-test, Kruskal-Wallis test, chi-square test, and multivariable linear regression analysis were used to assess the influence of review characteristics on AMSTAR-score. Fourty-six systematic reviews fulfilled the inclusion criteria. Average methodological quality was high (median AMSTAR-score: 8), but variability was large (AMSTAR range: 0-11). Quality did not differ significantly according to vaccination target group. Cochrane reviews had higher methodological quality than non-Cochrane reviews (p=0.001). Detailed analysis showed that this was due to better study selection and data extraction, inclusion of unpublished studies, and better reporting of study characteristics (all p<0.05). In the adjusted analysis, no other factor, including industry sponsorship or journal impact factor had an influence on AMSTAR score. Systematic reviews on influenza vaccination showed large differences regarding their methodological quality. Reviews conducted by the Cochrane collaboration were of higher quality than others. When using systematic reviews to guide the development of vaccination recommendations, the methodological quality of a review in addition to its content should be considered. Copyright © 2014 Elsevier Ltd. All rights reserved.

Use of methodological tools for assessing the quality of studies in periodontology and implant dentistry: a systematic review.

PubMed

Faggion, Clovis M; Huda, Fahd; Wasiak, Jason

2014-06-01

To evaluate the methodological approaches used to assess the quality of studies included in systematic reviews (SRs) in periodontology and implant dentistry. Two electronic databases (PubMed and Cochrane Database of Systematic Reviews) were searched independently to identify SRs examining interventions published through 2 September 2013. The reference lists of included SRs and records of 10 specialty dental journals were searched manually. Methodological approaches were assessed using seven criteria based on the Cochrane Handbook for Systematic Reviews of Interventions. Temporal trends in methodological quality were also explored. Of the 159 SRs with meta-analyses included in the analysis, 44 (28%) reported the use of domain-based tools, 15 (9%) reported the use of checklists and 7 (4%) reported the use of scales. Forty-two (26%) SRs reported use of more than one tool. Criteria were met heterogeneously; authors of 15 (9%) publications incorporated the quality of evidence of primary studies into SRs, whereas 69% of SRs reported methodological approaches in the Materials/Methods section. Reporting of four criteria was significantly better in recent (2010-2013) than in previous publications. The analysis identified several methodological limitations of approaches used to assess evidence in studies included in SRs in periodontology and implant dentistry. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Comparison of methodological quality of positive versus negative comparative studies published in Indian medical journals: a systematic review.

PubMed

Charan, Jaykaran; Chaudhari, Mayur; Jackson, Ryan; Mhaskar, Rahul; Reljic, Tea; Kumar, Ambuj

2015-06-24

Published negative studies should have the same rigour of methodological quality as studies with positive findings. However, the methodological quality of negative versus positive studies is not known. The objective was to assess the reported methodological quality of positive versus negative studies published in Indian medical journals. A systematic review (SR) was performed of all comparative studies published in Indian medical journals with a clinical science focus and impact factor >1 between 2011 and 2013. The methodological quality of randomised controlled trials (RCTs) was assessed using the Cochrane risk of bias tool, and the Newcastle-Ottawa scale for observational studies. The results were considered positive if the primary outcome was statistically significant and negative otherwise. When the primary outcome was not specified, we used data on the first outcome reported in the history followed by the results section. Differences in various methodological quality domains between positive versus negative studies were assessed by Fisher's exact test. Seven journals with 259 comparative studies were included in this SR. 24% (63/259) were RCTs, 24% (63/259) cohort studies, and 49% (128/259) case-control studies. 53% (137/259) of studies explicitly reported the primary outcome. Five studies did not report sufficient data to enable us to determine if results were positive or negative. Statistical significance was determined by p value in 78.3% (199/254), CI in 2.8% (7/254), both p value and CI in 11.8% (30/254), and only descriptive in 6.3% (16/254) of studies. The overall methodological quality was poor and no statistically significant differences between reporting of methodological quality were detected between studies with positive versus negative findings. There was no difference in the reported methodological quality of positive versus negative studies. However, the uneven reporting of positive versus negative studies (72% vs 28%) indicates a publication bias in Indian medical journals with an impact factor of >1. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews.

PubMed

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-11-14

To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines-for example, in enemas, foot massage and compressing the umbilicus. A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Systematic review and quality assessment of cost-effectiveness analysis of pharmaceutical therapies for advanced colorectal cancer.

PubMed

Leung, Henry W C; Chan, Agnes L F; Leung, Matthew S H; Lu, Chin-Li

2013-04-01

To systematically review and assess the quality of cost-effectiveness analyses (CEAs) of pharmaceutical therapies for metastatic colorectal cancer (mCRC). The MEDLINE, EMBASE, Cochrane, and EconLit databases were searched for the Medical Subject Headings or text key words quality-adjusted, QALY, life-year gained (LYG), and cost-effectiveness (January 1, 1999-December 31, 2009). Original CEAs of mCRC pharmacotherapy published in English were included. CEAs that measured health effects in units other than quality-adjusted life years or LYG and letters to the editor, case reports, posters, and editorials were excluded. Each article was independently assessed by 2 trained reviewers according to a quality checklist created by the Panel on Cost-Effectiveness in Health and Medicine. Twenty-four CEA studies pertaining to pharmaceutical therapies for mCRC were identified. All studies showed a wide variation in methodologic approaches, which resulted in a different range of incremental cost-effectiveness ratios reported for each regimen. We found common methodologic flaws in a significant number of CEA studies, including lack of clear description for critique of data quality; lack of method for adjusting costs for inflation and methods for obtaining expert judgment; no results of model validation; wide differences in the types of perspective, time horizon, study design, cost categories, and effect outcomes; and no quality assessment of data (cost and effectiveness) for the interventions evaluation. This study has shown a wide variation in the methodology and quality of cost-effectiveness analysis for mCRC. Improving quality and harmonization of CEA for cancer treatment is needed. Further study is suggested to assess the quality of CEA methodology outside the mCRC disease state.

The public water supply protection value of forests: A watershed-scale ecosystem services based upon total organic carbon

USDA-ARS?s Scientific Manuscript database

We developed a cost-based methodology to assess the value of forested watersheds to improve water quality in public water supplies. The developed methodology is applicable to other source watersheds to determine ecosystem services for water quality. We assess the value of forest land for source wate...

Specific guidelines for assessing and improving the methodological quality of economic evaluations of newborn screening

PubMed Central

2012-01-01

Background Economic evaluation of newborn screening poses specific methodological challenges. Amongst others, these challenges refer to the use of quality adjusted life years (QALYs) in newborns, and which costs and outcomes need to be considered in a full evaluation of newborn screening programmes. Because of the increasing scale and scope of such programmes, a better understanding of the methods of high-quality economic evaluations may be crucial for both producers/authors and consumers/reviewers of newborn screening-related economic evaluations. The aim of this study was therefore to develop specific guidelines designed to assess and improve the methodological quality of economic evaluations in newborn screening. Methods To develop the guidelines, existing guidelines for assessing the quality of economic evaluations were identified through a literature search, and were reviewed and consolidated using a deductive iterative approach. In a subsequent test phase, these guidelines were applied to various economic evaluations which acted as case studies. Results The guidelines for assessing and improving the methodological quality of economic evaluations in newborn screening are organized into 11 categories: “bibliographic details”, “study question and design”, “modelling”, “health outcomes”, “costs”, “discounting”, “presentation of results”, “sensitivity analyses”, “discussion”, “conclusions”, and “commentary”. Conclusions The application of the guidelines highlights important issues regarding newborn screening-related economic evaluations, and underscores the need for such issues to be afforded greater consideration in future economic evaluations. The variety in methodological quality detected by this study reveals the need for specific guidelines on the appropriate methods for conducting sound economic evaluations in newborn screening. PMID:22947299

Systematic reviews identify important methodological flaws in stroke rehabilitation therapy primary studies: review of reviews.

PubMed

Santaguida, Pasqualina; Oremus, Mark; Walker, Kathryn; Wishart, Laurie R; Siegel, Karen Lohmann; Raina, Parminder

2012-04-01

A "review of reviews" was undertaken to assess methodological issues in studies evaluating nondrug rehabilitation interventions in stroke patients. MEDLINE, CINAHL, PsycINFO, and the Cochrane Database of Systematic Reviews were searched from January 2000 to January 2008 within the stroke rehabilitation setting. Electronic searches were supplemented by reviews of reference lists and citations identified by experts. Eligible studies were systematic reviews; excluded citations were narrative reviews or reviews of reviews. Review characteristics and criteria for assessing methodological quality of primary studies within them were extracted. The search yielded 949 English-language citations. We included a final set of 38 systematic reviews. Cochrane reviews, which have a standardized methodology, were generally of higher methodological quality than non-Cochrane reviews. Most systematic reviews used standardized quality assessment criteria for primary studies, but not all were comprehensive. Reviews showed that primary studies had problems with randomization, allocation concealment, and blinding. Baseline comparability, adverse events, and co-intervention or contamination were not consistently assessed. Blinding of patients and providers was often not feasible and was not evaluated as a source of bias. The eligible systematic reviews identified important methodological flaws in the evaluated primary studies, suggesting the need for improvement of research methods and reporting. Copyright © 2012 Elsevier Inc. All rights reserved.

Towards Quality Assessment in an EFL Programme

ERIC Educational Resources Information Center

Ali, Holi Ibrahim Holi; Al Ajmi, Ahmed Ali Saleh

2013-01-01

Assessment is central in education and the teaching-learning process. This study attempts to explore the perspectives and views about quality assessment among teachers of English as a Foreign Language (EFL), and to find ways of promoting quality assessment. Quantitative methodology was used to collect data. To answer the study questions, a…

About subjective evaluation of adaptive video streaming

NASA Astrophysics Data System (ADS)

Tavakoli, Samira; Brunnström, Kjell; Garcia, Narciso

2015-03-01

The usage of HTTP Adaptive Streaming (HAS) technology by content providers is increasing rapidly. Having available the video content in multiple qualities, using HAS allows to adapt the quality of downloaded video to the current network conditions providing smooth video-playback. However, the time-varying video quality by itself introduces a new type of impairment. The quality adaptation can be done in different ways. In order to find the best adaptation strategy maximizing users perceptual quality it is necessary to investigate about the subjective perception of adaptation-related impairments. However, the novelties of these impairments and their comparably long time duration make most of the standardized assessment methodologies fall less suited for studying HAS degradation. Furthermore, in traditional testing methodologies, the quality of the video in audiovisual services is often evaluated separated and not in the presence of audio. Nevertheless, the requirement of jointly evaluating the audio and the video within a subjective test is a relatively under-explored research field. In this work, we address the research question of determining the appropriate assessment methodology to evaluate the sequences with time-varying quality due to the adaptation. This was done by studying the influence of different adaptation related parameters through two different subjective experiments using a methodology developed to evaluate long test sequences. In order to study the impact of audio presence on quality assessment by the test subjects, one of the experiments was done in the presence of audio stimuli. The experimental results were subsequently compared with another experiment using the standardized single stimulus Absolute Category Rating (ACR) methodology.

76 FR 50188 - Notice of Proposed Methodology for the Delaware River and Bay Integrated List Water Quality...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-12

... Integrated List Water Quality Assessment AGENCY: Delaware River Basin Commission. ACTION: Notice. SUMMARY... Integrated List Water Quality Assessment is available for review and comment. DATES: Comments must be... should have the phrase ``Water Quality Assessment 2012'' in the subject line and should include the name...

Methodological Quality Assessment of Meta-Analyses and Systematic Reviews of Probiotics in Inflammatory Bowel Disease and Pouchitis.

PubMed

Dong, Jinpei; Teng, Guigen; Wei, Tiantong; Gao, Wen; Wang, Huahong

2016-01-01

Probiotics are widely used for the induction and maintenance of remission in inflammatory bowel disease (IBD) and pouchitis. There are a large number of meta-analyses (MAs)/ systematic reviews (SRs) on this subject, the methodological quality of which has not been evaluated. This study aimed to evaluate the methodological quality of and summarize the evidence obtained from MAs/SRs of probiotic treatments for IBD and pouchitis patients. The PubMed, EMBASE, Cochrane Library and China National Knowledge Infrastructure (CNKI) databases were searched to identify Chinese and English language MAs/SRs of the use of probiotics for IBD and pouchitis. The Assessment of Multiple Systematic Reviews (AMSTAR) scale was used to assess the methodological quality of the studies. A total of 36 MAs/SRs were evaluated. The AMSTAR scores of the included studies ranged from 1 to 10, and the average score was 5.81. According to the Canadian Agency for Drugs and Technologies in Health, 4 articles were classified as high quality, 24 articles were classified as moderate quality, and 8 articles were classified as low quality. Most of the MAs/SRs suggested that probiotics had potential benefits for patients with ulcerative colitis (UC), but failed to show effectiveness in the induction and maintenance of remission in Crohn's disease (CD). The probiotic preparation VSL#3 may play a beneficial role in pouchitis. The overall methodological quality of the current MAs/SRs in the field of probiotics for IBD and pouchitis was found to be low to moderate. More MAs/SRs of high quality are required to support using probiotics to treat IBD and pouchitis.

The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature.

PubMed

Pölkki, Tarja; Kanste, Outi; Kääriäinen, Maria; Elo, Satu; Kyngäs, Helvi

2014-02-01

To analyse systematic review articles published in the top 10 nursing journals to determine the quality of the methods employed within them. Systematic review is defined as a scientific research method that synthesises high-quality scientific knowledge on a given topic. The number of such reviews in nursing science has increased dramatically during recent years, but their methodological quality has not previously been assessed. A review of the literature using a narrative approach. Ranked impact factor scores for nursing journals were obtained from the Journal Citation Report database of the Institute of Scientific Information (ISI Web of Knowledge). All issues from the years 2009 and 2010 of the top 10 ranked journals were included. CINAHL and MEDLINE databases were searched to locate studies using the search terms 'systematic review' and 'systematic literature review'. A total of 39 eligible studies were identified. Their methodological quality was evaluated through the specific criteria of quality assessment, description of synthesis and strengths and weaknesses reported in the included studies. Most of the eligible systematic reviews included several different designs or types of quantitative study. The majority included a quality assessment, and a total of 17 different criteria were identified. The method of synthesis was mentioned in about half of the reviews, the most common being narrative synthesis. The weaknesses of reviews were discussed, while strengths were rarely highlighted. The methodological quality of the systematic reviews examined varied considerably, although they were all published in nursing journals with a high-impact factor. Despite the fact that systematic reviews are considered the most robust source of research evidence, they vary in methodological quality. This point is important to consider in clinical practice when applying the results to patient care. © 2013 Blackwell Publishing Ltd.

78 FR 63972 - Notice of Proposed Methodology for the 2014 Delaware River and Bay Water Quality Assessment Report

Federal Register 2010, 2011, 2012, 2013, 2014

2013-10-25

... Water Quality Assessment Report AGENCY: Delaware River Basin Commission. ACTION: Notice. SUMMARY: Notice....us , with ``Water Quality Assessment 2014'' as the subject line; via fax to 609-883-9522; via U.S. Mail to DRBC, Attn: Water Quality Assessment 2014, P.O. Box 7360, West Trenton, NJ 08628-0360; via...

Systematic Review of the Application of Lean and Six Sigma Quality Improvement Methodologies in Radiology.

PubMed

Amaratunga, Thelina; Dobranowski, Julian

2016-09-01

Preventable yet clinically significant rates of medical error remain systemic, while health care spending is at a historic high. Industry-based quality improvement (QI) methodologies show potential for utility in health care and radiology because they use an empirical approach to reduce variability and improve workflow. The aim of this review was to systematically assess the literature with regard to the use and efficacy of Lean and Six Sigma (the most popular of the industrial QI methodologies) within radiology. MEDLINE, the Allied & Complementary Medicine Database, Embase Classic + Embase, Health and Psychosocial Instruments, and the Ovid HealthStar database, alongside the Cochrane Library databases, were searched on June 2015. Empirical studies in peer-reviewed journals were included if they assessed the use of Lean, Six Sigma, or Lean Six Sigma with regard to their ability to improve a variety of quality metrics in a radiology-centered clinical setting. Of the 278 articles returned, 23 studies were suitable for inclusion. Of these, 10 assessed Six Sigma, 7 assessed Lean, and 6 assessed Lean Six Sigma. The diverse range of measured outcomes can be organized into 7 common aims: cost savings, reducing appointment wait time, reducing in-department wait time, increasing patient volume, reducing cycle time, reducing defects, and increasing staff and patient safety and satisfaction. All of the included studies demonstrated improvements across a variety of outcomes. However, there were high rates of systematic bias and imprecision as per the Grading of Recommendations Assessment, Development and Evaluation guidelines. Lean and Six Sigma QI methodologies have the potential to reduce error and costs and improve quality within radiology. However, there is a pressing need to conduct high-quality studies in order to realize the true potential of these QI methodologies in health care and radiology. Recommendations on how to improve the quality of the literature are proposed. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Clinical trials in palliative care: a systematic review of their methodological characteristics and of the quality of their reporting.

PubMed

Bouça-Machado, Raquel; Rosário, Madalena; Alarcão, Joana; Correia-Guedes, Leonor; Abreu, Daisy; Ferreira, Joaquim J

2017-01-25

Over the past decades there has been a significant increase in the number of published clinical trials in palliative care. However, empirical evidence suggests that there are methodological problems in the design and conduct of studies, which raises questions about the validity and generalisability of the results and of the strength of the available evidence. We sought to evaluate the methodological characteristics and assess the quality of reporting of clinical trials in palliative care. We performed a systematic review of published clinical trials assessing therapeutic interventions in palliative care. Trials were identified using MEDLINE (from its inception to February 2015). We assessed methodological characteristics and describe the quality of reporting using the Cochrane Risk of Bias tool. We retrieved 107 studies. The most common medical field studied was oncology, and 43.9% of trials evaluated pharmacological interventions. Symptom control and physical dimensions (e.g. intervention on pain, breathlessness, nausea) were the palliative care-specific issues most studied. We found under-reporting of key information in particular on random sequence generation, allocation concealment, and blinding. While the number of clinical trials in palliative care has increased over time, methodological quality remains suboptimal. This compromises the quality of studies. Therefore, a greater effort is needed to enable the appropriate performance of future studies and increase the robustness of evidence-based medicine in this important field.

Epidemiology, methodological and reporting characteristics of systematic reviews of nursing interventions published in China.

PubMed

Shi, Chunhu; Zhu, Lin; Wang, Xue; Qin, Chunxia; Xu, Qi; Tian, Jinhui

2014-12-01

The importance of systematic reviews (SRs) of nursing interventions' impact on practice makes their methodological quality and reporting characteristics especially important as it directly influence their utility for clinicians, patients and policy makers.The study aims to assess the methodological quality and reporting characteristics of SRs of nursing interventions in Chinese nursing journals. Three Chinese databases were searched for SRs of nursing interventions from inception to October 2011. The assessment of multiple systematic reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) statements were used to assess methodological quality and reporting characteristics. Seventy-four SRs were included. The proportion of SRs complying with AMSTAR checklist items ranged from 0% to 82.4%. No SRs reported an 'a priori' design or conflict of interest. Only four items were found to be reported in more than 50% of the SRs: a list of included and excluded studies, the scientific quality of included studies, the appropriate use of methods to combine findings, and formulating conclusions appropriately. The majority of SRs of nursing interventions in China had major methodological and reporting flaws that limited their value to guide decisions. Chinese authors and journals should adopt and keep up with the AMSTAR and PRISMA statements to improve the quality of SRs in this field. © 2014 Wiley Publishing Asia Pty Ltd.

78 FR 15023 - Office of Health Assessment and Translation Webinar on the Assessment of Data Quality in Animal...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-08

... and Translation Webinar on the Assessment of Data Quality in Animal Studies; Notice of Public Webinar...- based meeting on the assessment of data quality in animal studies. The Office of Health Assessment and... meetings with a focus on methodological issues related to OHAT implementing systematic review. The first...

Quality assessment of urban environment

NASA Astrophysics Data System (ADS)

Ovsiannikova, T. Y.; Nikolaenko, M. N.

2015-01-01

This paper is dedicated to the research applicability of quality management problems of construction products. It is offered to expand quality management borders in construction, transferring its principles to urban systems as economic systems of higher level, which qualitative characteristics are substantially defined by quality of construction product. Buildings and structures form spatial-material basis of cities and the most important component of life sphere - urban environment. Authors justify the need for the assessment of urban environment quality as an important factor of social welfare and life quality in urban areas. The authors suggest definition of a term "urban environment". The methodology of quality assessment of urban environment is based on integrated approach which includes the system analysis of all factors and application of both quantitative methods of assessment (calculation of particular and integrated indicators) and qualitative methods (expert estimates and surveys). The authors propose the system of indicators, characterizing quality of the urban environment. This indicators fall into four classes. The authors show the methodology of their definition. The paper presents results of quality assessment of urban environment for several Siberian regions and comparative analysis of these results.

Methodological quality of randomized controlled trials of spinal manipulation and mobilization in tension-type headache, migraine, and cervicogenic headache.

PubMed

Fernández-de-las-Peñas, César; Alonso-Blanco, Cristina; San-Roman, Jesús; Miangolarra-Page, Juan C

2006-03-01

Literature review of quality of clinical trials. To determine the methodological quality of published randomized controlled trials that used spinal manipulation and/or mobilization to treat patients with tension-type headache (TTH), cervicogenic headache (CeH), and migraine (M) in the last decade. TTH, CeH, and M are the most prevalent types of headaches seen in adults. Individuals who have headaches frequently use physical therapy, manual therapy, or chiropractic care. Randomized controlled trials are considered an optimal method with which to assess the efficacy of any intervention. Computerized literature searches were performed in MEDLINE, EMBASE, COCHRANE, AMED, MANTIS, CINHAL, and PEDro databases. Randomized controlled trials in which spinal manipulation and/or mobilization had been used for TTH, CeH, and M published in a peer-reviewed journal as full text, and with at least 1 clinically relevant outcome measure (ie, headache intensity, duration, or frequency) were reviewed. The methodological quality of the studies was assessed independently by 2 reviewers using a set of predefined criteria. Only 8 studies met all the inclusion criteria. One clinical trial evaluated spinal manipulation and mobilization together, and the remaining 7 assessed spinal manipulative therapy. No controlled trials analyzing exclusively the effects of spinal mobilization were found. Methodological scores ranged from 35 to 56 points out of a theoretical maximum of 100 points, indicating an overall poor methodology of the studies. Only 2 studies obtained a high-quality score (greater than 50 points). No significant differences in quality scores were found based on the type of headache investigated. Methodological quality was not associated with the year of publication (before 2000, or later) nor with the results (positive, neutral, negative) reported in the studies. The most common flaws were a small sample size, the absence of a placebo control group, lack of blinded patients, and no description of the manipulative procedure. There are few published randomized controlled trials analyzing the effectiveness of spinal manipulation and/or mobilization for TTH, CeH, and M in the last decade. In addition, the methodological quality of these papers is typically low. Clearly, there is a need for high-quality randomized controlled trials assessing the effectiveness of these interventions in these headache disorders.

Development of a Valid and Reliable Knee Articular Cartilage Condition-Specific Study Methodological Quality Score.

PubMed

Harris, Joshua D; Erickson, Brandon J; Cvetanovich, Gregory L; Abrams, Geoffrey D; McCormick, Frank M; Gupta, Anil K; Verma, Nikhil N; Bach, Bernard R; Cole, Brian J

2014-02-01

Condition-specific questionnaires are important components in evaluation of outcomes of surgical interventions. No condition-specific study methodological quality questionnaire exists for evaluation of outcomes of articular cartilage surgery in the knee. To develop a reliable and valid knee articular cartilage-specific study methodological quality questionnaire. Cross-sectional study. A stepwise, a priori-designed framework was created for development of a novel questionnaire. Relevant items to the topic were identified and extracted from a recent systematic review of 194 investigations of knee articular cartilage surgery. In addition, relevant items from existing generic study methodological quality questionnaires were identified. Items for a preliminary questionnaire were generated. Redundant and irrelevant items were eliminated, and acceptable items modified. The instrument was pretested and items weighed. The instrument, the MARK score (Methodological quality of ARticular cartilage studies of the Knee), was tested for validity (criterion validity) and reliability (inter- and intraobserver). A 19-item, 3-domain MARK score was developed. The 100-point scale score demonstrated face validity (focus group of 8 orthopaedic surgeons) and criterion validity (strong correlation to Cochrane Quality Assessment score and Modified Coleman Methodology Score). Interobserver reliability for the overall score was good (intraclass correlation coefficient [ICC], 0.842), and for all individual items of the MARK score, acceptable to perfect (ICC, 0.70-1.000). Intraobserver reliability ICC assessed over a 3-week interval was strong for 2 reviewers (≥0.90). The MARK score is a valid and reliable knee articular cartilage condition-specific study methodological quality instrument. This condition-specific questionnaire may be used to evaluate the quality of studies reporting outcomes of articular cartilage surgery in the knee.

Rating methodological quality: toward improved assessment and investigation.

PubMed

Moyer, Anne; Finney, John W

2005-01-01

Assessing methodological quality is considered essential in deciding what investigations to include in research syntheses and in detecting potential sources of bias in meta-analytic results. Quality assessment is also useful in characterizing the strengths and limitations of the research in an area of study. Although numerous instruments to measure research quality have been developed, they have lacked empirically-supported components. In addition, different summary quality scales have yielded different findings when they were used to weight treatment effect estimates for the same body of research. Suggestions for developing improved quality instruments include: distinguishing distinct domains of quality, such as internal validity, external validity, the completeness of the study report, and adherence to ethical practices; focusing on individual aspects, rather than domains of quality; and focusing on empirically-verified criteria. Other ways to facilitate the constructive use of quality assessment are to improve and standardize the reporting of research investigations, so that the quality of studies can be more equitably and thoroughly compared, and to identify optimal methods for incorporating study quality ratings into meta-analyses.

Using Plant Clinic Registers to Assess the Quality of Diagnoses and Advice Given to Farmers: A Case Study from Uganda

ERIC Educational Resources Information Center

Danielsen, Solveig; Boa, Eric; Mafabi, Moses; Mutebi, Emmanuel; Reeder, Robert; Kabeere, Flavia; Karyeija, Robert

2013-01-01

Purpose: This study developed a framework for quality assessment of diagnoses and advice given at plant clinics. Design/methodology/approach: Clinic registers from five plant clinics in Uganda (2006-2010) were used to develop quality assessment protocols for diagnoses and advice given by plant doctors. Assessment of quality of diagnoses was based…

Randomized clinical trials in dentistry: Risks of bias, risks of random errors, reporting quality, and methodologic quality over the years 1955–2013

PubMed Central

Armijo-Olivo, Susan; Cummings, Greta G.; Amin, Maryam; Flores-Mir, Carlos

2017-01-01

Objectives To examine the risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions and the development of these aspects over time. Methods We included 540 randomized clinical trials from 64 selected systematic reviews. We extracted, in duplicate, details from each of the selected randomized clinical trials with respect to publication and trial characteristics, reporting and methodologic characteristics, and Cochrane risk of bias domains. We analyzed data using logistic regression and Chi-square statistics. Results Sequence generation was assessed to be inadequate (at unclear or high risk of bias) in 68% (n = 367) of the trials, while allocation concealment was inadequate in the majority of trials (n = 464; 85.9%). Blinding of participants and blinding of the outcome assessment were judged to be inadequate in 28.5% (n = 154) and 40.5% (n = 219) of the trials, respectively. A sample size calculation before the initiation of the study was not performed/reported in 79.1% (n = 427) of the trials, while the sample size was assessed as adequate in only 17.6% (n = 95) of the trials. Two thirds of the trials were not described as double blinded (n = 358; 66.3%), while the method of blinding was appropriate in 53% (n = 286) of the trials. We identified a significant decrease over time (1955–2013) in the proportion of trials assessed as having inadequately addressed methodological quality items (P < 0.05) in 30 out of the 40 quality criteria, or as being inadequate (at high or unclear risk of bias) in five domains of the Cochrane risk of bias tool: sequence generation, allocation concealment, incomplete outcome data, other sources of bias, and overall risk of bias. Conclusions The risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions have improved over time; however, further efforts that contribute to the development of more stringent methodology and detailed reporting of trials are still needed. PMID:29272315

Randomized clinical trials in dentistry: Risks of bias, risks of random errors, reporting quality, and methodologic quality over the years 1955-2013.

PubMed

Saltaji, Humam; Armijo-Olivo, Susan; Cummings, Greta G; Amin, Maryam; Flores-Mir, Carlos

2017-01-01

To examine the risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions and the development of these aspects over time. We included 540 randomized clinical trials from 64 selected systematic reviews. We extracted, in duplicate, details from each of the selected randomized clinical trials with respect to publication and trial characteristics, reporting and methodologic characteristics, and Cochrane risk of bias domains. We analyzed data using logistic regression and Chi-square statistics. Sequence generation was assessed to be inadequate (at unclear or high risk of bias) in 68% (n = 367) of the trials, while allocation concealment was inadequate in the majority of trials (n = 464; 85.9%). Blinding of participants and blinding of the outcome assessment were judged to be inadequate in 28.5% (n = 154) and 40.5% (n = 219) of the trials, respectively. A sample size calculation before the initiation of the study was not performed/reported in 79.1% (n = 427) of the trials, while the sample size was assessed as adequate in only 17.6% (n = 95) of the trials. Two thirds of the trials were not described as double blinded (n = 358; 66.3%), while the method of blinding was appropriate in 53% (n = 286) of the trials. We identified a significant decrease over time (1955-2013) in the proportion of trials assessed as having inadequately addressed methodological quality items (P < 0.05) in 30 out of the 40 quality criteria, or as being inadequate (at high or unclear risk of bias) in five domains of the Cochrane risk of bias tool: sequence generation, allocation concealment, incomplete outcome data, other sources of bias, and overall risk of bias. The risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions have improved over time; however, further efforts that contribute to the development of more stringent methodology and detailed reporting of trials are still needed.

[Integrated Quality Management System (IQMS): a model for improving the quality of reproductive health care in rural Kenya].

PubMed

Herrler, Claudia; Bramesfeld, Anke; Brodowski, Marc; Prytherch, Helen; Marx, Irmgard; Nafula, Maureen; Richter-Aairijoki, Heide; Musyoka, Lucy; Marx, Michael; Szecsenyi, Joachim

2015-01-01

To develop a model aiming to improve the quality of services for reproductive health care in rural Kenya and designed to measure the quality of reproductive health services in such a way that allows these services to identify measures for improving their performance. The Integrated Quality Management System (IQMS) was developed on the basis of a pre-existing and validated model for quality promotion, namely the European Practice Assessment (EPA). The methodology for quality assessment and feedback of assessment results to the service teams was adopted from the EPA model. Quality assessment methodology included data assessment through staff, patient surveys and service visitation. Quality is assessed by indicators, and so indicators had to be developed that were appropriate for assessing reproductive health care in rural Kenya. A search of the Kenyan and international literature was conducted to identify potential indicators. These were then rated for their relevance and clarity by a panel of Kenyan experts. 260 indicators were rated as relevant and assigned to 29 quality dimensions and 5 domains. The implementation of IQMS in ten facilities showed that IQMS is a feasible model for assessing the quality of reproductive health services in rural Kenya. IQMS enables these services to identify quality improvement targets and necessary improvement measures. Both strengths and limitations of IQMS will be discussed. Copyright © 2015. Published by Elsevier GmbH.

Identifying Items to Assess Methodological Quality in Physical Therapy Trials: A Factor Analysis

PubMed Central

Cummings, Greta G.; Fuentes, Jorge; Saltaji, Humam; Ha, Christine; Chisholm, Annabritt; Pasichnyk, Dion; Rogers, Todd

2014-01-01

Background Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. Objective The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). Design A methodological research design was used, and an EFA was performed. Methods Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. Results Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. Limitation Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. Conclusions To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items. PMID:24786942

Identifying items to assess methodological quality in physical therapy trials: a factor analysis.

PubMed

Armijo-Olivo, Susan; Cummings, Greta G; Fuentes, Jorge; Saltaji, Humam; Ha, Christine; Chisholm, Annabritt; Pasichnyk, Dion; Rogers, Todd

2014-09-01

Numerous tools and individual items have been proposed to assess the methodological quality of randomized controlled trials (RCTs). The frequency of use of these items varies according to health area, which suggests a lack of agreement regarding their relevance to trial quality or risk of bias. The objectives of this study were: (1) to identify the underlying component structure of items and (2) to determine relevant items to evaluate the quality and risk of bias of trials in physical therapy by using an exploratory factor analysis (EFA). A methodological research design was used, and an EFA was performed. Randomized controlled trials used for this study were randomly selected from searches of the Cochrane Database of Systematic Reviews. Two reviewers used 45 items gathered from 7 different quality tools to assess the methodological quality of the RCTs. An exploratory factor analysis was conducted using the principal axis factoring (PAF) method followed by varimax rotation. Principal axis factoring identified 34 items loaded on 9 common factors: (1) selection bias; (2) performance and detection bias; (3) eligibility, intervention details, and description of outcome measures; (4) psychometric properties of the main outcome; (5) contamination and adherence to treatment; (6) attrition bias; (7) data analysis; (8) sample size; and (9) control and placebo adequacy. Because of the exploratory nature of the results, a confirmatory factor analysis is needed to validate this model. To the authors' knowledge, this is the first factor analysis to explore the underlying component items used to evaluate the methodological quality or risk of bias of RCTs in physical therapy. The items and factors represent a starting point for evaluating the methodological quality and risk of bias in physical therapy trials. Empirical evidence of the association among these items with treatment effects and a confirmatory factor analysis of these results are needed to validate these items. © 2014 American Physical Therapy Association.

Application of process mining to assess the data quality of routinely collected time-based performance data sourced from electronic health records by validating process conformance.

PubMed

Perimal-Lewis, Lua; Teubner, David; Hakendorf, Paul; Horwood, Chris

2016-12-01

Effective and accurate use of routinely collected health data to produce Key Performance Indicator reporting is dependent on the underlying data quality. In this research, Process Mining methodology and tools were leveraged to assess the data quality of time-based Emergency Department data sourced from electronic health records. This research was done working closely with the domain experts to validate the process models. The hospital patient journey model was used to assess flow abnormalities which resulted from incorrect timestamp data used in time-based performance metrics. The research demonstrated process mining as a feasible methodology to assess data quality of time-based hospital performance metrics. The insight gained from this research enabled appropriate corrective actions to be put in place to address the data quality issues. © The Author(s) 2015.

DPP-4 inhibitors for the treatment of type 2 diabetes: a methodology overview of systematic reviews.

PubMed

Ling, Juan; Ge, Long; Zhang, Ding-Hua; Wang, Yong-Feng; Xie, Zhuo-Lin; Tian, Jin-Hui; Xiao, Xiao-Hui; Yang, Ke-Hu

2018-06-01

To evaluate the methodological quality of systematic reviews (SRs), and summarize evidence of important outcomes from dipeptidyl peptidase-4 inhibitors (DPP4-I) in treating type 2 diabetes mellitus (T2DM). We included SRs of DPP4-I for the treatment of T2DM until January, 2018 by searching the Cochrane Library, PubMed, EMBASE and three Chinese databases. We evaluated the methodological qualities with the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool and the GRADE (The Grading of Recommendations Assessment, Development and Evaluation) approach. Sixty-three SRs (a total of 2,603,140 participants) receiving DPP4-I for the treatment of T2DM were included. The results of AMSTAR showed that the lowest quality was "a list of studies (included and excluded) item" with only one (1.6%) study provided, followed by the "providing a priori design" item with only four (6.3%) studies conforming to this item, the next were "the status of publication (gray literature) used as an inclusion criterion item", with only 18 (28.9%) studies conforming to these items. Only seven (11.1%) studies scored more than nine points in AMSTAR, indicating high methodological quality. For GRADE, of the 128 outcomes, high quality evidence was provided in only 28 (21.9%), moderate in 70 (54.7%), low in 27 (21.1%), and very low in three (2.3%). The methodological quality of SRs of DPP4-I for type 2 diabetes mellitus is not high and there are common areas for improvement. Furthermore, the quality of evidence level is moderate and more high quality evidence is needed.

Approaches and Methodological As Well As Interpretative Issues in Quality of Life Research in Malaysia

PubMed Central

Hasanah, C. I.

2003-01-01

Quality of life measures are designed to enable patients’ perspectives on the impact of health and healthcare interventions on their lives to be assessed and taken into account in clinical decision-making and research. This paper discusses some approaches, methodological as well as interpretative issues of health related quality of life research. PMID:23386798

Methodological Quality Assessment of Meta-analyses in Endodontics.

PubMed

Kattan, Sereen; Lee, Su-Min; Kohli, Meetu R; Setzer, Frank C; Karabucak, Bekir

2018-01-01

The objectives of this review were to assess the methodological quality of published meta-analyses related to endodontics using the assessment of multiple systematic reviews (AMSTAR) tool and to provide a follow-up to previously published reviews. Three electronic databases were searched for eligible studies according to the inclusion and exclusion criteria: Embase via Ovid, The Cochrane Library, and Scopus. The electronic search was amended by a hand search of 6 dental journals (International Endodontic Journal; Journal of Endodontics; Australian Endodontic Journal; Oral Surgery, Oral Medicine, Oral Pathology, Oral Radiology; Endodontics and Dental Traumatology; and Journal of Dental Research). The searches were conducted to include articles published after July 2009, and the deadline for inclusion of the meta-analyses was November 30, 2016. The AMSTAR assessment tool was used to evaluate the methodological quality of all included studies. A total of 36 reports of meta-analyses were included. The overall quality of the meta-analyses reports was found to be medium, with an estimated mean overall AMSTAR score of 7.25 (95% confidence interval, 6.59-7.90). The most poorly assessed areas were providing an a priori design, the assessment of the status of publication, and publication bias. In recent publications in the field of endodontics, the overall quality of the reported meta-analyses is medium according to AMSTAR. Copyright © 2017 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

[The methodological assessment and qualitative evaluation of psychometric performance tests based on the example of modern tests that assess reading and spelling skills].

PubMed

Galuschka, Katharina; Rothe, Josefine; Schulte-Körne, Gerd

2015-09-01

This article looks at a means of objectively evaluating the quality of psychometric tests. This approach enables users to evaluate psychometric tests based on their methodological characteristics, in order to decide which instrument should be used. Reading and spelling assessment tools serve as examples. The paper also provides a review of German psychometric tests for the assessment of reading and spelling skills. This method facilitates the identification of psychometric tests.of high methodological quality which can be used for the assessment of reading and spelling skills. Reading performance should ideally be assessed with the following instruments: ELFE 1-6, LGVT 6-12, LESEN 6-7, LESEN 8-9, or WLLP-R. The tests to be used for the evaluation of spelling skills are DERET 1-2+, DERET 3-4+, WRT 1+, WRT 2+, WRT 3+, WRT 4+ or HSP 1-10.

Appendix C: Background and Methodology for Alternative Certification Pilot. [2014 Teacher Prep Review

ERIC Educational Resources Information Center

Greenberg, Julie; Walsh, Kate; McKee, Arthur

2014-01-01

The "NCTQ Teacher Prep Review" evaluates the quality of programs that provide preservice preparation of public school teachers. As part of the "Review," this appendix reports on a pilot study of new standards for assessing the quality of alternative certification programs. Background and methodology for alternative…

Indirect Comparisons: A Review of Reporting and Methodological Quality

PubMed Central

Donegan, Sarah; Williamson, Paula; Gamble, Carrol; Tudur-Smith, Catrin

2010-01-01

Background The indirect comparison of two interventions can be valuable in many situations. However, the quality of an indirect comparison will depend on several factors including the chosen methodology and validity of underlying assumptions. Published indirect comparisons are increasingly more common in the medical literature, but as yet, there are no published recommendations of how they should be reported. Our aim is to systematically review the quality of published indirect comparisons to add to existing empirical data suggesting that improvements can be made when reporting and applying indirect comparisons. Methodology/Findings Reviews applying statistical methods to indirectly compare the clinical effectiveness of two interventions using randomised controlled trials were eligible. We searched (1966–2008) Database of Abstracts and Reviews of Effects, The Cochrane library, and Medline. Full review publications were assessed for eligibility. Specific criteria to assess quality were developed and applied. Forty-three reviews were included. Adequate methodology was used to calculate the indirect comparison in 41 reviews. Nineteen reviews assessed the similarity assumption using sensitivity analysis, subgroup analysis, or meta-regression. Eleven reviews compared trial-level characteristics. Twenty-four reviews assessed statistical homogeneity. Twelve reviews investigated causes of heterogeneity. Seventeen reviews included direct and indirect evidence for the same comparison; six reviews assessed consistency. One review combined both evidence types. Twenty-five reviews urged caution in interpretation of results, and 24 reviews indicated when results were from indirect evidence by stating this term with the result. Conclusions This review shows that the underlying assumptions are not routinely explored or reported when undertaking indirect comparisons. We recommend, therefore, that the quality of indirect comparisons should be improved, in particular, by assessing assumptions and reporting the assessment methods applied. We propose that the quality criteria applied in this article may provide a basis to help review authors carry out indirect comparisons and to aid appropriate interpretation. PMID:21085712

National Water Quality Laboratory - A Profile

USGS Publications Warehouse

Raese, Jon W.

2001-01-01

The U.S. Geological Survey (USGS) National Water Quality Laboratory (NWQL) is a full-service laboratory that specializes in environmental analytical chemistry. The NWQL's primary mission is to support USGS programs requiring environmental analyses that provide consistent methodology for national assessment and trends analysis. The NWQL provides the following: high-quality chemical data; consistent, published, state-of-the-art methodology; extremely low-detection levels; high-volume capability; biological unit for identifying benthic invertebrates; quality assurance for determining long-term water-quality trends; and a professional staff.

Development of fuzzy air quality index using soft computing approach.

PubMed

Mandal, T; Gorai, A K; Pathak, G

2012-10-01

Proper assessment of air quality status in an atmosphere based on limited observations is an essential task for meeting the goals of environmental management. A number of classification methods are available for estimating the changing status of air quality. However, a discrepancy frequently arises from the quality criteria of air employed and vagueness or fuzziness embedded in the decision making output values. Owing to inherent imprecision, difficulties always exist in some conventional methodologies like air quality index when describing integrated air quality conditions with respect to various pollutants parameters and time of exposure. In recent years, the fuzzy logic-based methods have demonstrated to be appropriated to address uncertainty and subjectivity in environmental issues. In the present study, a methodology based on fuzzy inference systems (FIS) to assess air quality is proposed. This paper presents a comparative study to assess status of air quality using fuzzy logic technique and that of conventional technique. The findings clearly indicate that the FIS may successfully harmonize inherent discrepancies and interpret complex conditions.

Epidemiological characteristics and methodological quality of meta-analyses on diabetes mellitus treatment: a systematic review.

PubMed

Wu, Xin Yin; Lam, Victor C K; Yu, Yue Feng; Ho, Robin S T; Feng, Ye; Wong, Charlene H L; Yip, Benjamin H K; Tsoi, Kelvin K F; Wong, Samuel Y S; Chung, Vincent C H

2016-11-01

Well-conducted meta-analyses (MAs) are considered as one of the best sources of clinical evidence for treatment decision. MA with methodological flaws may introduce bias and mislead evidence users. The aim of this study is to investigate the characteristics and methodological quality of MAs on diabetes mellitus (DM) treatments. Systematic review. Cochrane Database of Systematic Review and Database of Abstract of Reviews of Effects were searched for relevant MAs. Assessing methodological quality of systematic reviews (AMSTAR) tool was used to evaluate the methodological quality of included MAs. Logistic regression analysis was used to identify association between characteristics of MA and AMSTAR results. A total of 252 MAs including 4999 primary studies and 13,577,025 patients were included. Over half of the MAs (65.1%) only included type 2 DM patients and 160 MAs (63.5%) focused on pharmacological treatments. About 89.7% MAs performed comprehensive literature search and 89.3% provided characteristics of included studies. Included MAs generally had poor performance on the remaining AMSTAR items, especially in assessing publication bias (39.3%), providing lists of studies (19.0%) and declaring source of support comprehensively (7.5%). Only 62.7% MAs mentioned about harm of interventions. MAs with corresponding author from Asia performed less well in providing MA protocol than those from Europe. Methodological quality of MA on DM treatments was unsatisfactory. There is considerable room for improvement, especially in assessing publication bias, providing lists of studies and declaring source of support comprehensively. Also, there is an urgent need for MA authors to report treatment harm comprehensively. © 2016 European Society of Endocrinology.

Anti-tobacco mass media and socially disadvantaged groups: a systematic and methodological review.

PubMed

Guillaumier, Ashleigh; Bonevski, Billie; Paul, Chris

2012-07-01

Only a limited amount of research has been conducted to explore whether there are socioeconomic status differences in responses to mass media. However, the methodological quality of this evidence has not been assessed, limiting confidence in conclusions that can be drawn regarding study outcomes. A systematic review of the effectiveness of anti-tobacco mass media campaigns with socially disadvantaged groups was conducted, and the methodological quality of included studies was assessed. Medline, The Cochrane Library, PsycInfo, Embase and Web of Science were searched using MeSH and keywords for quantitative studies conducted in Western countries prior to March 2012. A methodological quality assessment and narrative analysis of included studies was undertaken. Seventeen relevant studies (reported in 18 papers) were identified; however, weak study designs and selection bias were common characteristics, limiting strong conclusions about effectiveness. Using predominantly non-cessation related outcome measures reviewed papers indicated mixed results for mass media tobacco control campaign effectiveness among various social groups. Most studies assessed mass media impact on low socioeconomic status groups rather than highly socially disadvantaged groups. Methodological rigour of evaluations in this field must be improved to aid understanding regarding the effectiveness of mass media campaigns in driving cessation among disadvantaged groups. The results of this review indicate a gap in methodologically rigorous research into the effectiveness of mass media campaigns among socially disadvantaged groups, particularly the highly disadvantaged. © 2012 Australasian Professional Society on Alcohol and other Drugs.

Interventional Radiology Clinical Practice Guideline Recommendations for Neurovascular Disorders Are Not Based on High-Quality Systematic Reviews.

PubMed

Chong, A B; Taylor, M; Schubert, G; Vassar, M

2017-04-01

In recent years, clinical practice guidelines have been criticized for biased interpretations of research evidence, and interventional radiology is no exception. Our aim was to evaluate the methodologic quality and transparency of reporting in systematic reviews used as evidence in interventional radiology clinical practice guidelines for neurovascular disorders from the Society of Interventional Radiology. Our sources were 9 neurovascular disorder clinical practice guidelines from the Society of Interventional Radiology. We selected 65 systematic reviews and meta-analyses. A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) tools were used to assess the methodologic quality and reporting transparency of systematic reviews. Radial plots were created on the basis of average scores for PRISMA and AMSTAR items. On the basis of AMSTAR scores, 3 (4.62%) reviews were high-quality, 28 reviews (43.08%) were moderate-quality, and 34 reviews (52.31%) were low-quality, with an average quality score of 3.66 (34.32%; minimum, 0%; maximum, 81.82%). The average PRISMA score was 18.18 (69.41%). We were unable to obtain previous versions for 8 reviews, 7 of which were from the Cochrane Database of Systematic Reviews. The methodologic quality of systematic reviews needs to be improved. Although reporting clarity was much better than the methodologic quality, it still has room for improvement. The methodologic quality and transparency of reporting did not vary much among clinical practice guidelines. This study can also be applied to other medical specialties to examine the quality of studies used as evidence in their own clinical practice guidelines. © 2017 by American Journal of Neuroradiology.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Methodological quality and descriptive characteristics of prosthodontic-related systematic reviews.

PubMed

Aziz, T; Compton, S; Nassar, U; Matthews, D; Ansari, K; Flores-Mir, C

2013-04-01

Ideally, healthcare systematic reviews (SRs) should be beneficial to practicing professionals in making evidence-based clinical decisions. However, the conclusions drawn from SRs are directly related to the quality of the SR and of the included studies. The aim was to investigate the methodological quality and key descriptive characteristics of SRs published in prosthodontics. Methodological quality was analysed using the Assessment of Multiple Reviews (AMSTAR) tool. Several electronic resources (MEDLINE, EMBASE, Web of Science and American Dental Association's Evidence-based Dentistry website) were searched. In total 106 SRs were located. Key descriptive characteristics and methodological quality features were gathered and assessed, and descriptive and inferential statistical testing performed. Most SRs in this sample originated from the European continent followed by North America. Two to five authors conducted most SRs; the majority was affiliated with academic institutions and had prior experience publishing SRs. The majority of SRs were published in specialty dentistry journals, with implant or implant-related topics, the primary topics of interest for most. According to AMSTAR, most quality aspects were adequately fulfilled by less than half of the reviews. Publication bias and grey literature searches were the most poorly adhered components. Overall, the methodological quality of the prosthodontic-related systematic was deemed limited. Future recommendations would include authors to have prior training in conducting SRs and for journals to include a universal checklist that should be adhered to address all key characteristics of an unbiased SR process. © 2013 Blackwell Publishing Ltd.

Choosing Wisely: assessment of current US top five list recommendations’ trustworthiness using a pragmatic approach

PubMed Central

Horvath, Karl; Semlitsch, Thomas; Jeitler, Klaus; Abuzahra, Muna E; Posch, Nicole; Domke, Andreas; Siebenhofer, Andrea

2016-01-01

Objectives Identification of sufficiently trustworthy top 5 list recommendations from the US Choosing Wisely campaign. Setting Not applicable. Participants All top 5 list recommendations available from the American Board of Internal Medicine Foundation website. Main outcome measures/interventions Compilation of US top 5 lists and search for current German highly trustworthy (S3) guidelines. Extraction of guideline recommendations, including grade of recommendation (GoR), for suggestions comparable to top 5 list recommendations. For recommendations without guideline equivalents, the methodological quality of the top 5 list development process was assessed using criteria similar to that used to judge guidelines, and relevant meta-literature was identified in cited references. Judgement of sufficient trustworthiness of top 5 list recommendations was based either on an ‘A’ GoR of guideline equivalents or on high methodological quality and citation of relevant meta-literature. Results 412 top 5 list recommendations were identified. For 75 (18%), equivalents were found in current German S3 guidelines. 44 of these recommendations were associated with an ‘A’ GoR, or a strong recommendation based on strong evidence, and 26 had a ‘B’ or a ‘C’ GoR. No GoR was provided for 5 recommendations. 337 recommendations had no equivalent in the German S3 guidelines. The methodological quality of the development process was high and relevant meta-literature was cited for 87 top 5 list recommendations. For a further 36, either the methodological quality was high without any meta-literature citations or meta-literature citations existed but the methodological quality was lacking. For the remaining 214 recommendations, either the methodological quality was lacking and no literature was cited or the methodological quality was generally unsatisfactory. Conclusions 131 of current US top 5 list recommendations were found to be sufficiently trustworthy. For a substantial number of current US top 5 list recommendations, their trustworthiness remains unclear. Methodological requirements for developing top 5 lists are recommended. PMID:27855098

A web based health technology assessment in tele-echocardiography: the experience within an Italian project.

PubMed

Giansanti, Daniele; Morelli, Sandra; Maccioni, Giovanni; Guerriero, Lorenzo; Bedini, Remo; Pepe, Gennaro; Colombo, Cesare; Borghi, Gabriella; Macellari, Velio

2009-01-01

Due to major advances in the information technology, telemedicine applications are ready for a widespread use. Nonetheless, to allow their diffusion in National Health Care Systems (NHCSs) specific methodologies of health technology assessment (HTA) should be used to assess the standardization, the overall quality, the interoperability, the addressing to legal, economic and cost benefit aspects. One of the limits to the diffusion of the digital tele-echocardiography (T-E) applications in the NHCS lacking of a specific methodology for the HTA. In the present study, a solution offering a structured HTA of T-E products was designed. The methodology assured also the definition of standardized quality levels for the application. The first level represents the minimum level of acceptance; the other levels are accessory levels useful for a more accurate assessment of the product. The methodology showed to be useful to rationalize the process of standardization and has received a high degree of acceptance by the subjects involved in the study.

Q-SEA – a tool for quality assessment of ethics analyses conducted as part of health technology assessments

PubMed Central

Scott, Anna Mae; Hofmann, Björn; Gutiérrez-Ibarluzea, Iñaki; Bakke Lysdahl, Kristin; Sandman, Lars; Bombard, Yvonne

2017-01-01

Introduction: Assessment of ethics issues is an important part of health technology assessments (HTA). However, in terms of existence of quality assessment tools, ethics for HTA is methodologically underdeveloped in comparison to other areas of HTA, such as clinical or cost effectiveness. Objective: To methodologically advance ethics for HTA by: (1) proposing and elaborating Q-SEA, the first instrument for quality assessment of ethics analyses, and (2) applying Q-SEA to a sample systematic review of ethics for HTA, in order to illustrate and facilitate its use. Methods: To develop a list of items for the Q-SEA instrument, we systematically reviewed the literature on methodology in ethics for HTA, reviewed HTA organizations’ websites, and solicited views from 32 experts in the field of ethics for HTA at two 2-day workshops. We subsequently refined Q-SEA through its application to an ethics analysis conducted for HTA. Results: Q-SEA instrument consists of two domains – the process domain and the output domain. The process domain consists of 5 elements: research question, literature search, inclusion/exclusion criteria, perspective, and ethics framework. The output domain consists of 5 elements: completeness, bias, implications, conceptual clarification, and conflicting values. Conclusion: Q-SEA is the first instrument for quality assessment of ethics analyses in HTA. Further refinements to the instrument to enhance its usability continue. PMID:28326147

Measurement properties of rheumatoid arthritis-specific quality-of-life questionnaires: systematic review of the literature.

PubMed

Lee, Jiyeon; Kim, Soo Hyun; Moon, Seung Hei; Lee, Eun-Hyun

2014-12-01

This study conducted a systematic review of the methodological quality of the psychometric evaluation process and the quality of measurement properties of rheumatoid arthritis (RA)-specific health-related quality-of-life (HRQOL) questionnaires with the purpose of obtaining the best evidence to help in the selection of the most appropriate instrument for measuring HRQOL in RA patients. A systematic literature search was performed to identify RA-specific HRQOL questionnaires in databases. The methodological quality of the studies was assessed using the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. The quality of the measurement properties was assessed using quality criteria. The evidence regarding the measurement properties was pooled using best-evidence synthesis, with considerations of the number and methodological quality of the studies, and the consistency of their findings in terms of the quality of the measurement properties. The search identified 37 studies describing 9 instruments. Best-evidence synthesis suggested that the Rheumatoid Arthritis Quality of Life (RAQoL) questionnaire had the strongest positive evidence, especially with respect to reliability, measurement error, and content validity, and moderate positive evidence with respect to hypothesis testing and responsiveness. The current evidence suggests that the best-validated instrument among the RA-specific HRQOL measures is the RAQoL questionnaire in terms of both methodological quality in the process of psychometric evaluation and the quality of the measurement properties. However, there is limited evidence regarding internal consistency and structural validity of the RAQoL. Further efforts are warranted to establish the psychometric quality of this questionnaire.

Systematic Reviews and Meta-Analyses of Home Telemonitoring Interventions for Patients With Chronic Diseases: A Critical Assessment of Their Methodological Quality

PubMed Central

2013-01-01

Background Systematic reviews and meta-analyses of home telemonitoring interventions for patients with chronic diseases have increased over the past decade and become increasingly important to a wide range of clinicians, policy makers, and other health care stakeholders. While a few criticisms about their methodological rigor and synthesis approaches have recently appeared, no formal appraisal of their quality has been conducted yet. Objective The primary aim of this critical review was to evaluate the methodology, quality, and reporting characteristics of prior reviews that have investigated the effects of home telemonitoring interventions in the context of chronic diseases. Methods Ovid MEDLINE, the Database of Abstract of Reviews of Effects (DARE), and Health Technology Assessment Database (HTA) of the Cochrane Library were electronically searched to find relevant systematic reviews, published between January 1966 and December 2012. Potential reviews were screened and assessed for inclusion independently by three reviewers. Data pertaining to the methods used were extracted from each included review and examined for accuracy by two reviewers. A validated quality assessment instrument, R-AMSTAR, was used as a framework to guide the assessment process. Results Twenty-four reviews, nine of which were meta-analyses, were identified from more than 200 citations. The bibliographic search revealed that the number of published reviews has increased substantially over the years in this area and although most reviews focus on studying the effects of home telemonitoring on patients with congestive heart failure, researcher interest has extended to other chronic diseases as well, such as diabetes, hypertension, chronic obstructive pulmonary disease, and asthma. Nevertheless, an important number of these reviews appear to lack optimal scientific rigor due to intrinsic methodological issues. Also, the overall quality of reviews does not appear to have improved over time. While several criteria were met satisfactorily by either all or nearly all reviews, such as the establishment of an a priori design with inclusion and exclusion criteria, use of electronic searches on multiple databases, and reporting of studies characteristics, there were other important areas that needed improvement. Duplicate data extraction, manual searches of highly relevant journals, inclusion of gray and non-English literature, assessment of the methodological quality of included studies and quality of evidence were key methodological procedures that were performed infrequently. Furthermore, certain methodological limitations identified in the synthesis of study results have affected the results and conclusions of some reviews. Conclusions Despite the availability of methodological guidelines that can be utilized to guide the proper conduct of systematic reviews and meta-analyses and eliminate potential risks of bias, this knowledge has not yet been fully integrated in the area of home telemonitoring. Further efforts should be made to improve the design, conduct, reporting, and publication of systematic reviews and meta-analyses in this area. PMID:23880072

Development and Field Test of an Audit Tool and Tracer Methodology for Clinician Assessment of Quality in End-of-Life Care.

PubMed

Bookbinder, Marilyn; Hugodot, Amandine; Freeman, Katherine; Homel, Peter; Santiago, Elisabeth; Riggs, Alexa; Gavin, Maggie; Chu, Alice; Brady, Ellen; Lesage, Pauline; Portenoy, Russell K

2018-02-01

Quality improvement in end-of-life care generally acquires data from charts or caregivers. "Tracer" methodology, which assesses real-time information from multiple sources, may provide complementary information. The objective of this study was to develop a valid brief audit tool that can guide assessment and rate care when used in a clinician tracer to evaluate the quality of care for the dying patient. To identify items for a brief audit tool, 248 items were created to evaluate overall quality, quality in specific content areas (e.g., symptom management), and specific practices. Collected into three instruments, these items were used to interview professional caregivers and evaluate the charts of hospitalized patients who died. Evidence that this information could be validly captured using a small number of items was obtained through factor analyses, canonical correlations, and group comparisons. A nurse manager field tested tracer methodology using candidate items to evaluate the care provided to other patients who died. The survey of 145 deaths provided chart data and data from 445 interviews (26 physicians, 108 nurses, 18 social workers, and nine chaplains). The analyses yielded evidence of construct validity for a small number of items, demonstrating significant correlations between these items and content areas identified as latent variables in factor analyses. Criterion validity was suggested by significant differences in the ratings on these items between the palliative care unit and other units. The field test evaluated 127 deaths, demonstrated the feasibility of tracer methodology, and informed reworking of the candidate items into the 14-item Tracer EoLC v1. The Tracer EoLC v1 can be used with tracer methodology to guide the assessment and rate the quality of end-of-life care. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Rating the methodological quality of single-subject designs and n-of-1 trials: introducing the Single-Case Experimental Design (SCED) Scale.

PubMed

Tate, Robyn L; McDonald, Skye; Perdices, Michael; Togher, Leanne; Schultz, Regina; Savage, Sharon

2008-08-01

Rating scales that assess methodological quality of clinical trials provide a means to critically appraise the literature. Scales are currently available to rate randomised and non-randomised controlled trials, but there are none that assess single-subject designs. The Single-Case Experimental Design (SCED) Scale was developed for this purpose and evaluated for reliability. Six clinical researchers who were trained and experienced in rating methodological quality of clinical trials developed the scale and participated in reliability studies. The SCED Scale is an 11-item rating scale for single-subject designs, of which 10 items are used to assess methodological quality and use of statistical analysis. The scale was developed and refined over a 3-year period. Content validity was addressed by identifying items to reduce the main sources of bias in single-case methodology as stipulated by authorities in the field, which were empirically tested against 85 published reports. Inter-rater reliability was assessed using a random sample of 20/312 single-subject reports archived in the Psychological Database of Brain Impairment Treatment Efficacy (PsycBITE). Inter-rater reliability for the total score was excellent, both for individual raters (overall ICC = 0.84; 95% confidence interval 0.73-0.92) and for consensus ratings between pairs of raters (overall ICC = 0.88; 95% confidence interval 0.78-0.95). Item reliability was fair to excellent for consensus ratings between pairs of raters (range k = 0.48 to 1.00). The results were replicated with two independent novice raters who were trained in the use of the scale (ICC = 0.88, 95% confidence interval 0.73-0.95). The SCED Scale thus provides a brief and valid evaluation of methodological quality of single-subject designs, with the total score demonstrating excellent inter-rater reliability using both individual and consensus ratings. Items from the scale can also be used as a checklist in the design, reporting and critical appraisal of single-subject designs, thereby assisting to improve standards of single-case methodology.

Methodological quality of randomized trials published in the Journal of the American Podiatric Medical Association, 1999-2013.

PubMed

Landorf, Karl B; Menz, Hylton B; Armstrong, David G; Herbert, Robert D

2015-07-01

Randomized trials must be of high methodological quality to yield credible, actionable findings. The main aim of this project was to evaluate whether there has been an improvement in the methodological quality of randomized trials published in the Journal of the American Podiatric Medical Association (JAPMA). Randomized trials published in JAPMA during a 15-year period (January 1999 to December 2013) were evaluated. The methodological quality of randomized trials was evaluated using the PEDro scale (scores range from 0 to 10, with 0 being lowest quality). Linear regression was used to assess changes in methodological quality over time. A total of 1,143 articles were published in JAPMA between January 1999 and December 2013. Of these, 44 articles were reports of randomized trials. Although the number of randomized trials published each year increased, there was only minimal improvement in their methodological quality (mean rate of improvement = 0.01 points per year). The methodological quality of the trials studied was typically moderate, with a mean ± SD PEDro score of 5.1 ± 1.5. Although there were a few high-quality randomized trials published in the journal, most (84.1%) scored between 3 and 6. Although there has been an increase in the number of randomized trials published in JAPMA, there is substantial opportunity for improvement in the methodological quality of trials published in the journal. Researchers seeking to publish reports of randomized trials should seek to meet current best-practice standards in the conduct and reporting of their trials.

Methodological Quality of Randomized Clinical Trials of Respiratory Physiotherapy in Coronary Artery Bypass Grafting Patients in the Intensive Care Unit: a Systematic Review

PubMed Central

Lorscheitter, Jaqueline; Stein, Cinara; Plentz, Rodrigo Della Méa

2017-01-01

Objective To assess methodological quality of the randomized controlled trials of physiotherapy in patients undergoing coronary artery bypass grafting in the intensive care unit. Methods The studies published until May 2015, in MEDLINE, Cochrane and PEDro were included. The primary outcome extracted was proper filling of the Cochrane Collaboration's tool's items and the secondary was suitability to the requirements of the CONSORT Statement and its extension. Results From 807 studies identified, 39 were included. Most at CONSORT items showed a better adequacy after the statement's publication. Studies with positive outcomes presented better methodological quality. Conclusion The methodological quality of the studies has been improving over the years. However, many aspects can still be better designed. PMID:28977205

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs.

PubMed

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed.

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs

PubMed Central

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed. PMID:27917143

[Method for the quality assessment of data collection processes in epidemiological studies].

PubMed

Schöne, G; Damerow, S; Hölling, H; Houben, R; Gabrys, L

2017-10-01

For a quantitative evaluation of primary data collection processes in epidemiological surveys based on accompaniments and observations (in the field), there is no description of test criteria and methodologies in relevant literature and thus no known application in practice. Therefore, methods need to be developed and existing procedures adapted. The aim was to identify quality-relevant developments within quality dimensions by means of inspection points (quality indicators) during the process of data collection. As a result we seek to implement and establish a methodology for the assessment of overall survey quality supplementary to standardized data analyses. Monitors detect deviations from standard primary data collection during site visits by applying standardized checklists. Quantitative results - overall and for each dimension - are obtained by numerical calculation of quality indicators. Score results are categorized and color coded. This visual prioritization indicates necessity for intervention. The results obtained give clues regarding the current quality of data collection. This allows for the identification of such sections where interventions for quality improvement are needed. In addition, process quality development can be shown over time on an intercomparable basis. This methodology for the evaluation of data collection quality can identify deviations from norms, focalize quality analyses and help trace causes for significant deviations.

Quality and methodological challenges in Internet-based mental health trials.

PubMed

Ye, Xibiao; Bapuji, Sunita Bayyavarapu; Winters, Shannon; Metge, Colleen; Raynard, Mellissa

2014-08-01

To review the quality of Internet-based mental health intervention studies and their methodological challenges. We searched multiple literature databases to identify relevant studies according to the Population, Interventions, Comparators, Outcomes, and Study Design framework. Two reviewers independently assessed selection bias, allocation bias, confounding bias, blinding, data collection methods, and withdrawals/dropouts, using the Quality Assessment Tool for Quantitative Studies. We rated each component as strong, moderate, or weak and assigned a global rating (strong, moderate, or weak) to each study. We discussed methodological issues related to the study quality. Of 122 studies included, 31 (25%), 44 (36%), and 47 (39%) were rated strong, moderate, and weak, respectively. Only five studies were rated strong for all of the six quality components (three of them were published by the same group). Lack of blinding, selection bias, and low adherence were the top three challenges in Internet-based mental health intervention studies. The overall quality of Internet-based mental health intervention needs to improve. In particular, studies need to improve sample selection, intervention allocation, and blinding.

Systematic reviews and meta-analyses on psoriasis: role of funding sources, conflict of interest and bibliometric indices as predictors of methodological quality.

PubMed

Gómez-García, F; Ruano, J; Aguilar-Luque, M; Gay-Mimbrera, J; Maestre-Lopez, B; Sanz-Cabanillas, J L; Carmona-Fernández, P J; González-Padilla, M; Vélez García-Nieto, A; Isla-Tejera, B

2017-06-01

The quality of systematic reviews and meta-analyses on psoriasis, a chronic inflammatory skin disease that severely impairs quality of life and is associated with high costs, remains unknown. To assess the methodological quality of systematic reviews published on psoriasis. After a comprehensive search in MEDLINE, Embase and the Cochrane Database (PROSPERO: CDR42016041611), the quality of studies was assessed by two raters using the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Article metadata and journal-related bibliometric indices were also obtained. Systematic reviews were classified as low (0-4), moderate (5-8) or high (9-11) quality. A prediction model for methodological quality was fitted using principal component and multivariate ordinal logistic regression analyses. We classified 220 studies as high (17·2%), moderate (55·0%) or low (27·8%) quality. Lower compliance rates were found for AMSTAR question (Q)5 (list of studies provided, 11·4%), Q10 (publication bias assessed, 27·7%), Q4 (status of publication included, 39·5%) and Q1 (a priori design provided, 40·9%). Factors such as meta-analysis inclusion [odds ratio (OR) 6·22; 95% confidence interval (CI) 2·78-14·86], funding by academic institutions (OR 2·90, 95% CI 1·11-7·89), Article Influence score (OR 2·14, 95% CI 1·05-6·67), 5-year impact factor (OR 1·34, 95% CI 1·02-1·40) and article page count (OR 1·08, 95% CI 1·02-1·15) significantly predicted higher quality. A high number of authors with a conflict of interest (OR 0·90, 95% CI 0·82-0·99) was significantly associated with lower quality. The methodological quality of systematic reviews published about psoriasis remains suboptimal. The type of funding sources and author conflicts may compromise study quality, increasing the risk of bias. © 2017 British Association of Dermatologists.

SERVQUAL Application and Adaptation for Educational Service Quality Assessments in Russian Higher Education

ERIC Educational Resources Information Center

Galeeva, Railya B.

2016-01-01

Purpose: The purpose of this study is to demonstrate an adaptation of the SERVQUAL survey method for measuring the quality of higher educational services in a Russian university context. We use a new analysis and a graphical technique for presentation of results. Design/methodology/approach: The methodology of this research follows the classic…

Evaluation of the Factors That Determine Quality in Higher Education: An Empirical Study

ERIC Educational Resources Information Center

Tsinidou, Maria; Gerogiannis, Vassilis; Fitsilis, Panos

2010-01-01

Purpose: The aim of this paper is to identify the quality determinants for education services provided by higher education institutions (HEIs) in Greece and to measure their relative importance from the students' points of view. Design/methodology/approach: A multi-criteria decision-making methodology was used for assessing the relative importance…

Quality in the Basic Grant Delivery System: Volume 3, Methodology.

ERIC Educational Resources Information Center

Advanced Technology, Inc., McLean, VA.

The research methodology of a study to assess 1980-1981 award accuracy of the Basic Educational Opportunity Grants (BEOG), or Pell grants, is described. The study is the first stage of a three-stage quality control project. During the spring of 1981 a nationally representative sample of 305 public, private, and proprietary institutions was…

Development of Management Methodology for Engineering Production Quality

NASA Astrophysics Data System (ADS)

Gorlenko, O.; Miroshnikov, V.; Borbatc, N.

2016-04-01

The authors of the paper propose four directions of the methodology developing the quality management of engineering products that implement the requirements of new international standard ISO 9001:2015: the analysis of arrangement context taking into account stakeholders, the use of risk management, management of in-house knowledge, assessment of the enterprise activity according to the criteria of effectiveness

Quality Assessment in the Blog Space

ERIC Educational Resources Information Center

Schaal, Markus; Fidan, Guven; Muller, Roland M.; Dagli, Orhan

2010-01-01

Purpose: The purpose of this paper is the presentation of a new method for blog quality assessment. The method uses the temporal sequence of link creation events between blogs as an implicit source for the collective tacit knowledge of blog authors about blog quality. Design/methodology/approach: The blog data are processed by the novel method for…

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews

PubMed Central

2013-01-01

Background Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. Methods This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. Results A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. Conclusion There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words) PMID:23331384

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews.

PubMed

Wells, Cherie; Kolt, Gregory S; Marshall, Paul; Hill, Bridget; Bialocerkowski, Andrea

2013-01-19

Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words).

ASSESSING BIOACCUMULATION FOR DERIVING NATIONAL HUMAN HEALTH WATER QUALITY CRITERIA

EPA Science Inventory

The United States Environmental Protection Agency is revising its methodology for deriving national ambient water quality criteria (AWQC) to protect human health. A component of this guidance involves assessing the potential for chemical bioaccumulation in commonly consumed fish ...

Retinal Image Quality Assessment for Spaceflight-Induced Vision Impairment Study

NASA Technical Reports Server (NTRS)

Vu, Amanda Cadao; Raghunandan, Sneha; Vyas, Ruchi; Radhakrishnan, Krishnan; Taibbi, Giovanni; Vizzeri, Gianmarco; Grant, Maria; Chalam, Kakarla; Parsons-Wingerter, Patricia

2015-01-01

Long-term exposure to space microgravity poses significant risks for visual impairment. Evidence suggests such vision changes are linked to cephalad fluid shifts, prompting a need to directly quantify microgravity-induced retinal vascular changes. The quality of retinal images used for such vascular remodeling analysis, however, is dependent on imaging methodology. For our exploratory study, we hypothesized that retinal images captured using fluorescein imaging methodologies would be of higher quality in comparison to images captured without fluorescein. A semi-automated image quality assessment was developed using Vessel Generation Analysis (VESGEN) software and MATLAB® image analysis toolboxes. An analysis of ten images found that the fluorescein imaging modality provided a 36% increase in overall image quality (two-tailed p=0.089) in comparison to nonfluorescein imaging techniques.

Methodology for stereoscopic motion-picture quality assessment

NASA Astrophysics Data System (ADS)

Voronov, Alexander; Vatolin, Dmitriy; Sumin, Denis; Napadovsky, Vyacheslav; Borisov, Alexey

2013-03-01

Creating and processing stereoscopic video imposes additional quality requirements related to view synchronization. In this work we propose a set of algorithms for detecting typical stereoscopic-video problems, which appear owing to imprecise setup of capture equipment or incorrect postprocessing. We developed a methodology for analyzing the quality of S3D motion pictures and for revealing their most problematic scenes. We then processed 10 modern stereo films, including Avatar, Resident Evil: Afterlife and Hugo, and analyzed changes in S3D-film quality over the years. This work presents real examples of common artifacts (color and sharpness mismatch, vertical disparity and excessive horizontal disparity) in the motion pictures we processed, as well as possible solutions for each problem. Our results enable improved quality assessment during the filming and postproduction stages.

Assessing medical professionalism: A systematic review of instruments and their measurement properties.

PubMed

Li, Honghe; Ding, Ning; Zhang, Yuanyuan; Liu, Yang; Wen, Deliang

2017-01-01

Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments' measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990-2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument's usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee's criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar's instrument for nursing students, Nurse Practitioners' Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies.

Methodological and Reporting Quality of Comparative Studies Evaluating Health-Related Quality of Life of Colorectal Cancer Patients and Controls: A Systematic Review.

PubMed

Wong, Carlos K H; Guo, Vivian Y W; Chen, Jing; Lam, Cindy L K

2016-11-01

Health-related quality of life is an important outcome measure in patients with colorectal cancer. Comparison with normative data has been increasingly undertaken to assess the additional impact of colorectal cancer on health-related quality of life. This review aimed to critically appraise the methodological details and reporting characteristics of comparative studies evaluating differences in health-related quality of life between patients and controls. A systematic search of English-language literature published between January 1985 and May 2014 was conducted through a database search of PubMed, Web of Science, Embase, and Medline. Comparative studies reporting health-related quality-of-life outcomes among patients who have colorectal cancer and controls were selected. Methodological and reporting quality per comparison study was evaluated based on a 11-item methodological checklist proposed by Efficace in 2003 and a set of criteria predetermined by reviewers. Thirty-one comparative studies involving >10,000 patients and >10,000 controls were included. Twenty-three studies (74.2%) originated from European countries, with the largest number from the Netherlands (n = 6). Twenty-eight studies (90.3%) compared the health-related quality of life of patients with normative data published elsewhere, whereas the remaining studies recruited a group of patients who had colorectal cancer and a group of control patients within the same studies. The European Organisation for Research and Treatment of Cancer Quality-of-Life Questionnaire Core 30 was the most extensively used instrument (n = 16; 51.6%). Eight studies (25.8%) were classified as "probably robust" for clinical decision making according to the Efficace standard methodological checklist. Our further quality assessment revealed the lack of score differences reported (61.3%), contemporary comparisons (36.7%), statistical significance tested (38.7%), and matching of control group (58.1%), possibly leading to inappropriate control groups for fair comparisons. Meta-analysis of differences between the 2 groups was not available. In general, one-fourth of comparative studies that evaluated health-related quality of life of patients who had colorectal cancer achieved high quality in reporting characteristics and methodological details. Future studies are encouraged to undertake health-related quality-of-life measurement and adhere to a methodological checklist in comparison with controls.

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

Assessment of Patient Empowerment - A Systematic Review of Measures

PubMed Central

Barr, Paul J.; Scholl, Isabelle; Bravo, Paulina; Faber, Marjan J.; Elwyn, Glyn; McAllister, Marion

2015-01-01

Background Patient empowerment has gained considerable importance but uncertainty remains about the best way to define and measure it. The validity of empirical findings depends on the quality of measures used. This systematic review aims to provide an overview of studies assessing psychometric properties of questionnaires purporting to capture patient empowerment, evaluate the methodological quality of these studies and assess the psychometric properties of measures identified. Methods Electronic searches in five databases were combined with reference tracking of included articles. Peer-reviewed articles reporting psychometric testing of empowerment measures for adult patients in French, German, English, Portuguese and Spanish were included. Study characteristics, constructs operationalised and psychometric properties were extracted. The quality of study design, methods and reporting was assessed using the COSMIN checklist. The quality of psychometric properties was assessed using Terwee’s 2007 criteria. Findings 30 studies on 19 measures were included. Six measures are generic, while 13 were developed for a specific condition (N=4) or specialty (N=9). Most studies tested measures in English (N=17) or Swedish (N=6). Sample sizes of included studies varied from N=35 to N=8261. A range of patient empowerment constructs was operationalised in included measures. These were classified into four domains: patient states, experiences and capacities; patient actions and behaviours; patient self-determination within the healthcare relationship and patient skills development. Quality assessment revealed several flaws in methodological study quality with COSMIN scores mainly fair or poor. The overall quality of psychometric properties of included measures was intermediate to positive. Certain psychometric properties were not tested for most measures. Discussion Findings provide a basis from which to develop consensus on a core set of patient empowerment constructs and for further work to develop a (set of) appropriately validated measure(s) to capture this. The methodological quality of psychometric studies could be improved by adhering to published quality criteria. PMID:25970618

Relationships between abstract features and methodological quality explained variations of social media activity derived from systematic reviews about psoriasis interventions.

PubMed

Ruano, J; Aguilar-Luque, M; Isla-Tejera, B; Alcalde-Mellado, P; Gay-Mimbrera, J; Hernandez-Romero, José Luis; Sanz-Cabanillas, J L; Maestre-López, B; González-Padilla, M; Carmona-Fernández, P J; Gómez-García, F; García-Nieto, A Vélez

2018-05-24

The aim of this study was to describe the relationship among abstract structure, readability, and completeness, and how these features may influence social media activity and bibliometric results, considering systematic reviews (SRs) about interventions in psoriasis classified by methodological quality. Systematic literature searches about psoriasis interventions were undertaken on relevant databases. For each review, methodological quality was evaluated using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Abstract extension, structure, readability, and quality and completeness of reporting were analyzed. Social media activity, which consider Twitter and Facebook mention counts, as well as Mendeley readers and Google scholar citations were obtained for each article. Analyses were conducted to describe any potential influence of abstract characteristics on review's social media diffusion. We classified 139 intervention SRs as displaying high/moderate/low methodological quality. We observed that abstract readability of SRs has been maintained high for last 20 years, although there are some differences based on their methodological quality. Free-format abstracts were most sensitive to the increase of text readability as compared with more structured abstracts (IMRAD or 8-headings), yielding opposite effects on their quality and completeness depending on the methodological quality: a worsening in low quality reviews and an improvement in those of high-quality. Both readability indices and PRISMA for Abstract total scores showed an inverse relationship with social media activity and bibliometric results in high methodological quality reviews but not in those of lower quality. Our results suggest that increasing abstract readability must be specially considered when writing free-format summaries of high-quality reviews, because this fact correlates with an improvement of their completeness and quality, and this may help to achieve broader social media visibility and article usage. Copyright © 2018 Elsevier Inc. All rights reserved.

Assessing quality of reports on randomized clinical trials in nursing journals.

PubMed

Parent, Nicole; Hanley, James A

2009-01-01

Several surveys have presented the quality of reports on randomized clinical trials (RCTs) published in general and specialty medical journals. The aim of these surveys was to raise scientific consciousness on methodological aspects pertaining to internal and external validity. These reviews have suggested that the methodological quality could be improved. We conducted a survey of reports on RCTs published in nursing journals to assess their methodological quality. The features we considered included sample size, flow of participants, assessment of baseline comparability, randomization, blinding, and statistical analysis. We collected data from all reports of RCTs published between January 1994 and December 1997 in Applied Nursing Research, Heart & Lung and Nursing Research. We hand-searched the journals and included all 54 articles in which authors reported that individuals have been randomly allocated to distinct groups. We collected data using a condensed form of the Consolidated Standards of Reporting Trials (CONSORT) statement for structured reporting of RCTs (Begg et al., 1996). Sample size calculations were included in only 22% of the reports. Only 48% of the reports provided information about the type of randomization, and a mere 22% described blinding strategies. Comparisons of baseline characteristics using hypothesis tests were abusively produced in more than 76% of the reports. Excessive use and unstructured reports of significance testing were common (59%), and all reports failed to provide magnitude of treatment differences with confidence intervals. Better methodological quality in reports of RCTs will contribute to increase the standards of nursing research.

Reporting and methodological quality of meta-analyses in urological literature.

PubMed

Xia, Leilei; Xu, Jing; Guzzo, Thomas J

2017-01-01

To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, " a priori " design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and " a priori " design were associated with superior reporting quality, following PRISMA guideline and " a priori " design were associated with superior methodological quality. Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having " a priori " protocol.

Characteristics and quality of published animal research in the field of radiology.

PubMed

Yoon, Soo Jeong; Yoon, Dae Young; Cho, Young Kwon; Baek, Sora; Lim, Kyoung Ja; Seo, Young Lan; Yun, Eun Joo

2017-06-01

Background Animal research has played an important role in the field of radiology. Purpose To evaluate the characteristics and quality of published radiological animal research. Material and Methods A PubMed search was performed for radiological animal research articles (defined as studies using animal models with a radiologist as the first author) published in 1994, 2004, and 2014. The following information was extracted from each article: journal name, radiological subspecialty, imaging technique, animal species, number of animals used, number of authors, declared funding, country of origin, methodological quality, and ethical quality. Methodological and ethical quality of studies were assessed with seven-item (sample size calculation, animal age, animal sex, animal weight, inclusion and exclusion criteria, randomization, and blinded outcome assessment) and four-item (ethical review committee approval, anesthesia, pain control, and euthanasia) scales, respectively. Results The numbers of radiological animal studies markedly increased, from 91 in 1994 to 163 in 2004 and to 305 in 2014. One hundred and sixty-two (29.0%) articles focused on the neuroradiology/head and neck subspecialty, 233 (41.7%) used magnetic resonance imaging (MRI), 190 (34.0%) used mice, 254 (45.4%) used 10-30 animals, 297 (53.1%) had 4-7 authors, 392 (70.1%) were funded, and 222 (39.7%) were from the USA. Six of 7 methodological and 3/4 ethical quality items significantly improved over time. Conclusion The quantity and quality of radiological animal research has increased over the last two decades; however, methodological and ethical quality remains suboptimal.

Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist.

PubMed

Terwee, Caroline B; Mokkink, Lidwine B; Knol, Dirk L; Ostelo, Raymond W J G; Bouter, Lex M; de Vet, Henrica C W

2012-05-01

The COSMIN checklist is a standardized tool for assessing the methodological quality of studies on measurement properties. It contains 9 boxes, each dealing with one measurement property, with 5-18 items per box about design aspects and statistical methods. Our aim was to develop a scoring system for the COSMIN checklist to calculate quality scores per measurement property when using the checklist in systematic reviews of measurement properties. The scoring system was developed based on discussions among experts and testing of the scoring system on 46 articles from a systematic review. Four response options were defined for each COSMIN item (excellent, good, fair, and poor). A quality score per measurement property is obtained by taking the lowest rating of any item in a box ("worst score counts"). Specific criteria for excellent, good, fair, and poor quality for each COSMIN item are described. In defining the criteria, the "worst score counts" algorithm was taken into consideration. This means that only fatal flaws were defined as poor quality. The scores of the 46 articles show how the scoring system can be used to provide an overview of the methodological quality of studies included in a systematic review of measurement properties. Based on experience in testing this scoring system on 46 articles, the COSMIN checklist with the proposed scoring system seems to be a useful tool for assessing the methodological quality of studies included in systematic reviews of measurement properties.

Vending machine assessment methodology. A systematic review.

PubMed

Matthews, Melissa A; Horacek, Tanya M

2015-07-01

The nutritional quality of food and beverage products sold in vending machines has been implicated as a contributing factor to the development of an obesogenic food environment. How comprehensive, reliable, and valid are the current assessment tools for vending machines to support or refute these claims? A systematic review was conducted to summarize, compare, and evaluate the current methodologies and available tools for vending machine assessment. A total of 24 relevant research studies published between 1981 and 2013 met inclusion criteria for this review. The methodological variables reviewed in this study include assessment tool type, study location, machine accessibility, product availability, healthfulness criteria, portion size, price, product promotion, and quality of scientific practice. There were wide variations in the depth of the assessment methodologies and product healthfulness criteria utilized among the reviewed studies. Of the reviewed studies, 39% evaluated machine accessibility, 91% evaluated product availability, 96% established healthfulness criteria, 70% evaluated portion size, 48% evaluated price, 52% evaluated product promotion, and 22% evaluated the quality of scientific practice. Of all reviewed articles, 87% reached conclusions that provided insight into the healthfulness of vended products and/or vending environment. Product healthfulness criteria and complexity for snack and beverage products was also found to be variable between the reviewed studies. These findings make it difficult to compare results between studies. A universal, valid, and reliable vending machine assessment tool that is comprehensive yet user-friendly is recommended. Copyright © 2015 Elsevier Ltd. All rights reserved.

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated. Clinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement. Copyright © 2017 Elsevier Ltd. All rights reserved.

Cognitive remediation in schizophrenia: A methodological appraisal of systematic reviews and meta-analyses.

PubMed

Bryce, Shayden; Sloan, Elise; Lee, Stuart; Ponsford, Jennie; Rossell, Susan

2016-04-01

Systematic reviews and meta-analyses are a primary source of evidence when evaluating the benefit(s) of cognitive remediation (CR) in schizophrenia. These studies are designed to rigorously synthesize scientific literature; however, cannot be assumed to be of high methodological quality. The aims of this report were to: 1) review the use of systematic reviews and meta-analyses regarding CR in schizophrenia; 2) conduct a systematic methodological appraisal of published reports examining the benefits of this intervention on core outcome domains; and 3) compare the correspondence between methodological and reporting quality. Electronic databases were searched for relevant articles. Twenty-one reviews met inclusion criteria and were scored according to the AMSTAR checklist-a validated scale of methodological quality. Five meta-analyses were also scored according to PRISMA statement to compare 'quality of conduct' with 'quality of reporting'. Most systematic reviews and meta-analyses shared strengths and fell within a 'medium' level of methodological quality. Nevertheless, there were consistent areas of potential weakness that were not addressed by most reviews. These included the lack of protocol registration, uncertainty regarding independent data extraction and consensus procedures, and the minimal assessment of publication bias. Moreover, quality of conduct may not necessarily parallel quality of reporting, suggesting that consideration of these methods independently may be important. Reviews concerning CR for schizophrenia are a valuable source of evidence. However, the methodological quality of these reports may require additional consideration. Enhancing quality of conduct is essential for enabling research literature to be interpreted with confidence. Copyright © 2016 Elsevier Ltd. All rights reserved.

Methodological quality evaluation of systematic reviews or meta-analyses on ERCC1 in non-small cell lung cancer: a systematic review.

PubMed

Tao, Huan; Zhang, Yueyuan; Li, Qian; Chen, Jin

2017-11-01

To assess the methodological quality of systematic reviews (SRs) or meta-analysis concerning the predictive value of ERCC1 in platinum chemotherapy of non-small cell lung cancer. We searched the PubMed, EMbase, Cochrane library, international prospective register of systematic reviews, Chinese BioMedical Literature Database, China National Knowledge Infrastructure, Wan Fang and VIP database for SRs or meta-analysis. The methodological quality of included literatures was evaluated by risk of bias in systematic review (ROBIS) scale. Nineteen eligible SRs/meta-analysis were included. The most frequently searched databases were EMbase (74%), PubMed, Medline and CNKI. Fifteen SRs did additional retrieval manually, but none of them retrieved the registration platform. 47% described the two-reviewers model in the screening for eligible original articles, and seven SRs described the two reviewers to extract data. In methodological quality assessment, inter-rater reliability Kappa was 0.87 between two reviewers. Research question were well related to all SRs in phase 1 and the eligibility criteria was suitable for each SR, and rated as 'low' risk bias. But the 'high' risk bias existed in all the SRs regarding methods used to identify and/or select studies, and data collection and study appraisal. More than two-third of SRs or meta-analysis were finished with high risk of bias in the synthesis, findings and the final phase. The study demonstrated poor methodological quality of SRs/meta-analysis assessing the predictive value of ERCC1 in chemotherapy among the NSCLC patients, especially the high performance bias. Registration or publishing the protocol is recommended in future research.

Static body postural misalignment in individuals with temporomandibular disorders: a systematic review

PubMed Central

Chaves, Thaís C.; Turci, Aline M.; Pinheiro, Carina F.; Sousa, Letícia M.; Grossi, Débora B.

2014-01-01

BACKGROUND: The association between body postural changes and temporomandibular disorders (TMD) has been widely discussed in the literature, however, there is little evidence to support this association. OBJECTIVES: The aim of the present study was to conduct a systematic review to assess the evidence concerning the association between static body postural misalignment and TMD. METHOD: A search was conducted in the PubMed/Medline, Embase, Lilacs, Scielo, Cochrane, and Scopus databases including studies published in English between 1950 and March 2012. Cross-sectional, cohort, case control, and survey studies that assessed body posture in TMD patients were selected. Two reviewers performed each step independently. A methodological checklist was used to evaluate the quality of the selected articles. RESULTS: Twenty studies were analyzed for their methodological quality. Only one study was classified as a moderate quality study and two were classified as strong quality studies. Among all studies considered, only 12 included craniocervical postural assessment, 2 included assessment of craniocervical and shoulder postures,, and 6 included global assessment of body posture. CONCLUSION: There is strong evidence of craniocervical postural changes in myogenous TMD, moderate evidence of cervical postural misalignment in arthrogenous TMD, and no evidence of absence of craniocervical postural misalignment in mixed TMD patients or of global body postural misalignment in patients with TMD. It is important to note the poor methodological quality of the studies, particularly those regarding global body postural misalignment in TMD patients. PMID:25590441

Toward a Methodology for Conducting Social Impact Assessments Using Quality of Social Life Indicators.

ERIC Educational Resources Information Center

Olsen, Marvin E.; Merwin, Donna J.

Broadly conceived, social impacts refer to all changes in the structure and functioning of patterned social ordering that occur in conjunction with an environmental, technological, or social innovation or alteration. Departing from the usual cost-benefit analysis approach, a new methodology proposes conducting social impact assessment grounded in…

The exchangeability of self-reports and administrative health care resource use measurements: assessement of the methodological reporting quality.

PubMed

Noben, Cindy Yvonne; de Rijk, Angelique; Nijhuis, Frans; Kottner, Jan; Evers, Silvia

2016-06-01

To assess the exchangeability of self-reported and administrative health care resource use measurements for cost estimation. In a systematic review (NHS EED and MEDLINE), reviewers evaluate, in duplicate, the methodological reporting quality of studies comparing the validation evidence of instruments measuring health care resource use. The appraisal tool Methodological Reporting Quality (MeRQ) is developed by merging aspects form the Guidelines for Reporting Reliability and Agreement Studies and the Standards for Reporting Diagnostic Accuracy. Out of 173 studies, 35 full-text articles are assessed for eligibility. Sixteen articles are included in this study. In seven articles, more than 75% of the reporting criteria assessed by MERQ are considered "good." Most studies score at least "fair" on most of the reporting quality criteria. In the end, six studies score "good" on the minimal criteria for reporting. Varying levels of agreement among the different data sources are found, with correlations ranging from 0.14 up to 0.93 and with occurrences of both random and systematic errors. The validation evidence of the small number of studies with adequate MeRQ cautiously supports the exchangeability of both the self-reported and administrative resource use measurement methods. Copyright © 2016 Elsevier Inc. All rights reserved.

Assessment of reproductive and developmental effects of DINP, DnHP and DCHP using quantitative weight of evidence.

PubMed

Dekant, Wolfgang; Bridges, James

2016-11-01

Quantitative weight of evidence (QWoE) methodology utilizes detailed scoring sheets to assess the quality/reliability of each publication on toxicity of a chemical and gives numerical scores for quality and observed toxicity. This QWoE-methodology was applied to the reproductive toxicity data on diisononylphthalate (DINP), di-n-hexylphthalate (DnHP), and dicyclohexylphthalate (DCHP) to determine if the scientific evidence for adverse effects meets the requirements for classification as reproductive toxicants. The scores for DINP were compared to those when applying the methodology DCHP and DnHP that have harmonized classifications. Based on the quality/reliability scores, application of the QWoE shows that the three databases are of similar quality; but effect scores differ widely. Application of QWoE to DINP studies resulted in an overall score well below the benchmark required to trigger classification. For DCHP, the QWoE also results in low scores. The high scores from the application of the QWoE methodology to the toxicological data for DnHP represent clear evidence for adverse effects and justify a classification of DnHP as category 1B for both development and fertility. The conclusions on classification based on the QWoE are well supported using a narrative assessment of consistency and biological plausibility. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

A Comparison of Methodological Approaches for Evaluating the Quality of Basic Skills Programs. AIR Forum 1982 Paper.

ERIC Educational Resources Information Center

Dumont, Richard G.; And Others

A multiple-indicator and multiple-design approach for evaluating the quality of basic skills programs in reading, writing, and mathematics that has been implemented within a statewide system of higher education in the southeastern United States was assessed. Several of the evaluation methodologies are compared in order to determine whether results…

Non-Surgical Interventions for Adolescents with Idiopathic Scoliosis: An Overview of Systematic Reviews

PubMed Central

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Background Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Objectives Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Design Systematic overview of systematic reviews. Methods Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute’s hierarchies were applied to analyze the levels of evidence from included reviews. Results From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Conclusions Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. Protocol registry number CRD42013003538, PROSPERO PMID:25353954

Non-surgical interventions for adolescents with idiopathic scoliosis: an overview of systematic reviews.

PubMed

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Systematic overview of systematic reviews. Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute's hierarchies were applied to analyze the levels of evidence from included reviews. From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. CRD42013003538, PROSPERO.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed

Lexchin, J; Holbrook, A

1994-07-01

To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). Analytic study. All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion.

Evolution of the methodological quality of controlled clinical trials for myofascial trigger point treatments for the period 1978-2015: A systematic review.

PubMed

Stoop, Rahel; Clijsen, Ron; Leoni, Diego; Soldini, Emiliano; Castellini, Greta; Redaelli, Valentina; Barbero, Marco

2017-08-01

The methodological quality of controlled clinical trials (CCTs) of physiotherapeutic treatment modalities for myofascial trigger points (MTrP) has not been investigated yet. To detect the methodological quality of CCTs for physiotherapy treatments of MTrPs and demonstrating the possible increase over time. Systematic review. A systematic search was conducted in two databases, Physiotherapy Evidence Database (PEDro) and Medicine Medical Literature Analysis and Retrieval System online (MEDLINE), using the same keywords and selection procedure corresponding to pre-defined inclusion criteria. The methodological quality, assessed by the 11-item PEDro scale, served as outcome measure. The CCTs had to compare at least two interventions, where one intervention had to lay within the scope of physiotherapy. Participants had to be diagnosed with myofascial pain syndrome or trigger points (active or latent). A total of n = 230 studies was analysed. The cervico-thoracic region was the most frequently treated body part (n = 143). Electrophysical agent applications was the most frequent intervention. The average methodological quality reached 5.5 on the PEDro scale. A total of n = 6 studies scored the value of 9. The average PEDro score increased by 0.7 points per decade between 1978 and 2015. The average PEDro score of CCTs for MTrP treatments does not reach the cut-off of 6 proposed for moderate to high methodological quality. Nevertheless, a promising trend towards an increase of the average methodological quality of CCTs for MTrPs was recorded. More high-quality CCT studies with thorough research procedures are recommended to enhance methodological quality. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed Central

Lexchin, J; Holbrook, A

1994-01-01

OBJECTIVE: To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). DESIGN: Analytic study. DATA SOURCE: All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. MAIN OUTCOME MEASURES: Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. MAIN RESULTS: Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. CONCLUSIONS: Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion. PMID:8004560

The reliability of physical examination tests for the diagnosis of anterior cruciate ligament rupture--A systematic review.

PubMed

Lange, Toni; Freiberg, Alice; Dröge, Patrik; Lützner, Jörg; Schmitt, Jochen; Kopkow, Christian

2015-06-01

Systematic literature review. Despite their frequent application in routine care, a systematic review on the reliability of clinical examination tests to evaluate the integrity of the ACL is missing. To summarize and evaluate intra- and interrater reliability research on physical examination tests used for the diagnosis of ACL tears. A comprehensive systematic literature search was conducted in MEDLINE, EMBASE and AMED until May 30th 2013. Studies were included if they assessed the intra- and/or interrater reliability of physical examination tests for the integrity of the ACL. Methodological quality was evaluated with the Quality Appraisal of Reliability Studies (QAREL) tool by two independent reviewers. 110 hits were achieved of which seven articles finally met the inclusion criteria. These studies examined the reliability of four physical examination tests. Intrarater reliability was assessed in three studies and ranged from fair to almost perfect (Cohen's k = 0.22-1.00). Interrater reliability was assessed in all included studies and ranged from slight to almost perfect (Cohen's k = 0.02-0.81). The Lachman test is the physical tests with the highest intrarater reliability (Cohen's k = 1.00), the Lachman test performed in prone position the test with the highest interrater reliability (Cohen's k = 0.81). Included studies were partly of low methodological quality. A meta-analysis could not be performed due to the heterogeneity in study populations, reliability measures and methodological quality of included studies. Systematic investigations on the reliability of physical examination tests to assess the integrity of the ACL are scarce and of varying methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina.

PubMed

Zhang, Xiaoxia; Wang, Hui; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina

PubMed Central

Zhang, Xiaoxia; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved. PMID:26539221

Assessing medical professionalism: A systematic review of instruments and their measurement properties

PubMed Central

Li, Honghe; Liu, Yang; Wen, Deliang

2017-01-01

Background Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments’ measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. Methods A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990–2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument’s usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee’s criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. Results After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar’s instrument for nursing students, Nurse Practitioners’ Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Conclusion Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies. PMID:28498838

Feedback Effects of Teaching Quality Assessment: Macro and Micro Evidence

ERIC Educational Resources Information Center

Bianchini, Stefano

2014-01-01

This study investigates the feedback effects of teaching quality assessment. Previous literature looked separately at the evolution of individual and aggregate scores to understand whether instructors and university performance depends on its past evaluation. I propose a new quantitative-based methodology, combining statistical distributions and…

Design guidelines for an umbilical cord blood stem cell therapy quality assessment model

NASA Astrophysics Data System (ADS)

Januszewski, Witold S.; Michałek, Krzysztof; Yagensky, Oleksandr; Wardzińska, Marta

The paper enlists the pivotal guidelines for producing an empirical umbilical cord blood stem cell therapy quality assessment model. The methodology adapted was single equation linear model with domain knowledge derived from MEDAFAR classification. The resulting model is ready for therapeutical application.

Couple Attachment and Relationship Duration in Psychotherapy Patients: Exploring a New Methodology of Assessment

ERIC Educational Resources Information Center

Sochos, Antigonos

2014-01-01

The couple relationship is an essential source of support for individuals undergoing psychological treatment and the aim of this study was to apply a new methodology in assessing the quality of such support. A theoretically informed thematic analysis of interview transcripts was conducted, triangulated by quantitative data. Twenty-one brief…

Methodological and Reporting Quality of Systematic Reviews and Meta-analyses in Endodontics.

PubMed

Nagendrababu, Venkateshbabu; Pulikkotil, Shaju Jacob; Sultan, Omer Sheriff; Jayaraman, Jayakumar; Peters, Ove A

2018-06-01

The aim of this systematic review (SR) was to evaluate the quality of SRs and meta-analyses (MAs) in endodontics. A comprehensive literature search was conducted to identify relevant articles in the electronic databases from January 2000 to June 2017. Two reviewers independently assessed the articles for eligibility and data extraction. SRs and MAs on interventional studies with a minimum of 2 therapeutic strategies in endodontics were included in this SR. Methodologic and reporting quality were assessed using A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA), respectively. The interobserver reliability was calculated using the Cohen kappa statistic. Statistical analysis with the level of significance at P < .05 was performed using Kruskal-Wallis tests and simple linear regression analysis. A total of 30 articles were selected for the current SR. Using AMSTAR, the item related to the scientific quality of studies used in conclusion was adhered by less than 40% of studies. Using PRISMA, 3 items were reported by less than 40% of studies, which were on objectives, protocol registration, and funding. No association was evident comparing the number of authors and country with quality. Statistical significance was observed when quality was compared among journals, with studies published as Cochrane reviews superior to those published in other journals. AMSTAR and PRISMA scores were significantly related. SRs in endodontics showed variability in both methodologic and reporting quality. Copyright © 2018 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Reporting and methodological quality of meta-analyses in urological literature

PubMed Central

Xu, Jing

2017-01-01

Purpose To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. Materials and Methods We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. Results A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, “a priori” design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and “a priori” design were associated with superior reporting quality, following PRISMA guideline and “a priori” design were associated with superior methodological quality. Conclusions Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having “a priori” protocol. PMID:28439452

Wearable sensor use for assessing standing balance and walking stability in people with Parkinson's disease: a systematic review.

PubMed

Hubble, Ryan P; Naughton, Geraldine A; Silburn, Peter A; Cole, Michael H

2015-01-01

Postural instability and gait disability threaten the independence and well-being of people with Parkinson's disease and increase the risk of falls and fall-related injuries. Prospective research has shown that commonly-used clinical assessments of balance and walking lack the sensitivity to accurately and consistently identify those people with Parkinson's disease who are at a higher risk of falling. Wearable sensors provide a portable and affordable alternative for researchers and clinicians who are seeking to objectively assess movements and falls risk in the clinical setting. However, no consensus currently exists on the optimal placements for sensors and the best outcome measures to use for assessing standing balance and walking stability in Parkinson's disease patients. Hence, this systematic review aimed to examine the available literature to establish the best sensor types, locations and outcomes to assess standing balance and walking stability in this population. Papers listed in three electronic databases were searched by title and abstract to identify articles measuring standing balance or walking stability with any kind of wearable sensor among adults diagnosed with PD. To be eligible for inclusion, papers were required to be full-text articles published in English between January 1994 and December 2014 that assessed measures of standing balance or walking stability with wearable sensors in people with PD. Articles were excluded if they; i) did not use any form of wearable sensor to measure variables associated with standing balance or walking stability; ii) did not include a control group or control condition; iii) were an abstract and/or included in the proceedings of a conference; or iv) were a review article or case study. The targeted search of the three electronic databases identified 340 articles that were potentially eligible for inclusion, but following title, abstract and full-text review only 26 articles were deemed to meet the inclusion criteria. Included articles were assessed for methodological quality and relevant data from the papers were extracted and synthesized. Quality assessment of these included articles indicated that 31% were of low methodological quality, while 58% were of moderate methodological quality and 11% were of high methodological quality. All studies adopted a cross-sectional design and used a variety of sensor types and outcome measures to assess standing balance or walking stability in people with Parkinson's disease. Despite the typically low to moderate methodological quality, 81% of the studies reported differences in sensor-based measures of standing balance or walking stability between different groups of Parkinson's disease patients and/or healthy controls. These data support the use of wearable sensors for detecting differences in standing balance and walking stability between people with PD and controls. Further high-quality research is needed to better understand the utility of wearable sensors for the early identification of Parkinson's disease symptoms and for assessing falls risk in this population. CRD42014010838.

Wearable Sensor Use for Assessing Standing Balance and Walking Stability in People with Parkinson’s Disease: A Systematic Review

PubMed Central

Hubble, Ryan P.; Naughton, Geraldine A.; Silburn, Peter A.; Cole, Michael H.

2015-01-01

Background Postural instability and gait disability threaten the independence and well-being of people with Parkinson’s disease and increase the risk of falls and fall-related injuries. Prospective research has shown that commonly-used clinical assessments of balance and walking lack the sensitivity to accurately and consistently identify those people with Parkinson’s disease who are at a higher risk of falling. Wearable sensors provide a portable and affordable alternative for researchers and clinicians who are seeking to objectively assess movements and falls risk in the clinical setting. However, no consensus currently exists on the optimal placements for sensors and the best outcome measures to use for assessing standing balance and walking stability in Parkinson’s disease patients. Hence, this systematic review aimed to examine the available literature to establish the best sensor types, locations and outcomes to assess standing balance and walking stability in this population. Methods Papers listed in three electronic databases were searched by title and abstract to identify articles measuring standing balance or walking stability with any kind of wearable sensor among adults diagnosed with PD. To be eligible for inclusion, papers were required to be full-text articles published in English between January 1994 and December 2014 that assessed measures of standing balance or walking stability with wearable sensors in people with PD. Articles were excluded if they; i) did not use any form of wearable sensor to measure variables associated with standing balance or walking stability; ii) did not include a control group or control condition; iii) were an abstract and/or included in the proceedings of a conference; or iv) were a review article or case study. The targeted search of the three electronic databases identified 340 articles that were potentially eligible for inclusion, but following title, abstract and full-text review only 26 articles were deemed to meet the inclusion criteria. Included articles were assessed for methodological quality and relevant data from the papers were extracted and synthesized. Results Quality assessment of these included articles indicated that 31% were of low methodological quality, while 58% were of moderate methodological quality and 11% were of high methodological quality. All studies adopted a cross-sectional design and used a variety of sensor types and outcome measures to assess standing balance or walking stability in people with Parkinson’s disease. Despite the typically low to moderate methodological quality, 81% of the studies reported differences in sensor-based measures of standing balance or walking stability between different groups of Parkinson’s disease patients and/or healthy controls. Conclusion These data support the use of wearable sensors for detecting differences in standing balance and walking stability between people with PD and controls. Further high-quality research is needed to better understand the utility of wearable sensors for the early identification of Parkinson’s disease symptoms and for assessing falls risk in this population. PROSPERO Registration CRD42014010838 PMID:25894561

A systematic review of grounded theory studies in physiotherapy.

PubMed

Ali, Nancy; May, Stephen; Grafton, Kate

2018-05-23

This systematic review aimed at appraising the methodological rigor of grounded theory research published in the field of physiotherapy to assess how the methodology is understood and applied. A secondary aim was to provide research implications drawn from the findings to guide future grounded theory methodology (GTM) research. A systematic search was conducted in MEDLINE, CINHAL, SPORT Discus, Science Direct, PubMed, Scopus, and Web of Science to identify studies in the field of physiotherapy that reported using GTM and/or methods in the study title and/or abstract. The descriptive characteristics and methodological quality of eligible studies were examined using grounded theory methodology assessment guidelines. The review included 68 studies conducted between 1998 and 2017. The findings showed that GTM is becoming increasingly used by physiotherapy researchers. Thirty-six studies (53%) demonstrated a good understanding and appropriate application of GTM. Thirty-two studies (47%) presented descriptive findings and were considered to be of poor methodological quality. There are several key tenets of GTM that are integral to the iterative process of qualitative theorizing and need to be applied throughout all research practices including sampling, data collection, and analysis.

Are normative sonographic values of kidney size in children valid and reliable? A systematic review of the methodological quality of ultrasound studies using the Anatomical Quality Assessment (AQUA) tool.

PubMed

Chhapola, Viswas; Tiwari, Soumya; Deepthi, Bobbity; Henry, Brandon Michael; Brar, Rekha; Kanwal, Sandeep Kumar

2018-06-01

A plethora of research is available on ultrasonographic kidney size standards. We performed a systematic review of methodological quality of ultrasound studies aimed at developing normative renal parameters in healthy children, by evaluating the risk of bias (ROB) using the 'Anatomical Quality Assessment (AQUA)' tool. We searched Medline, Scopus, CINAHL, and Google Scholar on June 04 2018, and observational studies measuring kidney size by ultrasonography in healthy children (0-18 years) were included. The ROB of each study was evaluated in five domains using a 20 item coding scheme based on AQUA tool framework. Fifty-four studies were included. Domain 1 (subject characteristics) had a high ROB in 63% of studies due to the unclear description of age, sex, and ethnicity. The performance in Domain 2 (study design) was the best with 85% of studies having a prospective design. Methodological characterization (Domain 3) was poor across the studies (< 10% compliance), with suboptimal performance in the description of patient positioning, operator experience, and assessment of intra/inter-observer reliability. About three-fourth of the studies had a low ROB in Domain 4 (descriptive anatomy). Domain 5 (reporting of results) had a high ROB in approximately half of the studies, the majority reporting results in the form of central tendency measures. Significant deficiencies and heterogeneity were observed in the methodological quality of USG studies performed to-date for measurement of kidney size in children. We hereby provide a framework for the conducting such studies in future. PROSPERO (CRD42017071601).

Randomized controlled trials of simulation-based interventions in Emergency Medicine: a methodological review.

PubMed

Chauvin, Anthony; Truchot, Jennifer; Bafeta, Aida; Pateron, Dominique; Plaisance, Patrick; Yordanov, Youri

2018-04-01

The number of trials assessing Simulation-Based Medical Education (SBME) interventions has rapidly expanded. Many studies show that potential flaws in design, conduct and reporting of randomized controlled trials (RCTs) can bias their results. We conducted a methodological review of RCTs assessing a SBME in Emergency Medicine (EM) and examined their methodological characteristics. We searched MEDLINE via PubMed for RCT that assessed a simulation intervention in EM, published in 6 general and internal medicine and in the top 10 EM journals. The Cochrane Collaboration risk of Bias tool was used to assess risk of bias, intervention reporting was evaluated based on the "template for intervention description and replication" checklist, and methodological quality was evaluated by the Medical Education Research Study Quality Instrument. Reports selection and data extraction was done by 2 independents researchers. From 1394 RCTs screened, 68 trials assessed a SBME intervention. They represent one quarter of our sample. Cardiopulmonary resuscitation (CPR) is the most frequent topic (81%). Random sequence generation and allocation concealment were performed correctly in 66 and 49% of trials. Blinding of participants and assessors was performed correctly in 19 and 68%. Risk of attrition bias was low in three-quarters of the studies (n = 51). Risk of selective reporting bias was unclear in nearly all studies. The mean MERQSI score was of 13.4/18.4% of the reports provided a description allowing the intervention replication. Trials assessing simulation represent one quarter of RCTs in EM. Their quality remains unclear, and reproducing the interventions appears challenging due to reporting issues.

Quantification of health benefits related with reduction of atmospheric PM₁₀ levels: implementation of population mobility approach.

PubMed

Tchepel, Oxana; Dias, Daniela

2011-06-01

This study is focused on the assessment of potential health benefits by meeting the air quality limit values (2008/50/CE) for short-term PM₁₀ exposure. For this purpose, the methodology of the WHO for Health Impact Assessment and APHEIS guidelines for data collection were applied to Porto Metropolitan Area, Portugal. Additionally, an improved methodology using population mobility data is proposed in this work to analyse number of persons exposed. In order to obtain representative background concentrations, an innovative approach to process air quality time series was implemented. The results provide the number of attributable cases prevented annually by reducing PM(10) concentration. An intercomparison of two approaches to process input data for the health risk analysis provides information on sensitivity of the applied methodology. The findings highlight the importance of taking into account spatial variability of the air pollution levels and population mobility in the health impact assessment.

A Systematic and Transparent Approach for Assessing the Methodological Quality of Intervention Effectiveness Research: The Study Design and Implementation Assessment Device (Study DIAD)

ERIC Educational Resources Information Center

Valentine, Jeffrey C.; Cooper, Harris

2008-01-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of…

Methods of Quality Appraisal for Studies Reviewed by Evidence Clearinghouses

ERIC Educational Resources Information Center

Wilson, Sandra Jo; Tanner-Smith, Emily

2015-01-01

This presentation will discuss quality appraisal methods for assessing research studies used in systematic reviews, research syntheses, and evidence-based practice repositories such as the What Works Clearinghouse. The different ways that the methodological rigor and risk of bias of primary studies included in syntheses is assessed means that…

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

Appraisal of the methodological quality and summary of the findings of systematic reviews on the relationship between SSRIs and suicidality.

PubMed

Li, Wei; Li, Wei; Wan, Yumei; Ren, Juanjuan; Li, Ting; Li, Chunbo

2014-10-01

Several systematic reviews have been published about the relationship of the use of selective serotonin reuptake inhibitors (SSRIs) and risk of suicidal ideation or behavior but there has been no formal assessment of the quality of these reports. Assess the methodological quality of systematic reviews about the relationship of SSRI use and suicidal ideation and behavior; and provide overall conclusions based on this assessment. Systematic reviews of RCTs that compared SSRIs to placebo and used suicidal ideation or behavior as a key outcome variable were identified by searching Pubmed, Embase, The Cochrane Library, EBSCO, PsycINFO, Chinese National Knowledge Infrastructure, Chongqing VIP database for Chinese Technical Periodicals, WANFANG DATA, and the Chinese Biological Medical Literature Database. The methodological quality of included reviews was independently assessed by two expert raters using the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) scale. Twelve systematic reviews and meta-analyses were identified. The inter-rater reliability of the overall AMSTAR quality score was excellent (ICC=0.86) but the inter-rater reliability of 5 of the 11 AMSTAR items was poor (Kappa <0.60). Based on the AMSTAR total score, there was one high-quality review, eight moderate-quality reviews, and three low-quality reviews. The high-quality review and three of the moderate-quality reviews reported a significantly increased risk of suicidal ideation or behavior in the SSRI group compared to the placebo group. Three of the four reviews limited to children and adolescents found a significantly increased risk of suicidal ideation or behavior with SSRI use which was most evident in teenagers taking paroxetine and in teenagers with depressive disorders. The available evidence suggests that adolescents may experience an increase in suicidal ideation and behavior with SSRI use, particularly those who have a depressive disorder and those treated with paroxetine. However, there are few high-quality reviews on this issue, so some doubt about the evidence remains. The AMSTAR scale may be useful in the ongoing efforts to improve the quality of systematic reviews, but further work is needed on tightening the operational criteria for some of the items in the scale.

Sexual health education interventions for young people: a methodological review.

PubMed Central

Oakley, A.; Fullerton, D.; Holland, J.; Arnold, S.; France-Dawson, M.; Kelley, P.; McGrellis, S.

1995-01-01

OBJECTIVES--To locate reports of sexual health education interventions for young people, assess the methodological quality of evaluations, identify the subgroup with a methodologically sound design, and assess the evidence with respect to the effectiveness of different approaches to promoting young people's sexual health. DESIGN--Survey of reports in English by means of electronic databases and hand searches for relevant studies conducted in the developed world since 1982. Papers were reviewed for eight methodological qualities. The evidence on effectiveness generated by studies meeting four core criteria was assessed. Judgments on effectiveness by reviewers and authors were compared. PAPERS--270 papers reporting sexual health interventions. MAIN OUTCOME MEASURE--The methodological quality of evaluations. RESULTS--73 reports of evaluations of sexual health interventions examining the effectiveness of these interventions in changing knowledge, attitudes, or behavioural outcomes were identified, of which 65 were separate outcome evaluations. Of these studies, 45 (69%) lacked random control groups, 44 (68%) failed to present preintervention and 38 (59%) postintervention data, and 26 (40%) omitted to discuss the relevance of loss of data caused by drop outs. Only 12 (18%) of the 65 outcome evaluations were judged to be methodologically sound. Academic reviewers were more likely than authors to judge studies as unclear because of design faults. Only two of the sound evaluations recorded interventions which were effective in showing an impact on young people's sexual behaviour. CONCLUSIONS--The design of evaluations in sexual health intervention needs to be improved so that reliable evidence of the effectiveness of different approaches to promoting young people's sexual health may be generated. PMID:7833754

Quality Perception within Corporate E-Learning Providers in Catalonia

ERIC Educational Resources Information Center

Sangra, Albert; Fernandez-Michels, Pedro

2011-01-01

Purpose: The paper seeks to describe the Catalan corporate e-learning providers from the perspective of quality perception, quality assessment and quality control. Design/methodology/approach: A literature review reveals key aspects of the definition of quality in e-learning. The results of the review constitute the basis for exploratory research…

Quality Assessment of TPB-Based Questionnaires: A Systematic Review

PubMed Central

Oluka, Obiageli Crystal; Nie, Shaofa; Sun, Yi

2014-01-01

Objective This review is aimed at assessing the quality of questionnaires and their development process based on the theory of planned behavior (TPB) change model. Methods A systematic literature search for studies with the primary aim of TPB-based questionnaire development was conducted in relevant databases between 2002 and 2012 using selected search terms. Ten of 1,034 screened abstracts met the inclusion criteria and were assessed for methodological quality using two different appraisal tools: one for the overall methodological quality of each study and the other developed for the appraisal of the questionnaire content and development process. Both appraisal tools consisted of items regarding the likelihood of bias in each study and were eventually combined to give the overall quality score for each included study. Results 8 of the 10 included studies showed low risk of bias in the overall quality assessment of each study, while 9 of the studies were of high quality based on the quality appraisal of questionnaire content and development process. Conclusion Quality appraisal of the questionnaires in the 10 reviewed studies was successfully conducted, highlighting the top problem areas (including: sample size estimation; inclusion of direct and indirect measures; and inclusion of questions on demographics) in the development of TPB-based questionnaires and the need for researchers to provide a more detailed account of their development process. PMID:24722323

Protocol for Reliability Assessment of Structural Health Monitoring Systems Incorporating Model-assisted Probability of Detection (MAPOD) Approach

DTIC Science & Technology

2011-09-01

a quality evaluation with limited data, a model -based assessment must be...that affect system performance, a multistage approach to system validation, a modeling and experimental methodology for efficiently addressing a ...affect system performance, a multistage approach to system validation, a modeling and experimental methodology for efficiently addressing a wide range

The quality of instruments to assess the process of shared decision making: A systematic review

PubMed Central

Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

2018-01-01

Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations. PMID:29447193

Sensory re-education after nerve injury of the upper limb: a systematic review.

PubMed

Oud, Tanja; Beelen, Anita; Eijffinger, Elianne; Nollet, Frans

2007-06-01

To systematically review the available evidence for the effectiveness of sensory re-education to improve the sensibility of the hand in patients with a peripheral nerve injury of the upper limb. Studies were identified by an electronic search in the databases MEDLINE, Cumulative Index to Nursing & Allied Health Literature (CINAHL), EMBASE, the Cochrane Library, the Physiotherapy Evidence Database (PEDro), and the database of the Dutch National Institute of Allied Health Professions (Doconline) and by screening the reference lists of relevant articles. Two reviewers selected studies that met the following inclusion criteria: all designs except case reports, adults with impaired sensibility of the hand due to a peripheral nerve injury of the upper limb, and sensibility and functional sensibility as outcome measures. The methodological quality of the included studies was independently assessed by two reviewers. A best-evidence synthesis was performed, based on design, methodological quality and significant findings on outcome measures. Seven studies, with sample sizes ranging from 11 to 49, were included in the systematic review and appraised for content. Five of these studies were of poor methodological quality. One uncontrolled study (N = 1 3 ) was considered to be of sufficient methodological quality, and one randomized controlled trial (N = 49) was of high methodological quality. Best-evidence synthesis showed that there is limited evidence for the effectiveness of sensory re-education, provided by a statistically significant improvement in sensibility found in one high-quality randomized controlled trial. There is a need for further well-defined clinical trials to assess the effectiveness of sensory re-education of patients with impaired sensibility of the hand due to a peripheral nerve injury.

Evaluating Quality Management in University Departments

ERIC Educational Resources Information Center

Becket, Nina; Brookes, Maureen

2006-01-01

Purpose: Despite the abundance of research on quality management there is no universal consensus on how best to measure quality in higher education. This paper undertakes a critical evaluation of the different methods used to assess the quality of provision in higher education departments in the UK. Design/methodology/approach: Drawing on relevant…

A Methodology for Performing Effects-Based Assessments

DTIC Science & Technology

2006-03-01

can then be used to make assessments (Smith, 2002:384). 2.8 Cause-and-Effect Diagrams Developed by Dr. Kaoru Ishikawa in the field of Quality Control...John Wiley & Sons, Inc., 2004. Ishikawa , Kaoru . Guide to Quality Control. White Plains NY: Asian Productivity Organization, 1989...various causes affecting product quality by sorting out and relating the causes. Cause-and-effect diagrams are sometimes called Ishikawa diagrams, or

HOW GOOD ARE MY DATA? INFORMATION QUALITY ASSESSMENT METHODOLOGY

EPA Science Inventory

Quality assurance techniques used in software development and hardware maintenance/reliability help to ensure that data in a computerized information management system are maintained well. However, information workers may not know the quality of the data resident in their inf...

QUALITY ASSURANCE MEASURES ASSOCIATED WITH CORAL REEF MONITORING

EPA Science Inventory

Systematic efforts began in 1997 to assess the incidence of coral diseases in the Florida Keys. Protocols were developed for the selection of permanent stations and for data collection methodology. Permanent stations and for data collection methodology. Permanent stations were es...

Association between body composition and disease activity in rheumatoid arthritis. A systematic review.

PubMed

Alvarez-Nemegyei, José; Buenfil-Rello, Fátima Annai; Pacheco-Pantoja, Elda Leonor

2016-01-01

Reports regarding the association between body composition and inflammatory activity in rheumatoid arthritis (RA) have consistently yielded contradictory results. To perform a systematic review on the association between overweight/obesity and inflammatory activity in RA. FAST approach: Article search (Medline, EBSCO, Cochrane Library), followed by abstract retrieval, full text review and blinded assessment of methodological quality for final inclusion. Because of marked heterogeneity in statistical approach and RA activity assessment method, a meta-analysis could not be done. Results are presented as qualitative synthesis. One hundred and nineteen reports were found, 16 of them qualified for full text review. Eleven studies (8,147 patients; n range: 37-5,161) approved the methodological quality filter and were finally included. Interobserver agreement for methodological quality score (ICC: 0.93; 95% CI: 0.82-0.98; P<.001) and inclusion/rejection decision (k 1.00, P>.001) was excellent. In all reports body composition was assessed by BMI; however a marked heterogeneity was found in the method used for RA activity assessment. A significant association between BMI and RA activity was found in 6 reports having larger mean sample size: 1,274 (range: 140-5,161). On the other hand, this association was not found in 5 studies having lower mean sample size: 100 (range: 7-150). The modulation of RA clinical status by body fat mass is suggested because a significant association was found between BMI and inflammatory activity in those reports with a trend toward higher statistical power. The relationship between body composition and clinical activity in RA requires be approached with further studies with higher methodological quality. Copyright © 2015 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

The reliability of the Glasgow Coma Scale: a systematic review.

PubMed

Reith, Florence C M; Van den Brande, Ruben; Synnot, Anneliese; Gruen, Russell; Maas, Andrew I R

2016-01-01

The Glasgow Coma Scale (GCS) provides a structured method for assessment of the level of consciousness. Its derived sum score is applied in research and adopted in intensive care unit scoring systems. Controversy exists on the reliability of the GCS. The aim of this systematic review was to summarize evidence on the reliability of the GCS. A literature search was undertaken in MEDLINE, EMBASE and CINAHL. Observational studies that assessed the reliability of the GCS, expressed by a statistical measure, were included. Methodological quality was evaluated with the consensus-based standards for the selection of health measurement instruments checklist and its influence on results considered. Reliability estimates were synthesized narratively. We identified 52 relevant studies that showed significant heterogeneity in the type of reliability estimates used, patients studied, setting and characteristics of observers. Methodological quality was good (n = 7), fair (n = 18) or poor (n = 27). In good quality studies, kappa values were ≥0.6 in 85%, and all intraclass correlation coefficients indicated excellent reliability. Poor quality studies showed lower reliability estimates. Reliability for the GCS components was higher than for the sum score. Factors that may influence reliability include education and training, the level of consciousness and type of stimuli used. Only 13% of studies were of good quality and inconsistency in reported reliability estimates was found. Although the reliability was adequate in good quality studies, further improvement is desirable. From a methodological perspective, the quality of reliability studies needs to be improved. From a clinical perspective, a renewed focus on training/education and standardization of assessment is required.

The baby or the bath water? Lessons learned from the National Action Alliance for Suicide Prevention Research Prioritization Task Force literature review.

PubMed

Davis Molock, Sherry; Heekin, Janet M; Matlin, Samantha G; Barksdale, Crystal L; Gray, Ekwenzi; Booth, Chelsea L

2014-09-01

The Research Prioritization Task Force of the National Action Alliance for Suicide Prevention conducted a comprehensive literature review of suicide prevention/intervention trials to assess the quality of the scientific evidence. A literature "review of reviews" was conducted by searching the most widely used databases for mental health and public health research. The quality of the reviews was evaluated using the Revised Assessment of Multiple Systematic Reviews system; the quality of the scientific evidence for the suicide preventions/interventions was assessed using U.S. Preventive Services Task Force criteria. The reviews were limited to peer-reviewed publications with human subjects published in English. Ninety-eight systematic reviews and 45 primary sources on suicide prevention/interventions published between January 2000 and September 2012 were evaluated. The results suggest that the quality of both the systematic reviews and the scientific evidence for suicide preventions/interventions were mixed. The majority of the systematic reviews and prevention/interventions were evaluated as fair to poor in quality. There are many promising suicide prevention/intervention trials, but research findings are often inconclusive because of methodologic problems. Methodologic problems across systematic reviews include not conducting hand searches, not surveying gray literature, and being unable to aggregate data across studies. Methodologic problems with the scientific quality of the prevention/intervention trials include paucity of information on sample demographic characteristics, poorly defined outcomes, and excluding actively suicidal participants. Suggestions for ways to improve the quality of the systematic reviews and suicide preventions/interventions are provided. Copyright © 2014 American Journal of Preventive Medicine. All rights reserved.

Impact of sampling techniques on measured stormwater quality data for small streams

USDA-ARS?s Scientific Manuscript database

Science-based sampling methodologies are needed to enhance water quality characterization for developing Total Maximum Daily Loads (TMDLs), setting appropriate water quality standards, and managing nonpoint source pollution. Storm event sampling, which is vital for adequate assessment of water qual...

Methodology to incorporate EIA in land-use ordering -- case study: The Cataniapo River basin, Venezuela

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sebastiani, M.; Llambi, L.D.; Marquez, E.

1998-07-01

In Venezuela, the idea of tiering information between land-use ordering instruments and impact assessment is absent. In this article the authors explore a methodological alternative to bridge the information presented in land-use ordering instruments with the information requirements for impact assessment. The methodology is based on the steps carried out for an environmental impact assessment as well as on those considered to develop land-use ordering instruments. The methodology is applied to the territorial ordering plan and its proposal for the protection zone of the Cataniapo River basin. The purpose of the protection zone is to preserve the water quality andmore » quantity of the river basin for human consumption.« less

[Methodological quality and reporting quality evaluation of randomized controlled trials published in China Journal of Chinese Materia Medica].

PubMed

Yu, Dan-Dan; Xie, Yan-Ming; Liao, Xing; Zhi, Ying-Jie; Jiang, Jun-Jie; Chen, Wei

2018-02-01

To evaluate the methodological quality and reporting quality of randomized controlled trials(RCTs) published in China Journal of Chinese Materia Medica, we searched CNKI and China Journal of Chinese Materia webpage to collect RCTs since the establishment of the magazine. The Cochrane risk of bias assessment tool was used to evaluate the methodological quality of RCTs. The CONSORT 2010 list was adopted as reporting quality evaluating tool. Finally, 184 RCTs were included and evaluated methodologically, of which 97 RCTs were evaluated with reporting quality. For the methodological evaluating, 62 trials(33.70%) reported the random sequence generation; 9(4.89%) trials reported the allocation concealment; 25(13.59%) trials adopted the method of blinding; 30(16.30%) trials reported the number of patients withdrawing, dropping out and those lost to follow-up;2 trials （1.09%） reported trial registration and none of the trial reported the trial protocol; only 8(4.35%) trials reported the sample size estimation in details. For reporting quality appraising, 3 reporting items of 25 items were evaluated with high-quality,including: abstract, participants qualified criteria, and statistical methods; 4 reporting items with medium-quality, including purpose, intervention, random sequence method, and data collection of sites and locations; 9 items with low-quality reporting items including title, backgrounds, random sequence types, allocation concealment, blindness, recruitment of subjects, baseline data, harms, and funding;the rest of items were of extremely low quality(the compliance rate of reporting item<10%). On the whole, the methodological and reporting quality of RCTs published in the magazine are generally low. Further improvement in both methodological and reporting quality for RCTs of traditional Chinese medicine are warranted. It is recommended that the international standards and procedures for RCT design should be strictly followed to conduct high-quality trials. At the same time, in order to improve the reporting quality of randomized controlled trials, CONSORT standards should be adopted in the preparation of research reports and submissions. Copyright© by the Chinese Pharmaceutical Association.

Quality Measurement Recommendations Relevant to Clinical Guidelines in Germany and the United Kingdom: (What) Can We Learn From Each Other?

PubMed Central

Petzold, Thomas; Deckert, Stefanie; Williamson, Paula R.; Schmitt, Jochen

2018-01-01

We conducted a systematic review of clinical guidelines (CGs) to examine the methodological approaches of quality indicator derivation in CGs, the frequency of quality indicators to check CG recommendations in routine care, and clinimetric properties of quality indicators. We analyzed the publicly available CG databases of the Association of the Scientific Medical Societies in Germany (AWMF) and National Institute for Health and Care Excellence (NICE). Data on the methodology of subsequent quality indicator derivation, the content and definition of recommended quality indicators, and clinimetric properties of measurement instruments were extracted. In Germany, no explicit methodological guidance exists, but 3 different approaches are used. For NICE, a general approach is used for the derivation of quality indicators out of quality standards. Quality indicators were defined in 34 out of 87 CGs (39%) in Germany and for 58 out of 133 (43%) NICE CGs. Statements regarding measurement properties of instruments for quality indicator assessment were missing in German and NICE documents. Thirteen pairs of CGs (32%) have associated quality indicators. Thirty-four quality indicators refer to the same aspect of the quality of care, which corresponds to 27% of the German and 7% of NICE quality indicators. The development of a standardized and internationally accepted methodology for the derivation of quality indicators relevant to CGs is needed to measure and compare quality of care in health care systems. PMID:29591538

Methodological standards in single-case experimental design: Raising the bar.

PubMed

Ganz, Jennifer B; Ayres, Kevin M

2018-04-12

Single-case experimental designs (SCEDs), or small-n experimental research, are frequently implemented to assess approaches to improving outcomes for people with disabilities, particularly those with low-incidence disabilities, such as some developmental disabilities. SCED has become increasingly accepted as a research design. As this literature base is needed to determine what interventions are evidence-based practices, the acceptance of SCED has resulted in increased critiques with regard to methodological quality. Recent trends include recommendations from a number of expert scholars and institutions. The purpose of this article is to summarize the recent history of methodological quality considerations, synthesize the recommendations found in the SCED literature, and provide recommendations to researchers designing SCEDs with regard to essential and aspirational standards for methodological quality. Conclusions include imploring SCED to increase the quality of their experiments, with particular consideration regarding the applied nature of SCED research to be published in Research in Developmental Disabilities and beyond. Copyright © 2018 Elsevier Ltd. All rights reserved.

Validity and reliability of Internet-based physiotherapy assessment for musculoskeletal disorders: a systematic review.

PubMed

Mani, Suresh; Sharma, Shobha; Omar, Baharudin; Paungmali, Aatit; Joseph, Leonard

2017-04-01

Purpose The purpose of this review is to systematically explore and summarise the validity and reliability of telerehabilitation (TR)-based physiotherapy assessment for musculoskeletal disorders. Method A comprehensive systematic literature review was conducted using a number of electronic databases: PubMed, EMBASE, PsycINFO, Cochrane Library and CINAHL, published between January 2000 and May 2015. The studies examined the validity, inter- and intra-rater reliabilities of TR-based physiotherapy assessment for musculoskeletal conditions were included. Two independent reviewers used the Quality Appraisal Tool for studies of diagnostic Reliability (QAREL) and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool to assess the methodological quality of reliability and validity studies respectively. Results A total of 898 hits were achieved, of which 11 articles based on inclusion criteria were reviewed. Nine studies explored the concurrent validity, inter- and intra-rater reliabilities, while two studies examined only the concurrent validity. Reviewed studies were moderate to good in methodological quality. The physiotherapy assessments such as pain, swelling, range of motion, muscle strength, balance, gait and functional assessment demonstrated good concurrent validity. However, the reported concurrent validity of lumbar spine posture, special orthopaedic tests, neurodynamic tests and scar assessments ranged from low to moderate. Conclusion TR-based physiotherapy assessment was technically feasible with overall good concurrent validity and excellent reliability, except for lumbar spine posture, orthopaedic special tests, neurodynamic testa and scar assessment.

Outpatient Interventions for Adolescent Substance Abuse: A Quality of Evidence Review

ERIC Educational Resources Information Center

Becker, Sara J.; Curry, John F.

2008-01-01

Previous reviews of outpatient interventions for adolescent substance abuse have been limited in the extent to which they considered the methodological quality of individual studies. The authors assessed 31 randomized trials of outpatient interventions for adolescent substance abuse on 14 attributes of trial quality. A quality of evidence score…

Quality Concerns in Technical Education in India: A Quantifiable Quality Enabled Model

ERIC Educational Resources Information Center

Gambhir, Victor; Wadhwa, N. C.; Grover, Sandeep

2016-01-01

Purpose: The paper aims to discuss current Technical Education scenarios in India. It proposes modelling the factors affecting quality in a technical institute and then applying a suitable technique for assessment, comparison and ranking. Design/methodology/approach: The paper chose graph theoretic approach for quantification of quality-enabled…

Methodological quality is underrated in systematic reviews and meta-analyses in health psychology.

PubMed

Oliveras, Isabel; Losilla, Josep-Maria; Vives, Jaume

2017-06-01

In this paper, we compile and describe the main approaches proposed in the literature to include methodological quality (MQ) or risk of bias (RoB) into research synthesis. We also meta-review how the RoB of observational primary studies is being assessed and to what extent the results are incorporated in the conclusions of research synthesis. Electronic databases were searched for systematic reviews or meta-analyses related to health and clinical psychology. A random sample of 90 reviews published between January 2010 and May 2016 was examined. A total of 46 reviews (51%) performed a formal assessment of the RoB of primary studies. Only 17 reviews (19%) linked the outcomes of quality assessment with the results of the review. According to the previous literature, our results corroborate the lack of guidance to incorporate the RoB assessment in the results of systematic reviews and meta-analyses. Our recommendation is to appraise MQ according to domains of RoB to rate the degree of credibility of the results of a research synthesis, as well as subgroup analysis or meta-regression as analytical methods to incorporate the quality assessment. Copyright © 2017 Elsevier Inc. All rights reserved.

Methodological issues in the quantitative assessment of quality of life.

PubMed

Panagiotakos, Demosthenes B; Yfantopoulos, John N

2011-10-01

The term quality of life can be identified in Aristotle's classical writings of 330 BC. In his Nichomachian ethics he recognises the multiple relationships between happiness, well-being, "eudemonia" and quality of life. Historically the concept of quality of life has undergone various interpretations. It involves personal experience, perceptions and beliefs, attitudes concerning philosophical, cultural, spiritual, psychological, political, and financial aspects of everyday living. Quality of life has been extensively used both as an outcome and an explanatory factor in relation to human health, in various clinical trials, epidemiologic studies and health interview surveys. Because of the variations in the definition of quality of life, both in theory and in practice, there are also a wide range of procedures that are used to assess quality of life. In this paper several methodological issues regarding the tools used to evaluate quality of life is discussed. In summary, the use of components consisted of large number of classes, as well as the use of specific weights for each scale component, and the low-to-moderate inter-correlation level between the components, is evident from simulated and empirical studies.

Methodology and reporting of diagnostic accuracy studies of automated perimetry in glaucoma: evaluation using a standardised approach.

PubMed

Fidalgo, Bruno M R; Crabb, David P; Lawrenson, John G

2015-05-01

To evaluate methodological and reporting quality of diagnostic accuracy studies of perimetry in glaucoma and to determine whether there had been any improvement since the publication of the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines. A systematic review of English language articles published between 1993 and 2013 reporting the diagnostic accuracy of perimetry in glaucoma. Articles were appraised for methodological quality using the 14-item Quality assessment tool for diagnostic accuracy studies (QUADAS) and evaluated for quality of reporting by applying the STARD checklist. Fifty-eight articles were appraised. Overall methodological quality of these studies was moderate with a median number of QUADAS items rated as 'yes' equal to nine (out of a maximum of 14) (IQR 7-10). The studies were often poorly reported; median score of STARD items fully reported was 11 out of 25 (IQR 10-14). A comparison of the studies published in 10-year periods before and after the publication of the STARD checklist in 2003 found quality of reporting had not substantially improved. Methodological and reporting quality of diagnostic accuracy studies of perimetry is sub-optimal and appears not to have improved substantially following the development of the STARD reporting guidance. This observation is consistent with previous studies in ophthalmology and in other medical specialities. © 2015 The Authors Ophthalmic & Physiological Optics © 2015 The College of Optometrists.

Critical appraisal of systematic reviews on the effect of a history of periodontitis on dental implant loss.

PubMed

Faggion, Clovis Mariano; Giannakopoulos, Nikolaos Nikitas

2013-05-01

To perform a systematic critical appraisal of the methodological quality of systematic reviews on the effect of a history of periodontitis on dental implant loss. PubMed, the Cochrane database for systematic reviews, the DARE, Biosis Preview, CINAHL, Web of Science, and LILACS electronic databases were searched on 16th June 2012, independently and in duplicate, for systematic reviews and meta-analyses related to dental implants for patients with and without a history of periodontitis. Manual searching of the reference lists of included papers was also conducted. The methodological quality of these systematic reviews was assessed by use of the AMSTAR and R-AMSTAR checklists. Before quality assessment was initiated, the reviewers were calibrated until they achieved excellent agreement. Sixty-eight papers were initially retrieved. Of these, nine systematic reviews and three meta-analyses were included. Some domains, for example, "characteristics of the included studies" were satisfied in both checklists. In contrast, domains such as "comprehensive literature search" and "assessment of likelihood of publication bias" were rarely met. Much methodological variability was encountered in the selected reviews. To furnish readers with a more comprehensive assessment of the evidence, authors should observe higher standards when conducting and reporting their reviews. © 2013 John Wiley & Sons A/S.

Methodological quality of systematic reviews analyzing the use of laser therapy in restorative dentistry.

PubMed

Salmos, Janaina; Gerbi, Marleny E M M; Braz, Rodivan; Andrade, Emanuel S S; Vasconcelos, Belmiro C E; Bessa-Nogueira, Ricardo V

2010-01-01

The purpose of this study was to identify systematic reviews (SRs) that compared laser with other dental restorative procedures and to evaluate their methodological quality. A search strategy was developed and implemented for MEDLINE, the Cochrane Library, LILACS, and the Brazilian Dentistry Bibliography (1966- 2007). Inclusion criteria were: the article had to be an SR (+/- meta-analysis); primary focus was the use of laser in restorative dentistry; published in English, Spanish, Portuguese, Italian, German. Two investigators independently selected and evaluated the SRs. The overview quality assessment questionnaire (OQAQ) was used to evaluate methodological quality, and the results were averaged. There were 145 references identified, of which seven were SRs that met the inclusion criteria (kappa=0.81). Of the SRs, 71.4% appraised lasers in dental caries diagnosis. The mean overall OQAQ score was 4.4 [95% confidence interval (CI) 2.4- 6.5]. Of the SRs, 57.1% had major flaws, scoring < or = 4. SR methodological quality is low; therefore, clinicians should critically appraise them prior to considering their recommendations to guide patient care.

Assessment of air quality in Haora River basin using fuzzy multiple-attribute decision making techniques.

PubMed

Singh, Ajit Pratap; Chakrabarti, Sumanta; Kumar, Sumit; Singh, Anjaney

2017-08-01

This paper deals with assessment of air quality in Haora River basin using two techniques. Initially, air quality indices were evaluated using a modified EPA method. The indices were also evaluated using a fuzzy comprehensive assessment (FCA) method. The results obtained from the fuzzy comprehensive assessment method were compared to that obtained from the modified EPA method. To illustrate the applicability of the methodology proposed herein, a case study has been presented. Air samples have been collected at 10 sampling sites located along Haora River. Six important air pollutants, namely, carbon monoxide, sulfur dioxide, nitrogen dioxide, suspended particulate matter (SPM), PM 10 , and lead, were monitored continuously, and air quality maps were generated on the GIS platform. Comparison of the methodologies has clearly highlighted superiority and robustness of the fuzzy comprehensive assessment method in determining air quality indices under study. It has effectively addressed the inherent uncertainties involved in the evaluation, modeling, and interpretation of sampling data, which was beyond the scope of the traditional weighted approaches employed otherwise. The FCA method is robust and prepares a credible platform of air quality evaluation and identification, in face of the uncertainties that remain eclipsed in the traditional approaches like the modified EPA method. The insights gained through the present study are believed to be of pivotal significance in guiding the development and implementation of effective environmental remedial action plans in the study area.

Promoting quality and safety in women's health through the use of transdisciplinary clinical simulation educational modules: methodology and a pilot trial.

PubMed

Montgomery, Kymberlee; Morse, Catherine; Smith-Glasgow, Mary Ellen; Posmontier, Bobbie; Follen, Michele

2012-02-01

This manuscript presents the methodology used to assess the impact of a clinical simulation module used for training providers specializing in women's health. The methodology presented here will be used for a quantitative study in the future. Copyright © 2012 Elsevier HS Journals, Inc. All rights reserved.

Quality assessment of recent evidence-based clinical practice guidelines for management of type 2 diabetes mellitus in adults using the AGREE II instrument.

PubMed

Anwer, Muhammad A; Al-Fahed, Ousama B; Arif, Samir I; Amer, Yasser S; Titi, Maher A; Al-Rukban, Mohammed O

2018-02-01

Type 2 diabetes mellitus (T2DM) is a worldwide and national public health problem that has a great impact on the population in Saudi Arabia. High-quality clinical practice guidelines (CPGs) are cornerstones in improving the health care provided for patients with diabetes. This study evaluated the methodological rigour, transparency, and applicability of recently published CPGs. Our group conducted a systematic search for recently published CPGs for T2DM. The searching and screening for Source CPGs were guided by tools from the ADAPTE methods with specific inclusion/exclusion criteria. Five reviewers using the second version of the Appraisal of Guidelines for Research and Evaluation (AGREE II) Instrument independently assessed the quality of the retrieved Source CPGs. Domains of Scope and purpose and Clarity of presentation received the highest scores in all CPGs. Most of the assessed CPGs (86%) were considered with high overall quality and were recommended for use. Rigour of development and applicability domains were together highest in 3 CPGs (43%). The overall high quality of DM CPGs published in the last 3 years demonstrated the continuous development and improvement in CPG methodologies and standards. Health care professionals should consider the quality of any CPG for T2DM before deciding to use it in their daily clinical practice. Three CPGs have been identified, using the AGREE criteria, as high-quality and trustworthy. Ideally, the resources provided by the AGREE trust including the AGREE II Instrument should be used by a clinician to scan through the large number of published T2DM CPGs to identify the CPGs with high methodological quality and applicability. © 2017 John Wiley & Sons, Ltd.

Methodological quality of systematic reviews on treatments for depression: a cross-sectional study.

PubMed

Chung, V C H; Wu, X Y; Feng, Y; Ho, R S T; Wong, S Y S; Threapleton, D

2017-05-02

Depression is one of the most common mental disorders and identifying effective treatment strategies is crucial for the control of depression. Well-conducted systematic reviews (SRs) and meta-analyses can provide the best evidence for supporting treatment decision-making. Nevertheless, the trustworthiness of conclusions can be limited by lack of methodological rigour. This study aims to assess the methodological quality of a representative sample of SRs on depression treatments. A cross-sectional study on the bibliographical and methodological characteristics of SRs published on depression treatments trials was conducted. Two electronic databases (the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects) were searched for potential SRs. SRs with at least one meta-analysis on the effects of depression treatments were considered eligible. The methodological quality of included SRs was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. The associations between bibliographical characteristics and scoring on AMSTAR items were analysed using logistic regression analysis. A total of 358 SRs were included and appraised. Over half of included SRs (n = 195) focused on non-pharmacological treatments and harms were reported in 45.5% (n = 163) of all studies. Studies varied in methods and reporting practices: only 112 (31.3%) took the risk of bias among primary studies into account when formulating conclusions; 245 (68.4%) did not fully declare conflict of interests; 93 (26.0%) reported an 'a priori' design and 104 (29.1%) provided lists of both included and excluded studies. Results from regression analyses showed: more recent publications were more likely to report 'a priori' designs [adjusted odds ratio (AOR) 1.31, 95% confidence interval (CI) 1.09-1.57], to describe study characteristics fully (AOR 1.16, 95% CI 1.06-1.28), and to assess presence of publication bias (AOR 1.13, 95% CI 1.06-1.19), but were less likely to list both included and excluded studies (AOR 0.86, 95% CI 0.81-0.92). SRs published in journals with higher impact factor (AOR 1.14, 95% CI 1.04-1.25), completed by more review authors (AOR 1.12, 95% CI 1.01-1.24) and SRs on non-pharmacological treatments (AOR 1.62, 95% CI 1.01-2.59) were associated with better performance in publication bias assessment. The methodological quality of included SRs is disappointing. Future SRs should strive to improve rigour by considering of risk of bias when formulating conclusions, reporting conflict of interests and authors should explicitly describe harms. SR authors should also use appropriate methods to combine the results, prevent language and publication biases, and ensure timely updates.

Dissemination of Periodontal Pathogens in the Bloodstream after Periodontal Procedures: A Systematic Review

PubMed Central

Horliana, Anna Carolina Ratto Tempestini; Chambrone, Leandro; Foz, Adriana Moura; Artese, Hilana Paula Carillo; Rabelo, Mariana de Sousa; Pannuti, Cláudio Mendes; Romito, Giuseppe Alexandre

2014-01-01

Background To date, there is no compilation of evidence-based information associating bacteremia and periodontal procedures. This systematic review aims to assess magnitude, duration, prevalence and nature of bacteremia caused by periodontal procedures. Study Design Systematic Review Types of Studies Reviewed MEDLINE, EMBASE and LILACS databases were searched in duplicate through August, 2013 without language restriction. Observational studies were included if blood samples were collected before, during or after periodontal procedures of patients with periodontitis. The methodological quality was assessed in duplicate using the modified Newcastle-Ottawa scale (NOS). Results Search strategy identified 509 potentially eligible articles and nine were included. Only four studies demonstrated high methodological quality, whereas five were of medium or low methodological quality. The study characteristics were considered too heterogeneous to conduct a meta-analysis. Among 219 analyzed patients, 106 (49.4%) had positive bacteremia. More frequent bacteria were S. viridans, A. actinomycetemcomitans P. gingivalis, M. micros and species Streptococcus and Actinomyces, although identification methods of microbiologic assays were different among studies. Clinical Implications Although half of the patients presented positive bacteremia after periodontal procedures, accurate results regarding the magnitude, duration and nature of bacteremia could not be confidentially assessed. PMID:24870125

Assessing the Methodological Quality of Glaucoma Clinical Practice Guidelines and Their Recommendations on Microinvasive Glaucoma Surgery: A Systematic Review.

PubMed

Michaelov, Evan; Armstrong, James J; Nguyen, Mary; Instrum, Bridget; Lam, Tracey; Denstedt, James; Hutnik, Cindy M L

2018-02-01

Clinical practice guidelines (CPG) are regarded by many as critical communications providing guidance within specific medical fields. Over a decade ago, the first microinvasive glaucoma surgical (MIGS) procedures were introduced. Since then, a number of these novel intraocular pressure controlling surgical options have been approved worldwide. Governing bodies and health care administration often utilize CPGs when considering funding for newer technologies. This highlights the importance of well-written, accurate, and up-to-date CPGs in the rapidly evolving field of MIGS. If CPGs are unable to fill this role, their use in treatment decision-making is doing a disservice to patients, who will be denied currently available and potentially superior care. To determine the overall value of a CPG, the methodological quality with which it was developed, in addition to the current relevance and appropriateness of its recommendations, should be evaluated. The objective of the present study was to assess the methodological quality of currently available international glaucoma CPGs, as well as their coverage of MIGS as a surrogate marker of relevance and appropriateness to policy-makers and ophthalmologists alike. To identify potentially relevant CPGs, a predefined search strategy was used to search the following databases: Medline, EMBASE, BIOSIS, and Web of Science. All CPGs related to adult glaucoma and published in English were included. CPG methodological quality was assessed by 3 individuals using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool. Studies were then assessed for coverage of MIGS devices and procedures. Search strategy and subsequent screening identified 11 CPGs for analysis. Eight were of high quality according to the AGREE II criteria. Three included basic information on MIGS, but none provided specific recommendations regarding their indications or which patient populations would benefit most. Many international glaucoma CPGs are of high methodological quality. However, coverage of MIGS is sparse, nonspecific and in many instances, absent. This causes CPGs to be a suboptimal source in guiding physicians and health policy-makers in areas characterized by novel and/or rapidly evolving technologies. Mechanisms to incorporate updated evidence in CPGs would have to be considered before they can be used as a source of contemporary clinical decision-making.

Collection Evaluation in Research Libraries: The Search for Quality, Consistency, and System in Collection Development.

ERIC Educational Resources Information Center

Mosher, Paul H.

1979-01-01

Reviews the history, literature, and methodology of collection evaluation or assessment in American research libraries; discusses current problems, tools, and methodology of evaluation; and describes an ongoing collection evaluation program at the Stanford University Libraries. (Author/MBR)

[Reevaluation of the methodological quality in meta-analyses of accelerated rehabilitation on recovery after surgery for colorectal cancer].

PubMed

Ding, S N; Pan, H Y; Zhang, J G

2017-03-14

Objective: To evaluate the methodological quality and impacts on outcomes for systematic reviews (SRs) of accelerated rehabilitation versus traditional control for colorectal surgery. Methods: We comprehensively searched six databases and additional websites to collect SRs, or meta-analysis from inception to July 2016. The Overview Quality Assessment Questionnaire (OQAQ) was applied for quality assessment of the included studies, the tools recommended by the Cochrane Collaboration was applied for quality assessment for RCT and CCT and the Newcastle-Ottawa Scale (NOS) was applied to assess observational study. The relative ratios (RRs) and 95% confidence intervals (CIs) were integrated using Review Manager 5.3 software. Results: Fourteen meta-analyses were included in total. The mean OQAQ score was 3.8 with 95% CI 3.2 to 4.3. Only three meta-analyses were assessed as good quality. Two studies misused statistical models. A total of 42 primary studies referenced by meta-analyses were included, of which, 25 RCTs were levelled grade B and 1 CCT was levelled grade C. An estimated mean NOS score of 16 observation studies was 6.75 (totally scored 9 with 95% CI 6.4 to 7.1), of which, 10 studies scored ≥7 were high quality, 6 studies scored 6 were moderate quality. Conclusions: Currently, the overall quality of meta-analyses about comparing the effects and safety between accelerated rehabilitation and traditional control for colorectal surgery is fairly poor and the evidence level is lower. Health providers should apply the evidence with caution in clinical practice.

Methodological quality of guidelines in gastroenterology.

PubMed

Malheiro, Rui; de Monteiro-Soares, Matilde; Hassan, Cesare; Dinis-Ribeiro, Mário

2014-06-01

Clinical guidelines are a common feature in modern endoscopy practice and they are being produced faster than ever. However, their methodological quality is rarely assessed. This study evaluated the methodological quality of current clinical guidelines in the field of gastroenterology, with an emphasis on endoscopy. Practice guidelines published by the American College of Gastroenterology (ACG), American Gastroenterological Association (AGA), American Society for Gastrointestinal Endoscopy (ASGE), European Society of Gastrointestinal Endoscopy (ESGE), British Society of Gastroenterology (BSG), National Institute for Health and Care Excellence (NICE), and the Scottish Intercollegiate Guidelines Network (SIGN) were searched between September and October 2012 and evaluated using the AGREE II (Appraisal of Guidelines for Research and Evaluation) instrument (23 items, scores 1 - 7 for each item; higher scores mean better quality). A total of 100 guidelines were assessed. The mean number of items scoring 6 or 7 per guideline was 9.2 (out of 23 items). Overall, 99 % of guidelines failed to include the target population in the development process, and 96 % did not report facilitators and barriers to guideline application. In addition, 86 % did not include advice or tools, and 94 % did not present monitoring or auditing criteria. The global methodological quality of clinical guidelines in the field of gastroenterology is poor, particularly regarding involvement of the target population in the development of guidelines and in the provision of clear suggestions to practitioners. © Georg Thieme Verlag KG Stuttgart · New York.

Effectiveness of physical therapy interventions for children with cerebral palsy: A systematic review

PubMed Central

Anttila, Heidi; Autti-Rämö, Ilona; Suoranta, Jutta; Mäkelä, Marjukka; Malmivaara, Antti

2008-01-01

Background To assess the effectiveness of physical therapy (PT) interventions on functioning in children with cerebral palsy (CP). Methods A search was made in Medline, Cinahl, PEDro and the Cochrane library for the period 1990 to February 2007. Only randomized controlled trials (RCTs) on PT interventions in children with diagnosed CP were included. Two reviewers independently assessed the methodological quality and extracted the data. The outcomes measured in the trials were classified using the International Classification of Functioning, Disability and Health (ICF). Results Twenty-two trials were identified. Eight intervention categories were distinguished. Four trials were of high methodological quality. Moderate evidence of effectiveness was established for two intervention categories: effectiveness of upper extremity treatments on attained goals and active supination, and of prehensile hand treatment and neurodevelopmental therapy (NDT) or NDT twice a week on developmental status, and of constraint-induced therapy on amount and quality of hand use. Moderate evidence of ineffectiveness was found of strength training on walking speed and stride length. Conflicting evidence was found for strength training on gross motor function. For the other intervention categories the evidence was limited due to low methodological quality and the statistically insignificant results of the studies. Conclusion Due to limitations in methodological quality and variations in population, interventions and outcomes, mostly limited evidence on the effectiveness of most PT interventions is available through RCTs. Moderate evidence was found for some effectiveness of upper extremity training. Well-designed trials are needed especially for focused PT interventions. PMID:18435840

A Methodological Analysis of Randomized Clinical Trials of Computer-Assisted Therapies for Psychiatric Disorders: Toward Improved Standards for an Emerging Field

PubMed Central

Kiluk, Brian D.; Sugarman, Dawn E.; Nich, Charla; Gibbons, Carly J.; Martino, Steve; Rounsaville, Bruce J.; Carroll, Kathleen M.

2013-01-01

Objective Computer-assisted therapies offer a novel, cost-effective strategy for providing evidence-based therapies to a broad range of individuals with psychiatric disorders. However, the extent to which the growing body of randomized trials evaluating computer-assisted therapies meets current standards of methodological rigor for evidence-based interventions is not clear. Method A methodological analysis of randomized clinical trials of computer-assisted therapies for adult psychiatric disorders, published between January 1990 and January 2010, was conducted. Seventy-five studies that examined computer-assisted therapies for a range of axis I disorders were evaluated using a 14-item methodological quality index. Results Results indicated marked heterogeneity in study quality. No study met all 14 basic quality standards, and three met 13 criteria. Consistent weaknesses were noted in evaluation of treatment exposure and adherence, rates of follow-up assessment, and conformity to intention-to-treat principles. Studies utilizing weaker comparison conditions (e.g., wait-list controls) had poorer methodological quality scores and were more likely to report effects favoring the computer-assisted condition. Conclusions While several well-conducted studies have indicated promising results for computer-assisted therapies, this emerging field has not yet achieved a level of methodological quality equivalent to those required for other evidence-based behavioral therapies or pharmacotherapies. Adoption of more consistent standards for methodological quality in this field, with greater attention to potential adverse events, is needed before computer-assisted therapies are widely disseminated or marketed as evidence based. PMID:21536689

Review of reviews on exposures to synthetic organic chemicals and children's neurodevelopment: Methodological and interpretation challenges.

PubMed

LaKind, Judy S; Anthony, Laura G; Goodman, Michael

2017-01-01

Environmental epidemiology data are becoming increasingly important in public health decision making, which commonly incorporates a systematic review of multiple studies. This review addresses two fundamental questions: What is the quality of available reviews on associations between exposure to synthetic organic chemicals and neurodevelopmental outcomes? What is the value (e.g., quality and consistency) of the underlying literature? Published reviews on associations between synthetic organic environmental chemical exposures and neurodevelopmental outcomes in children were systematically evaluated. Seventy-four relevant reviews were identified, and these were evaluated with respect to four methodological characteristics: (1) systematic inclusion/exclusion criteria and reproducible methods for search and retrieval of studies; (2) structured evaluation of underlying data quality; (3) systematic assessment of consistency across specific exposure-outcome associations; and (4) evaluation of reporting/publication bias. None of the 74 reviews fully met the criteria for all four methodological characteristics. Only four reviews met two criteria, and six reviews fulfilled only one criterion. Perhaps more importantly, the higher quality reviews were not able to meet all of the criteria owing to the shortcomings of underlying studies, which lacked comparability in terms of specific research question of interest, overall design, exposure assessment, outcome ascertainment, and analytic methods. Thus, even the most thoughtful and rigorous review may be of limited value if the underlying literature includes investigations that address different hypotheses and are beset by methodological inconsistencies and limitations. Issues identified in this review of reviews illustrate considerable challenges that are facing assessments of epidemiological evidence.

Health-Related Quality of Life in Non–Small-Cell Lung Cancer: An Update of a Systematic Review on Methodologic Issues in Randomized Controlled Trials

PubMed Central

Claassens, Lily; van Meerbeeck, Jan; Coens, Corneel; Quinten, Chantal; Ghislain, Irina; Sloan, Elizabeth K.; Wang, Xin Shelly; Velikova, Galina; Bottomley, Andrew

2011-01-01

Purpose This study is an update of a systematic review of health-related quality-of-life (HRQOL) methodology reporting in non–small-cell lung cancer (NSCLC) randomized controlled trials (RCTs). The objective was to evaluate HRQOL methodology reporting over the last decade and its benefit for clinical decision making. Methods A MEDLINE systematic literature review was performed. Eligible RCTs implemented patient-reported HRQOL assessments and regular oncology treatments for newly diagnosed adult patients with NSCLC. Included studies were published in English from August 2002 to July 2010. Two independent reviewers evaluated all included RCTs. Results Fifty-three RCTs were assessed. Of the 53 RCTs, 81% reported that there was no significant difference in overall survival (OS). However, 50% of RCTs that were unable to find OS differences reported a significant difference in HRQOL scores. The quality of HRQOL reporting has improved; both reporting of clinically significant differences and statistical testing of HRQOL have improved. A European Organisation for Research and Treatment of Cancer HRQOL questionnaire was used in 57% of the studies. However, reporting of HRQOL hypotheses and rationales for choosing HRQOL instruments were significantly less than before 2002 (P < .05). Conclusion The number of NSCLC RCTs incorporating HRQOL assessments has considerably increased. HRQOL continues to demonstrate its importance in RCTs, especially in those studies in which no OS difference is found. Despite the improved quality of HRQOL methodology reporting, certain aspects remain underrepresented. Our findings suggest need for an international standardization of HRQOL reporting similar to the CONSORT guidelines for clinical findings. PMID:21464420

Systematic review of the methodological quality of clinical guideline development for the management of chronic disease in Europe.

PubMed

Knai, Cécile; Brusamento, Serena; Legido-Quigley, Helena; Saliba, Vanessa; Panteli, Dimitra; Turk, Eva; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

The use of evidence-based clinical guidelines is an essential component of chronic disease management. However, there is well-documented concern about variability in the quality of clinical guidelines, with evidence of persisting methodological shortcomings. The most widely accepted approach to assessing the quality of guidelines is the Appraisal of Guidelines for Research and Evaluation (AGREE) instrument. We have conducted a systematic review of the methodological quality (as assessed by AGREE) of clinical guidelines developed in Europe for the management of chronic diseases published since 2000. The systematic review was undertaken in accordance with the Cochrane methodology. The inclusion criteria were that studies should have appraised European clinical guidelines for certain selected chronic disorders using the AGREE instrument. We searched five databases (Cab Abstracts, EMBASE, MEDLINE, Trip and EPPI). Nine studies reported in 10 papers, analysing a total of 28 European guidelines from eight countries as well as pan-European, were included. There was considerable variation in the quality of clinical guidelines across the AGREE domains. The least well addressed domains were 'editorial independence' (with a mean domain score of 41%), 'applicability' (44%), 'stakeholder involvement' (55%), and 'rigour of development' (64%), while 'clarity of presentation' (80%) and 'scope and purpose' (84%) were less problematic. This review indicates that there is considerable scope for improvement in the methods used to develop clinical guidelines for the prevention, management and treatment of chronic diseases in Europe. Given the importance of decision support strategies such as clinical guidelines in chronic disease management, improvement measures should include the explicit and transparent involvement of key stakeholders (especially scientific experts, guideline users and methodological specialists) and consideration of the implications for guideline implementation and applicability early on in the process. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Proactive telephone counseling for smoking cessation: meta-analyses by recruitment channel and methodological quality.

PubMed

Tzelepis, Flora; Paul, Christine L; Walsh, Raoul A; McElduff, Patrick; Knight, Jenny

2011-06-22

Systematic reviews demonstrated that proactive telephone counseling increases smoking cessation rates. However, these reviews did not differentiate studies by recruitment channel, did not adequately assess methodological quality, and combined different measures of abstinence. Twenty-four randomized controlled trials published before December 31, 2008, included seven of active recruitment, 16 of passive recruitment, and one of mixed recruitment. We rated methodological quality on selection bias, study design, confounders, blinding, data collection methods, withdrawals, and dropouts, according to the Quality Assessment Tool for Quantitative Studies. We conducted random effects meta-analysis to pool the results according to abstinence type and follow-up time for studies overall and segregated by recruitment channel, and methodological quality. The level of statistical heterogeneity was quantified by I(2). All statistical tests were two-sided. Methodological quality ratings indicated two strong, 10 moderate, and 12 weak studies. Overall, compared with self-help materials or no intervention control groups, proactive telephone counseling had a statistically significantly greater effect on point prevalence abstinence (nonsmoking at follow-up or abstinent for at least 24 hours, 7 days before follow-up) at 6-9 months (relative risk [RR] = 1.26, 95% confidence interval [CI] = 1.11 to 1.43, P < .001, I(2) = 21.4%) but not at 12-15 months after recruitment. This pattern also emerged when studies were segregated by recruitment channel (active, passive) or methodological quality (strong/moderate, weak). Overall, the positive effect on prolonged/continuous abstinence (abstinent for 3 months or longer before follow-up) was also statistically significantly greater at 6-9 months (RR = 1.58, CI = 1.26 to 1.98, P < .001, I(2) = 49.1%) and 12-18 months after recruitment (RR = 1.40, CI = 1.23 to 1.60, P < .001, I(2) = 18.5%). With the exception of point prevalence abstinence in the long term, these data support previous results showing that proactive telephone counseling has a positive impact on smoking cessation. Proactive telephone counseling increased prolonged/continuous abstinence long term for both actively and passively recruited smokers.

Funding source and the quality of reports of chronic wounds trials: 2004 to 2011

PubMed Central

2014-01-01

Background Critical commentaries suggest that wound care randomised controlled trials (RCTs) are often poorly reported with many methodological flaws. Furthermore, interventions in chronic wounds, rather than being drugs, are often medical devices for which there are no requirements for RCTs to bring products to market. RCTs in wounds trials therefore potentially represent a form of marketing. This study presents a methodological overview of chronic wound trials published between 2004 and 2011 and investigates the influence of industry funding on methodological quality. Methods A systematic search for RCTs for the treatment of chronic wounds published in the English language between 2004 and 2011 (inclusive) in the Cochrane Wounds Group Specialised Register of Trials was carried out. Data were extracted on aspects of trial design, conduct and quality including sample size, duration of follow-up, specification of a primary outcome, use of surrogate outcomes, and risks of bias. In addition, the prevalence of industry funding was assessed and its influence on the above aspects of trial design, conduct and quality was assessed. Results A total of 167 RCTs met our inclusion criteria. We found chronic wound trials often have short durations of follow-up (median 12 weeks), small sample sizes (median 63), fail to define a primary outcome in 41% of cases, and those that do define a primary outcome, use surrogate measures of healing in 40% of cases. Only 40% of trials used appropriate methods of randomisation, 25% concealed allocation and 34% blinded outcome assessors. Of the included trials, 41% were wholly or partially funded by industry, 33% declared non-commercial funding and 26% did not report a funding source. Industry funding was not statistically significantly associated with any measure of methodological quality, though this analysis was probably underpowered. Conclusions This overview confirms concerns raised about the methodological quality of RCTs in wound care and illustrates that greater efforts must be made to follow international standards for conducting and reporting RCTs. There is currently minimal evidence of an influence of industry funding on methodological quality although analyses had limited power and funding source was not reported for a quarter of studies. PMID:24422753

Funding source and the quality of reports of chronic wounds trials: 2004 to 2011.

PubMed

Hodgson, Robert; Allen, Richard; Broderick, Ellen; Bland, J Martin; Dumville, Jo C; Ashby, Rebecca; Bell-Syer, Sally; Foxlee, Ruth; Hall, Jill; Lamb, Karen; Madden, Mary; O'Meara, Susan; Stubbs, Nikki; Cullum, Nicky

2014-01-14

Critical commentaries suggest that wound care randomised controlled trials (RCTs) are often poorly reported with many methodological flaws. Furthermore, interventions in chronic wounds, rather than being drugs, are often medical devices for which there are no requirements for RCTs to bring products to market. RCTs in wounds trials therefore potentially represent a form of marketing. This study presents a methodological overview of chronic wound trials published between 2004 and 2011 and investigates the influence of industry funding on methodological quality. A systematic search for RCTs for the treatment of chronic wounds published in the English language between 2004 and 2011 (inclusive) in the Cochrane Wounds Group Specialised Register of Trials was carried out.Data were extracted on aspects of trial design, conduct and quality including sample size, duration of follow-up, specification of a primary outcome, use of surrogate outcomes, and risks of bias. In addition, the prevalence of industry funding was assessed and its influence on the above aspects of trial design, conduct and quality was assessed. A total of 167 RCTs met our inclusion criteria. We found chronic wound trials often have short durations of follow-up (median 12 weeks), small sample sizes (median 63), fail to define a primary outcome in 41% of cases, and those that do define a primary outcome, use surrogate measures of healing in 40% of cases. Only 40% of trials used appropriate methods of randomisation, 25% concealed allocation and 34% blinded outcome assessors. Of the included trials, 41% were wholly or partially funded by industry, 33% declared non-commercial funding and 26% did not report a funding source. Industry funding was not statistically significantly associated with any measure of methodological quality, though this analysis was probably underpowered. This overview confirms concerns raised about the methodological quality of RCTs in wound care and illustrates that greater efforts must be made to follow international standards for conducting and reporting RCTs. There is currently minimal evidence of an influence of industry funding on methodological quality although analyses had limited power and funding source was not reported for a quarter of studies.

A systematic review of model-based economic evaluations of diagnostic and therapeutic strategies for lower extremity artery disease.

PubMed

Vaidya, Anil; Joore, Manuela A; ten Cate-Hoek, Arina J; Kleinegris, Marie-Claire; ten Cate, Hugo; Severens, Johan L

2014-01-01

Lower extremity artery disease (LEAD) is a sign of wide spread atherosclerosis also affecting coronary, cerebral and renal arteries and is associated with increased risk of cardiovascular events. Many economic evaluations have been published for LEAD due to its clinical, social and economic importance. The aim of this systematic review was to assess modelling methods used in published economic evaluations in the field of LEAD. Our review appraised and compared the general characteristics, model structure and methodological quality of published models. Electronic databases MEDLINE and EMBASE were searched until February 2013 via OVID interface. Cochrane database of systematic reviews, Health Technology Assessment database hosted by National Institute for Health research and National Health Services Economic Evaluation Database (NHSEED) were also searched. The methodological quality of the included studies was assessed by using the Philips' checklist. Sixteen model-based economic evaluations were identified and included. Eleven models compared therapeutic health technologies; three models compared diagnostic tests and two models compared a combination of diagnostic and therapeutic options for LEAD. Results of this systematic review revealed an acceptable to low methodological quality of the included studies. Methodological diversity and insufficient information posed a challenge for valid comparison of the included studies. In conclusion, there is a need for transparent, methodologically comparable and scientifically credible model-based economic evaluations in the field of LEAD. Future modelling studies should include clinically and economically important cardiovascular outcomes to reflect the wider impact of LEAD on individual patients and on the society.

Assessment of Teaching Quality: Survey of University Graduates

ERIC Educational Resources Information Center

Stankeviciene, Jurate

2007-01-01

Purpose: The purpose was to investigate higher education quality because there are links between the main society and university graduates and the university. Methodology: This research sought aspects of the teaching quality of the Faculty that could be improved. The spheres were: improvement in qualifications of the teachers; finding ways to…

Beyond Technology Transfer: Quality of Life Impacts from R&D Outcomes

ERIC Educational Resources Information Center

Stone, Vathsala I.; Lockett, Michelle; Usiak, Douglas J.; Arthanat, Sajay

2010-01-01

This paper presents methodology and findings from three product efficacy studies that verify the quality of life benefits resulting from prior research, development, and transfer activities. The paper then discusses key lessons learned with implications for product evaluation practice. The studies assessed the quality of three assistive technology…

Investigating Relationships among Quality Dimensions in Higher Education

ERIC Educational Resources Information Center

Ardi, Romadhani; Hidayatno, Akhmad; Zagloel, Teuku Yuri M.

2012-01-01

Purpose: This study aims to assess the relationships among quality dimensions in higher education (HE) and to determine the effect of each quality dimension on students' satisfaction. Design/methodology/approach: A questionnaire was developed and distributed to 270 final year students of an engineering faculty in an Indonesian state university.…

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, Longgao; Yang, Xiaoyan; School of Environmental Science and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116

The implementation of land use planning (LUP) has a large impact on environmental quality. There lacks a widely accepted and consolidated approach to assess the LUP environmental impact using Strategic Environmental Assessment (SEA). In this paper, we developed a state-impact-state (SIS) model employed in the LUP environmental impact assessment (LUPEA). With the usage of Matter-element (ME) and Extenics method, the methodology based on the SIS model was established and applied in the LUPEA of Zoucheng County, China. The results show that: (1) this methodology provides an intuitive and easy understanding logical model for both the theoretical analysis and application ofmore » LUPEA; (2) the spatial multi-temporal assessment from base year, near-future year to planning target year suggests the positive impact on the environmental quality in the whole County despite certain environmental degradation in some towns; (3) besides the spatial assessment, other achievements including the environmental elements influenced by land use and their weights, the identification of key indicators in LUPEA, and the appropriate environmental mitigation measures were obtained; and (4) this methodology can be used to achieve multi-temporal assessment of LUP environmental impact of County or Town level in other areas. - Highlights: • A State-Impact-State model for Land Use Planning Environmental Assessment (LUPEA). • Matter-element (ME) and Extenics methods were embedded in the LUPEA. • The model was applied to the LUPEA of Zoucheng County. • The assessment shows improving environment quality since 2000 in Zoucheng County. • The method provides a useful tool for the LUPEA in the county level.« less

Methodologic quality of meta-analyses and systematic reviews on the Mediterranean diet and cardiovascular disease outcomes: a review.

PubMed

Huedo-Medina, Tania B; Garcia, Marissa; Bihuniak, Jessica D; Kenny, Anne; Kerstetter, Jane

2016-03-01

Several systematic reviews/meta-analyses published within the past 10 y have examined the associations of Mediterranean-style diets (MedSDs) on cardiovascular disease (CVD) risk. However, these reviews have not been evaluated for satisfying contemporary methodologic quality standards. This study evaluated the quality of recent systematic reviews/meta-analyses on MedSD and CVD risk outcomes by using an established methodologic quality scale. The relation between review quality and impact per publication value of the journal in which the article had been published was also evaluated. To assess compliance with current standards, we applied a modified version of the Assessment of Multiple Systematic Reviews (AMSTARMedSD) quality scale to systematic reviews/meta-analyses retrieved from electronic databases that had met our selection criteria: 1) used systematic or meta-analytic procedures to review the literature, 2) examined MedSD trials, and 3) had MedSD interventions independently or combined with other interventions. Reviews completely satisfied from 8% to 75% of the AMSTARMedSD items (mean ± SD: 31.2% ± 19.4%), with those published in higher-impact journals having greater quality scores. At a minimum, 60% of the 24 reviews did not disclose full search details or apply appropriate statistical methods to combine study findings. Only 5 of the reviews included participant or study characteristics in their analyses, and none evaluated MedSD diet characteristics. These data suggest that current meta-analyses/systematic reviews evaluating the effect of MedSD on CVD risk do not fully comply with contemporary methodologic quality standards. As a result, there are more research questions to answer to enhance our understanding of how MedSD affects CVD risk or how these effects may be modified by the participant or MedSD characteristics. To clarify the associations between MedSD and CVD risk, future meta-analyses and systematic reviews should not only follow methodologic quality standards but also include more statistical modeling results when data allow. © 2016 American Society for Nutrition.

Twenty years of meta-analyses in orthopaedic surgery: has quality kept up with quantity?

PubMed

Dijkman, Bernadette G; Abouali, Jihad A K; Kooistra, Bauke W; Conter, Henry J; Poolman, Rudolf W; Kulkarni, Abhaya V; Tornetta, Paul; Bhandari, Mohit

2010-01-01

As the number of studies in the literature is increasing, orthopaedic surgeons highly depend on meta-analyses as their primary source of scientific evidence. The objectives of this review were to assess the scientific quality and number of published meta-analyses on orthopaedics-related topics over time. We conducted, in duplicate and independently, a systematic review of published meta-analyses in orthopaedics in the years 2005 and 2008 and compared them with a previous systematic review of meta-analyses from 1969 to 1999. A search of electronic databases (MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews) was performed to identify meta-analyses published in 2005 and 2008. We searched bibliographies and contacted content experts to identify additional relevant studies. Two investigators independently assessed the quality of the studies, using the Oxman and Guyatt index, and abstracted relevant data. We included forty-five and forty-four meta-analyses from 2005 and 2008, respectively. While the number of meta-analyses increased fivefold from 1999 to 2008, the mean quality score did not change significantly over time (p = 0.067). In the later years, a significantly lower proportion of meta-analyses had methodological flaws (56% in 2005 and 68% in 2008) compared with meta-analyses published prior to 2000 (88%) (p = 0.006). In 2005 and 2008, respectively, 18% and 30% of the meta-analyses had major to extensive flaws in their methodology. Studies from 2008 with positive conclusions used and described appropriate criteria for the validity assessment less often than did those with negative results. The use of random-effects and fixed-effects models as pooling methods became more popular toward 2008. Although the methodological quality of orthopaedic meta-analyses has increased in the past twenty years, a substantial proportion continues to show major to extensive flaws. As the number of published meta-analyses is increasing, a routine checklist for scientific quality should be used in the peer-review process to ensure methodological standards for publication.

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome

PubMed Central

Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety. PMID:26246841

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome.

PubMed

Lauche, Romy; Cramer, Holger; Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety.

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Validation methodology in publications describing epidemiological registration methods of dental caries: a systematic review.

PubMed

Sjögren, P; Ordell, S; Halling, A

2003-12-01

The aim was to describe and systematically review the methodology and reporting of validation in publications describing epidemiological registration methods for dental caries. BASIC RESEARCH METHODOLOGY: Literature searches were conducted in six scientific databases. All publications fulfilling the predetermined inclusion criteria were assessed for methodology and reporting of validation using a checklist including items described previously as well as new items. The frequency of endorsement of the assessed items was analysed. Moreover, the type and strength of evidence, was evaluated. Reporting of predetermined items relating to methodology of validation and the frequency of endorsement of the assessed items were of primary interest. Initially 588 publications were located. 74 eligible publications were obtained, 23 of which fulfilled the inclusion criteria and remained throughout the analyses. A majority of the studies reported the methodology of validation. The reported methodology of validation was generally inadequate, according to the recommendations of evidence-based medicine. The frequencies of reporting the assessed items (frequencies of endorsement) ranged from four to 84 per cent. A majority of the publications contributed to a low strength of evidence. There seems to be a need to improve the methodology and the reporting of validation in publications describing professionally registered caries epidemiology. Four of the items assessed in this study are potentially discriminative for quality assessments of reported validation.

The methodological quality of nurse-sensitive indicators in Dutch hospitals: A descriptive exploratory research study.

PubMed

Kieft, R A M M; Stalpers, D; Jansen, A P M; Francke, A L; Delnoij, D M J

2018-06-01

Nurse-sensitive indicators (NSIs) are increasingly being developed and used to establish quality of nursing care in Western countries. The objective was to gain insights into the methodological quality of mandatory NSIs in Dutch hospitals, including indicators for pain, wound care, malnutrition and delirium. A descriptive exploratory design was used, starting with desk research into publicly available documents and reports describing the development of the NSIs included in this study. We used the validated Appraisal of Indicators through Research and Evaluation (AIRE) instrument to evaluate the methodological quality. Although the purpose and relevance of each individual NSI have been described, no detailed information about the criteria for selecting these topics is available. It is not clear which specific stakeholders participated and how their input was used. We found no information about the process of collecting and compiling scientific evidence. It is unclear whether and to what extent the usability of NSIs has been tested. The methodological quality of NSIs used in Dutch hospitals is less than optimal in various ways and it is therefore questionable if the indicators are accurate enough to identify changes or improve nursing practice. Our study also provides an example of how the methodological quality of NSIs can be assessed systematically, which is relevant considering the increasing use of NSIs in various countries. Copyright © 2018 Elsevier B.V. All rights reserved.

Traditional Chinese medicine for knee osteoarthritis: An overview of systematic review.

PubMed

Yang, Min; Jiang, Li; Wang, Qing; Chen, Hao; Xu, Guihua

2017-01-01

Traditional Chinese medicine (TCM) has been accepted as a complementary therapy for knee osteoarthritis. However, the efficacy and safety of the intervention were still conflicting and uncertain. Meanwhile, the quality of methodology and evidence in the field was unknown. To summarize the characteristics and critically evaluate the quality of methodology, as well as the evidence of systematic reviews (SRs) on TCM for knee osteoarthritis. Five electronic databases were searched from inception to April 2016. The methodological quality of the included studies was assessed by AMSTAR and ROBIS. The quality of the evidence was determined using the GRADE approach. Ten SRs were included. The conclusions suggest that TCM provides potential benefits for patients with knee osteoarthritis. These benefits include pain relief, functional improvement, and presence of few adverse events. Limitations of the methodological quality mainly included the lack of a-priori protocol or protocol registration and incomprehensive literature search. A list of excluded studies was also not provided. The overall quality of evidence in the SRs was poor, ranging from "very low" to "low," mainly because of the serious risk of bias of original trials, inconsistencies, and imprecision in the outcomes. TCM generally appears to be effective for knee osteoarthritis treatment. However, the evidence is not robust enough because of the methodological flaws in SRs. Hence, these conclusions on available SRs should be treated with caution for clinical practice.

Reporting characteristics of meta-analyses in orthodontics: methodological assessment and statistical recommendations.

PubMed

Papageorgiou, Spyridon N; Papadopoulos, Moschos A; Athanasiou, Athanasios E

2014-02-01

Ideally meta-analyses (MAs) should consolidate the characteristics of orthodontic research in order to produce an evidence-based answer. However severe flaws are frequently observed in most of them. The aim of this study was to evaluate the statistical methods, the methodology, and the quality characteristics of orthodontic MAs and to assess their reporting quality during the last years. Electronic databases were searched for MAs (with or without a proper systematic review) in the field of orthodontics, indexed up to 2011. The AMSTAR tool was used for quality assessment of the included articles. Data were analyzed with Student's t-test, one-way ANOVA, and generalized linear modelling. Risk ratios with 95% confidence intervals were calculated to represent changes during the years in reporting of key items associated with quality. A total of 80 MAs with 1086 primary studies were included in this evaluation. Using the AMSTAR tool, 25 (27.3%) of the MAs were found to be of low quality, 37 (46.3%) of medium quality, and 18 (22.5%) of high quality. Specific characteristics like explicit protocol definition, extensive searches, and quality assessment of included trials were associated with a higher AMSTAR score. Model selection and dealing with heterogeneity or publication bias were often problematic in the identified reviews. The number of published orthodontic MAs is constantly increasing, while their overall quality is considered to range from low to medium. Although the number of MAs of medium and high level seems lately to rise, several other aspects need improvement to increase their overall quality.

Studies in Ambulatory Care Quality Assessment in the Indian Health Service. Volume II: Appraisal of System Performance.

ERIC Educational Resources Information Center

Nutting, Paul A.; And Others

Six Indian Health Service (IHS) units, chosen in a non-random manner, were evaluated via a quality assessment methodology currently under development by the IHS Office of Research and Development. A set of seven health problems (tracers) was selected to represent major health problems, and clinical algorithms (process maps) were constructed for…

Proposal and application of a regional methodology of comparative risk assessment for potentially contaminated sites.

PubMed

Marzocchini, Manrico; Tatàno, Fabio; Moretti, Michela Simona; Antinori, Caterina; Orilisi, Stefano

2018-06-05

A possible approach for determining soil and groundwater quality criteria for contaminated sites is the comparative risk assessment. Originating from but not limited to Italian interest in a decentralised (regional) implementation of comparative risk assessment, this paper first addresses the proposal of an original methodology called CORIAN REG-M , which was created with initial attention to the context of potentially contaminated sites in the Marche Region (Central Italy). To deepen the technical-scientific knowledge and applicability of the comparative risk assessment, the following characteristics of the CORIAN REG-M methodology appear to be relevant: the simplified but logical assumption of three categories of factors (source and transfer/transport of potential contamination, and impacted receptors) within each exposure pathway; the adaptation to quality and quantity of data that are available or derivable at the given scale of concern; the attention to a reliable but unsophisticated modelling; the achievement of a conceptual linkage to the absolute risk assessment approach; and the potential for easy updating and/or refining of the methodology. Further, the application of the CORIAN REG-M methodology to some case-study sites located in the Marche Region indicated the following: a positive correlation can be expected between air and direct contact pathway scores, as well as between individual pathway scores and the overall site scores based on a root-mean-square algorithm; the exposure pathway, which presents the highest variability of scores, tends to be dominant at sites with the highest computed overall site scores; and the adoption of a root-mean-square algorithm can be expected to emphasise the overall site scoring.

Measurement properties of existing clinical assessment methods evaluating scapular positioning and function. A systematic review.

PubMed

Larsen, Camilla Marie; Juul-Kristensen, Birgit; Lund, Hans; Søgaard, Karen

2014-10-01

The aims were to compile a schematic overview of clinical scapular assessment methods and critically appraise the methodological quality of the involved studies. A systematic, computer-assisted literature search using Medline, CINAHL, SportDiscus and EMBASE was performed from inception to October 2013. Reference lists in articles were also screened for publications. From 50 articles, 54 method names were identified and categorized into three groups: (1) Static positioning assessment (n = 19); (2) Semi-dynamic (n = 13); and (3) Dynamic functional assessment (n = 22). Fifteen studies were excluded for evaluation due to no/few clinimetric results, leaving 35 studies for evaluation. Graded according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN checklist), the methodological quality in the reliability and validity domains was "fair" (57%) to "poor" (43%), with only one study rated as "good". The reliability domain was most often investigated. Few of the assessment methods in the included studies that had "fair" or "good" measurement property ratings demonstrated acceptable results for both reliability and validity. We found a substantially larger number of clinical scapular assessment methods than previously reported. Using the COSMIN checklist the methodological quality of the included measurement properties in the reliability and validity domains were in general "fair" to "poor". None were examined for all three domains: (1) reliability; (2) validity; and (3) responsiveness. Observational evaluation systems and assessment of scapular upward rotation seem suitably evidence-based for clinical use. Future studies should test and improve the clinimetric properties, and especially diagnostic accuracy and responsiveness, to increase utility for clinical practice.

The use of grounded theory in studies of nurses and midwives' coping processes: a systematic literature search.

PubMed

Cheer, Karen; MacLaren, David; Tsey, Komla

2015-01-01

Researchers are increasingly using grounded theory methodologies to study the professional experience of nurses and midwives. To review common grounded theory characteristics and research design quality as described in grounded theory studies of coping strategies used by nurses and midwives. A systematic database search for 2005-2015 identified and assessed grounded theory characteristics from 16 studies. Study quality was assessed using a modified Critical Appraisal Skills Programme tool. Grounded theory was considered a methodology or a set of methods, able to be used within different nursing and midwifery contexts. Specific research requirements determined the common grounded theory characteristics used in different studies. Most researchers did not clarify their epistemological and theoretical perspectives. To improve research design and trustworthiness of grounded theory studies in nursing and midwifery, researchers need to state their theoretical stance and clearly articulate their use of grounded theory methodology and characteristics in research reporting.

The inland water macro-invertebrate occurrences in Flanders, Belgium.

PubMed

Vannevel, Rudy; Brosens, Dimitri; Cooman, Ward De; Gabriels, Wim; Frank Lavens; Mertens, Joost; Vervaeke, Bart

2018-01-01

The Flanders Environment Agency (VMM) has been performing biological water quality assessments on inland waters in Flanders (Belgium) since 1989 and sediment quality assessments since 2000. The water quality monitoring network is a combined physico-chemical and biological network, the biological component focusing on macro-invertebrates. The sediment monitoring programme produces biological data to assess the sediment quality. Both monitoring programmes aim to provide index values, applying a similar conceptual methodology based on the presence of macro-invertebrates. The biological data obtained from both monitoring networks are consolidated in the VMM macro-invertebrates database and include identifications at family and genus level of the freshwater phyla Coelenterata, Platyhelminthes, Annelida, Mollusca, and Arthropoda. This paper discusses the content of this database, and the dataset published thereof: 282,309 records of 210 observed taxa from 4,140 monitoring sites located on 657 different water bodies, collected during 22,663 events. This paper provides some background information on the methodology, temporal and spatial coverage, and taxonomy, and describes the content of the dataset. The data are distributed as open data under the Creative Commons CC-BY license.

Reporting of health-related quality of life (HRQOL) data in oncology trials: a comparison of the European Organization for Research and Treatment of Cancer Quality of Life (EORTC QLQ-C30) and the Functional Assessment of Cancer Therapy-General (FACT-G).

PubMed

Smith, Adam B; Cocks, Kim; Parry, David; Taylor, Matthew

2014-04-01

The inclusion of patient-reported outcome (PRO) instruments to record patient health-related quality of life (HRQOL) data has virtually become the norm in oncology randomised controlled trials (RCTs). Despite this fact, recent concerns have focused on the quality of reporting of HRQOL. The primary aim of this study was to evaluate the quality of reporting of HRQOL data from two common instruments in oncology RCTs. A meta-review was undertaken of systematic reviews reporting HRQOL data collected using PRO instruments in oncology randomised controlled trials (RCTs). English language articles published between 2000 and 2012 were included and evaluated against a methodology checklist. Four hundred and thirty-five potential articles were identified. Six systematic reviews were included in the analysis. A total of 70,403 patients had completed PROs. The European Organization for Research and Treatment of Cancer QLQ-C30 and Functional Assessment of Cancer Therapy-General questionnaire accounted for 55 % of RCTs. Eighty per cent of RCTs had used psychometrically validated instruments; 70 % reported culturally valid instruments and almost all reported the assessment timing (96 %). Thirty per cent of RCTS reported clinical significance and missing data. In terms of methodological design, only 25 % of RCTs could be categorised as probably robust. The majority of oncology RCTs has shortcomings in terms of reporting HRQOL data when assessed against regulatory and methodology guidelines. These limitations will need to be addressed if HRQOL data are to be used to successfully support clinical decision-making, treatment options and labelling claims in oncology.

Assessment of analytical quality in Nordic clinical chemistry laboratories using data from contemporary national programs.

PubMed

Aronsson, T; Bjørnstad, P; Leskinen, E; Uldall, A; de Verdier, C H

1984-01-01

The aim of this investigation was primarily to assess analytical quality expressed as between-laboratory, within-laboratory, and total imprecision, not in order to detect laboratories with poor performance, but in the positive sense to provide data for improving critical steps in analytical methodology. The aim was also to establish the present state of the art in comparison with earlier investigations to see if improvement in analytical quality could be observed.

A Comparative Study of Three Spatial Interpolation Methodologies for the Analysis of Air Pollution Concentrations in Athens, Greece

NASA Astrophysics Data System (ADS)

Deligiorgi, Despina; Philippopoulos, Kostas; Thanou, Lelouda; Karvounis, Georgios

2010-01-01

Spatial interpolation in air pollution modeling is the procedure for estimating ambient air pollution concentrations at unmonitored locations based on available observations. The selection of the appropriate methodology is based on the nature and the quality of the interpolated data. In this paper, an assessment of three widely used interpolation methodologies is undertaken in order to estimate the errors involved. For this purpose, air quality data from January 2001 to December 2005, from a network of seventeen monitoring stations, operating at the greater area of Athens in Greece, are used. The Nearest Neighbor and the Liner schemes were applied to the mean hourly observations, while the Inverse Distance Weighted (IDW) method to the mean monthly concentrations. The discrepancies of the estimated and measured values are assessed for every station and pollutant, using the correlation coefficient, the scatter diagrams and the statistical residuals. The capability of the methods to estimate air quality data in an area with multiple land-use types and pollution sources, such as Athens, is discussed.

Longitudinal analysis of reporting and quality of systematic reviews in high-impact surgical journals.

PubMed

Chapman, S J; Drake, T M; Bolton, W S; Barnard, J; Bhangu, A

2017-02-01

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement aims to optimize the reporting of systematic reviews. The performance of the PRISMA Statement in improving the reporting and quality of surgical systematic reviews remains unclear. Systematic reviews published in five high-impact surgical journals between 2007 and 2015 were identified from online archives. Manuscripts blinded to journal, publication year and authorship were assessed according to 27 reporting criteria described by the PRISMA Statement and scored using a validated quality appraisal tool (AMSTAR, Assessing the Methodological Quality of Systematic Reviews). Comparisons were made between studies published before (2007-2009) and after (2011-2015) its introduction. The relationship between reporting and study quality was measured using Spearman's rank test. Of 281 eligible manuscripts, 80 were published before the PRISMA Statement and 201 afterwards. Most manuscripts (208) included a meta-analysis, with the remainder comprising a systematic review only. There was no meaningful change in median compliance with the PRISMA Statement (19 (i.q.r. 16-21) of 27 items before versus 19 (17-22) of 27 after introduction of PRISMA) despite achieving statistical significance (P = 0·042). Better reporting compliance was associated with higher methodological quality (r s  = 0·70, P < 0·001). The PRISMA Statement has had minimal impact on the reporting of surgical systematic reviews. Better compliance was associated with higher-quality methodology. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

A probabilistic assessment of health risks associated with short-term exposure to tropospheric ozone

DOE Office of Scientific and Technical Information (OSTI.GOV)

Whitfield, R.G; Biller, W.F.; Jusko, M.J.

1996-06-01

The work described in this report is part of a larger risk assessment sponsored by the U.S. Environmental Protection Agency. Earlier efforts developed exposure-response relationships for acute health effects among populations engaged in heavy exertion. Those efforts also developed a probabilistic national ambient air quality standards exposure model and a general methodology for integrating probabilistic exposure-response relation- ships and exposure estimates to calculate overall risk results. Recently published data make it possible to model additional health endpoints (for exposure at moderate exertion), including hospital admissions. New air quality and exposure estimates for alternative national ambient air quality standards for ozonemore » are combined with exposure-response models to produce the risk results for hospital admissions and acute health effects. Sample results explain the methodology and introduce risk output formats.« less

Training Psychiatry Residents in Quality Improvement: An Integrated, Year-Long Curriculum

ERIC Educational Resources Information Center

Arbuckle, Melissa R.; Weinberg, Michael; Cabaniss, Deborah L.; Kistler; Susan C.; Isaacs, Abby J.; Sederer, Lloyd I.; Essock, Susan M.

2013-01-01

Objective: The authors describe a curriculum for psychiatry residents in Quality Improvement (QI) methodology. Methods: All PGY3 residents (N=12) participated in a QI curriculum that included a year-long group project. Knowledge and attitudes were assessed before and after the curriculum, using a modified Quality Improvement Knowledge Assessment…

Bone mass improved effect of icariin for postmenopausal osteoporosis in ovariectomy-induced rats: a meta-analysis and systematic review.

PubMed

Xu, Jin-Hai; Yao, Min; Ye, Jie; Wang, Guo-Dong; Wang, Jing; Cui, Xue-Jun; Mo, Wen

2016-10-01

Ovariectomy (OVX)-induced rats are the most frequently used animal model to research postmenopausal osteoporosis. Our objective was to summarize and critically assess the bone mass improved effect of icariin (ICA) for treatment of postmenopausal osteoporosis in an OVX-induced rat model. The PUBMED, EMBASE, and Chinese databases were searched from their inception date to February 2015. Two reviewers independently selected animal studies that evaluated the bone mass improved effect of ICA compared with control in OVX-induced rats. Extracted data were analyzed by RevMan statistical software, and the methodological quality of each study was assessed. Seven studies with adequate randomization were included in the systematic review. Overall, ICA seemed to significantly improve bone mass as assessed using the bone mineral density (seven studies, n = 169; weighted mean difference, 0.02; 95% CI, 0.01-0.02, I = 77%, P < 0.00001) using a random-effects model. There is no significant difference between ICA and estrogen (E) (six studies, n = 128; weighted mean difference, 0.00; 95% CI, -0.00 to 0.01, I = 54%, P = 0.01). Bone mass improved effect of ICA for postmenopausal osteoporosis was observed in OVX-induced rats. Assessment of the methodological quality of studies involving OVX-induced animal models is required, and good methodological quality should be valued in systematic reviews of animal studies.

Cross-Sectional And Longitudinal Uncertainty Propagation In Drinking Water Risk Assessment

NASA Astrophysics Data System (ADS)

Tesfamichael, A. A.; Jagath, K. J.

2004-12-01

Pesticide residues in drinking water can vary significantly from day to day. However, drinking water quality monitoring performed under the Safe Drinking Water Act (SDWA) at most community water systems (CWSs) is typically limited to four data points per year over a few years. Due to limited sampling, likely maximum residues may be underestimated in risk assessment. In this work, a statistical methodology is proposed to study the cross-sectional and longitudinal uncertainties in observed samples and their propagated effect in risk estimates. The methodology will be demonstrated using data from 16 CWSs across the US that have three independent databases of atrazine residue to estimate the uncertainty of risk in infants and children. The results showed that in 85% of the CWSs, chronic risks predicted with the proposed approach may be two- to four-folds higher than that predicted with the current approach, while intermediate risks may be two- to three-folds higher in 50% of the CWSs. In 12% of the CWSs, however, the proposed methodology showed a lower intermediate risk. A closed-form solution of propagated uncertainty will be developed to calculate the number of years (seasons) of water quality data and sampling frequency needed to reduce the uncertainty in risk estimates. In general, this methodology provided good insight into the importance of addressing uncertainty of observed water quality data and the need to predict likely maximum residues in risk assessment by considering propagation of uncertainties.

Balancing benefit and risk of medicines: a systematic review and classification of available methodologies.

PubMed

Mt-Isa, Shahrul; Hallgreen, Christine E; Wang, Nan; Callréus, Torbjörn; Genov, Georgy; Hirsch, Ian; Hobbiger, Stephen F; Hockley, Kimberley S; Luciani, Davide; Phillips, Lawrence D; Quartey, George; Sarac, Sinan B; Stoeckert, Isabelle; Tzoulaki, Ioanna; Micaleff, Alain; Ashby, Deborah

2014-07-01

The need for formal and structured approaches for benefit-risk assessment of medicines is increasing, as is the complexity of the scientific questions addressed before making decisions on the benefit-risk balance of medicines. We systematically collected, appraised and classified available benefit-risk methodologies to facilitate and inform their future use. A systematic review of publications identified benefit-risk assessment methodologies. Methodologies were appraised on their fundamental principles, features, graphical representations, assessability and accessibility. We created a taxonomy of methodologies to facilitate understanding and choice. We identified 49 methodologies, critically appraised and classified them into four categories: frameworks, metrics, estimation techniques and utility survey techniques. Eight frameworks describe qualitative steps in benefit-risk assessment and eight quantify benefit-risk balance. Nine metric indices include threshold indices to measure either benefit or risk; health indices measure quality-of-life over time; and trade-off indices integrate benefits and risks. Six estimation techniques support benefit-risk modelling and evidence synthesis. Four utility survey techniques elicit robust value preferences from relevant stakeholders to the benefit-risk decisions. Methodologies to help benefit-risk assessments of medicines are diverse and each is associated with different limitations and strengths. There is not a 'one-size-fits-all' method, and a combination of methods may be needed for each benefit-risk assessment. The taxonomy introduced herein may guide choice of adequate methodologies. Finally, we recommend 13 of 49 methodologies for further appraisal for use in the real-life benefit-risk assessment of medicines. Copyright © 2014 John Wiley & Sons, Ltd.

Evidence and practice in spine registries

PubMed Central

van Hooff, Miranda L; Jacobs, Wilco C H; Willems, Paul C; Wouters, Michel W J M; de Kleuver, Marinus; Peul, Wilco C; Ostelo, Raymond W J G; Fritzell, Peter

2015-01-01

Background and purpose We performed a systematic review and a survey in order to (1) evaluate the evidence for the impact of spine registries on the quality of spine care, and with that, on patient-related outcomes, and (2) evaluate the methodology used to organize, analyze, and report the “quality of spine care” from spine registries. Methods To study the impact, the literature on all spinal disorders was searched. To study methodology, the search was restricted to degenerative spinal disorders. The risk of bias in the studies included was assessed with the Newcastle-Ottawa scale. Additionally, a survey among registry representatives was performed to acquire information about the methodology and practice of existing registries. Results 4,273 unique references up to May 2014 were identified, and 1,210 were eligible for screening and assessment. No studies on impact were identified, but 34 studies were identified to study the methodology. Half of these studies (17 of the 34) were judged to have a high risk of bias. The survey identified 25 spine registries, representing 14 countries. The organization of these registries, methods used, analytical approaches, and dissemination of results are presented. Interpretation We found a lack of evidence that registries have had an impact on the quality of spine care, regardless of whether intervention was non-surgical and/or surgical. To improve the quality of evidence published with registry data, we present several recommendations. Application of these recommendations could lead to registries showing trends, monitoring the quality of spine care given, and ultimately improving the value of the care given to patients with degenerative spinal disorders. PMID:25909475

Ultrasound for assessing disease activity in IBD patients: a systematic review of activity scores.

PubMed

Bots, S; Nylund, K; Löwenberg, M; Gecse, K; Gilja, O H; D'Haens, G

2018-04-19

Ultrasound (US) indices for assessing disease activity in IBD patients have never been critically reviewed. We aimed to systematically review the quality and reliability of available ultrasound (US) indices compared with reference standards for grading disease activity in IBD patients. Pubmed, Embase and Medline were searched from 1990 until June 2017. Relevant publications were identified through full text review after initial screening by 2 investigators. Data on methodology and index characteristics were collected. Study quality was assessed with a modified version of the Quadas-2 tool for risk of bias assessment. Of 20 studies with an US index, 11 studies met the inclusion criteria. Out of these 11 studies, 7 and 4 studied CD and UC activity indices, respectively. Parameters that were used in these indices included bowel wall thickness (BWT), Doppler signal (DS), wall layer stratification (WLS), compressibility, peristalsis, haustrations, fatty wrapping, contrast enhancement (CE) and strain pattern. Study quality was graded high in 5 studies, moderate in 3 studies and low in 3 studies. Ileocolonoscopy was used as the reference standard in 9 studies. In 1 study a combined index of ileocolonoscopy and barium contrast radiography and in 1 study histology was used as the reference standard. Only 5 studies used an established endoscopic index for comparison with US. Several US indices for assessing disease activity in IBD are available; however the methodology for development was suboptimal in most studies. For the development of future indices stringent methodological design is required.

Adapting needs assessment methodologies to build integrated health pathways for people in the criminal justice system.

PubMed

de Viggiani, N

2012-09-01

Criminal justice health services should be underpinned with good public health evidence about the population's health needs. Health needs assessment methodologies can provide valuable intelligence for commissioners to evaluate the quality of services and innovate according to need. However, health needs assessment can be limited if it takes a conventional epidemiological approach, focussing on individuals' healthcare needs in criminal justice settings. Techniques used to measure health and social need could be more widely applied and appropriately employed in the planning of health and social care services, especially if the intention is to be effective in reducing social exclusion and tackling health inequalities. Assessment tools are available that capture individual, social and environmental risk factors and determinants predisposing people to health and criminogenic risks. Good evidence gathering can mean that public health practitioners not only improve health, reduce inequalities and tackle social exclusion, but contribute to reducing re-offending. This paper suggests a new approach to assessment that integrates the full range of assessment methodologies available to practitioners. An integrated approach may be the way to enhance and enrich the public health function in providing evidence to improve the quality of local public services. Copyright © 2012 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

On the performance of metrics to predict quality in point cloud representations

NASA Astrophysics Data System (ADS)

Alexiou, Evangelos; Ebrahimi, Touradj

2017-09-01

Point clouds are a promising alternative for immersive representation of visual contents. Recently, an increased interest has been observed in the acquisition, processing and rendering of this modality. Although subjective and objective evaluations are critical in order to assess the visual quality of media content, they still remain open problems for point cloud representation. In this paper we focus our efforts on subjective quality assessment of point cloud geometry, subject to typical types of impairments such as noise corruption and compression-like distortions. In particular, we propose a subjective methodology that is closer to real-life scenarios of point cloud visualization. The performance of the state-of-the-art objective metrics is assessed by considering the subjective scores as the ground truth. Moreover, we investigate the impact of adopting different test methodologies by comparing them. Advantages and drawbacks of every approach are reported, based on statistical analysis. The results and conclusions of this work provide useful insights that could be considered in future experimentation.

Experienced quality factors: qualitative evaluation approach to audiovisual quality

NASA Astrophysics Data System (ADS)

Jumisko-Pyykkö, Satu; Häkkinen, Jukka; Nyman, Göte

2007-02-01

Subjective evaluation is used to identify impairment factors of multimedia quality. The final quality is often formulated via quantitative experiments, but this approach has its constraints, as subject's quality interpretations, experiences and quality evaluation criteria are disregarded. To identify these quality evaluation factors, this study examined qualitatively the criteria participants used to evaluate audiovisual video quality. A semi-structured interview was conducted with 60 participants after a subjective audiovisual quality evaluation experiment. The assessment compared several, relatively low audio-video bitrate ratios with five different television contents on mobile device. In the analysis, methodological triangulation (grounded theory, Bayesian networks and correspondence analysis) was applied to approach the qualitative quality. The results showed that the most important evaluation criteria were the factors of visual quality, contents, factors of audio quality, usefulness - followability and audiovisual interaction. Several relations between the quality factors and the similarities between the contents were identified. As a research methodological recommendation, the focus on content and usage related factors need to be further examined to improve the quality evaluation experiments.

The use of bibliometrics to measure research quality in UK higher education institutions.

PubMed

Adams, Jonathan

2009-01-01

Research assessment in the UK has evolved over a quarter of a century from a loosely structured, peer-review based process to one with a well understood data portfolio and assessment methodology. After 2008, the assessment process will shift again, to the use of indicators based largely on publication and citation data. These indicators will in part follow the format introduced in 2008, with a profiling of assessment outcomes at national and international levels. However, the shift from peer assessment to a quantitative methodology raises critical issues about which metrics are appropriate and informative and how such metrics should be managed to produce weighting factors for funding formulae. The link between publication metrics and other perceptions of research quality needs to be thoroughly tested and reviewed, and may be variable between disciplines. Many of the indicators that drop out of publication data are poorly linked to quality and should not be used at all. There are also issues about which publications are the correct base for assessment, which staff should be included in a review, how subjects should be structured and how the citation data should be normalised to account for discipline-dependent variables. Finally, it is vital to consider the effect that any assessment process will have on the behaviour of those to be assessed.

Evaluating Electronic Reference Services: Issues, Approaches and Criteria.

ERIC Educational Resources Information Center

Novotny, Eric

2001-01-01

Discussion of electronic library reference services focuses on an overview of the chief methodologies available for conducting assessments of electronic services. Highlights include quantitative measures and benchmarks, including equity and access; quality measures; behavioral aspects of quality, including librarian-patron interaction; and future…

Objective impairments of gait and balance in adults living with HIV-1 infection: a systematic review and meta-analysis of observational studies.

PubMed

Berner, Karina; Morris, Linzette; Baumeister, Jochen; Louw, Quinette

2017-08-01

Gait and balance deficits are reported in adults with HIV infection and are associated with reduced quality of life. Current research suggests an increased fall-incidence in this population, with fall rates among middle-aged adults with HIV approximating that in seronegative elderly populations. Gait and postural balance rely on a complex interaction of the motor system, sensory control, and cognitive function. However, due to disease progression and complications related to ongoing inflammation, these systems may be compromised in people with HIV. Consequently, locomotor impairments may result that can contribute to higher-than-expected fall rates. The aim of this review was to synthesize the evidence regarding objective gait and balance impairments in adults with HIV, and to emphasize those which could contribute to increased fall risk. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. An electronic search of published observational studies was conducted in March 2016. Methodological quality was assessed using the NIH Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies. Narrative synthesis of gait and balance outcomes was performed, and meta-analyses where possible. Seventeen studies were included, with fair to low methodological quality. All studies used clinical tests for gait-assessment. Gait outcomes assessed were speed, initiation-time and cadence. No studies assessed kinetics or kinematics. Balance was assessed using both instrumented and clinical tests. Outcomes were mainly related to center of pressure, postural reflex latencies, and timed clinical tests. There is some agreement that adults with HIV walk slower and have increased center of pressure excursions and -long loop postural reflex latencies, particularly under challenging conditions. Gait and balance impairments exist in people with HIV, resembling fall-associated parameters in the elderly. Impairments are more pronounced during challenging conditions, might be associated with disease severity, are not influenced by antiretroviral therapy, and might not be associated with peripheral neuropathy. Results should be interpreted cautiously due to overall poor methodological quality and heterogeneity. Locomotor impairments in adults with HIV are currently insufficiently quantified. Future research involving more methodological uniformity is warranted to better understand such impairments and to inform clinical decision-making, including fall-prevention strategies, in this population.

Quality assurance and quality control in mammography: a review of available guidance worldwide.

PubMed

Reis, Cláudia; Pascoal, Ana; Sakellaris, Taxiarchis; Koutalonis, Manthos

2013-10-01

Review available guidance for quality assurance (QA) in mammography and discuss its contribution to harmonise practices worldwide. Literature search was performed on different sources to identify guidance documents for QA in mammography available worldwide in international bodies, healthcare providers, professional/scientific associations. The guidance documents identified were reviewed and a selection was compared for type of guidance (clinical/technical), technology and proposed QA methodologies focusing on dose and image quality (IQ) performance assessment. Fourteen protocols (targeted at conventional and digital mammography) were reviewed. All included recommendations for testing acquisition, processing and display systems associated with mammographic equipment. All guidance reviewed highlighted the importance of dose assessment and testing the Automatic Exposure Control (AEC) system. Recommended tests for assessment of IQ showed variations in the proposed methodologies. Recommended testing focused on assessment of low-contrast detection, spatial resolution and noise. QC of image display is recommended following the American Association of Physicists in Medicine guidelines. The existing QA guidance for mammography is derived from key documents (American College of Radiology and European Union guidelines) and proposes similar tests despite the variations in detail and methodologies. Studies reported on QA data should provide detail on experimental technique to allow robust data comparison. Countries aiming to implement a mammography/QA program may select/prioritise the tests depending on available technology and resources. •An effective QA program should be practical to implement in a clinical setting. •QA should address the various stages of the imaging chain: acquisition, processing and display. •AEC system QC testing is simple to implement and provides information on equipment performance.

Methodological quality of behavioural weight loss studies: a systematic review

PubMed Central

Lemon, S. C.; Wang, M. L.; Haughton, C. F.; Estabrook, D. P.; Frisard, C. F.; Pagoto, S. L.

2018-01-01

Summary This systematic review assessed the methodological quality of behavioural weight loss intervention studies conducted among adults and associations between quality and statistically significant weight loss outcome, strength of intervention effectiveness and sample size. Searches for trials published between January, 2009 and December, 2014 were conducted using PUBMED, MEDLINE and PSYCINFO and identified ninety studies. Methodological quality indicators included study design, anthropometric measurement approach, sample size calculations, intent-to-treat (ITT) analysis, loss to follow-up rate, missing data strategy, sampling strategy, report of treatment receipt and report of intervention fidelity (mean = 6.3). Indicators most commonly utilized included randomized design (100%), objectively measured anthropometrics (96.7%), ITT analysis (86.7%) and reporting treatment adherence (76.7%). Most studies (62.2%) had a follow-up rate >75% and reported a loss to follow-up analytic strategy or minimal missing data (69.9%). Describing intervention fidelity (34.4%) and sampling from a known population (41.1%) were least common. Methodological quality was not associated with reporting a statistically significant result, effect size or sample size. This review found the published literature of behavioural weight loss trials to be of high quality for specific indicators, including study design and measurement. Identified for improvement include utilization of more rigorous statistical approaches to loss to follow up and better fidelity reporting. PMID:27071775

Forty years of quality-of-life research in congenital heart disease: Temporal trends in conceptual and methodological rigor.

PubMed

Bratt, Ewa-Lena; Moons, Philip

2015-09-15

The first study on quality of life (QoL) in patients with congenital heart disease was published 40 years ago. Since then, the number of QoL articles on these patients has grown exponentially. We conducted a systematic literature review of all empirical studies on QoL in patients with congenital heart disease published since 1974, with the aim of determining the range of conceptual and methodological rigor of studies and identifying temporal trends in these parameters. PubMed, Embase, and Cinahl were searched for empirical studies addressing QoL in children, adolescents, or adults with congenital heart disease, published between January 1, 1974, and December 31, 2014. We applied 10 review criteria that were previously developed by Gill and Feinstein in 1994 and further refined by Moons et al. in 2004. Overall, 234 articles were reviewed. We found slight but non-significant temporal improvements in conceptual and methodological rigor and in use of assessment methods. This indicates a trend toward a more professional and exacting approach in QoL assessments. However, the majority of articles still had substantial conceptual and methodological deficits. Furthermore, we observed that citation of the publications of Gill and Feinstein and Moons et al. in published QoL research is associated with higher quality scores, suggesting that these articles have a positive impact on conceptual and methodological caliber. Despite 40 years of QoL research in this field, this review shows that major weaknesses in methodological rigor remain highly prevalent, which may make QoL studies inconclusive. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Implementation and evaluation of a multisite drug usage evaluation program across Australian hospitals - a quality improvement initiative

PubMed Central

2011-01-01

Background With the use of medicines being a broad and extensive part of health management, mechanisms to ensure quality use of medicines are essential. Drug usage evaluation (DUE) is an evidence-based quality improvement methodology, designed to improve the quality, safety and cost-effectiveness of drug use. The purpose of this paper is to describe a national DUE methodology used to improve health care delivery across the continuum through multi-faceted intervention involving audit and feedback, academic detailing and system change, and a qualitative assessment of the methodology, as illustrated by the Acute Postoperative Pain Management (APOP) project. Methods An established methodology, consisting of a baseline audit of inpatient medical records, structured patient interviews and general practitioner surveys, followed by an educational intervention and follow-up audit, is used. Australian hospitals, including private, public, metropolitan and regional, are invited to participate on a voluntary basis. De-identified data collected by hospitals are collated and evaluated nationally to provide descriptive comparative analyses. Hospitals benchmark their practices against state and national results to facilitate change. The educational intervention consists of academic detailing, group education, audit and feedback, point-of-prescribing prompts and system changes. A repeat data collection is undertaken to assess changes in practice. An online qualitative survey was undertaken to evaluate the APOP program. Qualitative assessment of hospitals' perceptions of the effectiveness of the overall DUE methodology and changes in procedure/prescribing/policy/clinical practice which resulted from participation were elicited. Results 62 hospitals participated in the APOP project. Among 23 respondents to the evaluation survey, 18 (78%) reported improvements in the documentation of pain scores at their hospital. 15 (65%) strongly agreed or agreed that participation in APOP directly resulted in increased prescribing of multimodal analgesia for pain relief in postoperative patients. Conclusions This national DUE program has facilitated the engagement and participation of a number of acute health care facilities to address issues relating to quality use of medicine. This approach has been perceived to be effective in helping them achieve improvements in patient care. PMID:21871132

Implementation and evaluation of a multisite drug usage evaluation program across Australian hospitals - a quality improvement initiative.

PubMed

Pulver, Lisa K; Wai, Angela; Maxwell, David J; Robertson, Marion B; Riddell, Steven

2011-08-29

With the use of medicines being a broad and extensive part of health management, mechanisms to ensure quality use of medicines are essential. Drug usage evaluation (DUE) is an evidence-based quality improvement methodology, designed to improve the quality, safety and cost-effectiveness of drug use. The purpose of this paper is to describe a national DUE methodology used to improve health care delivery across the continuum through multi-faceted intervention involving audit and feedback, academic detailing and system change, and a qualitative assessment of the methodology, as illustrated by the Acute Postoperative Pain Management (APOP) project. An established methodology, consisting of a baseline audit of inpatient medical records, structured patient interviews and general practitioner surveys, followed by an educational intervention and follow-up audit, is used. Australian hospitals, including private, public, metropolitan and regional, are invited to participate on a voluntary basis. De-identified data collected by hospitals are collated and evaluated nationally to provide descriptive comparative analyses. Hospitals benchmark their practices against state and national results to facilitate change. The educational intervention consists of academic detailing, group education, audit and feedback, point-of-prescribing prompts and system changes. A repeat data collection is undertaken to assess changes in practice.An online qualitative survey was undertaken to evaluate the APOP program. Qualitative assessment of hospitals' perceptions of the effectiveness of the overall DUE methodology and changes in procedure/prescribing/policy/clinical practice which resulted from participation were elicited. 62 hospitals participated in the APOP project. Among 23 respondents to the evaluation survey, 18 (78%) reported improvements in the documentation of pain scores at their hospital. 15 (65%) strongly agreed or agreed that participation in APOP directly resulted in increased prescribing of multimodal analgesia for pain relief in postoperative patients. This national DUE program has facilitated the engagement and participation of a number of acute health care facilities to address issues relating to quality use of medicine. This approach has been perceived to be effective in helping them achieve improvements in patient care.

A systematic review of the quality of homeopathic pathogenetic trials published from 1945 to 1995.

PubMed

Dantas, F; Fisher, P; Walach, H; Wieland, F; Rastogi, D P; Teixeira, H; Koster, D; Jansen, J P; Eizayaga, J; Alvarez, M E P; Marim, M; Belon, P; Weckx, L L M

2007-01-01

The quality of information gathered from homeopathic pathogenetic trials (HPTs), also known as 'provings', is fundamental to homeopathy. We systematically reviewed HPTs published in six languages (English, German, Spanish, French, Portuguese and Dutch) from 1945 to 1995, to assess their quality in terms of the validity of the information they provide. The literature was comprehensively searched, only published reports of HPTs were included. Information was extracted by two reviewers per trial using a form with 87 items. Information on: medicines, volunteers, ethical aspects, blinding, randomization, use of placebo, adverse effects, assessments, presentation of data and number of claimed findings were recorded. Methodological quality was assessed by an index including indicators of internal and external validity, personal judgement and comments of reviewers for each study. 156 HPTs on 143 medicines, involving 2815 volunteers, produced 20,538 pathogenetic effects (median 6.5 per volunteer). There was wide variation in methods and results. Sample size (median 15, range 1-103) and trial duration (mean 34 days) were very variable. Most studies had design flaws, particularly absence of proper randomization, blinding, placebo control and criteria for analysis of outcomes. Mean methodological score was 5.6 (range 4-16). More symptoms were reported from HPTs of poor quality than from better ones. In 56% of trials volunteers took placebo. Pathogenetic effects were claimed in 98% of publications. On average about 84% of volunteers receiving active treatment developed symptoms. The quality of reports was in general poor, and much important information was not available. The HPTs were generally of low methodological quality. There is a high incidence of pathogenetic effects in publications and volunteers but this could be attributable to design flaws. Homeopathic medicines, tested in HPTs, appear safe. The central question of whether homeopathic medicines in high dilutions can provoke effects in healthy volunteers has not yet been definitively answered, because of methodological weaknesses of the reports. Improvement of the method and reporting of results of HPTs are required. References to all included RCTs are available on-line at.

Epidemiology, quality and reporting characteristics of meta-analyses of observational studies published in Chinese journals.

PubMed

Zhang, Zhe-wen; Cheng, Juan; Liu, Zhuan; Ma, Ji-chun; Li, Jin-long; Wang, Jing; Yang, Ke-hu

2015-12-07

The aim of this study was to examine the epidemiological and reporting characteristics as well as the methodological quality of meta-analyses (MAs) of observational studies published in Chinese journals. 5 Chinese databases were searched for MAs of observational studies published from January 1978 to May 2014. Data were extracted into Excel spreadsheets, and Meta-analysis of Observational Studies in Epidemiology (MOOSE) and Assessment of Multiple Systematic Reviews (AMSTAR) checklists were used to assess reporting characteristics and methodological quality, respectively. A total of 607 MAs were included. Only 52.2% of the MAs assessed the quality of the included primary studies, and the retrieval information was not comprehensive in more than half (85.8%) of the MAs. In addition, 50 (8.2%) MAs did not search any Chinese databases, while 126 (20.8%) studies did not search any English databases. Approximately 41.2% of the MAs did not describe the statistical methods in sufficient details, and most (95.5%) MAs did not report on conflicts of interest. However, compared with the before publication of the MOOSE Checklist, the quality of reporting improved significantly for 20 subitems after publication of the MOOSE Checklist, and 7 items of the included MAs demonstrated significant improvement after publication of the AMSTAR Checklist (p<0.05). Although many MAs of observational studies have been published in Chinese journals, the reporting quality is questionable. Thus, there is an urgent need to increase the use of reporting guidelines and methodological tools in China; we recommend that Chinese journals adopt the MOOSE and AMSTAR criteria. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Quality Assessment for Placement Centres: A Case Study of the University of Barcelona's Faculty of Education

ERIC Educational Resources Information Center

Freixa Niella, Montse; Vilà Baños, Ruth; Rubio Hurtado, M. José

2015-01-01

The aim of this research was to identify the factors that could be used for quality assessments of the placement centres used by the University of Barcelona's Faculty of Education. To achieve this, a multiple case study method (bachelor's degrees in Education, Social Education and Social Work) was used, which was based on a survey methodology. A…

Studies in Ambulatory Care Quality Assessment in the Indian Health Service. Volume III: Comparison of Rural Private Practice, Health Maintenance Organizations, and the Indian Health Service.

ERIC Educational Resources Information Center

Nutting, Paul A.; And Others

Utilizing a quality assessment methodology for ambulatory patient care currently under development by the Indian Health Service's (IHS) Office of Research and Development, comparisons were made between results derived from a pilot test in IHS service units, 2 metropolitan Health Maintenance Organizations (HMO), and 3 rural private practices.…

[Audit and feedback, and continuous quality improvement strategies to improve the quality of care for type 2 diabetes: a systematic review of literature].

PubMed

Vecchi, Simona; Agabiti, Nera; Mitrova, Susanna; Cacciani, Laura; Amato, Laura; Davoli, Marina; Bargagli, Anna Maria

2016-01-01

we analysed evidence on effective interventions to improve the quality of care and management in patients with diabetes type 2. This review focuses particularly on audit and feedback intervention, targeted to healthcare providers, and continuous quality improvement (CQI) involving health professionals and health care systems, respectively. we searched The Cochrane Library, PubMed, and EMBASE (search period: January 2005-December 2015) to identify systematic reviews (SR) and randomized controlled trials (RCTs) considering patients' outcomes and process measures as quality indicators in diabetes care. Selection of studies and data extraction were carried out independently by two reviewers. Methodological quality of individual studies was assessed using the checklist «Assessment of methodological quality of systematic review» (AMSTAR) and the Cochrane's tool, respectively. We produced summaries of results for each study design. the search process resulted in 810 citations. One SR and 7 RCTs that compared any intervention in which audit and feedback and CQI was a component vs. other interventions were selected. The SR found that audit and feedback activity was associated with improvements of glycaemic (mean difference: 0.26; 95%CI 0.08;0.44) and cholesterol control (mean difference: 0.03; 95%CI -0.04;0.10). CQI interventions were not associated with an improvement of quality of diabetes care. The RCTs considered in this review compared a broad range of interventions including feedback as unique activity or as part of more complex strategies. The methodological quality was generally poor in all the included trials. the available evidence suggests that audit and feedback and CQI improve quality of care in diabetic patients, although the effect is small and heterogeneous among process and outcomes indicators.

Evaluation of global water quality - the potential of a data- and model-driven analysis

NASA Astrophysics Data System (ADS)

Bärlund, Ilona; Flörke, Martina; Alcamo, Joseph; Völker, Jeanette; Malsy, Marcus; Kaus, Andrew; Reder, Klara; Büttner, Olaf; Katterfeld, Christiane; Dietrich, Désirée; Borchardt, Dietrich

2016-04-01

The ongoing socio-economic development presents a new challenge for water quality worldwide, especially in developing and emerging countries. It is estimated that due to population growth and the extension of water supply networks, the amount of waste water will rise sharply. This can lead to an increased risk of surface water quality degradation, if the wastewater is not sufficiently treated. This development has impacts on ecosystems and human health, as well as food security. The United Nations Member States have adopted targets for sustainable development. They include, inter alia, sustainable protection of water quality and sustainable use of water resources. To achieve these goals, appropriate monitoring strategies and the development of indicators for water quality are required. Within the pre-study for a 'World Water Quality Assessment' (WWQA) led by United Nations Environment Programme (UNEP), a methodology for assessing water quality, taking into account the above-mentioned objectives has been developed. The novelty of this methodology is the linked model- and data-driven approach. The focus is on parameters reflecting the key water quality issues, such as increased waste water pollution, salinization or eutrophication. The results from the pre-study show, for example, that already about one seventh of all watercourses in Latin America, Africa and Asia show high organic pollution. This is of central importance for inland fisheries and associated food security. In addition, it could be demonstrated that global water quality databases have large gaps. These must be closed in the future in order to obtain an overall picture of global water quality and to target measures more efficiently. The aim of this presentation is to introduce the methodology developed within the WWQA pre-study and to show selected examples of application in Latin America, Africa and Asia.

Methodological quality of systematic reviews referenced in clinical practice guidelines for the treatment of opioid use disorder.

PubMed

Ross, Andrew; Rankin, Justin; Beaman, Jason; Murray, Kelly; Sinnett, Philip; Riddle, Ross; Haskins, Jordan; Vassar, Matt

2017-01-01

With efforts to combat opioid use disorder, there is an increased interest in clinical practice guidelines (CPGs) for opioid use disorder treatments. No literature exists examining the quality of systematic reviews used in opioid use disorder CPGs. This study aims to describe the methodological quality and reporting clarity of systematic reviews (SRs) used to create CPGs for opioid use disorder. From June to July 2016 guideline clearinghouses and medical literature databases were searched for relevant CPGs used in the treatment of opioid use disorder. Included CPGs must have been recognized by a national organization. SRs from the reference section of each CPG was scored by using AMSTAR (a measurement tool to assess the methodological quality of systematic reviews) tool and PRISMA (preferred reporting items for systematic reviews and meta-analyses) checklist. Seventeen CPGs from 2006-2016 were included in the review. From these, 57 unique SRs were extracted. SRS comprised 0.28% to 17.92% of all references found in the CPGs. All SRs obtained moderate or high methodological quality score on the AMSTAR tool. All reviews met at least 70% of PRISMA criteria. In PRISMA, underperforming areas included accurate title labeling, protocol registration, and risk of bias. Underperforming areas in AMSTAR included conflicts of interest, funding, and publication bias. A positive correlation was found between AMSTAR and PRISMA scores (r = .79). Although the SRs in the CPGs were of good quality, there are still areas for improvement. Systematic reviewers should consult PRISMA and AMSTAR when conducting and reporting reviews. It is important for CPG developers to consider methodological quality as a factor when developing CPG recommendations, recognizing that the quality of systematic reviews underpinning guidelines does not necessarily correspond to the quality of the guideline itself.

[A Methodological Quality Assessment of South Korean Nursing Research using Structural Equation Modeling in South Korea].

PubMed

Kim, Jung-Hee; Shin, Sujin; Park, Jin-Hwa

2015-04-01

The purpose of this study was to evaluate the methodological quality of nursing studies using structural equation modeling in Korea. Databases of KISS, DBPIA, and National Assembly Library up to March 2014 were searched using the MeSH terms 'nursing', 'structure', 'model'. A total of 152 studies were screened. After removal of duplicates and non-relevant titles, 61 papers were read in full. Of the sixty-one articles retrieved, 14 studies were published between 1992 and 2000, 27, between 2001 and 2010, and 20, between 2011 and March 2014. The methodological quality of the review examined varied considerably. The findings of this study suggest that more rigorous research is necessary to address theoretical identification, two indicator rule, distribution of sample, treatment of missing values, mediator effect, discriminant validity, convergent validity, post hoc model modification, equivalent models issues, and alternative models issues should be undergone. Further research with robust consistent methodological study designs from model identification to model respecification is needed to improve the validity of the research.

INDOOR AIR ASSESSMENT - A REVIEW OF INDOOR AIR QUALITY RISK CHARACTERIZATION

EPA Science Inventory

Risk assessment methodologies provide a mechanism for incorporating scientific evidence and Judgments Into the risk management decision process. isk characterization framework has been developed to provide a systematic approach for analysis and presentation of risk characterizati...

Traditional Chinese medicine for knee osteoarthritis: An overview of systematic review

PubMed Central

Wang, Qing; Chen, Hao

2017-01-01

Background Traditional Chinese medicine (TCM) has been accepted as a complementary therapy for knee osteoarthritis. However, the efficacy and safety of the intervention were still conflicting and uncertain. Meanwhile, the quality of methodology and evidence in the field was unknown. Objective To summarize the characteristics and critically evaluate the quality of methodology, as well as the evidence of systematic reviews (SRs) on TCM for knee osteoarthritis. Methods Five electronic databases were searched from inception to April 2016. The methodological quality of the included studies was assessed by AMSTAR and ROBIS. The quality of the evidence was determined using the GRADE approach. Results Ten SRs were included. The conclusions suggest that TCM provides potential benefits for patients with knee osteoarthritis. These benefits include pain relief, functional improvement, and presence of few adverse events. Limitations of the methodological quality mainly included the lack of a-priori protocol or protocol registration and incomprehensive literature search. A list of excluded studies was also not provided. The overall quality of evidence in the SRs was poor, ranging from “very low” to “low,” mainly because of the serious risk of bias of original trials, inconsistencies, and imprecision in the outcomes. Conclusions TCM generally appears to be effective for knee osteoarthritis treatment. However, the evidence is not robust enough because of the methodological flaws in SRs. Hence, these conclusions on available SRs should be treated with caution for clinical practice. PMID:29267324

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools

ERIC Educational Resources Information Center

Wendt, Oliver; Miller, Bridget

2012-01-01

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews.

PubMed

Pluye, Pierre; Gagnon, Marie-Pierre; Griffiths, Frances; Johnson-Lafleur, Janique

2009-04-01

A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies. To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components. A three-step critical review was conducted. 2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic. Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs). Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality. A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.

Assessing the quality of the volume-outcome relationship in uro-oncology.

PubMed

Mayer, Erik K; Purkayastha, Sanjay; Athanasiou, Thanos; Darzi, Ara; Vale, Justin A

2009-02-01

To assess systematically the quality of evidence for the volume-outcome relationship in uro-oncology, and thus facilitate the formulating of health policy within this speciality, as 'Implementation of Improving Outcome Guidance' has led to centralization of uro-oncology based on published studies that have supported a 'higher volume-better outcome' relationship, but improved awareness of methodological drawbacks in health service research has questioned the strength of this proposed volume-outcome relationship. We systematically searched previous relevant reports and extracted all articles from 1980 onwards assessing the volume-outcome relationship for cystectomy, prostatectomy and nephrectomy at the institution and/or surgeon level. Studies were assessed for their methodological quality using a previously validated rating system. Where possible, meta-analytical methods were used to calculate overall differences in outcome measures between low and high volume healthcare providers. In all, 22 studies were included in the final analysis; 19 of these were published in the last 5 years. Only four studies appropriately explored the effect of both the institution and surgeon volume on outcome measures. Mortality and length of stay were the most frequently measured outcomes. The median total quality scores within each of the operation types were 8.5, 9 and 8 for cystectomy, prostatectomy and nephrectomy, respectively (possible maximum score 18). Random-effects modelling showed a higher risk of mortality in low-volume institutions than in higher-volume institutions for both cystectomy and nephrectomy (odds ratio 1.88, 95% confidence interval 1.54-2.29, and 1.28, 1.10-1.49, respectively). The methodological quality of volume-outcome research as applied to cystectomy, prostatectomy and nephrectomy is only modest at best. Accepting several limitations, pooled analysis confirms a higher-volume, lower-mortality relationship for cystectomy and nephrectomy. Future research should focus on the development of a quality framework with a validated scoring system for the bench-marking of data to improve validity and facilitate rational policy-making within the speciality of uro-oncology.

Effects of obesity on lung volume and capacity in children and adolescents: a systematic review

PubMed Central

Winck, Aline Dill; Heinzmann-Filho, João Paulo; Soares, Rafaela Borges; da Silva, Juliana Severo; Woszezenki, Cristhiele Taís; Zanatta, Letiane Bueno

2016-01-01

Abstract Objective: To assess the effects of obesity on lung volume and capacity in children and adolescents. Data source: This is a systematic review, carried out in Pubmed, Lilacs, Scielo and PEDro databases, using the following Keywords: Plethysmography; Whole Body OR Lung Volume Measurements OR Total Lung Capacity OR Functional Residual Capacity OR Residual Volume AND Obesity. Observational studies or clinical trials that assessed the effects of obesity on lung volume and capacity in children and adolescents (0-18 years) without any other associated disease; in English; Portuguese and Spanish languages were selected. Methodological quality was assessed by the Agency for Healthcare Research and Quality. Data synthesis: Of the 1,030 articles, only four were included in the review. The studies amounted to 548 participants, predominantly males, with sample size ranging from 45 to 327 individuals. 100% of the studies evaluated nutritional status through BMI (z-score) and 50.0% reported the data on abdominal circumference. All demonstrated that obesity causes negative effects on lung volume and capacity, causing a reduction mainly in functional residual capacity in 75.0% of the studies; in the expiratory reserve volume in 50.0% and in the residual volume in 25.0%. The methodological quality ranged from moderate to high, with 75.0% of the studies classified as having high methodological quality. Conclusions: Obesity causes deleterious effects on lung volume and capacity in children and adolescents, mainly by reducing functional residual capacity, expiratory reserve volume and residual volume. PMID:27130483

The landscape of systematic reviews in urology (1998 to 2015): an assessment of methodological quality.

PubMed

Han, Julia L; Gandhi, Shreyas; Bockoven, Crystal G; Narayan, Vikram M; Dahm, Philipp

2017-04-01

To assess the quality of published systematic reviews in the urology literature (an extension of our previously reported work), as high-quality systematic reviews play a paramount role in informing evidence-based clinical practice. Our focus was on systematic reviews in the urology literature that incorporated questions of prevention and therapy. To identify such reviews published during a 36-month period (2013-2015), we systematically searched PubMed and hand-searched the table of contents of four major urology journals. Two reviewers independently assessed the methodological quality of those reviews, using the 11-point 'Assessment of Multiple Systematic Reviews' (AMSTAR) instrument. We performed protocol-driven analyses of the data from our present study's 36-month period alone, as well as in aggregate with the data from our previously reported work's study periods (2009-2012 and 1998-2008). In our literature search of the 36-month period (2013-2015), we initially identified 490 possibly relevant reviews, of which 125 met our inclusion criteria. The most common topic of reviews for the 2013-2015 period was oncology (51.2%; n = 64), followed by voiding dysfunction (21.6%; n = 27). The mean [standard deviation (SD)] AMSTAR score in the 2013-2015 period (n = 125) was 4.8 (2.4); 2009-2012 (n = 113), 5.4 (2.3); and 1998-2008 (n = 57), 4.8 (2.0) (P = 0.127). In the 2013-2015 period, the mean (SD) AMSTAR score for the BJU International (n = 25) was 5.6 (2.9); for The Journal of Urology (n = 20), 5.1 (2.6); for European Urology (n = 60), 4.5 (2.2); and for Urology (n = 20), 4.4 (2.2) (P = 0.106). The number of systematic reviews published in the urology literature has exponentially increased, year by year, but their methodological quality has stagnated. To enhance the validity and impact of systematic reviews, all authors and editors must apply established methodological standards. © 2016 The Authors BJU International © 2016 BJU International Published by John Wiley & Sons Ltd.

Tracking of childhood overweight into adulthood: a systematic review of the literature.

PubMed

Singh, A S; Mulder, C; Twisk, J W R; van Mechelen, W; Chinapaw, M J M

2008-09-01

Overweight and obesity in youth are important public health concerns and are of particular interest because of possible long-term associations with adult weight status and morbidity. The aim of this study was to systematically review the literature and update evidence concerning persistence of childhood overweight. A computerized bibliographical search--restricted to studies with a prospective or retrospective longitudinal design--was conducted. Two authors independently extracted data and assessed the methodological quality of the included studies in four dimensions (i) study population and participation rate; (ii) study attrition; (iii) data collection and (iv) data analysis. Conclusions were based on a rating system of three levels of evidence. A total of 25 publications were selected for inclusion in this review. According to a methodological quality assessment, 13 studies were considered to be of high quality. The majority of these high-quality studies were published after 2001, indicating that recently published data, in particular, provide us with reliable information. All included studies consistently report an increased risk of overweight and obese youth becoming overweight adults, suggesting that the likelihood of persistence of overweight into adulthood is moderate for overweight and obese youth. However, predictive values varied considerably. Limiting aspects with respect to generalizability and methodological issues are discussed.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond's Checklist: A Narrative Review.

PubMed

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-09-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond's checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles' structure was analyzed by Drummond's standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond's criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond’s Checklist: A Narrative Review

PubMed Central

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-01-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond’s checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles’ structure was analyzed by Drummond’s standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond’s criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies. PMID:29234174

Service quality assessment of workers compensation health care delivery programs in New York using SERVQUAL.

PubMed

Arunasalam, Mark; Paulson, Albert; Wallace, William

2003-01-01

Preferred provider organizations (PPOs) provide healthcare services to an expanding proportion of the U.S. population. This paper presents a programmatic assessment of service quality in the workers' compensation environment using two different models: the PPO program model and the fee-for-service (FFS) payor model. The methodology used here will augment currently available research in workers' compensation, which has been lacking in measuring service quality determinants and assessing programmatic success/failure of managed care type programs. Results indicated that the SERVQUAL tool provided a reliable and valid clinical quality assessment tool that ascertained that PPO marketers should focus on promoting physician outreach (to show empathy) and accessibility (to show reliability) for injured workers.

Does Methodological Guidance Produce Consistency? A Review of Methodological Consistency in Breast Cancer Utility Value Measurement in NICE Single Technology Appraisals.

PubMed

Rose, Micah; Rice, Stephen; Craig, Dawn

2018-06-01

Since 2004, National Institute for Health and Care Excellence (NICE) methodological guidance for technology appraisals has emphasised a strong preference for using the validated EuroQol 5-Dimensions (EQ-5D) quality-of-life instrument, measuring patient health status from patients or carers, and using the general public's preference-based valuation of different health states when assessing health benefits in economic evaluations. The aim of this study was to review all NICE single technology appraisals (STAs) for breast cancer treatments to explore consistency in the use of utility scores in light of NICE methodological guidance. A review of all published breast cancer STAs was undertaken using all publicly available STA documents for each included assessment. Utility scores were assessed for consistency with NICE-preferred methods and original data sources. Furthermore, academic assessment group work undertaken during the STA process was examined to evaluate the emphasis of NICE-preferred quality-of-life measurement methods. Twelve breast cancer STAs were identified, and many STAs used evidence that did not follow NICE's preferred utility score measurement methods. Recent STA submissions show companies using EQ-5D and mapping. Academic assessment groups rarely emphasized NICE-preferred methods, and queries about preferred methods were rare. While there appears to be a trend in recent STA submissions towards following NICE methodological guidance, historically STA guidance in breast cancer has generally not used NICE's preferred methods. Future STAs in breast cancer and reviews of older guidance should ensure that utility measurement methods are consistent with the NICE reference case to help produce consistent, equitable decision making.

WE-B-BRC-01: Current Methodologies in Risk Assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rath, F.

Prospective quality management techniques, long used by engineering and industry, have become a growing aspect of efforts to improve quality management and safety in healthcare. These techniques are of particular interest to medical physics as scope and complexity of clinical practice continue to grow, thus making the prescriptive methods we have used harder to apply and potentially less effective for our interconnected and highly complex healthcare enterprise, especially in imaging and radiation oncology. An essential part of most prospective methods is the need to assess the various risks associated with problems, failures, errors, and design flaws in our systems. Wemore » therefore begin with an overview of risk assessment methodologies used in healthcare and industry and discuss their strengths and weaknesses. The rationale for use of process mapping, failure modes and effects analysis (FMEA) and fault tree analysis (FTA) by TG-100 will be described, as well as suggestions for the way forward. This is followed by discussion of radiation oncology specific risk assessment strategies and issues, including the TG-100 effort to evaluate IMRT and other ways to think about risk in the context of radiotherapy. Incident learning systems, local as well as the ASTRO/AAPM ROILS system, can also be useful in the risk assessment process. Finally, risk in the context of medical imaging will be discussed. Radiation (and other) safety considerations, as well as lack of quality and certainty all contribute to the potential risks associated with suboptimal imaging. The goal of this session is to summarize a wide variety of risk analysis methods and issues to give the medical physicist access to tools which can better define risks (and their importance) which we work to mitigate with both prescriptive and prospective risk-based quality management methods. Learning Objectives: Description of risk assessment methodologies used in healthcare and industry Discussion of radiation oncology-specific risk assessment strategies and issues Evaluation of risk in the context of medical imaging and image quality E. Samei: Research grants from Siemens and GE.« less

DEVELOPMENT OF A MULTIMETRIC INDEX FOR ASSESSING THE BIOLOGICAL CONDITION OF THE OHIO RIVER

EPA Science Inventory

The use of fish communities to assess environmental quality is common for streams, but a standard methodology for large rivers is largely undeveloped. We developed an index to assess the condition of fish assemblages along 1580 km of the Ohio River. Representative samples of th...

Assessing Quality of Critical Thought in Online Discussion

ERIC Educational Resources Information Center

Weltzer-Ward, Lisa; Baltes, Beate; Lynn, Laura Knight

2009-01-01

Purpose: The purpose of this paper is to describe a theoretically based coding framework for an integrated analysis and assessment of critical thinking in online discussion. Design/methodology/approach: The critical thinking assessment framework (TAF) is developed through review of theory and previous research, verified by comparing results to…

Using quality assessment tools to critically appraise ageing research: a guide for clinicians.

PubMed

Harrison, Jennifer Kirsty; Reid, James; Quinn, Terry J; Shenkin, Susan Deborah

2017-05-01

Evidence based medicine tells us that we should not accept published research at face value. Even research from established teams published in the highest impact journals can have methodological flaws, biases and limited generalisability. The critical appraisal of research studies can seem daunting, but tools are available to make the process easier for the non-specialist. Understanding the language and process of quality assessment is essential when considering or conducting research, and is also valuable for all clinicians who use published research to inform their clinical practice.We present a review written specifically for the practising geriatrician. This considers how quality is defined in relation to the methodological conduct and reporting of research. Having established why quality assessment is important, we present and critique tools which are available to standardise quality assessment. We consider five study designs: RCTs, non-randomised studies, observational studies, systematic reviews and diagnostic test accuracy studies. Quality assessment for each of these study designs is illustrated with an example of published cognitive research. The practical applications of the tools are highlighted, with guidance on their strengths and limitations. We signpost educational resources and offer specific advice for use of these tools.We hope that all geriatricians become comfortable with critical appraisal of published research and that use of the tools described in this review - along with awareness of their strengths and limitations - become a part of teaching, journal clubs and practice. © The Author 2016. Published by Oxford University Press on behalf of the British Geriatrics Society.

Interventions to Improve Parental Communication About Sex: A Systematic Review

PubMed Central

Holland, Cynthia L.; Bost, James

2011-01-01

CONTEXT: The relative effectiveness of interventions to improve parental communication with adolescents about sex is not known. OBJECTIVE: To compare the effectiveness and methodologic quality of interventions for improving parental communication with adolescents about sex. METHODS: We searched 6 databases: OVID/Medline, PsychInfo, ERIC, Cochrane Review, Communication and Mass Media, and the Cumulative Index to Nursing and Allied Health Literature. We included studies published between 1980 and July 2010 in peer-reviewed English-language journals that targeted US parents of adolescents aged 11 to 18 years, used an experimental or quasi-experimental design, included a control group, and had a pretest/posttest design. We abstracted data on multiple communication outcomes defined by the integrative conceptual model (communication frequency, content, skills, intentions, self-efficacy, perceived environmental barriers/facilitators, perceived social norms, attitudes, outcome expectations, knowledge, and beliefs). Methodologic quality was assessed using the 11-item methodologic quality score. RESULTS: Twelve studies met inclusion criteria. Compared with controls, parents who participated in these interventions experienced improvements in multiple communication domains including the frequency, quality, intentions, comfort, and self-efficacy for communicating. We noted no effects on parental attitudes toward communicating or the outcomes they expected to occur as a result of communicating. Four studies were of high quality, 7 were of medium quality, and 1 was of lower quality. CONCLUSIONS: Our review was limited by the lack of standardized measures for assessing parental communication. Still, interventions for improving parent-adolescent sex communication are well designed and have some targeted effects. Wider dissemination could augment efforts by schools, clinicians, and health educators. PMID:21321027

Interventions to improve parental communication about sex: a systematic review.

PubMed

Akers, Aletha Y; Holland, Cynthia L; Bost, James

2011-03-01

The relative effectiveness of interventions to improve parental communication with adolescents about sex is not known. To compare the effectiveness and methodologic quality of interventions for improving parental communication with adolescents about sex. We searched 6 databases: OVID/Medline, PsychInfo, ERIC, Cochrane Review, Communication and Mass Media, and the Cumulative Index to Nursing and Allied Health Literature. We included studies published between 1980 and July 2010 in peer-reviewed English-language journals that targeted US parents of adolescents aged 11 to 18 years, used an experimental or quasi-experimental design, included a control group, and had a pretest/posttest design. We abstracted data on multiple communication outcomes defined by the integrative conceptual model (communication frequency, content, skills, intentions, self-efficacy, perceived environmental barriers/facilitators, perceived social norms, attitudes, outcome expectations, knowledge, and beliefs). Methodologic quality was assessed using the 11-item methodologic quality score. Twelve studies met inclusion criteria. Compared with controls, parents who participated in these interventions experienced improvements in multiple communication domains including the frequency, quality, intentions, comfort, and self-efficacy for communicating. We noted no effects on parental attitudes toward communicating or the outcomes they expected to occur as a result of communicating. Four studies were of high quality, 7 were of medium quality, and 1 was of lower quality. Our review was limited by the lack of standardized measures for assessing parental communication. Still, interventions for improving parent-adolescent sex communication are well designed and have some targeted effects. Wider dissemination could augment efforts by schools, clinicians, and health educators.

Physical examination tests for screening and diagnosis of cervicogenic headache: A systematic review.

PubMed

Rubio-Ochoa, J; Benítez-Martínez, J; Lluch, E; Santacruz-Zaragozá, S; Gómez-Contreras, P; Cook, C E

2016-02-01

It has been suggested that differential diagnosis of headaches should consist of a robust subjective examination and a detailed physical examination of the cervical spine. Cervicogenic headache (CGH) is a form of headache that involves referred pain from the neck. To our knowledge, no studies have summarized the reliability and diagnostic accuracy of physical examination tests for CGH. The aim of this study was to summarize the reliability and diagnostic accuracy of physical examination tests used to diagnose CGH. A systematic review following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines was performed in four electronic databases (MEDLINE, Web of Science, Embase and Scopus). Full text reports concerning physical tests for the diagnosis of CGH which reported the clinometric properties for assessment of CGH, were included and screened for methodological quality. Quality Appraisal for Reliability Studies (QAREL) and Quality Assessment of Studies of Diagnostic Accuracy (QUADAS-2) scores were completed to assess article quality. Eight articles were retrieved for quality assessment and data extraction. Studies investigating diagnostic reliability of physical examination tests for CGH scored poorer on methodological quality (higher risk of bias) than those of diagnostic accuracy. There is sufficient evidence showing high levels of reliability and diagnostic accuracy of the selected physical examination tests for the diagnosis of CGH. The cervical flexion-rotation test (CFRT) exhibited both the highest reliability and the strongest diagnostic accuracy for the diagnosis of CGH. Copyright © 2015 Elsevier Ltd. All rights reserved.

Randomized controlled drug trials on very elderly subjects: descriptive and methodological analysis of trials published between 1990 and 2002 and comparison with trials on adults.

PubMed

Le Quintrec, Jean-Laurent; Bussy, Caroline; Golmard, Jean-Louis; Hervé, Christian; Baulon, Alain; Piette, François

2005-03-01

Very elderly subjects (VES; aged 80 years or older) constitute a special population as they frequently present multiple diseases (polypathology). Results from trials on general adult populations therefore cannot be extrapolated to VES. We performed a census of randomized controlled trials (RCT) on VES published between 1990 and 2002, and carried out a descriptive and methodological analysis of these RCT/VES, comparing them with matched RCT on general adult populations (control RCT, RCT/C). We searched for RCT/VES in two international databases (EMBASE and MEDLINE) and then manually. RCT/C were matched to RCT/VES for disease area and year of publication. The methodological quality of each RCT was assessed with Chalmers' scale. We identified 84 RCT/VES, 63 of which were conclusive and 21, inconclusive. Subjects were institutionalized in 48 RCT, and community dwelling in 11 RCT (unspecified in 25 RCT). Efficacy was the main criterion in 75 RCT; tolerance in 9 RCT. Twenty-six RCT were published by geriatrics journals, and 58 by general medical journals. The RCT/VES covered most of the disease areas of geriatrics. The 84 RCT/VES had a mean methodological quality score of 0.578 +/- 0.157. The matched 84 RCT/C had a mean methodological quality score of 0.592 +/- 0.116 (p = .466). The methodological quality score of RCT/VES increased with the number of included subjects (p = .004) and the year of publication (p = .001). The methodological quality of RCT/VES is equivalent to that of RCT in general adult populations. Nevertheless, RCT/VES remain very scarce, and neglect certain diseases. RCT/VES and the inclusion of very elderly subjects in RCT on adults should be strongly encouraged.

Cumulative impact assessment: Application of a methodology

DOE Office of Scientific and Technical Information (OSTI.GOV)

Witmer, G.W.; Bain, M.B.; Irving, J.S.

We expanded upon the Federal Energy Regulatory Commission's (FERC) Cluster Impact Assessment Procedure (CIAP) to provide a practical methodology for assessing potential cumulative impacts from multiple hydroelectric projects within a river basin. The objectives in designing the methodology were to allow the evaluation of a large number of combinations of proposed projects and to minimize constraints on the use of ecological knowledge for planning and regulating hydroelectric development at the river basin level. Interactive workshops and evaluative matrices were used to identify preferred development scenarios in the Snohomish (Washington) and Salmon (Idaho) River Basins. Although the methodology achieved its basicmore » objectives, some difficulties were encountered. These revolved around issues of (1) data quality and quantity, (2) alternatives analysis, (3) determination of project interactions, (4) determination of cumulative impact thresholds, and (5) the use of evaluative techniques to express degrees of impact. 8 refs., 1 fig., 2 tabs.« less

Physical examination tests for the diagnosis of femoroacetabular impingement. A systematic review.

PubMed

Pacheco-Carrillo, Aitana; Medina-Porqueres, Ivan

2016-09-01

Numerous clinical tests have been proposed to diagnose FAI, but little is known about their diagnostic accuracy. To summarize and evaluate research on the accuracy of physical examination tests for diagnosis of FAI. A search of the PubMed, SPORTDiscus and CINAHL databases was performed. Studies were considered eligible if they compared the results of physical examination tests to those of a reference standard. Methodological quality and internal validity assessment was performed by two independent reviewers using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool. The systematic search strategy revealed 298 potential articles, five of which articles met the inclusion criteria. After assessment using the QUADAS score, four of the five articles were of high quality. Clinical tests included were Impingement sign, IROP test (Internal Rotation Over Pressure), FABER test (Flexion-Abduction-External Rotation), Stinchfield/RSRL (Resisted Straight Leg Raise) test, Scour test, Maximal squat test, and the Anterior Impingement test. IROP test, impingement sign, and FABER test showed the most sensitive values to identify FAI. The diagnostic accuracy of physical examination tests to assess FAI is limited due to its heterogenecity. There is a strong need for sound research of high methodological quality in this area. Copyright © 2016 Elsevier Ltd. All rights reserved.

A systematic and transparent approach for assessing the methodological quality of intervention effectiveness research: the Study Design and Implementation Assessment Device (Study DIAD).

PubMed

Valentine, Jeffrey C; Cooper, Harris

2008-06-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of studies. These tools tend to (a) be insufficiently operational, (b) rely on arbitrary post-hoc decision rules, and (c) result in a single number to represent a multidimensional construct. In response to these limitations, a multilevel and hierarchical instrument was developed in consultation with a wide range of methodological and statistical experts. The instrument focuses on the operational details of studies and results in a profile of scores instead of a single score to represent study quality. A pilot test suggested that satisfactory between-judge agreement can be obtained using well-trained raters working in naturalistic conditions. Limitations of the instrument are discussed, but these are inherent in making decisions about study quality given incomplete reporting and in the absence of strong, contextually based information about the effects of design flaws on study outcomes. (PsycINFO Database Record (c) 2008 APA, all rights reserved).

Flight simulator fidelity assessment in a rotorcraft lateral translation maneuver

NASA Technical Reports Server (NTRS)

Hess, R. A.; Malsbury, T.; Atencio, A., Jr.

1992-01-01

A model-based methodology for assessing flight simulator fidelity in closed-loop fashion is exercised in analyzing a rotorcraft low-altitude maneuver for which flight test and simulation results were available. The addition of a handling qualities sensitivity function to a previously developed model-based assessment criteria allows an analytical comparison of both performance and handling qualities between simulation and flight test. Model predictions regarding the existence of simulator fidelity problems are corroborated by experiment. The modeling approach is used to assess analytically the effects of modifying simulator characteristics on simulator fidelity.

Good reasons to implement quality assurance in nationwide breast cancer screening programs in Croatia and Serbia: results from a pilot study.

PubMed

Ciraj-Bjelac, Olivera; Faj, Dario; Stimac, Damir; Kosutic, Dusko; Arandjic, Danijela; Brkic, Hrvoje

2011-04-01

The purpose of this study is to investigate the need for and the possible achievements of a comprehensive QA programme and to look at effects of simple corrective actions on image quality in Croatia and in Serbia. The paper focuses on activities related to the technical and radiological aspects of QA. The methodology consisted of two phases. The aim of the first phase was the initial assessment of mammography practice in terms of image quality, patient dose and equipment performance in selected number of mammography units in Croatia and Serbia. Subsequently, corrective actions were suggested and implemented. Then the same parameters were re-assessed. Most of the suggested corrective actions were simple, low-cost and possible to implement immediately, as these were related to working habits in mammography units, such as film processing and darkroom conditions. It has been demonstrated how simple quantitative assessment of image quality can be used for optimisation purposes. Analysis of image quality parameters as OD, gradient and contrast demonstrated general similarities between mammography practices in Croatia and Serbia. The applied methodology should be expanded to larger number of hospitals and applied on a regular basis. Copyright © 2009 Elsevier Ireland Ltd. All rights reserved.

A methodology to analyze the quality of health information on the internet: the example of diabetic neuropathy.

PubMed

Chumber, Sundeep; Huber, Jörg; Ghezzi, Pietro

2015-02-01

The purpose of this work was to evaluate the criteria used to assess the quality of information on diabetic neuropathy on the Internet. Different search engines (Google, Yahoo, Bing, and Ask) and 1 governmental health website (MedlinePlus) were studied. The websites returned (200 for each search engine) were then classified according to their affiliation (eg, commercial, professional, patient groups). A scoring system was devised from the literature to assess quality of information. Websites were also analyzed using the 2 most widely used instruments for assessing the quality of health information, the Journal of the American Medical Association (JAMA) scoring system and the Health On the Net Foundation (HON) certification. Professional websites or health portals scored better according to most criteria. Google and MedlinePlus returned results scoring significantly higher than other engines in some of the criteria. The use of different instruments gave different results and indicates that the JAMA score and the HON certification may not be sufficient ones. This methodology could be used to evaluate the reliability and trustworthiness of information on the Internet on different topics to identify topic areas or websites where the available information is not appropriate. © 2014 The Author(s).

Using the Malcolm Baldrige "are we making progress" survey for organizational self-assessment and performance improvement.

PubMed

Shields, Judith A; Jennings, Jerry L

2013-01-01

A national healthcare company applied the Malcolm Baldrige Criteria for Performance Excellence and its "Are We Making Progress?" survey as an annual organizational self-assessment to identify areas for improvement. For 6 years, Liberty Healthcare Corporation reviewed the survey results on an annual basis to analyze positive and negative trends, monitor company progress toward targeted goals and develop new initiatives to address emerging areas for improvement. As such, the survey provided a simple and inexpensive methodology to gain useful information from employees at all levels and from multiple service sites and business sectors. In particular, it provided a valuable framework for assessing and improving the employees' commitment to the company's mission and values, high standards and ethics, quality of work, and customer satisfaction. The methodology also helped the company to incorporate the philosophy and principles of continuous quality improvement in a unified fashion. Corporate and local leadership used the same measure to evaluate the performance of individual programs relative to each other, to the company as a whole, and to the "best practices" standard of highly successful companies that received the Malcolm Baldrige National Quality Award. © 2012 National Association for Healthcare Quality.

Integrated care programmes for adults with chronic conditions: a meta-review.

PubMed

Martínez-González, Nahara Anani; Berchtold, Peter; Ullman, Klara; Busato, André; Egger, Matthias

2014-10-01

To review systematic reviews and meta-analyses of integrated care programmes in chronically ill patients, with a focus on methodological quality, elements of integration assessed and effects reported. Meta-review of systematic reviews and meta-analyses identified in Medline (1946-March 2012), Embase (1980-March 2012), CINHAL (1981-March 2012) and the Cochrane Library of Systematic Reviews (issue 1, 2012). Methodological quality assessed by the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) checklist; elements of integration assessed using a published list of 10 key principles of integration; effects on patient-centred outcomes, process quality, use of healthcare and costs. Twenty-seven systematic reviews were identified; conditions included chronic heart failure (CHF; 12 reviews), diabetes mellitus (DM; seven reviews), chronic obstructive pulmonary disease (COPD; seven reviews) and asthma (five reviews). The median number of AMSTAR checklist items met was five: few reviewers searched for unpublished literature or described the primary studies and interventions in detail. Most reviews covered comprehensive services across the care continuum or standardization of care through inter-professional teams, but organizational culture, governance structure or financial management were rarely assessed. A majority of reviews found beneficial effects of integration, including reduced hospital admissions and re-admissions (in CHF and DM), improved adherence to treatment guidelines (DM, COPD and asthma) or quality of life (DM). Few reviews showed reductions in costs. Systematic reviews of integrated care programmes were of mixed quality, assessed only some components of integration of care, and showed consistent benefits for some outcomes but not others. © The Author 2014. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Instruments to assess patients with rotator cuff pathology: a systematic review of measurement properties.

PubMed

Longo, Umile Giuseppe; Saris, Daniël; Poolman, Rudolf W; Berton, Alessandra; Denaro, Vincenzo

2012-10-01

The aims of this study were to obtain an overview of the methodological quality of studies on the measurement properties of rotator cuff questionnaires and to describe how well various aspects of the design and statistical analyses of studies on measurement properties are performed. A systematic review of published studies on the measurement properties of rotator cuff questionnaires was performed. Two investigators independently rated the quality of the studies using the Consensus-based Standards for the selection of health Measurement Instruments checklist. This checklist was developed in an international Delphi consensus study. Sixteen studies were included, in which two measurement instruments were evaluated, namely the Western Ontario Rotator Cuff Index and the Rotator Cuff Quality-of-Life Measure. The methodological quality of the included studies was adequate on some properties (construct validity, reliability, responsiveness, internal consistency, and translation) but need to be improved on other aspects. The most important methodological aspects that need to be developed are as follows: measurement error, content validity, structural validity, cross-cultural validity, criterion validity, and interpretability. Considering the importance of adequate measurement properties, it is concluded that, in the field of rotator cuff pathology, there is room for improvement in the methodological quality of studies measurement properties. II.

Quality indicators for the assessment and management of pain in the emergency department: a systematic review.

PubMed

Stang, Antonia Schirmer; Hartling, Lisa; Fera, Cassandra; Johnson, David; Ali, Samina

2014-01-01

Evidence indicates that pain is undertreated in the emergency department (ED). The first step in improving the pain experience for ED patients is to accurately and systematically assess the actual care being provided. Identifying gaps in the assessment and treatment of pain and improving patient outcomes requires relevant, evidence-based performance measures. To systematically review the literature and identify quality indicators specific to the assessment and management of pain in the ED. Four major bibliographical databases were searched from January 1980 to December 2010, and relevant journals and conference proceedings were manually searched. Original research that described the development or collection of data on one or more quality indicators relevant to the assessment or management of pain in the ED was included. The search identified 18,078 citations. Twenty-three articles were included: 15 observational (cohort) studies; three before-after studies; three audits; one quality indicator development study; and one survey. Methodological quality was moderate, with weaknesses in the reporting of study design and methodology. Twenty unique indicators were identified, with the majority (16 of 20) measuring care processes. Overall, 91% (21 of 23) of the studies reported indicators for the assessment or management of presenting pain, as opposed to procedural pain. Three of the studies included children; however, none of the indicators were developed specifically for a pediatric population. Gaps in the existing literature include a lack of measures reflecting procedural pain, patient outcomes and the pediatric population. Future efforts should focus on developing indicators specific to these key areas.

Combining natural background levels (NBLs) assessment with indicator kriging analysis to improve groundwater quality data interpretation and management.

PubMed

Ducci, Daniela; de Melo, M Teresa Condesso; Preziosi, Elisabetta; Sellerino, Mariangela; Parrone, Daniele; Ribeiro, Luis

2016-11-01

The natural background level (NBL) concept is revisited and combined with indicator kriging method to analyze the spatial distribution of groundwater quality within a groundwater body (GWB). The aim is to provide a methodology to easily identify areas with the same probability of exceeding a given threshold (which may be a groundwater quality criteria, standards, or recommended limits for selected properties and constituents). Three case studies with different hydrogeological settings and located in two countries (Portugal and Italy) are used to derive NBL using the preselection method and validate the proposed methodology illustrating its main advantages over conventional statistical water quality analysis. Indicator kriging analysis was used to create probability maps of the three potential groundwater contaminants. The results clearly indicate the areas within a groundwater body that are potentially contaminated because the concentrations exceed the drinking water standards or even the local NBL, and cannot be justified by geogenic origin. The combined methodology developed facilitates the management of groundwater quality because it allows for the spatial interpretation of NBL values. Copyright © 2016 Elsevier B.V. All rights reserved.

Methodological adequacy of articles published in two open-access Brazilian cardiology periodicals.

PubMed

Macedo, Cristiane Rufino; Silva, Davi Leite da; Puga, Maria Eduarda

2010-01-01

The use of rigorous scientific methods has contributed towards developing scientific articles of excellent methodological quality. This has made it possible to promote their citation and increase the impact factor. Brazilian periodicals have had to adapt to certain quality standards demanded by these indexing organizations, such as the content and the number of original articles published in each issue. This study aimed to evaluate the methodological adequacy of two Brazilian periodicals within the field of cardiology that are indexed in several databases and freely accessible through the Scientific Electronic Library Online (SciELO), and which are now indexed by the Web of Science (Institute for Scientific Information, ISI). Descriptive study at Brazilian Cochrane Center. All the published articles were evaluated according to merit assessment (content) and form assessment (performance). Ninety-six percent of the articles analyzed presented study designs that were adequate for answering the objectives. These two Brazilian periodicals within the field of cardiology published methodologically adequate articles, since they followed the quality standards. Thus, these periodicals can be considered both for consultation and as vehicles for publishing future articles. For further analyses, it is essential to apply other indicators of scientific activity such as bibliometrics, which evaluates quantitative aspects of the production, dissemination and use of information, and scientometrics, which is also concerned with the development of science policies, within which it is often superimposed on bibliometrics.

Surgical interventions for gastric cancer: a review of systematic reviews.

PubMed

He, Weiling; Tu, Jian; Huo, Zijun; Li, Yuhuang; Peng, Jintao; Qiu, Zhenwen; Luo, Dandong; Ke, Zunfu; Chen, Xinlin

2015-01-01

To evaluate methodological quality and the extent of concordance among meta-analysis and/or systematic reviews on surgical interventions for gastric cancer (GC). A comprehensive search of PubMed, Medline, EMBASE, the Cochrane library and the DARE database was conducted to identify the reviews comparing different surgical interventions for GC prior to April 2014. After applying included criteria, available data were summarized and appraised by the Oxman and Guyatt scale. Fifty six reviews were included. Forty five reviews (80.4%) were well conducted, with scores of adapted Oxman and Guyatt scale ≥ 14. The reviews differed in criteria for avoiding bias and assessing the validity of the primary studies. Many primary studies displayed major methodological flaws, such as randomization, allocation concealment, and dropouts and withdrawals. According to the concordance assessment, laparoscopy-assisted gastrectomy (LAG) was superior to open gastrectomy, and laparoscopy-assisted distal gastrectomy was superior to open distal gastrectomy in short-term outcomes. However, the concordance regarding other surgical interventions, such as D1 vs. D2 lymphadenectomy, and robotic gastrectomy vs. LAG were absent. Systematic reviews on surgical interventions for GC displayed relatively high methodological quality. The improvement of methodological quality and reporting was necessary for primary studies. The superiority of laparoscopic over open surgery was demonstrated. But concordance on other surgical interventions was rare, which needed more well-designed RCTs and systematic reviews.

ACSPRI 2014 4th International Social Science Methodology Conference Report

DTIC Science & Technology

2015-04-01

Validity, trustworthiness and rigour: quality and the idea of qualitative research . Journal of Advanced Nursing, 304-310. Spencer, L., Ritchie, J...increasing data quality; the Total Survey Error framework; multi-modal on-line surveying, quality frameworks for assessing qualitative research ; and...provided an overview of the current perspectives on causal claims in qualitative research . Three approaches to generating plausible causal

Telephone-quality pathological speech classification using empirical mode decomposition.

PubMed

Kaleem, M F; Ghoraani, B; Guergachi, A; Krishnan, S

2011-01-01

This paper presents a computationally simple and effective methodology based on empirical mode decomposition (EMD) for classification of telephone quality normal and pathological speech signals. EMD is used to decompose continuous normal and pathological speech signals into intrinsic mode functions, which are analyzed to extract physically meaningful and unique temporal and spectral features. Using continuous speech samples from a database of 51 normal and 161 pathological speakers, which has been modified to simulate telephone quality speech under different levels of noise, a linear classifier is used with the feature vector thus obtained to obtain a high classification accuracy, thereby demonstrating the effectiveness of the methodology. The classification accuracy reported in this paper (89.7% for signal-to-noise ratio 30 dB) is a significant improvement over previously reported results for the same task, and demonstrates the utility of our methodology for cost-effective remote voice pathology assessment over telephone channels.

Development and Application of Health-Based Screening Levels for Use in Water-Quality Assessments

USGS Publications Warehouse

Toccalino, Patricia L.

2007-01-01

Health-Based Screening Levels (HBSLs) are non-enforceable water-quality benchmarks that were developed by the U.S. Geological Survey in collaboration with the U.S. Environmental Protection Agency (USEPA) and others. HBSLs supplement existing Federal drinking-water standards and guidelines, thereby providing a basis for a more comprehensive evaluation of contaminant-occurrence data in the context of human health. Since the original methodology used to calculate HBSLs for unregulated contaminants was published in 2003, revisions have been made to the HBSL methodology in order to reflect updates to relevant USEPA policies. These revisions allow for the use of the most recent, USEPA peer-reviewed, publicly available human-health toxicity information in the development of HBSLs. This report summarizes the revisions to the HBSL methodology for unregulated contaminants, and updates the guidance on the use of HBSLs for interpreting water-quality data in the context of human health.

[Shoulder disability questionnaires: a systematic review].

PubMed

Fayad, F; Mace, Y; Lefevre-Colau, M M

2005-07-01

To identify all available shoulder disability questionnaires designed to measure physical functioning and to examine those with satisfactory clinimetric quality. We used the Medline database and the "Guide des outils de mesure de l'évaluation en médecine physique et de réadaptation" textbook to search for questionnaires. Analysis took into account the development methodology, clinimetric quality of the instruments and frequency of their utilization. We classified the instruments according to the International Classification of Functioning, Disability and Health. Thirty-eight instruments have been developed to measure disease-, shoulder- or upper extremity-specific outcome. Four scales assess upper-extremity disability and 3 others shoulder disability. We found 6 scales evaluating disability and shoulder pain, 7 scales measuring the quality of life in patients with various conditions of the shoulder, 14 scales combining objective and subjective measures, 2 pain scales and 2 unclassified scales. Older instruments developed before the advent of modern measurement development methodology usually combine objective and subjective measures. Recent instruments were designed with appropriate methodology. Most are self-administered questionnaires. Numerous shoulder outcome measure instruments are available. There is no "gold standard" for assessing shoulder function outcome in the general population.

Poor methodological quality and reporting standards of systematic reviews in burn care management.

PubMed

Wasiak, Jason; Tyack, Zephanie; Ware, Robert; Goodwin, Nicholas; Faggion, Clovis M

2017-10-01

The methodological and reporting quality of burn-specific systematic reviews has not been established. The aim of this study was to evaluate the methodological quality of systematic reviews in burn care management. Computerised searches were performed in Ovid MEDLINE, Ovid EMBASE and The Cochrane Library through to February 2016 for systematic reviews relevant to burn care using medical subject and free-text terms such as 'burn', 'systematic review' or 'meta-analysis'. Additional studies were identified by hand-searching five discipline-specific journals. Two authors independently screened papers, extracted and evaluated methodological quality using the 11-item A Measurement Tool to Assess Systematic Reviews (AMSTAR) tool and reporting quality using the 27-item Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist. Characteristics of systematic reviews associated with methodological and reporting quality were identified. Descriptive statistics and linear regression identified features associated with improved methodological quality. A total of 60 systematic reviews met the inclusion criteria. Six of the 11 AMSTAR items reporting on 'a priori' design, duplicate study selection, grey literature, included/excluded studies, publication bias and conflict of interest were reported in less than 50% of the systematic reviews. Of the 27 items listed for PRISMA, 13 items reporting on introduction, methods, results and the discussion were addressed in less than 50% of systematic reviews. Multivariable analyses showed that systematic reviews associated with higher methodological or reporting quality incorporated a meta-analysis (AMSTAR regression coefficient 2.1; 95% CI: 1.1, 3.1; PRISMA regression coefficient 6·3; 95% CI: 3·8, 8·7) were published in the Cochrane library (AMSTAR regression coefficient 2·9; 95% CI: 1·6, 4·2; PRISMA regression coefficient 6·1; 95% CI: 3·1, 9·2) and included a randomised control trial (AMSTAR regression coefficient 1·4; 95%CI: 0·4, 2·4; PRISMA regression coefficient 3·4; 95% CI: 0·9, 5·8). The methodological and reporting quality of systematic reviews in burn care requires further improvement with stricter adherence by authors to the PRISMA checklist and AMSTAR tool. © 2016 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

Assessing New Employee Orientation Programs

ERIC Educational Resources Information Center

Acevedo, Jose M.; Yancey, George B.

2011-01-01

Purpose: This paper aims to examine the importance of new employee orientation (NEO) programs, the quality of typical NEOs, and how to improve NEOs. Design/methodology/approach: The paper provides a viewpoint of the importance of new employee orientation programs, the quality of typical NEOs, and how to improve NEOs. Findings: Although western…

How best to assess quality of life in informal carers of people with dementia; A systematic review of existing outcome measures

PubMed Central

Robinson, Jonah; Robalino, Shannon; Finch, Tracy; McColl, Elaine

2018-01-01

Background In the UK, there are currently 800 000 people living with dementia. This number is expected to double in the next 20 years. Two-thirds of people with dementia live in the community supported by informal carers. Caring for a person with dementia has adverse effects on psychological, physical, social wellbeing and quality of life. The measurement of quality of life of carers of people with dementia is increasingly of interest to health and social care practitioners and commissioners, policymakers, and carers themselves. However, there is lack of consensus on the most suitable instrument(s) for undertaking this. Methods A systematic review of the literature using COSMIN methodology. Searching of electronic databases (Medline, PsycINFO, CINAHL and Web of Science), reference list and citation searching of key papers was undertaken. COSMIN methodology was used to simultaneously extract data from and assess methodological quality of included studies, and make a recommendation for the instrument with the most high quality evidence for its measurement properties. Results Ten instruments were suitable for inclusion in this review. The Carer well-being and support questionnaire (CWS) has the best quality evidence for the greatest number of measurement of properties. The Caregiver Well-Being Scale is also worthy of consideration. There is not presently a measure which could be recommended for use in economic evaluations, however the Impact of Alzheimer’s Disease on the Caregiver questionnaire (IADCQ) could potentially be used following further investigation of its measurement properties in a representative population. Conclusion The CWS is the most appropriate instrument to recommend for the assessment of quality of life in informal carers of people with dementia at present. All instruments included in this review would benefit from more rigorous evaluation of their measurement properties. PMID:29538433

The health-nutrition dimension: a methodological approach to assess the nutritional sustainability of typical agro-food products and the Mediterranean diet.

PubMed

Azzini, Elena; Maiani, Giuseppe; Turrini, Aida; Intorre, Federica; Lo Feudo, Gabriella; Capone, Roberto; Bottalico, Francesco; El Bilali, Hamid; Polito, Angela

2018-08-01

The aim of this paper is to provide a methodological approach to evaluate the nutritional sustainability of typical agro-food products, representing Mediterranean eating habits and included in the Mediterranean food pyramid. For each group of foods, suitable and easily measurable indicators were identified. Two macro-indicators were used to assess the nutritional sustainability of each product. The first macro-indicator, called 'business distinctiveness', takes into account the application of different regulations and standards regarding quality, safety and traceability as well as the origin of raw materials. The second macro-indicator, called 'nutritional quality', assesses product nutritional quality taking into account the contents of key compounds including micronutrients and bioactive phytochemicals. For each indicator a 0-10 scoring system was set up, with scores from 0 (unsustainable) to 10 (very sustainable), with 5 as a sustainability benchmark value. The benchmark value is the value from which a product can be considered sustainable. A simple formula was developed to produce a sustainability index. The proposed sustainability index could be considered a useful tool to describe both the qualitative and quantitative value of micronutrients and bioactive phytochemical present in foodstuffs. This methodological approach can also be applied beyond the Mediterranean, to food products in other world regions. © 2018 Society of Chemical Industry. © 2018 Society of Chemical Industry.

Methodological quality of randomised controlled trials in burns care. A systematic review.

PubMed

Danilla, Stefan; Wasiak, Jason; Searle, Susana; Arriagada, Cristian; Pedreros, Cesar; Cleland, Heather; Spinks, Anneliese

2009-11-01

To evaluate the methodological quality of published randomised controlled trials (RCTs) in burn care treatment and management. Using a predetermined search strategy we searched Ovid MEDLINE (1950 to January 2008) database to identify all English RCTs related to burn care. Full text studies identified were reviewed for key demographic and methodological characteristics. Methodological trial quality was assessed using the Jadad scale. A total of 257 studies involving 14,535 patients met the inclusion criteria. The median Jadad score was 2 (out of a best possible score of 5). Information was given in the introduction and discussion sections of most RCTs, although insufficient detail was provided on randomisation, allocation concealment, and blinding. The number of RCTs increased between 1950 and 2008 (Spearman's rho=0.6129, P<0.001), although the reporting quality did not improve over the same time period (P=0.1896) and was better in RCTs with larger sample sizes (median Jadad score, 4 vs. 2 points, P<0.0001). Methodological quality did not correlate with journal impact factor (P=0.2371). The reporting standards of RCTs are highly variable and less than optimal in most cases. The advent of evidence-based medicine heralds a new approach to burns care and systematic steps are needed to improve the quality of RCTs in this field. Identifying and reviewing the existing number of RCTs not only highlights the need for burn clinicians to conduct more trials, but may also encourage burn health clinicians to consider the importance of conducting trials that follow appropriate, evidence-based standards.

Systematic reviews addressing microsurgical head and neck reconstruction.

PubMed

Momeni, Arash; Jacobson, Joshua Y; Lee, Gordon K

2015-01-01

Systematic reviews frequently form the basis for clinical decision making and guideline development. Yet, the quality of systematic reviews has been variable, thus raising concerns about the validity of their conclusions. In the current study, a quality analysis of systematic reviews was performed, addressing microsurgical head and neck reconstruction. A PubMed search was performed to identify all systematic reviews published up to and including December 2012 in 12 surgical journals. Two authors independently reviewed the literature and extracted data from the included reviews. Discrepancies were resolved by consensus. Quality assessment was performed using AMSTAR. The initial search retrieved 1020 articles. After screening titles and abstracts, 987 articles were excluded. Full-text review of the remaining 33 articles resulted in further exclusion of 18 articles, leaving 15 systematic reviews for final analysis. A marked increase in the number of published systematic reviews over time was noted (P = 0.07). The median AMSTAR score was 5, thus reflecting a "fair" quality. No evidence for improvement in methodological quality over time was noted. The trend to publish more systematic reviews in microsurgical head and neck reconstruction is encouraging. However, efforts are indicated to improve the methodological quality of systematic reviews. Familiarity with criteria of methodological quality is critical to ensure future improvements in the quality of systematic reviews conducted in microsurgery.

A methodology for overall consequence modeling in chemical industry.

PubMed

Arunraj, N S; Maiti, J

2009-09-30

Risk assessment in chemical process industry is a very important issue for safeguarding human and the ecosystem from damages caused to them. Consequence assessment is an integral part of risk assessment. However, the commonly used consequence estimation methods involve time-consuming complex mathematical models and simple assimilation of losses without considering all the consequence factors. This lead to the deterioration of quality of estimated risk value. So, the consequence modeling has to be performed in detail considering all major losses with optimal time to improve the decisive value of risk. The losses can be broadly categorized into production loss, assets loss, human health and safety loss, and environment loss. In this paper, a conceptual framework is developed to assess the overall consequence considering all the important components of major losses. Secondly, a methodology is developed for the calculation of all the major losses, which are normalized to yield the overall consequence. Finally, as an illustration, the proposed methodology is applied to a case study plant involving benzene extraction. The case study result using the proposed consequence assessment scheme is compared with that from the existing methodologies.

Providing Doctors With High-Quality Information: An Updated Evaluation of Web-Based Point-of-Care Information Summaries

PubMed Central

Kwag, Koren Hyogene; González-Lorenzo, Marien; Banzi, Rita; Bonovas, Stefanos

2016-01-01

Background The complexity of modern practice requires health professionals to be active information-seekers. Objective Our aim was to review the quality and progress of point-of-care information summaries—Web-based medical compendia that are specifically designed to deliver pre-digested, rapidly accessible, comprehensive, and periodically updated information to health care providers. We aimed to evaluate product claims of being evidence-based. Methods We updated our previous evaluations by searching Medline, Google, librarian association websites, and conference proceedings from August 2012 to December 2014. We included Web-based, regularly updated point-of-care information summaries with claims of being evidence-based. We extracted data on the general characteristics and content presentation of products, and we quantitatively assessed their breadth of disease coverage, editorial quality, and evidence-based methodology. We assessed potential relationships between these dimensions and compared them with our 2008 assessment. Results We screened 58 products; 26 met our inclusion criteria. Nearly a quarter (6/26, 23%) were newly identified in 2014. We accessed and analyzed 23 products for content presentation and quantitative dimensions. Most summaries were developed by major publishers in the United States and the United Kingdom; no products derived from low- and middle-income countries. The main target audience remained physicians, although nurses and physiotherapists were increasingly represented. Best Practice, Dynamed, and UptoDate scored the highest across all dimensions. The majority of products did not excel across all dimensions: we found only a moderate positive correlation between editorial quality and evidence-based methodology (r=.41, P=.0496). However, all dimensions improved from 2008: editorial quality (P=.01), evidence-based methodology (P=.015), and volume of diseases and medical conditions (P<.001). Conclusions Medical and scientific publishers are investing substantial resources towards the development and maintenance of point-of-care summaries. The number of these products has increased since 2008 along with their quality. Best Practice, Dynamed, and UptoDate scored the highest across all dimensions, while others that were marketed as evidence-based were less reliable. Individuals and institutions should regularly assess the value of point-of-care summaries as their quality changes rapidly over time. PMID:26786976

Providing Doctors With High-Quality Information: An Updated Evaluation of Web-Based Point-of-Care Information Summaries.

PubMed

Kwag, Koren Hyogene; González-Lorenzo, Marien; Banzi, Rita; Bonovas, Stefanos; Moja, Lorenzo

2016-01-19

The complexity of modern practice requires health professionals to be active information-seekers. Our aim was to review the quality and progress of point-of-care information summaries-Web-based medical compendia that are specifically designed to deliver pre-digested, rapidly accessible, comprehensive, and periodically updated information to health care providers. We aimed to evaluate product claims of being evidence-based. We updated our previous evaluations by searching Medline, Google, librarian association websites, and conference proceedings from August 2012 to December 2014. We included Web-based, regularly updated point-of-care information summaries with claims of being evidence-based. We extracted data on the general characteristics and content presentation of products, and we quantitatively assessed their breadth of disease coverage, editorial quality, and evidence-based methodology. We assessed potential relationships between these dimensions and compared them with our 2008 assessment. We screened 58 products; 26 met our inclusion criteria. Nearly a quarter (6/26, 23%) were newly identified in 2014. We accessed and analyzed 23 products for content presentation and quantitative dimensions. Most summaries were developed by major publishers in the United States and the United Kingdom; no products derived from low- and middle-income countries. The main target audience remained physicians, although nurses and physiotherapists were increasingly represented. Best Practice, Dynamed, and UptoDate scored the highest across all dimensions. The majority of products did not excel across all dimensions: we found only a moderate positive correlation between editorial quality and evidence-based methodology (r=.41, P=.0496). However, all dimensions improved from 2008: editorial quality (P=.01), evidence-based methodology (P=.015), and volume of diseases and medical conditions (P<.001). Medical and scientific publishers are investing substantial resources towards the development and maintenance of point-of-care summaries. The number of these products has increased since 2008 along with their quality. Best Practice, Dynamed, and UptoDate scored the highest across all dimensions, while others that were marketed as evidence-based were less reliable. Individuals and institutions should regularly assess the value of point-of-care summaries as their quality changes rapidly over time.

Scoping review of pediatric tonsillectomy quality of life assessment instruments.

PubMed

Kao, Stephen Shih-Teng; Peters, Micah D J; Dharmawardana, Nuwan; Stew, Benjamin; Ooi, Eng Hooi

2017-10-01

Sleep-disordered breathing or recurrent tonsillitis have detrimental effects on the child's physical health and quality of life. Tonsillectomy is commonly performed to treat these common conditions and improve the child's quality of life. This scoping review aims to present a comprehensive and descriptive analysis of quality of life questionnaires as a resource for clinicians and researchers when deciding which tool to use when assessing the quality of life effects after tonsillectomy. A comprehensive search strategy was undertaken across MEDLINE (PubMed), CINAHL, Embase, and Cochrane CENTRAL. Quality of life questionnaires utilized in studies investigating pediatric patients undergoing tonsillectomy for chronic tonsillitis or sleep-disordered breathing were included. Methodological quality and data extraction were conducted as per Joanna Briggs Institute methodology. Ten questionnaires were identified, consisting of six generic and four disease-specific instruments. The Pediatric Quality of Life Inventory was the most commonly utilized generic questionnaire. The Obstructive Sleep Apnea-18 was the most commonly utilized disease-specific questionnaire. This review identified a range of generic and disease-specific quality of life questionnaires utilized in pediatric patients who have undergone tonsillectomy with or without adenoidectomy for sleep-disordered breathing or chronic tonsillitis. Important aspects of each questionnaire have been summarized to aid researchers and clinicians in choosing the appropriate questionnaire when evaluating the quality of life effects of tonsillectomy. NA Laryngoscope, 127:2399-2406, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Sugar-Sweetened Beverages and Obesity Risk in Children and Adolescents: A Systematic Analysis on How Methodological Quality May Influence Conclusions.

PubMed

Bucher Della Torre, Sophie; Keller, Amélie; Laure Depeyre, Jocelyne; Kruseman, Maaike

2016-04-01

In the context of a worldwide high prevalence of childhood obesity, the role of sugar-sweetened beverage (SSB) consumption as a cause of excess weight gain remains controversial. Conflicting results may be due to methodological issues in original studies and in reviews. The aim of this review was to systematically analyze the methodology of studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents, and the studies' ability to answer this research question. A systematic review of cohort and experimental studies published until December 2013 in peer-reviewed journals was performed on Medline, CINAHL, Web of Knowledge, and ClinicalTrials.gov. Studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents were included, and methodological quality to answer this question was assessed independently by two investigators using the Academy of Nutrition and Dietetics Quality Criteria Checklist. Among the 32 identified studies, nine had positive quality ratings and 23 studies had at least one major methodological issue. Main methodological issues included SSB definition and inadequate measurement of exposure. Studies with positive quality ratings found an association between SSB consumption and risk of obesity or obesity (n=5) (ie, when SSB consumption increased so did obesity) or mixed results (n=4). Studies with a neutral quality rating found a positive association (n=7), mixed results (n=9), or no association (n=7). The present review shows that the majority of studies with strong methodology indicated a positive association between SSB consumption and risk of obesity or obesity, especially among overweight children. In addition, study findings highlight the need for the careful and precise measurement of the consumption of SSBs and of important confounders. Copyright © 2016 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Systematic Review of Integrative Health Care Research: Randomized Control Trials, Clinical Controlled Trials, and Meta-Analysis

PubMed Central

Khorsan, Raheleh; Coulter, Ian D.; Crawford, Cindy; Hsiao, An-Fu

2011-01-01

A systematic review was conducted to assess the level of evidence for integrative health care research. We searched PubMed, Allied and Complementary Medicine (AMED), BIOSIS Previews, EMBASE, the entire Cochrane Library, MANTIS, Social SciSearch, SciSearch Cited Ref Sci, PsychInfo, CINAHL, and NCCAM grantee publications listings, from database inception to May 2009, as well as searches of the “gray literature.” Available studies published in English language were included. Three independent reviewers rated each article and assessed the methodological quality of studies using the Scottish Intercollegiate Guidelines Network (SIGN 50). Our search yielded 11,891 total citations but 6 clinical studies, including 4 randomized, met our inclusion criteria. There are no available systematic reviews/meta-analyses published that met our inclusion criteria. The methodological quality of the included studies was assessed independently using quality checklists of the SIGN 50. Only a small number of RCTs and CCTs with a limited number of patients and lack of adequate control groups assessing integrative health care research are available. These studies provide limited evidence of effective integrative health care on some modalities. However, integrative health care regimen appears to be generally safe. PMID:20953383

Fidelity assessment of a UH-60A simulation on the NASA Ames vertical motion simulator

NASA Technical Reports Server (NTRS)

Atencio, Adolph, Jr.

1993-01-01

Helicopter handling qualities research requires that a ground-based simulation be a high-fidelity representation of the actual helicopter, especially over the frequency range of the investigation. This experiment was performed to assess the current capability to simulate the UH-60A Black Hawk helicopter on the Vertical Motion Simulator (VMS) at NASA Ames, to develop a methodology for assessing the fidelity of a simulation, and to find the causes for lack of fidelity. The approach used was to compare the simulation to the flight vehicle for a series of tasks performed in flight and in the simulator. The results show that subjective handling qualities ratings from flight to simulator overlap, and the mathematical model matches the UH-60A helicopter very well over the range of frequencies critical to handling qualities evaluation. Pilot comments, however, indicate a need for improvement in the perceptual fidelity of the simulation in the areas of motion and visual cuing. The methodology used to make the fidelity assessment proved useful in showing differences in pilot work load and strategy, but additional work is needed to refine objective methods for determining causes of lack of fidelity.

Air quality impact assessment of at-berth ship emissions: Case-study for the project of a new freight port.

PubMed

Lonati, Giovanni; Cernuschi, Stefano; Sidi, Shelina

2010-12-01

This work is intended to assess the impact on local air quality due to atmospheric emissions from port area activities for a new port in project in the Mediterranean Sea. The sources of air pollutants in the harbour area are auxiliary engines used by ships at berth during loading/offloading operations. A fleet activity-based methodology is first applied to evaluate annual pollutant emissions (NO(X), SO(X), PM, CO and VOC) based on vessel traffic data, ships tonnage and in-port hotelling time for loading/offloading operations. The 3-dimensional Calpuff transport and dispersion model is then applied for the subsequent assessment of the ground level spatial distribution of atmospheric pollutants for both long-term and short-term averaging times. Compliance with current air quality standards in the port area is finally evaluated and indications for port operation are provided. Some methodological aspects of the impact assessment procedure, namely those concerning the steps of emission scenario definitions and model simulations set-up at the project stage, are specifically addressed, suggesting a pragmatic approach for similar evaluations for small new ports in project. Copyright © 2010 Elsevier B.V. All rights reserved.

Assessing Aircraft Susceptibility to Nonlinear Aircraft-Pilot Coupling/Pilot-Induced Oscillations

NASA Technical Reports Server (NTRS)

Hess, R.A.; Stout, P. W.

1997-01-01

A unified approach for assessing aircraft susceptibility to aircraft-pilot coupling (or pilot-induced oscillations) which was previously reported in the literature and applied to linear systems is extended to nonlinear systems, with emphasis upon vehicles with actuator rate saturation. The linear methodology provided a tool for predicting: (1) handling qualities levels, (2) pilot-induced oscillation rating levels and (3) a frequency range in which pilot-induced oscillations are likely to occur. The extension to nonlinear systems provides a methodology for predicting the latter two quantities. Eight examples are presented to illustrate the use of the technique. The dearth of experimental flight-test data involving systematic variation and assessment of the effects of actuator rate limits presently prevents a more thorough evaluation of the methodology.

Rapid evidence assessment: increasing the transparency of an emerging methodology.

PubMed

Varker, Tracey; Forbes, David; Dell, Lisa; Weston, Adele; Merlin, Tracy; Hodson, Stephanie; O'Donnell, Meaghan

2015-12-01

Within the field of evidence-based practice, policy makers, health care professionals and consumers require timely reviews to inform decisions on efficacious health care and treatments. Rapid evidence assessment (REA), also known as rapid review, has emerged in recent years as a literature review methodology that fulfils this need. It highlights what is known in a clinical area to the target audience in a relatively short time frame. This article discusses the lack of transparency and limited critical appraisal that can occur in REA, and goes on to propose general principles for conducting a REA. The approach that we describe is consistent with the principles underlying systematic review methodology, but also makes allowances for the rapid delivery of information as required while utilizing explicit and reproducible methods at each stage. Our method for conducting REA includes: developing an explicit research question in consultation with the end-users; clear definition of the components of the research question; development of a thorough and reproducible search strategy; development of explicit evidence selection criteria; and quality assessments and transparent decisions about the level of information to be obtained from each study. In addition, the REA may also include an assessment of the quality of the total body of evidence. Transparent reporting of REA methodologies will provide greater clarity to end-users about how the information is obtained and about the trade-offs that are made between speed and rigour. © 2015 John Wiley & Sons, Ltd.

Systematic review of the methodological and reporting quality of case series in surgery.

PubMed

Agha, R A; Fowler, A J; Lee, S-Y; Gundogan, B; Whitehurst, K; Sagoo, H K; Jeong, K J L; Altman, D G; Orgill, D P

2016-09-01

Case series are an important and common study type. No guideline exists for reporting case series and there is evidence of key data being missed from such reports. The first step in the process of developing a methodologically sound reporting guideline is a systematic review of literature relevant to the reporting deficiencies of case series. A systematic review of methodological and reporting quality in surgical case series was performed. The electronic search strategy was developed by an information specialist and included MEDLINE, Embase, Cochrane Methods Register, Science Citation Index and Conference Proceedings Citation index, from the start of indexing to 5 November 2014. Independent screening, eligibility assessments and data extraction were performed. Included articles were then analysed for five areas of deficiency: failure to use standardized definitions, missing or selective data (including the omission of whole cases or important variables), transparency or incomplete reporting, whether alternative study designs were considered, and other issues. Database searching identified 2205 records. Through the process of screening and eligibility assessments, 92 articles met inclusion criteria. Frequencies of methodological and reporting issues identified were: failure to use standardized definitions (57 per cent), missing or selective data (66 per cent), transparency or incomplete reporting (70 per cent), whether alternative study designs were considered (11 per cent) and other issues (52 per cent). The methodological and reporting quality of surgical case series needs improvement. The data indicate that evidence-based guidelines for the conduct and reporting of case series may be useful. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

A Narrative Review of High-Quality Literature on the Effects of Resident Duty Hours Reforms.

PubMed

Lin, Henry; Lin, Emery; Auditore, Stephanie; Fanning, Jon

2016-01-01

To summarize current high-quality studies evaluating the effect and efficacy of resident duty hours reforms (DHRs) on patient safety and resident education and well-being. The authors searched PubMed and Medline in August 2012 and again in May 2013 for literature (1987-2013) about the effects of DHRs. They assessed the quality of articles using the Medical Education Research Study Quality Instrument (MERSQI) scoring system. They considered randomized controlled trials (RCTs), partial RCTs, and all studies with a MERSQI score ≥ 14 to be "high-quality" methodology studies. A total of 72 high-quality studies met inclusion criteria. Most studies showed no change or slight improvement in mortality and complication rates after DHRs. Resident well-being was generally improved, but there was a perceived negative impact on education (knowledge acquisition, skills, and cognitive performance) following DHRs. Eleven high-quality studies assessed the impact of DHR interventions; all reported a neutral to positive impact. Seven high-quality studies assessed costs associated with DHRs and demonstrated an increase in hospital costs. The results of most studies that allow enough time for DHR interventions to take effect suggest a benefit to patient safety and resident well-being, but the effect on the quality of training remains unknown. Additional methodologically sound studies on the impact of DHRs are necessary. Priorities for future research include approaches to optimizing education and clinical proficiency and studies on the effect of intervention strategies on both education and patient safety. Such studies will provide additional information to help improve duty hours policies.

Cross-cultural adaptation and measurement properties of generic and cancer-related patient-reported outcome measures (PROMs) for use with cancer patients in Brazil: a systematic review.

PubMed

Albach, Carlos Augusto; Wagland, Richard; Hunt, Katherine J

2018-04-01

This systematic review (1) identifies the current generic and cancer-related patient-reported outcome measures (PROMs) that have been cross-culturally adapted to Brazilian Portuguese and applied to cancer patients and (2) critically evaluates their cross-cultural adaptation (CCA) and measurement properties. Seven databases were searched for articles regarding the translation and evaluation of measurement properties of generic and cancer-related PROMs cross-culturally adapted to Brazilian Portuguese that are applied in adult (≥18 years old) cancer patients. The methodological quality of included studies was assessed using the COSMIN checklist. The bibliographic search retrieved 1674 hits, of which seven studies analysing eight instruments were included in this review. Data on the interpretability of scores were poorly reported. Overall, the quality of the CCA process was inconsistent throughout the studies. None of the included studies performed a cross-cultural validation. The evidence concerning the quality of measurement properties is limited by poor or fair methodological quality. Moreover, limited information regarding measurement properties was provided within the included papers. This review aids the selection process of Brazilian Portuguese PROMs for use in cancer patients. After acknowledging the methodological caveats and strengths of each tool, our opinion is that for quality of life and symptoms assessment the adapted FACT-G version and the ESAS could be recommended, respectively. Future research should rely on the already accepted standards of CCA and validation studies.

Mobile and Web 2.0 interventions for weight management: an overview of review evidence and its methodological quality

PubMed Central

Smith, Jane R.; Samaha, Laya; Abraham, Charles

2016-01-01

Abstract Background : The use of Internet and related technologies for promoting weight management (WM), physical activity (PA), or dietary-related behaviours has been examined in many articles and systematic reviews. This overview aims to summarize and assess the quality of the review evidence specifically focusing on mobile and Web 2.0 technologies, which are the most utilized, currently available technologies. Methods: Following a registered protocol (CRD42014010323), we searched 16 databases for articles published in English until 31 December 2014 discussing the use of either mobile or Web 2.0 technologies to promote WM or related behaviors, i.e. diet and physical activity (PA). Two reviewers independently selected reviews and assessed their methodological quality using the AMSTAR checklist. Citation matrices were used to determine the overlap among reviews. Results: Forty-four eligible reviews were identified, 39 of which evaluated the effects of interventions using mobile or Web 2.0 technologies. Methodological quality was generally low with only 7 reviews (16%) meeting the highest standards. Suggestive evidence exists for positive effects of mobile technologies on weight-related outcomes and, to a lesser extent, PA. Evidence is inconclusive regarding Web 2.0 technologies. Conclusions : Reviews on mobile and Web 2.0 interventions for WM and related behaviors suggest that these technologies can, under certain circumstances, be effective, but conclusions are limited by poor review quality based on a heterogeneous evidence base. PMID:27335330

Are validated outcome measures used in distal radial fractures truly valid?

PubMed Central

Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

2016-01-01

Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the validity on hypothesis testing are good. There is no evidence for the other measurement properties. Conclusion According to this systematic review, there is, at best, moderate evidence that the responsiveness of the PRWE and DASH are good, as are the reliability and validity of the PRWE. We recommend these PROMs in clinical studies in patients with distal radial fractures; however, more clinimetric studies of higher methodological quality are needed to adequately determine the other measurement properties. Cite this article: Dr Y. V. Kleinlugtenbelt. Are validated outcome measures used in distal radial fractures truly valid?: A critical assessment using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Bone Joint Res 2016;5:153–161. DOI: 10.1302/2046-3758.54.2000462. PMID:27132246

Systematic Review of Measurement Property Evidence for 8 Financial Management Instruments in Populations With Acquired Cognitive Impairment.

PubMed

Engel, Lisa; Chui, Adora; Beaton, Dorcas E; Green, Robin E; Dawson, Deirdre R

2018-03-07

To critically appraise the measurement property evidence (ie, psychometric) for 8 observation-based financial management assessment instruments. Seven databases were searched in May 2015. Two reviewers used an independent decision-agreement process to select studies of measurement property evidence relevant to populations with adulthood acquired cognitive impairment, appraise the quality of the evidence, and extract data. Twenty-one articles were selected. This review used the COnsensus-based Standards for the selection of health Measurement Instruments review guidelines and 4-point tool to appraise evidence. After appraising the methodologic quality, the adequacy of results and volume of evidence per instrument were synthesized. Measurement property evidence with high risk of bias was excluded from the synthesis. The volume of measurement property evidence per instrument is low; most instruments had 1 to 3 included studies. Many included studies had poor methodologic quality per measurement property evidence area examined. Six of the 8 instruments reviewed had supporting construct validity/hypothesis-testing evidence of fair methodologic quality. There is a dearth of acceptable quality content validity, reliability, and responsiveness evidence for all 8 instruments. Rehabilitation practitioners assess financial management functions in adults with acquired cognitive impairments. However, there is limited published evidence to support using any of the reviewed instruments. Practitioners should exercise caution when interpreting the results of these instruments. This review highlights the importance of appraising the quality of measurement property evidence before examining the adequacy of the results and synthesizing the evidence. Copyright © 2018 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Acupuncture and moxibustion for lateral elbow pain: a systematic review of randomized controlled trials

PubMed Central

2014-01-01

Background Acupuncture and moxibustion have widely been used to treat lateral elbow pain (LEP). A comprehensive systematic review of randomized controlled trials (RCTs) including both English and Chinese databases was conducted to assess the efficacy of acupuncture and moxibustion in the treatment of LEP. Methods Revised STRICTA (2010) criteria were used to appraise the acupuncture procedures, the Cochrane risk of bias tool was used to assess the methodological quality of the studies. A total of 19 RCTs that compared acupuncture and/or moxibustion with sham acupuncture, another form of acupuncture, or conventional treatment were included. Results All studies had at least one domain rated as high risk or uncertain risk of bias in the Cochrane risk of bias tool. Results from three RCTs of moderate quality showed that acupuncture was more effective than sham acupuncture. Results from 10 RCTs of mostly low quality showed that acupuncture or moxibustion was superior or equal to conventional treatment, such as local anesthetic injection, local steroid injection, non-steroidal anti- inflammatory drugs, or ultrasound. There were six low quality RCTs that compared acupuncture and moxibustion combined with manual acupuncture alone, and all showed that acupuncture and moxibustion combined was superior to manual acupuncture alone. Conclusion Moderate quality studies suggest that acupuncture is more effective than sham acupuncture. Interpretations of findings regarding acupuncture vs. conventional treatment, and acupuncture and moxibustion combined vs. manual acupuncture alone are limited by the methodological qualities of these studies. Future studies with improved methodological design are warranted to confirm the efficacy of acupuncture and moxibustion for LEP. PMID:24726029

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews.

PubMed

Mayo-Wilson, Evan; Ng, Sueko Matsumura; Chuck, Roy S; Li, Tianjing

2017-09-05

Systematic reviews should inform American Academy of Ophthalmology (AAO) Preferred Practice Pattern® (PPP) guidelines. The quality of systematic reviews related to the forthcoming Preferred Practice Pattern® guideline (PPP) Refractive Errors & Refractive Surgery is unknown. We sought to identify reliable systematic reviews to assist the AAO Refractive Errors & Refractive Surgery PPP. Systematic reviews were eligible if they evaluated the effectiveness or safety of interventions included in the 2012 PPP Refractive Errors & Refractive Surgery. To identify potentially eligible systematic reviews, we searched the Cochrane Eyes and Vision United States Satellite database of systematic reviews. Two authors identified eligible reviews and abstracted information about the characteristics and quality of the reviews independently using the Systematic Review Data Repository. We classified systematic reviews as "reliable" when they (1) defined criteria for the selection of studies, (2) conducted comprehensive literature searches for eligible studies, (3) assessed the methodological quality (risk of bias) of the included studies, (4) used appropriate methods for meta-analyses (which we assessed only when meta-analyses were reported), (5) presented conclusions that were supported by the evidence provided in the review. We identified 124 systematic reviews related to refractive error; 39 met our eligibility criteria, of which we classified 11 to be reliable. Systematic reviews classified as unreliable did not define the criteria for selecting studies (5; 13%), did not assess methodological rigor (10; 26%), did not conduct comprehensive searches (17; 44%), or used inappropriate quantitative methods (3; 8%). The 11 reliable reviews were published between 2002 and 2016. They included 0 to 23 studies (median = 9) and analyzed 0 to 4696 participants (median = 666). Seven reliable reviews (64%) assessed surgical interventions. Most systematic reviews of interventions for refractive error are low methodological quality. Following widely accepted guidance, such as Cochrane or Institute of Medicine standards for conducting systematic reviews, would contribute to improved patient care and inform future research.

Effects of obesity on lung volume and capacity in children and adolescents: a systematic review.

PubMed

Winck, Aline Dill; Heinzmann-Filho, João Paulo; Soares, Rafaela Borges; da Silva, Juliana Severo; Woszezenki, Cristhiele Taís; Zanatta, Letiane Bueno

2016-12-01

To assess the effects of obesity on lung volume and capacity in children and adolescents. This is a systematic review, carried out in Pubmed, Lilacs, Scielo and PEDro databases, using the following Keywords: Plethysmography; Whole Body OR Lung Volume Measurements OR Total Lung Capacity OR Functional Residual Capacity OR Residual Volume AND Obesity. Observational studies or clinical trials that assessed the effects of obesity on lung volume and capacity in children and adolescents (0-18 years) without any other associated disease; in English; Portuguese and Spanish languages were selected. Methodological quality was assessed by the Agency for Healthcare Research and Quality. Of the 1,030 articles, only four were included in the review. The studies amounted to 548 participants, predominantly males, with sample size ranging from 45 to 327 individuals. 100% of the studies evaluated nutritional status through BMI (z-score) and 50.0% reported the data on abdominal circumference. All demonstrated that obesity causes negative effects on lung volume and capacity, causing a reduction mainly in functional residual capacity in 75.0% of the studies; in the expiratory reserve volume in 50.0% and in the residual volume in 25.0%. The methodological quality ranged from moderate to high, with 75.0% of the studies classified as having high methodological quality. Obesity causes deleterious effects on lung volume and capacity in children and adolescents, mainly by reducing functional residual capacity, expiratory reserve volume and residual volume. Copyright © 2016 Sociedade de Pediatria de São Paulo. Publicado por Elsevier Editora Ltda. All rights reserved.

Evaluating the statistical methodology of randomized trials on dentin hypersensitivity management.

PubMed

Matranga, Domenica; Matera, Federico; Pizzo, Giuseppe

2017-12-27

The present study aimed to evaluate the characteristics and quality of statistical methodology used in clinical studies on dentin hypersensitivity management. An electronic search was performed for data published from 2009 to 2014 by using PubMed, Ovid/MEDLINE, and Cochrane Library databases. The primary search terms were used in combination. Eligibility criteria included randomized clinical trials that evaluated the efficacy of desensitizing agents in terms of reducing dentin hypersensitivity. A total of 40 studies were considered eligible for assessment of quality statistical methodology. The four main concerns identified were i) use of nonparametric tests in the presence of large samples, coupled with lack of information about normality and equality of variances of the response; ii) lack of P-value adjustment for multiple comparisons; iii) failure to account for interactions between treatment and follow-up time; and iv) no information about the number of teeth examined per patient and the consequent lack of cluster-specific approach in data analysis. Owing to these concerns, statistical methodology was judged as inappropriate in 77.1% of the 35 studies that used parametric methods. Additional studies with appropriate statistical analysis are required to obtain appropriate assessment of the efficacy of desensitizing agents.

Rotary-wing flight test methods used for the evaluation of night vision devices

NASA Astrophysics Data System (ADS)

Haworth, Loran A.; Blanken, Christopher J.; Szoboszlay, Zoltan P.

2001-08-01

The U.S. Army Aviation mission includes flying helicopters at low altitude, at night, and in adverse weather. Night Vision Devices (NVDs) are used to supplement the pilot's visual cues for night flying. As the military requirement to conduct night helicopter operations has increased, the impact of helicopter flight operations with NVD technology in the Degraded Visual Environment (DVE) became increasingly important to quantify. Aeronautical Design Standard-33 (ADS- 33) was introduced to update rotorcraft handling qualities requirements and to quantify the impact of the NVDs in the DVE. As reported in this paper, flight test methodology in ADS-33 has been used by the handling qualities community to measure the impact of NVDs on task performance in the DVE. This paper provides the background and rationale behind the development of ADS-33 flight test methodology for handling qualities in the DVE, as well as the test methodology developed for human factor assessment of NVDs in the DVE. Lessons learned, shortcomings and recommendations for NVD flight test methodology are provided in this paper.

Association between funding source, methodological quality and research outcomes in randomized controlled trials of synbiotics, probiotics and prebiotics added to infant formula: A Systematic Review

PubMed Central

2013-01-01

Background There is little or no information available on the impact of funding by the food industry on trial outcomes and methodological quality of synbiotics, probiotics and prebiotics research in infants. The objective of this study was to compare the methodological quality, outcomes of food industry sponsored trials versus non industry sponsored trials, with regards to supplementation of synbiotics, probiotics and prebiotics in infant formula. Methods A comprehensive search was conducted to identify published and unpublished randomized clinical trials (RCTs). Cochrane methodology was used to assess the risk of bias of included RCTs in the following domains: 1) sequence generation; 2) allocation concealment; 3) blinding; 4) incomplete outcome data; 5) selective outcome reporting; and 6) other bias. Clinical outcomes and authors’ conclusions were reported in frequencies and percentages. The association between source of funding, risk of bias, clinical outcomes and conclusions were assessed using Pearson’s Chi-square test and the Fisher’s exact test. A p-value < 0.05 was statistically significant. Results Sixty seven completed and 3 on-going RCTs were included. Forty (59.7%) were funded by food industry, 11 (16.4%) by non-industry entities and 16 (23.9%) did not specify source of funding. Several risk of bias domains, especially sequence generation, allocation concealment and blinding, were not adequately reported. There was no significant association between the source of funding and sequence generation, allocation concealment, blinding and selective reporting, majority of reported clinical outcomes or authors’ conclusions. On the other hand, source of funding was significantly associated with the domains of incomplete outcome data, free of other bias domains as well as reported antibiotic use and conclusions on weight gain. Conclusion In RCTs on infants fed infant formula containing probiotics, prebiotics or synbiotics, the source of funding did not influence the majority of outcomes in favour of the sponsors’ products. More non-industry funded research is needed to further assess the impact of funding on methodological quality, reported clinical outcomes and authors’ conclusions. PMID:24219082

The quality of mental disorder information websites: a review.

PubMed

Reavley, Nicola J; Jorm, Anthony F

2011-11-01

This paper reviews studies assessing the quality of websites providing information about mental disorders. The review included 31 articles identified by searching research databases in March 2010. Topics covered included affective disorders, anxiety disorders, eating disorders, substance use disorders and schizophrenia/psychosis. The largest number of articles (13) reported studies assessing affective disorder information quality. Methodologies varied in site selection and rating methods, with some of limited validity. Most concluded that quality was poor, although quality of affective disorder sites may be improving. There is currently very little understanding of the influence of website quality on user behaviour. Future quality assessments might use the criteria informed by key behaviour change theories. A possible approach to research on websites and user behaviour might be to develop an evaluation framework incorporating strategies from behaviour change models, key mental health literacy elements and health outcomes relevant to mental health promotion. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

A Systematic Review of Herbal Medicine for Chemotherapy Induced Peripheral Neuropathy

PubMed Central

Noh, Hyeonseok

2018-01-01

Background Chemotherapy-induced peripheral neuropathy (CIPN) is a common adverse effect in cancer patients. The aim of this review was to assess the effectiveness of herbal medicine in preventing and treating CIPN. Methods Randomised controlled trials were included in this review. Extracting and assessing the data independently, two authors searched 13 databases. Results Twenty-eight trials involving 2174 patients met the inclusion criteria. Although there were some exceptions, the methodological quality was typically low. Seventeen trials reported the incidence rate of CIPN assessed by various tools and 14 showed a significant difference regarding the decrease of the incidence rate between the two groups. For clinical improvement, 12 trials reported it using various tools and 10 showed a significant difference between two groups. Two cases of adverse events occurred in one trial; the other nine trials reported no adverse events. Conclusions We found that herbal medicines in combination with and/or without other therapies potentially have preventive or therapeutic effects on CIPN. However, conclusions cannot be drawn because of the generally low quality of the methodology, the clinical heterogeneity, and the small sample size for each single herbal medicine. Trials that are more rigorous and report sufficient methodological data are needed. PMID:29636782

Lean interventions in healthcare: do they actually work? A systematic literature review.

PubMed

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-04-01

Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data on design, methods, interventions and key outcomes were extracted and collated. Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Analytical and simulator study of advanced transport

NASA Technical Reports Server (NTRS)

Levison, W. H.; Rickard, W. W.

1982-01-01

An analytic methodology, based on the optimal-control pilot model, was demonstrated for assessing longitidunal-axis handling qualities of transport aircraft in final approach. Calibration of the methodology is largely in terms of closed-loop performance requirements, rather than specific vehicle response characteristics, and is based on a combination of published criteria, pilot preferences, physical limitations, and engineering judgment. Six longitudinal-axis approach configurations were studied covering a range of handling qualities problems, including the presence of flexible aircraft modes. The analytical procedure was used to obtain predictions of Cooper-Harper ratings, a solar quadratic performance index, and rms excursions of important system variables.

Assessing the Quality of the Learning Outcome in Vocational Education: The Expero Model

ERIC Educational Resources Information Center

Cervai, Sara; Cian, Luca; Berlanga, Alicia; Borelli, Massimo; Kekale, Tauno

2013-01-01

Purpose: This paper aims to present an innovative model to evaluate the quality of the learning outcome in vocational education and training (VET) considering a wide approach that includes, in particular, stakeholders' expectations and perceptions. Design/methodology/approach: The Expero model was implemented in various kinds of vocational schools…

Managing the Quality of Cross-Border Higher Education in Zimbabwe

ERIC Educational Resources Information Center

Garwe, Evelyn Chiyevo

2015-01-01

A study on investigating the issues of quality associated with cross-border higher education was carried out using the case study approach focusing on Zimbabwe. The methodology involved document analysis of the cases of regulation and accreditation of cross-border higher education providers and assessment of qualifications acquired from foreign…

Physician Performance Assessment: Prevention of Cardiovascular Disease

ERIC Educational Resources Information Center

Lipner, Rebecca S.; Weng, Weifeng; Caverzagie, Kelly J.; Hess, Brian J.

2013-01-01

Given the rising burden of healthcare costs, both patients and healthcare purchasers are interested in discerning which physicians deliver quality care. We proposed a methodology to assess physician clinical performance in preventive cardiology care, and determined a benchmark for minimally acceptable performance. We used data on eight…

Quality of Life Assessment.

ERIC Educational Resources Information Center

Gore, Peter H.

Explaining the use of overlay methodology in the assessment of rural social service this paper describes a technique of visual juxtaposition wherein information is matched with geographic location. To ascertain whether senior citizen centers are located in areas of client concentration, for example, this model superimposes the location of senior…

Accuracy of the Canadian C-spine rule and NEXUS to screen for clinically important cervical spine injury in patients following blunt trauma: a systematic review

PubMed Central

Michaleff, Zoe A.; Maher, Chris G.; Verhagen, Arianne P.; Rebbeck, Trudy; Lin, Chung-Wei Christine

2012-01-01

Background: There is uncertainty about the optimal approach to screen for clinically important cervical spine (C-spine) injury following blunt trauma. We conducted a systematic review to investigate the diagnostic accuracy of the Canadian C-spine rule and the National Emergency X-Radiography Utilization Study (NEXUS) criteria, 2 rules that are available to assist emergency physicians to assess the need for cervical spine imaging. Methods: We identified studies by an electronic search of CINAHL, Embase and MEDLINE. We included articles that reported on a cohort of patients who experienced blunt trauma and for whom clinically important cervical spine injury detectable by diagnostic imaging was the differential diagnosis; evaluated the diagnostic accuracy of the Canadian C-spine rule or NEXUS or both; and used an adequate reference standard. We assessed the methodologic quality using the Quality Assessment of Diagnostic Accuracy Studies criteria. We used the extracted data to calculate sensitivity, specificity, likelihood ratios and post-test probabilities. Results: We included 15 studies of modest methodologic quality. For the Canadian C-spine rule, sensitivity ranged from 0.90 to 1.00 and specificity ranged from 0.01 to 0.77. For NEXUS, sensitivity ranged from 0.83 to 1.00 and specificity ranged from 0.02 to 0.46. One study directly compared the accuracy of these 2 rules using the same cohort and found that the Canadian C-spine rule had better accuracy. For both rules, a negative test was more informative for reducing the probability of a clinically important cervical spine injury. Interpretation: Based on studies with modest methodologic quality and only one direct comparison, we found that the Canadian C-spine rule appears to have better diagnostic accuracy than the NEXUS criteria. Future studies need to follow rigorous methodologic procedures to ensure that the findings are as free of bias as possible. PMID:23048086

Road-corridor planning in the EIA procedure in Spain. A review of case studies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Loro, Manuel, E-mail: manuel.loro@upm.es; Transport Research Centre; Centro de investigación del transporte, TRANSyT-UPM, ETSI Caminos, Canales y Puertos, Universidad Politécnica de Madrid, Prof. Aranguren s/n, 28040 Madrid

The assessment of different alternatives in road-corridor planning must be based on a number of well-defined territorial variables that serve as decision making criteria, and this requires a high-quality preliminary environmental assessment study. In Spain the formal specifications for the technical requirements stipulate the constraints that must be considered in the early stages of defining road corridors, but not how they should be analyzed and ranked. As part of the feasibility study of a new road definition, the most common methodology is to establish different levels of Territorial Carrying Capacity (TCC) in the study area in order to summarize themore » territorial variables on thematic maps and to ease the tracing process of road-corridor layout alternatives. This paper explores the variables used in 22 road-construction projects conducted by the Ministry of Public Works that were subject to the Spanish EIA regulation and published between 2006 and 2008. The aim was to evaluate the quality of the methods applied and the homogeneity and suitability of the variables used for defining the TCC. The variables were clustered into physical, environmental, land-use and cultural constraints for the purpose of comparing the TCC values assigned in the studies reviewed. We found the average quality of the studies to be generally acceptable in terms of the justification of the methodology, the weighting and classification of the variables, and the creation of a synthesis map. Nevertheless, the methods for assessing the TCC are not sufficiently standardized; there is a lack of uniformity in the cartographic information sources and methodologies for the TCC valuation. -- Highlights: • We explore 22 road-corridor planning studies subjected to the Spanish EIA regulation. • We analyze the variables selected for defining territorial carrying capacity. • The quality of the studies is acceptable (methodology, variable weighting, mapping). • There is heterogeneity in the methods for territorial carrying capacity valuation.« less

Quality of reporting of surveys in critical care journals: a methodologic review.

PubMed

Duffett, Mark; Burns, Karen E; Adhikari, Neill K; Arnold, Donald M; Lauzier, François; Kho, Michelle E; Meade, Maureen O; Hayani, Omar; Koo, Karen; Choong, Karen; Lamontagne, François; Zhou, Qi; Cook, Deborah J

2012-02-01

Adequate reporting is needed to judge methodologic quality and assess the risk of bias of surveys. The objective of this study is to describe the methodology and quality of reporting of surveys published in five critical care journals. All issues (1996-2009) of the American Journal of Respiratory and Critical Care Medicine, Critical Care, Critical Care Medicine, Intensive Care Medicine, and Pediatric Critical Care Medicine. Two reviewers hand-searched all issues in duplicate. We included publications of self-administered questionnaires of health professionals and excluded surveys that were part of a multi-method study or measured the effect of an intervention. Data were abstracted in duplicate. We included 151 surveys. The frequency of survey publication increased at an average rate of 0.38 surveys per 1000 citations per year from 1996-2009 (p for trend = 0.001). The median number of respondents and reported response rates were 217 (interquartile range 90 to 402) and 63.3% (interquartile range 45.0% to 81.0%), respectively. Surveys originated predominantly from North America (United States [40.4%] and Canada [18.5%]). Surveys most frequently examined stated practice (78.8%), attitudes or opinions (60.3%), and less frequently knowledge (9.9%). The frequency of reporting on the survey design and methods were: 1) instrument development: domains (59.1%), item generation (33.1%), item reduction (12.6%); 2) instrument testing: pretesting or pilot testing (36.2%) and assessments of clarity (25.2%) or clinical sensibility (15.7%); and 3) clinimetric properties: qualitative or quantitative description of at least one of face, content, construct validity, intra- or inter-rater reliability, or consistency (28.5%). The reporting of five key elements of survey design and conduct did not significantly change over time. Surveys, primarily conducted in North America and focused on self-reported practice, are increasingly published in highly cited critical care journals. More uniform and comprehensive reporting will facilitate assessment of methodologic quality.

Evaluation of the methodological quality of studies of the performance of diagnostic tests for bovine tuberculosis using QUADAS.

PubMed

Downs, Sara H; More, Simon J; Goodchild, Anthony V; Whelan, Adam O; Abernethy, Darrell A; Broughan, Jennifer M; Cameron, Angus; Cook, Alasdair J; Ricardo de la Rua-Domenech, R; Greiner, Matthias; Gunn, Jane; Nuñez-Garcia, Javier; Rhodes, Shelley; Rolfe, Simon; Sharp, Michael; Upton, Paul; Watson, Eamon; Welsh, Michael; Woolliams, John A; Clifton-Hadley, Richard S; Parry, Jessica E

2018-05-01

There has been little assessment of the methodological quality of studies measuring the performance (sensitivity and/or specificity) of diagnostic tests for animal diseases. In a systematic review, 190 studies of tests for bovine tuberculosis (bTB) in cattle (published 1934-2009) were assessed by at least one of 18 reviewers using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies) checklist adapted for animal disease tests. VETQUADAS (VQ) included items measuring clarity in reporting (n = 3), internal validity (n = 9) and external validity (n = 2). A similar pattern for compliance was observed in studies of different diagnostic test types. Compliance significantly improved with year of publication for all items measuring clarity in reporting and external validity but only improved in four of the nine items measuring internal validity (p < 0.05). 107 references, of which 83 had performance data eligible for inclusion in a meta-analysis were reviewed by two reviewers. In these references, agreement between reviewers' responses was 71% for compliance, 32% for unsure and 29% for non-compliance. Mean compliance with reporting items was 2, 5.2 for internal validity and 1.5 for external validity. The index test result was described in sufficient detail in 80.1% of studies and was interpreted without knowledge of the reference standard test result in only 33.1%. Loss to follow-up was adequately explained in only 31.1% of studies. The prevalence of deficiencies observed may be due to inadequate reporting but may also reflect lack of attention to methodological issues that could bias the results of diagnostic test performance estimates. QUADAS was a useful tool for assessing and comparing the quality of studies measuring the performance of diagnostic tests but might be improved further by including explicit assessment of population sampling strategy. Crown Copyright © 2017. Published by Elsevier B.V. All rights reserved.

Pressure ulcer risk assessment and prevention: a systematic comparative effectiveness review.

PubMed

Chou, Roger; Dana, Tracy; Bougatsos, Christina; Blazina, Ian; Starmer, Amy J; Reitel, Katie; Buckley, David I

2013-07-02

Pressure ulcers are associated with substantial health burdens but may be preventable. To review the clinical utility of pressure ulcer risk assessment instruments and the comparative effectiveness of preventive interventions in persons at higher risk. MEDLINE (1946 through November 2012), CINAHL, the Cochrane Library, grant databases, clinical trial registries, and reference lists. Randomized trials and observational studies on effects of using risk assessment on clinical outcomes and randomized trials of preventive interventions on clinical outcomes. Multiple investigators abstracted and checked study details and quality using predefined criteria. One good-quality trial found no evidence that use of a pressure ulcer risk assessment instrument, with or without a protocolized intervention strategy based on assessed risk, reduces risk for incident pressure ulcers compared with less standardized risk assessment based on nurses' clinical judgment. In higher-risk populations, 1 good-quality and 4 fair-quality randomized trials found that more advanced static support surfaces were associated with lower risk for pressure ulcers compared with standard mattresses (relative risk range, 0.20 to 0.60). Evidence on the effectiveness of low-air-loss and alternating-air mattresses was limited, with some trials showing no clear differences from advanced static support surfaces. Evidence on the effectiveness of nutritional supplementation, repositioning, and skin care interventions versus usual care was limited and had methodological shortcomings, precluding strong conclusions. Only English-language articles were included, publication bias could not be formally assessed, and most studies had methodological shortcomings. More advanced static support surfaces are more effective than standard mattresses for preventing ulcers in higher-risk populations. The effectiveness of formal risk assessment instruments and associated intervention protocols compared with less standardized assessment methods and the effectiveness of other preventive interventions compared with usual care have not been clearly established.

Dissemination Bias in Systematic Reviews of Animal Research: A Systematic Review

PubMed Central

Mueller, Katharina F.; Briel, Matthias; Strech, Daniel; Meerpohl, Joerg J.; Lang, Britta; Motschall, Edith; Gloy, Viktoria; Lamontagne, Francois; Bassler, Dirk

2014-01-01

Background Systematic reviews of preclinical studies, in vivo animal experiments in particular, can influence clinical research and thus even clinical care. Dissemination bias, selective dissemination of positive or significant results, is one of the major threats to validity in systematic reviews also in the realm of animal studies. We conducted a systematic review to determine the number of published systematic reviews of animal studies until present, to investigate their methodological features especially with respect to assessment of dissemination bias, and to investigate the citation of preclinical systematic reviews on clinical research. Methods Eligible studies for this systematic review constitute systematic reviews that summarize in vivo animal experiments whose results could be interpreted as applicable to clinical care. We systematically searched Ovid Medline, Embase, ToxNet, and ScienceDirect from 1st January 2009 to 9th January 2013 for eligible systematic reviews without language restrictions. Furthermore we included articles from two previous systematic reviews by Peters et al. and Korevaar et al. Results The literature search and screening process resulted in 512 included full text articles. We found an increasing number of published preclinical systematic reviews over time. The methodological quality of preclinical systematic reviews was low. The majority of preclinical systematic reviews did not assess methodological quality of the included studies (71%), nor did they assess heterogeneity (81%) or dissemination bias (87%). Statistics quantifying the importance of clinical research citing systematic reviews of animal studies showed that clinical studies referred to the preclinical research mainly to justify their study or a future study (76%). Discussion Preclinical systematic reviews may have an influence on clinical research but their methodological quality frequently remains low. Therefore, systematic reviews of animal research should be critically appraised before translating them to a clinical context. PMID:25541734

Effect of periodontal treatment on preterm birth rate: a systematic review of meta-analyses.

PubMed

López, Néstor J; Uribe, Sergio; Martinez, Benjamín

2015-02-01

Preterm birth is a major cause of neonatal morbidity and mortality in both developed and developing countries. Preterm birth is a highly complex syndrome that includes distinct clinical subtypes in which many different causes may be involved. The results of epidemiological, molecular, microbiological and animal-model studies support a positive association between maternal periodontal disease and preterm birth. However, the results of intervention studies carried out to determine the effect of periodontal treatment on reducing the risk of preterm birth are controversial. This systematic review critically analyzes the methodological issues of meta-analyses of the studies to determine the effect of periodontal treatment to reduce preterm birth. The quality of the individual randomized clinical trials selected is of highest relevance for a systematic review. This article describes the methodological features that should be identified a priori and assessed individually to determine the quality of a randomized controlled trial performed to evaluate the effect of periodontal treatment on pregnancy outcomes. The AMSTAR and the PRISMA checklist tools were used to assess the quality of the six meta-analyses selected, and the bias domain of the Cochrane Collaboration's Tool was applied to evaluate each of the trials included in the meta-analyses. In addition, the methodological characteristics of each clinical trial were assessed. The majority of the trials included in the meta-analyses have significant methodological flaws that threaten their internal validity. The lack of effect of periodontal treatment on preterm birth rate concluded by four meta-analyses, and the positive effect of treatment for reducing preterm birth risk concluded by the remaining two meta-analyses are not based on consistent scientific evidence. Well-conducted randomized controlled trials using rigorous methodology, including appropriate definition of the exposure, adequate control of confounders for preterm birth and application of effective periodontal interventions to eliminate periodontal infection, are needed to confirm the positive association between periodontal disease and preterm birth. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

"Total Deposition (TDEP) Maps" | Science Inventory | US EPA

EPA Pesticide Factsheets

The presentation provides an update on the use of a hybrid methodology that relies on measured values from national monitoring networks and modeled values from CMAQ to produce of maps of total deposition for use in critical loads and other ecological assessments. Additionally, comparisons of the deposition values from the hybrid approach are compared with deposition estimates from other methodologies. The National Exposure Research Laboratory (NERL) Atmospheric Modeling and Analysis Division (AMAD) conducts research in support of EPA mission to protect human health and the environment. AMAD research program is engaged in developing and evaluating predictive atmospheric models on all spatial and temporal scales for forecasting the air quality and for assessing changes in air quality and air pollutant exposures, as affected by changes in ecosystem management and regulatory decisions. AMAD is responsible for providing a sound scientific and technical basis for regulatory policies based on air quality models to improve ambient air quality. The models developed by AMAD are being used by EPA, NOAA, and the air pollution community in understanding and forecasting not only the magnitude of the air pollution problem, but also in developing emission control policies and regulations for air quality improvements.

Measurement properties of instruments evaluating self-care and related concepts in people with chronic obstructive pulmonary disease: A systematic review.

PubMed

Clari, Marco; Matarese, Maria; Alvaro, Rosaria; Piredda, Michela; De Marinis, Maria Grazia

2016-01-01

The use of valid and reliable instruments for assessing self-care is crucial for the evaluation of chronic obstructive pulmonary disease (COPD) management programs. The aim of this review is to evaluate the measurement properties and theoretical foundations of instruments for assessing self-care and related concepts in people with COPD. A systematic review was conducted of articles describing the development and validation of self-care instruments. The methodological quality of the measurement properties was assessed using the COSMIN checklist. Ten studies were included evaluating five instruments: three for assessing self-care and self-management and two for assessing self-efficacy. The COPD Self-Efficacy Scale was the most studied instrument, but due to poor study methodological quality, evidence about its measurement properties is inconclusive. Evidence from the COPD Self-Management Scale is more promising, but only one study tested its properties. Due to inconclusive evidence of their measurement properties, no instrument can be recommended for clinical use. Copyright © 2016 Elsevier Inc. All rights reserved.

Ambient air quality programmes for health impact assessment in the WHO European region.

PubMed

Mücke, H G

2000-06-01

An important aim of air quality assessment is to provide information about population exposure and health impact assessment. Numerous epidemiological studies have already shown that exposure to excessive levels of ambient air pollutants are associated with either acute or chronic health effects. Until recently, the adequacy of monitoring population exposure in relation to quantitative assessment of health effects of air pollution was rarely considered in ambient air monitoring strategies. This made the formulation of health-related recommendations to risk management difficult and weakens preventive and other measures to reduce adverse health effects of air pollution. To improve local and national capacities for health impact assessment, the European Centre for Environment and Health of the World Health Organization has prepared methodology guidelines concerning selected aspects of air monitoring. The WHO Collaborating Centre for Air Quality Management and Air Pollution Control support efforts in line with international programmes on quality assurance and control for Europe.

Critical appraisal of questionnaires to assess functional impairment in individuals with mild cognitive impairment.

PubMed

Kaur, Navaldeep; Belchior, Patricia; Gelinas, Isabelle; Bier, Nathalie

2016-09-01

Mild deficits in instrumental activities of daily living (IADLs) have consistently been reported in the individuals with mild cognitive impairment (MCI). A variety of functional assessment tools, including self-and informant report questionnaires and performance-based measures, have been employed in MCI. Previously, a limited focus has been directed at appraising the quality of questionnaires. The goal of this study was to identify the questionnaires that have been validated in the MCI population. Additionally, the quality of validation studies and psychometric attributes of these questionnaires were appraised. Relevant articles were systematically searched in PsychINFO, Ovid MEDLINE, and CINAHL against specific eligibility criteria. To evaluate the methodology of the psychometric studies, the COSMIN checklist was employed. Also, the psychometric properties of the assessment tools were evaluated based upon Terwee's criteria. A total of five psychometric studies and questionnaires were critically evaluated. Varying psychometric properties were available for the chosen tools. None of the studies received the best possible rating for their methodological quality. It was found that questionnaires with high discriminative ability to distinguish MCI from other diagnostic groups were: Disability Assessment in Dementia-6 (DAD-6), Functional Activity Questionnaire (FAQ), and Alzheimer's Disease Cooperative Study/Activities of Daily Living scale adapted for MCI patients (ADCS-MCI-ADL-24). Psychometric studies with strong methodological rigor are required in the future. Considering the fact that IADL decline has been associated with dementia, early detection of functional difficulties in MCI needs to be encouraged as it will allow suitable and timely interventions to prolong functional independence of affected individuals.

The differential impact of scientific quality, bibliometric factors, and social media activity on the influence of systematic reviews and meta-analyses about psoriasis.

PubMed

Ruano, Juan; Aguilar-Luque, Macarena; Gómez-Garcia, Francisco; Alcalde Mellado, Patricia; Gay-Mimbrera, Jesus; Carmona-Fernandez, Pedro J; Maestre-López, Beatriz; Sanz-Cabanillas, Juan Luís; Hernández Romero, José Luís; González-Padilla, Marcelino; Vélez García-Nieto, Antonio; Isla-Tejera, Beatriz

2018-01-01

Researchers are increasingly using on line social networks to promote their work. Some authors have suggested that measuring social media activity can predict the impact of a primary study (i.e., whether or not an article will be highly cited). However, the influence of variables such as scientific quality, research disclosures, and journal characteristics on systematic reviews and meta-analyses has not yet been assessed. The present study aims to describe the effect of complex interactions between bibliometric factors and social media activity on the impact of systematic reviews and meta-analyses about psoriasis (PROSPERO 2016: CRD42016053181). Methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Altmetrics, which consider Twitter, Facebook, and Google+ mention counts as well as Mendeley and SCOPUS readers, and corresponding article citation counts from Google Scholar were obtained for each article. Metadata and journal-related bibliometric indices were also obtained. One-hundred and sixty-four reviews with available altmetrics information were included in the final multifactorial analysis, which showed that social media and impact factor have less effect than Mendeley and SCOPUS readers on the number of cites that appear in Google Scholar. Although a journal's impact factor predicted the number of tweets (OR, 1.202; 95% CI, 1.087-1.049), the years of publication and the number of Mendeley readers predicted the number of citations in Google Scholar (OR, 1.033; 95% CI, 1.018-1.329). Finally, methodological quality was related neither with bibliometric influence nor social media activity for systematic reviews. In conclusion, there seems to be a lack of connectivity between scientific quality, social media activity, and article usage, thus predicting scientific success based on these variables may be inappropriate in the particular case of systematic reviews.

The differential impact of scientific quality, bibliometric factors, and social media activity on the influence of systematic reviews and meta-analyses about psoriasis

PubMed Central

Gómez-Garcia, Francisco; Alcalde Mellado, Patricia; Gay-Mimbrera, Jesus; Carmona-Fernandez, Pedro J.; Maestre-López, Beatriz; Sanz-Cabanillas, Juan Luís; Hernández Romero, José Luís; González-Padilla, Marcelino; Vélez García-Nieto, Antonio; Isla-Tejera, Beatriz

2018-01-01

Researchers are increasingly using on line social networks to promote their work. Some authors have suggested that measuring social media activity can predict the impact of a primary study (i.e., whether or not an article will be highly cited). However, the influence of variables such as scientific quality, research disclosures, and journal characteristics on systematic reviews and meta-analyses has not yet been assessed. The present study aims to describe the effect of complex interactions between bibliometric factors and social media activity on the impact of systematic reviews and meta-analyses about psoriasis (PROSPERO 2016: CRD42016053181). Methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Altmetrics, which consider Twitter, Facebook, and Google+ mention counts as well as Mendeley and SCOPUS readers, and corresponding article citation counts from Google Scholar were obtained for each article. Metadata and journal-related bibliometric indices were also obtained. One-hundred and sixty-four reviews with available altmetrics information were included in the final multifactorial analysis, which showed that social media and impact factor have less effect than Mendeley and SCOPUS readers on the number of cites that appear in Google Scholar. Although a journal’s impact factor predicted the number of tweets (OR, 1.202; 95% CI, 1.087–1.049), the years of publication and the number of Mendeley readers predicted the number of citations in Google Scholar (OR, 1.033; 95% CI, 1.018–1.329). Finally, methodological quality was related neither with bibliometric influence nor social media activity for systematic reviews. In conclusion, there seems to be a lack of connectivity between scientific quality, social media activity, and article usage, thus predicting scientific success based on these variables may be inappropriate in the particular case of systematic reviews. PMID:29377889

Response surface methodology for predicting quality characteristics of beef patties added with flaxseed and tomato paste.

PubMed

Valenzuela Melendres, M; Camou, J P; Torrentera Olivera, N G; Alvarez Almora, E; González Mendoza, D; Avendaño Reyes, L; González Ríos, H

2014-05-01

Response surface methodology was used to study the effect of flaxseed flour (FS) and tomato paste (TP) addition, from 0 to 10% and 0 to 20% respectively, on beef patty quality characteristics. The assessed quality characteristics were color (L, a, and b), pH and texture profile analysis (TPA). Also, sensory analysis was performed for the assessment of color, juiciness, firmness, and general acceptance. FS addition reduced L and a values and decreased weight loss of cooked products (P<0.05). An opposite effect was observed when TP was added (P<0.05). All TPA parameters decreased when percentages of FS and TP were increased in the formulation of beef patties. Furthermore, FS and TP addition adversely affected the sensory characteristics of the cooked product (P<0.05); nevertheless, all sensory characteristics evaluated had an acceptable score (>5.6). Thus FS and TP are ingredients that can be used in beef patty preparation. Copyright © 2014 Elsevier Ltd. All rights reserved.

A new multimodal interactive way of subjective scoring of 3D video quality of experience

NASA Astrophysics Data System (ADS)

Kim, Taewan; Lee, Kwanghyun; Lee, Sanghoon; Bovik, Alan C.

2014-03-01

People that watch today's 3D visual programs, such as 3D cinema, 3D TV and 3D games, experience wide and dynamically varying ranges of 3D visual immersion and 3D quality of experience (QoE). It is necessary to be able to deploy reliable methodologies that measure each viewers subjective experience. We propose a new methodology that we call Multimodal Interactive Continuous Scoring of Quality (MICSQ). MICSQ is composed of a device interaction process between the 3D display and a separate device (PC, tablet, etc.) used as an assessment tool, and a human interaction process between the subject(s) and the device. The scoring process is multimodal, using aural and tactile cues to help engage and focus the subject(s) on their tasks. Moreover, the wireless device interaction process makes it possible for multiple subjects to assess 3D QoE simultaneously in a large space such as a movie theater, and at di®erent visual angles and distances.

Effectiveness of the Comprehensive Approach to Rehabilitation (CARe) methodology: design of a cluster randomized controlled trial.

PubMed

Bitter, Neis A; Roeg, Diana P K; van Nieuwenhuizen, Chijs; van Weeghel, Jaap

2015-07-22

There is an increasing amount of evidence for the effectiveness of rehabilitation interventions for people with severe mental illness (SMI). In the Netherlands, a rehabilitation methodology that is well known and often applied is the Comprehensive Approach to Rehabilitation (CARe) methodology. The overall goal of the CARe methodology is to improve the client's quality of life by supporting the client in realizing his/her goals and wishes, handling his/her vulnerability and improving the quality of his/her social environment. The methodology is strongly influenced by the concept of 'personal recovery' and the 'strengths case management model'. No controlled effect studies have been conducted hitherto regarding the CARe methodology. This study is a two-armed cluster randomized controlled trial (RCT) that will be executed in teams from three organizations for sheltered and supported housing, which provide services to people with long-term severe mental illness. Teams in the intervention group will receive the multiple-day CARe methodology training from a specialized institute and start working according the CARe Methodology guideline. Teams in the control group will continue working in their usual way. Standardized questionnaires will be completed at baseline (T0), and 10 (T1) and 20 months (T2) post baseline. Primary outcomes are recovery, social functioning and quality of life. The model fidelity of the CARe methodology will be assessed at T1 and T2. This study is the first controlled effect study on the CARe methodology and one of the few RCTs on a broad rehabilitation method or strength-based approach. This study is relevant because mental health care organizations have become increasingly interested in recovery and rehabilitation-oriented care. The trial registration number is ISRCTN77355880 .

[Methodology for the comprehensive evaluation of the quality of performance of activities of medical and social experts].

PubMed

Moskalenko, V F; Gorban', Ie M; Marunich, V V; Ipatov, A V; Sergiieni, O V

2001-01-01

The paper scientifically substantiates methodology, approaches, criteria, and control indices for assessment of activities of establishments of medical-and-social performance. Most indices for efficiency and certain indices for week points in the work of establishments of the service depend on interaction thereof with curative- and prophylactic institutions; the best results with the problem of prevention of disability and rehabilitation of invalids are supposed to be achieved through collaborative efforts. Other criteria and intermediate indices having an effect on the quality of activities reflect the resource- and trained personnel supplies of establishments of the service, amount of work, organizational measures designed to raise the quality of medical-and-social expert performance.

Algorithm for evaluating the effectiveness of a high-rise development project based on current yield

NASA Astrophysics Data System (ADS)

Soboleva, Elena

2018-03-01

The article is aimed at the issues of operational evaluation of development project efficiency in high-rise construction under the current economic conditions in Russia. The author touches the following issues: problems of implementing development projects, the influence of the operational evaluation quality of high-rise construction projects on general efficiency, assessing the influence of the project's external environment on the effectiveness of project activities under crisis conditions and the quality of project management. The article proposes the algorithm and the methodological approach to the quality management of the developer project efficiency based on operational evaluation of the current yield efficiency. The methodology for calculating the current efficiency of a development project for high-rise construction has been updated.

[Systematic Review of the Methodology Quality in Lung Cancer Screening Guidelines].

PubMed

Li, Jiang; Su, Kai; Li, Fang; Tang, Wei; Huang, Yao; Wang, Le; Huang, Huiyao; Shi, Jufang; Dai, Min

2016-10-20

Lung cancer is the most common malignancy and screening can decrease the mortality. High quality screening guideline is necessary and important for effective work. Our study is to review and evaluate the basic characteristics and methodology quality of the current global lung cancer screening guidelines so as to provide useful information for domestic study in the future. Electronic searches were done in English and Chinese databases including PubMed, the Cochrane Library, Web of Science, Embase, CNKI, CBM, Wanfang, and some cancer official websites. Articles were screened according to the predefined inclusion and exclusion criteria by two researchers. The quality of guidelines was assessed by AGREE II. At last, a total of 11 guidelines with methodology were included. The guidelines were issued mainly by USA (81%). Canada and China developed one, respectively. As for quality, the average score in the "Scale and objective" of all guidelines was 80, the average score in the "Participants" was 52, the average score in the "rigorism" was 50, the average score in the "clarity" was 76, the average score in the "application" was 43 and the average score in the "independence" was 59. The highest average score was found in 2013 and 2015. Canada guideline had higher quality in six domains. 7 guidelines were evaluated as A level. The number of clinical guidelines showed an increasing trend. Most guidelines were issued by developed countries with heavy burden. Multi-country contribution to one guideline was another trend. Evidence-based methodology was accepted globally in the guideline development.

76 FR 71072 - Agency Information Collection Activities: Extension With Change of a Previously Approved...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-11-16

...: 30-Day notice. The United States Department of Justice (DOJ), National Drug Intelligence Center (NDIC..., including the validity of the methodology and assumptions used; --Enhance the quality, utility, and clarity... Assessment and other reports and assessments produced by the National Drug Intelligence Center. It provides...

The methodological quality of health economic evaluations for the management of hip fractures: A systematic review of the literature.

PubMed

Sabharwal, Sanjeeve; Carter, Alexander; Darzi, Lord Ara; Reilly, Peter; Gupte, Chinmay M

2015-06-01

Approximately 76,000 people a year sustain a hip fracture in the UK and the estimated cost to the NHS is £1.4 billion a year. Health economic evaluations (HEEs) are one of the methods employed by decision makers to deliver healthcare policy supported by clinical and economic evidence. The objective of this study was to (1) identify and characterize HEEs for the management of patients with hip fractures, and (2) examine their methodological quality. A literature search was performed in MEDLINE, EMBASE and the NHS Economic Evaluation Database. Studies that met the specified definition for a HEE and evaluated hip fracture management were included. Methodological quality was assessed using the Consensus on Health Economic Criteria (CHEC). Twenty-seven publications met the inclusion criteria of this study and were included in our descriptive and methodological analysis. Domains of methodology that performed poorly included use of an appropriate time horizon (66.7% of studies), incremental analysis of costs and outcomes (63%), future discounting (44.4%), sensitivity analysis (40.7%), declaration of conflicts of interest (37%) and discussion of ethical considerations (29.6%). HEEs for patients with hip fractures are increasing in publication in recent years. Most of these studies fail to adopt a societal perspective and key aspects of their methodology are poor. The development of future HEEs in this field must adhere to established principles of methodology, so that better quality research can be used to inform health policy on the management of patients with a hip fracture. Copyright © 2014 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

POSSUM--a model for surgical outcome audit in quality care.

PubMed

Ng, K J; Yii, M K

2003-10-01

Comparative surgical audit to monitor quality of care should be performed with a risk-adjusted scoring system rather than using crude morbidity and mortality rates. A validated and widely applied risk adjusted scoring system, P-POSSUM (Portsmouth-Physiological and Operative Severity Score for the enUmeration of Mortality) methodology, was applied to a prospective series of predominantly general surgical patients at the Sarawak General Hospital, Kuching over a six months period. The patients were grouped into four risk groups. The observed mortality rates were not significantly different from predicted rates, showing that the quality of surgical care was at par with typical western series. The simplicity and advantages of this scoring system over other auditing tools are discussed. The P-POSSUM methodology could form the basis of local comparative surgical audit for assessment and maintenance of quality care.

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand

PubMed Central

2013-01-01

Background Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. Methods A systematic search of 17 electronic databases and 13 websites for the period 1981–2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Results Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. Conclusions There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise. PMID:23663493

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand.

PubMed

Clifford, Anton C; Doran, Christopher M; Tsey, Komla

2013-05-13

Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. A systematic search of 17 electronic databases and 13 websites for the period 1981-2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise.

Effects of Regular Classes in Outdoor Education Settings: A Systematic Review on Students’ Learning, Social and Health Dimensions

PubMed Central

Becker, Christoph; Lauterbach, Gabriele; Spengler, Sarah; Dettweiler, Ulrich; Mess, Filip

2017-01-01

Background: Participants in Outdoor Education Programmes (OEPs) presumably benefit from these programmes in terms of their social and personal development, academic achievement and physical activity (PA). The aim of this systematic review was to identify studies about regular compulsory school- and curriculum-based OEPs, to categorise and evaluate reported outcomes, to assess the methodological quality, and to discuss possible benefits for students. Methods: We searched online databases to identify English- and German-language peer-reviewed journal articles that reported any outcomes on a student level. Two independent reviewers screened studies identified for eligibility and assessed the methodological quality. Results: Thirteen studies were included for analysis. Most studies used a case-study design, the average number of participants was moderate (mean valued (M) = 62.17; standard deviation (SD) = 64.12), and the methodological quality was moderate on average for qualitative studies (M = 0.52; SD = 0.11), and low on average for quantitative studies (M = 0.18; SD = 0.42). Eight studies described outcomes in terms of social dimensions, seven studies in learning dimensions and four studies were subsumed under additional outcomes, i.e., PA and health. Eleven studies reported positive, one study positive as well as negative, and one study reported negative effects. PA and mental health as outcomes were underrepresented. Conclusion: Tendencies were detected that regular compulsory school- and curriculum-based OEPs can promote students in respect of social, academic, physical and psychological dimensions. Very little is known concerning students’ PA or mental health. We recommend conducting more quasi-experimental design and longitudinal studies with a greater number of participants, and a high methodological quality to further investigate these tendencies. PMID:28475167

Effects of Regular Classes in Outdoor Education Settings: A Systematic Review on Students' Learning, Social and Health Dimensions.

PubMed

Becker, Christoph; Lauterbach, Gabriele; Spengler, Sarah; Dettweiler, Ulrich; Mess, Filip

2017-05-05

Participants in Outdoor Education Programmes (OEPs) presumably benefit from these programmes in terms of their social and personal development, academic achievement and physical activity (PA). The aim of this systematic review was to identify studies about regular compulsory school- and curriculum-based OEPs, to categorise and evaluate reported outcomes, to assess the methodological quality, and to discuss possible benefits for students. We searched online databases to identify English- and German-language peer-reviewed journal articles that reported any outcomes on a student level. Two independent reviewers screened studies identified for eligibility and assessed the methodological quality. Thirteen studies were included for analysis. Most studies used a case-study design, the average number of participants was moderate (mean valued (M) = 62.17; standard deviation (SD) = 64.12), and the methodological quality was moderate on average for qualitative studies (M = 0.52; SD = 0.11), and low on average for quantitative studies (M = 0.18; SD = 0.42). Eight studies described outcomes in terms of social dimensions, seven studies in learning dimensions and four studies were subsumed under additional outcomes, i.e., PA and health. Eleven studies reported positive, one study positive as well as negative, and one study reported negative effects. PA and mental health as outcomes were underrepresented. Tendencies were detected that regular compulsory school- and curriculum-based OEPs can promote students in respect of social, academic, physical and psychological dimensions. Very little is known concerning students' PA or mental health. We recommend conducting more quasi-experimental design and longitudinal studies with a greater number of participants, and a high methodological quality to further investigate these tendencies.

[Methodological quality of an article on the treatment of gastric cancer adopted as protocol by some Chilean hospitals].

PubMed

Manterola, Carlos; Torres, Rodrigo; Burgos, Luis; Vial, Manuel; Pineda, Viviana

2006-07-01

Surgery is a curative treatment for gastric cancer (GC). As relapse is frequent, adjuvant therapies such as postoperative chemo radiotherapy have been tried. In Chile, some hospitals adopted Macdonald's study as a protocol for the treatment of GC. To determine methodological quality and internal and external validity of the Macdonald study. Three instruments were applied that assess methodological quality. A critical appraisal was done and the internal and external validity of the methodological quality was analyzed with two scales: MINCIR (Methodology and Research in Surgery), valid for therapy studies and CONSORT (Consolidated Standards of Reporting Trials), valid for randomized controlled trials (RCT). Guides and scales were applied by 5 researchers with training in clinical epidemiology. The reader's guide verified that the Macdonald study was not directed to answer a clearly defined question. There was random assignment, but the method used is not described and the patients were not considered until the end of the study (36% of the group with surgery plus chemo radiotherapy did not complete treatment). MINCIR scale confirmed a multicentric RCT, not blinded, with an unclear randomized sequence, erroneous sample size estimation, vague objectives and no exclusion criteria. CONSORT system proved the lack of working hypothesis and specific objectives as well as an absence of exclusion criteria and identification of the primary variable, an imprecise estimation of sample size, ambiguities in the randomization process, no blinding, an absence of statistical adjustment and the omission of a subgroup analysis. The instruments applied demonstrated methodological shortcomings that compromise the internal and external validity of the.

[Education for patients with fibromyalgia. A systematic review of randomised clinical trials].

PubMed

Elizagaray-Garcia, Ignacio; Muriente-Gonzalez, Jorge; Gil-Martinez, Alfonso

2016-01-16

To analyse the effectiveness of education about pain, quality of life and functionality in patients with fibromyalgia. The search for articles was carried out in electronic databases. Eligibility criteria were: controlled randomised clinical trials (RCT), published in English and Spanish, that had been conducted on patients with fibromyalgia, in which the therapeutic procedure was based on patient education. Two independent reviewers analysed the methodological quality using the PEDro scale. Five RCT were selected, of which four offered good methodological quality. In three of the studies, patient education, in combination with another intervention based on therapeutic exercise, improved the outcomes in the variables assessing pain and quality of life as compared with the same procedures performed separately. Moreover, an RCT with a high quality methodology showed that patient education activated inhibitory neural pathways capable of lowering the level of pain. The quantitative analysis yields strong-moderate evidence that patient education, in combination with other therapeutic exercise procedures, offers positive results in the variables pain, quality of life and functionality. Patient education in itself has not proved to be effective for pain, quality of life or functionality in patients with fibromyalgia. There is strong evidence, however, of the effectiveness of combining patient education with exercise and active strategies for coping with pain, quality of life and functionality in the short, medium and long term in patients with fibromyalgia.

Wearable accelerometry-based technology capable of assessing functional activities in neurological populations in community settings: a systematic review.

PubMed

Steins, Dax; Dawes, Helen; Esser, Patrick; Collett, Johnny

2014-03-13

Integrating rehabilitation services through wearable systems has the potential to accurately assess the type, intensity, duration, and quality of movement necessary for procuring key outcome measures. This review aims to explore wearable accelerometry-based technology (ABT) capable of assessing mobility-related functional activities intended for rehabilitation purposes in community settings for neurological populations. In this review, we focus on the accuracy of ABT-based methods, types of outcome measures, and the implementation of ABT in non-clinical settings for rehabilitation purposes. Cochrane, PubMed, Web of Knowledge, EMBASE, and IEEE Xplore. The search strategy covered three main areas, namely wearable technology, rehabilitation, and setting. Potentially relevant studies were categorized as systems either evaluating methods or outcome parameters. Methodological qualities of studies were assessed by two customized checklists, depending on their categorization and rated independently by three blinded reviewers. Twelve studies involving ABT met the eligibility criteria, of which three studies were identified as having implemented ABT for rehabilitation purposes in non-clinical settings. From the twelve studies, seven studies achieved high methodological quality scores. These studies were not only capable of assessing the type, quantity, and quality measures of functional activities, but could also distinguish healthy from non-healthy subjects and/or address disease severity levels. While many studies support ABT's potential for telerehabilitation, few actually utilized it to assess mobility-related functional activities outside laboratory settings. To generate more appropriate outcome measures, there is a clear need to translate research findings and novel methods into practice.

Wearable accelerometry-based technology capable of assessing functional activities in neurological populations in community settings: a systematic review

PubMed Central

2014-01-01

Background Integrating rehabilitation services through wearable systems has the potential to accurately assess the type, intensity, duration, and quality of movement necessary for procuring key outcome measures. Objectives This review aims to explore wearable accelerometry-based technology (ABT) capable of assessing mobility-related functional activities intended for rehabilitation purposes in community settings for neurological populations. In this review, we focus on the accuracy of ABT-based methods, types of outcome measures, and the implementation of ABT in non-clinical settings for rehabilitation purposes. Data sources Cochrane, PubMed, Web of Knowledge, EMBASE, and IEEE Xplore. The search strategy covered three main areas, namely wearable technology, rehabilitation, and setting. Study selection Potentially relevant studies were categorized as systems either evaluating methods or outcome parameters. Methods Methodological qualities of studies were assessed by two customized checklists, depending on their categorization and rated independently by three blinded reviewers. Results Twelve studies involving ABT met the eligibility criteria, of which three studies were identified as having implemented ABT for rehabilitation purposes in non-clinical settings. From the twelve studies, seven studies achieved high methodological quality scores. These studies were not only capable of assessing the type, quantity, and quality measures of functional activities, but could also distinguish healthy from non-healthy subjects and/or address disease severity levels. Conclusion While many studies support ABT’s potential for telerehabilitation, few actually utilized it to assess mobility-related functional activities outside laboratory settings. To generate more appropriate outcome measures, there is a clear need to translate research findings and novel methods into practice. PMID:24625308

Risk of bias in overviews of reviews: a scoping review of methodological guidance and four-item checklist.

PubMed

Ballard, Madeleine; Montgomery, Paul

2017-03-01

To assess the conditions under which employing an overview of systematic reviews is likely to lead to a high risk of bias. To synthesise existing guidance concerning overview practice, a scoping review was conducted. Four electronic databases were searched with a pre-specified strategy (PROSPERO 2015:CRD42015027592) ending October 2015. Included studies needed to describe or develop overview methodology. Data were narratively synthesised to delineate areas highlighted as outstanding challenges or where methodological recommendations conflict. Twenty-four papers met the inclusion criteria. There is emerging debate regarding overlapping systematic reviews; systematic review scope; quality of included research; updating; and synthesizing and reporting results. While three functions for overviews have been proposed-identify gaps, explore heterogeneity, summarize evidence-overviews cannot perform the first; are unlikely to achieve the second and third simultaneously; and can only perform the third under specific circumstances. Namely, when identified systematic reviews meet the following four conditions: (1) include primary trials that do not substantially overlap, (2) match overview scope, (3) are of high methodological quality, and (4) are up-to-date. Considering the intended function of proposed overviews with the corresponding methodological conditions may improve the quality of this burgeoning publication type. Copyright © 2017 John Wiley & Sons, Ltd. Copyright © 2017 John Wiley & Sons, Ltd.

77 FR 69614 - Commission Information Collection Activities (FERC-714); Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-11-20

... to correlate rates and charges, assess reliability and other operating attributes in regulatory..., including the validity of the methodology and assumptions used; (3) ways to enhance the quality, utility and...

Cluster Randomised Trials in Cochrane Reviews: Evaluation of Methodological and Reporting Practice.

PubMed

Richardson, Marty; Garner, Paul; Donegan, Sarah

2016-01-01

Systematic reviews can include cluster-randomised controlled trials (C-RCTs), which require different analysis compared with standard individual-randomised controlled trials. However, it is not known whether review authors follow the methodological and reporting guidance when including these trials. The aim of this study was to assess the methodological and reporting practice of Cochrane reviews that included C-RCTs against criteria developed from existing guidance. Criteria were developed, based on methodological literature and personal experience supervising review production and quality. Criteria were grouped into four themes: identifying, reporting, assessing risk of bias, and analysing C-RCTs. The Cochrane Database of Systematic Reviews was searched (2nd December 2013), and the 50 most recent reviews that included C-RCTs were retrieved. Each review was then assessed using the criteria. The 50 reviews we identified were published by 26 Cochrane Review Groups between June 2013 and November 2013. For identifying C-RCTs, only 56% identified that C-RCTs were eligible for inclusion in the review in the eligibility criteria. For reporting C-RCTs, only eight (24%) of the 33 reviews reported the method of cluster adjustment for their included C-RCTs. For assessing risk of bias, only one review assessed all five C-RCT-specific risk-of-bias criteria. For analysing C-RCTs, of the 27 reviews that presented unadjusted data, only nine (33%) provided a warning that confidence intervals may be artificially narrow. Of the 34 reviews that reported data from unadjusted C-RCTs, only 13 (38%) excluded the unadjusted results from the meta-analyses. The methodological and reporting practices in Cochrane reviews incorporating C-RCTs could be greatly improved, particularly with regard to analyses. Criteria developed as part of the current study could be used by review authors or editors to identify errors and improve the quality of published systematic reviews incorporating C-RCTs.

Patient-reported outcomes in randomised controlled trials of colorectal cancer: an analysis determining the availability of robust data to inform clinical decision-making

PubMed Central

Whale, Katie; Fish, Daniel; Fayers, Peter; Cafaro, Valentina; Pusic, Andrea; Blazeby, Jane M.; Efficace, Fabio

2016-01-01

Purpose Randomised controlled trials (RCTs) are the most robust study design measuring outcomes of colorectal cancer (CRC) treatments, but to influence clinical practice trial design and reporting of patient-reported outcomes (PROs) must be of high quality. Objectives of this study were as follows: to examine the quality of PRO reporting in RCTs of CRC treatment; to assess the availability of robust data to inform clinical decision-making; and to investigate whether quality of reporting improved over time. Methods A systematic review from January 2004–February 2012 identified RCTs of CRC treatment describing PROs. Relevant abstracts were screened and manuscripts obtained. Methodological quality was assessed using International Society for Quality of Life Research—patient-reported outcome reporting standards. Changes in reporting quality over time were established by comparison with previous data, and risk of bias was assessed with the Cochrane risk of bias tool. Results Sixty-six RCTs were identified, seven studies (10 %) reported survival benefit favouring the experimental treatment, 35 trials (53 %) identified differences in PROs between treatment groups, and the clinical significance of these differences was discussed in 19 studies (29 %). The most commonly reported treatment type was chemotherapy (n = 45; 68 %). Improvements over time in key methodological issues including the documentation of missing data and the discussion of the clinical significance of PROs were found. Thirteen trials (20 %) had high-quality reporting. Conclusions Whilst improvements in PRO quality reporting over time were found, several recent studies still fail to robustly inform clinical practice. Quality of PRO reporting must continue to improve to maximise the clinical impact of PRO findings. PMID:25910987

Anti-bullying interventions in schools: a systematic literature review.

PubMed

Silva, Jorge Luiz da; Oliveira, Wanderlei Abadio de; Mello, Flávia Carvalho Malta de; Andrade, Luciane Sá de; Bazon, Marina Rezende; Silva, Marta Angélica Iossi

2017-07-01

This paper presents a systematic literature review addressing rigorously planned and assessed interventions intended to reduce school bullying. The search for papers was performed in four databases (Lilacs, Psycinfo, Scielo and Web of Science) and guided by the question: What are the interventions used to reduce bullying in schools? Only case-control studies specifically focusing on school bullying without a time frame were included. The methodological quality of investigations was assessed using the SIGN checklist. A total of 18 papers composed the corpus of analysis and all were considered to have high methodological quality. The interventions conducted in the revised studies were divided into four categories: multi-component or whole-school, social skills training, curricular, and computerized. The review synthesizes knowledge that can be used to contemplate practices and intervention programs in the education and health fields with a multidisciplinary nature.

Identification of sensitive indicators to assess the interrelationship between soil quality, management practices and human health

NASA Astrophysics Data System (ADS)

Zornoza, R.; Acosta, J. A.; Bastida, F.; Domínguez, S. G.; Toledo, D. M.; Faz, A.

2014-09-01

Soil quality (SQ) assessment has been a challenging issue since soils present high variability in properties and functions. This paper aims to increase understanding of SQ through review of SQ assessments in different scenarios providing evidence about the interrelationship between SQ, land use and human health. There is a general consensus that there is a need to develop methods to assess and monitor SQ for assuring sustainable land use with no prejudicial effects on human health. This review points out the importance of adopting indicators of different nature (physical, chemical and biological) to achieve a holistic image of SQ. Most authors use single indicators to assess SQ and its relationship with land uses, being the most used indicators soil organic carbon and pH. The use of nitrogen and nutrients content has resulted sensitive for agricultural and forest systems, together with physical properties such as texture, bulk density, available water and aggregate stability. These physical indicators have also been widely used to assess SQ after land use changes. The use of biological indicators is less generalized, being microbial biomass and enzyme activities the most selected indicators. Although most authors assess SQ using independent indicators, it is preferable to combine some of them into models to create a soil quality index (SQI), since it provides integrated information about soil processes and functioning. The majority of revised articles used the same methodology to establish a SQI, based on scoring and weighting of different soil indicators, selected by multivariate analyses. The use of multiple linear regressions has been successfully used under forest land use. Urban soil quality has been poorly assessed, with lack of adoption of SQIs. In addition, SQ assessments were human health indicators or exposure pathways are incorporated are practically inexistent. Thus, new efforts should be carried out to establish new methodologies not only to assess soil quality in terms of sustainability, productivity and ecosystems quality, but also human health. Additionally, new challenges arise with the use and integration into SQIs of stable isotopic, genomic, proteomic and spectroscopy data.

Identification of sensitive indicators to assess the interrelationship between soil quality, management practices and human health

NASA Astrophysics Data System (ADS)

Zornoza, R.; Acosta, J. A.; Bastida, F.; Domínguez, S. G.; Toledo, D. M.; Faz, A.

2015-02-01

Soil quality (SQ) assessment has long been a challenging issue, since soils present high variability in properties and functions. This paper aims to increase the understanding of SQ through the review of SQ assessments in different scenarios providing evidence about the interrelationship between SQ, land use and human health. There is a general consensus that there is a need to develop methods to assess and monitor SQ for assuring sustainable land use with no prejudicial effects on human health. This review points out the importance of adopting indicators of different nature (physical, chemical and biological) to achieve a holistic image of SQ. Most authors use single indicators to assess SQ and its relationship with land uses - soil organic carbon and pH being the most used indicators. The use of nitrogen and nutrient content has resulted sensitive for agricultural and forest systems, together with physical properties such as texture, bulk density, available water and aggregate stability. These physical indicators have also been widely used to assess SQ after land use changes. The use of biological indicators is less generalized, with microbial biomass and enzyme activities being the most selected indicators. Although most authors assess SQ using independent indicators, it is preferable to combine some of them into models to create a soil quality index (SQI), since it provides integrated information about soil processes and functioning. The majority of revised articles used the same methodology to establish an SQI, based on scoring and weighting of different soil indicators, selected by means of multivariate analyses. The use of multiple linear regressions has been successfully used for forest land use. Urban soil quality has been poorly assessed, with a lack of adoption of SQIs. In addition, SQ assessments where human health indicators or exposure pathways are incorporated are practically inexistent. Thus, further efforts should be carried out to establish new methodologies to assess soil quality not only in terms of sustainability, productivity and ecosystem quality but also human health. Additionally, new challenges arise with the use and integration of stable isotopic, genomic, proteomic and spectroscopic data into SQIs.

Visual land-use compatibility and scenic-resource quality

Treesearch

William G. Hendrix

1977-01-01

The effect that land-use relationships have upon perceived quality of the visual landscape is discussed, and a case is made for expansion of fit-misfit theory into what has been called visual land-use compatibility. An assessment methodology that was designed to test people's perceptions of land-use relationships is presented and the results are discussed.

A Retention Assessment Process: Utilizing Total Quality Management Principles and Focus Groups

ERIC Educational Resources Information Center

Codjoe, Henry M.; Helms, Marilyn M.

2005-01-01

Retaining students is a critical topic in higher education. Methodologies abound to gather attrition data as well as key variables important to retention. Using the theories of total quality management and focus groups, this case study gathers and reports data from current college students. Key results, suggestions for replication, and areas for…

Quantitative Research Methods, Study Quality, and Outcomes: The Case of Interaction Research

ERIC Educational Resources Information Center

Plonsky, Luke; Gass, Susan

2011-01-01

This article constitutes the first empirical assessment of methodological quality in second language acquisition (SLA). We surveyed a corpus of 174 studies (N = 7,951) within the tradition of research on second-language interaction, one of the longest and most influential traditions of inquiry in SLA. Each report was coded for methodological…

Studies in Environment--Volume II: Quality of Life.

ERIC Educational Resources Information Center

Hornback, Kenneth E.; And Others

This report investigates the concept of the Quality of Life (QOL) and presents a developmental methodology for constructing a measurement scheme to assess the QOL. A brief synopsis is given of the research that has been done in this area to date including various guidelines and rationale used in attempting to develop a meaningful social indicator…

Systematic evaluation of clinical practice guidelines for pharmacogenomics.

PubMed

Beckett, Robert D; Kisor, David F; Smith, Thomas; Vonada, Brooke

2018-06-01

To systematically assess methodological quality of pharmacogenomics clinical practice guidelines. Guidelines published through 2017 were reviewed by at least three independent reviewers using the AGREE II instrument, which consists of 23 items grouped into 6 domains and 2 items representing an overall assessment. Items were assessed on a seven-point rating scale, and aggregate quality scores were calculated. 31 articles were included. All guidelines were published as peer-reviewed articles and 90% (n = 28) were endorsed by professional organizations. Mean AGREE II domain scores (maximum score 100%) ranged from 46.6 ± 11.5% ('applicability') to 78.9 ± 11.4% ('clarity of presentation'). Median overall quality score was 72.2% (IQR: 61.1-77.8%). Quality of pharmacogenomics guidelines was generally high, but variable, for most AGREE II domains.

Systematic Review of Knowledge Translation Strategies to Promote Research Uptake in Child Health Settings.

PubMed

Albrecht, Lauren; Archibald, Mandy; Snelgrove-Clarke, Erna; Scott, Shannon D

2016-01-01

Strategies to assist evidence-based decision-making for healthcare professionals are crucial to ensure high quality patient care and outcomes. The goal of this systematic review was to identify and synthesize the evidence on knowledge translation interventions aimed at putting explicit research evidence into child health practice. A comprehensive search of thirteen electronic databases was conducted, restricted by date (1985-2011) and language (English). Articles were included if: 1) studies were randomized controlled trials (RCT), controlled clinical trials (CCT), or controlled before-and-after (CBA) studies; 2) target population was child health professionals; 3) interventions implemented research in child health practice; and 4) outcomes were measured at the professional/process, patient, or economic level. Two reviewers independently extracted data and assessed methodological quality. Study data were aggregated and analyzed using evidence tables. Twenty-one studies (13 RCT, 2 CCT, 6 CBA) were included. The studies employed single (n=9) and multiple interventions (n=12). The methodological quality of the included studies was largely moderate (n=8) or weak (n=11). Of the studies with moderate to strong methodological quality ratings, three demonstrated consistent, positive effect(s) on the primary outcome(s); effective knowledge translation interventions were two single, non-educational interventions and one multiple, educational intervention. This multidisciplinary systematic review in child health setting identified effective knowledge translation strategies assessed by the most rigorous research designs. Given the overall poor quality of the research literature, specific recommendations were made to improve knowledge translation efforts in child health. Copyright © 2016 Elsevier Inc. All rights reserved.

Sensory stimulation for persons with dementia: a review of the literature.

PubMed

Strøm, Benedicte S; Ytrehus, Siri; Grov, Ellen-Karine

2016-07-01

To provide an overview of available sensory stimulation interventions, and their effect on persons with dementia and to present theoretical and methodological characteristics of the studies included. Different sensory stimulation interventions are used for persons with dementia to increase alertness, reduce agitation and improve quality of life. However, the effect of these interventions is not clear, neither are their characteristics. A systematic search and review of the literature with description of the content and an evaluation of theoretical and methodological approaches. Systematic searches in CINAHL, PubMed (Medline), The Cochrane library and PsycINFO. Studies included have been subject to quality assessment by means of Critical Appraisal Skills Programme. Fifty-five studies were included and thirty of these documented significant effect. The effect of the sensory stimulation interventions mainly reported on negative behaviours, except from five studies assessing quality of life and well-being. The majority of the studies had methodological limitations. The different sensory stimulation interventions were organised into eight categories: music, light therapy, acupressure/reflexology, massage/aromatherapy and doll therapy/pet therapy/toy therapy, the Sonas programme and Snoezelen. More studies are needed to clarify appropriate substantial background for the specific interventions. However, most of the studies based their interventions on a theoretical foundation. Furthermore, more research is needed to measure the effect of sensory stimulation on communication as well as quality of life. In addition, studies are to focus on whether the effect depends on the stage of dementia. Nurses are to be aware of sensory stimulation as a possible intervention to improve persons' quality of life. © 2016 John Wiley & Sons Ltd.

Systematic Review of Childhood Sedentary Behavior Questionnaires: What do We Know and What is Next?

PubMed

Hidding, Lisan M; Altenburg, Teatske M; Mokkink, Lidwine B; Terwee, Caroline B; Chinapaw, Mai J M

2017-04-01

Accurate measurement of child sedentary behavior is necessary for monitoring trends, examining health effects, and evaluating the effectiveness of interventions. We therefore aimed to summarize studies examining the measurement properties of self-report or proxy-report sedentary behavior questionnaires for children and adolescents under the age of 18 years. Additionally, we provided an overview of the characteristics of the evaluated questionnaires. We performed systematic literature searches in the EMBASE, PubMed, and SPORTDiscus electronic databases. Studies had to report on at least one measurement property of a questionnaire assessing sedentary behavior. Questionnaire data were extracted using a standardized checklist, i.e. the Quality Assessment of Physical Activity Questionnaire (QAPAQ) checklist, and the methodological quality of the included studies was rated using a standardized tool, i.e. the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Forty-six studies on 46 questionnaires met our inclusion criteria, of which 33 examined test-retest reliability, nine examined measurement error, two examined internal consistency, 22 examined construct validity, eight examined content validity, and two examined structural validity. The majority of the included studies were of fair or poor methodological quality. Of the studies with at least a fair methodological quality, six scored positive on test-retest reliability, and two scored positive on construct validity. None of the questionnaires included in this review were considered as both valid and reliable. High-quality studies on the most promising questionnaires are required, with more attention to the content validity of the questionnaires. PROSPERO registration number: CRD42016035963.

Lean interventions in healthcare: do they actually work? A systematic literature review

PubMed Central

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-01-01

Purpose Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. Data sources We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Study selection Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data extraction Data on design, methods, interventions and key outcomes were extracted and collated. Results of data synthesis Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. Conclusion While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. PMID:26811118

Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research

PubMed Central

Weng, Chunhua

2013-01-01

Objective To review the methods and dimensions of data quality assessment in the context of electronic health record (EHR) data reuse for research. Materials and methods A review of the clinical research literature discussing data quality assessment methodology for EHR data was performed. Using an iterative process, the aspects of data quality being measured were abstracted and categorized, as well as the methods of assessment used. Results Five dimensions of data quality were identified, which are completeness, correctness, concordance, plausibility, and currency, and seven broad categories of data quality assessment methods: comparison with gold standards, data element agreement, data source agreement, distribution comparison, validity checks, log review, and element presence. Discussion Examination of the methods by which clinical researchers have investigated the quality and suitability of EHR data for research shows that there are fundamental features of data quality, which may be difficult to measure, as well as proxy dimensions. Researchers interested in the reuse of EHR data for clinical research are recommended to consider the adoption of a consistent taxonomy of EHR data quality, to remain aware of the task-dependence of data quality, to integrate work on data quality assessment from other fields, and to adopt systematic, empirically driven, statistically based methods of data quality assessment. Conclusion There is currently little consistency or potential generalizability in the methods used to assess EHR data quality. If the reuse of EHR data for clinical research is to become accepted, researchers should adopt validated, systematic methods of EHR data quality assessment. PMID:22733976

Water resources vulnerability assessment in the Adriatic Sea region: the case of Corfu Island.

PubMed

Kanakoudis, Vasilis; Tsitsifli, Stavroula; Papadopoulou, Anastasia; Cencur Curk, Barbara; Karleusa, Barbara

2017-09-01

Cross-border water resources management and protection is a complicated task to achieve, lacking a common methodological framework. Especially in the Adriatic region, water used for drinking water supply purposes pass from many different countries, turning its management into a hard task to achieve. During the DRINKADRIA project, a common methodological framework has been developed, for efficient and effective cross-border water supply and resources management, taking into consideration different resources types (surface and groundwater) emphasizing in drinking water supply intake. The common methodology for water resources management is based on four pillars: climate characteristics and climate change, water resources availability, quality, and security. The present paper assesses both present and future vulnerability of water resources in the Adriatic region, with special focus on Corfu Island, Greece. The results showed that climate change is expected to impact negatively on water resources availability while at the same time, water demand is expected to increase. Water quality problems will be intensified especially due to land use changes and salt water intrusion. The analysis identified areas where water resources are more vulnerable, allowing decision makers develop management strategies.

The Ocean Colour Climate Change Initiative: I. A Methodology for Assessing Atmospheric Correction Processors Based on In-Situ Measurements

NASA Technical Reports Server (NTRS)

Muller, Dagmar; Krasemann, Hajo; Brewin, Robert J. W.; Deschamps, Pierre-Yves; Doerffer, Roland; Fomferra, Norman; Franz, Bryan A.; Grant, Mike G.; Groom, Steve B.; Melin, Frederic;

Systematic review of studies on measurement properties of instruments for adults published in the American Journal of Occupational Therapy, 2009-2013.

PubMed

Yuen, Hon K; Austin, Sarah L

2014-01-01

We describe the methodological quality of recent studies on instrument development and testing published in the American Journal of Occupational Therapy (AJOT). We conducted a systematic review using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist to appraise 48 articles on measurement properties of assessments for adults published in AJOT between 2009 and 2013. Most studies had adequate methodological quality in design and statistical analysis. Common methodological limitations included that methods used to examine internal consistency were not consistently linked to the theoretical constructs underpinning assessments; participants in some test-retest reliability studies were not stable during the interim period; and in several studies of reliability and convergent validity, sample sizes were inadequate. AJOT's dissemination of psychometric research evidence has made important contributions to moving the profession toward the American Occupational Therapy Association's Centennial Vision. This study's results provide a benchmark by which to evaluate future accomplishments. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Cochrane Systematic Reviews of Chinese Herbal Medicines: An Overview

PubMed Central

Hu, Jing; Zhang, Junhua; Zhao, Wei; Zhang, Yongling; Zhang, Li; Shang, Hongcai

2011-01-01

Objectives Our study had two objectives: a) to systematically identify all existing systematic reviews of Chinese herbal medicines (CHM) published in Cochrane Library; b) to assess the methodological quality of included reviews. Methodology/Principal Findings We performed a systematic search of the Cochrane Database of Systematic Reviews (CDSR, Issue 5, 2010) to identify all reviews of CHM. A total of fifty-eight reviews were eligible for our study. Twenty-one of the included reviews had at least one Traditional Chinese Medicine (TCM) practitioner as its co-author. 7 reviews didn't include any primary study, the remaining reviews (n = 51) included a median of 9 studies and 936 participants. 50% of reviews were last assessed as up-to-date prior to 2008. The questions addressed by 39 reviews were broad in scope, in which 9 reviews combined studies with different herbal medicines. For OQAQ, the mean of overall quality score (item 10) was 5.05 (95% CI; 4.58-5.52). All reviews assessed the methodological quality of primary studies, 16% of included primary studies used adequate sequence generation and 7% used adequate allocation concealment. Of the 51 nonempty reviews, 23 reviews were reported as being inconclusive, while 27 concluded that there might be benefit of CHM, which was limited by the poor quality or inadequate quantity of included studies. 58 reviews reported searching a median of seven electronic databases, while 10 reviews did not search any Chinese database. Conclusions Now CDSR has included large numbers of CHM reviews, our study identified some areas which could be improved, such as almost half of included reviews did not have the participation of TCM practitioners and were not up-to-date according to Cochrane criteria, some reviews pooled the results of different herbal medicines and ignored the searching of Chinese databases. PMID:22174870

Analysis of the Quality of Clinical Trials Published in Spanish-Language Dermatology Journals Between 1997 and 2012.

PubMed

Sanclemente, G; Pardo, H; Sánchez, S; Bonfill, X

2016-01-01

The value of randomized clinical trials (RCTs) undertaken to identify an association between an intervention and an outcome is determined by their quality and scientific rigor. To assess the methodological quality of RCTs published in Spanish-language dermatology journals. By way of a systematic manual search, we identified all the RCTs in journals published in Spain and Latin America between 1997 (the year in which the CONSORT statement was published) and 2012. Risk of bias was evaluated for each RCT by assessing the following domains: randomization sequence generation, allocation concealment, blinding of patients and those assessing outcomes, missing data, and patient follow-up. Source of funding and conflict of interest statements, if any, were recorded for each study. The search identified 70 RCTs published in 21 journals. Most of the RCTs had a high risk of bias, primarily because of gaps in the reporting of important methodological aspects. The source of funding was reported in only 15 studies. In spite of the considerable number of Spanish and Latin American journals, few RCTs have been published in the 15 years analyzed. Most of the RCTs published had serious defects in that the authors omitted methodological information essential to any evaluation of the quality of the trial and failed to report sources of funding or possible conflicts of interest for the authors involved. Authors of experimental clinical research in dermatology published in Spain and Latin America need to substantially improve both the design of their trials and the reporting of results. Copyright © 2015 Elsevier España, S.L.U. and AEDV. All rights reserved.

Patient-reported outcomes in randomised controlled trials of prostate cancer: methodological quality and impact on clinical decision making.

PubMed

Efficace, Fabio; Feuerstein, Michael; Fayers, Peter; Cafaro, Valentina; Eastham, James; Pusic, Andrea; Blazeby, Jane

2014-09-01

Patient-reported outcomes (PRO) data from randomised controlled trials (RCTs) are increasingly used to inform patient-centred care as well as clinical and health policy decisions. The main objective of this study was to investigate the methodological quality of PRO assessment in RCTs of prostate cancer (PCa) and to estimate the likely impact of these studies on clinical decision making. A systematic literature search of studies was undertaken on main electronic databases to retrieve articles published between January 2004 and March 2012. RCTs were evaluated on a predetermined extraction form, including (1) basic trial demographics and clinical and PRO characteristics; (2) level of PRO reporting based on the recently published recommendations by the International Society for Quality of Life Research; and (3) bias, assessed using the Cochrane Risk of Bias tool. Studies were systematically analysed to evaluate their relevance for supporting clinical decision making. Sixty-five RCTs enrolling a total of 22 071 patients were evaluated, with 31 (48%) in patients with nonmetastatic disease. When a PRO difference between treatments was found, it related in most cases to symptoms only (n=29, 58%). Although the extent of missing data was generally documented (72% of RCTs), few reported details on statistical handling of this data (18%) and reasons for dropout (35%). Improvements in key methodological aspects over time were found. Thirteen (20%) RCTs were judged as likely to be robust in informing clinical decision making. Higher-quality PRO studies were generally associated with those RCTs that had higher internal validity. Including PRO in RCTs of PCa patients is critical for better evaluating the treatment effectiveness of new therapeutic approaches. Marked improvements in PRO quality reporting over time were found, and it is estimated that at least one-fifth of PRO RCTs have provided sufficient details to allow health policy makers and physicians to make critical appraisals of results. In this report, we have investigated the methodological quality of PCa trials that have included a PRO assessment. We conclude that including PRO is critical to better evaluating the treatment effectiveness of new therapeutic approaches from the patient's perspective. Also, at least one-fifth of PRO RCTs in PCa have provided sufficient details to allow health policy makers and physicians to make a critical appraisal of results. Copyright © 2013. Published by Elsevier B.V.

The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation.

PubMed

Lewis, Cara C; Stanick, Cameo F; Martinez, Ruben G; Weiner, Bryan J; Kim, Mimi; Barwick, Melanie; Comtois, Katherine A

2015-01-08

Identification of psychometrically strong instruments for the field of implementation science is a high priority underscored in a recent National Institutes of Health working meeting (October 2013). Existing instrument reviews are limited in scope, methods, and findings. The Society for Implementation Research Collaboration Instrument Review Project's objectives address these limitations by identifying and applying a unique methodology to conduct a systematic and comprehensive review of quantitative instruments assessing constructs delineated in two of the field's most widely used frameworks, adopt a systematic search process (using standard search strings), and engage an international team of experts to assess the full range of psychometric criteria (reliability, construct and criterion validity). Although this work focuses on implementation of psychosocial interventions in mental health and health-care settings, the methodology and results will likely be useful across a broad spectrum of settings. This effort has culminated in a centralized online open-access repository of instruments depicting graphical head-to-head comparisons of their psychometric properties. This article describes the methodology and preliminary outcomes. The seven stages of the review, synthesis, and evaluation methodology include (1) setting the scope for the review, (2) identifying frameworks to organize and complete the review, (3) generating a search protocol for the literature review of constructs, (4) literature review of specific instruments, (5) development of an evidence-based assessment rating criteria, (6) data extraction and rating instrument quality by a task force of implementation experts to inform knowledge synthesis, and (7) the creation of a website repository. To date, this multi-faceted and collaborative search and synthesis methodology has identified over 420 instruments related to 34 constructs (total 48 including subconstructs) that are relevant to implementation science. Despite numerous constructs having greater than 20 available instruments, which implies saturation, preliminary results suggest that few instruments stem from gold standard development procedures. We anticipate identifying few high-quality, psychometrically sound instruments once our evidence-based assessment rating criteria have been applied. The results of this methodology may enhance the rigor of implementation science evaluations by systematically facilitating access to psychometrically validated instruments and identifying where further instrument development is needed.

Six-minute walk test as a determinant of the functional capacity of children and adolescents with cystic fibrosis: A systematic review.

PubMed

Andrade Lima, Cibelle; Dornelas de Andrade, Armèle; Campos, Shirley Lima; Brandão, Daniella Cunha; Mourato, Ianny Pereira; Britto, Murilo Carlos Amorim de

2018-04-01

Cystic Fibrosis (CF) is a multisystem disorder. The involvement of the respiratory system is frequent and culminates in dyspnea and exercise intolerance. Functional capacity is an important diagnostic tool, because it reflects the cardiorespiratory status, quality of life and prognosis. This systematic review aims to assess the reproducibility and validity of the six minute walk test (6MWT) to reflect the functional capacity of children and adolescents with cystic fibrosis, and also the correlation between 6MWT and lung function. Searches for articles were performed in eight databases using MeSH/DeCS keywords. A total of 695 articles were found and, after verifying all eligibility criteria, six articles were included for analysis and scoring regarding the methodological quality according to the QUADAS scale (Quality Assessment of Diagnostic Accuracy Studies). All articles had good methodology (QUADAS between 9 and 11 points). The 6MWT is not correlated with lung function. There is a strong indication that the 6MWT is a reproducible test to assess the functional capacity of children and adolescents with CF. The validity assessment could not be reached because the studies included in this systematic review did not use adequate statistical tools to carry out such an evaluation. Copyright © 2018 Elsevier Ltd. All rights reserved.

Task-based image quality assessment in radiation therapy: initial characterization and demonstration with CT simulation images

NASA Astrophysics Data System (ADS)

Dolly, Steven R.; Anastasio, Mark A.; Yu, Lifeng; Li, Hua

2017-03-01

In current radiation therapy practice, image quality is still assessed subjectively or by utilizing physically-based metrics. Recently, a methodology for objective task-based image quality (IQ) assessment in radiation therapy was proposed by Barrett et al.1 In this work, we present a comprehensive implementation and evaluation of this new IQ assessment methodology. A modular simulation framework was designed to perform an automated, computer-simulated end-to-end radiation therapy treatment. A fully simulated framework was created that utilizes new learning-based stochastic object models (SOM) to obtain known organ boundaries, generates a set of images directly from the numerical phantoms created with the SOM, and automates the image segmentation and treatment planning steps of a radiation therapy work ow. By use of this computational framework, therapeutic operating characteristic (TOC) curves can be computed and the area under the TOC curve (AUTOC) can be employed as a figure-of-merit to guide optimization of different components of the treatment planning process. The developed computational framework is employed to optimize X-ray CT pre-treatment imaging. We demonstrate that use of the radiation therapy-based-based IQ measures lead to different imaging parameters than obtained by use of physical-based measures.

Attention, effort, and fatigue: Neuropsychological perspectives

NASA Technical Reports Server (NTRS)

Cohen, Ronald A.; Odonnell, Brian F.

1988-01-01

Models of attention, effort, and fatigue are reviewed. Methods are discussed for measuring these phenomena from a neuropsychological and psychophysiological perspective. The following methodologies are included: (1) the autonomic measurement of cognitive effort and quality of encoding; (2) serial assessment approaches to neurophysiological assessment; and (3) the assessment of subjective reports of fatigue using multidimensional ratings and their relationship to neurobehavioral measures.

Methodologic European external quality assurance for DNA sequencing: the EQUALseq program.

PubMed

Ahmad-Nejad, Parviz; Dorn-Beineke, Alexandra; Pfeiffer, Ulrike; Brade, Joachim; Geilenkeuser, Wolf-Jochen; Ramsden, Simon; Pazzagli, Mario; Neumaier, Michael

2006-04-01

DNA sequencing is a key technique in molecular diagnostics, but to date no comprehensive methodologic external quality assessment (EQA) programs have been instituted. Between 2003 and 2005, the European Union funded, as specific support actions, the EQUAL initiative to develop methodologic EQA schemes for genotyping (EQUALqual), quantitative PCR (EQUALquant), and sequencing (EQUALseq). Here we report on the results of the EQUALseq program. The participating laboratories received a 4-sample set comprising 2 DNA plasmids, a PCR product, and a finished sequencing reaction to be analyzed. Data and information from detailed questionnaires were uploaded online and evaluated by use of a scoring system for technical skills and proficiency of data interpretation. Sixty laboratories from 21 European countries registered, and 43 participants (72%) returned data and samples. Capillary electrophoresis was the predominant platform (n = 39; 91%). The median contiguous correct sequence stretch was 527 nucleotides with considerable variation in quality of both primary data and data evaluation. The association between laboratory performance and the number of sequencing assays/year was statistically significant (P <0.05). Interestingly, more than 30% of participants neither added comments to their data nor made efforts to identify the gene sequences or mutational positions. Considerable variations exist even in a highly standardized methodology such as DNA sequencing. Methodologic EQAs are appropriate tools to uncover strengths and weaknesses in both technique and proficiency, and our results emphasize the need for mandatory EQAs. The results of EQUALseq should help improve the overall quality of molecular genetics findings obtained by DNA sequencing.

Assessment Methodology for Process Validation Lifecycle Stage 3A.

PubMed

Sayeed-Desta, Naheed; Pazhayattil, Ajay Babu; Collins, Jordan; Chen, Shu; Ingram, Marzena; Spes, Jana

2017-07-01

The paper introduces evaluation methodologies and associated statistical approaches for process validation lifecycle Stage 3A. The assessment tools proposed can be applied to newly developed and launched small molecule as well as bio-pharma products, where substantial process and product knowledge has been gathered. The following elements may be included in Stage 3A: number of 3A batch determination; evaluation of critical material attributes, critical process parameters, critical quality attributes; in vivo in vitro correlation; estimation of inherent process variability (IPV) and PaCS index; process capability and quality dashboard (PCQd); and enhanced control strategy. US FDA guidance on Process Validation: General Principles and Practices, January 2011 encourages applying previous credible experience with suitably similar products and processes. A complete Stage 3A evaluation is a valuable resource for product development and future risk mitigation of similar products and processes. Elements of 3A assessment were developed to address industry and regulatory guidance requirements. The conclusions made provide sufficient information to make a scientific and risk-based decision on product robustness.

Evaluation of Cross-Cultural Adaptation and Measurement Properties of STarT Back Screening Tool: A Systematic Review.

PubMed

Al Zoubi, Fadi M; Eilayyan, Owis; Mayo, Nancy E; Bussières, André E

2017-10-01

The purpose of this systematic review was to investigate the extent to which the STarT Back Screening Tool (SBST) has been evaluated for (1) the quality of translation of evidence for cross-cultural adaptation and (2) the measurement properties in languages other than English. A systematic search of 8 databases, including Medline, Embase, CINAHL, PsycINFO, AMED, Scopus, PubMed, and Web of Science, was performed. Electronic databases were searched for the period between 2008 and December 27, 2016. We included studies related to cross-cultural adaptation, including translation and assessment of the measurement properties of SBST. Study selection, translation, methodologic and quality assessments, and data extraction were performed independently by 2 reviewers. Of the 1566 citations retrieved, 17 studies were admissible, representing 11 different SBST versions in 10 languages. The quadratic weighted κ statistics of the 2 reviewers, for the translation, methodologic assessment, and quality assessment were 0.85, 0.76, and 0.83, respectively. For translation, only 2 versions (Belgian-French and Mandarin) fulfilled all requirements. None of the versions had tested all the measurement properties, and when performed, these were found to have been conducted inadequately. With regard to quality assessment, overall, the included versions had a "Poor" total summary score except 2 (Persian and Swiss-German), which were rated as "Fair." Few versions fully met the standard criteria for valid translation, and none of the versions tested all the measurement properties. There is a clear need for more accurate cross-cultural adaptation of SBST and greater attention to the quality of psychometric evaluation of the adapted versions of SBST. At this time, caution is recommended when using SBST in languages other than English. Copyright © 2017. Published by Elsevier Inc.

Quality of reporting in oncology phase II trials: A 5-year assessment through systematic review.

PubMed

Langrand-Escure, Julien; Rivoirard, Romain; Oriol, Mathieu; Tinquaut, Fabien; Rancoule, Chloé; Chauvin, Frank; Magné, Nicolas; Bourmaud, Aurélie

2017-01-01

Phase II clinical trials are a cornerstone of the development in experimental treatments They work as a "filter" for phase III trials confirmation. Surprisingly the attrition ratio in Phase III trials in oncology is significantly higher than in any other medical specialty. This suggests phase II trials in oncology fail to achieve their goal. Objective The present study aims at estimating the quality of reporting in published oncology phase II clinical trials. A literature review was conducted among all phase II and phase II/III clinical trials published during a 5-year period (2010-2015). All articles electronically published by three randomly-selected oncology journals with Impact-Factors>4 were included: Journal of Clinical Oncology, Annals of Oncology and British Journal of Cancer. Quality of reporting was assessed using the Key Methodological Score. 557 articles were included. 315 trials were single-arm studies (56.6%), 193 (34.6%) were randomized and 49 (8.8%) were non-randomized multiple-arm studies. The Methodological Score was equal to 0 (lowest level), 1, 2, 3 (highest level) respectively for 22 (3.9%), 119 (21.4%), 270 (48.5%) and 146 (26.2%) articles. The primary end point is almost systematically reported (90.5%), while sample size calculation is missing in 66% of the articles. 3 variables were independently associated with reporting of a high standard: presence of statistical design (p-value <0.001), multicenter trial (p-value = 0.012), per-protocol analysis (p-value <0.001). Screening was mainly performed by a sole author. The Key Methodological Score was based on only 3 items, making grey zones difficult to translate. This literature review highlights the existence of gaps concerning the quality of reporting. It therefore raised the question of the suitability of the methodology as well as the quality of these trials, reporting being incomplete in the corresponding articles.

Quality of reporting in oncology phase II trials: A 5-year assessment through systematic review

PubMed Central

Langrand-Escure, Julien; Rivoirard, Romain; Oriol, Mathieu; Tinquaut, Fabien; Rancoule, Chloé; Chauvin, Frank; Magné, Nicolas; Bourmaud, Aurélie

2017-01-01

Background Phase II clinical trials are a cornerstone of the development in experimental treatments They work as a "filter" for phase III trials confirmation. Surprisingly the attrition ratio in Phase III trials in oncology is significantly higher than in any other medical specialty. This suggests phase II trials in oncology fail to achieve their goal. Objective The present study aims at estimating the quality of reporting in published oncology phase II clinical trials. Data sources A literature review was conducted among all phase II and phase II/III clinical trials published during a 5-year period (2010–2015). Study eligibility criteria All articles electronically published by three randomly-selected oncology journals with Impact-Factors>4 were included: Journal of Clinical Oncology, Annals of Oncology and British Journal of Cancer. Intervention Quality of reporting was assessed using the Key Methodological Score. Results 557 articles were included. 315 trials were single-arm studies (56.6%), 193 (34.6%) were randomized and 49 (8.8%) were non-randomized multiple-arm studies. The Methodological Score was equal to 0 (lowest level), 1, 2, 3 (highest level) respectively for 22 (3.9%), 119 (21.4%), 270 (48.5%) and 146 (26.2%) articles. The primary end point is almost systematically reported (90.5%), while sample size calculation is missing in 66% of the articles. 3 variables were independently associated with reporting of a high standard: presence of statistical design (p-value <0.001), multicenter trial (p-value = 0.012), per-protocol analysis (p-value <0.001). Limitations Screening was mainly performed by a sole author. The Key Methodological Score was based on only 3 items, making grey zones difficult to translate. Conclusions & implications of key findings This literature review highlights the existence of gaps concerning the quality of reporting. It therefore raised the question of the suitability of the methodology as well as the quality of these trials, reporting being incomplete in the corresponding articles. PMID:29216190

Quality of life assessment in children: a review of conceptual and methodological issues in multidimensional health status measures.

PubMed Central

Pal, D K

1996-01-01

STUDY OBJECTIVE: To clarify concepts and methodological problems in existing multidimensional health status measures for children. DESIGN: Thematic review of instruments found by computerised and manual searches, 1979-95. SUBJECTS: Nine health status instruments. MAIN RESULTS: Many instruments did not satisfy criteria of being child centered or family focussed; few had sufficient psychometric properties for research or clinical use; underlying conceptual assumptions were rarely explicit. CONCLUSIONS: Quality of life measures should be viewed cautiously. Interdisciplinary discussion is required, as well as discussion with children and parents, to establish constructs that are truly useful. PMID:8882220

[Goals, possibilities and limits of quality evaluation of guidelines. A background report on the user manual of the "Methodological Quality of Guidelines" check list].

PubMed

Helou, A; Ollenschläger, G

1998-06-01

Recently a German appraisal instrument for clinical guidelines was published that could be used by various parties in formal evaluation of guidelines. An user's guide to the appraisal instrument was designed that contains a detailed explanation for each question to ensure that the instrument is interpreted consistently. This paper describes the purposes, format and contents of the user's guide, and reviews the key factors influencing the validity of guidelines. Taking into account international experiences, the purposes, chances and methodological limitations of a prospective assessment of clinical practice guidelines are discussed.

[Field investigations of the air pollution level of populated territories].

PubMed

Vinokurov, M V

2014-01-01

The assessment and management of air quality of settlements is one of the priorities in the field of environmental protection. In the management of air quality the backbone factor is the methodology of the organization, performance and interpretation of data of field investigations. The present article is devoted to the analysis of the existing methodological approaches and practical aspects of their application in the organization and performance of field investigations with the aim to confirm the adequacy of the boundaries of the sanitary protection zone in the old industrial regions, hygienic evaluation of the data of field investigations of the air pollution level.

Surveying Consumer Satisfaction to Assess Managed-Care Quality: Current Practices

PubMed Central

Gold, Marsha; Wooldridge, Judith

1995-01-01

Growing interest in using consumer satisfaction information to enhance quality of care and promote informed consumer choice has accompanied recent expansions in managed care. This article synthesizes information about consumer satisfaction surveys conducted by managed-care plans, government and other agencies, community groups, and purchasers of care. We discuss survey content, methods, and use of consumer survey information. Differences in the use of consumer surveys preclude one instrument or methodology from meeting all needs. The effectiveness of plan-based surveys could be enhanced by increased information on alternative survey instruments and methods and new methodological studies, such as ones developing risk-adjustment methods. PMID:10151887

Contemporary health care economics: an overview.

PubMed

McLaughlin, Nancy; Ong, Michael K; Tabbush, Victor; Hagigi, Farhad; Martin, Neil A

2014-11-01

Economic evaluations provide a decision-making framework in which outcomes (benefits) and costs are assessed for various alternative options. Although the interest in complete and partial economic evaluations has increased over the past 2 decades, the quality of studies has been marginal due to methodological challenges or incomplete cost determination. This paper provides an overview of the main types of complete and partial economic evaluations, reviews key methodological elements to be considered for any economic evaluation, and reviews concepts of cost determination. The goal is to provide the clinician neurosurgeon with the knowledge and tools needed to appraise published economic evaluations and to direct high-quality health economic evaluations.

Measuring Impact of U.S. DOE Geothermal Technologies Office Funding: Considerations for Development of a Geothermal Resource Reporting Metric

DOE Office of Scientific and Technical Information (OSTI.GOV)

Young, Katherine R.; Wall, Anna M.; Dobson, Patrick F.

This paper reviews existing methodologies and reporting codes used to describe extracted energy resources such as coal and oil and describes a comparable proposed methodology to describe geothermal resources. The goal is to provide the U.S. Department of Energy's (DOE) Geothermal Technologies Office (GTO) with a consistent and comprehensible means of assessing the impacts of its funding programs. This framework will allow for GTO to assess the effectiveness of research, development, and deployment (RD&D) funding, prioritize funding requests, and demonstrate the value of RD&D programs to the U.S. Congress. Standards and reporting codes used in other countries and energy sectorsmore » provide guidance to inform development of a geothermal methodology, but industry feedback and our analysis suggest that the existing models have drawbacks that should be addressed. In order to formulate a comprehensive metric for use by GTO, we analyzed existing resource assessments and reporting methodologies for the geothermal, mining, and oil and gas industries, and we sought input from industry, investors, academia, national labs, and other government agencies. Using this background research as a guide, we describe a methodology for assessing and reporting on GTO funding according to resource knowledge and resource grade (or quality). This methodology would allow GTO to target funding or measure impact by progression of projects or geological potential for development.« less

Chinese herbal medicine for cancer-related fatigue: a systematic review of randomized clinical trials.

PubMed

Su, Chun-Xiang; Wang, Li-Qiong; Grant, Suzanne J; Liu, Jian-Ping

2014-06-01

To assess the effectiveness and safety of Chinese herbal medicine for the treatment of cancer-related fatigue. We systematically searched seven electronic databases and two trial registries for randomized clinical trials of Chinese herbal medicine for cancer-related fatigue. Two authors independently extracted data and assessed the methodological quality of the included trials using the Cochrane risk of bias tool. Data were synthesized using RevMan 5.2 software. A total of 10 trials involving 751 participants with cancer-related fatigue were identified and the methodological quality of the included trials was generally poor. Chinese herbal medicine used alone or in combination with chemotherapy or supportive care showed significant relief in cancer-related fatigue compared to placebo, chemotherapy or supportive care based on single trials. Chinese herbal medicine plus chemotherapy or supportive care was superior to chemotherapy or supportive care in improving quality of life. Data from one trial demonstrated Chinese herbal medicine exerted a greater beneficial effect on relieving anxiety but no difference in alleviating depression. Seven trials reported adverse events and no severe adverse effects were found in Chinese herbal medicine groups. The findings from limited number of trials suggest that Chinese herbal medicine seems to be effective and safe in the treatment of cancer-related fatigue. However, the current evidence is insufficient to draw a confirmative conclusion due to the poor methodological quality of included trials. Thus, conducting rigorously designed trials on potential Chinese herbal medicine is warranted. Copyright © 2014 Elsevier Ltd. All rights reserved.

Adding spatial flexibility to source-receptor relationships for air quality modeling.

PubMed

Pisoni, E; Clappier, A; Degraeuwe, B; Thunis, P

2017-04-01

To cope with computing power limitations, air quality models that are used in integrated assessment applications are generally approximated by simpler expressions referred to as "source-receptor relationships (SRR)". In addition to speed, it is desirable for the SRR also to be spatially flexible (application over a wide range of situations) and to require a "light setup" (based on a limited number of full Air Quality Models - AQM simulations). But "speed", "flexibility" and "light setup" do not naturally come together and a good compromise must be ensured that preserves "accuracy", i.e. a good comparability between SRR results and AQM. In this work we further develop a SRR methodology to better capture spatial flexibility. The updated methodology is based on a cell-to-cell relationship, in which a bell-shape function links emissions to concentrations. Maintaining a cell-to-cell relationship is shown to be the key element needed to ensure spatial flexibility, while at the same time the proposed approach to link emissions and concentrations guarantees a "light set-up" phase. Validation has been repeated on different areas and domain sizes (countries, regions, province throughout Europe) for precursors reduced independently or contemporarily. All runs showed a bias around 10% between the full AQM and the SRR. This methodology allows assessing the impact on air quality of emission scenarios applied over any given area in Europe (regions, set of regions, countries), provided that a limited number of AQM simulations are performed for training.

Best evidence on the educational effects of undergraduate portfolios.

PubMed

Buckley, Sharon; Coleman, Jamie; Khan, Khalid

2010-09-01

The great variety of portfolio types and schemes used in the education of health professionals is reflected in the extensive and diverse educational literature relating to portfolio use. We have recently completed a Best Evidence Medical Education (BEME) systematic review of the literature relating to the use of portfolios in the undergraduate setting that offers clinical teachers insights into both their effects on learning and issues to consider in portfolio implementation. Using a methodology based on BEME recommendations, we searched the literature relating to a range of health professions, identifying evidence for the effects of portfolios on undergraduate student learning, and assessing the methodological quality of each study. The higher quality studies in our review report that, when implemented appropriately, portfolios can improve students' ability to integrate theory with practice, can encourage their self-awareness and reflection, and can offer support for students facing difficult emotional situations. Portfolios can also enhance student-tutor relationships and prepare students for the rigours of postgraduate training. However, the time required to complete a portfolio may detract from students' clinical learning. An analysis of methodological quality against year of publication suggests that, across a range of health professions, the quality of the literature relating to the educational effects of portfolios is improving. However, further work is still required to build the evidence base for the educational effects of portfolios, particularly comparative studies that assess effects on learning directly. Our findings have implications for the design and implementation of portfolios in the undergraduate setting. © Blackwell Publishing Ltd 2010.

Principles of Assessment for Project and Research Based Learning

ERIC Educational Resources Information Center

Hunaiti, Ziad; Grimaldi, Silvia; Goven, Dharmendra; Mootanah, Rajshree; Martin, Louise

2010-01-01

Purpose: The purpose of this paper is to provide assessment guidelines which help to implement research-based education in science and technology areas, which would benefit from the quality of this type of education within this subject area. Design/methodology/approach: This paper is a reflection on, and analysis of, different aspects of…

Assessment of Competence in Clinical Reasoning and Decision-Making under Uncertainty: The Script Concordance Test Method

ERIC Educational Resources Information Center

Ramaekers, Stephan; Kremer, Wim; Pilot, Albert; van Beukelen, Peter; van Keulen, Hanno

2010-01-01

Real-life, complex problems often require that decisions are made despite limited information or insufficient time to explore all relevant aspects. Incorporating authentic uncertainties into an assessment, however, poses problems in establishing results and analysing their methodological qualities. This study aims at developing a test on clinical…

Where does good quality qualitative health care research get published?

PubMed

Richardson, Jane C; Liddle, Jennifer

2017-09-01

This short report aims to give some insight into current publication patterns for high-quality qualitative health research, using the Research Excellence Framework (REF) 2014 database. We explored patterns of publication by range and type of journal, by date and by methodological focus. We also looked at variations between the publications submitted to different Units of Assessment, focussing particularly on the one most closely aligned with our own research area of primary care. Our brief analysis demonstrates that general medical/health journals with high impact factors are the dominant routes of publication, but there is variation according to the methodological approach adopted by articles. The number of qualitative health articles submitted to REF 2014 overall was small, and even more so for articles based on mixed methods research, qualitative methodology or reviews/syntheses that included qualitative articles.

A Control Law Design Method Facilitating Control Power, Robustness, Agility, and Flying Qualities Tradeoffs: CRAFT

NASA Technical Reports Server (NTRS)

Murphy, Patrick C.; Davidson, John B.

1998-01-01

A multi-input, multi-output control law design methodology, named "CRAFT", is presented. CRAFT stands for the design objectives addressed, namely, Control power, Robustness, Agility, and Flying Qualities Tradeoffs. The methodology makes use of control law design metrics from each of the four design objective areas. It combines eigenspace assignment, which allows for direct specification of eigenvalues and eigenvectors, with a graphical approach for representing the metrics that captures numerous design goals in one composite illustration. Sensitivity of the metrics to eigenspace choice is clearly displayed, enabling the designer to assess the cost of design tradeoffs. This approach enhances the designer's ability to make informed design tradeoffs and to reach effective final designs. An example of the CRAFT methodology applied to an advanced experimental fighter and discussion of associated design issues are provided.

Photovoltaic Impact Assessment of Smart Inverter Volt-VAR Control on Distribution System Conservation Voltage Reduction and Power Quality

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ding, Fei; Nagarajan, Adarsh; Chakraborty, Sudipta

This report presents an impact assessment study of distributed photovoltaic (PV) with smart inverter Volt-VAR control on conservation voltage reduction (CVR) energy savings and distribution system power quality. CVR is a methodology of flattening and lowering a distribution system voltage profile in order to conserve energy. Traditional CVR relies on operating utility voltage regulators and switched capacitors. However, with the increased penetration of distributed PV systems, smart inverters provide the new opportunity to control local voltage and power factor by regulating the reactive power output, leading to a potential increase in CVR energy savings. This report proposes a methodology tomore » implement CVR scheme by operating voltage regulators, capacitors, and autonomous smart inverter Volt-VAR control in order to achieve increased CVR benefit. Power quality is an important consideration when operating a distribution system, especially when implementing CVR. It is easy to measure the individual components that make up power quality, but a comprehensive method to incorporate all of these values into a single score has yet to be undertaken. As a result, this report proposes a power quality scoring mechanism to measure the relative power quality of distribution systems using a single number, which is aptly named the 'power quality score' (PQS). Both the CVR and PQS methodologies were applied to two distribution system models, one obtained from the Hawaiian Electric Company (HECO) and another obtained from Pacific Gas and Electric (PG&E). These two models were converted to the OpenDSS platform using previous model conversion tools that were developed by NREL. Multiple scenarios including various PV penetration levels and smart inverter densities were simulated to analyze the impact of smart inverter Volt-VAR support on CVR energy savings and feeder power quality. In order to analyze the CVR benefit and PQS, an annual simulation was conducted for each scenario.« less

Occupational Noise and Ischemic Heart Disease: A Systematic Review

PubMed Central

Dzhambov, Angel M; Dimitrova, Donka D

2016-01-01

Noise exposure might be a risk factor for ischemic heart disease (IHD). Unlike residential exposure, however, evidence for occupational noise is limited. Given that high-quality quantitative synthesis of existing data is highly warranted for occupational safety and policy, we aimed at conducting a systematic review and meta-analysis of the risks of IHD morbidity and mortality because of occupational noise exposure. We carried out a systematic search in MEDLINE, EMBASE, and on the Internet since April 2, 2015, in English, Spanish, Russian, and Bulgarian. A quality-scoring checklist was developed a priori to assess different sources of methodological bias. A qualitative data synthesis was performed. Conservative assumptions were applied when appropriate. A meta-analysis was not feasible because of unresolvable methodological discrepancies between the studies. On the basis of five studies, there was some evidence to suggest higher risk of IHD among workers exposed to objectively assessed noise >75–80 dB for <20 years (supported by one high, one moderate, and one low quality study, opposed by one high and one moderate quality study). Three moderate and two low quality studies out of six found self-rated exposure to be associated with higher risk of IHD, and only one moderate quality study found no effect. Out of four studies, a higher mortality risk was suggested by one moderate quality study relying on self-rated exposure and one of high-quality study using objective exposure. Sensitivity analyses showed that at higher exposures and in some vulnerable subgroups, such as women, the adverse effects were considerably stronger. Despite methodological discrepancies and limitations of the included studies, occupational noise appeared to be a risk factor for IHD morbidity. Results suggested higher risk for IHD mortality only among vulnerable subgroups. Workers exposed to high occupational noise should be considered at higher overall risk of IHD. PMID:27569404

Evaluation of Quality of Lower Limb Arthroplasty Observational Studies Using the Assessment of Quality in Lower Limb Arthroplasty (AQUILA) Checklist.

PubMed

Cowan, James B; Mlynarek, Ryan A; Nelissen, Rob G H H; Pijls, Bart G C W; Gagnier, Joel J

2015-09-01

This study used the assessment of quality in lower limb arthroplasty (AQUILA) checklist to assess the quality of lower limb arthroplasty observational studies. Among 132 studies the mean reporting quality score was 5.4 (SD=1.2) out of 8 possible points. Most studies adequately reported reasons for revisions (98%) and prosthesis brand and fixation (95%) in sufficient detail. Only 3% of studies adequately reported the number of patients unwilling to participate, 15% stated a clear primary research question or hypothesis, 11% reported a worst-case analysis or competing risk analysis for endpoints, and 42% reported more than 5% of patients were lost to follow-up. There is significant room for improvement in the reporting and methodology of lower limb arthroplasty observational studies. Level III. Copyright © 2015 Elsevier Inc. All rights reserved.

Overview of integrative tools and methods in assessing ecological integrity in estuarine and coastal systems worldwide.

PubMed

Borja, Angel; Bricker, Suzanne B; Dauer, Daniel M; Demetriades, Nicolette T; Ferreira, João G; Forbes, Anthony T; Hutchings, Pat; Jia, Xiaoping; Kenchington, Richard; Carlos Marques, João; Zhu, Changbo

2008-09-01

In recent years, several sets of legislation worldwide (Oceans Act in USA, Australia or Canada; Water Framework Directive or Marine Strategy in Europe, National Water Act in South Africa, etc.) have been developed in order to address ecological quality or integrity, within estuarine and coastal systems. Most such legislation seeks to define quality in an integrative way, by using several biological elements, together with physico-chemical and pollution elements. Such an approach allows assessment of ecological status at the ecosystem level ('ecosystem approach' or 'holistic approach' methodologies), rather than at species level (e.g. mussel biomonitoring or Mussel Watch) or just at chemical level (i.e. quality objectives) alone. Increasing attention has been paid to the development of tools for different physico-chemical or biological (phytoplankton, zooplankton, benthos, algae, phanerogams, fishes) elements of the ecosystems. However, few methodologies integrate all the elements into a single evaluation of a water body. The need for such integrative tools to assess ecosystem quality is very important, both from a scientific and stakeholder point of view. Politicians and managers need information from simple and pragmatic, but scientifically sound methodologies, in order to show to society the evolution of a zone (estuary, coastal area, etc.), taking into account human pressures or recovery processes. These approaches include: (i) multidisciplinarity, inherent in the teams involved in their implementation; (ii) integration of biotic and abiotic factors; (iii) accurate and validated methods in determining ecological integrity; and (iv) adequate indicators to follow the evolution of the monitored ecosystems. While some countries increasingly use the establishment of marine parks to conserve marine biodiversity and ecological integrity, there is awareness (e.g. in Australia) that conservation and management of marine ecosystems cannot be restricted to Marine Protected Areas but must include areas outside such reserves. This contribution reviews the current situation of integrative ecological assessment worldwide, by presenting several examples from each of the continents: Africa, Asia, Australia, Europe and North America.

Do Men Produce Higher Quality Ejaculates When Primed With Thoughts of Partner Infidelity?

PubMed

Pham, Michael N; Barbaro, Nicole; Holub, Andrew M; Holden, Christopher J; Mogilski, Justin K; Lopes, Guilherme S; Nicolas, Sylis C A; Sela, Yael; Shackelford, Todd K; Zeigler-Hill, Virgil; Welling, Lisa L M

2018-01-01

Sperm competition theory can be used to generate the hypothesis that men alter the quality of their ejaculates as a function of sperm competition risk. Using a repeated measures experimental design, we investigated whether men produce a higher quality ejaculate when primed with cues to sperm competition (i.e., imagined partner infidelity) relative to a control prime. Men ( n = 45) submitted two masturbatory ejaculates-one ejaculate sample for each condition (i.e., sperm competition and control conditions). Ejaculates were assessed on 17 clinical parameters. The results did not support the hypothesis: Men did not produce higher quality ejaculates in the sperm competition condition relative to the control condition. Despite the null results of the current research, there is evidence for psychological and physiological adaptations to sperm competition in humans. We discuss methodological limitations that may have produced the null results and present methodological suggestions for research on human sperm competition.

Air quality assessment of benzo(a)pyrene from asphalt plant operation.

PubMed

Gibson, Nigel; Stewart, Robert; Rankin, Erika

2012-01-01

A study has been carried out to assess the contribution of Polycyclic Aromatic Hydrocarbons (PAHs) from asphalt plant operation, utilising Benzo(a)pyrene (BaP) as a marker for PAHs, to the background air concentration around asphalt plants in the UK. The purpose behind this assessment was to determine whether the use of published BaP emission factors based on the US Environmental Protection Agency (EPA) methodology is appropriate in the context of the UK, especially as the EPA methodology does not give BaP emission factors for all activities. The study also aimed to improve the overall understanding of BaP emissions from asphalt plants in the UK, and determine whether site location and operation is likely to influence the contribution of PAHs to ambient air quality. In order to establish whether the use of US EPA emissions factors is appropriate, the study has compared the BaP emissions measured and calculated emissions rates from two UK sites with those estimated using US EPA emission factors. A dispersion modelling exercise was carried out to show the BaP contribution to ambient air around each site. This study showed that, as the US EPA methodology does not provide factors for all emission sources on asphalt plants, their use may give rise to over- or under-estimations, particularly where sources of BaP are temperature dependent. However, the contribution of both the estimated and measured BaP concentrations to environmental concentration were low, averaging about 0.05 ng m(-3) at the boundary of the sites, which is well below the UK BaP assessment threshold of 0.25 ng m(-3). Therefore, BaP concentrations, and hence PAH concentrations, from similar asphalt plant operations are unlikely to contribute negatively to ambient air quality.

Synthesising quantitative and qualitative research in evidence-based patient information.

PubMed

Goldsmith, Megan R; Bankhead, Clare R; Austoker, Joan

2007-03-01

Systematic reviews have, in the past, focused on quantitative studies and clinical effectiveness, while excluding qualitative evidence. Qualitative research can inform evidence-based practice independently of other research methodologies but methods for the synthesis of such data are currently evolving. Synthesising quantitative and qualitative research in a single review is an important methodological challenge. This paper describes the review methods developed and the difficulties encountered during the process of updating a systematic review of evidence to inform guidelines for the content of patient information related to cervical screening. Systematic searches of 12 electronic databases (January 1996 to July 2004) were conducted. Studies that evaluated the content of information provided to women about cervical screening or that addressed women's information needs were assessed for inclusion. A data extraction form and quality assessment criteria were developed from published resources. A non-quantitative synthesis was conducted and a tabular evidence profile for each important outcome (eg "explain what the test involves") was prepared. The overall quality of evidence for each outcome was then assessed using an approach published by the GRADE working group, which was adapted to suit the review questions and modified to include qualitative research evidence. Quantitative and qualitative studies were considered separately for every outcome. 32 papers were included in the systematic review following data extraction and assessment of methodological quality. The review questions were best answered by evidence from a range of data sources. The inclusion of qualitative research, which was often highly relevant and specific to many components of the screening information materials, enabled the production of a set of recommendations that will directly affect policy within the NHS Cervical Screening Programme. A practical example is provided of how quantitative and qualitative data sources might successfully be brought together and considered in one review.

Clinical trials of homoeopathy.

PubMed Central

Kleijnen, J; Knipschild, P; ter Riet, G

1991-01-01

OBJECTIVE--To establish whether there is evidence of the efficacy of homoeopathy from controlled trials in humans. DESIGN--Criteria based meta-analysis. Assessment of the methodological quality of 107 controlled trials in 96 published reports found after an extensive search. Trials were scored using a list of predefined criteria of good methodology, and the outcome of the trials was interpreted in relation to their quality. SETTING--Controlled trials published world wide. MAIN OUTCOME MEASURES--Results of the trials with the best methodological quality. Trials of classical homoeopathy and several modern varieties were considered separately. RESULTS--In 14 trials some form of classical homoeopathy was tested and in 58 trials the same single homoeopathic treatment was given to patients with comparable conventional diagnosis. Combinations of several homoeopathic treatments were tested in 26 trials; isopathy was tested in nine trials. Most trials seemed to be of very low quality, but there were many exceptions. The results showed a positive trend regardless of the quality of the trial or the variety of homeopathy used. Overall, of the 105 trials with interpretable results, 81 trials indicated positive results whereas in 24 trials no positive effects of homoeopathy were found. The results of the review may be complicated by publication bias, especially in such a controversial subject as homoeopathy. CONCLUSIONS--At the moment the evidence of clinical trials is positive but not sufficient to draw definitive conclusions because most trials are of low methodological quality and because of the unknown role of publication bias. This indicates that there is a legitimate case for further evaluation of homoeopathy, but only by means of well performed trials. PMID:1825800

Methodological challenges in assessing the environmental status of a marine ecosystem: case study of the Baltic Sea.

PubMed

Ojaveer, Henn; Eero, Margit

2011-04-29

Assessments of the environmental status of marine ecosystems are increasingly needed to inform management decisions and regulate human pressures to meet the objectives of environmental policies. This paper addresses some generic methodological challenges and related uncertainties involved in marine ecosystem assessment, using the central Baltic Sea as a case study. The objectives of good environmental status of the Baltic Sea are largely focusing on biodiversity, eutrophication and hazardous substances. In this paper, we conduct comparative evaluations of the status of these three segments, by applying different methodological approaches. Our analyses indicate that the assessment results are sensitive to a selection of indicators for ecological quality objectives that are affected by a broad spectrum of human activities and natural processes (biodiversity), less so for objectives that are influenced by a relatively narrow array of drivers (eutrophications, hazardous substances). The choice of indicator aggregation rule appeared to be of essential importance for assessment results for all three segments, whereas the hierarchical structure of indicators had only a minor influence. Trend-based assessment was shown to be a useful supplement to reference-based evaluation, being independent of the problems related to defining reference values and indicator aggregation methodologies. Results of this study will help in setting priorities for future efforts to improve environmental assessments in the Baltic Sea and elsewhere, and to ensure the transparency of the assessment procedure.

Methodological quality in randomised controlled trials of transcutaneous electric nerve stimulation for pain: low fidelity may explain negative findings.

PubMed

Bennett, Michael I; Hughes, Nicola; Johnson, Mark I

2011-06-01

The benefits of transcutaneous electrical nerve stimulation (TENS) for pain relief have not been reliably established, as most systematic reviews find poor methodological quality in many studies. The paradox within the evidence base for TENS is that despite identified sources of bias that may lead to an overestimation of treatment effects, no benefits for TENS can be clearly demonstrated. Conventional assessments of quality assume a single direction of bias, and little work has been undertaken examining other directions of bias. Our hypothesis was that low fidelity in studies (bias leading to an underestimation of treatment effects) may account for inconclusive findings. We included 38 studies from 3 recently published Cochrane systematic reviews that examined TENS for acute, chronic, and cancer pain. We extracted data relating to treatment allocation, application of TENS and to the assessment of outcomes. We quantified these data and judged this against standardised assessment criteria using a "traffic light" approach based on the number of studies reaching the standard. We identified significant sources of potential bias in both directions in relation to study design and implementation fidelity that have not been quantified previously. Suboptimal dosing of TENS and inappropriate outcome assessment were particularly prevalent weaknesses indicating low fidelity. We propose criteria for judging directions of bias in future studies of TENS that may be adapted to assess other trials in which implementation fidelity is important, such as other nonpharmacological interventions for pain. Poor implementation fidelity was identified as a significant source of bias in systematic reviews of TENS studies and might explain lack of consistent treatment effects of TENS in pain. Here, criteria for assessing methodology are proposed for use in designing future clinical trials of TENS. Copyright © 2010 International Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.

Modeling of process of forming quality parameters for surfaces of parts by diamond burnishing taking into account technological heredity

NASA Astrophysics Data System (ADS)

Nagorkin, M. N.; Fyodorov, V. P.; Kovalyova, E. V.

2018-03-01

The paper presents a methodology for quantitative assessment of the influence of technological heredity on the formation of quality parameters for surfaces of machine parts. An example of an estimation of influence factors of technological subsystems of processing by end milling processing by composite 10 and the subsequent diamond burnishing is presented.

An Empirical Appraisal of Canadian Doctoral Dissertations Using Grounded Theory: Implications for Social Work Research and Teaching

ERIC Educational Resources Information Center

Braganza, Morgan; Akesson, Bree; Rothwell, David

2017-01-01

Grounded theory is a popular methodological approach in social work research, especially by doctoral students conducting qualitative research. The approach, however, is not always used consistently or as originally designed, compromising the quality of the research. The aim of the current study is to assess the quality of recent Canadian social…

Using COPE To Improve Quality of Care: The Experience of the Family Planning Association of Kenya.

ERIC Educational Resources Information Center

Bradley, Janet

1998-01-01

COPE (Client-Oriented, Provider-Efficient) methodology, a self-assessment tool that has been used in 35 countries around the world, was used to improve the quality of care in family planning clinics in Kenya. COPE involves a process that legitimately invests power with providers and clinic-level staff. It gives providers more control over their…

Methodological issues and recommendations for systematic reviews of prognostic studies: an example from cardiovascular disease.

PubMed

Dretzke, Janine; Ensor, Joie; Bayliss, Sue; Hodgkinson, James; Lordkipanidzé, Marie; Riley, Richard D; Fitzmaurice, David; Moore, David

2014-12-03

Prognostic factors are associated with the risk of future health outcomes in individuals with a particular health condition. The prognostic ability of such factors is increasingly being assessed in both primary research and systematic reviews. Systematic review methodology in this area is continuing to evolve, reflected in variable approaches to key methodological aspects. The aim of this article was to (i) explore and compare the methodology of systematic reviews of prognostic factors undertaken for the same clinical question, (ii) to discuss implications for review findings, and (iii) to present recommendations on what might be considered to be 'good practice' approaches. The sample was comprised of eight systematic reviews addressing the same clinical question, namely whether 'aspirin resistance' (a potential prognostic factor) has prognostic utility relative to future vascular events in patients on aspirin therapy for secondary prevention. A detailed comparison of methods around study identification, study selection, quality assessment, approaches to analysis, and reporting of findings was undertaken and the implications discussed. These were summarised into key considerations that may be transferable to future systematic reviews of prognostic factors. Across systematic reviews addressing the same clinical question, there were considerable differences in the numbers of studies identified and overlap between included studies, which could only partially be explained by different study eligibility criteria. Incomplete reporting and differences in terminology within primary studies hampered study identification and selection process across reviews. Quality assessment was highly variable and only one systematic review considered a checklist for studies of prognostic questions. There was inconsistency between reviews in approaches towards analysis, synthesis, addressing heterogeneity and reporting of results. Different methodological approaches may ultimately affect the findings and interpretation of systematic reviews of prognostic research, with implications for clinical decision-making.

Standardised survey method for identifying catchment risks to water quality.

PubMed

Baker, D L; Ferguson, C M; Chier, P; Warnecke, M; Watkinson, A

2016-06-01

This paper describes the development and application of a systematic methodology to identify and quantify risks in drinking water and recreational catchments. The methodology assesses microbial and chemical contaminants from both diffuse and point sources within a catchment using Escherichia coli, protozoan pathogens and chemicals (including fuel and pesticides) as index contaminants. Hazard source information is gathered by a defined sanitary survey process involving use of a software tool which groups hazards into six types: sewage infrastructure, on-site sewage systems, industrial, stormwater, agriculture and recreational sites. The survey estimates the likelihood of the site affecting catchment water quality, and the potential consequences, enabling the calculation of risk for individual sites. These risks are integrated to calculate a cumulative risk for each sub-catchment and the whole catchment. The cumulative risks process accounts for the proportion of potential input sources surveyed and for transfer of contaminants from upstream to downstream sub-catchments. The output risk matrices show the relative risk sources for each of the index contaminants, highlighting those with the greatest impact on water quality at a sub-catchment and catchment level. Verification of the sanitary survey assessments and prioritisation is achieved by comparison with water quality data and microbial source tracking.

Integrated assessment of urban drainage system under the framework of uncertainty analysis.

PubMed

Dong, X; Chen, J; Zeng, S; Zhao, D

2008-01-01

Due to a rapid urbanization as well as the presence of large number of aging urban infrastructures in China, the urban drainage system is facing a dual pressure of construction and renovation nationwide. This leads to the need for an integrated assessment when an urban drainage system is under planning or re-design. In this paper, an integrated assessment methodology is proposed based upon the approaches of analytic hierarchy process (AHP), uncertainty analysis, mathematical simulation of urban drainage system and fuzzy assessment. To illustrate this methodology, a case study in Shenzhen City of south China has been implemented to evaluate and compare two different urban drainage system renovation plans, i.e., the distributed plan and the centralized plan. By comparing their water quality impacts, ecological impacts, technological feasibility and economic costs, the integrated performance of the distributed plan is found to be both better and robust. The proposed methodology is also found to be both effective and practical. (c) IWA Publishing 2008.

What is covered by "cancer rehabilitation" in PubMed? A review of randomized controlled trials 1990-2011.

PubMed

Gudbergsson, Sævar Berg; Dahl, Alv A; Loge, Jon Håvard; Thorsen, Lene; Oldervoll, Line M; Grov, Ellen K

2015-02-01

This focused review examines randomized controlled studies included by the term "cancer rehabilitation" in PubMed. The research questions concern the type of interventions performed and their methodological quality. Using the Medical Subject Headings (MeSH) terms: neoplasm AND rehabilitation, all articles with randomized controlled studies that included adult cancer patients, written in English, were extracted from PubMed. Papers covering physical exercise, psychiatric/psychological treatment or social support only were excluded as they had been reviewed recently. Abstracts and papers were assessed by 3 pairs of reviewers, and descriptive information was extracted systematically. Methodological quality was rated on a 10-item index scale, and the cut-off for acceptable quality was set at ≥ 8. A total of 132 (19%) of the 683 identified papers met the eligibility criteria and were assessed in detail. The papers were grouped into 5 thematic categories: 44 physical; 15 art and expressive; 47 psycho-educative; 21 emotionally supportive; and 5 others. Good quality of design was observed in 32 studies, 18 of them uni-dimensional and 14 multi-dimensional. Published randomized controlled studies on cancer rehabilitation are heterogeneous in terms of content and samples, and are mostly characterized by suboptimal design quality. Future studies should be more specific and well-designed with sufficient statistical strength.

Efficacy of exercise therapy in workers with rotator cuff tendinopathy: a systematic review

PubMed Central

Desmeules, François; Boudreault, Jennifer; Dionne, Clermont E.; Frémont, Pierre; Lowry, Véronique; MacDermid, Joy C.; Roy, Jean-Sébastien

2016-01-01

Objective: To perform a systematic review of randomized controlled trials (RCTs) on the efficacy of therapeutic exercises for workers suffering from rotator cuff (RC) tendinopathy. Methods: A literature search in four bibliographical databases (Pubmed, CINAHL, EMBASE, and PEDro) was conducted from inception up to February 2015. RCTs were included if participants were workers suffering from RC tendinopathy, the outcome measures included work-related outcomes, and at least one of the interventions under study included exercises. The methodological quality of the studies was evaluated with the Cochrane Risk of Bias Assessment tool. Results: The mean methodological score of the ten included studies was 54.4%±17.2%. Types of workers included were often not defined, and work-related outcome measures were heterogeneous and often not validated. Three RCTs of moderate methodological quality concluded that exercises were superior to a placebo or no intervention in terms of function and return-to-work outcomes. No significant difference was found between surgery and exercises based on the results of two studies of low to moderate methodological quality. One study of low methodological quality, comparing a workplace-based exercise program focusing on the participants' work demands to an exercise program delivered in a clinical setting, concluded that the work-based intervention was superior in terms of function and return-to-work outcomes. Conclusion: There is low to moderate-grade evidence that therapeutic exercises provided in a clinical setting are an effective modality to treat workers suffering from RC tendinopathy and to promote return-to-work. Further high quality studies comparing different rehabilitation programs including exercises in different settings with defined workers populations are needed to draw firm conclusions on the optimal program to treat workers. PMID:27488037

Psychometric evaluation of commonly used game-specific skills tests in rugby: A systematic review

PubMed Central

Oorschot, Sander; Chiwaridzo, Matthew; CM Smits-Engelsman, Bouwien

2017-01-01

Objectives To (1) give an overview of commonly used game-specific skills tests in rugby and (2) evaluate available psychometric information of these tests. Methods The databases PubMed, MEDLINE CINAHL and Africa Wide information were systematically searched for articles published between January 1995 and March 2017. First, commonly used game-specific skills tests were identified. Second, the available psychometrics of these tests were evaluated and the methodological quality of the studies assessed using the Consensus-based Standards for the selection of health Measurement Instruments checklist. Studies included in the first step had to report detailed information on the construct and testing procedure of at least one game-specific skill, and studies included in the second step had additionally to report at least one psychometric property evaluating reliability, validity or responsiveness. Results 287 articles were identified in the first step, of which 30 articles met the inclusion criteria and 64 articles were identified in the second step of which 10 articles were included. Reactive agility, tackling and simulated rugby games were the most commonly used tests. All 10 studies reporting psychometrics reported reliability outcomes, revealing mainly strong evidence. However, all studies scored poor or fair on methodological quality. Four studies reported validity outcomes in which mainly moderate evidence was indicated, but all articles had fair methodological quality. Conclusion Game-specific skills tests indicated mainly high reliability and validity evidence, but the studies lacked methodological quality. Reactive agility seems to be a promising domain, but the specific tests need further development. Future high methodological quality studies are required in order to develop valid and reliable test batteries for rugby talent identification. Trial registration number PROSPERO CRD42015029747. PMID:29259812

Efficacy of exercise therapy in workers with rotator cuff tendinopathy: a systematic review.

PubMed

Desmeules, François; Boudreault, Jennifer; Dionne, Clermont E; Frémont, Pierre; Lowry, Véronique; MacDermid, Joy C; Roy, Jean-Sébastien

2016-09-30

To perform a systematic review of randomized controlled trials (RCTs) on the efficacy of therapeutic exercises for workers suffering from rotator cuff (RC) tendinopathy. A literature search in four bibliographical databases (Pubmed, CINAHL, EMBASE, and PEDro) was conducted from inception up to February 2015. RCTs were included if participants were workers suffering from RC tendinopathy, the outcome measures included work-related outcomes, and at least one of the interventions under study included exercises. The methodological quality of the studies was evaluated with the Cochrane Risk of Bias Assessment tool. The mean methodological score of the ten included studies was 54.4%±17.2%. Types of workers included were often not defined, and work-related outcome measures were heterogeneous and often not validated. Three RCTs of moderate methodological quality concluded that exercises were superior to a placebo or no intervention in terms of function and return-to-work outcomes. No significant difference was found between surgery and exercises based on the results of two studies of low to moderate methodological quality. One study of low methodological quality, comparing a workplace-based exercise program focusing on the participants' work demands to an exercise program delivered in a clinical setting, concluded that the work-based intervention was superior in terms of function and return-to-work outcomes. There is low to moderate-grade evidence that therapeutic exercises provided in a clinical setting are an effective modality to treat workers suffering from RC tendinopathy and to promote return-to-work. Further high quality studies comparing different rehabilitation programs including exercises in different settings with defined workers populations are needed to draw firm conclusions on the optimal program to treat workers.

Comparison of tools for assessing the methodological quality of primary and secondary studies in health technology assessment reports in Germany.

PubMed

Dreier, Maren; Borutta, Birgit; Stahmeyer, Jona; Krauth, Christian; Walter, Ulla

2010-06-14

HEALTH CARE POLICY BACKGROUND: Findings from scientific studies form the basis for evidence-based health policy decisions. Quality assessments to evaluate the credibility of study results are an essential part of health technology assessment reports and systematic reviews. Quality assessment tools (QAT) for assessing the study quality examine to what extent study results are systematically distorted by confounding or bias (internal validity). The tools can be divided into checklists, scales and component ratings. What QAT are available to assess the quality of interventional studies or studies in the field of health economics, how do they differ from each other and what conclusions can be drawn from these results for quality assessments? A systematic search of relevant databases from 1988 onwards is done, supplemented by screening of the references, of the HTA reports of the German Agency for Health Technology Assessment (DAHTA) and an internet search. The selection of relevant literature, the data extraction and the quality assessment are carried out by two independent reviewers. The substantive elements of the QAT are extracted using a modified criteria list consisting of items and domains specific to randomized trials, observational studies, diagnostic studies, systematic reviews and health economic studies. Based on the number of covered items and domains, more and less comprehensive QAT are distinguished. In order to exchange experiences regarding problems in the practical application of tools, a workshop is hosted. A total of eight systematic methodological reviews is identified as well as 147 QAT: 15 for systematic reviews, 80 for randomized trials, 30 for observational studies, 17 for diagnostic studies and 22 for health economic studies. The tools vary considerably with regard to the content, the performance and quality of operationalisation. Some tools do not only include the items of internal validity but also the items of quality of reporting and external validity. No tool covers all elements or domains. Design-specific generic tools are presented, which cover most of the content criteria. The evaluation of QAT by using content criteria is difficult, because there is no scientific consensus on the necessary elements of internal validity, and not all of the generally accepted elements are based on empirical evidence. Comparing QAT with regard to contents neglects the operationalisation of the respective parameters, for which the quality and precision are important for transparency, replicability, the correct assessment and interrater reliability. QAT, which mix items on the quality of reporting and internal validity, should be avoided. There are different, design-specific tools available which can be preferred for quality assessment, because of its wider coverage of substantive elements of internal validity. To minimise the subjectivity of the assessment, tools with a detailed and precise operationalisation of the individual elements should be applied. For health economic studies, tools should be developed and complemented with instructions, which define the appropriateness of the criteria. Further research is needed to identify study characteristics that influence the internal validity of studies.

Intra-Articular Cellular Therapy for Osteoarthritis and Focal Cartilage Defects of the Knee: A Systematic Review of the Literature and Study Quality Analysis.

PubMed

Chahla, Jorge; Piuzzi, Nicolas S; Mitchell, Justin J; Dean, Chase S; Pascual-Garrido, Cecilia; LaPrade, Robert F; Muschler, George F

2016-09-21

Intra-articular cellular therapy injections constitute an appealing strategy that may modify the intra-articular milieu or regenerate cartilage in the settings of osteoarthritis and focal cartilage defects. However, little consensus exists regarding the indications for cellular therapies, optimal cell sources, methods of preparation and delivery, or means by which outcomes should be reported. We present a systematic review of the current literature regarding the safety and efficacy of cellular therapy delivered by intra-articular injection in the knee that provided a Level of Evidence of III or higher. A total of 420 papers were screened. Methodological quality was assessed using a modified Coleman methodology score. Only 6 studies (4 Level II and 2 Level III) met the criteria to be included in this review; 3 studies were on treatment of osteoarthritis and 3 were on treatment of focal cartilage defects. These included 4 randomized controlled studies without blinding, 1 prospective cohort study, and 1 retrospective therapeutic case-control study. The studies varied widely with respect to cell sources, cell characterization, adjuvant therapies, and assessment of outcomes. Outcome was reported in a total of 300 knees (124 in the osteoarthritis studies and 176 in the cartilage defect studies). Mean follow-up was 21.0 months (range, 12 to 36 months). All studies reported improved outcomes with intra-articular cellular therapy and no major adverse events. The mean modified Coleman methodology score was 59.1 ± 16 (range, 32 to 82). The studies of intra-articular cellular therapy injections for osteoarthritis and focal cartilage defects in the human knee suggested positive results with respect to clinical improvement and safety. However, the improvement was modest and a placebo effect cannot be disregarded. The overall quality of the literature was poor, and the methodological quality was fair, even among Level-II and III studies. Effective clinical assessment and optimization of injection therapies will demand greater attention to study methodology, including blinding; standardized quantitative methods for cell harvesting, processing, characterization, and delivery; and standardized reporting of clinical and structural outcomes. Therapeutic Level III. See Instructions for Authors for a complete description of levels of evidence. Copyright © 2016 by The Journal of Bone and Joint Surgery, Incorporated.

How Methodologic Differences Affect Results of Economic Analyses: A Systematic Review of Interferon Gamma Release Assays for the Diagnosis of LTBI

PubMed Central

Oxlade, Olivia; Pinto, Marcia; Trajman, Anete; Menzies, Dick

2013-01-01

Introduction Cost effectiveness analyses (CEA) can provide useful information on how to invest limited funds, however they are less useful if different analysis of the same intervention provide unclear or contradictory results. The objective of our study was to conduct a systematic review of methodologic aspects of CEA that evaluate Interferon Gamma Release Assays (IGRA) for the detection of Latent Tuberculosis Infection (LTBI), in order to understand how differences affect study results. Methods A systematic review of studies was conducted with particular focus on study quality and the variability in inputs used in models used to assess cost-effectiveness. A common decision analysis model of the IGRA versus Tuberculin Skin Test (TST) screening strategy was developed and used to quantify the impact on predicted results of observed differences of model inputs taken from the studies identified. Results Thirteen studies were ultimately included in the review. Several specific methodologic issues were identified across studies, including how study inputs were selected, inconsistencies in the costing approach, the utility of the QALY (Quality Adjusted Life Year) as the effectiveness outcome, and how authors choose to present and interpret study results. When the IGRA versus TST test strategies were compared using our common decision analysis model predicted effectiveness largely overlapped. Implications Many methodologic issues that contribute to inconsistent results and reduced study quality were identified in studies that assessed the cost-effectiveness of the IGRA test. More specific and relevant guidelines are needed in order to help authors standardize modelling approaches, inputs, assumptions and how results are presented and interpreted. PMID:23505412

A Systematic Scoping Review of Yoga Intervention Components and Study Quality

PubMed Central

Elwy, A. Rani; Groessl, Erik J.; Eisen, Susan V.; Riley, Kristen; Maiya, Meghan; Lee, Jennifer P.; Sarkin, Andrew; Park, Crystal L.

2014-01-01

Context The scientific study of yoga requires rigorous methodology. This review aimed to systematically assess all studies of yoga interventions to: (1) determine yoga intervention characteristics; (2) examine methodologic quality of the subset of RCTs; and (3) explore how well these interventions are reported. Evidence acquisition Searches were conducted through April 2012 in PubMed, PsycInfo, Ageline, and Ovid’s Alternative and Complementary Medicine database using the text term yoga, and through handsearching five journals. Original studies were included if the intervention: (1) consisted of at least one yoga session with some type of health assessment; (2) targeted adults age ≥18 years; (3) was published in an English language peer–reviewed journal; and (4) was available for review. Evidence synthesis Of 3,062 studies identified, 465 studies in 30 countries were included. Analyses were conducted through 2013. Most interventions took place in India (n=228) or the U.S. (n=124), with intensity ranging from a single yoga session up to two sessions per day. Intervention lengths ranged from one session to 2 years. Asanas (poses) were mentioned as yoga components in 369 (79%) interventions, but were either minimally or not at all described in 200 (54%) of these. Most interventions (74%, n=336) did not include home practice. Of the included studies, 151 were RCTs. RCT quality was rated as poor. Conclusions This review highlights the inadequate reporting and methodologic limitations of current yoga intervention research, which limits study interpretation and comparability. Recommendations for future methodology and reporting are discussed. PMID:24996759

Environmental risk assessment of water quality in harbor areas: a new methodology applied to European ports.

PubMed

Gómez, Aina G; Ondiviela, Bárbara; Puente, Araceli; Juanes, José A

2015-05-15

This work presents a standard and unified procedure for assessment of environmental risks at the contaminant source level in port aquatic systems. Using this method, port managers and local authorities will be able to hierarchically classify environmental hazards and proceed with the most suitable management actions. This procedure combines rigorously selected parameters and indicators to estimate the environmental risk of each contaminant source based on its probability, consequences and vulnerability. The spatio-temporal variability of multiple stressors (agents) and receptors (endpoints) is taken into account to provide accurate estimations for application of precisely defined measures. The developed methodology is tested on a wide range of different scenarios via application in six European ports. The validation process confirms its usefulness, versatility and adaptability as a management tool for port water quality in Europe and worldwide. Copyright © 2015 Elsevier Ltd. All rights reserved.

Assessment of soil pollution based on total petroleum hydrocarbons and individual oil substances.

PubMed

Pinedo, J; Ibáñez, R; Lijzen, J P A; Irabien, Á

2013-11-30

Different oil products like gasoline, diesel or heavy oils can cause soil contamination. The assessment of soils exposed to oil products can be conducted through the comparison between a measured concentration and an intervention value (IV). Several national policies include the IV based on the so called total petroleum hydrocarbons (TPH) measure. However, the TPH assessment does not indicate the individual substances that may produce contamination. The soil quality assessment can be improved by including common hazardous compounds as polycyclic aromatic hydrocarbons (PAHs) and aromatic volatile hydrocarbons like benzene, toluene, ethylbenzene and xylenes (BTEX). This study, focused on 62 samples collected from different sites throughout The Netherlands, evaluates TPH, PAH and BTEX concentrations in soils. Several indices of pollution are defined for the assessment of individual variables (TPH, PAH, B, T, E, and X) and multivariables (MV, BTEX), allowing us to group the pollutants and simplify the methodology. TPH and PAH concentrations above the IV are mainly found in medium and heavy oil products such as diesel and heavy oil. On the other hand, unacceptable BTEX concentrations are reached in soils contaminated with gasoline and kerosene. The TPH assessment suggests the need for further action to include lighter products. The application of multivariable indices allows us to include these products in the soil quality assessment without changing the IV for TPH. This work provides useful information about the soil quality assessment methodology of oil products in soils, focussing the analysis into the substances that mainly cause the risk. Copyright © 2013 Elsevier Ltd. All rights reserved.

Quantitative weight of evidence assessment of higher-tier studies on the toxicity and risks of neonicotinoid insecticides in honeybees 1: Methods.

PubMed

Solomon, Keith R; Stephenson, Gladys L

2017-01-01

A quantitative weight of evidence (QWoE) methodology was developed and used to assess many higher-tier studies on the effects of three neonicotinoid insecticides: clothianidin (CTD), imidacloprid (IMI), and thiamethoxam (TMX) on honeybees. A general problem formulation, a conceptual model for exposures of honeybees, and an analysis plan were developed. A QWoE methodology was used to characterize the quality of the available studies from the literature and unpublished reports of studies conducted by or for the registrants. These higher-tier studies focused on the exposures of honeybees to neonicotinoids via several matrices as measured in the field as well as the effects in experimentally controlled field studies. Reports provided by Bayer Crop Protection and Syngenta Crop Protection and papers from the open literature were assessed in detail, using predefined criteria for quality and relevance to develop scores (on a relative scale of 0-4) to separate the higher-quality from lower-quality studies and those relevant from less-relevant results. The scores from the QWoEs were summarized graphically to illustrate the overall quality of the studies and their relevance. Through mean and standard errors, this method provided graphical and numerical indications of the quality and relevance of the responses observed in the studies and the uncertainty associated with these two metrics. All analyses were conducted transparently and the derivations of the scores were fully documented. The results of these analyses are presented in three companion papers and the QWoE analyses for each insecticide are presented in detailed supplemental information (SI) in these papers.

Methodology for turbulence code validation: Quantification of simulation-experiment agreement and application to the TORPEX experiment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ricci, Paolo; Theiler, C.; Fasoli, A.

A methodology for plasma turbulence code validation is discussed, focusing on quantitative assessment of the agreement between experiments and simulations. The present work extends the analysis carried out in a previous paper [P. Ricci et al., Phys. Plasmas 16, 055703 (2009)] where the validation observables were introduced. Here, it is discussed how to quantify the agreement between experiments and simulations with respect to each observable, how to define a metric to evaluate this agreement globally, and - finally - how to assess the quality of a validation procedure. The methodology is then applied to the simulation of the basic plasmamore » physics experiment TORPEX [A. Fasoli et al., Phys. Plasmas 13, 055902 (2006)], considering both two-dimensional and three-dimensional simulation models.« less

Association of journal quality indicators with methodological quality of clinical research articles.

PubMed

Lee, Kirby P; Schotland, Marieka; Bacchetti, Peter; Bero, Lisa A

2002-06-05

The ability to identify scientific journals that publish high-quality research would help clinicians, scientists, and health-policy analysts to select the most up-to-date medical literature to review. To assess whether journal characteristics of (1) peer-review status, (2) citation rate, (3) impact factor, (4) circulation, (5) manuscript acceptance rate, (6) MEDLINE indexing, and (7) Brandon/Hill Library List indexing are predictors of methodological quality of research articles, we conducted a cross-sectional study of 243 original research articles involving human subjects published in general internal medical journals. The mean (SD) quality score of the 243 articles was 1.37 (0.22). All journals reported a peer-review process and were indexed on MEDLINE. In models that controlled for article type (randomized controlled trial [RCT] or non-RCT), journal citation rate was the most statistically significant predictor (0.051 increase per doubling; 95% confidence interval [CI], 0.037-0.065; P<.001). In separate analyses by article type, acceptance rate was the strongest predictor for RCT quality (-0.113 per doubling; 95% CI, -0.148 to -0.078; P<.001), while journal citation rate was the most predictive factor for non-RCT quality (0.051 per doubling; 95% CI, 0.044-0.059; P<.001). High citation rates, impact factors, and circulation rates, and low manuscript acceptance rates and indexing on Brandon/Hill Library List appear to be predictive of higher methodological quality scores for journal articles.

Assessing Impacts on Unplanned Hospitalisations of Care Quality and Access Using a Structural Equation Method: With a Case Study of Diabetes

PubMed Central

Congdon, Peter

2016-01-01

Background: Enhanced quality of care and improved access are central to effective primary care management of long term conditions. However, research evidence is inconclusive in establishing a link between quality of primary care, or access, and adverse outcomes, such as unplanned hospitalisation. Methods: This paper proposes a structural equation model for quality and access as latent variables affecting adverse outcomes, such as unplanned hospitalisations. In a case study application, quality of care (QOC) is defined in relation to diabetes, and the aim is to assess impacts of care quality and access on unplanned hospital admissions for diabetes, while allowing also for socio-economic deprivation, diabetes morbidity, and supply effects. The study involves 90 general practitioner (GP) practices in two London Clinical Commissioning Groups, using clinical quality of care indicators, and patient survey data on perceived access. Results: As a single predictor, quality of care has a significant negative impact on emergency admissions, and this significant effect remains when socio-economic deprivation and morbidity are allowed. In a full structural equation model including access, the probability that QOC negatively impacts on unplanned admissions exceeds 0.9. Furthermore, poor access is linked to deprivation, diminished QOC, and larger list sizes. Conclusions: Using a Bayesian inference methodology, the evidence from the analysis is weighted towards negative impacts of higher primary care quality and improved access on unplanned admissions. The methodology of the paper is potentially applicable to other long term conditions, and relevant when care quality and access cannot be measured directly and are better regarded as latent variables. PMID:27598184

Assessing Impacts on Unplanned Hospitalisations of Care Quality and Access Using a Structural Equation Method: With a Case Study of Diabetes.

PubMed

Congdon, Peter

2016-09-01

Enhanced quality of care and improved access are central to effective primary care management of long term conditions. However, research evidence is inconclusive in establishing a link between quality of primary care, or access, and adverse outcomes, such as unplanned hospitalisation. This paper proposes a structural equation model for quality and access as latent variables affecting adverse outcomes, such as unplanned hospitalisations. In a case study application, quality of care (QOC) is defined in relation to diabetes, and the aim is to assess impacts of care quality and access on unplanned hospital admissions for diabetes, while allowing also for socio-economic deprivation, diabetes morbidity, and supply effects. The study involves 90 general practitioner (GP) practices in two London Clinical Commissioning Groups, using clinical quality of care indicators, and patient survey data on perceived access. As a single predictor, quality of care has a significant negative impact on emergency admissions, and this significant effect remains when socio-economic deprivation and morbidity are allowed. In a full structural equation model including access, the probability that QOC negatively impacts on unplanned admissions exceeds 0.9. Furthermore, poor access is linked to deprivation, diminished QOC, and larger list sizes. Using a Bayesian inference methodology, the evidence from the analysis is weighted towards negative impacts of higher primary care quality and improved access on unplanned admissions. The methodology of the paper is potentially applicable to other long term conditions, and relevant when care quality and access cannot be measured directly and are better regarded as latent variables.

A study of undue pain and surfing: using hierarchical criteria to assess website quality.

PubMed

Lorence, Daniel; Abraham, Joanna

2008-09-01

In studies of web-based consumer health information, scant attention has been paid to the selective development of differential methodologies for website quality evaluation, or to selective grouping and analysis of specific ;domains of uncertainty' in healthcare. Our objective is to introduce a more refined model for website evaluation, and illustrate its application using assessment of websites within an area of ongoing medical uncertainty, back pain. In this exploratory technology assessment, we suggest a model for assessing these ;domains of uncertainty' within healthcare, using qualitative assessment of websites and hierarchical concepts. Using such a hierarchy of quality criteria, we review medical information provided by the most frequently accessed websites related to back pain. Websites are evaluated using standardized criteria, with results rated from the viewpoint of the consumer. Results show that standardization of quality rating across subjective content, and between commercial and niche search results, can provide a consumer-friendly dimension to health information.

Adapting total quality management for general practice: evaluation of a programme.

PubMed Central

Lawrence, M; Packwood, T

1996-01-01

OBJECTIVE: Assessment of the benefits and limitations of a quality improvement programme based on total quality management principles in general practice over a period of one year (October 1993-4). DESIGN: Questionnaires to practice team members before any intervention and after one year. Three progress reports completed by facilitators at four month intervals. Semistructured interviews with a sample of staff from each practice towards the end of the year. SETTING: 18 self selected practices from across the former Oxford Region. Three members of each practice received an initial residential course and three one day seminars during the year. Each practice was supported by a facilitator from their Medical Audit Advisory Group. MEASURES: Extent of understanding and implementation of quality improvement methodology. Number, completeness, and evaluation of quality improvement projects. Practice team members' attitudes to and involvement in team working and quality improvement. RESULTS: 16 of the 18 practices succeeded in implementing the quality improvement methods. 48 initiatives were considered and staff involvement was broad. Practice members showed increased involvement in, and appreciation of, strategic planning and team working, and satisfaction from improved patients services. 11 of the practices intend to continue with the methodology. The commonest barrier expressed was time. CONCLUSION: Quality improvement programmes based on total quality management principles produce beneficial changes in service delivery and team working in most general practices. It is incompatible with traditional doctor centred practice. The methodology needs to be adapted for primary care to avoid quality improvement being seen as separate from routine activity, and to save time. PMID:10161529

Organ Donation European Quality System: ODEQUS project methodology.

PubMed

Manyalich, M; Guasch, X; Gomez, M P; Páez, G; Teixeira, L

2013-01-01

Differences in the number of organ donors among hospitals cannot be explained only by the number of intensive care unit beds used or neurologic patients treated. The figures obtained are influenced by the organizational structure of the donation process and how efficient it is. The Organ Donation European Quality System (ODEQUS) is a 3-year project (from October 2010 to September 2013) co-financed by the European Agency for Health and Consumers (EAHC20091108) which aims to define a methodology to evaluate organ procurement performance at the hospital level. ODEQUS's specific objectives are to identify quality criteria and to develop quality indicators in three types of organ donation (after brain death, after cardiac death, and living donation). Those tools will be useful for hospitals' self-assessment as well as for developing an international auditing model. A consortium has been established involving 14 associated partners from Austria, Croatia, France, Germany, Italy, Poland, Portugal, Romania, Spain, Sweden, and the United Kingdom, as well as five collaborating partners from Greece, Hungary, Malta, Slovenia, and Turkey. The project has been established in three steps: 1) Design of a survey about the use of quality tools in a wide sample of European hospitals; 2) Development of quality criteria and quality indicators by the project experts. The main fields considered have been organizational structures, clinical procedures, and outcomes; and 3) Elaboration of an evaluation system to test the quality indicators in 11 European hospitals. Two types of training have been designed and performed: one concerns the development of quality criteria and quality indicators, whereas another is focused on how to use evaluation tools. Following this methodology, the project has so far identified 131 quality criteria and developed 31 quality indicators. Currently, the quality indicators are being tested in 11 selected hospitals. Copyright © 2013 Elsevier Inc. All rights reserved.

TH-CD-202-07: A Methodology for Generating Numerical Phantoms for Radiation Therapy Using Geometric Attribute Distribution Models

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dolly, S; Chen, H; Mutic, S

Purpose: A persistent challenge for the quality assessment of radiation therapy treatments (e.g. contouring accuracy) is the absence of the known, ground truth for patient data. Moreover, assessment results are often patient-dependent. Computer simulation studies utilizing numerical phantoms can be performed for quality assessment with a known ground truth. However, previously reported numerical phantoms do not include the statistical properties of inter-patient variations, as their models are based on only one patient. In addition, these models do not incorporate tumor data. In this study, a methodology was developed for generating numerical phantoms which encapsulate the statistical variations of patients withinmore » radiation therapy, including tumors. Methods: Based on previous work in contouring assessment, geometric attribute distribution (GAD) models were employed to model both the deterministic and stochastic properties of individual organs via principle component analysis. Using pre-existing radiation therapy contour data, the GAD models are trained to model the shape and centroid distributions of each organ. Then, organs with different shapes and positions can be generated by assigning statistically sound weights to the GAD model parameters. Organ contour data from 20 retrospective prostate patient cases were manually extracted and utilized to train the GAD models. As a demonstration, computer-simulated CT images of generated numerical phantoms were calculated and assessed subjectively and objectively for realism. Results: A cohort of numerical phantoms of the male human pelvis was generated. CT images were deemed realistic both subjectively and objectively in terms of image noise power spectrum. Conclusion: A methodology has been developed to generate realistic numerical anthropomorphic phantoms using pre-existing radiation therapy data. The GAD models guarantee that generated organs span the statistical distribution of observed radiation therapy patients, according to the training dataset. The methodology enables radiation therapy treatment assessment with multi-modality imaging and a known ground truth, and without patient-dependent bias.« less

Assessing value-based health care delivery for haemodialysis.

PubMed

Parra, Eduardo; Arenas, María Dolores; Alonso, Manuel; Martínez, María Fernanda; Gamen, Ángel; Aguarón, Juan; Escobar, María Teresa; Moreno-Jiménez, José María; Alvarez-Ude, Fernando

2017-06-01

Disparities in haemodialysis outcomes among centres have been well-documented. Besides, attempts to assess haemodialysis results have been based on non-comprehensive methodologies. This study aimed to develop a comprehensive methodology for assessing haemodialysis centres, based on the value of health care. The value of health care is defined as the patient benefit from a specific medical intervention per monetary unit invested (Value = Patient Benefit/Cost). This study assessed the value of health care and ranked different haemodialysis centres. A nephrology quality management group identified the criteria for the assessment. An expert group composed of stakeholders (patients, clinicians and managers) agreed on the weighting of each variable, considering values and preferences. Multi-criteria methodology was used to analyse the data. Four criteria and their weights were identified: evidence-based clinical performance measures = 43 points; yearly mortality = 27 points; patient satisfaction = 13 points; and health-related quality of life = 17 points (100-point scale). Evidence-based clinical performance measures included five sub-criteria, with respective weights, including: dialysis adequacy; haemoglobin concentration; mineral and bone disorders; type of vascular access; and hospitalization rate. The patient benefit was determined from co-morbidity-adjusted results and corresponding weights. The cost of each centre was calculated as the average amount expended per patient per year. The study was conducted in five centres (1-5). After adjusting for co-morbidity, value of health care was calculated, and the centres were ranked. A multi-way sensitivity analysis that considered different weights (10-60% changes) and costs (changes of 10% in direct and 30% in allocated costs) showed that the methodology was robust. The rankings: 4-5-3-2-1 and 4-3-5-2-1 were observed in 62.21% and 21.55%, respectively, of simulations, when weights were varied by 60%. Value assessments may integrate divergent stakeholder perceptions, create a context for improvement and aid in policy-making decisions. © 2015 John Wiley & Sons, Ltd.

Spoilt for choice: A critical review on the chemical and biological assessment of current wastewater treatment technologies.

PubMed

Prasse, Carsten; Stalter, Daniel; Schulte-Oehlmann, Ulrike; Oehlmann, Jörg; Ternes, Thomas A

2015-12-15

The knowledge we have gained in recent years on the presence and effects of compounds discharged by wastewater treatment plants (WWTPs) brings us to a point where we must question the appropriateness of current water quality evaluation methodologies. An increasing number of anthropogenic chemicals is detected in treated wastewater and there is increasing evidence of adverse environmental effects related to WWTP discharges. It has thus become clear that new strategies are needed to assess overall quality of conventional and advanced treated wastewaters. There is an urgent need for multidisciplinary approaches combining expertise from engineering, analytical and environmental chemistry, (eco)toxicology, and microbiology. This review summarizes the current approaches used to assess treated wastewater quality from the chemical and ecotoxicological perspective. Discussed chemical approaches include target, non-target and suspect analysis, sum parameters, identification and monitoring of transformation products, computational modeling as well as effect directed analysis and toxicity identification evaluation. The discussed ecotoxicological methodologies encompass in vitro testing (cytotoxicity, genotoxicity, mutagenicity, endocrine disruption, adaptive stress response activation, toxicogenomics) and in vivo tests (single and multi species, biomonitoring). We critically discuss the benefits and limitations of the different methodologies reviewed. Additionally, we provide an overview of the current state of research regarding the chemical and ecotoxicological evaluation of conventional as well as the most widely used advanced wastewater treatment technologies, i.e., ozonation, advanced oxidation processes, chlorination, activated carbon, and membrane filtration. In particular, possible directions for future research activities in this area are provided. Copyright © 2015 Elsevier Ltd. All rights reserved.

Paternal Influences on Adolescent Sexual Risk Behaviors: A Structured Literature Review

PubMed Central

Bouris, Alida; Lee, Jane; McCarthy, Katharine; Michael, Shannon L.; Pitt-Barnes, Seraphine; Dittus, Patricia

2012-01-01

BACKGROUND AND OBJECTIVE: To date, most parent-based research has neglected the role of fathers in shaping adolescent sexual behavior and has focused on mothers. The objective of this study was to conduct a structured review to assess the role of paternal influence on adolescent sexual behavior and to assess the methodological quality of the paternal influence literature related to adolescent sexual behavior. METHODS: We searched electronic databases: PubMed, PsychINFO, Social Services Abstracts, Family Studies Abstracts, Sociological Abstracts, and the Cumulative Index to Nursing and Allied Health Literature. Studies published between 1980 and 2011 that targeted adolescents 11 to 18 years and focused on paternal parenting processes were included. Methodological quality was assessed by using an 11-item scoring system. RESULTS: Thirteen articles were identified and reviewed. Findings suggest paternal factors are independently associated with adolescent sexual behavior relative to maternal factors. The most commonly studied paternal influence was emotional qualities of the father-adolescent relationship. Paternal communication about sex was most consistently associated with adolescent sexual behavior, whereas paternal attitudes about sex was least associated. Methodological limitations include a tendency to rely on cross-sectional design, nonprobability sampling methods, and focus on sexual debut versus broader sexual behavior. CONCLUSIONS: Existing research preliminarily suggests fathers influence the sexual behavior of their adolescent children; however, more rigorous research examining diverse facets of paternal influence on adolescent sexual behavior is needed. We provide recommendations for primary care providers and public health practitioners to better incorporate fathers into interventions designed to reduce adolescent sexual risk behavior. PMID:23071205

Quality of systematic reviews: an example of studies comparing artificial disc replacement with fusion in the cervical spine.

PubMed

Tashani, Osama A; El-Tumi, Hanan; Aneiba, Khaled

2015-01-01

Cervical artificial disc replacement (C-ADR) is now an alternative to anterior cervical discectomy and fusion (ACDF). Many studies have evaluated the efficacy of C-ADR compared with ACDF. This led to a series of systematic reviews and meta-analyses to evaluate the evidence of the superiority of one intervention against the other. The aim of the study presented here was to evaluate the quality of these reviews and meta-analyses. Medline via Ovid, Embase, and Cochrane Library were searched using the keywords: (total disk replacement, prosthesis, implantation, discectomy, and arthroplasty) AND (cervical vertebrae, cervical spine, and spine) AND (systematic reviews, reviews, and meta-analysis). Screening and data extraction were conducted by two reviewers independently. Two reviewers then assessed the quality of the selected reviews and meta-analysis using 11-item AMSTAR score which is a validated measurement tool to assess the methodological quality of systematic reviews. Screening of full reports of 46 relevant abstracts resulted in the selection of 15 systematic reviews and/or meta-analyses as eligible for this study. The two reviewers' inter-rater agreement level was high as indicated by kappa of >0.72. The AMSTAR score of the reviews ranged from 3 to 11. Only one study (a Cochrane review) scored 100% (AMSTAR 11). Five studies scored below (AMSTAR 5) indicating low-quality reviews. The most significant drawbacks of reviews of a score below 5 were not using an extensive search strategy, failure to use the scientific quality of the included studies appropriately in formulating a conclusion, not assessing publication bias, and not reporting the excluded studies. With a significant exception of a Cochrane review, the methodological quality of systematic reviews evaluating the evidence of C-ADR versus ACDF has to be improved.

Social cognition interventions for people with schizophrenia: a systematic review focussing on methodological quality and intervention modality.

PubMed

Grant, Nina; Lawrence, Megan; Preti, Antonio; Wykes, Til; Cella, Matteo

2017-08-01

People with a diagnosis of schizophrenia have significant social and functional difficulties. Social cognition was found to influences these outcomes and in recent years interventions targeting this domain were developed. This paper reviews the existing literature on social cognition interventions for people with a diagnosis of schizophrenia focussing on: i) comparing focussed (i.e. targeting only one social cognitive domain) and global interventions and ii) studies methodological quality. Systematic search was conducted on PubMed and PsycInfo. Studies were included if they were randomised control trials, participants had a diagnosis of schizophrenia or schizoaffective disorder, and the intervention targeted at least one out of four social cognition domains (i.e. theory of mind, affect recognition, social perception and attribution bias). All papers were assessed for methodological quality. Information on the intervention, control condition, study methodology and the main findings from each study were extracted and critically summarised. Data from 32 studies fulfilled the inclusion criteria, considering a total of 1440 participants. Taking part in social cognition interventions produced significant improvements in theory of mind and affect recognition compared to both passive and active control conditions. Results were less clear for social perception and attributional bias. Focussed and global interventions had similar results on outcomes. Overall study methodological quality was modest. There was very limited evidence showing that social cognitive intervention result in functional outcome improvement. The evidence considered suggests that social cognition interventions may be a valuable approach for people with a diagnosis of schizophrenia. However, evidence quality is limited by measure heterogeneity, modest study methodology and short follow-up periods. The findings point to a number of recommendations for future research, including measurement standardisation, appropriately powered studies and investigation of the impact of social cognition improvements on functioning problems. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

[Quality standards for duplex ultrasonographic assessment (duplex us) of abdominal aortic stent grafts].

PubMed

Diard, A; Becker, F; Pichot, O

2017-05-01

The quality standards of the French Society of Vascular Medicine for the ultrasound assessment of lower limb arteries in vascular medicine practice are based on the principle that these examinations have to meet two requirements: technical know-how (knowledge of devices and methodologies); medical know-how (level of examination matching the indication and purpose of the examination, interpretation and critical analysis of results). To describe an optimal level of examination adjusted to the indication or clinical hypothesis; to establish harmonious practices, methodologies, terminologies, results description and report; to provide good practice reference points and to promote a high quality process. The three levels of examination, indications and objectives for each level; the reference standard examination (level 2) and its variants according to indications; the minimal content of the exam report, the medical conclusion letter to the corresponding physician (synthesis, conclusion and management suggestions); commented glossary (anatomy, hemodynamics, signs and symptoms); technical basis; device settings. Here, we discuss duplex ultrasound for the supervision of the aortic stent grafts. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Tai Chi for Essential Hypertension

PubMed Central

Wang, Jie; Feng, Bo; Yang, Xiaochen; Liu, Wei; Teng, Fei; Li, Shengjie; Xiong, Xingjiang

2013-01-01

Objectives. To assess the current clinical evidence of Tai Chi for essential hypertension (EH). Search Strategy. 7 electronic databases were searched until 20 April, 2013. Inclusion Criteria. We included randomized trials testing Tai Chi versus routine care or antihypertensive drugs. Trials testing Tai Chi combined with antihypertensive drugs versus antihypertensive drugs were also included. Data Extraction and Analyses. Study selection, data extraction, quality assessment, and data analyses were conducted according to the Cochrane standards. Results. 18 trials were included. Methodological quality of the trials was low. 14 trials compared Tai Chi with routine care. 1 trial compared Tai Chi with antihypertensive drugs. Meta-analysis all showed significant effect of TaiChi in lowering blood pressure (BP). 3 trials compared Tai Chi plus antihypertensive drugs with antihypertensive drugs. Positive results in BP were found in the other 2 combination groups. Most of the trials did not report adverse events, and the safety of Tai Chi is still uncertain. Conclusions. There is some encouraging evidence of Tai Chi for EH. However, due to poor methodological quality of included studies, the evidence remains weak. Rigorously designed trials are needed to confirm the evidence. PMID:23986780

Economic Evaluation of Obesity Prevention in Early Childhood: Methods, Limitations and Recommendations.

PubMed

Döring, Nora; Mayer, Susanne; Rasmussen, Finn; Sonntag, Diana

2016-09-13

Despite methodological advances in the field of economic evaluations of interventions, economic evaluations of obesity prevention programmes in early childhood are seldom conducted. The aim of the present study was to explore existing methods and applications of economic evaluations, examining their limitations and making recommendations for future cost-effectiveness assessments. A systematic literature search was conducted using PubMed, Cochrane Library, the British National Health Service Economic Evaluation Databases and EconLit. Eligible studies included trial-based or simulation-based cost-effectiveness analyses of obesity prevention programmes targeting preschool children and/or their parents. The quality of included studies was assessed. Of the six studies included, five were intervention studies and one was based on a simulation approach conducted on secondary data. We identified three main conceptual and methodological limitations of their economic evaluations: Insufficient conceptual approach considering the complexity of childhood obesity, inadequate measurement of effects of interventions, and lack of valid instruments to measure child-related quality of life and costs. Despite the need for economic evaluations of obesity prevention programmes in early childhood, only a few studies of varying quality have been conducted. Moreover, due to methodological and conceptual weaknesses, they offer only limited information for policy makers and intervention providers. We elaborate reasons for the limitations of these studies and offer guidance for designing better economic evaluations of early obesity prevention.

Economic Evaluation of Obesity Prevention in Early Childhood: Methods, Limitations and Recommendations

PubMed Central

Döring, Nora; Mayer, Susanne; Rasmussen, Finn; Sonntag, Diana

2016-01-01

Despite methodological advances in the field of economic evaluations of interventions, economic evaluations of obesity prevention programmes in early childhood are seldom conducted. The aim of the present study was to explore existing methods and applications of economic evaluations, examining their limitations and making recommendations for future cost-effectiveness assessments. A systematic literature search was conducted using PubMed, Cochrane Library, the British National Health Service Economic Evaluation Databases and EconLit. Eligible studies included trial-based or simulation-based cost-effectiveness analyses of obesity prevention programmes targeting preschool children and/or their parents. The quality of included studies was assessed. Of the six studies included, five were intervention studies and one was based on a simulation approach conducted on secondary data. We identified three main conceptual and methodological limitations of their economic evaluations: Insufficient conceptual approach considering the complexity of childhood obesity, inadequate measurement of effects of interventions, and lack of valid instruments to measure child-related quality of life and costs. Despite the need for economic evaluations of obesity prevention programmes in early childhood, only a few studies of varying quality have been conducted. Moreover, due to methodological and conceptual weaknesses, they offer only limited information for policy makers and intervention providers. We elaborate reasons for the limitations of these studies and offer guidance for designing better economic evaluations of early obesity prevention. PMID:27649218

Fuzzy Clustering Analysis in Environmental Impact Assessment--A Complement Tool to Environmental Quality Index.

ERIC Educational Resources Information Center

Kung, Hsiang-Te; And Others

1993-01-01

In spite of rapid progress achieved in the methodological research underlying environmental impact assessment (EIA), the problem of weighting various parameters has not yet been solved. This paper presents a new approach, fuzzy clustering analysis, which is illustrated with an EIA case study on Baoshan-Wusong District in Shanghai, China. (Author)

Critical appraisal of clinical trials in multiple system atrophy: Toward better quality.

PubMed

Castro Caldas, Ana; Levin, Johannes; Djaldetti, Ruth; Rascol, Olivier; Wenning, Gregor; Ferreira, Joaquim J

2017-10-01

Multiple system atrophy (MSA) is a rare neurodegenerative disease of undetermined cause. Although many clinical trials have been conducted, there is still no treatment that cures the disease or slows its progression. We sought to assess the clinical trials, methodology, and quality of reporting of clinical trails conducted in MSA patients. We conducted a systematic review of all trials with at least 1 MSA patient subject to any pharmacological/nonpharmacological interventions. Two independent reviewers evaluated the methodological characteristics and quality of reporting of trials. A total of 60 clinical trials were identified, including 1375 MSA patients. Of the trials, 51% (n = 31) were single-arm studies. A total of 28% (n = 17) had a parallel design, half of which (n = 13) were placebo controlled. Of the studies, 8 (13.3%) were conducted in a multicenter setting, 3 of which were responsible for 49.3% (n = 678) of the total included MSA patients. The description of primary outcomes was unclear in 60% (n = 40) of trials. Only 10 (16.7%) clinical trials clearly described the randomization process. Blinding of the participants, personnel, and outcome assessments were at high risk of bias in the majority of studies. The number of dropouts/withdrawals was high (n = 326, 23.4% among the included patients). Overall, the design and quality of reporting of the reviewed studies is unsatisfactory. The most frequent clinical trials were small and single centered. Inadequate reporting was related to the information on the randomization process, sequence generation, allocation concealment, blinding of participants, and sample size calculations. Although improved during the recent years, methodological quality and trial design need to be optimized to generate more informative results. © 2017 International Parkinson and Movement Disorder Society. © 2017 International Parkinson and Movement Disorder Society.

Measurement properties of patient reported outcome measures for spondyloarthritis: A systematic review.

PubMed

Png, Kelly; Kwan, Yu Heng; Leung, Ying Ying; Phang, Jie Kie; Lau, Jia Qi; Lim, Ka Keat; Chew, Eng Hui; Low, Lian Leng; Tan, Chuen Seng; Thumboo, Julian; Fong, Warren; Østbye, Truls

2018-03-21

This systematic review aimed to identify studies investigating measurement properties of patient reported outcome measures (PROMs) for spondyloarthritis (SpA), and to evaluate their methodological quality and level of evidence relating to the measurement properties of PROMs. This systematic review was guided by the preferred reporting items for systematic review and meta-analysis (PRISMA). Articles published before 30 June 2017 were retrieved from PubMed ® , Embase ® , and PsychINFO ® (Ovid). Methodological quality and level of evidence were evaluated according to recommendations from the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). We identified 60 unique PROMs from 125 studies in 39 countries. Twenty-one PROMs were validated for two or more SpA subtypes. The literature examined hypothesis testing (82.4%) most frequently followed by reliability (60.0%). A percentage of 77.7% and 42.7% of studies that assessed PROMs for hypothesis testing and reliability, respectively had "fair" or better methodological quality. Among the PROMs identified, 41.7% were studied in ankylosing spondylitis (AS) only and 23.3% were studied in psoriatic arthritis (PsA) only. The more extensively assessed PROMs included the ankylosing spondylitis quality of life (ASQoL) and bath ankylosing spondylitis functional index (BASFI) for ankylosing spondylitis, and the psoriatic arthritis quality of life questionnaire (VITACORA-19) for psoriatic arthritis. This study identified 60 unique PROMs through a systematic review and synthesized evidence of the measurement properties of the PROMs. There is a lack of validation of PROMs for use across SpA subtypes. Future studies may consider validating PROMs for use across different SpA subtypes. Copyright © 2018 Elsevier Inc. All rights reserved.

Music for medical indications in the neonatal period: a systematic review of randomised controlled trials.

PubMed

Hartling, L; Shaik, M S; Tjosvold, L; Leicht, R; Liang, Y; Kumar, M

2009-09-01

To conduct a systematic review of the efficacy of music for medical indications in term or preterm neonates. We searched 17 electronic databases, subject bibliographies, reference lists and trials registries. Two reviewers independently screened studies for inclusion, assessed methodological quality, and extracted data. Meta-analysis was not feasible due to heterogeneity in outcomes so a qualitative analysis is presented. Nine randomised trials were included. The methodological quality was generally poor (median Jadad score = 1). The outcomes most commonly reported were physiological measures (heart rate (HR), respiratory rate, oxygen saturation (SaO2)), behavioural state and pain. Six studies evaluated music for the painful procedures circumcision (three trials) and heel prick (three trials). For circumcisions, one high quality pilot study (n = 23) showed benefits of music for the outcomes of HR, SaO2 and pain, while two low quality studies showed no difference. For heel prick, three low quality studies provided some evidence that music may be beneficial primarily for measures of behaviour and pain. The remaining studies evaluated the use of music in preterm infants to improve physiological and behavioural parameters (n = 31; benefits observed for behavioural parameters), to reinforce non-nutritive sucking via use of a pacifier activated lullaby (n = 32; significant increase in feeding rates), and to influence physiological stability and behaviours in infants with chronic lung disease (n = 22; no significant differences for outcomes assessed). The heterogeneity in study populations, interventions and outcomes precludes definitive conclusions around efficacy. There is preliminary evidence for some therapeutic benefits of music for specific indications; however, these findings need to be confirmed in methodologically rigorous trials.

Epidemiology, quality, and reporting characteristics of systematic reviews and meta-analyses of nursing interventions published in Chinese journals.

PubMed

Zhang, Juxia; Wang, Jiancheng; Han, Lin; Zhang, Fengwa; Cao, Jianxun; Ma, Yuxia

2015-01-01

Systematic reviews (SRs) and meta-analyses (MAs) of nursing interventions have become increasingly popular in China. This review provides the first examination of epidemiological characteristics of these SRs as well as compliance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses and Assessment of Multiple Systematic Reviews guidelines. The purpose of this study was to examine epidemiologic and reporting characteristics as well as the methodologic quality of SRs and MAs of nursing interventions published in Chinese journals. Four Chinese databases were searched (the Chinese Biomedicine Literature Database, Chinese Scientific Journal Full-text Database, Chinese Journal Full-text Database, and Wanfang Database) for SRs and MAs of nursing intervention from inception through June 2013. Data were extracted into Excel (Microsoft, Redmond, WA). The Assessment of Multiple Systematic Reviews and Preferred Reporting Items for Systematic Reviews and Meta-analyses checklists were used to assess methodologic quality and reporting characteristics, respectively. A total of 144 SRs were identified, most (97.2%) of which used "systematic review" or "meta-analyses" in the titles. None of the reviews had been updated. Nearly half (41%) were written by nurses, and more than half (61%) were reported in specialist journals. The most common conditions studied were endocrine, nutritional and metabolic diseases, and neoplasms. Most (70.8%) reported information about quality assessment, whereas less than half (25%) reported assessing for publication bias. None of the reviews reported a conflict of interest. Although many SRs of nursing interventions have been published in Chinese journals, the quality of these reviews is of concern. As a potential key source of information for nurses and nursing administrators, not only were many of these reviews incomplete in the information they provided, but also some results were misleading. Improving the quality of SRs of nursing interventions conducted and published by nurses in China is urgently needed in order to increase the value of these studies. Copyright © 2015 Elsevier Inc. All rights reserved.

Bayesian Revision of Residual Detection Power

NASA Technical Reports Server (NTRS)

DeLoach, Richard

2013-01-01

This paper addresses some issues with quality assessment and quality assurance in response surface modeling experiments executed in wind tunnels. The role of data volume on quality assurance for response surface models is reviewed. Specific wind tunnel response surface modeling experiments are considered for which apparent discrepancies exist between fit quality expectations based on implemented quality assurance tactics, and the actual fit quality achieved in those experiments. These discrepancies are resolved by using Bayesian inference to account for certain imperfections in the assessment methodology. Estimates of the fraction of out-of-tolerance model predictions based on traditional frequentist methods are revised to account for uncertainty in the residual assessment process. The number of sites in the design space for which residuals are out of tolerance is seen to exceed the number of sites where the model actually fails to fit the data. A method is presented to estimate how much of the design space in inadequately modeled by low-order polynomial approximations to the true but unknown underlying response function.

The use of hierarchical clustering for the design of optimized monitoring networks

NASA Astrophysics Data System (ADS)

Soares, Joana; Makar, Paul Andrew; Aklilu, Yayne; Akingunola, Ayodeji

2018-05-01

Associativity analysis is a powerful tool to deal with large-scale datasets by clustering the data on the basis of (dis)similarity and can be used to assess the efficacy and design of air quality monitoring networks. We describe here our use of Kolmogorov-Zurbenko filtering and hierarchical clustering of NO2 and SO2 passive and continuous monitoring data to analyse and optimize air quality networks for these species in the province of Alberta, Canada. The methodology applied in this study assesses dissimilarity between monitoring station time series based on two metrics: 1 - R, R being the Pearson correlation coefficient, and the Euclidean distance; we find that both should be used in evaluating monitoring site similarity. We have combined the analytic power of hierarchical clustering with the spatial information provided by deterministic air quality model results, using the gridded time series of model output as potential station locations, as a proxy for assessing monitoring network design and for network optimization. We demonstrate that clustering results depend on the air contaminant analysed, reflecting the difference in the respective emission sources of SO2 and NO2 in the region under study. Our work shows that much of the signal identifying the sources of NO2 and SO2 emissions resides in shorter timescales (hourly to daily) due to short-term variation of concentrations and that longer-term averages in data collection may lose the information needed to identify local sources. However, the methodology identifies stations mainly influenced by seasonality, if larger timescales (weekly to monthly) are considered. We have performed the first dissimilarity analysis based on gridded air quality model output and have shown that the methodology is capable of generating maps of subregions within which a single station will represent the entire subregion, to a given level of dissimilarity. We have also shown that our approach is capable of identifying different sampling methodologies as well as outliers (stations' time series which are markedly different from all others in a given dataset).

Monitoring scale scores over time via quality control charts, model-based approaches, and time series techniques.

PubMed

Lee, Yi-Hsuan; von Davier, Alina A

2013-07-01

Maintaining a stable score scale over time is critical for all standardized educational assessments. Traditional quality control tools and approaches for assessing scale drift either require special equating designs, or may be too time-consuming to be considered on a regular basis with an operational test that has a short time window between an administration and its score reporting. Thus, the traditional methods are not sufficient to catch unusual testing outcomes in a timely manner. This paper presents a new approach for score monitoring and assessment of scale drift. It involves quality control charts, model-based approaches, and time series techniques to accommodate the following needs of monitoring scale scores: continuous monitoring, adjustment of customary variations, identification of abrupt shifts, and assessment of autocorrelation. Performance of the methodologies is evaluated using manipulated data based on real responses from 71 administrations of a large-scale high-stakes language assessment.

THE USE AND LIMITATIONS OF DETECTION AND QUANTITATION LIMITS IN ENVIRONMENTAL ANALYSIS

EPA Science Inventory

Site assessment, remediation and compliance monitoring require the routine determination of the concentration of regulated substances in environmental samples. Each measurement methodology providing the concentration determinations, is required to specify key data quality elemen...

Patient-perceived hospital service quality: an empirical assessment.

PubMed

Pai, Yogesh P; Chary, Satyanarayana T; Pai, Rashmi Yogesh

2018-02-12

Purpose The purpose of this paper is to appraise Pai and Chary's (2016) conceptual framework for measuring patient-perceived hospital service quality (HSQ). Design/methodology/approach A structured questionnaire was used to obtain data from teaching, public and corporate hospital patients. Several tests were conducted to assess the instrument's reliability and validity. Pai and Chary's (2016) nine dimensions for measuring HSQ were examined in this paper. Findings The tests confirm that Pai and Chary's (2016) conceptual framework is reliable and valid. The study also establishes that the nine dimensions measure HSQ. Practical implications The framework empowers managers to assess service quality in any hospital settings, corporate, public and teaching, using an approach that is superior to the existing HSQ scales. Originality/value This paper helps researchers and practitioners to assess HSQ from patient perspectives in any hospital setting.

Saharan dust contribution to PM levels: The EC LIFE+ DIAPASON project

NASA Astrophysics Data System (ADS)

Gobbi, G. P.; Wille, H.; Sozzi, R.; Angelini, F.; Barnaba, F.; Costabile, F.; Frey, S.; Bolignano, A.; Di Giosa, A.

2012-04-01

The contribution of Saharan-dust advections to both daily and annual PM average values can be significant all over Southern Europe. The most important effects of dust on the number of PM exceedances are mostly observed in polluted areas and large cities. While a wide literature exists documenting episodes of Saharan dust transport towards the Euro-Mediterranean region and Europe in general, a limited number of studies are still available providing statistically significant results on the impact of Saharan dust on the particulate matter loads over the continent. A four-year (2001-2004) study performed in Rome (Italy) found these events to contribute to the average ground PM10 with about 15±10 µg/m3 on about 17% of the days in a year. Since the PM10 yearly average of many traffic stations in Rome is close to 40 μg/m3, these events can cause the PM10 concentration to exceed air quality limit values (50 μg/m3 as daily average) set by the EU Air Quality Directive 2008/50/EC. Although the European legislation allows Member States to subtract the contribution of natural sources before counting PM10 exceedances, definition of an optimal methodology to quantitatively assess such contribution is still in progress. On the basis of the current European Guidelines on the assessment of natural contributions to PM, the DIAPASON project ("Desert-dust Impact on Air quality through model-Predictions and Advanced Sensors ObservatioNs", recently funded under the EC LIFE+ program) has been formulated to provide a robust, user-oriented methodology to assess the presence of desert dust and its contribution to PM levels. To this end, in addition to satellite-based data and model forecasts, the DIAPASON methodology will employ innovative and affordable technologies, partly prototyped within the project itself, as an operational Polarization Lidar-Ceilometer (laser radar) capable of detecting and profiling dust clouds from the ground up to 10 km altitude. The DIAPASON Project (2011-2014) will be first implemented as a network of three stations in the Rome metropolitan area. However, the DIAPASON methodology to detect/quantify the Saharan dust contribution to PM will be designed to be easily applicable by air-quality and meteorological agencies. In fact, the possibility of manufacturing cheap, operational polarization lidar-ceilometers and scatter them on the territory will also represent a breakthrough in the detection and quantification of other atmospheric aerosol layers, as volcanic or wild-fire plumes, with further benefits in terms of meteo forecasts, flight security and air quality assessments.

Designing a Method with Physician Participation to Assess and Improve Quality of Healthcare in Otolaryngology.

PubMed

Arce, José M; Martín Cleary, Catalina; Cenjor, Carlos; Ramos, Ángel; Ortiz, Alberto

2017-04-01

Patient choice of healthcare centers to be treated for specific diseases is compromised by the low accessibility of understandable information. Physicians are rarely involved in healthcare quality assessment, despite their potentially valuable input. The purpose of this study was to develop a methodology for evaluating the quality of care that specifically incorporates advice from medical specialists and provides accessible information for patients in search of high-quality healthcare. A pilot Delphi study was conducted among 28 Spanish otolaryngology experts, seeking their opinion on the quality-of-care indicators and on their ability to recommend the most suitable department for the treatment of specific otolaryngologic diseases. The average acceptance rate was 91.9% for quality-of-care indicator and 96.5% for the resources needed for improving the quality of care. Furthermore, 93% experts reported that patients frequently ask for physician advice on which center provides better care for a specific disease, 92.6% experts believe they could recommend the best centers for specific otolaryngologic diseases, and 80% experts agreed that expert opinion on the quality of care offered by different centers would be a valuable addition to quality-of-care assessment. The incorporation of physician advice into healthcare quality assessment may improve the usefulness of healthcare quality indicators for patients. Assessment tools incorporating physician advice should be developed and validated.

The cost-effectiveness of exercise-based cardiac rehabilitation: a systematic review of the characteristics and methodological quality of published literature.

PubMed

Edwards, Katherine; Jones, Natasha; Newton, Julia; Foster, Charlie; Judge, Andrew; Jackson, Kate; Arden, Nigel K; Pinedo-Villanueva, Rafael

2017-10-19

This descriptive review aimed to assess the characteristics and methodological quality of economic evaluations of cardiac rehabilitation (CR) programs according to updated economic guidelines for healthcare interventions. Recommendations will be made to inform future research addressing the impact of a physical exercise component on cost-effectiveness. Electronic databases were searched for economic evaluations of exercise-based CR programs published in English between 2000 and 2014. The Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement was used to review the methodological quality of included economic evaluations. Fifteen economic evaluations met the review inclusion criteria. Assessed study characteristics exhibited wide variability, particularly in their economic perspective, time horizon, setting, comparators and included costs, with significant heterogeneity in exercise dose across interventions. Ten evaluations were based on randomised controlled trials (RCTs) spanning 6-24 months but often with weak or inconclusive results; two were modelling studies; and the final three utilised longer time horizons of 3.5-5 years from which findings suggest that long-term exercise-based CR results in lower costs, reduced hospitalisations and a longer cumulative patient lifetime. None of the 15 articles met all the CHEERS quality criteria, with the majority either fully or partially meeting a selection of the assessed variables. Evidence exists supporting the cost-effectiveness of exercise-based CR for cardiovascular disease patients. However, variability in CR program delivery and weak consistency between study perspective and design limits study comparability and therefore the accumulation of evidence in support of a particular exercise regime. The generalisability of study findings was limited due to the exclusion of patients with comorbidities as would typically be found in a real-world setting. The use of longer time-horizons would be more comparable with a chronic condition and enable economic assessments of the long-term effects of CR. As none of the articles met recent reporting standards for the economic assessment of healthcare interventions, it is recommended that future studies adhere to such guidelines.

Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. part 2: methodological quality and effects.

PubMed

Johansen, Monika Alise; Berntsen, Gro K Rosvold; Schuster, Tibor; Henriksen, Eva; Horsch, Alexander

2012-10-03

We conducted in two parts a systematic review of randomized controlled trials (RCTs) on electronic symptom reporting between patients and providers to improve health care service quality. Part 1 reviewed the typology of patient groups, health service innovations, and research targets. Four innovation categories were identified: consultation support, monitoring with clinician support, self-management with clinician support, and therapy. To assess the methodological quality of the RCTs, and summarize effects and benefits from the methodologically best studies. We searched Medline, EMBASE, PsycINFO, Cochrane Central Register of Controlled Trials, and IEEE Xplore for original studies presented in English-language articles between 1990 and November 2011. Risk of bias and feasibility were judged according to the Cochrane recommendation, and theoretical evidence and preclinical testing were evaluated according to the Framework for Design and Evaluation of Complex Interventions to Improve Health. Three authors assessed the risk of bias and two authors extracted the effect data independently. Disagreement regarding bias assessment, extraction, and interpretation of results were resolved by consensus discussions. Of 642 records identified, we included 32 articles representing 29 studies. No articles fulfilled all quality requirements. All interventions were feasible to implement in a real-life setting, and theoretical evidence was provided for almost all studies. However, preclinical testing was reported in only a third of the articles. We judged three-quarters of the articles to have low risk for random sequence allocation and approximately half of the articles to have low risk for the following biases: allocation concealment, incomplete outcome data, and selective reporting. Slightly more than one fifth of the articles were judged as low risk for blinding of outcome assessment. Only 1 article had low risk of bias for blinding of participants and personnel. We excluded 12 articles showing high risk or unclear risk for both selective reporting and blinding of outcome assessment from the effect assessment. The authors' hypothesis was confirmed for 13 (65%) of the 20 remaining articles. Articles on self-management support were of higher quality, allowing us to assess effects in a larger proportion of studies. All except one self-management interventions were equally effective to or better than the control option. The self-management articles document substantial benefits for patients, and partly also for health professionals and the health care system. Electronic symptom reporting between patients and providers is an exciting area of development for health services. However, the research generally is of low quality. The field would benefit from increased focus on methods for conducting and reporting RCTs. It appears particularly important to improve blinding of outcome assessment and to precisely define primary outcomes to avoid selective reporting. Supporting self-management seems to be especially promising, but consultation support also shows encouraging results.

Electronic Symptom Reporting Between Patient and Provider for Improved Health Care Service Quality: A Systematic Review of Randomized Controlled Trials. Part 2: Methodological Quality and Effects

PubMed Central

Berntsen, Gro K Rosvold; Schuster, Tibor; Henriksen, Eva; Horsch, Alexander

2012-01-01

Background We conducted in two parts a systematic review of randomized controlled trials (RCTs) on electronic symptom reporting between patients and providers to improve health care service quality. Part 1 reviewed the typology of patient groups, health service innovations, and research targets. Four innovation categories were identified: consultation support, monitoring with clinician support, self-management with clinician support, and therapy. Objective To assess the methodological quality of the RCTs, and summarize effects and benefits from the methodologically best studies. Methods We searched Medline, EMBASE, PsycINFO, Cochrane Central Register of Controlled Trials, and IEEE Xplore for original studies presented in English-language articles between 1990 and November 2011. Risk of bias and feasibility were judged according to the Cochrane recommendation, and theoretical evidence and preclinical testing were evaluated according to the Framework for Design and Evaluation of Complex Interventions to Improve Health. Three authors assessed the risk of bias and two authors extracted the effect data independently. Disagreement regarding bias assessment, extraction, and interpretation of results were resolved by consensus discussions. Results Of 642 records identified, we included 32 articles representing 29 studies. No articles fulfilled all quality requirements. All interventions were feasible to implement in a real-life setting, and theoretical evidence was provided for almost all studies. However, preclinical testing was reported in only a third of the articles. We judged three-quarters of the articles to have low risk for random sequence allocation and approximately half of the articles to have low risk for the following biases: allocation concealment, incomplete outcome data, and selective reporting. Slightly more than one fifth of the articles were judged as low risk for blinding of outcome assessment. Only 1 article had low risk of bias for blinding of participants and personnel. We excluded 12 articles showing high risk or unclear risk for both selective reporting and blinding of outcome assessment from the effect assessment. The authors’ hypothesis was confirmed for 13 (65%) of the 20 remaining articles. Articles on self-management support were of higher quality, allowing us to assess effects in a larger proportion of studies. All except one self-management interventions were equally effective to or better than the control option. The self-management articles document substantial benefits for patients, and partly also for health professionals and the health care system. Conclusion Electronic symptom reporting between patients and providers is an exciting area of development for health services. However, the research generally is of low quality. The field would benefit from increased focus on methods for conducting and reporting RCTs. It appears particularly important to improve blinding of outcome assessment and to precisely define primary outcomes to avoid selective reporting. Supporting self-management seems to be especially promising, but consultation support also shows encouraging results. PMID:23032363

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation.

PubMed

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7-8) versus Group B: 8 (7-9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals.

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation

PubMed Central

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Introduction Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. Methods In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Results Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7–8) versus Group B: 8 (7–9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). Conclusion The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals. PMID:27167982

[Audit as a tool to assess and promote the quality of medical records and hospital appropriateness: metodology and preliminary results].

PubMed

Poscia, Andrea; Cambieri, Andrea; Tucceri, Chiara; Ricciardi, Walter; Volpe, Massimo

2015-01-01

In the actual economic context, with increasing health needs, efficiency and efficacy represents fundamental keyword to ensure a successful use of the resources and the best health outcomes. Together, the medical record, completely and correctly compiled, is an essential tool in the patient diagnostic and therapeutic path, but it's becoming more and more essential for the administrative reporting and legal claims. Nevertheless, even if the improvement of medical records quality and of hospital stay appropriateness represent priorities for every health organization, they could be difficult to realize. This study aims to present the methodology and the preliminary results of a training and improvement process: it was carried out from the Hospital Management of a third level Italian teaching hospital through audit cycles to actively involve their health professionals. A self assessment process of medical records quality and hospital stay appropriateness (inpatients admission and Day Hospital) was conducted through a retrospective evaluation of medical records. It started in 2012 and a random sample of 2295 medical records was examined: the quality assessment was performed using a 48-item evaluation grid modified from the Lombardy Region manual of the medical record, while the appropriateness of each days was assessed using the Italian version of Appropriateness Evaluation Protocol (AEP) - 2002ed. The overall assessment was presented through departmental audit: the audit were designed according to the indication given by the Italian and English Ministry of Health to share the methodology and the results with all the involved professionals (doctors and nurses) and to implement improvement strategies that are synthesized in this paper. Results from quality and appropriateness assessment show several deficiencies, due to 40% of minimum level of acceptability not completely satisfied and to 30% of inappropriateness between days of hospitalization. Furthermore, there are great discrepancies among departments and among Care Units: the higher problems are centered in DHs, which are generally lacking on both profiles. Finally, our audit model, that could be considered a good project according the NHS (score of 20/25), has allowed to involve in 34 editions 480 professionals of different care Unit which are satisfied and stimulated to keep going in continuous improvement of the quality and appropriateness with these arrangements. The tools used in the project have proven their value for measuring the minimum quality of healthcare documentation and organizational appropriateness: furthermore, the audit has been shown as an effective methodology for their introduction because it ensures their acceptability among the staff and creates the basis for a rapid and quantifiable improvement that, through the promotion of accountability and transparency, could support the risk management activities and ensure greater efficiency in hospitalization.

Systematic Review and Quality Appraisal of Cost-Effectiveness Analyses of Pharmacologic Maintenance Treatment for Chronic Obstructive Pulmonary Disease: Methodological Considerations and Recommendations.

PubMed

van der Schans, Simon; Goossens, Lucas M A; Boland, Melinde R S; Kocks, Janwillem W H; Postma, Maarten J; van Boven, Job F M; Rutten-van Mölken, Maureen P M H

2017-01-01

Worldwide, chronic obstructive pulmonary disease (COPD) is a highly prevalent chronic lung disease with considerable clinical and socioeconomic impact. Pharmacologic maintenance drugs (such as bronchodilators and inhaled corticosteroids) play an important role in the treatment of COPD. The cost effectiveness of these treatments has been frequently assessed, but studies to date have largely neglected the impact of treatment sequence and the exact stage of disease in which the drugs are used in real life. We aimed to systematically review recently published articles that reported the cost effectiveness of COPD maintenance treatments, with a focus on key findings, quality and methodological issues. We performed a systematic literature search in Embase, PubMed, the UK NHS Economic Evaluation Database (NHS-EED) and EURONHEED (European Network of Health Economics Evaluation Databases) and included all relevant articles published between 2011 and 2015 in either Dutch, English or German. Main study characteristics, methods and outcomes were extracted and critically assessed. The Quality of Health Economic Studies (QHES) instrument was used as basis for quality assessment, but additional items were also addressed. The search identified 18 recent pharmacoeconomic analyses of COPD maintenance treatments. Papers reported the cost effectiveness of long-acting muscarinic antagonist (LAMA) monotherapy (n = 6), phosphodiesterase (PDE)-4 inhibitors (n = 4), long-acting beta agonist/inhaled corticosteroid (LABA/ICS) combinations (n = 4), LABA monotherapy (n = 2) and LABA/LAMA combinations (n = 2). All but two studies were funded by the manufacturer, and all studies indicated favourable cost effectiveness; however, the number of quality-adjusted life-years (QALYs) gained was small. Less than half of the studies reported a COPD-specific outcome in addition to a generic outcome (mostly QALYs). Exacerbation and mortality rates were found to be the main drivers of cost effectiveness. According to the QHES, the quality of the studies was generally sufficient, but additional assessment revealed that most studies poorly represented the cost effectiveness of real-life medication use. The majority of studies showed that pharmacologic COPD maintenance treatment is cost effective, but most studies poorly reflected real-life drug use. Consistent and COPD-specific methodology is recommended.

Methodology for assessing exposure and impacts of air pollutants in school children: Data collection, analysis and health effects - A literature review

NASA Astrophysics Data System (ADS)

Mejía, Jaime F.; Choy, Samantha Low; Mengersen, Kerrie; Morawska, Lidia

2011-02-01

The aim of this review is to explore the methodologies employed to assess the exposure of children to air pollutants, in particular traffic emissions, at school, and how these methodologies influence the assessment of the impact of this exposure on the children's health. This involves four main steps: the measurement of air quality at school level, the association between measured air quality and children's exposure, the association between children's exposure and health; and source identification. The comparative advantages and disadvantages of the methods used at each of these steps are discussed. Air quality in schools can be measured at three scales: broad scale, across several city blocks using remote monitors; school-based scale, through ground-level monitors installed within the schools or their immediate surroundings (i.e. only a few metres outside the school); and personal exposure scale using portable monitors attached to a sample of children. Although studies have reported high exposure to PAHs (polycyclic aromatic hydrocarbons), submicrometre (<1.0 μm) and ultrafine particles (<100 nm) at school, no study has investigated the formation of new particles in school facilities and only a handful of studies have analysed children's exposure at school. Associating air quality measurements at the broad and medium scale with children's exposure is challenging: there is spatial and temporal heterogeneity in the distribution of air quality within a school, indoor measurements can often exceed outdoor measurements; and exposure in the classroom is affected by the penetration of outdoor pollutants, wall absorption, emissions from furniture and other materials, level and length of occupancy, and quality of ventilation. This is further exacerbated by the fact that children move around during their school day. Quantifying the contribution of school exposure with observed health symptoms presents further challenges. In addition to ascertaining the impact of non-school-based exposures and co-morbidities, the air pollutant dose intake is affected by daily patterns of physical and traffic activity during and outside school hours which make it difficult to compare the contribution of school-based and non-school-based exposures to the health effect under investigation. Finally, there is strong evidence that low socioeconomic level is highly correlated with the proximity of the school to pollution sources, yet this area of socioeconomic research has been largely unexplored in the assessment of traffic emission exposure.

Community-based physical activity interventions among women: a systematic review

PubMed Central

Amiri Farahani, Leila; Asadi-Lari, Mohsen; Mohammadi, Eesa; Parvizy, Soroor; Haghdoost, Ali Akbar; Taghizadeh, Ziba

2015-01-01

Objective Review and assess the effectiveness of community-based physical activity interventions among women aged 18–65 years. Design Systematic review Methods To find relevant articles, the researcher selected reports published in English between 1 January 2000 and 31 March 2013. Systematic search was to find controlled-trial studies that were conducted to uncover the effect of community-based interventions to promote physical activity among women 18–65 years of age, in which physical activity was reported as one of the measured outcomes. The methodological quality assessment was performed using a critical appraisal sheet. Also, the levels of evidence were assessed for the types of interventions. Results The literature search identified nine articles. Four of the studies were randomised and the others studies had high methodological quality. There was no evidence, on the basis of effectiveness, for social cognitive theory-based interventions and inconclusive evidence of effectiveness for the rest of interventions. Conclusions There is insufficient evidence to assess the effectiveness of community-based interventions for enhancing physical activity among women. There is a need for high-quality randomised clinical trials with adequate statistical power to determine whether multicomponent and community-based intervention programmes increase physical activity among women, as well as to determine what type of interventions have a more effective and sustainable impact on women's physical activity. PMID:25833668

Prediction models for intracranial hemorrhage or major bleeding in patients on antiplatelet therapy: a systematic review and external validation study.

PubMed

Hilkens, N A; Algra, A; Greving, J P

2016-01-01

ESSENTIALS: Prediction models may help to identify patients at high risk of bleeding on antiplatelet therapy. We identified existing prediction models for bleeding and validated them in patients with cerebral ischemia. Five prediction models were identified, all of which had some methodological shortcomings. Performance in patients with cerebral ischemia was poor. Background Antiplatelet therapy is widely used in secondary prevention after a transient ischemic attack (TIA) or ischemic stroke. Bleeding is the main adverse effect of antiplatelet therapy and is potentially life threatening. Identification of patients at increased risk of bleeding may help target antiplatelet therapy. This study sought to identify existing prediction models for intracranial hemorrhage or major bleeding in patients on antiplatelet therapy and evaluate their performance in patients with cerebral ischemia. We systematically searched PubMed and Embase for existing prediction models up to December 2014. The methodological quality of the included studies was assessed with the CHARMS checklist. Prediction models were externally validated in the European Stroke Prevention Study 2, comprising 6602 patients with a TIA or ischemic stroke. We assessed discrimination and calibration of included prediction models. Five prediction models were identified, of which two were developed in patients with previous cerebral ischemia. Three studies assessed major bleeding, one studied intracerebral hemorrhage and one gastrointestinal bleeding. None of the studies met all criteria of good quality. External validation showed poor discriminative performance, with c-statistics ranging from 0.53 to 0.64 and poor calibration. A limited number of prediction models is available that predict intracranial hemorrhage or major bleeding in patients on antiplatelet therapy. The methodological quality of the models varied, but was generally low. Predictive performance in patients with cerebral ischemia was poor. In order to reliably predict the risk of bleeding in patients with cerebral ischemia, development of a prediction model according to current methodological standards is needed. © 2015 International Society on Thrombosis and Haemostasis.

How does study quality affect the results of a diagnostic meta-analysis?

PubMed Central

Westwood, Marie E; Whiting, Penny F; Kleijnen, Jos

2005-01-01

Background The use of systematic literature review to inform evidence based practice in diagnostics is rapidly expanding. Although the primary diagnostic literature is extensive, studies are often of low methodological quality or poorly reported. There has been no rigorously evaluated, evidence based tool to assess the methodological quality of diagnostic studies. The primary objective of this study was to determine the extent to which variations in the quality of primary studies impact the results of a diagnostic meta-analysis and whether this differs with diagnostic test type. A secondary objective was to contribute to the evaluation of QUADAS, an evidence-based tool for the assessment of quality in diagnostic accuracy studies. Methods This study was conducted as part of large systematic review of tests used in the diagnosis and further investigation of urinary tract infection (UTI) in children. All studies included in this review were assessed using QUADAS, an evidence-based tool for the assessment of quality in systematic reviews of diagnostic accuracy studies. The impact of individual components of QUADAS on a summary measure of diagnostic accuracy was investigated using regression analysis. The review divided the diagnosis and further investigation of UTI into the following three clinical stages: diagnosis of UTI, localisation of infection, and further investigation of the UTI. Each stage used different types of diagnostic test, which were considered to involve different quality concerns. Results Many of the studies included in our review were poorly reported. The proportion of QUADAS items fulfilled was similar for studies in different sections of the review. However, as might be expected, the individual items fulfilled differed between the three clinical stages. Regression analysis found that different items showed a strong association with test performance for the different tests evaluated. These differences were observed both within and between the three clinical stages assessed by the review. The results of regression analyses were also affected by whether or not a weighting (by sample size) was applied. Our analysis was severely limited by the completeness of reporting and the differences between the index tests evaluated and the reference standards used to confirm diagnoses in the primary studies. Few tests were evaluated by sufficient studies to allow meaningful use of meta-analytic pooling and investigation of heterogeneity. This meant that further analysis to investigate heterogeneity could only be undertaken using a subset of studies, and that the findings are open to various interpretations. Conclusion Further work is needed to investigate the influence of methodological quality on the results of diagnostic meta-analyses. Large data sets of well-reported primary studies are needed to address this question. Without significant improvements in the completeness of reporting of primary studies, progress in this area will be limited. PMID:15943861

Effects of muscle stretching exercises in the treatment of fibromyalgia: a systematic review.

PubMed

Lorena, Suélem Barros de; Lima, Maria do Carmo Correia de; Ranzolin, Aline; Duarte, Ângela Luiza Branco Pinto

2015-01-01

This study has the objective to systematize scientific evidences about the use of muscle stretching exercises in the treatment of FM. It was performed from retrospective research without chronological and linguistic limits, at databases of MEDLINE, LILACS, SciELO and PEDro, as well as at PubMed search tool. Data collection was performed by two independent reviewers in October 2012, with the search strategy formulated by crossing descriptors and relevant terms to the topic in English, Portuguese and Spanish languages. Randomized clinical trials, only with patients with a clinical diagnosis of fibromyalgia and muscle stretching exercises as a therapeutic measure at least in one of the intervention groups were included. Included studies were assessed for methodological quality using PEDro scale and their references analyzed to highlight additional sources. The search amounted to an average of 6,794 items. Only five articles were selected, one being excluded because of its low methodological quality. Pain was assessed unanimously. The method and timing of interventions varied widely, there was poor mention of the parameters used in the stretches and absence of specific physical examinations. There was significant improvement in all studies regarding pain, besides as related to quality of life and physical condition. It is clear the importance of muscle stretching in the treatment of FM, however, there is a need for further studies to establish the real benefits of the technique, because the majority of published studies shows low methodological quality and there is a lack of standardization regarding the use of this resource. Copyright © 2014 Elsevier Editora Ltda. All rights reserved.

Inventory of Personal Factors Influencing Conditioned Pain Modulation in Healthy People: A Systematic Literature Review.

PubMed

Hermans, Linda; Van Oosterwijck, Jessica; Goubert, Dorien; Goudman, Lisa; Crombez, Geert; Calders, Patrick; Meeus, Mira

2016-07-01

Conditioned pain modulation (CPM) is believed to play an important role in the development and exacerbation of chronic pain, because dysfunction of CPM is associated with a shift in balance between pain facilitation and pain inhibition. In many patients with central sensitization, CPM is less efficacious. Besides that, efficacy of CPM is highly variable in healthy people. Consequently, it seems that several individual variables may influence CPM. A systematic review examining personal factors influencing CPM was conducted. This systematic review follows the PRISMA guidelines. "Pubmed" and "Web of Science" were searched using different synonyms of CPM. Full-text clinical reports addressing the influence of personal factors on CPM in healthy adults were included. Checklists for RCTs and case-control studies provided by the Dutch Institute for Healthcare Improvement (CBO) and the Dutch Cochrane Centre were utilized to assess methodological quality. Levels of evidence and strength of conclusion were assigned using the CBO guidelines. Forty-six articles were identified that reported the influence of personal factors on CPM. Quality assessment revealed 10 studies with a methodological quality less than 50% wherefore they were excluded (21.8%), resulting in a general total methodological quality score of 72.5%. Overall younger adult age, male gender, ovulatory phase, positive expectations, attention to the conditioning stimulus, and carrier of the 5-HTTLPR long allele result in better CPM. It is advised for future studies to take these factors into account. Further research regarding the influence of oral contraceptives, catastrophizing, information about conditioning stimulation, distraction, physical activity, and genetics on CPM magnitude is required. © 2015 World Institute of Pain.

Cohen's Kappa and classification table metrics 2.0: An ArcView 3.x extension for accuracy assessment of spatially explicit models

Treesearch

Jeff Jenness; J. Judson Wynne

2005-01-01

In the field of spatially explicit modeling, well-developed accuracy assessment methodologies are often poorly applied. Deriving model accuracy metrics have been possible for decades, but these calculations were made by hand or with the use of a spreadsheet application. Accuracy assessments may be useful for: (1) ascertaining the quality of a model; (2) improving model...

Measurement Properties of the Functional Rating Index: A systematic Review and Meta-analysis.

PubMed

Bai, Zhongfei; Shu, Tian; Lu, Jiani; Niu, Wenxin

2018-04-13

A systematic review and meta-analysis. To assess the measurement properties of the Functional Rating Index (FRI) and determine whether its measurement properties are comparable with other region-specific questionnaires. In addition to low back pain (LBP) and neck pain (NP), multi-region spinal pain (SP) is a common problem with a considerable prevalence in the general population. The FRI was built to assess physical functioning in patients with SP. However, a systematic review assessing evidence of its measurement properties in separated populations and a comparison with other questionnaires regarding each measurement property is lacking. Articles concerning the FRI's measurement properties or head-to-head comparison with other questionnaires on measurement properties were obtained from MEDLINE, Embase, CINAHL, and PsycINFO. Two reviewers independently reviewed the articles, extracted data, and conducted the methodological quality assessment. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to assess the methodological quality of the included studies. A total of 18 studies evaluating the FRI's measurement properties, including seven that carried out head-to-head comparisons in at least one measurement property with other questionnaires, were included in the current review. Our findings show strong positive evidence for structural validity and internal consistency in patients with SP and LBP. Evidence for most of the FRI's measurement properties is limited, conflicting, or even unknown. The current evidence shows that the FRI is comparable with both the ODI and the NDI in responsiveness. However, relevant information about the majority of the other measurement properties is lacking. Our finding suggests that clinicians and researchers should use the FRI with caution until there are more studies with high methodological quality that support the view that it is positive in all measurement properties, especially in regard to patients with multi-region SP. 1.

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments.

PubMed

Langer, Astrid

2012-08-16

Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test.

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments

PubMed Central

2012-01-01

Background Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. Methods To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. Results The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. Conclusions The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test. PMID:22894708

Is Hyperbaric Oxygen Therapy Effective for Traumatic Brain Injury? A Rapid Evidence Assessment of the Literature and Recommendations for the Field.

PubMed

Crawford, Cindy; Teo, Lynn; Yang, EunMee; Isbister, Caitlin; Berry, Kevin

This systematic review examines the efficacy of hyperbaric oxygen (HBO2) for traumatic brain injury (TBI) to make evidence-based recommendations for its application and future research. A comprehensive search was conducted to identify studies through 2014. Methodological quality was assessed and synthesis and interpretation of relevant data was performed. Twelve randomized trials were included. All mild TBI studies demonstrated minimal bias and no statistically significant differences between HBO2 and sham arms. Statistically significant improvement occurred over time within both groups. Moderate-to-severe TBI studies were of mixed quality, with majority of results favoring HBO2 compared with "standard care." The placebo analysis conducted was limited by lack of details. For mild TBI, results indicate HBO2 is no better than sham treatment. Improvements within both HBO2 and sham groups cannot be ignored. For acute treatment of moderate-to-severe TBI, although methodology appears flawed across some studies, because of the complexity of brain injury, HBO2 may be beneficial as a relatively safe adjunctive therapy if feasible. Further research should be considered to resolve the controversy surrounding this field, but only if methodological flaws are avoided and bias minimized.

Bruxism is unlikely to cause damage to the periodontium: findings from a systematic literature assessment.

PubMed

Manfredini, Daniele; Ahlberg, Jari; Mura, Rossano; Lobbezoo, Frank

2015-04-01

This paper systematically reviews the MEDLINE and SCOPUS literature to answer the following question: Is there any evidence that bruxism may cause periodontal damage per se? Clinical studies on humans, assessing the potential relationship between bruxism and periodontal lesions (i.e., decreased attachment level, bone loss, tooth mobility/migration, altered periodontal perception) were eligible. Methodologic shortcomings were identified by the adoption of the Critical Appraisal Skills Program quality assessment, mainly concerning the internal validity of findings according to an unspecific bruxism diagnosis. The six included articles covered a high variability of topics, without multiple papers on the same argument. Findings showed that the only effect of bruxism on periodontal structures was an increase in periodontal sensation, whereas a relationship with periodontal lesions was absent. Based on the analysis of Hill criteria, the validity of causation conclusions was limited, mainly owing to the absence of a longitudinal evaluation of the temporal relationship and dose-response effects between bruxism and periodontal lesions. Despite the scarce quantity and quality of the literature that prevents sound conclusions on the causal link between bruxism and the periodontal problems assessed in this review, it seems reasonable to suggest that bruxism cannot cause periodontal damage per se. It is also important to emphasize, however, that because of methodologic problems, particularly regarding sleep bruxism assessment, more high-quality studies (e.g., randomized controlled trials) are needed to further clarify this issue.

Methodological Quality of Systematic Reviews Published in the Urological Literature from 1998 to 2012.

PubMed

Corbyons, Katherine; Han, Julia; Neuberger, Molly M; Dahm, Philipp

2015-11-01

Systematic reviews synthesize the current best evidence to address a clinical question. Given the growing emphasis on evidence-based clinical practice, systematic reviews are being increasingly sought after and published. We previously reported limitations in the methodological quality of 57 individual systematic reviews published from 1998 to 2008. We provide an update to our previous study, adding systematic reviews published from 2009 to 2012. We systematically searched PubMed® and hand searched the table of contents of 4 major urological journals to identify systematic reviews related to questions of prevention and therapy. Two independent reviewers with prior formal evidence-based medicine training assessed the methodological quality using the validated 11-point AMSTAR (A Measurement Tool to Assess Systematic Reviews) instrument. We performed predefined statistical hypothesis testing for differences by publication period (1998 to 2008 vs 2009 to 2012) and journal of publication. We performed statistical testing using SPSS®, version 23.0 with a 2-sided α of 0.05 using the Student t-test, ANOVA and the chi-square test. A total of 113 systematic reviews published from 2009 to 2012 met study inclusion criteria. The most common topics were oncology (44 reviews or 38.9%), voiding dysfunction (26 or 23.0%) and stones/endourology (13 or 11.5%). The largest contributor was European Urology (46 reviews or 40.7%), followed by BJU International (31 or 27.4%) and The Journal of Urology® (22 or 19.5%). The mean ± SD AMSTAR score for the 2009 to 2012 period was 5.3 ± 2.3 compared to 4.8 ± 2.0 for 1998 to 2008 with a mean difference of 0.5 (95% CI 0.2 to 1.2, p = 0.133). While the number of systematic reviews published in the urological literature has increased substantially, the methodological quality of these studies remains suboptimal. Systematic review authors and editors should make every effort to adhere to well established methodological standards to enhance the impact of their research efforts. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Comparing methodologies to assess transportation and air quality impacts of Brownfields and infill development.

DOT National Transportation Integrated Search

2001-08-01

States and communities across the country are actively pursuing smart growth strategies. New transit : lines are opening to higher ridership than expected. States and communities have passed hundreds of : ballot initiatives preserving open space, inc...

Systematic review of the cost effectiveness of prophylactic treatments in the prevention of gastropathy in patients with rheumatoid arthritis or osteoarthritis taking non-steroidal anti-inflammatory drugs

PubMed Central

van Dieten, H. E M; Bos, I.; van Tulder, M. W; Lems, W.; Dijkmans, B.; Boers, M.

2000-01-01

A systematic review on the cost effectiveness of prophylactic treatments of non-steroidal anti-inflammatory drug (NSAID) induced gastropathy in patients with osteoarthritis or rheumatoid arthritis was conducted. Two reviewers conducted the literature search and the review. Both full and partial economic evaluations published in English, Dutch, or German were included. The criteria list published in the textbook of Drummond was used to determine the quality of the economic evaluations. The methodological quality of three randomised controlled trials (RCTs) in which the economic evaluations obtained probability estimates of NSAID induced gastropathy and adverse events was assessed by a list of internal validity criteria. The conclusions were based on a rating system consisting of four levels of evidence.
  Ten economic evaluations were included; three were based on RCTs. All evaluations studied misoprostol as prophylactic treatment: in one evaluation misoprostol was studied as a fixed component in a combination with diclofenac (Arthrotec). All economic evaluations comprised analytical studies containing a decision tree. The three trials were of high methodological quality. Nine economic evaluations were considered high quality and one economic evaluation was considered of low methodological quality. There is strong evidence (level "A") that the use of misoprostol for the prevention of NSAID induced gastropathy is cost effective, and limited evidence (level "C") that the use of Arthrotec is cost effective. Although the levels of evidence used in this review are arbitrary, it is believed that a qualitative analysis is useful: quantitative analyses in this field are hampered by the heterogeneity of economic evaluations. Existing criteria to evaluate the methodological quality of economic evaluations may need refinement for use in systematic reviews.

 PMID:11005773

Systematic review of the cost effectiveness of prophylactic treatments in the prevention of gastropathy in patients with rheumatoid arthritis or osteoarthritis taking non-steroidal anti-inflammatory drugs.

PubMed

van Dieten, H E; Korthals-de Bos, I B; van Tulder, M W; Lems, W F; Dijkmans, B A; Boers, M

2000-10-01

A systematic review on the cost effectiveness of prophylactic treatments of non-steroidal anti-inflammatory drug (NSAID) induced gastropathy in patients with osteoarthritis or rheumatoid arthritis was conducted. Two reviewers conducted the literature search and the review. Both full and partial economic evaluations published in English, Dutch, or German were included. The criteria list published in the textbook of Drummond was used to determine the quality of the economic evaluations. The methodological quality of three randomised controlled trials (RCTs) in which the economic evaluations obtained probability estimates of NSAID induced gastropathy and adverse events was assessed by a list of internal validity criteria. The conclusions were based on a rating system consisting of four levels of evidence. Ten economic evaluations were included; three were based on RCTs. All evaluations studied misoprostol as prophylactic treatment: in one evaluation misoprostol was studied as a fixed component in a combination with diclofenac (Arthrotec). All economic evaluations comprised analytical studies containing a decision tree. The three trials were of high methodological quality. Nine economic evaluations were considered high quality and one economic evaluation was considered of low methodological quality. There is strong evidence (level "A") that the use of misoprostol for the prevention of NSAID induced gastropathy is cost effective, and limited evidence (level "C") that the use of Arthrotec is cost effective. Although the levels of evidence used in this review are arbitrary, it is believed that a qualitative analysis is useful: quantitative analyses in this field are hampered by the heterogeneity of economic evaluations. Existing criteria to evaluate the methodological quality of economic evaluations may need refinement for use in systematic reviews.

Measurement properties of translated versions of neck-specific questionnaires: a systematic review

PubMed Central

2011-01-01

Background Several disease-specific questionnaires to measure pain and disability in patients with neck pain have been translated. However, a simple translation of the original version doesn't guarantee similar measurement properties. The objective of this study is to critically appraise the quality of the translation process, cross-cultural validation and the measurement properties of translated versions of neck-specific questionnaires. Methods Bibliographic databases were searched for articles concerning the translation or evaluation of the measurement properties of a translated version of a neck-specific questionnaire. The methodological quality of the selected studies and the results of the measurement properties were critically appraised and rated using the COSMIN checklist and criteria for measurement properties. Results The search strategy resulted in a total of 3641 unique hits, of which 27 articles, evaluating 6 different questionnaires in 15 different languages, were included in this study. Generally the methodological quality of the translation process is poor and none of the included studies performed a cross-cultural adaptation. A substantial amount of information regarding the measurement properties of translated versions of the different neck-specific questionnaires is lacking. Moreover, the evidence for the quality of measurement properties of the translated versions is mostly limited or assessed in studies of poor methodological quality. Conclusions Until results from high quality studies are available, we advise to use the Catalan, Dutch, English, Iranian, Korean, Spanish and Turkish version of the NDI, the Chinese version of the NPQ, and the Finnish, German and Italian version of the NPDS. The Greek NDI needs cross-cultural validation and there is no methodologically sound information for the Swedish NDI. For all other languages we advise to translate the original version of the NDI. PMID:21645355

Measurement properties of translated versions of neck-specific questionnaires: a systematic review.

PubMed

Schellingerhout, Jasper M; Heymans, Martijn W; Verhagen, Arianne P; de Vet, Henrica C; Koes, Bart W; Terwee, Caroline B

2011-06-06

Several disease-specific questionnaires to measure pain and disability in patients with neck pain have been translated. However, a simple translation of the original version doesn't guarantee similar measurement properties. The objective of this study is to critically appraise the quality of the translation process, cross-cultural validation and the measurement properties of translated versions of neck-specific questionnaires. Bibliographic databases were searched for articles concerning the translation or evaluation of the measurement properties of a translated version of a neck-specific questionnaire. The methodological quality of the selected studies and the results of the measurement properties were critically appraised and rated using the COSMIN checklist and criteria for measurement properties. The search strategy resulted in a total of 3641 unique hits, of which 27 articles, evaluating 6 different questionnaires in 15 different languages, were included in this study. Generally the methodological quality of the translation process is poor and none of the included studies performed a cross-cultural adaptation. A substantial amount of information regarding the measurement properties of translated versions of the different neck-specific questionnaires is lacking. Moreover, the evidence for the quality of measurement properties of the translated versions is mostly limited or assessed in studies of poor methodological quality. Until results from high quality studies are available, we advise to use the Catalan, Dutch, English, Iranian, Korean, Spanish and Turkish version of the NDI, the Chinese version of the NPQ, and the Finnish, German and Italian version of the NPDS. The Greek NDI needs cross-cultural validation and there is no methodologically sound information for the Swedish NDI. For all other languages we advise to translate the original version of the NDI.

Is there relationship between temporomandibular disorders and head and cervical posture? A systematic review.

PubMed

Rocha, C P; Croci, C S; Caria, P H F

2013-11-01

The objective of this systematic review was to find sufficient evidence to deny or accept the association between the head and cervical posture and temporomandibular disorders (TMDs), and thus assist health professionals in the evaluation and treatment of patients with TMDs. A search was conducted through all publications written in English about this topic using the databases from Medline, ISI Web of Science, EMBASE, PubMed and Lilacs. The abstracts that fulfilled the initial guideline were retrieved and evaluated to ensure they met the inclusion criteria. To assess the methodological quality of the studies, we developed a questionnaire considering the following criteria: participant's eligibility, control group, diagnosis of TMDs, posture diagnosis and randomisation. Twenty-two studies were selected as potential studies based on their abstracts. Only seventeen studies actually fulfilled the inclusion criteria. The search provided information about the methodological quality of the studies, in which several methodological defects were found. The evidence presented in this systematic review shows that the relation between TMDs and the head and neck posture is still controversial and unclear. The insufficient number of articles considered of excellent methodological quality is a factor that hinders the acceptance or denial of this association. © 2013 John Wiley & Sons Ltd.

Measurement properties of the upright motor control test for adults with stroke: a systematic review.

PubMed

Gorgon, Edward James R; Lazaro, Rolando T

2016-01-01

The Upright Motor Control Test (UMCT) has been used in clinical practice and research to assess functional strength of the hemiparetic lower limb in adults with stroke. It is unclear if evidence is sufficient to warrant its use. The purpose of this systematic review was to synthesize available evidence on the measurement properties of the UMCT for stroke rehabilitation. Electronic databases that indexed biomedical literature were systematically searched from inception until October 2015 (week 4): Embase, PubMed, Web of Science, CINAHL, PEDro, Cochrane Library, Scopus, ScienceDirect, SPORTDiscus, LILACS, DOAJ, and Google Scholar. All studies that had used the UMCT in the time period covered underwent hand searching for any additional study. Observational studies involving adults with stroke that explored any measurement property of the UMCT were included. The COnsensus-based Standards for the selection of health Measurement INstruments was used to assess the methodological quality of included studies. The CanChild Outcome Measures Rating Form was used for extracting data on measurement properties and clinical utility. The search yielded three methodologic studies that addressed criterion-related validity and contruct validity. Two studies of fair methodological quality demonstrated moderate-level evidence that Knee Extension and Knee Flexion subtest scores were predictive of community-level and household-level ambulation. One study of fair methodological quality provided limited-level evidence for the correlation of Knee Extension subtest scores with a laboratory measure of ground reaction forces. No published studies formally assessed reliability, responsiveness, or clinical utility. Limited information on responsiveness and clinical utility dimensions could be inferred from the included studies. The UMCT is a practical assessment tool for voluntary control or functional strength of the hemiparetic lower limb in standing in adults with stroke. Although different levels of evidence suggest that the Knee Extension and Knee Flexion subtests may possess criterion and construct validity, the lack of published literature examining content validity, reliability, and responsiveness raises questions regarding the use of the UMCT in routine clinical practice. These key findings highlight the need to further investigate the UMCT's measurement properties toward enhancing its standardization.

Traditional Chinese medicine injection for angina pectoris: an overview of systematic reviews.

PubMed

Luo, Jing; Shang, Qinghua; Han, Mei; Chen, Keji; Xu, Hao

2014-01-01

Traditional Chinese medicine (TCM) injection is widely used to treat angina pectoris in China. This overview aims to systematically summarize the general characteristics of systematic reviews (SRs) on TCM injection in treating angina, and assess the methodological and reporting quality of these reviews. We searched PubMed, Embase, the Cochrane Library and four Chinese databases from inception until March 2013. Data were extracted according to a preset form. The AMSTAR and PRISMA checklists were used to explore the methodological quality and reporting characteristics of included reviews, respectively. All data analyses were descriptive. 46 SRs involving over 57,463 participants with angina reviewing 23 kinds of TCM injections were included. The main outcomes evaluated in the reviews were symptoms (43/46, 93.5%), surrogate outcomes (42/46, 91.3%) and adverse events (41/46, 87.0%). Few reviews evaluated endpoints (7/46, 15.2%) and quality of life (1/46, 2.2%). One third of the reviews (16/46, 34.8%) drew definitely positive conclusions while the others (30/46, 65.2%) suggested potential benefits mainly in symptoms, electrocardiogram and adverse events. With many serious flaws such as lack of a protocol and inappropriate data synthesis, the overall methodological and reporting quality of the reviews was limited. While many SRs of TCM injection on the treatment of angina suggested potential benefits or definitely positive effects, stakeholders should not accept the findings of these reviews uncritically due to the limited methodological and reporting quality. Future SRs should be appropriately conducted and reported according to international standards such as AMSTAR and PRISMA, rather than published in large numbers.

Measures and Indicators of Vgi Quality: AN Overview

NASA Astrophysics Data System (ADS)

Antoniou, V.; Skopeliti, A.

2015-08-01

The evaluation of VGI quality has been a very interesting and popular issue amongst academics and researchers. Various metrics and indicators have been proposed for evaluating VGI quality elements. Various efforts have focused on the use of well-established methodologies for the evaluation of VGI quality elements against authoritative data. In this paper, a number of research papers have been reviewed and summarized in a detailed report on measures for each spatial data quality element. Emphasis is given on the methodology followed and the data used in order to assess and evaluate the quality of the VGI datasets. However, as the use of authoritative data is not always possible many researchers have turned their focus on the analysis of new quality indicators that can function as proxies for the understanding of VGI quality. In this paper, the difficulties in using authoritative datasets are briefly presented and new proposed quality indicators are discussed, as recorded through the literature review. We classify theses new indicators in four main categories that relate with: i) data, ii) demographics, iii) socio-economic situation and iv) contributors. This paper presents a dense, yet comprehensive overview of the research on this field and provides the basis for the ongoing academic effort to create a practical quality evaluation method through the use of appropriate quality indicators.

Introducing a methodology for estimating duration of surgery in health services research.

PubMed

Redelmeier, Donald A; Thiruchelvam, Deva; Daneman, Nick

2008-09-01

The duration of surgery is an indicator for the quality, risks, and efficiency of surgical procedures. We introduce a new methodology for assessing the duration of surgery based on anesthesiology billing records, along with reviewing its fundamental logic and limitations. The validity of the methodology was assessed through a population-based cohort of patients (n=480,986) undergoing elective operations in 246 Ontario hospitals with 1,084 anesthesiologists between April 1, 1992 and March 31, 2002 (10 years). The weaknesses of the methodology relate to missing data, self-serving exaggerations by providers, imprecisions from clinical diversity, upper limits due to accounting regulations, fluctuations from updates over the years, national differences in reimbursement schedules, and the general failings of claims base analyses. The strengths of the methodology are in providing data that match clinical experiences, correspond to chart review, are consistent over time, can detect differences where differences would be anticipated, and might have implications for examining patient outcomes after long surgical times. We suggest that an understanding and application of large studies of surgical duration may help scientists explore selected questions concerning postoperative complications.

The NCC project: A quality management perspective

NASA Technical Reports Server (NTRS)

Lee, Raymond H.

1993-01-01

The Network Control Center (NCC) Project introduced the concept of total quality management (TQM) in mid-1990. The CSC project team established a program which focused on continuous process improvement in software development methodology and consistent deliveries of high quality software products for the NCC. The vision of the TQM program was to produce error free software. Specific goals were established to allow continuing assessment of the progress toward meeting the overall quality objectives. The total quality environment, now a part of the NCC Project culture, has become the foundation for continuous process improvement and has resulted in the consistent delivery of quality software products over the last three years.

Systematic review of measurement properties of self-reported instruments for evaluating self-care in adults.

PubMed

Matarese, Maria; Lommi, Marzia; De Marinis, Maria Grazia

2017-06-01

The aims of this study were as follows: to identify instruments developed to assess self-care in healthy adults; to determine the theory on which they were based; their validity and reliability properties and to synthesize the evidence on their measurement properties. Many instruments have been developed to assess self-care in many different populations and conditions. Clinicians and researchers should select the most appropriate self-care instrument based on the knowledge of their measurement properties. Systematic review of measurement instruments according to the protocol recommended by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. PubMed, Embase, PsycINFO, Scopus and CINAHL databases were searched from inception to December 2015. Studies testing measurement properties of self-report instruments assessing self-care in healthy adults, published in the English language and in peer review journals were selected. Two reviewers independently appraised the methodological quality of the studies with the COSMIN checklist and the quality of results using specific quality criteria. Twenty-six articles were included in the review testing the measurement properties of nine instruments. Seven instruments were based on Orem's Self-care theory. Not all the measurement properties were evaluated for the identified instruments. No self-care instrument showed strong evidence supporting the evaluated measurement properties. Despite the development of several instruments to assess self-care in the adult population, no instrument can be fully recommended to clinical nurses and researchers. Further studies of high methodological quality are needed to confirm the measurement properties of these instruments. © 2016 John Wiley & Sons Ltd.

Improving the wellbeing of staff who work in palliative care settings: A systematic review of psychosocial interventions.

PubMed

Hill, Rebecca C; Dempster, Martin; Donnelly, Michael; McCorry, Noleen K

2016-10-01

Staff in palliative care settings perform emotionally demanding roles which may lead to psychological distress including stress and burnout. Therefore, interventions have been designed to address these occupational risks. To investigate quantitative studies exploring the effectiveness of psychosocial interventions that attempt to improve psychological wellbeing of palliative care staff. A systematic review was conducted according to methodological guidance from UK Centre for Reviews and Dissemination. A search strategy was developed based on the initial scans of palliative care studies. Potentially eligible research articles were identified by searching the following databases: CINAHL, MEDLINE (Ovid), PsycINFO and Web of Science. Two reviewers independently screened studies against pre-set eligibility criteria. To assess quality, both researchers separately assessed the remaining studies using the Quality Assessment Tool for Quantitative Studies. A total of 1786 potentially eligible articles were identified - nine remained following screening and quality assessment. Study types included two randomised controlled trials, two non-randomised controlled trial designs, four one-group pre-post evaluations and one process evaluation. Studies took place in the United States and Canada (5), Europe (3) and Hong Kong (1). Interventions comprised a mixture of relaxation, education, support and cognitive training and targeted stress, fatigue, burnout, depression and satisfaction. The randomised controlled trial evaluations did not improve psychological wellbeing of palliative care staff. Only two of the quasi-experimental studies appeared to show improved staff wellbeing although these studies were methodologically weak. There is an urgent need to address the lack of intervention development work and high-quality research in this area. © The Author(s) 2016.

Changes in clinical trials methodology over time: a systematic review of six decades of research in psychopharmacology.

PubMed

Brunoni, André R; Tadini, Laura; Fregni, Felipe

2010-03-03

There have been many changes in clinical trials methodology since the introduction of lithium and the beginning of the modern era of psychopharmacology in 1949. The nature and importance of these changes have not been fully addressed to date. As methodological flaws in trials can lead to false-negative or false-positive results, the objective of our study was to evaluate the impact of methodological changes in psychopharmacology clinical research over the past 60 years. We performed a systematic review from 1949 to 2009 on MEDLINE and Web of Science electronic databases, and a hand search of high impact journals on studies of seven major drugs (chlorpromazine, clozapine, risperidone, lithium, fluoxetine and lamotrigine). All controlled studies published 100 months after the first trial were included. Ninety-one studies met our inclusion criteria. We analyzed the major changes in abstract reporting, study design, participants' assessment and enrollment, methodology and statistical analysis. Our results showed that the methodology of psychiatric clinical trials changed substantially, with quality gains in abstract reporting, results reporting, and statistical methodology. Recent trials use more informed consent, periods of washout, intention-to-treat approach and parametric tests. Placebo use remains high and unchanged over time. Clinical trial quality of psychopharmacological studies has changed significantly in most of the aspects we analyzed. There was significant improvement in quality reporting and internal validity. These changes have increased study efficiency; however, there is room for improvement in some aspects such as rating scales, diagnostic criteria and better trial reporting. Therefore, despite the advancements observed, there are still several areas that can be improved in psychopharmacology clinical trials.

Promoting Teaching, Learning and Informed Decision-Making through the Lenses of International Large-Scale Assessment: Looking beyond Numbers

ERIC Educational Resources Information Center

Säljö, Roger; Radišic, Jelena

2018-01-01

Public discussion on the quality of education in different corners of the world very much relies on the data provided by the international large-scale assessment (ILSA) studies. While aware of different methodological keystones and technicalities embedded in these, the idea behind this special issue is to contribute to the understanding of how…

Design and Development of Rubrics to Improve Assessment Outcomes: A Pilot Study in a Master's Level Business Program in India

ERIC Educational Resources Information Center

Reddy, Malini Y.

2011-01-01

Purpose: This paper seeks to discuss the characteristics that describe a rubric. It aims to propose a systematic method for developing curriculum wide rubrics and to discuss their potential utility for program quality assessment. Design/methodology/approach: Implementation of rubrics is a recent phenomenon in higher education. Prior research and…

Teaching Self- and Social Competencies in the Retail Sector: Findings from Vocational Schools in Germany, Italy and Poland

ERIC Educational Resources Information Center

Edeling, Sabrina; Pilz, Matthias

2016-01-01

Purpose: The purpose of this paper is to use teaching and learning units specially devised for development of self-competencies and social competencies in the retail sector to explore how learners assess these units in relation to acceptance, quality and self-assessment of improvement in their own performance. Design/methodology/approach: The…

Department of Defense Dependents Schools Comprehensive Social Studies Program Evaluation, Spring, 1980. Summary Report.

ERIC Educational Resources Information Center

National Evaluation Systems, Inc., Amherst, MA.

The methodology and results of an assessment designed to determine the status of educational quality in grades 4, 8, and 11 social studies programs of the Department of Defense Dependents Schools (DODDS) is summarized. The assessment was part of the DODDS five-year curriculum development cycle comprised of the following phases: (1) development of…

Diagnosing Alzheimer's disease: a systematic review of economic evaluations.

PubMed

Handels, Ron L H; Wolfs, Claire A G; Aalten, Pauline; Joore, Manuela A; Verhey, Frans R J; Severens, Johan L

2014-03-01

The objective of this study is to systematically review the literature on economic evaluations of interventions for the early diagnosis of Alzheimer's disease (AD) and related disorders and to describe their general and methodological characteristics. We focused on the diagnostic aspects of the decision models to assess the applicability of existing decision models for the evaluation of the recently revised diagnostic research criteria for AD. PubMed and the National Institute for Health Research Economic Evaluation database were searched for English-language publications related to economic evaluations on diagnostic technologies. Trial-based economic evaluations were assessed using the Consensus on Health Economic Criteria list. Modeling studies were assessed using the framework for quality assessment of decision-analytic models. The search retrieved 2109 items, from which eight decision-analytic modeling studies and one trial-based economic evaluation met all eligibility criteria. Diversity among the study objective and characteristics was considerable and, despite considerable methodological quality, several flaws were indicated. Recommendations were focused on diagnostic aspects and the applicability of existing models for the evaluation of recently revised diagnostic research criteria for AD. Copyright © 2014 The Alzheimer's Association. Published by Elsevier Inc. All rights reserved.

Assessing the evidence of Six Sigma and Lean in the health care industry.

PubMed

DelliFraine, Jami L; Langabeer, James R; Nembhard, Ingrid M

2010-01-01

Popular quality improvement tools such as Six Sigma and Lean Systems (SS/L) claim to provide health care managers the opportunity to improve health care quality on the basis of sound methodology and data. However, it is unclear whether these 2 quality improvement tools actually improve health care quality. The authors conducted a comprehensive literature review to assess the empirical evidence relating SS/L to improved clinical outcomes, processes of care, and financial performance of health care organizations. The authors identified 177 articles on SS/L published in the last 10 years. However, only 34 of them reported any outcomes of the SS/L projects studied, and less than one-third of these articles included statistical analyses to test for significant changes in outcomes. This review demonstrates that there are significant gaps in the SS/L health care quality improvement literature and very weak evidence that SS/L improve health care quality.

A systematic review of etiological and risk factors associated with bruxism.

PubMed

Feu, Daniela; Catharino, Fernanda; Quintão, Catia Cardoso Abdo; Almeida, Marco Antonio de Oliveira

2013-06-01

The aim of the present work was to systematically review the literature and identify all peer-reviewed papers dealing with etiological and risk factors associated with bruxism. Data extraction was carried out according to the standard Cochrane systematic review methodology. The following databases were searched for randomized clinical trials (RCT), controlled clinical trials (CCT) or cohort studies: Cochrane Library, Medline, and Embase from 1980 to 2011. Unpublished literature was searched electronically using ClinicalTrials.gov. The primary outcome was bruxism etiology. Studies should have a standardized method to assess bruxism. Screening of eligible studies, assessment of the methodological quality and data extraction were conducted independently and in duplicate. Two reviewers inspected the references using the same search strategy and then applied the same inclusion criteria to the selected studies. They used criteria for methodological quality that was previously described in the Cochrane Handbook. Among the 1247 related articles that were critically assessed, one randomized clinical trial, one controlled clinical trial and seven longitudinal studies were included in the critical appraisal. Of these studies, five were selected, but reported different outcomes. There is convincing evidence that (sleep-related) bruxism can be induced by esophageal acidification and also that it has an important relationship with smoking in a dose-dependent manner. Disturbances in the central dopaminergic system are also implicated in the etiology of bruxism.

Prevalence of self-medication in the adult population of Brazil: a systematic review

PubMed Central

Domingues, Paulo Henrique Faria; Galvão, Taís Freire; de Andrade, Keitty Regina Cordeiro; de Sá, Pedro Terra Teles; Silva, Marcus Tolentino; Pereira, Mauricio Gomes

2015-01-01

OBJECTIVE To evaluate the prevalence of self-medication in Brazil’s adult population. METHODS Systematic review of cross-sectional population-based studies. The following databases were used: Medline, Embase, Scopus, ISI, CINAHL, Cochrane Library, CRD, Lilacs, SciELO, the Banco de teses brasileiras (Brazilian theses database) (Capes) and files from the Portal Domínio Público (Brazilian Public Domain). In addition, the reference lists from relevant studies were examined to identify potentially eligible articles. There were no applied restrictions in terms of the publication date, language or publication status. Data related to publication, population, methods and prevalence of self-medication were extracted by three independent researchers. Methodological quality was assessed following eight criteria related to sampling, measurement and presentation of results. The prevalences were measured from participants who used at least one medication during the recall period of the studies. RESULTS The literature screening identified 2,778 records, from which 12 were included for analysis. Most studies were conducted in the Southeastern region of Brazil, after 2000 and with a 15-day recall period. Only five studies achieved high methodological quality, of which one study had a 7-day recall period, in which the prevalence of self-medication was 22.9% (95%CI 14.6;33.9). The prevalence of self-medication in three studies of high methodological quality with a 15-day recall period was 35.0% (95%CI 29.0;40.0, I2 = 83.9%) in the adult Brazilian population. CONCLUSIONS Despite differences in the methodologies of the included studies, the results of this systematic review indicate that a significant proportion of the adult Brazilian population self-medicates. It is suggested that future research projects that assess self-medication in Brazil standardize their methods. PMID:26083944

Oral Chinese proprietary medicine for angina pectoris: an overview of systematic reviews/meta-analyses.

PubMed

Luo, Jing; Xu, Hao; Yang, Guoyan; Qiu, Yu; Liu, Jianping; Chen, Keji

2014-08-01

Oral Chinese proprietary medicine (CPM) is commonly used to treat angina pectoris, and many relevant systematic reviews/meta-analyses are available. However, these reviews have not been systematically summarized and evaluated. We conducted an overview of these reviews, and explored their methodological and reporting quality to inform both practice and further research. We included systematic reviews/meta-analyses on oral CPM in treating angina until March 2013 by searching PubMed, Embase, the Cochrane Library and four Chinese databases. We extracted data according to a pre-designed form, and assessed the methodological and reporting characteristics of the reviews in terms of AMSTAR and PRISMA respectively. Most of the data analyses were descriptive. 36 systematic reviews/meta-analyses involving over 82,105 participants with angina reviewing 13 kinds of oral CPM were included. The main outcomes assessed in the reviews were surrogate outcomes (34/36, 94.4%), adverse events (31/36, 86.1%), and symptoms (30/36, 83.3%). Six reviews (6/36, 16.7%) drew definitely positive conclusions, while the others suggested potential benefits in the symptoms, electrocardiogram, and adverse events. The overall methodological and reporting quality of the reviews was limited, with many serious flaws such as the lack of review protocol and incomprehensive literature searches. Though many systematic reviews/meta-analyses on oral CPM for angina suggested potential benefits or definitely positive effects, stakeholders should interpret the findings of these reviews with caution, considering the overall limited methodological and reporting quality. We recommend further studies should be appropriately conducted and systematic reviews reported according to PRISMA standard. Copyright © 2014 Elsevier Ltd. All rights reserved.

[Quality appraisal of systematic reviews or meta-analysis on traditional Chinese medicine published in Chinese journals].

PubMed

Liu, Jian-ping; Xia, Yun

2007-04-01

To critically assess the quality of literature about systematic review or meta-analysis on traditional Chinese medicine (TCM) published in Chinese journals. Electronic searches in CNKI, VIP and Wanfang data-base were conducted to retrieve the systematic reviews or meta-analysis reports on TCM, including herbal medicine, needling, acupuncture and moxibustion, as well as integrative medicine, they were identified and extracted according to the 18 items of QUOROM (quality of reporting of meta-analyses) Statement and relative information. The appraisal was made taking the indexes mainly including objectives, source of data, methods of data extraction, quality assessment of the included studies, measurement data synthesis, etc. Eighty-two systematic reviews were identified, except 6 reviews were excluded for repeatedly published or didn't comply with the enrolled criterion, 76 reviews concerning 51 kinds of diseases were enrolled for appraisal. Among them, 70 reviews evaluated the efficacy of TCM, mainly on Chinese herbs and 9 on acupuncture and moxibustion. In majority of the reviews, randomised controlled trials were included and the data resources were described, but in 26 reviews only the Chinese databases were searched and the description about data extraction and analysis method were too simple; and 70% of reviews assessed the quality of the included studies; none used flow chart to express the process of selection, inclusion and exclusion of studies. Few reviews or Meta-analysis reports reached the international standard and there is insufficient description of methodology for conducting systematic reviews, so it is hardly to be repeated. The authors suggested that advanced methodological training is necessary for reviewers.