Quality of systematic reviews in pediatric oncology--a systematic review.

PubMed

Lundh, Andreas; Knijnenburg, Sebastiaan L; Jørgensen, Anders W; van Dalen, Elvira C; Kremer, Leontien C M

2009-12-01

To ensure evidence-based decision making in pediatric oncology systematic reviews are necessary. The objective of our study was to evaluate the methodological quality of all currently existing systematic reviews in pediatric oncology. We identified eligible systematic reviews through a systematic search of the literature. Data on clinical and methodological characteristics of the included systematic reviews were extracted. The methodological quality of the included systematic reviews was assessed using the overview quality assessment questionnaire, a validated 10-item quality assessment tool. We compared the methodological quality of systematic reviews published in regular journals with that of Cochrane systematic reviews. We included 117 systematic reviews, 99 systematic reviews published in regular journals and 18 Cochrane systematic reviews. The average methodological quality of systematic reviews was low for all ten items, but the quality of Cochrane systematic reviews was significantly higher than systematic reviews published in regular journals. On a 1-7 scale, the median overall quality score for all systematic reviews was 2 (range 1-7), with a score of 1 (range 1-7) for systematic reviews in regular journals compared to 6 (range 3-7) in Cochrane systematic reviews (p<0.001). Most systematic reviews in the field of pediatric oncology seem to have serious methodological flaws leading to a high risk of bias. While Cochrane systematic reviews were of higher methodological quality than systematic reviews in regular journals, some of them also had methodological problems. Therefore, the methodology of each individual systematic review should be scrutinized before accepting its results.

Methodological quality and reporting of systematic reviews in hand and wrist pathology.

PubMed

Wasiak, J; Shen, A Y; Ware, R; O'Donohoe, T J; Faggion, C M

2017-10-01

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions. I.

Designing, Evaluating, and Deploying Automated Scoring Systems with Validity in Mind: Methodological Design Decisions

ERIC Educational Resources Information Center

Rupp, André A.

2018-01-01

This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

POSSUM--a model for surgical outcome audit in quality care.

PubMed

Ng, K J; Yii, M K

2003-10-01

Comparative surgical audit to monitor quality of care should be performed with a risk-adjusted scoring system rather than using crude morbidity and mortality rates. A validated and widely applied risk adjusted scoring system, P-POSSUM (Portsmouth-Physiological and Operative Severity Score for the enUmeration of Mortality) methodology, was applied to a prospective series of predominantly general surgical patients at the Sarawak General Hospital, Kuching over a six months period. The patients were grouped into four risk groups. The observed mortality rates were not significantly different from predicted rates, showing that the quality of surgical care was at par with typical western series. The simplicity and advantages of this scoring system over other auditing tools are discussed. The P-POSSUM methodology could form the basis of local comparative surgical audit for assessment and maintenance of quality care.

The methodological quality of systematic reviews of animal studies in dentistry.

PubMed

Faggion, C M; Listl, S; Giannakopoulos, N N

2012-05-01

Systematic reviews and meta-analyses of animal studies are important for improving estimates of the effects of treatment and for guiding future clinical studies on humans. The purpose of this systematic review was to assess the methodological quality of systematic reviews and meta-analyses of animal studies in dentistry through using a validated checklist. A literature search was conducted independently and in duplicate in the PubMed and LILACS databases. References in selected systematic reviews were assessed to identify other studies not captured by the electronic searches. The methodological quality of studies was assessed independently and in duplicate by using the AMSTAR checklist; the quality was scored as low, moderate, or high. The reviewers were calibrated before the assessment and agreement between them was assessed using Cohen's Kappa statistic. Of 444 studies retrieved, 54 systematic reviews were selected after full-text assessment. Agreement between the reviewers was regarded as excellent. Only two studies were scored as high quality; 17 and 35 studies were scored as medium and low quality, respectively. There is room for improvement of the methodological quality of systematic reviews of animal studies in dentistry. Checklists, such as AMSTAR, can guide researchers in planning and executing systematic reviews and meta-analyses. For determining the need for additional investigations in animals and in order to provide good data for potential application in human, such reviews should be based on animal experiments performed according to sound methodological principles. Copyright © 2011 Elsevier Ltd. All rights reserved.

Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.

PubMed

Dosenovic, Svjetlana; Jelicic Kadic, Antonia; Vucic, Katarina; Markovina, Nikolina; Pieper, Dawid; Puljak, Livia

2018-05-08

Systematic reviews (SRs) in the field of neuropathic pain (NeuP) are increasingly important for decision-making. However, methodological flaws in SRs can reduce the validity of conclusions. Hence, it is important to assess the methodological quality of NeuP SRs critically. Additionally, it remains unclear which assessment tool should be used. We studied the methodological quality of SRs published in the field of NeuP and compared two assessment tools. We systematically searched 5 electronic databases to identify SRs of randomized controlled trials of interventions for NeuP available up to March 2015. Two independent reviewers assessed the methodological quality of the studies using the Assessment of Multiple Systematic Reviews (AMSTAR) and the revised AMSTAR (R-AMSTAR) tools. The scores were converted to percentiles and ranked into 4 grades to allow comparison between the two checklists. Gwet's AC1 coefficient was used for interrater reliability assessment. The 97 included SRs had a wide range of methodological quality scores (AMSTAR median (IQR): 6 (5-8) vs. R-AMSTAR median (IQR): 30 (26-35)). The overall agreement score between the 2 raters was 0.62 (95% CI 0.39-0.86) for AMSTAR and 0.62 (95% CI 0.53-0.70) for R-AMSTAR. The 31 Cochrane systematic reviews (CSRs) were consistently ranked higher than the 66 non-Cochrane systematic reviews (NCSRs). The analysis of individual domains showed the best compliance in a comprehensive literature search (item 3) on both checklists. The results for the domain that was the least compliant differed: conflict of interest (item 11) was the item most poorly reported on AMSTAR vs. publication bias assessment (item 10) on R-AMSTAR. A high positive correlation between the total AMSTAR and R-AMSTAR scores for all SRs, as well as for CSRs and NCSRs, was observed. The methodological quality of analyzed SRs in the field of NeuP was not optimal, and CSRs had a higher quality than NCSRs. Both AMSTAR and R-AMSTAR tools produced comparable quality ratings. Our results point out to weaknesses in the methodology of existing SRs on interventions for the management NeuP and call for future improvement by better adherence to analyzed quality checklists, either AMSTAR or R-AMSTAR.

A Validity-Based Approach to Quality Control and Assurance of Automated Scoring

ERIC Educational Resources Information Center

Bejar, Isaac I.

2011-01-01

Automated scoring of constructed responses is already operational in several testing programmes. However, as the methodology matures and the demand for the utilisation of constructed responses increases, the volume of automated scoring is likely to increase at a fast pace. Quality assurance and control of the scoring process will likely be more…

Methodological quality of systematic reviews referenced in clinical practice guidelines for the treatment of opioid use disorder.

PubMed

Ross, Andrew; Rankin, Justin; Beaman, Jason; Murray, Kelly; Sinnett, Philip; Riddle, Ross; Haskins, Jordan; Vassar, Matt

2017-01-01

With efforts to combat opioid use disorder, there is an increased interest in clinical practice guidelines (CPGs) for opioid use disorder treatments. No literature exists examining the quality of systematic reviews used in opioid use disorder CPGs. This study aims to describe the methodological quality and reporting clarity of systematic reviews (SRs) used to create CPGs for opioid use disorder. From June to July 2016 guideline clearinghouses and medical literature databases were searched for relevant CPGs used in the treatment of opioid use disorder. Included CPGs must have been recognized by a national organization. SRs from the reference section of each CPG was scored by using AMSTAR (a measurement tool to assess the methodological quality of systematic reviews) tool and PRISMA (preferred reporting items for systematic reviews and meta-analyses) checklist. Seventeen CPGs from 2006-2016 were included in the review. From these, 57 unique SRs were extracted. SRS comprised 0.28% to 17.92% of all references found in the CPGs. All SRs obtained moderate or high methodological quality score on the AMSTAR tool. All reviews met at least 70% of PRISMA criteria. In PRISMA, underperforming areas included accurate title labeling, protocol registration, and risk of bias. Underperforming areas in AMSTAR included conflicts of interest, funding, and publication bias. A positive correlation was found between AMSTAR and PRISMA scores (r = .79). Although the SRs in the CPGs were of good quality, there are still areas for improvement. Systematic reviewers should consult PRISMA and AMSTAR when conducting and reporting reviews. It is important for CPG developers to consider methodological quality as a factor when developing CPG recommendations, recognizing that the quality of systematic reviews underpinning guidelines does not necessarily correspond to the quality of the guideline itself.

Cognitive remediation in schizophrenia: A methodological appraisal of systematic reviews and meta-analyses.

PubMed

Bryce, Shayden; Sloan, Elise; Lee, Stuart; Ponsford, Jennie; Rossell, Susan

2016-04-01

Systematic reviews and meta-analyses are a primary source of evidence when evaluating the benefit(s) of cognitive remediation (CR) in schizophrenia. These studies are designed to rigorously synthesize scientific literature; however, cannot be assumed to be of high methodological quality. The aims of this report were to: 1) review the use of systematic reviews and meta-analyses regarding CR in schizophrenia; 2) conduct a systematic methodological appraisal of published reports examining the benefits of this intervention on core outcome domains; and 3) compare the correspondence between methodological and reporting quality. Electronic databases were searched for relevant articles. Twenty-one reviews met inclusion criteria and were scored according to the AMSTAR checklist-a validated scale of methodological quality. Five meta-analyses were also scored according to PRISMA statement to compare 'quality of conduct' with 'quality of reporting'. Most systematic reviews and meta-analyses shared strengths and fell within a 'medium' level of methodological quality. Nevertheless, there were consistent areas of potential weakness that were not addressed by most reviews. These included the lack of protocol registration, uncertainty regarding independent data extraction and consensus procedures, and the minimal assessment of publication bias. Moreover, quality of conduct may not necessarily parallel quality of reporting, suggesting that consideration of these methods independently may be important. Reviews concerning CR for schizophrenia are a valuable source of evidence. However, the methodological quality of these reports may require additional consideration. Enhancing quality of conduct is essential for enabling research literature to be interpreted with confidence. Copyright © 2016 Elsevier Ltd. All rights reserved.

A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews.

PubMed

Pluye, Pierre; Gagnon, Marie-Pierre; Griffiths, Frances; Johnson-Lafleur, Janique

2009-04-01

A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies. To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components. A three-step critical review was conducted. 2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic. Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs). Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality. A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.

Randomized controlled drug trials on very elderly subjects: descriptive and methodological analysis of trials published between 1990 and 2002 and comparison with trials on adults.

PubMed

Le Quintrec, Jean-Laurent; Bussy, Caroline; Golmard, Jean-Louis; Hervé, Christian; Baulon, Alain; Piette, François

2005-03-01

Very elderly subjects (VES; aged 80 years or older) constitute a special population as they frequently present multiple diseases (polypathology). Results from trials on general adult populations therefore cannot be extrapolated to VES. We performed a census of randomized controlled trials (RCT) on VES published between 1990 and 2002, and carried out a descriptive and methodological analysis of these RCT/VES, comparing them with matched RCT on general adult populations (control RCT, RCT/C). We searched for RCT/VES in two international databases (EMBASE and MEDLINE) and then manually. RCT/C were matched to RCT/VES for disease area and year of publication. The methodological quality of each RCT was assessed with Chalmers' scale. We identified 84 RCT/VES, 63 of which were conclusive and 21, inconclusive. Subjects were institutionalized in 48 RCT, and community dwelling in 11 RCT (unspecified in 25 RCT). Efficacy was the main criterion in 75 RCT; tolerance in 9 RCT. Twenty-six RCT were published by geriatrics journals, and 58 by general medical journals. The RCT/VES covered most of the disease areas of geriatrics. The 84 RCT/VES had a mean methodological quality score of 0.578 +/- 0.157. The matched 84 RCT/C had a mean methodological quality score of 0.592 +/- 0.116 (p = .466). The methodological quality score of RCT/VES increased with the number of included subjects (p = .004) and the year of publication (p = .001). The methodological quality of RCT/VES is equivalent to that of RCT in general adult populations. Nevertheless, RCT/VES remain very scarce, and neglect certain diseases. RCT/VES and the inclusion of very elderly subjects in RCT on adults should be strongly encouraged.

Methodological Quality of Consensus Guidelines in Implant Dentistry.

PubMed

Faggion, Clovis Mariano; Apaza, Karol; Ariza-Fritas, Tania; Málaga, Lilian; Giannakopoulos, Nikolaos Nikitas; Alarcón, Marco Antonio

2017-01-01

Consensus guidelines are useful to improve clinical decision making. Therefore, the methodological evaluation of these guidelines is of paramount importance. Low quality information may guide to inadequate or harmful clinical decisions. To evaluate the methodological quality of consensus guidelines published in implant dentistry using a validated methodological instrument. The six implant dentistry journals with impact factors were scrutinised for consensus guidelines related to implant dentistry. Two assessors independently selected consensus guidelines, and four assessors independently evaluated their methodological quality using the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument. Disagreements in the selection and evaluation of guidelines were resolved by consensus. First, the consensus guidelines were analysed alone. Then, systematic reviews conducted to support the guidelines were included in the analysis. Non-parametric statistics for dependent variables (Wilcoxon signed rank test) was used to compare both groups. Of 258 initially retrieved articles, 27 consensus guidelines were selected. Median scores in four domains (applicability, rigour of development, stakeholder involvement, and editorial independence), expressed as percentages of maximum possible domain scores, were below 50% (median, 26%, 30.70%, 41.70%, and 41.70%, respectively). The consensus guidelines and consensus guidelines + systematic reviews data sets could be compared for 19 guidelines, and the results showed significant improvements in all domain scores (p < 0.05). Methodological improvement of consensus guidelines published in major implant dentistry journals is needed. The findings of the present study may help researchers to better develop consensus guidelines in implant dentistry, which will improve the quality and trust of information needed to make proper clinical decisions.

Methodological Quality of Consensus Guidelines in Implant Dentistry

PubMed Central

Faggion, Clovis Mariano; Apaza, Karol; Ariza-Fritas, Tania; Málaga, Lilian; Giannakopoulos, Nikolaos Nikitas; Alarcón, Marco Antonio

2017-01-01

Background Consensus guidelines are useful to improve clinical decision making. Therefore, the methodological evaluation of these guidelines is of paramount importance. Low quality information may guide to inadequate or harmful clinical decisions. Objective To evaluate the methodological quality of consensus guidelines published in implant dentistry using a validated methodological instrument. Methods The six implant dentistry journals with impact factors were scrutinised for consensus guidelines related to implant dentistry. Two assessors independently selected consensus guidelines, and four assessors independently evaluated their methodological quality using the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument. Disagreements in the selection and evaluation of guidelines were resolved by consensus. First, the consensus guidelines were analysed alone. Then, systematic reviews conducted to support the guidelines were included in the analysis. Non-parametric statistics for dependent variables (Wilcoxon signed rank test) was used to compare both groups. Results Of 258 initially retrieved articles, 27 consensus guidelines were selected. Median scores in four domains (applicability, rigour of development, stakeholder involvement, and editorial independence), expressed as percentages of maximum possible domain scores, were below 50% (median, 26%, 30.70%, 41.70%, and 41.70%, respectively). The consensus guidelines and consensus guidelines + systematic reviews data sets could be compared for 19 guidelines, and the results showed significant improvements in all domain scores (p < 0.05). Conclusions Methodological improvement of consensus guidelines published in major implant dentistry journals is needed. The findings of the present study may help researchers to better develop consensus guidelines in implant dentistry, which will improve the quality and trust of information needed to make proper clinical decisions. PMID:28107405

Methodological quality of randomised controlled trials in burns care. A systematic review.

PubMed

Danilla, Stefan; Wasiak, Jason; Searle, Susana; Arriagada, Cristian; Pedreros, Cesar; Cleland, Heather; Spinks, Anneliese

2009-11-01

To evaluate the methodological quality of published randomised controlled trials (RCTs) in burn care treatment and management. Using a predetermined search strategy we searched Ovid MEDLINE (1950 to January 2008) database to identify all English RCTs related to burn care. Full text studies identified were reviewed for key demographic and methodological characteristics. Methodological trial quality was assessed using the Jadad scale. A total of 257 studies involving 14,535 patients met the inclusion criteria. The median Jadad score was 2 (out of a best possible score of 5). Information was given in the introduction and discussion sections of most RCTs, although insufficient detail was provided on randomisation, allocation concealment, and blinding. The number of RCTs increased between 1950 and 2008 (Spearman's rho=0.6129, P<0.001), although the reporting quality did not improve over the same time period (P=0.1896) and was better in RCTs with larger sample sizes (median Jadad score, 4 vs. 2 points, P<0.0001). Methodological quality did not correlate with journal impact factor (P=0.2371). The reporting standards of RCTs are highly variable and less than optimal in most cases. The advent of evidence-based medicine heralds a new approach to burns care and systematic steps are needed to improve the quality of RCTs in this field. Identifying and reviewing the existing number of RCTs not only highlights the need for burn clinicians to conduct more trials, but may also encourage burn health clinicians to consider the importance of conducting trials that follow appropriate, evidence-based standards.

Methodological quality of systematic reviews analyzing the use of laser therapy in restorative dentistry.

PubMed

Salmos, Janaina; Gerbi, Marleny E M M; Braz, Rodivan; Andrade, Emanuel S S; Vasconcelos, Belmiro C E; Bessa-Nogueira, Ricardo V

2010-01-01

The purpose of this study was to identify systematic reviews (SRs) that compared laser with other dental restorative procedures and to evaluate their methodological quality. A search strategy was developed and implemented for MEDLINE, the Cochrane Library, LILACS, and the Brazilian Dentistry Bibliography (1966- 2007). Inclusion criteria were: the article had to be an SR (+/- meta-analysis); primary focus was the use of laser in restorative dentistry; published in English, Spanish, Portuguese, Italian, German. Two investigators independently selected and evaluated the SRs. The overview quality assessment questionnaire (OQAQ) was used to evaluate methodological quality, and the results were averaged. There were 145 references identified, of which seven were SRs that met the inclusion criteria (kappa=0.81). Of the SRs, 71.4% appraised lasers in dental caries diagnosis. The mean overall OQAQ score was 4.4 [95% confidence interval (CI) 2.4- 6.5]. Of the SRs, 57.1% had major flaws, scoring < or = 4. SR methodological quality is low; therefore, clinicians should critically appraise them prior to considering their recommendations to guide patient care.

"Assessing the methodological quality of systematic reviews in radiation oncology: A systematic review".

PubMed

Hasan, Haroon; Muhammed, Taaha; Yu, Jennifer; Taguchi, Kelsi; Samargandi, Osama A; Howard, A Fuchsia; Lo, Andrea C; Olson, Robert; Goddard, Karen

2017-10-01

The objective of our study was to evaluate the methodological quality of systematic reviews and meta-analyses in Radiation Oncology. A systematic literature search was conducted for all eligible systematic reviews and meta-analyses in Radiation Oncology from 1966 to 2015. Methodological characteristics were abstracted from all works that satisfied the inclusion criteria and quality was assessed using the critical appraisal tool, AMSTAR. Regression analyses were performed to determine factors associated with a higher score of quality. Following exclusion based on a priori criteria, 410 studies (157 systematic reviews and 253 meta-analyses) satisfied the inclusion criteria. Meta-analyses were found to be of fair to good quality while systematic reviews were found to be of less than fair quality. Factors associated with higher scores of quality in the multivariable analysis were including primary studies consisting of randomized control trials, performing a meta-analysis, and applying a recommended guideline related to establishing a systematic review protocol and/or reporting. Systematic reviews and meta-analyses may introduce a high risk of bias if applied to inform decision-making based on AMSTAR. We recommend that decision-makers in Radiation Oncology scrutinize the methodological quality of systematic reviews and meta-analyses prior to assessing their utility to inform evidence-based medicine and researchers adhere to methodological standards outlined in validated guidelines when embarking on a systematic review. Copyright © 2017 Elsevier Ltd. All rights reserved.

Predictive validity evidence for medical education research study quality instrument scores: quality of submissions to JGIM's Medical Education Special Issue.

PubMed

Reed, Darcy A; Beckman, Thomas J; Wright, Scott M; Levine, Rachel B; Kern, David E; Cook, David A

2008-07-01

Deficiencies in medical education research quality are widely acknowledged. Content, internal structure, and criterion validity evidence support the use of the Medical Education Research Study Quality Instrument (MERSQI) to measure education research quality, but predictive validity evidence has not been explored. To describe the quality of manuscripts submitted to the 2008 Journal of General Internal Medicine (JGIM) medical education issue and determine whether MERSQI scores predict editorial decisions. Cross-sectional study of original, quantitative research studies submitted for publication. Study quality measured by MERSQI scores (possible range 5-18). Of 131 submitted manuscripts, 100 met inclusion criteria. The mean (SD) total MERSQI score was 9.6 (2.6), range 5-15.5. Most studies used single-group cross-sectional (54%) or pre-post designs (32%), were conducted at one institution (78%), and reported satisfaction or opinion outcomes (56%). Few (36%) reported validity evidence for evaluation instruments. A one-point increase in MERSQI score was associated with editorial decisions to send manuscripts for peer review versus reject without review (OR 1.31, 95%CI 1.07-1.61, p = 0.009) and to invite revisions after review versus reject after review (OR 1.29, 95%CI 1.05-1.58, p = 0.02). MERSQI scores predicted final acceptance versus rejection (OR 1.32; 95% CI 1.10-1.58, p = 0.003). The mean total MERSQI score of accepted manuscripts was significantly higher than rejected manuscripts (10.7 [2.5] versus 9.0 [2.4], p = 0.003). MERSQI scores predicted editorial decisions and identified areas of methodological strengths and weaknesses in submitted manuscripts. Researchers, reviewers, and editors might use this instrument as a measure of methodological quality.

[Drug-promoting advertisements in the Dutch Journal of Medicine and Pharmaceutical Weekly: not always evidence based].

PubMed

van Eeden, Annelies E; Roach, Rachel E J; Halbesma, Nynke; Dekker, Friedo W

2012-01-01

To determine and compare the foundation of claims in drug-promoting advertisements in a Dutch journal for physicians and a Dutch journal for pharmacists. A cross-sectional study. We included all the drug-promoting advertisements referring to a randomized controlled trial (RCT) we could find on Medline from 2 volumes of the Dutch Journal of Medicine (Nederlands Tijdschrift voor Geneeskunde; NTvG) and the (also Dutch) Pharmaceutical Weekly (Pharmaceutisch Weekblad; PW). The validity of the advertisements (n = 54) and the methodological quality of the referenced RCTs (n = 150) were independently scored by 250 medical students using 2 standardised questionnaires. The advertisements' sources were concealed from the students. Per journal, the percentage of drug-promoting advertisements having a valid claim and the percentage of high-quality RCT references were determined. Average scores on quality and validity were compared between the 2 journals. On a scale of 0-18 points, the mean quality scores of the RCTs differed 0.3 (95% CI: -0.1-0.7) between the NTvG (score: 14.8; SD: 2.2) and the PW (score: 14.5; SD: 2.6). The difference between the validity scores of drug-promoting advertisements in the NTvG (score: 5.8; SD: 3.3) and the PW (score: 5.6; SD: 3.6) was 0.3 (95% CI: -0.3-0.9) on a scale of 0-10 points. For both journals, an average of 15% of drug-promoting advertisements was valid (defined as a validity score of > 8 points); 35% of the RCTs referred to was of good methodological quality (defined as a quality score of > 16 points). The substantiation of many claims in drug-promoting advertisements in the NTvG and the PW was mediocre. There was no difference between the 2 journals.

A methodology to analyze the quality of health information on the internet: the example of diabetic neuropathy.

PubMed

Chumber, Sundeep; Huber, Jörg; Ghezzi, Pietro

2015-02-01

The purpose of this work was to evaluate the criteria used to assess the quality of information on diabetic neuropathy on the Internet. Different search engines (Google, Yahoo, Bing, and Ask) and 1 governmental health website (MedlinePlus) were studied. The websites returned (200 for each search engine) were then classified according to their affiliation (eg, commercial, professional, patient groups). A scoring system was devised from the literature to assess quality of information. Websites were also analyzed using the 2 most widely used instruments for assessing the quality of health information, the Journal of the American Medical Association (JAMA) scoring system and the Health On the Net Foundation (HON) certification. Professional websites or health portals scored better according to most criteria. Google and MedlinePlus returned results scoring significantly higher than other engines in some of the criteria. The use of different instruments gave different results and indicates that the JAMA score and the HON certification may not be sufficient ones. This methodology could be used to evaluate the reliability and trustworthiness of information on the Internet on different topics to identify topic areas or websites where the available information is not appropriate. © 2014 The Author(s).

Methodological quality of guidelines in gastroenterology.

PubMed

Malheiro, Rui; de Monteiro-Soares, Matilde; Hassan, Cesare; Dinis-Ribeiro, Mário

2014-06-01

Clinical guidelines are a common feature in modern endoscopy practice and they are being produced faster than ever. However, their methodological quality is rarely assessed. This study evaluated the methodological quality of current clinical guidelines in the field of gastroenterology, with an emphasis on endoscopy. Practice guidelines published by the American College of Gastroenterology (ACG), American Gastroenterological Association (AGA), American Society for Gastrointestinal Endoscopy (ASGE), European Society of Gastrointestinal Endoscopy (ESGE), British Society of Gastroenterology (BSG), National Institute for Health and Care Excellence (NICE), and the Scottish Intercollegiate Guidelines Network (SIGN) were searched between September and October 2012 and evaluated using the AGREE II (Appraisal of Guidelines for Research and Evaluation) instrument (23 items, scores 1 - 7 for each item; higher scores mean better quality). A total of 100 guidelines were assessed. The mean number of items scoring 6 or 7 per guideline was 9.2 (out of 23 items). Overall, 99 % of guidelines failed to include the target population in the development process, and 96 % did not report facilitators and barriers to guideline application. In addition, 86 % did not include advice or tools, and 94 % did not present monitoring or auditing criteria. The global methodological quality of clinical guidelines in the field of gastroenterology is poor, particularly regarding involvement of the target population in the development of guidelines and in the provision of clear suggestions to practitioners. © Georg Thieme Verlag KG Stuttgart · New York.

Appraising the quality of medical education research methods: the Medical Education Research Study Quality Instrument and the Newcastle-Ottawa Scale-Education.

PubMed

Cook, David A; Reed, Darcy A

2015-08-01

The Medical Education Research Study Quality Instrument (MERSQI) and the Newcastle-Ottawa Scale-Education (NOS-E) were developed to appraise methodological quality in medical education research. The study objective was to evaluate the interrater reliability, normative scores, and between-instrument correlation for these two instruments. In 2014, the authors searched PubMed and Google for articles using the MERSQI or NOS-E. They obtained or extracted data for interrater reliability-using the intraclass correlation coefficient (ICC)-and normative scores. They calculated between-scale correlation using Spearman rho. Each instrument contains items concerning sampling, controlling for confounders, and integrity of outcomes. Interrater reliability for overall scores ranged from 0.68 to 0.95. Interrater reliability was "substantial" or better (ICC > 0.60) for nearly all domain-specific items on both instruments. Most instances of low interrater reliability were associated with restriction of range, and raw agreement was usually good. Across 26 studies evaluating published research, the median overall MERSQI score was 11.3 (range 8.9-15.1, of possible 18). Across six studies, the median overall NOS-E score was 3.22 (range 2.08-3.82, of possible 6). Overall MERSQI and NOS-E scores correlated reasonably well (rho 0.49-0.72). The MERSQI and NOS-E are useful, reliable, complementary tools for appraising methodological quality of medical education research. Interpretation and use of their scores should focus on item-specific codes rather than overall scores. Normative scores should be used for relative rather than absolute judgments because different research questions require different study designs.

Appraising the methodological quality of the clinical practice guideline for diabetes mellitus using the AGREE II instrument: a methodological evaluation.

PubMed

Radwan, Mahmoud; Akbari Sari, Ali; Rashidian, Arash; Takian, Amirhossein; Abou-Dagga, Sanaa; Elsous, Aymen

2017-02-01

To evaluate the methodological quality of the Palestinian Clinical Practice Guideline for Diabetes Mellitus using the Translated Arabic Version of the AGREE II. Methodological evaluation. A cross-cultural adaptation framework was followed to translate and develop a standardised Translated Arabic Version of the AGREE II. Palestinian Primary Healthcare Centres. Sixteen appraisers independently evaluated the Clinical Practice Guideline for Diabetes Mellitus using the Translated Arabic Version of the AGREE II. Methodological quality of diabetic guideline. The Translated Arabic Version of the AGREE II showed an acceptable reliability and validity. Internal consistency ranged between 0.67 and 0.88 (Cronbach's α). Intra-class coefficient among appraisers ranged between 0.56 and 0.88. The quality of this guideline is low. Both domains 'Scope and Purpose' and 'Clarity of Presentation' had the highest quality scores (66.7% and 61.5%, respectively), whereas the scores for 'Applicability', 'Stakeholder Involvement', 'Rigour of Development' and 'Editorial Independence' were the lowest (27%, 35%, 36.5%, and 40%, respectively). The findings suggest that the quality of this Clinical Practice Guideline is disappointingly low. To improve the quality of current and future guidelines, the AGREE II instrument is extremely recommended to be incorporated as a gold standard for developing, evaluating or updating the Palestinian Clinical Practice Guidelines. Future guidelines can be improved by setting specific strategies to overcome implementation barriers with respect to economic considerations, engaging of all relevant end-users and patients, ensuring a rigorous methodology for searching, selecting and synthesising the evidences and recommendations, and addressing potential conflict of interests within the development group.

Methodological quality of randomized controlled trials of spinal manipulation and mobilization in tension-type headache, migraine, and cervicogenic headache.

PubMed

Fernández-de-las-Peñas, César; Alonso-Blanco, Cristina; San-Roman, Jesús; Miangolarra-Page, Juan C

2006-03-01

Literature review of quality of clinical trials. To determine the methodological quality of published randomized controlled trials that used spinal manipulation and/or mobilization to treat patients with tension-type headache (TTH), cervicogenic headache (CeH), and migraine (M) in the last decade. TTH, CeH, and M are the most prevalent types of headaches seen in adults. Individuals who have headaches frequently use physical therapy, manual therapy, or chiropractic care. Randomized controlled trials are considered an optimal method with which to assess the efficacy of any intervention. Computerized literature searches were performed in MEDLINE, EMBASE, COCHRANE, AMED, MANTIS, CINHAL, and PEDro databases. Randomized controlled trials in which spinal manipulation and/or mobilization had been used for TTH, CeH, and M published in a peer-reviewed journal as full text, and with at least 1 clinically relevant outcome measure (ie, headache intensity, duration, or frequency) were reviewed. The methodological quality of the studies was assessed independently by 2 reviewers using a set of predefined criteria. Only 8 studies met all the inclusion criteria. One clinical trial evaluated spinal manipulation and mobilization together, and the remaining 7 assessed spinal manipulative therapy. No controlled trials analyzing exclusively the effects of spinal mobilization were found. Methodological scores ranged from 35 to 56 points out of a theoretical maximum of 100 points, indicating an overall poor methodology of the studies. Only 2 studies obtained a high-quality score (greater than 50 points). No significant differences in quality scores were found based on the type of headache investigated. Methodological quality was not associated with the year of publication (before 2000, or later) nor with the results (positive, neutral, negative) reported in the studies. The most common flaws were a small sample size, the absence of a placebo control group, lack of blinded patients, and no description of the manipulative procedure. There are few published randomized controlled trials analyzing the effectiveness of spinal manipulation and/or mobilization for TTH, CeH, and M in the last decade. In addition, the methodological quality of these papers is typically low. Clearly, there is a need for high-quality randomized controlled trials assessing the effectiveness of these interventions in these headache disorders.

Proposal and application of a regional methodology of comparative risk assessment for potentially contaminated sites.

PubMed

Marzocchini, Manrico; Tatàno, Fabio; Moretti, Michela Simona; Antinori, Caterina; Orilisi, Stefano

2018-06-05

A possible approach for determining soil and groundwater quality criteria for contaminated sites is the comparative risk assessment. Originating from but not limited to Italian interest in a decentralised (regional) implementation of comparative risk assessment, this paper first addresses the proposal of an original methodology called CORIAN REG-M , which was created with initial attention to the context of potentially contaminated sites in the Marche Region (Central Italy). To deepen the technical-scientific knowledge and applicability of the comparative risk assessment, the following characteristics of the CORIAN REG-M methodology appear to be relevant: the simplified but logical assumption of three categories of factors (source and transfer/transport of potential contamination, and impacted receptors) within each exposure pathway; the adaptation to quality and quantity of data that are available or derivable at the given scale of concern; the attention to a reliable but unsophisticated modelling; the achievement of a conceptual linkage to the absolute risk assessment approach; and the potential for easy updating and/or refining of the methodology. Further, the application of the CORIAN REG-M methodology to some case-study sites located in the Marche Region indicated the following: a positive correlation can be expected between air and direct contact pathway scores, as well as between individual pathway scores and the overall site scores based on a root-mean-square algorithm; the exposure pathway, which presents the highest variability of scores, tends to be dominant at sites with the highest computed overall site scores; and the adoption of a root-mean-square algorithm can be expected to emphasise the overall site scoring.

LibQUAL+[TM]: A Methodological Suite; Reliability and Structure of LibQUAL+[TM] Scores: Measuring Perceived Library Service Quality; Score Norms for Improving Library Service Quality: A LibQUAL+[TM] Study; ARL Index and Other Validity Correlates of LibQUAL+[TM] Scores.

ERIC Educational Resources Information Center

Heath, Fred M.; Thompson, Bruce; Cook, Colleen; Thompson, Russel L.; Kyrillidou, Martha

2002-01-01

Includes four articles that discuss LibQUAL+[TM], a collaborative effort of the Association of Research Libraries and Texas A&M University responding to the need for greater accountability in measuring the delivery of library services to research library users. Discusses the reliability of LibQUAL+[TM] scores in measuring perceived library…

Don’t forget the posters! Quality and content variables associated with accepted abstracts at a national trauma meeting

PubMed Central

Dossett, Lesly A.; Fox, Erin E.; del Junco, Deborah J.; Zaydfudim, Victor; Kauffmann, Rondi; Shelton, Julia; Wang, Weiwei; Cioffi, William G.; Holcomb, John B.; Cotton, Bryan A.

2014-01-01

BACKGROUND As a primary venue for presenting research results, abstracts selected for presentation at national meetings should be of the highest scientific merit and research quality. It is uncertain to what degree this is achieved as the methodological quality of abstracts submitted to national surgical meetings has not been previously described. The objective of this study was to evaluate abstracts presented at a leading trauma meeting for methodological quality. METHODS All abstracts accepted for the 2009 American Association for the Surgery of Trauma meeting were reviewed and scored for methodological quality based on 10 criteria (scores, 0–10; 10 being the highest). Criteria were based on nationally published methodology guidelines. Two independent reviewers who were blinded to institution, region, and author reviewed each abstract. RESULTS A total of 187 abstracts were accepted for presentation (67 oral and 120 posters). The most frequent clinical topics were shock/transfusion (23%), abdomen (12%), and nervous system (11%). Shock/transfusion abstracts were more common in the oral presentations (31% vs. 19%; p =0.06). Abstracts from the northeast and south regions were the most common in both oral (26% and 29%) and posters (25% and 24%). Basic science accounted for 12% of accepted studies, while 51% were clinical and 28% were health services/outcomes. Only 8% of abstracts presented randomized data and only 11% reported null findings. Overall abstract scores ranged from 3 to 10 (median, 7; mean, 7.4). Abstracts selected for poster presentation had an overall higher score than those selected for oral presentation (7.4 ±1.7 vs. 6.8 ±1.7; p =0.02). CONCLUSION Although oral presentations traditionally receive the most attention and interest, the methodological quality of abstracts accepted for poster presentation equals (and sometimes exceeds) that of oral abstracts. Attendees of these national meetings should reconsider their time spent in viewing and visiting these poster sessions as with the oral presentations. In light of our findings, we highly encourage that all members and guests attend the American Association for the Surgery of Trauma Poster Rounds at each year’s scientific assembly. PMID:22673278

Don't forget the posters! Quality and content variables associated with accepted abstracts at a national trauma meeting.

PubMed

Dossett, Lesly A; Fox, Erin E; del Junco, Deborah J; Zaydfudim, Victor; Kauffmann, Rondi; Shelton, Julia; Wang, Weiwei; Cioffi, William G; Holcomb, John B; Cotton, Bryan A

2012-05-01

As a primary venue for presenting research results, abstracts selected for presentation at national meetings should be of the highest scientific merit and research quality. It is uncertain to what degree this is achieved as the methodological quality of abstracts submitted to national surgical meetings has not been previously described. The objective of this study was to evaluate abstracts presented at a leading trauma meeting for methodological quality. All abstracts accepted for the 2009 American Association for the Surgery of Trauma meeting were reviewed and scored for methodological quality based on 10 criteria (scores, 0-10; 10 being the highest). Criteria were based on nationally published methodology guidelines. Two independent reviewers who were blinded to institution, region, and author reviewed each abstract. A total of 187 abstracts were accepted for presentation (67 oral and 120 posters). The most frequent clinical topics were shock/transfusion (23%), abdomen (12%), and nervous system (11%). Shock/transfusion abstracts were more common in the oral presentations (31% vs. 19%; p = 0.06). Abstracts from the northeast and south regions were the most common in both oral (26% and 29%) and posters (25% and 24%). Basic science accounted for 12% of accepted studies, while 51% were clinical and 28% were health services/outcomes. Only 8% of abstracts presented randomized data and only 11% reported null findings. Overall abstract scores ranged from 3 to 10 (median, 7; mean, 7.4). Abstracts selected for poster presentation had an overall higher score than those selected for oral presentation (7.4 ± 1.7 vs. 6.8 ± 1.7; p = 0.02). Although oral presentations traditionally receive the most attention and interest, the methodological quality of abstracts accepted for poster presentation equals (and sometimes exceeds) that of oral abstracts. Attendees of these national meetings should reconsider their time spent in viewing and visiting these poster sessions as with the oral presentations. In light of our findings, we highly encourage that all members and guests attend the American Association for the Surgery of Trauma Poster Rounds at each year's scientific assembly.

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews

PubMed Central

2013-01-01

Background Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. Methods This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. Results A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. Conclusion There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words) PMID:23331384

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews.

PubMed

Wells, Cherie; Kolt, Gregory S; Marshall, Paul; Hill, Bridget; Bialocerkowski, Andrea

2013-01-19

Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words).

[Reevaluation of the methodological quality in meta-analyses of accelerated rehabilitation on recovery after surgery for colorectal cancer].

PubMed

Ding, S N; Pan, H Y; Zhang, J G

2017-03-14

Objective: To evaluate the methodological quality and impacts on outcomes for systematic reviews (SRs) of accelerated rehabilitation versus traditional control for colorectal surgery. Methods: We comprehensively searched six databases and additional websites to collect SRs, or meta-analysis from inception to July 2016. The Overview Quality Assessment Questionnaire (OQAQ) was applied for quality assessment of the included studies, the tools recommended by the Cochrane Collaboration was applied for quality assessment for RCT and CCT and the Newcastle-Ottawa Scale (NOS) was applied to assess observational study. The relative ratios (RRs) and 95% confidence intervals (CIs) were integrated using Review Manager 5.3 software. Results: Fourteen meta-analyses were included in total. The mean OQAQ score was 3.8 with 95% CI 3.2 to 4.3. Only three meta-analyses were assessed as good quality. Two studies misused statistical models. A total of 42 primary studies referenced by meta-analyses were included, of which, 25 RCTs were levelled grade B and 1 CCT was levelled grade C. An estimated mean NOS score of 16 observation studies was 6.75 (totally scored 9 with 95% CI 6.4 to 7.1), of which, 10 studies scored ≥7 were high quality, 6 studies scored 6 were moderate quality. Conclusions: Currently, the overall quality of meta-analyses about comparing the effects and safety between accelerated rehabilitation and traditional control for colorectal surgery is fairly poor and the evidence level is lower. Health providers should apply the evidence with caution in clinical practice.

[Clinical practice guidelines in Peru: evaluation of its quality using the AGREE II instrument].

PubMed

Canelo-Aybar, Carlos; Balbin, Graciela; Perez-Gomez, Ángela; Florez, Iván D

2016-01-01

To evaluate the methodological quality of clinical practice guidelines (CPGs) put into practice by the Peruvian Ministry of Health (MINSA), 17 CPGs from the ministry, published between 2009 and 2014, were independently evaluated by three methodologic experts using the AGREE II instrument. The score of AGREE II domains was low and very low in all CPGs: scope and purpose (medium, 44%), clarity of presentation (medium, 47%), participation of decision-makers (medium, 8%), methodological rigor (medium, 5%), applicability (medium, 5%), and editorial independence (medium, 8%). In conclusion, the methodological quality of CPGs implemented by the MINSA is low. Consequently, its use could not be recommended. The implementation of the methodology for the development of CPGs described in the recentlypublished CPG methodological preparation manual in Peru is a pressing need.

The relationship between return on investment and quality of study methodology in workplace health promotion programs.

PubMed

Baxter, Siyan; Sanderson, Kristy; Venn, Alison J; Blizzard, C Leigh; Palmer, Andrew J

2014-01-01

To determine the relationship between return on investment (ROI) and quality of study methodology in workplace health promotion programs. Data were obtained through a systematic literature search of National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE), Health Technology Database (HTA), Cost Effectiveness Analysis (CEA) Registry, EconLit, PubMed, Embase, Wiley, and Scopus. Included were articles written in English or German reporting cost(s) and benefit(s) and single or multicomponent health promotion programs on working adults. Return-to-work and workplace injury prevention studies were excluded. Methodological quality was graded using British Medical Journal Economic Evaluation Working Party checklist. Economic outcomes were presented as ROI. ROI was calculated as ROI = (benefits - costs of program)/costs of program. Results were weighted by study size and combined using meta-analysis techniques. Sensitivity analysis was performed using two additional methodological quality checklists. The influences of quality score and important study characteristics on ROI were explored. Fifty-one studies (61 intervention arms) published between 1984 and 2012 included 261,901 participants and 122,242 controls from nine industry types across 12 countries. Methodological quality scores were highly correlated between checklists (r = .84-.93). Methodological quality improved over time. Overall weighted ROI [mean ± standard deviation (confidence interval)] was 1.38 ± 1.97 (1.38-1.39), which indicated a 138% return on investment. When accounting for methodological quality, an inverse relationship to ROI was found. High-quality studies (n = 18) had a smaller mean ROI, 0.26 ± 1.74 (.23-.30), compared to moderate (n = 16) 0.90 ± 1.25 (.90-.91) and low-quality (n = 27) 2.32 ± 2.14 (2.30-2.33) studies. Randomized control trials (RCTs) (n = 12) exhibited negative ROI, -0.22 ± 2.41(-.27 to -.16). Financial returns become increasingly positive across quasi-experimental, nonexperimental, and modeled studies: 1.12 ± 2.16 (1.11-1.14), 1.61 ± 0.91 (1.56-1.65), and 2.05 ± 0.88 (2.04-2.06), respectively. Overall, mean weighted ROI in workplace health promotion demonstrated a positive ROI. Higher methodological quality studies provided evidence of smaller financial returns. Methodological quality and study design are important determinants.

Methodological Quality Assessment of Meta-Analyses and Systematic Reviews of Probiotics in Inflammatory Bowel Disease and Pouchitis.

PubMed

Dong, Jinpei; Teng, Guigen; Wei, Tiantong; Gao, Wen; Wang, Huahong

2016-01-01

Probiotics are widely used for the induction and maintenance of remission in inflammatory bowel disease (IBD) and pouchitis. There are a large number of meta-analyses (MAs)/ systematic reviews (SRs) on this subject, the methodological quality of which has not been evaluated. This study aimed to evaluate the methodological quality of and summarize the evidence obtained from MAs/SRs of probiotic treatments for IBD and pouchitis patients. The PubMed, EMBASE, Cochrane Library and China National Knowledge Infrastructure (CNKI) databases were searched to identify Chinese and English language MAs/SRs of the use of probiotics for IBD and pouchitis. The Assessment of Multiple Systematic Reviews (AMSTAR) scale was used to assess the methodological quality of the studies. A total of 36 MAs/SRs were evaluated. The AMSTAR scores of the included studies ranged from 1 to 10, and the average score was 5.81. According to the Canadian Agency for Drugs and Technologies in Health, 4 articles were classified as high quality, 24 articles were classified as moderate quality, and 8 articles were classified as low quality. Most of the MAs/SRs suggested that probiotics had potential benefits for patients with ulcerative colitis (UC), but failed to show effectiveness in the induction and maintenance of remission in Crohn's disease (CD). The probiotic preparation VSL#3 may play a beneficial role in pouchitis. The overall methodological quality of the current MAs/SRs in the field of probiotics for IBD and pouchitis was found to be low to moderate. More MAs/SRs of high quality are required to support using probiotics to treat IBD and pouchitis.

Reporting and methodological quality of meta-analyses in urological literature.

PubMed

Xia, Leilei; Xu, Jing; Guzzo, Thomas J

2017-01-01

To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, " a priori " design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and " a priori " design were associated with superior reporting quality, following PRISMA guideline and " a priori " design were associated with superior methodological quality. Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having " a priori " protocol.

Comparison of methodologic quality and study/report characteristics between quantitative clinical nursing and nursing education research articles.

PubMed

Schneider, Barbara St Pierre; Nicholas, Jennifer; Kurrus, Jeffrey E

2013-01-01

To compare the methodologic quality and study/report characteristics between quantitative clinical nursing and nursing education research articles. The methodologic quality of quantitative nursing education research needs to advance to a higher level. Clinical research can provide guidance for nursing education to reach this level. One hundred quantitative clinical research articles from-high impact journals published in 2007 and 37 education research articles from high impact journals published in 2006 to 2007 were chosen for analysis. Clinical articles had significantly higher quality scores than education articles in three domains: number of institutions studied, type of data, and outcomes. The findings indicate three ways in which nursing education researchers can strengthen the methodologic quality of their quantitative research. With this approach, greater funding may be secured for advancing the science of nursing education.

Methodological quality and scientific impact of quantitative nursing education research over 18 months.

PubMed

Yucha, Carolyn B; Schneider, Barbara St Pierre; Smyer, Tish; Kowalski, Susan; Stowers, Eva

2011-01-01

The methodological quality of nursing education research has not been rigorously studied. The purpose of this study was to evaluate the methodological quality and scientific impact of nursing education research reports. The methodological quality of 133 quantitative nursing education research articles published between July 2006 and December 2007 was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).The mean (+/- SD) MERSQI score was 9.8 +/- 2.2. It correlated (p < .05) with several scientific impact indicators: citation counts from Scopus (r = .223), Google Scholar (r = .224), and journal impact factor (r = .216); it was not associated with Web of Science citation count, funding, or h Index. The similarities between this study's MERSQI ratings for nursing literature and those reported for the medical literature, coupled with the association with citation counts, suggest that the MERSQI is an appropriate instrument to evaluate the quality of nursing education research.

Evaluation of the quality of the reporting of phase II clinical trials in oncology: A systematic review.

PubMed

Rivoirard, Romain; Langrand-Escure, Julien; Oriol, Mathieu; Tinquaut, Fabien; Chauvin, Franck; Rancoule, Chloé; Magné, Nicolas; Bourmaud, Aurélie

2018-05-01

To describe the current state of knowledge concerning the quality of reporting in phase II clinical trials in oncology and to describe the various methods published allowing this quality evaluation. databases including MEDLINE and COCHRANE were searched. Reviews and meta-analyses analyzing the quality of the reporting of phase II trials in oncology were included. Descriptive analysis of the results was performed. Thirteen publications were retained. Only 2 publications adopted a systematic approach of evaluation of the quality of reporting by overall scores. The Key Methodological Score (KMS), proposed by Grellety et al., gathering 3 items, seemed adapted for such an evaluation. A score of 3/3 was found in 16.1% of the 156 phase II trials analysed by this score. The other reviews used a qualitative analysis to evaluate the reporting, via an analysis of a single criterion, generally the statistical plan of the study. This item was considered as having been correctly reported in less than 50% of the analysed articles. The quality of reporting in phase II trials in oncology is a field that has been investigated very little (13 publications). When it is studied, the estimated level of quality is not satisfactory, whatever the method employed. The use of an overall score of evaluation is a path which should be pursued, in order to get reliable results. It also seems necessary to propose strong recommendations, which would create a consensus for the methodology and the reporting of these studies. Copyright © 2018 Elsevier B.V. All rights reserved.

Application of Autonomous Smart Inverter Volt-VAR Function for Voltage Reduction Energy Savings and Power Quality in Electric Distribution Systems: Preprint

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ding, Fei; Nagarajan, Adarsh; Baggu, Murali

This paper evaluated the impact of smart inverter Volt-VAR function on voltage reduction energy saving and power quality in electric power distribution systems. A methodology to implement the voltage reduction optimization was developed by controlling the substation LTC and capacitor banks, and having smart inverters participate through their autonomous Volt-VAR control. In addition, a power quality scoring methodology was proposed and utilized to quantify the effect on power distribution system power quality. All of these methodologies were applied to a utility distribution system model to evaluate the voltage reduction energy saving and power quality under various PV penetrations and smartmore » inverter densities.« less

The reliability of the Glasgow Coma Scale: a systematic review.

PubMed

Reith, Florence C M; Van den Brande, Ruben; Synnot, Anneliese; Gruen, Russell; Maas, Andrew I R

2016-01-01

The Glasgow Coma Scale (GCS) provides a structured method for assessment of the level of consciousness. Its derived sum score is applied in research and adopted in intensive care unit scoring systems. Controversy exists on the reliability of the GCS. The aim of this systematic review was to summarize evidence on the reliability of the GCS. A literature search was undertaken in MEDLINE, EMBASE and CINAHL. Observational studies that assessed the reliability of the GCS, expressed by a statistical measure, were included. Methodological quality was evaluated with the consensus-based standards for the selection of health measurement instruments checklist and its influence on results considered. Reliability estimates were synthesized narratively. We identified 52 relevant studies that showed significant heterogeneity in the type of reliability estimates used, patients studied, setting and characteristics of observers. Methodological quality was good (n = 7), fair (n = 18) or poor (n = 27). In good quality studies, kappa values were ≥0.6 in 85%, and all intraclass correlation coefficients indicated excellent reliability. Poor quality studies showed lower reliability estimates. Reliability for the GCS components was higher than for the sum score. Factors that may influence reliability include education and training, the level of consciousness and type of stimuli used. Only 13% of studies were of good quality and inconsistency in reported reliability estimates was found. Although the reliability was adequate in good quality studies, further improvement is desirable. From a methodological perspective, the quality of reliability studies needs to be improved. From a clinical perspective, a renewed focus on training/education and standardization of assessment is required.

Quality dependent fusion of intramodal and multimodal biometric experts

NASA Astrophysics Data System (ADS)

Kittler, J.; Poh, N.; Fatukasi, O.; Messer, K.; Kryszczuk, K.; Richiardi, J.; Drygajlo, A.

2007-04-01

We address the problem of score level fusion of intramodal and multimodal experts in the context of biometric identity verification. We investigate the merits of confidence based weighting of component experts. In contrast to the conventional approach where confidence values are derived from scores, we use instead raw measures of biometric data quality to control the influence of each expert on the final fused score. We show that quality based fusion gives better performance than quality free fusion. The use of quality weighted scores as features in the definition of the fusion functions leads to further improvements. We demonstrate that the achievable performance gain is also affected by the choice of fusion architecture. The evaluation of the proposed methodology involves 6 face and one speech verification experts. It is carried out on the XM2VTS data base.

A new multimodal interactive way of subjective scoring of 3D video quality of experience

NASA Astrophysics Data System (ADS)

Kim, Taewan; Lee, Kwanghyun; Lee, Sanghoon; Bovik, Alan C.

2014-03-01

People that watch today's 3D visual programs, such as 3D cinema, 3D TV and 3D games, experience wide and dynamically varying ranges of 3D visual immersion and 3D quality of experience (QoE). It is necessary to be able to deploy reliable methodologies that measure each viewers subjective experience. We propose a new methodology that we call Multimodal Interactive Continuous Scoring of Quality (MICSQ). MICSQ is composed of a device interaction process between the 3D display and a separate device (PC, tablet, etc.) used as an assessment tool, and a human interaction process between the subject(s) and the device. The scoring process is multimodal, using aural and tactile cues to help engage and focus the subject(s) on their tasks. Moreover, the wireless device interaction process makes it possible for multiple subjects to assess 3D QoE simultaneously in a large space such as a movie theater, and at di®erent visual angles and distances.

Systematic evaluation of clinical practice guidelines for pharmacogenomics.

PubMed

Beckett, Robert D; Kisor, David F; Smith, Thomas; Vonada, Brooke

2018-06-01

To systematically assess methodological quality of pharmacogenomics clinical practice guidelines. Guidelines published through 2017 were reviewed by at least three independent reviewers using the AGREE II instrument, which consists of 23 items grouped into 6 domains and 2 items representing an overall assessment. Items were assessed on a seven-point rating scale, and aggregate quality scores were calculated. 31 articles were included. All guidelines were published as peer-reviewed articles and 90% (n = 28) were endorsed by professional organizations. Mean AGREE II domain scores (maximum score 100%) ranged from 46.6 ± 11.5% ('applicability') to 78.9 ± 11.4% ('clarity of presentation'). Median overall quality score was 72.2% (IQR: 61.1-77.8%). Quality of pharmacogenomics guidelines was generally high, but variable, for most AGREE II domains.

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles on Elbow Medial Ulnar Collateral Ligament Surgery.

PubMed

Jack, Robert A; Sochacki, Kyle R; Morehouse, Hannah A; McCulloch, Patrick C; Lintner, David M; Harris, Joshua D

2018-04-01

Several studies have analyzed the most cited articles in shoulder, elbow, pediatrics, and foot and ankle surgery. However, no study has analyzed the quality of the most cited articles in elbow medial ulnar collateral ligament (UCL) surgery. To (1) identify the top 50 most cited articles related to UCL surgery, (2) determine whether there was a correlation between the top cited articles and level of evidence, and (3) determine whether there was a correlation between study methodological quality and the top cited articles. Systematic review. Web of Science and Scopus online databases were searched to identify the top 50 cited articles in UCL surgery. Level of evidence, number of times cited, year of publication, name of journal, country of origin, and study type were recorded for each study. Study methodological quality was analyzed for each article with the Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS). Correlation coefficients were calculated. The 50 most cited articles were published between 1981 and 2015. The number of citations per article ranged from 20 to 301 (mean ± SD, 71 ± 62 citations). Most articles (92%) were from the United States and were level 3 (16%), level 4 (58%), or unclassified (16%) evidence. There were no articles of level 1 evidence quality. The mean MCMS and MINORS scores were 28.1 ± 13.4 (range, 3-52) and 9.2 ± 3.6 (range, 2-19), respectively. There was no significant correlation between the mean number of citations and level of evidence or quality ( r s = -0.01, P = .917), MCMS ( r s = 0.09, P = .571), or MINORS ( r s = -0.26, P = .089). The top 50 cited articles in UCL surgery constitute a low level of evidence and low methodological quality, including no level 1 articles. There was no significant correlation between the mean number of citations and level of evidence or study methodological quality. However, weak correlations were observed for later publication date and improved level of evidence and methodological quality.

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles on Elbow Medial Ulnar Collateral Ligament Surgery

PubMed Central

Jack, Robert A.; Sochacki, Kyle R.; Morehouse, Hannah A.; McCulloch, Patrick C.; Lintner, David M.; Harris, Joshua D.

2018-01-01

Background: Several studies have analyzed the most cited articles in shoulder, elbow, pediatrics, and foot and ankle surgery. However, no study has analyzed the quality of the most cited articles in elbow medial ulnar collateral ligament (UCL) surgery. Purpose: To (1) identify the top 50 most cited articles related to UCL surgery, (2) determine whether there was a correlation between the top cited articles and level of evidence, and (3) determine whether there was a correlation between study methodological quality and the top cited articles. Study Design: Systematic review. Methods: Web of Science and Scopus online databases were searched to identify the top 50 cited articles in UCL surgery. Level of evidence, number of times cited, year of publication, name of journal, country of origin, and study type were recorded for each study. Study methodological quality was analyzed for each article with the Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS). Correlation coefficients were calculated. Results: The 50 most cited articles were published between 1981 and 2015. The number of citations per article ranged from 20 to 301 (mean ± SD, 71 ± 62 citations). Most articles (92%) were from the United States and were level 3 (16%), level 4 (58%), or unclassified (16%) evidence. There were no articles of level 1 evidence quality. The mean MCMS and MINORS scores were 28.1 ± 13.4 (range, 3-52) and 9.2 ± 3.6 (range, 2-19), respectively. There was no significant correlation between the mean number of citations and level of evidence or quality (rs = –0.01, P = .917), MCMS (rs = 0.09, P = .571), or MINORS (rs = –0.26, P = .089). Conclusion: The top 50 cited articles in UCL surgery constitute a low level of evidence and low methodological quality, including no level 1 articles. There was no significant correlation between the mean number of citations and level of evidence or study methodological quality. However, weak correlations were observed for later publication date and improved level of evidence and methodological quality. PMID:29780841

Author-paper affiliation network architecture influences the methodological quality of systematic reviews and meta-analyses of psoriasis.

PubMed

Sanz-Cabanillas, Juan Luis; Ruano, Juan; Gomez-Garcia, Francisco; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Maestre-Lopez, Beatriz; Gonzalez-Padilla, Marcelino; Carmona-Fernandez, Pedro J; Velez Garcia-Nieto, Antonio; Isla-Tejera, Beatriz

2017-01-01

Moderate-to-severe psoriasis is associated with significant comorbidity, an impaired quality of life, and increased medical costs, including those associated with treatments. Systematic reviews (SRs) and meta-analyses (MAs) of randomized clinical trials are considered two of the best approaches to the summarization of high-quality evidence. However, methodological bias can reduce the validity of conclusions from these types of studies and subsequently impair the quality of decision making. As co-authorship is among the most well-documented forms of research collaboration, the present study aimed to explore whether authors' collaboration methods might influence the methodological quality of SRs and MAs of psoriasis. Methodological quality was assessed by two raters who extracted information from full articles. After calculating total and per-item Assessment of Multiple Systematic Reviews (AMSTAR) scores, reviews were classified as low (0-4), medium (5-8), or high (9-11) quality. Article metadata and journal-related bibliometric indices were also obtained. A total of 741 authors from 520 different institutions and 32 countries published 220 reviews that were classified as high (17.2%), moderate (55%), or low (27.7%) methodological quality. The high methodological quality subnetwork was larger but had a lower connection density than the low and moderate methodological quality subnetworks; specifically, the former contained relatively fewer nodes (authors and reviews), reviews by authors, and collaborators per author. Furthermore, the high methodological quality subnetwork was highly compartmentalized, with several modules representing few poorly interconnected communities. In conclusion, structural differences in author-paper affiliation network may influence the methodological quality of SRs and MAs on psoriasis. As the author-paper affiliation network structure affects study quality in this research field, authors who maintain an appropriate balance between scientific quality and productivity are more likely to develop higher quality reviews.

Reporting and methodological quality of meta-analyses in urological literature

PubMed Central

Xu, Jing

2017-01-01

Purpose To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. Materials and Methods We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. Results A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, “a priori” design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and “a priori” design were associated with superior reporting quality, following PRISMA guideline and “a priori” design were associated with superior methodological quality. Conclusions Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having “a priori” protocol. PMID:28439452

Does updating improve the methodological and reporting quality of systematic reviews?

PubMed

Shea, Beverley; Boers, Maarten; Grimshaw, Jeremy M; Hamel, Candyce; Bouter, Lex M

2006-06-13

Systematic reviews (SRs) must be of high quality. The purpose of our research was to compare the methodological and reporting quality of original versus updated Cochrane SRs to determine whether updating had improved these two quality dimensions. We identified updated Cochrane SRs published in issue 4, 2002 of the Cochrane Library. We assessed the updated and original versions of the SRs using two instruments: the 10 item enhanced Overview Quality Assessment Questionnaire (OQAQ), and an 18-item reporting quality checklist and flow chart based upon the Quality of Reporting of Meta-analyses (QUOROM) statement. At least two reviewers extracted data and assessed quality. We calculated the percentage (with a 95% confidence interval) of 'yes' answers to each question. We calculated mean differences in percentage, 95% confidence intervals and p-values for each of the individual items and the overall methodological quality score of the updated and pre-updated versions using OQAQ. We assessed 53 SRs. There was no significant improvement in the global quality score of the OQAQ (mean difference 0.11 (-0.28; 0.70 p = 0.52)). Updated reviews showed a significant improvement of 18.9 (7.2; 30.6 p < .01) on the OQAQ item assessing whether the conclusions drawn by the author(s) were supported by the data and/or analysis presented in the SR. The QUOROM statement showed that the quality of reporting of Cochrane reviews improved in some areas with updating. Improvements were seen on the items relating to data sources reported in the abstract, with a significant difference of 17.0 (9.8; 28.7 p = 0.01), review methods, reported in the abstract 35 (24.1; 49.1 p = 0.00), searching methods 18.9 (9.7; 31.6 p = 0.01), and data abstraction 18.9 (11.7; 30.9 p = 0.00). The overall quality of Cochrane SRs is fair-to-good. Although reporting quality improved on certain individual items there was no overall improvement seen with updating and methodological quality remained unchanged. Further improvement of quality of reporting is possible. There is room for improvement of methodological quality as well. Authors updating reviews should address identified methodological or reporting weaknesses. We recommend to give full attention to both quality domains when updating SRs.

Quality of systematic reviews: an example of studies comparing artificial disc replacement with fusion in the cervical spine.

PubMed

Tashani, Osama A; El-Tumi, Hanan; Aneiba, Khaled

2015-01-01

Cervical artificial disc replacement (C-ADR) is now an alternative to anterior cervical discectomy and fusion (ACDF). Many studies have evaluated the efficacy of C-ADR compared with ACDF. This led to a series of systematic reviews and meta-analyses to evaluate the evidence of the superiority of one intervention against the other. The aim of the study presented here was to evaluate the quality of these reviews and meta-analyses. Medline via Ovid, Embase, and Cochrane Library were searched using the keywords: (total disk replacement, prosthesis, implantation, discectomy, and arthroplasty) AND (cervical vertebrae, cervical spine, and spine) AND (systematic reviews, reviews, and meta-analysis). Screening and data extraction were conducted by two reviewers independently. Two reviewers then assessed the quality of the selected reviews and meta-analysis using 11-item AMSTAR score which is a validated measurement tool to assess the methodological quality of systematic reviews. Screening of full reports of 46 relevant abstracts resulted in the selection of 15 systematic reviews and/or meta-analyses as eligible for this study. The two reviewers' inter-rater agreement level was high as indicated by kappa of >0.72. The AMSTAR score of the reviews ranged from 3 to 11. Only one study (a Cochrane review) scored 100% (AMSTAR 11). Five studies scored below (AMSTAR 5) indicating low-quality reviews. The most significant drawbacks of reviews of a score below 5 were not using an extensive search strategy, failure to use the scientific quality of the included studies appropriately in formulating a conclusion, not assessing publication bias, and not reporting the excluded studies. With a significant exception of a Cochrane review, the methodological quality of systematic reviews evaluating the evidence of C-ADR versus ACDF has to be improved.

The Ocean Colour Climate Change Initiative: I. A Methodology for Assessing Atmospheric Correction Processors Based on In-Situ Measurements

NASA Technical Reports Server (NTRS)

Muller, Dagmar; Krasemann, Hajo; Brewin, Robert J. W.; Deschamps, Pierre-Yves; Doerffer, Roland; Fomferra, Norman; Franz, Bryan A.; Grant, Mike G.; Groom, Steve B.; Melin, Frederic;

Tracking tumor biology with radiomics: A systematic review utilizing a radiomics quality score.

PubMed

Sanduleanu, Sebastian; Woodruff, Henry C; de Jong, Evelyn E C; van Timmeren, Janna E; Jochems, Arthur; Dubois, Ludwig; Lambin, Philippe

2018-05-18

In this review we describe recent developments in the field of radiomics along with current relevant literature linking it to tumor biology. We furthermore explore the methodologic quality of these studies with our in-house radiomics quality scoring (RQS) tool. Finally, we offer our vision on necessary future steps for the development of stable radiomic features and their links to tumor biology. Two authors (S.S. and H.W.) independently performed a thorough systematic literature search and outcome extraction to identify relevant studies published in MEDLINE/PubMed (National Center for Biotechnology Information, NCBI), EMBASE (Ovid) and Web of Science (WoS). Two authors (S.S, H.W) separately and two authors (J.v.T and E.d.J) concordantly scored the articles for their methodology and analyses according to the previously published radiomics quality score (RQS). In summary, a total of 655 records were identified till 25-09-2017 based on the previously specified search terms, from which n = 236 in MEDLINE/PubMed, n = 215 in EMBASE and n = 204 from Web of Science. After determining full article availability and reading the available articles, a total of n = 41 studies were included in the systematic review. The RQS scoring resulted in some discrepancies between the reviewers, e.g. reviewer H.W scored 4 studies ≥50%, reviewer S.S scored 3 studies ≥50% while reviewers J.v.T and E.d.J scored 1 study ≥50%. Up to nine studies were given a quality score of 0%. The majority of studies were scored below 50%. In this study, we performed a systematic literature search linking radiomics to tumor biology. All but two studies (n = 39) revealed that radiomic features derived from ultrasound, CT, PET and/or MR are significantly associated with one or several specific tumor biologic substrates, from somatic mutation status to tumor histopathologic grading and metabolism. Considerable inter-observer differences were found with regard to RQS scoring, while important questions were raised concerning the interpretability of the outcome of such scores. Copyright © 2018 The Author(s). Published by Elsevier B.V. All rights reserved.

Methodological Quality Assessment of Meta-Analyses of Hyperthyroidism Treatment.

PubMed

Qin, Yahong; Yao, Liang; Shao, Feifei; Yang, Kehu; Tian, Limin

2018-01-01

Hyperthyroidism is a common condition that is associated with increased morbidity and mortality. A number of meta-analyses (MAs) have assessed the therapeutic measures for hyperthyroidism, including antithyroid drugs, surgery, and radioiodine, however, the methodological quality has not been evaluated. This study evaluated the methodological quality and summarized the evidence obtained from MAs of hyperthyroidism treatments for radioiodine, antithyroid drugs, and surgery. We searched the PubMed, EMBASE, Cochrane Library, Web of Science, and Chinese Biomedical Literature Database databases. Two investigators independently assessed the meta-analyses titles and abstracts for inclusion. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. A total of 26 MAs fulfilled the inclusion criteria. Based on the AMSTAR scores, the average methodological quality was 8.31, with large variability ranging from 4 to 11. The methodological quality of English meta-analyses was better than that of Chinese meta-analyses. Cochrane reviews had better methodological quality than non-Cochrane reviews due to better study selection and data extraction, the inclusion of unpublished studies, and better reporting of study characteristics. The authors did not report conflicts of interest in 53.8% meta-analyses, and 19.2% did not report the harmful effects of treatment. Publication bias was not assessed in 38.5% of meta-analyses, and 19.2% did not report the follow-up time. Large-scale assessment of methodological quality of meta-analyses of hyperthyroidism treatment highlighted methodological strengths and weaknesses. Consideration of scientific quality when formulating conclusions should be made explicit. Future meta-analyses should improve on reporting conflict of interest. © Georg Thieme Verlag KG Stuttgart · New York.

A systematic review of economic evaluations of treatments for patients with epilepsy.

PubMed

Wijnen, Ben F M; van Mastrigt, Ghislaine A P G; Evers, Silvia M A A; Gershuni, Olga; Lambrechts, Danielle A J E; Majoie, Marian H J M; Postulart, Debby; Aldenkamp, Bert A P; de Kinderen, Reina J A

2017-05-01

The increasing number of treatment options and the high costs associated with epilepsy have fostered the development of economic evaluations in epilepsy. It is important to examine the availability and quality of these economic evaluations and to identify potential research gaps. As well as looking at both pharmacologic (antiepileptic drugs [AEDs]) and nonpharmacologic (e.g., epilepsy surgery, ketogenic diet, vagus nerve stimulation) therapies, this review examines the methodologic quality of the full economic evaluations included. Literature search was performed in MEDLINE, EMBASE, NHS Economic Evaluation Database (NHS EED), Econlit, Web of Science, and CEA Registry. In addition, Cochrane Reviews, Cochrane DARE and Cochrane Health Technology Assessment Databases were used. To identify relevant studies, predefined clinical search strategies were combined with a search filter designed to identify health economic studies. Specific search strategies were devised for the following topics: (1) AEDs, (2) patients with cognitive deficits, (3) elderly patients, (4) epilepsy surgery, (5) ketogenic diet, (6) vagus nerve stimulation, and (7) treatment of (non)convulsive status epilepticus. A total of 40 publications were included in this review, 29 (73%) of which were articles about pharmacologic interventions. Mean quality score of all articles on the Consensus Health Economic Criteria (CHEC)-extended was 81.8%, the lowest quality score being 21.05%, whereas five studies had a score of 100%. Looking at the Consolidated Health Economic Evaluation Reporting Standards (CHEERS), the average quality score was 77.0%, the lowest being 22.7%, and four studies rated as 100%. There was a substantial difference in methodology in all included articles, which hampered the attempt to combine information meaningfully. Overall, the methodologic quality was acceptable; however, some studies performed significantly worse than others. The heterogeneity between the studies stresses the need to define a reference case (e.g., how should an economic evaluation within epilepsy be performed) and to derive consensus on what constitutes "standard optimal care." Wiley Periodicals, Inc. © 2017 International League Against Epilepsy.

[Methodological quality of articles on therapeutic procedures published in Cirugía Española. Evaluation of the period 2005-2008].

PubMed

Manterola, Carlos; Grande, Luís

2010-04-01

To determine methodological quality of therapy articles published in Cirugía Española and to study its association with the publication year, the centre of origin and subjects. A literature study which included all therapy articles published between 2005 and 2008. All kinds of clinical designs were considered, excluding editorials, review articles, letters to editor and experimental studies. Variables analysed included: year of publication, centre of origin, design, and methodological quality of articles. A valid and reliable scale was applied to determine methodological quality. A total of 243 articles [206 series of cases (84.8%), 27 cohort studies (11.1%), 9 clinical trials (3.7%) and 1 case control study (0.4%)] were found. Studies came preferentially from Catalonia and Valencia (22.3% and 12.3% respectively). Thematic areas most frequently found were hepato-bilio-pancreatic and colorectal surgery (20.0% and 16.6%, respectively). Average and median of the methodological quality score calculated for the entire series were 9.5+/-4.3 points and 8 points, respectively. Association between methodological quality and geographical area (p=0.0101), subject area (p=0.0267), and university origin (p=0.0369) was found. A significant increase of methodological quality by publication year was observed (p=0.0004). Methodological quality of therapy articles published in Cirugía Española between 2005 and 2008 is low; but an increase tendency with statistical significance was observed.

Effectiveness of mirror therapy, motor imagery, and virtual feedback on phantom limb pain following amputation: A systematic review.

PubMed

Herrador Colmenero, Laura; Perez Marmol, Jose Manuel; Martí-García, Celia; Querol Zaldivar, María de Los Ángeles; Tapia Haro, Rosa María; Castro Sánchez, Adelaida María; Aguilar-Ferrándiz, María Encarnación

2018-06-01

Phantom limb pain is reported in 50%-85% of people with amputation. Clinical interventions in treating central pain, such as mirror therapy, motor imagery, or virtual visual feedback, could redound in benefits to amputee patients with phantom limb pain. To provide an overview of the effectiveness of different techniques for treating phantom limb pain in amputee patients. Systematic review. A computerized literature search up to April 2017 was performed using the following databases: PubMed, Scopus, CINAHL, MEDLINE, ProQuest, PEDro, EBSCOhost, and Cochrane Plus. Methodological quality and internal validity score of each study were assessed using PEDro scale. For data synthesis, qualitative methods from the Cochrane Back Review Group were applied. In all, 12 studies met our inclusion criteria, where 9 were rated as low methodological quality and 3 rated moderate quality. All studies showed a significant reduction in pain, but there was heterogeneity among subjects and methodologies and any high-quality clinical trial (PEDro score ≤8; internal validity score ≤5) was not found. Mirror therapy, motor imaginary, and virtual visual feedback reduce phantom limb pain; however, there is limited scientific evidence supporting their effectiveness. Future studies should include designs with more solid research methods, exploring short- and long-term benefits of these therapies. Clinical relevance This systematic review investigates the effectiveness of mirror therapy, motor imagery, and virtual visual feedback on phantom limb pain, summarizing the currently published trials and evaluating the research quality. Although these interventions have positive benefits in phantom limb pain, there is still a lack of evidence for supporting their effectiveness.

An Umbrella Review of Nuts Intake and Risk of Cardiovascular Disease.

PubMed

Schwingshackl, Lukas; Hoffmann, Georg; Missbach, Benjamin; Stelmach-Mardas, Marta; Boeing, Heiner

2017-01-01

Nuts have been an indispensable component of the human diet for hundreds because of their unique nutrient composition and are thought to play a beneficial part in the prevention of cardiovascular diseases. To evaluate the extent, validity and presence of evidence for studies investigating the impact of nuts intake on biomarkers of cardiovascular disease and cardiovascular events, we performed an umbrella review of all published meta-analyses synthesizing data from both observational studies and randomized controlled trials. PubMed (between 1966 and April 2016) was searched for systematic reviews and meta-analyses. Methodological quality was assessed by applying the AMSTAR score (0-11 points), and the meta-evidence by applying NutriGrade, our recently developed scoring system (0-10 points). In total, 14 meta-analyses were included in the umbrella review. Only 4 out of 14 reported an AMSTAR score ≥8 (high methodological quality), whereas NutriGrade meta-evidence score varied between 2 (very low meta-evidence) and 7.9 (moderate meta-evidence). There is consistent evidence from intervention trials, reporting significant reductions for total cholesterol, and from observational studies that higher intakes of nuts were associated with reduced risk of cardiovascular disease and hypertension. On the other side no effect could be observed for stroke, HDL-cholesterol, and blood pressure in the normal range. In summary, the present umbrella review showed that nuts intake was associated with reduced risk of cardiovascular disease and hypertension, and lower levels of total cholesterol. The observed evidence is limited by the moderate methodological quality and very low to moderate quality of evidence. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

PQScal (Power Quality Score Calculation for Distribution Systems with DER Integration)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Power Quality is of great importance to evaluate the “health” of a distribution system, especially when the distributed energy resource (DER) penetration becomes more significant. The individual components that make up power quality, such as voltage magnitude and unbalance, can be measured in simulations or in the field, however, a comprehensive method to incorporate all of these values into a single score doesn't exist. As a result, we propose a methodology to quantify the power quality health using the single number value, named as Power Quality Score (PQS). The PQS is dependent on six metrics that are developed based onmore » both components that directly impact power quality and those are often reference in the context of power quality. These six metrics are named as System Average Voltage Magnitude Violation Index (SAVMVI), System Average Voltage Fluctuation Index (SAVFI), System Average Voltage Unbalance Index (SAVUI), System Control Device Operation Index (SCDOI), System Reactive Power Demand Index (SRPDI) and System Energy Loss Index (SELI). This software tool, PQScal, is developed based on this novel PQS methodology. Besides of traditional distribution systems, PQScal can also measure the power quality for distribution systems with various DER penetrations. PQScal has been tested on two utility distribution feeders with distinct model characteristics and its effectiveness has been proved. In sum, PQScal can help utilities or other parties to measure the power quality of distribution systems with DER integration easily and effectively.« less

PRISMA and AMSTAR Show Systematic Reviews of Health Literacy and Cancer Screening are Good Quality.

PubMed

Sharma, Sakshi; Oremus, Mark

2018-04-11

To evaluate the reporting and methodological quality of systematic reviews (SRs) in health literacy and cancer screening; to investigate factors that may influence overall quality. A review of SRs published between 2009 and 2017. We calculated indices to represent the included SRs' adherence to PRISMA and AMSTAR. To assess possible determinants of SR quality, we regressed the index scores on year and region of publication, journal impact factor, authors' reported use of PRISMA, and presence of funding statements. We included 19 SRs and median index scores were 0.86 for PRISMA (interquartile range [IQR] = 0.11; range = 0.32 to 1.00) and 0.67 for AMSTAR (IQR = 0.30; range = 0.22 to 1.00). Methodological and reporting problems pertained to protocol registration or publication, number of raters used, gray literature searches, excluded article lists, and unintegrated discussions of risk of bias and efficacy. Only journal impact factor was statistically significantly associated (positively) with PRISMA and AMSTAR index scores. The quality of SRs in health literacy and cancer screening was generally good. Systematic reviewers should register or publish their protocols, include PRISMA and AMSTAR checklists when submitting SRs to journals, and self-evaluate their SRs before submission. Copyright © 2018. Published by Elsevier Inc.

Association of journal quality indicators with methodological quality of clinical research articles.

PubMed

Lee, Kirby P; Schotland, Marieka; Bacchetti, Peter; Bero, Lisa A

2002-06-05

The ability to identify scientific journals that publish high-quality research would help clinicians, scientists, and health-policy analysts to select the most up-to-date medical literature to review. To assess whether journal characteristics of (1) peer-review status, (2) citation rate, (3) impact factor, (4) circulation, (5) manuscript acceptance rate, (6) MEDLINE indexing, and (7) Brandon/Hill Library List indexing are predictors of methodological quality of research articles, we conducted a cross-sectional study of 243 original research articles involving human subjects published in general internal medical journals. The mean (SD) quality score of the 243 articles was 1.37 (0.22). All journals reported a peer-review process and were indexed on MEDLINE. In models that controlled for article type (randomized controlled trial [RCT] or non-RCT), journal citation rate was the most statistically significant predictor (0.051 increase per doubling; 95% confidence interval [CI], 0.037-0.065; P<.001). In separate analyses by article type, acceptance rate was the strongest predictor for RCT quality (-0.113 per doubling; 95% CI, -0.148 to -0.078; P<.001), while journal citation rate was the most predictive factor for non-RCT quality (0.051 per doubling; 95% CI, 0.044-0.059; P<.001). High citation rates, impact factors, and circulation rates, and low manuscript acceptance rates and indexing on Brandon/Hill Library List appear to be predictive of higher methodological quality scores for journal articles.

Author-paper affiliation network architecture influences the methodological quality of systematic reviews and meta-analyses of psoriasis

PubMed Central

Gomez-Garcia, Francisco; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Maestre-Lopez, Beatriz; Gonzalez-Padilla, Marcelino; Carmona-Fernandez, Pedro J.; Velez Garcia-Nieto, Antonio; Isla-Tejera, Beatriz

2017-01-01

Moderate-to-severe psoriasis is associated with significant comorbidity, an impaired quality of life, and increased medical costs, including those associated with treatments. Systematic reviews (SRs) and meta-analyses (MAs) of randomized clinical trials are considered two of the best approaches to the summarization of high-quality evidence. However, methodological bias can reduce the validity of conclusions from these types of studies and subsequently impair the quality of decision making. As co-authorship is among the most well-documented forms of research collaboration, the present study aimed to explore whether authors’ collaboration methods might influence the methodological quality of SRs and MAs of psoriasis. Methodological quality was assessed by two raters who extracted information from full articles. After calculating total and per-item Assessment of Multiple Systematic Reviews (AMSTAR) scores, reviews were classified as low (0-4), medium (5-8), or high (9-11) quality. Article metadata and journal-related bibliometric indices were also obtained. A total of 741 authors from 520 different institutions and 32 countries published 220 reviews that were classified as high (17.2%), moderate (55%), or low (27.7%) methodological quality. The high methodological quality subnetwork was larger but had a lower connection density than the low and moderate methodological quality subnetworks; specifically, the former contained relatively fewer nodes (authors and reviews), reviews by authors, and collaborators per author. Furthermore, the high methodological quality subnetwork was highly compartmentalized, with several modules representing few poorly interconnected communities. In conclusion, structural differences in author-paper affiliation network may influence the methodological quality of SRs and MAs on psoriasis. As the author-paper affiliation network structure affects study quality in this research field, authors who maintain an appropriate balance between scientific quality and productivity are more likely to develop higher quality reviews. PMID:28403245

Quality of reporting in oncology phase II trials: A 5-year assessment through systematic review.

PubMed

Langrand-Escure, Julien; Rivoirard, Romain; Oriol, Mathieu; Tinquaut, Fabien; Rancoule, Chloé; Chauvin, Frank; Magné, Nicolas; Bourmaud, Aurélie

2017-01-01

Phase II clinical trials are a cornerstone of the development in experimental treatments They work as a "filter" for phase III trials confirmation. Surprisingly the attrition ratio in Phase III trials in oncology is significantly higher than in any other medical specialty. This suggests phase II trials in oncology fail to achieve their goal. Objective The present study aims at estimating the quality of reporting in published oncology phase II clinical trials. A literature review was conducted among all phase II and phase II/III clinical trials published during a 5-year period (2010-2015). All articles electronically published by three randomly-selected oncology journals with Impact-Factors>4 were included: Journal of Clinical Oncology, Annals of Oncology and British Journal of Cancer. Quality of reporting was assessed using the Key Methodological Score. 557 articles were included. 315 trials were single-arm studies (56.6%), 193 (34.6%) were randomized and 49 (8.8%) were non-randomized multiple-arm studies. The Methodological Score was equal to 0 (lowest level), 1, 2, 3 (highest level) respectively for 22 (3.9%), 119 (21.4%), 270 (48.5%) and 146 (26.2%) articles. The primary end point is almost systematically reported (90.5%), while sample size calculation is missing in 66% of the articles. 3 variables were independently associated with reporting of a high standard: presence of statistical design (p-value <0.001), multicenter trial (p-value = 0.012), per-protocol analysis (p-value <0.001). Screening was mainly performed by a sole author. The Key Methodological Score was based on only 3 items, making grey zones difficult to translate. This literature review highlights the existence of gaps concerning the quality of reporting. It therefore raised the question of the suitability of the methodology as well as the quality of these trials, reporting being incomplete in the corresponding articles.

Quality of reporting in oncology phase II trials: A 5-year assessment through systematic review

PubMed Central

Langrand-Escure, Julien; Rivoirard, Romain; Oriol, Mathieu; Tinquaut, Fabien; Rancoule, Chloé; Chauvin, Frank; Magné, Nicolas; Bourmaud, Aurélie

2017-01-01

Background Phase II clinical trials are a cornerstone of the development in experimental treatments They work as a "filter" for phase III trials confirmation. Surprisingly the attrition ratio in Phase III trials in oncology is significantly higher than in any other medical specialty. This suggests phase II trials in oncology fail to achieve their goal. Objective The present study aims at estimating the quality of reporting in published oncology phase II clinical trials. Data sources A literature review was conducted among all phase II and phase II/III clinical trials published during a 5-year period (2010–2015). Study eligibility criteria All articles electronically published by three randomly-selected oncology journals with Impact-Factors>4 were included: Journal of Clinical Oncology, Annals of Oncology and British Journal of Cancer. Intervention Quality of reporting was assessed using the Key Methodological Score. Results 557 articles were included. 315 trials were single-arm studies (56.6%), 193 (34.6%) were randomized and 49 (8.8%) were non-randomized multiple-arm studies. The Methodological Score was equal to 0 (lowest level), 1, 2, 3 (highest level) respectively for 22 (3.9%), 119 (21.4%), 270 (48.5%) and 146 (26.2%) articles. The primary end point is almost systematically reported (90.5%), while sample size calculation is missing in 66% of the articles. 3 variables were independently associated with reporting of a high standard: presence of statistical design (p-value <0.001), multicenter trial (p-value = 0.012), per-protocol analysis (p-value <0.001). Limitations Screening was mainly performed by a sole author. The Key Methodological Score was based on only 3 items, making grey zones difficult to translate. Conclusions & implications of key findings This literature review highlights the existence of gaps concerning the quality of reporting. It therefore raised the question of the suitability of the methodology as well as the quality of these trials, reporting being incomplete in the corresponding articles. PMID:29216190

Monitoring scale scores over time via quality control charts, model-based approaches, and time series techniques.

PubMed

Lee, Yi-Hsuan; von Davier, Alina A

2013-07-01

Maintaining a stable score scale over time is critical for all standardized educational assessments. Traditional quality control tools and approaches for assessing scale drift either require special equating designs, or may be too time-consuming to be considered on a regular basis with an operational test that has a short time window between an administration and its score reporting. Thus, the traditional methods are not sufficient to catch unusual testing outcomes in a timely manner. This paper presents a new approach for score monitoring and assessment of scale drift. It involves quality control charts, model-based approaches, and time series techniques to accommodate the following needs of monitoring scale scores: continuous monitoring, adjustment of customary variations, identification of abrupt shifts, and assessment of autocorrelation. Performance of the methodologies is evaluated using manipulated data based on real responses from 71 administrations of a large-scale high-stakes language assessment.

Feedback Effects of Teaching Quality Assessment: Macro and Micro Evidence

ERIC Educational Resources Information Center

Bianchini, Stefano

2014-01-01

This study investigates the feedback effects of teaching quality assessment. Previous literature looked separately at the evolution of individual and aggregate scores to understand whether instructors and university performance depends on its past evaluation. I propose a new quantitative-based methodology, combining statistical distributions and…

Photovoltaic Impact Assessment of Smart Inverter Volt-VAR Control on Distribution System Conservation Voltage Reduction and Power Quality

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ding, Fei; Nagarajan, Adarsh; Chakraborty, Sudipta

This report presents an impact assessment study of distributed photovoltaic (PV) with smart inverter Volt-VAR control on conservation voltage reduction (CVR) energy savings and distribution system power quality. CVR is a methodology of flattening and lowering a distribution system voltage profile in order to conserve energy. Traditional CVR relies on operating utility voltage regulators and switched capacitors. However, with the increased penetration of distributed PV systems, smart inverters provide the new opportunity to control local voltage and power factor by regulating the reactive power output, leading to a potential increase in CVR energy savings. This report proposes a methodology tomore » implement CVR scheme by operating voltage regulators, capacitors, and autonomous smart inverter Volt-VAR control in order to achieve increased CVR benefit. Power quality is an important consideration when operating a distribution system, especially when implementing CVR. It is easy to measure the individual components that make up power quality, but a comprehensive method to incorporate all of these values into a single score has yet to be undertaken. As a result, this report proposes a power quality scoring mechanism to measure the relative power quality of distribution systems using a single number, which is aptly named the 'power quality score' (PQS). Both the CVR and PQS methodologies were applied to two distribution system models, one obtained from the Hawaiian Electric Company (HECO) and another obtained from Pacific Gas and Electric (PG&E). These two models were converted to the OpenDSS platform using previous model conversion tools that were developed by NREL. Multiple scenarios including various PV penetration levels and smart inverter densities were simulated to analyze the impact of smart inverter Volt-VAR support on CVR energy savings and feeder power quality. In order to analyze the CVR benefit and PQS, an annual simulation was conducted for each scenario.« less

A quantitative weight of evidence methodology for the assessment of reproductive and developmental toxicity and its application for classification and labeling of chemicals.

PubMed

Dekant, Wolfgang; Bridges, James

2016-12-01

Hazard assessment of chemicals usually applies narrative assessments with a number of weaknesses. Therefore, application of weight of evidence (WoE) approaches are often mandated but guidance to perform a WoE assessment is lacking. This manuscript describes a quantitative WoE (QWoE) assessment for reproductive toxicity data and its application for classification and labeling (C&L). Because C&L criteria are based on animal studies, the scope is restricted to animal toxicity data. The QWoE methodology utilizes numerical scoring sheets to assess reliability of a publication and the toxicological relevance of reported effects. Scores are given for fourteen quality aspects, best practice receives the highest score. The relevance/effects scores (0 to four) are adjusted to the key elements of the toxic response for the endpoint and include weighting factors for effects on different levels of the biological organization. The relevance/effects scores are then assessed against the criteria dose-response, magnitude and persistence of effects, consistency of observations with the hypothesis, and relation of effects to human disease. The quality/reliability scores and the relevance/effect scores are then multiplied to give a numerical strength of evidence for adverse effects. This total score is then used to assign the chemical to the different classes employed in classification. Copyright © 2016 Elsevier Inc. All rights reserved.

Relationships between abstract features and methodological quality explained variations of social media activity derived from systematic reviews about psoriasis interventions.

PubMed

Ruano, J; Aguilar-Luque, M; Isla-Tejera, B; Alcalde-Mellado, P; Gay-Mimbrera, J; Hernandez-Romero, José Luis; Sanz-Cabanillas, J L; Maestre-López, B; González-Padilla, M; Carmona-Fernández, P J; Gómez-García, F; García-Nieto, A Vélez

2018-05-24

The aim of this study was to describe the relationship among abstract structure, readability, and completeness, and how these features may influence social media activity and bibliometric results, considering systematic reviews (SRs) about interventions in psoriasis classified by methodological quality. Systematic literature searches about psoriasis interventions were undertaken on relevant databases. For each review, methodological quality was evaluated using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Abstract extension, structure, readability, and quality and completeness of reporting were analyzed. Social media activity, which consider Twitter and Facebook mention counts, as well as Mendeley readers and Google scholar citations were obtained for each article. Analyses were conducted to describe any potential influence of abstract characteristics on review's social media diffusion. We classified 139 intervention SRs as displaying high/moderate/low methodological quality. We observed that abstract readability of SRs has been maintained high for last 20 years, although there are some differences based on their methodological quality. Free-format abstracts were most sensitive to the increase of text readability as compared with more structured abstracts (IMRAD or 8-headings), yielding opposite effects on their quality and completeness depending on the methodological quality: a worsening in low quality reviews and an improvement in those of high-quality. Both readability indices and PRISMA for Abstract total scores showed an inverse relationship with social media activity and bibliometric results in high methodological quality reviews but not in those of lower quality. Our results suggest that increasing abstract readability must be specially considered when writing free-format summaries of high-quality reviews, because this fact correlates with an improvement of their completeness and quality, and this may help to achieve broader social media visibility and article usage. Copyright © 2018 Elsevier Inc. All rights reserved.

The exchangeability of self-reports and administrative health care resource use measurements: assessement of the methodological reporting quality.

PubMed

Noben, Cindy Yvonne; de Rijk, Angelique; Nijhuis, Frans; Kottner, Jan; Evers, Silvia

2016-06-01

To assess the exchangeability of self-reported and administrative health care resource use measurements for cost estimation. In a systematic review (NHS EED and MEDLINE), reviewers evaluate, in duplicate, the methodological reporting quality of studies comparing the validation evidence of instruments measuring health care resource use. The appraisal tool Methodological Reporting Quality (MeRQ) is developed by merging aspects form the Guidelines for Reporting Reliability and Agreement Studies and the Standards for Reporting Diagnostic Accuracy. Out of 173 studies, 35 full-text articles are assessed for eligibility. Sixteen articles are included in this study. In seven articles, more than 75% of the reporting criteria assessed by MERQ are considered "good." Most studies score at least "fair" on most of the reporting quality criteria. In the end, six studies score "good" on the minimal criteria for reporting. Varying levels of agreement among the different data sources are found, with correlations ranging from 0.14 up to 0.93 and with occurrences of both random and systematic errors. The validation evidence of the small number of studies with adequate MeRQ cautiously supports the exchangeability of both the self-reported and administrative resource use measurement methods. Copyright © 2016 Elsevier Inc. All rights reserved.

Decision to abort after a prenatal diagnosis of sex chromosome abnormality: a systematic review of the literature.

PubMed

Jeon, Kwon Chan; Chen, Lei-Shih; Goodson, Patricia

2012-01-01

We performed a systematic review of factors affecting parental decisions to continue or terminate a pregnancy after prenatal diagnosis of a sex chromosome abnormality, as reported in published studies from 1987 to May 2011. Based on the Matrix Method for systematic reviews, 19 studies were found in five electronic databases, meeting specific inclusion/exclusion criteria. Abstracted data were organized in a matrix. Alongside the search for factors influencing parental decisions, each study was judged on its methodological quality and assigned a methodological quality score. Decisions either to terminate or to continue a sex chromosome abnormality-affected pregnancy shared five similar factors: specific type of sex chromosome abnormality, gestational week at diagnosis, parents' age, providers' genetic expertise, and number of children/desire for (more) children. Factors unique to termination decisions included parents' fear/anxiety and directive counseling. Factors uniquely associated with continuation decisions were parents' socioeconomic status and ethnicity. The studies' average methodological quality score was 10.6 (SD = 1.67; range, 8-14). Findings from this review can be useful in adapting and modifying guidelines for genetic counseling after prenatal diagnosis of a sex chromosome abnormality. Moreover, improving the quality of future studies on this topic may allow clearer understanding of the most influential factors affecting parental decisions.

A systematic review of the association between radiographic and clinical osteoarthritis of hip and knee.

PubMed

Kinds, M B; Welsing, P M J; Vignon, E P; Bijlsma, J W J; Viergever, M A; Marijnissen, A C A; Lafeber, F P J G

2011-07-01

There is ongoing debate on whether an association between radiographic and clinical osteoarthritis (OA) exists. We hypothesized that the inconsistency in the detection of an association might be caused by different definitions of OA, by different radiographic protocols, and by scoring methods for radiographic damage and symptoms. The goal of this study was to evaluate which methodological criteria are important to detect an association between radiographic and clinical OA of hip and knee. A literature search was performed with the keywords 'OA', 'hip', 'knee', 'radiographic', and 'clinical' and results were screened for relevant studies. Quality criteria for study characteristics and methodology were developed. Studies were classified according to these criteria and the presence of an association between radiographic and clinical OA was scored. The importance of methodological quality and patient characteristics on the presence of an association was evaluated. The literature search resulted in 39 studies describing an association between radiographic and clinical OA. The frequency of an association between radiographic and clinical OA outcome measures diminished when less quality criteria were fulfilled. Specifically the criterion for standardized outcome measures appeared important in the detection of an association. The association was not influenced by patient characteristics. Only four studies were identified that fulfilled all quality criteria and in these studies an association was found for the knee joint and an inconsistent association was found for the hip joint. Methodological quality criteria are of importance to reveal an association between radiographic and clinical OA. Copyright © 2011 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Critical Appraisal of International Clinical Practice Guidelines in Kidney Transplantation Using the Appraisal of Guidelines for Research and Education (AGREE) II Tool: A Systematic Review.

PubMed

OʼDonoghue, Katriona Jane Marie; Reed, Rhiannon D; Knight, Simon R; O'Callaghan, John M; Ayaz-Shah, Anam A; Hassan, Sevda; Weissenbacher, Annemarie; Morris, Peter J; Pengel, Liset H M

2018-05-22

Whilst Clinical Practice Guidelines (CPGs) are used for the development of local protocols in kidney transplantation (Ktx), the quality of their methodology is variable. This systematic review aimed to critically appraise international CPGs in all aspects of Ktx using the Appraisal of Guidelines for Research and Evaluation (AGREE) II tool. CPGs in Ktx and donation published between 2010 and 2017 were identified from MEDLINE, Embase, National Guideline Clearinghouse, NHS and NICE Evidence Searches, and the websites of transplant societies. Using AGREE II, 3 appraisers assessed the quality of CPGs. Interrater reliability was measured using the intraclass correlation coefficient (ICC). Searches identified 3,168 records and 115 CPGs were included. The highest scoring AGREE II domain was 'Scope and Purpose' (80%; Range 30-100%), followed by 'Clarity of Presentation' (77%; Range 43-98%), 'Editorial independence' (52%; Range 0-94%), 'Rigour of Development' (47%; Range 6-97%) and 'Stakeholder Involvement' (41%; Range 11-85%). The poorest scoring domain was 'Applicability' (31%; Range 3-74%). Most CPGs were recommended for future use either with (63%) or without modifications (18%). A small number were not recommended for future use (14%) or reviewers did not agree on recommending the CPG (5%). The overall mean CPG quality score was 4 out of 7 (Range 2-7). The mean ICC of 0.74 indicated substantial agreement between reviewers. The quality of international CPGs in Ktx was variable, and most CPGs lacked key aspects of methodological robustness and transparency. Improvements in methodology, patient involvement and strategies for implementation are required.

A quality evaluation methodology of health web-pages for non-professionals.

PubMed

Currò, Vincenzo; Buonuomo, Paola Sabrina; Onesimo, Roberta; de Rose, Paola; Vituzzi, Andrea; di Tanna, Gian Luca; D'Atri, Alessandro

2004-06-01

The proposal of an evaluation methodology for determining the quality of healthcare web sites for the dissemination of medical information to non-professionals. Three (macro) factors are considered for the quality evaluation: medical contents, accountability of the authors, and usability of the web site. Starting from two results in the literature the problem of whether or not to introduce a weighting function has been investigated. This methodology has been validated on a specialized information content, i.e., sore throats, due to the large interest such a topic enjoys with target users. The World Wide Web was accessed using a meta-search system merging several search engines. A statistical analysis was made to compare the proposed methodology with the obtained ranks of the sample web pages. The statistical analysis confirms that the variables examined (per item and sub factor) show substantially similar ranks and are capable of contributing to the evaluation of the main quality macro factors. A comparison between the aggregation functions in the proposed methodology (non-weighted averages) and the weighting functions, derived from the literature, allowed us to verify the suitability of the method. The proposed methodology suggests a simple approach which can quickly award an overall quality score for medical web sites oriented to non-professionals.

Methological quality of systematic reviews and meta-analyses on acupuncture for stroke: A review of review.

PubMed

Chen, Xin-Lin; Mo, Chuan-Wei; Lu, Li-Ya; Gao, Ri-Yang; Xu, Qian; Wu, Min-Feng; Zhou, Qian-Yi; Hu, Yue; Zhou, Xuan; Li, Xian-Tao

2017-11-01

To assess the methodological quality of systematic reviews and meta-analyses regarding acupuncture intervention for stroke and the primary studies within them. Two researchers searched PubMed, Cumulative index to Nursing and Allied Health Literature, Embase, ISI Web of Knowledge, Cochrane, Allied and Complementary Medicine, Ovid Medline, Chinese Biomedical Literature Database, China National Knowledge Infrastructure, Wanfang and Traditional Chinese Medical Database to identify systematic reviews and meta-analyses about acupuncture for stroke published from the inception to December 2016. Review characteristics and the criteria for assessing the primary studies within reviews were extracted. The methodological quality of the reviews was assessed using adapted Oxman and Guyatt Scale. The methodological quality of primary studies was also assessed. Thirty-two eligible reviews were identified, 15 in English and 17 in Chinese. The English reviews were scored higher than the Chinese reviews (P=0.025), especially in criteria for avoiding bias and the scope of search. All reviews used the quality criteria to evaluate the methodological quality of primary studies, but some criteria were not comprehensive. The primary studies, in particular the Chinese reviews, had problems with randomization, allocation concealment, blinding, dropouts and withdrawals, intent-to-treat analysis and adverse events. Important methodological flaws were found in Chinese systematic reviews and primary studies. It was necessary to improve the methodological quality and reporting quality of both the systematic reviews published in China and primary studies on acupuncture for stroke.

Clinical practice guidelines for fertility preservation in young women undergoing gonadotoxic treatment: an overview and critical appraisal of methodological quality and content.

PubMed

Baysal, Özlem; Hamilton, Jozefien A M; Hamilton, Carl J C M; Braat, Didi D M; Beerendonk, Catharina C M; Nelen, Willianne L D M

2018-04-13

What is the methodological quality and content of internationally available clinical practice guidelines (CPGs) on fertility preservation (FP) care in adult women? Internationally available CPGs on FP care in adult women were identified after conducting an extensive literature search and consulting (inter)national key experts. The methodological quality of the CPGs was appraised by an (inter)national panel of experts using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. The content of the best CPGs, scoring ≥60% for the domain 'Rigour of development' of the AGREE II instrument, was extracted and categorized according to their topic. Thirty of the 1808 documents found were included. After consulting (inter)national key experts, 30 CPGs were included, six of which scored ≥60% for their 'Rigour of development'. The number of FP-related topics discussed by these six CPGs ranged from 4 to 12. The number of recommendations provided by the CPGs on these topics varied. The number of topics to which ≥5 recommendations were dedicated ranged from 0 to 4 between CPGs. CPGs on the subject of FP care are available, but there is room for improvement in quality and content. Although written for use in daily practice, the CPGs can also be used to develop quality indicators to monitor the quality of current FP care or to evaluate future improvement initiatives. Copyright © 2018 Reproductive Healthcare Ltd. Published by Elsevier Ltd. All rights reserved.

Identifying individual changes in performance with composite quality indicators while accounting for regression to the mean.

PubMed

Gajewski, Byron J; Dunton, Nancy

2013-04-01

Almost a decade ago Morton and Torgerson indicated that perceived medical benefits could be due to "regression to the mean." Despite this caution, the regression to the mean "effects on the identification of changes in institutional performance do not seem to have been considered previously in any depth" (Jones and Spiegelhalter). As a response, Jones and Spiegelhalter provide a methodology to adjust for regression to the mean when modeling recent changes in institutional performance for one-variable quality indicators. Therefore, in our view, Jones and Spiegelhalter provide a breakthrough methodology for performance measures. At the same time, in the interests of parsimony, it is useful to aggregate individual quality indicators into a composite score. Our question is, can we develop and demonstrate a methodology that extends the "regression to the mean" literature to allow for composite quality indicators? Using a latent variable modeling approach, we extend the methodology to the composite indicator case. We demonstrate the approach on 4 indicators collected by the National Database of Nursing Quality Indicators. A simulation study further demonstrates its "proof of concept."

What Is the Methodologic Quality of Human Therapy Studies in ISI Surgical Publications?

PubMed Central

Manterola, Carlos; Pineda, Viviana; Vial, Manuel; Losada, Héctor

2006-01-01

Objective: To determine the methodologic quality of therapy articles about humans published in ISI surgical journals, and to explore the association between methodologic quality, origin, and subject matter. Summary Background Data: It is supposed that ISI journals contain the best methodologic articles. Methods: This is a bibliometric study. All journals listed in the 2002 ISI under the subject heading of “Surgery” were included. A simple randomized sampling was conducted for selected journals (Annals of Surgery, The American Surgeon, Archives of Surgery, British Journal of Surgery, European Journal of Surgery, Journal of the American College of Surgeons, Surgery, and World Journal of Surgery). Published articles related to therapy on humans of the selected journals were reviewed and analyzed. All kinds of clinical designs were considered, excluding editorials, review articles, letters to the editor, and experimental studies. The variables considered were: place of origin, design, and the methodologic quality of articles, which was determined by applying a valid and reliable scale. The review was performed interchangeably and independently by 2 research teams. Descriptive and analytical statistics were used. Statistical significance was defined as P values less than 1%. Results: A total of 653 articles were studied. Studies came predominantly from the United States and Europe (43.6% and 36.8%, respectively). The subject areas most frequently found were digestive and hepatobiliopancreatic surgery (29.1% and 24.5%, respectively). Average and median methodologic quality scores of the entire series were 11.6 ± 4.9 points and 11 points, respectively. The association between methodologic quality and journals was determined. Also, the association between methodologic quality and origin was observed, but no association with subject area was verified. Conclusions: The methodologic quality of therapy articles published in the journals analyzed is low; however, statistical significance was determined between them. Association was observed between methodologic quality and origin, but not with subject matter. PMID:17060778

[What is the methodological quality of articles on therapeutic procedures published in Cirugía Española?].

PubMed

Manterola, Carlos; Busquets, Juli; Pascual, Marta; Grande, Luis

2006-02-01

The aim of this study was to determine the methodological quality of articles on therapeutic procedures published in Cirugía Española and to study its association with the publication year, center, and subject-matter. A bibliometric study that included all articles on therapeutic procedures published in Cirugía Española between 2001 and 2004 was performed. All kinds of clinical designs were considered, excluding editorials, review articles, letters to editor, and experimental studies. The variables analyzed were: year of publication, center, design, and methodological quality. Methodological quality was determined by a valid and reliable scale. Descriptive statistics (calculation of means, standard deviation and medians) and analytical statistics (Pearson's chi2, nonparametric, ANOVA and Bonferroni tests) were used. A total of 244 articles were studied (197 case series [81%], 28 cohort studies [12%], 17 clinical trials [7%], 1 cross sectional study and 1 case-control study [0.8%]). The studies were performed mainly in Catalonia and Murcia (22% and 16%, respectively). The most frequent subject areas were soft tissue and hepatobiliopancreatic surgery (23% and 19%, respectively). The mean and median of the methodological quality score calculated for the entire series was 10.2 +/- 3.9 points and 9.5 points, respectively. Methodological quality significantly increased by publication year (p < 0.001). An association between methodological quality and subject area was observed but no association was detected with the center performing the study. The methodological quality of articles on therapeutic procedures published in Cirugía Española between 2001 and 2004 is low. However, a statistically significant trend toward improvement was observed.

Methodological reporting of randomized trials in five leading Chinese nursing journals.

PubMed

Shi, Chunhu; Tian, Jinhui; Ren, Dan; Wei, Hongli; Zhang, Lihuan; Wang, Quan; Yang, Kehu

2014-01-01

Randomized controlled trials (RCTs) are not always well reported, especially in terms of their methodological descriptions. This study aimed to investigate the adherence of methodological reporting complying with CONSORT and explore associated trial level variables in the Chinese nursing care field. In June 2012, we identified RCTs published in five leading Chinese nursing journals and included trials with details of randomized methods. The quality of methodological reporting was measured through the methods section of the CONSORT checklist and the overall CONSORT methodological items score was calculated and expressed as a percentage. Meanwhile, we hypothesized that some general and methodological characteristics were associated with reporting quality and conducted a regression with these data to explore the correlation. The descriptive and regression statistics were calculated via SPSS 13.0. In total, 680 RCTs were included. The overall CONSORT methodological items score was 6.34 ± 0.97 (Mean ± SD). No RCT reported descriptions and changes in "trial design," changes in "outcomes" and "implementation," or descriptions of the similarity of interventions for "blinding." Poor reporting was found in detailing the "settings of participants" (13.1%), "type of randomization sequence generation" (1.8%), calculation methods of "sample size" (0.4%), explanation of any interim analyses and stopping guidelines for "sample size" (0.3%), "allocation concealment mechanism" (0.3%), additional analyses in "statistical methods" (2.1%), and targeted subjects and methods of "blinding" (5.9%). More than 50% of trials described randomization sequence generation, the eligibility criteria of "participants," "interventions," and definitions of the "outcomes" and "statistical methods." The regression analysis found that publication year and ITT analysis were weakly associated with CONSORT score. The completeness of methodological reporting of RCTs in the Chinese nursing care field is poor, especially with regard to the reporting of trial design, changes in outcomes, sample size calculation, allocation concealment, blinding, and statistical methods.

The PEDro scale had acceptably high convergent validity, construct validity, and interrater reliability in evaluating methodological quality of pharmaceutical trials.

PubMed

Yamato, Tie Parma; Maher, Chris; Koes, Bart; Moseley, Anne

2017-06-01

The Physiotherapy Evidence Database (PEDro) scale has been widely used to investigate methodological quality in physiotherapy randomized controlled trials; however, its validity has not been tested for pharmaceutical trials. The aim of this study was to investigate the validity and interrater reliability of the PEDro scale for pharmaceutical trials. The reliability was also examined for the Cochrane Back and Neck (CBN) Group risk of bias tool. This is a secondary analysis of data from a previous study. We considered randomized placebo controlled trials evaluating any pain medication for chronic spinal pain or osteoarthritis. Convergent validity was evaluated by correlating the PEDro score with the summary score of the CBN risk of bias tool. The construct validity was tested using a linear regression analysis to determine the degree to which the total PEDro score is associated with treatment effect sizes, journal impact factor, and the summary score for the CBN risk of bias tool. The interrater reliability was estimated using the Prevalence and Bias Adjusted Kappa coefficient and 95% confidence interval (CI) for the PEDro scale and CBN risk of bias tool. Fifty-three trials were included, with 91 treatment effect sizes included in the analyses. The correlation between PEDro scale and CBN risk of bias tool was 0.83 (95% CI 0.76-0.88) after adjusting for reliability, indicating strong convergence. The PEDro score was inversely associated with effect sizes, significantly associated with the summary score for the CBN risk of bias tool, and not associated with the journal impact factor. The interrater reliability for each item of the PEDro scale and CBN risk of bias tool was at least substantial for most items (>0.60). The intraclass correlation coefficient for the PEDro score was 0.80 (95% CI 0.68-0.88), and for the CBN, risk of bias tool was 0.81 (95% CI 0.69-0.88). There was evidence for the convergent and construct validity for the PEDro scale when used to evaluate methodological quality of pharmacological trials. Both risk of bias tools have acceptably high interrater reliability. Copyright © 2017 Elsevier Inc. All rights reserved.

An Empirical Review of Internet Addiction Outcome Studies in China

ERIC Educational Resources Information Center

Liu, Chennan; Liao, Minli; Smith, Douglas C.

2012-01-01

Objectives: The authors systematically reviewed the outcomes and methodological quality of 24 Internet addiction (IA) treatment outcome studies in China. Method: The authors used 15 attributes from the quality of evidence scores to evaluate 24 outcome studies. These studies came from both English and Chinese academic databases from 2000 to 2010.…

Rating the methodological quality of single-subject designs and n-of-1 trials: introducing the Single-Case Experimental Design (SCED) Scale.

PubMed

Tate, Robyn L; McDonald, Skye; Perdices, Michael; Togher, Leanne; Schultz, Regina; Savage, Sharon

2008-08-01

Rating scales that assess methodological quality of clinical trials provide a means to critically appraise the literature. Scales are currently available to rate randomised and non-randomised controlled trials, but there are none that assess single-subject designs. The Single-Case Experimental Design (SCED) Scale was developed for this purpose and evaluated for reliability. Six clinical researchers who were trained and experienced in rating methodological quality of clinical trials developed the scale and participated in reliability studies. The SCED Scale is an 11-item rating scale for single-subject designs, of which 10 items are used to assess methodological quality and use of statistical analysis. The scale was developed and refined over a 3-year period. Content validity was addressed by identifying items to reduce the main sources of bias in single-case methodology as stipulated by authorities in the field, which were empirically tested against 85 published reports. Inter-rater reliability was assessed using a random sample of 20/312 single-subject reports archived in the Psychological Database of Brain Impairment Treatment Efficacy (PsycBITE). Inter-rater reliability for the total score was excellent, both for individual raters (overall ICC = 0.84; 95% confidence interval 0.73-0.92) and for consensus ratings between pairs of raters (overall ICC = 0.88; 95% confidence interval 0.78-0.95). Item reliability was fair to excellent for consensus ratings between pairs of raters (range k = 0.48 to 1.00). The results were replicated with two independent novice raters who were trained in the use of the scale (ICC = 0.88, 95% confidence interval 0.73-0.95). The SCED Scale thus provides a brief and valid evaluation of methodological quality of single-subject designs, with the total score demonstrating excellent inter-rater reliability using both individual and consensus ratings. Items from the scale can also be used as a checklist in the design, reporting and critical appraisal of single-subject designs, thereby assisting to improve standards of single-case methodology.

Association between prospective registration and overall reporting and methodological quality of systematic reviews: a meta-epidemiological study.

PubMed

Ge, Long; Tian, Jin-Hui; Li, Ya-Nan; Pan, Jia-Xue; Li, Ge; Wei, Dang; Xing, Xin; Pan, Bei; Chen, Yao-Long; Song, Fu-Jian; Yang, Ke-Hu

2018-01-01

The aim of this study was to investigate the differences in main characteristics, reporting and methodological quality between prospectively registered and nonregistered systematic reviews. PubMed was searched to identify systematic reviews of randomized controlled trials published in 2015 in English. After title and abstract screening, potentially relevant reviews were divided into three groups: registered non-Cochrane reviews, Cochrane reviews, and nonregistered reviews. For each group, random number tables were generated in Microsoft Excel, and the first 50 eligible studies from each group were randomly selected. Data of interest from systematic reviews were extracted. Regression analyses were conducted to explore the association between total Revised Assessment of Multiple Systematic Review (R-AMSTAR) or Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) scores and the selected characteristics of systematic reviews. The conducting and reporting of literature search in registered reviews were superior to nonregistered reviews. Differences in 9 of the 11 R-AMSTAR items were statistically significant between registered and nonregistered reviews. The total R-AMSTAR score of registered reviews was higher than nonregistered reviews [mean difference (MD) = 4.82, 95% confidence interval (CI): 3.70, 5.94]. Sensitivity analysis by excluding the registration-related item presented similar result (MD = 4.34, 95% CI: 3.28, 5.40). Total PRISMA scores of registered reviews were significantly higher than nonregistered reviews (all reviews: MD = 1.47, 95% CI: 0.64-2.30; non-Cochrane reviews: MD = 1.49, 95% CI: 0.56-2.42). However, the difference in the total PRISMA score was no longer statistically significant after excluding the item related to registration (item 5). Regression analyses showed similar results. Prospective registration may at least indirectly improve the overall methodological quality of systematic reviews, although its impact on the overall reporting quality was not significant. Copyright © 2017 Elsevier Inc. All rights reserved.

Assessing the quality of the volume-outcome relationship in uro-oncology.

PubMed

Mayer, Erik K; Purkayastha, Sanjay; Athanasiou, Thanos; Darzi, Ara; Vale, Justin A

2009-02-01

To assess systematically the quality of evidence for the volume-outcome relationship in uro-oncology, and thus facilitate the formulating of health policy within this speciality, as 'Implementation of Improving Outcome Guidance' has led to centralization of uro-oncology based on published studies that have supported a 'higher volume-better outcome' relationship, but improved awareness of methodological drawbacks in health service research has questioned the strength of this proposed volume-outcome relationship. We systematically searched previous relevant reports and extracted all articles from 1980 onwards assessing the volume-outcome relationship for cystectomy, prostatectomy and nephrectomy at the institution and/or surgeon level. Studies were assessed for their methodological quality using a previously validated rating system. Where possible, meta-analytical methods were used to calculate overall differences in outcome measures between low and high volume healthcare providers. In all, 22 studies were included in the final analysis; 19 of these were published in the last 5 years. Only four studies appropriately explored the effect of both the institution and surgeon volume on outcome measures. Mortality and length of stay were the most frequently measured outcomes. The median total quality scores within each of the operation types were 8.5, 9 and 8 for cystectomy, prostatectomy and nephrectomy, respectively (possible maximum score 18). Random-effects modelling showed a higher risk of mortality in low-volume institutions than in higher-volume institutions for both cystectomy and nephrectomy (odds ratio 1.88, 95% confidence interval 1.54-2.29, and 1.28, 1.10-1.49, respectively). The methodological quality of volume-outcome research as applied to cystectomy, prostatectomy and nephrectomy is only modest at best. Accepting several limitations, pooled analysis confirms a higher-volume, lower-mortality relationship for cystectomy and nephrectomy. Future research should focus on the development of a quality framework with a validated scoring system for the bench-marking of data to improve validity and facilitate rational policy-making within the speciality of uro-oncology.

SU-E-T-616: Plan Quality Assessment of Both Treatment Planning System Dose and Measurement-Based 3D Reconstructed Dose in the Patient

DOE Office of Scientific and Technical Information (OSTI.GOV)

Olch, A

2015-06-15

Purpose: Systematic radiotherapy plan quality assessment promotes quality improvement. Software tools can perform this analysis by applying site-specific structure dose metrics. The next step is to similarly evaluate the quality of the dose delivery. This study defines metrics for acceptable doses to targets and normal organs for a particular treatment site and scores each plan accordingly. The input can be the TPS or the measurement-based 3D patient dose. From this analysis, one can determine whether the delivered dose distribution to the patient receives a score which is comparable to the TPS plan score, otherwise replanning may be indicated. Methods: Elevenmore » neuroblastoma patient plans were exported from Eclipse to the Quality Reports program. A scoring algorithm defined a score for each normal and target structure based on dose-volume parameters. Each plan was scored by this algorithm and the percentage of total possible points was obtained. Each plan also underwent IMRT QA measurements with a Mapcheck2 or ArcCheck. These measurements were input into the 3DVH program to compute the patient 3D dose distribution which was analyzed using the same scoring algorithm as the TPS plan. Results: The mean quality score for the TPS plans was 75.37% (std dev=14.15%) compared to 71.95% (std dev=13.45%) for the 3DVH dose distribution. For 3/11 plans, the 3DVH-based quality score was higher than the TPS score, by between 0.5 to 8.4 percentage points. Eight/11 plans scores decreased based on IMRT QA measurements by 1.2 to 18.6 points. Conclusion: Software was used to determine the degree to which the plan quality score differed between the TPS and measurement-based dose. Although the delivery score was generally in good agreement with the planned dose score, there were some that improved while there was one plan whose delivered dose quality was significantly less than planned. This methodology helps evaluate both planned and delivered dose quality. Sun Nuclear Corporation has provded a license for the software described.« less

Methodology and reporting of diagnostic accuracy studies of automated perimetry in glaucoma: evaluation using a standardised approach.

PubMed

Fidalgo, Bruno M R; Crabb, David P; Lawrenson, John G

2015-05-01

To evaluate methodological and reporting quality of diagnostic accuracy studies of perimetry in glaucoma and to determine whether there had been any improvement since the publication of the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines. A systematic review of English language articles published between 1993 and 2013 reporting the diagnostic accuracy of perimetry in glaucoma. Articles were appraised for methodological quality using the 14-item Quality assessment tool for diagnostic accuracy studies (QUADAS) and evaluated for quality of reporting by applying the STARD checklist. Fifty-eight articles were appraised. Overall methodological quality of these studies was moderate with a median number of QUADAS items rated as 'yes' equal to nine (out of a maximum of 14) (IQR 7-10). The studies were often poorly reported; median score of STARD items fully reported was 11 out of 25 (IQR 10-14). A comparison of the studies published in 10-year periods before and after the publication of the STARD checklist in 2003 found quality of reporting had not substantially improved. Methodological and reporting quality of diagnostic accuracy studies of perimetry is sub-optimal and appears not to have improved substantially following the development of the STARD reporting guidance. This observation is consistent with previous studies in ophthalmology and in other medical specialities. © 2015 The Authors Ophthalmic & Physiological Optics © 2015 The College of Optometrists.

Use of Balanced Scorecard Methodology for Performance Measurement of the Health Extension Program in Ethiopia

PubMed Central

Teklehaimanot, Hailay D.; Teklehaimanot, Awash; Tedella, Aregawi A.; Abdella, Mustofa

2016-01-01

In 2004, Ethiopia introduced a community-based Health Extension Program to deliver basic and essential health services. We developed a comprehensive performance scoring methodology to assess the performance of the program. A balanced scorecard with six domains and 32 indicators was developed. Data collected from 1,014 service providers, 433 health facilities, and 10,068 community members sampled from 298 villages were used to generate weighted national, regional, and agroecological zone scores for each indicator. The national median indicator scores ranged from 37% to 98% with poor performance in commodity availability, workforce motivation, referral linkage, infection prevention, and quality of care. Indicator scores showed significant difference by region (P < 0.001). Regional performance varied across indicators suggesting that each region had specific areas of strength and deficiency, with Tigray and the Southern Nations, Nationalities and Peoples Region being the best performers while the mainly pastoral regions of Gambela, Afar, and Benishangul-Gumuz were the worst. The findings of this study suggest the need for strategies aimed at improving specific elements of the program and its performance in specific regions to achieve quality and equitable health services. PMID:26928842

Use of Balanced Scorecard Methodology for Performance Measurement of the Health Extension Program in Ethiopia.

PubMed

Teklehaimanot, Hailay D; Teklehaimanot, Awash; Tedella, Aregawi A; Abdella, Mustofa

2016-05-04

In 2004, Ethiopia introduced a community-based Health Extension Program to deliver basic and essential health services. We developed a comprehensive performance scoring methodology to assess the performance of the program. A balanced scorecard with six domains and 32 indicators was developed. Data collected from 1,014 service providers, 433 health facilities, and 10,068 community members sampled from 298 villages were used to generate weighted national, regional, and agroecological zone scores for each indicator. The national median indicator scores ranged from 37% to 98% with poor performance in commodity availability, workforce motivation, referral linkage, infection prevention, and quality of care. Indicator scores showed significant difference by region (P < 0.001). Regional performance varied across indicators suggesting that each region had specific areas of strength and deficiency, with Tigray and the Southern Nations, Nationalities and Peoples Region being the best performers while the mainly pastoral regions of Gambela, Afar, and Benishangul-Gumuz were the worst. The findings of this study suggest the need for strategies aimed at improving specific elements of the program and its performance in specific regions to achieve quality and equitable health services. © The American Society of Tropical Medicine and Hygiene.

Clinical practice guidelines in breast cancer

PubMed Central

Tyagi, N. Kumar; Dhesy-Thind, S.

2018-01-01

Background A number of clinical practice guidelines (cpgs) concerning breast cancer (bca) screening and management are available. Here, we review the strengths and weaknesses of cpgs from various professional organizations and consensus groups with respect to their methodologic quality, recommendations, and implementability. Methods Guidelines from four groups were reviewed with respect to two clinical scenarios: adjuvant ovarian function suppression (ofs) in premenopausal women with early-stage estrogen receptor–positive bca, and use of sentinel lymph node biopsy (slnb) after neoadjuvant chemotherapy (nac) for locally advanced bca. Guidelines from the American Society of Clinical Oncology (asco); Cancer Care Ontario’s Program in Evidence Based Care (cco’s pebc); the U.S. National Comprehensive Cancer Network (nccn); and the St. Gallen International Breast Cancer Consensus Conference were reviewed by two independent assessors. Guideline methodology and applicability were evaluated using the agree ii tool. Results The quality of the cpgs was greatest for the guidelines developed by asco and cco’s pebc. The nccn and St. Gallen guidelines were found to have lower scores for methodologic rigour. All guidelines scored poorly for applicability. The recommendations for ofs were similar in three guidelines. Recommendations by the various organizations for the use of slnb after nac were contradictory. Conclusions Our review demonstrated that cpgs can be heterogeneous in methodologic quality. Low-quality cpg implementation strategies contribute to low uptake of, and adherence to, bca cpgs. Further research examining the barriers to recommendations—such as intrinsic guideline characteristics and the needs of end users—is required. The use of bca cpgs can improve the knowledge-to-practice gap and patient outcomes.

Using QALYs in telehealth evaluations: a systematic review of methodology and transparency.

PubMed

Bergmo, Trine S

2014-08-03

The quality-adjusted life-year (QALY) is a recognised outcome measure in health economic evaluations. QALY incorporates individual preferences and identifies health gains by combining mortality and morbidity into one single index number. A literature review was conducted to examine and discuss the use of QALYs to measure outcomes in telehealth evaluations. Evaluations were identified via a literature search in all relevant databases. Only economic evaluations measuring both costs and QALYs using primary patient level data of two or more alternatives were included. A total of 17 economic evaluations estimating QALYs were identified. All evaluations used validated generic health related-quality of life (HRQoL) instruments to describe health states. They used accepted methods for transforming the quality scores into utility values. The methodology used varied between the evaluations. The evaluations used four different preference measures (EQ-5D, SF-6D, QWB and HUI3), and utility scores were elicited from the general population. Most studies reported the methodology used in calculating QALYs. The evaluations were less transparent in reporting utility weights at different time points and variability around utilities and QALYs. Few made adjustments for differences in baseline utilities. The QALYs gained in the reviewed evaluations varied from 0.001 to 0.118 in implying a small but positive effect of telehealth intervention on patient's health. The evaluations reported mixed cost-effectiveness results. The use of QALYs in telehealth evaluations has increased over the last few years. Different methodologies and utility measures have been used to calculate QALYs. A more harmonised methodology and utility measure is needed to ensure comparability across telehealth evaluations.

Clinical practice guidelines in hypertension: a review.

PubMed

Álvarez-Vargas, Mayita Lizbeth; Galvez-Olortegui, José Kelvin; Galvez-Olortegui, Tomas Vladimir; Sosa-Rosado, José Manuel; Camacho-Saavedra, Luis Arturo

2015-10-23

The aim of this study is the methodological evaluation of Clinical Practice Guidelines (CPG) in hypertension. This is the first in a series of review articles, analysis, assessment in methodology and content of clinical practice guidelines in Cardiology. Of all clinical practice guidelines, three were selected and the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument was used to assess each guide. The guidelines obtained the lowest score in the domain of applicability (mean 43.8%); while the highest score was for clarity of presentation (mean 81.5%). The lowest percentage was found in the applicability domain (European guideline) and the highest of all scores was found in two domains: scope and purpose, and clarity of presentation (Canadian guideline). Assessing the quality of the clinical practice guidelines analyzed, the Canadian is one with the best scores obtained by applying the AGREE II instrument, and it is advised to be used without modifications.

A Methodological Analysis of Randomized Clinical Trials of Computer-Assisted Therapies for Psychiatric Disorders: Toward Improved Standards for an Emerging Field

PubMed Central

Kiluk, Brian D.; Sugarman, Dawn E.; Nich, Charla; Gibbons, Carly J.; Martino, Steve; Rounsaville, Bruce J.; Carroll, Kathleen M.

2013-01-01

Objective Computer-assisted therapies offer a novel, cost-effective strategy for providing evidence-based therapies to a broad range of individuals with psychiatric disorders. However, the extent to which the growing body of randomized trials evaluating computer-assisted therapies meets current standards of methodological rigor for evidence-based interventions is not clear. Method A methodological analysis of randomized clinical trials of computer-assisted therapies for adult psychiatric disorders, published between January 1990 and January 2010, was conducted. Seventy-five studies that examined computer-assisted therapies for a range of axis I disorders were evaluated using a 14-item methodological quality index. Results Results indicated marked heterogeneity in study quality. No study met all 14 basic quality standards, and three met 13 criteria. Consistent weaknesses were noted in evaluation of treatment exposure and adherence, rates of follow-up assessment, and conformity to intention-to-treat principles. Studies utilizing weaker comparison conditions (e.g., wait-list controls) had poorer methodological quality scores and were more likely to report effects favoring the computer-assisted condition. Conclusions While several well-conducted studies have indicated promising results for computer-assisted therapies, this emerging field has not yet achieved a level of methodological quality equivalent to those required for other evidence-based behavioral therapies or pharmacotherapies. Adoption of more consistent standards for methodological quality in this field, with greater attention to potential adverse events, is needed before computer-assisted therapies are widely disseminated or marketed as evidence based. PMID:21536689

Quantitative weight of evidence assessment of higher-tier studies on the toxicity and risks of neonicotinoid insecticides in honeybees 1: Methods.

PubMed

Solomon, Keith R; Stephenson, Gladys L

2017-01-01

A quantitative weight of evidence (QWoE) methodology was developed and used to assess many higher-tier studies on the effects of three neonicotinoid insecticides: clothianidin (CTD), imidacloprid (IMI), and thiamethoxam (TMX) on honeybees. A general problem formulation, a conceptual model for exposures of honeybees, and an analysis plan were developed. A QWoE methodology was used to characterize the quality of the available studies from the literature and unpublished reports of studies conducted by or for the registrants. These higher-tier studies focused on the exposures of honeybees to neonicotinoids via several matrices as measured in the field as well as the effects in experimentally controlled field studies. Reports provided by Bayer Crop Protection and Syngenta Crop Protection and papers from the open literature were assessed in detail, using predefined criteria for quality and relevance to develop scores (on a relative scale of 0-4) to separate the higher-quality from lower-quality studies and those relevant from less-relevant results. The scores from the QWoEs were summarized graphically to illustrate the overall quality of the studies and their relevance. Through mean and standard errors, this method provided graphical and numerical indications of the quality and relevance of the responses observed in the studies and the uncertainty associated with these two metrics. All analyses were conducted transparently and the derivations of the scores were fully documented. The results of these analyses are presented in three companion papers and the QWoE analyses for each insecticide are presented in detailed supplemental information (SI) in these papers.

Does Methodological Guidance Produce Consistency? A Review of Methodological Consistency in Breast Cancer Utility Value Measurement in NICE Single Technology Appraisals.

PubMed

Rose, Micah; Rice, Stephen; Craig, Dawn

2018-06-01

Since 2004, National Institute for Health and Care Excellence (NICE) methodological guidance for technology appraisals has emphasised a strong preference for using the validated EuroQol 5-Dimensions (EQ-5D) quality-of-life instrument, measuring patient health status from patients or carers, and using the general public's preference-based valuation of different health states when assessing health benefits in economic evaluations. The aim of this study was to review all NICE single technology appraisals (STAs) for breast cancer treatments to explore consistency in the use of utility scores in light of NICE methodological guidance. A review of all published breast cancer STAs was undertaken using all publicly available STA documents for each included assessment. Utility scores were assessed for consistency with NICE-preferred methods and original data sources. Furthermore, academic assessment group work undertaken during the STA process was examined to evaluate the emphasis of NICE-preferred quality-of-life measurement methods. Twelve breast cancer STAs were identified, and many STAs used evidence that did not follow NICE's preferred utility score measurement methods. Recent STA submissions show companies using EQ-5D and mapping. Academic assessment groups rarely emphasized NICE-preferred methods, and queries about preferred methods were rare. While there appears to be a trend in recent STA submissions towards following NICE methodological guidance, historically STA guidance in breast cancer has generally not used NICE's preferred methods. Future STAs in breast cancer and reviews of older guidance should ensure that utility measurement methods are consistent with the NICE reference case to help produce consistent, equitable decision making.

DPP-4 inhibitors for the treatment of type 2 diabetes: a methodology overview of systematic reviews.

PubMed

Ling, Juan; Ge, Long; Zhang, Ding-Hua; Wang, Yong-Feng; Xie, Zhuo-Lin; Tian, Jin-Hui; Xiao, Xiao-Hui; Yang, Ke-Hu

2018-06-01

To evaluate the methodological quality of systematic reviews (SRs), and summarize evidence of important outcomes from dipeptidyl peptidase-4 inhibitors (DPP4-I) in treating type 2 diabetes mellitus (T2DM). We included SRs of DPP4-I for the treatment of T2DM until January, 2018 by searching the Cochrane Library, PubMed, EMBASE and three Chinese databases. We evaluated the methodological qualities with the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool and the GRADE (The Grading of Recommendations Assessment, Development and Evaluation) approach. Sixty-three SRs (a total of 2,603,140 participants) receiving DPP4-I for the treatment of T2DM were included. The results of AMSTAR showed that the lowest quality was "a list of studies (included and excluded) item" with only one (1.6%) study provided, followed by the "providing a priori design" item with only four (6.3%) studies conforming to this item, the next were "the status of publication (gray literature) used as an inclusion criterion item", with only 18 (28.9%) studies conforming to these items. Only seven (11.1%) studies scored more than nine points in AMSTAR, indicating high methodological quality. For GRADE, of the 128 outcomes, high quality evidence was provided in only 28 (21.9%), moderate in 70 (54.7%), low in 27 (21.1%), and very low in three (2.3%). The methodological quality of SRs of DPP4-I for type 2 diabetes mellitus is not high and there are common areas for improvement. Furthermore, the quality of evidence level is moderate and more high quality evidence is needed.

Distal biceps brachii tendon repair: a systematic review of patient outcome determination using modified Coleman methodology score criteria.

PubMed

Nyland, John; Causey, Brandon; Wera, Jeff; Krupp, Ryan; Tate, David; Gupta, Amit

2017-07-01

This systematic literature review evaluated the methodological research design quality of studies that evaluated patient outcomes following distal biceps brachii tendon repair and developed evidence-based recommendations for future patient clinical outcomes research. Following the preferred reporting items for systematic reviews and meta-analyses criteria, and using "biceps brachii", "tendon", "repair" and "outcome assessment" search terms, the CINAHL, Academic Search Premier and MEDLINE databases were searched from January 1960-October 2015. The modified Coleman methodology score (MCMS) served as the primary outcome measure. Descriptive statistical analysis was performed for composite and component MCMS and for patient outcome assessment methodology use frequency. A total of 93 studies were evaluated. Overall MCMS was low (57.1 ± 14). Only 12 (12.9 %) had prospective cohort or randomized controlled trial designs. There was a moderate relationship between publication year and MCMS (r = 0.53, P < 0.0001). Although 61 studies (65.6 %) had adequate surgical descriptions, only 3 (3.2 %) had well-described rehabilitation. Of 2253 subjects, only 39 (1.7 %) were women. Studies published after 2008 had higher MCMS scores than studies published earlier (61.3 ± 10 versus 52.9 ± 16, P = 0.003). Although overall research study methodological scores improved on average since 2008, generally low MCMS scores, retrospective designs, lack of eccentric elbow flexor or supinator strength testing, and poorly described surgical and rehabilitation descriptions remain commonplace. These findings decrease clinical study validity and generalizability. III.

Automatically-computed prehospital severity scores are equivalent to scores based on medic documentation.

PubMed

Reisner, Andrew T; Chen, Liangyou; McKenna, Thomas M; Reifman, Jaques

2008-10-01

Prehospital severity scores can be used in routine prehospital care, mass casualty care, and military triage. If computers could reliably calculate clinical scores, new clinical and research methodologies would be possible. One obstacle is that vital signs measured automatically can be unreliable. We hypothesized that Signal Quality Indices (SQI's), computer algorithms that differentiate between reliable and unreliable monitored physiologic data, could improve the predictive power of computer-calculated scores. In a retrospective analysis of trauma casualties transported by air ambulance, we computed the Triage Revised Trauma Score (RTS) from archived travel monitor data. We compared the areas-under-the-curve (AUC's) of receiver operating characteristic curves for prediction of mortality and red blood cell transfusion for 187 subjects with comparable quantities of good-quality and poor-quality data. Vital signs deemed reliable by SQI's led to significantly more discriminatory severity scores than vital signs deemed unreliable. We also compared automatically-computed RTS (using the SQI's) versus RTS computed from vital signs documented by medics. For the subjects in whom the SQI algorithms identified 15 consecutive seconds of reliable vital signs data (n = 350), the automatically-computed scores' AUC's were the same as the medic-based scores' AUC's. Using the Prehospital Index in place of RTS led to very similar results, corroborating our findings. SQI algorithms improve automatically-computed severity scores, and automatically-computed scores using SQI's are equivalent to medic-based scores.

76 FR 627 - Medicare Program; End-Stage Renal Disease Quality Incentive Program

Federal Register 2010, 2011, 2012, 2013, 2014

2011-01-05

... FR 49215- 49232). We received and reviewed many helpful comments regarding the design of the QIP that... three measures. We stated that in designing the scoring methodology for the first year, we wanted to...

Systematic Reviews in Sports Medicine.

PubMed

DiSilvestro, Kevin J; Tjoumakaris, Fotios P; Maltenfort, Mitchell G; Spindler, Kurt P; Freedman, Kevin B

2016-02-01

The number of systematic reviews published in the orthopaedic literature has increased, and these reviews can help guide clinical decision making. However, the quality of these reviews can affect the reader's ability to use the data to arrive at accurate conclusions and make clinical decisions. To evaluate the methodological and reporting quality of systematic reviews and meta-analyses in the sports medicine literature to determine whether such reviews should be used to guide treatment decisions. The hypothesis was that many systematic reviews in the orthopaedic sports medicine literature may not follow the appropriate reporting guidelines or methodological criteria recommended for systematic reviews. Systematic review. All clinical sports medicine systematic reviews and meta-analyses from 2009 to 2013 published in The American Journal of Sports Medicine (AJSM), The Journal of Bone and Joint Surgery (JBJS), Arthroscopy, Sports Health, and Knee Surgery, Sports Traumatology, Arthroscopy (KSSTA) were reviewed and evaluated for level of evidence according to the guidelines from the Oxford Centre for Evidence-Based Medicine, for reporting quality according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, and for methodological quality according to the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Analysis was performed by year and journal of publication, and the levels of evidence included in the systematic reviews were also analyzed. A total of 200 systematic reviews and meta-analyses were identified over the study period. Of these, 53% included evidence levels 4 and 5 in their analyses, with just 32% including evidence levels 1 and 2 only. There were significant differences in the proportion of articles with high levels of evidence (P < .001) and low levels of evidence (P = .005) by journal. The average PRISMA score was 87% and the average AMSTAR score was 73% among all journals. The average AMSTAR and PRISMA scores were significantly different by journal (P = .002 and .001, respectively) and by year (P = .046 and .019, respectively). Arthroscopy, AJSM, and JBJS all scored higher than Sports Health and KSSTA on the PRISMA and AMSTAR. The average PRISMA score by year varied from 85% to 89%, and the average AMSTAR score varied from 70% to 76%. Systematic reviews and meta-analyses in orthopaedics sports medicine literature relied on evidence levels 4 and 5 in 53% of studies over the 5-year study period. Overall, PRISMA and AMSTAR scores are high and may be better than those in other disciplines. Readers need to be conscious of potential shortcomings when reading systematic reviews and using them in practice. © 2015 The Author(s).

[Method for the quality assessment of data collection processes in epidemiological studies].

PubMed

Schöne, G; Damerow, S; Hölling, H; Houben, R; Gabrys, L

2017-10-01

For a quantitative evaluation of primary data collection processes in epidemiological surveys based on accompaniments and observations (in the field), there is no description of test criteria and methodologies in relevant literature and thus no known application in practice. Therefore, methods need to be developed and existing procedures adapted. The aim was to identify quality-relevant developments within quality dimensions by means of inspection points (quality indicators) during the process of data collection. As a result we seek to implement and establish a methodology for the assessment of overall survey quality supplementary to standardized data analyses. Monitors detect deviations from standard primary data collection during site visits by applying standardized checklists. Quantitative results - overall and for each dimension - are obtained by numerical calculation of quality indicators. Score results are categorized and color coded. This visual prioritization indicates necessity for intervention. The results obtained give clues regarding the current quality of data collection. This allows for the identification of such sections where interventions for quality improvement are needed. In addition, process quality development can be shown over time on an intercomparable basis. This methodology for the evaluation of data collection quality can identify deviations from norms, focalize quality analyses and help trace causes for significant deviations.

Systematic Review of Childhood Sedentary Behavior Questionnaires: What do We Know and What is Next?

PubMed

Hidding, Lisan M; Altenburg, Teatske M; Mokkink, Lidwine B; Terwee, Caroline B; Chinapaw, Mai J M

2017-04-01

Accurate measurement of child sedentary behavior is necessary for monitoring trends, examining health effects, and evaluating the effectiveness of interventions. We therefore aimed to summarize studies examining the measurement properties of self-report or proxy-report sedentary behavior questionnaires for children and adolescents under the age of 18 years. Additionally, we provided an overview of the characteristics of the evaluated questionnaires. We performed systematic literature searches in the EMBASE, PubMed, and SPORTDiscus electronic databases. Studies had to report on at least one measurement property of a questionnaire assessing sedentary behavior. Questionnaire data were extracted using a standardized checklist, i.e. the Quality Assessment of Physical Activity Questionnaire (QAPAQ) checklist, and the methodological quality of the included studies was rated using a standardized tool, i.e. the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Forty-six studies on 46 questionnaires met our inclusion criteria, of which 33 examined test-retest reliability, nine examined measurement error, two examined internal consistency, 22 examined construct validity, eight examined content validity, and two examined structural validity. The majority of the included studies were of fair or poor methodological quality. Of the studies with at least a fair methodological quality, six scored positive on test-retest reliability, and two scored positive on construct validity. None of the questionnaires included in this review were considered as both valid and reliable. High-quality studies on the most promising questionnaires are required, with more attention to the content validity of the questionnaires. PROSPERO registration number: CRD42016035963.

Cannabinoids for nausea and vomiting related to chemotherapy: Overview of systematic reviews.

PubMed

Schussel, Victor; Kenzo, Lucas; Santos, Andreia; Bueno, Júlia; Yoshimura, Ellen; de Oliveira Cruz Latorraca, Carolina; Pachito, Daniela Vianna; Riera, Rachel

2018-04-01

Nausea and vomiting are common and distressing adverse events of chemotherapy. This review focuses on the findings and quality of systematic reviews (SRs) of cannabinoids for chemotherapy-induced nausea and vomiting (CINV). Review of SRs, a systematic literature search, was conducted in several electronic databases and included SRs evaluating cannabinoids for CINV in cancer patients. Methodological quality and quality of reporting were evaluated by AMSTAR and PRISMA, respectively. Initial search retrieved 2,206 records, and 5 SRs were included. On the basis of findings of the sole SR judged as high methodological quality, cannabinoids seem to be more effective than placebo, equal to prochlorperazine for reducing CINV, and to be preferred by patients. The response to different combinations of antiemetic agents seems to be equal to 1 antiemetic alone. The average of AMSTAR score was 5, and the average of PRISMA score was 13.2. Cannabinoids represent a valuable option for treating CINV, despite the adverse events related to treatment, such as drowsiness and cognitive impairment. There is no good quality evidence to recommend or not the use of cannabinoids for CINV. More studies are still needed to evaluate the effectiveness of cannabinoids when compared with modern antiemetics. Copyright © 2017 John Wiley & Sons, Ltd.

Methodological Reporting of Randomized Trials in Five Leading Chinese Nursing Journals

PubMed Central

Shi, Chunhu; Tian, Jinhui; Ren, Dan; Wei, Hongli; Zhang, Lihuan; Wang, Quan; Yang, Kehu

2014-01-01

Background Randomized controlled trials (RCTs) are not always well reported, especially in terms of their methodological descriptions. This study aimed to investigate the adherence of methodological reporting complying with CONSORT and explore associated trial level variables in the Chinese nursing care field. Methods In June 2012, we identified RCTs published in five leading Chinese nursing journals and included trials with details of randomized methods. The quality of methodological reporting was measured through the methods section of the CONSORT checklist and the overall CONSORT methodological items score was calculated and expressed as a percentage. Meanwhile, we hypothesized that some general and methodological characteristics were associated with reporting quality and conducted a regression with these data to explore the correlation. The descriptive and regression statistics were calculated via SPSS 13.0. Results In total, 680 RCTs were included. The overall CONSORT methodological items score was 6.34±0.97 (Mean ± SD). No RCT reported descriptions and changes in “trial design,” changes in “outcomes” and “implementation,” or descriptions of the similarity of interventions for “blinding.” Poor reporting was found in detailing the “settings of participants” (13.1%), “type of randomization sequence generation” (1.8%), calculation methods of “sample size” (0.4%), explanation of any interim analyses and stopping guidelines for “sample size” (0.3%), “allocation concealment mechanism” (0.3%), additional analyses in “statistical methods” (2.1%), and targeted subjects and methods of “blinding” (5.9%). More than 50% of trials described randomization sequence generation, the eligibility criteria of “participants,” “interventions,” and definitions of the “outcomes” and “statistical methods.” The regression analysis found that publication year and ITT analysis were weakly associated with CONSORT score. Conclusions The completeness of methodological reporting of RCTs in the Chinese nursing care field is poor, especially with regard to the reporting of trial design, changes in outcomes, sample size calculation, allocation concealment, blinding, and statistical methods. PMID:25415382

Evaluation of the methodological quality of the Health Protection Agency's 2009 guidance on neuraminidase inhibitors.

PubMed

Hopayian, Kevork; Jackson, Lucy

2012-01-01

The Health Protection Agency (HPA) issued guidance advocating the prescription of neuraminidase inhibitors in July 2009 in response to a predicted pandemic of influenza. Although the contents of the guidance have been debated, the methodology has not. The guidance was evaluated by two reviewers using a validated and internationally recognised tool for assessing guidelines, the Appraisal of Guidelines Research & Evaluation instrument (AGREE). This tool scores six domains independently of each other. The guidance scored 61% for the domain scope and purpose and 54% for the domain clarity and presentation. By contrast, it scored only 31% for rigour of development due to poor linkage of its recommendations to evidence. The HPA should improve its performance in this domain to general practitioners in order to improve the credibility of its future guidance.

Platelet-rich plasma in arthroscopic rotator cuff repair: a meta-analysis of randomized controlled trials.

PubMed

Zhao, Jia-Guo; Zhao, Li; Jiang, Yan-Xia; Wang, Zeng-Liang; Wang, Jia; Zhang, Peng

2015-01-01

The purpose of this study was to appraise the retear rate and clinical outcomes of platelet-rich plasma use in patients undergoing arthroscopic full-thickness rotator cuff repair. We searched the Cochrane Library, PubMed, and EMBASE databases for randomized controlled trials comparing the outcomes of arthroscopic rotator cuff surgery with or without the use of platelet-rich plasma. Methodological quality was assessed by the Detsky quality scale. When there was no high heterogeneity, we used a fixed-effects model. Dichotomous variables were presented as risk ratios (RRs) with 95% confidence intervals (CIs), and continuous data were measured as mean differences with 95% CIs. The Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system was used to assess the quality of evidence for each individual outcome. Eight randomized controlled trials were included, with the sample size ranging from 28 to 88. Overall methodological quality was high. Fixed-effects analysis showed that differences were not significant between the 2 groups in retear rate (RR, 0.94; 95% CI, 0.70 to 1.25; P = .66), Constant score (mean difference, 1.12; 95% CI, -1.38 to 3.61; P = .38), and University of California at Los Angeles (UCLA) score (mean difference, -0.68; 95% CI, -2.00 to 0.65; P = .32). The strength of GRADE evidence was categorized respectively as low for retear, moderate for Constant score, and low for UCLA shoulder score. Our meta-analysis does not support the use of platelet-rich plasma in the arthroscopic repair of full-thickness rotator cuff tears over repairs without platelet-rich plasma because of similar retear rates and clinical outcomes. Level II, meta-analysis of Level I and II randomized controlled trials. Copyright © 2015 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Methodological Quality of Systematic Reviews in Subfertility: A Comparison of Two Different Approaches

PubMed Central

Popovich, Ivor; Windsor, Bethany; Jordan, Vanessa; Showell, Marian; Shea, Bev; Farquhar, Cynthia M.

2012-01-01

Background Systematic reviews are used widely to guide health care decisions. Several tools have been created to assess systematic review quality. The measurement tool for assessing the methodological quality of systematic reviews known as the AMSTAR tool applies a yes/no score to eleven relevant domains of review methodology. This tool has been reworked so that each domain is scored based on a four point scale, producing R-AMSTAR. Methods and Findings We aimed to compare the AMSTAR and R-AMSTAR tools in assessing systematic reviews in the field of assisted reproduction for subfertility. All published systematic reviews on assisted reproductive technology, with the latest search for studies taking place from 2007–2011, were considered. Reviews that contained no included studies or considered diagnostic outcomes were excluded. Thirty each of Cochrane and non-Cochrane reviews were randomly selected from a search of relevant databases. Both tools were then applied to all sixty reviews. The results were converted to percentage scores and all reviews graded and ranked based on this. AMSTAR produced a much wider variation in percentage scores and achieved higher inter-rater reliability than R-AMSTAR according to kappa statistics. The average rating for Cochrane reviews was consistent between the two tools (88.3% for R-AMSTAR versus 83.6% for AMSTAR) but inconsistent for non-Cochrane reviews (63.9% R-AMSTAR vs. 38.5% AMSTAR). In comparing the rankings generated between the two tools Cochrane reviews changed an average of 4.2 places, compared to 2.9 for non-Cochrane. Conclusion R-AMSTAR provided greater guidance in the assessment of domains and produced quantitative results. However, there were many problems with the construction of its criteria and AMSTAR was much easier to apply consistently. We recommend that AMSTAR incorporates the findings of this study and produces additional guidance for its application in order to improve its reliability and usefulness. PMID:23300526

Study for the quality assessment of abstracts presented to Italian public health national conferences: a six years survey.

PubMed

Castaldi, S; Colombo, A; D'Errico, R; Bert, F; Siliquini, R; Ceruti, M; Curti, S; Gaietta, M; Garavelli, E; Legouellec, L; Lovato, E; Martinese, M; Visco, F

2013-01-01

Oral and poster presentations at congresses are essential to spread scientific knowledge among the medical community. Many scientific societies have analyzed the quality of papers presented at their meetings but no information on abstracts' evaluation has been presented in Public Health field. This study aims to examine the quality of abstracts presented at annual meetings of Italian Public Health Society (SItI) in the period 2005-2010 through a validated checklist grid, evaluating eight dimensions: Inherency, Structure, Originality, Objectives, Study design, Sources, Results, Conclusions. Each item was scored from 0 to 3 points (max score: 24) and we used the average score in our study (15) as threshold of good quality. A multivariate analysis was performed in order to investigate predictors of score of abstracts presented. A total of 4,399 abstracts (1,172 oral communications, 3,227 posters) was examined. Around 60% were submitted by Universities and around 40% were from Central Italy. The highest quality was found in the fields of Vaccines (average score 18.9), Infectious Diseases (18) and in abstracts submitted by Universities (16.4). Predictors of lower quality identified were geographical area and affiliation (p= 0.002). Abstracts containing well-written Results, Conclusions and Objectives (3 points) were more likely to be of high quality(OR=55.6, OR=41.9, and OR=157.4; p>0.001) CONCLUSIONS: This is the first European study evaluating the quality of abstracts in the public health field. A reliable evaluation tool is fundamental to offer a transparent methodology of assessment and to improve the quality of research.

A systematic review of the therapeutic effects of Reiki.

PubMed

vanderVaart, Sondra; Gijsen, Violette M G J; de Wildt, Saskia N; Koren, Gideon

2009-11-01

Reiki is an ancient form of Japanese healing. While this healing method is widely used for a variety of psychologic and physical symptoms, evidence of its effectiveness is scarce and conflicting. The purpose of this systematic review was to try to evaluate whether Reiki produces a significant treatment effect. Studies were identified using an electronic search of Medline, EMBASE, Cochrane Library, and Google Scholar. Quality of reporting was evaluated using a modified CONSORT Criteria for Herbal Interventions, while methodological quality was assessed using the Jadad Quality score. Two (2) researchers selected articles based on the following features: placebo or other adequate control, clinical investigation on humans, intervention using a Reiki practitioner, and published in English. They independently extracted data on study design, inclusion criteria, type of control, sample size, result, and nature of outcome measures. The modified CONSORT Criteria indicated that all 12 trials meeting the inclusion criteria were lacking in at least one of the three key areas of randomization, blinding, and accountability of all patients, indicating a low quality of reporting. Nine (9) of the 12 trials detected a significant therapeutic effect of the Reiki intervention; however, using the Jadad Quality score, 11 of the 12 studies ranked "poor." The serious methodological and reporting limitations of limited existing Reiki studies preclude a definitive conclusion on its effectiveness. High-quality randomized controlled trials are needed to address the effectiveness of Reiki over placebo.

Frontier-based techniques in measuring hospital efficiency in Iran: a systematic review and meta-regression analysis

PubMed Central

2013-01-01

Background In recent years, there has been growing interest in measuring the efficiency of hospitals in Iran and several studies have been conducted on the topic. The main objective of this paper was to review studies in the field of hospital efficiency and examine the estimated technical efficiency (TE) of Iranian hospitals. Methods Persian and English databases were searched for studies related to measuring hospital efficiency in Iran. Ordinary least squares (OLS) regression models were applied for statistical analysis. The PRISMA guidelines were followed in the search process. Results A total of 43 efficiency scores from 29 studies were retrieved and used to approach the research question. Data envelopment analysis was the principal frontier efficiency method in the estimation of efficiency scores. The pooled estimate of mean TE was 0.846 (±0.134). There was a considerable variation in the efficiency scores between the different studies performed in Iran. There were no differences in efficiency scores between data envelopment analysis (DEA) and stochastic frontier analysis (SFA) techniques. The reviewed studies are generally similar and suffer from similar methodological deficiencies, such as no adjustment for case mix and quality of care differences. The results of OLS regression revealed that studies that included more variables and more heterogeneous hospitals generally reported higher TE. Larger sample size was associated with reporting lower TE. Conclusions The features of frontier-based techniques had a profound impact on the efficiency scores among Iranian hospital studies. These studies suffer from major methodological deficiencies and were of sub-optimal quality, limiting their validity and reliability. It is suggested that improving data collection and processing in Iranian hospital databases may have a substantial impact on promoting the quality of research in this field. PMID:23945011

Contrast-detail phantom scoring methodology.

PubMed

Thomas, Jerry A; Chakrabarti, Kish; Kaczmarek, Richard; Romanyukha, Alexander

2005-03-01

Published results of medical imaging studies which make use of contrast detail mammography (CDMAM) phantom images for analysis are difficult to compare since data are often not analyzed in the same way. In order to address this situation, the concept of ideal contrast detail curves is suggested. The ideal contrast detail curves are constructed based on the requirement of having the same product of the diameter and contrast (disk thickness) of the minimal correctly determined object for every row of the CDMAM phantom image. A correlation and comparison of five different quality parameters of the CDMAM phantom image determined for obtained ideal contrast detail curves is performed. The image quality parameters compared include: (1) contrast detail curve--a graph correlation between "minimal correct reading" diameter and disk thickness; (2) correct observation ratio--the ratio of the number of correctly identified objects to the actual total number of objects multiplied by 100; (3) image quality figure--the sum of the product of the diameter of the smallest scored object and its relative contrast; (4) figure-of-merit--the zero disk diameter value obtained from extrapolation of the contrast detail curve to the origin (e.g., zero disk diameter); and (5) k-factor--the product of the thickness and the diameter of the smallest correctly identified disks. The analysis carried out showed the existence of a nonlinear relationship between the above parameters, which means that use of different parameters of CDMAM image quality potentially can cause different conclusions about changes in image quality. Construction of the ideal contrast detail curves for CDMAM phantom is an attempt to determine the quantitative limits of the CDMAM phantom as employed for image quality evaluation. These limits are determined by the relationship between certain parameters of a digital mammography system and the set of the gold disks sizes in the CDMAM phantom. Recommendations are made on selections of CDMAM phantom regions which should be used for scoring at different image quality and which scoring methodology may be most appropriate. Special attention is also paid to the use of the CDMAM phantom for image quality assessment of digital mammography systems particularly in the vicinity of the Nyquist frequency.

The health-nutrition dimension: a methodological approach to assess the nutritional sustainability of typical agro-food products and the Mediterranean diet.

PubMed

Azzini, Elena; Maiani, Giuseppe; Turrini, Aida; Intorre, Federica; Lo Feudo, Gabriella; Capone, Roberto; Bottalico, Francesco; El Bilali, Hamid; Polito, Angela

2018-08-01

The aim of this paper is to provide a methodological approach to evaluate the nutritional sustainability of typical agro-food products, representing Mediterranean eating habits and included in the Mediterranean food pyramid. For each group of foods, suitable and easily measurable indicators were identified. Two macro-indicators were used to assess the nutritional sustainability of each product. The first macro-indicator, called 'business distinctiveness', takes into account the application of different regulations and standards regarding quality, safety and traceability as well as the origin of raw materials. The second macro-indicator, called 'nutritional quality', assesses product nutritional quality taking into account the contents of key compounds including micronutrients and bioactive phytochemicals. For each indicator a 0-10 scoring system was set up, with scores from 0 (unsustainable) to 10 (very sustainable), with 5 as a sustainability benchmark value. The benchmark value is the value from which a product can be considered sustainable. A simple formula was developed to produce a sustainability index. The proposed sustainability index could be considered a useful tool to describe both the qualitative and quantitative value of micronutrients and bioactive phytochemical present in foodstuffs. This methodological approach can also be applied beyond the Mediterranean, to food products in other world regions. © 2018 Society of Chemical Industry. © 2018 Society of Chemical Industry.

The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature.

PubMed

Pölkki, Tarja; Kanste, Outi; Kääriäinen, Maria; Elo, Satu; Kyngäs, Helvi

2014-02-01

To analyse systematic review articles published in the top 10 nursing journals to determine the quality of the methods employed within them. Systematic review is defined as a scientific research method that synthesises high-quality scientific knowledge on a given topic. The number of such reviews in nursing science has increased dramatically during recent years, but their methodological quality has not previously been assessed. A review of the literature using a narrative approach. Ranked impact factor scores for nursing journals were obtained from the Journal Citation Report database of the Institute of Scientific Information (ISI Web of Knowledge). All issues from the years 2009 and 2010 of the top 10 ranked journals were included. CINAHL and MEDLINE databases were searched to locate studies using the search terms 'systematic review' and 'systematic literature review'. A total of 39 eligible studies were identified. Their methodological quality was evaluated through the specific criteria of quality assessment, description of synthesis and strengths and weaknesses reported in the included studies. Most of the eligible systematic reviews included several different designs or types of quantitative study. The majority included a quality assessment, and a total of 17 different criteria were identified. The method of synthesis was mentioned in about half of the reviews, the most common being narrative synthesis. The weaknesses of reviews were discussed, while strengths were rarely highlighted. The methodological quality of the systematic reviews examined varied considerably, although they were all published in nursing journals with a high-impact factor. Despite the fact that systematic reviews are considered the most robust source of research evidence, they vary in methodological quality. This point is important to consider in clinical practice when applying the results to patient care. © 2013 Blackwell Publishing Ltd.

Applying an Empirical Hydropathic Forcefield in Refinement May Improve Low-Resolution Protein X-Ray Crystal Structures

PubMed Central

Koparde, Vishal N.; Scarsdale, J. Neel; Kellogg, Glen E.

2011-01-01

Background The quality of X-ray crystallographic models for biomacromolecules refined from data obtained at high-resolution is assured by the data itself. However, at low-resolution, >3.0 Å, additional information is supplied by a forcefield coupled with an associated refinement protocol. These resulting structures are often of lower quality and thus unsuitable for downstream activities like structure-based drug discovery. Methodology An X-ray crystallography refinement protocol that enhances standard methodology by incorporating energy terms from the HINT (Hydropathic INTeractions) empirical forcefield is described. This protocol was tested by refining synthetic low-resolution structural data derived from 25 diverse high-resolution structures, and referencing the resulting models to these structures. The models were also evaluated with global structural quality metrics, e.g., Ramachandran score and MolProbity clashscore. Three additional structures, for which only low-resolution data are available, were also re-refined with this methodology. Results The enhanced refinement protocol is most beneficial for reflection data at resolutions of 3.0 Å or worse. At the low-resolution limit, ≥4.0 Å, the new protocol generated models with Cα positions that have RMSDs that are 0.18 Å more similar to the reference high-resolution structure, Ramachandran scores improved by 13%, and clashscores improved by 51%, all in comparison to models generated with the standard refinement protocol. The hydropathic forcefield terms are at least as effective as Coulombic electrostatic terms in maintaining polar interaction networks, and significantly more effective in maintaining hydrophobic networks, as synthetic resolution is decremented. Even at resolutions ≥4.0 Å, these latter networks are generally native-like, as measured with a hydropathic interactions scoring tool. PMID:21246043

Systematic reviews addressing microsurgical head and neck reconstruction.

PubMed

Momeni, Arash; Jacobson, Joshua Y; Lee, Gordon K

2015-01-01

Systematic reviews frequently form the basis for clinical decision making and guideline development. Yet, the quality of systematic reviews has been variable, thus raising concerns about the validity of their conclusions. In the current study, a quality analysis of systematic reviews was performed, addressing microsurgical head and neck reconstruction. A PubMed search was performed to identify all systematic reviews published up to and including December 2012 in 12 surgical journals. Two authors independently reviewed the literature and extracted data from the included reviews. Discrepancies were resolved by consensus. Quality assessment was performed using AMSTAR. The initial search retrieved 1020 articles. After screening titles and abstracts, 987 articles were excluded. Full-text review of the remaining 33 articles resulted in further exclusion of 18 articles, leaving 15 systematic reviews for final analysis. A marked increase in the number of published systematic reviews over time was noted (P = 0.07). The median AMSTAR score was 5, thus reflecting a "fair" quality. No evidence for improvement in methodological quality over time was noted. The trend to publish more systematic reviews in microsurgical head and neck reconstruction is encouraging. However, efforts are indicated to improve the methodological quality of systematic reviews. Familiarity with criteria of methodological quality is critical to ensure future improvements in the quality of systematic reviews conducted in microsurgery.

Arthroscopic Transtibial Pullout Repair for Posterior Medial Meniscus Root Tears: A Systematic Review of Clinical, Radiographic, and Second-Look Arthroscopic Results.

PubMed

Feucht, Matthias J; Kühle, Jan; Bode, Gerrit; Mehl, Julian; Schmal, Hagen; Südkamp, Norbert P; Niemeyer, Philipp

2015-09-01

To systematically review the results of arthroscopic transtibial pullout repair (ATPR) for posterior medial meniscus root tears. A systematic electronic search of the PubMed database and the Cochrane Library was performed in September 2014 to identify studies that reported clinical, radiographic, or second-look arthroscopic outcomes of ATPR for posterior medial meniscus root tears. Included studies were abstracted regarding study characteristics, patient demographic characteristics, surgical technique, rehabilitation, and outcome measures. The methodologic quality of the included studies was assessed with the modified Coleman Methodology Score. Seven studies with a total of 172 patients met the inclusion criteria. The mean patient age was 55.3 years, and 83% of patients were female patients. Preoperative and postoperative Lysholm scores were reported for all patients. After a mean follow-up period of 30.2 months, the Lysholm score increased from 52.4 preoperatively to 85.9 postoperatively. On conventional radiographs, 64 of 76 patients (84%) showed no progression of Kellgren-Lawrence grading. Magnetic resonance imaging showed no progression of cartilage degeneration in 84 of 103 patients (82%) and showed reduced medial meniscal extrusion in 34 of 61 patients (56%). On the basis of second-look arthroscopy and magnetic resonance imaging in 137 patients, the healing status was rated as complete in 62%, partial in 34%, and failed in 3%. Overall, the methodologic quality of the included studies was fair, with a mean modified Coleman Methodology Score of 63. ATPR significantly improves functional outcome scores and seems to prevent the progression of osteoarthritis in most patients, at least during a short-term follow-up. Complete healing of the repaired root and reduction of meniscal extrusion seem to be less predictable, being observed in only about 60% of patients. Conclusions about the progression of osteoarthritis and reduction of meniscal extrusion are limited by the small portion of patients undergoing specific evaluation (44% and 35% of the study group, respectively). Level IV, systematic review of Level III and IV studies. Copyright © 2015 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Efficient clinical evaluation of guideline quality: development and testing of a new tool

PubMed Central

2014-01-01

Background Evaluating the methodological quality of clinical practice guidelines is essential before deciding which ones which could best inform policy or practice. One current method of evaluating clinical guideline quality is the research-focused AGREE II instrument. This uses 23 questions scored 1–7, arranged in six domains, which requires at least two independent testers, and uses a formulaic weighted domain scoring system. Following feedback from time-poor clinicians, policy-makers and managers that this instrument did not suit clinical need, we developed and tested a simpler, shorter, binary scored instrument (the iCAHE Guideline Quality Checklist) designed for single users. Methods Content and construct validity, inter-tester reliability and clinical utility were tested by comparing the new iCAHE Guideline Quality Checklist with the AGREE II instrument. Firstly the questions and domains in both instruments were compared. Six randomly-selected guidelines on a similar theme were then assessed by three independent testers with different experience in guideline quality assessment, using both instruments. Per guideline, weighted domain and total AGREE II scores were calculated, using the scoring rubric for three testers. Total iCAHE scores were calculated per guideline, per tester. The linear relationship between iCAHE and AGREE II scores was assessed using Pearson r correlation coefficients. Score differences between testers were assessed for the iCAHE Guideline Quality Checklist. Results There were congruent questions in each instrument in four domains (Scope & Purpose, Stakeholder involvement, Underlying evidence/Rigour, Clarity). The iCAHE and AGREE II scores were moderate to strongly correlated for the six guidelines. There was generally good agreement between testers for iCAHE scores, irrespective of their experience. The iCAHE instrument was preferred by all testers, and took significantly less time to administer than the AGREE II instrument. However, the use of only three testers and six guidelines compromised study power, rendering this research as pilot investigations of the psychometric properties of the iCAHE instrument. Conclusion The iCAHE Guideline Quality Checklist has promising psychometric properties and clinical utility. PMID:24885893

Do modern total knee replacements offer better value for money? A health economic analysis.

PubMed

Hamilton, David F; Clement, Nicholas D; Burnett, Richard; Patton, James T; Moran, Mathew; Howie, Colin R; Simpson, A H R W; Gaston, Paul

2013-11-01

Cost effectiveness is an increasingly important factor in today's healthcare environment, and selection of arthroplasty implant is not exempt from such concerns. Quality adjusted life years (QALYs) are the typical tool for this type of evaluation. Using this methodology, joint arthroplasty has been shown to be cost effective; however, studies directly comparing differing prostheses are lacking. Data was gathered in a single-centre prospective double-blind randomised controlled trial comparing the outcome of modern and traditional knee implants, using the Short Form 6 dimensional (SF-6D) score and quality adjusted life year (QALY) methodology. There was significant improvement in the SF-6D score for both groups at one year (p < 0.0001). The calculated overall life expectancy for the study cohort was 15.1 years, resulting in an overall QALY gain of 2.144 (95% CI 1.752-2.507). The modern implant group demonstrated a small improvement in SF-6D score compared to the traditional design at one year (0.141 versus 0.143, p = 0.94). This difference resulted in the modern implant costing £298 less per QALY at one year. This study demonstrates that modern implant technology does not influence the cost-effectiveness of TKA using the SF-6D and QALY methodology. This type of analysis however assesses health status, and is not sensitive to joint specific function. Evolutionary design changes in implant technology are thus unlikely to influence QALY analysis following joint replacement, which has important implications for implant procurement.

An appraisal of the utility or futility of ENT consultant postal questionnaires.

PubMed

Ryan, Stephen; Saunders, J; Clarke, E; Fenton, J E

2013-03-01

Despite an increase in ENT postal questionnaires, the quality of their methodology has been questioned (Ramphul et al. in J Laryngol Otol 119:175-178, 1). This retrospective study examined whether quality and utility of such questionnaires published since 2005 has improved. Seventeen consultant postal questionnaires published between 2005 and 2012 were reviewed. Quality of questionnaires was assessed using a 30-point score based on compliance with 15 criteria previously established to evaluate postal questionnaire study-design (Ramphul et al. in J Laryngol Otol 119:175-178, 1). Citation rates were used as an indicator of utility. The specific comments made in each citing paper was reviewed providing information on whether questionnaire findings (a) had an impact on clinical practice, (b) were the citing comments positive, (c) negative or (d) non-specific. Recurrent methodological flaws were identified in all questionnaires. The average score assigned was 44 %, versus 32 % previously reported (Ramphul et al. in J Laryngol Otol 119:175-178, 1) (P < 0.01, Student's t test). The low citation rate demonstrates poor utility for postal questionnaires. Citations were general non-specific referencing with no clear indication that questionnaire findings positively impacted clinical practice. In conclusion, although the quality of ENT postal questionnaire has improved since the original study (Ramphul et al. in J Laryngol Otol 119:175-178, 1), important recurring methodological flaws still exist. The poor utility, based on low citation rates, also reflects the continued deficiencies in design quality. It is recommended that authors of questionnaire-based research should ensure that guidelines for questionnaire design are adhered in order to improve the validity of findings and hence impact on clinical practice.

Appraisal of the methodological quality and summary of the findings of systematic reviews on the relationship between SSRIs and suicidality.

PubMed

Li, Wei; Li, Wei; Wan, Yumei; Ren, Juanjuan; Li, Ting; Li, Chunbo

2014-10-01

Several systematic reviews have been published about the relationship of the use of selective serotonin reuptake inhibitors (SSRIs) and risk of suicidal ideation or behavior but there has been no formal assessment of the quality of these reports. Assess the methodological quality of systematic reviews about the relationship of SSRI use and suicidal ideation and behavior; and provide overall conclusions based on this assessment. Systematic reviews of RCTs that compared SSRIs to placebo and used suicidal ideation or behavior as a key outcome variable were identified by searching Pubmed, Embase, The Cochrane Library, EBSCO, PsycINFO, Chinese National Knowledge Infrastructure, Chongqing VIP database for Chinese Technical Periodicals, WANFANG DATA, and the Chinese Biological Medical Literature Database. The methodological quality of included reviews was independently assessed by two expert raters using the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) scale. Twelve systematic reviews and meta-analyses were identified. The inter-rater reliability of the overall AMSTAR quality score was excellent (ICC=0.86) but the inter-rater reliability of 5 of the 11 AMSTAR items was poor (Kappa <0.60). Based on the AMSTAR total score, there was one high-quality review, eight moderate-quality reviews, and three low-quality reviews. The high-quality review and three of the moderate-quality reviews reported a significantly increased risk of suicidal ideation or behavior in the SSRI group compared to the placebo group. Three of the four reviews limited to children and adolescents found a significantly increased risk of suicidal ideation or behavior with SSRI use which was most evident in teenagers taking paroxetine and in teenagers with depressive disorders. The available evidence suggests that adolescents may experience an increase in suicidal ideation and behavior with SSRI use, particularly those who have a depressive disorder and those treated with paroxetine. However, there are few high-quality reviews on this issue, so some doubt about the evidence remains. The AMSTAR scale may be useful in the ongoing efforts to improve the quality of systematic reviews, but further work is needed on tightening the operational criteria for some of the items in the scale.

A Narrative Review of High-Quality Literature on the Effects of Resident Duty Hours Reforms.

PubMed

Lin, Henry; Lin, Emery; Auditore, Stephanie; Fanning, Jon

2016-01-01

To summarize current high-quality studies evaluating the effect and efficacy of resident duty hours reforms (DHRs) on patient safety and resident education and well-being. The authors searched PubMed and Medline in August 2012 and again in May 2013 for literature (1987-2013) about the effects of DHRs. They assessed the quality of articles using the Medical Education Research Study Quality Instrument (MERSQI) scoring system. They considered randomized controlled trials (RCTs), partial RCTs, and all studies with a MERSQI score ≥ 14 to be "high-quality" methodology studies. A total of 72 high-quality studies met inclusion criteria. Most studies showed no change or slight improvement in mortality and complication rates after DHRs. Resident well-being was generally improved, but there was a perceived negative impact on education (knowledge acquisition, skills, and cognitive performance) following DHRs. Eleven high-quality studies assessed the impact of DHR interventions; all reported a neutral to positive impact. Seven high-quality studies assessed costs associated with DHRs and demonstrated an increase in hospital costs. The results of most studies that allow enough time for DHR interventions to take effect suggest a benefit to patient safety and resident well-being, but the effect on the quality of training remains unknown. Additional methodologically sound studies on the impact of DHRs are necessary. Priorities for future research include approaches to optimizing education and clinical proficiency and studies on the effect of intervention strategies on both education and patient safety. Such studies will provide additional information to help improve duty hours policies.

A systematic and transparent approach for assessing the methodological quality of intervention effectiveness research: the Study Design and Implementation Assessment Device (Study DIAD).

PubMed

Valentine, Jeffrey C; Cooper, Harris

2008-06-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of studies. These tools tend to (a) be insufficiently operational, (b) rely on arbitrary post-hoc decision rules, and (c) result in a single number to represent a multidimensional construct. In response to these limitations, a multilevel and hierarchical instrument was developed in consultation with a wide range of methodological and statistical experts. The instrument focuses on the operational details of studies and results in a profile of scores instead of a single score to represent study quality. A pilot test suggested that satisfactory between-judge agreement can be obtained using well-trained raters working in naturalistic conditions. Limitations of the instrument are discussed, but these are inherent in making decisions about study quality given incomplete reporting and in the absence of strong, contextually based information about the effects of design flaws on study outcomes. (PsycINFO Database Record (c) 2008 APA, all rights reserved).

The Airline Quality Rating 2003

NASA Technical Reports Server (NTRS)

Bowen, Brent D.; Headley, Dean E.

2003-01-01

The Airline Quality Rating (AQR) was developed and first announced in early 1991 as an objective method of comparing airline quality on combined multiple performance criteria. This current report, the Airline Quality Rating 2003, reflects monthly Airline Quality Rating scores for 2002. AQR scores for the calendar year 2002 are based on 15 elements that focus on airline performance areas important to air travel consumers. The Airline Quality Rating 2003 is a summary of month-by-month quality ratings for the 10 largest U.S. airlines operating during 2002. Using the Airline Quality Rating system of weighted averages and monthly performance data in the areas of ontime arrivals, involuntary denied boardings, mishandled baggage, and a combination of 12 customer complaint categories, airlines comparative performance for the calendar year of 2002 is reported. This research monograph contains a brief summary of the AQR methodology, detailed data and charts that track comparative quality for domestic airline operations for the 12-month period of 2002, and industry average results. Also, comparative Airline Quality Rating data for 2001 are included for each airline to provide historical perspective regarding performance quality in the industry.

The Airline Quality Rating 2002

NASA Technical Reports Server (NTRS)

Bowen, Brent D.; Headley, Dean E.

2002-01-01

The Airline Quality Rating (AQR) was developed and first announced in early 1991 as an objective method of comparing airline quality on combined multiple performance criteria. This current report, Airline Quality Rating 2002, reflects monthly Airline Quality Rating scores for 2001. AQR scores for the calendar year 2001 are based on 15 elements that focus on airline performance areas important to air travel consumers. The Airline Quality Rating 2002 is a summary of month-by-month quality ratings for the 11 largest U.S. airlines operating during 2001. Using the Airline Quality Rating system of weighted averages and monthly performance data in the areas of on-time arrivals, involuntary denied boardings, mishandled baggage, and a combination of 12 customer complaint categories, airlines comparative performance for the calendar year of 2001 is reported. This research monograph contains a brief summary of the AQR methodology, detailed data and charts that track comparative quality for domestic airline operations for the 12-month period of 2001, and industry average results. Also, comparative Airline Quality Rating data for 2000 are included for each airline to provide historical perspective regarding performance quality in the industry.

The Airline Quality Rating 2001

NASA Technical Reports Server (NTRS)

Bowen, Brent D.; Headley, Dean E.

2001-01-01

The Airline Quality Rating (AQR) was developed and first announced in early 1991 as an objective method of comparing airline quality on combined multiple performance criteria. This current report, Airline Quality Rating 2001, reflects monthly Airline Quality Rating scores for 2000. AQR scores for the calendar year 2000 are based on 15 elements that focus on airline performance areas important to air travel consumers. The Airline Quality Rating 2001 is a summary of month-by-month quality ratings for the ten major U.S. airlines operating during 2000. Using the Airline Quality Rating system of weighted averages and monthly performance data in the areas of on-time arrivals, involuntary denied boardings, mishandled baggage, and a combination of 12 customer complaint categories, major airlines comparative performance for the calendar year of 2000 is reported. This research monograph contains a brief summary of the AQR methodology, detailed data and charts that track comparative quality for major airlines domestic operations for the 12 month period of 2000, and industry average results. Also, comparative Airline Quality Rating data for 1999 are included for each airline to provide historical perspective regarding performance quality in the industry.

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

Epidemiology Characteristics, Methodological Assessment and Reporting of Statistical Analysis of Network Meta-Analyses in the Field of Cancer

PubMed Central

Ge, Long; Tian, Jin-hui; Li, Xiu-xia; Song, Fujian; Li, Lun; Zhang, Jun; Li, Ge; Pei, Gai-qin; Qiu, Xia; Yang, Ke-hu

2016-01-01

Because of the methodological complexity of network meta-analyses (NMAs), NMAs may be more vulnerable to methodological risks than conventional pair-wise meta-analysis. Our study aims to investigate epidemiology characteristics, conduction of literature search, methodological quality and reporting of statistical analysis process in the field of cancer based on PRISMA extension statement and modified AMSTAR checklist. We identified and included 102 NMAs in the field of cancer. 61 NMAs were conducted using a Bayesian framework. Of them, more than half of NMAs did not report assessment of convergence (60.66%). Inconsistency was assessed in 27.87% of NMAs. Assessment of heterogeneity in traditional meta-analyses was more common (42.62%) than in NMAs (6.56%). Most of NMAs did not report assessment of similarity (86.89%) and did not used GRADE tool to assess quality of evidence (95.08%). 43 NMAs were adjusted indirect comparisons, the methods used were described in 53.49% NMAs. Only 4.65% NMAs described the details of handling of multi group trials and 6.98% described the methods of similarity assessment. The median total AMSTAR-score was 8.00 (IQR: 6.00–8.25). Methodological quality and reporting of statistical analysis did not substantially differ by selected general characteristics. Overall, the quality of NMAs in the field of cancer was generally acceptable. PMID:27848997

The Airline Quality Rating 1999

NASA Technical Reports Server (NTRS)

Bowen, Brent D.; Headley, Dean E.

1999-01-01

The Airline Quality Rating (AQR) was developed and first announced in early 1991 as an objective method of comparing airline performance on combined multiple criteria. This current report, Airline Quality Rating 1999, reflects an updated approach to calculating monthly Airline Quality Rating scores for 1998. AQR scores for the calendar year 1998 are based on 15 elements that focus on airline performance areas important to air travel consumers. The Airline Quality Rating is a summary of month-by-month quality ratings for the ten major U.S. airlines operating during 1998. Using the Airline Quality Rating system of weighted averages and monthly performance data in the areas of on-time arrivals, involuntary denied boardings, mishandled baggage, and a combination of 12 customer complaint categories, major airlines comparative performance for the calendar year 1998 is reported. This research monograph contains a brief summary of the AQR methodology, detailed data and charts that track comparative quality for major airlines domestic operations for the 12 month period of 1998, and industry average results. Also, comparative Airline Quality Rating data for 1997, using the updated criteria, are included to provide a reference point regarding quality in the industry.

The Airline Quality Rating 2004

NASA Technical Reports Server (NTRS)

Bowen, Brent D.; Headley, Dean E.

2004-01-01

The Airline Quality Rating (AQR) was developed and first announced in early 1991 as an objective method of comparing airline quality on combined multiple performance criteria. This current report, the Airline Quality Rating 2004, reflects monthly Airline Quality Rating scores for 2003. AQR scores far the calendar year 2003 are based on 15 elemnts in four major areas that focus on airline performance aspects important to air travel consumers. The Airline Quality Rating 2004 is a summary of month-by-month quality ratings for U.S. airlines that have at least 1% of domestic passenger volume during 2003. Using the Airline Quality Rating system of weighted averages and monthly performance data in the areas of on-time arrivals, involuntary denied boardings, mishandled baggage, and a combination of 12 customer complaint categories, airlines comparative performance for the calendar year of 2003 is reported. This research monograph contains a brief summary of the AQR methodology, detailed data and charts that track comparative quality for domestic airline operations for the 12-month period of 2003, and industry results. Also, comparative Airline Quality Rating data for 2002 are included, where available, to provide historical perspective

Derivation, Validation and Application of a Pragmatic Risk Prediction Index for Benchmarking of Surgical Outcomes.

PubMed

Spence, Richard T; Chang, David C; Kaafarani, Haytham M A; Panieri, Eugenio; Anderson, Geoffrey A; Hutter, Matthew M

2018-02-01

Despite the existence of multiple validated risk assessment and quality benchmarking tools in surgery, their utility outside of high-income countries is limited. We sought to derive, validate and apply a scoring system that is both (1) feasible, and (2) reliably predicts mortality in a middle-income country (MIC) context. A 5-step methodology was used: (1) development of a de novo surgical outcomes database modeled around the American College of Surgeons' National Surgical Quality Improvement Program (ACS-NSQIP) in South Africa (SA dataset), (2) use of the resultant data to identify all predictors of in-hospital death with more than 90% capture indicating feasibility of collection, (3) use these predictors to derive and validate an integer-based score that reliably predicts in-hospital death in the 2012 ACS-NSQIP, (4) apply the score in the original SA dataset and demonstrate its performance, (5) identify threshold cutoffs of the score to prompt action and drive quality improvement. Following step one-three above, the 13 point Codman's score was derived and validated on 211,737 and 109,079 patients, respectively, and includes: age 65 (1), partially or completely dependent functional status (1), preoperative transfusions ≥4 units (1), emergency operation (2), sepsis or septic shock (2) American Society of Anesthesia score ≥3 (3) and operative procedure (1-3). Application of the score to 373 patients in the SA dataset showed good discrimination and calibration to predict an in-hospital death. A Codman Score of 8 is an optimal cutoff point for defining expected and unexpected deaths. We have designed a novel risk prediction score specific for a MIC context. The Codman Score can prove useful for both (1) preoperative decision-making and (2) benchmarking the quality of surgical care in MIC's.

Guidelines for the symptomatic management of fever in children: systematic review of the literature and quality appraisal with AGREE II.

PubMed

Chiappini, Elena; Bortone, Barbara; Galli, Luisa; de Martino, Maurizio

2017-07-31

Several societies have produced and disseminated clinical practice guidelines (CPGs) for the symptomatic management of fever in children. However, to date, the quality of such guidelines has not been appraised. To identify and evaluate guidelines for the symptomatic management of fever in children. The research was conducted using PubMed, guideline websites, and Google (January 2010 to July 2016). The quality of the CPGs was independently assessed by two assessors using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) instrument, and specific recommendations in guidelines were summarised and evaluated. Domain scores were considered of sufficient quality when >60% and of good quality when >80%. Seven guidelines were retrieved. The median score for the scope and purpose domain was 85.3% (range 66.6-100%). The median score for the stakeholder involvement domain was 57.5% (range 33.3-83.3%) and four guidelines scored >60%. The median score for the rigour of development domain was 52.0% (range 14.6-98.9%), and only three guidelines scored >60%. The median score for the clarity of presentation domain was 80.9% (range 50.0-94.4%). The median score for the applicability domain was 39.3% (8.3-100%). Only one guideline scored >60%. The median score for the editorial independence domain was 48.84% (0-91.6%); only three guidelines scored >60%. Most guidelines were recommended for use even if with modification, especially in the methodology, the applicability and the editorial independence domains. Our results could help improve reporting of future guidelines, and affect the selection and use of guidelines in clinical practice. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Exploration of the methodological quality and clinical usefulness of a cross-sectional sample of published guidance about exercise training and physical activity for the secondary prevention of coronary heart disease.

PubMed

Abell, Bridget; Glasziou, Paul; Hoffmann, Tammy

2017-06-13

Clinicians are encouraged to use guidelines to assist in providing evidence-based secondary prevention to patients with coronary heart disease. However, the expanding number of publications providing guidance about exercise training may confuse cardiac rehabilitation clinicians. We therefore sought to explore the number, scope, publication characteristics, methodological quality, and clinical usefulness of published exercise-based cardiac rehabilitation guidance. We included publications recommending physical activity, exercise or cardiac rehabilitation for patients with coronary heart disease. These included systematically developed clinical practice guidelines, as well as other publications intended to support clinician decision making, such as position papers or consensus statements. Publications were obtained via electronic searches of preventive cardiology societies, guideline databases and PubMed, to November 2016. Publication characteristics were extracted, and two independent assessors evaluated quality using the 23-item Appraisal of Guidelines Research and Evaluation II (AGREE) tool. Fifty-four international publications from 1994 to 2016 were identified. Most were found on preventive cardiology association websites (n = 35; 65%) and were freely accessible (n = 50; 93%). Thirty (56%) publications contained only broad recommendations for physical activity and cardiac rehabilitation referral, while 24 (44%) contained the necessary detailed exercise training recommendations. Many were labelled as "guidelines", however publications with other titles (e.g. scientific statements) were common (n = 24; 44%). This latter group of publications contained a significantly greater proportion of detailed exercise training recommendations than clinical guidelines (p = 0.017). Wide variation in quality also existed, with 'applicability' the worst scoring AGREE II domain for clinical guidelines (mean score 53%) and 'rigour of development' rated lowest for other guidance types (mean score 33%). While a large number of guidance documents provide recommendations for exercise-based cardiac rehabilitation, most have limitations in either methodological quality or clinical usefulness. The lack of rigorously developed guidelines which also contain necessary detail about exercise training remains a substantial problem for clinicians.

Assessment of Stone Complexity for PCNL: A Systematic Review of the Literature, How Best Can We Record Stone Complexity in PCNL?

PubMed

Withington, John; Armitage, James; Finch, William; Wiseman, Oliver; Glass, Jonathan; Burgess, Neil

2016-01-01

This study aims to systematically review the literature reporting tools for scoring stone complexity and the stratification of outcomes by stone complexity. In doing so, we aim to determine whether the evidence favors uniform adoption of any one scoring system. PubMed and Embase databases were systematically searched for relevant studies from 2004 to 2014. Reports selected according to predetermined inclusion and exclusion criteria were appraised in terms of methodologic quality and their findings summarized in structured tables. After review, 15 studies were considered suitable for inclusion. Four distinct scoring systems were identified and a further five studies that aimed to validate aspects of those scoring systems. Six studies reported the stratification of outcomes by stone complexity, without specifically defining a scoring system. All studies reported some correlation between stone complexity and stone clearance. Correlation with complications was less clearly established, where investigated. This review does not allow us to firmly recommend one scoring system over the other. However, the quality of evidence supporting validation of the Guy's Stone Score is marginally superior, according to the criteria applied in this study. Further evaluation of the interobserver reliability of this scoring system is required.

Methodological and Reporting Quality of Comparative Studies Evaluating Health-Related Quality of Life of Colorectal Cancer Patients and Controls: A Systematic Review.

PubMed

Wong, Carlos K H; Guo, Vivian Y W; Chen, Jing; Lam, Cindy L K

2016-11-01

Health-related quality of life is an important outcome measure in patients with colorectal cancer. Comparison with normative data has been increasingly undertaken to assess the additional impact of colorectal cancer on health-related quality of life. This review aimed to critically appraise the methodological details and reporting characteristics of comparative studies evaluating differences in health-related quality of life between patients and controls. A systematic search of English-language literature published between January 1985 and May 2014 was conducted through a database search of PubMed, Web of Science, Embase, and Medline. Comparative studies reporting health-related quality-of-life outcomes among patients who have colorectal cancer and controls were selected. Methodological and reporting quality per comparison study was evaluated based on a 11-item methodological checklist proposed by Efficace in 2003 and a set of criteria predetermined by reviewers. Thirty-one comparative studies involving >10,000 patients and >10,000 controls were included. Twenty-three studies (74.2%) originated from European countries, with the largest number from the Netherlands (n = 6). Twenty-eight studies (90.3%) compared the health-related quality of life of patients with normative data published elsewhere, whereas the remaining studies recruited a group of patients who had colorectal cancer and a group of control patients within the same studies. The European Organisation for Research and Treatment of Cancer Quality-of-Life Questionnaire Core 30 was the most extensively used instrument (n = 16; 51.6%). Eight studies (25.8%) were classified as "probably robust" for clinical decision making according to the Efficace standard methodological checklist. Our further quality assessment revealed the lack of score differences reported (61.3%), contemporary comparisons (36.7%), statistical significance tested (38.7%), and matching of control group (58.1%), possibly leading to inappropriate control groups for fair comparisons. Meta-analysis of differences between the 2 groups was not available. In general, one-fourth of comparative studies that evaluated health-related quality of life of patients who had colorectal cancer achieved high quality in reporting characteristics and methodological details. Future studies are encouraged to undertake health-related quality-of-life measurement and adhere to a methodological checklist in comparison with controls.

A retrospective survey of the quality of reports and their correlates among randomized controlled trials of immunotherapy for Guillain-Barré syndrome.

PubMed

Lu, Liming; Luo, Gaoquan; Xiao, Fang

2013-08-01

This study aims to assess the quality of reports and their correlates in randomized controlled trials (RCTs) of immunotherapy for Guillain-Barré syndrome (GBS). A search was performed in multiple databases of reports published between April 1992 and November 2012. Reporting quality was assessed by items of the Consolidated Standards of Reporting Trials (CONSORT) 2010 Statement. An overall quality score (OQS) and a key methodological index score (MIS) were calculated for each trial. Factors associated with OQS and MIS were then identified. A total of 19 RCTs were included in the full text. The median OQS was 7.0, with a range of 1-10. However, the quality of reporting in items of 'flow chart' and 'ancillary analyses' was poor with a positive rate of less than 40%. The median MIS was 0 with a range of 0-2. Twelve (63.2%) did not report any of the three key methodological items. Specifically, the mean OQS increased by approximately 2.73 for manuscripts published in the New England Journal of Medicine, The Lancet, Pediatrics and Neurology (95% CI: 0.35-5.12; p < 0.05). Multivariate linear regression and the Poisson regression model could not be presented as the number of included trials was too small. The reporting quality in RCTs on immunotherapy for GBS was poor, which indicated that reporting in RCTs of immunotherapy for GBS needed substantial improvement in order to meet the guideline of the CONSORT Statement.

Physical examination tests for screening and diagnosis of cervicogenic headache: A systematic review.

PubMed

Rubio-Ochoa, J; Benítez-Martínez, J; Lluch, E; Santacruz-Zaragozá, S; Gómez-Contreras, P; Cook, C E

2016-02-01

It has been suggested that differential diagnosis of headaches should consist of a robust subjective examination and a detailed physical examination of the cervical spine. Cervicogenic headache (CGH) is a form of headache that involves referred pain from the neck. To our knowledge, no studies have summarized the reliability and diagnostic accuracy of physical examination tests for CGH. The aim of this study was to summarize the reliability and diagnostic accuracy of physical examination tests used to diagnose CGH. A systematic review following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines was performed in four electronic databases (MEDLINE, Web of Science, Embase and Scopus). Full text reports concerning physical tests for the diagnosis of CGH which reported the clinometric properties for assessment of CGH, were included and screened for methodological quality. Quality Appraisal for Reliability Studies (QAREL) and Quality Assessment of Studies of Diagnostic Accuracy (QUADAS-2) scores were completed to assess article quality. Eight articles were retrieved for quality assessment and data extraction. Studies investigating diagnostic reliability of physical examination tests for CGH scored poorer on methodological quality (higher risk of bias) than those of diagnostic accuracy. There is sufficient evidence showing high levels of reliability and diagnostic accuracy of the selected physical examination tests for the diagnosis of CGH. The cervical flexion-rotation test (CFRT) exhibited both the highest reliability and the strongest diagnostic accuracy for the diagnosis of CGH. Copyright © 2015 Elsevier Ltd. All rights reserved.

Identity and perceived peer relationship quality in emerging adulthood: the mediating role of attachment-related emotions.

PubMed

Doumen, Sarah; Smits, Ilse; Luyckx, Koen; Duriez, Bart; Vanhalst, Janne; Verschueren, Karine; Goossens, Luc

2012-12-01

Identity formation and the perceived quality of one's peer relationships are theorized to be intimately linked in emerging adulthood. The present study examined the associations between identity styles (i.e., information-oriented, normative, and diffuse-avoidant styles) and the quality of relationships with peers (as indexed by friendship quality and loneliness) in a sample of 343 college students from Belgium. High scores for the information-oriented style were positively related to friendship quality, whereas high scores for the diffuse-avoidant identity style were positively related to loneliness. These direct associations were mediated, at least in part, by attachment-related emotions (i.e., avoidance and anxiety). These associations, both direct and indirect, provide the first evidence linking identity styles and the quality of peer relationships. Suggestions for future research are provided, both at the methodological and the conceptual level. Copyright © 2012 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Surrogate outcomes are associated with low methodological quality of studies of rheumatoid arthritis treated with antitumour necrosis factor agents: a systematic review.

PubMed

Nobre, Moacyr Roberto Cuce; da Costa, Frnanda Marques

2012-02-01

Surrogate endpoints may be used as substitutes for, but often do not predict clinically relevant events. Objective To assess the methodological quality of articles that present their conclusions based on clinically relevant or surrogate outcomes in a systematic review of randomised trials and cohort studies of patients with rheumatoid arthritis treated with antitumour necrosis factor (TNF) agents. PubMed, Embase and Cochrane databases were searched. The Jadad score, the percentage of Consolidated Standards Of Reporting Trials (CONSORT) statement items adequately reported and levels-of-evidence (Center for Evidence-based Medicine, Oxford) were used in a descriptive synthesis. Among 88 articles appraised, 27 had surrogate endpoints, mainly radiographic, and 44 were duplicate publications; 74% of articles with surrogate and 39% of articles with clinical endpoints (p=0.006). Fewer articles with surrogate endpoints represented a high level of evidence (Level 1b, 33% vs 62%, p=0.037) and the mean percentage of CONSORT statement items met was also lower for articles with surrogate endpoints (62.5 vs 70.7, p=0.026). Although fewer articles with surrogate endpoints were randomised trials (63% vs 74%, p=0.307) and articles with surrogate endpoints had lower Jadad scores (3.0 vs 3.2, p=0.538), these differences were not statistically significant. Studies of anti-TNF agents that report surrogate outcomes are of lesser methodological quality. As such, inclusion of such studies in evidence syntheses may bias results.

Improved protein model quality assessments by changing the target function.

PubMed

Uziela, Karolis; Menéndez Hurtado, David; Shu, Nanjiang; Wallner, Björn; Elofsson, Arne

2018-06-01

Protein modeling quality is an important part of protein structure prediction. We have for more than a decade developed a set of methods for this problem. We have used various types of description of the protein and different machine learning methodologies. However, common to all these methods has been the target function used for training. The target function in ProQ describes the local quality of a residue in a protein model. In all versions of ProQ the target function has been the S-score. However, other quality estimation functions also exist, which can be divided into superposition- and contact-based methods. The superposition-based methods, such as S-score, are based on a rigid body superposition of a protein model and the native structure, while the contact-based methods compare the local environment of each residue. Here, we examine the effects of retraining our latest predictor, ProQ3D, using identical inputs but different target functions. We find that the contact-based methods are easier to predict and that predictors trained on these measures provide some advantages when it comes to identifying the best model. One possible reason for this is that contact based methods are better at estimating the quality of multi-domain targets. However, training on the S-score gives the best correlation with the GDT_TS score, which is commonly used in CASP to score the global model quality. To take the advantage of both of these features we provide an updated version of ProQ3D that predicts local and global model quality estimates based on different quality estimates. © 2018 Wiley Periodicals, Inc.

Models to predict length of stay in the Intensive Care Unit after coronary artery bypass grafting: a systematic review.

PubMed

Atashi, Alireza; Verburg, Ilona W; Karim, Hesam; Miri, Mirmohammad; Abu-Hanna, Ameen; de Jonge, Evert; de Keizer, Nicolette F; Eslami, Saeid

2018-06-01

Intensive Care Units (ICU) length of stay (LoS) prediction models are used to compare different institutions and surgeons on their performance, and is useful as an efficiency indicator for quality control. There is little consensus about which prediction methods are most suitable to predict (ICU) length of stay. The aim of this study is to systematically review models for predicting ICU LoS after coronary artery bypass grafting and to assess the reporting and methodological quality of these models to apply them for benchmarking. A general search was conducted in Medline and Embase up to 31-12-2016. Three authors classified the papers for inclusion by reading their title, abstract and full text. All original papers describing development and/or validation of a prediction model for LoS in the ICU after CABG surgery were included. We used a checklist developed for critical appraisal and data extraction for systematic reviews of prediction modeling and extended it on handling specific patients subgroups. We also defined other items and scores to assess the methodological and reporting quality of the models. Of 5181 uniquely identified articles, fifteen studies were included of which twelve on development of new models and three on validation of existing models. All studies used linear or logistic regression as method for model development, and reported various performance measures based on the difference between predicted and observed ICU LoS. Most used a prospective (46.6%) or retrospective study design (40%). We found heterogeneity in patient inclusion/exclusion criteria; sample size; reported accuracy rates; and methods of candidate predictor selection. Most (60%) studies have not mentioned the handling of missing values and none compared the model outcome measure of survivors with non-survivors. For model development and validation studies respectively, the maximum reporting (methodological) scores were 66/78 and 62/62 (14/22 and 12/22). There are relatively few models for predicting ICU length of stay after CABG. Several aspects of methodological and reporting quality of studies in this field should be improved. There is a need for standardizing outcome and risk factor definitions in order to develop/validate a multi-institutional and international risk scoring system.

Methodologic European external quality assurance for DNA sequencing: the EQUALseq program.

PubMed

Ahmad-Nejad, Parviz; Dorn-Beineke, Alexandra; Pfeiffer, Ulrike; Brade, Joachim; Geilenkeuser, Wolf-Jochen; Ramsden, Simon; Pazzagli, Mario; Neumaier, Michael

2006-04-01

DNA sequencing is a key technique in molecular diagnostics, but to date no comprehensive methodologic external quality assessment (EQA) programs have been instituted. Between 2003 and 2005, the European Union funded, as specific support actions, the EQUAL initiative to develop methodologic EQA schemes for genotyping (EQUALqual), quantitative PCR (EQUALquant), and sequencing (EQUALseq). Here we report on the results of the EQUALseq program. The participating laboratories received a 4-sample set comprising 2 DNA plasmids, a PCR product, and a finished sequencing reaction to be analyzed. Data and information from detailed questionnaires were uploaded online and evaluated by use of a scoring system for technical skills and proficiency of data interpretation. Sixty laboratories from 21 European countries registered, and 43 participants (72%) returned data and samples. Capillary electrophoresis was the predominant platform (n = 39; 91%). The median contiguous correct sequence stretch was 527 nucleotides with considerable variation in quality of both primary data and data evaluation. The association between laboratory performance and the number of sequencing assays/year was statistically significant (P <0.05). Interestingly, more than 30% of participants neither added comments to their data nor made efforts to identify the gene sequences or mutational positions. Considerable variations exist even in a highly standardized methodology such as DNA sequencing. Methodologic EQAs are appropriate tools to uncover strengths and weaknesses in both technique and proficiency, and our results emphasize the need for mandatory EQAs. The results of EQUALseq should help improve the overall quality of molecular genetics findings obtained by DNA sequencing.

The Airline Quality Rating 2004

NASA Technical Reports Server (NTRS)

Fink, Mary M. (Editor); Bowen, Brent D.; Headley, Dean E.

2004-01-01

The Airline Quality Rating (AQR) was developed and first announced in early 1991 as an objective method of comparing airline quality on combined multiple performance criteria. This current report, the Airline Quality Rating 2004, reflects monthly Airline Quality Rating scores for 2003. AQR scores for the calendar year 2003 are based on 15 elements in four major areas that focus on airline performance aspects important to air travel consumers. The Airline Quality Rating 2004 is a summary of month-by-month quality ratings for U.S. airlines that have at least 1 % of domestic passenger volume during 2003. Using the Airline Quality Rating system of weighted averages and monthly performance data in the areas of on-time arrivals, involuntary denied boardings, mishandled baggage, and a combination of 12 customer complaint categories, airlines comparative performance for the calendar year of 2003 is reported. This research monograph contains a brief summary of the AQR methodology, detailed data and charts that track comparative quality for domestic airline operations for the 12-month period of 2003, and industry results. Also, comparative Airline Quality Rating data for 2002 are included, where available, to provide historical perspective regarding performance quality in the industry.

Quality of life in breast cancer sufferers.

PubMed

Shouman, Ahmed Essmat; Abou El Ezz, Nahla Fawzy; Gado, Nivine; Ibrahim Goda, Amal Mahmoud

2016-08-08

Purpose - The purpose of this paper is to measure health-related quality of life (QOL) among patients with early stage cancer breast under curative treatment at department of oncology and nuclear medicine at Ain Shams University Hospitals. Identify factors affecting QOL among these patients. Design/methodology/approach - A cross-sectional study measured QOL among early stage female breast cancer (BC) patients and determined the main factors affecting their QOL. Three interviewer administered questionnaires were used. Findings - The physical domain mostly affected in BC patients and the functional domain least. Socio-demographic factors that significantly affected BC patients QOL scores were patient age, education, having children and family income. Specific patient characteristics include caregiver presence - a factor that affected different QOL scores. Age at diagnosis, affection in the side of the predominant hand, post-operative chemotherapy and difficulty in obtaining the medication were the disease-related factors that affected QOL scores. Originality/value - The final model predicting QOL for early stage female BC patients included age, education and difficulty in obtaining the medication as determinants for total QOL score. Carer presence was the specific patient characteristic that affected different QOL scores.

Complementary and alternative medicine for lowering blood lipid levels: A systematic review of systematic reviews.

PubMed

Posadzki, Paul; AlBedah, Abdullah M N; Khalil, Mohamed M K; AlQaed, Meshari S

2016-12-01

The aim of this article is to summarize and critically evaluate the evidence from systematic reviews (SRs) of complementary and alternative medicine (CAM) for lowering blood lipid levels (BLL). Eight electronic databases were searched until March 2016. Additionally, all the retrieved references were inspected manually for further relevant papers. Systematic reviews were considered eligible, if they included patients of any age and/or gender with elevated blood lipid levels using any type of CAM. We used the Oxman and AMSTAR criteria to critically appraise the methodological quality of the included SRs. Twenty-seven SRs were included in the analyses. The majority of the SRs were of high methodological quality (mean Oxman score=4.81, SD=4.88; and the mean AMSTAR score=7.22, SD=3.38). The majority of SRs (56%) arrived at equivocal conclusions (of these 8 were of high quality); 7 SRs (37%) arrived at positive conclusions (of these 6 were of high quality), and 2 (7%) arrived at negative conclusions (both were of high quality). There was conflicting evidence regarding the effectiveness of garlic; and promising evidence for yoga. To conclude, the evidence from SRs evaluating the effectiveness of CAM in lowering BLL is predominantly equivocal and confusing. Several limitations exist, such as variety of doses and preparations, confounding effects of diets and lifestyle factors, or heterogeneity of the primary trials among others. Copyright © 2016. Published by Elsevier Ltd.

Do psychosocial interventions improve rehabilitation outcomes after anterior cruciate ligament reconstruction? A systematic review.

PubMed

Coronado, Rogelio A; Bird, Mackenzie L; Van Hoy, Erin E; Huston, Laura J; Spindler, Kurt P; Archer, Kristin R

2018-03-01

To examine the role of psychosocial interventions in improving patient-reported clinical outcomes, including return to sport/activity, and intermediary psychosocial factors after anterior cruciate ligament reconstruction. MEDLINE/PubMed, CINAHL, PsycINFO, and Web of Science were searched from each database's inception to March 2017 for published studies in patients after anterior cruciate ligament reconstruction. Studies were included if they reported on the effects of a postoperative psychosocial intervention on a patient-reported clinical measure of disability, function, pain, quality of life, return to sport/activity, or intermediary psychosocial factor. Data were extracted using a standardized form and summary effects from each article were compiled. The methodological quality of randomized trials was assessed using the Physiotherapy Evidence Database Scale and scores greater than 5/10 were considered high quality. A total of 893 articles were identified from the literature search. Of these, four randomized trials ( N = 210) met inclusion criteria. The four articles examined guided imagery and relaxation, coping modeling, and visual imagery as postoperative psychosocial interventions. Methodological quality scores of the studies ranged from 5 to 9. There were inconsistent findings for the additive benefit of psychosocial interventions for improving postoperative function, pain, or self-efficacy and limited evidence for improving postoperative quality of life, anxiety, or fear of reinjury. No study examined the effects of psychosocial interventions on return to sport/activity. Overall, there is limited evidence on the efficacy of postoperative psychosocial interventions for improving functional recovery after anterior cruciate ligament reconstruction.

Effect of self-acupressure for symptom management: a systematic review.

PubMed

Song, Hyun Jin; Seo, Hyun-Ju; Lee, Heeyoung; Son, Heejeong; Choi, Sun Mi; Lee, Sanghun

2015-02-01

To assess the efficacy and safety of self-administered acupressure to alleviate symptoms of various health problems, including allergic disease, cancer, respiratory disease, dysmenorrhea, perceived stress, insomnia, and sleep disturbances. We searched core, Korean, Chinese, and Japanese databases, including Ovid-MEDLINE, Ovid-EMBASE, the Cochrane Central Register of Controlled Trials (CENTRAL), the Cumulative Index to Nursing and Allied Health Literature (CINAHL), six representative electronic Korean medical databases, China National Knowledge Infrastructure (CNKI), and Japan Science and Technology Information Aggregator (J-STAGE). We included randomized controlled trials (RCTs) and quasi-RCTs that examined disease-specific effects or symptom relief, adverse reactions, and quality-of-life (QOL) for self-administered acupressure. Data collection and assessment of the methodological quality of the included studies were conducted by two independent reviewers. Eight RCTs and two quasi-RCTs showed positive effects and safety of self-acupressure therapy in clinically diverse populations. Quality assessment revealed moderate quality for the RCTs, with 50% or more of the trials assessed as presenting a low risk of bias in seven domains. All of the selected 10 studies reported positive effects for primary outcomes of self-acupressure therapy for symptom management, including significant improvements in symptom scores in allergic disease, nausea and vomiting in cancer, symptom scores in respiratory disease, pain symptoms in dysmenorrhea, and stress/fatigue scores and sleep disturbances in healthy people. Our findings suggest that self-administered acupressure shows promise to alleviate the symptoms of various health problems. Therefore, further research with larger samples and methodologically well-designed RCTs is required to establish the efficacy of self-administered acupressure. Copyright © 2014 Elsevier Ltd. All rights reserved.

Quality of Life, Perceptions, and Health Satisfaction of Older Adults with End-Stage Renal Disease: A Systematic Review.

PubMed

Balogun, Seki A; Balogun, Rasheed; Philbrick, John; Abdel-Rahman, Emaad

2017-04-01

To explore the quality of life (QOL), perceptions, and health satisfaction of older adults with end-stage renal disease (ESRD) undergoing renal replacement therapy (RRT). Systematic review of literature. Individuals with ESRD undergoing RRT aged 65 and older. Articles identified from PubMed database search from January 1994 to December 2014. The methodological quality of each of the selected articles was assessed using eight standards adapted from well-established research quality review criteria. Of the initial 1,401 articles identified, 23 met the inclusion criteria. The age range of study participants examined was 65 to 90. Seventy-eight percent of the studies met six or more of the methodological standards; 47% found overall health-related and mental component summary QOL scores in elderly adults with ESRD to be similar to or higher than those of age-matched controls or younger individuals, although the physical component summary QOL scores tended to be lower in older adults. Only six studies addressed health satisfaction and perceptions of elderly adults with ESRD, with widely variable findings. Few studies specifically examine QOL in elderly adults with ESRD undergoing RRT and even fewer address issues of perceptions and health satisfaction. However, the limited data from the QOL studies looks promising with a significant proportion showing similar or higher overall health-related and mental component summary QOL scores in elderly adults with ESRD. The very limited data on perceptions and health satisfaction of elderly adults with ESRD undergoing RRT makes it difficult to make any generalizable conclusions. Overall, more research is needed to examine these factors in elderly adults with ESRD. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Health related quality of life in adults after burn injuries: A systematic review

PubMed Central

Legemate, Catherine; Oen, Irma; van Loey, Nancy; Polinder, Suzanne; van Baar, Margriet

2018-01-01

Objectives Measurement of health-related quality of life (HRQL) is essential to qualify the subjective burden of burns in survivors. We performed a systematic review of HRQL studies in adult burn patients to evaluate study design, instruments used, methodological quality, and recovery patterns. Methods A systematic review was performed. Relevant databases were searched from the earliest record until October 2016. Studies examining HRQL in adults after burn injuries were included. Risk of bias was scored using the Quality in Prognostic Studies tool. Results Twenty different HRQL instruments were used among the 94 included studies. The Burn Specific Health Scale–Brief (BSHS-B) (46%), the Short Form–36 (SF-36) (42%) and the EuroQol questionnaire (EQ-5D) (9%) were most often applied. Most domains, both mentally and physically orientated, were affected shortly after burns but improved over time. The lowest scores were reported for the domains ‘work’ and ‘heat sensitivity’ (BSHS-B), ‘bodily pain’, ‘physical role limitations’ (SF-36), and ‘pain/discomfort’ (EQ-5D) in the short-term and for ‘work’ and ‘heat sensitivity’, ‘emotional functioning’ (SF-36), ‘physical functioning’ and ‘pain/discomfort’ in the long-term. Risk of bias was generally low in outcome measurement and high in study attrition. Conclusion Consensus on preferred validated methodologies of HRQL measurement in burn patients would facilitate comparability across studies, resulting in improved insights in recovery patterns and better estimates of HRQL after burns. We recommend to develop a guideline on the measurement of HRQL in burns. Five domains representing a variety of topics had low scores in the long-term and require special attention in the aftermath of burns. PMID:29795616

Developing a set of consensus indicators to support maternity service quality improvement: using Core Outcome Set methodology including a Delphi process.

PubMed

Bunch, K J; Allin, B; Jolly, M; Hardie, T; Knight, M

2018-05-16

To develop a core metric set to monitor the quality of maternity care. Delphi process followed by a face-to-face consensus meeting. English maternity units. Three representative expert panels: service designers, providers and users. Maternity care metrics judged important by participants. Participants were asked to complete a two-phase Delphi process, scoring metrics from existing local maternity dashboards. A consensus meeting discussed the results and re-scored the metrics. In all, 125 distinct metrics across six domains were identified from existing dashboards. Following the consensus meeting, 14 metrics met the inclusion criteria for the final core set: smoking rate at booking; rate of birth without intervention; caesarean section delivery rate in Robson group 1 women; caesarean section delivery rate in Robson group 2 women; caesarean section delivery rate in Robson group 5 women; third- and fourth-degree tear rate among women delivering vaginally; rate of postpartum haemorrhage of ≥1500 ml; rate of successful vaginal birth after a single previous caesarean section; smoking rate at delivery; proportion of babies born at term with an Apgar score <7 at 5 minutes; proportion of babies born at term admitted to the neonatal intensive care unit; proportion of babies readmitted to hospital at <30 days of age; breastfeeding initiation rate; and breastfeeding rate at 6-8 weeks. Core outcome set methodology can be used to incorporate the views of key stakeholders in developing a core metric set to monitor the quality of care in maternity units, thus enabling improvement. Achieving consensus on core metrics for monitoring the quality of maternity care. © 2018 The Authors. BJOG: An International Journal of Obstetrics and Gynaecology published by John Wiley & Sons Ltd on behalf of Royal College of Obstetricians and Gynaecologists.

The landscape of systematic reviews in urology (1998 to 2015): an assessment of methodological quality.

PubMed

Han, Julia L; Gandhi, Shreyas; Bockoven, Crystal G; Narayan, Vikram M; Dahm, Philipp

2017-04-01

To assess the quality of published systematic reviews in the urology literature (an extension of our previously reported work), as high-quality systematic reviews play a paramount role in informing evidence-based clinical practice. Our focus was on systematic reviews in the urology literature that incorporated questions of prevention and therapy. To identify such reviews published during a 36-month period (2013-2015), we systematically searched PubMed and hand-searched the table of contents of four major urology journals. Two reviewers independently assessed the methodological quality of those reviews, using the 11-point 'Assessment of Multiple Systematic Reviews' (AMSTAR) instrument. We performed protocol-driven analyses of the data from our present study's 36-month period alone, as well as in aggregate with the data from our previously reported work's study periods (2009-2012 and 1998-2008). In our literature search of the 36-month period (2013-2015), we initially identified 490 possibly relevant reviews, of which 125 met our inclusion criteria. The most common topic of reviews for the 2013-2015 period was oncology (51.2%; n = 64), followed by voiding dysfunction (21.6%; n = 27). The mean [standard deviation (SD)] AMSTAR score in the 2013-2015 period (n = 125) was 4.8 (2.4); 2009-2012 (n = 113), 5.4 (2.3); and 1998-2008 (n = 57), 4.8 (2.0) (P = 0.127). In the 2013-2015 period, the mean (SD) AMSTAR score for the BJU International (n = 25) was 5.6 (2.9); for The Journal of Urology (n = 20), 5.1 (2.6); for European Urology (n = 60), 4.5 (2.2); and for Urology (n = 20), 4.4 (2.2) (P = 0.106). The number of systematic reviews published in the urology literature has exponentially increased, year by year, but their methodological quality has stagnated. To enhance the validity and impact of systematic reviews, all authors and editors must apply established methodological standards. © 2016 The Authors BJU International © 2016 BJU International Published by John Wiley & Sons Ltd.

Expert panels as a reference standard in orthodontic research: An assessment of published methods and reporting.

PubMed

Lempesi, Evangelia; Toulia, Electra; Pandis, Nikolaos

2017-04-01

The aim of this study was to investigate the expert panel methodology applied in orthodontics and its reporting quality. Additionally, the relationship between the reporting quality and a range of variables was explored. PubMed was searched for orthodontic studies in which the final diagnosis or assessment was made by 2 or more experts published up to March 16, 2015. Reporting quality assessment was conducted using an established modified checklist. The relationship between potential predictors and the total score was assessed using univariable linear regression. We identified 237 studies with a mean score of 9.97 (SD, 1.12) out of a maximum of 15. Critical information about panel methodology was missing in all studies. The panel composition differed substantially across studies, ranging from 2 to 646 panel members, with large variations in the expertise represented. Only 17 studies (7.2%) reported sample size calculations to justify the panel size. Panel members were partly blinded in 65 (27.4%) studies. Most studies failed to report which statistic was used to compute intrarater (65.8%) and interrater (66.2%) agreements. Journal type (nonorthodontic: β, 0.23; 95% CI, -0.07 to 0.54 compared with orthodontic), publication year (β, 0; 95% CI, -0.02 to 0.02 for each additional year), number of authors (1-3: β, 0.30; 95% CI, -0.13 to 0.74 compared with at least 6; 4-5: β, 0.18; 95% CI, -0.29 to 0.33 compared with at least 6), and number of centers involved (single: β, 0.20; 95% CI, -0.14 to 0.54 compared with multicenter) were not significant predictors of improved reporting. Studies published in Asia and Australia had significantly lower scores compared with those published in Europe (β, -0.54; 95% CI, -0.92 to -0.17). Formal guidelines on methodology and reporting of studies involving expert panels are required. Copyright © 2016 American Association of Orthodontists. Published by Elsevier Inc. All rights reserved.

[Evaluation of quality of service in Early Intervention: A systematic review].

PubMed

Jemes Campaña, Inmaculada Concepción; Romero-Galisteo, Rita Pilar; Labajos Manzanares, María Teresa; Moreno Morales, Noelia

2018-06-07

Early Intervention (EI), as a paediatric service, has the duty of quantifying the results and the quality of its services provided. The accessibility of valid and reliable tools allows professionals to evaluate the quality of these services. The aim of this study is to review the scientific literature on tools used to measure the methodological and service quality in EI. A search was made in different databases: Medline (from PubMed), Web of Science, PsycINFO, Cochrane, Scopus, ERIC and Scielo. The methodological quality of the studies was tested using the COSMIN scale. A total of 13 manuscripts met the criteria to be included in this review. Ten of them received a "good" or "reasonable" score based on the COSMIN scale. Despite its importance, there is no consensus among authors on the measurement of service quality in EI. It is often the family of the children attended in EI that are considered the target to study, although the opinion of professionals carries more weight and completes the information. Copyright © 2018. Publicado por Elsevier España, S.L.U.

Chinese herbal medicine for the treatment of primary hypertension: a methodology overview of systematic reviews.

PubMed

Xinke, Zhao; Yingdong, Li; Mingxia, Feng; Kai, Liu; Kaibing, Chen; Yuqing, Lu; Shaobo, Sun; Peng, Song; Bin, Liu

2016-10-20

Chinese herbal medicine has been used to treat hypertension in China and East Asia since centuries. In this study, we conduct an overview of systematic reviews of Chinese herbal medicine in the treatment of primary hypertension to 1) summarize the conclusions of these reviews, 2) evaluate the methodological quality of these reviews, and 3) rate the confidence in the effect on each outcome. We comprehensively searched six databases to retrieve systematic reviews of Chinese herbal medicine for primary hypertension from inception to December 31, 2015. We used AMSTAR to evaluate the methodological quality of included reviews, and we classified the quality of evidence for each outcome in included reviews using the GRADE approach. A total of 12 systematic reviews with 31 outcomes were included, among which 11 systematic reviews focus on the therapeutic effect of Chinese herbal medicine combined with conventional medicine or simple Chinese herbal medicine versus simple conventional medicine. Among the 11 items of AMSTAR, the lowest quality was "providing a priori design" item, none review conformed to this item, the next was "stating the conflict of interest" item, only three reviews conformed to this item. Five reviews scored less than seven in AMSTAR, which means that the overall methodological quality was fairly poor. For GRADE, of the 31 outcomes, the quality of evidence was high in none (0 %), moderate in three (10 %), low in 19 (61 %), and very low in nine (29 %). Of the five downgrading factors, risk of bias (100 %) was the most common downgrading factor in the included reviews, followed by imprecision (42 %), inconsistency (39 %), publication bias (39 %), and indirectness (0 %). The methodological quality of systematic reviews about Chinese herbal medicine for primary hypertension is fairly poor, and the quality of evidence level is low. Physicians should be cautious when applying the interventions in these reviews for primary hypertension patients in clinical practice.

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Clinical trials of homoeopathy.

PubMed Central

Kleijnen, J; Knipschild, P; ter Riet, G

1991-01-01

OBJECTIVE--To establish whether there is evidence of the efficacy of homoeopathy from controlled trials in humans. DESIGN--Criteria based meta-analysis. Assessment of the methodological quality of 107 controlled trials in 96 published reports found after an extensive search. Trials were scored using a list of predefined criteria of good methodology, and the outcome of the trials was interpreted in relation to their quality. SETTING--Controlled trials published world wide. MAIN OUTCOME MEASURES--Results of the trials with the best methodological quality. Trials of classical homoeopathy and several modern varieties were considered separately. RESULTS--In 14 trials some form of classical homoeopathy was tested and in 58 trials the same single homoeopathic treatment was given to patients with comparable conventional diagnosis. Combinations of several homoeopathic treatments were tested in 26 trials; isopathy was tested in nine trials. Most trials seemed to be of very low quality, but there were many exceptions. The results showed a positive trend regardless of the quality of the trial or the variety of homeopathy used. Overall, of the 105 trials with interpretable results, 81 trials indicated positive results whereas in 24 trials no positive effects of homoeopathy were found. The results of the review may be complicated by publication bias, especially in such a controversial subject as homoeopathy. CONCLUSIONS--At the moment the evidence of clinical trials is positive but not sufficient to draw definitive conclusions because most trials are of low methodological quality and because of the unknown role of publication bias. This indicates that there is a legitimate case for further evaluation of homoeopathy, but only by means of well performed trials. PMID:1825800

Efficacy of exercise therapy in workers with rotator cuff tendinopathy: a systematic review

PubMed Central

Desmeules, François; Boudreault, Jennifer; Dionne, Clermont E.; Frémont, Pierre; Lowry, Véronique; MacDermid, Joy C.; Roy, Jean-Sébastien

2016-01-01

Objective: To perform a systematic review of randomized controlled trials (RCTs) on the efficacy of therapeutic exercises for workers suffering from rotator cuff (RC) tendinopathy. Methods: A literature search in four bibliographical databases (Pubmed, CINAHL, EMBASE, and PEDro) was conducted from inception up to February 2015. RCTs were included if participants were workers suffering from RC tendinopathy, the outcome measures included work-related outcomes, and at least one of the interventions under study included exercises. The methodological quality of the studies was evaluated with the Cochrane Risk of Bias Assessment tool. Results: The mean methodological score of the ten included studies was 54.4%±17.2%. Types of workers included were often not defined, and work-related outcome measures were heterogeneous and often not validated. Three RCTs of moderate methodological quality concluded that exercises were superior to a placebo or no intervention in terms of function and return-to-work outcomes. No significant difference was found between surgery and exercises based on the results of two studies of low to moderate methodological quality. One study of low methodological quality, comparing a workplace-based exercise program focusing on the participants' work demands to an exercise program delivered in a clinical setting, concluded that the work-based intervention was superior in terms of function and return-to-work outcomes. Conclusion: There is low to moderate-grade evidence that therapeutic exercises provided in a clinical setting are an effective modality to treat workers suffering from RC tendinopathy and to promote return-to-work. Further high quality studies comparing different rehabilitation programs including exercises in different settings with defined workers populations are needed to draw firm conclusions on the optimal program to treat workers. PMID:27488037

Psychometric evaluation of commonly used game-specific skills tests in rugby: A systematic review

PubMed Central

Oorschot, Sander; Chiwaridzo, Matthew; CM Smits-Engelsman, Bouwien

2017-01-01

Objectives To (1) give an overview of commonly used game-specific skills tests in rugby and (2) evaluate available psychometric information of these tests. Methods The databases PubMed, MEDLINE CINAHL and Africa Wide information were systematically searched for articles published between January 1995 and March 2017. First, commonly used game-specific skills tests were identified. Second, the available psychometrics of these tests were evaluated and the methodological quality of the studies assessed using the Consensus-based Standards for the selection of health Measurement Instruments checklist. Studies included in the first step had to report detailed information on the construct and testing procedure of at least one game-specific skill, and studies included in the second step had additionally to report at least one psychometric property evaluating reliability, validity or responsiveness. Results 287 articles were identified in the first step, of which 30 articles met the inclusion criteria and 64 articles were identified in the second step of which 10 articles were included. Reactive agility, tackling and simulated rugby games were the most commonly used tests. All 10 studies reporting psychometrics reported reliability outcomes, revealing mainly strong evidence. However, all studies scored poor or fair on methodological quality. Four studies reported validity outcomes in which mainly moderate evidence was indicated, but all articles had fair methodological quality. Conclusion Game-specific skills tests indicated mainly high reliability and validity evidence, but the studies lacked methodological quality. Reactive agility seems to be a promising domain, but the specific tests need further development. Future high methodological quality studies are required in order to develop valid and reliable test batteries for rugby talent identification. Trial registration number PROSPERO CRD42015029747. PMID:29259812

Systematic review of the methodological quality of clinical guideline development for the management of chronic disease in Europe.

PubMed

Knai, Cécile; Brusamento, Serena; Legido-Quigley, Helena; Saliba, Vanessa; Panteli, Dimitra; Turk, Eva; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

The use of evidence-based clinical guidelines is an essential component of chronic disease management. However, there is well-documented concern about variability in the quality of clinical guidelines, with evidence of persisting methodological shortcomings. The most widely accepted approach to assessing the quality of guidelines is the Appraisal of Guidelines for Research and Evaluation (AGREE) instrument. We have conducted a systematic review of the methodological quality (as assessed by AGREE) of clinical guidelines developed in Europe for the management of chronic diseases published since 2000. The systematic review was undertaken in accordance with the Cochrane methodology. The inclusion criteria were that studies should have appraised European clinical guidelines for certain selected chronic disorders using the AGREE instrument. We searched five databases (Cab Abstracts, EMBASE, MEDLINE, Trip and EPPI). Nine studies reported in 10 papers, analysing a total of 28 European guidelines from eight countries as well as pan-European, were included. There was considerable variation in the quality of clinical guidelines across the AGREE domains. The least well addressed domains were 'editorial independence' (with a mean domain score of 41%), 'applicability' (44%), 'stakeholder involvement' (55%), and 'rigour of development' (64%), while 'clarity of presentation' (80%) and 'scope and purpose' (84%) were less problematic. This review indicates that there is considerable scope for improvement in the methods used to develop clinical guidelines for the prevention, management and treatment of chronic diseases in Europe. Given the importance of decision support strategies such as clinical guidelines in chronic disease management, improvement measures should include the explicit and transparent involvement of key stakeholders (especially scientific experts, guideline users and methodological specialists) and consideration of the implications for guideline implementation and applicability early on in the process. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Efficacy of exercise therapy in workers with rotator cuff tendinopathy: a systematic review.

PubMed

Desmeules, François; Boudreault, Jennifer; Dionne, Clermont E; Frémont, Pierre; Lowry, Véronique; MacDermid, Joy C; Roy, Jean-Sébastien

2016-09-30

To perform a systematic review of randomized controlled trials (RCTs) on the efficacy of therapeutic exercises for workers suffering from rotator cuff (RC) tendinopathy. A literature search in four bibliographical databases (Pubmed, CINAHL, EMBASE, and PEDro) was conducted from inception up to February 2015. RCTs were included if participants were workers suffering from RC tendinopathy, the outcome measures included work-related outcomes, and at least one of the interventions under study included exercises. The methodological quality of the studies was evaluated with the Cochrane Risk of Bias Assessment tool. The mean methodological score of the ten included studies was 54.4%±17.2%. Types of workers included were often not defined, and work-related outcome measures were heterogeneous and often not validated. Three RCTs of moderate methodological quality concluded that exercises were superior to a placebo or no intervention in terms of function and return-to-work outcomes. No significant difference was found between surgery and exercises based on the results of two studies of low to moderate methodological quality. One study of low methodological quality, comparing a workplace-based exercise program focusing on the participants' work demands to an exercise program delivered in a clinical setting, concluded that the work-based intervention was superior in terms of function and return-to-work outcomes. There is low to moderate-grade evidence that therapeutic exercises provided in a clinical setting are an effective modality to treat workers suffering from RC tendinopathy and to promote return-to-work. Further high quality studies comparing different rehabilitation programs including exercises in different settings with defined workers populations are needed to draw firm conclusions on the optimal program to treat workers.

Investigating the association between medication adherence and health-related quality of life in COPD: Methodological challenges when using a proxy measure of adherence.

PubMed

Boland, Melinde R S; van Boven, Job F M; Kruis, Annemarije L; Chavannes, Niels H; van der Molen, Thys; Goossens, Lucas M A; Rutten-van Mölken, Maureen P M H

2016-01-01

The association between non-adherence to medication and health-related quality-of-life (HRQoL) in Chronic Obstructive Pulmonary Disease (COPD) remains poorly understood. Different ways to deal with methodological challenges to estimate this association have probably contributed to conflicting results. To investigate the association between medication adherence and HRQoL, thereby illustrating methodological challenges that need to be addressed. We used longitudinal patient-level data from a cluster-randomized controlled trial (i.e. RECODE) including three-year data on type and dose of COPD maintenance medication prescribed and HRQoL (Clinical COPD Questionnaire [CCQ], st. George Respiratory Questionnaire [SGRQ], EuroQol 5-dimensions [EQ-5D]) of 511 patients. A linear mixed model was used to assess the association between adherence and HRQoL using a fixed cut-off of 80% of the proportion of days covered (PDC) to define adherence. Subsequently, we investigated the impact of differences in disease severity; lifestyle; and reversed causality, representing the methodological challenges. Additionally, we investigated the impact of changing the definition of adherence. In unadjusted analyses, and analyses adjusting for demographic characteristics only, SGRQ score was worse in the adherent compared to the non-adherent group. This association disappeared when correcting for disease severity and/or lifestyle. A better SGRQ score was predictive of decreased adherence in the following year. However, accounting for the previous HRQoL did not result in positive associations between adherence and HRQoL. When defining four categories of adherence, patients with a PDC between 80 and 99% had a significantly worse SGRQ score compared to patients with a PDC <60%, even after correction for lifestyle. There was no significant association between adherence and CCQ or EQ-5D. This study showed persistent methodological challenges in the investigation of the effect of medication adherence on HRQoL in COPD. A positive association of adherence and HRQoL was not found, even after adjusting for lifestyle, disease severity, and previous HRQoL. Copyright © 2015. Published by Elsevier Ltd.

ACL reconstruction in patients aged 40 years and older: a systematic review and introduction of a new methodology score for ACL studies.

PubMed

Brown, Christopher A; McAdams, Timothy R; Harris, Alex H S; Maffulli, Nicola; Safran, Marc R

2013-09-01

Treatment of the anterior cruciate ligament (ACL)-deficient knee in older patients remains a core debate. To perform a systematic review of studies that assessed outcomes in patients aged 40 years and older treated with ACL reconstruction and to provide a new methodological scoring system that is directed at critical assessment of studies evaluating ACL surgical outcomes: the ACL Methodology Score (AMS). Systematic review. A comprehensive literature search was performed from 1995 to 2012 using MEDLINE, EMBASE, and Scopus. Inclusion criteria for studies were primary ACL injury, patient age of 40 years and older, and mean follow-up of at least 21 months after reconstruction. Nineteen studies met the inclusion criteria from the 371 abstracts from MEDLINE and 880 abstracts from Scopus. Clinical outcomes (International Knee Documentation Committee [IKDC], Lysholm, and Tegner activity scores), joint stability measures (Lachman test, pivot-shift test, and instrumented knee arthrometer assessment), graft type, complications, and reported chondral or meniscal injury were evaluated in this review. A new methodology scoring system was developed to be specific at critically analyzing ACL outcome studies and used to examine each study design. Nineteen studies describing 627 patients (632 knees; mean age, 49.0 years; range, 42.6-60.0 years) were included in the review. The mean time to surgery was 32.0 months (range, 2.9-88.0 months), with a mean follow-up of 40.2 months (range, 21.0-114.0 months). The IKDC, Lysholm, and Tegner scores and knee laxity assessment indicated favorable results in the studies that reported these outcomes. Patients did not demonstrate a significant difference between graft types and functional outcome scores or stability assessment. The mean AMS was 43.9 ± 7.2 (range, 33.5-57.5). The level of evidence rating did not positively correlate with the AMS, which suggests that the new AMS system may be able to detect errors in methodology or reporting that may not be taken into account by the classic level of evidence rating. Patients aged 40 years and older with an ACL injury can have satisfactory outcomes after reconstruction. However, the quality of currently available data is still limited, such that further well-designed studies are needed to determine long-term efficacy and to better inform our patients with regard to expected outcomes.

The role of platelet-rich plasma in arthroscopic rotator cuff repair: a systematic review with quantitative synthesis.

PubMed

Chahal, Jaskarndip; Van Thiel, Geoffrey S; Mall, Nathan; Heard, Wendell; Bach, Bernard R; Cole, Brian J; Nicholson, Gregory P; Verma, Nikhil N; Whelan, Daniel B; Romeo, Anthony A

2012-11-01

Despite the theoretic basis and interest in using platelet-rich plasma (PRP) to improve the potential for rotator cuff healing, there remains ongoing controversy regarding its clinical efficacy. The objective of this systematic review was to identify and summarize the available evidence to compare the efficacy of arthroscopic rotator cuff repair in patients with full-thickness rotator cuff tears who were concomitantly treated with PRP. We searched the Cochrane Central Register of Controlled Trials, Medline, Embase, and PubMed for eligible studies. Two reviewers selected studies for inclusion, assessed methodologic quality, and extracted data. Pooled analyses were performed using a random effects model to arrive at summary estimates of treatment effect with associated 95% confidence intervals. Five studies (2 randomized and 3 nonrandomized with comparative control groups) met the inclusion criteria, with a total of 261 patients. Methodologic quality was uniformly sound as assessed by the Detsky scale and Newcastle-Ottawa Scale. Quantitative synthesis of all 5 studies showed that there was no statistically significant difference in the overall rate of rotator cuff retear between patients treated with PRP and those treated without PRP (risk ratio, 0.77; 95% confidence interval, 0.48 to 1.23). There were also no differences in the pooled Constant score; Simple Shoulder Test score; American Shoulder and Elbow Surgeons score; University of California, Los Angeles shoulder score; or Single Assessment Numeric Evaluation score. PRP does not have an effect on overall retear rates or shoulder-specific outcomes after arthroscopic rotator cuff repair. Additional well-designed randomized trials are needed to corroborate these findings. Level III, systematic review of Level I, II, and III studies. Copyright © 2012 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Quality assessment of systematic reviews on alveolar socket preservation.

PubMed

Moraschini, V; Barboza, E Dos S P

2016-09-01

The aim of this overview was to evaluate and compare the quality of systematic reviews, with or without meta-analysis, that have evaluated studies on techniques or biomaterials used for the preservation of alveolar sockets post tooth extraction in humans. An electronic search was conducted without date restrictions using the Medline/PubMed, Cochrane Library, and Web of Science databases up to April 2015. Eligibility criteria included systematic reviews, with or without meta-analysis, focused on the preservation of post-extraction alveolar sockets in humans. Two independent authors assessed the quality of the included reviews using AMSTAR and the checklist proposed by Glenny et al. in 2003. After the selection process, 12 systematic reviews were included. None of these reviews obtained the maximum score using the quality assessment tools implemented, and the results of the analyses were highly variable. A significant statistical correlation was observed between the scores of the two checklists. A wide structural and methodological variability was observed between the systematic reviews published on the preservation of alveolar sockets post tooth extraction. None of the reviews evaluated obtained the maximum score using the two quality assessment tools implemented. Copyright © 2016 International Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Radiofrequency energy in the arthroscopic treatment of knee chondral lesions: a systematic review.

PubMed

Rocco, Papalia; Lorenzo, Diaz Balzani; Guglielmo, Torre; Michele, Paciotti; Nicola, Maffulli; Vincenzo, Denaro

2016-03-01

Cartilage debridement is one of the recommended procedures for the management of chondral defects. Radiofrequency probes allow to debride the cartilage, but may induce subchondral bone necrosis. Medline, Cochrane and Google Scholar were searched to identify studies on arthroscopic debridement of the articular cartilage of the knee using radiofrequency chondroplasty. The methodological quality of the studies was assessed using the Coleman methodology score (CMS). Monopolar and bipolar radiofrequency devices provide significantly better clinical outcomes, especially for patients with high-grade chondral lesions, compared with mechanical shaver only. Despite the original concerns regarding subchondral bone necrosis, low complication rates are reported. Heterogeneity in terms of type of device does not allow sound comparison of the published results. There is lack of evidence on the long-term effects of radiofrequency chondroplasty. Study methodology should be improved: the average Coleman methodology score was 56.2 out of 100. More comparative, well-designed and larger cohort trials are needed to ascertain whether radiofrequency chondroplasty offers long-term benefits over other simpler and more economical alternatives. © The Author 2016. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Proposal for a novel methodology to screen and score cost versus survival for anticancer drugs in metastatic disease: could cost weigh in evaluation?

PubMed

Guirgis, Helmy M

2012-07-01

Rising costs of anticancer drugs prompt concerns about their approval, use, and affordability. A methodology was developed to evaluate cost versus survival for anticancer drugs in metastatic breast cancer and non-small-cell lung cancer (NSCLC). Costs of evaluated drugs were calculated by using average wholesale prices in US dollars. Ratios of cost to day of survival (cost/survival/d) were obtained by dividing costs of the entire treatment by reported median survival gain in days. A crude score of 100% was assigned to a cost/survival/d of less than $25, and 0% to a cost/survival/d of more than $750. A strategy was designed to correct for overall survival (OS) versus progression-free survival (PFS), adverse effects, and quality of life. In breast cancer, PFS scores of bevacizumab varied between 0% and 60%. In NSCLC, OS scores of bevacizumab improved from 0% to 50%, as a result of histology, lower prices, and extended therapy. Gefitinib and erlotinib PFS scores were 80% and 70%, respectively. Correction for longer survival with erlotinib resulted in similar scores. In maintenance therapy, the OS score for pemetrexed was 70% as compared with 25% for erlotinib. Generic drugs scored 70% to 90%. Cost/survival varied with the number of cycles. In breast cancer, bevacizumab scores failed to justify its use. In NSCLC, 10 cycles of bevacizumab scored 0%. Scores improved with extended treatment and lower prices. Scores for gefitinib and erlotinib would support their approval. Erlotinib was preferred because of longer PFS. Results tended to endorse maintenance pemetrexed but not erlotinib. Generic drugs demonstrated high scores. Cost/survival could weigh in drug evaluation.

Providing Doctors With High-Quality Information: An Updated Evaluation of Web-Based Point-of-Care Information Summaries

PubMed Central

Kwag, Koren Hyogene; González-Lorenzo, Marien; Banzi, Rita; Bonovas, Stefanos

2016-01-01

Background The complexity of modern practice requires health professionals to be active information-seekers. Objective Our aim was to review the quality and progress of point-of-care information summaries—Web-based medical compendia that are specifically designed to deliver pre-digested, rapidly accessible, comprehensive, and periodically updated information to health care providers. We aimed to evaluate product claims of being evidence-based. Methods We updated our previous evaluations by searching Medline, Google, librarian association websites, and conference proceedings from August 2012 to December 2014. We included Web-based, regularly updated point-of-care information summaries with claims of being evidence-based. We extracted data on the general characteristics and content presentation of products, and we quantitatively assessed their breadth of disease coverage, editorial quality, and evidence-based methodology. We assessed potential relationships between these dimensions and compared them with our 2008 assessment. Results We screened 58 products; 26 met our inclusion criteria. Nearly a quarter (6/26, 23%) were newly identified in 2014. We accessed and analyzed 23 products for content presentation and quantitative dimensions. Most summaries were developed by major publishers in the United States and the United Kingdom; no products derived from low- and middle-income countries. The main target audience remained physicians, although nurses and physiotherapists were increasingly represented. Best Practice, Dynamed, and UptoDate scored the highest across all dimensions. The majority of products did not excel across all dimensions: we found only a moderate positive correlation between editorial quality and evidence-based methodology (r=.41, P=.0496). However, all dimensions improved from 2008: editorial quality (P=.01), evidence-based methodology (P=.015), and volume of diseases and medical conditions (P<.001). Conclusions Medical and scientific publishers are investing substantial resources towards the development and maintenance of point-of-care summaries. The number of these products has increased since 2008 along with their quality. Best Practice, Dynamed, and UptoDate scored the highest across all dimensions, while others that were marketed as evidence-based were less reliable. Individuals and institutions should regularly assess the value of point-of-care summaries as their quality changes rapidly over time. PMID:26786976

Providing Doctors With High-Quality Information: An Updated Evaluation of Web-Based Point-of-Care Information Summaries.

PubMed

Kwag, Koren Hyogene; González-Lorenzo, Marien; Banzi, Rita; Bonovas, Stefanos; Moja, Lorenzo

2016-01-19

The complexity of modern practice requires health professionals to be active information-seekers. Our aim was to review the quality and progress of point-of-care information summaries-Web-based medical compendia that are specifically designed to deliver pre-digested, rapidly accessible, comprehensive, and periodically updated information to health care providers. We aimed to evaluate product claims of being evidence-based. We updated our previous evaluations by searching Medline, Google, librarian association websites, and conference proceedings from August 2012 to December 2014. We included Web-based, regularly updated point-of-care information summaries with claims of being evidence-based. We extracted data on the general characteristics and content presentation of products, and we quantitatively assessed their breadth of disease coverage, editorial quality, and evidence-based methodology. We assessed potential relationships between these dimensions and compared them with our 2008 assessment. We screened 58 products; 26 met our inclusion criteria. Nearly a quarter (6/26, 23%) were newly identified in 2014. We accessed and analyzed 23 products for content presentation and quantitative dimensions. Most summaries were developed by major publishers in the United States and the United Kingdom; no products derived from low- and middle-income countries. The main target audience remained physicians, although nurses and physiotherapists were increasingly represented. Best Practice, Dynamed, and UptoDate scored the highest across all dimensions. The majority of products did not excel across all dimensions: we found only a moderate positive correlation between editorial quality and evidence-based methodology (r=.41, P=.0496). However, all dimensions improved from 2008: editorial quality (P=.01), evidence-based methodology (P=.015), and volume of diseases and medical conditions (P<.001). Medical and scientific publishers are investing substantial resources towards the development and maintenance of point-of-care summaries. The number of these products has increased since 2008 along with their quality. Best Practice, Dynamed, and UptoDate scored the highest across all dimensions, while others that were marketed as evidence-based were less reliable. Individuals and institutions should regularly assess the value of point-of-care summaries as their quality changes rapidly over time.

Does pelvic floor muscle training improve female sexual function? A systematic review.

PubMed

Ferreira, Cristine Homsi Jorge; Dwyer, Peter L; Davidson, Melissa; De Souza, Alison; Ugarte, Julio Alvarez; Frawley, Helena C

2015-12-01

We performed a review of the literature reporting on the effects of pelvic floor muscle training (PFMT) on female sexual function (SF). Pubmed (from 1946 to December 2014), Ovid Medline (from 1946 to December 2014), CINAHL (from 1937 to December 2014), PsycINFO (from 1805 to December 2014), Scopus and Cochrane Central Register of Controlled Trials were searched by two independent reviewers. Randomised controlled trials (RCTs) investigating the impact of PFMT on women's SF published in English were included. Methodological quality was scored using the PEDro scale. Data were analysed qualitatively and interpreted. A total of 1341 women were included in the eight RCTs covered by this review. The studies were published between 1997 and 2014. Methodological scores were between 4 and 7. The sample included derived from heterogeneous populations of women. In only one study was SF the primary outcome measure. Pelvic floor dysfunction was an inclusion criterion in the majority of studies. Most studies reported a significant improvement in SF score after PFMT between control and intervention groups. Although most studies indicated an improvement of at least one sexual variable in women with pelvic floor dysfunction, and one study demonstrated an improvement in SF in postpartum women selected independently of their continence status, the results need to be interpreted with caution. High-quality RCTs specifically designed to investigate the impact of PFMT on women's SF are required.

Exploring Applications of Radiomics in Magnetic Resonance Imaging of Head and Neck Cancer: A Systematic Review.

PubMed

Jethanandani, Amit; Lin, Timothy A; Volpe, Stefania; Elhalawani, Hesham; Mohamed, Abdallah S R; Yang, Pei; Fuller, Clifton D

2018-01-01

Radiomics has been widely investigated for non-invasive acquisition of quantitative textural information from anatomic structures. While the vast majority of radiomic analysis is performed on images obtained from computed tomography, magnetic resonance imaging (MRI)-based radiomics has generated increased attention. In head and neck cancer (HNC), however, attempts to perform consistent investigations are sparse, and it is unclear whether the resulting textural features can be reproduced. To address this unmet need, we systematically reviewed the quality of existing MRI radiomics research in HNC. Literature search was conducted in accordance with guidelines established by Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Electronic databases were examined from January 1990 through November 2017 for common radiomic keywords. Eligible completed studies were then scored using a standardized checklist that we developed from Enhancing the Quality and Transparency of Health Research guidelines for reporting machine-learning predictive model specifications and results in biomedical research, defined by Luo et al. (1). Descriptive statistics of checklist scores were populated, and a subgroup analysis of methodology items alone was conducted in comparison to overall scores. Sixteen completed studies and four ongoing trials were selected for inclusion. Of the completed studies, the nasopharynx was the most common site of study (37.5%). MRI modalities varied with only four of the completed studies (25%) extracting radiomic features from a single sequence. Study sample sizes ranged between 13 and 118 patients (median of 40), and final radiomic signatures ranged from 2 to 279 features. Analyzed endpoints included either segmentation or histopathological classification parameters (44%) or prognostic and predictive biomarkers (56%). Liu et al. (2) addressed the highest number of our checklist items (total score: 48), and a subgroup analysis of methodology checklist items alone did not demonstrate any difference in scoring trends between studies [Spearman's ρ = 0.94 ( p  < 0.0001)]. Although MRI radiomic applications demonstrate predictive potential in analyzing diverse HNC outcomes, methodological variances preclude accurate and collective interpretation of data.

OPTIGOV - A new methodology for evaluating Clinical Governance implementation by health providers

PubMed Central

2010-01-01

Background The aim of Clinical Governance (CG) is to the pursuit of quality in health care through the integration of all the activities impacting on the patient into a single strategy. OPTIGOV (Optimizing Health Care Governance) is a methodology for the assessment of the level of implementation of CG within healthcare organizations. The aim of this paper is to explain the process underlying the development of OPTIGOV, and describe its characteristics and steps. Methods OPTIGOV was developed in 2006 by the Institute of Hygiene of the Catholic University of the Sacred Heart and Eurogroup Consulting Alliance. The main steps of the process were: choice of areas for analysis and questionnaire development, based on a review of scientific literature; assignment of scores and weights to individual questions and areas; implementation of a software interfaceable with Microsoft Office. Results OPTIGOV consists of: a) a hospital audit with a structured approach; b) development of an improvement operational plan. A questionnaire divided into 13 areas of analysis is used. For each area there is a form with a variable number of questions and "closed" answers. A score is assigned to each answer, area of analysis, healthcare department and unit. The single scores can be gathered for the organization as a whole. The software application allows for collation of data, calculation of scores and development of benchmarks to allow comparisons between healthcare organizations. Implementation consists of three stages: the preparation phase includes a kick off meeting, selection of interviewees and development of a survey plan. The registration phase includes hospital audits, reviewing of hospital documentation, data collection and score processing. Lastly, results are processed, inserted into a final report, and discussed in a meeting with the Hospital Board and in a final workshop. Conclusions The OPTIGOV methodology for the evaluation of CG implementation was developed with an evidence-based approach. The ongoing adoption of OPTIGOV in several projects will put to the test its potential to realistically represent the organization status, pinpoint criticalities and transferable best practices, provide a plan for improvement, and contribute to triggering changes and pursuit of quality in health care. PMID:20565967

Potential impact of the digestible indispensable amino acid score as a measure of protein quality on dietary regulations and health

PubMed Central

Marinangeli, Christopher P F; House, James D

2017-01-01

Abstract Regulatory frameworks for protein content claims in Canada and the United States are underpinned by the protein efficiency ratio and protein digestibility-corrected amino acid score (PDCAAS), respectively, which are used to assess the protein quality of a given food. The digestible indispensable amino acid score (DIAAS) is a novel approach to measuring the protein quality of foods and is supported by the Food and Agriculture Organization of the United Nations. Methodological concerns about the PDCAAS are addressed by the DIAAS through introduction of the use of ileal amino acid digestibility coefficients and untruncated protein scores. However, before the DIAAS is widely adopted within regulatory frameworks, a comprehensive assessment is required. Accordingly, this review addresses the potential impact of the DIAAS on regulation, communication, and public health, as well as knowledge gaps, analytical challenges, and cost of implementation. A pragmatic approach to addressing protein quality is advocated by suggesting the use of conservative coefficients of digestibility that are derived from in vitro methods. Before adopting the DIAAS as a framework for supporting protein content claims, updated food-related regulations and policies should also be evaluated through a lens that anticipates the impact on consumer-facing nutrition communication, the adoption of dietary patterns that are nutritionally adequate, and a food value chain that fosters a spirit of food and nutritional innovation. PMID:28969364

Methodological and Reporting Quality of Systematic Reviews and Meta-analyses in Endodontics.

PubMed

Nagendrababu, Venkateshbabu; Pulikkotil, Shaju Jacob; Sultan, Omer Sheriff; Jayaraman, Jayakumar; Peters, Ove A

2018-06-01

The aim of this systematic review (SR) was to evaluate the quality of SRs and meta-analyses (MAs) in endodontics. A comprehensive literature search was conducted to identify relevant articles in the electronic databases from January 2000 to June 2017. Two reviewers independently assessed the articles for eligibility and data extraction. SRs and MAs on interventional studies with a minimum of 2 therapeutic strategies in endodontics were included in this SR. Methodologic and reporting quality were assessed using A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA), respectively. The interobserver reliability was calculated using the Cohen kappa statistic. Statistical analysis with the level of significance at P < .05 was performed using Kruskal-Wallis tests and simple linear regression analysis. A total of 30 articles were selected for the current SR. Using AMSTAR, the item related to the scientific quality of studies used in conclusion was adhered by less than 40% of studies. Using PRISMA, 3 items were reported by less than 40% of studies, which were on objectives, protocol registration, and funding. No association was evident comparing the number of authors and country with quality. Statistical significance was observed when quality was compared among journals, with studies published as Cochrane reviews superior to those published in other journals. AMSTAR and PRISMA scores were significantly related. SRs in endodontics showed variability in both methodologic and reporting quality. Copyright © 2018 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Longitudinal analysis of reporting and quality of systematic reviews in high-impact surgical journals.

PubMed

Chapman, S J; Drake, T M; Bolton, W S; Barnard, J; Bhangu, A

2017-02-01

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement aims to optimize the reporting of systematic reviews. The performance of the PRISMA Statement in improving the reporting and quality of surgical systematic reviews remains unclear. Systematic reviews published in five high-impact surgical journals between 2007 and 2015 were identified from online archives. Manuscripts blinded to journal, publication year and authorship were assessed according to 27 reporting criteria described by the PRISMA Statement and scored using a validated quality appraisal tool (AMSTAR, Assessing the Methodological Quality of Systematic Reviews). Comparisons were made between studies published before (2007-2009) and after (2011-2015) its introduction. The relationship between reporting and study quality was measured using Spearman's rank test. Of 281 eligible manuscripts, 80 were published before the PRISMA Statement and 201 afterwards. Most manuscripts (208) included a meta-analysis, with the remainder comprising a systematic review only. There was no meaningful change in median compliance with the PRISMA Statement (19 (i.q.r. 16-21) of 27 items before versus 19 (17-22) of 27 after introduction of PRISMA) despite achieving statistical significance (P = 0·042). Better reporting compliance was associated with higher methodological quality (r s  = 0·70, P < 0·001). The PRISMA Statement has had minimal impact on the reporting of surgical systematic reviews. Better compliance was associated with higher-quality methodology. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Same family, different species: methodological conduct and quality varies according to purpose for five types of knowledge synthesis.

PubMed

Tricco, Andrea C; Zarin, Wasifa; Ghassemi, Marco; Nincic, Vera; Lillie, Erin; Page, Matthew J; Shamseer, Larissa; Antony, Jesmin; Rios, Patricia; Hwee, Jeremiah; Veroniki, Areti Angeliki; Moher, David; Hartling, Lisa; Pham, Ba'; Straus, Sharon E

2018-04-01

The aim of the study was to characterize methodological conduct, reporting, and quality of five knowledge synthesis (KS) approaches. Retrospective analysis of a convenience sample of five published databases of KS approaches: overview of reviews (n = 74), scoping reviews (n = 494), rapid reviews (n = 84), systematic reviews (n = 300), and network meta-analyses (NMAs; n = 456). Data in the five published databases were abstracted by two reviewers independently, any missing data for this retrospective analysis were abstracted by one experienced reviewer. Methods were appraised using the A MeaSurement Tool to Assess systematic Reviews (AMSTAR) tool. Descriptive analysis was performed. Reporting the use of a protocol ranged from 4% for rapid reviews to 32% for systematic reviews. The use of two reviewers for citation and full-text screening ranged from 20% for scoping reviews to 60% for NMAs. Data abstraction was performed in duplicate for 11% of rapid reviews and 54% of NMAs, and for risk of bias appraisal, this ranged from 6% for scoping reviews to 41% for NMAs. NMAs had the highest median percentage of maximum obtainable AMSTAR score (64%; Q1-Q3:45-73%), while scoping reviews had the lowest (25%; Q1-Q3:13-38%). NMAs consistently scored the highest on the AMSTAR tool likely because the purpose is to estimate treatment effects statistically. Scoping reviews scored the lowest (even after adjusting the score for not relevant items) likely because the purpose is to characterize the literature. Copyright © 2017 Elsevier Inc. All rights reserved.

New scoring methodology improves the sensitivity of the Alzheimer's Disease Assessment Scale-Cognitive subscale (ADAS-Cog) in clinical trials.

PubMed

Verma, Nishant; Beretvas, S Natasha; Pascual, Belen; Masdeu, Joseph C; Markey, Mia K

2015-11-12

As currently used, the Alzheimer's Disease Assessment Scale-Cognitive subscale (ADAS-Cog) has low sensitivity for measuring Alzheimer's disease progression in clinical trials. A major reason behind the low sensitivity is its sub-optimal scoring methodology, which can be improved to obtain better sensitivity. Using item response theory, we developed a new scoring methodology (ADAS-CogIRT) for the ADAS-Cog, which addresses several major limitations of the current scoring methodology. The sensitivity of the ADAS-CogIRT methodology was evaluated using clinical trial simulations as well as a negative clinical trial, which had shown an evidence of a treatment effect. The ADAS-Cog was found to measure impairment in three cognitive domains of memory, language, and praxis. The ADAS-CogIRT methodology required significantly fewer patients and shorter trial durations as compared to the current scoring methodology when both were evaluated in simulated clinical trials. When validated on data from a real clinical trial, the ADAS-CogIRT methodology had higher sensitivity than the current scoring methodology in detecting the treatment effect. The proposed scoring methodology significantly improves the sensitivity of the ADAS-Cog in measuring progression of cognitive impairment in clinical trials focused in the mild-to-moderate Alzheimer's disease stage. This provides a boost to the efficiency of clinical trials requiring fewer patients and shorter durations for investigating disease-modifying treatments.

Mentored peer review of standardized manuscripts as a teaching tool for residents: a pilot randomized controlled multi-center study.

PubMed

Wong, Victoria S S; Strowd, Roy E; Aragón-García, Rebeca; Moon, Yeseon Park; Ford, Blair; Haut, Sheryl R; Kass, Joseph S; London, Zachary N; Mays, MaryAnn; Milligan, Tracey A; Price, Raymond S; Reynolds, Patrick S; Selwa, Linda M; Spencer, David C; Elkind, Mitchell S V

2017-01-01

There is increasing need for peer reviewers as the scientific literature grows. Formal education in biostatistics and research methodology during residency training is lacking. In this pilot study, we addressed these issues by evaluating a novel method of teaching residents about biostatistics and research methodology using peer review of standardized manuscripts. We hypothesized that mentored peer review would improve resident knowledge and perception of these concepts more than non-mentored peer review, while improving review quality. A partially blinded, randomized, controlled multi-center study was performed. Seventy-eight neurology residents from nine US neurology programs were randomized to receive mentoring from a local faculty member or not. Within a year, residents reviewed a baseline manuscript and four subsequent manuscripts, all with introduced errors designed to teach fundamental review concepts. In the mentored group, mentors discussed completed reviews with residents. Primary outcome measure was change in knowledge score between pre- and post-tests, measuring epidemiology and biostatistics knowledge. Secondary outcome measures included level of confidence in the use and interpretation of statistical concepts before and after intervention, and RQI score for baseline and final manuscripts. Sixty-four residents (82%) completed initial review with gradual decline in completion on subsequent reviews. Change in primary outcome, the difference between pre- and post-test knowledge scores, did not differ between mentored (-8.5%) and non-mentored (-13.9%) residents ( p  = 0.48). Significant differences in secondary outcomes (using 5-point Likert scale, 5 = strongly agree) included mentored residents reporting enhanced understanding of research methodology (3.69 vs 2.61; p  = 0.001), understanding of manuscripts (3.73 vs 2.87; p  = 0.006), and application of study results to clinical practice (3.65 vs 2.78; p  = 0.005) compared to non-mentored residents. There was no difference between groups in level of interest in peer review (3.00 vs 3.09; p  = 0.72) or the quality of manuscript review assessed by the Review Quality Instrument (RQI) (3.25 vs 3.06; p  = 0.50). We used mentored peer review of standardized manuscripts to teach biostatistics and research methodology and introduce the peer review process to residents. Though knowledge level did not change, mentored residents had enhanced perception in their abilities to understand research methodology and manuscripts and apply study results to clinical practice.

Intra-Articular Cellular Therapy for Osteoarthritis and Focal Cartilage Defects of the Knee: A Systematic Review of the Literature and Study Quality Analysis.

PubMed

Chahla, Jorge; Piuzzi, Nicolas S; Mitchell, Justin J; Dean, Chase S; Pascual-Garrido, Cecilia; LaPrade, Robert F; Muschler, George F

2016-09-21

Intra-articular cellular therapy injections constitute an appealing strategy that may modify the intra-articular milieu or regenerate cartilage in the settings of osteoarthritis and focal cartilage defects. However, little consensus exists regarding the indications for cellular therapies, optimal cell sources, methods of preparation and delivery, or means by which outcomes should be reported. We present a systematic review of the current literature regarding the safety and efficacy of cellular therapy delivered by intra-articular injection in the knee that provided a Level of Evidence of III or higher. A total of 420 papers were screened. Methodological quality was assessed using a modified Coleman methodology score. Only 6 studies (4 Level II and 2 Level III) met the criteria to be included in this review; 3 studies were on treatment of osteoarthritis and 3 were on treatment of focal cartilage defects. These included 4 randomized controlled studies without blinding, 1 prospective cohort study, and 1 retrospective therapeutic case-control study. The studies varied widely with respect to cell sources, cell characterization, adjuvant therapies, and assessment of outcomes. Outcome was reported in a total of 300 knees (124 in the osteoarthritis studies and 176 in the cartilage defect studies). Mean follow-up was 21.0 months (range, 12 to 36 months). All studies reported improved outcomes with intra-articular cellular therapy and no major adverse events. The mean modified Coleman methodology score was 59.1 ± 16 (range, 32 to 82). The studies of intra-articular cellular therapy injections for osteoarthritis and focal cartilage defects in the human knee suggested positive results with respect to clinical improvement and safety. However, the improvement was modest and a placebo effect cannot be disregarded. The overall quality of the literature was poor, and the methodological quality was fair, even among Level-II and III studies. Effective clinical assessment and optimization of injection therapies will demand greater attention to study methodology, including blinding; standardized quantitative methods for cell harvesting, processing, characterization, and delivery; and standardized reporting of clinical and structural outcomes. Therapeutic Level III. See Instructions for Authors for a complete description of levels of evidence. Copyright © 2016 by The Journal of Bone and Joint Surgery, Incorporated.

Systematic Review and Quality Appraisal of Economic Evaluation Publications in Dentistry.

PubMed

Tonmukayakul, U; Calache, H; Clark, R; Wasiak, J; Faggion, C M

2015-10-01

Economic evaluation (EE) studies have been undertaken in dentistry since the late 20th century because economic data provide additional information to policy makers to develop guidelines and set future direction for oral health services. The objectives of this study were to assess the methodological quality of EEs in oral health. Electronic searching of Ovid MEDLINE, the Cochrane Library, and the NHS Economic Evaluation Database from 1975 to 2013 were undertaken to identify publications that include costs and outcomes in dentistry. Relevant reference lists were also searched for additional studies. Studies were retrieved and reviewed independently for inclusion by 3 authors. Furthermore, to appraise the EE methods, 1 author applied the Drummond 10-item (13-criteria) checklist tool to each study. Of the 114 publications identified, 79 studies were considered full EE and 35 partial. Twenty-eight studies (30%) were published between the years 2011 and 2013. Sixty-four (53%) studies focused on dental caries prevention or treatment. Median appraisal scores calculated for full and partial EE studies were 11 and 9 out of 13, respectively. Quality assessment scores showed that the quality of partial EE studies published after 2000 significantly improved (P = 0.02) compared to those published before 2000. Significant quality improvement was not found in full EE studies. Common methodological limitations were identified: absence of sensitivity analysis, discounting, and insufficient information on how costs and outcomes were measured and valued. EE studies in dentistry increased over the last 40 y in both quantity and quality, but a number of publications failed to satisfy some components of standard EE research methods, such as sensitivity analysis and discounting. © International & American Associations for Dental Research 2015.

Five Steps to Successfully Implement and Evaluate Propensity Score Matching in Clinical Research Studies.

PubMed

Staffa, Steven J; Zurakowski, David

2018-01-09

In clinical research, the gold standard level of evidence is the randomized controlled trial (RCT). The availability of nonrandomized retrospective data is growing; however, a primary concern of analyzing such data is comparability of the treatment groups with respect to confounding variables. Propensity score matching (PSM) aims to equate treatment groups with respect to measured baseline covariates to achieve a comparison with reduced selection bias. It is a valuable statistical methodology that mimics the RCT, and it may create an "apples to apples" comparison while reducing bias due to confounding. PSM can improve the quality of anesthesia research and broaden the range of research opportunities. PSM is not necessarily a magic bullet for poor-quality data, but rather may allow the researcher to achieve balanced treatment groups similar to a RCT when high-quality observational data are available. PSM may be more appealing than the common approach of including confounders in a regression model because it allows for a more intuitive analysis of a treatment effect between 2 comparable groups.We present 5 steps that anesthesiologists can use to successfully implement PSM in their research with an example from the 2015 Pediatric National Surgical Quality Improvement Program: a validated, annually updated surgery and anesthesia pediatric database. The first step of PSM is to identify its feasibility with regard to the data at hand and ensure availability of data on any potential confounders. The second step is to obtain the set of propensity scores from a logistic regression model with treatment group as the outcome and the balancing factors as predictors. The third step is to match patients in the 2 treatment groups with similar propensity scores, balancing all factors. The fourth step is to assess the success of the matching with balance diagnostics, graphically or analytically. The fifth step is to apply appropriate statistical methodology using the propensity-matched data to compare outcomes among treatment groups.PSM is becoming an increasingly more popular statistical methodology in medical research. It often allows for improved evaluation of a treatment effect that may otherwise be invalid due to a lack of balance between the 2 treatment groups with regard to confounding variables. PSM may increase the level of evidence of a study and in turn increases the strength and generalizability of its results. Our step-by-step approach provides a useful strategy for anesthesiologists to implement PSM in their future research.

Methodological Quality Assessment of Meta-analyses in Endodontics.

PubMed

Kattan, Sereen; Lee, Su-Min; Kohli, Meetu R; Setzer, Frank C; Karabucak, Bekir

2018-01-01

The objectives of this review were to assess the methodological quality of published meta-analyses related to endodontics using the assessment of multiple systematic reviews (AMSTAR) tool and to provide a follow-up to previously published reviews. Three electronic databases were searched for eligible studies according to the inclusion and exclusion criteria: Embase via Ovid, The Cochrane Library, and Scopus. The electronic search was amended by a hand search of 6 dental journals (International Endodontic Journal; Journal of Endodontics; Australian Endodontic Journal; Oral Surgery, Oral Medicine, Oral Pathology, Oral Radiology; Endodontics and Dental Traumatology; and Journal of Dental Research). The searches were conducted to include articles published after July 2009, and the deadline for inclusion of the meta-analyses was November 30, 2016. The AMSTAR assessment tool was used to evaluate the methodological quality of all included studies. A total of 36 reports of meta-analyses were included. The overall quality of the meta-analyses reports was found to be medium, with an estimated mean overall AMSTAR score of 7.25 (95% confidence interval, 6.59-7.90). The most poorly assessed areas were providing an a priori design, the assessment of the status of publication, and publication bias. In recent publications in the field of endodontics, the overall quality of the reported meta-analyses is medium according to AMSTAR. Copyright © 2017 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Methodologic quality of meta-analyses and systematic reviews on the Mediterranean diet and cardiovascular disease outcomes: a review.

PubMed

Huedo-Medina, Tania B; Garcia, Marissa; Bihuniak, Jessica D; Kenny, Anne; Kerstetter, Jane

2016-03-01

Several systematic reviews/meta-analyses published within the past 10 y have examined the associations of Mediterranean-style diets (MedSDs) on cardiovascular disease (CVD) risk. However, these reviews have not been evaluated for satisfying contemporary methodologic quality standards. This study evaluated the quality of recent systematic reviews/meta-analyses on MedSD and CVD risk outcomes by using an established methodologic quality scale. The relation between review quality and impact per publication value of the journal in which the article had been published was also evaluated. To assess compliance with current standards, we applied a modified version of the Assessment of Multiple Systematic Reviews (AMSTARMedSD) quality scale to systematic reviews/meta-analyses retrieved from electronic databases that had met our selection criteria: 1) used systematic or meta-analytic procedures to review the literature, 2) examined MedSD trials, and 3) had MedSD interventions independently or combined with other interventions. Reviews completely satisfied from 8% to 75% of the AMSTARMedSD items (mean ± SD: 31.2% ± 19.4%), with those published in higher-impact journals having greater quality scores. At a minimum, 60% of the 24 reviews did not disclose full search details or apply appropriate statistical methods to combine study findings. Only 5 of the reviews included participant or study characteristics in their analyses, and none evaluated MedSD diet characteristics. These data suggest that current meta-analyses/systematic reviews evaluating the effect of MedSD on CVD risk do not fully comply with contemporary methodologic quality standards. As a result, there are more research questions to answer to enhance our understanding of how MedSD affects CVD risk or how these effects may be modified by the participant or MedSD characteristics. To clarify the associations between MedSD and CVD risk, future meta-analyses and systematic reviews should not only follow methodologic quality standards but also include more statistical modeling results when data allow. © 2016 American Society for Nutrition.

Structure, Process, and Outcome Quality of Surgical Site Infection Surveillance in Switzerland.

PubMed

Kuster, Stefan P; Eisenring, Marie-Christine; Sax, Hugo; Troillet, Nicolas

2017-10-01

OBJECTIVE To assess the structure and quality of surveillance activities and to validate outcome detection in the Swiss national surgical site infection (SSI) surveillance program. DESIGN Countrywide survey of SSI surveillance quality. SETTING 147 hospitals or hospital units with surgical activities in Switzerland. METHODS Site visits were conducted with on-site structured interviews and review of a random sample of 15 patient records per hospital: 10 from the entire data set and 5 from a subset of patients with originally reported infection. Process and structure were rated in 9 domains with a weighted overall validation score, and sensitivity, specificity, positive predictive value, and negative predictive value were calculated for the identification of SSI. RESULTS Of 50 possible points, the median validation score was 35.5 (range, 16.25-48.5). Public hospitals (P<.001), hospitals in the Italian-speaking region of Switzerland (P=.021), and hospitals with longer participation in the surveillance (P=.018) had higher scores than others. Domains that contributed most to lower scores were quality of chart review and quality of data extraction. Of 49 infections, 15 (30.6%) had been overlooked in a random sample of 1,110 patient records, accounting for a sensitivity of 69.4% (95% confidence interval [CI], 54.6%-81.7%), a specificity of 99.9% (95% CI, 99.5%-100%), a positive predictive value of 97.1% (95% CI, 85.1%-99.9%), and a negative predictive value of 98.6% (95% CI, 97.7%-99.2%). CONCLUSIONS Irrespective of a well-defined surveillance methodology, there is a wide variation of SSI surveillance quality. The quality of chart review and the accuracy of data collection are the main areas for improvement. Infect Control Hosp Epidemiol 2017;38:1172-1181.

Zhen gan xi feng decoction, a traditional chinese herbal formula, for the treatment of essential hypertension: a systematic review of randomized controlled trials.

PubMed

Xiong, Xingjiang; Yang, Xiaochen; Feng, Bo; Liu, Wei; Duan, Lian; Gao, Ao; Li, Haixia; Ma, Jizheng; Du, Xinliang; Li, Nan; Wang, Pengqian; Su, Kelei; Chu, Fuyong; Zhang, Guohao; Li, Xiaoke; Wang, Jie

2013-01-01

Objectives. To assess the clinical effectiveness and adverse effects of Zhen Gan Xi Feng Decoction (ZGXFD) for essential hypertension (EH). Methods. Five major electronic databases were searched up to August 2012 to retrieve any potential randomized controlled trials designed to evaluate the clinical effectiveness of ZGXFD for EH reported in any language, with main outcome measure as blood pressure (BP). Results. Six randomized trials were included. Methodological quality of the trials was evaluated as generally low. Four trials compared prescriptions based on ZGXFD with antihypertensive drugs. Meta-analysis showed that ZGXFD was more effective in BP control and TCM syndrome and symptom differentiation (TCM-SSD) scores than antihypertensive drugs. Two trials compared the combination of modified ZGXFD plus antihypertensive drugs with antihypertensive drugs. Meta-analysis showed that there is significant beneficial effect on TCM-SSD scores. However, no significant effect on BP was found. The safety of ZGXFD is still uncertain. Conclusions. ZGXFD appears to be effective in improving blood pressure and hypertension-related symptoms for EH. However, the evidence remains weak due to poor methodological quality of the included studies. More rigorous trials are warranted to support their clinical use.

Psychometric Properties of Questionnaires on Functional Health Status in Oropharyngeal Dysphagia: A Systematic Literature Review

PubMed Central

Speyer, Renée; Cordier, Reinie; Kertscher, Berit; Heijnen, Bas J

2014-01-01

Introduction. Questionnaires on Functional Health Status (FHS) are part of the assessment of oropharyngeal dysphagia. Objective. To conduct a systematic review of the literature on the psychometric properties of English-language FHS questionnaires in adults with oropharyngeal dysphagia. Methods. A systematic search was performed using the electronic databases Pubmed and Embase. The psychometric properties of the questionnaires were determined based on the COSMIN taxonomy of measurement properties and definitions for health-related patient-reported outcomes and the COSMIN checklist using preset psychometric criteria. Results. Three questionnaires were included: the Eating Assessment Tool (EAT-10), the Swallowing Outcome after Laryngectomy (SOAL), and the Self-report Symptom Inventory. The Sydney Swallow Questionnaire (SSQ) proved to be identical to the Modified Self-report Symptom Inventory. All FHS questionnaires obtained poor overall methodological quality scores for most measurement properties. Conclusions. The retrieved FHS questionnaires need psychometric reevaluation; if the overall methodological quality shows satisfactory improvement on most measurement properties, the use of the questionnaires in daily clinic and research can be justified. However, in case of insufficient validity and/or reliability scores, new FHS questionnaires need to be developed using and reporting on preestablished psychometric criteria as recommended in literature. PMID:24877095

Quality of Reporting and Study Design of CKD Cohort Studies Assessing Mortality in the Elderly Before and After STROBE: A Systematic Review.

PubMed

Rao, Anirudh; Brück, Katharina; Methven, Shona; Evans, Rebecca; Stel, Vianda S; Jager, Kitty J; Hooft, Lotty; Ben-Shlomo, Yoav; Caskey, Fergus

2016-01-01

The STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) statement was published in October 2007 to improve quality of reporting of observational studies. The aim of this review was to assess the impact of the STROBE statement on observational study reporting and study design quality in the nephrology literature. Systematic literature review. European and North American, Pre-dialysis Chronic Kidney Disease (CKD) cohort studies. Studies assessing the association between CKD and mortality in the elderly (>65 years) published from 1st January 2002 to 31st December 2013 were included, following systematic searching of MEDLINE & EMBASE. Time period before and after the publication of the STROBE statement. Quality of study reporting using the STROBE statement and quality of study design using the Newcastle Ottawa Scale (NOS), Scottish Intercollegiate Guidelines Network (SIGN) and Critical Appraisal Skills Programme (CASP) tools. 37 papers (11 Pre & 26 Post STROBE) were identified from 3621 potential articles. Only four of the 22 STROBE items and their sub-criteria (objectives reporting, choice of quantitative groups and description of and carrying out sensitivity analysis) showed improvements, with the majority of items showing little change between the period before and after publication of the STROBE statement. Pre- and post-period analysis revealed a Manuscript STROBE score increase (median score 77.8% (Inter-quartile range [IQR], 64.7-82.0) vs 83% (IQR, 78.4-84.9, p = 0.05). There was no change in quality of study design with identical median scores in the two periods for NOS (Manuscript NOS score 88.9), SIGN (Manuscript SIGN score 83.3) and CASP (Manuscript CASP score 91.7) tools. Only 37 Studies from Europe and North America were included from one medical specialty. Assessment of study design largely reliant on good reporting. This study highlights continuing deficiencies in the reporting of STROBE items and their sub-criteria in cohort studies in nephrology. There was weak evidence of improvement in the overall reporting quality, with no improvement in methodological quality of CKD cohort studies between the period before and after publication of the STROBE statement.

Forty years of quality-of-life research in congenital heart disease: Temporal trends in conceptual and methodological rigor.

PubMed

Bratt, Ewa-Lena; Moons, Philip

2015-09-15

The first study on quality of life (QoL) in patients with congenital heart disease was published 40 years ago. Since then, the number of QoL articles on these patients has grown exponentially. We conducted a systematic literature review of all empirical studies on QoL in patients with congenital heart disease published since 1974, with the aim of determining the range of conceptual and methodological rigor of studies and identifying temporal trends in these parameters. PubMed, Embase, and Cinahl were searched for empirical studies addressing QoL in children, adolescents, or adults with congenital heart disease, published between January 1, 1974, and December 31, 2014. We applied 10 review criteria that were previously developed by Gill and Feinstein in 1994 and further refined by Moons et al. in 2004. Overall, 234 articles were reviewed. We found slight but non-significant temporal improvements in conceptual and methodological rigor and in use of assessment methods. This indicates a trend toward a more professional and exacting approach in QoL assessments. However, the majority of articles still had substantial conceptual and methodological deficits. Furthermore, we observed that citation of the publications of Gill and Feinstein and Moons et al. in published QoL research is associated with higher quality scores, suggesting that these articles have a positive impact on conceptual and methodological caliber. Despite 40 years of QoL research in this field, this review shows that major weaknesses in methodological rigor remain highly prevalent, which may make QoL studies inconclusive. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

What is the quality of the maternal near-miss case reviews in WHO European Region? Cross-sectional study in Armenia, Georgia, Latvia, Republic of Moldova and Uzbekistan

PubMed Central

Bacci, Alberta; Hodorogea, Stelian; Khachatryan, Henrik; Babojonova, Shohida; Irsa, Signe; Jansone, Maira; Dondiuc, Iurie; Matarazde, George; Lazdane, Gunta; Lazzerini, Marzia

2018-01-01

Objectives The maternal near-miss case review (NMCR) cycle is a type of clinical audit aiming at improving quality of maternal healthcare by discussing near-miss cases. In several countries this approach has been introduced and supported by WHO and partners since 2004, but information on the quality of its implementation is missing. This study aimed at evaluating the quality of the NMCR implementation in selected countries within WHO European Region. Design Cross-sectional study. Settings Twenty-three maternity units in Armenia, Georgia, Latvia, Moldova and Uzbekistan. Assessment tools A predefined checklist including 50 items, according to WHO methodology. Quality in the NMCR implementation was defined by summary scores ranging from 0 (totally inappropriate) to 3 (appropriate). Results Quality of the NMCR implementation was heterogeneous among different countries, and within the same country. Overall, the first part of the audit cycle (from case identification to case analysis) was fairly well performed (mean score 2.00, 95% CI 1.94 to 2.06), with the exception of the ‘inclusion of users’ views’ (mean score 0.66, 95% CI 0.11 to 1.22), while the second part (developing recommendations, implementing them and ensuring quality) was poorly performed (mean score 0.66, 95% CI 0.11 to 1.22). Each country had at least one champion facility, where quality of the NMCR cycle was acceptable. Quality of the implementation was not associated with its duration. Gaps in implementation were of technical, organisational and attitudinal nature. Conclusions Ensuring quality in the NMCR may be difficult but achievable. The high heterogeneity in results within the same country suggests that quality of the NMCR implementation depends, to a large extent, from hospital factors, including staff’s commitment, managerial support and local coordination. Efforts should be put in preventing and mitigating common barriers that hamper successful NMCR implementation. PMID:29654004

Quality assessment of osteoporosis clinical practice guidelines for physical activity and safe movement: an AGREE II appraisal.

PubMed

Armstrong, James Jacob; Rodrigues, Isabel Braganca; Wasiuta, Tom; MacDermid, Joy C

2016-01-01

Many osteoporosis clinical practice guidelines are published, and the extent to which physical activity and safe movement is addressed varies. To better inform clinical decision-making, a quality assessment and structured analysis of recommendations was undertaken. Guideline quality varied substantially, and improvement is necessary in physical activity and safe movement recommendations. The purpose of the present study is to survey available osteoporosis clinical practice guidelines (CPGs) containing physical activity and safe movement recommendations in order to assess the methodological quality with which they were developed. An analysis of the various physical activity and safe movement recommendations was conducted to determine variability between CPGs. An online literature search revealed 19 CPGs meeting our inclusion criteria. Three independent scorers evaluated CPG quality using the Appraisal of Guidelines for Research and Evaluation version II (AGREE II) instrument. Two separate individuals used a standard table to extract relevant recommendations. Intra-reviewer AGREE II score agreement ranged from fair to good (intra-class correlation coefficient (ICC) = 0.34 to 0.65). The quality of the 19 included CPGs was variable (AGREE sub-scores: 14 to 100%). CPGs scored higher in the "scope and purpose" and "clarity of presentation" domains. They scored the lowest in "applicability" and "editorial independence." Four CPGs were classified as high quality, ten average quality, and five low quality. Most CPGs recommended weight-bearing, muscle-strengthening, and resistance exercises. Information on exercise dosage, progression, and contraindications was often absent. Immobility and movements involving spinal flexion and/or torsion were discouraged. There were several high-quality CPGs; however, variability in quality and lack of specific parameters for implementation necessitates caution and critical examination by readers. CPG development groups should pay special attention to the clinical applicability of their CPGs as well as fully disclosing conflicts of interest. CPGs were in general an agreement regarding safe physical activity and safe movement recommendations. However, recommendations were often vague and the more specific recommendations were inconsistent between CPGs.

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students’ academic success. PMID:27031506

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

Quality indicators for musculoskeletal injury management in the emergency department: a systematic review.

PubMed

Strudwick, Kirsten; Nelson, Mark; Martin-Khan, Melinda; Bourke, Michael; Bell, Anthony; Russell, Trevor

2015-02-01

There is increasing importance placed on quality of health care for musculoskeletal injuries in emergency departments (EDs). This systematic review aimed to identify existing musculoskeletal quality indicators (QIs) developed for ED use and to critically evaluate their methodological quality. MEDLINE, EMBASE, CINAHL, and the gray literature, including relevant organizational websites, were searched in 2013. English-language articles were included that described the development of at least one QI related to the ED care of musculoskeletal injuries. Data extraction of each included article was conducted. A quality assessment was then performed by rating each relevant QI against the Appraisal of Indicators through Research and Evaluation (AIRE) Instrument. QIs with similar definitions were grouped together and categorized according to the health care quality frameworks of Donabedian and the Institute of Medicine. The search revealed 1,805 potentially relevant articles, of which 15 were finally included in the review. The number of relevant QIs per article ranged from one to 11, resulting in a total of 71 QIs overall. Pain (n = 17) and fracture management (n = 13) QIs were predominant. Ten QIs scored at least 50% across all AIRE Instrument domains, and these related to pain management and appropriate imaging of the spine. Methodological quality of the development of most QIs is poor. Recommendations for a core set of QIs that address the complete spectrum of musculoskeletal injury management in emergency medicine is not possible, and more work is needed. Currently, QIs with highest methodological quality are in the areas of pain management and medical imaging. © 2015 by the Society for Academic Emergency Medicine.

Clinical guidelines in pediatric headache: evaluation of quality using the AGREE II instrument

PubMed Central

2014-01-01

Background The Appraisal of Guidelines for Research and Evaluation (AGREE II) tool is a validated questionnaire used to assess the methodological quality of clinical guidelines (CGs). We used the AGREE II tool to assess the development process, the methodological quality, and the quality of reporting of available pediatric CGs for the management of headache in children. We also studied the variability in responses related to the characteristics of eleven Italian neuropediatric centers, showing similarities and differences in the main recommendations reported in CGs. Methods A systematic literature search was conducted from January 2002 to June 2013 on Mediline, the Cochrane database, the National Guideline Clearinghouse website and the NHS evidence search tool, using the following terms: headache, cephalalgia, guidelines and children (MESH or text words). Six CGs providing information on the diagnosis and management of headache and specific recommendations for children were selected. Eleven neuropediatric centers assessed the overall quality and the appropriateness of all available CGs using of the AGREE II instrument. Results Six CGs meeting the inclusion and exclusion criteria were identified and assessed by 11 reviewers. Our study showed that the NICE CGs was “strongly recommended” while the French and Danish CGs were mainly “not recommended”. The comparison between the overall quality score of the French CGs and the NICE CGs was statistically significant (6.54 ± 0.69 vs 4.18 ± 1.08; p =0.001). The correlation analysis between quality domain score and guideline publication date showed a statistically significant association only for the “editorial independence” domain (r = 0.842 p = 0.035). The intra-class coefficients showed that the 11 reviewers had the highest agreement for the Lewis CGs (r = 0.857), and the lowest one for the NICE CGs (r = 0.656). Statistical analyses showed that professionals from outpatient services dedicated pediatric headache assigned a higher overall quality score to the NICE CGs as compared to professionals from non-outpatient services (6.86 ± 0.38 vs 6.0 ± 0.82; p = 0.038). Conclusions CGs resulted definitely of low-moderate quality and non “homogeneous”. Further major efforts are needed to update the existing CGs according to the principles of evidence based medicine. PMID:25178699

Evidence for current recommendations concerning the management of foot health for people with chronic long-term conditions: a systematic review.

PubMed

Edwards, Katherine; Borthwick, Alan; McCulloch, Louise; Redmond, Anthony; Pinedo-Villanueva, Rafael; Prieto-Alhambra, Daniel; Judge, Andrew; Arden, Nigel; Bowen, Catherine

2017-01-01

Research focusing on management of foot health has become more evident over the past decade, especially related to chronic conditions such as diabetes. The level of methodological rigour across this body of work however is varied and outputs do not appear to have been developed or translated into clinical practice. The aim of this systematic review was to assess the latest guidelines, standards of care and current recommendations relative to people with chronic conditions to ascertain the level of supporting evidence concerning the management of foot health. A systematic search of electronic databases (Medline, Embase, Cinahl, Web of Science, SCOPUS and The Cochrane Library) for literature on recommendations for foot health management for people with chronic conditions was performed between 2000 and 2016 using predefined criteria. Data from the included publications was synthesised via template analysis, employing a thematic organisation and structure. The methodological quality of all included publications was appraised using the Appraisal for Research and Evaluation (AGREE II) instrument. A more in-depth analysis was carried out that specifically considered the levels of evidence that underpinned the strength of their recommendations concerning management of foot health. The data collected revealed 166 publications in which the majority (102) were guidelines, standards of care or recommendations related to the treatment and management of diabetes. We noted a trend towards a systematic year on year increase in guidelines standards of care or recommendations related to the treatment and management of long term conditions other than diabetes over the past decade. The most common recommendation is for preventive care or assessments (e.g. vascular tests), followed by clinical interventions such as foot orthoses, foot ulcer care and foot health education. Methodological quality was spread across the range of AGREE II scores with 62 publications falling into the category of high quality (scores 6-7). The number of publications providing a recommendation in the context of a narrative but without an indication of the strength or quality of the underlying evidence was high (79 out of 166). It is clear that evidence needs to be accelerated and in place to support the future of the Podiatry workforce. Whilst high level evidence for podiatry is currently low in quantity, the methodological quality is growing. Where levels of evidence have been given in in high quality guidelines, standards of care or recommendations, they also tend to be strong-moderate quality such that further strategically prioritised research, if performed, is likely to have an important impact in the field.

Dementia ascertainment using existing data in UK longitudinal and cohort studies: a systematic review of methodology.

PubMed

Sibbett, Ruth A; Russ, Tom C; Deary, Ian J; Starr, John M

2017-07-03

Studies investigating the risk factors for or causation of dementia must consider subjects prior to disease onset. To overcome the limitations of prospective studies and self-reported recall of information, the use of existing data is key. This review provides a narrative account of dementia ascertainment methods using sources of existing data. The literature search was performed using: MEDLINE, EMBASE, PsychInfo and Web of Science. Included articles reported a UK-based study of dementia in which cases were ascertained using existing data. Existing data included that which was routinely collected and that which was collected for previous research. After removing duplicates, abstracts were screened and the remaining articles were included for full-text review. A quality tool was used to evaluate the description of the ascertainment methodology. Of the 3545 abstracts screened, 360 articles were selected for full-text review. 47 articles were included for final consideration. Data sources for ascertainment included: death records, national datasets, research databases and hospital records among others. 36 articles used existing data alone for ascertainment, of which 27 used only a single data source. The most frequently used source was a research database. Quality scores ranged from 7/16 to 16/16. Quality scores were better for articles with dementia ascertainment as an outcome. Some papers performed validation studies of dementia ascertainment and most indicated that observed rates of dementia were lower than expected. We identified a lack of consistency in dementia ascertainment methodology using existing data. With no data source identified as a "gold-standard", we suggest the use of multiple sources. Where possible, studies should access records with evidence to confirm the diagnosis. Studies should also calculate the dementia ascertainment rate for the population being studied to enable a comparison with an expected rate.

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

Development of an Online Library of Patient-Reported Outcome Measures in Gastroenterology: The GI-PRO Database

PubMed Central

Khanna, Puja; Agarwal, Nikhil; Khanna, Dinesh; Hays, Ron D.; Chang, Lin; Bolus, Roger; Melmed, Gil; Whitman, Cynthia B.; Kaplan, Robert M.; Ogawa, Rikke; Snyder, Bradley; Spiegel, Brennan M.R.

2014-01-01

OBJECTIVES Because gastrointestinal (GI) illnesses can cause physical, emotional, and social distress, patient-reported outcomes (PROs) are used to guide clinical decision making, conduct research, and seek drug approval. It is important to develop a mechanism for identifying, categorizing, and evaluating the over 100 GI PROs that exist. Here we describe a new, National Institutes of Health (NIH)-supported, online PRO clearinghouse—the GI-PRO database. METHODS Using a protocol developed by the NIH Patient-Reported Outcome Measurement Information System (PROMIS®), we performed a systematic review to identify English-language GI PROs. We abstracted PRO items and developed an online searchable item database. We categorized symptoms into content “bins” to evaluate a framework for GI symptom reporting. Finally, we assigned a score for the methodological quality of each PRO represented in the published literature (0–20 range; higher indicates better). RESULTS We reviewed 15,697 titles (κ > 0.6 for title and abstract selection), from which we identified 126 PROs. Review of the PROs revealed eight GI symptom “bins”: (i) abdominal pain, (ii) bloat/gas, (iii) diarrhea, (iv) constipation, (v) bowel incontinence/soilage, (vi) heartburn/reflux, (vii) swallowing, and (viii) nausea/vomiting. In addition to these symptoms, the PROs covered four psychosocial domains: (i) behaviors, (ii) cognitions, (iii) emotions, and (iv) psychosocial impact. The quality scores were generally low (mean 8.88±4.19; 0 (min)−20 (max)). In addition, 51% did not include patient input in developing the PRO, and 41% provided no information on score interpretation. CONCLUSIONS GI PROs cover a wide range of biopsychosocial symptoms. Although plentiful, GI PROs are limited by low methodological quality. Our online PRO library (www.researchcore.org/gipro/) can help in selecting PROs for clinical and research purposes. PMID:24343547

Variable methodological quality and use found in systematic reviews referenced in STEMI clinical practice guidelines.

PubMed

Scott, Jared; Howard, Benjamin; Sinnett, Philip; Schiesel, Michael; Baker, Jana; Henderson, Patrick; Vassar, Matt

2017-12-01

The objective of this study was to assess the methodological quality and clarity of reporting of the systematic reviews (SRs) supporting clinical practice guideline (CPG) recommendations in the management of ST-elevation myocardial infarction (STEMI) across international CPGs. We searched 13 guideline clearinghouses including the National Guideline Clearinghouse and Guidelines International Network (GIN). To meet inclusion criteria CPGs must be pertinent to the management of STEMI, endorsed by a governing body or national organization, and written in English. We retrieved SRs from the reference sections using a combination of keywords and hand searching. Two investigators scored eligible SRs using AMSTAR and PRISMA. We included four CPGs. We extracted 71 unique SRs. These SRs received AMSTAR scores ranging from 1 (low) to 9 (high) on an 11-point scale. All CPGs consistently underperformed in areas including disclosure of funding sources, risk of bias, and publication bias according to AMSTAR. PRISMA checklist completeness ranged from 44% to 96%. The PRISMA scores indicated that SRs did not provide a full search strategy, study protocol and registration, assessment of publication bias or report funding sources. Only one SR was referenced in all four CPGs. All CPGs omitted a large subset of available SRs cited by other guidelines. Our study demonstrates the variable quality of SRs used to establish recommendations within guidelines included in our sample. Although guideline developers have acknowledged this variability, it remains a significant finding that needs to be addressed further. This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. Copyright © 2017 Elsevier Inc. All rights reserved.

The Flint Food Store Survey: combining spatial analysis with a modified Nutrition Environment Measures Survey in Stores (NEMS-S) to measure the community and consumer nutrition environments.

PubMed

Shaver, Erika R; Sadler, Richard C; Hill, Alex B; Bell, Kendall; Ray, Myah; Choy-Shin, Jennifer; Lerner, Joy; Soldner, Teresa; Jones, Andrew D

2018-06-01

The goal of the present study was to use a methodology that accurately and reliably describes the availability, price and quality of healthy foods at both the store and community levels using the Nutrition Environment Measures Survey in Stores (NEMS-S), to propose a spatial methodology for integrating these store and community data into measures for defining objective food access. Two hundred and sixty-five retail food stores in and within 2 miles (3·2 km) of Flint, Michigan, USA, were mapped using ArcGIS mapping software. A survey based on the validated NEMS-S was conducted at each retail food store. Scores were assigned to each store based on a modified version of the NEMS-S scoring system and linked to the mapped locations of stores. Neighbourhood characteristics (race and socio-economic distress) were appended to each store. Finally, spatial and kernel density analyses were run on the mapped store scores to obtain healthy food density metrics. Regression analyses revealed that neighbourhoods with higher socio-economic distress had significantly lower dairy sub-scores compared with their lower-distress counterparts (β coefficient=-1·3; P=0·04). Additionally, supermarkets were present only in neighbourhoods with <60 % African-American population and low socio-economic distress. Two areas in Flint had an overall NEMS-S score of 0. By identifying areas with poor access to healthy foods via a validated metric, this research can be used help local government and organizations target interventions to high-need areas. Furthermore, the methodology used for the survey and the mapping exercise can be replicated in other cities to provide comparable results.

Evaluating online diagnostic decision support tools for the clinical setting.

PubMed

Pryor, Marie; White, David; Potter, Bronwyn; Traill, Roger

2012-01-01

Clinical decision support tools available at the point of care are an effective adjunct to support clinicians to make clinical decisions and improve patient outcomes. We developed a methodology and applied it to evaluate commercially available online clinical diagnostic decision support (DDS) tools for use at the point of care. We identified 11 commercially available DDS tools and assessed these against an evaluation instrument that included 6 categories; general information, content, quality control, search, clinical results and other features. We developed diagnostically challenging clinical case scenarios based on real patient experience that were commonly missed by junior medical staff. The evaluation was divided into 2 phases; an initial evaluation of all identified and accessible DDS tools conducted by the Clinical Information Access Portal (CIAP) team and a second phase that further assessed the top 3 tools identified in the initial evaluation phase. An evaluation panel consisting of senior and junior medical clinicians from NSW Health conducted the second phase. Of the eleven tools that were assessed against the evaluation instrument only 4 tools completely met the DDS definition that was adopted for this evaluation and were able to produce a differential diagnosis. From the initial phase of the evaluation 4 DDS tools scored 70% or more (maximum score 96%) for the content category, 8 tools scored 65% or more (maximum 100%) for the quality control category, 5 tools scored 65% or more (maximum 94%) for the search category, and 4 tools score 70% or more (maximum 81%) for the clinical results category. The second phase of the evaluation was focused on assessing diagnostic accuracy for the top 3 tools identified in the initial phase. Best Practice ranked highest overall against the 6 clinical case scenarios used. Overall the differentiating factor between the top 3 DDS tools was determined by diagnostic accuracy ranking, ease of use and the confidence and credibility of the clinical information. The evaluation methodology used here to assess the quality and comprehensiveness of clinical DDS tools was effective in identifying the most appropriate tool for the clinical setting. The use of clinical case scenarios is fundamental in determining the diagnostic accuracy and usability of the tools.

The impact of financial incentives on the implementation of asthma or diabetes self-management: A systematic review.

PubMed

Jackson, Tracy; Shields, Michael D; Heaney, Liam G; Kendall, Marilyn; Pearce, Christina J; Hui, Chi Yan; Pinnock, Hilary

2017-01-01

Financial incentives are utilised in healthcare systems in a number of countries to improve quality of care delivered to patients by rewarding practices or practitioners for achieving set targets. To systematically review the evidence investigating the impact of financial incentives for implementation of supported self-management on quality of care including: organisational process outcomes, individual behavioural outcomes, and health outcomes for individuals with asthma or diabetes; both conditions with an extensive evidence base for self-management. We followed Cochrane methodology, using a PICOS search strategy to search eight databases in November 2015 (updated May 2017) including a broad range of implementation methodologies. Studies were weighted by robustness of methodology, number of participants and the quality score. We used narrative synthesis due to heterogeneity of studies. We identified 2,541 articles; 12 met our inclusion criteria. The articles were from the US (n = 7), UK (n = 4) and Canada (n = 1). Measured outcomes were HbA1c tests undertaken and/or the level achieved (n = 10), written action plans for asthma (n = 1) and hospital/emergency department visits (n = 1). Three of the studies were part of a larger incentive scheme including many conditions; one focused on asthma; eight focussed on diabetes. In asthma, the proportion receiving 'perfect care' (including providing a written action plan) increased from 4% to 88% in one study, and there were fewer hospitalisations/emergency department visits in another study. Across the diabetes studies, quality-of-care/GP performance scores improved in three, were unchanged in six and deteriorated in one. Results for the impact of financial incentives for the implementation of self-management were mixed. The evidence in diabetes suggests no consistent impact on diabetic control. There was evidence from a single study of improved process and health outcomes in asthma. Further research is needed to confirm these findings and understand the process by which financial incentives may impact (or not) on care. Protocol registration number: CRD42016027411.

Measuring Provider Performance for Physicians Participating in the Merit-Based Incentive Payment System.

PubMed

Squitieri, Lee; Chung, Kevin C

2017-07-01

In 2017, the Centers for Medicare and Medicaid Services began requiring all eligible providers to participate in the Quality Payment Program or face financial reimbursement penalty. The Quality Payment Program outlines two paths for provider participation: the Merit-Based Incentive Payment System and Advanced Alternative Payment Models. For the first performance period beginning in January of 2017, the Centers for Medicare and Medicaid Services estimates that approximately 83 to 90 percent of eligible providers will not qualify for participation in an Advanced Alternative Payment Model and therefore must participate in the Merit-Based Incentive Payment System program. The Merit-Based Incentive Payment System path replaces existing quality-reporting programs and adds several new measures to evaluate providers using four categories of data: (1) quality, (2) cost/resource use, (3) improvement activities, and (4) advancing care information. These categories will be combined to calculate a weighted composite score for each provider or provider group. Composite Merit-Based Incentive Payment System scores based on 2017 performance data will be used to adjust reimbursed payment in 2019. In this article, the authors provide relevant background for understanding value-based provider performance measurement. The authors also discuss Merit-Based Incentive Payment System reporting requirements and scoring methodology to provide plastic surgeons with the necessary information to critically evaluate their own practice capabilities in the context of current performance metrics under the Quality Payment Program.

The mid-term outcome of total ankle arthroplasty and ankle fusion in rheumatoid arthritis: a systematic review.

PubMed

van Heiningen, Jacqueline; Vliet Vlieland, Thea P M; van der Heide, Huub J L

2013-10-26

While arthrodesis is the standard treatment of a severely arthritic ankle joint, total ankle arthroplasty has become a popular alternative. This review provides clinical outcomes and complications of both interventions in patients with rheumatoid arthritis. Studies were obtained from Pubmed, Embase and Web of Science (January 1980-June 2011) and additional manual search. original clinical study, > 5 rheumatoid arthritis (population), internal fixation arthrodesis or three-component mobile bearing prosthesis (intervention), ankle scoring system (outcome). The clinical outcome score, complication- and failure rates were extracted and the methodological quality of the studies was analysed. 17 observational studies of 868 citations were included. The effect size concerning total ankle arthroplasty ranged between 1.9 and 6.0, for arthrodesis the effect sizes were 4.0 and 4.7. Reoperation due to implant failure or reoperation due to non-union, was 11% and 12% for respectively total ankle arthroplasty and arthrodesis. The methodological quality of the studies was low (mean 6.4 out of a maximum of 14 points) and was lower for arthrodesis (mean 4.8) as compared to arthroplasty (mean 7.8) (p = 0.04). 17 observational and no (randomized) controlled clinical trials are published on the effectiveness of arthroplasty or arthrodesis of the ankle in rheumatoid arthritis. Regardless of the methodological limitations it can be concluded that both interventions show clinical improvement and in line with current literature neither procedure is superior to the other.

US adolescents’ friendship networks and health risk behaviors: a systematic review of studies using social network analysis and Add Health data

PubMed Central

Goodson, Patricia

2015-01-01

Background. Documented trends in health-related risk behaviors among US adolescents have remained high over time. Studies indicate relationships among mutual friends are a major influence on adolescents’ risky behaviors. Social Network Analysis (SNA) can help understand friendship ties affecting individual adolescents’ engagement in these behaviors. Moreover, a systematic literature review can synthesize findings from a range of studies using SNA, as well as assess these studies’ methodological quality. Review findings also can help health educators and promoters develop more effective programs. Objective. This review systematically examined studies of the influence of friendship networks on adolescents’ risk behaviors, which utilized SNA and the Add Health data (a nationally representative sample). Methods. We employed the Matrix Method to synthesize and evaluate 15 published studies that met our inclusion and exclusion criteria, retrieved from the Add Health website and 3 major databases (Medline, Eric, and PsycINFO). Moreover, we assigned each study a methodological quality score (MQS). Results. In all studies, friendship networks among adolescents promoted their risky behaviors, including drinking alcohol, smoking, sexual intercourse, and marijuana use. The average MQS was 4.6, an indicator of methodological rigor (scale: 1–9). Conclusion. Better understanding of risky behaviors influenced by friends can be useful for health educators and promoters, as programs targeting friendships might be more effective. Additionally, the overall MQ of these reviewed studies was good, as average scores fell above the scale’s mid-point. PMID:26157622

Research methodology workshops evaluation using the Kirkpatrick's model: translating theory into practice.

PubMed

Abdulghani, Hamza Mohammad; Shaik, Shaffi Ahamed; Khamis, Nehal; Al-Drees, Abdulmajeed Abdulrahman; Irshad, Mohammad; Khalil, Mahmoud Salah; Alhaqwi, Ali Ibrahim; Isnani, Arthur

2014-04-01

Qualitative and quantitative evaluation of academic programs can enhance the development, effectiveness, and dissemination of comparative quality reports as well as quality improvement efforts. To evaluate the five research methodology workshops through assessing participants' satisfaction, knowledge and skills gain and impact on practices by the Kirkpatrick's evaluation model. The four level Kirkpatrick's model was applied for the evaluation. Training feedback questionnaires, pre and post tests, learner development plan reports and behavioral surveys were used to evaluate the effectiveness of the workshop programs. Of the 116 participants, 28 (24.1%) liked with appreciation, 62 (53.4%) liked with suggestions and 26 (22.4%) disliked the programs. Pre and post MCQs tests mean scores showed significant improvement of relevant basic knowledge and cognitive skills by 17.67% (p ≤ 0.005). Pre-and-post tests scores on workshops sub-topics also significantly improved for the manuscripts (p ≤ 0.031) and proposal writing (p ≤ 0.834). As for the impact, 56.9% of participants started research, and 6.9% published their studies. The results from participants' performance revealed an overall positive feedback and 79% of participant reported transfer of training skills at their workplace. The course outcomes achievement and suggestions given for improvements offer insight into the program which were encouraging and very useful. Encouraging "research culture" and work-based learning are probably the most powerful determinants for research promotion. These findings therefore encourage faculty development unit to continue its training and development in the research methodology aspects.

Factors associated with smoking in Asian American adults: a systematic review.

PubMed

Zhang, Jing; Wang, Zhongmiao

2008-05-01

This review systematically examined the factors associated with smoking in Asian American adults (aged > or =17 years). A total of 21 quantitative studies published in peer-reviewed journals from 1997 to 2006 were reviewed and abstracted using the matrix method. Statistically significant factors reported by the studies were summarized. Methodological quality of the studies also was assessed (maximum possible score = 10). Acculturation and education were the most frequently reported factors (n = 10, 47.6%). Acculturation was negatively associated with men's smoking but was positively associated with women's smoking. Education was uniformly found to be negatively related to smoking. Age was reported to have either a positive or a negative relationship with smoking (n = 9, 42.9%). Men were more likely to smoke than women (n = 7, 33.3%). The mean methodological score of the reviewed studies was 4.14 (on a scale of 1-10 points; SD = 1.62; range = 2-8). Health promotion professionals need to consider the summarized factors associated with Asian American adults' smoking behavior when planning smoking prevention programs and when recruiting participants for smoking cessation programs. When addressing acculturation, program planners should design different health education materials and use different strategies for men and women. To identify, understand, and incorporate essential factors into effective interventions, future studies should aim at higher methodological quality by using longitudinal design and increasing the use of theory, the test of data validity and reliability, and the report of effect sizes.

Cost-utility analyses of drug therapies in breast cancer: a systematic review.

PubMed

Nerich, Virginie; Saing, Sopany; Gamper, Eva Maria; Kemmler, Georg; Daval, Franck; Pivot, Xavier; Holzner, Bernhard

2016-10-01

The economic evaluation (EE) of health care products has become a necessity. Their quality must be high in order to trust the results and make informed decisions. While cost-utility analyses (CUAs) should be preferred to cost-effectiveness analyses in the oncology area, the quality of breast cancer (BC)-related CUA has been given little attention so far. Thus, firstly, a systematic review of published CUA related to drug therapies for BC, gene expression profiling, and HER2 status testing was performed. Secondly, the quality of selected CUA was assessed and the factors associated with a high-quality CUA identified. The systematic literature search was conducted in PubMed, MEDLINE/EMBASE, and Cochrane to identify published CUA between 2000 and 2014. After screening and data extraction, the quality of each selected CUA was assessed by two independent reviewers, using the checklist proposed by Drummond et al. The analysis of factors associated with a high-quality CUA (defined as a Drummond score ≥7) was performed using a two-step approach. Our systematic review was based on 140 CUAs and showed a wide variety of methodological approaches, including differences in the perspective adopted, the time horizon, measurement of cost and effectiveness, and more specially health-state utility values (HSUVs). The median Drummond score was 7 [range 3-10]. Only one in two of the CUA (n = 74) had a Drummond score ≥7, synonymous of "high quality." The statistically significant predictors of a high-quality CUA were article with "gene expression profiling" topic (p = 0.001), consulting or pharmaceutical company as main location of first author (p = 0.004), and articles with both incremental cost-utility ratio and incremental cost-effectiveness ratio as outcomes of EE (p = 0.02). Our systematic review identified only 140 CUAs published over the past 15 years with one in two of high quality. It showed a wide variety of methodological approaches, especially focused on HSUVs. A critical appraisal of utility values is necessary to better understand one of the main difficulties encountered by authors and propose areas for improvement to increase the quality of CUA. Since the last 5 years, there is a tendency toward an improvement in the quality of these studies, probably coupled with economic context, a better and widely spreading of recommendations and thus appropriation by medical practitioners. That being said, there is an urgent need for mandatory use of European and international recommendations to ensure quality of such approaches and to allow easy comparison.

Surgical interventions for gastric cancer: a review of systematic reviews.

PubMed

He, Weiling; Tu, Jian; Huo, Zijun; Li, Yuhuang; Peng, Jintao; Qiu, Zhenwen; Luo, Dandong; Ke, Zunfu; Chen, Xinlin

2015-01-01

To evaluate methodological quality and the extent of concordance among meta-analysis and/or systematic reviews on surgical interventions for gastric cancer (GC). A comprehensive search of PubMed, Medline, EMBASE, the Cochrane library and the DARE database was conducted to identify the reviews comparing different surgical interventions for GC prior to April 2014. After applying included criteria, available data were summarized and appraised by the Oxman and Guyatt scale. Fifty six reviews were included. Forty five reviews (80.4%) were well conducted, with scores of adapted Oxman and Guyatt scale ≥ 14. The reviews differed in criteria for avoiding bias and assessing the validity of the primary studies. Many primary studies displayed major methodological flaws, such as randomization, allocation concealment, and dropouts and withdrawals. According to the concordance assessment, laparoscopy-assisted gastrectomy (LAG) was superior to open gastrectomy, and laparoscopy-assisted distal gastrectomy was superior to open distal gastrectomy in short-term outcomes. However, the concordance regarding other surgical interventions, such as D1 vs. D2 lymphadenectomy, and robotic gastrectomy vs. LAG were absent. Systematic reviews on surgical interventions for GC displayed relatively high methodological quality. The improvement of methodological quality and reporting was necessary for primary studies. The superiority of laparoscopic over open surgery was demonstrated. But concordance on other surgical interventions was rare, which needed more well-designed RCTs and systematic reviews.

Response surface methodology for predicting quality characteristics of beef patties added with flaxseed and tomato paste.

PubMed

Valenzuela Melendres, M; Camou, J P; Torrentera Olivera, N G; Alvarez Almora, E; González Mendoza, D; Avendaño Reyes, L; González Ríos, H

2014-05-01

Response surface methodology was used to study the effect of flaxseed flour (FS) and tomato paste (TP) addition, from 0 to 10% and 0 to 20% respectively, on beef patty quality characteristics. The assessed quality characteristics were color (L, a, and b), pH and texture profile analysis (TPA). Also, sensory analysis was performed for the assessment of color, juiciness, firmness, and general acceptance. FS addition reduced L and a values and decreased weight loss of cooked products (P<0.05). An opposite effect was observed when TP was added (P<0.05). All TPA parameters decreased when percentages of FS and TP were increased in the formulation of beef patties. Furthermore, FS and TP addition adversely affected the sensory characteristics of the cooked product (P<0.05); nevertheless, all sensory characteristics evaluated had an acceptable score (>5.6). Thus FS and TP are ingredients that can be used in beef patty preparation. Copyright © 2014 Elsevier Ltd. All rights reserved.

Development of cookies made with cocoyam, fermented sorghum and germinated pigeon pea flour blends using response surface methodology.

PubMed

Okpala, Laura C; Okoli, Eric C

2014-10-01

Cookies were produced from blends of cocoyam, fermented sorghum and germinated pigeon pea flours. The study was carried out to evaluate the effects of varying the proportions of these components on the sensory and protein quality of the cookies. The sensory attributes studied were colour, taste, texture, crispness and general acceptability while the protein quality indices were biological value (BV) and net protein utilization (NPU). Mixture response surface methodology was used to model the sensory and protein quality with single, binary and ternary combinations of germinated pigeon pea, fermented sorghum and cocoyam flours. Results showed that BV and NPU of most of the cookies were above minimum acceptable levels. With the exception of cookies containing high levels of pigeon pea flour, cookies had acceptable sensory scores. Increase in pigeon pea flour resulted in increase in the BV and NPU. Regression equations suggested that the ternary blends produced the highest increase in all the sensory attributes (with the exception of colour).

On the performance of metrics to predict quality in point cloud representations

NASA Astrophysics Data System (ADS)

Alexiou, Evangelos; Ebrahimi, Touradj

2017-09-01

Point clouds are a promising alternative for immersive representation of visual contents. Recently, an increased interest has been observed in the acquisition, processing and rendering of this modality. Although subjective and objective evaluations are critical in order to assess the visual quality of media content, they still remain open problems for point cloud representation. In this paper we focus our efforts on subjective quality assessment of point cloud geometry, subject to typical types of impairments such as noise corruption and compression-like distortions. In particular, we propose a subjective methodology that is closer to real-life scenarios of point cloud visualization. The performance of the state-of-the-art objective metrics is assessed by considering the subjective scores as the ground truth. Moreover, we investigate the impact of adopting different test methodologies by comparing them. Advantages and drawbacks of every approach are reported, based on statistical analysis. The results and conclusions of this work provide useful insights that could be considered in future experimentation.

Interventions to Improve Parental Communication About Sex: A Systematic Review

PubMed Central

Holland, Cynthia L.; Bost, James

2011-01-01

CONTEXT: The relative effectiveness of interventions to improve parental communication with adolescents about sex is not known. OBJECTIVE: To compare the effectiveness and methodologic quality of interventions for improving parental communication with adolescents about sex. METHODS: We searched 6 databases: OVID/Medline, PsychInfo, ERIC, Cochrane Review, Communication and Mass Media, and the Cumulative Index to Nursing and Allied Health Literature. We included studies published between 1980 and July 2010 in peer-reviewed English-language journals that targeted US parents of adolescents aged 11 to 18 years, used an experimental or quasi-experimental design, included a control group, and had a pretest/posttest design. We abstracted data on multiple communication outcomes defined by the integrative conceptual model (communication frequency, content, skills, intentions, self-efficacy, perceived environmental barriers/facilitators, perceived social norms, attitudes, outcome expectations, knowledge, and beliefs). Methodologic quality was assessed using the 11-item methodologic quality score. RESULTS: Twelve studies met inclusion criteria. Compared with controls, parents who participated in these interventions experienced improvements in multiple communication domains including the frequency, quality, intentions, comfort, and self-efficacy for communicating. We noted no effects on parental attitudes toward communicating or the outcomes they expected to occur as a result of communicating. Four studies were of high quality, 7 were of medium quality, and 1 was of lower quality. CONCLUSIONS: Our review was limited by the lack of standardized measures for assessing parental communication. Still, interventions for improving parent-adolescent sex communication are well designed and have some targeted effects. Wider dissemination could augment efforts by schools, clinicians, and health educators. PMID:21321027

Interventions to improve parental communication about sex: a systematic review.

PubMed

Akers, Aletha Y; Holland, Cynthia L; Bost, James

2011-03-01

The relative effectiveness of interventions to improve parental communication with adolescents about sex is not known. To compare the effectiveness and methodologic quality of interventions for improving parental communication with adolescents about sex. We searched 6 databases: OVID/Medline, PsychInfo, ERIC, Cochrane Review, Communication and Mass Media, and the Cumulative Index to Nursing and Allied Health Literature. We included studies published between 1980 and July 2010 in peer-reviewed English-language journals that targeted US parents of adolescents aged 11 to 18 years, used an experimental or quasi-experimental design, included a control group, and had a pretest/posttest design. We abstracted data on multiple communication outcomes defined by the integrative conceptual model (communication frequency, content, skills, intentions, self-efficacy, perceived environmental barriers/facilitators, perceived social norms, attitudes, outcome expectations, knowledge, and beliefs). Methodologic quality was assessed using the 11-item methodologic quality score. Twelve studies met inclusion criteria. Compared with controls, parents who participated in these interventions experienced improvements in multiple communication domains including the frequency, quality, intentions, comfort, and self-efficacy for communicating. We noted no effects on parental attitudes toward communicating or the outcomes they expected to occur as a result of communicating. Four studies were of high quality, 7 were of medium quality, and 1 was of lower quality. Our review was limited by the lack of standardized measures for assessing parental communication. Still, interventions for improving parent-adolescent sex communication are well designed and have some targeted effects. Wider dissemination could augment efforts by schools, clinicians, and health educators.

Transitions, Risks, and Actions in Coronary Events--Center for Outcomes Research and Education (TRACE-CORE): design and rationale.

PubMed

Waring, Molly E; McManus, Richard H; Saczynski, Jane S; Anatchkova, Milena D; McManus, David D; Devereaux, Randolph S; Goldberg, Robert J; Allison, Jeroan J; Kiefe, Catarina I

2012-09-01

Cardiovascular disease continues to cause significant morbidity, mortality, and impaired quality of life, with unrealized health gains from the underuse of available evidence. The Transitions, Risks, and Actions in Coronary Events Center for Outcomes Research and Education (TRACE-CORE) aims to advance the science of acute coronary syndromes by examining the determinants and outcomes of the quality of transition from hospital to community and by quantifying the impact of potentially modifiable characteristics associated with decreased quality of life, rehospitalization, and mortality. TRACE-CORE comprises a longitudinal multiracial cohort of patients hospitalized with acute coronary syndromes, 2 research projects, and development of a nucleus of early stage investigators. We are currently enrolling 2500 adults hospitalized for acute coronary syndromes at 6 hospitals in the northeastern and southeastern United States. We will follow these patients for 24 months after hospitalization through medical record abstraction and 5 patient interviews focusing on quality of life, cardiac events, rehospitalizations, mortality, and medical, behavioral, and psychosocial characteristics. The Transitions Project studies determinants of and disparities in outcomes of the quality of patients' transition from hospital to community. Focusing on potentially modifiable factors, the Action Scores Project will develop and validate action scores to predict recurrent cardiac events, death, and quality of life, describe longitudinal variation in these scores, and develop a dashboard for patient and provider action on the basis of these scores. In TRACE-CORE, sound methodologic principles of observational studies converge with outcomes and effectiveness research approaches. We expect that our data, research infrastructure, and research projects will inform the development of novel secondary prevention approaches and underpin the careers of cardiovascular outcomes researchers.

Systematic reviews and meta-analyses on psoriasis: role of funding sources, conflict of interest and bibliometric indices as predictors of methodological quality.

PubMed

Gómez-García, F; Ruano, J; Aguilar-Luque, M; Gay-Mimbrera, J; Maestre-Lopez, B; Sanz-Cabanillas, J L; Carmona-Fernández, P J; González-Padilla, M; Vélez García-Nieto, A; Isla-Tejera, B

2017-06-01

The quality of systematic reviews and meta-analyses on psoriasis, a chronic inflammatory skin disease that severely impairs quality of life and is associated with high costs, remains unknown. To assess the methodological quality of systematic reviews published on psoriasis. After a comprehensive search in MEDLINE, Embase and the Cochrane Database (PROSPERO: CDR42016041611), the quality of studies was assessed by two raters using the Assessment of Multiple Systematic Reviews (AMSTAR) tool. Article metadata and journal-related bibliometric indices were also obtained. Systematic reviews were classified as low (0-4), moderate (5-8) or high (9-11) quality. A prediction model for methodological quality was fitted using principal component and multivariate ordinal logistic regression analyses. We classified 220 studies as high (17·2%), moderate (55·0%) or low (27·8%) quality. Lower compliance rates were found for AMSTAR question (Q)5 (list of studies provided, 11·4%), Q10 (publication bias assessed, 27·7%), Q4 (status of publication included, 39·5%) and Q1 (a priori design provided, 40·9%). Factors such as meta-analysis inclusion [odds ratio (OR) 6·22; 95% confidence interval (CI) 2·78-14·86], funding by academic institutions (OR 2·90, 95% CI 1·11-7·89), Article Influence score (OR 2·14, 95% CI 1·05-6·67), 5-year impact factor (OR 1·34, 95% CI 1·02-1·40) and article page count (OR 1·08, 95% CI 1·02-1·15) significantly predicted higher quality. A high number of authors with a conflict of interest (OR 0·90, 95% CI 0·82-0·99) was significantly associated with lower quality. The methodological quality of systematic reviews published about psoriasis remains suboptimal. The type of funding sources and author conflicts may compromise study quality, increasing the risk of bias. © 2017 British Association of Dermatologists.

How do you know things are getting better (or not?) Assessing resource conditions in National Parks and Protected Areas

Treesearch

James D. Nations

2011-01-01

The National Parks Conservation Association’s Center for State of the Parks uses an easily explained, fact-based methodology to determine the condition of natural and cultural resources in the United States National Park System. Researchers assess and numerically score natural resources that include water quality and quantity, climate change impacts, forest...

A Quality Improvement Activity to Promote Interprofessional Collaboration Among Health Professions Students

PubMed Central

Stevenson, Katherine; Busch, Angela; Scott, Darlene J.; Henry, Carol; Wall, Patricia A.

2009-01-01

Objectives To develop and evaluate a classroom-based curriculum designed to promote interprofessional competencies by having undergraduate students from various health professions work together on system-based problems using quality improvement (QI) methods and tools to improve patient-centered care. Design Students from 4 health care programs (nursing, nutrition, pharmacy, and physical therapy) participated in an interprofessional QI activity. In groups of 6 or 7, students completed pre-intervention and post-intervention reflection tools on attitudes relating to interprofessio nal teams, and a tool designed to evaluate group process. Assessment One hundred thirty-four students (76.6%) completed both self-reflection instruments, and 132 (74.2%) completed the post-course group evaluation instrument. Although already high prior to the activity, students' mean post-intervention reflection scores increased for 12 of 16 items. Post-intervention group evaluation scores reflected a high level of satisfaction with the experience. Conclusion Use of a quality-based case study and QI methodology were an effective approach to enhancing interprofessional experiences among students. PMID:19657497

Prediction models for Arabica coffee beverage quality based on aroma analyses and chemometrics.

PubMed

Ribeiro, J S; Augusto, F; Salva, T J G; Ferreira, M M C

2012-11-15

In this work, soft modeling based on chemometric analyses of coffee beverage sensory data and the chromatographic profiles of volatile roasted coffee compounds is proposed to predict the scores of acidity, bitterness, flavor, cleanliness, body, and overall quality of the coffee beverage. A partial least squares (PLS) regression method was used to construct the models. The ordered predictor selection (OPS) algorithm was applied to select the compounds for the regression model of each sensory attribute in order to take only significant chromatographic peaks into account. The prediction errors of these models, using 4 or 5 latent variables, were equal to 0.28, 0.33, 0.35, 0.33, 0.34 and 0.41, for each of the attributes and compatible with the errors of the mean scores of the experts. Thus, the results proved the feasibility of using a similar methodology in on-line or routine applications to predict the sensory quality of Brazilian Arabica coffee. Copyright © 2012 Elsevier B.V. All rights reserved.

Practice Guideline Recommendations on Perioperative Fasting: A Systematic Review.

PubMed

Lambert, Eva; Carey, Sharon

2016-11-01

Traditionally, perioperative fasting consisted of being nil by mouth (NBM) from midnight before surgery and fasting postoperatively until recovery of bowel function. These outdated practices persist despite emerging evidence revealing that excessive fasting results in negative outcomes and delayed recovery. Various evidence-based, multimodal, enhanced recovery protocols incorporating minimized perioperative fasting have arisen to improve patient outcomes and streamline recovery, but implementation remains limited. This article aims to review current fasting guidelines, assess their quality, summarize relevant recommendations, and identify gaps in evidence. A systematic literature search of Medline and CINAHL and a manual search of relevant websites identified guidelines containing suitable grading systems and fasting recommendations. Guideline quality was assessed using the Appraisal of Guidelines Research and Evaluation (AGREE) tool. Grading systems were standardized to the American Society for Parenteral and Enteral Nutrition format and recommendations summarized based on grading and guideline quality. Nineteen guidelines were included. Rigor of development scores ranged from 29%-95%, with only 8 guidelines explicitly declaring the use of systematic methodology. Applicability scores were lowest, averaging 32%. Ten recommendation types were extracted and summarized. Strong and consistent evidence exists for the minimization of perioperative fasting, for a 2-hour preoperative fast after clear fluids, and for early recommencement of oral food and fluid intake postoperatively. This article presents several high-level recommendations ready for immediate implementation, while poorly graded and inconsistent recommendations reveal key areas for future research. Meanwhile, guideline quality requires improvement, especially regarding rigor of development and applicability, through systematic methodology, reporting transparency, and implementation strategies. © 2015 American Society for Parenteral and Enteral Nutrition.

Differences in Nursing Home Quality Between Medicare Advantage and Traditional Medicare Patients.

PubMed

Chang, Emiley; Ruder, Teague; Setodji, Claude; Saliba, Debra; Hanson, Mark; Zingmond, David S; Wenger, Neil S; Ganz, David A

2016-10-01

Medicare Advantage (MA) enrollment is steadily growing, but little is known about the quality of nursing home (NH) care provided to MA enrollees compared to enrollees in traditional fee-for-service (FFS) Medicare. To compare MA and FFS enrollees' quality of NH care. Cross-sectional. US nursing homes. 2.17 million Medicare enrollees receiving care at an NH during 2011. CMS methodology was used to calculate the 18 Nursing Home Compare quality measures as applicable for each enrollee. Among Medicare enrollees using NH in 2011, 17% were in MA plans. Most quality scores were similar between MA and FFS. After adjusting for facility, beneficiary age and gender, CMS Hierarchical Condition Category score, and geographic region, short-stay MA enrollees had statistically significantly lower rates of new or worsening pressure ulcers [relative risk (RR) = 0.76, 95% confidence interval (CI) = 0.71-0.82] and new antipsychotic use (RR = 0.82, 95% CI = 0.80-0.83) but higher rates of moderate to severe pain (RR = 1.09, 95% CI = 1.07-1.12), compared with short-stay FFS enrollees. MA long-stay enrollees had lower rates of antipsychotic use (RR = 0.94, 95% CI = 0.93-0.96) but had higher rates of incontinence (RR = 1.08, 95% CI = 1.06-1.09) and urinary catheterization (RR = 1.10, 95% CI = 1.06-1.13), compared with long-stay FFS enrollees. Overall, we found few differences in NH quality scores between MA and FFS Medicare enrollees. MA enrollment was associated with better scores for pressure ulcers and antipsychotic use but worse scores for pain control, incontinence, and urinary catheterization. Results may be limited by residual case-mix differences between MA and FFS patients or by the small number of short-stay measures reported. Copyright © 2016 AMDA - The Society for Post-Acute and Long-Term Care Medicine. All rights reserved.

Derivation of Two Critical Appraisal Scores for Trainees to Evaluate Online Educational Resources: A METRIQ Study

PubMed Central

Chan, Teresa M.; Thoma, Brent; Krishnan, Keeth; Lin, Michelle; Carpenter, Christopher R.; Astin, Matt; Kulasegaram, Kulamakan

2016-01-01

Introduction Online education resources (OERs), like blogs and podcasts, increasingly augment or replace traditional medical education resources such as textbooks and lectures. Trainees’ ability to evaluate these resources is poor, and few quality assessment aids have been developed to assist them. This study aimed to derive a quality evaluation instrument for this purpose. Methods We used a three-phase methodology. In Phase 1, a previously derived list of 151 OER quality indicators was reduced to 13 items using data from published consensus-building studies (of medical educators, expert podcasters, and expert bloggers) and subsequent evaluation by our team. In Phase 2, these 13 items were converted to seven-point Likert scales used by trainee raters (n=40) to evaluate 39 OERs. The reliability and usability of these 13 rating items was determined using responses from trainee raters, and top items were used to create two OER quality evaluation instruments. In Phase 3, these instruments were compared to an external certification process (the ALiEM AIR certification) and the gestalt evaluation of the same 39 blog posts by 20 faculty educators. Results Two quality-evaluation instruments were derived with fair inter-rater reliability: the METRIQ-8 Score (Inter class correlation coefficient [ICC]=0.30, p<0.001) and the METRIQ-5 Score (ICC=0.22, p<0.001). Both scores, when calculated using the derivation data, correlated with educator gestalt (Pearson’s r=0.35, p=0.03 and r=0.41, p<0.01, respectively) and were related to increased odds of receiving an ALiEM AIR certification (odds ratio=1.28, p=0.03; OR=1.5, p=0.004, respectively). Conclusion Two novel scoring instruments with adequate psychometric properties were derived to assist trainees in evaluating OER quality and correlated favourably with gestalt ratings of online educational resources by faculty educators. Further testing is needed to ensure these instruments are accurate when applied by trainees. PMID:27625722

Derivation of Two Critical Appraisal Scores for Trainees to Evaluate Online Educational Resources: A METRIQ Study.

PubMed

Chan, Teresa M; Thoma, Brent; Krishnan, Keeth; Lin, Michelle; Carpenter, Christopher R; Astin, Matt; Kulasegaram, Kulamakan

2016-09-01

Online education resources (OERs), like blogs and podcasts, increasingly augment or replace traditional medical education resources such as textbooks and lectures. Trainees' ability to evaluate these resources is poor, and few quality assessment aids have been developed to assist them. This study aimed to derive a quality evaluation instrument for this purpose. We used a three-phase methodology. In Phase 1, a previously derived list of 151 OER quality indicators was reduced to 13 items using data from published consensus-building studies (of medical educators, expert podcasters, and expert bloggers) and subsequent evaluation by our team. In Phase 2, these 13 items were converted to seven-point Likert scales used by trainee raters (n=40) to evaluate 39 OERs. The reliability and usability of these 13 rating items was determined using responses from trainee raters, and top items were used to create two OER quality evaluation instruments. In Phase 3, these instruments were compared to an external certification process (the ALiEM AIR certification) and the gestalt evaluation of the same 39 blog posts by 20 faculty educators. Two quality-evaluation instruments were derived with fair inter-rater reliability: the METRIQ-8 Score (Inter class correlation coefficient [ICC]=0.30, p<0.001) and the METRIQ-5 Score (ICC=0.22, p<0.001). Both scores, when calculated using the derivation data, correlated with educator gestalt (Pearson's r=0.35, p=0.03 and r=0.41, p<0.01, respectively) and were related to increased odds of receiving an ALiEM AIR certification (odds ratio=1.28, p=0.03; OR=1.5, p=0.004, respectively). Two novel scoring instruments with adequate psychometric properties were derived to assist trainees in evaluating OER quality and correlated favourably with gestalt ratings of online educational resources by faculty educators. Further testing is needed to ensure these instruments are accurate when applied by trainees.

What is the effectiveness of obesity related interventions at retail grocery stores and supermarkets? -a systematic review.

PubMed

Adam, Abdulfatah; Jensen, Jørgen D

2016-12-28

The Prevalence of obesity and overweight has been increasing in many countries. Many factors have been identified as contributing to obesity including the food environment, especially the access, availability and affordability of healthy foods in grocery stores and supermarkets. Several interventions have been carried out in retail grocery/supermarket settings as part of an effort to understand and influence consumption of healthful foods. The review's key outcome variable is sale/purchase of healthy foods as a result of the interventions. This systematic review sheds light on the effectiveness of food store interventions intended to promote the consumption of healthy foods and the methodological quality of studies reporting them. Systematic literature search spanning from 2003 to 2015 (inclusive both years), and confined to papers in the English language was conducted. Studies fulfilling search criteria were identified and critically appraised. Studies included in this review report health interventions at physical food stores including supermarkets and corner stores, and with outcome variable of adopting healthier food purchasing/consumption behavior. The methodological quality of all included articles has been determined using a validated 16-item quality assessment tool (QATSDD). The literature search identified 1580 publications, of which 42 met the inclusion criteria. Most interventions used a combination of information (e.g. awareness raising through food labeling, promotions, campaigns, etc.) and increasing availability of healthy foods such as fruits and vegetables. Few used price interventions. The average quality score for all papers is 65.0%, or an overall medium methodological quality. Apart from few studies, most studies reported that store interventions were effective in promoting purchase of healthy foods. Given the diverse study settings and despite the challenges of methodological quality for some papers, we find efficacy of in-store healthy food interventions in terms of increased purchase of healthy foods. Researchers need to take risk of bias and methodological quality into account when designing future studies that should guide policy makers. Interventions which combine price, information and easy access to and availability of healthy foods with interactive and engaging nutrition information, if carefully designed can help customers of food stores to buy and consume more healthy foods.

Health-Related Quality of Life in Non–Small-Cell Lung Cancer: An Update of a Systematic Review on Methodologic Issues in Randomized Controlled Trials

PubMed Central

Claassens, Lily; van Meerbeeck, Jan; Coens, Corneel; Quinten, Chantal; Ghislain, Irina; Sloan, Elizabeth K.; Wang, Xin Shelly; Velikova, Galina; Bottomley, Andrew

2011-01-01

Purpose This study is an update of a systematic review of health-related quality-of-life (HRQOL) methodology reporting in non–small-cell lung cancer (NSCLC) randomized controlled trials (RCTs). The objective was to evaluate HRQOL methodology reporting over the last decade and its benefit for clinical decision making. Methods A MEDLINE systematic literature review was performed. Eligible RCTs implemented patient-reported HRQOL assessments and regular oncology treatments for newly diagnosed adult patients with NSCLC. Included studies were published in English from August 2002 to July 2010. Two independent reviewers evaluated all included RCTs. Results Fifty-three RCTs were assessed. Of the 53 RCTs, 81% reported that there was no significant difference in overall survival (OS). However, 50% of RCTs that were unable to find OS differences reported a significant difference in HRQOL scores. The quality of HRQOL reporting has improved; both reporting of clinically significant differences and statistical testing of HRQOL have improved. A European Organisation for Research and Treatment of Cancer HRQOL questionnaire was used in 57% of the studies. However, reporting of HRQOL hypotheses and rationales for choosing HRQOL instruments were significantly less than before 2002 (P < .05). Conclusion The number of NSCLC RCTs incorporating HRQOL assessments has considerably increased. HRQOL continues to demonstrate its importance in RCTs, especially in those studies in which no OS difference is found. Despite the improved quality of HRQOL methodology reporting, certain aspects remain underrepresented. Our findings suggest need for an international standardization of HRQOL reporting similar to the CONSORT guidelines for clinical findings. PMID:21464420

Cross-cultural adaptation and measurement properties of generic and cancer-related patient-reported outcome measures (PROMs) for use with cancer patients in Brazil: a systematic review.

PubMed

Albach, Carlos Augusto; Wagland, Richard; Hunt, Katherine J

2018-04-01

This systematic review (1) identifies the current generic and cancer-related patient-reported outcome measures (PROMs) that have been cross-culturally adapted to Brazilian Portuguese and applied to cancer patients and (2) critically evaluates their cross-cultural adaptation (CCA) and measurement properties. Seven databases were searched for articles regarding the translation and evaluation of measurement properties of generic and cancer-related PROMs cross-culturally adapted to Brazilian Portuguese that are applied in adult (≥18 years old) cancer patients. The methodological quality of included studies was assessed using the COSMIN checklist. The bibliographic search retrieved 1674 hits, of which seven studies analysing eight instruments were included in this review. Data on the interpretability of scores were poorly reported. Overall, the quality of the CCA process was inconsistent throughout the studies. None of the included studies performed a cross-cultural validation. The evidence concerning the quality of measurement properties is limited by poor or fair methodological quality. Moreover, limited information regarding measurement properties was provided within the included papers. This review aids the selection process of Brazilian Portuguese PROMs for use in cancer patients. After acknowledging the methodological caveats and strengths of each tool, our opinion is that for quality of life and symptoms assessment the adapted FACT-G version and the ESAS could be recommended, respectively. Future research should rely on the already accepted standards of CCA and validation studies.

Quality assessment of recent evidence-based clinical practice guidelines for management of type 2 diabetes mellitus in adults using the AGREE II instrument.

PubMed

Anwer, Muhammad A; Al-Fahed, Ousama B; Arif, Samir I; Amer, Yasser S; Titi, Maher A; Al-Rukban, Mohammed O

2018-02-01

Type 2 diabetes mellitus (T2DM) is a worldwide and national public health problem that has a great impact on the population in Saudi Arabia. High-quality clinical practice guidelines (CPGs) are cornerstones in improving the health care provided for patients with diabetes. This study evaluated the methodological rigour, transparency, and applicability of recently published CPGs. Our group conducted a systematic search for recently published CPGs for T2DM. The searching and screening for Source CPGs were guided by tools from the ADAPTE methods with specific inclusion/exclusion criteria. Five reviewers using the second version of the Appraisal of Guidelines for Research and Evaluation (AGREE II) Instrument independently assessed the quality of the retrieved Source CPGs. Domains of Scope and purpose and Clarity of presentation received the highest scores in all CPGs. Most of the assessed CPGs (86%) were considered with high overall quality and were recommended for use. Rigour of development and applicability domains were together highest in 3 CPGs (43%). The overall high quality of DM CPGs published in the last 3 years demonstrated the continuous development and improvement in CPG methodologies and standards. Health care professionals should consider the quality of any CPG for T2DM before deciding to use it in their daily clinical practice. Three CPGs have been identified, using the AGREE criteria, as high-quality and trustworthy. Ideally, the resources provided by the AGREE trust including the AGREE II Instrument should be used by a clinician to scan through the large number of published T2DM CPGs to identify the CPGs with high methodological quality and applicability. © 2017 John Wiley & Sons, Ltd.

The quality of quality of life publications in the spinal literature: are we getting any better?

PubMed

Street, John; Lenehan, Brian; Fisher, Charles

2009-11-01

Criteria for methodological quality have been widely accepted in many fields of surgical practice. These criteria include those of Velanovich and Gill and Feinstein. No such analysis of the spine surgery literature has ever been reported. This study is a systematic review of the quality of life (QOL) publications to determine if the recent interest in QOL measurements following spinal surgery has been accompanied by an improvement in the quality of the papers published. The archives of the journals Journal of Neurosurgery: Spine, Spine, Journal of Spinal Disorders & Techniques, European Spine Journal, and The Spine Journal, for the years 2000-2004 inclusive, were examined, and all publications reporting QOL outcomes were analyzed. Each paper was scored according to the criteria of Velanovich and Gill and Feinstein, and the methodological quality of these manuscripts-and any time-dependent changes-were determined. During the study period, the total number of articles published increased by 36%, while the number of QOL articles increased by 102%. According to the criteria of Velanovich, there was a statistically significant improvement in the quality of the publications over the study period (p = 0.0394). In 2000, only 27% of outcome measures were disease specific, 77% were valid, and 77% were appropriate for the study design. In 2004, 43% were disease specific, 88% were valid, and 89% were appropriate. In 2000, 53% of studies used appropriate statistical analysis compared with 100 and 96% for 2003 and 2004, respectively. There was no demonstrable improvement in the fulfillment of the more rigorous Gill and Feinstein criteria for any of the 5 journals over the period of the study. The authors' study illustrates a moderate improvement in the quality of these publications over the study period but much methodological improvement is required.

Quality Assessment of TPB-Based Questionnaires: A Systematic Review

PubMed Central

Oluka, Obiageli Crystal; Nie, Shaofa; Sun, Yi

2014-01-01

Objective This review is aimed at assessing the quality of questionnaires and their development process based on the theory of planned behavior (TPB) change model. Methods A systematic literature search for studies with the primary aim of TPB-based questionnaire development was conducted in relevant databases between 2002 and 2012 using selected search terms. Ten of 1,034 screened abstracts met the inclusion criteria and were assessed for methodological quality using two different appraisal tools: one for the overall methodological quality of each study and the other developed for the appraisal of the questionnaire content and development process. Both appraisal tools consisted of items regarding the likelihood of bias in each study and were eventually combined to give the overall quality score for each included study. Results 8 of the 10 included studies showed low risk of bias in the overall quality assessment of each study, while 9 of the studies were of high quality based on the quality appraisal of questionnaire content and development process. Conclusion Quality appraisal of the questionnaires in the 10 reviewed studies was successfully conducted, highlighting the top problem areas (including: sample size estimation; inclusion of direct and indirect measures; and inclusion of questions on demographics) in the development of TPB-based questionnaires and the need for researchers to provide a more detailed account of their development process. PMID:24722323

[Clinical applicability of evidence-based orthopedics--a cross-sectional study of the quality of orthopedic evidence].

PubMed

Vavken, P; Culen, G; Dorotka, R

2008-01-01

The demand to routinely apply evidence-based methods in orthopedic surgery increases steadily. In order to do so, however, the validity and reliability of the "evidence" has to be scrutinized. The object of this study was to assess the quality of the most recent orthopedic evidence and to determine variables that have an influence on quality. All 2006 controlled trials from orthopedic journals with high impact factors were analysed in a cross-sectional study. A score based on the CONSORT statement was used to assess study quality. Selected variables were tested for their influence on the quality of the study. Two independent blinded observers reviewed 126 studies. The overall quality was moderate to high. The most neglected parameters were power analysis, intention-to-treat, and concealment. The participation of a methodologically trained investigator increases study quality significantly. There was no difference in study quality irrespective of whether or not there was statistically significant result. Using our quality score we were able show fairly good results for recent orthopedic studies. The most frequently neglected issues in orthopedic research are blinding, power analysis, and intention-to-treat. This may distort the results of clinical investigations considerably and, especially, lack of concealment causes false-positive findings. Our data show furthermore that participation of a methodologist significantly increases quality of the study and consequently strengthens the reliability of results.

Methodological review of the quality of reach out and read: does it "work"?

PubMed

Yeager Pelatti, Christina; Pentimonti, Jill M; Justice, Laura M

2014-04-01

A considerable percentage of American children and adults fail to learn adequate literacy skills and read below a third grade level. Shared book reading is perhaps the single most important activity to prepare young children for success in reading. The primary objective of this manuscript was to critically review the methodological quality of Read Out and Read (ROR), a clinically based literacy program/intervention that teaches parents strategies to incorporate while sharing books with children as a method of preventing reading difficulties and academic struggles. A PubMed search was conducted. Articles that met three criteria were considered. First, the study must be clinically based and include parent contact with a pediatrician. Second, parental counseling ("anticipatory guidance") about the importance of parent-child book reading must be included. Third, only experimental or quasi-experimental studies were included; no additional criteria were used. Published articles from any year and peer-reviewed journal were considered. Study quality was determined using a modified version of the Downs and Black (1998) checklist assessing four categories: (1) Reporting, (2) External Validity, (3) Internal Validity-Bias, and (4) Internal Validity-Confounding. We were also interested in whether quality differed based on study design, children's age, sample size, and study outcome. Eleven studies met the inclusion criteria. The overall quality of evidence was variable across all studies; Reporting and External Validity categories were relatively strong while methodological concerns were found in the area of internal validity. Quality scores differed on the four study characteristics. Implications related to clinical practice and future studies are discussed.

The Quality of Randomized Controlled Trials in Pediatric Orthopaedics: Are We Improving?

PubMed

Dodwell, Emily; Dua, Shiv; Dulai, Sukhdeep K; Astone, Kristina; Mulpuri, Kishore

2015-01-01

The quality of randomized controlled trials (RCTs) in orthopaedics is a topic of considerable importance, as RCTs play a major role in guiding clinical practice. The quality of RCTs published between 1995 and 2005 has previously been documented. The purpose of the current study was to assess and describe the quality of pediatric orthopaedic RCTs published from 2005 to 2012, by identifying study characteristics associated with higher quality and outlining areas for improvement. A standardized literature search was used to identify pediatric orthopaedic RCTs published in 7 well-recognized journals between September 2005 and July 2012 inclusive. The Detsky Quality Assessment Scale and the CONSORT checklist for Non-Pharmacologic Trials were used to assess the quality of the RCTs. Scores for the Detsky and CONSORT were calculated by 2 independent blinded orthopaedic surgeon reviewers with epidemiologic training. Forty RCTs were included in this analysis. The mean percentage score on the Detsky quality scale was 67%. Sixteen (40%) of the articles satisfied the threshold for a satisfactory level of methodological quality (Detsky >75%). Twenty-five (63%) of these studies were negative studies, concluding no difference between treatment arms. In 52% of the negative studies, an a priori sample size analysis was absent, and 28% were self-described as underpowered. In multiple variable regression analysis, only working with a statistician was significantly associated with higher Detsky percentage scores (P=0.01). There is a trend for improving quality in pediatric orthopaedic RCTs. Compared with past reports, the mean Detsky score improved from 53% to 67%, and the proportion meeting an acceptable level of quality improved from 19% to 40%. One of the most concerning findings of this study was the lack of attention to sample size and power analysis, and the potential for underpowered studies. Ongoing efforts are necessary to improve the conduct and reporting of clinical trials in pediatric orthopaedics. Pediatric orthopaedic surgeons, JPO, and POSNA are working toward improving levels of quality in pediatric orthopaedic research. This paper highlights progress that has been made, and addresses some high-yield areas for future improvement.

Association between framing of the research question using the PICOT format and reporting quality of randomized controlled trials

PubMed Central

2010-01-01

Background Experts recommend formulating a structured research question to guide the research design. However, the basis for this recommendation has not been formally evaluated. The aim of this study was to examine if a structured research question using the PICOT (Population, Intervention, Comparator, Outcome, Time-frame) format is associated with a better reporting quality of randomized controlled trials (RCTs). Methods We evaluated 89 RCTs reports published in three endocrinology journals in 2005 and 2006, the quality of reporting of which was assessed in a previous study. We examined whether the reports stated each of the five elements of a structured research question: population, intervention, comparator, outcome and time-frame. A PICOT score was created with a possible score between 0 and 5. Outcomes were: 1) a 14-point overall reporting quality score (OQS) based on the Consolidated Standards for Reporting Trials; and 2) a 3-point key score (KS), based on allocation concealment, blinding and use of intention-to-treat analysis. We conducted multivariable regression analyses using generalized estimating equations to determine if a higher PICOT score or the use of a structured research question were independently associated with a better reporting quality. Journal of publication, funding source and sample size were identified as factors associated with OQS in our previous report on this dataset, and therefore included in the model. Results A higher PICOT score was independently associated with OQS (incidence rate ratio (IRR) = 1.021, 95% CI: 1.012 to 1.029) and KS (IRR = 1.142, 95% CI: 1.079 to 1.210). A structured research question was present in 33.7% of the reports and it was associated with a better OQS (IRR = 1.095, 95% CI 1.059-1.132) and KS (IRR = 1.530, 95% CI 1.311-1.786). Conclusions Better framing of the research question using the PICOT format is independently associated with better overall reporting quality - although the effect is small - and better reporting of key methodologies. PMID:20137069

Application of Six Sigma towards improving surgical outcomes.

PubMed

Shukla, P J; Barreto, S G; Nadkarni, M S

2008-01-01

Six Sigma is a 'process excellence' tool targeting continuous improvement achieved by providing a methodology for improving key steps of a process. It is ripe for application into health care since almost all health care processes require a near-zero tolerance for mistakes. The aim of this study is to apply the Six Sigma methodology into a clinical surgical process and to assess the improvement (if any) in the outcomes and patient care. The guiding principles of Six Sigma, namely DMAIC (Define, Measure, Analyze, Improve, Control), were used to analyze the impact of double stapling technique (DST) towards improving sphincter preservation rates for rectal cancer. The analysis using the Six Sigma methodology revealed a Sigma score of 2.10 in relation to successful sphincter preservation. This score demonstrates an improvement over the previous technique (73% over previous 54%). This study represents one of the first clinical applications of Six Sigma in the surgical field. By understanding, accepting, and applying the principles of Six Sigma, we have an opportunity to transfer a very successful management philosophy to facilitate the identification of key steps that can improve outcomes and ultimately patient safety and the quality of surgical care provided.

Zhen Gan Xi Feng Decoction, a Traditional Chinese Herbal Formula, for the Treatment of Essential Hypertension: A Systematic Review of Randomized Controlled Trials

PubMed Central

Xiong, Xingjiang; Yang, Xiaochen; Feng, Bo; Liu, Wei; Duan, Lian; Gao, Ao; Li, Haixia; Ma, Jizheng; Du, Xinliang; Li, Nan; Wang, Pengqian; Su, Kelei; Chu, Fuyong; Zhang, Guohao; Li, Xiaoke; Wang, Jie

2013-01-01

Objectives. To assess the clinical effectiveness and adverse effects of Zhen Gan Xi Feng Decoction (ZGXFD) for essential hypertension (EH). Methods. Five major electronic databases were searched up to August 2012 to retrieve any potential randomized controlled trials designed to evaluate the clinical effectiveness of ZGXFD for EH reported in any language, with main outcome measure as blood pressure (BP). Results. Six randomized trials were included. Methodological quality of the trials was evaluated as generally low. Four trials compared prescriptions based on ZGXFD with antihypertensive drugs. Meta-analysis showed that ZGXFD was more effective in BP control and TCM syndrome and symptom differentiation (TCM-SSD) scores than antihypertensive drugs. Two trials compared the combination of modified ZGXFD plus antihypertensive drugs with antihypertensive drugs. Meta-analysis showed that there is significant beneficial effect on TCM-SSD scores. However, no significant effect on BP was found. The safety of ZGXFD is still uncertain. Conclusions. ZGXFD appears to be effective in improving blood pressure and hypertension-related symptoms for EH. However, the evidence remains weak due to poor methodological quality of the included studies. More rigorous trials are warranted to support their clinical use. PMID:23573163

Chest physiotherapy with positive expiratory pressure breathing after abdominal and thoracic surgery: a systematic review.

PubMed

Orman, J; Westerdahl, E

2010-03-01

A variety of chest physiotherapy techniques are used following abdominal and thoracic surgery to prevent or reduce post-operative complications. Breathing techniques with a positive expiratory pressure (PEP) are used to increase airway pressure and improve pulmonary function. No systematic review of the effects of PEP in surgery patients has been performed previously. The purpose of this systematic review was to determine the effect of PEP breathing after an open upper abdominal or thoracic surgery. A literature search of randomised-controlled trials (RCT) was performed in five databases. The trials included were systematically reviewed by two independent observers and critically assessed for methodological quality. We selected six RCT evaluating the PEP technique performed with a mechanical device in spontaneously breathing adult patients after abdominal or thoracic surgery via thoracotomy. The methodological quality score varied between 4 and 6 on the Physiotherapy Evidence Database score. The studies were published between 1979 and 1993. Only one of the included trials showed any positive effects of PEP compared to other breathing techniques. Today, there is scarce scientific evidence that PEP treatment is better than other physiotherapy breathing techniques in patients undergoing abdominal or thoracic surgery. There is a lack of studies investigating the effect of PEP over placebo or no physiotherapy treatment.

Optimal threshold estimator of a prognostic marker by maximizing a time-dependent expected utility function for a patient-centered stratified medicine.

PubMed

Dantan, Etienne; Foucher, Yohann; Lorent, Marine; Giral, Magali; Tessier, Philippe

2018-06-01

Defining thresholds of prognostic markers is essential for stratified medicine. Such thresholds are mostly estimated from purely statistical measures regardless of patient preferences potentially leading to unacceptable medical decisions. Quality-Adjusted Life-Years are a widely used preferences-based measure of health outcomes. We develop a time-dependent Quality-Adjusted Life-Years-based expected utility function for censored data that should be maximized to estimate an optimal threshold. We performed a simulation study to compare estimated thresholds when using the proposed expected utility approach and purely statistical estimators. Two applications illustrate the usefulness of the proposed methodology which was implemented in the R package ROCt ( www.divat.fr ). First, by reanalysing data of a randomized clinical trial comparing the efficacy of prednisone vs. placebo in patients with chronic liver cirrhosis, we demonstrate the utility of treating patients with a prothrombin level higher than 89%. Second, we reanalyze the data of an observational cohort of kidney transplant recipients: we conclude to the uselessness of the Kidney Transplant Failure Score to adapt the frequency of clinical visits. Applying such a patient-centered methodology may improve future transfer of novel prognostic scoring systems or markers in clinical practice.

Quality of Reporting and Study Design of CKD Cohort Studies Assessing Mortality in the Elderly Before and After STROBE: A Systematic Review

PubMed Central

Brück, Katharina; Methven, Shona; Evans, Rebecca; Stel, Vianda S.; Jager, Kitty J.; Hooft, Lotty; Ben-Shlomo, Yoav; Caskey, Fergus

2016-01-01

Background The STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) statement was published in October 2007 to improve quality of reporting of observational studies. The aim of this review was to assess the impact of the STROBE statement on observational study reporting and study design quality in the nephrology literature. Study Design Systematic literature review. Setting & Population European and North American, Pre-dialysis Chronic Kidney Disease (CKD) cohort studies. Selection Criteria for Studies Studies assessing the association between CKD and mortality in the elderly (>65 years) published from 1st January 2002 to 31st December 2013 were included, following systematic searching of MEDLINE & EMBASE. Predictor Time period before and after the publication of the STROBE statement. Outcome Quality of study reporting using the STROBE statement and quality of study design using the Newcastle Ottawa Scale (NOS), Scottish Intercollegiate Guidelines Network (SIGN) and Critical Appraisal Skills Programme (CASP) tools. Results 37 papers (11 Pre & 26 Post STROBE) were identified from 3621 potential articles. Only four of the 22 STROBE items and their sub-criteria (objectives reporting, choice of quantitative groups and description of and carrying out sensitivity analysis) showed improvements, with the majority of items showing little change between the period before and after publication of the STROBE statement. Pre- and post-period analysis revealed a Manuscript STROBE score increase (median score 77.8% (Inter-quartile range [IQR], 64.7–82.0) vs 83% (IQR, 78.4–84.9, p = 0.05). There was no change in quality of study design with identical median scores in the two periods for NOS (Manuscript NOS score 88.9), SIGN (Manuscript SIGN score 83.3) and CASP (Manuscript CASP score 91.7) tools. Limitations Only 37 Studies from Europe and North America were included from one medical specialty. Assessment of study design largely reliant on good reporting. Conclusions This study highlights continuing deficiencies in the reporting of STROBE items and their sub-criteria in cohort studies in nephrology. There was weak evidence of improvement in the overall reporting quality, with no improvement in methodological quality of CKD cohort studies between the period before and after publication of the STROBE statement. PMID:27168187

Decision Dissonance: Evaluating an Approach to Measuring the Quality of Surgical Decision Making

PubMed Central

Fowler, Floyd J.; Gallagher, Patricia M.; Drake, Keith M.; Sepucha, Karen R.

2013-01-01

Background Good decision making has been increasingly cited as a core component of good medical care, and shared decision making is one means of achieving high decision quality. If it is to be a standard, good measures and protocols are needed for assessing the quality of decisions. Consistency with patient goals and concerns is one defining characteristic of a good decision. A new method for evaluating decision quality for major surgical decisions was examined, and a methodology for collecting the needed data was developed. Methods For a national probability sample of fee-for-service Medicare beneficiaries who had a coronary artery bypass graft (CABG), a lumpectomy or a mastectomy for breast cancer, or surgery for prostate cancer during the last half of 2008, a mail survey of selected patients was carried out about one year after the procedures. Patients’ goals and concerns, knowledge, key aspects of interactions with clinicians, and feelings about the decisions were assessed. A Decision Dissonance Score was created that measured the extent to which patient ratings of goals ran counter to the treatment received. The construct and predictive validity of the Decision Dissonance Score was then assessed. Results When data were averaged across all four procedures, patients with more knowledge and those who reported more involvement reported significantly lower Decision Dissonance Scores. Patients with lower Decision Dissonance Scores also reported more confidence in their decisions and feeling more positively about how the treatment turned out, and they were more likely to say that they would make the same decision again. Conclusions Surveying discharged surgery patients is a feasible way to evaluate decision making, and Decision Dissonance appears to be a promising approach to validly measuring decision quality. PMID:23516764

Decision dissonance: evaluating an approach to measuring the quality of surgical decision making.

PubMed

Fowler, Floyd J; Gallagher, Patricia M; Drake, Keith M; Sepucha, Karen R

2013-03-01

Good decision making has been increasingly cited as a core component of good medical care, and shared decision making is one means of achieving high decision quality. If it is to be a standard, good measures and protocols are needed for assessing the quality of decisions. Consistency with patient goals and concerns is one defining characteristic of a good decision. A new method for evaluating decision quality for major surgical decisions was examined, and a methodology for collecting the needed data was developed. For a national probability sample of fee-for-service Medicare beneficiaries who had a coronary artery bypass graft (CABG), a lumpectomy or a mastectomy for breast cancer, or surgery for prostate cancer during the last half of 2008, a mail-survey of selected patients was carried out about one year after the procedures. Patients' goals and concerns, knowledge, key aspects of interactions with clinicians, and feelings about the decisions were assessed. A decision dissonance score was created that measured the extent to which patient ratings of goals ran counter to the treatment received. The construct and predictive validity of the decision dissonance score was then assessed. When data were averaged across all four procedures, patients with more knowledge and those who reported more involvement reported significantly lower Decision Dissonance Scores. Patients with lower Decision Dissonance Scores also reported more confidence in their decisions and feeling more positively about how the treatment turned out, and they were more likely to say that they would make the same decision again. Surveying discharged surgery patients is a feasible way to evaluate decision making, and Decision Dissonance appears to be a promising approach to validly measuring decision quality.

Validation of the Spine Oncology Study Group-Outcomes Questionnaire to assess quality of life in patients with metastatic spine disease.

PubMed

Janssen, Stein J; Teunis, Teun; van Dijk, Eva; Ferrone, Marco L; Shin, John H; Hornicek, Francis; Schwab, Joseph H

2017-06-01

General questionnaires are often used to assess quality of life in patients with spine metastases, although a disease-specific survey did not exist until recently. The Spine Oncology Study Group has developed an outcomes questionnaire (SOSG-OQ) to measure quality of life in these patients. However, a scoring system was not developed, and the questionnaire was not validated in a group of patients, nor was it compared with other general quality of life questionnaires such as the EuroQol 5 Dimensions (EQ-5D) questionnaire. Our primary null hypothesis is that there is no association between the SOSG-OQ and EQ-5D. Our secondary null hypothesis is that there is no difference in coverage and internal consistency between the SOSG-OQ and EQ-5D. We also assess coverage, consistency, and validity of the domains within the SOSG-OQ. A survey study from a tertiary care spine referral center was used for this study. The patient sample consisted of 82 patients with spine metastases, myeloma, or lymphoma. The SOSG-OQ (27 questions, 6 domains) score ranges from 0 to 80, with a higher score indicating worse quality of life. The EQ-5D (5 questions, 5 domains) index score ranges from 0 to 1, with a higher score indicating better quality of life. The association between the SOSG-OQ and EQ-5D index score was assessed using the Spearman rank correlation. Instrument coverage and precision were assessed by determining item completion rate, median score with range, and floor and ceiling effect. Internal consistency was assessed using Cronbach alpha. Multitrait analysis and exploratory factor analysis were used to analyze properties of the individual domains in the SOSG-OQ. The Spearman rank correlation between the SOSG-OQ and EQ-5D questionnaire was high (r=-0.83, p<.001). Internal consistency of the SOSG-OQ (0.92, 95% CI: 0.89-0.94) was higher as compared to the internal consistency of the EQ-5D (0.73, 95% CI: 0.63-0.84; p<.001). The SOSG-OQ score had no floor or ceiling effect indicating good coverage (median 30, range 3-64), whereas the EQ-5D had a ceiling effect of 10% (median 0.71, range 0.05-1). In conclusion, our study proposes a scoring methodology-after reversing four inversely scored items-for the SOSG-OQ and shows that the questionnaire is a valid tool for the assessment of quality of life in patients with metastatic spine disease. The SOSG-OQ is superior to the EQ-5D in terms of coverage and internal consistency but consists of more questions. Copyright © 2015 Elsevier Inc. All rights reserved.

A novel evaluation method for building construction project based on integrated information entropy with reliability theory.

PubMed

Bai, Xiao-ping; Zhang, Xi-wei

2013-01-01

Selecting construction schemes of the building engineering project is a complex multiobjective optimization decision process, in which many indexes need to be selected to find the optimum scheme. Aiming at this problem, this paper selects cost, progress, quality, and safety as the four first-order evaluation indexes, uses the quantitative method for the cost index, uses integrated qualitative and quantitative methodologies for progress, quality, and safety indexes, and integrates engineering economics, reliability theories, and information entropy theory to present a new evaluation method for building construction project. Combined with a practical case, this paper also presents detailed computing processes and steps, including selecting all order indexes, establishing the index matrix, computing score values of all order indexes, computing the synthesis score, sorting all selected schemes, and making analysis and decision. Presented method can offer valuable references for risk computing of building construction projects.

The effectiveness of hydrotherapy in the management of rheumatoid arthritis: a systematic review.

PubMed

Al-Qubaeissy, Khamis Y; Fatoye, Francis A; Goodwin, Peter C; Yohannes, Abebaw M

2013-03-01

Hydrotherapy is frequently indicated for the rehabilitation of patients with rheumatoid arthritis (RA); nevertheless, there has been inadequate appraisal of its effectiveness. The potential benefits of hydrotherapy for patients with RA are to improve and/or maintain functional ability and quality of life. The aim of this systematic review was to evaluate the effectiveness of hydrotherapy in the management of patients with RA. AMED, CINAHL, EMBASE, MEDLINE, PubMed, Science Direct and Web of Science were searched between 1988 and May 2011. Keywords used were rheumatoid arthritis, hydrotherapy, aquatic physiotherapy, aqua therapy and water therapy. Searches were supplemented with hand searches of references of selected articles. Randomized controlled trials were assessed for their methodological quality using the Physiotherapy Evidence Database (PEDro) scale. This scale ranks the methodological quality of a study scoring 7 out of 10 as 'high quality', 5-6 as 'moderate quality' and less than 4 as 'poor quality'. Initially, 197 studies were identified. Six studies met the inclusion criteria for further analysis. The average methodological quality for all studies was 6.8 using the PEDro scale. Most of the studies reported favourable outcomes for a hydrotherapy intervention compared with no treatment or other interventions for patients with RA. Improvement was particularly noted in reducing pain, joint tenderness, mood and tension symptoms, and increasing grip strength and patient satisfaction with hydrotherapy treatment in the short term. There is some evidence to suggest that hydrotherapy has a positive role in reducing pain and improving the health status of patients with RA compared with no or other interventions in the short term. However, the long-term benefit is unknown. Further studies are needed. Copyright © 2012 John Wiley & Sons, Ltd.

Is lavender an anxiolytic drug? A systematic review of randomised clinical trials.

PubMed

Perry, R; Terry, R; Watson, L K; Ernst, E

2012-06-15

Lavender (Lavandula angustifolia) is often recommended for stress/anxiety relief and believed to possess anxiolytic effects. To critically evaluate the efficacy/effectiveness of lavender for the reduction of stress/anxiety. Seven electronic databases were searched to identify all relevant studies. All methods of lavender administration were included. Data extraction and the assessment of the methodological quality of all included trials were conducted by two independent reviewers. Fifteen RCTs met the inclusion criteria. Two trials scored 4 points on the 5-point Jadad scale, the remaining 13 scored two or less. Results from seven trials appeared to favour lavender over controls for at least one relevant outcome. Methodological issues limit the extent to which any conclusions can be drawn regarding the efficacy/effectiveness of lavender. The best evidence suggests that oral lavender supplements may have some therapeutic effects. However, further independent replications are needed before firm conclusions can be drawn. Copyright © 2012 Elsevier GmbH. All rights reserved.

The Effect of Multiprofessional Simulation-Based Obstetric Team Training on Patient-Reported Quality of Care: A Pilot Study.

PubMed

Truijens, Sophie E M; Banga, Franyke R; Fransen, Annemarie F; Pop, Victor J M; van Runnard Heimel, Pieter J; Oei, S Guid

2015-08-01

This study aimed to explore whether multiprofessional simulation-based obstetric team training improves patient-reported quality of care during pregnancy and childbirth. Multiprofessional teams from a large obstetric collaborative network in the Netherlands were trained in teamwork skills using the principles of crew resource management. Patient-reported quality of care was measured with the validated Pregnancy and Childbirth Questionnaire (PCQ) at 6 weeks postpartum. Before the training, 76 postpartum women (sample I) completed the questionnaire 6 weeks postpartum. Three months after the training, another sample of 68 postpartum women (sample II) completed the questionnaire. In sample II (after the training), the mean (SD) score of 108.9 (10.9) on the PCQ questionnaire was significantly higher than the score of 103.5 (11.6) in sample I (before training) (t = 2.75, P = 0.007). The effect size of the increase in PCQ total score was 0.5. Moreover, the subscales "personal treatment during pregnancy" and "educational information" showed a significant increase after the team training (P < 0.001). Items with the largest increase in mean scores included communication between health care professionals, clear leadership, involvement in planning, and better provision of information. Despite the methodological restrictions of a pilot study, the preliminary results indicate that multiprofessional simulation-based obstetric team training seems to improve patient-reported quality of care. The possibility that this improvement relates to the training is supported by the fact that the items with the largest increase are about the principles of crew resource management, used in the training.

Measurement properties of the upright motor control test for adults with stroke: a systematic review.

PubMed

Gorgon, Edward James R; Lazaro, Rolando T

2016-01-01

The Upright Motor Control Test (UMCT) has been used in clinical practice and research to assess functional strength of the hemiparetic lower limb in adults with stroke. It is unclear if evidence is sufficient to warrant its use. The purpose of this systematic review was to synthesize available evidence on the measurement properties of the UMCT for stroke rehabilitation. Electronic databases that indexed biomedical literature were systematically searched from inception until October 2015 (week 4): Embase, PubMed, Web of Science, CINAHL, PEDro, Cochrane Library, Scopus, ScienceDirect, SPORTDiscus, LILACS, DOAJ, and Google Scholar. All studies that had used the UMCT in the time period covered underwent hand searching for any additional study. Observational studies involving adults with stroke that explored any measurement property of the UMCT were included. The COnsensus-based Standards for the selection of health Measurement INstruments was used to assess the methodological quality of included studies. The CanChild Outcome Measures Rating Form was used for extracting data on measurement properties and clinical utility. The search yielded three methodologic studies that addressed criterion-related validity and contruct validity. Two studies of fair methodological quality demonstrated moderate-level evidence that Knee Extension and Knee Flexion subtest scores were predictive of community-level and household-level ambulation. One study of fair methodological quality provided limited-level evidence for the correlation of Knee Extension subtest scores with a laboratory measure of ground reaction forces. No published studies formally assessed reliability, responsiveness, or clinical utility. Limited information on responsiveness and clinical utility dimensions could be inferred from the included studies. The UMCT is a practical assessment tool for voluntary control or functional strength of the hemiparetic lower limb in standing in adults with stroke. Although different levels of evidence suggest that the Knee Extension and Knee Flexion subtests may possess criterion and construct validity, the lack of published literature examining content validity, reliability, and responsiveness raises questions regarding the use of the UMCT in routine clinical practice. These key findings highlight the need to further investigate the UMCT's measurement properties toward enhancing its standardization.

Telemedicine-based system for quality management and peer review in radiology.

PubMed

Morozov, Sergey; Guseva, Ekaterina; Ledikhova, Natalya; Vladzymyrskyy, Anton; Safronov, Dmitry

2018-06-01

Quality assurance is the key component of modern radiology. A telemedicine-based quality assurance system helps to overcome the "scoring" approach and makes the quality control more accessible and objective. A concept for quality assurance in radiology is developed. Its realization is a set of strategies, actions, and tools. The latter is based on telemedicine-based peer review of 23,199 computed tomography (CT) and magnetic resonance imaging (MRI) images. The conception of the system for quality management in radiology represents a chain of actions: "discrepancies evaluation - routine support - quality improvement activity - discrepancies evaluation". It is realized by an audit methodology, telemedicine, elearning, and other technologies. After a year of systemic telemedicine-based peer reviews, the authors have estimated that clinically significant discrepancies were detected in 6% of all cases, while clinically insignificant ones were found in 19% of cases. Most often, problems appear in musculoskeletal records; 80% of the examinations have diagnostic or technical imperfections. The presence of routine telemedicine support and personalized elearning allowed improving the diagnostics quality. The level of discrepancies has decreased significantly (p < 0.05). The telemedicine-based peer review system allows improving radiology departments' network effectiveness. • "Scoring" approach to radiologists' performance assessment must be changed. • Telemedicine peer review and personalized elearning significantly decrease the number of discrepancies. • Teleradiology allows linking all primary-level hospitals to a common peer review network.

Twenty years of meta-analyses in orthopaedic surgery: has quality kept up with quantity?

PubMed

Dijkman, Bernadette G; Abouali, Jihad A K; Kooistra, Bauke W; Conter, Henry J; Poolman, Rudolf W; Kulkarni, Abhaya V; Tornetta, Paul; Bhandari, Mohit

2010-01-01

As the number of studies in the literature is increasing, orthopaedic surgeons highly depend on meta-analyses as their primary source of scientific evidence. The objectives of this review were to assess the scientific quality and number of published meta-analyses on orthopaedics-related topics over time. We conducted, in duplicate and independently, a systematic review of published meta-analyses in orthopaedics in the years 2005 and 2008 and compared them with a previous systematic review of meta-analyses from 1969 to 1999. A search of electronic databases (MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews) was performed to identify meta-analyses published in 2005 and 2008. We searched bibliographies and contacted content experts to identify additional relevant studies. Two investigators independently assessed the quality of the studies, using the Oxman and Guyatt index, and abstracted relevant data. We included forty-five and forty-four meta-analyses from 2005 and 2008, respectively. While the number of meta-analyses increased fivefold from 1999 to 2008, the mean quality score did not change significantly over time (p = 0.067). In the later years, a significantly lower proportion of meta-analyses had methodological flaws (56% in 2005 and 68% in 2008) compared with meta-analyses published prior to 2000 (88%) (p = 0.006). In 2005 and 2008, respectively, 18% and 30% of the meta-analyses had major to extensive flaws in their methodology. Studies from 2008 with positive conclusions used and described appropriate criteria for the validity assessment less often than did those with negative results. The use of random-effects and fixed-effects models as pooling methods became more popular toward 2008. Although the methodological quality of orthopaedic meta-analyses has increased in the past twenty years, a substantial proportion continues to show major to extensive flaws. As the number of published meta-analyses is increasing, a routine checklist for scientific quality should be used in the peer-review process to ensure methodological standards for publication.

Quality of reviews on sugar-sweetened beverages and health outcomes: a systematic review123

PubMed Central

Weed, Douglas L; Mink, Pamela J

2011-01-01

Background: Medical and public health decisions are informed by reviews, which makes the quality of reviews an important scientific concern. Objective: We systematically assessed the quality of published reviews on sugar-sweetened beverages (SSBs) and health, which is a controversial topic that is important to public health. Design: We performed a search of PubMed and Cochrane databases and a hand search of reference lists. Studies that were selected were published reviews and meta-analyses (June 2001 to June 2011) of epidemiologic studies of the relation between SSBs and obesity, type 2 diabetes, metabolic syndrome, and coronary heart disease. A standardized data-abstraction form was used. Review quality was assessed by using the validated instrument AMSTAR (assessment of multiple systematic reviews), which is a one-page tool with 11 questions. Results: Seventeen reviews met our inclusion and exclusion criteria: obesity or weight (16 reviews), diabetes (3 reviews), metabolic syndrome (3 reviews), and coronary heart disease (2 reviews). Authors frequently used a strictly narrative review (7 of 17 reviews). Only 6 of 17 reviews reported quantitative data in a table format. Overall, reviews of SSBs and health outcomes received moderately low–quality scores by the AMSTAR [mean: 4.4 points; median: 4 points; range: 1–8.5 points (out of a possible score of 11 points)]. AMSTAR scores were not related to the conclusions of authors (8 reviews reported an association with a mean AMSTAR score of 4.1 points; 9 reviews with equivocal conclusions scored 4.7 points; P value = 0.84). Less than one-third of published reviews reported a comprehensive literature search, listed included and excluded studies, or used duplicate study selection and data abstraction. Conclusion: The comprehensive reporting of epidemiologic evidence and use of systematic methodologies to interpret evidence were underused in published reviews on SSBs and health. PMID:21918218

Outcome reporting following navigated high tibial osteotomy of the knee: a systematic review.

PubMed

Yan, James; Musahl, Volker; Kay, Jeffrey; Khan, Moin; Simunovic, Nicole; Ayeni, Olufemi R

2016-11-01

This systematic review evaluates radiographic and clinical outcome reporting following navigated high tibial osteotomy (HTO). Conventional HTO was used as a control to compare outcomes and furthermore investigate the quality of evidence in studies reporting outcomes for navigated HTO. It was hypothesized that navigated HTO will show superior clinical and radiographic outcomes compared to conventional HTO. Two independent reviewers searched PubMed, Ovid (MEDLINE), EMBASE, and Cochrane databases for studies reporting outcomes following navigated HTO. Titles, abstracts, and full-text were screened in duplicate using an a priori inclusion and exclusion criteria. Descriptive statistics were calculated using Minitab ® statistical software. Methodological Index for Nonrandomized Studies (MINORS) and Cochrane Risk of Bias Scores were used to evaluate methodological quality. Thirty-four studies which involved 2216 HTOs were analysed in this review, 1608 (72.6 %) navigated HTOs and 608 (27.4 %) conventional HTOs. The majority of studies were of level IV evidence (16). Clinical outcomes were reported in knee and function scores or range of motion comparisons. Postoperative clinical and functional scores were improved by navigated HTO although it is not demonstrated if there is significant improvement compared to conventional HTO. Most common clinical outcome score reported was Lysholm scores (6) which report postoperative scores of 87.8 (standard deviation 5.9) and 88.8 (standard deviation 5.9) for conventional and navigation-assisted HTO, respectively. Radiographic outcomes reported commonly were weight-bearing mechanical axis, coronal plane angle, and posterior tibial slope angle in the sagittal plane. Studies have shown HTO gives significant correction of mechanical alignment and navigated HTO produces significantly less change in posterior tibial slope postoperatively compared to conventional. The mean MINORS for the 17 non-comparative studies was 9/16, and 15/24 for the 14 non-randomized comparative studies. Navigation HTO results in improved mechanical axis alignment and demonstrates significantly better control over the tibial slope angle change postoperatively compared to conventional methods; however, these improvements have not yet been reflected in clinical outcome scores. Overall the studies report HTO does create significantly improved knee scores and functions compared to patients' preoperative ratings regardless of technique. Future studies on HTO outcomes need to focus on consistency of outcome reporting. IV.

Application of person-centered analytic methodology in longitudinal research: exemplars from the Women's Health Initiative Clinical Trial data.

PubMed

Zaslavsky, Oleg; Cochrane, Barbara B; Herting, Jerald R; Thompson, Hilaire J; Woods, Nancy F; Lacroix, Andrea

2014-02-01

Despite the variety of available analytic methods, longitudinal research in nursing has been dominated by use of a variable-centered analytic approach. The purpose of this article is to present the utility of person-centered methodology using a large cohort of American women 65 and older enrolled in the Women's Health Initiative Clinical Trial (N = 19,891). Four distinct trajectories of energy/fatigue scores were identified. Levels of fatigue were closely linked to age, socio-demographic factors, comorbidities, health behaviors, and poor sleep quality. These findings were consistent regardless of the methodological framework. Finally, we demonstrated that energy/fatigue levels predicted future hospitalization in non-disabled elderly. Person-centered methods provide unique opportunities to explore and statistically model the effects of longitudinal heterogeneity within a population. © 2013 Wiley Periodicals, Inc.

Systematic review of economic analyses in patient safety: a protocol designed to measure development in the scope and quality of evidence

PubMed Central

Carter, Alexander W; Mandavia, Rishi; Mayer, Erik; Marti, Joachim; Mossialos, Elias; Darzi, Ara

2017-01-01

Introduction Recent avoidable failures in patient care highlight the ongoing need for evidence to support improvements in patient safety. According to the most recent reviews, there is a dearth of economic evidence related to patient safety. These reviews characterise an evidence gap in terms of the scope and quality of evidence available to support resource allocation decisions. This protocol is designed to update and improve on the reviews previously conducted to determine the extent of methodological progress in economic analyses in patient safety. Methods and analysis A broad search strategy with two core themes for original research (excluding opinion pieces and systematic reviews) in ‘patient safety’ and ‘economic analyses’ has been developed. Medline, Econlit and National Health Service Economic Evaluation Database bibliographic databases will be searched from January 2007 using a combination of medical subject headings terms and research-derived search terms (see table 1). The method is informed by previous reviews on this topic, published in 2012. Screening, risk of bias assessment (using the Cochrane collaboration tool) and economic evaluation quality assessment (using the Drummond checklist) will be conducted by two independent reviewers, with arbitration by a third reviewer as needed. Studies with a low risk of bias will be assessed using the Drummond checklist. High-quality economic evaluations are those that score >20/35. A qualitative synthesis of evidence will be performed using a data collection tool to capture the study design(s) employed, population(s), setting(s), disease area(s), intervention(s) and outcome(s) studied. Methodological quality scores will be compared with previous reviews where possible. Effect size(s) and estimate uncertainty will be captured and used in a quantitative synthesis of high-quality evidence, where possible. Ethics and dissemination Formal ethical approval is not required as primary data will not be collected. The results will be disseminated through a peer-reviewed publication, presentations and social media. Trial registration number CRD42017057853. PMID:28821527

Criteria for evaluating programme theory diagrams in quality improvement initiatives: a structured method for appraisal.

PubMed

Issen, Laurel; Woodcock, Thomas; McNicholas, Christopher; Lennox, Laura; Reed, Julie E

2018-04-09

Despite criticisms that many quality improvement (QI) initiatives fail due to incomplete programme theory, there is no defined way to evaluate how programme theory has been articulated. The objective of this research was to develop, and assess the usability and reliability of scoring criteria to evaluate programme theory diagrams. Criteria development was informed by published literature and QI experts. Inter-rater reliability was tested between two evaluators. About 63 programme theory diagrams (42 driver diagrams and 21 action-effect diagrams) were reviewed to establish whether the criteria could support comparative analysis of different approaches to constructing diagrams. Components of the scoring criteria include: assessment of overall aim, logical overview, clarity of components, cause-effect relationships, evidence and measurement. Independent reviewers had 78% inter-rater reliability. Scoring enabled direct comparison of different approaches to developing programme theory; action-effect diagrams were found to have had a statistically significant but moderate improvement in programme theory quality over driver diagrams; no significant differences were observed based on the setting in which driver diagrams were developed. The scoring criteria summarise the necessary components of programme theory that are thought to contribute to successful QI projects. The viability of the scoring criteria for practical application was demonstrated. Future uses include assessment of individual programme theory diagrams and comparison of different approaches (e.g. methodological, teaching or other QI support) to produce programme theory. The criteria can be used as a tool to guide the production of better programme theory diagrams, and also highlights where additional support for QI teams could be needed.

The Effectiveness of Manual Therapy for Relieving Pain, Stiffness, and Dysfunction in Knee Osteoarthritis: A Systematic Review and Meta-Analysis.

PubMed

Xu, Qinguang; Chen, Bei; Wang, Yueyi; Wang, Xuezong; Han, Dapeng; Ding, Daofang; Zheng, Yuxin; Cao, Yuelong; Zhan, Hongsheng; Zhou, Yao

2017-05-01

Knee osteoarthritis (KOA) is the most common form of arthritis, leading to pain disability in seniors and increased health care utilization. Manual therapy is one widely used physical treatment for KOA. To evaluate the effectiveness and adverse events (AEs) of manual therapy compared to other treatments for relieving pain, stiffness, and physical dysfunction in patients with KOA. A systematic review and meta-analysis of manual therapy for KOA. We searched PubMed, EMBASE, the Cochrane Library, and Chinese databases for relevant randomized controlled trials (RCTs) of manual therapy for patients with KOA from the inception to October 2015 without language restrictions. RCTs compared manual therapy to the placebo or other interventional control with an appropriate description of randomization. Two reviewers independently conducted the search results identification, data extraction, and methodological quality assessment. The methodological quality was assessed by PEDro scale. Pooled data was expressed as standard mean difference (SMD), with 95% confident intervals (CIs) in a random effects model. The meta-analysis of manual therapy for KOA on pain, stiffness, and physical function were conducted. Fourteen studies involving 841 KOA participants compared to other treatments were included. The methodological quality of most included RCTs was poor. The mean PEDro scale score was 6.6. The meta-analyses results showed that manual therapy had statistically significant effects on relieving pain (standardized mean difference, SMD = -0.61, 95% CI -0.95 to -0.28, P = 76%), stiffness (SMD = -0.58, 95% CI -0.95 to -0.21, P = 81%), improving physical function (SMD = -0.49, 95% CI -0.76 to -0.22, P = 65%), and total score (SMD = -0.56, 95% CI -0.78 to -0.35, P = 50%). But in the subgroups, manual therapy did not show significant improvements on stiffness and physical function when treatment duration was less than 4 weeks. And the long-term information for manual therapy was insufficient. The limitations of this systematic review include the paucity of literature and inevitable heterogeneity between included studies. The preliminary evidence from our study suggests that manual therapy might be effective and safe for improving pain, stiffness, and physical function in KOA patients and could be treated as complementary and alternative options. However, the evidence may be limited by potential bias and poor methodological quality of included studies. High-quality RCTs with long-term follow-up are warranted to confirm our findings.Key words: Knee osteoarthritis, manual therapy, systematic review.

Assessment of a Group Activity Based Educational Method to Teach Research Methodology to Undergraduate Medical Students of a Rural Medical College in Gujarat, India.

PubMed

Kumar, Dinesh; Singh, Uday Shankar; Solanki, Rajanikant

2015-07-01

Early undergraduate exposure to research helps in producing physicians who are better equipped to meet their professional needs especially the analytical skills. To assess the effectiveness and acceptability of small group method in teaching research methodology. Sixth semester medical undergraduates (III MBBS-part1) of a self-financed rural medical college. The workshop was of two full days duration consisting of daily two sessions by faculty for 30 minutes, followed by group activity of about four hours and presentation by students at the end of the day. A simple 8 steps approach was used. These steps are Identify a Problem, Refine the Problem, Determine a Solution, Frame the Question, Develop a Protocol, Take Action, Write the Report and Share your Experience. A Pre-test and post-test assessment was carried out using a questionnaire followed by anonymous feedback at the end of the workshop. The responses were evaluated by blinded evaluator. There were 95 (94.8%) valid responses out of the 99 students, who attended the workshop. The mean Pre-test and post-test scores were 4.21 and 10.37 respectively and the differences were found to be significant using Wilcoxon Sign Rank test (p<0.001). The median feedback score regarding relevance, skill learning, quality of facilitation, gain in knowledge was four and that of experience of group learning was 5 on a Likert scale of 1-5.There were no significant differences between male and female students in terms of Pre-test, post-test scores and overall gain in scores. Participatory research methodology workshop can play a significant role in teaching research to undergraduate students in an interesting manner. However, the long term effect of such workshops needs to be evaluated.

[Factors influencing the quality of clinical practice guidelines in ovarian cancer].

PubMed

Castillo-Londoño, J S; Medina-Torres, Y A; Sandoval-Salinas, C; Buitrago-Gutierrez, G; Torres-Ibargüen, M Z; Gonzalez-Rangel, A L

To identify the characteristics of the published clinical practice guidelines for the management of epithelial ovarian cancer that suggest a good methodological quality. A literature review was performed on 25 clinical practice guidelines for epithelial ovarian cancer that were identified in different databases (MEDLINE, Guidelines International Network, National Guidelines Clearing house) published between 2007 and 2014. The quality of the guidelines was evaluated using the Appraisal of Guidelines Research and Evaluation II tool. Descriptive and bivariate analyses were performed to assess the association between the quality of the guidelines and of some of their features and their developers. Just under half (48%) of the guidelines were rated as low quality. Scientific societies or independent centres and private funding, or under-reporting the source of funding, were statistically associated with lower quality of clinical practice guidelines (P<.01). The guidelines developed by National Program Guidelines had a median of consistently higher scores in all domains of the Appraisal of Guidelines Research and Evaluation II, with significant differences in the definition of scope and objectives, the participation of stakeholders, the methodological rigour of development, and applicability to the context. Features such as the nature of the developer and funding of the guidelines are predictors of quality that should be taken into account prior to the use of the recommendations of a document. Copyright © 2016 SECA. Publicado por Elsevier España, S.L.U. All rights reserved.

Review and evaluation of the methodological quality of the existing guidelines and recommendations for inherited neurometabolic disorders.

PubMed

Cassis, Linda; Cortès-Saladelafont, Elisenda; Molero-Luis, Marta; Yubero, Delia; González, Maria Julieta; Ormazábal, Aida; Fons, Carme; Jou, Cristina; Sierra, Cristina; Castejon Ponce, Esperanza; Ramos, Federico; Armstrong, Judith; O'Callaghan, M Mar; Casado, Mercedes; Montero, Raquel; Meavilla-Olivas, Silvia; Artuch, Rafael; Barić, Ivo; Bartoloni, Franco; Bellettato, Cinzia Maria; Bonifazi, Fedele; Ceci, Adriana; Cvitanović-Šojat, Ljerka; Dali, Christine I; D'Avanzo, Francesca; Fumic, Ksenija; Giannuzzi, Viviana; Lampe, Christina; Scarpa, Maurizio; Garcia-Cazorla, Ángels

2015-12-30

Inherited neurometabolic disorders (iNMDs) represent a group of almost seven hundred rare diseases whose common manifestations are clinical neurologic or cognitive symptoms that can appear at any time, in the first months/years of age or even later in adulthood. Early diagnosis and timely treatments are often pivotal for the favorable course of the disease. Thus, the elaboration of new evidence-based recommendations for iNMD diagnosis and management is increasingly requested by health care professionals and patients, even though the methodological quality of existing guidelines is largely unclear. InNerMeD-I-Network is the first European network on iNMDs that was created with the aim of sharing and increasing validated information about diagnosis and management of neurometabolic disorders. One of the goals of the project was to determine the number and the methodological quality of existing guidelines and recommendations for iNMDs. We performed a systematic search on PubMed, the National Guideline Clearinghouse (NGC), the Guidelines International Network (G-I-N), the Scottish Intercollegiate Guideline Network (SIGN) and the National Institute for Health and Care Excellence (NICE) to identify all the published guidelines and recommendations for iNMDs from January 2000 to June 2015. The methodological quality of the selected documents was determined using the AGREE II instrument, an appraisal tool composed of 6 domains covering 23 key items. A total of 55 records met the inclusion criteria, 11 % were about groups of disorders, whereas the majority encompassed only one disorder. Lysosomal disorders, and in particular Fabry, Gaucher disease and mucopolysaccharidoses where the most studied. The overall methodological quality of the recommendation was acceptable and increased over time, with 25 % of the identified guidelines strongly recommended by the appraisers, 64 % recommended, and 11 % not recommended. However, heterogeneity in the obtained scores for each domain was observed among documents covering different groups of disorders and some domains like 'stakeholder involvement' and 'applicability' were generally scarcely addressed. Greater efforts should be devoted to improve the methodological quality of guidelines and recommendations for iNMDs and AGREE II instrument seems advisable for new guideline development. The elaboration of new guidelines encompassing still uncovered disorders is badly needed.

An overview of clinical guidelines for the management of vertebral compression fracture: a systematic review.

PubMed

Parreira, Patrícia C S; Maher, Chris G; Megale, Rodrigo Z; March, Lyn; Ferreira, Manuela L

2017-12-01

Vertebral compression fractures (VCFs) are the most common type of osteoporotic fracture comprising approximately 1.4 million cases worldwide. Clinical practice guidelines can be powerful tools for promoting evidence-based practice as they integrate research findings to support decision making. However, currently available clinical guidelines and recommendations, established by different medical societies, are sometimes contradictory. The aim of this study was to appraise the recommendations and the methodological quality of international clinical guidelines for the management of VCFs. This is a systematic review of clinical guidelines for the management of VCF. Guidelines were selected by searching MEDLINE and PubMed, PEDro, CINAHL, and EMBASE electronic databases between 2010 and 2016. We also searched clinical practice guideline databases, including the National Guideline Clearinghouse and the Canadian Medical Association InfoBase. The methodological quality of the guidelines was assessed by two authors independently using the Appraisal of Guidelines, Research and Evaluation (AGREE) II Instrument. We also classified the strength of each recommendation as either strong (ie, based on high-quality studies with consistent findings for recommending for or against the intervention), weak (ie, based on a lack of compelling evidence resulting in uncertainty for benefit or potential harm), or expert consensus (ie, based on expert opinion of the working group rather than on scientific evidence). Guideline recommendations were grouped into diagnostic, conservative care, interventional care, and osteoporosis treatment and prevention of future fractures. Our study was prospectively registered on PROSPERO. Four guidelines from three countries, published in the period 2010-2013, were included. In general, the quality was not satisfactory (50% or less of the maximum possible score). The domains scoring 50% or less of the maximum possible score were rigor of development, clarity of presentation, and applicability. The use of plain radiography or dual-energy X-ray absorptiometry for diagnosis was recommended in two of the four guidelines. Vertebroplasty or kyphoplasty was recommended in three of the four guidelines. The recommendation for bed rest, trunk orthoses, electrical stimulation, and supervised or unsupervised exercise was inconsistent across the included guidelines. The comparison of clinical guidelines for the management of VCF showed that diagnostic and therapeutic recommendations were generally inconsistent. The evidence available to guideline developers was limited in quantity and quality. Greater efforts are needed to improve the quality of the majority of guidelines. Copyright © 2017 Elsevier Inc. All rights reserved.

Optimization of composite flour biscuits by mixture response surface methodology.

PubMed

Okpala, Laura C; Okoli, Eric C

2013-08-01

Biscuits were produced from blends of pigeon pea, sorghum and cocoyam flours. The study was carried out using mixture response surface methodology as the optimization technique. Using the simplex centroid design, 10 formulations were obtained. Protein and sensory quality of the biscuits were analyzed. The sensory attributes studied were appearance, taste, texture, crispness and general acceptability, while the protein quality indices were biological value and net protein utilization. The results showed that while the addition of pigeon pea improved the protein quality, its addition resulted in reduced sensory ratings for all the sensory attributes with the exception of appearance. Some of the biscuits had sensory ratings, which were not significantly different (p > 0.05) from biscuits made with wheat. Rat feeding experiments indicated that the biological value and net protein utilization values obtained for most of the biscuits were above minimum recommended values. Optimization suggested biscuits containing 75.30% sorghum, 0% pigeon pea and 24.70% cocoyam flours as the best proportion of these components. This sample received good scores for the sensory attributes.

Voiding dysfunction in patients with nasal congestion treated with pseudoephedrine: a prospective study

PubMed Central

Shao, I-Hung; Wu, Chia-Chen; Tseng, Hsiao-Jung; Lee, Ta-Jen; Lin, Yu-Hsiang; Tam, Yuan-Yun

2016-01-01

Background Pseudoephedrine is a sympathomimetic drug widely used as a nasal decongestant. However, it can cause adverse effects, such as voiding dysfunction. The risk of voiding dysfunction remains uncertain in patients without subjective voiding problems. Methodology We prospectively enrolled patients with nasal congestion who required treatment with pseudoephedrine from May to August 2015. All patients denied concomitant subjective voiding problem. The International Prostate Symptom Score (IPSS) questionnaire was used to evaluate voiding function before and 1 week after the pseudoephedrine treatment. The results of the IPSS questionnaire were analyzed as the total (IPSS-T), voiding (IPSS-V), storage (IPSS-S), and quality of life due to urinary symptom scores. Results We enrolled 131 males with a mean age of 42.0±14.3 years. The IPSS-T, IPSS-V, and IPSS-S scores slightly increased after the medication (IPSS-T increased from 6.49 to 6.77, IPSS-V from 3.33 to 3.53, and IPSS-S from 3.17 to 3.24). The quality of life due to urinary symptom score nonsignificantly decreased from 2.02 to 1.87. We observed that older age and a higher premedication IPSS-V score yielded significant differences (P<0.05) for subclinical voiding dysfunction and unchanged voiding function. In patients aged ≥50 years, the IPSS-T, IPSS-V, and IPSS-S scores significantly increased after the pseudoephedrine treatment (IPSS-T increased from 9.95 to 11.45, IPSS-V from 5.38 to 6.07, and IPSS-S 4.57 to 5.38), whereas the quality of life due to urinary symptom score nonsignificantly decreased from 2.71 to 2.48 (P=0.057). In patients aged <50 years, all scores did not significantly differ. Conclusion Pseudoephedrine treatment for nasal congestion requires extra precautions in males >50 years, even without subjective voiding symptoms. PMID:27486310

The quality of instruments to assess the process of shared decision making: A systematic review

PubMed Central

Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

2018-01-01

Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations. PMID:29447193

Association between body composition and disease activity in rheumatoid arthritis. A systematic review.

PubMed

Alvarez-Nemegyei, José; Buenfil-Rello, Fátima Annai; Pacheco-Pantoja, Elda Leonor

2016-01-01

Reports regarding the association between body composition and inflammatory activity in rheumatoid arthritis (RA) have consistently yielded contradictory results. To perform a systematic review on the association between overweight/obesity and inflammatory activity in RA. FAST approach: Article search (Medline, EBSCO, Cochrane Library), followed by abstract retrieval, full text review and blinded assessment of methodological quality for final inclusion. Because of marked heterogeneity in statistical approach and RA activity assessment method, a meta-analysis could not be done. Results are presented as qualitative synthesis. One hundred and nineteen reports were found, 16 of them qualified for full text review. Eleven studies (8,147 patients; n range: 37-5,161) approved the methodological quality filter and were finally included. Interobserver agreement for methodological quality score (ICC: 0.93; 95% CI: 0.82-0.98; P<.001) and inclusion/rejection decision (k 1.00, P>.001) was excellent. In all reports body composition was assessed by BMI; however a marked heterogeneity was found in the method used for RA activity assessment. A significant association between BMI and RA activity was found in 6 reports having larger mean sample size: 1,274 (range: 140-5,161). On the other hand, this association was not found in 5 studies having lower mean sample size: 100 (range: 7-150). The modulation of RA clinical status by body fat mass is suggested because a significant association was found between BMI and inflammatory activity in those reports with a trend toward higher statistical power. The relationship between body composition and clinical activity in RA requires be approached with further studies with higher methodological quality. Copyright © 2015 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Effects of obesity on lung volume and capacity in children and adolescents: a systematic review

PubMed Central

Winck, Aline Dill; Heinzmann-Filho, João Paulo; Soares, Rafaela Borges; da Silva, Juliana Severo; Woszezenki, Cristhiele Taís; Zanatta, Letiane Bueno

2016-01-01

Abstract Objective: To assess the effects of obesity on lung volume and capacity in children and adolescents. Data source: This is a systematic review, carried out in Pubmed, Lilacs, Scielo and PEDro databases, using the following Keywords: Plethysmography; Whole Body OR Lung Volume Measurements OR Total Lung Capacity OR Functional Residual Capacity OR Residual Volume AND Obesity. Observational studies or clinical trials that assessed the effects of obesity on lung volume and capacity in children and adolescents (0-18 years) without any other associated disease; in English; Portuguese and Spanish languages were selected. Methodological quality was assessed by the Agency for Healthcare Research and Quality. Data synthesis: Of the 1,030 articles, only four were included in the review. The studies amounted to 548 participants, predominantly males, with sample size ranging from 45 to 327 individuals. 100% of the studies evaluated nutritional status through BMI (z-score) and 50.0% reported the data on abdominal circumference. All demonstrated that obesity causes negative effects on lung volume and capacity, causing a reduction mainly in functional residual capacity in 75.0% of the studies; in the expiratory reserve volume in 50.0% and in the residual volume in 25.0%. The methodological quality ranged from moderate to high, with 75.0% of the studies classified as having high methodological quality. Conclusions: Obesity causes deleterious effects on lung volume and capacity in children and adolescents, mainly by reducing functional residual capacity, expiratory reserve volume and residual volume. PMID:27130483

Systematic Review: FDA-Approved Prescription Medications for Adults With Constipation

PubMed Central

Lacy, Brian E.

2006-01-01

Constipation is a common, often chronic, gastrointestinal disorder that can negatively impact the lives of those it affects and can be difficult to treat satisfactorily. The objective of this systematic review is to identify and analyze the available published literature on US Food and Drug Administration–approved prescription therapies for adults with constipation (episodic and chronic) and to assess their place in therapy, based on the methodologic strength and results of identified clinical trials. Ovid MEDLINE, PubMed, and EMBASE databases were used to search the published literature. Studies were included if they were randomized and prospective, conducted in adults (age ≥18), published as full-length manuscripts in English, and compared the test agent with placebo or a comparator(s). Studies were excluded if they involved patients with constipation attributed to secondary causes. Because fully published manuscripts from phase III efficacy trials involving the recently approved medication lubiprostone were not available, a manual search was performed of abstracts from the two annual major gastroenterology meetings (American College of Gastroenterology and Digestive Disease Week) from the past 4 years. Data on study design; number, age, and sex of patients; duration of treatment period; primary efficacy variable; secondary efficacy variables; adverse events; and discontinuations because of adverse events were abstracted from eligible articles. Eligible studies were assessed using well-established recommendations and a preformatted standardized form. A scoring system, with scores ranging from 1 to 15, was used to individually and separately assess the methodologic quality of the studies. Results of this analysis indicate a general lack of methodologically high-quality clinical trials supporting the use of lactulose and PEG 3350 to treat patients with chronic constipation, but data support their use in acute, episodic constipation. Conversely, high-quality evidence for tegaserod and lubiprostone in patients with chronic constipation does exist, though conclusions regarding the role in therapy for lubiprostone are still in development. PMID:28325992

Methods in pharmacoepidemiology: a review of statistical analyses and data reporting in pediatric drug utilization studies.

PubMed

Sequi, Marco; Campi, Rita; Clavenna, Antonio; Bonati, Maurizio

2013-03-01

To evaluate the quality of data reporting and statistical methods performed in drug utilization studies in the pediatric population. Drug utilization studies evaluating all drug prescriptions to children and adolescents published between January 1994 and December 2011 were retrieved and analyzed. For each study, information on measures of exposure/consumption, the covariates considered, descriptive and inferential analyses, statistical tests, and methods of data reporting was extracted. An overall quality score was created for each study using a 12-item checklist that took into account the presence of outcome measures, covariates of measures, descriptive measures, statistical tests, and graphical representation. A total of 22 studies were reviewed and analyzed. Of these, 20 studies reported at least one descriptive measure. The mean was the most commonly used measure (18 studies), but only five of these also reported the standard deviation. Statistical analyses were performed in 12 studies, with the chi-square test being the most commonly performed test. Graphs were presented in 14 papers. Sixteen papers reported the number of drug prescriptions and/or packages, and ten reported the prevalence of the drug prescription. The mean quality score was 8 (median 9). Only seven of the 22 studies received a score of ≥10, while four studies received a score of <6. Our findings document that only a few of the studies reviewed applied statistical methods and reported data in a satisfactory manner. We therefore conclude that the methodology of drug utilization studies needs to be improved.

Elbow-specific clinical rating systems: extent of established validity, reliability, and responsiveness.

PubMed

The, Bertram; Reininga, Inge H F; El Moumni, Mostafa; Eygendaal, Denise

2013-10-01

The modern standard of evaluating treatment results includes the use of rating systems. Elbow-specific rating systems are frequently used in studies aiming at elbow-specific pathology. However, proper validation studies seem to be relatively sparse. In addition, these scoring systems might not always be used for appropriate populations of interest. Both of these issues might give rise to invalid conclusions being reported in the literature. Our aim was to investigate the extent to which the available elbow-specific outcome measurement tools have been validated and the quality of the validation itself. We also aimed to provide characteristics of the populations used for validation of these scales to enable clinicians to use them appropriately. A literature search identified 17 studies of 12 different elbow-specific scoring systems. These were assessed for validity, reliability, and responsiveness characteristics. The quality of these assessments was rated according to the Consensus Based Standards for the Selection of Health Measurement Instruments (COSMIN) checklist criteria, a standardized and validated tool developed specifically for this purpose. Currently, the only elbow-specific rating system that is validated using high-quality methodology is the Oxford Elbow Score, a patient-administered outcome measure tool that has been validated on heterogeneous study populations. Other rating systems still have to be proven in the future to be as good as the Oxford Elbow Score for clinical or research purposes. Additional validation studies are needed. Copyright © 2013 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Mosby, Inc. All rights reserved.

The impact of financial incentives on the implementation of asthma or diabetes self-management: A systematic review

PubMed Central

Shields, Michael D.; Heaney, Liam G.; Kendall, Marilyn; Pearce, Christina J.; Hui, Chi Yan; Pinnock, Hilary

2017-01-01

Introduction Financial incentives are utilised in healthcare systems in a number of countries to improve quality of care delivered to patients by rewarding practices or practitioners for achieving set targets. Objectives To systematically review the evidence investigating the impact of financial incentives for implementation of supported self-management on quality of care including: organisational process outcomes, individual behavioural outcomes, and health outcomes for individuals with asthma or diabetes; both conditions with an extensive evidence base for self-management. Methods We followed Cochrane methodology, using a PICOS search strategy to search eight databases in November 2015 (updated May 2017) including a broad range of implementation methodologies. Studies were weighted by robustness of methodology, number of participants and the quality score. We used narrative synthesis due to heterogeneity of studies. Results We identified 2,541 articles; 12 met our inclusion criteria. The articles were from the US (n = 7), UK (n = 4) and Canada (n = 1). Measured outcomes were HbA1c tests undertaken and/or the level achieved (n = 10), written action plans for asthma (n = 1) and hospital/emergency department visits (n = 1). Three of the studies were part of a larger incentive scheme including many conditions; one focused on asthma; eight focussed on diabetes. In asthma, the proportion receiving ‘perfect care’ (including providing a written action plan) increased from 4% to 88% in one study, and there were fewer hospitalisations/emergency department visits in another study. Across the diabetes studies, quality-of-care/GP performance scores improved in three, were unchanged in six and deteriorated in one. Conclusions Results for the impact of financial incentives for the implementation of self-management were mixed. The evidence in diabetes suggests no consistent impact on diabetic control. There was evidence from a single study of improved process and health outcomes in asthma. Further research is needed to confirm these findings and understand the process by which financial incentives may impact (or not) on care. Trial registration Protocol registration number: CRD42016027411 PMID:29107955

Efficacy and safety of Pueraria candollei var. mirifica (Airy Shaw & Suvat.) Niyomdham for menopausal women: A systematic review of clinical trials and the way forward.

PubMed

Kongkaew, Chuenjid; Scholfield, Norman C; Dhippayom, Teerapon; Dilokthornsakul, Piyameth; Saokaew, Surasak; Chaiyakunapruk, Nathorn

2018-04-24

Pueraria candollei var. mirifica (Airy Shaw & Suvat.) Niyomdham (commonly termed P. mirifica, PM) growing in upland Thailand has a long history as a postmenopausal rejuvenant therapy for indigenants. Its amelioration of menopause symptoms in clinical trials was assessed. International and Thai databases were searched from inception to February 2017. Clinical trials investigating effects of PM menopausal or postmenopausal women were included. Outcomes were self-reported menopausal symptoms, serum reproductive hormones, urino-genital tract function, and bone surrogates. Methodological quality was assessed by Cochrane risk-of-bias v2.0, and a 22-parameter quality score based on the CONSORT checklist for herbal medicines. Eight studies (9 articles) used data from 309 menopausal patients. Five-studies demonstrated that PM was associated with climacteric scores reduced by ~50% compared to baseline. Other PM studies using limited numbers of placebo participants suggested improved vaginal and other urogenital tract symptoms. Bone alkaline phosphatase halved (suggesting lowered bone turnover). Variable serum reproductive hormone levels suggested menopausal status differed between studies. PM active ingredients and sources were not defined. Adverse event rates (mastodynia, vaginal spotting, dizziness) were similar in all groups (PM, conjugated equine estrogen, and placebos) but serum C-reactive protein doubled. These studies had design and reporting deficiencies, high risks of biases, and low quality scores. The efficacy of PM on menopausal symptoms remains inconclusive because of methodological short-comings especially placebo effects inherent in self-assessment/recall questionnaires and no PM standardization. PM efficacy and safety need a fundamental re-appraisal by: (i) cohort (retro- and prospective) studies on current users to define its traditional use for rejuvenation; (ii) tightly coupling long-term efficacy to safety of well-defined PM and multiple end-points; (iii) using study design related to current understanding of menopause progression and estrogen pharmacology (iv) robust pharmacovigilance. Copyright © 2018 Elsevier B.V. All rights reserved.

Method and reporting quality in health professions education research: a systematic review.

PubMed

Cook, David A; Levinson, Anthony J; Garside, Sarah

2011-03-01

Studies evaluating reporting quality in health professions education (HPE) research have demonstrated deficiencies, but none have used comprehensive reporting standards. Additionally, the relationship between study methods and effect size (ES) in HPE research is unknown. This review aimed to evaluate, in a sample of experimental studies of Internet-based instruction, the quality of reporting, the relationship between reporting and methodological quality, and associations between ES and study methods. We conducted a systematic search of databases including MEDLINE, Scopus, CINAHL, EMBASE and ERIC, for articles published during 1990-2008. Studies (in any language) quantifying the effect of Internet-based instruction in HPE compared with no intervention or other instruction were included. Working independently and in duplicate, we coded reporting quality using the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement, and coded study methods using a modified Newcastle-Ottawa Scale (m-NOS), the Medical Education Research Study Quality Instrument (MERSQI), and the Best Evidence in Medical Education (BEME) global scale. For reporting quality, articles scored a mean±standard deviation (SD) of 51±25% of STROBE elements for the Introduction, 58±20% for the Methods, 50±18% for the Results and 41±26% for the Discussion sections. We found positive associations (all p<0.0001) between reporting quality and MERSQI (ρ=0.64), m-NOS (ρ=0.57) and BEME (ρ=0.58) scores. We explored associations between study methods and knowledge ES by subtracting each study's ES from the pooled ES for studies using that method and comparing these differences between subgroups. Effect sizes in single-group pretest/post-test studies differed from the pooled estimate more than ESs in two-group studies (p=0.013). No difference was found between other study methods (yes/no: representative sample, comparison group from same community, randomised, allocation concealed, participants blinded, assessor blinded, objective assessment, high follow-up). Information is missing from all sections of reports of HPE experiments. Single-group pre-/post-test studies may overestimate ES compared with two-group designs. Other methodological variations did not bias study results in this sample. © Blackwell Publishing Ltd 2011.

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery

PubMed Central

Gudlaugsdottir, Katrin; Andrews, James

2017-01-01

Objective Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality. Background Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated. Methods Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality. Results 112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression. Conclusions There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians. PMID:28384296

Assessment of Patient Empowerment - A Systematic Review of Measures

PubMed Central

Barr, Paul J.; Scholl, Isabelle; Bravo, Paulina; Faber, Marjan J.; Elwyn, Glyn; McAllister, Marion

2015-01-01

Background Patient empowerment has gained considerable importance but uncertainty remains about the best way to define and measure it. The validity of empirical findings depends on the quality of measures used. This systematic review aims to provide an overview of studies assessing psychometric properties of questionnaires purporting to capture patient empowerment, evaluate the methodological quality of these studies and assess the psychometric properties of measures identified. Methods Electronic searches in five databases were combined with reference tracking of included articles. Peer-reviewed articles reporting psychometric testing of empowerment measures for adult patients in French, German, English, Portuguese and Spanish were included. Study characteristics, constructs operationalised and psychometric properties were extracted. The quality of study design, methods and reporting was assessed using the COSMIN checklist. The quality of psychometric properties was assessed using Terwee’s 2007 criteria. Findings 30 studies on 19 measures were included. Six measures are generic, while 13 were developed for a specific condition (N=4) or specialty (N=9). Most studies tested measures in English (N=17) or Swedish (N=6). Sample sizes of included studies varied from N=35 to N=8261. A range of patient empowerment constructs was operationalised in included measures. These were classified into four domains: patient states, experiences and capacities; patient actions and behaviours; patient self-determination within the healthcare relationship and patient skills development. Quality assessment revealed several flaws in methodological study quality with COSMIN scores mainly fair or poor. The overall quality of psychometric properties of included measures was intermediate to positive. Certain psychometric properties were not tested for most measures. Discussion Findings provide a basis from which to develop consensus on a core set of patient empowerment constructs and for further work to develop a (set of) appropriately validated measure(s) to capture this. The methodological quality of psychometric studies could be improved by adhering to published quality criteria. PMID:25970618

[Patients' perspective and economic variables as objectives in clinical trials: added value to clinical parameters].

PubMed

Bovaira-García, M J; Soler-Company, E

2012-01-01

Patient-reported outcome (PRO) measures complement traditional biomedical outcome measures. The purpose of this study was to evaluate the use of PRO measures including health-related quality of life (HRQoL) questionnaires as a measurement of efficacy and the frequency of inclusion of economic variables related to direct and indirect costs in the design of clinical trials and phase IV observational studies. Moreover, for the trials quality score were measured, and if there were any relationship between the quality study design score and the PRO inclusion. Retrospective observational study of the clinical trials and phase IV observational studies approved by a Clinical Research Ethics Committee (2008-2010). We gathered data concerning general aspects including medical specialty, pathology, methodological quality based on Jadad scale (0-5), inclusion of PRO and economic variables. For clinical trials including HRQoL measurements, we analysed the type of questionnaire in use. Where there were no HRQoL measurements, we analysed if their inclusion would have been proper or not. A total of 70 protocols (59 CTs and 11 phase IV observational studies) were analysed; 37 (52.8%) included PRO measures, and 3 protocols (4.3%) used them as a primary endpoint. Data analysis by therapeutic area showed that PRO measures were most commonly studied in the fields of endocrinology, neurology, digestive diseases, and cardiology. The average quality score for the trials was 2.8. The trials with more PRO inclusion in their end points had a significantly higher quality score. Only 13 (22%) clinical trials and 2 (18.2%) phase IV observational studies included economic variables. The emergence of economic variables in clinical trials and phase IV observational studies evaluated was low, however, more than half of the revised protocols have included PRO measures, reflecting the importance of these parameters in the assessment of the effectiveness of drug treatments, although its use is still not systematic. Copyright © 2011 SECA. Published by Elsevier Espana. All rights reserved.

Clinical practice guidelines and consensus statements in oncology--an assessment of their methodological quality.

PubMed

Jacobs, Carmel; Graham, Ian D; Makarski, Julie; Chassé, Michaël; Fergusson, Dean; Hutton, Brian; Clemons, Mark

2014-01-01

Consensus statements and clinical practice guidelines are widely available for enhancing the care of cancer patients. Despite subtle differences in their definition and purpose, these terms are often used interchangeably. We systematically assessed the methodological quality of consensus statements and clinical practice guidelines published in three commonly read, geographically diverse, cancer-specific journals. Methods Consensus statements and clinical practice guidelines published between January 2005 and September 2013 in Current Oncology, European Journal of Cancer and Journal of Clinical Oncology were evaluated. Each publication was assessed using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) rigour of development and editorial independence domains. For assessment of transparency of document development, 7 additional items were taken from the Institute of Medicine's standards for practice guidelines and the Journal of Clinical Oncology guidelines for authors of guidance documents. Consensus statements and clinical practice guidelines published between January 2005 and September 2013 in Current Oncology, European Journal of Cancer and Journal of Clinical Oncology were evaluated. Each publication was assessed using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) rigour of development and editorial independence domains. For assessment of transparency of document development, 7 additional items were taken from the Institute of Medicine's standards for practice guidelines and the Journal of Clinical Oncology guidelines for authors of guidance documents. Thirty-four consensus statements and 67 clinical practice guidelines were evaluated. The rigour of development score for consensus statements over the three journals was 32% lower than that of clinical practice guidelines. The editorial independence score was 15% lower for consensus statements than clinical practice guidelines. One journal scored consistently lower than the others over both domains. No journals adhered to all the items related to the transparency of document development. One journal's consensus statements endorsed a product made by the sponsoring pharmaceutical company in 64% of cases. Guidance documents are an essential part of oncology care and should be subjected to a rigorous and validated development process. Consensus statements had lower methodological quality than clinical practice guidelines using AGREE II. At a minimum, journals should ensure that that all consensus statements and clinical practice guidelines adhere to AGREE II criteria. Journals should consider explicitly requiring guidelines to declare pharmaceutical company sponsorship and to identify the sponsor's product to enhance transparency.

Embedding systematic quality assessments in supportive supervision at primary healthcare level: application of an electronic Tool to Improve Quality of Healthcare in Tanzania.

PubMed

Mboya, Dominick; Mshana, Christopher; Kessy, Flora; Alba, Sandra; Lengeler, Christian; Renggli, Sabine; Vander Plaetse, Bart; Mohamed, Mohamed A; Schulze, Alexander

2016-10-13

Assessing quality of health services, for example through supportive supervision, is essential for strengthening healthcare delivery. Most systematic health facility assessment mechanisms, however, are not suitable for routine supervision. The objective of this study is to describe a quality assessment methodology using an electronic format that can be embedded in supervision activities and conducted by council health staff. An electronic Tool to Improve Quality of Healthcare (e-TIQH) was developed to assess the quality of primary healthcare provision. The e-TIQH contains six sub-tools, each covering one quality dimension: infrastructure and equipment of the facility, its management and administration, job expectations, clinical skills of the staff, staff motivation and client satisfaction. As part of supportive supervision, council health staff conduct quality assessments in all primary healthcare facilities in a given council, including observation of clinical consultations and exit interviews with clients. Using a hand-held device, assessors enter data and view results in real time through automated data analysis, permitting immediate feedback to health workers. Based on the results, quality gaps and potential measures to address them are jointly discussed and actions plans developed. For illustrative purposes, preliminary findings from e-TIQH application are presented from eight councils of Tanzania for the period 2011-2013, with a quality score <75 % classed as 'unsatisfactory'. Staff motivation (<50 % in all councils) and job expectations (≤50 %) scored lowest of all quality dimensions at baseline. Clinical practice was unsatisfactory in six councils, with more mixed results for availability of infrastructure and equipment, and for administration and management. In contrast, client satisfaction scored surprisingly high. Over time, each council showed a significant overall increase of 3-7 % in mean score, with the most pronounced improvements in staff motivation and job expectations. Given its comprehensiveness, convenient handling and automated statistical reports, e-TIQH enables council health staff to conduct systematic quality assessments. Therefore e-TIQH may not only contribute to objectively identifying quality gaps, but also to more evidence-based supervision. E-TIQH also provides important information for resource planning. Institutional and financial challenges for implementing e-TIQH on a broader scale need to be addressed.

Efficacy of hydrotherapy in fibromyalgia syndrome--a meta-analysis of randomized controlled clinical trials.

PubMed

Langhorst, Jost; Musial, Frauke; Klose, Petra; Häuser, Winfried

2009-09-01

To systematically review the efficacy of hydrotherapy in FM syndrome (FMS). We screened MEDLINE, PsychInfo, EMBASE, CAMBASE and CENTRAL (through December 2008) and the reference sections of original studies and systematic reviews on hydrotherapy in FMS. Randomized controlled trials (RCTs) on the treatment of FMS with hydrotherapy (spa-, balneo- and thalassotherapy, hydrotherapy and packing and compresses) were analysed. Methodological quality was assessed by the van Tulder score. Effects were summarized using standardized mean differences (SMDs). Ten out of 13 RCTs with 446 subjects, with a median sample size of 41 (range 24-80) and a median treatment time of 240 (range 200-300) min, were included into the meta-analysis. Only three studies had a moderate quality score. There was moderate evidence for reduction of pain (SMD -0.78; 95% CI -1.42, -0.13; P < 0.0001) and improved health-related quality of life (HRQOL) (SMD -1.67; 95% CI -2.91, -0.43; P = 0.008) at the end of therapy. There was moderate evidence that the reduction of pain (SMD -1.27; 95% CI -2.15, -0.38; P = 0.005) and improvement of HRQOL (SMD -1.16; 95% CI -1.96, -0.36; P = 0.005) could be maintained at follow-up (median 14 weeks). There is moderate evidence that hydrotherapy has short-term beneficial effects on pain and HRQOL in FMS patients. There is a risk to over-estimate the effects of hydrotherapy due to methodological weaknesses of the studies and to small trials included in meta-analysis.

Arthroscopic repair of lateral ankle ligament complex by suture anchor.

PubMed

Wang, Jingwei; Hua, Yinghui; Chen, Shiyi; Li, Hongyun; Zhang, Jian; Li, Yunxia

2014-06-01

Arthroscopic repair of the lateral ligament complex with suture anchors is increasingly used to treat chronic ankle instability (CAI). Our aims are (1) to analyze and evaluate the literature on arthroscopic suture anchor repair of the anterior talofibular ligament and (2) to conduct a systematic review of the clinical evidence on the reported outcomes and complications of treating CAI with this technique. We performed a systematic review of the literature using PubMed, Ovid, Elsevier ScienceDirect, Web of Science-Conference Proceedings Citation Index, and the Cochrane Database of Systematic Reviews from 1987 to September 2013. Clinical studies using the arthroscopic suture anchor technique to treat CAI were included. Outcome measures consisted of clinical assessment of postoperative ligament stability and complications. In addition, the methodologic quality of the included studies was assessed by use of the modified Coleman Methodology Score. After reviewing 371 studies, we identified 6 studies (5 retrospective case series and 1 prospective case series, all Level IV) that met the inclusion criteria, with a mean Coleman Methodology Score of 71.8 ± 7.52 (range, 63 to 82). In these studies 178 patients (179 ankles) underwent arthroscopic suture anchor repair of the anterior talofibular ligament with a mean follow-up period of 38.9 months (range, 6 to 117.6 months). All patients were reported to have subjective improvement of their ankle instability, with complications in 31 cases. Studies of arthroscopic suture anchor technique to treat CAI are sparse, with moderate mean methodologic quality. The included studies suggest that the arthroscopic technique is a feasible procedure to restore ankle stability; however, on the basis of our review, this technique seems to be associated with a relatively high complication rate. Extensive cadaveric studies, clinical trials, and comparative studies comparing arthroscopic and open repair should be performed in the future. Level IV, systematic review of Level IV studies. Copyright © 2014 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Hamstring autograft versus soft-tissue allograft in anterior cruciate ligament reconstruction: a systematic review and meta-analysis of randomized controlled trials.

PubMed

Cvetanovich, Gregory L; Mascarenhas, Randy; Saccomanno, Maristella F; Verma, Nikhil N; Cole, Brian J; Bush-Joseph, Charles A; Bach, Bernard R

2014-12-01

To compare outcomes of anterior cruciate ligament (ACL) reconstruction with hamstring autograft versus soft-tissue allograft by systematic review and meta-analysis. A systematic review of randomized controlled studies comparing hamstring autograft with soft-tissue allograft in ACL reconstruction was performed. Studies were identified by strict inclusion and exclusion criteria. Descriptive statistics were reported. Where possible, the data were pooled and a meta-analysis was performed using RevMan software (The Nordic Cochrane Centre, The Cochrane Collaboration, Copenhagen, Denmark). Dichotomous data were reported as risk ratios, whereas continuous data were reported as standardized mean differences and 95% confidence intervals. Heterogeneity was assessed by use of I(2) for each meta-analysis. Study methodologic quality was analyzed with the Modified Coleman Methodology Score and Jadad scale. Five studies with 504 combined patients (251 autograft and 253 allograft; 374 male and 130 female patients) with a mean age of 29.9 ± 2.2 years were included. The allografts used were fresh-frozen hamstring, irradiated hamstring, mixture of fresh-frozen and cryopreserved hamstring, fresh-frozen tibialis anterior, and fresh-frozen Achilles tendon grafts without bone blocks. The mean follow-up period was 47.4 ± 26.9 months, with a mean follow-up rate of 83.3% ± 8.6%. Two studies found a longer operative time with autograft than with allograft (77.1 ± 2.0 minutes v 59.9 ± 0.9 minutes, P = .008). Meta-analysis showed no statistically significant differences between autografts and allografts for any outcome measures (P > .05 for all tests). One study found significantly greater laxity for irradiated allograft than for autograft. The methodologic quality of the 5 studies was poor, with a mean Modified Coleman Methodology Score of 54.4 ± 6.9 and mean Jadad score of 1.6 ± 1.5. On the basis of this systematic review and meta-analysis of 5 randomized controlled trials, there is no statistically significant difference in outcome between patients undergoing ACL reconstruction with hamstring autograft and those undergoing ACL reconstruction with soft-tissue allograft. These results may not extrapolate to younger patient populations. The methodology of the available randomized controlled trials comparing hamstring autograft and soft-tissue allograft is poor. Level II, systematic review of Level I and II studies. Copyright © 2014 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

An evaluation of the objective quality and perceived usefulness of maternity clinical practice guidelines at a tertiary maternity unit.

PubMed

Trollope, Helena; Leung, Joyce Pui Yee; Wise, Michelle; Farquhar, Cynthia; Sadler, Lynn

2018-03-05

Compliance with maternity clinical practice guidelines developed by National Women's Health has been found to be low at audit. To explore the reasons for poor compliance with maternity guidelines by evaluating the quality of a sample of National Women's Health guidelines using a validated instrument and assessing local guideline users' perceptions of and attitudes toward guidelines. Five independent reviewers evaluated the quality of 10 purposively selected guidelines for adherence to the Appraisal of Guidelines Research & Evaluation (AGREE) II instrument standards. A self-administered questionnaire for staff was undertaken regarding views of and barriers to guideline use. None of the guidelines attained a score over 50% for the following domains: stakeholder involvement, rigour of development, applicability, editorial independence. The highest scoring domain was clarity of presentation (mean 69%). All guidelines scored the minimum possible for editorial independence. Survey respondents had positive attitudes toward guidelines, believed that their use could improve quality of care within the service, and felt that encouragement from senior staff members and peers would encourage their use. Accessibility was the most commonly cited of many barriers identified. The National Women's Health guidelines evaluated in this study cannot be considered to be high quality, and could be improved by reporting on methodology of the development process. Although poor guideline development may contribute to failure of the local maternity guidelines, it appears that accessibility is a major barrier to their use and implementation. © 2018 The Royal Australian and New Zealand College of Obstetricians and Gynaecologists.

An algorithm to assess methodological quality of nutrition and mortality cross-sectional surveys: development and application to surveys conducted in Darfur, Sudan.

PubMed

Prudhon, Claudine; de Radiguès, Xavier; Dale, Nancy; Checchi, Francesco

2011-11-09

Nutrition and mortality surveys are the main tools whereby evidence on the health status of populations affected by disasters and armed conflict is quantified and monitored over time. Several reviews have consistently revealed a lack of rigor in many surveys. We describe an algorithm for analyzing nutritional and mortality survey reports to identify a comprehensive range of errors that may result in sampling, response, or measurement biases and score quality. We apply the algorithm to surveys conducted in Darfur, Sudan. We developed an algorithm based on internationally agreed upon methods and best practices. Penalties are attributed for a list of errors, and an overall score is built from the summation of penalties accrued by the survey as a whole. To test the algorithm reproducibility, it was independently applied by three raters on 30 randomly selected survey reports. The algorithm was further applied to more than 100 surveys conducted in Darfur, Sudan. The Intra Class Correlation coefficient was 0.79 for mortality surveys and 0.78 for nutrition surveys. The overall median quality score and range of about 100 surveys conducted in Darfur were 0.60 (0.12-0.93) and 0.675 (0.23-0.86) for mortality and nutrition surveys, respectively. They varied between the organizations conducting the surveys, with no major trend over time. Our study suggests that it is possible to systematically assess quality of surveys and reveals considerable problems with the quality of nutritional and particularly mortality surveys conducted in the Darfur crisis.

An algorithm to assess methodological quality of nutrition and mortality cross-sectional surveys: development and application to surveys conducted in Darfur, Sudan

PubMed Central

2011-01-01

Background Nutrition and mortality surveys are the main tools whereby evidence on the health status of populations affected by disasters and armed conflict is quantified and monitored over time. Several reviews have consistently revealed a lack of rigor in many surveys. We describe an algorithm for analyzing nutritional and mortality survey reports to identify a comprehensive range of errors that may result in sampling, response, or measurement biases and score quality. We apply the algorithm to surveys conducted in Darfur, Sudan. Methods We developed an algorithm based on internationally agreed upon methods and best practices. Penalties are attributed for a list of errors, and an overall score is built from the summation of penalties accrued by the survey as a whole. To test the algorithm reproducibility, it was independently applied by three raters on 30 randomly selected survey reports. The algorithm was further applied to more than 100 surveys conducted in Darfur, Sudan. Results The Intra Class Correlation coefficient was 0.79 for mortality surveys and 0.78 for nutrition surveys. The overall median quality score and range of about 100 surveys conducted in Darfur were 0.60 (0.12-0.93) and 0.675 (0.23-0.86) for mortality and nutrition surveys, respectively. They varied between the organizations conducting the surveys, with no major trend over time. Conclusion Our study suggests that it is possible to systematically assess quality of surveys and reveals considerable problems with the quality of nutritional and particularly mortality surveys conducted in the Darfur crisis. PMID:22071133

Systematic review, critical appraisal, and analysis of the quality of economic evaluations in stroke imaging.

PubMed

Burton, Kirsteen R; Perlis, Nathan; Aviv, Richard I; Moody, Alan R; Kapral, Moira K; Krahn, Murray D; Laupacis, Andreas

2014-03-01

This study reviews the quality of economic evaluations of imaging after acute stroke and identifies areas for improvement. We performed full-text searches of electronic databases that included Medline, Econlit, the National Health Service Economic Evaluation Database, and the Tufts Cost Effectiveness Analysis Registry through July 2012. Search strategy terms included the following: stroke*; cost*; or cost-benefit analysis*; and imag*. Inclusion criteria were empirical studies published in any language that reported the results of economic evaluations of imaging interventions for patients with stroke symptoms. Study quality was assessed by a commonly used checklist (with a score range of 0% to 100%). Of 568 unique potential articles identified, 5 were included in the review. Four of 5 articles were explicit in their analysis perspectives, which included healthcare system payers, hospitals, and stroke services. Two studies reported results during a 5-year time horizon, and 3 studies reported lifetime results. All included the modified Rankin Scale score as an outcome measure. The median quality score was 84.4% (range=71.9%-93.5%). Most studies did not consider the possibility that patients could not tolerate contrast media or could incur contrast-induced nephropathy. Three studies compared perfusion computed tomography with unenhanced computed tomography but assumed that outcomes guided by the results of perfusion computed tomography were equivalent to outcomes guided by the results of magnetic resonance imaging or noncontrast computed tomography. Economic evaluations of imaging modalities after acute ischemic stroke were generally of high methodological quality. However, important radiology-specific clinical components were missing from all of these analyses.

Systematic Review of Biological Modulation of Healing in Anterior Cruciate Ligament Reconstruction

PubMed Central

Fu, Sai-Chuen; Cheuk, Yau-Chuk; Yung, Shu-Hang; Rolf, Christer Gustav; Chan, Kai-Ming

2014-01-01

Background: Whether biological modulation is effective to promote healing in anterior cruciate ligament (ACL) reconstruction remains unclear. Purpose: To perform a systematic review of both clinical and experimental evidence of preclinical animal studies on biological modulation to promote healing in ACL reconstruction. Study Design: Systematic review; Level of evidence, 2. Methods: A systematic search was performed using the PubMed, Ovid, and Scopus search engines. Inclusion criteria were clinical and animal studies involving subjects with ACL injury with the use of biological modulation to promote healing outcomes. Methodological quality of clinical studies was evaluated using the Critical Appraisal Skill Programme (CASP) appraisal tool, and animal studies were evaluated by a scoring system based on a published checklist of good animal studies. Results: Ten clinical studies and 50 animal studies were included. Twenty-five included studies were regarded as good quality, with a methodological score ≥5. These studies suggested that transforming growth factor–beta (TGF-β), mesenchymal stem cells, osteogenic factors, and modalities that reduce local inflammation may be beneficial to promote graft healing in ACL reconstruction. Conclusion: This systematic review suggests that biological modulation is able to promote healing on top of surgical treatment for ACL injuries. This treatment strategy chiefly works through promotion of healing at the tunnel-graft interface, but the integrity of the intra-articular midsubstance of the graft would be another target for biological modulation. PMID:26535311

Echocardiographic Methods, Quality Review, and Measurement Accuracy in a Randomized Multicenter Clinical Trial of Marfan Syndrome

PubMed Central

Selamet Tierney, Elif Seda; Levine, Jami C.; Chen, Shan; Bradley, Timothy J.; Pearson, Gail D.; Colan, Steven D.; Sleeper, Lynn A.; Campbell, M. Jay; Cohen, Meryl S.; Backer, Julie De; Guey, Lin T.; Heydarian, Haleh; Lai, Wyman W.; Lewin, Mark B.; Marcus, Edward; Mart, Christopher R.; Pignatelli, Ricardo H.; Printz, Beth F.; Sharkey, Angela M.; Shirali, Girish S.; Srivastava, Shubhika; Lacro, Ronald V.

2013-01-01

Background The Pediatric Heart Network is conducting a large international randomized trial to compare aortic root growth and other cardiovascular outcomes in 608 subjects with Marfan syndrome randomized to receive atenolol or losartan for 3 years. The authors report here the echocardiographic methods and baseline echocardiographic characteristics of the randomized subjects, describe the interobserver agreement of aortic measurements, and identify factors influencing agreement. Methods Individuals aged 6 months to 25 years who met the original Ghent criteria and had body surface area–adjusted maximum aortic root diameter (ROOTmax) Z scores > 3 were eligible for inclusion. The primary outcome measure for the trial is the change over time in ROOTmax Z score. A detailed echocardiographic protocol was established and implemented across 22 centers, with an extensive training and quality review process. Results Interobserver agreement for the aortic measurements was excellent, with intraclass correlation coefficients ranging from 0.921 to 0.989. Lower interobserver percentage error in ROOTmax measurements was independently associated (model R2 = 0.15) with better image quality (P = .002) and later study reading date (P < .001). Echocardiographic characteristics of the randomized subjects did not differ by treatment arm. Subjects with ROOTmax Z scores ≥ 4.5 (36%) were more likely to have mitral valve prolapse and dilation of the main pulmonary artery and left ventricle, but there were no differences in aortic regurgitation, aortic stiffness indices, mitral regurgitation, or left ventricular function compared with subjects with ROOTmax Z scores < 4.5. Conclusions The echocardiographic methodology, training, and quality review process resulted in a robust evaluation of aortic root dimensions, with excellent reproducibility. PMID:23582510

Randomized controlled trials of simulation-based interventions in Emergency Medicine: a methodological review.

PubMed

Chauvin, Anthony; Truchot, Jennifer; Bafeta, Aida; Pateron, Dominique; Plaisance, Patrick; Yordanov, Youri

2018-04-01

The number of trials assessing Simulation-Based Medical Education (SBME) interventions has rapidly expanded. Many studies show that potential flaws in design, conduct and reporting of randomized controlled trials (RCTs) can bias their results. We conducted a methodological review of RCTs assessing a SBME in Emergency Medicine (EM) and examined their methodological characteristics. We searched MEDLINE via PubMed for RCT that assessed a simulation intervention in EM, published in 6 general and internal medicine and in the top 10 EM journals. The Cochrane Collaboration risk of Bias tool was used to assess risk of bias, intervention reporting was evaluated based on the "template for intervention description and replication" checklist, and methodological quality was evaluated by the Medical Education Research Study Quality Instrument. Reports selection and data extraction was done by 2 independents researchers. From 1394 RCTs screened, 68 trials assessed a SBME intervention. They represent one quarter of our sample. Cardiopulmonary resuscitation (CPR) is the most frequent topic (81%). Random sequence generation and allocation concealment were performed correctly in 66 and 49% of trials. Blinding of participants and assessors was performed correctly in 19 and 68%. Risk of attrition bias was low in three-quarters of the studies (n = 51). Risk of selective reporting bias was unclear in nearly all studies. The mean MERQSI score was of 13.4/18.4% of the reports provided a description allowing the intervention replication. Trials assessing simulation represent one quarter of RCTs in EM. Their quality remains unclear, and reproducing the interventions appears challenging due to reporting issues.

Implementation and evaluation of a multisite drug usage evaluation program across Australian hospitals - a quality improvement initiative

PubMed Central

2011-01-01

Background With the use of medicines being a broad and extensive part of health management, mechanisms to ensure quality use of medicines are essential. Drug usage evaluation (DUE) is an evidence-based quality improvement methodology, designed to improve the quality, safety and cost-effectiveness of drug use. The purpose of this paper is to describe a national DUE methodology used to improve health care delivery across the continuum through multi-faceted intervention involving audit and feedback, academic detailing and system change, and a qualitative assessment of the methodology, as illustrated by the Acute Postoperative Pain Management (APOP) project. Methods An established methodology, consisting of a baseline audit of inpatient medical records, structured patient interviews and general practitioner surveys, followed by an educational intervention and follow-up audit, is used. Australian hospitals, including private, public, metropolitan and regional, are invited to participate on a voluntary basis. De-identified data collected by hospitals are collated and evaluated nationally to provide descriptive comparative analyses. Hospitals benchmark their practices against state and national results to facilitate change. The educational intervention consists of academic detailing, group education, audit and feedback, point-of-prescribing prompts and system changes. A repeat data collection is undertaken to assess changes in practice. An online qualitative survey was undertaken to evaluate the APOP program. Qualitative assessment of hospitals' perceptions of the effectiveness of the overall DUE methodology and changes in procedure/prescribing/policy/clinical practice which resulted from participation were elicited. Results 62 hospitals participated in the APOP project. Among 23 respondents to the evaluation survey, 18 (78%) reported improvements in the documentation of pain scores at their hospital. 15 (65%) strongly agreed or agreed that participation in APOP directly resulted in increased prescribing of multimodal analgesia for pain relief in postoperative patients. Conclusions This national DUE program has facilitated the engagement and participation of a number of acute health care facilities to address issues relating to quality use of medicine. This approach has been perceived to be effective in helping them achieve improvements in patient care. PMID:21871132

Implementation and evaluation of a multisite drug usage evaluation program across Australian hospitals - a quality improvement initiative.

PubMed

Pulver, Lisa K; Wai, Angela; Maxwell, David J; Robertson, Marion B; Riddell, Steven

2011-08-29

With the use of medicines being a broad and extensive part of health management, mechanisms to ensure quality use of medicines are essential. Drug usage evaluation (DUE) is an evidence-based quality improvement methodology, designed to improve the quality, safety and cost-effectiveness of drug use. The purpose of this paper is to describe a national DUE methodology used to improve health care delivery across the continuum through multi-faceted intervention involving audit and feedback, academic detailing and system change, and a qualitative assessment of the methodology, as illustrated by the Acute Postoperative Pain Management (APOP) project. An established methodology, consisting of a baseline audit of inpatient medical records, structured patient interviews and general practitioner surveys, followed by an educational intervention and follow-up audit, is used. Australian hospitals, including private, public, metropolitan and regional, are invited to participate on a voluntary basis. De-identified data collected by hospitals are collated and evaluated nationally to provide descriptive comparative analyses. Hospitals benchmark their practices against state and national results to facilitate change. The educational intervention consists of academic detailing, group education, audit and feedback, point-of-prescribing prompts and system changes. A repeat data collection is undertaken to assess changes in practice.An online qualitative survey was undertaken to evaluate the APOP program. Qualitative assessment of hospitals' perceptions of the effectiveness of the overall DUE methodology and changes in procedure/prescribing/policy/clinical practice which resulted from participation were elicited. 62 hospitals participated in the APOP project. Among 23 respondents to the evaluation survey, 18 (78%) reported improvements in the documentation of pain scores at their hospital. 15 (65%) strongly agreed or agreed that participation in APOP directly resulted in increased prescribing of multimodal analgesia for pain relief in postoperative patients. This national DUE program has facilitated the engagement and participation of a number of acute health care facilities to address issues relating to quality use of medicine. This approach has been perceived to be effective in helping them achieve improvements in patient care.

Evaluation of Quality of Lower Limb Arthroplasty Observational Studies Using the Assessment of Quality in Lower Limb Arthroplasty (AQUILA) Checklist.

PubMed

Cowan, James B; Mlynarek, Ryan A; Nelissen, Rob G H H; Pijls, Bart G C W; Gagnier, Joel J

2015-09-01

This study used the assessment of quality in lower limb arthroplasty (AQUILA) checklist to assess the quality of lower limb arthroplasty observational studies. Among 132 studies the mean reporting quality score was 5.4 (SD=1.2) out of 8 possible points. Most studies adequately reported reasons for revisions (98%) and prosthesis brand and fixation (95%) in sufficient detail. Only 3% of studies adequately reported the number of patients unwilling to participate, 15% stated a clear primary research question or hypothesis, 11% reported a worst-case analysis or competing risk analysis for endpoints, and 42% reported more than 5% of patients were lost to follow-up. There is significant room for improvement in the reporting and methodology of lower limb arthroplasty observational studies. Level III. Copyright © 2015 Elsevier Inc. All rights reserved.

A systematic review of the quality of homeopathic pathogenetic trials published from 1945 to 1995.

PubMed

Dantas, F; Fisher, P; Walach, H; Wieland, F; Rastogi, D P; Teixeira, H; Koster, D; Jansen, J P; Eizayaga, J; Alvarez, M E P; Marim, M; Belon, P; Weckx, L L M

2007-01-01

The quality of information gathered from homeopathic pathogenetic trials (HPTs), also known as 'provings', is fundamental to homeopathy. We systematically reviewed HPTs published in six languages (English, German, Spanish, French, Portuguese and Dutch) from 1945 to 1995, to assess their quality in terms of the validity of the information they provide. The literature was comprehensively searched, only published reports of HPTs were included. Information was extracted by two reviewers per trial using a form with 87 items. Information on: medicines, volunteers, ethical aspects, blinding, randomization, use of placebo, adverse effects, assessments, presentation of data and number of claimed findings were recorded. Methodological quality was assessed by an index including indicators of internal and external validity, personal judgement and comments of reviewers for each study. 156 HPTs on 143 medicines, involving 2815 volunteers, produced 20,538 pathogenetic effects (median 6.5 per volunteer). There was wide variation in methods and results. Sample size (median 15, range 1-103) and trial duration (mean 34 days) were very variable. Most studies had design flaws, particularly absence of proper randomization, blinding, placebo control and criteria for analysis of outcomes. Mean methodological score was 5.6 (range 4-16). More symptoms were reported from HPTs of poor quality than from better ones. In 56% of trials volunteers took placebo. Pathogenetic effects were claimed in 98% of publications. On average about 84% of volunteers receiving active treatment developed symptoms. The quality of reports was in general poor, and much important information was not available. The HPTs were generally of low methodological quality. There is a high incidence of pathogenetic effects in publications and volunteers but this could be attributable to design flaws. Homeopathic medicines, tested in HPTs, appear safe. The central question of whether homeopathic medicines in high dilutions can provoke effects in healthy volunteers has not yet been definitively answered, because of methodological weaknesses of the reports. Improvement of the method and reporting of results of HPTs are required. References to all included RCTs are available on-line at.

QUALITY OF HEALTH TECHNOLOGY ASSESSMENT REPORTS PREPARED FOR THE MEDICAL SERVICES ADVISORY COMMITTEE.

PubMed

Hua, Martin; Boonstra, Tristan; Kelly, Patrick J; Wilson, Andrew; Craig, Jonathan C; Webster, Angela C

2016-01-01

The Medical Services Advisory Committee (MSAC) makes recommendations to the Australian Government for funding health technologies under the Medicare Benefits Schedule (MBS). Differences in public, clinical, commercial, and political opinions on health expenditure emphasize the importance of defensible funding decisions. We aimed to evaluate the quality of health technology assessment (HTA) reports over time and among health technologies assessed for MSAC. A cohort study was performed of HTA reports prepared for MSAC between 1998 and 2013. We measured the quality of HTA reports using reporting guidelines proposed by the European Collaboration for Assessment of Health Interventions. Individual component scores across eleven domains were calculated, and summed for an overall aggregate score. We used linear regression to investigate any change in quality over time and among the types of technologies assessed. We included 110 HTA reports. The safety (80 percent), effectiveness (84 percent), economic (74 percent), and organizational (99 percent) domains were better reported than the psychological, social, and ethical considerations (34 percent). The basic (75 percent), methodological (62 percent), background (82 percent), contextual (46 percent), status quo (54 percent), and technical information (66 percent) that framed each assessment were inconsistently reported. On average, overall quality scores increased by 2 percent (p < 0.001) per year, from approximately 60 percent to 80 percent over the 15-year period, with no significant difference among surgical, diagnostic or other nonpharmaceutical health technologies (p = 0.22). HTA reports prepared for MSAC are a key tool in allocating scarce health resources. The overall quality of these reports has improved, but the reporting of specific domains and subthemes therein could be better addressed.

A systematic review of economic evaluation in pancreatic ductal adenocarcinoma.

PubMed

Gérard, Claire; Fagnoni, Philippe; Vienot, Angélique; Borg, Christophe; Limat, Samuel; Daval, Franck; Calais, François; Vardanega, Julie; Jary, Marine; Nerich, Virginie

2017-11-01

The economic evaluation (EE) of healthcare interventions has become a necessity. However, high quality needs to be ensured in order to achieve validated results and help making informed decisions. Thus, the objective of the present study was to systematically identify and review published pancreatic ductal adenocarcinoma-related EEs and to assess their quality. Systematic literature research was conducted in PubMed and Cochrane to identify published EEs between 2000 and 2015. The quality of each selected EE was assessed by two independent reviewers, using the Drummond's checklist. Our systematic review was based on 32 EEs and showed a wide variety of methodological approaches, including different perspectives, time horizon, and cost effectiveness analyses. Nearly two-thirds of EEs are full EEs (n = 21), and about one-third of EEs had a Drummond score ≥7, synonymous with 'high quality'. Close to 50% of full EEs had a Drummond score ≥7, whereas all of partial EEs had a Drummond score <7 (n = 11). Over the past 15 years, a lot of interest has been evinced over the EE of pancreatic ductal adenocarcinoma (PDAC) and its direct impact on therapeutic advances in PDAC. To provide a framework for health care decision-making, to facilitate transferability and to lend credibility to health EEs, their quality must be improved. For the last 4 years, a tendency towards a quality improvement of these studies has been observed, probably coupled with a context of rational decision-making in health care, a better and wider spread of recommendations and thus, medical practitioners' full endorsement. Copyright © 2017 Elsevier Ltd. All rights reserved.

Spinal curves and health: a systematic critical review of the epidemiological literature dealing with associations between sagittal spinal curves and health.

PubMed

Christensen, Sanne Toftgaard; Hartvigsen, Jan

2008-01-01

The purposes of this study were to (1) determine whether sagittal spinal curves are associated with health in epidemiological studies, (2) estimate the strength of such associations, and (3) consider whether these relations are likely to be causal. A systematic critical literature review of epidemiological (cross-sectional, case-control, cohort) studies published before 2008 including studies identified in the CINAHL, EMBASE, Mantis, and Medline databases was performed using a structured checklist and a quality assessment. Level of evidence analysis was performed as outlined by van Tulder et al (Spine. 2003;28:1290-9), and the strength of associations were determined using the procedure outlined by Hemingway and Marmot (BMJ. 1999;318:1460-7). Quality of the included articles were assessed by our own scoring system based on the STrengthening the Reporting of OBservational studies in Epidemiology checklist. Studies scoring maximum points (4/4 or 3/3) were considered to be of higher quality. Fifty-four original studies were included. We found no strong evidence for any association between sagittal spinal curves and any health outcomes including spinal pain. The included studies were generally of low methodological quality. There is moderate evidence for association between sagittal spinal curves and 4 health outcomes as follows: temporomandibular disorders (no odds ratios [ORs] provided), pelvic organ prolapse (OR, 3.18; 95% confidence interval [CI], 1.46-96.93), daily function (OR range, 1.8-3.7; 95% CI range, 1.1-6.3), and death (OR, 1.40; 95% CI, 1.08-1.91). These associations are however unlikely to be causal. Evidence from epidemiological studies does not support an association between sagittal spinal curves and health including spinal pain. Further research of better methodological quality may affect this conclusion, and causal effects cannot be determined in a systematic review.

The methodological quality of guidelines for hospital-acquired pneumonia and ventilator-associated pneumonia: A systematic review.

PubMed

Ambaras Khan, R; Aziz, Z

2018-05-02

Clinical practice guidelines serve as a framework for physicians to make decisions and to support best practice for optimizing patient care. However, if the guidelines do not address all the important components of optimal care sufficiently, the quality and validity of the guidelines can be reduced. The objectives of this study were to systematically review current guidelines for hospital-acquired pneumonia (HAP) and ventilator-associated pneumonia (VAP), evaluate their methodological quality and highlight the similarities and differences in their recommendations for empirical antibiotic and antibiotic de-escalation strategies. This review is reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement. Electronic databases including MEDLINE, CINAHL, PubMed and EMBASE were searched up to September 2017 for relevant guidelines. Other databases such as NICE, Scottish Intercollegiate Guidelines Network (SIGN) and the websites of professional societies were also searched for relevant guidelines. The quality and reporting of included guidelines were assessed using the Appraisal of Guidelines for Research and Evaluation II (AGREE-II) instrument. Six guidelines were eligible for inclusion in our review. Among 6 domains of AGREE-II, "clarity of presentation" scored the highest (80.6%), whereas "applicability" scored the lowest (11.8%). All the guidelines supported the antibiotic de-escalation strategy, whereas the majority of the guidelines (5 of 6) recommended that empirical antibiotic therapy should be implemented in accordance with local microbiological data. All the guidelines suggested that for early-onset HAP/VAP, therapy should start with a narrow spectrum empirical antibiotic such as penicillin or cephalosporins, whereas for late-onset HAP/VAP, the guidelines recommended the use of a broader spectrum empirical antibiotic such as the penicillin extended spectrum carbapenems and glycopeptides. Expert guidelines promote the judicious use of antibiotics and prevent antibiotic overuse. The quality and validity of available HAP/VAP guidelines would be enhanced by improving their adherence to accepted best practice for the management of HAP and VAP. © 2018 John Wiley & Sons Ltd.

Reporting characteristics of meta-analyses in orthodontics: methodological assessment and statistical recommendations.

PubMed

Papageorgiou, Spyridon N; Papadopoulos, Moschos A; Athanasiou, Athanasios E

2014-02-01

Ideally meta-analyses (MAs) should consolidate the characteristics of orthodontic research in order to produce an evidence-based answer. However severe flaws are frequently observed in most of them. The aim of this study was to evaluate the statistical methods, the methodology, and the quality characteristics of orthodontic MAs and to assess their reporting quality during the last years. Electronic databases were searched for MAs (with or without a proper systematic review) in the field of orthodontics, indexed up to 2011. The AMSTAR tool was used for quality assessment of the included articles. Data were analyzed with Student's t-test, one-way ANOVA, and generalized linear modelling. Risk ratios with 95% confidence intervals were calculated to represent changes during the years in reporting of key items associated with quality. A total of 80 MAs with 1086 primary studies were included in this evaluation. Using the AMSTAR tool, 25 (27.3%) of the MAs were found to be of low quality, 37 (46.3%) of medium quality, and 18 (22.5%) of high quality. Specific characteristics like explicit protocol definition, extensive searches, and quality assessment of included trials were associated with a higher AMSTAR score. Model selection and dealing with heterogeneity or publication bias were often problematic in the identified reviews. The number of published orthodontic MAs is constantly increasing, while their overall quality is considered to range from low to medium. Although the number of MAs of medium and high level seems lately to rise, several other aspects need improvement to increase their overall quality.

The relationship between external and internal validity of randomized controlled trials: A sample of hypertension trials from China.

PubMed

Zhang, Xin; Wu, Yuxia; Ren, Pengwei; Liu, Xueting; Kang, Deying

2015-10-30

To explore the relationship between the external validity and the internal validity of hypertension RCTs conducted in China. Comprehensive literature searches were performed in Medline, Embase, Cochrane Central Register of Controlled Trials (CCTR), CBMdisc (Chinese biomedical literature database), CNKI (China National Knowledge Infrastructure/China Academic Journals Full-text Database) and VIP (Chinese scientific journals database) as well as advanced search strategies were used to locate hypertension RCTs. The risk of bias in RCTs was assessed by a modified scale, Jadad scale respectively, and then studies with 3 or more grading scores were included for the purpose of evaluating of external validity. A data extract form including 4 domains and 25 items was used to explore relationship of the external validity and the internal validity. Statistic analyses were performed by using SPSS software, version 21.0 (SPSS, Chicago, IL). 226 hypertension RCTs were included for final analysis. RCTs conducted in university affiliated hospitals (P < 0.001) or secondary/tertiary hospitals (P < 0.001) were scored at higher internal validity. Multi-center studies (median = 4.0, IQR = 2.0) were scored higher internal validity score than single-center studies (median = 3.0, IQR = 1.0) (P < 0.001). Funding-supported trials had better methodological quality (P < 0.001). In addition, the reporting of inclusion criteria also leads to better internal validity (P = 0.004). Multivariate regression indicated sample size, industry-funding, quality of life (QOL) taken as measure and the university affiliated hospital as trial setting had statistical significance (P < 0.001, P < 0.001, P = 0.001, P = 0.006 respectively). Several components relate to the external validity of RCTs do associate with the internal validity, that do not stand in an easy relationship to each other. Regarding the poor reporting, other possible links between two variables need to trace in the future methodological researches.

Aqueduct: a methodology to measure and communicate global water risks

NASA Astrophysics Data System (ADS)

Gassert, Francis; Reig, Paul

2013-04-01

The Aqueduct Water Risk Atlas (Aqueduct) is a publicly available, global database and interactive tool that maps indicators of water related risks for decision makers worldwide. Aqueduct makes use of the latest geo-statistical modeling techniques to compute a composite index and translate the most recently available hydrological data into practical information on water related risks for companies, investors, and governments alike. Twelve global indicators are grouped into a Water Risk Framework designed in response to the growing concerns from private sector actors around water scarcity, water quality, climate change, and increasing demand for freshwater. The Aqueduct framework organizes indicators into three categories of risk that bring together multiple dimensions of water related risk into comprehensive aggregated scores and includes indicators of water stress, variability in supply, storage, flood, drought, groundwater, water quality and social conflict, addressing both spatial and temporal variation in water hazards. Indicators are selected based on relevance to water users, availability and robustness of global data sources, and expert consultation, and are collected from existing datasets or derived from a Global Land Data Assimilation System (GLDAS) based integrated water balance model. Indicators are normalized using a threshold approach, and composite scores are computed using a linear aggregation scheme that allows for dynamic weighting to capture users' unique exposure to water hazards. By providing consistent scores across the globe, the Aqueduct Water Risk Atlas enables rapid comparison across diverse aspects of water risk. Companies can use this information to prioritize actions, investors to leverage financial interest to improve water management, and governments to engage with the private sector to seek solutions for more equitable and sustainable water governance. The Aqueduct Water Risk Atlas enables practical applications of scientific data, helping non-expert audiences better understand and evaluate risks facing water users. This presentation will discuss the methodology used to combine the indicator values into aggregated risk scores and lessons learned from working with diverse audiences in academia, development institutions, and the public and private sectors.

Comparative effectiveness research methodology using secondary data: A starting user's guide.

PubMed

Sun, Maxine; Lipsitz, Stuart R

2018-04-01

The use of secondary data, such as claims or administrative data, in comparative effectiveness research has grown tremendously in recent years. We believe that the current review can help investigators relying on secondary data to (1) gain insight into both the methodologies and statistical methods, (2) better understand the necessity of a rigorous planning before initiating a comparative effectiveness investigation, and (3) optimize the quality of their investigations. Specifically, we review concepts of adjusted analyses and confounders, methods of propensity score analyses, and instrumental variable analyses, risk prediction models (logistic and time-to-event), decision-curve analysis, as well as the interpretation of the P value and hypothesis testing. Overall, we hope that the current review article can help research investigators relying on secondary data to perform comparative effectiveness research better understand the necessity of a rigorous planning before study start, and gain better insight in the choice of statistical methods so as to optimize the quality of the research study. Copyright © 2017 Elsevier Inc. All rights reserved.

Occupational Noise and Ischemic Heart Disease: A Systematic Review

PubMed Central

Dzhambov, Angel M; Dimitrova, Donka D

2016-01-01

Noise exposure might be a risk factor for ischemic heart disease (IHD). Unlike residential exposure, however, evidence for occupational noise is limited. Given that high-quality quantitative synthesis of existing data is highly warranted for occupational safety and policy, we aimed at conducting a systematic review and meta-analysis of the risks of IHD morbidity and mortality because of occupational noise exposure. We carried out a systematic search in MEDLINE, EMBASE, and on the Internet since April 2, 2015, in English, Spanish, Russian, and Bulgarian. A quality-scoring checklist was developed a priori to assess different sources of methodological bias. A qualitative data synthesis was performed. Conservative assumptions were applied when appropriate. A meta-analysis was not feasible because of unresolvable methodological discrepancies between the studies. On the basis of five studies, there was some evidence to suggest higher risk of IHD among workers exposed to objectively assessed noise >75–80 dB for <20 years (supported by one high, one moderate, and one low quality study, opposed by one high and one moderate quality study). Three moderate and two low quality studies out of six found self-rated exposure to be associated with higher risk of IHD, and only one moderate quality study found no effect. Out of four studies, a higher mortality risk was suggested by one moderate quality study relying on self-rated exposure and one of high-quality study using objective exposure. Sensitivity analyses showed that at higher exposures and in some vulnerable subgroups, such as women, the adverse effects were considerably stronger. Despite methodological discrepancies and limitations of the included studies, occupational noise appeared to be a risk factor for IHD morbidity. Results suggested higher risk for IHD mortality only among vulnerable subgroups. Workers exposed to high occupational noise should be considered at higher overall risk of IHD. PMID:27569404

Highlights in emergency medicine medical education research: 2008.

PubMed

Farrell, Susan E; Coates, Wendy C; Khun, Gloria J; Fisher, Jonathan; Shayne, Philip; Lin, Michelle

2009-12-01

The purpose of this article is to highlight medical education research studies published in 2008 that were methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine. Through a PubMed search of the English language literature in 2008, 30 medical education research studies were independently identified as hypothesis-testing investigations and measurements of educational interventions. Six reviewers independently rated and scored all articles based on eight anchors, four of which related to methodologic criteria. Articles were ranked according to their total rating score. A ranking agreement among the reviewers of 83% was established a priori as a minimum for highlighting articles in this review. Five medical education research studies met the a priori criteria for inclusion and are reviewed and summarized here. Four of these employed experimental or quasi-experimental methodology. Although technology was not a component of the structured literature search employed to identify the candidate articles for this review, 14 of the articles identified, including four of the five highlighted articles, employed or studied technology as a focus of the educational research. Overall, 36% of the reviewed studies were supported by funding; three of the highlighted articles were funded studies. This review highlights quality medical education research studies published in 2008, with outcomes of relevance to teaching and education in emergency medicine. It focuses on research methodology, notes current trends in the use of technology for learning in emergency medicine, and suggests future avenues for continued rigorous study in education.

Quality in physical therapist clinical education: a systematic review.

PubMed

McCallum, Christine A; Mosher, Peter D; Jacobson, Peri J; Gallivan, Sean P; Giuffre, Suzanne M

2013-10-01

Many factors affect student learning throughout the clinical education (CE) component of professional (entry-level) physical therapist education curricula. Physical therapist education programs (PTEPs) manage CE, yet the material and human resources required to provide CE are generally overseen by community-based physical therapist practices. The purposes of this systematic review were: (1) to examine how the construct of quality is defined in CE literature and (2) to determine the methodological rigor of the available evidence on quality in physical therapist CE. This study was a systematic review of English-language journals using the American Physical Therapy Association's Open Door Portal to Evidence-Based Practice as the computer search engine. The search was categorized using terms for physical therapy and quality and for CE pedagogy and models or roles. Summary findings were characterized by 5 primary themes and 14 subthemes using a qualitative-directed content analysis. Fifty-four articles were included in the study. The primary quality themes were: CE framework, CE sites, structure of CE, assessment in CE, and CE faculty. The methodological rigor of the studies was critically appraised using a binary system based on the McMaster appraisal tools. Scores ranged from 3 to 14. Publication bias and outcome reporting bias may be inherent limitations to the results. The review found inconclusive evidence about what constitutes quality or best practice for physical therapist CE. Five key constructs of CE were identified that, when aggregated, could construe quality.

Music for medical indications in the neonatal period: a systematic review of randomised controlled trials.

PubMed

Hartling, L; Shaik, M S; Tjosvold, L; Leicht, R; Liang, Y; Kumar, M

2009-09-01

To conduct a systematic review of the efficacy of music for medical indications in term or preterm neonates. We searched 17 electronic databases, subject bibliographies, reference lists and trials registries. Two reviewers independently screened studies for inclusion, assessed methodological quality, and extracted data. Meta-analysis was not feasible due to heterogeneity in outcomes so a qualitative analysis is presented. Nine randomised trials were included. The methodological quality was generally poor (median Jadad score = 1). The outcomes most commonly reported were physiological measures (heart rate (HR), respiratory rate, oxygen saturation (SaO2)), behavioural state and pain. Six studies evaluated music for the painful procedures circumcision (three trials) and heel prick (three trials). For circumcisions, one high quality pilot study (n = 23) showed benefits of music for the outcomes of HR, SaO2 and pain, while two low quality studies showed no difference. For heel prick, three low quality studies provided some evidence that music may be beneficial primarily for measures of behaviour and pain. The remaining studies evaluated the use of music in preterm infants to improve physiological and behavioural parameters (n = 31; benefits observed for behavioural parameters), to reinforce non-nutritive sucking via use of a pacifier activated lullaby (n = 32; significant increase in feeding rates), and to influence physiological stability and behaviours in infants with chronic lung disease (n = 22; no significant differences for outcomes assessed). The heterogeneity in study populations, interventions and outcomes precludes definitive conclusions around efficacy. There is preliminary evidence for some therapeutic benefits of music for specific indications; however, these findings need to be confirmed in methodologically rigorous trials.

Joint scientific statement of the European Association for the Study of Obesity and the European Society of Hypertension: Obesity and early vascular ageing.

PubMed

Jordan, Jens; Nilsson, Peter M; Kotsis, Vasilios; Olsen, Michael H; Grassi, Guido; Yumuk, Volkan; Hauner, Hans; Zahorska-Markiewicz, Barbara; Toplak, Hermann; Engeli, Stefan; Finer, Nick

2015-03-01

Current cardiovascular risk scores do not include obesity or fat distribution as independent factors, and may underestimate risk in obese individuals. Assessment of early vascular ageing (EVA) biomarkers including arterial stiffness, central blood pressure, carotid intima-media thickness and flow-mediated vasodilation may help to refine risk assessment in obese individuals in whom traditional cardiovascular risk scores and factors suggest no need for specific medical attention. A number of issues need to be addressed before this approach is ready for translation into routine clinical practice. Methodologies for measurements of vascular markers need to be further standardized and less operator-dependent. The utility of these nontraditional risk factors will also need to be proven in sufficiently large and properly designed interventional studies. Indeed, published studies on vascular markers in obesity and weight loss vary in quality and study design, are sometimes conducted in small populations, use a variety of differing methodologies and study differing vascular beds. Finally, current vascular measurements are still crude and may not be sufficient to cover the different aspects of EVA in obesity.

Physical examination tests for the diagnosis of femoroacetabular impingement. A systematic review.

PubMed

Pacheco-Carrillo, Aitana; Medina-Porqueres, Ivan

2016-09-01

Numerous clinical tests have been proposed to diagnose FAI, but little is known about their diagnostic accuracy. To summarize and evaluate research on the accuracy of physical examination tests for diagnosis of FAI. A search of the PubMed, SPORTDiscus and CINAHL databases was performed. Studies were considered eligible if they compared the results of physical examination tests to those of a reference standard. Methodological quality and internal validity assessment was performed by two independent reviewers using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool. The systematic search strategy revealed 298 potential articles, five of which articles met the inclusion criteria. After assessment using the QUADAS score, four of the five articles were of high quality. Clinical tests included were Impingement sign, IROP test (Internal Rotation Over Pressure), FABER test (Flexion-Abduction-External Rotation), Stinchfield/RSRL (Resisted Straight Leg Raise) test, Scour test, Maximal squat test, and the Anterior Impingement test. IROP test, impingement sign, and FABER test showed the most sensitive values to identify FAI. The diagnostic accuracy of physical examination tests to assess FAI is limited due to its heterogenecity. There is a strong need for sound research of high methodological quality in this area. Copyright © 2016 Elsevier Ltd. All rights reserved.

Acupuncture for Functional Dyspepsia: What Strength Does It Have? A Systematic Review and Meta-Analysis of Randomized Controlled Trials

PubMed Central

Li, Jing; Li, Bo; Hu, Ya-Cai; Cai, Qiu-Han

2016-01-01

Background. Although the effectiveness of acupuncture therapy on functional dyspepsia (FD) has been systematically reviewed, the available reports are still contradictive and no robust evidence has been provided to date. Objective. To assess the current evidence of high quality on the effects of acupuncture for patients with FD. Methods. A comprehensive literature database search was conducted to identify randomized controlled trials (RCTs) comparing acupuncture therapies (including manual acupuncture and electroacupuncture) to sham acupuncture and medication use. A meta-analysis was performed following a strict methodology. Results. 16 RCTs involving 1436 participants were included. The majority of the trials were determined to be of low quality. Positive results were found for acupuncture in improving the Nepean Dyspepsia Index (NDI) and scores of the MOS 36-Item Short-Form Health Survey (SF-36), as well as in alleviating relevant symptoms (especially postprandial fullness and early satiation) of FD patients. Conclusion. Based on current available evidence, acupuncture therapy achieves statistically significant effect for FD in comparison with sham acupuncture and is superior to medication (prokinetic agents) in improving the symptoms and quality of life of FD patients. Nonetheless, despite stringent methodological analyses, the conclusion of our review still needs to be strengthened by additional RCTs of higher quality. PMID:28119758

Inventory of Personal Factors Influencing Conditioned Pain Modulation in Healthy People: A Systematic Literature Review.

PubMed

Hermans, Linda; Van Oosterwijck, Jessica; Goubert, Dorien; Goudman, Lisa; Crombez, Geert; Calders, Patrick; Meeus, Mira

2016-07-01

Conditioned pain modulation (CPM) is believed to play an important role in the development and exacerbation of chronic pain, because dysfunction of CPM is associated with a shift in balance between pain facilitation and pain inhibition. In many patients with central sensitization, CPM is less efficacious. Besides that, efficacy of CPM is highly variable in healthy people. Consequently, it seems that several individual variables may influence CPM. A systematic review examining personal factors influencing CPM was conducted. This systematic review follows the PRISMA guidelines. "Pubmed" and "Web of Science" were searched using different synonyms of CPM. Full-text clinical reports addressing the influence of personal factors on CPM in healthy adults were included. Checklists for RCTs and case-control studies provided by the Dutch Institute for Healthcare Improvement (CBO) and the Dutch Cochrane Centre were utilized to assess methodological quality. Levels of evidence and strength of conclusion were assigned using the CBO guidelines. Forty-six articles were identified that reported the influence of personal factors on CPM. Quality assessment revealed 10 studies with a methodological quality less than 50% wherefore they were excluded (21.8%), resulting in a general total methodological quality score of 72.5%. Overall younger adult age, male gender, ovulatory phase, positive expectations, attention to the conditioning stimulus, and carrier of the 5-HTTLPR long allele result in better CPM. It is advised for future studies to take these factors into account. Further research regarding the influence of oral contraceptives, catastrophizing, information about conditioning stimulation, distraction, physical activity, and genetics on CPM magnitude is required. © 2015 World Institute of Pain.

Effects of obesity on lung volume and capacity in children and adolescents: a systematic review.

PubMed

Winck, Aline Dill; Heinzmann-Filho, João Paulo; Soares, Rafaela Borges; da Silva, Juliana Severo; Woszezenki, Cristhiele Taís; Zanatta, Letiane Bueno

2016-12-01

To assess the effects of obesity on lung volume and capacity in children and adolescents. This is a systematic review, carried out in Pubmed, Lilacs, Scielo and PEDro databases, using the following Keywords: Plethysmography; Whole Body OR Lung Volume Measurements OR Total Lung Capacity OR Functional Residual Capacity OR Residual Volume AND Obesity. Observational studies or clinical trials that assessed the effects of obesity on lung volume and capacity in children and adolescents (0-18 years) without any other associated disease; in English; Portuguese and Spanish languages were selected. Methodological quality was assessed by the Agency for Healthcare Research and Quality. Of the 1,030 articles, only four were included in the review. The studies amounted to 548 participants, predominantly males, with sample size ranging from 45 to 327 individuals. 100% of the studies evaluated nutritional status through BMI (z-score) and 50.0% reported the data on abdominal circumference. All demonstrated that obesity causes negative effects on lung volume and capacity, causing a reduction mainly in functional residual capacity in 75.0% of the studies; in the expiratory reserve volume in 50.0% and in the residual volume in 25.0%. The methodological quality ranged from moderate to high, with 75.0% of the studies classified as having high methodological quality. Obesity causes deleterious effects on lung volume and capacity in children and adolescents, mainly by reducing functional residual capacity, expiratory reserve volume and residual volume. Copyright © 2016 Sociedade de Pediatria de São Paulo. Publicado por Elsevier Editora Ltda. All rights reserved.

Threshold-based segmentation of fluorescent and chromogenic images of microglia, astrocytes and oligodendrocytes in FIJI.

PubMed

Healy, Sinead; McMahon, Jill; Owens, Peter; Dockery, Peter; FitzGerald, Una

2018-02-01

Image segmentation is often imperfect, particularly in complex image sets such z-stack micrographs of slice cultures and there is a need for sufficient details of parameters used in quantitative image analysis to allow independent repeatability and appraisal. For the first time, we have critically evaluated, quantified and validated the performance of different segmentation methodologies using z-stack images of ex vivo glial cells. The BioVoxxel toolbox plugin, available in FIJI, was used to measure the relative quality, accuracy, specificity and sensitivity of 16 global and 9 local threshold automatic thresholding algorithms. Automatic thresholding yields improved binary representation of glial cells compared with the conventional user-chosen single threshold approach for confocal z-stacks acquired from ex vivo slice cultures. The performance of threshold algorithms varies considerably in quality, specificity, accuracy and sensitivity with entropy-based thresholds scoring highest for fluorescent staining. We have used the BioVoxxel toolbox to correctly and consistently select the best automated threshold algorithm to segment z-projected images of ex vivo glial cells for downstream digital image analysis and to define segmentation quality. The automated OLIG2 cell count was validated using stereology. As image segmentation and feature extraction can quite critically affect the performance of successive steps in the image analysis workflow, it is becoming increasingly necessary to consider the quality of digital segmenting methodologies. Here, we have applied, validated and extended an existing performance-check methodology in the BioVoxxel toolbox to z-projected images of ex vivo glia cells. Copyright © 2017 Elsevier B.V. All rights reserved.

Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols

PubMed Central

Mhaskar, Rahul; Djulbegovic, Benjamin; Magazin, Anja; Soares, Heloisa P.; Kumar, Ambuj

2011-01-01

Objectives To assess whether reported methodological quality of randomized controlled trials (RCTs) reflect the actual methodological quality, and to evaluate the association of effect size (ES) and sample size with methodological quality. Study design Systematic review Setting Retrospective analysis of all consecutive phase III RCTs published by 8 National Cancer Institute Cooperative Groups until year 2006. Data were extracted from protocols (actual quality) and publications (reported quality) for each study. Results 429 RCTs met the inclusion criteria. Overall reporting of methodological quality was poor and did not reflect the actual high methodological quality of RCTs. The results showed no association between sample size and actual methodological quality of a trial. Poor reporting of allocation concealment and blinding exaggerated the ES by 6% (ratio of hazard ratio [RHR]: 0.94, 95%CI: 0.88, 0.99) and 24% (RHR: 1.24, 95%CI: 1.05, 1.43), respectively. However, actual quality assessment showed no association between ES and methodological quality. Conclusion The largest study to-date shows poor quality of reporting does not reflect the actual high methodological quality. Assessment of the impact of quality on the ES based on reported quality can produce misleading results. PMID:22424985

45 CFR 156.275 - Accreditation of QHP issuers.

Code of Federal Regulations, 2012 CFR

2012-10-01

... QHP issuers codified in § 156.230(a)(2) and (a)(3). (3) Methodological and scoring criteria for accreditation. Recognized accrediting entities must use transparent and rigorous methodological and scoring...

Total ankle arthroplasty versus ankle arthrodesis for the treatment of end-stage ankle arthritis: a meta-analysis of comparative studies.

PubMed

Kim, Hyun Jung; Suh, Dong Hun; Yang, Jae Hyuk; Lee, Jin Woo; Kim, Hak Jun; Ahn, Hyeong Sik; Han, Seung Woo; Choi, Gi Won

2017-01-01

Total ankle arthroplasty (TAA) and ankle arthrodesis (AA) are the main surgical treatment options for end-stage ankle arthritis. Although the superiority of each modality remains debated, there remains a lack of high-quality evidence-based studies, such as randomized controlled clinical trials, and meta-analyses of comparative studies. We performed a meta-analysis of comparative studies to determine whether there is a significant difference between these two procedures in terms of (i) clinical scores and patient satisfaction, (ii) re-operations, and (iii) complications. We conducted a comprehensive search in the MEDLINE, EMBASE, and Cochrane library databases. Only retrospective or prospective comparative studies were included in this meta-analysis. The literature search, data extraction, and quality assessment were conducted by two independent reviewers. The primary outcomes were clinical scores and patient satisfaction. We also investigated the prevalence of complications and the re-operation rate. Ten comparative studies were included (four prospective and six retrospective studies). There were no significant differences between the two procedures in the American Orthopaedic Foot and Ankle Society ankle-hindfoot score, Short Form-36 physical component summary and mental component summary scores, visual analogue scale for pain, and patient satisfaction rate. The risk of re-operation and major surgical complications were significantly increased in the TAA group. The meta-analysis revealed that TAA and AA could achieve similar clinical outcomes, whereas the incidence of re-operation and major surgical complication was significantly increased in TAA. Further studies of high methodological quality with long-term follow-up are required to confirm our conclusions.

Diabetes ongoing sustainable care and treatment (DOST): A strategy for informational deliverance through visual dynamic modules sustained by near peer mentoring.

PubMed

Joshi, Ankur; Arutagi, Vishwanath; Nahar, Nitin; Tiwari, Sharad; Singh, Daneshwar; Sethia, Soumitra

2016-01-01

The informational continuity for a diabetic patient is of paramount importance. This study on a pilot basis explores the process utility of structured educational modular sessions grounded on the principle of near-peer mentoring. Visual modules were prepared for diabetic patients. These modules were instituted to 25 diabetic patients in logical sequences. In the next phase, 4 persons of these 25 patients were designated as diabetic-diabetes ongoing sustainable care and treatment (DOST). Each diabetic-DOST was clubbed with two patients for modular session and informational deliverance during the next 7 days. Process analysis was performed with "proxy-indicators," namely, monthly glycemic status, knowledge assessment scores, and quality of life. Data were analyzed by interval estimates and through nonparametric analysis. Nonparametric analysis indicated a significant improvement in glycemic status in terms with fasting blood sugar (W = 78 z = 3.04, P = 0.002), 2 h-postprandial blood sugar (W = 54, z = 2.01, P = 0.035), and in knowledge score (χ 2 = 19.53, df = 3; P = 0.0002). Quality of life score showed significant improvement in 2 out of 7 domains, namely, satisfaction with treatment ([difference in mean score = 1.40 [1.94 to 0.85]) and symptom botherness (difference in mean score = 0.98 [1.3-0.65]). Because of inherent methodological limitations and innate biases, at this juncture no conclusive statement can be drawn. Although, primitive process evidences indicate the promising role of the diabetic-DOST strategy.

Roselle (Hibiscus sabdariffa L.) and soybean oil effects on quality characteristics of pork patties studied by response surface methodology.

PubMed

Jung, Eunkyung; Joo, Nami

2013-07-01

Response surface methodology was used to investigate the effect and interactions of processing variables such as roselle extract (0.1-1.3%), soybean oil (5-20%) on physicochemical, textural and sensory properties of cooked pork patties. It was found that reduction in thickness, pH, L* and b* values decreased; however, water-holding capacity, reduction in diameter and a* values increased, respectively, as the amount of roselle increased. Soybean oil addition increased water-holding capacity, reduction in thickness, b* values of the patties. The hardness depended on the roselle and soybean oil added, as its linear effect was negative at p<0.01. The preference of color, tenderness, juiciness, and overall quality depend on the addition of roselle and soybean oil. The maximum overall quality score (5.42) was observed when 12.5 g of soybean oil and 0.7 g of roselle extract was added. The results of this optimization study would be useful for meat industry that tends to increase the product yield for patties using the optimum levels of ingredients by RSM. Copyright © 2013 Elsevier Ltd. All rights reserved.

Building Efficiency Evaluation and Uncertainty Analysis with DOE's Asset Score Preview

DOE Office of Scientific and Technical Information (OSTI.GOV)

None

2016-08-12

Building Energy Asset Score Tool, developed by the U.S. Department of Energy (DOE), is a program to encourage energy efficiency improvement by helping building owners and managers assess a building's energy-related systems independent of operations and maintenance. Asset Score Tool uses a simplified EnergyPlus model to provide an assessment of building systems, through minimum user inputs of basic building characteristics. Asset Score Preview is a newly developed option that allows users to assess their building's systems and the potential value of a more in-depth analysis via an even more simplified approach. This methodology provides a preliminary approach to estimating amore » building's energy efficiency and potential for improvement. This paper provides an overview of the methodology used for the development of Asset Score Preview and the scoring methodology.« less

45 CFR 156.275 - Accreditation of QHP issuers.

Code of Federal Regulations, 2013 CFR

2013-10-01

... issuers codified in § 156.230(a)(2) and (a)(3). (3) Methodological and scoring criteria for accreditation. Recognized accrediting entities must use transparent and rigorous methodological and scoring criteria. (4...

45 CFR 156.275 - Accreditation of QHP issuers.

Code of Federal Regulations, 2014 CFR

2014-10-01

... issuers codified in § 156.230(a)(2) and (a)(3). (3) Methodological and scoring criteria for accreditation. Recognized accrediting entities must use transparent and rigorous methodological and scoring criteria. (4...

The quality of reporting of randomized controlled trials of traditional Chinese medicine: a survey of 13 randomly selected journals from mainland China.

PubMed

Wang, Gang; Mao, Bing; Xiong, Ze-Yu; Fan, Tao; Chen, Xiao-Dong; Wang, Lei; Liu, Guan-Jian; Liu, Jia; Guo, Jia; Chang, Jing; Wu, Tai-Xiang; Li, Ting-Qian

2007-07-01

The number of randomized controlled trials (RCTs) of traditional Chinese medicine (TCM) is increasing. However, there have been few systematic assessments of the quality of reporting of these trials. This study was undertaken to evaluate the quality of reporting of RCTs in TCM journals published in mainland China from 1999 to 2004. Thirteen TCM journals were randomly selected by stratified sampling of the approximately 100 TCM journals published in mainland China. All issues of the selected journals published from 1999 to 2004 were hand-searched according to guidelines from the Cochrane Centre. All reviewers underwent training in the evaluation of RCTs at the Chinese Centre of Evidence-based Medicine. A comprehensive quality assessment of each RCT was completed using a modified version of the Consolidated Standards of Reporting Trials (CONSORT) checklist (total of 30 items) and the Jadad scale. Disagreements were resolved by consensus. Seven thousand four hundred twenty-two RCTs were identified. The proportion of published RCTs relative to all types of published clinical trials increased significantly over the period studied, from 18.6% in 1999 to 35.9% in 2004 (P < 0.001). The mean (SD) Jadad score was 1.03 (0.61) overall. One RCT had a Jadad score of 5 points; 14 had a score of 4 points; and 102 had a score of 3 points. The mean (SD) Jadad score was 0.85 (0.53) in 1999 (746 RCTs) and 1.20 (0.62) in 2004 (1634 RCTs). Across all trials, 39.4% of the items on the modified CONSORT checklist were reported, which was equivalent to 11.82 (5.78) of the 30 items. Some important methodologic components of RCTs were incompletely reported, such as sample-size calculation (reported in 1.1% of RCTs), randomization sequence (7.9%), allocation concealment (0.3 %), implementation of the random-allocation sequence (0%), and analysis of intention to treat (0%). The findings of this study indicate that the quality of reporting of RCTs of TCM has improved, but remains poor.

Local environmental quality positively predicts breastfeeding in the UK’s Millennium Cohort Study

PubMed Central

Sear, Rebecca

2017-01-01

ABSTRACT Background and Objectives: Breastfeeding is an important form of parental investment with clear health benefits. Despite this, rates remain low in the UK; understanding variation can therefore help improve interventions. Life history theory suggests that environmental quality may pattern maternal investment, including breastfeeding. We analyse a nationally representative dataset to test two predictions: (i) higher local environmental quality predicts higher likelihood of breastfeeding initiation and longer duration; (ii) higher socioeconomic status (SES) provides a buffer against the adverse influences of low local environmental quality. Methodology: We ran factor analysis on a wide range of local-level environmental variables. Two summary measures of local environmental quality were generated by this analysis—one ‘objective’ (based on an independent assessor’s neighbourhood scores) and one ‘subjective’ (based on respondent’s scores). We used mixed-effects regression techniques to test our hypotheses. Results: Higher objective, but not subjective, local environmental quality predicts higher likelihood of starting and maintaining breastfeeding over and above individual SES and area-level measures of environmental quality. Higher individual SES is protective, with women from high-income households having relatively high breastfeeding initiation rates and those with high status jobs being more likely to maintain breastfeeding, even in poor environmental conditions. Conclusions and Implications: Environmental quality is often vaguely measured; here we present a thorough investigation of environmental quality at the local level, controlling for individual- and area-level measures. Our findings support a shift in focus away from individual factors and towards altering the landscape of women’s decision making contexts when considering behaviours relevant to public health. PMID:29354262

Local environmental quality positively predicts breastfeeding in the UK's Millennium Cohort Study.

PubMed

Brown, Laura J; Sear, Rebecca

2017-01-01

Background and Objectives: Breastfeeding is an important form of parental investment with clear health benefits. Despite this, rates remain low in the UK; understanding variation can therefore help improve interventions. Life history theory suggests that environmental quality may pattern maternal investment, including breastfeeding. We analyse a nationally representative dataset to test two predictions: (i) higher local environmental quality predicts higher likelihood of breastfeeding initiation and longer duration; (ii) higher socioeconomic status (SES) provides a buffer against the adverse influences of low local environmental quality. Methodology: We ran factor analysis on a wide range of local-level environmental variables. Two summary measures of local environmental quality were generated by this analysis-one 'objective' (based on an independent assessor's neighbourhood scores) and one 'subjective' (based on respondent's scores). We used mixed-effects regression techniques to test our hypotheses. Results: Higher objective, but not subjective, local environmental quality predicts higher likelihood of starting and maintaining breastfeeding over and above individual SES and area-level measures of environmental quality. Higher individual SES is protective, with women from high-income households having relatively high breastfeeding initiation rates and those with high status jobs being more likely to maintain breastfeeding, even in poor environmental conditions. Conclusions and Implications: Environmental quality is often vaguely measured; here we present a thorough investigation of environmental quality at the local level, controlling for individual- and area-level measures. Our findings support a shift in focus away from individual factors and towards altering the landscape of women's decision making contexts when considering behaviours relevant to public health.

"Big Data" in Rheumatology: Intelligent Data Modeling Improves the Quality of Imaging Data.

PubMed

Landewé, Robert B M; van der Heijde, Désirée

2018-05-01

Analysis of imaging data in rheumatology is a challenge. Reliability of scores is an issue for several reasons. Signal-to-noise ratio of most imaging techniques is rather unfavorable (too little signal in relation to too much noise). Optimal use of all available data may help to increase credibility of imaging data, but knowledge of complicated statistical methodology and the help of skilled statisticians are required. Clinicians should appreciate the merits of sophisticated data modeling and liaise with statisticians to increase the quality of imaging results, as proper imaging studies in rheumatology imply more than a supersensitive imaging technique alone. Copyright © 2018 Elsevier Inc. All rights reserved.

Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols.

PubMed

Mhaskar, Rahul; Djulbegovic, Benjamin; Magazin, Anja; Soares, Heloisa P; Kumar, Ambuj

2012-06-01

To assess whether the reported methodological quality of randomized controlled trials (RCTs) reflects the actual methodological quality and to evaluate the association of effect size (ES) and sample size with methodological quality. Systematic review. This is a retrospective analysis of all consecutive phase III RCTs published by eight National Cancer Institute Cooperative Groups up to 2006. Data were extracted from protocols (actual quality) and publications (reported quality) for each study. Four hundred twenty-nine RCTs met the inclusion criteria. Overall reporting of methodological quality was poor and did not reflect the actual high methodological quality of RCTs. The results showed no association between sample size and actual methodological quality of a trial. Poor reporting of allocation concealment and blinding exaggerated the ES by 6% (ratio of hazard ratio [RHR]: 0.94; 95% confidence interval [CI]: 0.88, 0.99) and 24% (RHR: 1.24; 95% CI: 1.05, 1.43), respectively. However, actual quality assessment showed no association between ES and methodological quality. The largest study to date shows that poor quality of reporting does not reflect the actual high methodological quality. Assessment of the impact of quality on the ES based on reported quality can produce misleading results. Copyright © 2012 Elsevier Inc. All rights reserved.

What Makes a Successful Survey? A Systematic Review of Surveys Used in Anterior Cruciate Ligament Reconstruction.

PubMed

Ekhtiari, Seper; Kay, Jeffrey; de Sa, Darren; Simunovic, Nicole; Musahl, Volker; Peterson, Devin C; Ayeni, Olufemi R

2017-05-01

To characterize and assess the methodological quality of patient and physician surveys related to anterior cruciate ligament reconstruction, and to analyze the factors influencing response rate. The databases MEDLINE, Embase, and PubMed were searched from database inception to search date and screened in duplicate for relevant studies. Data regarding survey characteristics, response rates, and distribution methods were extracted. A previously published list of recommendations for high-quality surveys in orthopaedics was used as a scale to assess survey quality (12 items scored 0, 1, or 2; maximum score = 24). Of the initial 1,276 studies, 53 studies published between 1986 and 2016 met the inclusion criteria. Sixty-four percent of studies were distributed to physicians, compared with 32% distributed to patients and less than 4% to coaches. The median number of items in each survey was 10.5, and the average response rate was 73% (range: 18% to 100%). In-person distribution was the most common method (40%), followed by web-based methods (28%) and mail (25%). Response rates were highest for surveys targeted at patients (77%, P < .0001) and those delivered in-person (94%, P < .0001). The median quality score was 12/24 (range = 8.5/24 to 21/24). There was high inter-rater agreement using the quality scale (intraclass correlation coefficient = 0.92), but there was no correlation with the response rate (Rho = -0.01, P = .97). Response rates vary based on target audience and distribution methods, with patients responding at a significantly higher rate than physicians and in-person distribution yielding significantly higher response rates than web or mail surveys. Level IV, systematic review of Level IV studies. Copyright © 2017 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Metal-backed versus all-polyethylene tibial components in primary total knee arthroplasty

PubMed Central

2011-01-01

Background and purpose The choice of either all-polyethylene (AP) tibial components or metal-backed (MB) tibial components in total knee arthroplasty (TKA) remains controversial. We therefore performed a meta-analysis and systematic review of randomized controlled trials that have evaluated MB and AP tibial components in primary TKA. Methods The search strategy included a computerized literature search (Medline, EMBASE, Scopus, and the Cochrane Central Register of Controlled Trials) and a manual search of major orthopedic journals. A meta-analysis and systematic review of randomized or quasi-randomized trials that compared the performance of tibial components in primary TKA was performed using a fixed or random effects model. We assessed the methodological quality of studies using Detsky quality scale. Results 9 randomized controlled trials (RCTs) published between 2000 and 2009 met the inclusion quality standards for the systematic review. The mean standardized Detsky score was 14 (SD 3). We found that the frequency of radiolucent lines in the MB group was significantly higher than that in the AP group. There were no statistically significant differences between the MB and AP tibial components regarding component positioning, knee score, knee range of motion, quality of life, and postoperative complications. Interpretation Based on evidence obtained from this study, the AP tibial component was comparable with or better than the MB tibial component in TKA. However, high-quality RCTs are required to validate the results. PMID:21895503

Process, cost, and clinical quality: the initial oral contraceptive visit.

PubMed

McMullen, Michael J; Woolford, Samuel W; Moore, Charles L; Berger, Barry M

2013-01-01

To demonstrate how the analysis of clinical process, cost, and outcomes can identify healthcare improvements that reduce cost without sacrificing quality, using the example of the initial visit associated with oral contraceptive pill use. Cross-sectional study using data collected by HealthMETRICS between 1996 and 2009. Using data collected from 106 sites in 24 states, the unintended pregnancy (UIP) rate, effectiveness of patient education, and unit visit cost were calculated. Staff type providing education and placement of education were recorded. Two-way analysis of variance models were created and tested for significance to identify differences between groups. Sites using nonclinical staff to provide education outside the exam were associated with lower cost, higher education scores, and a UIP rate no different from that of sites using clinical staff. Sites also providing patient education during the physical examination were associated with higher cost, lower education scores, and a UIP rate no lower than that of sites providing education outside of the exam. Through analyzing process, cost, and quality, lower-cost processes that did not reduce clinical quality were identified. This methodology is applicable to other clinical services for identifying low-cost processes that do not result in lower clinical quality. By using nonclinical staff educators to provide education outside of the physical examination, sites could save an average of 32% of the total cost of the visit.

Systematic review of economic analyses in patient safety: a protocol designed to measure development in the scope and quality of evidence.

PubMed

Carter, Alexander W; Mandavia, Rishi; Mayer, Erik; Marti, Joachim; Mossialos, Elias; Darzi, Ara

2017-08-18

Recent avoidable failures in patient care highlight the ongoing need for evidence to support improvements in patient safety. According to the most recent reviews, there is a dearth of economic evidence related to patient safety. These reviews characterise an evidence gap in terms of the scope and quality of evidence available to support resource allocation decisions. This protocol is designed to update and improve on the reviews previously conducted to determine the extent of methodological progress in economic analyses in patient safety. A broad search strategy with two core themes for original research (excluding opinion pieces and systematic reviews) in 'patient safety' and 'economic analyses' has been developed. Medline, Econlit and National Health Service Economic Evaluation Database bibliographic databases will be searched from January 2007 using a combination of medical subject headings terms and research-derived search terms (see table 1). The method is informed by previous reviews on this topic, published in 2012. Screening, risk of bias assessment (using the Cochrane collaboration tool) and economic evaluation quality assessment (using the Drummond checklist) will be conducted by two independent reviewers, with arbitration by a third reviewer as needed. Studies with a low risk of bias will be assessed using the Drummond checklist. High-quality economic evaluations are those that score >20/35. A qualitative synthesis of evidence will be performed using a data collection tool to capture the study design(s) employed, population(s), setting(s), disease area(s), intervention(s) and outcome(s) studied. Methodological quality scores will be compared with previous reviews where possible. Effect size(s) and estimate uncertainty will be captured and used in a quantitative synthesis of high-quality evidence, where possible. Formal ethical approval is not required as primary data will not be collected. The results will be disseminated through a peer-reviewed publication, presentations and social media. CRD42017057853. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Efficacy and safety of Suanzaoren decoction for primary insomnia: a systematic review of randomized controlled trials

PubMed Central

2013-01-01

Background Insomnia is a widespread human health problem, but there currently are the limitations of conventional therapies available. Suanzaoren decoction (SZRD) is a well known classic Chinese herbal prescription for insomnia and has been treating people’s insomnia for more than thousand years. The objective of this study was to evaluate the efficacy and safety of SZRD for insomnia. Methods A systematic literature search was performed for 6 databases up to July of 2012 to identify randomized control trials (RCTs) involving SZRD for insomniac patients. The methodological quality of RCTs was assessed independently using the Cochrane Handbook for Systematic Reviews of Interventions. Results Twelve RCTs with total of 1376 adult participants were identified. The methodological quality of all included trials are no more than 3/8 score. Majority of the RCTs concluded that SZRD was more significantly effective than benzodiazepines for treating insomnia. Despite these positive outcomes, there were many methodological shortcomings in the studies reviewed, including insufficient information about randomization generation and absence of allocation concealment, lack of blinding and no placebo control, absence of intention-to-treat analysis and lack of follow-ups, selective publishing and reporting, and small number of sample sizes. A number of clinical heterogeneity such as diagnosis, intervention, control, and outcome measures were also reviewed. Only 3 trials reported adverse events, whereas the other 9 trials did not provide the safety information. Conclusions Despite the apparent reported positive findings, there is insufficient evidence to support efficacy of SZRD for insomnia due to the poor methodological quality and the small number of trials of the included studies. SZRD seems generally safe, but is insufficient evidence to make conclusions on the safety because fewer studies reported the adverse events. Further large sample-size and well-designed RCTs are needed. PMID:23336848

A comparison of macroinvertebrate and habitat methods of data collection in the Little Colorado River Watershed, Arizona 2007

USGS Publications Warehouse

Spindler, Patrice; Paretti, Nick V.

2007-01-01

The Arizona Department of Environmental Quality (ADEQ) and the U.S. Environmental Protection Agency (USEPA) Ecological Monitoring and Assessment Program (EMAP), use different field methods for collecting macroinvertebrate samples and habitat data for bioassessment purposes. Arizona’s Biocriteria index was developed using a riffle habitat sampling methodology, whereas the EMAP method employs a multi-habitat sampling protocol. There was a need to demonstrate comparability of these different bioassessment methodologies to allow use of the EMAP multi-habitat protocol for both statewide probabilistic assessments for integration of the EMAP data into the national (305b) assessment and for targeted in-state bioassessments for 303d determinations of standards violations and impaired aquatic life conditions. The purpose of this study was to evaluate whether the two methods yield similar bioassessment results, such that the data could be used interchangeably in water quality assessments. In this Regional EMAP grant funded project, a probabilistic survey of 30 sites in the Little Colorado River basin was conducted in the spring of 2007. Macroinvertebrate and habitat data were collected using both ADEQ and EMAP sampling methods, from adjacent reaches within these stream channels.

All analyses indicated that the two macroinvertebrate sampling methods were significantly correlated. ADEQ and EMAP samples were classified into the same scoring categories (meeting, inconclusive, violating the biocriteria standard) 82% of the time. When the ADEQ-IBI was applied to both the ADEQ and EMAP taxa lists, the resulting IBI scores were significantly correlated (r=0.91), even though only 4 of the 7 metrics in the IBI were significantly correlated. The IBI scores from both methods were significantly correlated to the percent of riffle habitat, even though the average percent riffle habitat was only 30% of the stream reach. Multivariate analyses found that the percent riffle was an important attribute for both datasets in classifying IBI scores into assessment categories.

Habitat measurements generated from EMAP and ADEQ methods were also significantly correlated; 13 of 16 habitat measures were significantly correlated (p<0.01). The visual-based percentage estimates of percent riffle and pool habitats, vegetative cover and percent canopy cover, and substrate measurements of percent fine substrate and embeddedness were all remarkably similar, given the different field methods used. A multivariate analysis identified substrate and flow conditions, as well as canopy cover as important combinations of habitat attributes affecting both IBI scores. These results indicate that similar habitat measures can be obtained using two different field sampling protocols. In addition, similar combinations of these habitat parameters were important to macroinvertebrate community condition in multivariate analyses of both ADEQ and EMAP datasets.

These results indicate the two sampling methods for macroinvertebrates and habitat data were very similar in terms of bioassessment results and stressors. While the bioassessment category was not identical for all sites, overall the assessments were significantly correlated, providing similar bioassessment results for the cold water streams used in this study. The findings of this study indicate that ADEQ can utilize either a riffle-based sampling methodology or a multi-habitat sampling approach in cold water streams as both yield similar results relative to the macroinvertebrate assemblage. These results will allow for use of either macroinvertebrate dataset to determine water quality standards compliance with the ADEQ Indexes of Biological Integrity, for which threshold values were just recently placed into the Arizona Surface Water Quality Standards. While this survey did not include warm water desert streams of Arizona, we would predict that EMAP and ADEQ sampling methodologies would provide similar bioassessment results and would not be significantly different, as we have found that the percent riffle habitat in cold and warm water perennial, wadeable streams is not significantly different. However, a comparison study of sampling methodologies in warm water streams should be conducted to confirm the predicted similarity of bioassessment results. ADEQ will continue to implement a monitoring strategy that includes probabilistic monitoring for a statewide ecological assessment of stream conditions. Conclusions from this study will guide decisions regarding the most appropriate sampling methods for future probabilistic monitoring sample plans.

External quality assessment of national public health laboratories in Africa, 2002–2009

PubMed Central

Perovic, Olga; Fensham, Vivian; McCarthy, Kerrigan; von Gottberg, Anne; de Gouveia, Linda; Poonsamy, Bhavani; Dini, Leigh; Rossouw, Jenny; Keddy, Karen; Alemu, Wondimagegnehu; Yahaya, Ali; Pierson, Antoine; Dolmazon, Virginie; Cognat, Sébastien; Ndihokubwayo, Jean Bosco

2012-01-01

Abstract Objective To describe findings from an external quality assessment programme involving laboratories in Africa that routinely investigate epidemic-prone diseases. Methods Beginning in 2002, the Regional Office for Africa of the World Health Organization (WHO) invited national public health laboratories and related facilities in Africa to participate in the programme. Three surveys comprising specimens and questionnaires associated with bacterial enteric diseases, bacterial meningitis, plague, tuberculosis and malaria were sent annually to test participants’ diagnostic proficiency. Identical surveys were sent to referee laboratories for quality control. Materials were prepared, packaged and shipped in accordance with standard protocols. Findings and reports were due within 30 days. Key methodological decisions and test results were categorized as acceptable or unacceptable on the basis of consensus feedback from referees, using established grading schemes. Findings Between 2002 and 2009, participation increased from 30 to 48 Member States of the WHO and from 39 to 78 laboratories. Each survey was returned by 64–93% of participants. Mean turnaround time was 25.9 days. For bacterial enteric diseases and meningitis components, bacterial identification was acceptable in 65% and 69% of challenges, respectively, but serotyping and antibiotic susceptibility testing and reporting were frequently unacceptable. Microscopy was acceptable for 73% of plague challenges. Tuberculosis microscopy was satisfactorily performed, with 87% of responses receiving acceptable scores. In the malaria component, 82% of responses received acceptable scores for species identification but only 51% of parasite quantitation scores were acceptable. Conclusion The external quality assessment programme consistently identified certain functional deficiencies requiring strengthening that were present in African public health microbiology laboratories. PMID:22461714

A Systematic Review of the Effectiveness of Manipulative Therapy in Treating Lateral Epicondylalgia

PubMed Central

Herd, Christopher R.; Meserve, Brent B.

2008-01-01

Lateral epicondylalgia is a commonly encountered musculoskeletal complaint. Currently, there is no agreement regarding the exact underlying pathoanatomical cause or the most effective management strategy. Various forms of joint manipulation have been recommended as treatment. The purpose of this study was to systematically review available literature regarding the effectiveness of manipulation in treating lateral epicondylalgia. A comprehensive search of Medline, CINAHL, Health Source, SPORTDiscus, and the Physiotherapy Evidence Database ending in November 2007 was conducted. Thirteen studies, both randomized and non-randomized clinical trials, met inclusion criteria. Articles were assessed for quality by one reviewer using the 10-point PEDro scale. Quality scores ranged from 1–8 with a mean score of 5.15 ± 1.85. This score represented fair quality overall; however, trends indicated the presence of consistent methodological flaws. Specifically, no study achieved successful blinding of the patient or treating therapist, and less than 50% used a blinded outcome assessor. Additionally, studies varied significantly in terms of outcome measures, follow-up, and comparison treatments, thus making comparing results across studies difficult. Results of this review support the use of Mulligan's mobilization with movement in providing immediate, short-, and long-term benefits. In addition, positive results were demonstrated with manipulative therapy directed at the cervical spine, although data regarding long-term effects were limited. Currently, limited evidence exists to support a synthesis of any particular technique whether directed at the elbow or cervical spine. Overall, this review identified the need for further high-quality studies using larger sample sizes, valid functional outcome measures, and longer follow-up periods. PMID:19771195

Ultrasound for assessing disease activity in IBD patients: a systematic review of activity scores.

PubMed

Bots, S; Nylund, K; Löwenberg, M; Gecse, K; Gilja, O H; D'Haens, G

2018-04-19

Ultrasound (US) indices for assessing disease activity in IBD patients have never been critically reviewed. We aimed to systematically review the quality and reliability of available ultrasound (US) indices compared with reference standards for grading disease activity in IBD patients. Pubmed, Embase and Medline were searched from 1990 until June 2017. Relevant publications were identified through full text review after initial screening by 2 investigators. Data on methodology and index characteristics were collected. Study quality was assessed with a modified version of the Quadas-2 tool for risk of bias assessment. Of 20 studies with an US index, 11 studies met the inclusion criteria. Out of these 11 studies, 7 and 4 studied CD and UC activity indices, respectively. Parameters that were used in these indices included bowel wall thickness (BWT), Doppler signal (DS), wall layer stratification (WLS), compressibility, peristalsis, haustrations, fatty wrapping, contrast enhancement (CE) and strain pattern. Study quality was graded high in 5 studies, moderate in 3 studies and low in 3 studies. Ileocolonoscopy was used as the reference standard in 9 studies. In 1 study a combined index of ileocolonoscopy and barium contrast radiography and in 1 study histology was used as the reference standard. Only 5 studies used an established endoscopic index for comparison with US. Several US indices for assessing disease activity in IBD are available; however the methodology for development was suboptimal in most studies. For the development of future indices stringent methodological design is required.

Measuring Longitudinal Gains in Student Learning: A Comparison of Rasch Scoring and Summative Scoring Approaches

ERIC Educational Resources Information Center

Zhao, Yue; Huen, Jenny M. Y.; Chan, Y. W.

2017-01-01

This study pioneers a Rasch scoring approach and compares it to a conventional summative approach for measuring longitudinal gains in student learning. In this methodological note, our proposed methodology is demonstrated using an example of rating scales in a student survey as part of a higher education outcome assessment. Such assessments have…

[Quality of life in children and adolescents with autism spectrum disorder without intellectual disability].

PubMed

Cuesta-Gomez, J L; Vidriales-Fernandez, R; Carvajal-Molina, F

2016-01-01

The concept of quality of life is of great importance for interventions directed at people living with disabilities. It is undeniable that the achievement of a satisfactory quality of life should be the objective of clinical interventions that are directed at the group of people with autism spectrum disorder (ASD) and should be a key element in the design of the treatments that are needed to improve the prognosis of future development. Nevertheless, knowledge of both the objective and the subjective conditions that predict greater quality of life satisfaction in people with ASD is still very limited. To explore the perception of the quality of life experienced by a group of children and adolescents with ASD without intellectual disability. A sample of 12 children and 11 adolescents with ASD without intellectual disability. In accordance with their age, they were administered the corresponding quality of life questionnaires. Both groups reported positively on their quality of life, without any differences in the basic dimensions. Nevertheless, in the case of adolescents, very low scores were obtained in the area of self-determination in comparison with their scores in other areas. The discussion centers on the identification of the most relevant dimensions for quality of life, the implications for intervention, and the need to adapt the methodologies in use for the subjective evaluation of those factors, due to the characteristics of ASD that can affect the capabilities necessary for the evaluation of personal experience, and may require the adaptation of the procedures that are employed.

Controlled trials in children: quantity, methodological quality and descriptive characteristics of pediatric controlled trials published 1948-2006.

PubMed

Thomson, Denise; Hartling, Lisa; Cohen, Eyal; Vandermeer, Ben; Tjosvold, Lisa; Klassen, Terry P

2010-09-30

The objective of this study was to describe randomized controlled trials (RCTs) and controlled clinical trials (CCTs) in child health published between 1948 and 2006, in terms of quantity, methodological quality, and publication and trial characteristics. We used the Trials Register of the Cochrane Child Health Field for overall trends and a sample from this to explore trial characteristics in more detail. We extracted descriptive data on a random sample of 578 trials. Ninety-six percent of the trials were published in English; the percentage of child-only trials was 90.5%. The most frequent diagnostic categories were infectious diseases (13.2%), behavioural and psychiatric disorders (11.6%), neonatal critical care (11.4%), respiratory disorders (8.9%), non-critical neonatology (7.9%), and anaesthesia (6.5%). There were significantly fewer child-only studies (i.e., more mixed child and adult studies) over time (P = 0.0460). The proportion of RCTs to CCTs increased significantly over time (P<0.0001), as did the proportion of multicentre trials (P = 0.002). Significant increases over time were found in methodological quality (Jadad score) (P<0.0001), the proportion of double-blind studies (P<0.0001), and studies with adequate allocation concealment (P<0.0001). Additionally, we found an improvement in reporting over time: adequate description of withdrawals and losses to follow-up (P<0.0001), sample size calculations (P<0.0001), and intention-to-treat analysis (P<0.0001). However, many trials still do not describe their level of blinding, and allocation concealment was inadequately reported in the majority of studies across the entire time period. The proportion of studies with industry funding decreased slightly over time (P = 0.003), and these studies were more likely to report positive conclusions (P = 0.028). The quantity and quality of pediatric controlled trials has increased over time; however, much work remains to be done, particularly in improving methodological issues around conduct and reporting of trials.

[Development of an optimized formulation of damask marmalade with low energy level using Taguchi methodology].

PubMed

Villarroel, Mario; Castro, Ruth; Junod, Julio

2003-06-01

The goal of this present study was the development of an optimized formula of damask marmalade low in calories applying Taguchi methodology to improve the quality of this product. The selection of this methodology lies on the fact that in real life conditions the result of an experiment frequently depends on the influence of several variables, therefore, one expedite way to solve this problem is utilizing factorial desings. The influence of acid, thickener, sweetener and aroma additives, as well as time of cooking, and possible interactions among some of them, were studied trying to get the best combination of these factors to optimize the sensorial quality of an experimental formulation of dietetic damask marmalade. An orthogonal array L8 (2(7)) was applied in this experience, as well as level average analysis was carried out according Taguchi methodology to determine the suitable working levels of the design factors previously choiced, to achieve a desirable product quality. A sensory trained panel was utilized to analyze the marmalade samples using a composite scoring test with a descriptive acuantitative scale ranging from 1 = Bad, 5 = Good. It was demonstrated that the design factors sugar/aspartame, pectin and damask aroma had a significant effect (p < 0.05) on the sensory quality of the marmalade with 82% of contribution on the response. The optimal combination result to be: citric acid 0.2%; pectin 1%; 30 g sugar/16 mg aspartame/100 g, damask aroma 0.5 ml/100 g, time of cooking 5 minutes. Regarding chemical composition, the most important results turned out to be the decrease in carbohydrate content compaired with traditional marmalade with a reduction of 56% in coloric value and also the amount of dietary fiber greater than similar commercial products. Assays of storage stability were carried out on marmalade samples submitted to different temperatures held in plastic bags of different density. Non percetible sensorial, microbiological and chemical changes were detected after 90 days of storage under controlled conditions.

Using a composite morbidity score and cultural survey to explore characteristics of high proficiency neonatal intensive care units.

PubMed

Kaempf, Joseph W; Wang, Lian; Dunn, Michael

2018-01-03

Continuous quality improvement (CQI) collaboration has not eliminated the morbidity variability seen among neonatal intensive care units (NICUs). Factors other than inconstant application of potentially better practices (PBPs) might explain divergent proficiency. Measure a composite morbidity score and determine whether cultural, environmental and cognitive factors distinguish high proficiency from lower proficiency NICUs. Retrospective analysis using a risk-adjusted composite morbidity score (Benefit Metric) and cultural survey focusing on very low birth weight (VLBW) infants from 39 NICUs, years 2000-2014. The Benefit Metric and yearly variance from the group mean was rank-ordered by NICU. A comprehensive survey was completed by each NICU exploring whether morbidity variance correlated with CQI methodology, cultural, environmental and/or cognitive characteristics. 58 272 VLBW infants were included, mean (SD) age 28.2 (3.0) weeks, birth weight 1031 (301) g. The 39 NICU groups' Benefit Metric improved 40%, from 80 in 2000 to 112 in 2014 (P<0.001). 14 NICUs had composite morbidity scores significantly better than the group, 16 did not differ and 9 scored below the group mean. The 14 highest performing NICUs were characterised by more effective team work, superior morale, greater problem-solving expectations of providers, enhanced learning opportunities, knowledge of CQI fundamentals and more generous staffing. Cultural, environmental and cognitive characteristics vary among NICUs perhaps more than traditional CQI methodology and PBPs, possibly explaining the inconstancy of VLBW infant morbidity reduction efforts. High proficiency NICUs foster spirited team work and camaraderie, sustained learning opportunities and support of favourable staffing that allows problem solving and widespread involvement in CQI activities. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Controlled Trials in Children: Quantity, Methodological Quality and Descriptive Characteristics of Pediatric Controlled Trials Published 1948-2006

PubMed Central

Thomson, Denise; Hartling, Lisa; Cohen, Eyal; Vandermeer, Ben; Tjosvold, Lisa; Klassen, Terry P.

2010-01-01

Background The objective of this study was to describe randomized controlled trials (RCTs) and controlled clinical trials (CCTs) in child health published between 1948 and 2006, in terms of quantity, methodological quality, and publication and trial characteristics. We used the Trials Register of the Cochrane Child Health Field for overall trends and a sample from this to explore trial characteristics in more detail. Methodology/Principal Findings We extracted descriptive data on a random sample of 578 trials. Ninety-six percent of the trials were published in English; the percentage of child-only trials was 90.5%. The most frequent diagnostic categories were infectious diseases (13.2%), behavioural and psychiatric disorders (11.6%), neonatal critical care (11.4%), respiratory disorders (8.9%), non-critical neonatology (7.9%), and anaesthesia (6.5%). There were significantly fewer child-only studies (i.e., more mixed child and adult studies) over time (P = 0.0460). The proportion of RCTs to CCTs increased significantly over time (P<0.0001), as did the proportion of multicentre trials (P = 0.002). Significant increases over time were found in methodological quality (Jadad score) (P<0.0001), the proportion of double-blind studies (P<0.0001), and studies with adequate allocation concealment (P<0.0001). Additionally, we found an improvement in reporting over time: adequate description of withdrawals and losses to follow-up (P<0.0001), sample size calculations (P<0.0001), and intention-to-treat analysis (P<0.0001). However, many trials still do not describe their level of blinding, and allocation concealment was inadequately reported in the majority of studies across the entire time period. The proportion of studies with industry funding decreased slightly over time (P = 0.003), and these studies were more likely to report positive conclusions (P = 0.028). Conclusions/Significance The quantity and quality of pediatric controlled trials has increased over time; however, much work remains to be done, particularly in improving methodological issues around conduct and reporting of trials. PMID:20927344

Methodological Quality of Systematic Reviews Published in the Urological Literature from 1998 to 2012.

PubMed

Corbyons, Katherine; Han, Julia; Neuberger, Molly M; Dahm, Philipp

2015-11-01

Systematic reviews synthesize the current best evidence to address a clinical question. Given the growing emphasis on evidence-based clinical practice, systematic reviews are being increasingly sought after and published. We previously reported limitations in the methodological quality of 57 individual systematic reviews published from 1998 to 2008. We provide an update to our previous study, adding systematic reviews published from 2009 to 2012. We systematically searched PubMed® and hand searched the table of contents of 4 major urological journals to identify systematic reviews related to questions of prevention and therapy. Two independent reviewers with prior formal evidence-based medicine training assessed the methodological quality using the validated 11-point AMSTAR (A Measurement Tool to Assess Systematic Reviews) instrument. We performed predefined statistical hypothesis testing for differences by publication period (1998 to 2008 vs 2009 to 2012) and journal of publication. We performed statistical testing using SPSS®, version 23.0 with a 2-sided α of 0.05 using the Student t-test, ANOVA and the chi-square test. A total of 113 systematic reviews published from 2009 to 2012 met study inclusion criteria. The most common topics were oncology (44 reviews or 38.9%), voiding dysfunction (26 or 23.0%) and stones/endourology (13 or 11.5%). The largest contributor was European Urology (46 reviews or 40.7%), followed by BJU International (31 or 27.4%) and The Journal of Urology® (22 or 19.5%). The mean ± SD AMSTAR score for the 2009 to 2012 period was 5.3 ± 2.3 compared to 4.8 ± 2.0 for 1998 to 2008 with a mean difference of 0.5 (95% CI 0.2 to 1.2, p = 0.133). While the number of systematic reviews published in the urological literature has increased substantially, the methodological quality of these studies remains suboptimal. Systematic review authors and editors should make every effort to adhere to well established methodological standards to enhance the impact of their research efforts. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

The natural course of shoulder instability and treatment trends: a systematic review.

PubMed

Eljabu, W; Klinger, H M; von Knoch, M

2017-03-01

The natural course of shoulder instability is still not entirely clear. We aimed in this review to analyse the current scientific evidence of the natural history of shoulder instability. A systematic review of the English literature was performed using the PubMED database throughout January 2014. This review was guided, conducted and reported according to PRISMA criteria. The criteria for inclusion in the study were (1) the article was written in English, (2) the level of evidence was 1-4, (3) the article was available in full text, (4) the article investigated the natural history or course of shoulder instability, the outcome of non-operative management, or the regression of the shoulder symptoms to the mean. The methodological quality of each included study was individually assessed using a newly developed general assessment tool-Assessing the Methodological Quality of Published Papers (AMQPP). Eight articles related to shoulder instability met the inclusion criteria. Four papers were considered high-quality studies (evidence level 1 and 2). One paper assessed the natural history and the natural course of shoulder instability directly. The other studies indirectly assessed the natural history by studying non-operative and operative therapy trends. We found no articles which clearly referred to the role of 'regression to the mean'. Following the natural history and the implementation of standardised non-operative treatment programmes are an effective therapy and superior to surgery in many cases. However, primary acute shoulder dislocation in young active individuals partaking in demanding physical activities could benefit from early surgical intervention. The AMQPP score works as a quick quality-checking tool which helps researchers to identify the key points in each paper and reach a decision regarding the eligibility of the paper more easily. The AMQPP scoring system is still open for further development and expansion. Level of evidence Level IV.

Evidence-based decision-making in infectious diseases epidemiology, prevention and control: matching research questions to study designs and quality appraisal tools

PubMed Central

2014-01-01

Background The Project on a Framework for Rating Evidence in Public Health (PRECEPT) was initiated and is being funded by the European Centre for Disease Prevention and Control (ECDC) to define a methodology for evaluating and grading evidence and strength of recommendations in the field of public health, with emphasis on infectious disease epidemiology, prevention and control. One of the first steps was to review existing quality appraisal tools (QATs) for individual research studies of various designs relevant to this area, using a question-based approach. Methods Through team discussions and expert consultations, we identified 20 relevant types of public health questions, which were grouped into six domains, i.e. characteristics of the pathogen, burden of disease, diagnosis, risk factors, intervention, and implementation of intervention. Previously published systematic reviews were used and supplemented by expert consultation to identify suitable QATs. Finally, a matrix was constructed for matching questions to study designs suitable to address them and respective QATs. Key features of each of the included QATs were then analyzed, in particular in respect to its intended use, types of questions and answers, presence/absence of a quality score, and if a validation was performed. Results In total we identified 21 QATs and 26 study designs, and matched them. Four QATs were suitable for experimental quantitative study designs, eleven for observational quantitative studies, two for qualitative studies, three for economic studies, one for diagnostic test accuracy studies, and one for animal studies. Included QATs consisted of six to 28 items. Six of the QATs had a summary quality score. Fourteen QATs had undergone at least one validation procedure. Conclusions The results of this methodological study can be used as an inventory of potentially relevant questions, appropriate study designs and QATs for researchers and authorities engaged with evidence-based decision-making in infectious disease epidemiology, prevention and control. PMID:24886571

Head-camera video recordings of trauma core competency procedures can evaluate surgical resident's technical performance as well as colocated evaluators.

PubMed

Mackenzie, Colin F; Pasley, Jason; Garofalo, Evan; Shackelford, Stacy; Chen, Hegang; Longinaker, Nyaradzo; Granite, Guinevere; Pugh, Kristy; Hagegeorge, George; Tisherman, Samuel A

2017-07-01

Unbiased evaluation of trauma core competency procedures is necessary to determine if residency and predeployment training courses are useful. We tested whether a previously validated individual procedure score (IPS) for individual procedure vascular exposure and fasciotomy (FAS) performance skills could discriminate training status by comparing IPS of evaluators colocated with surgeons to blind video evaluations. Performance of axillary artery (AA), brachial artery (BA), and femoral artery (FA) vascular exposures and lower extremity FAS on fresh cadavers by 40 PGY-2 to PGY-6 residents was video-recorded from head-mounted cameras. Two colocated trained evaluators assessed IPS before and after training. One surgeon in each pretraining tertile of IPS for each procedure was randomly identified for blind video review. The same 12 surgeons were video-recorded repeating the procedures less than 4 weeks after training. Five evaluators independently reviewed all 96 randomly arranged deidentified videos. Inter-rater reliability/consistency, intraclass correlation coefficients were compared by colocated versus video review of IPS, and errors. Study methodology and bias were judged by Medical Education Research Study Quality Instrument and the Quality Assessment of Diagnostic Accuracy Studies criteria. There were no differences (p ≥ 0.5) in IPS for AA, FA, FAS, whether evaluators were colocated or reviewed video recordings. Evaluator consistency was 0.29 (BA) - 0.77 (FA). Video and colocated evaluators were in total agreement (p = 1.0) for error recognition. Intraclass correlation coefficient was 0.73 to 0.92, dependent on procedure. Correlations video versus colocated evaluations were 0.5 to 0.9. Except for BA, blinded video evaluators discriminated (p < 0.002) whether procedures were performed before training versus after training. Study methodology by Medical Education Research Study Quality Instrument criteria scored 15.5/19, Quality Assessment of Diagnostic Accuracy Studies 2 showed low bias risk. Video evaluations of AA, FA, and FAS procedures with IPS are unbiased, valid, and have potential for formative assessments of competency. Prognostic study, level II.

Evidence-based decision-making in infectious diseases epidemiology, prevention and control: matching research questions to study designs and quality appraisal tools.

PubMed

Harder, Thomas; Takla, Anja; Rehfuess, Eva; Sánchez-Vivar, Alex; Matysiak-Klose, Dorothea; Eckmanns, Tim; Krause, Gérard; de Carvalho Gomes, Helena; Jansen, Andreas; Ellis, Simon; Forland, Frode; James, Roberta; Meerpohl, Joerg J; Morgan, Antony; Schünemann, Holger; Zuiderent-Jerak, Teun; Wichmann, Ole

2014-05-21

The Project on a Framework for Rating Evidence in Public Health (PRECEPT) was initiated and is being funded by the European Centre for Disease Prevention and Control (ECDC) to define a methodology for evaluating and grading evidence and strength of recommendations in the field of public health, with emphasis on infectious disease epidemiology, prevention and control. One of the first steps was to review existing quality appraisal tools (QATs) for individual research studies of various designs relevant to this area, using a question-based approach. Through team discussions and expert consultations, we identified 20 relevant types of public health questions, which were grouped into six domains, i.e. characteristics of the pathogen, burden of disease, diagnosis, risk factors, intervention, and implementation of intervention. Previously published systematic reviews were used and supplemented by expert consultation to identify suitable QATs. Finally, a matrix was constructed for matching questions to study designs suitable to address them and respective QATs. Key features of each of the included QATs were then analyzed, in particular in respect to its intended use, types of questions and answers, presence/absence of a quality score, and if a validation was performed. In total we identified 21 QATs and 26 study designs, and matched them. Four QATs were suitable for experimental quantitative study designs, eleven for observational quantitative studies, two for qualitative studies, three for economic studies, one for diagnostic test accuracy studies, and one for animal studies. Included QATs consisted of six to 28 items. Six of the QATs had a summary quality score. Fourteen QATs had undergone at least one validation procedure. The results of this methodological study can be used as an inventory of potentially relevant questions, appropriate study designs and QATs for researchers and authorities engaged with evidence-based decision-making in infectious disease epidemiology, prevention and control.

Risk Factors for Low Back Pain in Childhood and Adolescence: A Systematic Review.

PubMed

Calvo-Muñoz, Inmaculada; Kovacs, Francisco M; Roqué, Marta; Gago Fernández, Inés; Seco Calvo, Jesús

2018-05-01

To identify factors associated with low back pain (LBP) in children and adolescents. A systematic review was conducted (Prospero CRD42016038186). Observational studies analyzing LBP risk factors among participants aged between 9 and 16 were searched for in 13 electronic databases and 8 specialized journals until March 31, 2016, with no language restrictions. In addition, references in the identified studies were manually tracked. All identified studies that included ≥50 participants aged 9 to 16, were reviewed. Their methodological quality was assessed by 2 reviewers separately, using validated tools, which scored, from worst to best, 0 to 100 for cross-sectional and 0 to 12 for cohort studies. A sensitivity analysis only included studies that had adjusted for confounders, had ≥500 participants, and had a methodological score of ≥50%. A total of 5142 citations were screened and 61 studies, including 137,877 participants from 5 continents, were reviewed. Their mean (range) methodological scores were 74.56 (50 to 100) for cross-sectional studies and 7.36 (5 to 9) for cohort studies. The studies had assessed 35 demographic, clinical, biological, family, psychological, ergonomic, and lifestyle risk factors. The mean (range) prevalence of LBP ranged between 15.25% (3.20 to 57.00) for point prevalence and 38.98% (11.60 to 85.56) for lifetime prevalence. Results on the association between LBP and risk factors were inconsistent. In the sensitivity analysis, "older age" and "participation in competitive sports" showed a consistent association with LBP. Future studies should focus on muscle characteristics, the relationship between body and backpack weights, duration of carrying the backpack, characteristics of sport practice, and which are the factors associated with specifically chronic pain.

Validation of two novel electronic devices to time-link transcutaneous electrical nerve stimulation and pain report in patients with chronic back pain.

PubMed

Pallett, Edward J; Rentowl, Patricia; Watson, Paul J

2013-01-01

The analgesic effectiveness of transcutaneous electrical nerve stimulation (TENS) is uncertain. Negative findings, interpreted as ineffectiveness, might be due to poor methodological quality. Monitoring is necessary to differentiate between ineffectiveness and low implementation fidelity. Electronic data-logging devices, "TLOG" and "TSCORE," were developed to monitor and time-link TENS and pain report. TLOG records the time and duration of TENS use and output parameters; TSCORE records time-stamped pain scores. The purpose was to determine the accuracy, reliability, and acceptability of the devices. Forty-two outpatients with chronic back pain consented to use TENS daily for 2 weeks. Treatment times and durations were recorded in paper diaries and compared with TLOG data. Using TSCORE, patients reported pain before, during, and after TENS. Pain scores, reported using TSCORE or paper numerical rating scale at the beginning and end of 2 study visits, were compared using Bland-Altman methodology. The mean (SD) difference between paper and TSCORE pain scores was -0.05 (0.81). Limits of agreement (mean difference ± 1.96 SD) were -1.65 to 1.55. Test-retest reliabilities of paper and TSCORE were comparable: Paper mean (SD) difference was -0.33 (0.66), limits of agreement were -1.62 to 0.96; TSCORE mean (SD) difference was -0.10 (0.31), limits were -0.7 to 0.5. TLOG recorded TENS use accurately and worked reliably for 2 weeks in 84% of cases. An overall 79% of participants preferred TSCORE to paper numerical rating scale. TLOG and TSCORE are accurate, reliable, and acceptable devices for monitoring TENS implementation fidelity and pain outcome, with potential for improving TENS research methodology and clinical application.

Monitoring costs in the ICU: a search for a pertinent methodology.

PubMed

Reis Miranda, D; Jegers, M

2012-10-01

Attempts to determine costs in the intensive care unit (ICU) were not successful until now, as they failed to detect differences of costs between patients. The methodology and/or the instruments used might be at the origin of this failure. Based on the results of the European ICUs studies and on the descriptions of the activities of care in the ICU, we gathered and analysed the relevant literature concerning the monitoring of costs in the ICU. The aim was to formulate a methodology, from an economic perspective, in which future research may be framed. A bottom-up microcosting methodology will enable to distinguish costs between patients. The resulting information will at the same time support the decision-making of top management and be ready to include in the financial system of the hospital. Nursing staff explains about 30% of the total costs. This relation remains constant irrespective of the annual nurse/patient ratio. In contrast with other scoring instruments, the nursing activities score (NAS) covers all nursing activities. (1) NAS is to be chosen for quantifying nursing activities; (2) an instrument for measuring the physician's activities is not yet available; (3) because the nursing activities have a large impact on total costs, the standardisation of the processes of care (following the system approach) will contribute to manage costs, making also reproducible the issue of quality of care; (4) the quantification of the nursing activities may be the required (proxy) input for the automated bottom-up monitoring of costs in the ICU. © 2012 The Authors. Acta Anaesthesiologica Scandinavica © 2012 The Acta Anaesthesiologica Scandinavica Foundation.

Effectiveness of probiotics in irritable bowel syndrome: Updated systematic review with meta-analysis

PubMed Central

Didari, Tina; Mozaffari, Shilan; Nikfar, Shekoufeh; Abdollahi, Mohammad

2015-01-01

AIM: To investigate the efficacy of probiotics in irritable bowel syndrome (IBS) patients. METHODS: PubMed, Cochrane library, Scopus, Google Scholar, and Clinicaltrial.gov databases were searched for literature published between September 2007 and December 2013. The applied Mesh terms were “probiotics,” “irritable bowel syndrome,” and “irritable bowel syndrome treatment.” The collected data contained24 clinical trials, of which 15 were eligible for meta-analysis and nine were reviewed systematically. All studies were randomized placebo-controlled trials in patients with IBS that investigated the efficacy of probiotics in IBS improvement. The Jadad score was used to assess the methodological quality of trials. The quality scale ranges from 0 to 5 points, with a score ≤ 2 indicating a low quality report, and a score of ≥ 3 indicating a high quality report. Relative risk (RR), standardized effect size, and 95%CI were calculated using the DerSimonian-Laird method. The Cochran Q test was used to test heterogeneity with P < 0.05. Funnel plots were constructed and Egger’s and Begg-Mazumdar tests were performed to assess publication bias. RESULTS: A total of 1793 patients were included in the meta-analysis. The RR of responders to therapies based on abdominal pain score in IBS patients for two included trials comparing probiotics to placebo was 1.96 (95%CI: 1.14-3.36; P = 0.01). RR of responders to therapies based on a global symptom score in IBS patients for two included trials comparing probiotics with placebo was 2.43 (95%CI: 1.13-5.21; P = 0.02). For adequate improvement of general symptoms in IBS patients, the RR of seven included trials (six studies) comparing probiotics with placebo was 2.14 (95%CI: 1.08-4.26; P = 0.03). Distension, bloating, and flatulence were evaluated using an IBS severity scoring system in three trials (two studies) to compare the effect of probiotic therapy in IBS patients with placebo, the standardized effect size of mean differences for probiotics therapy was -2.57 (95%CI: -13.05--7.92). CONCLUSION: Probiotics reduce pain and symptom severity scores. The results demonstrate the beneficial effects of probiotics in IBS patients in comparison with placebo. PMID:25780308

Quality of life among untreated sleep apnea patients compared with the general population and changes after treatment with positive airway pressure.

PubMed

Bjornsdottir, Erla; Keenan, Brendan T; Eysteinsdottir, Bjorg; Arnardottir, Erna Sif; Janson, Christer; Gislason, Thorarinn; Sigurdsson, Jon Fridrik; Kuna, Samuel T; Pack, Allan I; Benediktsdottir, Bryndis

2015-06-01

Obstructive sleep apnea leads to recurrent arousals from sleep, oxygen desaturations, daytime sleepiness and fatigue. This can have an adverse impact on quality of life. The aims of this study were to compare: (i) quality of life between the general population and untreated patients with obstructive sleep apnea; and (ii) changes of quality of life among patients with obstructive sleep apnea after 2 years of positive airway pressure treatment between adherent patients and non-users. Propensity score methodologies were used in order to minimize selection bias and strengthen causal inferences. The enrolled obstructive sleep apnea subjects (n = 822) were newly diagnosed with moderate to severe obstructive sleep apnea who were starting positive airway pressure treatment, and the general population subjects (n = 742) were randomly selected Icelanders. The Short Form 12 was used to measure quality of life. Untreated patients with obstructive sleep apnea had a worse quality of life when compared with the general population. This effect remained significant after using propensity scores to select samples, balanced with regard to age, body mass index, gender, smoking, diabetes, hypertension and cardiovascular disease. We did not find significant overall differences between full and non-users of positive airway pressure in improvement of quality of life from baseline to follow-up. However, there was a trend towards more improvement in physical quality of life for positive airway pressure-adherent patients, and the most obese subjects improved their physical quality of life more. The results suggest that co-morbidities of obstructive sleep apnea, such as obesity, insomnia and daytime sleepiness, have a great effect on life qualities and need to be taken into account and addressed with additional interventions. © 2014 European Sleep Research Society.

The Contribution of Human Factors in Military System Development: Methodological Considerations

DTIC Science & Technology

1980-07-01

Risk/Uncertainty Analysis - Project Scoring - Utility Scales - Relevance Tree Techniques (Reverse Factor Analysis) 2. Computer Simulation Simulation...effectiveness of mathematical models for R&D project selection. Management Science, April 1973, 18. 6-43 .1~ *.-. Souder, W.E. h scoring methodology for...per some interval PROFICIENCY test scores (written) RADIATION radiation effects aircrew performance on radiation environments REACTION TIME 1) (time

Impact of Processing on the Protein Quality of Pinto Bean (Phaseolus vulgaris) and Buckwheat (Fagopyrum esculentum Moench) Flours and Blends, As Determined by in Vitro and in Vivo Methodologies.

PubMed

Nosworthy, Matthew G; Franczyk, Adam; Zimoch-Korzycka, Anna; Appah, Paulyn; Utioh, Alphonsus; Neufeld, Jason; House, James D

2017-05-17

Blending of protein sources can increase protein quality by compensating for limiting amino acids present in individual sources, whereas processing grain flours by extrusion or baking can also alter protein quality. To determine the effect of baking and extrusion on the protein quality of blended flours from buckwheat and pinto beans, a rodent bioassay was performed and compared to an in vitro method of protein quality determination. Overall, extruded products had higher protein efficiency ratio values, increased digestibility, and greater protein digestibility corrected amino acid score (PDCAAS) values than baked products, with the extruded buckwheat/pinto blend having the greatest PDCAAS value of the experimental diets investigated. A correlation was found between both digestibility and PDCAAS values generated from in vitro and in vivo methods. The use of in vitro digestibility analysis should be investigated as a potential replacement for the current rodent assay for nutrient content claim purposes.

Risk factors for injury in sport climbing and bouldering: a systematic review of the literature.

PubMed

Woollings, Kaikanani Y; McKay, Carly D; Emery, Carolyn A

2015-09-01

Rock climbing is an increasingly popular sport worldwide, as a recreational activity and a competitive sport. Several disciplines including sport climbing and bouldering have developed, each employing specific movements and techniques, leading to specific injuries. To examine risk factors and prevention measures for injury in sport climbing and bouldering, and to assess the methodological quality of existing studies. 12 electronic databases and several other sources were searched systematically using predetermined inclusion and exclusion criteria. Eligible articles were peer-reviewed, based on primary research using original data; outcome measures included injury, morbidity or mortality in rock climbing, and included one or more potential risk factor or injury prevention strategy. Two independent reviewers assessed the methodology of research in each study using the Downs and Black Quality Index. The data extracted is summarised, and appraisals of the articles are presented with respect to the quality of evidence presented. 19 studies met the inclusion criteria, and introduced 35 possible risk factors or injury prevention measures in climbing. Age, increasing years of climbing experience, highest climbing grade achieved (skill level), high climbing intensity score (CIS) and participating in lead climbing are potential risk factors. Results regarding injury prevention measures remain inconclusive. This field is relatively new and, as such, the data are not as robust as for more established sports with a larger research foundation. The key need is establishing modifiable risk factors using prospective studies and high quality methodology, such that injury prevention strategies can be developed. The CIS may be a useful measure in this field of research. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Cochrane Systematic Reviews of Chinese Herbal Medicines: An Overview

PubMed Central

Hu, Jing; Zhang, Junhua; Zhao, Wei; Zhang, Yongling; Zhang, Li; Shang, Hongcai

2011-01-01

Objectives Our study had two objectives: a) to systematically identify all existing systematic reviews of Chinese herbal medicines (CHM) published in Cochrane Library; b) to assess the methodological quality of included reviews. Methodology/Principal Findings We performed a systematic search of the Cochrane Database of Systematic Reviews (CDSR, Issue 5, 2010) to identify all reviews of CHM. A total of fifty-eight reviews were eligible for our study. Twenty-one of the included reviews had at least one Traditional Chinese Medicine (TCM) practitioner as its co-author. 7 reviews didn't include any primary study, the remaining reviews (n = 51) included a median of 9 studies and 936 participants. 50% of reviews were last assessed as up-to-date prior to 2008. The questions addressed by 39 reviews were broad in scope, in which 9 reviews combined studies with different herbal medicines. For OQAQ, the mean of overall quality score (item 10) was 5.05 (95% CI; 4.58-5.52). All reviews assessed the methodological quality of primary studies, 16% of included primary studies used adequate sequence generation and 7% used adequate allocation concealment. Of the 51 nonempty reviews, 23 reviews were reported as being inconclusive, while 27 concluded that there might be benefit of CHM, which was limited by the poor quality or inadequate quantity of included studies. 58 reviews reported searching a median of seven electronic databases, while 10 reviews did not search any Chinese database. Conclusions Now CDSR has included large numbers of CHM reviews, our study identified some areas which could be improved, such as almost half of included reviews did not have the participation of TCM practitioners and were not up-to-date according to Cochrane criteria, some reviews pooled the results of different herbal medicines and ignored the searching of Chinese databases. PMID:22174870

AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Hamel, Candyce; Wells, George A; Bouter, Lex M; Kristjansson, Elizabeth; Grimshaw, Jeremy; Henry, David A; Boers, Maarten

2009-10-01

Our purpose was to measure the agreement, reliability, construct validity, and feasibility of a measurement tool to assess systematic reviews (AMSTAR). We randomly selected 30 systematic reviews from a database. Each was assessed by two reviewers using: (1) the enhanced quality assessment questionnaire (Overview of Quality Assessment Questionnaire [OQAQ]); (2) Sacks' instrument; and (3) our newly developed measurement tool (AMSTAR). We report on reliability (interobserver kappas of the 11 AMSTAR items), intraclass correlation coefficients (ICCs) of the sum scores, construct validity (ICCs of the sum scores of AMSTAR compared with those of other instruments), and completion times. The interrater agreement of the individual items of AMSTAR was substantial with a mean kappa of 0.70 (95% confidence interval [CI]: 0.57, 0.83) (range: 0.38-1.0). Kappas recorded for the other instruments were 0.63 (95% CI: 0.38, 0.78) for enhanced OQAQ and 0.40 (95% CI: 0.29, 0.50) for the Sacks' instrument. The ICC of the total score for AMSTAR was 0.84 (95% CI: 0.65, 0.92) compared with 0.91 (95% CI: 0.82, 0.96) for OQAQ and 0.86 (95% CI: 0.71, 0.94) for the Sacks' instrument. AMSTAR proved easy to apply, each review taking about 15 minutes to complete. AMSTAR has good agreement, reliability, construct validity, and feasibility. These findings need confirmation by a broader range of assessors and a more diverse range of reviews.

The effect of routine early amniotomy on spontaneous labor: a meta-analysis.

PubMed

Brisson-Carroll, G; Fraser, W; Bréart, G; Krauss, I; Thornton, J

1996-05-01

To obtain estimates of the effects of amniotomy on the risk of cesarean delivery and on other indicators of maternal and neonatal morbidity (Apgar score less than 7 at 5 minutes, admission to neonatal intensive care unit [NICU]). Published studies were identified through manual and computerized searches using Medline and the Cochrane Collaboration Pregnancy and Childbirth Database. Our search identified ten trials, all published in peer-reviewed journals. Trials were assigned a methodological quality score based on a standardized rating system. Three trials were excluded from the analysis for methodological limitations. Data were abstracted by two trained reviewers. Typical odds ratios (OR) were calculated. Amniotomy was associated with a reduction in labor duration varying from 0.8-2.3 hours. There was a nonstatistically significant increase in the risk of cesarean delivery; OR 1.2, 95% confidence interval (CI) 0.9-1.6. The risk of a 5-minute Apgar score less than 7 was reduced in association with early amniotomy (OR 0.5, 95% CI 0.3-0.9). Groups were similar with respect to other indicators of neonatal status (arterial cord pH, NICU admissions). Routine early amniotomy is associated with both benefits and risks. Benefits include a reduction in labor duration and a possible reduction in abnormal 5-minute Apgar scores. This meta-analysis provides no support for the hypothesis that routine early amniotomy reduces the risk of cesarean delivery. An association between early amniotomy and cesarean delivery for fetal distress was noted in one large trial, suggesting that amniotomy should be reserved for patients with abnormal labor progress.

Chinese Herbal Medicine for Acute Mountain Sickness: A Systematic Review of Randomized Controlled Trials

PubMed Central

Wang, Jie; Xiong, Xingjiang; Xing, Yanwei; Liu, Zhen; Jiang, Wenrui; Huang, Junyi; Feng, Bo

2013-01-01

Objectives. We aimed to assess the current clinical evidence of Chinese herbal medicine for AMS. Methods. Seven electronic databases were searched until January 2013. We included randomized clinical trials testing Chinese herbal medicine against placebo, no drugs, Western drugs, or a combination of routine treatment drugs against routine treatment drugs. Study selection, data extraction, quality assessment, and data analyses were conducted according to Cochrane standards. Results. Nine randomized trials were included. The methodological quality of the included trials was evaluated as low. Two trials compared prescriptions of Chinese formula used alone with Western drugs. A meta-analysis showed a beneficial effect in decreasing the score of AMS (MD: −2.23 [−3.98, −0.49], P = 0.01). Only one trial compared prescriptions of Chinese formula used alone with no drugs. A meta-analysis showed a significant beneficial effect in decreasing the score of AMS (MD: −6.00 [−6.45, −5.55], P < 0.00001). Four trials compared Chinese formula used alone with placebo. A meta-analysis also showed a significant beneficial effect in decreasing the score of AMS (MD: −1.10 [−1.64, −0.55], P < 0.0001). Two trials compared the combination of Chinese formula plus routine treatment drugs with routine treatment drugs. A meta-analysis showed a beneficial effect in decreasing the score of AMS (MD: −5.99 [−11.11, −0.86], P = 0.02). Conclusions. No firm conclusion on the effectiveness and safety of Chinese herbal medicine for AMS can be made. More rigorous high-quality trials are required to generate a high level of evidence and to confirm the results. PMID:24454510

Data inconsistencies from states with unconventional oil and gas activity.

PubMed

Malone, Samantha; Kelso, Matthew; Auch, Ted; Edelstein, Karen; Ferrar, Kyle; Jalbert, Kirk

2015-01-01

The quality and availability of unconventional oil and gas (O&G) data in the United States have never been compared methodically state-to-state. By conducting such an assessment, this study seeks to better understand private and publicly sourced data variability and to identify data availability gaps. We developed an exploratory data-grading tool - Data Accessibility and Usability Index (DAUI) - to guide the review of O&G data quality. Between July and October 2013, we requested, collected, and assessed 5 categories of unconventional O&G data (wells drilled, violations, production, waste, and Class II disposal wells) from 10 states with active drilling activity. We based our assessment on eight data quality parameters (accessibility, usability, point location, completeness, metadata, agency responsiveness, accuracy, and cost). Using the DAUI, two authors graded the 10 states and then averaged their scores. The average score received across all states, data categories, and parameters was 67.1 out of 100, largely insufficient for proper data transparency. By state, Pennsylvania received the highest average ( = 93.5) and ranked first in all but one data category. The lowest scoring state was Texas ( = 44) largely due to its policy of charging for certain data. This article discusses the various reasons for scores received, as well as methodological limitations of the assessment metrics. We argue that the significant variability of unconventional O&G data-and its availability to the public-is a barrier to regulatory and industry transparency. The lack of transparency also impacts public education and broader participation in industry governance. This study supports the need to develop a set of data best management practices (BMPs) for state regulatory agencies and the O&G industry, and suggests potential BMPs for this purpose.

Impact of a structured intern education programme on clinical documentation in the emergency department.

PubMed

McLean, Andrew; Lawlor, Jenine; Mitchell, Rob; Kault, David; O'Kane, Carl; Lees, Michelle

2015-02-01

To evaluate the impact of More Learning for Interns in Emergency (MoLIE) on clinical documentation in the ED of a large regional hospital. MoLIE was implemented at The Townsville Hospital (TTH) in 2010, and has since provided ED interns with structured off-floor teaching and a dedicated clinical supervisor. A pre- and post-intervention study was conducted using retrospective medical record review methodology. Charts were selected by identifying all TTH ED patients seen by interns in the period 2008-2011. Two hundred pre-intervention records (2008-2009) and 200 post-intervention records (2010-2011) were reviewed. These were randomly selected following an initial screen by an ED staff specialist. The quality of clinical documentation for five common ED presentations (asthma, chest pain, lacerations, abdominal pain and upper limb fractures) was assessed. For each presentation, documentation quality was scored out of 10 using predefined criteria. An improvement of two or more was thought to be clinically significant. Mean scores for each group were compared using a Student's t-test for independent samples. Mean documentation scores (and 95% confidence intervals) were 5.55 (5.17-5.93) in 2008, 5.42 (4.98-5.86) in 2009, 6.37 (5.99-6.75) in 2010 and 6.08 (5.71-6.45) in 2011. There was a statistically but not clinically significant improvement in scores pre- and post-intervention (P ≤ 0.001). The introduction of MoLIE was associated with a small but statistically significant improvement in documentation, despite an 80% increase in intern placements. These results suggest that structured training programmes have potential to improve intern performance while simultaneously enhancing training capacity. The impact on quality of care requires further evaluation. © 2015 Australasian College for Emergency Medicine and Australasian Society for Emergency Medicine.

Typology of end-of-life priorities in Saudi females: averaging analysis and Q-methodology.

PubMed

Hammami, Muhammad M; Hammami, Safa; Amer, Hala A; Khodr, Nesrine A

2016-01-01

Understanding culture-and sex-related end-of-life preferences is essential to provide quality end-of-life care. We have previously explored end-of-life choices in Saudi males and found important culture-related differences and that Q-methodology is useful in identifying intraculture, opinion-based groups. Here, we explore Saudi females' end-of-life choices. A volunteer sample of 68 females rank-ordered 47 opinion statements on end-of-life issues into a nine-category symmetrical distribution. The ranking scores of the statements were analyzed by averaging analysis and Q-methodology. The mean age of the females in the sample was 30.3 years (range, 19-55 years). Among them, 51% reported average religiosity, 78% reported very good health, 79% reported very good life quality, and 100% reported high-school education or more. The extreme five overall priorities were to be able to say the statement of faith, be at peace with God, die without having the body exposed, maintain dignity, and resolve all conflicts. The extreme five overall dis-priorities were to die in the hospital, die well dressed, be informed about impending death by family/friends rather than doctor, die at peak of life, and not know if one has a fatal illness. Q-methodology identified five opinion-based groups with qualitatively different characteristics: "physical and emotional privacy concerned, family caring" (younger, lower religiosity), "whole person" (higher religiosity), "pain and informational privacy concerned" (lower life quality), "decisional privacy concerned" (older, higher life quality), and "life quantity concerned, family dependent" (high life quality, low life satisfaction). Out of the extreme 14 priorities/dis-priorities for each group, 21%-50% were not represented among the extreme 20 priorities/dis-priorities for the entire sample. Consistent with the previously reported findings in Saudi males, transcendence and dying in the hospital were the extreme end-of-life priority and dis-priority, respectively, in Saudi females. Body modesty was a major overall concern; however, concerns about pain, various types of privacy, and life quantity were variably emphasized by the five opinion-based groups but masked by averaging analysis.

Development and Validation of a Combined Methodology for Assessing the Total Quality Control of Herbal Medicinal Products – Application to Oleuropein Preparations

PubMed Central

Lemonakis, Nikolaos; Gikas, Evagelos; Halabalaki, Maria; Skaltsounis, Alexios-Leandros

2013-01-01

Oleuropein (OE) is a secoiridoid glycoside, which occurs mostly in the Oleaceae family presenting several pharmacological properties, including antioxidant, cardio-protective, anti-atherogenic effects etc. Based on these findings OE is commercially available, as Herbal Medicinal Product (HMP), claimed for its antioxidant effects. As there are general provisions of the medicine regulating bodies e.g. European Medicines Agency, the quality of the HMP’s must always be demonstrated. Therefore, a novel LC-MS methodology was developed and validated for the simultaneous quantification of OE and its main degradation product, hydroxytyrosol (HT), for the relevant OE claimed HMP’s. The internal standard (IS) methodology was employed and separation of OE, HT and IS was achieved on a C18 Fused Core column with 3.1 min overall run time employing the SIM method for the analytical signal acquisition. The method was validated according to the International Conference on Harmonisation requirements and the results show adequate linearity (r2 > 0.99) over a wide concentration range [0.1–15 μg/mL (n=12)] and a LLOQ value of 0.1 μg/mL, for both OE and HT. Furthermore, as it would be beneficial to control the quality taking into account all the substances of the OE claimed HMP’s; a metabolomics-like approach has been developed and applied for the total quality control of the different preparations employing UHPLC-HRMS-multivariate analysis (MVA). Four OE-claimed commercial HMP’s have been randomly selected and MVA similarity-based measurements were performed. The results showed that the examined samples could also be differentiated as evidenced according to their scores plot. Batch to batch reproducibility between the samples of the same brand has also been determined and found to be acceptable. Overall, the developed combined methodology has been found to be an efficient tool for the monitoring of the HMP’s total quality. Only one OE HMP has been found to be consistent to its label claim. PMID:24205178

Typology of end-of-life priorities in Saudi females: averaging analysis and Q-methodology

PubMed Central

Hammami, Muhammad M; Hammami, Safa; Amer, Hala A; Khodr, Nesrine A

2016-01-01

Background Understanding culture-and sex-related end-of-life preferences is essential to provide quality end-of-life care. We have previously explored end-of-life choices in Saudi males and found important culture-related differences and that Q-methodology is useful in identifying intraculture, opinion-based groups. Here, we explore Saudi females’ end-of-life choices. Methods A volunteer sample of 68 females rank-ordered 47 opinion statements on end-of-life issues into a nine-category symmetrical distribution. The ranking scores of the statements were analyzed by averaging analysis and Q-methodology. Results The mean age of the females in the sample was 30.3 years (range, 19–55 years). Among them, 51% reported average religiosity, 78% reported very good health, 79% reported very good life quality, and 100% reported high-school education or more. The extreme five overall priorities were to be able to say the statement of faith, be at peace with God, die without having the body exposed, maintain dignity, and resolve all conflicts. The extreme five overall dis-priorities were to die in the hospital, die well dressed, be informed about impending death by family/friends rather than doctor, die at peak of life, and not know if one has a fatal illness. Q-methodology identified five opinion-based groups with qualitatively different characteristics: “physical and emotional privacy concerned, family caring” (younger, lower religiosity), “whole person” (higher religiosity), “pain and informational privacy concerned” (lower life quality), “decisional privacy concerned” (older, higher life quality), and “life quantity concerned, family dependent” (high life quality, low life satisfaction). Out of the extreme 14 priorities/dis-priorities for each group, 21%–50% were not represented among the extreme 20 priorities/dis-priorities for the entire sample. Conclusion Consistent with the previously reported findings in Saudi males, transcendence and dying in the hospital were the extreme end-of-life priority and dis-priority, respectively, in Saudi females. Body modesty was a major overall concern; however, concerns about pain, various types of privacy, and life quantity were variably emphasized by the five opinion-based groups but masked by averaging analysis. PMID:27274205

A Profile of Injuries Sustained by Law Enforcement Officers: A Critical Review.

PubMed

Lyons, Kate; Radburn, Cameron; Orr, Robin; Pope, Rodney

2017-02-03

Due to the unpredictable, varied and often physical nature of law enforcement duties, police officers are at a high risk of work-related physical injury. The aim of this critical narrative review was to identify and synthesize key findings of studies that have investigated musculoskeletal injuries sustained by law enforcement officers during occupational tasks. A systematic search of four databases using key search terms was conducted to identify potentially relevant studies, which were assessed against key inclusion and exclusion criteria to determine studies to be included in the review. Included studies were critically appraised and the level of evidence determined. Relevant data were extracted, tabulated and synthesized. The 16 identified studies ranged in percentage quality scores from 25.00% to 65.00%, with a mean score of 41.25% and high interrater agreement in scores reflected in a Cohen's Kappa coefficient, κ = 0.977. The most common body site of injury was the upper extremity, the most common injury types were soft-tissue sprains and strains and the most common cause of injury was a non-compliant offender, often involving assault. However, there was limited peer reviewed research in this area and the published research had a narrow focus and was of low to fair methodological quality.

A Profile of Injuries Sustained by Law Enforcement Officers: A Critical Review

PubMed Central

Lyons, Kate; Radburn, Cameron; Orr, Robin; Pope, Rodney

2017-01-01

Due to the unpredictable, varied and often physical nature of law enforcement duties, police officers are at a high risk of work-related physical injury. The aim of this critical narrative review was to identify and synthesize key findings of studies that have investigated musculoskeletal injuries sustained by law enforcement officers during occupational tasks. A systematic search of four databases using key search terms was conducted to identify potentially relevant studies, which were assessed against key inclusion and exclusion criteria to determine studies to be included in the review. Included studies were critically appraised and the level of evidence determined. Relevant data were extracted, tabulated and synthesized. The 16 identified studies ranged in percentage quality scores from 25.00% to 65.00%, with a mean score of 41.25% and high interrater agreement in scores reflected in a Cohen’s Kappa coefficient, κ = 0.977. The most common body site of injury was the upper extremity, the most common injury types were soft-tissue sprains and strains and the most common cause of injury was a non-compliant offender, often involving assault. However, there was limited peer reviewed research in this area and the published research had a narrow focus and was of low to fair methodological quality. PMID:28165373

The UNO Aviation Monograph Series: The Airline Quality Rating 1998

NASA Technical Reports Server (NTRS)

Bowen, Brent D.; Headley, Dean E.

1998-01-01

The Airline Quality Rating (AQR) was developed and first announced in early 1991 as an objective method of comparing airline performance on combined multiple factors important to consumers. Development history and calculation details for the AQR rating system are detailed in The Airline Quality Rating 1991 issued in April, 1991, by the National Institute for Aviation Research at Wichita State University. This current report, Airline Quality Rating 1998, contains monthly Airline Quality Rating scores for 1997. Additional copies are available by contacting Wichita State University or University of Nebraska at Omaha. The Airline Quality Rating 1998 is a summary of month-by-month quality ratings for the ten major U.S. airlines operating during 1997. Using the Airline Quality Rating system and monthly performance data for each airline for the calendar year of 1997, individual and comparative ratings are reported. This research monograph contains a brief summary of the AQR methodology, detailed data and charts that track comparative quality for major airlines domestic operations for the 12 month period of 1997, and industry average results. Also, comparative Airline Quality Rating data for 1991 through 1996 are included to provide a longer term view of quality in the industry.

Ballistic Resistance of Armored Passenger Vehicles: Test Protocols and Quality Methods

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jeffrey M. Lacy; Robert E. Polk

2005-07-01

This guide establishes a test methodology for determining the overall ballistic resistance of the passenger compartment of assembled nontactical armored passenger vehicles (APVs). Because ballistic testing of every piece of every component of an armored vehicle is impractical, if not impossible, this guide describes a testing scheme based on statistical sampling of exposed component surface areas. Results from the test of the sampled points are combined to form a test score that reflects the probability of ballistic penetration into the passenger compartment of the vehicle.

[Do you mean benchmarking?].

PubMed

Bonnet, F; Solignac, S; Marty, J

2008-03-01

The purpose of benchmarking is to settle improvement processes by comparing the activities to quality standards. The proposed methodology is illustrated by benchmark business cases performed inside medical plants on some items like nosocomial diseases or organization of surgery facilities. Moreover, the authors have built a specific graphic tool, enhanced with balance score numbers and mappings, so that the comparison between different anesthesia-reanimation services, which are willing to start an improvement program, is easy and relevant. This ready-made application is even more accurate as far as detailed tariffs of activities are implemented.

Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review.

PubMed

Eysenbach, Gunther; Powell, John; Kuss, Oliver; Sa, Eun-Ryoung

The quality of consumer health information on the World Wide Web is an important issue for medicine, but to date no systematic and comprehensive synthesis of the methods and evidence has been performed. To establish a methodological framework on how quality on the Web is evaluated in practice, to determine the heterogeneity of the results and conclusions, and to compare the methodological rigor of these studies, to determine to what extent the conclusions depend on the methodology used, and to suggest future directions for research. We searched MEDLINE and PREMEDLINE (1966 through September 2001), Science Citation Index (1997 through September 2001), Social Sciences Citation Index (1997 through September 2001), Arts and Humanities Citation Index (1997 through September 2001), LISA (1969 through July 2001), CINAHL (1982 through July 2001), PsychINFO (1988 through September 2001), EMBASE (1988 through June 2001), and SIGLE (1980 through June 2001). We also conducted hand searches, general Internet searches, and a personal bibliographic database search. We included published and unpublished empirical studies in any language in which investigators searched the Web systematically for specific health information, evaluated the quality of Web sites or pages, and reported quantitative results. We screened 7830 citations and retrieved 170 potentially eligible full articles. A total of 79 distinct studies met the inclusion criteria, evaluating 5941 health Web sites and 1329 Web pages, and reporting 408 evaluation results for 86 different quality criteria. Two reviewers independently extracted study characteristics, medical domains, search strategies used, methods and criteria of quality assessment, results (percentage of sites or pages rated as inadequate pertaining to a quality criterion), and quality and rigor of study methods and reporting. Most frequently used quality criteria used include accuracy, completeness, readability, design, disclosures, and references provided. Fifty-five studies (70%) concluded that quality is a problem on the Web, 17 (22%) remained neutral, and 7 studies (9%) came to a positive conclusion. Positive studies scored significantly lower in search (P =.02) and evaluation (P =.04) methods. Due to differences in study methods and rigor, quality criteria, study population, and topic chosen, study results and conclusions on health-related Web sites vary widely. Operational definitions of quality criteria are needed.

Methodological quality of systematic reviews on treatments for depression: a cross-sectional study.

PubMed

Chung, V C H; Wu, X Y; Feng, Y; Ho, R S T; Wong, S Y S; Threapleton, D

2017-05-02

Depression is one of the most common mental disorders and identifying effective treatment strategies is crucial for the control of depression. Well-conducted systematic reviews (SRs) and meta-analyses can provide the best evidence for supporting treatment decision-making. Nevertheless, the trustworthiness of conclusions can be limited by lack of methodological rigour. This study aims to assess the methodological quality of a representative sample of SRs on depression treatments. A cross-sectional study on the bibliographical and methodological characteristics of SRs published on depression treatments trials was conducted. Two electronic databases (the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects) were searched for potential SRs. SRs with at least one meta-analysis on the effects of depression treatments were considered eligible. The methodological quality of included SRs was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. The associations between bibliographical characteristics and scoring on AMSTAR items were analysed using logistic regression analysis. A total of 358 SRs were included and appraised. Over half of included SRs (n = 195) focused on non-pharmacological treatments and harms were reported in 45.5% (n = 163) of all studies. Studies varied in methods and reporting practices: only 112 (31.3%) took the risk of bias among primary studies into account when formulating conclusions; 245 (68.4%) did not fully declare conflict of interests; 93 (26.0%) reported an 'a priori' design and 104 (29.1%) provided lists of both included and excluded studies. Results from regression analyses showed: more recent publications were more likely to report 'a priori' designs [adjusted odds ratio (AOR) 1.31, 95% confidence interval (CI) 1.09-1.57], to describe study characteristics fully (AOR 1.16, 95% CI 1.06-1.28), and to assess presence of publication bias (AOR 1.13, 95% CI 1.06-1.19), but were less likely to list both included and excluded studies (AOR 0.86, 95% CI 0.81-0.92). SRs published in journals with higher impact factor (AOR 1.14, 95% CI 1.04-1.25), completed by more review authors (AOR 1.12, 95% CI 1.01-1.24) and SRs on non-pharmacological treatments (AOR 1.62, 95% CI 1.01-2.59) were associated with better performance in publication bias assessment. The methodological quality of included SRs is disappointing. Future SRs should strive to improve rigour by considering of risk of bias when formulating conclusions, reporting conflict of interests and authors should explicitly describe harms. SR authors should also use appropriate methods to combine the results, prevent language and publication biases, and ensure timely updates.

A method for developing standardised interactive education for complex clinical guidelines

PubMed Central

2012-01-01

Background Although systematic use of the Perinatal Society of Australia and New Zealand internationally endorsed Clinical Practice Guideline for Perinatal Mortality (PSANZ-CPG) improves health outcomes, implementation is inadequate. Its complexity is a feature known to be associated with non-compliance. Interactive education is effective as a guideline implementation strategy, but lacks an agreed definition. SCORPIO is an educational framework containing interactive and didactic teaching, but has not previously been used to implement guidelines. Our aim was to transform the PSANZ-CPG into an education workshop to develop quality standardised interactive education acceptable to participants for learning skills in collaborative interprofessional care. Methods The workshop was developed using the construct of an educational framework (SCORPIO), the PSANZ-CPG, a transformation process and tutor training. After a pilot workshop with key target and stakeholder groups, modifications were made to this and subsequent workshops based on multisource written observations from interprofessional participants, tutors and an independent educator. This participatory action research process was used to monitor acceptability and educational standards. Standardised interactive education was defined as the attainment of content and teaching standards. Quantitative analysis of positive expressed as a percentage of total feedback was used to derive a total quality score. Results Eight workshops were held with 181 participants and 15 different tutors. Five versions resulted from the action research methodology. Thematic analysis of multisource observations identified eight recurring education themes or quality domains used for standardisation. The two content domains were curriculum and alignment with the guideline and the six teaching domains; overload, timing, didacticism, relevance, reproducibility and participant engagement. Engagement was the most challenging theme to resolve. Tutors identified all themes for revision whilst participants identified a number of teaching but no content themes. From version 1 to 5, a significant increasing trend in total quality score was obtained; participants: 55%, p=0.0001; educator: 42%, p=0.0004; tutor peers: 57%, p=0.0001. Conclusions Complex clinical guidelines can be developed into a workshop acceptable to interprofessional participants. Eight quality domains provide a framework to standardise interactive teaching for complex clinical guidelines. Tutor peer review is important for content validity. This methodology may be useful for other guideline implementation. PMID:23131137

The validity and reliability of the four square step test in different adult populations: a systematic review.

PubMed

Moore, Martha; Barker, Karen

2017-09-11

The four square step test (FSST) was first validated in healthy older adults to provide a measure of dynamic standing balance and mobility. The FSST has since been used in a variety of patient populations. The purpose of this systematic review is to determine the validity and reliability of the FSST in these different adult patient populations. The literature search was conducted to highlight all the studies that measured validity and reliability of the FSST. Six electronic databases were searched including AMED, CINAHL, MEDLINE, PEDro, Web of Science and Google Scholar. Grey literature was also searched for any documents relevant to the review. Two independent reviewers carried out study selection and quality assessment. The methodological quality was assessed using the QUADAS-2 tool, which is a validated tool for the quality assessment of diagnostic accuracy studies, and the COSMIN four-point checklist, which contains standards for evaluating reliability studies on the measurement properties of health instruments. Fifteen studies were reviewed studying community-dwelling older adults, Parkinson's disease, Huntington's disease, multiple sclerosis, vestibular disorders, post stroke, post unilateral transtibial amputation, knee pain and hip osteoarthritis. Three of the studies were of moderate methodological quality scoring low in risk of bias and applicability for all domains in the QUADAS-2 tool. Three studies scored "fair" on the COSMIN four-point checklist for the reliability components. The concurrent validity of the FSST was measured in nine of the studies with moderate to strong correlations being found. Excellent Intraclass Correlation Coefficients were found between physiotherapists carrying out the tests (ICC = .99) with good to excellent test-retest reliability shown in nine of the studies (ICC = .73-.98). The FSST may be an effective and valid tool for measuring dynamic balance and a participants' falls risk. It has been shown to have strong correlations with other measures of balance and mobility with good reliability shown in a number of populations. However, the quality of the papers reviewed was variable with key factors, such as sample size and test set up, needing to be addressed before the tool can be confidently used in these specified populations.

A method for developing standardised interactive education for complex clinical guidelines.

PubMed

Vaughan, Janet I; Jeffery, Heather E; Raynes-Greenow, Camille; Gordon, Adrienne; Hirst, Jane; Hill, David A; Arbuckle, Susan

2012-11-06

Although systematic use of the Perinatal Society of Australia and New Zealand internationally endorsed Clinical Practice Guideline for Perinatal Mortality (PSANZ-CPG) improves health outcomes, implementation is inadequate. Its complexity is a feature known to be associated with non-compliance. Interactive education is effective as a guideline implementation strategy, but lacks an agreed definition. SCORPIO is an educational framework containing interactive and didactic teaching, but has not previously been used to implement guidelines. Our aim was to transform the PSANZ-CPG into an education workshop to develop quality standardised interactive education acceptable to participants for learning skills in collaborative interprofessional care. The workshop was developed using the construct of an educational framework (SCORPIO), the PSANZ-CPG, a transformation process and tutor training. After a pilot workshop with key target and stakeholder groups, modifications were made to this and subsequent workshops based on multisource written observations from interprofessional participants, tutors and an independent educator. This participatory action research process was used to monitor acceptability and educational standards. Standardised interactive education was defined as the attainment of content and teaching standards. Quantitative analysis of positive expressed as a percentage of total feedback was used to derive a total quality score. Eight workshops were held with 181 participants and 15 different tutors. Five versions resulted from the action research methodology. Thematic analysis of multisource observations identified eight recurring education themes or quality domains used for standardisation. The two content domains were curriculum and alignment with the guideline and the six teaching domains; overload, timing, didacticism, relevance, reproducibility and participant engagement. Engagement was the most challenging theme to resolve. Tutors identified all themes for revision whilst participants identified a number of teaching but no content themes. From version 1 to 5, a significant increasing trend in total quality score was obtained; participants: 55%, p=0.0001; educator: 42%, p=0.0004; tutor peers: 57%, p=0.0001. Complex clinical guidelines can be developed into a workshop acceptable to interprofessional participants. Eight quality domains provide a framework to standardise interactive teaching for complex clinical guidelines. Tutor peer review is important for content validity. This methodology may be useful for other guideline implementation.

The UNO Aviation Monograph Series: The Airline Quality Rating 1997

NASA Technical Reports Server (NTRS)

Bowen, Brent D.; Headley, Dean E.

1997-01-01

The Airline Quality Rating (AQR) was developed and first announced in early 1991 as an objective method of comparing airline performance on combined multiple factors important to consumers. Development history and calculation details for the AQR rating system are detailed in The Airline Quality Rating 1991 issued in April, 1991, by the National Institute for Aviation Research at Wichita State University. This current report, Airline Rating 1997, contains monthly Airline Quality Rating scores for 1996. Additional copies are available by contacting Wichita State University or the University of Nebraska at Omaha. The Airline Quality Rating (AQR) 1997 is a summary of a month-by-month quality ratings for the nine major domestic U.S. airlines operating during 1996. Using the Airline Quality Rating system and monthly performance data for each airline for the calendar year of 1996, individual and comparative ratings are reported. This research monograph contains a brief summary of the AQR methodology, detailed data and charts that track comparative quality for major domestic airlines across the 12 month period of 1996, and industry average results. Also comparative Airline Quality Rating data for 1991 through 1995 are included to provide a longer term view of quality in the industry.

Evaluating the lexico-grammatical differences in the writing of native and non-native speakers of English in peer-reviewed medical journals in the field of pediatric oncology: Creation of the genuine index scoring system

PubMed Central

Gayle, Alberto Alexander; Shimaoka, Motomu

2017-01-01

Introduction The predominance of English in scientific research has created hurdles for “non-native speakers” of English. Here we present a novel application of native language identification (NLI) for the assessment of medical-scientific writing. For this purpose, we created a novel classification system whereby scoring would be based solely on text features found to be distinctive among native English speakers (NS) within a given context. We dubbed this the “Genuine Index” (GI). Methodology This methodology was validated using a small set of journals in the field of pediatric oncology. Our dataset consisted of 5,907 abstracts, representing work from 77 countries. A support vector machine (SVM) was used to generate our model and for scoring. Results Accuracy, precision, and recall of the classification model were 93.3%, 93.7%, and 99.4%, respectively. Class specific F-scores were 96.5% for NS and 39.8% for our benchmark class, Japan. Overall kappa was calculated to be 37.2%. We found significant differences between countries with respect to the GI score. Significant correlation was found between GI scores and two validated objective measures of writing proficiency and readability. Two sets of key terms and phrases differentiating NS and non-native writing were identified. Conclusions Our GI model was able to detect, with a high degree of reliability, subtle differences between the terms and phrasing used by native and non-native speakers in peer reviewed journals, in the field of pediatric oncology. In addition, L1 language transfer was found to be very likely to survive revision, especially in non-Western countries such as Japan. These findings show that even when the language used is technically correct, there may still be some phrasing or usage that impact quality. PMID:28212419

The methodological quality of diagnostic test accuracy studies for musculoskeletal conditions can be improved.

PubMed

Henschke, Nicholas; Keuerleber, Julia; Ferreira, Manuela; Maher, Christopher G; Verhagen, Arianne P

2014-04-01

To provide an overview of reporting and methodological quality in diagnostic test accuracy (DTA) studies in the musculoskeletal field and evaluate the use of the QUality Assessment of Diagnostic Accuracy Studies (QUADAS) checklist. A literature review identified all systematic reviews that evaluated the accuracy of clinical tests to diagnose musculoskeletal conditions and used the QUADAS checklist. Two authors screened all identified reviews and extracted data on the target condition, index tests, reference standard, included studies, and QUADAS items. A descriptive analysis of the QUADAS checklist was performed, along with Rasch analysis to examine the construct validity and internal reliability. A total of 19 systematic reviews were included, which provided data on individual items of the QUADAS checklist for 392 DTA studies. In the musculoskeletal field, uninterpretable or intermediate test results are commonly not reported, with 175 (45%) studies scoring "no" to this item. The proportion of studies fulfilling certain items varied from 22% (item 11) to 91% (item 3). The interrater reliability of the QUADAS checklist was good and Rasch analysis showed excellent construct validity and internal consistency. This overview identified areas where the reporting and performance of diagnostic studies within the musculoskeletal field can be improved. Copyright © 2014 Elsevier Inc. All rights reserved.

Six-minute walk test as a determinant of the functional capacity of children and adolescents with cystic fibrosis: A systematic review.

PubMed

Andrade Lima, Cibelle; Dornelas de Andrade, Armèle; Campos, Shirley Lima; Brandão, Daniella Cunha; Mourato, Ianny Pereira; Britto, Murilo Carlos Amorim de

2018-04-01

Cystic Fibrosis (CF) is a multisystem disorder. The involvement of the respiratory system is frequent and culminates in dyspnea and exercise intolerance. Functional capacity is an important diagnostic tool, because it reflects the cardiorespiratory status, quality of life and prognosis. This systematic review aims to assess the reproducibility and validity of the six minute walk test (6MWT) to reflect the functional capacity of children and adolescents with cystic fibrosis, and also the correlation between 6MWT and lung function. Searches for articles were performed in eight databases using MeSH/DeCS keywords. A total of 695 articles were found and, after verifying all eligibility criteria, six articles were included for analysis and scoring regarding the methodological quality according to the QUADAS scale (Quality Assessment of Diagnostic Accuracy Studies). All articles had good methodology (QUADAS between 9 and 11 points). The 6MWT is not correlated with lung function. There is a strong indication that the 6MWT is a reproducible test to assess the functional capacity of children and adolescents with CF. The validity assessment could not be reached because the studies included in this systematic review did not use adequate statistical tools to carry out such an evaluation. Copyright © 2018 Elsevier Ltd. All rights reserved.

[Pelvic floor muscles training, electrical stimulation, bladder training and lifestyle interventions to manage lower urinary tract dysfunction in multiple sclerosis: a systematic review].

PubMed

Gaspard, L; Tombal, B; Castille, Y; Opsomer, R-J; Detrembleur, C

2014-03-01

To assess the effectiveness of conservative therapeutic approaches in a multiple sclerosis population. Review was performed in PubMed, PEDro, Scopus and Cochrane Library using combinations of the following keywords: multiple sclerosis; bladder dysfunction; overactive bladder; detrusor hyperreflexia; urge incontinence; urgency; stress incontinence; pelvic floor muscle; biofeedback; PTNS; tibial nerve; bladder training; physical therapy; physiotherapy; conservative treatment and behavioral therapy. Six randomized articles including 289 patients were selected. Four papers exhibited strong scores for the methodological quality assessment. The parameters always significantly improved concerned: number of incontinence episodes (decreased from 64% to 86% after treatment versus before treatment), quality of life (P≤0.001), severity of irritative symptoms (decreased by more than 50% after treatment versus before treatment), and nocturia (P=0.035 to P<0.001). Activities and participation, maximum flow rate, mean voided volume and daytime frequency were not significantly improved in all trials. The physical therapy techniques could be effective for the treatment of urinary disorders in multiple sclerosis populations with mild disability. However, the analyses are based on six studies within only four showed good methodological quality. No strong conclusions regarding treatment approaches can be drawn from this review. Copyright © 2013 Elsevier Masson SAS. All rights reserved.

Prevalence of transactive response DNA-binding protein 43 (TDP-43) proteinopathy in cognitively normal older adults: systematic review and meta-analysis.

PubMed

Nascimento, C; Di Lorenzo Alho, A T; Bazan Conceição Amaral, C; Leite, R E P; Nitrini, R; Jacob-Filho, W; Pasqualucci, C A; Hokkanen, S R K; Hunter, S; Keage, H; Kovacs, G G; Grinberg, L T; Suemoto, C K

2018-04-01

To perform a systematic review and meta-analysis on the prevalence of transactive response DNA-binding protein 43 (TDP-43) proteinopathy in cognitively normal older adults. We systematically reviewed and performed a meta-analysis on the prevalence of TDP-43 proteinopathy in older adults with normal cognition, evaluated by the Mini-Mental State Examination or the Clinical Dementia Rating. We estimated the overall prevalence of TDP-43 using random-effect models, and stratified by age, sex, sample size, study quality, antibody used to assess TDP-43 aggregates, analysed brain regions, Braak stage, Consortium to Establish a Registry for Alzheimer's Disease score, hippocampal sclerosis and geographic location. A total of 505 articles were identified in the systematic review, and 7 were included in the meta-analysis with 1196 cognitively normal older adults. We found an overall prevalence of TDP-43 proteinopathy of 24%. Prevalence of TDP-43 proteinopathy varied widely across geographic location (North America: 37%, Asia: 29%, Europe: 14%, and Latin America: 11%). Estimated prevalence of TDP-43 proteinopathy also varied according to study quality (quality score >7: 22% vs. quality score <7: 42%), antibody used to assess TDP-43 proteinopathy (native: 18% vs. hyperphosphorylated: 24%) and presence of hippocampal sclerosis (without 24% vs. with hippocampal sclerosis: 48%). Other stratified analyses by age, sex, analysed brain regions, sample size and severity of AD neuropathology showed similar pooled TDP-43 prevalence. Different methodology to access TDP-43, and also differences in lifestyle and genetic factors across different populations could explain our results. Standardization of TDP-43 measurement, and future studies about the impact of genetic and lifestyle characteristics on the development of neurodegenerative diseases are needed. © 2017 British Neuropathological Society.

Best practices in teaching echocardiography to cardiology fellows: a review of the evidence.

PubMed

Ruden, Emily A; Way, David P; Nagel, Rollin W; Cheek, Fern; Auseon, Alex J

2016-11-01

Best practices in the teaching of performance and interpretation of echocardiography to cardiology fellows are unknown, and thus, it has traditionally been performed through an apprenticeship model. This review summarizes the existing literature describing evidence-based teaching of echocardiography. A comprehensive search of multiple scientific and educational databases included prospective studies describing an educational intervention for teaching echocardiography to physicians. A total of 288 articles were retrieved, and 10 articles were included in our review. The Medical Education Research Study Quality Instrument (MERSQI), a validated rubric designed to measure the methodological quality of educational research, was used to assign a comprehensive score to each paper. The articles were categorized by educational themes as follows: focused curriculum-based training, simulation, and assessment of competency. Individual study MERSQI scores varied from 8 to 13 (mean 10.55) on a scale of 18 points. The distribution of each group's median score (focused curriculum-based training 11.64; simulation 12.92; assessment of competency 9.39) was analyzed using boxplots with a 95% confidence interval. The median MERSQI score for the assessment of competency group was significantly lower than the others. A review of the data exploring best practices in teaching echocardiography shows only limited effects describing the curricular and assessment components of an overall educational system, rather than one-on-one clinical teaching. Future papers should explore application of point-of-care teaching and the impact of interventions on patient outcomes. © 2016, Wiley Periodicals, Inc.

The efficacy of nonsurgical interventions for pediatric flexible flat foot: a critical review.

PubMed

Jane MacKenzie, Angela; Rome, Keith; Evans, Angela Margaret

2012-12-01

The pediatric flat foot frequently presents as a common parental concern in the health care setting. Foot orthoses are often used, yet benefits are uncertain and disputed, having been variably investigated. A recent Cochrane review cites limited evidence for nonsurgical interventions. This critical and structured review evaluates the effect of pediatric foot orthoses from assessment of the current literature. A systematic search of the following electronic databases: Medline, CINAHL, AMED, and SPORTDiscus, using an array of search terms. A further search was also performed on relevant reference listings. Inclusion criteria were peer-reviewed journal articles, publication date from 1970 onwards, in the English language. Exclusion criteria were surgery interventions, adult subjects, rigid flat foot, articles based on opinion. A structured Quality Index was used to evaluate the research quality of articles. Three reviewers independently assessed the studies with disputes resolved by majority consensus. Studies were then grouped according to the outcome measures used. Thirteen articles, from an initial 429, met the criteria for quality evaluation. The mean Quality Index score was 35% (range: 13% to 81%), indicative of generally poor and varying methodological quality. The low quality of the studies negates definitive conclusions. Only 3/13 quality evaluations scored > 50%; hence, evidence for efficacy of nonsurgical interventions for flexible pediatric flat feet is very limited. Future research needs validated foot type assessment, applicable outcome measures for the intervention, the use of control groups, allowance for independent effects of footwear, age range comparisons, larger samples, and prospective, longer follow-up. There is very limited evidence for the efficacy of nonsurgical interventions for children with flexible flat feet. Clinicians need to consider the lack of good-quality evidence in their decision-making for the management of pediatric flat foot.

Medical Rehabilitation in Natural Disasters: A Review.

PubMed

Khan, Fary; Amatya, Bhasker; Gosney, James; Rathore, Farooq A; Burkle, Frederick M

2015-09-01

To present an evidence-based overview of the effectiveness of medical rehabilitation intervention in natural disaster survivors and outcomes that are affected. A literature search was conducted using medical and health science electronic databases (PubMed, MEDLINE, Embase, Cumulative Index to Nursing and Allied Health Literature, Cochrane Library, PsycINFO) up to September 2014. Two independent reviewers selected studies reporting outcomes for natural disaster survivors after medical rehabilitation that addressed functional restoration and participation. Two reviewers independently extracted data and assessed the methodologic quality of the studies using the Critical Appraisal Skills Program's appraisal tools. A meta-analysis was not possible because of heterogeneity among included trials; therefore, a narrative analysis was performed for best evidence synthesis. Ten studies (2 randomized controlled trials, 8 observational studies) investigated a variety of medical rehabilitation interventions for natural disaster survivors to evaluate best evidence to date. The interventions ranged from comprehensive multidisciplinary rehabilitation to community educational programs. Studies scored low on quality assessment because of methodologic limitations. The findings suggest some evidence for the effectiveness of inpatient rehabilitation in reducing disability and improving participation and quality of life and for community-based rehabilitation for participation. There were no data available for associated costs. The findings highlight the need to incorporate medical rehabilitation into response planning and disaster management for future natural catastrophes. Access to rehabilitation and investment in sustainable infrastructure and education are crucial. More methodologically robust studies are needed to build evidence for rehabilitation programs, cost-effectiveness, and outcome measurement in such settings. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Paternal Influences on Adolescent Sexual Risk Behaviors: A Structured Literature Review

PubMed Central

Bouris, Alida; Lee, Jane; McCarthy, Katharine; Michael, Shannon L.; Pitt-Barnes, Seraphine; Dittus, Patricia

2012-01-01

BACKGROUND AND OBJECTIVE: To date, most parent-based research has neglected the role of fathers in shaping adolescent sexual behavior and has focused on mothers. The objective of this study was to conduct a structured review to assess the role of paternal influence on adolescent sexual behavior and to assess the methodological quality of the paternal influence literature related to adolescent sexual behavior. METHODS: We searched electronic databases: PubMed, PsychINFO, Social Services Abstracts, Family Studies Abstracts, Sociological Abstracts, and the Cumulative Index to Nursing and Allied Health Literature. Studies published between 1980 and 2011 that targeted adolescents 11 to 18 years and focused on paternal parenting processes were included. Methodological quality was assessed by using an 11-item scoring system. RESULTS: Thirteen articles were identified and reviewed. Findings suggest paternal factors are independently associated with adolescent sexual behavior relative to maternal factors. The most commonly studied paternal influence was emotional qualities of the father-adolescent relationship. Paternal communication about sex was most consistently associated with adolescent sexual behavior, whereas paternal attitudes about sex was least associated. Methodological limitations include a tendency to rely on cross-sectional design, nonprobability sampling methods, and focus on sexual debut versus broader sexual behavior. CONCLUSIONS: Existing research preliminarily suggests fathers influence the sexual behavior of their adolescent children; however, more rigorous research examining diverse facets of paternal influence on adolescent sexual behavior is needed. We provide recommendations for primary care providers and public health practitioners to better incorporate fathers into interventions designed to reduce adolescent sexual risk behavior. PMID:23071205

A systematic review of controlled clinical trials on the prevention of back pain in industry.

PubMed

van Poppel, M N; Koes, B W; Smid, T; Bouter, L M

1997-12-01

To assess the effectiveness of lumbar supports, education, and exercise in the prevention of back pain in industry. A computerised search for controlled clinical trials was conducted. A criteria list was used to assess the methodological quality of the studies. The available evidence for the effectiveness of the interventions was graded with a rating system for the level of evidence. Effect sizes of individual studies were combined if the studies were sufficiently similar. 11 studies were identified for the review. The methodological quality of all studies was low, with a maximum score of three out of seven for internal validity. There was no evidence for the effectiveness of lumbar supports due to contradictory outcomes of the studies. Five of the six studies on education reported no effect. Thus there is limited evidence that education does not help to prevent back pain. All three studies on exercise reported a positive result, indicating limited evidence for the effectiveness of exercise. The combined effect size for exercise was 0.53, which is a medium sized effect. Although widely used, there is little evaluative research on the preventive measures studied here. The review showed that there is limited evidence that exercise has some effect in the prevention of back pain and that education is not effective. No conclusive evidence was found for or against the effectiveness of lumbar supports. Research of higher methodological quality is needed before firm conclusions on the effectiveness of lumbar supports, education, and exercise in the prevention of back pain in industry can be drawn.

[Injuries in the Martial Arts Judo, Taekwondo and Wrestling - A Systematic Review].

PubMed

Jäggi, U; Joray, C P; Brülhart, Y; Luijckx, E; Rogan, S

2015-12-01

Martial arts such as judo, taekwondo and wrestling are regulated, usually athletic duels. The aim is to score better than your opponent or to win. As with any type of sport, athletes in martial arts sustain minor and major injuries, which may have many negative consequences. In addition, sports injuries and their rehabilitation generate high costs to the healthcare system. In contrast to the FIFA 11+ warm-up program, no preventive programs have been postulated for injury prevention in these martial arts. Therefore, the aim of this systematic review was to summarise the latest research findings and to evaluate whether initial recommendations can be given for the reduction of injuries in the martial arts judo, wrestling and taekwondo. To gain an overview of the latest research findings, we searched for systematic reviews in PEDro, PubMed, Cochrane and the internet search engine Google Scholar. The methodological quality of these reviews was assessed using the Critical Appraisal Tool for a Systematic Review (CASP), and data was extracted on the risk of injury, injury location and injury type. It was found that all three review articles are of low to moderate methodological quality. Regarding injury location, it became evident that the extremities are particularly vulnerable to injury in all three martial arts. Effusion was observed to be the most common type of injury. Due to the moderate methodological quality and the injury type of effusion, it is not possible to formulate recommendations for injury prevention. Moreover, uniform definitions should be developed to describe sports injuries. © Georg Thieme Verlag KG Stuttgart · New York.

Most systematic reviews of high methodological quality on psoriasis interventions are classified as high risk of bias using ROBIS tool.

PubMed

Gómez-García, Francisco; Ruano, Juan; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Sanz-Cabanillas, Juan Luis; Alcalde-Mellado, Patricia; Maestre-López, Beatriz; Carmona-Fernández, Pedro Jesús; González-Padilla, Marcelino; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-01

No gold standard exists to assess methodological quality of systematic reviews (SRs). Although Assessing the Methodological Quality of Systematic Reviews (AMSTAR) is widely accepted for analyzing quality, the ROBIS instrument has recently been developed. This study aimed to compare the capacity of both instruments to capture the quality of SRs concerning psoriasis interventions. Systematic literature searches were undertaken on relevant databases. For each review, methodological quality and bias risk were evaluated using the AMSTAR and ROBIS tools. Descriptive and principal component analyses were conducted to describe similarities and discrepancies between both assessment tools. We classified 139 intervention SRs as displaying high/moderate/low methodological quality and as high/low risk of bias. A high risk of bias was detected for most SRs classified as displaying high or moderate methodological quality by AMSTAR. When comparing ROBIS result profiles, responses to domain 4 signaling questions showed the greatest differences between bias risk assessments, whereas domain 2 items showed the least. When considering SRs published about psoriasis, methodological quality remains suboptimal, and the risk of bias is elevated, even for SRs exhibiting high methodological quality. Furthermore, the AMSTAR and ROBIS tools may be considered as complementary when conducting quality assessment of SRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Quality of reporting in oncology studies: A systematic analysis of literature reviews and prospects.

PubMed

Rivoirard, Romain; Bourmaud, Aurélie; Oriol, Mathieu; Tinquaut, Fabien; Méry, Benoîte; Langrand-Escure, Julien; Vallard, Alexis; Fournel, Pierre; Magné, Nicolas; Chauvin, Franck

2017-04-01

The present review gives an overview of systematic reviews published in peer reviewed Journals analysing quality of reporting in oncology studies. PUBMED and Cochrane library were searched to identify systematic reviews assessing quality of reporting for randomized controlled trials (RCTs) and observational studies (OBS). Recommendations and primary endpoints used to assess the quality of reporting were described. Intrinsic quality of reporting was analyzed using an Overall Quality Score for literature Reviews (OQSR). Main evaluation themes were overall quality of reporting (20/58) and reporting of Health-Related Quality Of Life (HRQOL) in RCTs (7/58). Reporting recommendations used were not detailed in 56.9% of reviews. Insufficient reporting for the methodological description (randomization, blinding details, and allocation concealment) and the rationale for using specific measure of HRQOL were highlighted. OQSR was significantly higher for reviews published between 2010 and 2014 (after the PRISMA Publication), as compared to those published between 1996-2009 (median OQSR 10 (10-11) versus median OQSR 9 (6-10) respectively, p=0.0053). Intrinsic quality of reporting is satisfactory and has been improved in the last years. Copyright © 2017 Elsevier B.V. All rights reserved.

Methodological issues in the design of a rheumatoid arthritis activity score and its cut-offs.

PubMed

Collignon, Olivier

2014-01-01

Activity of rheumatoid arthritis (RA) can be evaluated using several scoring scales based on clinical features. The most widely used one is the Disease Activity Score involving 28 joint counts (DAS28) for which cut-offs were proposed to help physicians classify patients. However, inaccurate scoring can lead to inappropriate medical decisions. In this article some methodological issues in the design of such a score and its cut-offs are highlighted in order to further propose a strategy to overcome them. As long as the issues reviewed in this article are not addressed, results of studies based on standard disease activity scores such as DAS28 should be considered with caution.

Non-pharmacological sleep interventions for youth with chronic health conditions: a critical review of the methodological quality of the evidence.

PubMed

Brown, Cary A; Kuo, Melissa; Phillips, Leah; Berry, Robyn; Tan, Maria

2013-07-01

Restorative sleep is clearly linked with well-being in youth with chronic health conditions. This review addresses the methodological quality of non-pharmacological sleep intervention (NPSI) research for youth with chronic health conditions. The Guidelines for Critical Review (GCR) and the Effective Public Health Practice Project Quality Assessment Tool (EPHPP) were used in the review. The search yielded 31 behavioural and 10 non-behavioural NPSI for review. Most studies had less than 10 participants. Autism spectrum disorders, attention deficit/hyperactivity disorders, down syndrome, intellectual disabilities, and visual impairments were the conditions that most studies focused upon. The global EPHPP scores indicated most reviewed studies were of weak quality. Only 7 studies were rated as moderate, none were strong. Studies rated as weak quality frequently had recruitment issues; non-blinded participants/parents and/or researchers; and used outcome measures without sound psychometric properties. Little conclusive evidence exists for NPSIs in this population. However, NPSIs are widely used and these preliminary studies demonstrate promising outcomes. There have not been any published reports of negative outcomes that would preclude application of the different NPSIs on a case-by-case basis guided by clinical judgement. These findings support the need for more rigorous, applied research. • Methodological Quality of Sleep Research • Disordered sleep (DS) in youth with chronic health conditions is pervasive and is important to rehabilitation therapists because DS contributes to significant functional problems across psychological, physical and emotional domains. • Rehabilitation therapists and other healthcare providers receive little education about disordered sleep and are largely unaware of the range of assessment and non-pharmacological intervention strategies that exist. An evidence-based website of pediatric sleep resources can be found at http://www.SleepRight.ualberta.ca • The current research on non-pharmacological sleep interventions (NPSI) for youth with health conditions is methodologically weak. However, consistently positive outcomes reported in the literature demonstrate that pragmatic interventions such as bright light therapy, activity, massage and behavioral interventions are promising areas. No studies found reasons that a trail of a NPSI matched to the youth's context and condition should not attempted. More rigorous clinically relevant study of pragmatic non-pharmacological interventions appropriate for therapists' and parents' needs is required.

An Evaluation of Web-Based Clinical Practice Guidelines for Managing Problems Associated with Cannabis Use

PubMed Central

Turner, Michael W; Rooke, Sally E; Langton, Julia M; Gates, Peter J

2012-01-01

Background Cannabis is the most widely used illicit substance, and multiple treatment options and avenues exist for managing its use. There has been an increase in the development of clinical practice guidelines (CPGs) to improve standards of care in this area, many of which are disseminated online. However, little is known about the quality and accessibility of these online CPGs. Objective The purpose of study 1 was to determine the extent to which cannabis-related CPGs disseminated online adhere to established methodological standards. The purpose of study 2 was to determine if treatment providers are familiar with these guidelines and to assess their perceived quality of these guidelines. Methods Study 1 involved a systematic search using the Google Scholar search engine and the National Drugs Sector Information Service (NDSIS) website of the Alcohol and Other Drugs Council of Australia (ADCA) to identify CPGs disseminated online. To be included in the current study, CPGs needed to be free of charge and provide guidance on psychological interventions for reducing cannabis use. Four trained reviewers independently assessed the quality of the 7 identified guidelines using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. Study 2 assessed 166 Australian cannabis-use treatment providers’ (mean age = 45.47 years, SD 12.14) familiarity with and opinions of these 7 guidelines using an online survey. Treatment providers were recruited using online advertisements that directed volunteers to a link to complete the survey, which was posted online for 6 months (January to June 2012). Primary study outcomes included quality scores and rates of guideline familiarity, guideline use, and discovery methods. Results Based on the AGREE II, the quality of CPGs varied considerably. Across different reporting domains, adherence to methodological standards ranged from 0% to 92%. Quality was lowest in the domains of rigor of development (50%), applicability (46%), and editorial independence (30%). Although examination of AGREE II domain scores demonstrated that the quality of the 7 guidelines could be divided into 3 categories (high quality, acceptable to low quality, and very low quality), review of treatment providers’ quality perceptions indicated all guidelines fell into 1 category (acceptable quality). Based on treatment providers’ familiarity with and usage rates of the CPGs, a combination of peer/colleagues, senior professionals, workshops, and Internet dissemination was deemed to be most effective for promoting cannabis use CPGs. Lack of time, guideline length, conflicts with theoretical orientation, and prior content knowledge were identified as barriers to guideline uptake. Conclusions Developers of CPGs should improve their reporting of development processes, conflicts of interest, and CPGs’ applicability to practice, while remaining cognizant that long guidelines may deter implementation. Treatment providers need to be aware that the quality of cannabis-related CPGs varies substantially. PMID:23249447

Child anthropometry data quality from Demographic and Health Surveys, Multiple Indicator Cluster Surveys, and National Nutrition Surveys in the West Central Africa region: are we comparing apples and oranges?

PubMed Central

Corsi, Daniel J.; Perkins, Jessica M.; Subramanian, S. V.

2017-01-01

ABSTRACT Background: There has been limited work comparing survey characteristics and assessing the quality of child anthropometric data from population-based surveys. Objective: To investigate survey characteristics and indicators of quality of anthropometric data in children aged 0–59 months from 23 countries in the West Central Africa region. Methods: Using established methodologies and criteria to examine child age, sex, height, and weight, we conducted a comprehensive assessment and scoring of the quality of anthropometric data collected in 100 national surveys. Results: The Multiple Indicator Cluster Surveys (MICS) and Demographic and Health Surveys (DHS) collected data from a greater number of younger children than older children while the opposite was found for the National Nutrition Surveys (NNS). Missing or implausible height/weight data proportions were 12% and 8% in MICS and DHS compared to 3% in NNS. Average data quality scores were 14 in NNS, 33 in DHS, and 41 in MICS. Conclusions: Although our metric of data quality suggests that data from the NNS appear more consistent and robust, it is equally important to consider its disadvantages related to access and lack of broader socioeconomic information. In comparison, the DHS and MICS are publicly-accessable for research and provide socioeconomic context essential for assessing and addressing the burden of undernutrition within and between countries. The strengths and weaknesses of data from these three sources should be carefully considered when seeking to determine the burden of child undernutrition and its variation within countries. PMID:28641057

Child anthropometry data quality from Demographic and Health Surveys, Multiple Indicator Cluster Surveys, and National Nutrition Surveys in the West Central Africa region: are we comparing apples and oranges?

PubMed

Corsi, Daniel J; Perkins, Jessica M; Subramanian, S V

2017-01-01

There has been limited work comparing survey characteristics and assessing the quality of child anthropometric data from population-based surveys. To investigate survey characteristics and indicators of quality of anthropometric data in children aged 0-59 months from 23 countries in the West Central Africa region. Using established methodologies and criteria to examine child age, sex, height, and weight, we conducted a comprehensive assessment and scoring of the quality of anthropometric data collected in 100 national surveys. The Multiple Indicator Cluster Surveys (MICS) and Demographic and Health Surveys (DHS) collected data from a greater number of younger children than older children while the opposite was found for the National Nutrition Surveys (NNS). Missing or implausible height/weight data proportions were 12% and 8% in MICS and DHS compared to 3% in NNS. Average data quality scores were 14 in NNS, 33 in DHS, and 41 in MICS. Although our metric of data quality suggests that data from the NNS appear more consistent and robust, it is equally important to consider its disadvantages related to access and lack of broader socioeconomic information. In comparison, the DHS and MICS are publicly-accessable for research and provide socioeconomic context essential for assessing and addressing the burden of undernutrition within and between countries. The strengths and weaknesses of data from these three sources should be carefully considered when seeking to determine the burden of child undernutrition and its variation within countries.

Effects of a psycho-educational programme on health-related quality of life in patients treated for colorectal and anal cancer: A feasibility trial.

PubMed

Ohlsson-Nevo, Emma; Karlsson, Jan; Nilsson, Ulrica

2016-04-01

Colorectal cancer (CRC) may have a negative impact on a person's quality of life. Psycho-educational interventions for patients with CRC are rarely studied. The purpose of this feasibility trial was to evaluate the effect of a psycho-educational programme (PEP) on the health-related quality of life (HRQL) of patients treated for CRC and anal cancer. Patients with CRC and anal cancer were randomly assigned to a PEP (n = 47) or standard treatment (n = 39). The PEP included informative lectures, discussion, and reflection. HRQL was evaluated using the SF-36 at baseline and 1, 6, and 12 months after the end of the PEP. Patients in the PEP group had significantly better Mental Health scores after 1 month and significantly better Bodily Pain scores after 6 months compared with patients who received standard care. The results of this study indicate that a PEP can have a short-term effect on the mental health and bodily pain of patients treated for CRC and anal cancer when comparing with a control group. The article discusses the methodological difficulties of evaluating an intervention such as this PEP in a clinical setting. Copyright © 2015. Published by Elsevier Ltd.

Two approaches to estimating the effect of parenting on the development of executive function in early childhood.

PubMed

Blair, Clancy; Raver, C Cybele; Berry, Daniel J

2014-02-01

In the current article, we contrast 2 analytical approaches to estimate the relation of parenting to executive function development in a sample of 1,292 children assessed longitudinally between the ages of 36 and 60 months of age. Children were administered a newly developed and validated battery of 6 executive function tasks tapping inhibitory control, working memory, and attention shifting. Residualized change analysis indicated that higher quality parenting as indicated by higher scores on widely used measures of parenting at both earlier and later time points predicted more positive gain in executive function at 60 months. Latent change score models in which parenting and executive function over time were held to standards of longitudinal measurement invariance provided additional evidence of the association between change in parenting quality and change in executive function. In these models, cross-lagged paths indicated that in addition to parenting predicting change in executive function, executive function bidirectionally predicted change in parenting quality. Results were robust with the addition of covariates, including child sex, race, maternal education, and household income-to-need. Strengths and drawbacks of the 2 analytic approaches are discussed, and the findings are considered in light of emerging methodological innovations for testing the extent to which executive function is malleable and open to the influence of experience.

A systematic comparison of the closed shoulder reduction techniques.

PubMed

Alkaduhimi, H; van der Linde, J A; Willigenburg, N W; van Deurzen, D F P; van den Bekerom, M P J

2017-05-01

To identify the optimal technique for closed reduction for shoulder instability, based on success rates, reduction time, complication risks, and pain level. A PubMed and EMBASE query was performed, screening all relevant literature of closed reduction techniques mentioning the success rate written in English, Dutch, German, and Arabic. Studies with a fracture dislocation or lacking information on success rates for closed reduction techniques were excluded. We used the modified Coleman Methodology Score (CMS) to assess the quality of included studies and excluded studies with a poor methodological quality (CMS < 50). Finally, a meta-analysis was performed on the data from all studies combined. 2099 studies were screened for their title and abstract, of which 217 studies were screened full-text and finally 13 studies were included. These studies included 9 randomized controlled trials, 2 retrospective comparative studies, and 2 prospective non-randomized comparative studies. A combined analysis revealed that the scapular manipulation is the most successful (97%), fastest (1.75 min), and least painful reduction technique (VAS 1,47); the "Fast, Reliable, and Safe" (FARES) method also scores high in terms of successful reduction (92%), reduction time (2.24 min), and intra-reduction pain (VAS 1.59); the traction-countertraction technique is highly successful (95%), but slower (6.05 min) and more painful (VAS 4.75). For closed reduction of anterior shoulder dislocations, the combined data from the selected studies indicate that scapular manipulation is the most successful and fastest technique, with the shortest mean hospital stay and least pain during reduction. The FARES method seems the best alternative.

Evaluation of methodologies for assessing the overall diet: dietary quality scores and dietary pattern analysis.

PubMed

Ocké, Marga C

2013-05-01

This paper aims to describe different approaches for studying the overall diet with advantages and limitations. Studies of the overall diet have emerged because the relationship between dietary intake and health is very complex with all kinds of interactions. These cannot be captured well by studying single dietary components. Three main approaches to study the overall diet can be distinguished. The first method is researcher-defined scores or indices of diet quality. These are usually based on guidelines for a healthy diet or on diets known to be healthy. The second approach, using principal component or cluster analysis, is driven by the underlying dietary data. In principal component analysis, scales are derived based on the underlying relationships between food groups, whereas in cluster analysis, subgroups of the population are created with people that cluster together based on their dietary intake. A third approach includes methods that are driven by a combination of biological pathways and the underlying dietary data. Reduced rank regression defines linear combinations of food intakes that maximally explain nutrient intakes or intermediate markers of disease. Decision tree analysis identifies subgroups of a population whose members share dietary characteristics that influence (intermediate markers of) disease. It is concluded that all approaches have advantages and limitations and essentially answer different questions. The third approach is still more in an exploration phase, but seems to have great potential with complementary value. More insight into the utility of conducting studies on the overall diet can be gained if more attention is given to methodological issues.

Implementation and evaluation of a pharmacist-led hypertension management service in primary care: outcomes and methodological challenges.

PubMed

Bajorek, Beata; Lemay, Kate S; Magin, Parker; Roberts, Christopher; Krass, Ines; Armour, Carol L

2016-01-01

Suboptimal utilisation of pharmacotherapy, non-adherence to prescribed treatment, and a lack of monitoring all contribute to poor blood (BP) pressure control in patients with hypertension. The objective of this study was to evaluate the implementation of a pharmacist-led hypertension management service in terms of processes, outcomes, and methodological challenges. A prospective, controlled study was undertaken within the Australian primary care setting. Community pharmacists were recruited to one of three study groups: Group A (Control - usual care), Group B (Intervention), or Group C (Short Intervention). Pharmacists in Groups B and C delivered a service comprising screening and monitoring of BP, as well as addressing poor BP control through therapeutic adjustment and adherence strategies. Pharmacists in Group C delivered the shortened version of the service. Significant changes to key outcome measures were observed in Group C: reduction in systolic and diastolic BPs at the 3-month visit (P<0.01 and P<0.01, respectively), improvement in medication adherence scores (P=0.01), and a slight improvement in quality of life (EQ-5D-3L Index) scores (P=0.91). There were no significant changes in Group B (the full intervention), and no differences in comparison to Group A (usual care). Pharmacists fed-back that patient recruitment was a key barrier to service implementation, highlighting the methodological implications of screening. A collaborative, pharmacist-led hypertension management service can help monitor BP, improve medication adherence, and optimise therapy in a step-wise approach. However, blood pressure screening can effect behaviour change in patients, presenting methodological challenges in the evaluation of services in this context.

Implementation and evaluation of a pharmacist-led hypertension management service in primary care: outcomes and methodological challenges

PubMed Central

2016-01-01

Background: Suboptimal utilisation of pharmacotherapy, non-adherence to prescribed treatment, and a lack of monitoring all contribute to poor blood (BP) pressure control in patients with hypertension. Objective: The objective of this study was to evaluate the implementation of a pharmacist-led hypertension management service in terms of processes, outcomes, and methodological challenges. Method: A prospective, controlled study was undertaken within the Australian primary care setting. Community pharmacists were recruited to one of three study groups: Group A (Control – usual care), Group B (Intervention), or Group C (Short Intervention). Pharmacists in Groups B and C delivered a service comprising screening and monitoring of BP, as well as addressing poor BP control through therapeutic adjustment and adherence strategies. Pharmacists in Group C delivered the shortened version of the service. Results: Significant changes to key outcome measures were observed in Group C: reduction in systolic and diastolic BPs at the 3-month visit (P<0.01 and P<0.01, respectively), improvement in medication adherence scores (P=0.01), and a slight improvement in quality of life (EQ-5D-3L Index) scores (P=0.91). There were no significant changes in Group B (the full intervention), and no differences in comparison to Group A (usual care). Pharmacists fed-back that patient recruitment was a key barrier to service implementation, highlighting the methodological implications of screening. Conclusion: A collaborative, pharmacist-led hypertension management service can help monitor BP, improve medication adherence, and optimise therapy in a step-wise approach. However, blood pressure screening can effect behaviour change in patients, presenting methodological challenges in the evaluation of services in this context. PMID:27382427

The Application of Failure Modes and Effects Analysis Methodology to Intrathecal Drug Delivery for Pain Management

PubMed Central

Patel, Teresa; Fisher, Stanley P.

2016-01-01

Objective This study aimed to utilize failure modes and effects analysis (FMEA) to transform clinical insights into a risk mitigation plan for intrathecal (IT) drug delivery in pain management. Methods The FMEA methodology, which has been used for quality improvement, was adapted to assess risks (i.e., failure modes) associated with IT therapy. Ten experienced pain physicians scored 37 failure modes in the following categories: patient selection for therapy initiation (efficacy and safety concerns), patient safety during IT therapy, and product selection for IT therapy. Participants assigned severity, probability, and detection scores for each failure mode, from which a risk priority number (RPN) was calculated. Failure modes with the highest RPNs (i.e., most problematic) were discussed, and strategies were proposed to mitigate risks. Results Strategic discussions focused on 17 failure modes with the most severe outcomes, the highest probabilities of occurrence, and the most challenging detection. The topic of the highest‐ranked failure mode (RPN = 144) was manufactured monotherapy versus compounded combination products. Addressing failure modes associated with appropriate patient and product selection was predicted to be clinically important for the success of IT therapy. Conclusions The methodology of FMEA offers a systematic approach to prioritizing risks in a complex environment such as IT therapy. Unmet needs and information gaps are highlighted through the process. Risk mitigation and strategic planning to prevent and manage critical failure modes can contribute to therapeutic success. PMID:27477689

Reliability of a retail food store survey and development of an accompanying retail scoring system to communicate survey findings and identify vendors for healthful food and marketing initiatives.

PubMed

Ghirardelli, Alyssa; Quinn, Valerie; Sugerman, Sharon

2011-01-01

To develop a retail grocery instrument with weighted scoring to be used as an indicator of the food environment. Twenty six retail food stores in low-income areas in California. Observational. Inter-rater reliability for grocery store survey instrument. Description of store scoring methodology weighted to emphasize availability of healthful food. Type A intra-class correlation coefficients (ICC) with absolute agreement definition or a κ test for measures using ranges as categories. Measures of availability and price of fruits and vegetables performed well in reliability testing (κ = 0.681-0.800). Items for vegetable quality were better than for fruit (ICC 0.708 vs 0.528). Kappa scores indicated low to moderate agreement (0.372-0.674) on external store marketing measures and higher scores for internal store marketing. "Next to" the checkout counter was more reliable than "within 6 feet." Health departments using the store scoring system reported it as the most useful communication of neighborhood findings. There was good reliability of the measures among the research pairs. The local store scores can show the need to bring in resources and to provide access to fruits and vegetables and other healthful food. Copyright © 2011 Society for Nutrition Education. Published by Elsevier Inc. All rights reserved.

Improving patient satisfaction with pain management using Six Sigma tools.

PubMed

DuPree, Erin; Martin, Lisa; Anderson, Rebecca; Kathuria, Navneet; Reich, David; Porter, Carol; Chassin, Mark R

2009-07-01

Patient satisfaction as a direct and public measure of quality of care is changing the way hospitals address quality improvement. The feasibility of using the Six Sigma DMAIC (Define, Measure, Analyze, Improve, Control) methodology to improve patient satisfaction as it relates to pain management was evaluated. This project used the DMAIC methodology to improve patients' overall satisfaction with pain management on two inpatient units in an urban academic medical center. Pre- and postintervention patient surveys were conducted. The DMAIC methodology provided a data-driven structure to determine the optimal improvement strategies, as well as a long-term plan for maintaining any improvements. In addition, the Change Acceleration Process (CAP) was used throughout the project's various DMAIC stages to further the work of the team by creating a shared need to meet the objectives of the project. Overall satisfaction with pain management "excellent" ratings increased from 37% to 54%. Both units surpassed the goal of at least 50% of responses in the "excellent" category. Several key drivers of satisfaction with pain management were uncovered in the Analyze phase of the project, and each saw rating increases from the pre-intervention to postintervention surveys. Ongoing monitoring by the hospital inpatient satisfaction survey showed that the pain satisfaction score improved in subsequent quarters as compared with the pre-intervention period. The Six Sigma DMAIC methodology can be used successfully to improve patient satisfaction. The project led to measurable improvements in patient satisfaction with pain management, which have endured past the duration of the Six Sigma project. The Control phase of DMAIC allows the improvements to be incorporated into daily operations.

Applying Multi-Criteria Decision Analysis (MCDA) Simple Scoring as an Evidence-based HTA Methodology for Evaluating Off-Patent Pharmaceuticals (OPPs) in Emerging Markets.

PubMed

Brixner, Diana; Maniadakis, Nikos; Kaló, Zoltán; Hu, Shanlian; Shen, Jie; Wijaya, Kalman

2017-09-01

Off-patent pharmaceuticals (OPPs) represent more than 60% of the pharmaceutical market in many emerging countries, where they are frequently evaluated primarily on cost rather than with health technology assessment. OPPs are assumed to be identical to the originators. Branded and unbranded generic versions can, however, vary from the originator in active pharmaceutical ingredients, dosage, consistency formulation, excipients, manufacturing processes, and distribution, for example. These variables can alter the efficacy and safety of the product, negatively impacting both the anticipated cost savings and the population's health. In addition, many health care systems lack the resources or expertise to evaluate such products, and current assessment methods can be complex and difficult to adapt to a health system's needs. Multicriteria decision analysis (MCDA) simple scoring is an evidence-based health technology assessment methodology for evaluating OPPs, especially in emerging countries in which resources are limited but decision makers still must balance affordability with factors such as drug safety, level interchangeability, manufacturing site and active pharmaceutical ingredient quality, supply track record, and real-life outcomes. MCDA simple scoring can be applied to pharmaceutical pricing, reimbursement, formulary listing, and drug procurement. In November 2015, a workshop was held at the International Society for Pharmacoeconomics and Outcomes Research Annual Meeting in Milan to refine and prioritize criteria that can be used in MCDA simple scoring for OPPs, resulting in an example MCDA process and 22 prioritized criteria that health care systems in emerging countries can easily adapt to their own decision-making processes. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Impact of Inadequate Empirical Therapy on the Mortality of Patients with Bloodstream Infections: a Propensity Score-Based Analysis

PubMed Central

Retamar, Pilar; Portillo, María M.; López-Prieto, María Dolores; Rodríguez-López, Fernando; de Cueto, Marina; García, María V.; Gómez, María J.; del Arco, Alfonso; Muñoz, Angel; Sánchez-Porto, Antonio; Torres-Tortosa, Manuel; Martín-Aspas, Andrés; Arroyo, Ascensión; García-Figueras, Carolina; Acosta, Federico; Corzo, Juan E.; León-Ruiz, Laura; Escobar-Lara, Trinidad

2012-01-01

The impact of the adequacy of empirical therapy on outcome for patients with bloodstream infections (BSI) is key for determining whether adequate empirical coverage should be prioritized over other, more conservative approaches. Recent systematic reviews outlined the need for new studies in the field, using improved methodologies. We assessed the impact of inadequate empirical treatment on the mortality of patients with BSI in the present-day context, incorporating recent methodological recommendations. A prospective multicenter cohort including all BSI episodes in adult patients was performed in 15 hospitals in Andalucía, Spain, over a 2-month period in 2006 to 2007. The main outcome variables were 14- and 30-day mortality. Adjusted analyses were performed by multivariate analysis and propensity score-based matching. Eight hundred one episodes were included. Inadequate empirical therapy was administered in 199 (24.8%) episodes; mortality at days 14 and 30 was 18.55% and 22.6%, respectively. After controlling for age, Charlson index, Pitt score, neutropenia, source, etiology, and presentation with severe sepsis or shock, inadequate empirical treatment was associated with increased mortality at days 14 and 30 (odds ratios [ORs], 2.12 and 1.56; 95% confidence intervals [95% CI], 1.34 to 3.34 and 1.01 to 2.40, respectively). The adjusted ORs after a propensity score-based matched analysis were 3.03 and 1.70 (95% CI, 1.60 to 5.74 and 0.98 to 2.98, respectively). In conclusion, inadequate empirical therapy is independently associated with increased mortality in patients with BSI. Programs to improve the quality of empirical therapy in patients with suspicion of BSI and optimization of definitive therapy should be implemented. PMID:22005999

Association between bibliometric parameters, reporting and methodological quality of randomised controlled trials in vascular and endovascular surgery.

PubMed

Hajibandeh, Shahab; Hajibandeh, Shahin; Antoniou, George A; Green, Patrick A; Maden, Michelle; Torella, Francesco

2017-04-01

Purpose We aimed to investigate association between bibliometric parameters, reporting and methodological quality of vascular and endovascular surgery randomised controlled trials. Methods The most recent 75 and oldest 75 randomised controlled trials published in leading journals over a 10-year period were identified. The reporting quality was analysed using the CONSORT statement, and methodological quality with the Intercollegiate Guidelines Network checklist. We used exploratory univariate and multivariable linear regression analysis to investigate associations. Findings Bibliometric parameters such as type of journal, study design reported in title, number of pages; external funding, industry sponsoring and number of citations are associated with reporting quality. Moreover, parameters such as type of journal, subject area and study design reported in title are associated with methodological quality. Conclusions The bibliometric parameters of randomised controlled trials may be independent predictors for their reporting and methodological quality. Moreover, the reporting quality of randomised controlled trials is associated with their methodological quality and vice versa.

Patient reported outcomes in head and neck cancer: selecting instruments for quality of life integration in clinical protocols.

PubMed

Silveira, Augusta P; Gonçalves, Joaquim; Sequeira, Teresa; Ribeiro, Cláudia; Lopes, Carlos; Monteiro, Eurico; Pimentel, Francisco L

2010-10-31

Health Related Quality of Life has been used in medical research for more than twenty years, being progressively accepted during the last decade as an important patient reported outcome. Considering the multidimensional approach involved in Health Related Quality of Life assessment, instrument applicability and cultural adaptation must be tested for each population. In order to select the most appropriate instrument for Head and Neck cancer patients, two major Health Related Quality of Life specific questionnaires for Head and Neck cancer patients were compared. Conceptual differences, psychometric characteristics, scores, reliability, construct validity and sensitivity to symptomatology, tumour location, tumour size were analyzed. 102 consecutive Head and Neck cancer patients completed two different Health Related Quality of Life questionnaires: EORTC QLQ-C30 and its specific head and neck module QLQ-H&N35 and the Functional Assessment of Cancer Therapy Scales (FACT-H&N). Patients completed the questionnaires, immediately before consultation as a part of the routine evaluation. A greater variability was always found in the EORTC QLC-C30 questionnaire's scores for all comparable domains. Both instruments revealed a good internal consistency and demonstrated to be good tools to distinguish symptomatic patients. The EORTC questionnaires still demonstrated sensitivity to distinguish T3 and T4 staging. Conceptual differences and the psychometric characteristics are discussed. Our results suggest that these two instruments assess different aspects of Health Related Quality of Life - the questionnaires should be used separately and chosen according to the study objectives and methodology. This study emphases the importance in selecting the appropriate tool as a critical success factor in implementing routine Health Related Quality of Life assessment in clinical practice. This decision assumes particularly importance when utilization of results in real time and integration into clinical protocols are considered.

Medicare Program; Prospective Payment System and Consolidated Billing for Skilled Nursing Facilities for FY 2017, SNF Value-Based Purchasing Program, SNF Quality Reporting Program, and SNF Payment Models Research. Final rule.

PubMed

2016-08-05

This final rule updates the payment rates used under the prospective payment system (PPS) for skilled nursing facilities (SNFs) for fiscal year (FY) 2017. In addition, it specifies a potentially preventable readmission measure for the Skilled Nursing Facility Value-Based Purchasing Program (SNF VBP), and implements requirements for that program, including performance standards, a scoring methodology, and a review and correction process for performance information to be made public, aimed at implementing value-based purchasing for SNFs. Additionally, this final rule includes additional polices and measures in the Skilled Nursing Facility Quality Reporting Program (SNF QRP). This final rule also responds to comments on the SNF Payment Models Research (PMR) project.

School meals participation and weekday dietary quality were associated after controlling for weekend eating among U.S. school children aged 6 to 17 years.

PubMed

Hanson, Karla L; Olson, Christine M

2013-05-01

Prior research has shown positive associations between participation in school meals and some dietary measures, but the evidence is equivocal. Few prior studies have used methodological approaches that address underlying differences in food preferences and health beliefs between school meals participants and nonparticipants, resulting in the potential for selection bias to influence results. This study estimated relationships among school meals participation and weekday energy intake and dietary quality, controlling for weekend dietary intake as a proxy for food preferences and health beliefs. Further, this paper explored how family income moderated these relationships. NHANES data (2003-2008) were analyzed for children aged 6-17 y with reliable dietary recalls for one weekday and one weekend day (n = 2376). Using multivariate linear regression models, we examined weekday-weekend differences in energy intake as a percentage of the estimated energy requirement (%EER) and differences in Healthy Eating Index-2005 (HEI) scores for breakfast and lunch and for the entire day. Overall, school meals participants and nonparticipants had equivalent %EERs and total HEI scores, but participants scored higher for milk and lower for saturated fat and sodium after adjustment for weekend eating. Family income moderated the relationship between school meals participation and HEI. Low-income children who ate school breakfast and lunch had significantly higher total HEI, and total grain, and meat and beans component scores. Conversely, higher income participants had significantly lower scores for total grains, whole grains, and saturated fat. Changes to the content of school meals may differentially affect weekday dietary intake of low-income and higher income participants.

Panning for the gold in health research: incorporating studies' methodological quality in meta-analysis.

PubMed

Johnson, Blair T; Low, Robert E; MacDonald, Hayley V

2015-01-01

Systematic reviews now routinely assess methodological quality to gauge the validity of the included studies and of the synthesis as a whole. Although trends from higher quality studies should be clearer, it is uncertain how often meta-analyses incorporate methodological quality in models of study results either as predictors, or, more interestingly, in interactions with theoretical moderators. We survey 200 meta-analyses in three health promotion domains to examine when and how meta-analyses incorporate methodological quality. Although methodological quality assessments commonly appear in contemporary meta-analyses (usually as scales), they are rarely incorporated in analyses, and still more rarely analysed in interaction with theoretical determinants of the success of health promotions. The few meta-analyses (2.5%) that did include such an interaction analysis showed that moderator results remained significant in higher quality studies or were present only among higher quality studies. We describe how to model quality interactively with theoretically derived moderators and discuss strengths and weaknesses of this approach and in relation to current meta-analytic practice. In large literatures exhibiting heterogeneous effects, meta-analyses can incorporate methodological quality and generate conclusions that enable greater confidence not only about the substantive phenomenon but also about the role that methodological quality itself plays.

Simulation modeling for stratified breast cancer screening - a systematic review of cost and quality of life assumptions.

PubMed

Arnold, Matthias

2017-12-02

The economic evaluation of stratified breast cancer screening gains momentum, but produces also very diverse results. Systematic reviews so far focused on modeling techniques and epidemiologic assumptions. However, cost and utility parameters received only little attention. This systematic review assesses simulation models for stratified breast cancer screening based on their cost and utility parameters in each phase of breast cancer screening and care. A literature review was conducted to compare economic evaluations with simulation models of personalized breast cancer screening. Study quality was assessed using reporting guidelines. Cost and utility inputs were extracted, standardized and structured using a care delivery framework. Studies were then clustered according to their study aim and parameters were compared within the clusters. Eighteen studies were identified within three study clusters. Reporting quality was very diverse in all three clusters. Only two studies in cluster 1, four studies in cluster 2 and one study in cluster 3 scored high in the quality appraisal. In addition to the quality appraisal, this review assessed if the simulation models were consistent in integrating all relevant phases of care, if utility parameters were consistent and methodological sound and if cost were compatible and consistent in the actual parameters used for screening, diagnostic work up and treatment. Of 18 studies, only three studies did not show signs of potential bias. This systematic review shows that a closer look into the cost and utility parameter can help to identify potential bias. Future simulation models should focus on integrating all relevant phases of care, using methodologically sound utility parameters and avoiding inconsistent cost parameters.

How is AMSTAR applied by authors - a call for better reporting.

PubMed

Pieper, Dawid; Koensgen, Nadja; Breuing, Jessica; Ge, Long; Wegewitz, Uta

2018-06-18

The assessment of multiple systematic reviews (AMSTAR) tool is widely used for investigating the methodological quality of systematic reviews (SR). Originally, AMSTAR was developed for SRs of randomized controlled trials (RCTs). Its applicability to SRs of other study designs remains unclear. Our objectives were to: 1) analyze how AMSTAR is applied by authors and (2) analyze whether the authors pay attention to the original purpose of AMSTAR and for what it has been validated. We searched MEDLINE (via PubMed) from inception through October 2016 to identify studies that applied AMSTAR. Full-text studies were sought for all retrieved hits and screened by one reviewer. A second reviewer verified the excluded studies (liberal acceleration). Data were extracted into structured tables by one reviewer and were checked by a second reviewer. Discrepancies at any stage were resolved by consensus or by consulting a third person. We analyzed the data descriptively as frequencies or medians and interquartile ranges (IQRs). Associations were quantified using the risk ratio (RR), with 95% confidence intervals. We identified 247 studies. They included a median of 17 reviews (interquartile range (IQR): 8 to 47) per study. AMSTAR was modified in 23% (57/247) of studies. In most studies, an AMSTAR score was calculated (200/247; 81%). Methods for calculating an AMSTAR score varied, with summing up all yes answers (yes = 1) being the most frequent option (102/200; 51%). More than one third of the authors failed to report how the AMSTAR score was obtained (71/200; 36%). In a subgroup analysis, we compared overviews of reviews (n = 154) with the methodological publications (n = 93). The overviews of reviews were much less likely to mention both limitations with respect to study designs (if other studies other than RCTs were included in the reviews) (RR 0.27, 95% CI 0.09 to 0.75) and overall score (RR 0.08, 95% CI 0.02 to 0.35). Authors, peer reviewers, and editors should pay more attention to the correct use and reporting of assessment tools in evidence synthesis. Authors of overviews of reviews should ensure to have a methodological expert in their review team.

[Management of pre-analytical nonconformities].

PubMed

Berkane, Z; Dhondt, J L; Drouillard, I; Flourié, F; Giannoli, J M; Houlbert, C; Surgat, P; Szymanowicz, A

2010-12-01

The main nonconformities enumerated to facilitate consensual codification. In each case, an action is defined: refusal to realize the examination with request of a new sample, request of information or correction, results cancellation, nurse or physician information. A traceability of the curative, corrective and preventive actions is needed. Then, methodology and indicators are proposed to assess nonconformity and to follow the quality improvements. The laboratory information system can be used instead of dedicated software. Tools for the follow-up of nonconformities scores are proposed. Finally, we propose an organization and some tools allowing the management and control of the nonconformities occurring during the pre-examination phase.

Exploring end of life priorities in Saudi males: usefulness of Q-methodology.

PubMed

Hammami, Muhammad M; Al Gaai, Eman; Hammami, Safa; Attala, Sahar

2015-11-26

Quality end-of-life care depends on understanding patients' end-of-life choices. Individuals and cultures may hold end-of-life priorities at different hierarchy. Forced ranking rather than independent rating, and by-person factor analysis rather than averaging may reveal otherwise masked typologies. We explored Saudi males' forced-ranked, end-of-life priorities and dis-priorities. Respondents (n = 120) rank-ordered 47 opinion statements on end-of-life care following a 9-category symmetrical distribution. Statements' scores were analyzed by averaging analysis and factor analysis (Q-methodology). Respondents' mean age was 32.1 years (range, 18-65); 52% reported average religiosity, 88 and 83% ≥ very good health and life-quality, respectively, and 100% ≥ high school education. Averaging analysis revealed that the extreme five end-of-life priorities were to, be at peace with God, be able to say the statement of faith, maintain dignity, resolve conflicts, and have religious death rituals respected, respectively. The extreme five dis-priorities were to, die in the hospital, not receive intensive care if in coma, die at peak of life, be informed about impending death by family/friends rather than doctor, and keep medical status confidential from family/friends, respectively. Q-methodology classified 67% of respondents into five highly transcendent opinion types. Type-I (rituals-averse, family-caring, monitoring-coping, life-quality-concerned) and Type-V (rituals-apt, family-centered, neutral-coping, life-quantity-concerned) reported the lowest and highest religiosity, respectively. Type-II (rituals-apt, family-dependent, monitoring-coping, life-quantity-concerned) and Type-III (rituals-silent, self/family-neutral, avoidance-coping, life-quality & quantity-concerned) reported the best and worst life-quality, respectively. Type-I respondents were the oldest with the lowest general health, in contrast to Type-IV (rituals-apt, self-centered, monitoring-coping, life-quality/quantity-neutral). Of the extreme 14 priorities/dis-priorities for the five types, 29, 14, 14, 50, and 36%, respectively, were not among the extreme 20 priorities/dis-priorities identified by averaging analysis for the entire cohort. 1) Transcendence was the extreme end-of-life priority, and dying in the hospital was the extreme dis-priority. 2) Quality of life was conceptualized differently with less emphasize on its physiological aspects. 3) Disclosure of terminal illness to family/close friends was preferred as long it is through the patient. 4) Q-methodology identified five types of constellations of end-of-life priorities and dis-priorities that may be related to respondents' demographics and are partially masked by averaging analysis.

A Systematic Review of Serious Games in Training Health Care Professionals.

PubMed

Wang, Ryan; DeMaria, Samuel; Goldberg, Andrew; Katz, Daniel

2016-02-01

Serious games are computer-based games designed for training purposes. They are poised to expand their role in medical education. This systematic review, conducted in accordance with PRISMA guidelines, aimed to synthesize current serious gaming trends in health care training, especially those pertaining to developmental methodologies and game evaluation. PubMed, EMBASE, and Cochrane databases were queried for relevant documents published through December 2014. Of the 3737 publications identified, 48 of them, covering 42 serious games, were included. From 2007 to 2014, they demonstrate a growth from 2 games and 2 genres to 42 games and 8 genres. Overall, study design was heterogeneous and methodological quality by MERQSI score averaged 10.5/18, which is modest. Seventy-nine percent of serious games were evaluated for training outcomes. As the number of serious games for health care training continues to grow, having schemas that organize how educators approach their development and evaluation is essential for their success.

An integrative fuzzy Kansei engineering and Kano model for logistics services

NASA Astrophysics Data System (ADS)

Hartono, M.; Chuan, T. K.; Prayogo, D. N.; Santoso, A.

2017-11-01

Nowadays, customer emotional needs (known as Kansei) in product and especially in services become a major concern. One of the emerging services is the logistics services. In obtaining a global competitive advantage, logistics services should understand and satisfy their customer affective impressions (Kansei). How to capture, model and analyze the customer emotions has been well structured by Kansei Engineering, equipped with Kano model to strengthen its methodology. However, its methodology lacks of the dynamics of customer perception. More specifically, there is a criticism of perceived scores on user preferences, in both perceived service quality and Kansei response, whether they represent an exact numerical value. Thus, this paper is proposed to discuss an approach of fuzzy Kansei in logistics service experiences. A case study in IT-based logistics services involving 100 subjects has been conducted. Its findings including the service gaps accompanied with prioritized improvement initiatives are discussed.

A robust dataset-agnostic heart disease classifier from Phonocardiogram.

PubMed

Banerjee, Rohan; Dutta Choudhury, Anirban; Deshpande, Parijat; Bhattacharya, Sakyajit; Pal, Arpan; Mandana, K M

2017-07-01

Automatic classification of normal and abnormal heart sounds is a popular area of research. However, building a robust algorithm unaffected by signal quality and patient demography is a challenge. In this paper we have analysed a wide list of Phonocardiogram (PCG) features in time and frequency domain along with morphological and statistical features to construct a robust and discriminative feature set for dataset-agnostic classification of normal and cardiac patients. The large and open access database, made available in Physionet 2016 challenge was used for feature selection, internal validation and creation of training models. A second dataset of 41 PCG segments, collected using our in-house smart phone based digital stethoscope from an Indian hospital was used for performance evaluation. Our proposed methodology yielded sensitivity and specificity scores of 0.76 and 0.75 respectively on the test dataset in classifying cardiovascular diseases. The methodology also outperformed three popular prior art approaches, when applied on the same dataset.

Efficacy of total ankle replacement with meniscal-bearing devices: a systematic review and meta-analysis.

PubMed

Stengel, Dirk; Bauwens, Kai; Ekkernkamp, Axel; Cramer, Jörg

2005-03-01

The reputation of total ankle arthroplasty for treating end-stage ankle arthritis of different origin is dubious. Newer generation meniscal-bearing prostheses may have overcome the known problems with earlier implants. There is, however, no systematic approach to the available scientific evidence allowing for a critical appraisal of their benefits and risks. We conducted a systematic review meta-analysis of studies exploring the efficacy of three-component total ankle prostheses. We demanded a minimum sample size of 20 subjects, at least 1 year of follow-up, and a clinically relevant study endpoint (for example, results of ankle scoring, ranges of motion [ROM], complications, and survival rates). We identified citations by electronic medical databases and a manual search. We made no restrictions for language. We used an eight-point quality scale to appraise methodological standards, and modeled outcomes by random-effects meta-regression analysis. Eighteen of 1830 citations including 1086 patients fulfilled our eligibility criteria. Studies met a median of four quality items (interquartile range 2-5). Outcome estimates did not depend on methodological quality. There was no evidence of strong heterogeneity or publication bias. With standardized 100-point ankle and hindfoot scores, formal data pooling was possible for 10 trials (n =497), showing a mean improvement of 45.2 points (95% confidence interval [CI] 39.3-51.1). Overall ROM improved slightly (6.3 degrees, 95%CI 2.2-10.5 degrees ). Weighted complication rates ranged from 1.6% (deep infections) to 14.7% (impingement). Secondary surgery had to be performed in 12.5%, whereas secondary arthrodesis was necessary in 6.3%. The weighted 5-year prosthesis survival rate averaged 90.6%. Ankle arthroplasty improves pain and joint mobility in end-stage ankle arthritis. Its performance in comparison to the current reference standard (that is, ankle fusion) remains to be defined in a properly designed randomized trial.

'Six sigma approach' - an objective strategy in digital assessment of postoperative air leaks: a prospective randomised study.

PubMed

Bertolaccini, Luca; Rizzardi, Giovanna; Filice, Mary Jo; Terzi, Alberto

2011-05-01

Until now, only way to report air leaks (ALs) has been with an analogue score in an inherently subjective manner. The Six Sigma quality improvement methodology is a data-driven approach applicable to evaluate the quality of the quantification method of repetitive procedures. We applied the Six Sigma concept to improve the process of AL evaluation. A digital device for AL measurement (Drentech PALM, Redax S.r.l., Mirandola (MO), Italy) was applied to 49 consecutive patients, who underwent pulmonary intervention, compared with a similar population with classical chest drainage. Data recorded were postoperative AL, chest-tube removal days, number of chest roentgenograms, hospital length of stay; device setup time, average time rating AL and patient satisfaction. Bivariable comparisons were made using the Mann-Whitney test, the χ² test and Fisher's exact test. Analysis of quality was conducted using the Six Sigma methodology. There were no significant differences regarding AL (p=0.075), although not statistically significant; there was a reduction of postoperative chest X-rays (four vs five) and of hospital length of stay (6.5 vs 7.1 days); and a marginally significant difference was found between chest-tube removal days (p=0.056). There were significant differences regarding device setup time (p=0.001), average time rating AL (p=0.001), inter-observer variability (p=0.001) and patient satisfaction (p=0.002). Six Sigma analyses revealed accurate assessment of AL. Continuous digital measurement of AL reduces degree of variability of AL score, gives more assurance for tube removal, and reports AL without the apprehension of observer error. Efficiency and effectiveness improved with the use of a digital device. We have noted that the AL curves depict actually sealing of AL. The clinical importance of AL curves requires further study. Copyright © 2010 European Association for Cardio-Thoracic Surgery. Published by Elsevier B.V. All rights reserved.

Real money: complications and hospital costs in trauma patients.

PubMed

Hemmila, Mark R; Jakubus, Jill L; Maggio, Paul M; Wahl, Wendy L; Dimick, Justin B; Campbell, Darrell A; Taheri, Paul A

2008-08-01

Major postoperative complications are associated with a substantial increase in hospital costs. Trauma patients are known to have a higher rate of complications than the general surgery population. We used the National Surgical Quality Improvement Program (NSQIP) methodology to evaluate hospital costs, duration of stay, and payment associated with complications in trauma patients. Using NSQIP principles, patient data were collected for 512 adult patients admitted to the trauma service for > 24 hours at a Level 1 trauma center (2004-2005). Patients were placed in 1 of 3 groups: no complications (none), >or=1 minor complication (minor, eg, urinary tract infection), or >or=1 major complication (major, eg, pneumonia). Total hospital charges, costs, payment, and duration of stay associated with each complication group were determined from a cost-accounting database. Multiple regression was used to determine the costs of each type of complication after adjusting for differences in age, sex, new injury severity score, Glasgow coma scale score, maximum head abbreviated injury scale, and first emergency department systolic blood pressure. A total of 330 (64%) patients had no complications, 53 (10%) had >or= 1 minor complication, and 129 (25%) had >or= 1 major complication. Median hospital charges increased from $33,833 (none) to $81,936 (minor) and $150,885 (major). The mean contribution to margin per day was similar for the no complication and minor complication groups ($994 vs $1,115, P = .7). Despite higher costs, the patients in the major complication group generated a higher mean contribution to margin per day compared to the no complication group ($2,168, P < .001). The attributable increase in median total hospital costs when adjusted for confounding variables was $19,915 for the minor complication group (P < .001), and $40,555 for the major complication group (P < .001). Understanding the costs associated with traumatic injury provides a window for assessing the potential cost reductions associated with improved quality care. To optimize system benefits, payers and providers should develop integrated reimbursement methodologies that align incentives to provide quality care.

A quality assessment of randomized controlled trial reports in endodontics.

PubMed

Lucena, C; Souza, E M; Voinea, G C; Pulgar, R; Valderrama, M J; De-Deus, G

2017-03-01

To assess the quality of the randomized clinical trial (RCT) reports published in Endodontics between 1997 and 2012. Retrieval of RCTs in Endodontics was based on a search of the Thomson Reuters Web of Science (WoS) database (March 2013). Quality evaluation was performed using a checklist based on the Jadad criteria, CONSORT (Consolidated Standards of Reporting Trials) statement and SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials). Descriptive statistics were used for frequency distribution of data. Student's t-test and Welch test were used to identify the influence of certain trial characteristics upon report quality (α = 0.05). A total of 89 RCTs were evaluated, and several methodological flaws were found: only 45% had random sequence generation at low risk of bias, 75% did not provide information on allocation concealment, and 19% were nonblinded designs. Regarding statistics, only 55% of the RCTs performed adequate sample size estimations, only 16% presented confidence intervals, and 25% did not provide the exact P-value. Also, 2% of the articles used no statistical tests, and in 87% of the RCTs, the information provided was insufficient to determine whether the statistical methodology applied was appropriate or not. Significantly higher scores were observed for multicentre trials (P = 0.023), RCTs signed by more than 5 authors (P = 0.03), articles belonging to journals ranked above the JCR median (P = 0.03), and articles complying with the CONSORT guidelines (P = 0.000). The quality of RCT reports in key areas for internal validity of the study was poor. Several measures, such as compliance with the CONSORT guidelines, are important in order to raise the quality of RCTs in Endodontics. © 2016 International Endodontic Journal. Published by John Wiley & Sons Ltd.

Methodological quality of diagnostic accuracy studies on non-invasive coronary CT angiography: influence of QUADAS (Quality Assessment of Diagnostic Accuracy Studies included in systematic reviews) items on sensitivity and specificity.

PubMed

Schueler, Sabine; Walther, Stefan; Schuetz, Georg M; Schlattmann, Peter; Dewey, Marc

2013-06-01

To evaluate the methodological quality of diagnostic accuracy studies on coronary computed tomography (CT) angiography using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies included in systematic reviews) tool. Each QUADAS item was individually defined to adapt it to the special requirements of studies on coronary CT angiography. Two independent investigators analysed 118 studies using 12 QUADAS items. Meta-regression and pooled analyses were performed to identify possible effects of methodological quality items on estimates of diagnostic accuracy. The overall methodological quality of coronary CT studies was merely moderate. They fulfilled a median of 7.5 out of 12 items. Only 9 of the 118 studies fulfilled more than 75 % of possible QUADAS items. One QUADAS item ("Uninterpretable Results") showed a significant influence (P = 0.02) on estimates of diagnostic accuracy with "no fulfilment" increasing specificity from 86 to 90 %. Furthermore, pooled analysis revealed that each QUADAS item that is not fulfilled has the potential to change estimates of diagnostic accuracy. The methodological quality of studies investigating the diagnostic accuracy of non-invasive coronary CT is only moderate and was found to affect the sensitivity and specificity. An improvement is highly desirable because good methodology is crucial for adequately assessing imaging technologies. • Good methodological quality is a basic requirement in diagnostic accuracy studies. • Most coronary CT angiography studies have only been of moderate design quality. • Weak methodological quality will affect the sensitivity and specificity. • No improvement in methodological quality was observed over time. • Authors should consider the QUADAS checklist when undertaking accuracy studies.

Can Chinese Herbal Medicine Adjunctive Therapy Improve Outcomes of Senile Vascular Dementia? Systematic Review with Meta-analysis of Clinical Trials.

PubMed

Zeng, Lingfeng; Zou, Yuanping; Kong, Lingshuo; Wang, Ningsheng; Wang, Qi; Wang, Lu; Cao, Ye; Wang, Kezhu; Chen, Yunbo; Mi, Suiqing; Zhao, Wei; Wu, Haitao; Cheng, Shuyi; Xu, Weihua; Liang, Weixiong

2015-12-01

Many publications have reported the growing application of complementary and alternative medicine, particularly the use of Chinese herbal medicine (CHM) in combination with routine pharmacotherapy (RP) for senile vascular dementia (SVD), but its efficacy remains largely unexplored. The purpose of this study is to evaluate the efficacy of CHM adjunctive therapy (CHMAT), which is CHM combined with RP, in the treatment of SVD. Publications in seven electronic databases were searched extensively, and 27 trials with a total of 1961 patients were included for analysis. Compared with RP alone, CHMAT significantly increased the effective rate [odds ratio (OR) 2.98, 95% confidence interval (CI) 2.30, 3.86]. In addition, CHMAT showed benefits in detailed subgroups of the Mini-Mental State Exam (MMSE) score from time of onset to 4 weeks (WMD 3.01, 95% CI 2.15, 3.87), 8 weeks (weighted mean difference (WMD) 2.30, 95% CI 1.28, 3.32), 12 weeks (WMD 2.93, 95% CI 2.17, 3.69), and 24 weeks (WMD 3.25, 95% CI 2.61, 3.88), and in the activity of daily living scale score from time of onset to 4 weeks (WMD -4.64, 95% CI -6.12, -3.17), 8 weeks (WMD -4.30, 95% CI -6.04, -2.56), 12 weeks (WMD -3.89, 95% CI -4.68, -3.09), and 24 weeks (WMD -4.04, 95% CI -6.51, -1.57). Moreover, CHMAT had positive effects on changes in the Hasegawa dementia scale, National Institutes of Health Stroke Scale, Clinical Dementia Rating, and Montreal Cognitive Assessment scores, as well as blood fat levels (total cholesterol, triglyceride, high-density lipoprotein cholesterol, low-density lipoprotein cholesterol, and apolipoprotein E), platelet aggregation rate (1-min platelet aggregation rate, 5-min platelet aggregation rate, and maximal platelet aggregation rate), and blood rheology (whole-blood viscosity and hematocrit). No serious or frequently occurring adverse effects were reported. Weaknesses of methodological quality in most trials were assessed using the Cochrane risk of bias tool, while the quality level of Grades of Recommendations Assessment Development and Evaluation (GRADE) evidence classification indicated 'very low'. This systematic review suggests that CHM as an adjunctive therapy can improve cognitive impairment and enhance immediate response and quality of life in SVD patients. However, because of limitations of methodological quality in the included studies, further research of rigorous design is needed. Copyright © 2015 John Wiley & Sons, Ltd.

Mindfulness: A systematic review of instruments to measure an emergent patientreported outcome (PRO)

PubMed Central

Park, Taehwan; Reilly-Spong, Maryanne

2013-01-01

Purpose Mindfulness has emerged as an important health concept based on evidence that mindfulness interventions reduce symptoms and improve health-related quality of life. The objectives of this study were to systematically assess and compare the properties of instruments to measure self-reported mindfulness. Methods Ovid Medline®, CINAHL®, and PsycINFO® were searched through May 2012, and articles were selected if their primary purpose was development or evaluation of the measurement properties (validity, reliability, responsiveness) of a self-report mindfulness scale. Two reviewers independently evaluated the methodological quality of the selected studies using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. Discrepancies were discussed with a third reviewer, and scored by consensus. Finally, a level of evidence approach was used to synthesize results and study quality. Results Our search strategy identified a total of 2,588 articles. Forty-six articles, reporting 79 unique studies, met inclusion criteria. Ten instruments quantifying mindfulness as a unidimensional scale (n=5) or as a set of 2 to 5 subscales (n=5) were reviewed. The Mindful Attention Awareness Scale (MAAS) was evaluated by the most studies (n=27), and had positive overall quality ratings for most of the psychometric properties reviewed. The Five Facet Mindfulness Questionnaire (FFMQ) received the highest possible rating (“consistent findings in multiple studies of good methodological quality”) for two properties, internal consistency and construct validation by hypothesis testing. However, none of the instruments had sufficient evidence of content validity. Comprehensiveness of construct coverage had not been assessed; qualitative methods to confirm understanding and relevance were absent. In addition, estimates of test-retest reliability, responsiveness, or measurement error to guide users in protocol development or interpretation of scores were lacking. Conclusions Current mindfulness scales have important conceptual differences, and none can be strongly recommended based solely on superior psychometric properties. Important limitations in the field are the absence of qualitative evaluations and accepted external referents to support construct validity. Investigators need to proceed cautiously before optimizing any mindfulness intervention based on the existing scales. PMID:23539467

The effectiveness of the problem-based learning teaching model for use in introductory Chinese undergraduate medical courses: a systematic review and meta-analysis.

PubMed

Zhang, Yanqi; Zhou, Liang; Liu, Xiaoyu; Liu, Ling; Wu, Yazhou; Zhao, Zengwei; Yi, Dali; Yi, Dong

2015-01-01

Although the problem-based learning (PBL) emerged in 1969 and was soon widely applied internationally, the rapid development in China only occurred in the last 10 years. This study aims to compare the effect of PBL and lecture-based learning (LBL) on student course examination results for introductory Chinese undergraduate medical courses. Randomized and nonrandomized controlled trial studies on PBL use in Chinese undergraduate medical education were retrieved through PubMed, the Excerpta Medica Database (EMBASE), Chinese National Knowledge Infrastructure (CNKI) and VIP China Science and Technology Journal Database (VIP-CSTJ) with publication dates from 1st January 1966 till 31 August 2014. The pass rate, excellence rate and examination scores of course examination were collected. Methodological quality was evaluated based on the modified Jadad scale. The I-square statistic and Chi-square test of heterogeneity were used to assess the statistical heterogeneity. Overall RRs or SMDs with their 95% CIs were calculated in meta-analysis. Meta-regression and subgroup meta-analyses were also performed based on comparators and other confounding factors. Funnel plots and Egger's tests were performed to assess degrees of publication bias. The meta-analysis included 31studies and 4,699 subjects. Fourteen studies were of high quality with modified Jadad scores of 4 to 6, and 17 studies were of low quality with scores of 1 to 3. Relative to the LBL model, the PBL model yielded higher course examination pass rates [RR = 1.09, 95%CI (1.03, 1.17)], excellence rates [RR = 1.66, 95%CI (1.33, 2.06)] and examination scores [SMD = 0.82, 95%CI (0.63, 1.01)]. The meta-regression results show that course type was the significant confounding factor that caused heterogeneity in the examination-score meta-analysis (t = 0.410, P<0.001). The examination score SMD in "laboratory course" subgroup [SMD = 2.01, 95% CI: (1.50, 2.52)] was higher than that in "theory course" subgroup [SMD = 0.72, 95% CI: (0.56, 0.89)]. PBL teaching model application in introductory undergraduate medical courses can increase course examination excellence rates and scores in Chinese medical education system. It is more effective when applied to laboratory courses than to theory-based courses.

The Effectiveness of the Problem-Based Learning Teaching Model for Use in Introductory Chinese Undergraduate Medical Courses: A Systematic Review and Meta-Analysis

PubMed Central

Zhang, Yanqi; Zhou, Liang; Liu, Xiaoyu; Liu, Ling; Wu, Yazhou; Zhao, Zengwei; Yi, Dali; Yi, Dong

2015-01-01

Background Although the problem-based learning (PBL) emerged in 1969 and was soon widely applied internationally, the rapid development in China only occurred in the last 10 years. This study aims to compare the effect of PBL and lecture-based learning (LBL) on student course examination results for introductory Chinese undergraduate medical courses. Methods Randomized and nonrandomized controlled trial studies on PBL use in Chinese undergraduate medical education were retrieved through PubMed, the Excerpta Medica Database (EMBASE), Chinese National Knowledge Infrastructure (CNKI) and VIP China Science and Technology Journal Database (VIP-CSTJ) with publication dates from 1st January 1966 till 31 August 2014. The pass rate, excellence rate and examination scores of course examination were collected. Methodological quality was evaluated based on the modified Jadad scale. The I-square statistic and Chi-square test of heterogeneity were used to assess the statistical heterogeneity. Overall RRs or SMDs with their 95% CIs were calculated in meta-analysis. Meta-regression and subgroup meta-analyses were also performed based on comparators and other confounding factors. Funnel plots and Egger’s tests were performed to assess degrees of publication bias. Results The meta-analysis included 31studies and 4,699 subjects. Fourteen studies were of high quality with modified Jadad scores of 4 to 6, and 17 studies were of low quality with scores of 1 to 3. Relative to the LBL model, the PBL model yielded higher course examination pass rates [RR = 1.09, 95%CI (1.03, 1.17)], excellence rates [RR = 1.66, 95%CI (1.33, 2.06)] and examination scores [SMD = 0.82, 95%CI (0.63, 1.01)]. The meta-regression results show that course type was the significant confounding factor that caused heterogeneity in the examination-score meta-analysis (t = 0.410, P<0.001). The examination score SMD in “laboratory course” subgroup [SMD = 2.01, 95% CI: (1.50, 2.52)] was higher than that in “theory course” subgroup [SMD = 0.72, 95% CI: (0.56, 0.89)]. Conclusions PBL teaching model application in introductory undergraduate medical courses can increase course examination excellence rates and scores in Chinese medical education system. It is more effective when applied to laboratory courses than to theory-based courses. PMID:25822653

Technical and scale efficiency in public and private Irish nursing homes - a bootstrap DEA approach.

PubMed

Ni Luasa, Shiovan; Dineen, Declan; Zieba, Marta

2016-10-27

This article provides methodological and empirical insights into the estimation of technical efficiency in the nursing home sector. Focusing on long-stay care and using primary data, we examine technical and scale efficiency in 39 public and 73 private Irish nursing homes by applying an input-oriented data envelopment analysis (DEA). We employ robust bootstrap methods to validate our nonparametric DEA scores and to integrate the effects of potential determinants in estimating the efficiencies. Both the homogenous and two-stage double bootstrap procedures are used to obtain confidence intervals for the bias-corrected DEA scores. Importantly, the application of the double bootstrap approach affords true DEA technical efficiency scores after adjusting for the effects of ownership, size, case-mix, and other determinants such as location, and quality. Based on our DEA results for variable returns to scale technology, the average technical efficiency score is 62 %, and the mean scale efficiency is 88 %, with nearly all units operating on the increasing returns to scale part of the production frontier. Moreover, based on the double bootstrap results, Irish nursing homes are less technically efficient, and more scale efficient than the conventional DEA estimates suggest. Regarding the efficiency determinants, in terms of ownership, we find that private facilities are less efficient than the public units. Furthermore, the size of the nursing home has a positive effect, and this reinforces our finding that Irish homes produce at increasing returns to scale. Also, notably, we find that a tendency towards quality improvements can lead to poorer technical efficiency performance.

Non-cancer health effects of pesticides

PubMed Central

Sanborn, M.; Kerr, K.J.; Sanin, L.H.; Cole, D.C.; Bassil, K.L.; Vakil, C.

2007-01-01

OBJECTIVE To investigate whether there are associations between exposure to pesticides and 4 chronic non-cancer health effects: dermatologic, neurologic, reproductive, and genotoxic effects. DATA SOURCES We searched PreMedline, MEDLINE, and LILACS using the key word pesticide combined with the term for the specific health effect being searched. Reviewers scanned the references of all articles for additional relevant studies. STUDY SELECTION Studies since 1992 were assessed using structured inclusion and quality-of-methods criteria. Studies scoring <4 on a 7-point global methodologic quality scale were excluded. In total, 124 studies were included. These studies had a mean quality score of 4.88 out of 7. SYNTHESIS Strong evidence of association with pesticide exposure was found for all neurologic outcomes, genotoxicity, and 4 of 6 reproductive effects: birth defects, fetal death, altered growth, and other outcomes. Exposure to pesticides generally doubled the level of genetic damage as measured by chromosome aberrations in lymphocytes. Only a few high-quality studies focused on the dermatologic effects of pesticides. In some of these studies, rates of dermatitis were higher among those who had had high exposure to pesticides on the job. CONCLUSION Evidence from research on humans consistently points to positive associations between pesticide exposure and 3 of the 4 non-cancer health outcomes studied. Physicians have a dual role in educating individual patients about the risks of exposure and in reducing exposure in the community by advocating for restrictions on use of pesticides. PMID:17934035

Quality of care in European home care programs using the second generation interRAI Home Care Quality Indicators (HCQIs).

PubMed

Foebel, Andrea D; van Hout, Hein P; van der Roest, Henriëtte G; Topinkova, Eva; Garms-Homolova, Vjenka; Frijters, Dinnus; Finne-Soveri, Harriet; Jónsson, Pálmi V; Hirdes, John P; Bernabei, Roberto; Onder, Graziano

2015-11-14

Evaluating the quality of care provided to older individuals is a key step to ensure that needs are being met and to target interventions to improve care. To this aim, interRAI's second-generation home care quality indicators (HCQIs) were developed in 2013. This study assesses the quality of home care services in six European countries using these HCQIs as well as the two derived summary scales. Data for this study were derived from the Aged in Home Care (AdHOC) study - a cohort study that examined different models of community care in European countries. The current study selected a sub-sample of the AdHOC cohort from six countries whose follow-up data were complete (Czech Republic, Denmark, Finland, Germany, Italy and the Netherlands). Data were collected from the interRAI Home Care instrument (RAI-HC) between 2000 and 2002. The 23 HCQIs of interest were determined according to previously established methodology, including risk adjustment. Two summary measures, the Clinical Balance Scale and Independence Quality Scale were also determined using established methodology. A total of 1,354 individuals from the AdHOC study were included in these analyses. Of the 23 HCQIs that were measured, the highest proportion of individuals experienced declines in Instrumental Activities of Daily Living (IADLs) (48.4 %). Of the clinical quality indicators, mood decline was the most prevalent (30.0 %), while no flu vaccination and being alone and distressed were the most prevalent procedural and social quality indicators, respectively (33.4 and 12.8 %). Scores on the two summary scales varied by country, but were concentrated around the median mark. The interRAI HCQIs can be used to determine the quality of home care services in Europe and identify areas for improvement. Our results suggest functional declines may prove the most beneficial targets for interventions.

Psychological, pharmacological, and combined smoking cessation interventions for smokers with current depression: A systematic review and meta-analysis.

PubMed

Secades-Villa, Roberto; González-Roz, Alba; García-Pérez, Ángel; Becoña, Elisardo

2017-01-01

We conducted a systematic literature review and meta-analysis (ID: CRD42016051017) of smoking cessation interventions for patients with current depression. We examined the effectiveness of smoking cessation treatments in improving abstinence rates and depressive symptoms. The following electronic databases were used for potentially eligible studies: PUBMED, PSYCINFO, DIALNET and WEB OF KNOWLEDGE. The search terms used were: smoking cessation, depressive disorder, depression, mood, depressive, depressed, smoking, smokers, nicotine, nicotine dependence, and tobacco cigarette smoking. The methodological quality of included studies was assessed using the Effective Public Health Practice Project Quality assessment tool (EPHPP). Of the 6,584 studies identified, 20 were eligible and included in the review. Trial designs of studies were 16 randomized controlled trials and 4 secondary studies. Studies included three types of intervention: psychological (6/30%), pharmacological (6/30%) or combined (8/40%). Four trials comprised special populations of smokers. Four studies received a strong methodological quality, 7 were scored as moderate and 9 studies received a weak methodological rating. Analyses of effectiveness showed that smoking cessation interventions appear to increase short-term and long-term smoking abstinence in individuals with current depression. Subgroup analyses revealed stronger effects among studies that provided pharmacological treatments than in studies using psychological treatments. However, the evidence is weak due to the small number of studies. Smoking abstinence appears to be associated with an improvement in depressive symptoms. Heterogeneity in protocols in similar types of treatment also prevent firm conclusions being drawn on the effectiveness of any particular treatment model to optimally manage abstinence among depressed smokers. Further research is required to strengthen the evidence base.

Psychological, pharmacological, and combined smoking cessation interventions for smokers with current depression: A systematic review and meta-analysis

PubMed Central

González-Roz, Alba; García-Pérez, Ángel; Becoña, Elisardo

2017-01-01

We conducted a systematic literature review and meta-analysis (ID: CRD42016051017) of smoking cessation interventions for patients with current depression. We examined the effectiveness of smoking cessation treatments in improving abstinence rates and depressive symptoms. The following electronic databases were used for potentially eligible studies: PUBMED, PSYCINFO, DIALNET and WEB OF KNOWLEDGE. The search terms used were: smoking cessation, depressive disorder, depression, mood, depressive, depressed, smoking, smokers, nicotine, nicotine dependence, and tobacco cigarette smoking. The methodological quality of included studies was assessed using the Effective Public Health Practice Project Quality assessment tool (EPHPP). Of the 6,584 studies identified, 20 were eligible and included in the review. Trial designs of studies were 16 randomized controlled trials and 4 secondary studies. Studies included three types of intervention: psychological (6/30%), pharmacological (6/30%) or combined (8/40%). Four trials comprised special populations of smokers. Four studies received a strong methodological quality, 7 were scored as moderate and 9 studies received a weak methodological rating. Analyses of effectiveness showed that smoking cessation interventions appear to increase short-term and long-term smoking abstinence in individuals with current depression. Subgroup analyses revealed stronger effects among studies that provided pharmacological treatments than in studies using psychological treatments. However, the evidence is weak due to the small number of studies. Smoking abstinence appears to be associated with an improvement in depressive symptoms. Heterogeneity in protocols in similar types of treatment also prevent firm conclusions being drawn on the effectiveness of any particular treatment model to optimally manage abstinence among depressed smokers. Further research is required to strengthen the evidence base. PMID:29206852

A systematic review of physical therapy interventions for patients with anorexia and bulemia nervosa.

PubMed

Vancampfort, Davy; Vanderlinden, Johan; De Hert, Marc; Soundy, Andrew; Adámkova, Milena; Skjaerven, Liv Helvik; Catalán-Matamoros, Daniel; Lundvik Gyllensten, Amanda; Gómez-Conesa, Antonia; Probst, Michel

2014-01-01

The purpose of this systematic review was to summarise the evidence from randomised controlled trials examining the effectiveness of physical therapy compared with care as usual or a wait-list condition on eating pathology and on physiological and psychological parameters in patients with anorexia and bulimia nervosa. EMBASE, PsycINFO, PubMed, Cumulative Index to Nursing and Allied Health Literature, Physiotherapy Evidence Database and The Cochrane Library were searched from their inception until February, 2013. Articles were eligible if they utilised a randomised controlled trial design, compared physical therapy with a placebo condition, control intervention, or standard care and included patients with anorexia and bulimia nervosa. The methodological quality was assessed with the Jadad scale. Eight randomised controlled trials involving 213 patients (age range: 16-36 years) met all selection criteria. Three of the 8 included studies were of strong methodological quality (Jadad score≥3). Major methodological weaknesses were attrition and selection bias. The main results demonstrate that aerobic and resistance training result in significantly increased muscle strength, body mass index and body fat percentage in anorexia patients. In addition, aerobic exercise, yoga, massage and basic body awareness therapy significantly lowered scores of eating pathology and depressive symptoms in both anorexia and bulimia nervosa patients. No adverse effects were reported. The paucity and heterogeneity of available studies limits overall conclusions and highlights the need for further research. Implications for Rehabilitation Supervised physical therapy might increase weight in anorexia nervosa patients. Aerobic exercise, massage, basic body awareness therapy and yoga might reduce eating pathology in patients with anorexia and bulimia nervosa. Aerobic exercise, yoga and basic body awareness therapy might improve mental and physical quality of life in patients with an eating disorder.

Developing a Validity Argument through Abductive Reasoning with an Empirical Demonstration of the Latent Class Analysis

ERIC Educational Resources Information Center

Wu, Amery D.; Stone, Jake E.; Liu, Yan

2016-01-01

This article proposes and demonstrates a methodology for test score validation through abductive reasoning. It describes how abductive reasoning can be utilized in support of the claims made about test score validity. This methodology is demonstrated with a real data example of the Canadian English Language Proficiency Index Program…

Statins and tendinopathy: a systematic review.

PubMed

Teichtahl, Andrew J; Brady, Sharmayne R E; Urquhart, Donna M; Wluka, Anita E; Wang, Yuanyuan; Shaw, Jonathan E; Cicuttini, Flavia M

2016-02-15

To systematically review the evidence on whether statin therapy, commonly used in clinical practice to treat hypercholesterolaemia for primary and secondary prevention of cardiovascular disease, contributes to tendinopathy; and to examine causality according to the Bradford Hill criteria. A systematic review of studies examining the relationship between statin therapy and tendinopathy. Included studies were rated based on their methodological quality. A best evidence synthesis was used to summarise the results, and Bradford Hill criteria were used to assess causation. Ovid MEDLINE, CINAHL Plus, PubMed and Embase databases. We included adult human studies published in the English language between January 1966 and October 2015. Study designs eligible for inclusion were randomised controlled trials and cross-sectional, cohort or case-control studies. Four studies (three cohort studies and one case-control study) were included, with a mean methodological quality score of 67%. Three studies were deemed high quality. Tendon rupture was the primary outcome in three studies, and rotator cuff disease in the other. All studies found no positive association between statin therapy and tendon rupture for the total study population. There was evidence that simvastatin reduces the risk of tendinopathy. To date, there is a paucity of evidence to implicate statin therapy as a well established risk factor or causal mechanism for tendon rupture in the general population. There is strong evidence that simvastatin reduces the risk of tendinopathy.

Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity.

PubMed

Hawkins, Melanie; Elsworth, Gerald R; Osborne, Richard H

2018-07-01

Data from subjective patient-reported outcome measures (PROMs) are now being used in the health sector to make or support decisions about individuals, groups and populations. Contemporary validity theorists define validity not as a statistical property of the test but as the extent to which empirical evidence supports the interpretation of test scores for an intended use. However, validity testing theory and methodology are rarely evident in the PROM validation literature. Application of this theory and methodology would provide structure for comprehensive validation planning to support improved PROM development and sound arguments for the validity of PROM score interpretation and use in each new context. This paper proposes the application of contemporary validity theory and methodology to PROM validity testing. The validity testing principles will be applied to a hypothetical case study with a focus on the interpretation and use of scores from a translated PROM that measures health literacy (the Health Literacy Questionnaire or HLQ). Although robust psychometric properties of a PROM are a pre-condition to its use, a PROM's validity lies in the sound argument that a network of empirical evidence supports the intended interpretation and use of PROM scores for decision making in a particular context. The health sector is yet to apply contemporary theory and methodology to PROM development and validation. The theoretical and methodological processes in this paper are offered as an advancement of the theory and practice of PROM validity testing in the health sector.

Simulation teaching method in Engineering Optics

NASA Astrophysics Data System (ADS)

Lu, Qieni; Wang, Yi; Li, Hongbin

2017-08-01

We here introduce a pedagogical method of theoretical simulation as one major means of the teaching process of "Engineering Optics" in course quality improvement action plan (Qc) in our school. Students, in groups of three to five, complete simulations of interference, diffraction, electromagnetism and polarization of light; each student is evaluated and scored in light of his performance in the interviews between the teacher and the student, and each student can opt to be interviewed many times until he is satisfied with his score and learning. After three years of Qc practice, the remarkable teaching and learning effect is obatined. Such theoretical simulation experiment is a very valuable teaching method worthwhile for physical optics which is highly theoretical and abstruse. This teaching methodology works well in training students as to how to ask questions and how to solve problems, which can also stimulate their interest in research learning and their initiative to develop their self-confidence and sense of innovation.

BIOREL: the benchmark resource to estimate the relevance of the gene networks.

PubMed

Antonov, Alexey V; Mewes, Hans W

2006-02-06

The progress of high-throughput methodologies in functional genomics has lead to the development of statistical procedures to infer gene networks from various types of high-throughput data. However, due to the lack of common standards, the biological significance of the results of the different studies is hard to compare. To overcome this problem we propose a benchmark procedure and have developed a web resource (BIOREL), which is useful for estimating the biological relevance of any genetic network by integrating different sources of biological information. The associations of each gene from the network are classified as biologically relevant or not. The proportion of genes in the network classified as "relevant" is used as the overall network relevance score. Employing synthetic data we demonstrated that such a score ranks the networks fairly in respect to the relevance level. Using BIOREL as the benchmark resource we compared the quality of experimental and theoretically predicted protein interaction data.

Effects of Physical Activity on Cancer Survival: A Systematic Review

PubMed Central

Barbaric, Mary; Brooks, Eleanor; Moore, Lisa

2010-01-01

ABSTRACT Purpose: Physical activity (PA) has been suggested to help increase the survival of individuals with cancer. The objective of this review was to systematically evaluate and summarize the available evidence investigating the effect of PA on the survival of individuals with cancer. Methods: Electronic databases (CINAHL, EMBASE, and MEDLINE) were systematically searched for randomized controlled trials and cohort studies. Selected studies were assessed by two independent investigators for methodological quality, using the PEDro scale. Results: Ten prospective cohort studies met the inclusion criteria. Quality-assessment scores averaged 5/10 on the PEDro scale, with two articles obtaining a score of 6/10. The majority of studies found that individuals participating in higher levels of physical activity had a reduced risk of cancer-related mortality. This trend was observed specifically for breast, colon, and colorectal cancers. On average, it appears that engaging in higher levels of metabolic equivalent hours per week may help to improve survival rates among individuals diagnosed with cancer. Conclusion: Patients diagnosed with cancer demonstrated a trend toward increased survival with greater levels of PA. However, because only prospective cohort studies were included in the study, the conclusions drawn should be regarded with caution. PMID:21197176

Does robot-assisted gait rehabilitation improve balance in stroke patients? A systematic review.

PubMed

Swinnen, Eva; Beckwée, David; Meeusen, Romain; Baeyens, Jean-Pierre; Kerckhofs, Eric

2014-01-01

The aim of this systematic review was to summarize the improvements in balance after robot-assisted gait training (RAGT) in stroke patients. Two databases were searched: PubMed and Web of Knowledge. The most important key words are "stroke," "RAGT," "balance," "Lokomat," and "gait trainer." Studies were included if stroke patients were involved in RAGT protocols, and balance was determined as an outcome measurement. The articles were checked for methodological quality by 2 reviewers (Cohen's κ = 0.72). Nine studies were included (7 true experimental and 2 pre-experimental studies; methodological quality score, 56%-81%). In total, 229 subacute or chronic stroke patients (70.5% male) were involved in RAGT (3 to 5 times per week, 3 to 10 weeks, 12 to 25 sessions). In 5 studies, the gait trainer was used; in 2, the Lokomat was used; in 1 study, a single-joint wearable knee orthosis was used; and in 1 study, the AutoAmbulator was used. Eight studies compared RAGT with other gait rehabilitation methods. Significant improvements (no to large effect sizes, Cohen's d = 0.01 to 3.01) in balance scores measured with the Berg Balance Scale, the Tinetti test, postural sway tests, and the Timed Up and Go test were found after RAGT. No significant differences in balance between the intervention and control groups were reported. RAGT can lead to improvements in balance in stroke patients; however, it is not clear whether the improvements are greater compared with those associated with other gait rehabilitation methods. Because a limited number of studies are available, more specific research (eg, randomized controlled trials with larger, specific populations) is necessary to draw stronger conclusions.

Plant extracts for the topical management of psoriasis: a systematic review and meta-analysis.

PubMed

Deng, S; May, B H; Zhang, A L; Lu, C; Xue, C C L

2013-10-01

Patients with psoriasis frequently use preparations of plant extracts. Physicians need to be aware of the current evidence concerning these products. This review evaluates the efficacy and safety of preparations of plant extracts used topically for psoriasis. Searches were conducted in PubMed, Embase, the Cochrane library, two Chinese databases and article reference lists. Randomized controlled trials investigating extracts of single plants were included. Preparations of multiple plants and combinations of plant extracts plus conventional therapies were excluded. Two authors conducted searches, extracted data and assessed risk of bias. Outcomes used in meta-analyses were: clinical efficacy, Psoriasis Area and Severity Index score, and quality of life and symptom scores. The 12 included studies investigated extracts of: Mahonia aquifolium (n = 5), Aloe vera (n = 3), indigo naturalis (n = 2), kukui nut oil (n = 1) and Camptotheca acuminata nut (n = 1). Methodological quality was variable. Six studies provided data suitable for meta-analysis of clinical efficacy, and five were vs. placebo (relative risk 3·37, 95% confidence interval 1·36-8·33). Experimental studies indicate components of indigo naturalis, Mahonia and Camptotheca have anti-inflammatory, antiproliferative and other actions of relevance to psoriasis. The clinical trial evidence provides limited support for preparations containing extracts of M. aquifolium, indigo naturalis and Aloe vera for the topical management of plaque psoriasis based on multiple studies. No serious adverse events were reported. Because of the small size of most studies and methodological weaknesses, strong conclusions cannot be made. The magnitudes of any effects cannot be measured with accuracy, so it is difficult to assess the clinical relevance of these preparations. © 2013 British Association of Dermatologists.

Ginkgo Biloba for Mild Cognitive Impairment and Alzheimer's Disease: A Systematic Review and Meta-Analysis of Randomized Controlled Trials.

PubMed

Yang, Guoyan; Wang, Yuyi; Sun, Jin; Zhang, Kang; Liu, Jianping

2016-01-01

Ginkgo biloba is a natural medicine used for cognitive impairment and Alzheimer's disease. The objective of this review is to explore the effectiveness and safety of Ginkgo biloba in treating mild cognitive impairment and Alzheimer's disease. Electronic search was conducted from PubMed, Cochrane Library, and four major Chinese databases from their inception up to 1(st) December, 2014 for randomized clinical trials on Ginkgo biloba in treating mild cognitive impairment or Alzheimer's disease. Meta-analyses were performed by RevMan 5.2 software. 21 trials with 2608 patients met the inclusion criteria. The general methodological quality of included trials was moderate to poor. Compared with conventional medicine alone, Ginkgo biboba in combination with conventional medicine was superior in improving Mini-Mental State Examination (MMSE) scores at 24 weeks for patients with Alzheimer's disease (MD 2.39, 95% CI 1.28 to 3.50, P<0.0001) and mild cognitive impairment (MD 1.90, 95% CI 1.41 to 2.39, P<0.00001), and Activity of Daily Living (ADL) scores at 24 weeks for Alzheimer's disease (MD -3.72, 95% CI -5.68 to -1.76, P=0.0002). When compared with placebo or conventional medicine in individual trials, Ginkgo biboba demonstrated similar but inconsistent findings. Adverse events were mild. Ginkgo biloba is potentially beneficial for the improvement of cognitive function, activities of daily living, and global clinical assessment in patients with mild cognitive impairment or Alzheimer's disease. However, due to limited sample size, inconsistent findings and methodological quality of included trials, more research are warranted to confirm the effectiveness and safety of ginkgo biloba in treating mild cognitive impairment and Alzheimer's disease.

A systematic review of job-specific workers' health surveillance activities for fire-fighting, ambulance, police and military personnel.

PubMed

Plat, M J; Frings-Dresen, M H W; Sluiter, J K

2011-12-01

Some occupations have tasks and activities that require monitoring safety and health aspects of the job; examples of such occupations are emergency services personnel and military personnel. The two objectives of this systematic review were to describe (1) the existing job-specific workers' health surveillance (WHS) activities and (2) the effectiveness of job-specific WHS interventions with respect to work functioning, for selected jobs. The search strategy systematically searched the PubMed, PsycINFO and OSH-update databases. The search strategy consisted of several synonyms of the job titles of interest, combined with synonyms for workers' health surveillance. The methodological quality was checked. At least one study was found for each of the following occupations fire fighters, ambulance personnel, police personnel and military personnel. For the first objective, 24 studies described several job-specific WHS activities aimed at aspects of psychological, 'physical' (energetic, biomechanical and balance), sense-related, environmental exposure or cardiovascular requirements. The seven studies found for the second objective measured different outcomes related to work functioning. The methodological quality of the interventions varied, but with the exception of one study, all scored over 55% of the maximum score. Six studies showed effectiveness on at least some of the defined outcomes. The studies described several job-specific interventions: a trauma resilience training, healthy lifestyle promotion, physical readiness training, respiratory muscle training, endurance and resistance training, a physical exercise programme and comparing vaccines. Several examples of job-specific WHS activities were found for the four occupations. Compared to studies focusing on physical tasks, a few studies were found that focus on psychological tasks. Effectiveness studies for job-specific WHS interventions were scarce, although their results were promising. We recommend studying job-specific WHS in effectiveness studies.

Measuring geographical accessibility to rural and remote health care services: Challenges and considerations.

PubMed

Shah, Tayyab Ikram; Milosavljevic, Stephan; Bath, Brenna

2017-06-01

This research is focused on methodological challenges and considerations associated with the estimation of the geographical aspects of access to healthcare with a focus on rural and remote areas. With the assumption that GIS-based accessibility measures for rural healthcare services will vary across geographic units of analysis and estimation techniques, which could influence the interpretation of spatial access to rural healthcare services. Estimations of geographical accessibility depend on variations of the following three parameters: 1) quality of input data; 2) accessibility method; and 3) geographical area. This research investigated the spatial distributions of physiotherapists (PTs) in comparison to family physicians (FPs) across Saskatchewan, Canada. The three-steps floating catchment areas (3SFCA) method was applied to calculate the accessibility scores for both PT and FP services at two different geographical units. A comparison of accessibility scores to simple healthcare provider-to-population ratios was also calculated. The results vary considerably depending on the accessibility methods used and the choice of geographical area unit for measuring geographical accessibility for both FP and PT services. These findings raise intriguing questions regarding the nature and extent of technical issues and methodological considerations that can affect GIS-based measures in health services research and planning. This study demonstrates how the selection of geographical areal units and different methods for measuring geographical accessibility could affect the distribution of healthcare resources in rural areas. These methodological issues have implications for determining where there is reduced access that will ultimately impact health human resource priorities and policies. Copyright © 2017 Elsevier Ltd. All rights reserved.

Potential Pitfalls of Reporting and Bias in Observational Studies With Propensity Score Analysis Assessing a Surgical Procedure: A Methodological Systematic Review.

PubMed

Lonjon, Guillaume; Porcher, Raphael; Ergina, Patrick; Fouet, Mathilde; Boutron, Isabelle

2017-05-01

To describe the evolution of the use and reporting of propensity score (PS) analysis in observational studies assessing a surgical procedure. Assessing surgery in randomized controlled trials raises several challenges. Observational studies with PS analysis are a robust alternative for comparative effectiveness research. In this methodological systematic review, we identified all PubMed reports of observational studies with PS analysis that evaluated a surgical procedure and described the evolution of their use over time. Then, we selected a sample of articles published from August 2013 to July 2014 and systematically appraised the quality of reporting and potential bias of the PS analysis used. We selected 652 reports of observational studies with PS analysis. The publications increased over time, from 1 report in 1987 to 198 in 2013. Among the 129 reports assessed, 20% (n = 24) did not detail the covariates included in the PS and 77% (n = 100) did not report a justification for including these covariates in the PS. The rate of missing data for potential covariates was reported in 9% of articles. When a crossover by conversion was possible, only 14% of reports (n = 12) mentioned this issue. For matched analysis, 10% of articles reported all 4 key elements that allow for reproducibility of a PS-matched analysis (matching ratio, method to choose the nearest neighbors, replacement and method for statistical analysis). Observational studies with PS analysis in surgery are increasing in frequency, but specific methodological issues and weaknesses in reporting exist.

Using the Simulated Patient Methodology to Assess Paracetamol-Related Counselling for Headache

PubMed Central

Horvat, Nejc; Koder, Marko; Kos, Mitja

2012-01-01

Objectives Firstly, to assess paracetamol-related counselling. Secondly, to evaluate the patient’s approach as a determinant of counselling and to test the acceptability of the simulated patient method in Slovenian pharmacies. Methods The simulated patient methodology was used in 17 community pharmacies. Three scenarios related to self-medication for headaches were developed and used in all participating pharmacies. Two scenarios were direct product requests: scenario 1: a patient with an uncomplicated short-term headache; scenario 2: a patient with a severe, long-duration headache who takes paracetamol for too long and concurrently drinks alcohol. Scenario 3 was a symptom-based request: a patient asking for medicine for a headache. Pharmacy visits were audio recorded and scored according to predetermined criteria arranged in two categories: counselling content and manner of counselling. The acceptability of the methodology used was evaluated by surveying the participating pharmacists. Results The symptom-based request was scored significantly better (a mean 2.17 out of a possible 4 points) than the direct product requests (means of 1.64 and 0.67 out of a possible 4 points for scenario 1 and 2, respectively). The most common information provided was dosage and adverse effects. Only the symptom-based request stimulated spontaneous counselling. No statistically significant differences in the duration of the consultation between the scenarios were found. There were also no significant differences in the quality of counselling between the Masters of Pharmacy and Pharmacy Technicians. The acceptability of the SP method was not as high as in other countries. Conclusion The assessment of paracetamol-related counselling demonstrates room for practice improvement. PMID:23300691

Memory and selective attention in multiple sclerosis: cross-sectional computer-based assessment in a large outpatient sample.

PubMed

Adler, Georg; Lembach, Yvonne

2015-08-01

Cognitive impairments may have a severe impact on everyday functioning and quality of life of patients with multiple sclerosis (MS). However, there are some methodological problems in the assessment and only a few studies allow a representative estimate of the prevalence and severity of cognitive impairments in MS patients. We applied a computer-based method, the memory and attention test (MAT), in 531 outpatients with MS, who were assessed at nine neurological practices or specialized outpatient clinics. The findings were compared with those obtained in an age-, sex- and education-matched control group of 84 healthy subjects. Episodic short-term memory was substantially decreased in the MS patients. About 20% of them reached a score of only less than two standard deviations below the mean of the control group. The episodic short-term memory score was negatively correlated with the EDSS score. Minor but also significant impairments in the MS patients were found for verbal short-term memory, episodic working memory and selective attention. The computer-based MAT was found to be useful for a routine assessment of cognition in MS outpatients.

Objective assessment of MPEG-2 video quality

NASA Astrophysics Data System (ADS)

Gastaldo, Paolo; Zunino, Rodolfo; Rovetta, Stefano

2002-07-01

The increasing use of video compression standards in broadcasting television systems has required, in recent years, the development of video quality measurements that take into account artifacts specifically caused by digital compression techniques. In this paper we present a methodology for the objective quality assessment of MPEG video streams by using circular back-propagation feedforward neural networks. Mapping neural networks can render nonlinear relationships between objective features and subjective judgments, thus avoiding any simplifying assumption on the complexity of the model. The neural network processes an instantaneous set of input values, and yields an associated estimate of perceived quality. Therefore, the neural-network approach turns objective quality assessment into adaptive modeling of subjective perception. The objective features used for the estimate are chosen according to the assessed relevance to perceived quality and are continuously extracted in real time from compressed video streams. The overall system mimics perception but does not require any analytical model of the underlying physical phenomenon. The capability to process compressed video streams represents an important advantage over existing approaches, like avoiding the stream-decoding process greatly enhances real-time performance. Experimental results confirm that the system provides satisfactory, continuous-time approximations for actual scoring curves concerning real test videos.

Service quality, patient satisfaction and loyalty in the Bangladesh healthcare sector.

PubMed

Ahmed, Selim; Tarique, Kazi Md; Arif, Ishtiaque

2017-06-12

Purpose The purpose of this paper is to investigate service quality, patient satisfaction and loyalty in Bangladesh's healthcare sector. It identifies healthcare quality conformance, patient satisfaction and loyalty based on demographics such as gender, age and marital status. It examines the differences between public and private healthcare sectors regarding service quality, patient satisfaction and loyalty. Design/methodology/approach The authors distributed 450 self-administered questionnaires to hospital patients resulting in 204 useful responses (45.3 per cent response rate). Data were analysed based on reliability analysis, exploratory factor analysis, independent samples t-tests, ANOVA and discriminant analysis using SPSS version 23. Findings Findings indicate that single patients perceive tangibles, reliability, empathy and loyalty higher compared to married patients. Young patients (⩽20 years) have a higher tangibles, empathy and loyalty scores compared to other age groups. The authors observed that private hospital patients perceive healthcare service quality performance higher compared to patients in public hospitals. Research limitations/implications The authors focussed solely on the Bangladesh health sector, so the results might not be applicable to other countries. Originality/value The findings provide guidelines for enhancing service quality, patient satisfaction and loyalty in the Bangladesh healthcare sector and other countries.

Owner perceptions of their cat's quality of life when treated with a modified University of Wisconsin-Madison protocol for lymphoma.

PubMed

Thornton, Laura A; Cave, Nicholas; Bridges, Janis P; Stell, Anneliese J

2018-04-01

Objectives The objectives of this study were to assess owner perceptions of their cat's quality of life during treatment for lymphoma with a doxorubicin-containing multi-agent chemotherapy protocol, whether various health-related parameters correlated with quality of life scores, and to assess owner satisfaction with the protocol. Methods A postal questionnaire was sent to the owners of 33 treated cats. Owners retrospectively assessed their cat's quality of life using a Likert scale (1-10) before lymphoma was diagnosed, at diagnosis and during chemotherapy. Owners assigned scores to various health-related parameters previously reported to affect quality of life at the three time points, and correlations with quality of life scores were sought. Owners were asked to rate the importance of these health-related parameters. Satisfaction with the protocol was investigated. Results Twenty questionnaires were completed (61% response rate). The median quality of life score before diagnosis (10, range 5-10) was higher than at diagnosis (3, range 1-9) ( P <0.05). The median quality of life score during chemotherapy (7, range 3-9) was lower than before diagnosis ( P <0.05) and higher than at diagnosis, but this was not statistically significant. Quality of life scores did not correlate with individual health-related parameter scores consistently; however, quality of life scores did correlate with appetite scores during chemotherapy. Appetite, vomiting and diarrhoea were parameters perceived as important in affecting quality of life. Most owners (75%) were happy they had treated their cat. Conclusions and relevance The quality of life scores observed were comparable to a previous study using cyclophosphamide, vincristine and prednisolone, employing the same scoring system. Although quality of life scores during chemotherapy were not significantly improved at diagnosis, owner satisfaction with the protocol was high. The factors perceived by owners to determine quality of life in their pets may be different to those previously conjectured, but appetite during chemotherapy remains important.

A systematic review of evidence for the effectiveness of practitioner-based complementary and alternative therapies in the management of rheumatic diseases: osteoarthritis.

PubMed

Macfarlane, Gary J; Paudyal, Priya; Doherty, Michael; Ernst, Edzard; Lewith, George; MacPherson, Hugh; Sim, Julius; Jones, Gareth T

2012-12-01

To critically review the evidence on the efficacy and effectiveness of practitioner-based complementary therapies for patients with osteoarthritis. We excluded t'ai chi and acupuncture, which have been the subject of recent reviews. Randomized controlled trials, published in English up to May 2011, were identified using systematic searches of bibliographic databases and searching of reference lists. Information was extracted on outcomes, statistical significance in comparison with alternative treatments and reported side effects. The methodological quality of the identified studies was determined using the Jadad scoring system. Outcomes considered were pain and patient global assessment. In all, 16 eligible trials were identified covering 12 therapies. Overall, there was no good evidence of the effectiveness of any of the therapies in relation to pain or global health improvement/quality of life because most therapies only had a single randomized controlled trial. Where positive results were reported, they were often comparing an active intervention with no intervention. Therapies with multiple trials either provided null (biofeedback) or inconsistent results (magnet therapy), or the trials available scored poorly for quality (chiropractic). There were few adverse events reported in the trials. There is not sufficient evidence to recommend any of the practitioner-based complementary therapies considered here for the management of OA, but neither is there sufficient evidence to conclude that they are not effective or efficacious.

Two Approaches to Estimating the Effect of Parenting on the Development of Executive Function in Early Childhood

PubMed Central

Blair, Clancy; Raver, C. Cybele; Berry, Daniel J.

2015-01-01

In the current article, we contrast 2 analytical approaches to estimate the relation of parenting to executive function development in a sample of 1,292 children assessed longitudinally between the ages of 36 and 60 months of age. Children were administered a newly developed and validated battery of 6 executive function tasks tapping inhibitory control, working memory, and attention shifting. Residualized change analysis indicated that higher quality parenting as indicated by higher scores on widely used measures of parenting at both earlier and later time points predicted more positive gain in executive function at 60 months. Latent change score models in which parenting and executive function over time were held to standards of longitudinal measurement invariance provided additional evidence of the association between change in parenting quality and change in executive function. In these models, cross-lagged paths indicated that in addition to parenting predicting change in executive function, executive function bidirectionally predicted change in parenting quality. Results were robust with the addition of covariates, including child sex, race, maternal education, and household income-to-need. Strengths and drawbacks of the 2 analytic approaches are discussed, and the findings are considered in light of emerging methodological innovations for testing the extent to which executive function is malleable and open to the influence of experience. PMID:23834294

Benefits of utilizing CellProfiler as a characterization tool for U-10Mo nuclear fuel

DOE PAGES

Collette, R.; Douglas, J.; Patterson, L.; ...

2015-05-01

Automated image processing techniques have the potential to aid in the performance evaluation of nuclear fuels by eliminating judgment calls that may vary from person-to-person or sample-to-sample. Analysis of in-core fuel performance is required for design and safety evaluations related to almost every aspect of the nuclear fuel cycle. This study presents a methodology for assessing the quality of uranium-molybdenum fuel images and describes image analysis routines designed for the characterization of several important microstructural properties. The analyses are performed in CellProfiler, an open-source program designed to enable biologists without training in computer vision or programming to automatically extract cellularmore » measurements from large image sets. The quality metric scores an image based on three parameters: the illumination gradient across the image, the overall focus of the image, and the fraction of the image that contains scratches. The metric presents the user with the ability to ‘pass’ or ‘fail’ an image based on a reproducible quality score. Passable images may then be characterized through a separate CellProfiler pipeline, which enlists a variety of common image analysis techniques. The results demonstrate the ability to reliably pass or fail images based on the illumination, focus, and scratch fraction of the image, followed by automatic extraction of morphological data with respect to fission gas voids, interaction layers, and grain boundaries.« less

An appraisal of the 2012 American College of Rheumatology Guidelines for the Management of Gout.

PubMed

Nuki, George

2014-03-01

Appraisal of the 2012 American College of Rheumatology (ACR) Guidelines for the Management of Gout. The ACRs first clinical practice guidelines for the management of gout focus on recommendations for nonpharmacologic and pharmacologic approaches to hyperuricaemia and the treatment and prophylaxis of acute gouty arthritis. The RAND/UCLA appropriateness methodology employed assessed risks and benefits of alternative treatments for efficacy, safety and quality but not for cost-effectiveness. Novel recommendations include the use of either allopurinol or febuxostat for first-line urate-lowering drug therapy (ULT), screening for HLA-B*5801 prior to initiation of allopurinol in Asians at relatively high risk for allopurinol hypersensitivity, and the use of pegloticase for patients with severe, symptomatic, tophaceous gout refractory to, or intolerant of, appropriately dosed ULTs. Appraisal and comparison with other guidelines using Guidelines International Network and Appraisal of Guidelines, Research and Evaluation (AGREE II) criteria showed good scores for scope and purpose, stakeholder involvement, rigour of development, clarity of presentation, editorial independence and, overall quality, but not for applicability. The ACR guidelines provide comprehensive, up-to-date, good-quality, evidence-based, expert consensus recommendations for the management of gout in clinical practice but score poorly for applicability. To improve the management of gout in the community a summary of key recommendations, criteria for audit and standards of care are now required.

Virtual reality using games for improving physical functioning in older adults: a systematic review.

PubMed

Molina, Karina Iglesia; Ricci, Natalia Aquaroni; de Moraes, Suzana Albuquerque; Perracini, Monica Rodrigues

2014-11-15

The use of virtual reality through exergames or active video game, i.e. a new form of interactive gaming, as a complementary tool in rehabilitation has been a frequent focus in research and clinical practice in the last few years. However, evidence of their effectiveness is scarce in the older population. This review aim to provide a summary of the effects of exergames in improving physical functioning in older adults. A search for randomized controlled trials was performed in the databases EMBASE, MEDLINE, PsyInfo, Cochrane data base, PEDro and ISI Web of Knowledge. Results from the included studies were analyzed through a critical review and methodological quality by the PEDro scale. Thirteen studies were included in the review. The most common apparatus for exergames intervention was the Nintendo Wii gaming console (8 studies), followed by computers games, Dance video game with pad (two studies each) and only one study with the Balance Rehabilitation Unit. The Timed Up and Go was the most frequently used instrument to assess physical functioning (7 studies). According to the PEDro scale, most of the studies presented methodological problems, with a high proportion of scores below 5 points (8 studies). The exergames protocols and their duration varied widely, and the benefits for physical function in older people remain inconclusive. However, a consensus between studies is the positive motivational aspect that the use of exergames provides. Further studies are needed in order to achieve better methodological quality, external validity and provide stronger scientific evidence.

The creation, management, and use of data quality information for life cycle assessment.

PubMed

Edelen, Ashley; Ingwersen, Wesley W

2018-04-01

Despite growing access to data, questions of "best fit" data and the appropriate use of results in supporting decision making still plague the life cycle assessment (LCA) community. This discussion paper addresses revisions to assessing data quality captured in a new US Environmental Protection Agency guidance document as well as additional recommendations on data quality creation, management, and use in LCA databases and studies. Existing data quality systems and approaches in LCA were reviewed and tested. The evaluations resulted in a revision to a commonly used pedigree matrix, for which flow and process level data quality indicators are described, more clarity for scoring criteria, and further guidance on interpretation are given. Increased training for practitioners on data quality application and its limits are recommended. A multi-faceted approach to data quality assessment utilizing the pedigree method alongside uncertainty analysis in result interpretation is recommended. A method of data quality score aggregation is proposed and recommendations for usage of data quality scores in existing data are made to enable improved use of data quality scores in LCA results interpretation. Roles for data generators, data repositories, and data users are described in LCA data quality management. Guidance is provided on using data with data quality scores from other systems alongside data with scores from the new system. The new pedigree matrix and recommended data quality aggregation procedure can now be implemented in openLCA software. Additional ways in which data quality assessment might be improved and expanded are described. Interoperability efforts in LCA data should focus on descriptors to enable user scoring of data quality rather than translation of existing scores. Developing and using data quality indicators for additional dimensions of LCA data, and automation of data quality scoring through metadata extraction and comparison to goal and scope are needed.

Cloud-Based Service Information System for Evaluating Quality of Life after Breast Cancer Surgery.

PubMed

Kao, Hao-Yun; Wu, Wen-Hsiung; Liang, Tyng-Yeu; Lee, King-The; Hou, Ming-Feng; Shi, Hon-Yi

2015-01-01

Although recent studies have improved understanding of quality of life (QOL) outcomes of breast conserving surgery, few have used longitudinal data for more than two time points, and few have examined predictors of QOL over two years. Additionally, the longitudinal data analyses in such studies rarely apply the appropriate statistical methodology to control for censoring and inter-correlations arising from repeated measures obtained from the same patient pool. This study evaluated an internet-based system for measuring longitudinal changes in QOL and developed a cloud-based system for managing patients after breast conserving surgery. This prospective study analyzed 657 breast cancer patients treated at three tertiary academic hospitals. Related hospital personnel such as surgeons and other healthcare professionals were also interviewed to determine the requirements for an effective cloud-based system for surveying QOL in breast cancer patients. All patients completed the SF-36, Quality of Life Questionnaire (QLQ-C30) and its supplementary breast cancer measure (QLQ-BR23) at baseline, 6 months, 1 year, and 2 years postoperatively. The 95% confidence intervals for differences in responsiveness estimates were derived by bootstrap estimation. Scores derived by these instruments were interpreted by generalized estimating equation before and after surgery. All breast cancer surgery patients had significantly improved QLQ-C30 and QLQ-BR23 subscale scores throughout the 2-year follow-up period (p<0.05). During the study period, QOL generally had a negative association with advanced age, high Charlson comorbidity index score, tumor stage III or IV, previous chemotherapy, and long post-operative LOS. Conversely, QOL was positively associated with previous radiotherapy and hormone therapy. Additionally, patients with high scores for preoperative QOL tended to have high scores for QLQ-C30, QLQ-BR23 and SF-36 subscales. Based on the results of usability testing, the five constructs were rated on a Likert scale from 1-7 as follows: system usefulness (5.6±1.8), ease of use (5.6±1.5), information quality (5.4±1.4), interface quality (5.5±1.4), and overall satisfaction (5.5±1.6). The current trend in clinical medicine is applying therapies and interventions that improve QOL. Therefore, a potentially vast amount of internet-based QOL data is available for use in defining patient populations that may benefit from therapeutic intervention. Additionally, before undergoing breast conserving surgery, patients should be advised that their postoperative QOL depends not only on the success of the surgery, but also on their preoperative functional status.

Cloud-Based Service Information System for Evaluating Quality of Life after Breast Cancer Surgery

PubMed Central

Kao, Hao-Yun; Wu, Wen-Hsiung; Liang, Tyng-Yeu; Lee, King-The; Hou, Ming-Feng; Shi, Hon-Yi

2015-01-01

Objective Although recent studies have improved understanding of quality of life (QOL) outcomes of breast conserving surgery, few have used longitudinal data for more than two time points, and few have examined predictors of QOL over two years. Additionally, the longitudinal data analyses in such studies rarely apply the appropriate statistical methodology to control for censoring and inter-correlations arising from repeated measures obtained from the same patient pool. This study evaluated an internet-based system for measuring longitudinal changes in QOL and developed a cloud-based system for managing patients after breast conserving surgery. Methods This prospective study analyzed 657 breast cancer patients treated at three tertiary academic hospitals. Related hospital personnel such as surgeons and other healthcare professionals were also interviewed to determine the requirements for an effective cloud-based system for surveying QOL in breast cancer patients. All patients completed the SF-36, Quality of Life Questionnaire (QLQ-C30) and its supplementary breast cancer measure (QLQ-BR23) at baseline, 6 months, 1 year, and 2 years postoperatively. The 95% confidence intervals for differences in responsiveness estimates were derived by bootstrap estimation. Scores derived by these instruments were interpreted by generalized estimating equation before and after surgery. Results All breast cancer surgery patients had significantly improved QLQ-C30 and QLQ-BR23 subscale scores throughout the 2-year follow-up period (p<0.05). During the study period, QOL generally had a negative association with advanced age, high Charlson comorbidity index score, tumor stage III or IV, previous chemotherapy, and long post-operative LOS. Conversely, QOL was positively associated with previous radiotherapy and hormone therapy. Additionally, patients with high scores for preoperative QOL tended to have high scores for QLQ-C30, QLQ-BR23 and SF-36 subscales. Based on the results of usability testing, the five constructs were rated on a Likert scale from 1–7 as follows: system usefulness (5.6±1.8), ease of use (5.6±1.5), information quality (5.4±1.4), interface quality (5.5±1.4), and overall satisfaction (5.5±1.6). Conclusions The current trend in clinical medicine is applying therapies and interventions that improve QOL. Therefore, a potentially vast amount of internet-based QOL data is available for use in defining patient populations that may benefit from therapeutic intervention. Additionally, before undergoing breast conserving surgery, patients should be advised that their postoperative QOL depends not only on the success of the surgery, but also on their preoperative functional status. PMID:26422018

Pyridoxine (vitamin B6) supplementation during pregnancy or labour for maternal and neonatal outcomes.

PubMed

Salam, Rehana A; Zuberi, Nadeem F; Bhutta, Zulfiqar A

2015-06-03

Vitamin B6 plays vital roles in numerous metabolic processes in the human body, such as nervous system development and functioning. It has been associated with some benefits in non-randomised studies, such as higher Apgar scores, higher birthweights, and reduced incidence of pre-eclampsia and preterm birth. Recent studies also suggest a protection against certain congenital malformations. To evaluate the clinical effects of vitamin B6 supplementation during pregnancy and/or labour. We searched the Cochrane Pregnancy and Childbirth Group Trials Register (31 March 2015) and reference lists of retrieved studies. We included randomised controlled trials comparing vitamin B6 administration in pregnancy and/or labour with: placebos, no supplementations, or supplements not containing vitamin B6. Two review authors independently assessed trials for inclusion and risk of bias, extracted data and checked them for accuracy. For this update, we assessed methodological quality of the included trials using risk of bias and the GRADE approach. Four trials (1646 women) were included. The method of randomisation was unclear in all four trials and allocation concealment was reported in only one trial. Two trials used blinding of participants and outcomes. Vitamin B6 as oral capsules or lozenges resulted in decreased risk of dental decay in pregnant women (capsules: risk ratio (RR) 0.84; 95% confidence interval (CI) 0.71 to 0.98; one trial, n = 371, low quality of evidence; lozenges: RR 0.68; 95% CI 0.56 to 0.83; one trial, n = 342, low quality of evidence). A small trial showed reduced mean birthweights with vitamin B6 supplementation (mean difference -0.23 kg; 95% CI -0.42 to -0.04; n = 33; one trial). We did not find any statistically significant differences in the risk of eclampsia (capsules: n = 1242; three trials; lozenges: n = 944; one trial), pre-eclampsia (capsules n = 1197; two trials, low quality of evidence; lozenges: n = 944; one trial, low-quality evidence) or low Apgar scores at one minute (oral pyridoxine: n = 45; one trial), between supplemented and non-supplemented groups. No differences were found in Apgar scores at five minutes, or breastmilk production between controls and women receiving oral (n = 24; one trial) or intramuscular (n = 24; one trial) loading doses of pyridoxine at labour. Overall, the risk of bias was judged as unclear. The quality of the evidence using GRADE was low for both pre-eclampsia and dental decay. The other primary outcomes, preterm birth before 37 weeks and low birthweight, were not reported in the included trials. There were few trials, reporting few clinical outcomes and mostly with unclear trial methodology and inadequate follow-up. There is not enough evidence to detect clinical benefits of vitamin B6 supplementation in pregnancy and/or labour other than one trial suggesting protection against dental decay. Future trials assessing this and other outcomes such as orofacial clefts, cardiovascular malformations, neurological development, preterm birth, pre-eclampsia and adverse events are required.

Characteristics and Methodological Quality of Meta-Analyses on Hypertension Treatments-A Cross-Sectional Study.

PubMed

Wu, Xin Yin; Du, Xin Jian; Ho, Robin S T; Lee, Clarence C Y; Yip, Benjamin H K; Wong, Martin C S; Wong, Samuel Y S; Chung, Vincent C H

2017-02-01

Methodological quality of meta-analyses on hypertension treatments can affect treatment decision-making. The authors conducted a cross-sectional study to investigate the methodological quality of meta-analyses on hypertension treatments. One hundred and fifty-eight meta-analyses were identified. Overall, methodological quality was unsatisfactory in the following aspects: comprehensive reporting of financial support (1.9%), provision of included and excluded lists of studies (22.8%), inclusion of grey literature (27.2%), and inclusion of protocols (32.9%). The 126 non-Cochrane meta-analyses had poor performance on almost all the methodological items. Non-Cochrane meta-analyses focused on nonpharmacologic treatments were more likely to consider scientific quality of included studies when making conclusions. The 32 Cochrane meta-analyses generally had good methodological quality except for comprehensive reporting of the sources of support. These results highlight the need for cautious interpretation of these meta-analyses, especially among physicians and policy makers when guidelines are formulated. Future meta-analyses should pay attention to improving these methodological aspects. ©2016 Wiley Periodicals, Inc.

Results of the First Italian External Quality Assurance Scheme for somatic EGFR mutation testing in non-small-cell lung cancer.

PubMed

Normanno, Nicola; Pinto, Carmine; Taddei, Gianluigi; Gambacorta, Marcello; Castiglione, Francesca; Barberis, Massimo; Clemente, Claudio; Marchetti, Antonio

2013-06-01

The Italian Association of Medical Oncology (AIOM) and the Italian Society of Pathology and Cytology organized an external quality assessment (EQA) scheme for EGFR mutation testing in non-small-cell lung cancer. Ten specimens, including three small biopsies with known epidermal growth factor receptor (EGFR) mutation status, were validated in three referral laboratories and provided to 47 participating centers. The participants were requested to perform mutational analysis, using their usual method, and to submit results within a 4-week time frame. According to a predefined scoring system, two points were assigned to correct genotype and zero points to false-negative or false-positive results. The threshold to pass the EQA was set at higher than 18 of 20 points. Two rounds were preplanned. All participating centers submitted the results within the time frame. Polymerase chain reaction (PCR)/sequencing was the main methodology used (n = 37 laboratories), although a few centers did use pyrosequencing (n = 8) or real-time PCR (n = 2). A significant number of analytical errors were observed (n = 20), with a high frequency of false-positive results (n = 16). The lower scores were obtained for the small biopsies. Fourteen of 47 centers (30%) that did not pass the first round, having a score less than or equal to 18 points, used PCR/sequencing, whereas 10 of 10 laboratories, using pyrosequencing or real-time PCR, passed the first round. Eight laboratories passed the second round. Overall, 41of 47 centers (87%) passed the EQA. The results of the EQA for EGFR testing in non-small-cell lung cancer suggest that good quality EGFR mutational analysis is performed in Italian laboratories, although differences between testing methods were observed, especially for small biopsies.

High Spicy Food Intake and Risk of Cancer: A Meta-analysis of Case-control Studies.

PubMed

Chen, Yu-Heng; Zou, Xiao-Nong; Zheng, Tong-Zhang; Zhou, Qi; Qiu, Hui; Chen, Yuan-Li; He, Mei; Du, Jia; Lei, Hai-Ke; Zhao, Ping

2017-09-20

Studies on the association between spicy food intake and cancer risk have reported inconsistent results. We quantitatively assessed this association by conducting a meta-analysis based on evidence from case-control studies. PubMed, EMBASE, and the Cochrane Library were searched for eligible publications. Combined odds ratios (OR s) with their 95% confidence interval (CI) were calculated using a random- or fixed-effects model. The methodological quality of the included articles was assessed using the Newcastle-Ottawa scale (NOS). All data were analyzed using STATA 11.0 software (version 11.0; StataCorp., College Station, TX, USA). Subgroup analyses were also performed with stratification by region, sex, number of cases, cancer subtype, source of the control group, and NOS score. A total 39 studies from 28 articles fulfilled the inclusion criteria for the meta-analysis (7884 patients with cancer and 10,142 controls). Comparison of the highest versus lowest exposure category in each study revealed a significant OR of 1.76 (95% CI = 1.35-2.29) in spite of significant heterogeneity (P < 0.001). In the subgroup analyses, this positive correlation was still found for gastric cancer, different regions, different numbers of cases, different sources of the control group, and high-quality articles (NOS score of ≥ 7). However, no statistically significant association was observed for women, esophageal cancer, gallbladder cancer, or low-quality articles (NOS score of <7). No evidence of publication bias was found. Evidence from case-control studies suggested that a higher level of spicy food intake may be associated with an increased incidence of cancer despite significant heterogeneity. More studies are warranted to clarify our understanding of the association between high spicy food intake and the risk of cancer.

Quality indicators for pharmaceutical care: a comprehensive set with national scores for Dutch community pharmacies.

PubMed

Teichert, Martina; Schoenmakers, Tim; Kylstra, Nico; Mosk, Berend; Bouvy, Marcel L; van de Vaart, Frans; De Smet, Peter A G M; Wensing, Michel

2016-08-01

Background The quality of pharmaceutical care in community pharmacies in the Netherlands has been assessed annually since 2008. The initial set has been further developed with pharmacists and patient organizations, the healthcare inspectorate, the government and health insurance companies. The set over 2012 was the first set of quality indicators for community pharmacies which was validated and supported by all major stakeholders. The aims of this study were to describe the validated set of quality indicators for community pharmacies and to report their scores over 2012. In subanalyses the score development over 5 years was described for those indicators, that have been surveyed before and remained unchanged. Methods Community pharmacists in the Netherlands were invited in 2013 to provide information for the set of 2012. Quality indicators were mapped by categories relevant for pharmaceutical care and defined for structures, processes and dispensing outcomes. Scores for categorically-measured quality indicators were presented as the percentage of pharmacies reporting the presence of a quality aspect. For numerical quality indicators, the mean of all reported scores was expressed. In subanalyses for those indicators that had been questioned previously, scores were collected from earlier measurements for pharmacies providing their scores in 2012. Multilevel analysis was used to assess the consistency of scores within one pharmacy over time by the intra-class correlation coefficient (ICC). Results For the set in 2012, 1739 Dutch community pharmacies (88 % of the total) provided information for 66 quality indicators in 10 categories. Indicator scores on the presence of quality structures showed relatively high quality levels. Scores for processes and dispensing outcomes were lower. Subanalyses showed that overall indicators scores improved within pharmacies, but this development differed between pharmacies. Conclusions A set of validated quality indicators provided insight into the quality of pharmaceutical care in the Netherlands. The quality of pharmaceutical care improved over time. As of 2012 quality structures were present in at least 80 % of the community pharmacies. Variation in scores on care processes and outcomes between individual pharmacies and over time can initiate future research to better understand and facilitate quality improvement in community pharmacies.

Economic Analysis of Children's Surgical Care in Low- and Middle-Income Countries: A Systematic Review and Analysis.

PubMed

Saxton, Anthony T; Poenaru, Dan; Ozgediz, Doruk; Ameh, Emmanuel A; Farmer, Diana; Smith, Emily R; Rice, Henry E

2016-01-01

Understanding the economic value of health interventions is essential for policy makers to make informed resource allocation decisions. The objective of this systematic review was to summarize available information on the economic impact of children's surgical care in low- and middle-income countries (LMICs). We searched MEDLINE (Pubmed), Embase, and Web of Science for relevant articles published between Jan. 1996 and Jan. 2015. We summarized reported cost information for individual interventions by country, including all costs, disability weights, health outcome measurements (most commonly disability-adjusted life years [DALYs] averted) and cost-effectiveness ratios (CERs). We calculated median CER as well as societal economic benefits (using a human capital approach) by procedure group across all studies. The methodological quality of each article was assessed using the Drummond checklist and the overall quality of evidence was summarized using a scale adapted from the Agency for Healthcare Research and Quality. We identified 86 articles that met inclusion criteria, spanning 36 groups of surgical interventions. The procedure group with the lowest median CER was inguinal hernia repair ($15/DALY). The procedure group with the highest median societal economic benefit was neurosurgical procedures ($58,977). We found a wide range of study quality, with only 35% of studies having a Drummond score ≥ 7. Our findings show that many areas of children's surgical care are extremely cost-effective in LMICs, provide substantial societal benefits, and are an appropriate target for enhanced investment. Several areas, including inguinal hernia repair, trichiasis surgery, cleft lip and palate repair, circumcision, congenital heart surgery and orthopedic procedures, should be considered "Essential Pediatric Surgical Procedures" as they offer considerable economic value. However, there are major gaps in existing research quality and methodology which limit our current understanding of the economic value of surgical care.

Evaluation of Cross-Cultural Adaptation and Measurement Properties of STarT Back Screening Tool: A Systematic Review.

PubMed

Al Zoubi, Fadi M; Eilayyan, Owis; Mayo, Nancy E; Bussières, André E

2017-10-01

The purpose of this systematic review was to investigate the extent to which the STarT Back Screening Tool (SBST) has been evaluated for (1) the quality of translation of evidence for cross-cultural adaptation and (2) the measurement properties in languages other than English. A systematic search of 8 databases, including Medline, Embase, CINAHL, PsycINFO, AMED, Scopus, PubMed, and Web of Science, was performed. Electronic databases were searched for the period between 2008 and December 27, 2016. We included studies related to cross-cultural adaptation, including translation and assessment of the measurement properties of SBST. Study selection, translation, methodologic and quality assessments, and data extraction were performed independently by 2 reviewers. Of the 1566 citations retrieved, 17 studies were admissible, representing 11 different SBST versions in 10 languages. The quadratic weighted κ statistics of the 2 reviewers, for the translation, methodologic assessment, and quality assessment were 0.85, 0.76, and 0.83, respectively. For translation, only 2 versions (Belgian-French and Mandarin) fulfilled all requirements. None of the versions had tested all the measurement properties, and when performed, these were found to have been conducted inadequately. With regard to quality assessment, overall, the included versions had a "Poor" total summary score except 2 (Persian and Swiss-German), which were rated as "Fair." Few versions fully met the standard criteria for valid translation, and none of the versions tested all the measurement properties. There is a clear need for more accurate cross-cultural adaptation of SBST and greater attention to the quality of psychometric evaluation of the adapted versions of SBST. At this time, caution is recommended when using SBST in languages other than English. Copyright © 2017. Published by Elsevier Inc.

A new framework for interactive quality assessment with application to light field coding

NASA Astrophysics Data System (ADS)

Viola, Irene; Ebrahimi, Touradj

2017-09-01

In recent years, light field has experienced a surge of popularity, mainly due to the recent advances in acquisition and rendering technologies that have made it more accessible to the public. Thanks to image-based rendering techniques, light field contents can be rendered in real time on common 2D screens, allowing virtual navigation through the captured scenes in an interactive fashion. However, this richer representation of the scene poses the problem of reliable quality assessments for light field contents. In particular, while subjective methodologies that enable interaction have already been proposed, no work has been done on assessing how users interact with light field contents. In this paper, we propose a new framework to subjectively assess the quality of light field contents in an interactive manner and simultaneously track users behaviour. The framework is successfully used to perform subjective assessment of two coding solutions. Moreover, statistical analysis performed on the results shows interesting correlation between subjective scores and average interaction time.

A Chinese patent medicine Salvia miltiorrhiza depside salts for infusion combined with conventional treatment for patients with angina pectoris: A systematic review and meta-analysis of randomized controlled trials.

PubMed

Zhang, Yili; Xie, Yanming; Liao, Xing; Jia, Qiulei; Chai, Yan

2017-02-15

Currently, many trials have been conducted to investigate the beneficial and harmful effects of Salvia miltiorrhiza depside salts for infusion for treating patients with angina pectoris. It is important to systematically and criticallyevaluate the existing literature into providing a pooled effect to examine outcomes of angina pectoris with Salvia miltiorrhiza depside salts for infusion. A systematic review and meta-analysis were performed to determine the clinical curative effect and safety of Salvia miltiorrhiza depside salts for infusion for angina pectoris and provide clear evidence to inform clinical practice. The Cochrane Library, MEDLINE, EMBASE, and other four electronic Chinese databases were searched to identify relevant randomized controlled trials. Methodological quality and reporting quality of eligible studies was evaluated by using the Cochrane risk-of-bias tool and CONSORT for traditional Chinese medicine respectively. Meta-analysis was performed by RevMan 5.3 software. Fifty-six randomized controlled trials involving 5503 patients were included. Most of the trials were classified as having an unclear risk of bias because of poor reported methodology. The main outcomes are improvements in angina symptoms, ECG improvement and reduction of nitroglycerin use. CHD mortality or rate of CHD events was not reported in any trial. Meta-analysis showed that Salvia miltiorrhiza depside salts for infusion combined with conventional treatment was better than conventional treatment alone in improving angina symptoms (RR= 1.28, 95% CI 1.24 to 1.31, p < 0.00001), the frequency of angina attack (time/week)(WMD=-1.47, 95% CI -2.16 to -0.78), reducing clinical symptom scores (WMD=-0.55, 95% CI -0.57 to -0.53, p < 0.000011), increasing physical limitation scores (WMD= 7.68, 95% CI 1.48 to 13.88, p = 0.02), improving ECG (RR= 1.32,95% CI 1.27 to 1.38, p < 0.00001) and reducing dosage of nitroglycerin (RR= 1.50, 95% CI: 1.26 to 1.77, p < 0.00001). In addition, Egger's regression tests was found there was publication bias (Kendall' tau= 0.36, p < 0.01). The current systematic review indicates relevant evidence for Salvia miltiorrhiza depside salts for infusion combined with conventional treatments treating patient with angina pectoris. However, the results should be interpreted with caution due to the low methodological quality, the risk of publication bias, lack of important clinically relevant outcomes and inadequate reporting on adverse events of the included trials. International methodological and reporting standards could help researchers conduct well designed trials and generate better evidence for Salvia miltiorrhiza depside salts for infusion. Copyright © 2017 The Authors. Published by Elsevier GmbH.. All rights reserved.

METHODOLOGICAL QUALITY OF ECONOMIC EVALUATIONS ALONGSIDE TRIALS OF KNEE PHYSIOTHERAPY.

PubMed

García-Pérez, Lidia; Linertová, Renata; Arvelo-Martín, Alejandro; Guerra-Marrero, Carolina; Martínez-Alberto, Carlos Enrique; Cuéllar-Pompa, Leticia; Escobar, Antonio; Serrano-Aguilar, Pedro

2017-01-01

The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis. Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale. All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account. Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool.

PubMed

Ho, Robin S T; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel Y S; Chung, Vincent C H

2015-01-08

Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. To assess the methodological quality of MAs on COPD treatments. A cross-sectional study on MAs of COPD trials. MAs published during 2000-2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool

PubMed Central

Ho, Robin ST; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel YS; Chung, Vincent CH

2015-01-01

Background: Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. Aims: To assess the methodological quality of MAs on COPD treatments. Methods: A cross-sectional study on MAs of COPD trials. MAs published during 2000–2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Results: Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. Conclusions: The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods. PMID:25569783

Application of machine vision to pup loaf bread evaluation

NASA Astrophysics Data System (ADS)

Zayas, Inna Y.; Chung, O. K.

1996-12-01

Intrinsic end-use quality of hard winter wheat breeding lines is routinely evaluated at the USDA, ARS, USGMRL, Hard Winter Wheat Quality Laboratory. Experimental baking test of pup loaves is the ultimate test for evaluating hard wheat quality. Computer vision was applied to developing an objective methodology for bread quality evaluation for the 1994 and 1995 crop wheat breeding line samples. Computer extracted features for bread crumb grain were studied, using subimages (32 by 32 pixel) and features computed for the slices with different threshold settings. A subsampling grid was located with respect to the axis of symmetry of a slice to provide identical topological subimage information. Different ranking techniques were applied to the databases. Statistical analysis was run on the database with digital image and breadmaking features. Several ranking algorithms and data visualization techniques were employed to create a sensitive scale for porosity patterns of bread crumb. There were significant linear correlations between machine vision extracted features and breadmaking parameters. Crumb grain scores by human experts were correlated more highly with some image features than with breadmaking parameters.

Development of Process Control Methodology for Tracking the Quality and Safety of Pain, Agitation, and Sedation Management in Critical Care Units.

PubMed

Walsh, Timothy S; Kydonaki, Kalliopi; Lee, Robert J; Everingham, Kirsty; Antonelli, Jean; Harkness, Ronald T; Cole, Stephen; Quasim, Tara; Ruddy, James; McDougall, Marcia; Davidson, Alan; Rutherford, John; Richards, Jonathan; Weir, Christopher J

2016-03-01

To develop sedation, pain, and agitation quality measures using process control methodology and evaluate their properties in clinical practice. A Sedation Quality Assessment Tool was developed and validated to capture data for 12-hour periods of nursing care. Domains included pain/discomfort and sedation-agitation behaviors; sedative, analgesic, and neuromuscular blocking drug administration; ventilation status; and conditions potentially justifying deep sedation. Predefined sedation-related adverse events were recorded daily. Using an iterative process, algorithms were developed to describe the proportion of care periods with poor limb relaxation, poor ventilator synchronization, unnecessary deep sedation, agitation, and an overall optimum sedation metric. Proportion charts described processes over time (2 monthly intervals) for each ICU. The numbers of patients treated between sedation-related adverse events were described with G charts. Automated algorithms generated charts for 12 months of sequential data. Mean values for each process were calculated, and variation within and between ICUs explored qualitatively. Eight Scottish ICUs over a 12-month period. Mechanically ventilated patients. None. The Sedation Quality Assessment Tool agitation-sedation domains correlated with the Richmond Sedation Agitation Scale score (Spearman ρ = 0.75) and were reliable in clinician-clinician (weighted kappa; κ = 0.66) and clinician-researcher (κ = 0.82) comparisons. The limb movement domain had fair correlation with Behavioral Pain Scale (ρ = 0.24) and was reliable in clinician-clinician (κ = 0.58) and clinician-researcher (κ = 0.45) comparisons. Ventilator synchronization correlated with Behavioral Pain Scale (ρ = 0.54), and reliability in clinician-clinician (κ = 0.29) and clinician-researcher (κ = 0.42) comparisons was fair-moderate. Eight hundred twenty-five patients were enrolled (range, 59-235 across ICUs), providing 12,385 care periods for evaluation (range 655-3,481 across ICUs). The mean proportion of care periods with each quality metric varied between ICUs: excessive sedation 12-38%; agitation 4-17%; poor relaxation 13-21%; poor ventilator synchronization 8-17%; and overall optimum sedation 45-70%. Mean adverse event intervals ranged from 1.5 to 10.3 patients treated. The quality measures appeared relatively stable during the observation period. Process control methodology can be used to simultaneously monitor multiple aspects of pain-sedation-agitation management within ICUs. Variation within and between ICUs could be used as triggers to explore practice variation, improve quality, and monitor this over time.

Wearable accelerometry-based technology capable of assessing functional activities in neurological populations in community settings: a systematic review.

PubMed

Steins, Dax; Dawes, Helen; Esser, Patrick; Collett, Johnny

2014-03-13

Integrating rehabilitation services through wearable systems has the potential to accurately assess the type, intensity, duration, and quality of movement necessary for procuring key outcome measures. This review aims to explore wearable accelerometry-based technology (ABT) capable of assessing mobility-related functional activities intended for rehabilitation purposes in community settings for neurological populations. In this review, we focus on the accuracy of ABT-based methods, types of outcome measures, and the implementation of ABT in non-clinical settings for rehabilitation purposes. Cochrane, PubMed, Web of Knowledge, EMBASE, and IEEE Xplore. The search strategy covered three main areas, namely wearable technology, rehabilitation, and setting. Potentially relevant studies were categorized as systems either evaluating methods or outcome parameters. Methodological qualities of studies were assessed by two customized checklists, depending on their categorization and rated independently by three blinded reviewers. Twelve studies involving ABT met the eligibility criteria, of which three studies were identified as having implemented ABT for rehabilitation purposes in non-clinical settings. From the twelve studies, seven studies achieved high methodological quality scores. These studies were not only capable of assessing the type, quantity, and quality measures of functional activities, but could also distinguish healthy from non-healthy subjects and/or address disease severity levels. While many studies support ABT's potential for telerehabilitation, few actually utilized it to assess mobility-related functional activities outside laboratory settings. To generate more appropriate outcome measures, there is a clear need to translate research findings and novel methods into practice.

Wearable accelerometry-based technology capable of assessing functional activities in neurological populations in community settings: a systematic review

PubMed Central

2014-01-01

Background Integrating rehabilitation services through wearable systems has the potential to accurately assess the type, intensity, duration, and quality of movement necessary for procuring key outcome measures. Objectives This review aims to explore wearable accelerometry-based technology (ABT) capable of assessing mobility-related functional activities intended for rehabilitation purposes in community settings for neurological populations. In this review, we focus on the accuracy of ABT-based methods, types of outcome measures, and the implementation of ABT in non-clinical settings for rehabilitation purposes. Data sources Cochrane, PubMed, Web of Knowledge, EMBASE, and IEEE Xplore. The search strategy covered three main areas, namely wearable technology, rehabilitation, and setting. Study selection Potentially relevant studies were categorized as systems either evaluating methods or outcome parameters. Methods Methodological qualities of studies were assessed by two customized checklists, depending on their categorization and rated independently by three blinded reviewers. Results Twelve studies involving ABT met the eligibility criteria, of which three studies were identified as having implemented ABT for rehabilitation purposes in non-clinical settings. From the twelve studies, seven studies achieved high methodological quality scores. These studies were not only capable of assessing the type, quantity, and quality measures of functional activities, but could also distinguish healthy from non-healthy subjects and/or address disease severity levels. Conclusion While many studies support ABT’s potential for telerehabilitation, few actually utilized it to assess mobility-related functional activities outside laboratory settings. To generate more appropriate outcome measures, there is a clear need to translate research findings and novel methods into practice. PMID:24625308

Baclofen for alcohol withdrawal.

PubMed

Liu, Jia; Wang, Lu-Ning

2017-08-20

Baclofen shows potential for rapidly reducing symptoms of severe alcohol withdrawal syndrome (AWS) in people with alcoholism. Treatment with baclofen is easy to manage and rarely produces euphoria or other pleasant effects, or craving for the drug. This is an updated version of the original Cochrane Review published in 2015, Issue 4. To assess the efficacy and safety of baclofen for people with AWS. We updated our searches of the following databases to March 2017: the Cochrane Drugs and Alcohol Group Specialised Register, CENTRAL, PubMed, Embase, and CINAHL. We also searched registers of ongoing trials. We handsearched the references quoted in the identified trials, and sought information from researchers, pharmaceutical companies, and relevant trial authors about unpublished or uncompleted trials. We placed no restrictions on language. We included all randomised controlled clinical trials (RCTs) evaluating baclofen versus placebo or any other treatment for people with AWS. We excluded uncontrolled, non-randomised, or quasi-randomised trials. We included both parallel group and cross-over studies. We used standard methodological procedures expected by Cochrane. We included three RCTs with 141 randomised participants. We did not perform meta-analyses due to the different control interventions. For the comparison of baclofen and placebo (1 study, 31 participants), there was no significant difference in Clinical Institute Withdrawal Assessment of Alcohol Scale, Revised (CIWA-Ar) scores (very low quality evidence). For the comparison of baclofen and diazepam (1 study, 37 participants), there was no significant difference in CIWA-Ar scores (very low quality evidence), adverse events (risk difference (RD) 0.00, 95% confidence interval (CI) -0.10 to 0.10; very low quality evidence), dropouts (RD 0.00, 95% CI -0.10 to 0.10; very low quality evidence), and dropouts due to adverse events (RD 0.00, 95% CI -0.10 to 0.10; very low quality evidence). For the comparison of baclofen and chlordiazepoxide (1 study, 60 participants), there was no significant difference in CIWA-Ar scores (mean difference (MD) 1.00, 95% CI 0.70 to 1.30; very low quality evidence), global improvement (MD 0.10, 95% CI -0.03 to 0.23; very low quality evidence), adverse events (RD 2.50, 95% CI 0.88 to 7.10; very low quality of evidence), dropouts (RD 0.00, 95% CI -0.06 to 0.06; very low quality evidence), and dropouts due to adverse events (RD 0.00, 95% CI -0.06 to 0.06; very low quality evidence). No conclusions can be drawn about the efficacy and safety of baclofen for the management of alcohol withdrawal because we found insufficient and very low quality evidence.

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs.

PubMed

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed.

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs

PubMed Central

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed. PMID:27917143

Benefits of utilizing CellProfiler as a characterization tool for U–10Mo nuclear fuel

DOE Office of Scientific and Technical Information (OSTI.GOV)

Collette, R.; Douglas, J.; Patterson, L.

2015-07-15

Automated image processing techniques have the potential to aid in the performance evaluation of nuclear fuels by eliminating judgment calls that may vary from person-to-person or sample-to-sample. Analysis of in-core fuel performance is required for design and safety evaluations related to almost every aspect of the nuclear fuel cycle. This study presents a methodology for assessing the quality of uranium–molybdenum fuel images and describes image analysis routines designed for the characterization of several important microstructural properties. The analyses are performed in CellProfiler, an open-source program designed to enable biologists without training in computer vision or programming to automatically extract cellularmore » measurements from large image sets. The quality metric scores an image based on three parameters: the illumination gradient across the image, the overall focus of the image, and the fraction of the image that contains scratches. The metric presents the user with the ability to ‘pass’ or ‘fail’ an image based on a reproducible quality score. Passable images may then be characterized through a separate CellProfiler pipeline, which enlists a variety of common image analysis techniques. The results demonstrate the ability to reliably pass or fail images based on the illumination, focus, and scratch fraction of the image, followed by automatic extraction of morphological data with respect to fission gas voids, interaction layers, and grain boundaries. - Graphical abstract: Display Omitted - Highlights: • A technique is developed to score U–10Mo FIB-SEM image quality using CellProfiler. • The pass/fail metric is based on image illumination, focus, and area scratched. • Automated image analysis is performed in pipeline fashion to characterize images. • Fission gas void, interaction layer, and grain boundary coverage data is extracted. • Preliminary characterization results demonstrate consistency of the algorithm.« less

Diet Quality and Cancer Outcomes in Adults: A Systematic Review of Epidemiological Studies

PubMed Central

Potter, Jennifer; Brown, Leanne; Williams, Rebecca L.; Byles, Julie; Collins, Clare E.

2016-01-01

Dietary patterns influence cancer risk. However, systematic reviews have not evaluated relationships between a priori defined diet quality scores and adult cancer risk and mortality. The aims of this systematic review are to (1) describe diet quality scores used in cohort or cross-sectional research examining cancer outcomes; and (2) describe associations between diet quality scores and cancer risk and mortality. The protocol was registered in Prospero, and a systematic search using six electronic databases was conducted through to December 2014. Records were assessed for inclusion by two independent reviewers, and quality was evaluated using a validated tool. Sixty-four studies met inclusion criteria from which 55 different diet quality scores were identified. Of the 35 studies investigating diet quality and cancer risk, 60% (n = 21) found a positive relationship. Results suggest no relationship between diet quality scores and overall cancer risk. Inverse associations were found for diet quality scores and risk of postmenopausal breast, colorectal, head, and neck cancer. No consistent relationships between diet quality scores and cancer mortality were found. Diet quality appears to be related to site-specific adult cancer risk. The relationship with cancer mortality is less conclusive, suggesting additional factors impact overall cancer survival. Development of a cancer-specific diet quality score for application in prospective epidemiology and in public health is warranted. PMID:27399671

Psychometric challenges and proposed solutions when scoring facial emotion expression codes.

PubMed

Olderbak, Sally; Hildebrandt, Andrea; Pinkpank, Thomas; Sommer, Werner; Wilhelm, Oliver

2014-12-01

Coding of facial emotion expressions is increasingly performed by automated emotion expression scoring software; however, there is limited discussion on how best to score the resulting codes. We present a discussion of facial emotion expression theories and a review of contemporary emotion expression coding methodology. We highlight methodological challenges pertinent to scoring software-coded facial emotion expression codes and present important psychometric research questions centered on comparing competing scoring procedures of these codes. Then, on the basis of a time series data set collected to assess individual differences in facial emotion expression ability, we derive, apply, and evaluate several statistical procedures, including four scoring methods and four data treatments, to score software-coded emotion expression data. These scoring procedures are illustrated to inform analysis decisions pertaining to the scoring and data treatment of other emotion expression questions and under different experimental circumstances. Overall, we found applying loess smoothing and controlling for baseline facial emotion expression and facial plasticity are recommended methods of data treatment. When scoring facial emotion expression ability, maximum score is preferred. Finally, we discuss the scoring methods and data treatments in the larger context of emotion expression research.

RAS screening in colorectal cancer: a comprehensive analysis of the results from the UK NEQAS colorectal cancer external quality assurance schemes (2009-2016).

PubMed

Richman, Susan D; Fairley, Jennifer; Butler, Rachel; Deans, Zandra C

2017-12-01

Evidence strongly indicates that extended RAS testing should be undertaken in mCRC patients, prior to prescribing anti-EGFR therapies. With more laboratories implementing testing, the requirement for External Quality Assurance schemes increases, thus ensuring high standards of molecular analysis. Data was analysed from 15 United Kingdom National External Quality Assessment Service (UK NEQAS) for Molecular Genetics Colorectal cancer external quality assurance (EQA) schemes, delivered between 2009 and 2016. Laboratories were provided annually with nine colorectal tumour samples for genotyping. Information on methodology and extent of testing coverage was requested, and scores given for genotyping, interpretation and clerical accuracy. There has been a sixfold increase in laboratory participation (18 in 2009 to 108 in 2016). For RAS genotyping, fewer laboratories now use Roche cobas®, pyrosequencing and Sanger sequencing, with more moving to next generation sequencing (NGS). NGS is the most commonly employed technology for BRAF and PIK3CA mutation screening. KRAS genotyping errors were seen in ≤10% laboratories, until the 2014-2015 scheme, when there was an increase to 16.7%, corresponding to a large increase in scheme participants. NRAS genotyping errors peaked at 25.6% in the first 2015-2016 scheme but subsequently dropped to below 5%. Interpretation and clerical accuracy scores have been consistently good throughout. Within this EQA scheme, we have observed that the quality of molecular analysis for colorectal cancer has continued to improve, despite changes in the required targets, the volume of testing and the technologies employed. It is reassuring to know that laboratories clearly recognise the importance of participating in EQA schemes.

[How to assess clinical practice guidelines with AGREE II: The example of neonatal jaundice].

PubMed

Renesme, L; Bedu, A; Tourneux, P; Truffert, P

2016-03-01

Neonatal jaundice is a very frequent condition that occurs in approximately 50-70% of term or near-term (>35 GA) babies in the 1st week of life. In some cases, a high bilirubin blood level can lead to kernicterus. There is no consensus for the management of neonatal jaundice and few countries have published national clinical practice guidelines for the management of neonatal jaundice. The aim of this study was to assess the quality of these guidelines. We conducted a systematic review of the literature for national clinical practice guidelines for the management of neonatal jaundice in term or near-term babies. Four independent reviewers assessed the quality of each guideline using the AGREE II evaluation. For each of the clinical practice guidelines, the management modalities were analyzed (screening, treatment, follow-up, etc.). Seven national clinical practice guidelines were found (South Africa, USA AAP, UK NICE, Canada, Norway, Switzerland, and Israel). The AGREE II score showed widespread variation regarding the quality of these national guidelines. There was no major difference between the guidelines concerning the clinical management of these babies. The NICE guideline is the most valuable guideline regarding the AGREE II score. NICE showed that, despite a strong and rigorous methodology, there is no evidenced-based recommended code of practice (RCP). Comparing RCPs, we found no major differences. The NICE guideline showed the best quality. The AGREE II instrument should be used as a framework when developing clinical practice guidelines to improve the quality of the future guideline. In France, a national guideline is needed for a more standardized management of neonatal jaundice. Copyright © 2015 Elsevier Masson SAS. All rights reserved.

The Statistical point of view of Quality: the Lean Six Sigma methodology

PubMed Central

Viti, Andrea; Terzi, Alberto

2015-01-01

Six Sigma and Lean are two quality improvement methodologies. The Lean Six Sigma methodology is applicable to repetitive procedures. Therefore, the use of this methodology in the health-care arena has focused mainly on areas of business operations, throughput, and case management and has focused on efficiency outcomes. After the revision of methodology, the paper presents a brief clinical example of the use of Lean Six Sigma as a quality improvement method in the reduction of the complications during and after lobectomies. Using Lean Six Sigma methodology, the multidisciplinary teams could identify multiple modifiable points across the surgical process. These process improvements could be applied to different surgical specialties and could result in a measurement, from statistical point of view, of the surgical quality. PMID:25973253

The Statistical point of view of Quality: the Lean Six Sigma methodology.

PubMed

Bertolaccini, Luca; Viti, Andrea; Terzi, Alberto

2015-04-01

Six Sigma and Lean are two quality improvement methodologies. The Lean Six Sigma methodology is applicable to repetitive procedures. Therefore, the use of this methodology in the health-care arena has focused mainly on areas of business operations, throughput, and case management and has focused on efficiency outcomes. After the revision of methodology, the paper presents a brief clinical example of the use of Lean Six Sigma as a quality improvement method in the reduction of the complications during and after lobectomies. Using Lean Six Sigma methodology, the multidisciplinary teams could identify multiple modifiable points across the surgical process. These process improvements could be applied to different surgical specialties and could result in a measurement, from statistical point of view, of the surgical quality.

Level of quality management in the Municipal Sports Services, contrast trough EFQM Excellence Model.

PubMed

Martínez-Moreno, Alfonso; Díaz Suárez, Arturo

2016-01-01

The quality management in the Municipal Sports Services is embedded in the servuction provided to the citizens, which are their internal customers who determine the quality improvement ensuring competitiveness with excellence criteria. The Model of the European Foundation for Quality Management enables the evaluation of organization progress towards achieving quality goals, from a structured, measurable and comparable methodology. The aim is to carry out a diagnosis of the level of implementation of quality in the Municipal Sports Services of the Region of Murcia, Spain. The sample of 287 workers of 30 sports services gets a high level of reliability at all scales, with a coefficient of variation of .985 (range .810-.943). The score in the criteria of Policy and Strategy, People Management, Alliances and Resources, Processes and People Results were significantly higher (p < .05) in the Municipalities with more than 25,000 inhabitants when compared with those less than 10,000 and with those from 10,000 to 25,000 inhabitants obtaining global ratings of 571 points, those less than 10,000, 590 points those from 10,000 to 25,000 and those higher than 25,000 reach 636, having a good level of quality in relation to the scale that determines the model.

Effects of whole body vibration on pain, stiffness and physical functions in patients with knee osteoarthritis: a systematic review and meta-analysis.

PubMed

Wang, Pu; Yang, Xiaotian; Yang, Yonghong; Yang, Lin; Zhou, Yujing; Liu, Chuan; Reinhardt, Jan D; He, Chengqi

2015-10-01

To assess the effects of whole body vibration for pain, stiffness and physical functions in patients with knee osteoarthritis. We searched the Cochrane Central Register of Controlled Trials, MEDLINE, Physiotherapy Evidence Database (PEDro) and EMBASE (up to October 2014) to identify relevant randomized controlled trials. The outcome measures were pain, stiffness and physical functions. Two investigators identified eligible studies and extracted data independently. The PEDro score was used to evaluate the methodological quality of the selected studies. Standard mean differences (SMDs) and 95% confidence intervals (CIs) were calculated, and heterogeneity was assessed using the I(2) test. A total of five randomized controlled trials involving 170 patients with knee osteoarthritis met the inclusion criteria. Only four studies involving 144 patients were deemed to be good quality trials (PEDro score = 6-7). Meta-analysis revealed that whole body vibration has a significant treatment effect in Western Ontario and McMaster Universities index physical function score (SMD = -0.72 points, 95% CI = -1.14 to -0.30, P = 0.0008), 12 weeks whole body vibration improved the 6-minute walk test (SMD 1.15 m, 95% CI 0.50 to 1.80, P = 0.0006) and balance (SMD = -0.78 points, 95% CI -1.40 to -0.16, P = 0.01). Whole body vibration was not associated with a significant reduction in Western Ontario and McMaster Universities index pain and stiffness score. Eight-week and 12-week whole body vibration is beneficial for improving physical functions in patients with knee osteoarthritis and could be included in rehabilitation programs. © The Author(s) 2014.

Medial tibial stress syndrome: evidence-based prevention.

PubMed

Craig, Debbie I

2008-01-01

Thacker SB, Gilchrist J, Stroup DF, Kimsey CD. The prevention of shin splints in sports: a systematic review of literature. Med Sci Sports Exerc. 2002;34(1):32-40. Among physically active individuals, which medial tibial stress syndrome (MTSS) prevention methods are most effective to decrease injury rates? Studies were identified by searching MEDLINE (1966-2000), Current Contents (1996-2000), Biomedical Collection (1993-1999), and Dissertation Abstracts. Reference lists of identified studies were searched manually until no further studies were identified. Experts in the field were contacted, including first authors of randomized controlled trials addressing prevention of MTSS. The Cochrane Collaboration (early stage of Cochrane Database of Systematic Reviews) was contacted. Inclusion criteria included randomized controlled trials or clinical trials comparing different MTSS prevention methods with control groups. Excluded were studies that did not provide primary research data or that addressed treatment and rehabilitation rather than prevention of incident MTSS. A total of 199 citations were identified. Of these, 4 studies compared prevention methods for MTSS. Three reviewers independently scored the 4 studies. Reviewers were blinded to the authors' names and affiliations but not the results. Each study was evaluated independently for methodologic quality using a 100-point checklist. Final scores were averages of the 3 reviewers' scores. Prevention methods studied were shock-absorbent insoles, foam heel pads, Achilles tendon stretching, footwear, and graduated running programs. No statistically significant results were noted for any of the prevention methods. Median quality scores ranged from 29 to 47, revealing flaws in design, control for bias, and statistical methods. No current evidence supports any single prevention method for MTSS. The most promising outcomes support the use of shock-absorbing insoles. Well-designed and controlled trials are critically needed to decrease the incidence of this common injury.

How to evaluate the microcirculation: report of a round table conference

PubMed Central

De Backer, Daniel; Hollenberg, Steven; Boerma, Christiaan; Goedhart, Peter; Büchele, Gustavo; Ospina-Tascon, Gustavo; Dobbe, Iwan; Ince, Can

2007-01-01

Introduction Microvascular alterations may play an important role in the development of organ failure in critically ill patients and especially in sepsis. Recent advances in technology have allowed visualization of the microcirculation, but several scoring systems have been used so it is sometimes difficult to compare studies. This paper reports the results of a round table conference that was organized in Amsterdam in November 2006 in order to achieve consensus on image acquisition and analysis. Methods The participants convened to discuss the various aspects of image acquisition and the different scores, and a consensus statement was drafted using the Delphi methodology. Results The participants identified the following five key points for optimal image acquisition: five sites per organ, avoidance of pressure artifacts, elimination of secretions, adequate focus and contrast adjustment, and recording quality. The scores that can be used to describe numerically the microcirculatory images consist of the following: a measure of vessel density (total and perfused vessel density; two indices of perfusion of the vessels (proportion of perfused vessels and microcirculatory flow index); and a heterogeneity index. In addition, this information should be provided for all vessels and for small vessels (mostly capillaries) identified as smaller than 20 μm. Venular perfusion should be reported as a quality control index, because venules should always be perfused in the absence of pressure artifact. It is anticipated that although this information is currently obtained manually, it is likely that image analysis software will ease analysis in the future. Conclusion We proposed that scoring of the microcirculation should include an index of vascular density, assessment of capillary perfusion and a heterogeneity index. PMID:17845716

The efficacy of manual joint mobilisation/manipulation in treatment of lateral ankle sprains: a systematic review.

PubMed

Loudon, Janice K; Reiman, Michael P; Sylvain, Jonathan

2014-03-01

Lateral ankle sprains are common and can have detrimental consequences to the athlete. Joint mobilisation/manipulation may limit these outcomes. Systematically summarise the effectiveness of manual joint techniques in treatment of lateral ankle sprains. This review employed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. A computer-assisted literature search of MEDLINE, CINHAL, EMBASE, OVID and Physiotherapy Evidence Database (PEDro) (January 1966 to March 2013) was used with the following keywords alone and in combination 'ankle', 'sprain', 'injuries', 'lateral', 'manual therapy', and 'joint mobilisation'. The methodological quality of individual studies was assessed using the PEDro scale. After screening of titles, abstracts and full articles, eight articles were kept for examination. Three articles achieved a score of 10 of 11 total points; one achieved a score of 9; two articles scored 8; one article scored a 7 and the remaining article scored a 5. Three articles examined joint techniques for acute sprains and the remainder examined subacute/chronic ankle sprains. Outcome measures included were pain level, ankle range of motion, swelling, functional score, stabilometry and gait parameters. The majority of the articles only assessed these outcome measures immediately after treatment. No detrimental effects from the joint techniques were revealed in any of the studies reviewed. For acute ankle sprains, manual joint mobilisation diminished pain and increased dorsiflexion range of motion. For treatment of subacute/chronic lateral ankle sprains, these techniques improved ankle range-of-motion, decreased pain and improved function.

REM desensitization as a new therapeutic method for post-traumatic stress disorder: a randomized controlled trial.

PubMed

Ahmadi, Khodabakhsh; Hazrati, Majid; Ahmadizadeh, Mohammadjavad; Noohi, Sima

2015-04-01

to evaluate potential efficacy of a new therapeutic approach in posttraumatic stress disorder in comparison with eye movement desensitization and reprocessing (EMDR), a standard treatment approach and controls. the study was designed using a randomized controlled trial methodology. Participants were recruited from military servicemen aged between 25 to 50 years who were admitting hospitals of Bushehr, Iran, with the final diagnosis of PTSD. Finally 33 male patients were devided into three subgroups: G1: EMDR; G2: REM Desensitization; and group 3: controls who received no therapy. Mississippi Scale for Posttraumatic Stress Disorder, Pittsburgh Sleep Quality Index (PSQI) and a 37 item death anxiety questionnaire were used for measures. multiple comparisons showed that intrusive thoughts were significantly more likely to improve with REM Desensitization versus EMDR (P=0.03), while depression was more responsive to EMDR (p=0.03). Among the Pittsburgh scale for the quality of sleep items, sleep quality (p=0.02), sleep duration (p=0.001), and total sleep quality score (p=0.002) were significantly more likely to improve in the REM Desensitization group. Change in the absolute death anxiety scores was not different between subgroups excepting EMDR versus control group (p=0.05). REM, desensitization, the new therapeutic approach to PTSD is a highly effective strategy, even more than EMDR, the standard treatment, in most of the evaluated subjects, with special emphasis on sleep symptoms, and also in the management of intrusive thoughts. Depression is the only factor in which, REM Desensitization was significantly less likely to represent a superior therapeutic effect than EMDR.

Characteristics of knowledge content in a curated online evidence library.

PubMed

Varada, Sowmya; Lacson, Ronilda; Raja, Ali S; Ip, Ivan K; Schneider, Louise; Osterbur, David; Bain, Paul; Vetrano, Nicole; Cellini, Jacqueline; Mita, Carol; Coletti, Margaret; Whelan, Julia; Khorasani, Ramin

2018-05-01

To describe types of recommendations represented in a curated online evidence library, report on the quality of evidence-based recommendations pertaining to diagnostic imaging exams, and assess underlying knowledge representation. The evidence library is populated with clinical decision rules, professional society guidelines, and locally developed best practice guidelines. Individual recommendations were graded based on a standard methodology and compared using chi-square test. Strength of evidence ranged from grade 1 (systematic review) through grade 5 (recommendations based on expert opinion). Finally, variations in the underlying representation of these recommendations were identified. The library contains 546 individual imaging-related recommendations. Only 15% (16/106) of recommendations from clinical decision rules were grade 5 vs 83% (526/636) from professional society practice guidelines and local best practice guidelines that cited grade 5 studies (P < .0001). Minor head trauma, pulmonary embolism, and appendicitis were topic areas supported by the highest quality of evidence. Three main variations in underlying representations of recommendations were "single-decision," "branching," and "score-based." Most recommendations were grade 5, largely because studies to test and validate many recommendations were absent. Recommendation types vary in amount and complexity and, accordingly, the structure and syntax of statements they generate. However, they can be represented in single-decision, branching, and score-based representations. In a curated evidence library with graded imaging-based recommendations, evidence quality varied widely, with decision rules providing the highest-quality recommendations. The library may be helpful in highlighting evidence gaps, comparing recommendations from varied sources on similar clinical topics, and prioritizing imaging recommendations to inform clinical decision support implementation.

Tailored Communication Within Mobile Apps for Diabetes Self-Management: A Systematic Review

PubMed Central

Wahl, Astrid Klopstad; Cvancarova Småstuen, Milada; Ribu, Lis

2017-01-01

Background The prevalence of diabetes is increasing and with the requirements for self-management and risk of late complications, it remains a challenge for the individual and society. Patients can benefit from support from health care personnel in their self-management, and the traditional communication between patients and health care personnel is changing. Smartphones and apps offer a unique platform for communication, but apps with integrated health care personnel communication based on patient data are yet to be investigated to provide evidence of possible effects. Objective Our goal was to systematically review studies that aimed to evaluate integrated communication within mobile apps for tailored feedback between patients with diabetes and health care personnel in terms of (1) study characteristics, (2) functions, (3) study outcomes, (4) effects, and (5) methodological quality. Methods A systematic literature search was conducted following our International Prospective Register of Systematic Reviews (PROSPERO) protocol, searching for apps with integrated communication for persons with diabetes tested in a controlled trial in the period 2008 to 2016. We searched the databases PubMed, Medical Literature Analysis and Retrieval System Online (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Central, Excerpta Medica database (EMBASE), ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform. The search was closed in September 2016. Reference lists of primary articles and review papers were assessed. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed, and we applied the Cochrane risk of bias tool to assess methodological quality. Results We identified 2822 citations and after duplicate removal, we assessed 1128 citations. A total of 6 papers were included in this systematic review, reporting on data from 431 persons participating in small trials of short duration. The integrated communication features were mostly individualized as written non–real-time feedback. The number of functions varied from 2 to 9, and blood glucose tracking was the most common. HbA1c was the most common primary outcome, but the remaining reported outcomes were not standardized and comparable. Because of both the heterogeneity of the included trials and the poor methodological quality of the studies, a meta-analysis was not possible. A statistically significant improvement in the primary measure of outcome was found in 3 of the 6 included studies, of which 2 were HbA1c and 1 was mean daytime ambulatory blood pressure. Participants in the included trials reported positive usability or feasibility postintervention in 5 out of 6 trials. The overall methodological quality of the trials was, however, scored as an uncertain risk of bias. Conclusions This systematic review highlights the need for more trials of higher methodological quality. Few studies offer an integrated function for communication and feedback from health care personnel, and the research field represents an area of heterogeneity with few studies of highly rigorous methodological quality. This, in combination with a low number of participants and a short follow-up, is making it difficult to provide reliable evidence of effects for stakeholders. PMID:28645890

Assessing the Medication Adherence App Marketplace From the Health Professional and Consumer Vantage Points

PubMed Central

2017-01-01

Background Nonadherence produces considerable health consequences and economic burden to patients and payers. One approach to improve medication nonadherence that has gained interest in recent years is the use of smartphone adherence apps. The development of smartphone adherence apps has increased rapidly since 2012; however, literature evaluating the clinical app and effectiveness of smartphone adherence apps to improve medication adherence is generally lacking. Objective The aims of this study were to (1) provide an updated evaluation and comparison of medication adherence apps in the marketplace by assessing the features, functionality, and health literacy (HL) of the highest-ranking adherence apps and (2) indirectly measure the validity of our rating methodology by determining the relationship between our app evaluations and Web-based consumer ratings. Methods Two independent reviewers assessed the features and functionality using a 4-domain rating tool of all adherence apps identified based on developer claims. The same reviewers downloaded and tested the 100 highest-ranking apps including an additional domain for assessment of HL. Pearson product correlations were estimated between the consumer ratings and our domain and total scores. Results A total of 824 adherence apps were identified; of these, 645 unique apps were evaluated after applying exclusion criteria. The median initial score based on descriptions was 14 (max of 68; range 0-60). As a result, 100 of the highest-scoring unique apps underwent user testing. The median overall user-tested score was 31.5 (max of 73; range 0-60). The majority of the user tested the adherence apps that underwent user testing reported a consumer rating score in their respective online marketplace. The mean consumer rating was 3.93 (SD 0.84). The total user-tested score was positively correlated with consumer ratings (r=.1969, P=.04). Conclusions More adherence apps are available in the Web-based marketplace, and the quality of these apps varies considerably. Consumer ratings are positively but weakly correlated with user-testing scores suggesting that our rating tool has some validity but that consumers and clinicians may assess adherence app quality differently. PMID:28428169

ReQON: a Bioconductor package for recalibrating quality scores from next-generation sequencing data

PubMed Central

2012-01-01

Background Next-generation sequencing technologies have become important tools for genome-wide studies. However, the quality scores that are assigned to each base have been shown to be inaccurate. If the quality scores are used in downstream analyses, these inaccuracies can have a significant impact on the results. Results Here we present ReQON, a tool that recalibrates the base quality scores from an input BAM file of aligned sequencing data using logistic regression. ReQON also generates diagnostic plots showing the effectiveness of the recalibration. We show that ReQON produces quality scores that are both more accurate, in the sense that they more closely correspond to the probability of a sequencing error, and do a better job of discriminating between sequencing errors and non-errors than the original quality scores. We also compare ReQON to other available recalibration tools and show that ReQON is less biased and performs favorably in terms of quality score accuracy. Conclusion ReQON is an open source software package, written in R and available through Bioconductor, for recalibrating base quality scores for next-generation sequencing data. ReQON produces a new BAM file with more accurate quality scores, which can improve the results of downstream analysis, and produces several diagnostic plots showing the effectiveness of the recalibration. PMID:22946927

Vasomotor and physical menopausal symptoms are associated with sleep quality.

PubMed

Kim, Min-Ju; Yim, Gyeyoon; Park, Hyun-Young

2018-01-01

Sleep disturbance is one of the common complaints in menopause. This study investigated the relationship between menopausal symptoms and sleep quality in middle-aged women. This cross-sectional observational study involved 634 women aged 44-56 years attending a healthcare center at Kangbuk Samsung Hospitals. Sleep quality was measured using the Pittsburgh Sleep Quality Index (PSQI).Multiple linear regression analysis was performed to assess the associations between Menopause-specific Quality of Life (MENQOL) scores and PSQI scores and Menopause-specific Quality of Life (MENQOL)scores. The mean PSQI score was 3.6±2.3, and the rates of poor sleep quality(PSQI score > 5) in premenopausal, perimenopausal, and postmenopausal women were 14.4%, 18.2%, and 30.2%, respectively. Total PSQI score, specifically the sleep latency, habitual sleep efficiency and sleep disturbances scores, were significantly increased in postmenopausal women. Multiple linear regression analysis adjusted for age, BMI, hypertension, diabetes, smoking, marital status, family income, education, employment status, parity, physical activity, depression symptoms, perceived stress and menopausal status showed that higher PSQI score was positively correlated with higher vasomotor(ß = 0.240, P = 0.020)and physical(ß = 0.572, P<0.001) scores. Vasomotor and physical menopause symptoms was related to poor sleep quality. Effective management strategies aimed at reducing menopausal symptoms may improve sleep quality among women around the time of menopause.