Systematic reviews identify important methodological flaws in stroke rehabilitation therapy primary studies: review of reviews.

PubMed

Santaguida, Pasqualina; Oremus, Mark; Walker, Kathryn; Wishart, Laurie R; Siegel, Karen Lohmann; Raina, Parminder

2012-04-01

A "review of reviews" was undertaken to assess methodological issues in studies evaluating nondrug rehabilitation interventions in stroke patients. MEDLINE, CINAHL, PsycINFO, and the Cochrane Database of Systematic Reviews were searched from January 2000 to January 2008 within the stroke rehabilitation setting. Electronic searches were supplemented by reviews of reference lists and citations identified by experts. Eligible studies were systematic reviews; excluded citations were narrative reviews or reviews of reviews. Review characteristics and criteria for assessing methodological quality of primary studies within them were extracted. The search yielded 949 English-language citations. We included a final set of 38 systematic reviews. Cochrane reviews, which have a standardized methodology, were generally of higher methodological quality than non-Cochrane reviews. Most systematic reviews used standardized quality assessment criteria for primary studies, but not all were comprehensive. Reviews showed that primary studies had problems with randomization, allocation concealment, and blinding. Baseline comparability, adverse events, and co-intervention or contamination were not consistently assessed. Blinding of patients and providers was often not feasible and was not evaluated as a source of bias. The eligible systematic reviews identified important methodological flaws in the evaluated primary studies, suggesting the need for improvement of research methods and reporting. Copyright © 2012 Elsevier Inc. All rights reserved.

Methodological quality of randomised controlled trials in burns care. A systematic review.

PubMed

Danilla, Stefan; Wasiak, Jason; Searle, Susana; Arriagada, Cristian; Pedreros, Cesar; Cleland, Heather; Spinks, Anneliese

2009-11-01

To evaluate the methodological quality of published randomised controlled trials (RCTs) in burn care treatment and management. Using a predetermined search strategy we searched Ovid MEDLINE (1950 to January 2008) database to identify all English RCTs related to burn care. Full text studies identified were reviewed for key demographic and methodological characteristics. Methodological trial quality was assessed using the Jadad scale. A total of 257 studies involving 14,535 patients met the inclusion criteria. The median Jadad score was 2 (out of a best possible score of 5). Information was given in the introduction and discussion sections of most RCTs, although insufficient detail was provided on randomisation, allocation concealment, and blinding. The number of RCTs increased between 1950 and 2008 (Spearman's rho=0.6129, P<0.001), although the reporting quality did not improve over the same time period (P=0.1896) and was better in RCTs with larger sample sizes (median Jadad score, 4 vs. 2 points, P<0.0001). Methodological quality did not correlate with journal impact factor (P=0.2371). The reporting standards of RCTs are highly variable and less than optimal in most cases. The advent of evidence-based medicine heralds a new approach to burns care and systematic steps are needed to improve the quality of RCTs in this field. Identifying and reviewing the existing number of RCTs not only highlights the need for burn clinicians to conduct more trials, but may also encourage burn health clinicians to consider the importance of conducting trials that follow appropriate, evidence-based standards.

Quality of systematic reviews in pediatric oncology--a systematic review.

PubMed

Lundh, Andreas; Knijnenburg, Sebastiaan L; Jørgensen, Anders W; van Dalen, Elvira C; Kremer, Leontien C M

2009-12-01

To ensure evidence-based decision making in pediatric oncology systematic reviews are necessary. The objective of our study was to evaluate the methodological quality of all currently existing systematic reviews in pediatric oncology. We identified eligible systematic reviews through a systematic search of the literature. Data on clinical and methodological characteristics of the included systematic reviews were extracted. The methodological quality of the included systematic reviews was assessed using the overview quality assessment questionnaire, a validated 10-item quality assessment tool. We compared the methodological quality of systematic reviews published in regular journals with that of Cochrane systematic reviews. We included 117 systematic reviews, 99 systematic reviews published in regular journals and 18 Cochrane systematic reviews. The average methodological quality of systematic reviews was low for all ten items, but the quality of Cochrane systematic reviews was significantly higher than systematic reviews published in regular journals. On a 1-7 scale, the median overall quality score for all systematic reviews was 2 (range 1-7), with a score of 1 (range 1-7) for systematic reviews in regular journals compared to 6 (range 3-7) in Cochrane systematic reviews (p<0.001). Most systematic reviews in the field of pediatric oncology seem to have serious methodological flaws leading to a high risk of bias. While Cochrane systematic reviews were of higher methodological quality than systematic reviews in regular journals, some of them also had methodological problems. Therefore, the methodology of each individual systematic review should be scrutinized before accepting its results.

Tracer methodology: an appropriate tool for assessing compliance with accreditation standards?

PubMed

Bouchard, Chantal; Jean, Olivier

2017-10-01

Tracer methodology has been used by Accreditation Canada since 2008 to collect evidence on the quality and safety of care and services, and to assess compliance with accreditation standards. Given the importance of this methodology in the accreditation program, the objective of this study is to assess the quality of the methodology and identify its strengths and weaknesses. A mixed quantitative and qualitative approach was adopted to evaluate consistency, appropriateness, effectiveness and stakeholder synergy in applying the methodology. An online questionnaire was sent to 468 Accreditation Canada surveyors. According to surveyors' perceptions, tracer methodology is an effective tool for collecting useful, credible and reliable information to assess compliance with Qmentum program standards and priority processes. The results show good coherence between methodology components (appropriateness of the priority processes evaluated, activities to evaluate a tracer, etc.). The main weaknesses are the time constraints faced by surveyors and management's lack of cooperation during the evaluation of tracers. The inadequate amount of time allowed for the methodology to be applied properly raises questions about the quality of the information obtained. This study paves the way for a future, more in-depth exploration of the identified weaknesses to help the accreditation organization make more targeted improvements to the methodology. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Reporting and methodological quality of meta-analyses in urological literature

PubMed Central

Xu, Jing

2017-01-01

Purpose To assess the overall quality of published urological meta-analyses and identify predictive factors for high quality. Materials and Methods We systematically searched PubMed to identify meta-analyses published from January 1st, 2011 to December 31st, 2015 in 10 predetermined major paper-based urology journals. The characteristics of the included meta-analyses were collected, and their reporting and methodological qualities were assessed by the PRISMA checklist (27 items) and AMSTAR tool (11 items), respectively. Descriptive statistics were used for individual items as a measure of overall compliance, and PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. Logistic regression was used to identify predictive factors for high qualities. Results A total of 183 meta-analyses were included. The mean PRISMA and AMSTAR scores were 22.74 ± 2.04 and 7.57 ± 1.41, respectively. PRISMA item 5, protocol and registration, items 15 and 22, risk of bias across studies, items 16 and 23, additional analysis had less than 50% adherence. AMSTAR item 1, “a priori” design, item 5, list of studies and item 10, publication bias had less than 50% adherence. Logistic regression analyses showed that funding support and “a priori” design were associated with superior reporting quality, following PRISMA guideline and “a priori” design were associated with superior methodological quality. Conclusions Reporting and methodological qualities of recently published meta-analyses in major paper-based urology journals are generally good. Further improvement could potentially be achieved by strictly adhering to PRISMA guideline and having “a priori” protocol. PMID:28439452

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

National Water Quality Laboratory - A Profile

USGS Publications Warehouse

Raese, Jon W.

2001-01-01

The U.S. Geological Survey (USGS) National Water Quality Laboratory (NWQL) is a full-service laboratory that specializes in environmental analytical chemistry. The NWQL's primary mission is to support USGS programs requiring environmental analyses that provide consistent methodology for national assessment and trends analysis. The NWQL provides the following: high-quality chemical data; consistent, published, state-of-the-art methodology; extremely low-detection levels; high-volume capability; biological unit for identifying benthic invertebrates; quality assurance for determining long-term water-quality trends; and a professional staff.

Quality reporting of carotid intima-media thickness methodology; Current state of the science in the field of spinal cord injury.

PubMed

Hoskin, Jordan D; Miyatani, Masae; Craven, B Catharine

2017-03-30

Carotid intima-media thickness (cIMT) may be used increasingly as a cardiovascular disease (CVD) screening tool in individuals with spinal cord injury (SCI) as other routine invasive diagnostic tests are often unfeasible. However, variation in cIMT acquisition and analysis methods is an issue in the current published literature. The growth of the field is dependent on cIMT quality acquisition and analysis to ensure accurate reporting of CVD risk. The purpose of this study is to evaluate the quality of the reported methodology used to collect cIMT values in SCI. Data from 12 studies, which measured cIMT in individuals with SCI, were identified from the Medline, Embase and CINAHL databases. The quality of the reported methodologies was scored based on adherence to cIMT methodological guidelines abstracted from two consensus papers. Five studies were scored as 'moderate quality' in methodological reporting, having specified 9 to 11 of 15 quality reporting criterion. The remaining seven studies were scored as 'low quality', having reported less than 9 of 15 quality reporting criterion. No study had methodological reporting that was scored as 'high quality'. The overall reporting of quality methodology was poor in the published SCI literature. A greater adherence to current methodological guidelines is needed to advance the field of cIMT in SCI. Further research is necessary to refine cIMT acquisition and analysis guidelines to aid authors designing research and journals in screening manuscripts for publication.

Choosing Wisely: assessment of current US top five list recommendations’ trustworthiness using a pragmatic approach

PubMed Central

Horvath, Karl; Semlitsch, Thomas; Jeitler, Klaus; Abuzahra, Muna E; Posch, Nicole; Domke, Andreas; Siebenhofer, Andrea

2016-01-01

Objectives Identification of sufficiently trustworthy top 5 list recommendations from the US Choosing Wisely campaign. Setting Not applicable. Participants All top 5 list recommendations available from the American Board of Internal Medicine Foundation website. Main outcome measures/interventions Compilation of US top 5 lists and search for current German highly trustworthy (S3) guidelines. Extraction of guideline recommendations, including grade of recommendation (GoR), for suggestions comparable to top 5 list recommendations. For recommendations without guideline equivalents, the methodological quality of the top 5 list development process was assessed using criteria similar to that used to judge guidelines, and relevant meta-literature was identified in cited references. Judgement of sufficient trustworthiness of top 5 list recommendations was based either on an ‘A’ GoR of guideline equivalents or on high methodological quality and citation of relevant meta-literature. Results 412 top 5 list recommendations were identified. For 75 (18%), equivalents were found in current German S3 guidelines. 44 of these recommendations were associated with an ‘A’ GoR, or a strong recommendation based on strong evidence, and 26 had a ‘B’ or a ‘C’ GoR. No GoR was provided for 5 recommendations. 337 recommendations had no equivalent in the German S3 guidelines. The methodological quality of the development process was high and relevant meta-literature was cited for 87 top 5 list recommendations. For a further 36, either the methodological quality was high without any meta-literature citations or meta-literature citations existed but the methodological quality was lacking. For the remaining 214 recommendations, either the methodological quality was lacking and no literature was cited or the methodological quality was generally unsatisfactory. Conclusions 131 of current US top 5 list recommendations were found to be sufficiently trustworthy. For a substantial number of current US top 5 list recommendations, their trustworthiness remains unclear. Methodological requirements for developing top 5 lists are recommended. PMID:27855098

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

Methods for the guideline-based development of quality indicators--a systematic review

PubMed Central

2012-01-01

Background Quality indicators (QIs) are used in many healthcare settings to measure, compare, and improve quality of care. For the efficient development of high-quality QIs, rigorous, approved, and evidence-based development methods are needed. Clinical practice guidelines are a suitable source to derive QIs from, but no gold standard for guideline-based QI development exists. This review aims to identify, describe, and compare methodological approaches to guideline-based QI development. Methods We systematically searched medical literature databases (Medline, EMBASE, and CINAHL) and grey literature. Two researchers selected publications reporting methodological approaches to guideline-based QI development. In order to describe and compare methodological approaches used in these publications, we extracted detailed information on common steps of guideline-based QI development (topic selection, guideline selection, extraction of recommendations, QI selection, practice test, and implementation) to predesigned extraction tables. Results From 8,697 hits in the database search and several grey literature documents, we selected 48 relevant references. The studies were of heterogeneous type and quality. We found no randomized controlled trial or other studies comparing the ability of different methodological approaches to guideline-based development to generate high-quality QIs. The relevant publications featured a wide variety of methodological approaches to guideline-based QI development, especially regarding guideline selection and extraction of recommendations. Only a few studies reported patient involvement. Conclusions Further research is needed to determine which elements of the methodological approaches identified, described, and compared in this review are best suited to constitute a gold standard for guideline-based QI development. For this research, we provide a comprehensive groundwork. PMID:22436067

Measurement properties of rheumatoid arthritis-specific quality-of-life questionnaires: systematic review of the literature.

PubMed

Lee, Jiyeon; Kim, Soo Hyun; Moon, Seung Hei; Lee, Eun-Hyun

2014-12-01

This study conducted a systematic review of the methodological quality of the psychometric evaluation process and the quality of measurement properties of rheumatoid arthritis (RA)-specific health-related quality-of-life (HRQOL) questionnaires with the purpose of obtaining the best evidence to help in the selection of the most appropriate instrument for measuring HRQOL in RA patients. A systematic literature search was performed to identify RA-specific HRQOL questionnaires in databases. The methodological quality of the studies was assessed using the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. The quality of the measurement properties was assessed using quality criteria. The evidence regarding the measurement properties was pooled using best-evidence synthesis, with considerations of the number and methodological quality of the studies, and the consistency of their findings in terms of the quality of the measurement properties. The search identified 37 studies describing 9 instruments. Best-evidence synthesis suggested that the Rheumatoid Arthritis Quality of Life (RAQoL) questionnaire had the strongest positive evidence, especially with respect to reliability, measurement error, and content validity, and moderate positive evidence with respect to hypothesis testing and responsiveness. The current evidence suggests that the best-validated instrument among the RA-specific HRQOL measures is the RAQoL questionnaire in terms of both methodological quality in the process of psychometric evaluation and the quality of the measurement properties. However, there is limited evidence regarding internal consistency and structural validity of the RAQoL. Further efforts are warranted to establish the psychometric quality of this questionnaire.

Methodological quality of diagnostic accuracy studies on non-invasive coronary CT angiography: influence of QUADAS (Quality Assessment of Diagnostic Accuracy Studies included in systematic reviews) items on sensitivity and specificity.

PubMed

Schueler, Sabine; Walther, Stefan; Schuetz, Georg M; Schlattmann, Peter; Dewey, Marc

2013-06-01

To evaluate the methodological quality of diagnostic accuracy studies on coronary computed tomography (CT) angiography using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies included in systematic reviews) tool. Each QUADAS item was individually defined to adapt it to the special requirements of studies on coronary CT angiography. Two independent investigators analysed 118 studies using 12 QUADAS items. Meta-regression and pooled analyses were performed to identify possible effects of methodological quality items on estimates of diagnostic accuracy. The overall methodological quality of coronary CT studies was merely moderate. They fulfilled a median of 7.5 out of 12 items. Only 9 of the 118 studies fulfilled more than 75 % of possible QUADAS items. One QUADAS item ("Uninterpretable Results") showed a significant influence (P = 0.02) on estimates of diagnostic accuracy with "no fulfilment" increasing specificity from 86 to 90 %. Furthermore, pooled analysis revealed that each QUADAS item that is not fulfilled has the potential to change estimates of diagnostic accuracy. The methodological quality of studies investigating the diagnostic accuracy of non-invasive coronary CT is only moderate and was found to affect the sensitivity and specificity. An improvement is highly desirable because good methodology is crucial for adequately assessing imaging technologies. • Good methodological quality is a basic requirement in diagnostic accuracy studies. • Most coronary CT angiography studies have only been of moderate design quality. • Weak methodological quality will affect the sensitivity and specificity. • No improvement in methodological quality was observed over time. • Authors should consider the QUADAS checklist when undertaking accuracy studies.

On the methodology of Engineering Geodesy

NASA Astrophysics Data System (ADS)

Brunner, Fritz K.

2007-09-01

Textbooks on geodetic surveying usually describe a very small number of principles which should provide the foundation of geodetic surveying. Here, the author argues that an applied field, such as engineering geodesy, has a methodology as foundation rather than a few principles. Ten methodological elements (ME) are identified: (1) Point discretisation of natural surfaces and objects, (2) distinction between coordinate and observation domain, (3) definition of reference systems, (4) specification of unknown parameters and desired precisions, (5) geodetic network and observation design, (6) quality control of equipment, (7) quality control of measurements, (8) establishment of measurement models, (9) establishment of parameter estimation models, (10) quality control of results. Each ME consists of a suite of theoretical developments, geodetic techniques and calculation procedures, which will be discussed. This paper is to be considered a first attempt at identifying the specific elements of the methodology of engineering geodesy. A better understanding of this methodology could lead to an increased objectivity, to a transformation of subjective practical experiences into objective working methods, and consequently to a new structure for teaching this rather diverse subject.

Navigating Survival: Quality of Life Following Bone Marrow Transplantation.

DTIC Science & Technology

1991-01-01

This study explored the quality of life of adult Bone Marrow Transplantation (BMT) survivors and processes involved in maintaining or enhancing life...quality were identified. Ground theory methodology was used to explore quality of life from the survivor’s perspective. Five adults, 87 to 578 days...processes employed by BMT survivors to manage quality of life disruptions. BMT survivors identified disruptions in quality of life during the rapid

Methodological quality of behavioural weight loss studies: a systematic review

PubMed Central

Lemon, S. C.; Wang, M. L.; Haughton, C. F.; Estabrook, D. P.; Frisard, C. F.; Pagoto, S. L.

2018-01-01

Summary This systematic review assessed the methodological quality of behavioural weight loss intervention studies conducted among adults and associations between quality and statistically significant weight loss outcome, strength of intervention effectiveness and sample size. Searches for trials published between January, 2009 and December, 2014 were conducted using PUBMED, MEDLINE and PSYCINFO and identified ninety studies. Methodological quality indicators included study design, anthropometric measurement approach, sample size calculations, intent-to-treat (ITT) analysis, loss to follow-up rate, missing data strategy, sampling strategy, report of treatment receipt and report of intervention fidelity (mean = 6.3). Indicators most commonly utilized included randomized design (100%), objectively measured anthropometrics (96.7%), ITT analysis (86.7%) and reporting treatment adherence (76.7%). Most studies (62.2%) had a follow-up rate >75% and reported a loss to follow-up analytic strategy or minimal missing data (69.9%). Describing intervention fidelity (34.4%) and sampling from a known population (41.1%) were least common. Methodological quality was not associated with reporting a statistically significant result, effect size or sample size. This review found the published literature of behavioural weight loss trials to be of high quality for specific indicators, including study design and measurement. Identified for improvement include utilization of more rigorous statistical approaches to loss to follow up and better fidelity reporting. PMID:27071775

Evidence and practice in spine registries

PubMed Central

van Hooff, Miranda L; Jacobs, Wilco C H; Willems, Paul C; Wouters, Michel W J M; de Kleuver, Marinus; Peul, Wilco C; Ostelo, Raymond W J G; Fritzell, Peter

2015-01-01

Background and purpose We performed a systematic review and a survey in order to (1) evaluate the evidence for the impact of spine registries on the quality of spine care, and with that, on patient-related outcomes, and (2) evaluate the methodology used to organize, analyze, and report the “quality of spine care” from spine registries. Methods To study the impact, the literature on all spinal disorders was searched. To study methodology, the search was restricted to degenerative spinal disorders. The risk of bias in the studies included was assessed with the Newcastle-Ottawa scale. Additionally, a survey among registry representatives was performed to acquire information about the methodology and practice of existing registries. Results 4,273 unique references up to May 2014 were identified, and 1,210 were eligible for screening and assessment. No studies on impact were identified, but 34 studies were identified to study the methodology. Half of these studies (17 of the 34) were judged to have a high risk of bias. The survey identified 25 spine registries, representing 14 countries. The organization of these registries, methods used, analytical approaches, and dissemination of results are presented. Interpretation We found a lack of evidence that registries have had an impact on the quality of spine care, regardless of whether intervention was non-surgical and/or surgical. To improve the quality of evidence published with registry data, we present several recommendations. Application of these recommendations could lead to registries showing trends, monitoring the quality of spine care given, and ultimately improving the value of the care given to patients with degenerative spinal disorders. PMID:25909475

[Method for the quality assessment of data collection processes in epidemiological studies].

PubMed

Schöne, G; Damerow, S; Hölling, H; Houben, R; Gabrys, L

2017-10-01

For a quantitative evaluation of primary data collection processes in epidemiological surveys based on accompaniments and observations (in the field), there is no description of test criteria and methodologies in relevant literature and thus no known application in practice. Therefore, methods need to be developed and existing procedures adapted. The aim was to identify quality-relevant developments within quality dimensions by means of inspection points (quality indicators) during the process of data collection. As a result we seek to implement and establish a methodology for the assessment of overall survey quality supplementary to standardized data analyses. Monitors detect deviations from standard primary data collection during site visits by applying standardized checklists. Quantitative results - overall and for each dimension - are obtained by numerical calculation of quality indicators. Score results are categorized and color coded. This visual prioritization indicates necessity for intervention. The results obtained give clues regarding the current quality of data collection. This allows for the identification of such sections where interventions for quality improvement are needed. In addition, process quality development can be shown over time on an intercomparable basis. This methodology for the evaluation of data collection quality can identify deviations from norms, focalize quality analyses and help trace causes for significant deviations.

Methodological Quality of Randomized Clinical Trials of Respiratory Physiotherapy in Coronary Artery Bypass Grafting Patients in the Intensive Care Unit: a Systematic Review

PubMed Central

Lorscheitter, Jaqueline; Stein, Cinara; Plentz, Rodrigo Della Méa

2017-01-01

Objective To assess methodological quality of the randomized controlled trials of physiotherapy in patients undergoing coronary artery bypass grafting in the intensive care unit. Methods The studies published until May 2015, in MEDLINE, Cochrane and PEDro were included. The primary outcome extracted was proper filling of the Cochrane Collaboration's tool's items and the secondary was suitability to the requirements of the CONSORT Statement and its extension. Results From 807 studies identified, 39 were included. Most at CONSORT items showed a better adequacy after the statement's publication. Studies with positive outcomes presented better methodological quality. Conclusion The methodological quality of the studies has been improving over the years. However, many aspects can still be better designed. PMID:28977205

Methodological quality and reporting of systematic reviews in hand and wrist pathology.

PubMed

Wasiak, J; Shen, A Y; Ware, R; O'Donohoe, T J; Faggion, C M

2017-10-01

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions. I.

The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature.

PubMed

Pölkki, Tarja; Kanste, Outi; Kääriäinen, Maria; Elo, Satu; Kyngäs, Helvi

2014-02-01

To analyse systematic review articles published in the top 10 nursing journals to determine the quality of the methods employed within them. Systematic review is defined as a scientific research method that synthesises high-quality scientific knowledge on a given topic. The number of such reviews in nursing science has increased dramatically during recent years, but their methodological quality has not previously been assessed. A review of the literature using a narrative approach. Ranked impact factor scores for nursing journals were obtained from the Journal Citation Report database of the Institute of Scientific Information (ISI Web of Knowledge). All issues from the years 2009 and 2010 of the top 10 ranked journals were included. CINAHL and MEDLINE databases were searched to locate studies using the search terms 'systematic review' and 'systematic literature review'. A total of 39 eligible studies were identified. Their methodological quality was evaluated through the specific criteria of quality assessment, description of synthesis and strengths and weaknesses reported in the included studies. Most of the eligible systematic reviews included several different designs or types of quantitative study. The majority included a quality assessment, and a total of 17 different criteria were identified. The method of synthesis was mentioned in about half of the reviews, the most common being narrative synthesis. The weaknesses of reviews were discussed, while strengths were rarely highlighted. The methodological quality of the systematic reviews examined varied considerably, although they were all published in nursing journals with a high-impact factor. Despite the fact that systematic reviews are considered the most robust source of research evidence, they vary in methodological quality. This point is important to consider in clinical practice when applying the results to patient care. © 2013 Blackwell Publishing Ltd.

Use of methodological tools for assessing the quality of studies in periodontology and implant dentistry: a systematic review.

PubMed

Faggion, Clovis M; Huda, Fahd; Wasiak, Jason

2014-06-01

To evaluate the methodological approaches used to assess the quality of studies included in systematic reviews (SRs) in periodontology and implant dentistry. Two electronic databases (PubMed and Cochrane Database of Systematic Reviews) were searched independently to identify SRs examining interventions published through 2 September 2013. The reference lists of included SRs and records of 10 specialty dental journals were searched manually. Methodological approaches were assessed using seven criteria based on the Cochrane Handbook for Systematic Reviews of Interventions. Temporal trends in methodological quality were also explored. Of the 159 SRs with meta-analyses included in the analysis, 44 (28%) reported the use of domain-based tools, 15 (9%) reported the use of checklists and 7 (4%) reported the use of scales. Forty-two (26%) SRs reported use of more than one tool. Criteria were met heterogeneously; authors of 15 (9%) publications incorporated the quality of evidence of primary studies into SRs, whereas 69% of SRs reported methodological approaches in the Materials/Methods section. Reporting of four criteria was significantly better in recent (2010-2013) than in previous publications. The analysis identified several methodological limitations of approaches used to assess evidence in studies included in SRs in periodontology and implant dentistry. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Evaluation of the Factors That Determine Quality in Higher Education: An Empirical Study

ERIC Educational Resources Information Center

Tsinidou, Maria; Gerogiannis, Vassilis; Fitsilis, Panos

2010-01-01

Purpose: The aim of this paper is to identify the quality determinants for education services provided by higher education institutions (HEIs) in Greece and to measure their relative importance from the students' points of view. Design/methodology/approach: A multi-criteria decision-making methodology was used for assessing the relative importance…

Identifying Continuous Quality Improvement Priorities in Maternal, Infant, and Early Childhood Home Visiting.

PubMed

Preskitt, Julie; Fifolt, Matthew; Ginter, Peter M; Rucks, Andrew; Wingate, Martha S

2016-01-01

The purpose of this article was to describe a methodology to identify continuous quality improvement (CQI) priorities for one state's Maternal, Infant, and Early Childhood Home Visiting program from among the 40 required constructs associated with 6 program benchmarks. The authors discuss how the methodology provided consensus on system CQI quality measure priorities and describe variation among the 3 service delivery models used within the state. Q-sort methodology was used by home visiting (HV) service delivery providers (home visitors) to prioritize HV quality measures for the overall state HV system as well as their service delivery model. There was general consensus overall and among the service delivery models on CQI quality measure priorities, although some variation was observed. Measures associated with Maternal, Infant, and Early Childhood Home Visiting benchmark 1, Improved Maternal and Newborn Health, and benchmark 3, Improvement in School Readiness and Achievement, were the highest ranked. The Q-sort exercise allowed home visitors an opportunity to examine priorities within their service delivery model as well as for the overall First Teacher HV system. Participants engaged in meaningful discussions regarding how and why they selected specific quality measures and developed a greater awareness and understanding of a systems approach to HV within the state. The Q-sort methodology presented in this article can easily be replicated by other states to identify CQI priorities at the local and state levels and can be used effectively in states that use a single HV service delivery model or those that implement multiple evidence-based models for HV service delivery.

Psychometric evaluation of commonly used game-specific skills tests in rugby: A systematic review

PubMed Central

Oorschot, Sander; Chiwaridzo, Matthew; CM Smits-Engelsman, Bouwien

2017-01-01

Objectives To (1) give an overview of commonly used game-specific skills tests in rugby and (2) evaluate available psychometric information of these tests. Methods The databases PubMed, MEDLINE CINAHL and Africa Wide information were systematically searched for articles published between January 1995 and March 2017. First, commonly used game-specific skills tests were identified. Second, the available psychometrics of these tests were evaluated and the methodological quality of the studies assessed using the Consensus-based Standards for the selection of health Measurement Instruments checklist. Studies included in the first step had to report detailed information on the construct and testing procedure of at least one game-specific skill, and studies included in the second step had additionally to report at least one psychometric property evaluating reliability, validity or responsiveness. Results 287 articles were identified in the first step, of which 30 articles met the inclusion criteria and 64 articles were identified in the second step of which 10 articles were included. Reactive agility, tackling and simulated rugby games were the most commonly used tests. All 10 studies reporting psychometrics reported reliability outcomes, revealing mainly strong evidence. However, all studies scored poor or fair on methodological quality. Four studies reported validity outcomes in which mainly moderate evidence was indicated, but all articles had fair methodological quality. Conclusion Game-specific skills tests indicated mainly high reliability and validity evidence, but the studies lacked methodological quality. Reactive agility seems to be a promising domain, but the specific tests need further development. Future high methodological quality studies are required in order to develop valid and reliable test batteries for rugby talent identification. Trial registration number PROSPERO CRD42015029747. PMID:29259812

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles on Elbow Medial Ulnar Collateral Ligament Surgery.

PubMed

Jack, Robert A; Sochacki, Kyle R; Morehouse, Hannah A; McCulloch, Patrick C; Lintner, David M; Harris, Joshua D

2018-04-01

Several studies have analyzed the most cited articles in shoulder, elbow, pediatrics, and foot and ankle surgery. However, no study has analyzed the quality of the most cited articles in elbow medial ulnar collateral ligament (UCL) surgery. To (1) identify the top 50 most cited articles related to UCL surgery, (2) determine whether there was a correlation between the top cited articles and level of evidence, and (3) determine whether there was a correlation between study methodological quality and the top cited articles. Systematic review. Web of Science and Scopus online databases were searched to identify the top 50 cited articles in UCL surgery. Level of evidence, number of times cited, year of publication, name of journal, country of origin, and study type were recorded for each study. Study methodological quality was analyzed for each article with the Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS). Correlation coefficients were calculated. The 50 most cited articles were published between 1981 and 2015. The number of citations per article ranged from 20 to 301 (mean ± SD, 71 ± 62 citations). Most articles (92%) were from the United States and were level 3 (16%), level 4 (58%), or unclassified (16%) evidence. There were no articles of level 1 evidence quality. The mean MCMS and MINORS scores were 28.1 ± 13.4 (range, 3-52) and 9.2 ± 3.6 (range, 2-19), respectively. There was no significant correlation between the mean number of citations and level of evidence or quality ( r s = -0.01, P = .917), MCMS ( r s = 0.09, P = .571), or MINORS ( r s = -0.26, P = .089). The top 50 cited articles in UCL surgery constitute a low level of evidence and low methodological quality, including no level 1 articles. There was no significant correlation between the mean number of citations and level of evidence or study methodological quality. However, weak correlations were observed for later publication date and improved level of evidence and methodological quality.

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles on Elbow Medial Ulnar Collateral Ligament Surgery

PubMed Central

Jack, Robert A.; Sochacki, Kyle R.; Morehouse, Hannah A.; McCulloch, Patrick C.; Lintner, David M.; Harris, Joshua D.

2018-01-01

Background: Several studies have analyzed the most cited articles in shoulder, elbow, pediatrics, and foot and ankle surgery. However, no study has analyzed the quality of the most cited articles in elbow medial ulnar collateral ligament (UCL) surgery. Purpose: To (1) identify the top 50 most cited articles related to UCL surgery, (2) determine whether there was a correlation between the top cited articles and level of evidence, and (3) determine whether there was a correlation between study methodological quality and the top cited articles. Study Design: Systematic review. Methods: Web of Science and Scopus online databases were searched to identify the top 50 cited articles in UCL surgery. Level of evidence, number of times cited, year of publication, name of journal, country of origin, and study type were recorded for each study. Study methodological quality was analyzed for each article with the Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS). Correlation coefficients were calculated. Results: The 50 most cited articles were published between 1981 and 2015. The number of citations per article ranged from 20 to 301 (mean ± SD, 71 ± 62 citations). Most articles (92%) were from the United States and were level 3 (16%), level 4 (58%), or unclassified (16%) evidence. There were no articles of level 1 evidence quality. The mean MCMS and MINORS scores were 28.1 ± 13.4 (range, 3-52) and 9.2 ± 3.6 (range, 2-19), respectively. There was no significant correlation between the mean number of citations and level of evidence or quality (rs = –0.01, P = .917), MCMS (rs = 0.09, P = .571), or MINORS (rs = –0.26, P = .089). Conclusion: The top 50 cited articles in UCL surgery constitute a low level of evidence and low methodological quality, including no level 1 articles. There was no significant correlation between the mean number of citations and level of evidence or study methodological quality. However, weak correlations were observed for later publication date and improved level of evidence and methodological quality. PMID:29780841

Does updating improve the methodological and reporting quality of systematic reviews?

PubMed

Shea, Beverley; Boers, Maarten; Grimshaw, Jeremy M; Hamel, Candyce; Bouter, Lex M

2006-06-13

Systematic reviews (SRs) must be of high quality. The purpose of our research was to compare the methodological and reporting quality of original versus updated Cochrane SRs to determine whether updating had improved these two quality dimensions. We identified updated Cochrane SRs published in issue 4, 2002 of the Cochrane Library. We assessed the updated and original versions of the SRs using two instruments: the 10 item enhanced Overview Quality Assessment Questionnaire (OQAQ), and an 18-item reporting quality checklist and flow chart based upon the Quality of Reporting of Meta-analyses (QUOROM) statement. At least two reviewers extracted data and assessed quality. We calculated the percentage (with a 95% confidence interval) of 'yes' answers to each question. We calculated mean differences in percentage, 95% confidence intervals and p-values for each of the individual items and the overall methodological quality score of the updated and pre-updated versions using OQAQ. We assessed 53 SRs. There was no significant improvement in the global quality score of the OQAQ (mean difference 0.11 (-0.28; 0.70 p = 0.52)). Updated reviews showed a significant improvement of 18.9 (7.2; 30.6 p < .01) on the OQAQ item assessing whether the conclusions drawn by the author(s) were supported by the data and/or analysis presented in the SR. The QUOROM statement showed that the quality of reporting of Cochrane reviews improved in some areas with updating. Improvements were seen on the items relating to data sources reported in the abstract, with a significant difference of 17.0 (9.8; 28.7 p = 0.01), review methods, reported in the abstract 35 (24.1; 49.1 p = 0.00), searching methods 18.9 (9.7; 31.6 p = 0.01), and data abstraction 18.9 (11.7; 30.9 p = 0.00). The overall quality of Cochrane SRs is fair-to-good. Although reporting quality improved on certain individual items there was no overall improvement seen with updating and methodological quality remained unchanged. Further improvement of quality of reporting is possible. There is room for improvement of methodological quality as well. Authors updating reviews should address identified methodological or reporting weaknesses. We recommend to give full attention to both quality domains when updating SRs.

Methodological quality of systematic reviews on influenza vaccination.

PubMed

Remschmidt, Cornelius; Wichmann, Ole; Harder, Thomas

2014-03-26

There is a growing body of evidence on the risks and benefits of influenza vaccination in various target groups. Systematic reviews are of particular importance for policy decisions. However, their methodological quality can vary considerably. To investigate the methodological quality of systematic reviews on influenza vaccination (efficacy, effectiveness, safety) and to identify influencing factors. A systematic literature search on systematic reviews on influenza vaccination was performed, using MEDLINE, EMBASE and three additional databases (1990-2013). Review characteristics were extracted and the methodological quality of the reviews was evaluated using the assessment of multiple systematic reviews (AMSTAR) tool. U-test, Kruskal-Wallis test, chi-square test, and multivariable linear regression analysis were used to assess the influence of review characteristics on AMSTAR-score. Fourty-six systematic reviews fulfilled the inclusion criteria. Average methodological quality was high (median AMSTAR-score: 8), but variability was large (AMSTAR range: 0-11). Quality did not differ significantly according to vaccination target group. Cochrane reviews had higher methodological quality than non-Cochrane reviews (p=0.001). Detailed analysis showed that this was due to better study selection and data extraction, inclusion of unpublished studies, and better reporting of study characteristics (all p<0.05). In the adjusted analysis, no other factor, including industry sponsorship or journal impact factor had an influence on AMSTAR score. Systematic reviews on influenza vaccination showed large differences regarding their methodological quality. Reviews conducted by the Cochrane collaboration were of higher quality than others. When using systematic reviews to guide the development of vaccination recommendations, the methodological quality of a review in addition to its content should be considered. Copyright © 2014 Elsevier Ltd. All rights reserved.

Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare.

PubMed

Nicolay, C R; Purkayastha, S; Greenhalgh, A; Benn, J; Chaturvedi, S; Phillips, N; Darzi, A

2012-03-01

The demand for the highest-quality patient care coupled with pressure on funding has led to the increasing use of quality improvement (QI) methodologies from the manufacturing industry. The aim of this systematic review was to identify and evaluate the application and effectiveness of these QI methodologies to the field of surgery. MEDLINE, the Cochrane Database, Allied and Complementary Medicine Database, British Nursing Index, Cumulative Index to Nursing and Allied Health Literature, Embase, Health Business(™) Elite, the Health Management Information Consortium and PsycINFO(®) were searched according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement. Empirical studies were included that implemented a described QI methodology to surgical care and analysed a named outcome statistically. Some 34 of 1595 articles identified met the inclusion criteria after consensus from two independent investigators. Nine studies described continuous quality improvement (CQI), five Six Sigma, five total quality management (TQM), five plan-do-study-act (PDSA) or plan-do-check-act (PDCA) cycles, five statistical process control (SPC) or statistical quality control (SQC), four Lean and one Lean Six Sigma; 20 of the studies were undertaken in the USA. The most common aims were to reduce complications or improve outcomes (11), to reduce infection (7), and to reduce theatre delays (7). There was one randomized controlled trial. QI methodologies from industry can have significant effects on improving surgical care, from reducing infection rates to increasing operating room efficiency. The evidence is generally of suboptimal quality, and rigorous randomized multicentre studies are needed to bring evidence-based management into the same league as evidence-based medicine. Copyright © 2011 British Journal of Surgery Society Ltd. Published by John Wiley & Sons, Ltd.

The Quality of an Action Research Thesis in the Social Sciences

ERIC Educational Resources Information Center

Zuber-Skerrit, Ortrun; Fletcher, Margaret

2007-01-01

Purpose: The paper seeks to identify the quality characteristics of critical action research and action research theses compared to traditional research thesis writing. Design/methodology/approach: Drawing on the literature and the authors' experience with supervising and examining action research theses, the paper identifies key problem areas in…

Identifying Quality in Preschool Education: Progress and Challenge

ERIC Educational Resources Information Center

Hughes, Jan N.

2010-01-01

In this article, the author comments on Dominguez, Vitiello, Maier, and Greenfield's (2010) article on identifying quality in preschool education. Dominguez et al. have conducted a methodologically sophisticated study describing the growth of learning behavior among Head Start children. By doing so, they contribute to a growing body of evidence…

Texas Quality Workforce Planning: 1993 Key Industries and Targeted Occupations for Texas' 24 Quality Work Force Planning Regions.

ERIC Educational Resources Information Center

Texas State Dept. of Commerce, Austin.

In 1993, Texas' 24 quality work force planning committees used a state-developed targeted occupations planning methodology to identify key industries and targeted occupations with the greatest potential for job openings in their respective regions. Between 11 and 20 key industries (13.5 on average) were identified for each region. The following 10…

Terrorism, Radicalisation, Extremism, Authoritarianism and Fundamentalism: A Systematic Review of the Quality and Psychometric Properties of Assessments.

PubMed

Scarcella, Akimi; Page, Ruairi; Furtado, Vivek

2016-01-01

Currently, terrorism and suicide bombing are global psychosocial processes that attracts a growing number of psychological and psychiatric contributions to enhance practical counter-terrorism measures. The present study is a systematic review that explores the methodological quality reporting and the psychometric soundness of the instruments developed to identify risk factors of terrorism, extremism, radicalisation, authoritarianism and fundamentalism. A systematic search strategy was established to identify instruments and studies developed to screen individuals at risk of committing extremist or terrorist offences using 20 different databases across the fields of law, medicine, psychology, sociology and politics. Information extracted was consolidated into two different tables and a 26-item checklist, reporting respectively background information, the psychometric properties of each tool, and the methodological quality markers of these tools. 37 articles met our criteria, which included a total of 4 instruments to be used operationally by professionals, 17 tools developed as research measures, and 9 inventories that have not been generated from a study. Just over half of the methodological quality markers required for a transparent methodological description of the instruments were reported. The amount of reported psychological properties was even fewer, with only a third of them available across the different studies. The category presenting the least satisfactory results was that containing the 4 instruments to be used operationally by professionals, which can be explained by the fact that half of them refrained from publishing the major part of their findings and relevant guidelines. A great number of flaws have been identified through this systematic review. The authors encourage future researchers to be more thorough, comprehensive and transparent in their methodology. They also recommend the creation of a multi-disciplinary joint working group in order to best tackle this growing contemporary problem.

What is the effectiveness of obesity related interventions at retail grocery stores and supermarkets? -a systematic review.

PubMed

Adam, Abdulfatah; Jensen, Jørgen D

2016-12-28

The Prevalence of obesity and overweight has been increasing in many countries. Many factors have been identified as contributing to obesity including the food environment, especially the access, availability and affordability of healthy foods in grocery stores and supermarkets. Several interventions have been carried out in retail grocery/supermarket settings as part of an effort to understand and influence consumption of healthful foods. The review's key outcome variable is sale/purchase of healthy foods as a result of the interventions. This systematic review sheds light on the effectiveness of food store interventions intended to promote the consumption of healthy foods and the methodological quality of studies reporting them. Systematic literature search spanning from 2003 to 2015 (inclusive both years), and confined to papers in the English language was conducted. Studies fulfilling search criteria were identified and critically appraised. Studies included in this review report health interventions at physical food stores including supermarkets and corner stores, and with outcome variable of adopting healthier food purchasing/consumption behavior. The methodological quality of all included articles has been determined using a validated 16-item quality assessment tool (QATSDD). The literature search identified 1580 publications, of which 42 met the inclusion criteria. Most interventions used a combination of information (e.g. awareness raising through food labeling, promotions, campaigns, etc.) and increasing availability of healthy foods such as fruits and vegetables. Few used price interventions. The average quality score for all papers is 65.0%, or an overall medium methodological quality. Apart from few studies, most studies reported that store interventions were effective in promoting purchase of healthy foods. Given the diverse study settings and despite the challenges of methodological quality for some papers, we find efficacy of in-store healthy food interventions in terms of increased purchase of healthy foods. Researchers need to take risk of bias and methodological quality into account when designing future studies that should guide policy makers. Interventions which combine price, information and easy access to and availability of healthy foods with interactive and engaging nutrition information, if carefully designed can help customers of food stores to buy and consume more healthy foods.

Reporting and Methodological Quality of Randomised Controlled Trials in Vascular and Endovascular Surgery.

PubMed

Hajibandeh, S; Hajibandeh, S; Antoniou, G A; Green, P A; Maden, M; Torella, F

2015-11-01

Randomised controlled trials (RCTs) are subject to bias if they lack methodological quality. Moreover, optimal and transparent reporting of RCT findings aids their critical appraisal and interpretation. The aim of this study was to ascertain whether the methodological and reporting quality of RCTs in vascular and endovascular surgery is improving. The most recent 75 and oldest 75 RCTs published in leading journals over a 10-year period (2003-2012) were identified. The reporting quality and methodological quality data of the old and new RCTs were extracted and compared. The former was analysed using the Consolidated Standards of Reporting Trials (CONSORT) statement, the latter with the Scottish Intercollegiate Guidelines Network (SIGN) checklist. Reporting quality measured by CONSORT was better in the new studies than in the old studies (0.68 [95% CI, 0.66-0.7] vs. 0.60 [95% CI, 0.58-0.62], p < .001); however, both new and old studies had similar methodological quality measured by SIGN (0.9 [IQR 0.1] vs. .09 [IQR: 0.2], p = .787). Unlike clinical items, the methodological items of the CONSORT statement were not well reported in old and new RCTs. More trials in the new group were endovascular related (33.33% vs. 17.33%, p = .038) and industry sponsored (28% vs. 6.67%, p = .001). Despite some progress, there remains room for improvement in the reporting quality of RCTs in vascular and endovascular surgery. The methodological quality of recent RCTs is similar to that of trials performed >10 years ago. Copyright © 2015 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.

Risk of bias in overviews of reviews: a scoping review of methodological guidance and four-item checklist.

PubMed

Ballard, Madeleine; Montgomery, Paul

2017-03-01

To assess the conditions under which employing an overview of systematic reviews is likely to lead to a high risk of bias. To synthesise existing guidance concerning overview practice, a scoping review was conducted. Four electronic databases were searched with a pre-specified strategy (PROSPERO 2015:CRD42015027592) ending October 2015. Included studies needed to describe or develop overview methodology. Data were narratively synthesised to delineate areas highlighted as outstanding challenges or where methodological recommendations conflict. Twenty-four papers met the inclusion criteria. There is emerging debate regarding overlapping systematic reviews; systematic review scope; quality of included research; updating; and synthesizing and reporting results. While three functions for overviews have been proposed-identify gaps, explore heterogeneity, summarize evidence-overviews cannot perform the first; are unlikely to achieve the second and third simultaneously; and can only perform the third under specific circumstances. Namely, when identified systematic reviews meet the following four conditions: (1) include primary trials that do not substantially overlap, (2) match overview scope, (3) are of high methodological quality, and (4) are up-to-date. Considering the intended function of proposed overviews with the corresponding methodological conditions may improve the quality of this burgeoning publication type. Copyright © 2017 John Wiley & Sons, Ltd. Copyright © 2017 John Wiley & Sons, Ltd.

Sports Injury Surveillance Systems: A Review of Methods and Data Quality.

PubMed

Ekegren, Christina L; Gabbe, Belinda J; Finch, Caroline F

2016-01-01

Data from sports injury surveillance systems are a prerequisite to the development and evaluation of injury prevention strategies. This review aimed to identify ongoing sports injury surveillance systems and determine whether there are gaps in our understanding of injuries in certain sport settings. A secondary aim was to determine which of the included surveillance systems have evaluated the quality of their data, a key factor in determining their usefulness. A systematic search was carried out to identify (1) publications presenting methodological details of sports injury surveillance systems within clubs and organisations; and (2) publications describing quality evaluations and the quality of data from these systems. Data extracted included methodological details of the surveillance systems, methods used to evaluate data quality, and results of these evaluations. Following literature search and review, a total of 15 sports injury surveillance systems were identified. Data relevant to each aim were summarised descriptively. Most systems were found to exist within professional and elite sports. Publications concerning data quality were identified for seven (47%) systems. Validation of system data through comparison with alternate sources has been undertaken for only four systems (27%). This review identified a shortage of ongoing injury surveillance data from amateur and community sport settings and limited information about the quality of data in professional and elite settings. More surveillance systems are needed across a range of sport settings, as are standards for data quality reporting. These efforts will enable better monitoring of sports injury trends and the development of sports safety strategies.

[Integrated Quality Management System (IQMS): a model for improving the quality of reproductive health care in rural Kenya].

PubMed

Herrler, Claudia; Bramesfeld, Anke; Brodowski, Marc; Prytherch, Helen; Marx, Irmgard; Nafula, Maureen; Richter-Aairijoki, Heide; Musyoka, Lucy; Marx, Michael; Szecsenyi, Joachim

2015-01-01

To develop a model aiming to improve the quality of services for reproductive health care in rural Kenya and designed to measure the quality of reproductive health services in such a way that allows these services to identify measures for improving their performance. The Integrated Quality Management System (IQMS) was developed on the basis of a pre-existing and validated model for quality promotion, namely the European Practice Assessment (EPA). The methodology for quality assessment and feedback of assessment results to the service teams was adopted from the EPA model. Quality assessment methodology included data assessment through staff, patient surveys and service visitation. Quality is assessed by indicators, and so indicators had to be developed that were appropriate for assessing reproductive health care in rural Kenya. A search of the Kenyan and international literature was conducted to identify potential indicators. These were then rated for their relevance and clarity by a panel of Kenyan experts. 260 indicators were rated as relevant and assigned to 29 quality dimensions and 5 domains. The implementation of IQMS in ten facilities showed that IQMS is a feasible model for assessing the quality of reproductive health services in rural Kenya. IQMS enables these services to identify quality improvement targets and necessary improvement measures. Both strengths and limitations of IQMS will be discussed. Copyright © 2015. Published by Elsevier GmbH.

Investigating the application of AOP methodology in development of Financial Accounting Software using Eclipse-AJDT Environment

NASA Astrophysics Data System (ADS)

Sharma, Amita; Sarangdevot, S. S.

2010-11-01

Aspect-Oriented Programming (AOP) methodology has been investigated in development of real world business application software—Financial Accounting Software. Eclipse-AJDT environment has been used as open source enhanced IDE support for programming in AOP language—Aspect J. Crosscutting concerns have been identified and modularized as aspects. This reduces the complexity of the design considerably due to elimination of code scattering and tangling. Improvement in modularity, quality and performance is achieved. The study concludes that AOP methodology in Eclipse-AJDT environment offers powerful support for modular design and implementation of real world quality business software.

Identifying approaches for assessing methodological and reporting quality of systematic reviews: a descriptive study.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-06-19

The methodological quality and completeness of reporting of the systematic reviews (SRs) is fundamental to optimal implementation of evidence-based health care and the reduction of research waste. Methods exist to appraise SRs yet little is known about how they are used in SRs or where there are potential gaps in research best-practice guidance materials. The aims of this study are to identify reports assessing the methodological quality (MQ) and/or reporting quality (RQ) of a cohort of SRs and to assess their number, general characteristics, and approaches to 'quality' assessment over time. The Cochrane Library, MEDLINE®, and EMBASE® were searched from January 1990 to October 16, 2014, for reports assessing MQ and/or RQ of SRs. Title, abstract, and full-text screening of all reports were conducted independently by two reviewers. Reports assessing the MQ and/or RQ of a cohort of ten or more SRs of interventions were included. All results are reported as frequencies and percentages of reports. Of 20,765 unique records retrieved, 1189 of them were reviewed for full-text review, of which 76 reports were included. Eight previously published approaches to assessing MQ or reporting guidelines used as proxy to assess RQ were used in 80% (61/76) of identified reports. These included two reporting guidelines (PRISMA and QUOROM) and five quality assessment tools (AMSTAR, R-AMSTAR, OQAQ, Mulrow, Sacks) and GRADE criteria. The remaining 24% (18/76) of reports developed their own criteria. PRISMA, OQAQ, and AMSTAR were the most commonly used published tools to assess MQ or RQ. In conjunction with other approaches, published tools were used in 29% (22/76) of reports, with 36% (8/22) assessing adherence to both PRISMA and AMSTAR criteria and 26% (6/22) using QUOROM and OQAQ. The methods used to assess quality of SRs are diverse, and none has become universally accepted. The most commonly used quality assessment tools are AMSTAR, OQAQ, and PRISMA. As new tools and guidelines are developed to improve both the MQ and RQ of SRs, authors of methodological studies are encouraged to put thoughtful consideration into the use of appropriate tools to assess quality and reporting.

Identifying individual changes in performance with composite quality indicators while accounting for regression to the mean.

PubMed

Gajewski, Byron J; Dunton, Nancy

2013-04-01

Almost a decade ago Morton and Torgerson indicated that perceived medical benefits could be due to "regression to the mean." Despite this caution, the regression to the mean "effects on the identification of changes in institutional performance do not seem to have been considered previously in any depth" (Jones and Spiegelhalter). As a response, Jones and Spiegelhalter provide a methodology to adjust for regression to the mean when modeling recent changes in institutional performance for one-variable quality indicators. Therefore, in our view, Jones and Spiegelhalter provide a breakthrough methodology for performance measures. At the same time, in the interests of parsimony, it is useful to aggregate individual quality indicators into a composite score. Our question is, can we develop and demonstrate a methodology that extends the "regression to the mean" literature to allow for composite quality indicators? Using a latent variable modeling approach, we extend the methodology to the composite indicator case. We demonstrate the approach on 4 indicators collected by the National Database of Nursing Quality Indicators. A simulation study further demonstrates its "proof of concept."

Using QALYs in telehealth evaluations: a systematic review of methodology and transparency.

PubMed

Bergmo, Trine S

2014-08-03

The quality-adjusted life-year (QALY) is a recognised outcome measure in health economic evaluations. QALY incorporates individual preferences and identifies health gains by combining mortality and morbidity into one single index number. A literature review was conducted to examine and discuss the use of QALYs to measure outcomes in telehealth evaluations. Evaluations were identified via a literature search in all relevant databases. Only economic evaluations measuring both costs and QALYs using primary patient level data of two or more alternatives were included. A total of 17 economic evaluations estimating QALYs were identified. All evaluations used validated generic health related-quality of life (HRQoL) instruments to describe health states. They used accepted methods for transforming the quality scores into utility values. The methodology used varied between the evaluations. The evaluations used four different preference measures (EQ-5D, SF-6D, QWB and HUI3), and utility scores were elicited from the general population. Most studies reported the methodology used in calculating QALYs. The evaluations were less transparent in reporting utility weights at different time points and variability around utilities and QALYs. Few made adjustments for differences in baseline utilities. The QALYs gained in the reviewed evaluations varied from 0.001 to 0.118 in implying a small but positive effect of telehealth intervention on patient's health. The evaluations reported mixed cost-effectiveness results. The use of QALYs in telehealth evaluations has increased over the last few years. Different methodologies and utility measures have been used to calculate QALYs. A more harmonised methodology and utility measure is needed to ensure comparability across telehealth evaluations.

The Association between Learning Styles and Perception of Teaching Quality

ERIC Educational Resources Information Center

Jepsen, Denise M.; Varhegyi, Melinda M.; Teo, Stephen T. T.

2015-01-01

Purpose: Although learning styles and teaching quality have been studied separately, the association between the association between the two has yet to be identified. The purpose of this paper is to establish the relationship between students' learning styles with students' perceptions of teaching quality. Design/methodology/approach: The study…

A review of economic evaluations of behavior change interventions: setting an agenda for research methods and practice.

PubMed

Alayli-Goebbels, Adrienne F G; Evers, Silvia M A A; Alexeeva, Daria; Ament, André J H A; de Vries, Nanne K; Tilly, Jan C; Severens, Johan L

2014-06-01

The objective of this study was to review methodological quality of economic evaluations of lifestyle behavior change interventions (LBCIs) and to examine how they address methodological challenges for public health economic evaluation identified in the literature. Pubmed and the NHS economic evaluation database were searched for published studies in six key areas for behavior change: smoking, physical activity, dietary behavior, (illegal) drug use, alcohol use and sexual behavior. From included studies (n = 142), we extracted data on general study characteristics, characteristics of the LBCIs, methodological quality and handling of methodological challenges. Economic evaluation evidence for LBCIs showed a number of weaknesses: methods, study design and characteristics of evaluated interventions were not well reported; methodological quality showed several shortcomings and progress with addressing methodological challenges remained limited. Based on the findings of this review we propose an agenda for improving future evidence to support decision-making. Recommendations for practice include improving reporting of essential study details and increasing adherence with good practice standards. Recommendations for research methods focus on mapping out complex causal pathways for modeling, developing measures to capture broader domains of wellbeing and community outcomes, testing methods for considering equity, identifying relevant non-health sector costs and advancing methods for evidence synthesis. © The Author 2013. Published by Oxford University Press on behalf of Faculty of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Advocating for Additional Aspects of Quality

ERIC Educational Resources Information Center

Herbel-Eisenmann, Beth A.

2016-01-01

Across the set of articles in this Special Issue, various authors describe methodology and methodological decisions, illustrate analyses, and share emerging findings from The Evolution of the Discourse of School Mathematics (EDSM) project. In general, the investigators were interested in identifying "changes over time in the kind of…

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Organ Donation European Quality System: ODEQUS project methodology.

PubMed

Manyalich, M; Guasch, X; Gomez, M P; Páez, G; Teixeira, L

2013-01-01

Differences in the number of organ donors among hospitals cannot be explained only by the number of intensive care unit beds used or neurologic patients treated. The figures obtained are influenced by the organizational structure of the donation process and how efficient it is. The Organ Donation European Quality System (ODEQUS) is a 3-year project (from October 2010 to September 2013) co-financed by the European Agency for Health and Consumers (EAHC20091108) which aims to define a methodology to evaluate organ procurement performance at the hospital level. ODEQUS's specific objectives are to identify quality criteria and to develop quality indicators in three types of organ donation (after brain death, after cardiac death, and living donation). Those tools will be useful for hospitals' self-assessment as well as for developing an international auditing model. A consortium has been established involving 14 associated partners from Austria, Croatia, France, Germany, Italy, Poland, Portugal, Romania, Spain, Sweden, and the United Kingdom, as well as five collaborating partners from Greece, Hungary, Malta, Slovenia, and Turkey. The project has been established in three steps: 1) Design of a survey about the use of quality tools in a wide sample of European hospitals; 2) Development of quality criteria and quality indicators by the project experts. The main fields considered have been organizational structures, clinical procedures, and outcomes; and 3) Elaboration of an evaluation system to test the quality indicators in 11 European hospitals. Two types of training have been designed and performed: one concerns the development of quality criteria and quality indicators, whereas another is focused on how to use evaluation tools. Following this methodology, the project has so far identified 131 quality criteria and developed 31 quality indicators. Currently, the quality indicators are being tested in 11 selected hospitals. Copyright © 2013 Elsevier Inc. All rights reserved.

The relationship between ground conditions and injury: what level of evidence do we have?

PubMed

Petrass, Lauren A; Twomey, Dara M

2013-03-01

To identify studies which address the relationship between ground conditions and injury, in a sporting context and to evaluate current practice and provide recommendations for future studies that measure ground conditions and injury risk. Systematic review. A comprehensive search of electronic databases from the earliest records available until the end of 2011, and supplemental hand searching was conducted to identify relevant studies. A classification scale was used to rate the methodological quality of studies. 79 potentially relevant articles were identified, and 27 met all inclusion criteria. They varied in methodological quality, with analytical observational studies the most common design, although four descriptive observational studies, considered to be of lower quality were also identified. Only five studies objectively measured ground conditions, and of studies that used subjective assessment, only one provided descriptors to explain their classifications. It appears that harder/drier grounds are associated with an increased injury risk but the presence of major limitations necessitates cautious interpretation of many key findings. There is limited high quality evidence of the relationship between injury risk and ground conditions. Further research with high quality designs, and measurement of ground conditions are required to draw more definitive conclusions regarding this relationship. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome

PubMed Central

Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety. PMID:26246841

A Systematic Overview of Reviews for Complementary and Alternative Therapies in the Treatment of the Fibromyalgia Syndrome.

PubMed

Lauche, Romy; Cramer, Holger; Häuser, Winfried; Dobos, Gustav; Langhorst, Jost

2015-01-01

Objectives. This systematic overview of reviews aimed to summarize evidence and methodological quality from systematic reviews of complementary and alternative medicine (CAM) for the fibromyalgia syndrome (FMS). Methods. The PubMed/MEDLINE, Cochrane Library, and Scopus databases were screened from their inception to Sept 2013 to identify systematic reviews and meta-analyses of CAM interventions for FMS. Methodological quality of reviews was rated using the AMSTAR instrument. Results. Altogether 25 systematic reviews were found; they investigated the evidence of CAM in general, exercised-based CAM therapies, manipulative therapies, Mind/Body therapies, acupuncture, hydrotherapy, phytotherapy, and homeopathy. Methodological quality of reviews ranged from lowest to highest possible quality. Consistently positive results were found for tai chi, yoga, meditation and mindfulness-based interventions, hypnosis or guided imagery, electromyogram (EMG) biofeedback, and balneotherapy/hydrotherapy. Inconsistent results concerned qigong, acupuncture, chiropractic interventions, electroencephalogram (EEG) biofeedback, and nutritional supplements. Inconclusive results were found for homeopathy and phytotherapy. Major methodological flaws included missing details on data extraction process, included or excluded studies, study details, and adaption of conclusions based on quality assessment. Conclusions. Despite a growing body of scientific evidence of CAM therapies for the management of FMS systematic reviews still show methodological flaws limiting definite conclusions about their efficacy and safety.

Measurement properties of patient reported outcome measures for spondyloarthritis: A systematic review.

PubMed

Png, Kelly; Kwan, Yu Heng; Leung, Ying Ying; Phang, Jie Kie; Lau, Jia Qi; Lim, Ka Keat; Chew, Eng Hui; Low, Lian Leng; Tan, Chuen Seng; Thumboo, Julian; Fong, Warren; Østbye, Truls

2018-03-21

This systematic review aimed to identify studies investigating measurement properties of patient reported outcome measures (PROMs) for spondyloarthritis (SpA), and to evaluate their methodological quality and level of evidence relating to the measurement properties of PROMs. This systematic review was guided by the preferred reporting items for systematic review and meta-analysis (PRISMA). Articles published before 30 June 2017 were retrieved from PubMed ® , Embase ® , and PsychINFO ® (Ovid). Methodological quality and level of evidence were evaluated according to recommendations from the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). We identified 60 unique PROMs from 125 studies in 39 countries. Twenty-one PROMs were validated for two or more SpA subtypes. The literature examined hypothesis testing (82.4%) most frequently followed by reliability (60.0%). A percentage of 77.7% and 42.7% of studies that assessed PROMs for hypothesis testing and reliability, respectively had "fair" or better methodological quality. Among the PROMs identified, 41.7% were studied in ankylosing spondylitis (AS) only and 23.3% were studied in psoriatic arthritis (PsA) only. The more extensively assessed PROMs included the ankylosing spondylitis quality of life (ASQoL) and bath ankylosing spondylitis functional index (BASFI) for ankylosing spondylitis, and the psoriatic arthritis quality of life questionnaire (VITACORA-19) for psoriatic arthritis. This study identified 60 unique PROMs through a systematic review and synthesized evidence of the measurement properties of the PROMs. There is a lack of validation of PROMs for use across SpA subtypes. Future studies may consider validating PROMs for use across different SpA subtypes. Copyright © 2018 Elsevier Inc. All rights reserved.

The methodological quality of nurse-sensitive indicators in Dutch hospitals: A descriptive exploratory research study.

PubMed

Kieft, R A M M; Stalpers, D; Jansen, A P M; Francke, A L; Delnoij, D M J

2018-06-01

Nurse-sensitive indicators (NSIs) are increasingly being developed and used to establish quality of nursing care in Western countries. The objective was to gain insights into the methodological quality of mandatory NSIs in Dutch hospitals, including indicators for pain, wound care, malnutrition and delirium. A descriptive exploratory design was used, starting with desk research into publicly available documents and reports describing the development of the NSIs included in this study. We used the validated Appraisal of Indicators through Research and Evaluation (AIRE) instrument to evaluate the methodological quality. Although the purpose and relevance of each individual NSI have been described, no detailed information about the criteria for selecting these topics is available. It is not clear which specific stakeholders participated and how their input was used. We found no information about the process of collecting and compiling scientific evidence. It is unclear whether and to what extent the usability of NSIs has been tested. The methodological quality of NSIs used in Dutch hospitals is less than optimal in various ways and it is therefore questionable if the indicators are accurate enough to identify changes or improve nursing practice. Our study also provides an example of how the methodological quality of NSIs can be assessed systematically, which is relevant considering the increasing use of NSIs in various countries. Copyright © 2018 Elsevier B.V. All rights reserved.

Methodological Quality of National Guidelines for Pediatric Inpatient Conditions

PubMed Central

Hester, Gabrielle; Nelson, Katherine; Mahant, Sanjay; Eresuma, Emily; Keren, Ron; Srivastava, Rajendu

2014-01-01

Background Guidelines help inform standardization of care for quality improvement (QI). The Pediatric Research in Inpatient Settings (PRIS) network published a prioritization list of inpatient conditions with high prevalence, cost, and variation in resource utilization across children’s hospitals. The methodological quality of guidelines for priority conditions is unknown. Objective To rate the methodological quality of national guidelines for 20 priority pediatric inpatient conditions. Design We searched sources including PubMed for national guidelines published 2002–2012. Guidelines specific to one organism, test or treatment, or institution were excluded. Guidelines were rated by two raters using a validated tool (AGREE II) with an overall rating on a 7-point scale (7–highest). Inter-rater reliability was measured with a weighted kappa coefficient. Results 17 guidelines met inclusion criteria for 13 conditions, 7 conditions yielded no relevant national guidelines. The highest methodological quality guidelines were for asthma, tonsillectomy, and bronchiolitis (mean overall rating 7, 6.5 and 6.5 respectively); the lowest were for sickle cell disease (2 guidelines) and dental caries (mean overall rating 4, 3.5, and 3 respectively). The overall weighted kappa was 0.83 (95% confidence interval 0.78–0.87). Conclusions We identified a group of moderate to high methodological quality national guidelines for priority pediatric inpatient conditions. Hospitals should consider these guidelines to inform QI initiatives. PMID:24677729

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students’ academic success. PMID:27031506

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

How can activity-based costing methodology be performed as a powerful tool to calculate costs and secure appropriate patient care?

PubMed

Lin, Blossom Yen-Ju; Chao, Te-Hsin; Yao, Yuh; Tu, Shu-Min; Wu, Chun-Ching; Chern, Jin-Yuan; Chao, Shiu-Hsiung; Shaw, Keh-Yuong

2007-04-01

Previous studies have shown the advantages of using activity-based costing (ABC) methodology in the health care industry. The potential values of ABC methodology in health care are derived from the more accurate cost calculation compared to the traditional step-down costing, and the potentials to evaluate quality or effectiveness of health care based on health care activities. This project used ABC methodology to profile the cost structure of inpatients with surgical procedures at the Department of Colorectal Surgery in a public teaching hospital, and to identify the missing or inappropriate clinical procedures. We found that ABC methodology was able to accurately calculate costs and to identify several missing pre- and post-surgical nursing education activities in the course of treatment.

Terrorism, Radicalisation, Extremism, Authoritarianism and Fundamentalism: A Systematic Review of the Quality and Psychometric Properties of Assessments

PubMed Central

Scarcella, Akimi; Page, Ruairi; Furtado, Vivek

2016-01-01

Background Currently, terrorism and suicide bombing are global psychosocial processes that attracts a growing number of psychological and psychiatric contributions to enhance practical counter-terrorism measures. The present study is a systematic review that explores the methodological quality reporting and the psychometric soundness of the instruments developed to identify risk factors of terrorism, extremism, radicalisation, authoritarianism and fundamentalism. Method A systematic search strategy was established to identify instruments and studies developed to screen individuals at risk of committing extremist or terrorist offences using 20 different databases across the fields of law, medicine, psychology, sociology and politics. Information extracted was consolidated into two different tables and a 26-item checklist, reporting respectively background information, the psychometric properties of each tool, and the methodological quality markers of these tools. 37 articles met our criteria, which included a total of 4 instruments to be used operationally by professionals, 17 tools developed as research measures, and 9 inventories that have not been generated from a study. Results Just over half of the methodological quality markers required for a transparent methodological description of the instruments were reported. The amount of reported psychological properties was even fewer, with only a third of them available across the different studies. The category presenting the least satisfactory results was that containing the 4 instruments to be used operationally by professionals, which can be explained by the fact that half of them refrained from publishing the major part of their findings and relevant guidelines. Conclusions A great number of flaws have been identified through this systematic review. The authors encourage future researchers to be more thorough, comprehensive and transparent in their methodology. They also recommend the creation of a multi-disciplinary joint working group in order to best tackle this growing contemporary problem. PMID:28002457

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand

PubMed Central

2013-01-01

Background Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. Methods A systematic search of 17 electronic databases and 13 websites for the period 1981–2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Results Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. Conclusions There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise. PMID:23663493

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand.

PubMed

Clifford, Anton C; Doran, Christopher M; Tsey, Komla

2013-05-13

Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. A systematic search of 17 electronic databases and 13 websites for the period 1981-2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise.

Development and Field Test of an Audit Tool and Tracer Methodology for Clinician Assessment of Quality in End-of-Life Care.

PubMed

Bookbinder, Marilyn; Hugodot, Amandine; Freeman, Katherine; Homel, Peter; Santiago, Elisabeth; Riggs, Alexa; Gavin, Maggie; Chu, Alice; Brady, Ellen; Lesage, Pauline; Portenoy, Russell K

2018-02-01

Quality improvement in end-of-life care generally acquires data from charts or caregivers. "Tracer" methodology, which assesses real-time information from multiple sources, may provide complementary information. The objective of this study was to develop a valid brief audit tool that can guide assessment and rate care when used in a clinician tracer to evaluate the quality of care for the dying patient. To identify items for a brief audit tool, 248 items were created to evaluate overall quality, quality in specific content areas (e.g., symptom management), and specific practices. Collected into three instruments, these items were used to interview professional caregivers and evaluate the charts of hospitalized patients who died. Evidence that this information could be validly captured using a small number of items was obtained through factor analyses, canonical correlations, and group comparisons. A nurse manager field tested tracer methodology using candidate items to evaluate the care provided to other patients who died. The survey of 145 deaths provided chart data and data from 445 interviews (26 physicians, 108 nurses, 18 social workers, and nine chaplains). The analyses yielded evidence of construct validity for a small number of items, demonstrating significant correlations between these items and content areas identified as latent variables in factor analyses. Criterion validity was suggested by significant differences in the ratings on these items between the palliative care unit and other units. The field test evaluated 127 deaths, demonstrated the feasibility of tracer methodology, and informed reworking of the candidate items into the 14-item Tracer EoLC v1. The Tracer EoLC v1 can be used with tracer methodology to guide the assessment and rate the quality of end-of-life care. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

The methodological quality of systematic reviews of animal studies in dentistry.

PubMed

Faggion, C M; Listl, S; Giannakopoulos, N N

2012-05-01

Systematic reviews and meta-analyses of animal studies are important for improving estimates of the effects of treatment and for guiding future clinical studies on humans. The purpose of this systematic review was to assess the methodological quality of systematic reviews and meta-analyses of animal studies in dentistry through using a validated checklist. A literature search was conducted independently and in duplicate in the PubMed and LILACS databases. References in selected systematic reviews were assessed to identify other studies not captured by the electronic searches. The methodological quality of studies was assessed independently and in duplicate by using the AMSTAR checklist; the quality was scored as low, moderate, or high. The reviewers were calibrated before the assessment and agreement between them was assessed using Cohen's Kappa statistic. Of 444 studies retrieved, 54 systematic reviews were selected after full-text assessment. Agreement between the reviewers was regarded as excellent. Only two studies were scored as high quality; 17 and 35 studies were scored as medium and low quality, respectively. There is room for improvement of the methodological quality of systematic reviews of animal studies in dentistry. Checklists, such as AMSTAR, can guide researchers in planning and executing systematic reviews and meta-analyses. For determining the need for additional investigations in animals and in order to provide good data for potential application in human, such reviews should be based on animal experiments performed according to sound methodological principles. Copyright © 2011 Elsevier Ltd. All rights reserved.

Effects of Regular Classes in Outdoor Education Settings: A Systematic Review on Students’ Learning, Social and Health Dimensions

PubMed Central

Becker, Christoph; Lauterbach, Gabriele; Spengler, Sarah; Dettweiler, Ulrich; Mess, Filip

2017-01-01

Background: Participants in Outdoor Education Programmes (OEPs) presumably benefit from these programmes in terms of their social and personal development, academic achievement and physical activity (PA). The aim of this systematic review was to identify studies about regular compulsory school- and curriculum-based OEPs, to categorise and evaluate reported outcomes, to assess the methodological quality, and to discuss possible benefits for students. Methods: We searched online databases to identify English- and German-language peer-reviewed journal articles that reported any outcomes on a student level. Two independent reviewers screened studies identified for eligibility and assessed the methodological quality. Results: Thirteen studies were included for analysis. Most studies used a case-study design, the average number of participants was moderate (mean valued (M) = 62.17; standard deviation (SD) = 64.12), and the methodological quality was moderate on average for qualitative studies (M = 0.52; SD = 0.11), and low on average for quantitative studies (M = 0.18; SD = 0.42). Eight studies described outcomes in terms of social dimensions, seven studies in learning dimensions and four studies were subsumed under additional outcomes, i.e., PA and health. Eleven studies reported positive, one study positive as well as negative, and one study reported negative effects. PA and mental health as outcomes were underrepresented. Conclusion: Tendencies were detected that regular compulsory school- and curriculum-based OEPs can promote students in respect of social, academic, physical and psychological dimensions. Very little is known concerning students’ PA or mental health. We recommend conducting more quasi-experimental design and longitudinal studies with a greater number of participants, and a high methodological quality to further investigate these tendencies. PMID:28475167

Effects of Regular Classes in Outdoor Education Settings: A Systematic Review on Students' Learning, Social and Health Dimensions.

PubMed

Becker, Christoph; Lauterbach, Gabriele; Spengler, Sarah; Dettweiler, Ulrich; Mess, Filip

2017-05-05

Participants in Outdoor Education Programmes (OEPs) presumably benefit from these programmes in terms of their social and personal development, academic achievement and physical activity (PA). The aim of this systematic review was to identify studies about regular compulsory school- and curriculum-based OEPs, to categorise and evaluate reported outcomes, to assess the methodological quality, and to discuss possible benefits for students. We searched online databases to identify English- and German-language peer-reviewed journal articles that reported any outcomes on a student level. Two independent reviewers screened studies identified for eligibility and assessed the methodological quality. Thirteen studies were included for analysis. Most studies used a case-study design, the average number of participants was moderate (mean valued (M) = 62.17; standard deviation (SD) = 64.12), and the methodological quality was moderate on average for qualitative studies (M = 0.52; SD = 0.11), and low on average for quantitative studies (M = 0.18; SD = 0.42). Eight studies described outcomes in terms of social dimensions, seven studies in learning dimensions and four studies were subsumed under additional outcomes, i.e., PA and health. Eleven studies reported positive, one study positive as well as negative, and one study reported negative effects. PA and mental health as outcomes were underrepresented. Tendencies were detected that regular compulsory school- and curriculum-based OEPs can promote students in respect of social, academic, physical and psychological dimensions. Very little is known concerning students' PA or mental health. We recommend conducting more quasi-experimental design and longitudinal studies with a greater number of participants, and a high methodological quality to further investigate these tendencies.

Effects of efforts to optimise morbidity and mortality rounds to serve contemporary quality improvement and educational goals: a systematic review.

PubMed

Smaggus, Andrew; Mrkobrada, Marko; Marson, Alanna; Appleton, Andrew

2018-01-01

The quality and safety movement has reinvigorated interest in optimising morbidity and mortality (M&M) rounds. We performed a systematic review to identify effective means of updating M&M rounds to (1) identify and address quality and safety issues, and (2) address contemporary educational goals. Relevant databases (Medline, Embase, PubMed, Education Resource Information Centre, Cumulative Index to Nursing and Allied Health Literature, Healthstar, and Global Health) were searched to identify primary sources. Studies were included if they (1) investigated an intervention applied to M&M rounds, (2) reported outcomes relevant to the identification of quality and safety issues, or educational outcomes relevant to quality improvement (QI), patient safety or general medical education and (3) included a control group. Study quality was assessed using the Medical Education Research Study Quality Instrument and Newcastle-Ottawa Scale-Education instruments. Given the heterogeneity of interventions and outcome measures, results were analysed thematically. The final analysis included 19 studies. We identified multiple effective strategies (updating objectives, standardising elements of rounds and attaching rounds to a formal quality committee) to optimise M&M rounds for a QI/safety purpose. These efforts were associated with successful integration of quality and safety content into rounds, and increased implementation of QI interventions. Consistent effects on educational outcomes were difficult to identify, likely due to the use of methodologies ill-fitted for educational research. These results are encouraging for those seeking to optimise the quality and safety mission of M&M rounds. However, the inability to identify consistent educational effects suggests the investigation of M&M rounds could benefit from additional methodologies (qualitative, mixed methods) in order to understand the complex mechanisms driving learning at M&M rounds. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Sexual health education interventions for young people: a methodological review.

PubMed Central

Oakley, A.; Fullerton, D.; Holland, J.; Arnold, S.; France-Dawson, M.; Kelley, P.; McGrellis, S.

1995-01-01

OBJECTIVES--To locate reports of sexual health education interventions for young people, assess the methodological quality of evaluations, identify the subgroup with a methodologically sound design, and assess the evidence with respect to the effectiveness of different approaches to promoting young people's sexual health. DESIGN--Survey of reports in English by means of electronic databases and hand searches for relevant studies conducted in the developed world since 1982. Papers were reviewed for eight methodological qualities. The evidence on effectiveness generated by studies meeting four core criteria was assessed. Judgments on effectiveness by reviewers and authors were compared. PAPERS--270 papers reporting sexual health interventions. MAIN OUTCOME MEASURE--The methodological quality of evaluations. RESULTS--73 reports of evaluations of sexual health interventions examining the effectiveness of these interventions in changing knowledge, attitudes, or behavioural outcomes were identified, of which 65 were separate outcome evaluations. Of these studies, 45 (69%) lacked random control groups, 44 (68%) failed to present preintervention and 38 (59%) postintervention data, and 26 (40%) omitted to discuss the relevance of loss of data caused by drop outs. Only 12 (18%) of the 65 outcome evaluations were judged to be methodologically sound. Academic reviewers were more likely than authors to judge studies as unclear because of design faults. Only two of the sound evaluations recorded interventions which were effective in showing an impact on young people's sexual behaviour. CONCLUSIONS--The design of evaluations in sexual health intervention needs to be improved so that reliable evidence of the effectiveness of different approaches to promoting young people's sexual health may be generated. PMID:7833754

Requirement Metrics for Risk Identification

NASA Technical Reports Server (NTRS)

Hammer, Theodore; Huffman, Lenore; Wilson, William; Rosenberg, Linda; Hyatt, Lawrence

1996-01-01

The Software Assurance Technology Center (SATC) is part of the Office of Mission Assurance of the Goddard Space Flight Center (GSFC). The SATC's mission is to assist National Aeronautics and Space Administration (NASA) projects to improve the quality of software which they acquire or develop. The SATC's efforts are currently focused on the development and use of metric methodologies and tools that identify and assess risks associated with software performance and scheduled delivery. This starts at the requirements phase, where the SATC, in conjunction with software projects at GSFC and other NASA centers is working to identify tools and metric methodologies to assist project managers in identifying and mitigating risks. This paper discusses requirement metrics currently being used at NASA in a collaborative effort between the SATC and the Quality Assurance Office at GSFC to utilize the information available through the application of requirements management tools.

Quality and Rigor of the Concept Mapping Methodology: A Pooled Study Analysis

ERIC Educational Resources Information Center

Rosas, Scott R.; Kane, Mary

2012-01-01

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative…

Guidance on assessing the methodological and reporting quality of toxicologically relevant studies: A scoping review.

PubMed

Samuel, Gbeminiyi O; Hoffmann, Sebastian; Wright, Robert A; Lalu, Manoj Mathew; Patlewicz, Grace; Becker, Richard A; DeGeorge, George L; Fergusson, Dean; Hartung, Thomas; Lewis, R Jeffrey; Stephens, Martin L

2016-01-01

Assessments of methodological and reporting quality are critical to adequately judging the credibility of a study's conclusions and to gauging its potential reproducibility. To aid those seeking to assess the methodological or reporting quality of studies relevant to toxicology, we conducted a scoping review of the available guidance with respect to four types of studies: in vivo and in vitro, (quantitative) structure-activity relationships ([Q]SARs), physico-chemical, and human observational studies. Our aims were to identify the available guidance in this diverse literature, briefly summarize each document, and distill the common elements of these documents for each study type. In general, we found considerable guidance for in vivo and human studies, but only one paper addressed in vitro studies exclusively. The guidance for (Q)SAR studies and physico-chemical studies was scant but authoritative. There was substantial overlap across guidance documents in the proposed criteria for both methodological and reporting quality. Some guidance documents address toxicology research directly, whereas others address preclinical research generally or clinical research and therefore may not be fully applicable to the toxicology context without some translation. Another challenge is the degree to which assessments of methodological quality in toxicology should focus on risk of bias - as in clinical medicine and healthcare - or be broadened to include other quality measures, such as confirming the identity of test substances prior to exposure. Our review is intended primarily for those in toxicology and risk assessment seeking an entry point into the extensive and diverse literature on methodological and reporting quality applicable to their work. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Quality and methodological challenges in Internet-based mental health trials.

PubMed

Ye, Xibiao; Bapuji, Sunita Bayyavarapu; Winters, Shannon; Metge, Colleen; Raynard, Mellissa

2014-08-01

To review the quality of Internet-based mental health intervention studies and their methodological challenges. We searched multiple literature databases to identify relevant studies according to the Population, Interventions, Comparators, Outcomes, and Study Design framework. Two reviewers independently assessed selection bias, allocation bias, confounding bias, blinding, data collection methods, and withdrawals/dropouts, using the Quality Assessment Tool for Quantitative Studies. We rated each component as strong, moderate, or weak and assigned a global rating (strong, moderate, or weak) to each study. We discussed methodological issues related to the study quality. Of 122 studies included, 31 (25%), 44 (36%), and 47 (39%) were rated strong, moderate, and weak, respectively. Only five studies were rated strong for all of the six quality components (three of them were published by the same group). Lack of blinding, selection bias, and low adherence were the top three challenges in Internet-based mental health intervention studies. The overall quality of Internet-based mental health intervention needs to improve. In particular, studies need to improve sample selection, intervention allocation, and blinding.

Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools

ERIC Educational Resources Information Center

Wendt, Oliver; Miller, Bridget

2012-01-01

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

Applying Quality Indicators to Single-Case Research Designs Used in Special Education: A Systematic Review

ERIC Educational Resources Information Center

Moeller, Jeremy D.; Dattilo, John; Rusch, Frank

2015-01-01

This study examined how specific guidelines and heuristics have been used to identify methodological rigor associated with single-case research designs based on quality indicators developed by Horner et al. Specifically, this article describes how literature reviews have applied Horner et al.'s quality indicators and evidence-based criteria.…

Outcomes of Quality Assurance: A Discussion of Knowledge, Methodology and Validity

ERIC Educational Resources Information Center

Stensaker, Bjorn

2008-01-01

A common characteristic in many quality assurance schemes around the world is their implicit and often narrowly formulated understanding of how organisational change is to take place as a result of the process. By identifying some of the underlying assumptions related to organisational change in current quality assurance schemes, the aim of this…

Methodological Quality Assessment of Meta-Analyses and Systematic Reviews of Probiotics in Inflammatory Bowel Disease and Pouchitis.

PubMed

Dong, Jinpei; Teng, Guigen; Wei, Tiantong; Gao, Wen; Wang, Huahong

2016-01-01

Probiotics are widely used for the induction and maintenance of remission in inflammatory bowel disease (IBD) and pouchitis. There are a large number of meta-analyses (MAs)/ systematic reviews (SRs) on this subject, the methodological quality of which has not been evaluated. This study aimed to evaluate the methodological quality of and summarize the evidence obtained from MAs/SRs of probiotic treatments for IBD and pouchitis patients. The PubMed, EMBASE, Cochrane Library and China National Knowledge Infrastructure (CNKI) databases were searched to identify Chinese and English language MAs/SRs of the use of probiotics for IBD and pouchitis. The Assessment of Multiple Systematic Reviews (AMSTAR) scale was used to assess the methodological quality of the studies. A total of 36 MAs/SRs were evaluated. The AMSTAR scores of the included studies ranged from 1 to 10, and the average score was 5.81. According to the Canadian Agency for Drugs and Technologies in Health, 4 articles were classified as high quality, 24 articles were classified as moderate quality, and 8 articles were classified as low quality. Most of the MAs/SRs suggested that probiotics had potential benefits for patients with ulcerative colitis (UC), but failed to show effectiveness in the induction and maintenance of remission in Crohn's disease (CD). The probiotic preparation VSL#3 may play a beneficial role in pouchitis. The overall methodological quality of the current MAs/SRs in the field of probiotics for IBD and pouchitis was found to be low to moderate. More MAs/SRs of high quality are required to support using probiotics to treat IBD and pouchitis.

Clinical trials in palliative care: a systematic review of their methodological characteristics and of the quality of their reporting.

PubMed

Bouça-Machado, Raquel; Rosário, Madalena; Alarcão, Joana; Correia-Guedes, Leonor; Abreu, Daisy; Ferreira, Joaquim J

2017-01-25

Over the past decades there has been a significant increase in the number of published clinical trials in palliative care. However, empirical evidence suggests that there are methodological problems in the design and conduct of studies, which raises questions about the validity and generalisability of the results and of the strength of the available evidence. We sought to evaluate the methodological characteristics and assess the quality of reporting of clinical trials in palliative care. We performed a systematic review of published clinical trials assessing therapeutic interventions in palliative care. Trials were identified using MEDLINE (from its inception to February 2015). We assessed methodological characteristics and describe the quality of reporting using the Cochrane Risk of Bias tool. We retrieved 107 studies. The most common medical field studied was oncology, and 43.9% of trials evaluated pharmacological interventions. Symptom control and physical dimensions (e.g. intervention on pain, breathlessness, nausea) were the palliative care-specific issues most studied. We found under-reporting of key information in particular on random sequence generation, allocation concealment, and blinding. While the number of clinical trials in palliative care has increased over time, methodological quality remains suboptimal. This compromises the quality of studies. Therefore, a greater effort is needed to enable the appropriate performance of future studies and increase the robustness of evidence-based medicine in this important field.

Developing a stochastic conflict resolution model for urban runoff quality management: Application of info-gap and bargaining theories

NASA Astrophysics Data System (ADS)

Ghodsi, Seyed Hamed; Kerachian, Reza; Estalaki, Siamak Malakpour; Nikoo, Mohammad Reza; Zahmatkesh, Zahra

2016-02-01

In this paper, two deterministic and stochastic multilateral, multi-issue, non-cooperative bargaining methodologies are proposed for urban runoff quality management. In the proposed methodologies, a calibrated Storm Water Management Model (SWMM) is used to simulate stormwater runoff quantity and quality for different urban stormwater runoff management scenarios, which have been defined considering several Low Impact Development (LID) techniques. In the deterministic methodology, the best management scenario, representing location and area of LID controls, is identified using the bargaining model. In the stochastic methodology, uncertainties of some key parameters of SWMM are analyzed using the info-gap theory. For each water quality management scenario, robustness and opportuneness criteria are determined based on utility functions of different stakeholders. Then, to find the best solution, the bargaining model is performed considering a combination of robustness and opportuneness criteria for each scenario based on utility function of each stakeholder. The results of applying the proposed methodology in the Velenjak urban watershed located in the northeastern part of Tehran, the capital city of Iran, illustrate its practical utility for conflict resolution in urban water quantity and quality management. It is shown that the solution obtained using the deterministic model cannot outperform the result of the stochastic model considering the robustness and opportuneness criteria. Therefore, it can be concluded that the stochastic model, which incorporates the main uncertainties, could provide more reliable results.

Evaluation of AMSTAR to assess the methodological quality of systematic reviews in overviews of reviews of healthcare interventions.

PubMed

Pollock, Michelle; Fernandes, Ricardo M; Hartling, Lisa

2017-03-23

Overviews of reviews (overviews) compile information from multiple systematic reviews (SRs) to provide a single synthesis of relevant evidence for decision-making. It is recommended that authors assess and report the methodological quality of SRs in overviews-for example, using A MeaSurement Tool to Assess systematic Reviews (AMSTAR). Currently, there is variation in whether and how overview authors assess and report SR quality, and limited guidance is available. Our objectives were to: examine methodological considerations involved in using AMSTAR to assess the quality of Cochrane and non-Cochrane SRs in overviews of healthcare interventions; identify challenges (and develop potential decision rules) when using AMSTAR in overviews; and examine the potential impact of considering methodological quality when making inclusion decisions in overviews. We selected seven overviews of healthcare interventions and included all SRs meeting each overview's inclusion criteria. For each SR, two reviewers independently conducted AMSTAR assessments with consensus and discussed challenges encountered. We also examined the correlation between AMSTAR assessments and SR results/conclusions. Ninety-five SRs were included (30 Cochrane, 65 non-Cochrane). Mean AMSTAR assessments (9.6/11 vs. 5.5/11; p < 0.001) and inter-rater reliability (AC1 statistic: 0.84 vs. 0.69; "almost perfect" vs. "substantial" using the Landis & Koch criteria) were higher for Cochrane compared to non-Cochrane SRs. Four challenges were identified when applying AMSTAR in overviews: the scope of the SRs and overviews often differed; SRs examining similar topics sometimes made different methodological decisions; reporting of non-Cochrane SRs was sometimes poor; and some non-Cochrane SRs included other SRs as well as primary studies. Decision rules were developed to address each challenge. We found no evidence that AMSTAR assessments were correlated with SR results/conclusions. Results indicate that the AMSTAR tool can be used successfully in overviews that include Cochrane and non-Cochrane SRs, though decision rules may be useful to circumvent common challenges. Findings support existing recommendations that quality assessments of SRs in overviews be conducted independently, in duplicate, with a process for consensus. Results also suggest that using methodological quality to guide inclusion decisions (e.g., to exclude poorly conducted and reported SRs) may not introduce bias into the overview process.

A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews.

PubMed

Pluye, Pierre; Gagnon, Marie-Pierre; Griffiths, Frances; Johnson-Lafleur, Janique

2009-04-01

A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies. To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components. A three-step critical review was conducted. 2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic. Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs). Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality. A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.

How Methodologic Differences Affect Results of Economic Analyses: A Systematic Review of Interferon Gamma Release Assays for the Diagnosis of LTBI

PubMed Central

Oxlade, Olivia; Pinto, Marcia; Trajman, Anete; Menzies, Dick

2013-01-01

Introduction Cost effectiveness analyses (CEA) can provide useful information on how to invest limited funds, however they are less useful if different analysis of the same intervention provide unclear or contradictory results. The objective of our study was to conduct a systematic review of methodologic aspects of CEA that evaluate Interferon Gamma Release Assays (IGRA) for the detection of Latent Tuberculosis Infection (LTBI), in order to understand how differences affect study results. Methods A systematic review of studies was conducted with particular focus on study quality and the variability in inputs used in models used to assess cost-effectiveness. A common decision analysis model of the IGRA versus Tuberculin Skin Test (TST) screening strategy was developed and used to quantify the impact on predicted results of observed differences of model inputs taken from the studies identified. Results Thirteen studies were ultimately included in the review. Several specific methodologic issues were identified across studies, including how study inputs were selected, inconsistencies in the costing approach, the utility of the QALY (Quality Adjusted Life Year) as the effectiveness outcome, and how authors choose to present and interpret study results. When the IGRA versus TST test strategies were compared using our common decision analysis model predicted effectiveness largely overlapped. Implications Many methodologic issues that contribute to inconsistent results and reduced study quality were identified in studies that assessed the cost-effectiveness of the IGRA test. More specific and relevant guidelines are needed in order to help authors standardize modelling approaches, inputs, assumptions and how results are presented and interpreted. PMID:23505412

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated. Clinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement. Copyright © 2017 Elsevier Ltd. All rights reserved.

Prediction models for intracranial hemorrhage or major bleeding in patients on antiplatelet therapy: a systematic review and external validation study.

PubMed

Hilkens, N A; Algra, A; Greving, J P

2016-01-01

ESSENTIALS: Prediction models may help to identify patients at high risk of bleeding on antiplatelet therapy. We identified existing prediction models for bleeding and validated them in patients with cerebral ischemia. Five prediction models were identified, all of which had some methodological shortcomings. Performance in patients with cerebral ischemia was poor. Background Antiplatelet therapy is widely used in secondary prevention after a transient ischemic attack (TIA) or ischemic stroke. Bleeding is the main adverse effect of antiplatelet therapy and is potentially life threatening. Identification of patients at increased risk of bleeding may help target antiplatelet therapy. This study sought to identify existing prediction models for intracranial hemorrhage or major bleeding in patients on antiplatelet therapy and evaluate their performance in patients with cerebral ischemia. We systematically searched PubMed and Embase for existing prediction models up to December 2014. The methodological quality of the included studies was assessed with the CHARMS checklist. Prediction models were externally validated in the European Stroke Prevention Study 2, comprising 6602 patients with a TIA or ischemic stroke. We assessed discrimination and calibration of included prediction models. Five prediction models were identified, of which two were developed in patients with previous cerebral ischemia. Three studies assessed major bleeding, one studied intracerebral hemorrhage and one gastrointestinal bleeding. None of the studies met all criteria of good quality. External validation showed poor discriminative performance, with c-statistics ranging from 0.53 to 0.64 and poor calibration. A limited number of prediction models is available that predict intracranial hemorrhage or major bleeding in patients on antiplatelet therapy. The methodological quality of the models varied, but was generally low. Predictive performance in patients with cerebral ischemia was poor. In order to reliably predict the risk of bleeding in patients with cerebral ischemia, development of a prediction model according to current methodological standards is needed. © 2015 International Society on Thrombosis and Haemostasis.

Factors Associated with the Utilization and Quality of Prenatal Care in Western Rural Regions of China

ERIC Educational Resources Information Center

Dongxu, Wang; Yuhui, Shi; Stewart, Donald; Chun, Chang; Chaoyang, Li

2012-01-01

Purpose: The paper seeks to identify key features of prenatal care utilization and quality in western regions of China and to determine the factors affecting the quality of prenatal care. Design/methodology/approach: A descriptive, cross-sectional study was conducted. The instrument for the study was a 10-stem respondent-administered, structured…

Randomized controlled drug trials on very elderly subjects: descriptive and methodological analysis of trials published between 1990 and 2002 and comparison with trials on adults.

PubMed

Le Quintrec, Jean-Laurent; Bussy, Caroline; Golmard, Jean-Louis; Hervé, Christian; Baulon, Alain; Piette, François

2005-03-01

Very elderly subjects (VES; aged 80 years or older) constitute a special population as they frequently present multiple diseases (polypathology). Results from trials on general adult populations therefore cannot be extrapolated to VES. We performed a census of randomized controlled trials (RCT) on VES published between 1990 and 2002, and carried out a descriptive and methodological analysis of these RCT/VES, comparing them with matched RCT on general adult populations (control RCT, RCT/C). We searched for RCT/VES in two international databases (EMBASE and MEDLINE) and then manually. RCT/C were matched to RCT/VES for disease area and year of publication. The methodological quality of each RCT was assessed with Chalmers' scale. We identified 84 RCT/VES, 63 of which were conclusive and 21, inconclusive. Subjects were institutionalized in 48 RCT, and community dwelling in 11 RCT (unspecified in 25 RCT). Efficacy was the main criterion in 75 RCT; tolerance in 9 RCT. Twenty-six RCT were published by geriatrics journals, and 58 by general medical journals. The RCT/VES covered most of the disease areas of geriatrics. The 84 RCT/VES had a mean methodological quality score of 0.578 +/- 0.157. The matched 84 RCT/C had a mean methodological quality score of 0.592 +/- 0.116 (p = .466). The methodological quality score of RCT/VES increased with the number of included subjects (p = .004) and the year of publication (p = .001). The methodological quality of RCT/VES is equivalent to that of RCT in general adult populations. Nevertheless, RCT/VES remain very scarce, and neglect certain diseases. RCT/VES and the inclusion of very elderly subjects in RCT on adults should be strongly encouraged.

Is there an "abortion trauma syndrome"? Critiquing the evidence.

PubMed

Robinson, Gail Erlick; Stotland, Nada L; Russo, Nancy Felipe; Lang, Joan A; Occhiogrosso, Mallay

2009-01-01

The objective of this review is to identify and illustrate methodological issues in studies used to support claims that induced abortion results in an "abortion trauma syndrome" or a psychiatric disorder. After identifying key methodological issues to consider when evaluating such research, we illustrate these issues by critically examining recent empirical studies that are widely cited in legislative and judicial testimony in support of the existence of adverse psychiatric sequelae of induced abortion. Recent studies that have been used to assert a causal connection between abortion and subsequent mental disorders are marked by methodological problems that include, but not limited to: poor sample and comparison group selection; inadequate conceptualization and control of relevant variables; poor quality and lack of clinical significance of outcome measures; inappropriateness of statistical analyses; and errors of interpretation, including misattribution of causal effects. By way of contrast, we review some recent major studies that avoid these methodological errors. The most consistent predictor of mental disorders after abortion remains preexisting disorders, which, in turn, are strongly associated with exposure to sexual abuse and intimate violence. Educating researchers, clinicians, and policymakers how to appropriately assess the methodological quality of research about abortion outcomes is crucial. Further, methodologically sound research is needed to evaluate not only psychological outcomes of abortion, but also the impact of existing legislation and the effects of social attitudes and behaviors on women who have abortions.

Relationship between Service Quality, Satisfaction, Motivation and Loyalty: A Multi-Dimensional Perspective

ERIC Educational Resources Information Center

Subrahmanyam, Annamdevula

2017-01-01

Purpose: This paper aims to identify and test four competing models with the interrelationships between students' perceived service quality, students' satisfaction, loyalty and motivation using structural equation modeling (SEM), and to select the best model using chi-square difference (??2) statistic test. Design/methodology/approach: The study…

Methodological quality of quantitative lesbian, gay, bisexual, and transgender nursing research from 2000 to 2010.

PubMed

Johnson, Michael; Smyer, Tish; Yucha, Carolyn

2012-01-01

The purpose of this study was to evaluate the methodological quality of quantitative lesbian, gay, bisexual, and transgender nursing research from 2000 to 2010. Using a key word search in Cumulative Index to Nursing and Allied Health Literature, 188 studies were identified and 40 met the criteria, which included descriptive, experimental, quasi-experimental, or observational (case control, cohort, and cross-sectional) design. The methodological quality of these studies was similar to that reported for medical and nursing educational research. The foci of these lesbian, gay, bisexual, and transgender studies were biased toward human immunodeficiency virus, acquired immunodeficiency syndrome, and sexually transmitted diseases, and 58.5% of the funded research was related to human immunodeficiency virus or acquired immunodeficiency syndrome. To provide evidence-based health care to these populations, an understanding of the current state of research is crucial.

Combining natural background levels (NBLs) assessment with indicator kriging analysis to improve groundwater quality data interpretation and management.

PubMed

Ducci, Daniela; de Melo, M Teresa Condesso; Preziosi, Elisabetta; Sellerino, Mariangela; Parrone, Daniele; Ribeiro, Luis

2016-11-01

The natural background level (NBL) concept is revisited and combined with indicator kriging method to analyze the spatial distribution of groundwater quality within a groundwater body (GWB). The aim is to provide a methodology to easily identify areas with the same probability of exceeding a given threshold (which may be a groundwater quality criteria, standards, or recommended limits for selected properties and constituents). Three case studies with different hydrogeological settings and located in two countries (Portugal and Italy) are used to derive NBL using the preselection method and validate the proposed methodology illustrating its main advantages over conventional statistical water quality analysis. Indicator kriging analysis was used to create probability maps of the three potential groundwater contaminants. The results clearly indicate the areas within a groundwater body that are potentially contaminated because the concentrations exceed the drinking water standards or even the local NBL, and cannot be justified by geogenic origin. The combined methodology developed facilitates the management of groundwater quality because it allows for the spatial interpretation of NBL values. Copyright © 2016 Elsevier B.V. All rights reserved.

Quality assessment of recent evidence-based clinical practice guidelines for management of type 2 diabetes mellitus in adults using the AGREE II instrument.

PubMed

Anwer, Muhammad A; Al-Fahed, Ousama B; Arif, Samir I; Amer, Yasser S; Titi, Maher A; Al-Rukban, Mohammed O

2018-02-01

Type 2 diabetes mellitus (T2DM) is a worldwide and national public health problem that has a great impact on the population in Saudi Arabia. High-quality clinical practice guidelines (CPGs) are cornerstones in improving the health care provided for patients with diabetes. This study evaluated the methodological rigour, transparency, and applicability of recently published CPGs. Our group conducted a systematic search for recently published CPGs for T2DM. The searching and screening for Source CPGs were guided by tools from the ADAPTE methods with specific inclusion/exclusion criteria. Five reviewers using the second version of the Appraisal of Guidelines for Research and Evaluation (AGREE II) Instrument independently assessed the quality of the retrieved Source CPGs. Domains of Scope and purpose and Clarity of presentation received the highest scores in all CPGs. Most of the assessed CPGs (86%) were considered with high overall quality and were recommended for use. Rigour of development and applicability domains were together highest in 3 CPGs (43%). The overall high quality of DM CPGs published in the last 3 years demonstrated the continuous development and improvement in CPG methodologies and standards. Health care professionals should consider the quality of any CPG for T2DM before deciding to use it in their daily clinical practice. Three CPGs have been identified, using the AGREE criteria, as high-quality and trustworthy. Ideally, the resources provided by the AGREE trust including the AGREE II Instrument should be used by a clinician to scan through the large number of published T2DM CPGs to identify the CPGs with high methodological quality and applicability. © 2017 John Wiley & Sons, Ltd.

Research design in end-of-life research: state of science.

PubMed

George, Linda K

2002-10-01

The volume of research on end-of-life care, death, and dying has exploded during the past decade. This article reviews the conceptual and methodological adequacy of end-of-life research to date, focusing on limitations of research to date and ways of improving future research. A systematic search was conducted to identify the base of end-of-life research. Approximately 400 empirical articles were identified and are the basis of this review. Although much has been learned from research to date, limitations in the knowledge base are substantial. The most fundamental problems identified are conceptual and include failure to define dying; neglect of the distinctions among quality of life, quality of death, and quality of end-of-life care. Methodologically, the single greatest problem is the lack of longitudinal studies that cover more than the time period immediately before death. Gaps in the research base include insufficient attention to psychological and spiritual issues, the prevalence of psychiatric disorder and the effectiveness of the treatment of such disorders among dying persons, provider and health system variables, social and cultural diversity, and the effects of comorbidity on trajectories of dying.

Review of reviews on exposures to synthetic organic chemicals and children's neurodevelopment: Methodological and interpretation challenges.

PubMed

LaKind, Judy S; Anthony, Laura G; Goodman, Michael

2017-01-01

Environmental epidemiology data are becoming increasingly important in public health decision making, which commonly incorporates a systematic review of multiple studies. This review addresses two fundamental questions: What is the quality of available reviews on associations between exposure to synthetic organic chemicals and neurodevelopmental outcomes? What is the value (e.g., quality and consistency) of the underlying literature? Published reviews on associations between synthetic organic environmental chemical exposures and neurodevelopmental outcomes in children were systematically evaluated. Seventy-four relevant reviews were identified, and these were evaluated with respect to four methodological characteristics: (1) systematic inclusion/exclusion criteria and reproducible methods for search and retrieval of studies; (2) structured evaluation of underlying data quality; (3) systematic assessment of consistency across specific exposure-outcome associations; and (4) evaluation of reporting/publication bias. None of the 74 reviews fully met the criteria for all four methodological characteristics. Only four reviews met two criteria, and six reviews fulfilled only one criterion. Perhaps more importantly, the higher quality reviews were not able to meet all of the criteria owing to the shortcomings of underlying studies, which lacked comparability in terms of specific research question of interest, overall design, exposure assessment, outcome ascertainment, and analytic methods. Thus, even the most thoughtful and rigorous review may be of limited value if the underlying literature includes investigations that address different hypotheses and are beset by methodological inconsistencies and limitations. Issues identified in this review of reviews illustrate considerable challenges that are facing assessments of epidemiological evidence.

Education in cardiopulmonary resuscitation in Russia: A systematic review of the available evidence

PubMed Central

Birkun, Alexei; Glotov, Maksim

2017-01-01

BACKGROUND: To summarise and appraise cumulative published scientific evidence relevant to cardiopulmonary resuscitation (CPR) education in Russia. DATA RESOURCES: We searched Medline, Scopus, Science Direct and Russian Science Citation Index databases from December 1991 to December 2016 to identify studies pertaining to the field of CPR education that were carried out by Russian researchers and/or investigated the topic of interest for Russia/Russian population. Reference lists of eligible publications, contents pages of relevant Russian journals and Google Scholar were also searched. There was no limitation based on publication language or study design. RESULTS: Of 7 964 unique citations identified, 22 studies were included. All studies were published from 2009 to 2016, mainly in Russian. Only three studies were reported to be randomized controlled. Non-medical individuals constituted 17% of studied populations. Most of the studies aimed to assess effects of CPR educational interventions, generally suggesting positive influence of the training conducted. The studies were highly heterogeneous as for methodological approaches, structure and duration of educational interventions, evaluation methods and criteria being used. Methodological quality was generally poor, with >40% publications not passing quality screening and only 2 studies meeting the criteria of moderate high quality. CONCLUSION: The results suggest paucity, low population coverage, high thematic and methodological heterogeneity and low quality of the studies addressing CPR education, which were carried out in the Russian Federation. There is a critical need in conducting methodologically consistent, large-scale, randomized, controlled studies evaluating and comparing efficiency of educational interventions for teaching CPR in different population categories of Russia. PMID:29123601

The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation.

PubMed

Lewis, Cara C; Stanick, Cameo F; Martinez, Ruben G; Weiner, Bryan J; Kim, Mimi; Barwick, Melanie; Comtois, Katherine A

2015-01-08

Identification of psychometrically strong instruments for the field of implementation science is a high priority underscored in a recent National Institutes of Health working meeting (October 2013). Existing instrument reviews are limited in scope, methods, and findings. The Society for Implementation Research Collaboration Instrument Review Project's objectives address these limitations by identifying and applying a unique methodology to conduct a systematic and comprehensive review of quantitative instruments assessing constructs delineated in two of the field's most widely used frameworks, adopt a systematic search process (using standard search strings), and engage an international team of experts to assess the full range of psychometric criteria (reliability, construct and criterion validity). Although this work focuses on implementation of psychosocial interventions in mental health and health-care settings, the methodology and results will likely be useful across a broad spectrum of settings. This effort has culminated in a centralized online open-access repository of instruments depicting graphical head-to-head comparisons of their psychometric properties. This article describes the methodology and preliminary outcomes. The seven stages of the review, synthesis, and evaluation methodology include (1) setting the scope for the review, (2) identifying frameworks to organize and complete the review, (3) generating a search protocol for the literature review of constructs, (4) literature review of specific instruments, (5) development of an evidence-based assessment rating criteria, (6) data extraction and rating instrument quality by a task force of implementation experts to inform knowledge synthesis, and (7) the creation of a website repository. To date, this multi-faceted and collaborative search and synthesis methodology has identified over 420 instruments related to 34 constructs (total 48 including subconstructs) that are relevant to implementation science. Despite numerous constructs having greater than 20 available instruments, which implies saturation, preliminary results suggest that few instruments stem from gold standard development procedures. We anticipate identifying few high-quality, psychometrically sound instruments once our evidence-based assessment rating criteria have been applied. The results of this methodology may enhance the rigor of implementation science evaluations by systematically facilitating access to psychometrically validated instruments and identifying where further instrument development is needed.

Scoping review of pediatric tonsillectomy quality of life assessment instruments.

PubMed

Kao, Stephen Shih-Teng; Peters, Micah D J; Dharmawardana, Nuwan; Stew, Benjamin; Ooi, Eng Hooi

2017-10-01

Sleep-disordered breathing or recurrent tonsillitis have detrimental effects on the child's physical health and quality of life. Tonsillectomy is commonly performed to treat these common conditions and improve the child's quality of life. This scoping review aims to present a comprehensive and descriptive analysis of quality of life questionnaires as a resource for clinicians and researchers when deciding which tool to use when assessing the quality of life effects after tonsillectomy. A comprehensive search strategy was undertaken across MEDLINE (PubMed), CINAHL, Embase, and Cochrane CENTRAL. Quality of life questionnaires utilized in studies investigating pediatric patients undergoing tonsillectomy for chronic tonsillitis or sleep-disordered breathing were included. Methodological quality and data extraction were conducted as per Joanna Briggs Institute methodology. Ten questionnaires were identified, consisting of six generic and four disease-specific instruments. The Pediatric Quality of Life Inventory was the most commonly utilized generic questionnaire. The Obstructive Sleep Apnea-18 was the most commonly utilized disease-specific questionnaire. This review identified a range of generic and disease-specific quality of life questionnaires utilized in pediatric patients who have undergone tonsillectomy with or without adenoidectomy for sleep-disordered breathing or chronic tonsillitis. Important aspects of each questionnaire have been summarized to aid researchers and clinicians in choosing the appropriate questionnaire when evaluating the quality of life effects of tonsillectomy. NA Laryngoscope, 127:2399-2406, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.

PubMed

Dosenovic, Svjetlana; Jelicic Kadic, Antonia; Vucic, Katarina; Markovina, Nikolina; Pieper, Dawid; Puljak, Livia

2018-05-08

Systematic reviews (SRs) in the field of neuropathic pain (NeuP) are increasingly important for decision-making. However, methodological flaws in SRs can reduce the validity of conclusions. Hence, it is important to assess the methodological quality of NeuP SRs critically. Additionally, it remains unclear which assessment tool should be used. We studied the methodological quality of SRs published in the field of NeuP and compared two assessment tools. We systematically searched 5 electronic databases to identify SRs of randomized controlled trials of interventions for NeuP available up to March 2015. Two independent reviewers assessed the methodological quality of the studies using the Assessment of Multiple Systematic Reviews (AMSTAR) and the revised AMSTAR (R-AMSTAR) tools. The scores were converted to percentiles and ranked into 4 grades to allow comparison between the two checklists. Gwet's AC1 coefficient was used for interrater reliability assessment. The 97 included SRs had a wide range of methodological quality scores (AMSTAR median (IQR): 6 (5-8) vs. R-AMSTAR median (IQR): 30 (26-35)). The overall agreement score between the 2 raters was 0.62 (95% CI 0.39-0.86) for AMSTAR and 0.62 (95% CI 0.53-0.70) for R-AMSTAR. The 31 Cochrane systematic reviews (CSRs) were consistently ranked higher than the 66 non-Cochrane systematic reviews (NCSRs). The analysis of individual domains showed the best compliance in a comprehensive literature search (item 3) on both checklists. The results for the domain that was the least compliant differed: conflict of interest (item 11) was the item most poorly reported on AMSTAR vs. publication bias assessment (item 10) on R-AMSTAR. A high positive correlation between the total AMSTAR and R-AMSTAR scores for all SRs, as well as for CSRs and NCSRs, was observed. The methodological quality of analyzed SRs in the field of NeuP was not optimal, and CSRs had a higher quality than NCSRs. Both AMSTAR and R-AMSTAR tools produced comparable quality ratings. Our results point out to weaknesses in the methodology of existing SRs on interventions for the management NeuP and call for future improvement by better adherence to analyzed quality checklists, either AMSTAR or R-AMSTAR.

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews.

PubMed

Mayo-Wilson, Evan; Ng, Sueko Matsumura; Chuck, Roy S; Li, Tianjing

2017-09-05

Systematic reviews should inform American Academy of Ophthalmology (AAO) Preferred Practice Pattern® (PPP) guidelines. The quality of systematic reviews related to the forthcoming Preferred Practice Pattern® guideline (PPP) Refractive Errors & Refractive Surgery is unknown. We sought to identify reliable systematic reviews to assist the AAO Refractive Errors & Refractive Surgery PPP. Systematic reviews were eligible if they evaluated the effectiveness or safety of interventions included in the 2012 PPP Refractive Errors & Refractive Surgery. To identify potentially eligible systematic reviews, we searched the Cochrane Eyes and Vision United States Satellite database of systematic reviews. Two authors identified eligible reviews and abstracted information about the characteristics and quality of the reviews independently using the Systematic Review Data Repository. We classified systematic reviews as "reliable" when they (1) defined criteria for the selection of studies, (2) conducted comprehensive literature searches for eligible studies, (3) assessed the methodological quality (risk of bias) of the included studies, (4) used appropriate methods for meta-analyses (which we assessed only when meta-analyses were reported), (5) presented conclusions that were supported by the evidence provided in the review. We identified 124 systematic reviews related to refractive error; 39 met our eligibility criteria, of which we classified 11 to be reliable. Systematic reviews classified as unreliable did not define the criteria for selecting studies (5; 13%), did not assess methodological rigor (10; 26%), did not conduct comprehensive searches (17; 44%), or used inappropriate quantitative methods (3; 8%). The 11 reliable reviews were published between 2002 and 2016. They included 0 to 23 studies (median = 9) and analyzed 0 to 4696 participants (median = 666). Seven reliable reviews (64%) assessed surgical interventions. Most systematic reviews of interventions for refractive error are low methodological quality. Following widely accepted guidance, such as Cochrane or Institute of Medicine standards for conducting systematic reviews, would contribute to improved patient care and inform future research.

Adherence of hip and knee arthroplasty studies to RSA standardization guidelines. A systematic review.

PubMed

Madanat, Rami; Mäkinen, Tatu J; Aro, Hannu T; Bragdon, Charles; Malchau, Henrik

2014-09-01

Guidelines for standardization of radiostereometry (RSA) of implants were published in 2005 to facilitate comparison of outcomes between various research groups. In this systematic review, we determined how well studies have adhered to these guidelines. We carried out a literature search to identify all articles published between January 2000 and December 2011 that used RSA in the evaluation of hip or knee prosthesis migration. 2 investigators independently evaluated each of the studies for adherence to the 13 individual guideline items. Since some of the 13 points included more than 1 criterion, studies were assessed on whether each point was fully met, partially met, or not met. 153 studies that met our inclusion criteria were identified. 61 of these were published before the guidelines were introduced (2000-2005) and 92 after the guidelines were introduced (2006-2011). The methodological quality of RSA studies clearly improved from 2000 to 2011. None of the studies fully met all 13 guidelines. Nearly half (43) of the studies published after the guidelines demonstrated a high methodological quality and adhered at least partially to 10 of the 13 guidelines, whereas less than one-fifth (11) of the studies published before the guidelines had the same methodological quality. Commonly unaddressed guideline items were related to imaging methodology, determination of precision from double examinations, and also mean error of rigid-body fitting and condition number cutoff levels. The guidelines have improved methodological reporting in RSA studies, but adherence to these guidelines is still relatively low. There is a need to update and clarify the guidelines for clinical hip and knee arthroplasty RSA studies.

Systematic review of the methodological and reporting quality of case series in surgery.

PubMed

Agha, R A; Fowler, A J; Lee, S-Y; Gundogan, B; Whitehurst, K; Sagoo, H K; Jeong, K J L; Altman, D G; Orgill, D P

2016-09-01

Case series are an important and common study type. No guideline exists for reporting case series and there is evidence of key data being missed from such reports. The first step in the process of developing a methodologically sound reporting guideline is a systematic review of literature relevant to the reporting deficiencies of case series. A systematic review of methodological and reporting quality in surgical case series was performed. The electronic search strategy was developed by an information specialist and included MEDLINE, Embase, Cochrane Methods Register, Science Citation Index and Conference Proceedings Citation index, from the start of indexing to 5 November 2014. Independent screening, eligibility assessments and data extraction were performed. Included articles were then analysed for five areas of deficiency: failure to use standardized definitions, missing or selective data (including the omission of whole cases or important variables), transparency or incomplete reporting, whether alternative study designs were considered, and other issues. Database searching identified 2205 records. Through the process of screening and eligibility assessments, 92 articles met inclusion criteria. Frequencies of methodological and reporting issues identified were: failure to use standardized definitions (57 per cent), missing or selective data (66 per cent), transparency or incomplete reporting (70 per cent), whether alternative study designs were considered (11 per cent) and other issues (52 per cent). The methodological and reporting quality of surgical case series needs improvement. The data indicate that evidence-based guidelines for the conduct and reporting of case series may be useful. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Methodological quality of systematic reviews in subfertility: a comparison of Cochrane and non-Cochrane systematic reviews in assisted reproductive technologies.

PubMed

Windsor, B; Popovich, I; Jordan, V; Showell, M; Shea, B; Farquhar, C

2012-12-01

Are there differences in the methodological quality of Cochrane systematic reviews (CRs) and non-Cochrane systematic reviews (NCRs) of assisted reproductive technologies? CRs on assisted reproduction are of higher methodological quality than similar reviews published in other journals. The quality of systematic reviews varies. This was a cross-sectional study of 30 CR and 30 NCR systematic reviews that were randomly selected from the eligible reviews identified from a literature search for the years 2007-2011. We extracted data on the reporting and methodological characteristics of the included systematic reviews. We assessed the methodological quality of the reviews using the 11-domain Measurement Tool to Assess the Methodological Quality of Systematic Reviews (AMSTAR) tool and subsequently compared CR and NCR systematic reviews. The AMSTAR quality assessment found that CRs were superior to NCRs. For 10 of 11 AMSTAR domains, the requirements were met in >50% of CRs, but only 4 of 11 domains showed requirements being met in >50% of NCRs. The strengths of CRs are the a priori study design, comprehensive literature search, explicit lists of included and excluded studies and assessments of internal validity. Significant failings in the CRs were found in duplicate study selection and data extraction (67% meeting requirements), assessment for publication bias (53% meeting requirements) and reporting of conflicts of interest (47% meeting requirements). NCRs were more likely to contain methodological weaknesses as the majority of the domains showed <40% of reviews meeting requirements, e.g. a priori study design (17%), duplicate study selection and data extraction (17%), assessment of study quality (27%), study quality in the formulation of conclusions (23%) and reporting of conflict of interests (10%). The AMSTAR assessment can only judge what is reported by authors. Although two of the five authors are involved in the production of CRs, the risk of bias was reduced by not involving these authors in the assessment of the systematic review quality. Not all systematic reviews are equal. The reader needs to consider the quality of the systematic review when they consider the results and the conclusions of a systematic review. There are no conflicts with any commercial organization. Funding was provided for the students by the summer studentship programme of the Faculty of Medical and Health Sciences of the University of Auckland.

Use of graph theory measures to identify errors in record linkage.

PubMed

Randall, Sean M; Boyd, James H; Ferrante, Anna M; Bauer, Jacqueline K; Semmens, James B

2014-07-01

Ensuring high linkage quality is important in many record linkage applications. Current methods for ensuring quality are manual and resource intensive. This paper seeks to determine the effectiveness of graph theory techniques in identifying record linkage errors. A range of graph theory techniques was applied to two linked datasets, with known truth sets. The ability of graph theory techniques to identify groups containing errors was compared to a widely used threshold setting technique. This methodology shows promise; however, further investigations into graph theory techniques are required. The development of more efficient and effective methods of improving linkage quality will result in higher quality datasets that can be delivered to researchers in shorter timeframes. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Systematic reviews addressing microsurgical head and neck reconstruction.

PubMed

Momeni, Arash; Jacobson, Joshua Y; Lee, Gordon K

2015-01-01

Systematic reviews frequently form the basis for clinical decision making and guideline development. Yet, the quality of systematic reviews has been variable, thus raising concerns about the validity of their conclusions. In the current study, a quality analysis of systematic reviews was performed, addressing microsurgical head and neck reconstruction. A PubMed search was performed to identify all systematic reviews published up to and including December 2012 in 12 surgical journals. Two authors independently reviewed the literature and extracted data from the included reviews. Discrepancies were resolved by consensus. Quality assessment was performed using AMSTAR. The initial search retrieved 1020 articles. After screening titles and abstracts, 987 articles were excluded. Full-text review of the remaining 33 articles resulted in further exclusion of 18 articles, leaving 15 systematic reviews for final analysis. A marked increase in the number of published systematic reviews over time was noted (P = 0.07). The median AMSTAR score was 5, thus reflecting a "fair" quality. No evidence for improvement in methodological quality over time was noted. The trend to publish more systematic reviews in microsurgical head and neck reconstruction is encouraging. However, efforts are indicated to improve the methodological quality of systematic reviews. Familiarity with criteria of methodological quality is critical to ensure future improvements in the quality of systematic reviews conducted in microsurgery.

Review and evaluation of the methodological quality of the existing guidelines and recommendations for inherited neurometabolic disorders.

PubMed

Cassis, Linda; Cortès-Saladelafont, Elisenda; Molero-Luis, Marta; Yubero, Delia; González, Maria Julieta; Ormazábal, Aida; Fons, Carme; Jou, Cristina; Sierra, Cristina; Castejon Ponce, Esperanza; Ramos, Federico; Armstrong, Judith; O'Callaghan, M Mar; Casado, Mercedes; Montero, Raquel; Meavilla-Olivas, Silvia; Artuch, Rafael; Barić, Ivo; Bartoloni, Franco; Bellettato, Cinzia Maria; Bonifazi, Fedele; Ceci, Adriana; Cvitanović-Šojat, Ljerka; Dali, Christine I; D'Avanzo, Francesca; Fumic, Ksenija; Giannuzzi, Viviana; Lampe, Christina; Scarpa, Maurizio; Garcia-Cazorla, Ángels

2015-12-30

Inherited neurometabolic disorders (iNMDs) represent a group of almost seven hundred rare diseases whose common manifestations are clinical neurologic or cognitive symptoms that can appear at any time, in the first months/years of age or even later in adulthood. Early diagnosis and timely treatments are often pivotal for the favorable course of the disease. Thus, the elaboration of new evidence-based recommendations for iNMD diagnosis and management is increasingly requested by health care professionals and patients, even though the methodological quality of existing guidelines is largely unclear. InNerMeD-I-Network is the first European network on iNMDs that was created with the aim of sharing and increasing validated information about diagnosis and management of neurometabolic disorders. One of the goals of the project was to determine the number and the methodological quality of existing guidelines and recommendations for iNMDs. We performed a systematic search on PubMed, the National Guideline Clearinghouse (NGC), the Guidelines International Network (G-I-N), the Scottish Intercollegiate Guideline Network (SIGN) and the National Institute for Health and Care Excellence (NICE) to identify all the published guidelines and recommendations for iNMDs from January 2000 to June 2015. The methodological quality of the selected documents was determined using the AGREE II instrument, an appraisal tool composed of 6 domains covering 23 key items. A total of 55 records met the inclusion criteria, 11 % were about groups of disorders, whereas the majority encompassed only one disorder. Lysosomal disorders, and in particular Fabry, Gaucher disease and mucopolysaccharidoses where the most studied. The overall methodological quality of the recommendation was acceptable and increased over time, with 25 % of the identified guidelines strongly recommended by the appraisers, 64 % recommended, and 11 % not recommended. However, heterogeneity in the obtained scores for each domain was observed among documents covering different groups of disorders and some domains like 'stakeholder involvement' and 'applicability' were generally scarcely addressed. Greater efforts should be devoted to improve the methodological quality of guidelines and recommendations for iNMDs and AGREE II instrument seems advisable for new guideline development. The elaboration of new guidelines encompassing still uncovered disorders is badly needed.

Sugar-Sweetened Beverages and Obesity Risk in Children and Adolescents: A Systematic Analysis on How Methodological Quality May Influence Conclusions.

PubMed

Bucher Della Torre, Sophie; Keller, Amélie; Laure Depeyre, Jocelyne; Kruseman, Maaike

2016-04-01

In the context of a worldwide high prevalence of childhood obesity, the role of sugar-sweetened beverage (SSB) consumption as a cause of excess weight gain remains controversial. Conflicting results may be due to methodological issues in original studies and in reviews. The aim of this review was to systematically analyze the methodology of studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents, and the studies' ability to answer this research question. A systematic review of cohort and experimental studies published until December 2013 in peer-reviewed journals was performed on Medline, CINAHL, Web of Knowledge, and ClinicalTrials.gov. Studies investigating the influence of SSB consumption on risk of obesity and obesity among children and adolescents were included, and methodological quality to answer this question was assessed independently by two investigators using the Academy of Nutrition and Dietetics Quality Criteria Checklist. Among the 32 identified studies, nine had positive quality ratings and 23 studies had at least one major methodological issue. Main methodological issues included SSB definition and inadequate measurement of exposure. Studies with positive quality ratings found an association between SSB consumption and risk of obesity or obesity (n=5) (ie, when SSB consumption increased so did obesity) or mixed results (n=4). Studies with a neutral quality rating found a positive association (n=7), mixed results (n=9), or no association (n=7). The present review shows that the majority of studies with strong methodology indicated a positive association between SSB consumption and risk of obesity or obesity, especially among overweight children. In addition, study findings highlight the need for the careful and precise measurement of the consumption of SSBs and of important confounders. Copyright © 2016 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Specific guidelines for assessing and improving the methodological quality of economic evaluations of newborn screening

PubMed Central

2012-01-01

Background Economic evaluation of newborn screening poses specific methodological challenges. Amongst others, these challenges refer to the use of quality adjusted life years (QALYs) in newborns, and which costs and outcomes need to be considered in a full evaluation of newborn screening programmes. Because of the increasing scale and scope of such programmes, a better understanding of the methods of high-quality economic evaluations may be crucial for both producers/authors and consumers/reviewers of newborn screening-related economic evaluations. The aim of this study was therefore to develop specific guidelines designed to assess and improve the methodological quality of economic evaluations in newborn screening. Methods To develop the guidelines, existing guidelines for assessing the quality of economic evaluations were identified through a literature search, and were reviewed and consolidated using a deductive iterative approach. In a subsequent test phase, these guidelines were applied to various economic evaluations which acted as case studies. Results The guidelines for assessing and improving the methodological quality of economic evaluations in newborn screening are organized into 11 categories: “bibliographic details”, “study question and design”, “modelling”, “health outcomes”, “costs”, “discounting”, “presentation of results”, “sensitivity analyses”, “discussion”, “conclusions”, and “commentary”. Conclusions The application of the guidelines highlights important issues regarding newborn screening-related economic evaluations, and underscores the need for such issues to be afforded greater consideration in future economic evaluations. The variety in methodological quality detected by this study reveals the need for specific guidelines on the appropriate methods for conducting sound economic evaluations in newborn screening. PMID:22947299

[Types of medical registries - definitions, methodological aspects and quality of the scientific work with registries].

PubMed

Mathis-Edenhofer, Stefan; Piso, Brigitte

2011-12-01

This work presents a comprehensive list of registry definitions including broader and narrower definitions. Compared to each other different methodological issues can be identified. Some of these issues are common for all registry types; some can be assigned more easily to a specific registry type. Instruments for evaluating the quality of registers reflect many of the mentioned aspects. Generally, and especially at registers with a descriptive or exploratory research dimension it is important to consider their intended purpose and in about it was achieved. This includes, for instance, whether the purpose and the methodology are coordinated. From the start of registration an initiator should be - based on the purpose - aware of the methodological dimension of the registry. This helps to apply the correct type of the registry, the appropriate guidance and, ultimately, the arguments for the effort (cost-benefit ratio).

Twenty years of meta-analyses in orthopaedic surgery: has quality kept up with quantity?

PubMed

Dijkman, Bernadette G; Abouali, Jihad A K; Kooistra, Bauke W; Conter, Henry J; Poolman, Rudolf W; Kulkarni, Abhaya V; Tornetta, Paul; Bhandari, Mohit

2010-01-01

As the number of studies in the literature is increasing, orthopaedic surgeons highly depend on meta-analyses as their primary source of scientific evidence. The objectives of this review were to assess the scientific quality and number of published meta-analyses on orthopaedics-related topics over time. We conducted, in duplicate and independently, a systematic review of published meta-analyses in orthopaedics in the years 2005 and 2008 and compared them with a previous systematic review of meta-analyses from 1969 to 1999. A search of electronic databases (MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews) was performed to identify meta-analyses published in 2005 and 2008. We searched bibliographies and contacted content experts to identify additional relevant studies. Two investigators independently assessed the quality of the studies, using the Oxman and Guyatt index, and abstracted relevant data. We included forty-five and forty-four meta-analyses from 2005 and 2008, respectively. While the number of meta-analyses increased fivefold from 1999 to 2008, the mean quality score did not change significantly over time (p = 0.067). In the later years, a significantly lower proportion of meta-analyses had methodological flaws (56% in 2005 and 68% in 2008) compared with meta-analyses published prior to 2000 (88%) (p = 0.006). In 2005 and 2008, respectively, 18% and 30% of the meta-analyses had major to extensive flaws in their methodology. Studies from 2008 with positive conclusions used and described appropriate criteria for the validity assessment less often than did those with negative results. The use of random-effects and fixed-effects models as pooling methods became more popular toward 2008. Although the methodological quality of orthopaedic meta-analyses has increased in the past twenty years, a substantial proportion continues to show major to extensive flaws. As the number of published meta-analyses is increasing, a routine checklist for scientific quality should be used in the peer-review process to ensure methodological standards for publication.

Selecting Health Care Improvement Projects: A Methodology Integrating Cause-and-Effect Diagram and Analytical Hierarchy Process.

PubMed

Testik, Özlem Müge; Shaygan, Amir; Dasdemir, Erdi; Soydan, Guray

It is often vital to identify, prioritize, and select quality improvement projects in a hospital. Yet, a methodology, which utilizes experts' opinions with different points of view, is needed for better decision making. The proposed methodology utilizes the cause-and-effect diagram to identify improvement projects and construct a project hierarchy for a problem. The right improvement projects are then prioritized and selected using a weighting scheme of analytical hierarchy process by aggregating experts' opinions. An approach for collecting data from experts and a graphical display for summarizing the obtained information are also provided. The methodology is implemented for improving a hospital appointment system. The top-ranked 2 major project categories for improvements were identified to be system- and accessibility-related causes (45%) and capacity-related causes (28%), respectively. For each of the major project category, subprojects were then ranked for selecting the improvement needs. The methodology is useful in cases where an aggregate decision based on experts' opinions is expected. Some suggestions for practical implementations are provided.

Epidemiology Characteristics, Methodological Assessment and Reporting of Statistical Analysis of Network Meta-Analyses in the Field of Cancer

PubMed Central

Ge, Long; Tian, Jin-hui; Li, Xiu-xia; Song, Fujian; Li, Lun; Zhang, Jun; Li, Ge; Pei, Gai-qin; Qiu, Xia; Yang, Ke-hu

2016-01-01

Because of the methodological complexity of network meta-analyses (NMAs), NMAs may be more vulnerable to methodological risks than conventional pair-wise meta-analysis. Our study aims to investigate epidemiology characteristics, conduction of literature search, methodological quality and reporting of statistical analysis process in the field of cancer based on PRISMA extension statement and modified AMSTAR checklist. We identified and included 102 NMAs in the field of cancer. 61 NMAs were conducted using a Bayesian framework. Of them, more than half of NMAs did not report assessment of convergence (60.66%). Inconsistency was assessed in 27.87% of NMAs. Assessment of heterogeneity in traditional meta-analyses was more common (42.62%) than in NMAs (6.56%). Most of NMAs did not report assessment of similarity (86.89%) and did not used GRADE tool to assess quality of evidence (95.08%). 43 NMAs were adjusted indirect comparisons, the methods used were described in 53.49% NMAs. Only 4.65% NMAs described the details of handling of multi group trials and 6.98% described the methods of similarity assessment. The median total AMSTAR-score was 8.00 (IQR: 6.00–8.25). Methodological quality and reporting of statistical analysis did not substantially differ by selected general characteristics. Overall, the quality of NMAs in the field of cancer was generally acceptable. PMID:27848997

Residents-as-teachers programs in psychiatry: a systematic review.

PubMed

Dewey, Charlene M; Coverdale, John H; Ismail, Nadia J; Culberson, John W; Thompson, Britta M; Patton, Cynthia S; Friedland, Joan A

2008-02-01

Because psychiatry residents have important roles as teachers and significant opportunities to contribute to medical student education, we set out to: identify all randomized control trials (RCT) for residents' teaching skills programs in psychiatry and to identify the efficacy of those interventions for improving teaching skills; identify the strengths and weaknesses of the available studies across medical disciplines; and identify currently available methods for enhancing residents' teaching skills for residents training in psychiatry. The published English-language literature was searched using PubMed, Social Sciences Index, and PsycINFO databases, with key search words including: residents, teaching skills, residents as teachers, psychiatry, and assessments. Both RCT and controlled, nonrandomized trials of residents' teaching programs directed to enhance residents' teaching skills were selected and critically appraised. Of 13 trials identified and reviewed, most included residents in internal medicine. Only one included psychiatry residents and assessed their ability to teach interviewing skills to medical students. Along with other studies, this study demonstrated improvement in residents' teaching skills. Overall, interventions and outcome measures were heterogeneous while the quality of methodologies varied. Five studies were of higher quality, representing examples of quality educational research. Several described group differences, blinding, good follow-up, and use of valid, reliable tools. Only one trial exists that incorporated psychiatry residents. Significant opportunity to advance educational research in this field exists. Psychiatry residency program directors should incorporate high-quality methodologies and can benefit from the findings of trials in other disciplines.

A systematic review of grounded theory studies in physiotherapy.

PubMed

Ali, Nancy; May, Stephen; Grafton, Kate

2018-05-23

This systematic review aimed at appraising the methodological rigor of grounded theory research published in the field of physiotherapy to assess how the methodology is understood and applied. A secondary aim was to provide research implications drawn from the findings to guide future grounded theory methodology (GTM) research. A systematic search was conducted in MEDLINE, CINHAL, SPORT Discus, Science Direct, PubMed, Scopus, and Web of Science to identify studies in the field of physiotherapy that reported using GTM and/or methods in the study title and/or abstract. The descriptive characteristics and methodological quality of eligible studies were examined using grounded theory methodology assessment guidelines. The review included 68 studies conducted between 1998 and 2017. The findings showed that GTM is becoming increasingly used by physiotherapy researchers. Thirty-six studies (53%) demonstrated a good understanding and appropriate application of GTM. Thirty-two studies (47%) presented descriptive findings and were considered to be of poor methodological quality. There are several key tenets of GTM that are integral to the iterative process of qualitative theorizing and need to be applied throughout all research practices including sampling, data collection, and analysis.

The use of hierarchical clustering for the design of optimized monitoring networks

NASA Astrophysics Data System (ADS)

Soares, Joana; Makar, Paul Andrew; Aklilu, Yayne; Akingunola, Ayodeji

2018-05-01

Associativity analysis is a powerful tool to deal with large-scale datasets by clustering the data on the basis of (dis)similarity and can be used to assess the efficacy and design of air quality monitoring networks. We describe here our use of Kolmogorov-Zurbenko filtering and hierarchical clustering of NO2 and SO2 passive and continuous monitoring data to analyse and optimize air quality networks for these species in the province of Alberta, Canada. The methodology applied in this study assesses dissimilarity between monitoring station time series based on two metrics: 1 - R, R being the Pearson correlation coefficient, and the Euclidean distance; we find that both should be used in evaluating monitoring site similarity. We have combined the analytic power of hierarchical clustering with the spatial information provided by deterministic air quality model results, using the gridded time series of model output as potential station locations, as a proxy for assessing monitoring network design and for network optimization. We demonstrate that clustering results depend on the air contaminant analysed, reflecting the difference in the respective emission sources of SO2 and NO2 in the region under study. Our work shows that much of the signal identifying the sources of NO2 and SO2 emissions resides in shorter timescales (hourly to daily) due to short-term variation of concentrations and that longer-term averages in data collection may lose the information needed to identify local sources. However, the methodology identifies stations mainly influenced by seasonality, if larger timescales (weekly to monthly) are considered. We have performed the first dissimilarity analysis based on gridded air quality model output and have shown that the methodology is capable of generating maps of subregions within which a single station will represent the entire subregion, to a given level of dissimilarity. We have also shown that our approach is capable of identifying different sampling methodologies as well as outliers (stations' time series which are markedly different from all others in a given dataset).

Systematic review and quality assessment of cost-effectiveness analysis of pharmaceutical therapies for advanced colorectal cancer.

PubMed

Leung, Henry W C; Chan, Agnes L F; Leung, Matthew S H; Lu, Chin-Li

2013-04-01

To systematically review and assess the quality of cost-effectiveness analyses (CEAs) of pharmaceutical therapies for metastatic colorectal cancer (mCRC). The MEDLINE, EMBASE, Cochrane, and EconLit databases were searched for the Medical Subject Headings or text key words quality-adjusted, QALY, life-year gained (LYG), and cost-effectiveness (January 1, 1999-December 31, 2009). Original CEAs of mCRC pharmacotherapy published in English were included. CEAs that measured health effects in units other than quality-adjusted life years or LYG and letters to the editor, case reports, posters, and editorials were excluded. Each article was independently assessed by 2 trained reviewers according to a quality checklist created by the Panel on Cost-Effectiveness in Health and Medicine. Twenty-four CEA studies pertaining to pharmaceutical therapies for mCRC were identified. All studies showed a wide variation in methodologic approaches, which resulted in a different range of incremental cost-effectiveness ratios reported for each regimen. We found common methodologic flaws in a significant number of CEA studies, including lack of clear description for critique of data quality; lack of method for adjusting costs for inflation and methods for obtaining expert judgment; no results of model validation; wide differences in the types of perspective, time horizon, study design, cost categories, and effect outcomes; and no quality assessment of data (cost and effectiveness) for the interventions evaluation. This study has shown a wide variation in the methodology and quality of cost-effectiveness analysis for mCRC. Improving quality and harmonization of CEA for cancer treatment is needed. Further study is suggested to assess the quality of CEA methodology outside the mCRC disease state.

Rating methodological quality: toward improved assessment and investigation.

PubMed

Moyer, Anne; Finney, John W

2005-01-01

Assessing methodological quality is considered essential in deciding what investigations to include in research syntheses and in detecting potential sources of bias in meta-analytic results. Quality assessment is also useful in characterizing the strengths and limitations of the research in an area of study. Although numerous instruments to measure research quality have been developed, they have lacked empirically-supported components. In addition, different summary quality scales have yielded different findings when they were used to weight treatment effect estimates for the same body of research. Suggestions for developing improved quality instruments include: distinguishing distinct domains of quality, such as internal validity, external validity, the completeness of the study report, and adherence to ethical practices; focusing on individual aspects, rather than domains of quality; and focusing on empirically-verified criteria. Other ways to facilitate the constructive use of quality assessment are to improve and standardize the reporting of research investigations, so that the quality of studies can be more equitably and thoroughly compared, and to identify optimal methods for incorporating study quality ratings into meta-analyses.

A systematic review of economic evaluations of treatments for patients with epilepsy.

PubMed

Wijnen, Ben F M; van Mastrigt, Ghislaine A P G; Evers, Silvia M A A; Gershuni, Olga; Lambrechts, Danielle A J E; Majoie, Marian H J M; Postulart, Debby; Aldenkamp, Bert A P; de Kinderen, Reina J A

2017-05-01

The increasing number of treatment options and the high costs associated with epilepsy have fostered the development of economic evaluations in epilepsy. It is important to examine the availability and quality of these economic evaluations and to identify potential research gaps. As well as looking at both pharmacologic (antiepileptic drugs [AEDs]) and nonpharmacologic (e.g., epilepsy surgery, ketogenic diet, vagus nerve stimulation) therapies, this review examines the methodologic quality of the full economic evaluations included. Literature search was performed in MEDLINE, EMBASE, NHS Economic Evaluation Database (NHS EED), Econlit, Web of Science, and CEA Registry. In addition, Cochrane Reviews, Cochrane DARE and Cochrane Health Technology Assessment Databases were used. To identify relevant studies, predefined clinical search strategies were combined with a search filter designed to identify health economic studies. Specific search strategies were devised for the following topics: (1) AEDs, (2) patients with cognitive deficits, (3) elderly patients, (4) epilepsy surgery, (5) ketogenic diet, (6) vagus nerve stimulation, and (7) treatment of (non)convulsive status epilepticus. A total of 40 publications were included in this review, 29 (73%) of which were articles about pharmacologic interventions. Mean quality score of all articles on the Consensus Health Economic Criteria (CHEC)-extended was 81.8%, the lowest quality score being 21.05%, whereas five studies had a score of 100%. Looking at the Consolidated Health Economic Evaluation Reporting Standards (CHEERS), the average quality score was 77.0%, the lowest being 22.7%, and four studies rated as 100%. There was a substantial difference in methodology in all included articles, which hampered the attempt to combine information meaningfully. Overall, the methodologic quality was acceptable; however, some studies performed significantly worse than others. The heterogeneity between the studies stresses the need to define a reference case (e.g., how should an economic evaluation within epilepsy be performed) and to derive consensus on what constitutes "standard optimal care." Wiley Periodicals, Inc. © 2017 International League Against Epilepsy.

The application of quantitative methods for identifying and exploring the presence of bias in systematic reviews: PDE-5 inhibitors for erectile dysfunction.

PubMed

Bekkering, G E; Abou-Setta, A M; Kleijnen, J

2008-01-01

A systematic review of PDE-5 inhibitors for erectile dysfunction was performed to evaluate the utility of quantitative methods for identifying and exploring the influence of bias and study quality on pooled outcomes from meta-analyses. We included 123 randomized controlled trials (RCTs). Methodological quality was poorly reported. All three drugs appeared highly effective. Indirect adjusted analyses showed no differences between the three drugs. Funnel plots and statistical tests showed no evidence of small-study effects for sildenafil whereas there was evidence of such bias for tadalafil and vardenafil. Adjustment for missing studies using trim and fill techniques did not alter the pooled estimates substantially. The exclusion of previous sildenafil nonresponders was associated with larger treatment effects for tadalafil. This investigation was hampered by poor reporting of methodological quality, a low number of studies, heterogeneity and large effect sizes. Despite such limitations, a comprehensive assessment of biases should be a routine in systematic reviews.

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

Epidemiological characteristics and methodological quality of meta-analyses on diabetes mellitus treatment: a systematic review.

PubMed

Wu, Xin Yin; Lam, Victor C K; Yu, Yue Feng; Ho, Robin S T; Feng, Ye; Wong, Charlene H L; Yip, Benjamin H K; Tsoi, Kelvin K F; Wong, Samuel Y S; Chung, Vincent C H

2016-11-01

Well-conducted meta-analyses (MAs) are considered as one of the best sources of clinical evidence for treatment decision. MA with methodological flaws may introduce bias and mislead evidence users. The aim of this study is to investigate the characteristics and methodological quality of MAs on diabetes mellitus (DM) treatments. Systematic review. Cochrane Database of Systematic Review and Database of Abstract of Reviews of Effects were searched for relevant MAs. Assessing methodological quality of systematic reviews (AMSTAR) tool was used to evaluate the methodological quality of included MAs. Logistic regression analysis was used to identify association between characteristics of MA and AMSTAR results. A total of 252 MAs including 4999 primary studies and 13,577,025 patients were included. Over half of the MAs (65.1%) only included type 2 DM patients and 160 MAs (63.5%) focused on pharmacological treatments. About 89.7% MAs performed comprehensive literature search and 89.3% provided characteristics of included studies. Included MAs generally had poor performance on the remaining AMSTAR items, especially in assessing publication bias (39.3%), providing lists of studies (19.0%) and declaring source of support comprehensively (7.5%). Only 62.7% MAs mentioned about harm of interventions. MAs with corresponding author from Asia performed less well in providing MA protocol than those from Europe. Methodological quality of MA on DM treatments was unsatisfactory. There is considerable room for improvement, especially in assessing publication bias, providing lists of studies and declaring source of support comprehensively. Also, there is an urgent need for MA authors to report treatment harm comprehensively. © 2016 European Society of Endocrinology.

Cluster Randomised Trials in Cochrane Reviews: Evaluation of Methodological and Reporting Practice.

PubMed

Richardson, Marty; Garner, Paul; Donegan, Sarah

2016-01-01

Systematic reviews can include cluster-randomised controlled trials (C-RCTs), which require different analysis compared with standard individual-randomised controlled trials. However, it is not known whether review authors follow the methodological and reporting guidance when including these trials. The aim of this study was to assess the methodological and reporting practice of Cochrane reviews that included C-RCTs against criteria developed from existing guidance. Criteria were developed, based on methodological literature and personal experience supervising review production and quality. Criteria were grouped into four themes: identifying, reporting, assessing risk of bias, and analysing C-RCTs. The Cochrane Database of Systematic Reviews was searched (2nd December 2013), and the 50 most recent reviews that included C-RCTs were retrieved. Each review was then assessed using the criteria. The 50 reviews we identified were published by 26 Cochrane Review Groups between June 2013 and November 2013. For identifying C-RCTs, only 56% identified that C-RCTs were eligible for inclusion in the review in the eligibility criteria. For reporting C-RCTs, only eight (24%) of the 33 reviews reported the method of cluster adjustment for their included C-RCTs. For assessing risk of bias, only one review assessed all five C-RCT-specific risk-of-bias criteria. For analysing C-RCTs, of the 27 reviews that presented unadjusted data, only nine (33%) provided a warning that confidence intervals may be artificially narrow. Of the 34 reviews that reported data from unadjusted C-RCTs, only 13 (38%) excluded the unadjusted results from the meta-analyses. The methodological and reporting practices in Cochrane reviews incorporating C-RCTs could be greatly improved, particularly with regard to analyses. Criteria developed as part of the current study could be used by review authors or editors to identify errors and improve the quality of published systematic reviews incorporating C-RCTs.

The Pennsylvania Trauma Outcomes Study Risk-Adjusted Mortality Model: Results of a Statewide Benchmarking Program

PubMed Central

WIEBE, DOUGLAS J.; HOLENA, DANIEL N.; DELGADO, M. KIT; McWILLIAMS, NATHAN; ALTENBURG, JULIET; CARR, BRENDAN G.

2018-01-01

Trauma centers need objective feedback on performance to inform quality improvement efforts. The Trauma Quality Improvement Program recently published recommended methodology for case mix adjustment and benchmarking performance. We tested the feasibility of applying this methodology to develop risk-adjusted mortality models for a statewide trauma system. We performed a retrospective cohort study of patients ≥16 years old at Pennsylvania trauma centers from 2011 to 2013 (n = 100,278). Our main outcome measure was observed-to-expected mortality ratios (overall and within blunt, penetrating, multisystem, isolated head, and geriatric subgroups). Patient demographic variables, physiology, mechanism of injury, transfer status, injury severity, and pre-existing conditions were included as predictor variables. The statistical model had excellent discrimination (area under the curve = 0.94). Funnel plots of observed-to-expected identified five centers with lower than expected mortality and two centers with higher than expected mortality. No centers were outliers for management of penetrating trauma, but five centers had lower and three had higher than expected mortality for blunt trauma. It is feasible to use Trauma Quality Improvement Program methodology to develop risk-adjusted models for statewide trauma systems. Even with smaller numbers of trauma centers that are available in national datasets, it is possible to identify high and low outliers in performance. PMID:28541852

The Pennsylvania Trauma Outcomes Study Risk-Adjusted Mortality Model: Results of a Statewide Benchmarking Program.

PubMed

Wiebe, Douglas J; Holena, Daniel N; Delgado, M Kit; McWilliams, Nathan; Altenburg, Juliet; Carr, Brendan G

2017-05-01

Trauma centers need objective feedback on performance to inform quality improvement efforts. The Trauma Quality Improvement Program recently published recommended methodology for case mix adjustment and benchmarking performance. We tested the feasibility of applying this methodology to develop risk-adjusted mortality models for a statewide trauma system. We performed a retrospective cohort study of patients ≥16 years old at Pennsylvania trauma centers from 2011 to 2013 (n = 100,278). Our main outcome measure was observed-to-expected mortality ratios (overall and within blunt, penetrating, multisystem, isolated head, and geriatric subgroups). Patient demographic variables, physiology, mechanism of injury, transfer status, injury severity, and pre-existing conditions were included as predictor variables. The statistical model had excellent discrimination (area under the curve = 0.94). Funnel plots of observed-to-expected identified five centers with lower than expected mortality and two centers with higher than expected mortality. No centers were outliers for management of penetrating trauma, but five centers had lower and three had higher than expected mortality for blunt trauma. It is feasible to use Trauma Quality Improvement Program methodology to develop risk-adjusted models for statewide trauma systems. Even with smaller numbers of trauma centers that are available in national datasets, it is possible to identify high and low outliers in performance.

Patient-reported outcomes in randomised controlled trials of colorectal cancer: an analysis determining the availability of robust data to inform clinical decision-making

PubMed Central

Whale, Katie; Fish, Daniel; Fayers, Peter; Cafaro, Valentina; Pusic, Andrea; Blazeby, Jane M.; Efficace, Fabio

2016-01-01

Purpose Randomised controlled trials (RCTs) are the most robust study design measuring outcomes of colorectal cancer (CRC) treatments, but to influence clinical practice trial design and reporting of patient-reported outcomes (PROs) must be of high quality. Objectives of this study were as follows: to examine the quality of PRO reporting in RCTs of CRC treatment; to assess the availability of robust data to inform clinical decision-making; and to investigate whether quality of reporting improved over time. Methods A systematic review from January 2004–February 2012 identified RCTs of CRC treatment describing PROs. Relevant abstracts were screened and manuscripts obtained. Methodological quality was assessed using International Society for Quality of Life Research—patient-reported outcome reporting standards. Changes in reporting quality over time were established by comparison with previous data, and risk of bias was assessed with the Cochrane risk of bias tool. Results Sixty-six RCTs were identified, seven studies (10 %) reported survival benefit favouring the experimental treatment, 35 trials (53 %) identified differences in PROs between treatment groups, and the clinical significance of these differences was discussed in 19 studies (29 %). The most commonly reported treatment type was chemotherapy (n = 45; 68 %). Improvements over time in key methodological issues including the documentation of missing data and the discussion of the clinical significance of PROs were found. Thirteen trials (20 %) had high-quality reporting. Conclusions Whilst improvements in PRO quality reporting over time were found, several recent studies still fail to robustly inform clinical practice. Quality of PRO reporting must continue to improve to maximise the clinical impact of PRO findings. PMID:25910987

Systematic Reviews and Meta-Analyses of Home Telemonitoring Interventions for Patients With Chronic Diseases: A Critical Assessment of Their Methodological Quality

PubMed Central

2013-01-01

Background Systematic reviews and meta-analyses of home telemonitoring interventions for patients with chronic diseases have increased over the past decade and become increasingly important to a wide range of clinicians, policy makers, and other health care stakeholders. While a few criticisms about their methodological rigor and synthesis approaches have recently appeared, no formal appraisal of their quality has been conducted yet. Objective The primary aim of this critical review was to evaluate the methodology, quality, and reporting characteristics of prior reviews that have investigated the effects of home telemonitoring interventions in the context of chronic diseases. Methods Ovid MEDLINE, the Database of Abstract of Reviews of Effects (DARE), and Health Technology Assessment Database (HTA) of the Cochrane Library were electronically searched to find relevant systematic reviews, published between January 1966 and December 2012. Potential reviews were screened and assessed for inclusion independently by three reviewers. Data pertaining to the methods used were extracted from each included review and examined for accuracy by two reviewers. A validated quality assessment instrument, R-AMSTAR, was used as a framework to guide the assessment process. Results Twenty-four reviews, nine of which were meta-analyses, were identified from more than 200 citations. The bibliographic search revealed that the number of published reviews has increased substantially over the years in this area and although most reviews focus on studying the effects of home telemonitoring on patients with congestive heart failure, researcher interest has extended to other chronic diseases as well, such as diabetes, hypertension, chronic obstructive pulmonary disease, and asthma. Nevertheless, an important number of these reviews appear to lack optimal scientific rigor due to intrinsic methodological issues. Also, the overall quality of reviews does not appear to have improved over time. While several criteria were met satisfactorily by either all or nearly all reviews, such as the establishment of an a priori design with inclusion and exclusion criteria, use of electronic searches on multiple databases, and reporting of studies characteristics, there were other important areas that needed improvement. Duplicate data extraction, manual searches of highly relevant journals, inclusion of gray and non-English literature, assessment of the methodological quality of included studies and quality of evidence were key methodological procedures that were performed infrequently. Furthermore, certain methodological limitations identified in the synthesis of study results have affected the results and conclusions of some reviews. Conclusions Despite the availability of methodological guidelines that can be utilized to guide the proper conduct of systematic reviews and meta-analyses and eliminate potential risks of bias, this knowledge has not yet been fully integrated in the area of home telemonitoring. Further efforts should be made to improve the design, conduct, reporting, and publication of systematic reviews and meta-analyses in this area. PMID:23880072

An Application of Six Sigma to Reduce Supplier Quality Cost

NASA Astrophysics Data System (ADS)

Gaikwad, Lokpriya Mohanrao; Teli, Shivagond Nagappa; Majali, Vijay Shashikant; Bhushi, Umesh Mahadevappa

2016-01-01

This article presents an application of Six Sigma to reduce supplier quality cost in manufacturing industry. Although there is a wider acceptance of Six Sigma in many organizations today, there is still a lack of in-depth case study of Six Sigma. For the present research the case study methodology was used. The company decided to reduce quality cost and improve selected processes using Six Sigma methodologies. Regarding the fact that there is a lack of case studies dealing with Six Sigma especially in individual manufacturing organization this article could be of great importance also for the practitioners. This paper discusses the quality and productivity improvement in a supplier enterprise through a case study. The paper deals with an application of Six Sigma define-measure-analyze-improve-control methodology in an industry which provides a framework to identify, quantify and eliminate sources of variation in an operational process in question, to optimize the operation variables, improve and sustain performance viz. process yield with well-executed control plans. Six Sigma improves the process performance (process yield) of the critical operational process, leading to better utilization of resources, decreases variations and maintains consistent quality of the process output.

The methodological quality of health economic evaluations for the management of hip fractures: A systematic review of the literature.

PubMed

Sabharwal, Sanjeeve; Carter, Alexander; Darzi, Lord Ara; Reilly, Peter; Gupte, Chinmay M

2015-06-01

Approximately 76,000 people a year sustain a hip fracture in the UK and the estimated cost to the NHS is £1.4 billion a year. Health economic evaluations (HEEs) are one of the methods employed by decision makers to deliver healthcare policy supported by clinical and economic evidence. The objective of this study was to (1) identify and characterize HEEs for the management of patients with hip fractures, and (2) examine their methodological quality. A literature search was performed in MEDLINE, EMBASE and the NHS Economic Evaluation Database. Studies that met the specified definition for a HEE and evaluated hip fracture management were included. Methodological quality was assessed using the Consensus on Health Economic Criteria (CHEC). Twenty-seven publications met the inclusion criteria of this study and were included in our descriptive and methodological analysis. Domains of methodology that performed poorly included use of an appropriate time horizon (66.7% of studies), incremental analysis of costs and outcomes (63%), future discounting (44.4%), sensitivity analysis (40.7%), declaration of conflicts of interest (37%) and discussion of ethical considerations (29.6%). HEEs for patients with hip fractures are increasing in publication in recent years. Most of these studies fail to adopt a societal perspective and key aspects of their methodology are poor. The development of future HEEs in this field must adhere to established principles of methodology, so that better quality research can be used to inform health policy on the management of patients with a hip fracture. Copyright © 2014 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

EQUIP: A European Survey of Quality Criteria for the Evaluation of Databases.

ERIC Educational Resources Information Center

Wilson, T. D.

1998-01-01

Reports on two stages of an investigation into the perceived quality of online databases. Presents data from 989 questionnaires from 600 database users in 12 European and Scandinavian countries and results of a test of the SERVQUAL methodology for identifying user expectations about database services. Lists statements used in the SERVQUAL survey.…

Determinants of Quality Education in Private Universities from Student Perspectives: A Case Study in Bangladesh

ERIC Educational Resources Information Center

Ashraf, Mohammad A.; Osman, Abu Zafar Rashed; Ratan, Sarker Rafij Ahmed

2016-01-01

Purpose: The purpose of the present study is to identify the determinants that potentially influence quality education in private universities in Bangladesh. Design/methodology/approach: To attain this objective, 234 data were collected through face-to-face interviews on campus during February-March 2013 from Bachelor of Business Administration…

Methodological quality and implications for practice of systematic Cochrane reviews in pediatric oral health: a critical assessment

PubMed Central

2014-01-01

Background To ensure evidence-based decision-making in pediatric oral health, Cochrane systematic reviews that address topics pertinent to this field are necessary. We aimed to identify all systematic reviews of paediatric dentistry and oral health by the Cochrane Oral Health Group (COHG), summarize their characteristics and assess their methodological quality. Our second objective was to assess implications for practice in the review conclusions and provide an overview of clinical implications about the usefulness of paediatric oral health interventions in practice. Methods We conducted a methodological survey including all paediatric dentistry reviews from the COHG. We extracted data on characteristics of included reviews, then assessed the methodological quality using a validated 11-item quality assessment tool (AMSTAR). Finally, we coded each review to indicate whether its authors concluded that an intervention should be implemented in practice, was not supported or was refuted by the evidence, or should be used only in research (inconclusive evidence). Results We selected 37 reviews; most concerned the prevention of caries. The methodological quality was high, except for the assessment of reporting bias. In 7 reviews (19%), the research showed that benefits outweighed harms; in 1, the experimental intervention was found ineffective; and in 29 (78%), evidence was insufficient to assess benefits and harms. In the 7 reviews, topical fluoride treatments (with toothpaste, gel or varnish) were found effective for permanent and deciduous teeth in children and adolescents, and sealants for occlusal tooth surfaces of permanent molars. Conclusions Cochrane reviews of paediatric dentistry were of high quality. They provided strong evidence that topical fluoride treatments and sealants are effective for children and adolescents and thus should be implemented in practice. However, a substantial number of reviews yielded inconclusive evidence. PMID:24716532

Sensory re-education after nerve injury of the upper limb: a systematic review.

PubMed

Oud, Tanja; Beelen, Anita; Eijffinger, Elianne; Nollet, Frans

2007-06-01

To systematically review the available evidence for the effectiveness of sensory re-education to improve the sensibility of the hand in patients with a peripheral nerve injury of the upper limb. Studies were identified by an electronic search in the databases MEDLINE, Cumulative Index to Nursing & Allied Health Literature (CINAHL), EMBASE, the Cochrane Library, the Physiotherapy Evidence Database (PEDro), and the database of the Dutch National Institute of Allied Health Professions (Doconline) and by screening the reference lists of relevant articles. Two reviewers selected studies that met the following inclusion criteria: all designs except case reports, adults with impaired sensibility of the hand due to a peripheral nerve injury of the upper limb, and sensibility and functional sensibility as outcome measures. The methodological quality of the included studies was independently assessed by two reviewers. A best-evidence synthesis was performed, based on design, methodological quality and significant findings on outcome measures. Seven studies, with sample sizes ranging from 11 to 49, were included in the systematic review and appraised for content. Five of these studies were of poor methodological quality. One uncontrolled study (N = 1 3 ) was considered to be of sufficient methodological quality, and one randomized controlled trial (N = 49) was of high methodological quality. Best-evidence synthesis showed that there is limited evidence for the effectiveness of sensory re-education, provided by a statistically significant improvement in sensibility found in one high-quality randomized controlled trial. There is a need for further well-defined clinical trials to assess the effectiveness of sensory re-education of patients with impaired sensibility of the hand due to a peripheral nerve injury.

Adherence of hip and knee arthroplasty studies to RSA standardization guidelines

PubMed Central

Mäkinen, Tatu J; Aro, Hannu T; Bragdon, Charles; Malchau, Henrik

2014-01-01

Background and purpose Guidelines for standardization of radiostereometry (RSA) of implants were published in 2005 to facilitate comparison of outcomes between various research groups. In this systematic review, we determined how well studies have adhered to these guidelines. Methods We carried out a literature search to identify all articles published between January 2000 and December 2011 that used RSA in the evaluation of hip or knee prosthesis migration. 2 investigators independently evaluated each of the studies for adherence to the 13 individual guideline items. Since some of the 13 points included more than 1 criterion, studies were assessed on whether each point was fully met, partially met, or not met. Results 153 studies that met our inclusion criteria were identified. 61 of these were published before the guidelines were introduced (2000–2005) and 92 after the guidelines were introduced (2006–2011). The methodological quality of RSA studies clearly improved from 2000 to 2011. None of the studies fully met all 13 guidelines. Nearly half (43) of the studies published after the guidelines demonstrated a high methodological quality and adhered at least partially to 10 of the 13 guidelines, whereas less than one-fifth (11) of the studies published before the guidelines had the same methodological quality. Commonly unaddressed guideline items were related to imaging methodology, determination of precision from double examinations, and also mean error of rigid-body fitting and condition number cutoff levels. Interpretation The guidelines have improved methodological reporting in RSA studies, but adherence to these guidelines is still relatively low. There is a need to update and clarify the guidelines for clinical hip and knee arthroplasty RSA studies. PMID:24954489

Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols

PubMed Central

Mhaskar, Rahul; Djulbegovic, Benjamin; Magazin, Anja; Soares, Heloisa P.; Kumar, Ambuj

2011-01-01

Objectives To assess whether reported methodological quality of randomized controlled trials (RCTs) reflect the actual methodological quality, and to evaluate the association of effect size (ES) and sample size with methodological quality. Study design Systematic review Setting Retrospective analysis of all consecutive phase III RCTs published by 8 National Cancer Institute Cooperative Groups until year 2006. Data were extracted from protocols (actual quality) and publications (reported quality) for each study. Results 429 RCTs met the inclusion criteria. Overall reporting of methodological quality was poor and did not reflect the actual high methodological quality of RCTs. The results showed no association between sample size and actual methodological quality of a trial. Poor reporting of allocation concealment and blinding exaggerated the ES by 6% (ratio of hazard ratio [RHR]: 0.94, 95%CI: 0.88, 0.99) and 24% (RHR: 1.24, 95%CI: 1.05, 1.43), respectively. However, actual quality assessment showed no association between ES and methodological quality. Conclusion The largest study to-date shows poor quality of reporting does not reflect the actual high methodological quality. Assessment of the impact of quality on the ES based on reported quality can produce misleading results. PMID:22424985

Symptomatic spinal metastasis: A systematic literature review of the preoperative prognostic factors for survival, neurological, functional and quality of life in surgically treated patients and methodological recommendations for prognostic studies

PubMed Central

Nater, Anick; Martin, Allan R.; Sahgal, Arjun; Choi, David

2017-01-01

Purpose While several clinical prediction rules (CPRs) of survival exist for patients with symptomatic spinal metastasis (SSM), these have variable prognostic ability and there is no recognized CPR for health related quality of life (HRQoL). We undertook a critical appraisal of the literature to identify key preoperative prognostic factors of clinical outcomes in patients with SSM who were treated surgically. The results of this study could be used to modify existing or develop new CPRs. Methods Seven electronic databases were searched (1990–2015), without language restriction, to identify studies that performed multivariate analysis of preoperative predictors of survival, neurological, functional and HRQoL outcomes in surgical patients with SSM. Individual studies were assessed for class of evidence. The strength of the overall body of evidence was evaluated using GRADE for each predictor. Results Among 4,818 unique citations, 17 were included; all were in English, rated Class III and focused on survival, revealing a total of 46 predictors. The strength of the overall body of evidence was very low for 39 and low for 7 predictors. Due to considerable heterogeneity in patient samples and prognostic factors investigated as well as several methodological issues, our results had a moderately high risk of bias and were difficult to interpret. Conclusions The quality of evidence for predictors of survival was, at best, low. We failed to identify studies that evaluated preoperative prognostic factors for neurological, functional, or HRQoL outcomes in surgical patients with SSM. We formulated methodological recommendations for prognostic studies to promote acquiring high-quality evidence to better estimate predictor effect sizes to improve patient education, surgical decision-making and development of CPRs. PMID:28225772

Cochrane Systematic Reviews of Chinese Herbal Medicines: An Overview

PubMed Central

Hu, Jing; Zhang, Junhua; Zhao, Wei; Zhang, Yongling; Zhang, Li; Shang, Hongcai

2011-01-01

Objectives Our study had two objectives: a) to systematically identify all existing systematic reviews of Chinese herbal medicines (CHM) published in Cochrane Library; b) to assess the methodological quality of included reviews. Methodology/Principal Findings We performed a systematic search of the Cochrane Database of Systematic Reviews (CDSR, Issue 5, 2010) to identify all reviews of CHM. A total of fifty-eight reviews were eligible for our study. Twenty-one of the included reviews had at least one Traditional Chinese Medicine (TCM) practitioner as its co-author. 7 reviews didn't include any primary study, the remaining reviews (n = 51) included a median of 9 studies and 936 participants. 50% of reviews were last assessed as up-to-date prior to 2008. The questions addressed by 39 reviews were broad in scope, in which 9 reviews combined studies with different herbal medicines. For OQAQ, the mean of overall quality score (item 10) was 5.05 (95% CI; 4.58-5.52). All reviews assessed the methodological quality of primary studies, 16% of included primary studies used adequate sequence generation and 7% used adequate allocation concealment. Of the 51 nonempty reviews, 23 reviews were reported as being inconclusive, while 27 concluded that there might be benefit of CHM, which was limited by the poor quality or inadequate quantity of included studies. 58 reviews reported searching a median of seven electronic databases, while 10 reviews did not search any Chinese database. Conclusions Now CDSR has included large numbers of CHM reviews, our study identified some areas which could be improved, such as almost half of included reviews did not have the participation of TCM practitioners and were not up-to-date according to Cochrane criteria, some reviews pooled the results of different herbal medicines and ignored the searching of Chinese databases. PMID:22174870

Analysis of the Quality of Clinical Trials Published in Spanish-Language Dermatology Journals Between 1997 and 2012.

PubMed

Sanclemente, G; Pardo, H; Sánchez, S; Bonfill, X

2016-01-01

The value of randomized clinical trials (RCTs) undertaken to identify an association between an intervention and an outcome is determined by their quality and scientific rigor. To assess the methodological quality of RCTs published in Spanish-language dermatology journals. By way of a systematic manual search, we identified all the RCTs in journals published in Spain and Latin America between 1997 (the year in which the CONSORT statement was published) and 2012. Risk of bias was evaluated for each RCT by assessing the following domains: randomization sequence generation, allocation concealment, blinding of patients and those assessing outcomes, missing data, and patient follow-up. Source of funding and conflict of interest statements, if any, were recorded for each study. The search identified 70 RCTs published in 21 journals. Most of the RCTs had a high risk of bias, primarily because of gaps in the reporting of important methodological aspects. The source of funding was reported in only 15 studies. In spite of the considerable number of Spanish and Latin American journals, few RCTs have been published in the 15 years analyzed. Most of the RCTs published had serious defects in that the authors omitted methodological information essential to any evaluation of the quality of the trial and failed to report sources of funding or possible conflicts of interest for the authors involved. Authors of experimental clinical research in dermatology published in Spain and Latin America need to substantially improve both the design of their trials and the reporting of results. Copyright © 2015 Elsevier España, S.L.U. and AEDV. All rights reserved.

Journal impact factor and methodological quality of surgical randomized controlled trials: an empirical study.

PubMed

Ahmed Ali, Usama; Reiber, Beata M M; Ten Hove, Joren R; van der Sluis, Pieter C; Gooszen, Hein G; Boermeester, Marja A; Besselink, Marc G

2017-11-01

The journal impact factor (IF) is often used as a surrogate marker for methodological quality. The objective of this study is to evaluate the relation between the journal IF and methodological quality of surgical randomized controlled trials (RCTs). Surgical RCTs published in PubMed in 1999 and 2009 were identified. According to IF, RCTs were divided into groups of low (<2), median (2-3) and high IF (>3), as well as into top-10 vs all other journals. Methodological quality characteristics and factors concerning funding, ethical approval and statistical significance of outcomes were extracted and compared between the IF groups. Additionally, a multivariate regression was performed. The median IF was 2.2 (IQR 2.37). The percentage of 'low-risk of bias' RCTs was 13% for top-10 journals vs 4% for other journals in 1999 (P < 0.02), and 30 vs 12% in 2009 (P < 0.02). Similar results were observed for high vs low IF groups. The presence of sample-size calculation, adequate generation of allocation and intention-to-treat analysis were independently associated with publication in higher IF journals; as were multicentre trials and multiple authors. Publication of RCTs in high IF journals is associated with moderate improvement in methodological quality compared to RCTs published in lower IF journals. RCTs with adequate sample-size calculation, generation of allocation or intention-to-treat analysis were associated with publication in a high IF journal. On the other hand, reporting a statistically significant outcome and being industry funded were not independently associated with publication in a higher IF journal.

Systematic Review of Knowledge Translation Strategies to Promote Research Uptake in Child Health Settings.

PubMed

Albrecht, Lauren; Archibald, Mandy; Snelgrove-Clarke, Erna; Scott, Shannon D

2016-01-01

Strategies to assist evidence-based decision-making for healthcare professionals are crucial to ensure high quality patient care and outcomes. The goal of this systematic review was to identify and synthesize the evidence on knowledge translation interventions aimed at putting explicit research evidence into child health practice. A comprehensive search of thirteen electronic databases was conducted, restricted by date (1985-2011) and language (English). Articles were included if: 1) studies were randomized controlled trials (RCT), controlled clinical trials (CCT), or controlled before-and-after (CBA) studies; 2) target population was child health professionals; 3) interventions implemented research in child health practice; and 4) outcomes were measured at the professional/process, patient, or economic level. Two reviewers independently extracted data and assessed methodological quality. Study data were aggregated and analyzed using evidence tables. Twenty-one studies (13 RCT, 2 CCT, 6 CBA) were included. The studies employed single (n=9) and multiple interventions (n=12). The methodological quality of the included studies was largely moderate (n=8) or weak (n=11). Of the studies with moderate to strong methodological quality ratings, three demonstrated consistent, positive effect(s) on the primary outcome(s); effective knowledge translation interventions were two single, non-educational interventions and one multiple, educational intervention. This multidisciplinary systematic review in child health setting identified effective knowledge translation strategies assessed by the most rigorous research designs. Given the overall poor quality of the research literature, specific recommendations were made to improve knowledge translation efforts in child health. Copyright © 2016 Elsevier Inc. All rights reserved.

Identifying depression post-stroke in patients with aphasia: a systematic review of the reliability, validity and feasibility of available instruments.

PubMed

van Dijk, Mariska J; de Man-van Ginkel, Janneke M; Hafsteinsdóttir, Thóra B; Schuurmans, Marieke J

2016-08-01

To identify and critically appraise the evidence for instruments assessing depression in stroke patients with aphasia. The PubMed, CINAHL, Web of Science, Psych Info and Cochrane databases were searched from inception until May 2015. Of the 383 titles found in the search, 15 articles met the inclusion criteria and six instruments were identified: The Aphasic Depression Rating Scale, the Clinical Global Impression-Scale, the Stroke Aphasic Depression Questionnaire (four versions), the Signs of Depression Scale, the Visual Analogue Mood Scale (three versions) and the Visual Analogue Self Esteem Scale. Supporting evidence for reliability and validity was limited owing to methodological flaws in the studies influencing the ratings of methodological quality. Feasibility data were available for all instruments. Rating time of the instruments ranged from less than one minute to five minutes, two instruments required extensive training. A number of instruments to assess depressive symptoms in patients with aphasia are available. None of the instruments however, were found to be sufficiently investigated and most of the studies identified were of low methodological quality. Given the present evidence, the Stroke Aphasic Depression Questionnaire-10, the Stroke Aphasic Depression Questionnaire-H10 and the Signs of Depression Scale are the most feasible and can be recommended for clinical practice. © The Author(s) 2015.

Quality indicators for the assessment and management of pain in the emergency department: a systematic review.

PubMed

Stang, Antonia Schirmer; Hartling, Lisa; Fera, Cassandra; Johnson, David; Ali, Samina

2014-01-01

Evidence indicates that pain is undertreated in the emergency department (ED). The first step in improving the pain experience for ED patients is to accurately and systematically assess the actual care being provided. Identifying gaps in the assessment and treatment of pain and improving patient outcomes requires relevant, evidence-based performance measures. To systematically review the literature and identify quality indicators specific to the assessment and management of pain in the ED. Four major bibliographical databases were searched from January 1980 to December 2010, and relevant journals and conference proceedings were manually searched. Original research that described the development or collection of data on one or more quality indicators relevant to the assessment or management of pain in the ED was included. The search identified 18,078 citations. Twenty-three articles were included: 15 observational (cohort) studies; three before-after studies; three audits; one quality indicator development study; and one survey. Methodological quality was moderate, with weaknesses in the reporting of study design and methodology. Twenty unique indicators were identified, with the majority (16 of 20) measuring care processes. Overall, 91% (21 of 23) of the studies reported indicators for the assessment or management of presenting pain, as opposed to procedural pain. Three of the studies included children; however, none of the indicators were developed specifically for a pediatric population. Gaps in the existing literature include a lack of measures reflecting procedural pain, patient outcomes and the pediatric population. Future efforts should focus on developing indicators specific to these key areas.

Evaluating Remote Reference Service: A Practical Guide to Problems and Solutions

ERIC Educational Resources Information Center

Pomerantz, Jeffrey; Mon, Lorri; McClure, Charles R.

2008-01-01

This paper identifies key methodological issues affecting quality of data in the evaluation of remote reference services. Despite a growing number of studies in this area, no comprehensive effort has been made to identify potential problems and suggest solutions. The strategies proposed in this paper offer practical ways in which libraries can…

[Factors influencing the quality of clinical practice guidelines in ovarian cancer].

PubMed

Castillo-Londoño, J S; Medina-Torres, Y A; Sandoval-Salinas, C; Buitrago-Gutierrez, G; Torres-Ibargüen, M Z; Gonzalez-Rangel, A L

To identify the characteristics of the published clinical practice guidelines for the management of epithelial ovarian cancer that suggest a good methodological quality. A literature review was performed on 25 clinical practice guidelines for epithelial ovarian cancer that were identified in different databases (MEDLINE, Guidelines International Network, National Guidelines Clearing house) published between 2007 and 2014. The quality of the guidelines was evaluated using the Appraisal of Guidelines Research and Evaluation II tool. Descriptive and bivariate analyses were performed to assess the association between the quality of the guidelines and of some of their features and their developers. Just under half (48%) of the guidelines were rated as low quality. Scientific societies or independent centres and private funding, or under-reporting the source of funding, were statistically associated with lower quality of clinical practice guidelines (P<.01). The guidelines developed by National Program Guidelines had a median of consistently higher scores in all domains of the Appraisal of Guidelines Research and Evaluation II, with significant differences in the definition of scope and objectives, the participation of stakeholders, the methodological rigour of development, and applicability to the context. Features such as the nature of the developer and funding of the guidelines are predictors of quality that should be taken into account prior to the use of the recommendations of a document. Copyright © 2016 SECA. Publicado por Elsevier España, S.L.U. All rights reserved.

Randomized clinical trials in dentistry: Risks of bias, risks of random errors, reporting quality, and methodologic quality over the years 1955–2013

PubMed Central

Armijo-Olivo, Susan; Cummings, Greta G.; Amin, Maryam; Flores-Mir, Carlos

2017-01-01

Objectives To examine the risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions and the development of these aspects over time. Methods We included 540 randomized clinical trials from 64 selected systematic reviews. We extracted, in duplicate, details from each of the selected randomized clinical trials with respect to publication and trial characteristics, reporting and methodologic characteristics, and Cochrane risk of bias domains. We analyzed data using logistic regression and Chi-square statistics. Results Sequence generation was assessed to be inadequate (at unclear or high risk of bias) in 68% (n = 367) of the trials, while allocation concealment was inadequate in the majority of trials (n = 464; 85.9%). Blinding of participants and blinding of the outcome assessment were judged to be inadequate in 28.5% (n = 154) and 40.5% (n = 219) of the trials, respectively. A sample size calculation before the initiation of the study was not performed/reported in 79.1% (n = 427) of the trials, while the sample size was assessed as adequate in only 17.6% (n = 95) of the trials. Two thirds of the trials were not described as double blinded (n = 358; 66.3%), while the method of blinding was appropriate in 53% (n = 286) of the trials. We identified a significant decrease over time (1955–2013) in the proportion of trials assessed as having inadequately addressed methodological quality items (P < 0.05) in 30 out of the 40 quality criteria, or as being inadequate (at high or unclear risk of bias) in five domains of the Cochrane risk of bias tool: sequence generation, allocation concealment, incomplete outcome data, other sources of bias, and overall risk of bias. Conclusions The risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions have improved over time; however, further efforts that contribute to the development of more stringent methodology and detailed reporting of trials are still needed. PMID:29272315

Randomized clinical trials in dentistry: Risks of bias, risks of random errors, reporting quality, and methodologic quality over the years 1955-2013.

PubMed

Saltaji, Humam; Armijo-Olivo, Susan; Cummings, Greta G; Amin, Maryam; Flores-Mir, Carlos

2017-01-01

To examine the risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions and the development of these aspects over time. We included 540 randomized clinical trials from 64 selected systematic reviews. We extracted, in duplicate, details from each of the selected randomized clinical trials with respect to publication and trial characteristics, reporting and methodologic characteristics, and Cochrane risk of bias domains. We analyzed data using logistic regression and Chi-square statistics. Sequence generation was assessed to be inadequate (at unclear or high risk of bias) in 68% (n = 367) of the trials, while allocation concealment was inadequate in the majority of trials (n = 464; 85.9%). Blinding of participants and blinding of the outcome assessment were judged to be inadequate in 28.5% (n = 154) and 40.5% (n = 219) of the trials, respectively. A sample size calculation before the initiation of the study was not performed/reported in 79.1% (n = 427) of the trials, while the sample size was assessed as adequate in only 17.6% (n = 95) of the trials. Two thirds of the trials were not described as double blinded (n = 358; 66.3%), while the method of blinding was appropriate in 53% (n = 286) of the trials. We identified a significant decrease over time (1955-2013) in the proportion of trials assessed as having inadequately addressed methodological quality items (P < 0.05) in 30 out of the 40 quality criteria, or as being inadequate (at high or unclear risk of bias) in five domains of the Cochrane risk of bias tool: sequence generation, allocation concealment, incomplete outcome data, other sources of bias, and overall risk of bias. The risks of bias, risks of random errors, reporting quality, and methodological quality of randomized clinical trials of oral health interventions have improved over time; however, further efforts that contribute to the development of more stringent methodology and detailed reporting of trials are still needed.

A checklist is associated with increased quality of reporting preclinical biomedical research: A systematic review

PubMed Central

Olonisakin, Tolani F.; Pribis, John P.; Zupetic, Jill; Yoon, Joo Heung; Holleran, Kyle M.; Jeong, Kwonho; Shaikh, Nader; Rubio, Doris M.; Lee, Janet S.

2017-01-01

Irreproducibility of preclinical biomedical research has gained recent attention. It is suggested that requiring authors to complete a checklist at the time of manuscript submission would improve the quality and transparency of scientific reporting, and ultimately enhance reproducibility. Whether a checklist enhances quality and transparency in reporting preclinical animal studies, however, has not been empirically studied. Here we searched two highly cited life science journals, one that requires a checklist at submission (Nature) and one that does not (Cell), to identify in vivo animal studies. After screening 943 articles, a total of 80 articles were identified in 2013 (pre-checklist) and 2015 (post-checklist), and included for the detailed evaluation of reporting methodological and analytical information. We compared the quality of reporting preclinical animal studies between the two journals, accounting for differences between journals and changes over time in reporting. We find that reporting of randomization, blinding, and sample-size estimation significantly improved when comparing Nature to Cell from 2013 to 2015, likely due to implementation of a checklist. Specifically, improvement in reporting of the three methodological information was at least three times greater when a mandatory checklist was implemented than when it was not. Reporting the sex of animals and the number of independent experiments performed also improved from 2013 to 2015, likely from factors not related to a checklist. Our study demonstrates that completing a checklist at manuscript submission is associated with improved reporting of key methodological information in preclinical animal studies. PMID:28902887

Methodologic European external quality assurance for DNA sequencing: the EQUALseq program.

PubMed

Ahmad-Nejad, Parviz; Dorn-Beineke, Alexandra; Pfeiffer, Ulrike; Brade, Joachim; Geilenkeuser, Wolf-Jochen; Ramsden, Simon; Pazzagli, Mario; Neumaier, Michael

2006-04-01

DNA sequencing is a key technique in molecular diagnostics, but to date no comprehensive methodologic external quality assessment (EQA) programs have been instituted. Between 2003 and 2005, the European Union funded, as specific support actions, the EQUAL initiative to develop methodologic EQA schemes for genotyping (EQUALqual), quantitative PCR (EQUALquant), and sequencing (EQUALseq). Here we report on the results of the EQUALseq program. The participating laboratories received a 4-sample set comprising 2 DNA plasmids, a PCR product, and a finished sequencing reaction to be analyzed. Data and information from detailed questionnaires were uploaded online and evaluated by use of a scoring system for technical skills and proficiency of data interpretation. Sixty laboratories from 21 European countries registered, and 43 participants (72%) returned data and samples. Capillary electrophoresis was the predominant platform (n = 39; 91%). The median contiguous correct sequence stretch was 527 nucleotides with considerable variation in quality of both primary data and data evaluation. The association between laboratory performance and the number of sequencing assays/year was statistically significant (P <0.05). Interestingly, more than 30% of participants neither added comments to their data nor made efforts to identify the gene sequences or mutational positions. Considerable variations exist even in a highly standardized methodology such as DNA sequencing. Methodologic EQAs are appropriate tools to uncover strengths and weaknesses in both technique and proficiency, and our results emphasize the need for mandatory EQAs. The results of EQUALseq should help improve the overall quality of molecular genetics findings obtained by DNA sequencing.

Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols.

PubMed

Mhaskar, Rahul; Djulbegovic, Benjamin; Magazin, Anja; Soares, Heloisa P; Kumar, Ambuj

2012-06-01

To assess whether the reported methodological quality of randomized controlled trials (RCTs) reflects the actual methodological quality and to evaluate the association of effect size (ES) and sample size with methodological quality. Systematic review. This is a retrospective analysis of all consecutive phase III RCTs published by eight National Cancer Institute Cooperative Groups up to 2006. Data were extracted from protocols (actual quality) and publications (reported quality) for each study. Four hundred twenty-nine RCTs met the inclusion criteria. Overall reporting of methodological quality was poor and did not reflect the actual high methodological quality of RCTs. The results showed no association between sample size and actual methodological quality of a trial. Poor reporting of allocation concealment and blinding exaggerated the ES by 6% (ratio of hazard ratio [RHR]: 0.94; 95% confidence interval [CI]: 0.88, 0.99) and 24% (RHR: 1.24; 95% CI: 1.05, 1.43), respectively. However, actual quality assessment showed no association between ES and methodological quality. The largest study to date shows that poor quality of reporting does not reflect the actual high methodological quality. Assessment of the impact of quality on the ES based on reported quality can produce misleading results. Copyright © 2012 Elsevier Inc. All rights reserved.

Methodological issues in the quantitative assessment of quality of life.

PubMed

Panagiotakos, Demosthenes B; Yfantopoulos, John N

2011-10-01

The term quality of life can be identified in Aristotle's classical writings of 330 BC. In his Nichomachian ethics he recognises the multiple relationships between happiness, well-being, "eudemonia" and quality of life. Historically the concept of quality of life has undergone various interpretations. It involves personal experience, perceptions and beliefs, attitudes concerning philosophical, cultural, spiritual, psychological, political, and financial aspects of everyday living. Quality of life has been extensively used both as an outcome and an explanatory factor in relation to human health, in various clinical trials, epidemiologic studies and health interview surveys. Because of the variations in the definition of quality of life, both in theory and in practice, there are also a wide range of procedures that are used to assess quality of life. In this paper several methodological issues regarding the tools used to evaluate quality of life is discussed. In summary, the use of components consisted of large number of classes, as well as the use of specific weights for each scale component, and the low-to-moderate inter-correlation level between the components, is evident from simulated and empirical studies.

Appraisal of the methodological quality and summary of the findings of systematic reviews on the relationship between SSRIs and suicidality.

PubMed

Li, Wei; Li, Wei; Wan, Yumei; Ren, Juanjuan; Li, Ting; Li, Chunbo

2014-10-01

Several systematic reviews have been published about the relationship of the use of selective serotonin reuptake inhibitors (SSRIs) and risk of suicidal ideation or behavior but there has been no formal assessment of the quality of these reports. Assess the methodological quality of systematic reviews about the relationship of SSRI use and suicidal ideation and behavior; and provide overall conclusions based on this assessment. Systematic reviews of RCTs that compared SSRIs to placebo and used suicidal ideation or behavior as a key outcome variable were identified by searching Pubmed, Embase, The Cochrane Library, EBSCO, PsycINFO, Chinese National Knowledge Infrastructure, Chongqing VIP database for Chinese Technical Periodicals, WANFANG DATA, and the Chinese Biological Medical Literature Database. The methodological quality of included reviews was independently assessed by two expert raters using the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) scale. Twelve systematic reviews and meta-analyses were identified. The inter-rater reliability of the overall AMSTAR quality score was excellent (ICC=0.86) but the inter-rater reliability of 5 of the 11 AMSTAR items was poor (Kappa <0.60). Based on the AMSTAR total score, there was one high-quality review, eight moderate-quality reviews, and three low-quality reviews. The high-quality review and three of the moderate-quality reviews reported a significantly increased risk of suicidal ideation or behavior in the SSRI group compared to the placebo group. Three of the four reviews limited to children and adolescents found a significantly increased risk of suicidal ideation or behavior with SSRI use which was most evident in teenagers taking paroxetine and in teenagers with depressive disorders. The available evidence suggests that adolescents may experience an increase in suicidal ideation and behavior with SSRI use, particularly those who have a depressive disorder and those treated with paroxetine. However, there are few high-quality reviews on this issue, so some doubt about the evidence remains. The AMSTAR scale may be useful in the ongoing efforts to improve the quality of systematic reviews, but further work is needed on tightening the operational criteria for some of the items in the scale.

Innovation and Integrity in Intervention Research: Conceptual Issues, Methodology, and Knowledge Translation.

PubMed

Malti, Tina; Beelmann, Andreas; Noam, Gil G; Sommer, Simon

2018-04-01

In this article, we introduce the special issue entitled Innovation and Integrity in Intervention Science. Its focus is on essential problems and prospects for intervention research examining two related topics, i.e., methodological issues and research integrity, and challenges in the transfer of research knowledge into practice and policy. The main aims are to identify how to advance methodology in order to improve research quality, examine scientific integrity in the field of intervention science, and discuss future steps to enhance the transfer of knowledge about evidence-based intervention principles into sustained practice, routine activities, and policy decisions. Themes of the special issue are twofold. The first includes questions about research methodology in intervention science, both in terms of research design and methods, as well as data analyses and the reporting of findings. Second, the issue tackles questions surrounding the types of knowledge translation frameworks that might be beneficial to mobilize the transfer of research-based knowledge into practice and public policies. The issue argues that innovations in methodology and thoughtful approaches to knowledge translation can enable transparency, quality, and sustainability of intervention research.

Assessing the Methodological Quality of Glaucoma Clinical Practice Guidelines and Their Recommendations on Microinvasive Glaucoma Surgery: A Systematic Review.

PubMed

Michaelov, Evan; Armstrong, James J; Nguyen, Mary; Instrum, Bridget; Lam, Tracey; Denstedt, James; Hutnik, Cindy M L

2018-02-01

Clinical practice guidelines (CPG) are regarded by many as critical communications providing guidance within specific medical fields. Over a decade ago, the first microinvasive glaucoma surgical (MIGS) procedures were introduced. Since then, a number of these novel intraocular pressure controlling surgical options have been approved worldwide. Governing bodies and health care administration often utilize CPGs when considering funding for newer technologies. This highlights the importance of well-written, accurate, and up-to-date CPGs in the rapidly evolving field of MIGS. If CPGs are unable to fill this role, their use in treatment decision-making is doing a disservice to patients, who will be denied currently available and potentially superior care. To determine the overall value of a CPG, the methodological quality with which it was developed, in addition to the current relevance and appropriateness of its recommendations, should be evaluated. The objective of the present study was to assess the methodological quality of currently available international glaucoma CPGs, as well as their coverage of MIGS as a surrogate marker of relevance and appropriateness to policy-makers and ophthalmologists alike. To identify potentially relevant CPGs, a predefined search strategy was used to search the following databases: Medline, EMBASE, BIOSIS, and Web of Science. All CPGs related to adult glaucoma and published in English were included. CPG methodological quality was assessed by 3 individuals using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool. Studies were then assessed for coverage of MIGS devices and procedures. Search strategy and subsequent screening identified 11 CPGs for analysis. Eight were of high quality according to the AGREE II criteria. Three included basic information on MIGS, but none provided specific recommendations regarding their indications or which patient populations would benefit most. Many international glaucoma CPGs are of high methodological quality. However, coverage of MIGS is sparse, nonspecific and in many instances, absent. This causes CPGs to be a suboptimal source in guiding physicians and health policy-makers in areas characterized by novel and/or rapidly evolving technologies. Mechanisms to incorporate updated evidence in CPGs would have to be considered before they can be used as a source of contemporary clinical decision-making.

Standardised survey method for identifying catchment risks to water quality.

PubMed

Baker, D L; Ferguson, C M; Chier, P; Warnecke, M; Watkinson, A

2016-06-01

This paper describes the development and application of a systematic methodology to identify and quantify risks in drinking water and recreational catchments. The methodology assesses microbial and chemical contaminants from both diffuse and point sources within a catchment using Escherichia coli, protozoan pathogens and chemicals (including fuel and pesticides) as index contaminants. Hazard source information is gathered by a defined sanitary survey process involving use of a software tool which groups hazards into six types: sewage infrastructure, on-site sewage systems, industrial, stormwater, agriculture and recreational sites. The survey estimates the likelihood of the site affecting catchment water quality, and the potential consequences, enabling the calculation of risk for individual sites. These risks are integrated to calculate a cumulative risk for each sub-catchment and the whole catchment. The cumulative risks process accounts for the proportion of potential input sources surveyed and for transfer of contaminants from upstream to downstream sub-catchments. The output risk matrices show the relative risk sources for each of the index contaminants, highlighting those with the greatest impact on water quality at a sub-catchment and catchment level. Verification of the sanitary survey assessments and prioritisation is achieved by comparison with water quality data and microbial source tracking.

Quality improvement primer part 1: Preparing for a quality improvement project in the emergency department.

PubMed

Chartier, Lucas B; Cheng, Amy H Y; Stang, Antonia S; Vaillancourt, Samuel

2018-01-01

Emergency medicine (EM) providers work in a fast-paced and often hectic environment that has a high risk for patient safety incidents and gaps in the quality of care. These challenges have resulted in opportunities for frontline EM providers to play a role in quality improvement (QI) projects. QI has developed into a mature field with methodologies that can dramatically improve the odds of having a successful project with a sustainable impact. However, this expertise is not yet commonly taught during professional training. In this first of three articles meant as a QI primer for EM clinicians, we will introduce QI methodology and strategic planning using a fictional case study as an example. We will review how to identify a QI problem, define components of an effective problem statement, and identify stakeholders and core change team members. We will also describe three techniques used to perform root cause analyses-Ishikawa diagrams, Pareto charts and process mapping-and how they relate to preparing for a QI project. The next two papers in this series will focus on the execution of the QI project itself using rapid-cycle testing and on the evaluation and sustainability of QI projects.

[Satisfaction and perceived quality of people insured by the Social Health Protection in Mexico. Methodological foundations].

PubMed

Saturno-Hernández, Pedro J; Gutiérrez-Reyes, Juan Pablo; Vieyra-Romero, Waldo Ivan; Romero-Martínez, Martín; O'Shea-Cuevas, Gabriel Jaime; Lozano-Herrera, Javier; Tavera-Martínez, Sonia; Hernández-Ávila, Mauricio

2016-01-01

To describe the conceptual framework and methods for implementation and analysis of the satisfaction survey of the Mexican System for Social Protection in Health. We analyze the methodological elements of the 2013, 2014 and 2015 surveys, including the instrument, sampling method and study design, conceptual framework, and characteristics and indicators of the analysis. The survey captures information on perceived quality and satisfaction. Sampling has national and State representation. Simple and composite indicators (index of satisfaction and rate of reported quality problems) are built and described. The analysis is completed using Pareto diagrams, correlation between indicators and association with satisfaction by means of multivariate models. The measurement of satisfaction and perceived quality is a complex but necessary process to comply with regulations and to identify strategies for improvement. The described survey presents a design and rigorous analysis focused on its utility for improving.

[A functional analysis of healthcare auditors' skills in Venezuela, 2008].

PubMed

Chirinos-Muñoz, Mónica S

2010-10-01

Using functional analysis for identifying the basic, working, specific and generic skills and values which a health service auditor must have. Implementing the functional analysis technique with 10 experts, identifying specific, basic, generic skills and values by means of deductive logic. A functional map was obtained which started by establishing a key purpose based on improving healthcare and service quality from which three key functions emerged. The main functions and skills' units were then broken down into the competitive elements defining what a health service auditor is able to do. This functional map (following functional analysis methodology) shows in detail the simple and complex tasks which a healthcare auditor should apply in the workplace, adopting a forward management approach for improving healthcare and health service quality. This methodology, expressing logical-deductive awareness raising, provides expert consensual information validating each element regarding overall skills.

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews

PubMed Central

2013-01-01

Background Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. Methods This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. Results A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. Conclusion There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words) PMID:23331384

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews.

PubMed

Wells, Cherie; Kolt, Gregory S; Marshall, Paul; Hill, Bridget; Bialocerkowski, Andrea

2013-01-19

Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words).

Effectiveness of physical therapy interventions for children with cerebral palsy: A systematic review

PubMed Central

Anttila, Heidi; Autti-Rämö, Ilona; Suoranta, Jutta; Mäkelä, Marjukka; Malmivaara, Antti

2008-01-01

Background To assess the effectiveness of physical therapy (PT) interventions on functioning in children with cerebral palsy (CP). Methods A search was made in Medline, Cinahl, PEDro and the Cochrane library for the period 1990 to February 2007. Only randomized controlled trials (RCTs) on PT interventions in children with diagnosed CP were included. Two reviewers independently assessed the methodological quality and extracted the data. The outcomes measured in the trials were classified using the International Classification of Functioning, Disability and Health (ICF). Results Twenty-two trials were identified. Eight intervention categories were distinguished. Four trials were of high methodological quality. Moderate evidence of effectiveness was established for two intervention categories: effectiveness of upper extremity treatments on attained goals and active supination, and of prehensile hand treatment and neurodevelopmental therapy (NDT) or NDT twice a week on developmental status, and of constraint-induced therapy on amount and quality of hand use. Moderate evidence of ineffectiveness was found of strength training on walking speed and stride length. Conflicting evidence was found for strength training on gross motor function. For the other intervention categories the evidence was limited due to low methodological quality and the statistically insignificant results of the studies. Conclusion Due to limitations in methodological quality and variations in population, interventions and outcomes, mostly limited evidence on the effectiveness of most PT interventions is available through RCTs. Moderate evidence was found for some effectiveness of upper extremity training. Well-designed trials are needed especially for focused PT interventions. PMID:18435840

[Quality of life and AIDS from the perspective of persons living with HIV: a preliminary contribution by the structural approach to social representations].

PubMed

Costa, Tadeu Lessa da; Oliveira, Denize Cristina de; Formozo, Gláucia Alexandre

2015-02-01

This descriptive qualitative study had the following objectives: identify the content and structure of social representations of quality of life and AIDS for persons living with the disease and analyze the structural relations between such representations. The sample included 103 persons with HIV in a municipality (county) in northern Rio de Janeiro State, Brazil. The methodology used free and hierarchical recall of words for the inductive terms "AIDS" and "quality of life for persons with AIDS", with analysis by the EVOC software. The probable core representation of AIDS was identified as: prejudice, treatment, family, and medications, with the same components identified for quality of life, plus healthy diet and work. We thus elaborated the hypothesis of joint, coordinated representational interaction, fitting the representations together, with implications for the symbolic grasp and quality of life for persons living with HIV. The findings provide backing for collective and individual health approaches to improve quality of life in this group.

Factors contributing to chronic ankle instability: a protocol for a systematic review of systematic reviews.

PubMed

Thompson, Cassandra; Schabrun, Siobhan; Romero, Rick; Bialocerkowski, Andrea; Marshall, Paul

2016-06-07

Ankle sprains are a significant clinical problem. Researchers have identified a multitude of factors contributing to the presence of recurrent ankle sprains including deficits in balance, postural control, kinematics, muscle activity, strength, range of motion, ligament laxity and bone/joint characteristics. Unfortunately, the literature examining the presence of these factors in chronic ankle instability (CAI) is conflicting. As a result, researchers have attempted to integrate this evidence using systematic reviews to reach conclusions; however, readers are now faced with an increasing number of systematic review findings that are also conflicting. The overall aim of this review is to critically appraise the methodological quality of previous systematic reviews and pool this evidence to identify contributing factors to CAI. A systematic review will be conducted on systematic reviews that investigate the presence of various deficits identified in CAI. Databases will be searched using pre-determined search terms. Reviews will then be assessed for inclusion based on the set eligibility criteria. Two independent reviewers will assess the articles for inclusion before evaluating the methodological quality and presence of bias of the included studies; any disagreements will be resolved by discussion between reviewers to reach consensus or by a third reviewer. Data concerning the specific research question, search strategy, inclusion/exclusion criteria, population, method and outcomes will be extracted. Findings will be analysed with respect to the methodological quality of the included reviews. It is expected that this review will clarify the cause of contradicting findings in the literature and facilitate future research directions. PROSPERO CRD42016032592 .

Methodological quality evaluation of systematic reviews or meta-analyses on ERCC1 in non-small cell lung cancer: a systematic review.

PubMed

Tao, Huan; Zhang, Yueyuan; Li, Qian; Chen, Jin

2017-11-01

To assess the methodological quality of systematic reviews (SRs) or meta-analysis concerning the predictive value of ERCC1 in platinum chemotherapy of non-small cell lung cancer. We searched the PubMed, EMbase, Cochrane library, international prospective register of systematic reviews, Chinese BioMedical Literature Database, China National Knowledge Infrastructure, Wan Fang and VIP database for SRs or meta-analysis. The methodological quality of included literatures was evaluated by risk of bias in systematic review (ROBIS) scale. Nineteen eligible SRs/meta-analysis were included. The most frequently searched databases were EMbase (74%), PubMed, Medline and CNKI. Fifteen SRs did additional retrieval manually, but none of them retrieved the registration platform. 47% described the two-reviewers model in the screening for eligible original articles, and seven SRs described the two reviewers to extract data. In methodological quality assessment, inter-rater reliability Kappa was 0.87 between two reviewers. Research question were well related to all SRs in phase 1 and the eligibility criteria was suitable for each SR, and rated as 'low' risk bias. But the 'high' risk bias existed in all the SRs regarding methods used to identify and/or select studies, and data collection and study appraisal. More than two-third of SRs or meta-analysis were finished with high risk of bias in the synthesis, findings and the final phase. The study demonstrated poor methodological quality of SRs/meta-analysis assessing the predictive value of ERCC1 in chemotherapy among the NSCLC patients, especially the high performance bias. Registration or publishing the protocol is recommended in future research.

Screening for oropharyngeal dysphagia in older adults: A systematic review of self-reported questionnaires.

PubMed

Magalhães Junior, Hipólito V; Pernambuco, Leandro de Araújo; Lima, Kenio C; Ferreira, Maria Angela F

2018-04-03

Oropharyngeal dysphagia is a swallowing disorder with signs and symptoms which may be present in older adults, but they are rarely noticed as a health concern by older people. The earliest possible identification of this clinical condition is needed by self-reported population-based screening questionnaire, which are valid and reliable for preventing risks to nutritional status, increased morbidity and mortality. The aim of this systematic review was to identify self-reported screening questionnaires for oropharyngeal dysphagia in older adults to evaluate their methodological quality for population-based studies. An extensive search of electronic databases (PubMed (MEDLINE), Ovid MEDLINE(R), Scopus, Cochrane Library, CINAHL, Web of Science (WOS), PsycINFO (APA), Lilacs and Scielo) was conducted in the period from April to May 2017 using previously established search strategies by the two evaluators. The methodological quality and the psychometric properties of the included studies were evaluated by the COSMIN (Consensus based Standards for the selection of health Measurement Instruments) checklist and the quality criteria of Terwee and colleagues, respectively. The analysed information was extracted from three articles which had conducted studies on the prevalence of oropharyngeal dysphagia by self-reported screening questionnaires, showing poor methodological quality and flaws in the methodological description to demonstrate its psychometric properties. This study did not find any self-reported screening questionnaires for oropharyngeal dysphagia with suitable methodological quality and appropriate evidence in its psychometric properties for elders. Therefore, the self-reported questionnaires within the diagnostic proposal require greater details in its process for obtaining valid and reliable evidence. © 2018 John Wiley & Sons A/S and The Gerodontology Association. Published by John Wiley & Sons Ltd.

Anti-tobacco mass media and socially disadvantaged groups: a systematic and methodological review.

PubMed

Guillaumier, Ashleigh; Bonevski, Billie; Paul, Chris

2012-07-01

Only a limited amount of research has been conducted to explore whether there are socioeconomic status differences in responses to mass media. However, the methodological quality of this evidence has not been assessed, limiting confidence in conclusions that can be drawn regarding study outcomes. A systematic review of the effectiveness of anti-tobacco mass media campaigns with socially disadvantaged groups was conducted, and the methodological quality of included studies was assessed. Medline, The Cochrane Library, PsycInfo, Embase and Web of Science were searched using MeSH and keywords for quantitative studies conducted in Western countries prior to March 2012. A methodological quality assessment and narrative analysis of included studies was undertaken. Seventeen relevant studies (reported in 18 papers) were identified; however, weak study designs and selection bias were common characteristics, limiting strong conclusions about effectiveness. Using predominantly non-cessation related outcome measures reviewed papers indicated mixed results for mass media tobacco control campaign effectiveness among various social groups. Most studies assessed mass media impact on low socioeconomic status groups rather than highly socially disadvantaged groups. Methodological rigour of evaluations in this field must be improved to aid understanding regarding the effectiveness of mass media campaigns in driving cessation among disadvantaged groups. The results of this review indicate a gap in methodologically rigorous research into the effectiveness of mass media campaigns among socially disadvantaged groups, particularly the highly disadvantaged. © 2012 Australasian Professional Society on Alcohol and other Drugs.

The economic burden of patient safety targets in acute care: a systematic review

PubMed Central

Mittmann, Nicole; Koo, Marika; Daneman, Nick; McDonald, Andrew; Baker, Michael; Matlow, Anne; Krahn, Murray; Shojania, Kaveh G; Etchells, Edward

2012-01-01

Background Our objective was to determine the quality of literature in costing of the economic burden of patient safety. Methods We selected 15 types of patient safety targets for our systematic review. We searched the literature published between 2000 and 2010 using the following terms: “costs and cost analysis,” “cost-effectiveness,” “cost,” and “financial management, hospital.” We appraised the methodologic quality of potentially relevant studies using standard economic methods. We recorded results in the original currency, adjusted for inflation, and then converted to 2010 US dollars for comparative purposes (2010 US$1.00 = 2010 €0.76). The quality of each costing study per patient safety target was also evaluated. Results We screened 1948 abstracts, and identified 158 potentially eligible studies, of which only 61 (39%) reported any costing methodology. In these 61 studies, we found wide estimates of the attributable costs of patient safety events ranging from $2830 to $10,074. In general hospital populations, the cost per case of hospital-acquired infection ranged from $2132 to $15,018. Nosocomial bloodstream infection was associated with costs ranging from $2604 to $22,414. Conclusion There are wide variations in the estimates of economic burden due to differences in study methods and methodologic quality. Greater attention to methodologic standards for economic evaluations in patient safety is needed. PMID:23097615

Association of journal quality indicators with methodological quality of clinical research articles.

PubMed

Lee, Kirby P; Schotland, Marieka; Bacchetti, Peter; Bero, Lisa A

2002-06-05

The ability to identify scientific journals that publish high-quality research would help clinicians, scientists, and health-policy analysts to select the most up-to-date medical literature to review. To assess whether journal characteristics of (1) peer-review status, (2) citation rate, (3) impact factor, (4) circulation, (5) manuscript acceptance rate, (6) MEDLINE indexing, and (7) Brandon/Hill Library List indexing are predictors of methodological quality of research articles, we conducted a cross-sectional study of 243 original research articles involving human subjects published in general internal medical journals. The mean (SD) quality score of the 243 articles was 1.37 (0.22). All journals reported a peer-review process and were indexed on MEDLINE. In models that controlled for article type (randomized controlled trial [RCT] or non-RCT), journal citation rate was the most statistically significant predictor (0.051 increase per doubling; 95% confidence interval [CI], 0.037-0.065; P<.001). In separate analyses by article type, acceptance rate was the strongest predictor for RCT quality (-0.113 per doubling; 95% CI, -0.148 to -0.078; P<.001), while journal citation rate was the most predictive factor for non-RCT quality (0.051 per doubling; 95% CI, 0.044-0.059; P<.001). High citation rates, impact factors, and circulation rates, and low manuscript acceptance rates and indexing on Brandon/Hill Library List appear to be predictive of higher methodological quality scores for journal articles.

Quality Assessment for Placement Centres: A Case Study of the University of Barcelona's Faculty of Education

ERIC Educational Resources Information Center

Freixa Niella, Montse; Vilà Baños, Ruth; Rubio Hurtado, M. José

2015-01-01

The aim of this research was to identify the factors that could be used for quality assessments of the placement centres used by the University of Barcelona's Faculty of Education. To achieve this, a multiple case study method (bachelor's degrees in Education, Social Education and Social Work) was used, which was based on a survey methodology. A…

Evidence mapping based on systematic reviews of therapeutic interventions for gastrointestinal stromal tumors (GIST).

PubMed

Ballesteros, Mónica; Montero, Nadia; López-Pousa, Antonio; Urrútia, Gerard; Solà, Ivan; Rada, Gabriel; Pardo-Hernandez, Hector; Bonfill, Xavier

2017-09-07

Gastrointestinal Stromal Tumours (GISTs) are the most common mesenchymal tumours. Currently, different pharmacological and surgical options are used to treat localised and metastatic GISTs, although this research field is broad and the body of evidence is scattered and expanding. Our objectives are to identify, describe and organise the current available evidence for GIST through an evidence mapping approach. We followed the methodology of Global Evidence Mapping (GEM). We searched Pubmed, EMBASE, The Cochrane Library and Epistemonikos in order to identify systematic reviews (SRs) with or without meta-analyses published between 1990 and March 2016. Two authors assessed eligibility and extracted data. Methodological quality of the included systematic reviews was assessed using AMSTAR. We organised the results according to identified PICO questions and presented the evidence map in tables and a bubble plot. A total of 17 SRs met eligibility criteria. These reviews included 66 individual studies, of which three quarters were either observational or uncontrolled clinical trials. Overall, the quality of the included SRs was moderate or high. In total, we extracted 14 PICO questions from them and the corresponding results mostly favoured the intervention arm. The most common type of study used to evaluate therapeutic interventions in GIST sarcomas has been non-experimental studies. However, the majority of the interventions are reported as beneficial or probably beneficial by the respective authors of SRs. The evidence mapping is a useful and reliable methodology to identify and present the existing evidence about therapeutic interventions.

Methodology for vocational psychodiagnostics of senior schoolchildren using information technologies

NASA Astrophysics Data System (ADS)

Bogdanovskaya, I. M.; Kosheleva, A. N.; Kiselev, P. B.; Davydova, Yu. A.

2017-01-01

The article identifies the role and main problems of vocational psychodiagnostics in modern socio-cultural conditions. It analyzes the potentials of information technologies in vocational psychodiagnostics of senior schoolchildren. The article describes the theoretical and methodological grounds, content and diagnostic potentials of the computerized method in vocational psychodiagnostics. The computerized method includes three blocks of sub-tests to identify intellectual potential, personal qualities, professional interests and values, career orientations, as well as subtests to analyze the specific life experience of senior schoolchildren. The results of diagnostics allow developing an integrated psychodiagnostic conclusion with recommendations. The article contains options of software architecture for the given method.

The use of grounded theory in studies of nurses and midwives' coping processes: a systematic literature search.

PubMed

Cheer, Karen; MacLaren, David; Tsey, Komla

2015-01-01

Researchers are increasingly using grounded theory methodologies to study the professional experience of nurses and midwives. To review common grounded theory characteristics and research design quality as described in grounded theory studies of coping strategies used by nurses and midwives. A systematic database search for 2005-2015 identified and assessed grounded theory characteristics from 16 studies. Study quality was assessed using a modified Critical Appraisal Skills Programme tool. Grounded theory was considered a methodology or a set of methods, able to be used within different nursing and midwifery contexts. Specific research requirements determined the common grounded theory characteristics used in different studies. Most researchers did not clarify their epistemological and theoretical perspectives. To improve research design and trustworthiness of grounded theory studies in nursing and midwifery, researchers need to state their theoretical stance and clearly articulate their use of grounded theory methodology and characteristics in research reporting.

Wearable sensor use for assessing standing balance and walking stability in people with Parkinson's disease: a systematic review.

PubMed

Hubble, Ryan P; Naughton, Geraldine A; Silburn, Peter A; Cole, Michael H

2015-01-01

Postural instability and gait disability threaten the independence and well-being of people with Parkinson's disease and increase the risk of falls and fall-related injuries. Prospective research has shown that commonly-used clinical assessments of balance and walking lack the sensitivity to accurately and consistently identify those people with Parkinson's disease who are at a higher risk of falling. Wearable sensors provide a portable and affordable alternative for researchers and clinicians who are seeking to objectively assess movements and falls risk in the clinical setting. However, no consensus currently exists on the optimal placements for sensors and the best outcome measures to use for assessing standing balance and walking stability in Parkinson's disease patients. Hence, this systematic review aimed to examine the available literature to establish the best sensor types, locations and outcomes to assess standing balance and walking stability in this population. Papers listed in three electronic databases were searched by title and abstract to identify articles measuring standing balance or walking stability with any kind of wearable sensor among adults diagnosed with PD. To be eligible for inclusion, papers were required to be full-text articles published in English between January 1994 and December 2014 that assessed measures of standing balance or walking stability with wearable sensors in people with PD. Articles were excluded if they; i) did not use any form of wearable sensor to measure variables associated with standing balance or walking stability; ii) did not include a control group or control condition; iii) were an abstract and/or included in the proceedings of a conference; or iv) were a review article or case study. The targeted search of the three electronic databases identified 340 articles that were potentially eligible for inclusion, but following title, abstract and full-text review only 26 articles were deemed to meet the inclusion criteria. Included articles were assessed for methodological quality and relevant data from the papers were extracted and synthesized. Quality assessment of these included articles indicated that 31% were of low methodological quality, while 58% were of moderate methodological quality and 11% were of high methodological quality. All studies adopted a cross-sectional design and used a variety of sensor types and outcome measures to assess standing balance or walking stability in people with Parkinson's disease. Despite the typically low to moderate methodological quality, 81% of the studies reported differences in sensor-based measures of standing balance or walking stability between different groups of Parkinson's disease patients and/or healthy controls. These data support the use of wearable sensors for detecting differences in standing balance and walking stability between people with PD and controls. Further high-quality research is needed to better understand the utility of wearable sensors for the early identification of Parkinson's disease symptoms and for assessing falls risk in this population. CRD42014010838.

Wearable Sensor Use for Assessing Standing Balance and Walking Stability in People with Parkinson’s Disease: A Systematic Review

PubMed Central

Hubble, Ryan P.; Naughton, Geraldine A.; Silburn, Peter A.; Cole, Michael H.

2015-01-01

Background Postural instability and gait disability threaten the independence and well-being of people with Parkinson’s disease and increase the risk of falls and fall-related injuries. Prospective research has shown that commonly-used clinical assessments of balance and walking lack the sensitivity to accurately and consistently identify those people with Parkinson’s disease who are at a higher risk of falling. Wearable sensors provide a portable and affordable alternative for researchers and clinicians who are seeking to objectively assess movements and falls risk in the clinical setting. However, no consensus currently exists on the optimal placements for sensors and the best outcome measures to use for assessing standing balance and walking stability in Parkinson’s disease patients. Hence, this systematic review aimed to examine the available literature to establish the best sensor types, locations and outcomes to assess standing balance and walking stability in this population. Methods Papers listed in three electronic databases were searched by title and abstract to identify articles measuring standing balance or walking stability with any kind of wearable sensor among adults diagnosed with PD. To be eligible for inclusion, papers were required to be full-text articles published in English between January 1994 and December 2014 that assessed measures of standing balance or walking stability with wearable sensors in people with PD. Articles were excluded if they; i) did not use any form of wearable sensor to measure variables associated with standing balance or walking stability; ii) did not include a control group or control condition; iii) were an abstract and/or included in the proceedings of a conference; or iv) were a review article or case study. The targeted search of the three electronic databases identified 340 articles that were potentially eligible for inclusion, but following title, abstract and full-text review only 26 articles were deemed to meet the inclusion criteria. Included articles were assessed for methodological quality and relevant data from the papers were extracted and synthesized. Results Quality assessment of these included articles indicated that 31% were of low methodological quality, while 58% were of moderate methodological quality and 11% were of high methodological quality. All studies adopted a cross-sectional design and used a variety of sensor types and outcome measures to assess standing balance or walking stability in people with Parkinson’s disease. Despite the typically low to moderate methodological quality, 81% of the studies reported differences in sensor-based measures of standing balance or walking stability between different groups of Parkinson’s disease patients and/or healthy controls. Conclusion These data support the use of wearable sensors for detecting differences in standing balance and walking stability between people with PD and controls. Further high-quality research is needed to better understand the utility of wearable sensors for the early identification of Parkinson’s disease symptoms and for assessing falls risk in this population. PROSPERO Registration CRD42014010838 PMID:25894561

Using lean methodology to improve productivity in a hospital oncology pharmacy.

PubMed

Sullivan, Peter; Soefje, Scott; Reinhart, David; McGeary, Catherine; Cabie, Eric D

2014-09-01

Quality improvements achieved by a hospital pharmacy through the use of lean methodology to guide i.v. compounding workflow changes are described. The outpatient oncology pharmacy of Yale-New Haven Hospital conducted a quality-improvement initiative to identify and implement workflow changes to support a major expansion of chemotherapy services. Applying concepts of lean methodology (i.e., elimination of non-value-added steps and waste in the production process), the pharmacy team performed a failure mode and effects analysis, workflow mapping, and impact analysis; staff pharmacists and pharmacy technicians identified 38 opportunities to decrease waste and increase efficiency. Three workflow processes (order verification, compounding, and delivery) accounted for 24 of 38 recommendations and were targeted for lean process improvements. The workflow was decreased to 14 steps, eliminating 6 non-value-added steps, and pharmacy staff resources and schedules were realigned with the streamlined workflow. The time required for pharmacist verification of patient-specific oncology orders was decreased by 33%; the time required for product verification was decreased by 52%. The average medication delivery time was decreased by 47%. The results of baseline and postimplementation time trials indicated a decrease in overall turnaround time to about 70 minutes, compared with a baseline time of about 90 minutes. The use of lean methodology to identify non-value-added steps in oncology order processing and the implementation of staff-recommended workflow changes resulted in an overall reduction in the turnaround time per dose. Copyright © 2014 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

The methodological quality of diagnostic test accuracy studies for musculoskeletal conditions can be improved.

PubMed

Henschke, Nicholas; Keuerleber, Julia; Ferreira, Manuela; Maher, Christopher G; Verhagen, Arianne P

2014-04-01

To provide an overview of reporting and methodological quality in diagnostic test accuracy (DTA) studies in the musculoskeletal field and evaluate the use of the QUality Assessment of Diagnostic Accuracy Studies (QUADAS) checklist. A literature review identified all systematic reviews that evaluated the accuracy of clinical tests to diagnose musculoskeletal conditions and used the QUADAS checklist. Two authors screened all identified reviews and extracted data on the target condition, index tests, reference standard, included studies, and QUADAS items. A descriptive analysis of the QUADAS checklist was performed, along with Rasch analysis to examine the construct validity and internal reliability. A total of 19 systematic reviews were included, which provided data on individual items of the QUADAS checklist for 392 DTA studies. In the musculoskeletal field, uninterpretable or intermediate test results are commonly not reported, with 175 (45%) studies scoring "no" to this item. The proportion of studies fulfilling certain items varied from 22% (item 11) to 91% (item 3). The interrater reliability of the QUADAS checklist was good and Rasch analysis showed excellent construct validity and internal consistency. This overview identified areas where the reporting and performance of diagnostic studies within the musculoskeletal field can be improved. Copyright © 2014 Elsevier Inc. All rights reserved.

Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review.

PubMed

Rubin, Katrine Hass; Friis-Holmberg, Teresa; Hermann, Anne Pernille; Abrahamsen, Bo; Brixen, Kim

2013-08-01

A huge number of risk assessment tools have been developed. Far from all have been validated in external studies, more of them have absence of methodological and transparent evidence, and few are integrated in national guidelines. Therefore, we performed a systematic review to provide an overview of existing valid and reliable risk assessment tools for prediction of osteoporotic fractures. Additionally, we aimed to determine if the performance of each tool was sufficient for practical use, and last, to examine whether the complexity of the tools influenced their discriminative power. We searched PubMed, Embase, and Cochrane databases for papers and evaluated these with respect to methodological quality using the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS) checklist. A total of 48 tools were identified; 20 had been externally validated, however, only six tools had been tested more than once in a population-based setting with acceptable methodological quality. None of the tools performed consistently better than the others and simple tools (i.e., the Osteoporosis Self-assessment Tool [OST], Osteoporosis Risk Assessment Instrument [ORAI], and Garvan Fracture Risk Calculator [Garvan]) often did as well or better than more complex tools (i.e., Simple Calculated Risk Estimation Score [SCORE], WHO Fracture Risk Assessment Tool [FRAX], and Qfracture). No studies determined the effectiveness of tools in selecting patients for therapy and thus improving fracture outcomes. High-quality studies in randomized design with population-based cohorts with different case mixes are needed. Copyright © 2013 American Society for Bone and Mineral Research.

Critical Appraisal of International Clinical Practice Guidelines in Kidney Transplantation Using the Appraisal of Guidelines for Research and Education (AGREE) II Tool: A Systematic Review.

PubMed

OʼDonoghue, Katriona Jane Marie; Reed, Rhiannon D; Knight, Simon R; O'Callaghan, John M; Ayaz-Shah, Anam A; Hassan, Sevda; Weissenbacher, Annemarie; Morris, Peter J; Pengel, Liset H M

2018-05-22

Whilst Clinical Practice Guidelines (CPGs) are used for the development of local protocols in kidney transplantation (Ktx), the quality of their methodology is variable. This systematic review aimed to critically appraise international CPGs in all aspects of Ktx using the Appraisal of Guidelines for Research and Evaluation (AGREE) II tool. CPGs in Ktx and donation published between 2010 and 2017 were identified from MEDLINE, Embase, National Guideline Clearinghouse, NHS and NICE Evidence Searches, and the websites of transplant societies. Using AGREE II, 3 appraisers assessed the quality of CPGs. Interrater reliability was measured using the intraclass correlation coefficient (ICC). Searches identified 3,168 records and 115 CPGs were included. The highest scoring AGREE II domain was 'Scope and Purpose' (80%; Range 30-100%), followed by 'Clarity of Presentation' (77%; Range 43-98%), 'Editorial independence' (52%; Range 0-94%), 'Rigour of Development' (47%; Range 6-97%) and 'Stakeholder Involvement' (41%; Range 11-85%). The poorest scoring domain was 'Applicability' (31%; Range 3-74%). Most CPGs were recommended for future use either with (63%) or without modifications (18%). A small number were not recommended for future use (14%) or reviewers did not agree on recommending the CPG (5%). The overall mean CPG quality score was 4 out of 7 (Range 2-7). The mean ICC of 0.74 indicated substantial agreement between reviewers. The quality of international CPGs in Ktx was variable, and most CPGs lacked key aspects of methodological robustness and transparency. Improvements in methodology, patient involvement and strategies for implementation are required.

Quality assurance and quality control in mammography: a review of available guidance worldwide.

PubMed

Reis, Cláudia; Pascoal, Ana; Sakellaris, Taxiarchis; Koutalonis, Manthos

2013-10-01

Review available guidance for quality assurance (QA) in mammography and discuss its contribution to harmonise practices worldwide. Literature search was performed on different sources to identify guidance documents for QA in mammography available worldwide in international bodies, healthcare providers, professional/scientific associations. The guidance documents identified were reviewed and a selection was compared for type of guidance (clinical/technical), technology and proposed QA methodologies focusing on dose and image quality (IQ) performance assessment. Fourteen protocols (targeted at conventional and digital mammography) were reviewed. All included recommendations for testing acquisition, processing and display systems associated with mammographic equipment. All guidance reviewed highlighted the importance of dose assessment and testing the Automatic Exposure Control (AEC) system. Recommended tests for assessment of IQ showed variations in the proposed methodologies. Recommended testing focused on assessment of low-contrast detection, spatial resolution and noise. QC of image display is recommended following the American Association of Physicists in Medicine guidelines. The existing QA guidance for mammography is derived from key documents (American College of Radiology and European Union guidelines) and proposes similar tests despite the variations in detail and methodologies. Studies reported on QA data should provide detail on experimental technique to allow robust data comparison. Countries aiming to implement a mammography/QA program may select/prioritise the tests depending on available technology and resources. •An effective QA program should be practical to implement in a clinical setting. •QA should address the various stages of the imaging chain: acquisition, processing and display. •AEC system QC testing is simple to implement and provides information on equipment performance.

Systematic review on measurement properties of questionnaires assessing the neighbourhood environment in the context of youth physical activity behaviour

PubMed Central

2013-01-01

Background High-quality measurement instruments for assessing the neighbourhood environment are a prerequisite for identifying associations between the neighbourhood environment and a person’s physical activity. The aim of this systematic review was to identify reliable and valid questionnaires assessing neighbourhood environmental attributes in the context of physical activity behaviours in children and adolescents. In addition, current gaps and best practice models in instrumentation and their evaluation are discussed. Methods We conducted a systematic literature search using six databases (Web of Science, Medline, TRID, SportDISCUS, PsycARTICLES and PsycINFO). Two independent reviewers screened the identified English-language peer-reviewed journal articles. Only studies examining the measurement properties of self- or proxy-report questionnaires on any aspects of the neighbourhood environment in children and adolescents aged 3 to 18 years were included. The methodological quality of the included studies was assessed using the COSMIN checklists. Results We identified 13 questionnaires on attributes of the neighbourhood environment. Most of these studies were conducted in the United States (n = 7). Eight studies evaluated self-report measures, two studies evaluated parent-report measures and three studies included both administration types. While eight studies had poor methodological quality, we identified three questionnaires with substantial test-retest reliability and two questionnaires with acceptable convergent validity based on sufficient evidential basis. Conclusions Based on the results of this review, we recommend that cross-culturally adapted questionnaires should be used and that existing questionnaires should be evaluated especially in diverse samples and in countries other than the United States. Further, high-quality studies on measurement properties should be promoted and measurement models (formative vs. reflexive) should be specified to ensure that appropriate methods for psychometric testing are applied in future studies. PMID:23663328

Systematic review on measurement properties of questionnaires assessing the neighbourhood environment in the context of youth physical activity behaviour.

PubMed

Reimers, Anne K; Mess, Filip; Bucksch, Jens; Jekauc, Darko; Woll, Alexander

2013-05-11

High-quality measurement instruments for assessing the neighbourhood environment are a prerequisite for identifying associations between the neighbourhood environment and a person's physical activity. The aim of this systematic review was to identify reliable and valid questionnaires assessing neighbourhood environmental attributes in the context of physical activity behaviours in children and adolescents. In addition, current gaps and best practice models in instrumentation and their evaluation are discussed. We conducted a systematic literature search using six databases (Web of Science, Medline, TRID, SportDISCUS, PsycARTICLES and PsycINFO). Two independent reviewers screened the identified English-language peer-reviewed journal articles. Only studies examining the measurement properties of self- or proxy-report questionnaires on any aspects of the neighbourhood environment in children and adolescents aged 3 to 18 years were included. The methodological quality of the included studies was assessed using the COSMIN checklists. We identified 13 questionnaires on attributes of the neighbourhood environment. Most of these studies were conducted in the United States (n = 7). Eight studies evaluated self-report measures, two studies evaluated parent-report measures and three studies included both administration types. While eight studies had poor methodological quality, we identified three questionnaires with substantial test-retest reliability and two questionnaires with acceptable convergent validity based on sufficient evidential basis. Based on the results of this review, we recommend that cross-culturally adapted questionnaires should be used and that existing questionnaires should be evaluated especially in diverse samples and in countries other than the United States. Further, high-quality studies on measurement properties should be promoted and measurement models (formative vs. reflexive) should be specified to ensure that appropriate methods for psychometric testing are applied in future studies.

Methodological and Reporting Quality of Systematic Reviews and Meta-analyses in Endodontics.

PubMed

Nagendrababu, Venkateshbabu; Pulikkotil, Shaju Jacob; Sultan, Omer Sheriff; Jayaraman, Jayakumar; Peters, Ove A

2018-06-01

The aim of this systematic review (SR) was to evaluate the quality of SRs and meta-analyses (MAs) in endodontics. A comprehensive literature search was conducted to identify relevant articles in the electronic databases from January 2000 to June 2017. Two reviewers independently assessed the articles for eligibility and data extraction. SRs and MAs on interventional studies with a minimum of 2 therapeutic strategies in endodontics were included in this SR. Methodologic and reporting quality were assessed using A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA), respectively. The interobserver reliability was calculated using the Cohen kappa statistic. Statistical analysis with the level of significance at P < .05 was performed using Kruskal-Wallis tests and simple linear regression analysis. A total of 30 articles were selected for the current SR. Using AMSTAR, the item related to the scientific quality of studies used in conclusion was adhered by less than 40% of studies. Using PRISMA, 3 items were reported by less than 40% of studies, which were on objectives, protocol registration, and funding. No association was evident comparing the number of authors and country with quality. Statistical significance was observed when quality was compared among journals, with studies published as Cochrane reviews superior to those published in other journals. AMSTAR and PRISMA scores were significantly related. SRs in endodontics showed variability in both methodologic and reporting quality. Copyright © 2018 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Longitudinal analysis of reporting and quality of systematic reviews in high-impact surgical journals.

PubMed

Chapman, S J; Drake, T M; Bolton, W S; Barnard, J; Bhangu, A

2017-02-01

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement aims to optimize the reporting of systematic reviews. The performance of the PRISMA Statement in improving the reporting and quality of surgical systematic reviews remains unclear. Systematic reviews published in five high-impact surgical journals between 2007 and 2015 were identified from online archives. Manuscripts blinded to journal, publication year and authorship were assessed according to 27 reporting criteria described by the PRISMA Statement and scored using a validated quality appraisal tool (AMSTAR, Assessing the Methodological Quality of Systematic Reviews). Comparisons were made between studies published before (2007-2009) and after (2011-2015) its introduction. The relationship between reporting and study quality was measured using Spearman's rank test. Of 281 eligible manuscripts, 80 were published before the PRISMA Statement and 201 afterwards. Most manuscripts (208) included a meta-analysis, with the remainder comprising a systematic review only. There was no meaningful change in median compliance with the PRISMA Statement (19 (i.q.r. 16-21) of 27 items before versus 19 (17-22) of 27 after introduction of PRISMA) despite achieving statistical significance (P = 0·042). Better reporting compliance was associated with higher methodological quality (r s  = 0·70, P < 0·001). The PRISMA Statement has had minimal impact on the reporting of surgical systematic reviews. Better compliance was associated with higher-quality methodology. © 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.

Systematic Review and Quality Appraisal of Economic Evaluation Publications in Dentistry.

PubMed

Tonmukayakul, U; Calache, H; Clark, R; Wasiak, J; Faggion, C M

2015-10-01

Economic evaluation (EE) studies have been undertaken in dentistry since the late 20th century because economic data provide additional information to policy makers to develop guidelines and set future direction for oral health services. The objectives of this study were to assess the methodological quality of EEs in oral health. Electronic searching of Ovid MEDLINE, the Cochrane Library, and the NHS Economic Evaluation Database from 1975 to 2013 were undertaken to identify publications that include costs and outcomes in dentistry. Relevant reference lists were also searched for additional studies. Studies were retrieved and reviewed independently for inclusion by 3 authors. Furthermore, to appraise the EE methods, 1 author applied the Drummond 10-item (13-criteria) checklist tool to each study. Of the 114 publications identified, 79 studies were considered full EE and 35 partial. Twenty-eight studies (30%) were published between the years 2011 and 2013. Sixty-four (53%) studies focused on dental caries prevention or treatment. Median appraisal scores calculated for full and partial EE studies were 11 and 9 out of 13, respectively. Quality assessment scores showed that the quality of partial EE studies published after 2000 significantly improved (P = 0.02) compared to those published before 2000. Significant quality improvement was not found in full EE studies. Common methodological limitations were identified: absence of sensitivity analysis, discounting, and insufficient information on how costs and outcomes were measured and valued. EE studies in dentistry increased over the last 40 y in both quantity and quality, but a number of publications failed to satisfy some components of standard EE research methods, such as sensitivity analysis and discounting. © International & American Associations for Dental Research 2015.

Rating the methodological quality of single-subject designs and n-of-1 trials: introducing the Single-Case Experimental Design (SCED) Scale.

PubMed

Tate, Robyn L; McDonald, Skye; Perdices, Michael; Togher, Leanne; Schultz, Regina; Savage, Sharon

2008-08-01

Rating scales that assess methodological quality of clinical trials provide a means to critically appraise the literature. Scales are currently available to rate randomised and non-randomised controlled trials, but there are none that assess single-subject designs. The Single-Case Experimental Design (SCED) Scale was developed for this purpose and evaluated for reliability. Six clinical researchers who were trained and experienced in rating methodological quality of clinical trials developed the scale and participated in reliability studies. The SCED Scale is an 11-item rating scale for single-subject designs, of which 10 items are used to assess methodological quality and use of statistical analysis. The scale was developed and refined over a 3-year period. Content validity was addressed by identifying items to reduce the main sources of bias in single-case methodology as stipulated by authorities in the field, which were empirically tested against 85 published reports. Inter-rater reliability was assessed using a random sample of 20/312 single-subject reports archived in the Psychological Database of Brain Impairment Treatment Efficacy (PsycBITE). Inter-rater reliability for the total score was excellent, both for individual raters (overall ICC = 0.84; 95% confidence interval 0.73-0.92) and for consensus ratings between pairs of raters (overall ICC = 0.88; 95% confidence interval 0.78-0.95). Item reliability was fair to excellent for consensus ratings between pairs of raters (range k = 0.48 to 1.00). The results were replicated with two independent novice raters who were trained in the use of the scale (ICC = 0.88, 95% confidence interval 0.73-0.95). The SCED Scale thus provides a brief and valid evaluation of methodological quality of single-subject designs, with the total score demonstrating excellent inter-rater reliability using both individual and consensus ratings. Items from the scale can also be used as a checklist in the design, reporting and critical appraisal of single-subject designs, thereby assisting to improve standards of single-case methodology.

Quality of life among adult patients with neurofibromatosis 1, neurofibromatosis 2 and schwannomatosis: a systematic review of the literature.

PubMed

Vranceanu, Ana-Maria; Merker, Vanessa L; Park, Elyse; Plotkin, Scott R

2013-09-01

The aim of this study was to review the literature on quality of life among adult patients with neurofibromatosis 1, neurofibromatosis 2 and schwannomatosis, and to identify the specific aspects of quality of life that were studied and reported in this population. We also set out to report predictors of quality of life. Published research reports were included if they described quality of life in this population and met methodological quality according to a list of predefined criteria. Eight studies (7 in NF1, 1 in NF2, 0 in schwannomatosis), conducted between 2001 and 2013, met inclusion criteria. The methodological quality of the eight studies was mostly high according to ratings by predefined criteria. Most studies reported that patients with NF experience decreased quality of life when compared to the general population. Visibility and disease severity were strong predictors of skin-specific quality of life in NF1 patients. However, the majority of findings regarding predictors of quality of life were weak or inconclusive. Given the decreased quality of life in NF patients, it is important to examine more comprehensively the psychosocial factors in this population, especially in patients with NF2 and schwannomatosis. Mind body interventions that address these domains may provide comprehensive and efficacious long term treatment.

Efficacy and safety of Suanzaoren decoction for primary insomnia: a systematic review of randomized controlled trials

PubMed Central

2013-01-01

Background Insomnia is a widespread human health problem, but there currently are the limitations of conventional therapies available. Suanzaoren decoction (SZRD) is a well known classic Chinese herbal prescription for insomnia and has been treating people’s insomnia for more than thousand years. The objective of this study was to evaluate the efficacy and safety of SZRD for insomnia. Methods A systematic literature search was performed for 6 databases up to July of 2012 to identify randomized control trials (RCTs) involving SZRD for insomniac patients. The methodological quality of RCTs was assessed independently using the Cochrane Handbook for Systematic Reviews of Interventions. Results Twelve RCTs with total of 1376 adult participants were identified. The methodological quality of all included trials are no more than 3/8 score. Majority of the RCTs concluded that SZRD was more significantly effective than benzodiazepines for treating insomnia. Despite these positive outcomes, there were many methodological shortcomings in the studies reviewed, including insufficient information about randomization generation and absence of allocation concealment, lack of blinding and no placebo control, absence of intention-to-treat analysis and lack of follow-ups, selective publishing and reporting, and small number of sample sizes. A number of clinical heterogeneity such as diagnosis, intervention, control, and outcome measures were also reviewed. Only 3 trials reported adverse events, whereas the other 9 trials did not provide the safety information. Conclusions Despite the apparent reported positive findings, there is insufficient evidence to support efficacy of SZRD for insomnia due to the poor methodological quality and the small number of trials of the included studies. SZRD seems generally safe, but is insufficient evidence to make conclusions on the safety because fewer studies reported the adverse events. Further large sample-size and well-designed RCTs are needed. PMID:23336848

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

Prevalence of self-medication in the adult population of Brazil: a systematic review

PubMed Central

Domingues, Paulo Henrique Faria; Galvão, Taís Freire; de Andrade, Keitty Regina Cordeiro; de Sá, Pedro Terra Teles; Silva, Marcus Tolentino; Pereira, Mauricio Gomes

2015-01-01

OBJECTIVE To evaluate the prevalence of self-medication in Brazil’s adult population. METHODS Systematic review of cross-sectional population-based studies. The following databases were used: Medline, Embase, Scopus, ISI, CINAHL, Cochrane Library, CRD, Lilacs, SciELO, the Banco de teses brasileiras (Brazilian theses database) (Capes) and files from the Portal Domínio Público (Brazilian Public Domain). In addition, the reference lists from relevant studies were examined to identify potentially eligible articles. There were no applied restrictions in terms of the publication date, language or publication status. Data related to publication, population, methods and prevalence of self-medication were extracted by three independent researchers. Methodological quality was assessed following eight criteria related to sampling, measurement and presentation of results. The prevalences were measured from participants who used at least one medication during the recall period of the studies. RESULTS The literature screening identified 2,778 records, from which 12 were included for analysis. Most studies were conducted in the Southeastern region of Brazil, after 2000 and with a 15-day recall period. Only five studies achieved high methodological quality, of which one study had a 7-day recall period, in which the prevalence of self-medication was 22.9% (95%CI 14.6;33.9). The prevalence of self-medication in three studies of high methodological quality with a 15-day recall period was 35.0% (95%CI 29.0;40.0, I2 = 83.9%) in the adult Brazilian population. CONCLUSIONS Despite differences in the methodologies of the included studies, the results of this systematic review indicate that a significant proportion of the adult Brazilian population self-medicates. It is suggested that future research projects that assess self-medication in Brazil standardize their methods. PMID:26083944

A systematic review of the association between radiographic and clinical osteoarthritis of hip and knee.

PubMed

Kinds, M B; Welsing, P M J; Vignon, E P; Bijlsma, J W J; Viergever, M A; Marijnissen, A C A; Lafeber, F P J G

2011-07-01

There is ongoing debate on whether an association between radiographic and clinical osteoarthritis (OA) exists. We hypothesized that the inconsistency in the detection of an association might be caused by different definitions of OA, by different radiographic protocols, and by scoring methods for radiographic damage and symptoms. The goal of this study was to evaluate which methodological criteria are important to detect an association between radiographic and clinical OA of hip and knee. A literature search was performed with the keywords 'OA', 'hip', 'knee', 'radiographic', and 'clinical' and results were screened for relevant studies. Quality criteria for study characteristics and methodology were developed. Studies were classified according to these criteria and the presence of an association between radiographic and clinical OA was scored. The importance of methodological quality and patient characteristics on the presence of an association was evaluated. The literature search resulted in 39 studies describing an association between radiographic and clinical OA. The frequency of an association between radiographic and clinical OA outcome measures diminished when less quality criteria were fulfilled. Specifically the criterion for standardized outcome measures appeared important in the detection of an association. The association was not influenced by patient characteristics. Only four studies were identified that fulfilled all quality criteria and in these studies an association was found for the knee joint and an inconsistent association was found for the hip joint. Methodological quality criteria are of importance to reveal an association between radiographic and clinical OA. Copyright © 2011 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Observations concerning Research Literature on Neuro-Linguistic Programming.

ERIC Educational Resources Information Center

Einspruch, Eric L.; Forman, Bruce D.

1985-01-01

Identifies six categories of design and methodological errors contained in the 39 empirical studies of neurolinguistic programming (NLP) documented through April 1984. Representative reports reflecting each category are discussed. Suggestions are offered for improving the quality of research on NLP. (Author/MCF)

FRAMEWORK FOR DEVELOPING AMBIENT WATER ...

EPA Pesticide Factsheets

Currently, Ambient Water Quality Criteria (AWQC) for aquatic life protection are derived according to the Guidelines for Derivation of Ambient Water Quality Criteria for the Protection of Aquatic Life and Their Uses, published in 1985. To ensure that AWQC are derived from the best available science, Office of Water assessed the need to update the Guidelines and identified issues that should be addressed in the revisions. In December 2002, EPA's Science Advisory Board concurred with EPA's assessment of the need to update the Guidelines as well as with the issues EPA identified to address. Updating the Guidelines is a Priority Strategic Action included in OST's Strategy for Water Quality Standards and Criteria (Next Priority Strategic Action #1). To revise existing methodology for deriving ambient water quality criteria for the protection of aquatic life.

The quality of dietary intake methodology and reporting in child and adolescent obesity intervention trials: a systematic review.

PubMed

Burrows, T; Golley, R K; Khambalia, A; McNaughton, S A; Magarey, A; Rosenkranz, R R; Alllman-Farinelli, M; Rangan, A M; Truby, H; Collins, C

2012-12-01

Assessing dietary intake is important in evaluating childhood obesity intervention effectiveness. The purpose of this review was to evaluate the dietary intake methods and reporting in intervention studies that included a dietary component to treat overweight or obese children. A systematic review of studies published in the English language, between 1985 and August 2010 in health databases. The search identified 2,295 papers, of which 335 were retrieved and 31 met the inclusion criteria. Twenty-three studies reported energy intake as an outcome measure, 20 reported macronutrient intakes and 10 studies reported food intake outcomes. The most common dietary method employed was the food diary (n = 13), followed by 24-h recall (n = 5), food frequency questionnaire (FFQ) (n = 4) and dietary questionnaire (n = 4). The quality of the dietary intake methods reporting was rated as 'poor' in 15 studies (52%) and only 3 were rated as 'excellent'. The reporting quality of FFQs tended to be higher than food diaries/recalls. Deficiencies in the quality of dietary intake methods reporting in child obesity studies were identified. Use of a dietary intake methods reporting checklist is recommended. This will enable the quality of dietary intake results to be evaluated, and an increased ability to replicate study methodology by other researchers. © 2012 The Authors. obesity reviews © 2012 International Association for the Study of Obesity.

Multi-criteria analysis for PM10 planning

NASA Astrophysics Data System (ADS)

Pisoni, Enrico; Carnevale, Claudio; Volta, Marialuisa

To implement sound air quality policies, Regulatory Agencies require tools to evaluate outcomes and costs associated to different emission reduction strategies. These tools are even more useful when considering atmospheric PM10 concentrations due to the complex nonlinear processes that affect production and accumulation of the secondary fraction of this pollutant. The approaches presented in the literature (Integrated Assessment Modeling) are mainly cost-benefit and cost-effective analysis. In this work, the formulation of a multi-objective problem to control particulate matter is proposed. The methodology defines: (a) the control objectives (the air quality indicator and the emission reduction cost functions); (b) the decision variables (precursor emission reductions); (c) the problem constraints (maximum feasible technology reductions). The cause-effect relations between air quality indicators and decision variables are identified tuning nonlinear source-receptor models. The multi-objective problem solution provides to the decision maker a set of not-dominated scenarios representing the efficient trade-off between the air quality benefit and the internal costs (emission reduction technology costs). The methodology has been implemented for Northern Italy, often affected by high long-term exposure to PM10. The source-receptor models used in the multi-objective analysis are identified processing long-term simulations of GAMES multiphase modeling system, performed in the framework of CAFE-Citydelta project.

Most systematic reviews of high methodological quality on psoriasis interventions are classified as high risk of bias using ROBIS tool.

PubMed

Gómez-García, Francisco; Ruano, Juan; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Sanz-Cabanillas, Juan Luis; Alcalde-Mellado, Patricia; Maestre-López, Beatriz; Carmona-Fernández, Pedro Jesús; González-Padilla, Marcelino; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-01

No gold standard exists to assess methodological quality of systematic reviews (SRs). Although Assessing the Methodological Quality of Systematic Reviews (AMSTAR) is widely accepted for analyzing quality, the ROBIS instrument has recently been developed. This study aimed to compare the capacity of both instruments to capture the quality of SRs concerning psoriasis interventions. Systematic literature searches were undertaken on relevant databases. For each review, methodological quality and bias risk were evaluated using the AMSTAR and ROBIS tools. Descriptive and principal component analyses were conducted to describe similarities and discrepancies between both assessment tools. We classified 139 intervention SRs as displaying high/moderate/low methodological quality and as high/low risk of bias. A high risk of bias was detected for most SRs classified as displaying high or moderate methodological quality by AMSTAR. When comparing ROBIS result profiles, responses to domain 4 signaling questions showed the greatest differences between bias risk assessments, whereas domain 2 items showed the least. When considering SRs published about psoriasis, methodological quality remains suboptimal, and the risk of bias is elevated, even for SRs exhibiting high methodological quality. Furthermore, the AMSTAR and ROBIS tools may be considered as complementary when conducting quality assessment of SRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Forty years of quality-of-life research in congenital heart disease: Temporal trends in conceptual and methodological rigor.

PubMed

Bratt, Ewa-Lena; Moons, Philip

2015-09-15

The first study on quality of life (QoL) in patients with congenital heart disease was published 40 years ago. Since then, the number of QoL articles on these patients has grown exponentially. We conducted a systematic literature review of all empirical studies on QoL in patients with congenital heart disease published since 1974, with the aim of determining the range of conceptual and methodological rigor of studies and identifying temporal trends in these parameters. PubMed, Embase, and Cinahl were searched for empirical studies addressing QoL in children, adolescents, or adults with congenital heart disease, published between January 1, 1974, and December 31, 2014. We applied 10 review criteria that were previously developed by Gill and Feinstein in 1994 and further refined by Moons et al. in 2004. Overall, 234 articles were reviewed. We found slight but non-significant temporal improvements in conceptual and methodological rigor and in use of assessment methods. This indicates a trend toward a more professional and exacting approach in QoL assessments. However, the majority of articles still had substantial conceptual and methodological deficits. Furthermore, we observed that citation of the publications of Gill and Feinstein and Moons et al. in published QoL research is associated with higher quality scores, suggesting that these articles have a positive impact on conceptual and methodological caliber. Despite 40 years of QoL research in this field, this review shows that major weaknesses in methodological rigor remain highly prevalent, which may make QoL studies inconclusive. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Modeling companion diagnostics in economic evaluations of targeted oncology therapies: systematic review and methodological checklist.

PubMed

Doble, Brett; Tan, Marcus; Harris, Anthony; Lorgelly, Paula

2015-02-01

The successful use of a targeted therapy is intrinsically linked to the ability of a companion diagnostic to correctly identify patients most likely to benefit from treatment. The aim of this study was to review the characteristics of companion diagnostics that are of importance for inclusion in an economic evaluation. Approaches for including these characteristics in model-based economic evaluations are compared with the intent to describe best practice methods. Five databases and government agency websites were searched to identify model-based economic evaluations comparing a companion diagnostic and subsequent treatment strategy to another alternative treatment strategy with model parameters for the sensitivity and specificity of the companion diagnostic (primary synthesis). Economic evaluations that limited model parameters for the companion diagnostic to only its cost were also identified (secondary synthesis). Quality was assessed using the Quality of Health Economic Studies instrument. 30 studies were included in the review (primary synthesis n = 12; secondary synthesis n = 18). Incremental cost-effectiveness ratios may be lower when the only parameter for the companion diagnostic included in a model is the cost of testing. Incorporating the test's accuracy in addition to its cost may be a more appropriate methodological approach. Altering the prevalence of the genetic biomarker, specific population tested, type of test, test accuracy and timing/sequence of multiple tests can all impact overall model results. The impact of altering a test's threshold for positivity is unknown as it was not addressed in any of the included studies. Additional quality criteria as outlined in our methodological checklist should be considered due to the shortcomings of standard quality assessment tools in differentiating studies that incorporate important test-related characteristics and those that do not. There is a need to refine methods for incorporating the characteristics of companion diagnostics into model-based economic evaluations to ensure consistent and transparent reimbursement decisions are made.

Quality indicators for musculoskeletal injury management in the emergency department: a systematic review.

PubMed

Strudwick, Kirsten; Nelson, Mark; Martin-Khan, Melinda; Bourke, Michael; Bell, Anthony; Russell, Trevor

2015-02-01

There is increasing importance placed on quality of health care for musculoskeletal injuries in emergency departments (EDs). This systematic review aimed to identify existing musculoskeletal quality indicators (QIs) developed for ED use and to critically evaluate their methodological quality. MEDLINE, EMBASE, CINAHL, and the gray literature, including relevant organizational websites, were searched in 2013. English-language articles were included that described the development of at least one QI related to the ED care of musculoskeletal injuries. Data extraction of each included article was conducted. A quality assessment was then performed by rating each relevant QI against the Appraisal of Indicators through Research and Evaluation (AIRE) Instrument. QIs with similar definitions were grouped together and categorized according to the health care quality frameworks of Donabedian and the Institute of Medicine. The search revealed 1,805 potentially relevant articles, of which 15 were finally included in the review. The number of relevant QIs per article ranged from one to 11, resulting in a total of 71 QIs overall. Pain (n = 17) and fracture management (n = 13) QIs were predominant. Ten QIs scored at least 50% across all AIRE Instrument domains, and these related to pain management and appropriate imaging of the spine. Methodological quality of the development of most QIs is poor. Recommendations for a core set of QIs that address the complete spectrum of musculoskeletal injury management in emergency medicine is not possible, and more work is needed. Currently, QIs with highest methodological quality are in the areas of pain management and medical imaging. © 2015 by the Society for Academic Emergency Medicine.

Quality Assessment of Economic Evaluations of Suicide and Self-Harm Interventions.

PubMed

Bustamante Madsen, Lizell; Eddleston, Michael; Schultz Hansen, Kristian; Konradsen, Flemming

2018-03-01

Death following self-harm constitutes a major global public health challenge and there is an urgent need for governments to implement cost-effective, national suicide prevention strategies. To conduct a systematic review and quality appraisal of the economic evaluations of interventions aimed at preventing suicidal behavior. A systematic literature search was performed in several literature databases to identify relevant articles published from 2003 to 2016. Drummond's 10-item appraisal tool was used to assess the methodological quality of the included studies. In total, 25 documents encompassing 30 economic evaluations were included in the review. Of the identified evaluations, 10 studies were found to be of poor quality, 14 were of average quality, and six studies were considered of good quality. The majority of evaluations found the interventions to be cost-effective. Several limitations were identified and discussed in the article. A notable few economic evaluations were identified. The studies were diverse, primarily set in high-income countries, and often based on modeling, emphasizing the need for more primary research into the topic. The discussion of suicide and self-harm prevention should be as nuanced as possible, including health economics along with cultural, social, and political aspects.

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

[Audit and feedback, and continuous quality improvement strategies to improve the quality of care for type 2 diabetes: a systematic review of literature].

PubMed

Vecchi, Simona; Agabiti, Nera; Mitrova, Susanna; Cacciani, Laura; Amato, Laura; Davoli, Marina; Bargagli, Anna Maria

2016-01-01

we analysed evidence on effective interventions to improve the quality of care and management in patients with diabetes type 2. This review focuses particularly on audit and feedback intervention, targeted to healthcare providers, and continuous quality improvement (CQI) involving health professionals and health care systems, respectively. we searched The Cochrane Library, PubMed, and EMBASE (search period: January 2005-December 2015) to identify systematic reviews (SR) and randomized controlled trials (RCTs) considering patients' outcomes and process measures as quality indicators in diabetes care. Selection of studies and data extraction were carried out independently by two reviewers. Methodological quality of individual studies was assessed using the checklist «Assessment of methodological quality of systematic review» (AMSTAR) and the Cochrane's tool, respectively. We produced summaries of results for each study design. the search process resulted in 810 citations. One SR and 7 RCTs that compared any intervention in which audit and feedback and CQI was a component vs. other interventions were selected. The SR found that audit and feedback activity was associated with improvements of glycaemic (mean difference: 0.26; 95%CI 0.08;0.44) and cholesterol control (mean difference: 0.03; 95%CI -0.04;0.10). CQI interventions were not associated with an improvement of quality of diabetes care. The RCTs considered in this review compared a broad range of interventions including feedback as unique activity or as part of more complex strategies. The methodological quality was generally poor in all the included trials. the available evidence suggests that audit and feedback and CQI improve quality of care in diabetic patients, although the effect is small and heterogeneous among process and outcomes indicators.

Typology of end-of-life priorities in Saudi females: averaging analysis and Q-methodology.

PubMed

Hammami, Muhammad M; Hammami, Safa; Amer, Hala A; Khodr, Nesrine A

2016-01-01

Understanding culture-and sex-related end-of-life preferences is essential to provide quality end-of-life care. We have previously explored end-of-life choices in Saudi males and found important culture-related differences and that Q-methodology is useful in identifying intraculture, opinion-based groups. Here, we explore Saudi females' end-of-life choices. A volunteer sample of 68 females rank-ordered 47 opinion statements on end-of-life issues into a nine-category symmetrical distribution. The ranking scores of the statements were analyzed by averaging analysis and Q-methodology. The mean age of the females in the sample was 30.3 years (range, 19-55 years). Among them, 51% reported average religiosity, 78% reported very good health, 79% reported very good life quality, and 100% reported high-school education or more. The extreme five overall priorities were to be able to say the statement of faith, be at peace with God, die without having the body exposed, maintain dignity, and resolve all conflicts. The extreme five overall dis-priorities were to die in the hospital, die well dressed, be informed about impending death by family/friends rather than doctor, die at peak of life, and not know if one has a fatal illness. Q-methodology identified five opinion-based groups with qualitatively different characteristics: "physical and emotional privacy concerned, family caring" (younger, lower religiosity), "whole person" (higher religiosity), "pain and informational privacy concerned" (lower life quality), "decisional privacy concerned" (older, higher life quality), and "life quantity concerned, family dependent" (high life quality, low life satisfaction). Out of the extreme 14 priorities/dis-priorities for each group, 21%-50% were not represented among the extreme 20 priorities/dis-priorities for the entire sample. Consistent with the previously reported findings in Saudi males, transcendence and dying in the hospital were the extreme end-of-life priority and dis-priority, respectively, in Saudi females. Body modesty was a major overall concern; however, concerns about pain, various types of privacy, and life quantity were variably emphasized by the five opinion-based groups but masked by averaging analysis.

The landscape of systematic reviews in urology (1998 to 2015): an assessment of methodological quality.

PubMed

Han, Julia L; Gandhi, Shreyas; Bockoven, Crystal G; Narayan, Vikram M; Dahm, Philipp

2017-04-01

To assess the quality of published systematic reviews in the urology literature (an extension of our previously reported work), as high-quality systematic reviews play a paramount role in informing evidence-based clinical practice. Our focus was on systematic reviews in the urology literature that incorporated questions of prevention and therapy. To identify such reviews published during a 36-month period (2013-2015), we systematically searched PubMed and hand-searched the table of contents of four major urology journals. Two reviewers independently assessed the methodological quality of those reviews, using the 11-point 'Assessment of Multiple Systematic Reviews' (AMSTAR) instrument. We performed protocol-driven analyses of the data from our present study's 36-month period alone, as well as in aggregate with the data from our previously reported work's study periods (2009-2012 and 1998-2008). In our literature search of the 36-month period (2013-2015), we initially identified 490 possibly relevant reviews, of which 125 met our inclusion criteria. The most common topic of reviews for the 2013-2015 period was oncology (51.2%; n = 64), followed by voiding dysfunction (21.6%; n = 27). The mean [standard deviation (SD)] AMSTAR score in the 2013-2015 period (n = 125) was 4.8 (2.4); 2009-2012 (n = 113), 5.4 (2.3); and 1998-2008 (n = 57), 4.8 (2.0) (P = 0.127). In the 2013-2015 period, the mean (SD) AMSTAR score for the BJU International (n = 25) was 5.6 (2.9); for The Journal of Urology (n = 20), 5.1 (2.6); for European Urology (n = 60), 4.5 (2.2); and for Urology (n = 20), 4.4 (2.2) (P = 0.106). The number of systematic reviews published in the urology literature has exponentially increased, year by year, but their methodological quality has stagnated. To enhance the validity and impact of systematic reviews, all authors and editors must apply established methodological standards. © 2016 The Authors BJU International © 2016 BJU International Published by John Wiley & Sons Ltd.

Typology of end-of-life priorities in Saudi females: averaging analysis and Q-methodology

PubMed Central

Hammami, Muhammad M; Hammami, Safa; Amer, Hala A; Khodr, Nesrine A

2016-01-01

Background Understanding culture-and sex-related end-of-life preferences is essential to provide quality end-of-life care. We have previously explored end-of-life choices in Saudi males and found important culture-related differences and that Q-methodology is useful in identifying intraculture, opinion-based groups. Here, we explore Saudi females’ end-of-life choices. Methods A volunteer sample of 68 females rank-ordered 47 opinion statements on end-of-life issues into a nine-category symmetrical distribution. The ranking scores of the statements were analyzed by averaging analysis and Q-methodology. Results The mean age of the females in the sample was 30.3 years (range, 19–55 years). Among them, 51% reported average religiosity, 78% reported very good health, 79% reported very good life quality, and 100% reported high-school education or more. The extreme five overall priorities were to be able to say the statement of faith, be at peace with God, die without having the body exposed, maintain dignity, and resolve all conflicts. The extreme five overall dis-priorities were to die in the hospital, die well dressed, be informed about impending death by family/friends rather than doctor, die at peak of life, and not know if one has a fatal illness. Q-methodology identified five opinion-based groups with qualitatively different characteristics: “physical and emotional privacy concerned, family caring” (younger, lower religiosity), “whole person” (higher religiosity), “pain and informational privacy concerned” (lower life quality), “decisional privacy concerned” (older, higher life quality), and “life quantity concerned, family dependent” (high life quality, low life satisfaction). Out of the extreme 14 priorities/dis-priorities for each group, 21%–50% were not represented among the extreme 20 priorities/dis-priorities for the entire sample. Conclusion Consistent with the previously reported findings in Saudi males, transcendence and dying in the hospital were the extreme end-of-life priority and dis-priority, respectively, in Saudi females. Body modesty was a major overall concern; however, concerns about pain, various types of privacy, and life quantity were variably emphasized by the five opinion-based groups but masked by averaging analysis. PMID:27274205

Author-paper affiliation network architecture influences the methodological quality of systematic reviews and meta-analyses of psoriasis.

PubMed

Sanz-Cabanillas, Juan Luis; Ruano, Juan; Gomez-Garcia, Francisco; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Maestre-Lopez, Beatriz; Gonzalez-Padilla, Marcelino; Carmona-Fernandez, Pedro J; Velez Garcia-Nieto, Antonio; Isla-Tejera, Beatriz

2017-01-01

Moderate-to-severe psoriasis is associated with significant comorbidity, an impaired quality of life, and increased medical costs, including those associated with treatments. Systematic reviews (SRs) and meta-analyses (MAs) of randomized clinical trials are considered two of the best approaches to the summarization of high-quality evidence. However, methodological bias can reduce the validity of conclusions from these types of studies and subsequently impair the quality of decision making. As co-authorship is among the most well-documented forms of research collaboration, the present study aimed to explore whether authors' collaboration methods might influence the methodological quality of SRs and MAs of psoriasis. Methodological quality was assessed by two raters who extracted information from full articles. After calculating total and per-item Assessment of Multiple Systematic Reviews (AMSTAR) scores, reviews were classified as low (0-4), medium (5-8), or high (9-11) quality. Article metadata and journal-related bibliometric indices were also obtained. A total of 741 authors from 520 different institutions and 32 countries published 220 reviews that were classified as high (17.2%), moderate (55%), or low (27.7%) methodological quality. The high methodological quality subnetwork was larger but had a lower connection density than the low and moderate methodological quality subnetworks; specifically, the former contained relatively fewer nodes (authors and reviews), reviews by authors, and collaborators per author. Furthermore, the high methodological quality subnetwork was highly compartmentalized, with several modules representing few poorly interconnected communities. In conclusion, structural differences in author-paper affiliation network may influence the methodological quality of SRs and MAs on psoriasis. As the author-paper affiliation network structure affects study quality in this research field, authors who maintain an appropriate balance between scientific quality and productivity are more likely to develop higher quality reviews.

Virtual reality exposure therapy for the treatment of posttraumatic stress disorder: a methodological review using CONSORT guidelines.

PubMed

Motraghi, Terri E; Seim, Richard W; Meyer, Eric C; Morissette, Sandra B

2014-03-01

Virtual reality exposure therapy (VRET) is an extension of traditional exposure therapy and has been used to treat a variety of anxiety disorders. VRET utilizes a computer-generated virtual environment to present fear-relevant stimuli. Recent studies have evaluated the use of VRET for treatment of PTSD; however, a systematic evaluation of the methodological quality of these studies has yet to be conducted. This review aims to (a) identify treatment outcome studies examining the use of VRET for the treatment of PTSD and (b) appraise the methodological quality of each study using the 2010 Consolidating Standards of Reporting Trials (CONSORT) Statement and its 2008 extension for nonpharmacologic interventions. Two independent assessors conducted a database search (PsycINFO, Medline, CINAHL, Google Scholar) of studies published between January 1990 and June 2013 that reported outcome data comparing VRET with another type of treatment or a control condition. Next, a CONSORT quality appraisal of each study was completed. The search yielded nine unique studies. The CONSORT appraisal revealed that the methodological quality of studies examining VRET as a treatment for PTSD was variable. Although preliminary findings suggest some positive results for VRET as a form of exposure treatment for PTSD, additional research using well-specified randomization procedures, assessor blinding, and monitoring of treatment adherence is warranted. Movement toward greater standardization of treatment manuals, virtual environments, and equipment would further facilitate interpretation and consolidation of this literature. © 2013 Wiley Periodicals, Inc.

Methodology of quality improvement projects for the Texas Medicare population.

PubMed

Pendergrass, P W; Abel, R L; Bing, M; Vaughn, R; McCauley, C

1998-07-01

The Texas Medical Foundation, the quality improvement organization for the state of Texas, develops local quality improvement projects for the Medicare population. These projects are developed as part of the Health Care Quality Improvement Program undertaken by the Health Care Financing Administration. The goal of a local quality improvement project is to collaborate with providers to identify and reduce the incidence of unintentional variations in the delivery of care that negatively impact outcomes. Two factors are critical to the success of a quality improvement project. First, as opposed to peer review that is based on implicit criteria, quality improvement must be based on explicit criteria. These criteria represent key steps in the delivery of care that have been shown to improve outcomes for a specific disease. Second, quality improvement must be performed in partnership with the health care community. As such, the health care community must play an integral role in the design and evaluation of a quality improvement project and in the design and implementation of the resulting quality improvement plan. Specifically, this article provides a historical perspective for the transition from peer review to quality improvement. It discusses key steps used in developing and implementing local quality improvement projects including topic selection, quality indicator development, collaborator recruitment, and measurement of performance/improvement. Two Texas Medical Foundation projects are described to highlight the current methodology and to illustrate the impact of quality improvement projects.

HOLA: Human-like Orthogonal Network Layout.

PubMed

Kieffer, Steve; Dwyer, Tim; Marriott, Kim; Wybrow, Michael

2016-01-01

Over the last 50 years a wide variety of automatic network layout algorithms have been developed. Some are fast heuristic techniques suitable for networks with hundreds of thousands of nodes while others are multi-stage frameworks for higher-quality layout of smaller networks. However, despite decades of research currently no algorithm produces layout of comparable quality to that of a human. We give a new "human-centred" methodology for automatic network layout algorithm design that is intended to overcome this deficiency. User studies are first used to identify the aesthetic criteria algorithms should encode, then an algorithm is developed that is informed by these criteria and finally, a follow-up study evaluates the algorithm output. We have used this new methodology to develop an automatic orthogonal network layout method, HOLA, that achieves measurably better (by user study) layout than the best available orthogonal layout algorithm and which produces layouts of comparable quality to those produced by hand.

Framework and indicator testing protocol for developing and piloting quality indicators for the UK quality and outcomes framework.

PubMed

Campbell, Stephen M; Kontopantelis, Evangelos; Hannon, Kerin; Burke, Martyn; Barber, Annette; Lester, Helen E

2011-08-10

Quality measures should be subjected to a testing protocol before being used in practice using key attributes such as acceptability, feasibility and reliability, as well as identifying issues derived from actual implementation and unintended consequences. We describe the methodologies and results of an indicator testing protocol (ITP) using data from proposed quality indicators for the United Kingdom Quality and Outcomes Framework (QOF). The indicator testing protocol involved a multi-step and methodological process: 1) The RAND/UCLA Appropriateness Method, to test clarity and necessity, 2) data extraction from patients' medical records, to test technical feasibility and reliability, 3) diaries, to test workload, 4) cost-effectiveness modelling, and 5) semi-structured interviews, to test acceptability, implementation issues and unintended consequences. Testing was conducted in a sample of representative family practices in England. These methods were combined into an overall recommendation for each tested indicator. Using an indicator testing protocol as part of piloting was seen as a valuable way of testing potential indicators in 'real world' settings. Pilot 1 (October 2009-March 2010) involved thirteen indicators across six clinical domains and twelve indicators passed the indicator testing protocol. However, the indicator testing protocol identified a number of implementation issues and unintended consequences that can be rectified or removed prior to national roll out. A palliative care indicator is used as an exemplar of the value of piloting using a multiple attribute indicator testing protocol - while technically feasible and reliable, it was unacceptable to practice staff and raised concerns about potentially causing actual patient harm. This indicator testing protocol is one example of a protocol that may be useful in assessing potential quality indicators when adapted to specific country health care settings and may be of use to policy-makers and researchers worldwide to test the likely effect of implementing indicators prior to roll out. It builds on and codifies existing literature and other testing protocols to create a field testing methodology that can be used to produce country specific quality indicators for pay-for-performance or quality improvement schemes.

Clinical practice guidelines for fertility preservation in young women undergoing gonadotoxic treatment: an overview and critical appraisal of methodological quality and content.

PubMed

Baysal, Özlem; Hamilton, Jozefien A M; Hamilton, Carl J C M; Braat, Didi D M; Beerendonk, Catharina C M; Nelen, Willianne L D M

2018-04-13

What is the methodological quality and content of internationally available clinical practice guidelines (CPGs) on fertility preservation (FP) care in adult women? Internationally available CPGs on FP care in adult women were identified after conducting an extensive literature search and consulting (inter)national key experts. The methodological quality of the CPGs was appraised by an (inter)national panel of experts using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. The content of the best CPGs, scoring ≥60% for the domain 'Rigour of development' of the AGREE II instrument, was extracted and categorized according to their topic. Thirty of the 1808 documents found were included. After consulting (inter)national key experts, 30 CPGs were included, six of which scored ≥60% for their 'Rigour of development'. The number of FP-related topics discussed by these six CPGs ranged from 4 to 12. The number of recommendations provided by the CPGs on these topics varied. The number of topics to which ≥5 recommendations were dedicated ranged from 0 to 4 between CPGs. CPGs on the subject of FP care are available, but there is room for improvement in quality and content. Although written for use in daily practice, the CPGs can also be used to develop quality indicators to monitor the quality of current FP care or to evaluate future improvement initiatives. Copyright © 2018 Reproductive Healthcare Ltd. Published by Elsevier Ltd. All rights reserved.

Predicting Causes of Data Quality Issues in a Clinical Data Research Network.

PubMed

Khare, Ritu; Ruth, Byron J; Miller, Matthew; Tucker, Joshua; Utidjian, Levon H; Razzaghi, Hanieh; Patibandla, Nandan; Burrows, Evanette K; Bailey, L Charles

2018-01-01

Clinical data research networks (CDRNs) invest substantially in identifying and investigating data quality problems. While identification is largely automated, the investigation and resolution are carried out manually at individual institutions. In the PEDSnet CDRN, we found that only approximately 35% of the identified data quality issues are resolvable as they are caused by errors in the extract-transform-load (ETL) code. Nonetheless, with no prior knowledge of issue causes, partner institutions end up spending significant time investigating issues that represent either inherent data characteristics or false alarms. This work investigates whether the causes (ETL, Characteristic, or False alarm) can be predicted before spending time investigating issues. We trained a classifier on the metadata from 10,281 real-world data quality issues, and achieved a cause prediction F1-measure of up to 90%. While initially tested on PEDSnet, the proposed methodology is applicable to other CDRNs facing similar bottlenecks in handling data quality results.

Health economic evidence gaps and methodological constraints in low back pain and neck pain: Results of the Research Agenda for Health Economic Evaluation (RAHEE) project.

PubMed

van Dongen, J M; Ketheswaran, J; Tordrup, D; Ostelo, R W J G; Bertollini, R; van Tulder, M W

2016-12-01

Despite the increased interest in economic evaluations, there are difficulties in applying the results of such studies in practice. Therefore, the "Research Agenda for Health Economic Evaluation" (RAHEE) project was initiated, which aimed to improve the use of health economic evidence in practice for the 10 highest burden conditions in the European Union (including low back pain [LBP] and neck pain [NP]). This was done by undertaking literature mapping and convening an Expert Panel meeting, during which the literature mapping results were discussed and evidence gaps and methodological constraints were identified. The current paper is a part of the RAHEE project and aimed to identify economic evidence gaps and methodological constraints in the LBP and NP literature, in particular. The literature mapping revealed that economic evidence was unavailable for various commonly used LBP and NP treatments (e.g., injections, traction, and discography). Even if economic evidence was available, many treatments were only evaluated in a single study or studies for the same intervention were highly heterogeneous in terms of their patient population, control condition, follow-up duration, setting, and/or economic perspective. Up until now, this has prevented economic evaluation results from being statistically pooled in the LBP and NP literature, and strong conclusions about the cost-effectiveness of LBP and NP treatments can therefore not be made. The Expert Panel identified the need for further high-quality economic evaluations, especially on surgery versus conservative care and competing treatment options for chronic LBP. Handling of uncertainty and reporting quality were considered the most important methodological challenges. Copyright © 2017. Published by Elsevier Ltd.

A new methodology to identify surface water bodies at risk by using pesticide monitoring data: The glyphosate case study in Lombardy Region (Italy).

PubMed

Di Guardo, Andrea; Finizio, Antonio

2018-01-01

In the last decades, several monitoring programs were established as an effect of EU Directives addressing the quality of water resources (drinking water, groundwater and surface water). Plant Protection Products (PPPs) are an obvious target of monitoring activities, since they are directly released into the environment. One of the challenges in managing the risk of pesticides at the territorial scale is identifying the locations in water bodies needing implementation of risk mitigation measures. In this, the national pesticides monitoring plans could be very helpful. However, monitoring of pesticides is a challenging task because of the high number of registered pesticides, cost of analyses, and the periodicity of sampling related to pesticide application and use. Extensive high-quality data-sets are consequently often missing. More in general, the information that can be obtained from monitoring studies are frequently undervalued by risk managers. In this study, we propose a new methodology providing indications about the need to implement mitigation measures in stretches of surface water bodies on a territory by combining historical series of monitoring data and GIS. The methodology is articulated in two distinct phases: a) acquisition of monitoring data and setting-up of informative layers of georeferenced data (phase 1) and b) statistical and expert analysis for the identification of areas where implementation of limitation or mitigation measures are suggested (phase 2). Our methodology identifies potentially vulnerable water bodies, considering temporal contamination trends and relative risk levels at selected monitoring stations. A case study is presented considering glyphosate monitoring data in Lombardy Region (Northern of Italy) for the 2008-2014 period. Copyright © 2017 Elsevier B.V. All rights reserved.

Integrative treatment for low back pain: An exploratory systematic review and meta-analysis of randomized controlled trials.

PubMed

Hu, Xiao-Yang; Chen, Ni-Ni; Chai, Qian-Yun; Yang, Guo-Yan; Trevelyan, Esmé; Lorenc, Ava; Liu, Jian-Ping; Robinson, Nicola

2015-10-26

Low back pain (LBP) is a common musculoskeletal condition often treated using integrative medicine (IM). Most reviews have focused on a single complementary and alternative medicine (CAM) therapy for LBP rather than evaluating wider integrative approaches. This exploratory systematic review aimed to identify randomized controlled trials (RCTs) and provide evidence on the effectiveness, cost effectiveness and adverse effects of integrative treatment for LBP. A literature search was conducted in 12 English and Chinese databases. RCTs evaluating an integrative treatment for musculoskeletal related LBP were included. Reporting, methodological quality and relevant clinical characteristics were assessed and appraised. Metaanalyses were performed for outcomes where trials were sufficiently homogenous. Fifty-six RCTs were identified evaluating integrative treatment for LBP. Although reporting and methodological qualities were poor, meta-analysis showed a favourable effect for integrative treatment over conventional and CAM treatment for back pain and function at 3 months or less follow-up. Two trials investigated costs, reporting £ 5332 per quality adjusted life years with 6 Alexander technique lessons plus exercise at 12 months follow-up; and an increased total costs of $244 when giving an additional up to 15 sessions of CAM package of care at 12 weeks. Sixteen trials mentioned safety; no severe adverse effects were reported. Integrative treatment that combines CAM with conventional therapies appeared to have beneficial effects on pain and function. However, evidence is limited due to heterogeneity, the relatively small numbers available for subgroup analyses and the low methodological quality of the included trials. Identification of studies of true IM was not possible due to lack of reporting of the intervention details (registration No. CRD42013003916).

Advancing scoping study methodology: a web-based survey and consultation of perceptions on terminology, definition and methodological steps.

PubMed

O'Brien, Kelly K; Colquhoun, Heather; Levac, Danielle; Baxter, Larry; Tricco, Andrea C; Straus, Sharon; Wickerson, Lisa; Nayar, Ayesha; Moher, David; O'Malley, Lisa

2016-07-26

Scoping studies (or reviews) are a method used to comprehensively map evidence across a range of study designs in an area, with the aim of informing future research practice, programs and policy. However, no universal agreement exists on terminology, definition or methodological steps. Our aim was to understand the experiences of, and considerations for conducting scoping studies from the perspective of academic and community partners. Primary objectives were to 1) describe experiences conducting scoping studies including strengths and challenges; and 2) describe perspectives on terminology, definition, and methodological steps. We conducted a cross-sectional web-based survey with clinicians, educators, researchers, knowledge users, representatives from community-based organizations, graduate students, and policy stakeholders with experience and/or interest in conducting scoping studies to gain an understanding of experiences and perspectives on the conduct and reporting of scoping studies. We administered an electronic self-reported questionnaire comprised of 22 items related to experiences with scoping studies, strengths and challenges, opinions on terminology, and methodological steps. We analyzed questionnaire data using descriptive statistics and content analytical techniques. Survey results were discussed during a multi-stakeholder consultation to identify key considerations in the conduct and reporting of scoping studies. Of the 83 invitations, 54 individuals (65 %) completed the scoping questionnaire, and 48 (58 %) attended the scoping study meeting from Canada, the United Kingdom and United States. Many scoping study strengths were dually identified as challenges including breadth of scope, and iterative process. No consensus on terminology emerged, however key defining features that comprised a working definition of scoping studies included the exploratory mapping of literature in a field; iterative process, inclusion of grey literature; no quality assessment of included studies, and an optional consultation phase. We offer considerations for the conduct and reporting of scoping studies for researchers, clinicians and knowledge users engaging in this methodology. Lack of consensus on scoping terminology, definition and methodological steps persists. Reasons for this may be attributed to diversity of disciplines adopting this methodology for differing purposes. Further work is needed to establish guidelines on the reporting and methodological quality assessment of scoping studies.

An Overview of Key Indicators and Evaluation Tools for Assessing Housing Quality: A Literature Review

NASA Astrophysics Data System (ADS)

Sinha, Rajan Chandra; Sarkar, Satyaki; Mandal, Nikhil Ranjan

2017-09-01

The issue of the housing quality has been addressed for various stakeholders at different levels. There exist varied opinion about its measurability and possible applications. Thus the study is carried out to have an insight into the concept of housing quality and its relevance in the changing demographics, technological, socio-economic and socio-cultural conditions. This study attempts to summarize the literature that addresses past research concerned with factors related to housing quality, its measurement methodology and critically examines the broad key indicators identified to have impact upon enhancing the housing quality. This work discusses the recent techniques which are extensively used for analysis of housing quality.

Panning for the gold in health research: incorporating studies' methodological quality in meta-analysis.

PubMed

Johnson, Blair T; Low, Robert E; MacDonald, Hayley V

2015-01-01

Systematic reviews now routinely assess methodological quality to gauge the validity of the included studies and of the synthesis as a whole. Although trends from higher quality studies should be clearer, it is uncertain how often meta-analyses incorporate methodological quality in models of study results either as predictors, or, more interestingly, in interactions with theoretical moderators. We survey 200 meta-analyses in three health promotion domains to examine when and how meta-analyses incorporate methodological quality. Although methodological quality assessments commonly appear in contemporary meta-analyses (usually as scales), they are rarely incorporated in analyses, and still more rarely analysed in interaction with theoretical determinants of the success of health promotions. The few meta-analyses (2.5%) that did include such an interaction analysis showed that moderator results remained significant in higher quality studies or were present only among higher quality studies. We describe how to model quality interactively with theoretically derived moderators and discuss strengths and weaknesses of this approach and in relation to current meta-analytic practice. In large literatures exhibiting heterogeneous effects, meta-analyses can incorporate methodological quality and generate conclusions that enable greater confidence not only about the substantive phenomenon but also about the role that methodological quality itself plays.

The reliability of the Glasgow Coma Scale: a systematic review.

PubMed

Reith, Florence C M; Van den Brande, Ruben; Synnot, Anneliese; Gruen, Russell; Maas, Andrew I R

2016-01-01

The Glasgow Coma Scale (GCS) provides a structured method for assessment of the level of consciousness. Its derived sum score is applied in research and adopted in intensive care unit scoring systems. Controversy exists on the reliability of the GCS. The aim of this systematic review was to summarize evidence on the reliability of the GCS. A literature search was undertaken in MEDLINE, EMBASE and CINAHL. Observational studies that assessed the reliability of the GCS, expressed by a statistical measure, were included. Methodological quality was evaluated with the consensus-based standards for the selection of health measurement instruments checklist and its influence on results considered. Reliability estimates were synthesized narratively. We identified 52 relevant studies that showed significant heterogeneity in the type of reliability estimates used, patients studied, setting and characteristics of observers. Methodological quality was good (n = 7), fair (n = 18) or poor (n = 27). In good quality studies, kappa values were ≥0.6 in 85%, and all intraclass correlation coefficients indicated excellent reliability. Poor quality studies showed lower reliability estimates. Reliability for the GCS components was higher than for the sum score. Factors that may influence reliability include education and training, the level of consciousness and type of stimuli used. Only 13% of studies were of good quality and inconsistency in reported reliability estimates was found. Although the reliability was adequate in good quality studies, further improvement is desirable. From a methodological perspective, the quality of reliability studies needs to be improved. From a clinical perspective, a renewed focus on training/education and standardization of assessment is required.

Measurement properties of tools measuring mental health knowledge: a systematic review.

PubMed

Wei, Yifeng; McGrath, Patrick J; Hayden, Jill; Kutcher, Stan

2016-08-23

Mental health literacy has received great attention recently to improve mental health knowledge, decrease stigma and enhance help-seeking behaviors. We conducted a systematic review to critically appraise the qualities of studies evaluating the measurement properties of mental health knowledge tools and the quality of included measurement properties. We searched PubMed, PsycINFO, EMBASE, CINAHL, the Cochrane Library, and ERIC for studies addressing psychometrics of mental health knowledge tools and published in English. We applied the COSMIN checklist to assess the methodological quality of each study as "excellent", "good", "fair", or "indeterminate". We ranked the level of evidence of the overall quality of each measurement property across studies as "strong", "moderate", "limited", "conflicting", or "unknown". We identified 16 mental health knowledge tools in 17 studies, addressing reliability, validity, responsiveness or measurement errors. The methodological quality of included studies ranged from "poor" to "excellent" including 6 studies addressing the content validity, internal consistency or structural validity demonstrating "excellent" quality. We found strong evidence of the content validity or internal consistency of 6 tools; moderate evidence of the internal consistency, the content validity or the reliability of 8 tools; and limited evidence of the reliability, the structural validity, the criterion validity, or the construct validity of 12 tools. Both the methodological qualities of included studies and the overall evidence of measurement properties are mixed. Based on the current evidence, we recommend that researchers consider using tools with measurement properties of strong or moderate evidence that also reached the threshold for positive ratings according to COSMIN checklist.

Methodology in diagnostic laboratory test research in clinical chemistry and clinical chemistry and laboratory medicine.

PubMed

Lumbreras-Lacarra, Blanca; Ramos-Rincón, José Manuel; Hernández-Aguado, Ildefonso

2004-03-01

The application of epidemiologic principles to clinical diagnosis has been less developed than in other clinical areas. Knowledge of the main flaws affecting diagnostic laboratory test research is the first step for improving its quality. We assessed the methodologic aspects of articles on laboratory tests. We included articles that estimated indexes of diagnostic accuracy (sensitivity and specificity) and were published in Clinical Chemistry or Clinical Chemistry and Laboratory Medicine in 1996, 2001, and 2002. Clinical Chemistry has paid special attention to this field of research since 1996 by publishing recommendations, checklists, and reviews. Articles were identified through electronic searches in Medline. The strategy combined the Mesh term "sensitivity and specificity" (exploded) with the text words "specificity", "false negative", and "accuracy". We examined adherence to seven methodologic criteria used in the study by Reid et al. (JAMA1995;274:645-51) of papers published in general medical journals. Three observers evaluated each article independently. Seventy-nine articles fulfilled the inclusion criteria. The percentage of studies that satisfied each criterion improved from 1996 to 2002. Substantial improvement was observed in reporting of the statistical uncertainty of indices of diagnostic accuracy, in criteria based on clinical information from the study population (spectrum composition), and in avoidance of workup bias. Analytical reproducibility was reported frequently (68%), whereas information about indeterminate results was rarely provided. The mean number of methodologic criteria satisfied showed a statistically significant increase over the 3 years in Clinical Chemistry but not in Clinical Chemistry and Laboratory Medicine. The methodologic quality of the articles on diagnostic test research published in Clinical Chemistry and Clinical Chemistry and Laboratory Medicine is comparable to the quality observed in the best general medical journals. The methodologic aspects that most need improvement are those linked to the clinical information of the populations studied. Editorial actions aimed to increase the quality of reporting of diagnostic studies could have a relevant positive effect, as shown by the improvement observed in Clinical Chemistry.

Physical activity interventions for people with mental illness: a systematic review and meta-analysis.

PubMed

Rosenbaum, Simon; Tiedemann, Anne; Sherrington, Catherine; Curtis, Jackie; Ward, Philip B

2014-09-01

To determine effects of physical activity on depressive symptoms (primary objective), symptoms of schizophrenia, anthropometric measures, aerobic capacity, and quality of life (secondary objectives) in people with mental illness and explore between-study heterogeneity. MEDLINE, Cochrane Controlled Trials Register, PsycINFO, CINAHL, Embase, and the Physiotherapy Evidence Database (PEDro) were searched from earliest record to 2013. Randomized controlled trials of adults with a DSM-IV-TR, ICD-10, or clinician-confirmed diagnosis of a mental illness other than dysthymia or eating disorders were selected. Interventions included exercise programs, exercise counseling, lifestyle interventions, tai chi, or physical yoga. Study methodological quality and intervention compliance with American College of Sports Medicine (ACSM) guidelines were also assessed. Two investigators extracted data. Data were pooled using random-effects meta-analysis. Meta-regression was used to examine sources of between-study heterogeneity. Thirty-nine eligible trials were identified. The primary meta-analysis found a large effect of physical activity on depressive symptoms (n = 20; standardized mean difference (SMD) = 0.80). The effect size in trial interventions that met ACSM guidelines for aerobic exercise did not differ significantly from those that did not meet these guidelines. The effect for trials with higher methodological quality was smaller than that observed for trials with lower methodological quality (SMD = 0.39 vs 1.35); however, the difference was not statistically significant. A large effect was found for schizophrenia symptoms (SMD = 1.0), a small effect was found for anthropometry (SMD = 0.24), and moderate effects were found for aerobic capacity (SMD = 0.63) and quality of life (SMD = 0.64). Physical activity reduced depressive symptoms in people with mental illness. Larger effects were seen in studies of poorer methodological quality. Physical activity reduced symptoms of schizophrenia and improved anthropometric measures, aerobic capacity, and quality of life among people with mental illness. PROSPERO registration #CRD42012002012. © Copyright 2014 Physicians Postgraduate Press, Inc.

An appraisal of the quality of published qualitative dental research.

PubMed

Masood, Mohd; Thaliath, Ebin T; Bower, Elizabeth J; Newton, J Timothy

2011-06-01

To appraise the quality of published qualitative research in dentistry and identify aspects of quality, which require attention in future research. Qualitative research studies on dental topics were appraised using the critical appraisal skills programme (CASP) appraisal framework for qualitative research. The percentage of CASP criteria fully met during the assessment was used as an indication of the quality of each paper. Individual criteria were not weighted. Forty-three qualitative studies were identified for appraisal of which 48% had a dental public health focus. Deficiencies in detail of reporting, research design, methodological rigour, presentation of findings, reflexivity, credibility of findings and relevance of study were identified. Problems with quality were apparent irrespective of journal impact factor, although papers from low impact factor journals exhibited the most deficiencies. Journals with the highest impact factors published the least qualitative research. The quality of much of the qualitative research published on dental topics is mediocre. Qualitative methods are underutilized in oral health research. If quality guidelines such as the CASP framework are used in the context of a thorough understanding of qualitative research design and data analysis, they can promote good practice and the systematic assessment of qualitative research. © 2010 John Wiley & Sons A/S.

Factors affecting children's adherence to regular dental attendance: a systematic review.

PubMed

Badri, Parvaneh; Saltaji, Humam; Flores-Mir, Carlos; Amin, Maryam

2014-08-01

Parents' adherence to regular dental attendance for their young children plays an important role in improving and maintaining children's oral health. The authors conducted a systematic review to determine the factors that influence parental adherence to regular dental attendance for their children. The authors searched nine electronic databases to May 2013. They included quantitative and qualitative studies in which researchers examined factors influencing dental attendance in children 12 years or younger. The authors considered all emergency and nonemergency visits. They appraised methodological quality through the Health Evidence Bulletins Wales methodological quality assessment tool. The authors selected 14 studies for the systematic review. Researchers in these studies reported a variety of factors at the patient, provider and system levels that influenced dental attendance. Factors identified at the patient level included parents' education, socioeconomic status, behavioral beliefs, perceived power and subjective norms. At the provider level, the authors identified communication and professional skills. At the system level, the authors identified collaborations between communities and health care professionals, as well as a formal policy of referring patients from family physicians and pediatricians to dentists. Barriers to and facilitators of parents' adherence to regular dental attendance for their children should be identified and considered when formulating health promotion policies. Further research is needed to investigate psychosocial determinants of children's adherence to regular dental visits.

Author-paper affiliation network architecture influences the methodological quality of systematic reviews and meta-analyses of psoriasis

PubMed Central

Gomez-Garcia, Francisco; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Maestre-Lopez, Beatriz; Gonzalez-Padilla, Marcelino; Carmona-Fernandez, Pedro J.; Velez Garcia-Nieto, Antonio; Isla-Tejera, Beatriz

2017-01-01

Moderate-to-severe psoriasis is associated with significant comorbidity, an impaired quality of life, and increased medical costs, including those associated with treatments. Systematic reviews (SRs) and meta-analyses (MAs) of randomized clinical trials are considered two of the best approaches to the summarization of high-quality evidence. However, methodological bias can reduce the validity of conclusions from these types of studies and subsequently impair the quality of decision making. As co-authorship is among the most well-documented forms of research collaboration, the present study aimed to explore whether authors’ collaboration methods might influence the methodological quality of SRs and MAs of psoriasis. Methodological quality was assessed by two raters who extracted information from full articles. After calculating total and per-item Assessment of Multiple Systematic Reviews (AMSTAR) scores, reviews were classified as low (0-4), medium (5-8), or high (9-11) quality. Article metadata and journal-related bibliometric indices were also obtained. A total of 741 authors from 520 different institutions and 32 countries published 220 reviews that were classified as high (17.2%), moderate (55%), or low (27.7%) methodological quality. The high methodological quality subnetwork was larger but had a lower connection density than the low and moderate methodological quality subnetworks; specifically, the former contained relatively fewer nodes (authors and reviews), reviews by authors, and collaborators per author. Furthermore, the high methodological quality subnetwork was highly compartmentalized, with several modules representing few poorly interconnected communities. In conclusion, structural differences in author-paper affiliation network may influence the methodological quality of SRs and MAs on psoriasis. As the author-paper affiliation network structure affects study quality in this research field, authors who maintain an appropriate balance between scientific quality and productivity are more likely to develop higher quality reviews. PMID:28403245

Methodological Quality Assessment of Meta-Analyses of Hyperthyroidism Treatment.

PubMed

Qin, Yahong; Yao, Liang; Shao, Feifei; Yang, Kehu; Tian, Limin

2018-01-01

Hyperthyroidism is a common condition that is associated with increased morbidity and mortality. A number of meta-analyses (MAs) have assessed the therapeutic measures for hyperthyroidism, including antithyroid drugs, surgery, and radioiodine, however, the methodological quality has not been evaluated. This study evaluated the methodological quality and summarized the evidence obtained from MAs of hyperthyroidism treatments for radioiodine, antithyroid drugs, and surgery. We searched the PubMed, EMBASE, Cochrane Library, Web of Science, and Chinese Biomedical Literature Database databases. Two investigators independently assessed the meta-analyses titles and abstracts for inclusion. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. A total of 26 MAs fulfilled the inclusion criteria. Based on the AMSTAR scores, the average methodological quality was 8.31, with large variability ranging from 4 to 11. The methodological quality of English meta-analyses was better than that of Chinese meta-analyses. Cochrane reviews had better methodological quality than non-Cochrane reviews due to better study selection and data extraction, the inclusion of unpublished studies, and better reporting of study characteristics. The authors did not report conflicts of interest in 53.8% meta-analyses, and 19.2% did not report the harmful effects of treatment. Publication bias was not assessed in 38.5% of meta-analyses, and 19.2% did not report the follow-up time. Large-scale assessment of methodological quality of meta-analyses of hyperthyroidism treatment highlighted methodological strengths and weaknesses. Consideration of scientific quality when formulating conclusions should be made explicit. Future meta-analyses should improve on reporting conflict of interest. © Georg Thieme Verlag KG Stuttgart · New York.

A coupled stochastic inverse-management framework for dealing with nonpoint agriculture pollution under groundwater parameter uncertainty

NASA Astrophysics Data System (ADS)

Llopis-Albert, Carlos; Palacios-Marqués, Daniel; Merigó, José M.

2014-04-01

In this paper a methodology for the stochastic management of groundwater quality problems is presented, which can be used to provide agricultural advisory services. A stochastic algorithm to solve the coupled flow and mass transport inverse problem is combined with a stochastic management approach to develop methods for integrating uncertainty; thus obtaining more reliable policies on groundwater nitrate pollution control from agriculture. The stochastic inverse model allows identifying non-Gaussian parameters and reducing uncertainty in heterogeneous aquifers by constraining stochastic simulations to data. The management model determines the spatial and temporal distribution of fertilizer application rates that maximizes net benefits in agriculture constrained by quality requirements in groundwater at various control sites. The quality constraints can be taken, for instance, by those given by water laws such as the EU Water Framework Directive (WFD). Furthermore, the methodology allows providing the trade-off between higher economic returns and reliability in meeting the environmental standards. Therefore, this new technology can help stakeholders in the decision-making process under an uncertainty environment. The methodology has been successfully applied to a 2D synthetic aquifer, where an uncertainty assessment has been carried out by means of Monte Carlo simulation techniques.

[Shoulder disability questionnaires: a systematic review].

PubMed

Fayad, F; Mace, Y; Lefevre-Colau, M M

2005-07-01

To identify all available shoulder disability questionnaires designed to measure physical functioning and to examine those with satisfactory clinimetric quality. We used the Medline database and the "Guide des outils de mesure de l'évaluation en médecine physique et de réadaptation" textbook to search for questionnaires. Analysis took into account the development methodology, clinimetric quality of the instruments and frequency of their utilization. We classified the instruments according to the International Classification of Functioning, Disability and Health. Thirty-eight instruments have been developed to measure disease-, shoulder- or upper extremity-specific outcome. Four scales assess upper-extremity disability and 3 others shoulder disability. We found 6 scales evaluating disability and shoulder pain, 7 scales measuring the quality of life in patients with various conditions of the shoulder, 14 scales combining objective and subjective measures, 2 pain scales and 2 unclassified scales. Older instruments developed before the advent of modern measurement development methodology usually combine objective and subjective measures. Recent instruments were designed with appropriate methodology. Most are self-administered questionnaires. Numerous shoulder outcome measure instruments are available. There is no "gold standard" for assessing shoulder function outcome in the general population.

Dissemination of Periodontal Pathogens in the Bloodstream after Periodontal Procedures: A Systematic Review

PubMed Central

Horliana, Anna Carolina Ratto Tempestini; Chambrone, Leandro; Foz, Adriana Moura; Artese, Hilana Paula Carillo; Rabelo, Mariana de Sousa; Pannuti, Cláudio Mendes; Romito, Giuseppe Alexandre

2014-01-01

Background To date, there is no compilation of evidence-based information associating bacteremia and periodontal procedures. This systematic review aims to assess magnitude, duration, prevalence and nature of bacteremia caused by periodontal procedures. Study Design Systematic Review Types of Studies Reviewed MEDLINE, EMBASE and LILACS databases were searched in duplicate through August, 2013 without language restriction. Observational studies were included if blood samples were collected before, during or after periodontal procedures of patients with periodontitis. The methodological quality was assessed in duplicate using the modified Newcastle-Ottawa scale (NOS). Results Search strategy identified 509 potentially eligible articles and nine were included. Only four studies demonstrated high methodological quality, whereas five were of medium or low methodological quality. The study characteristics were considered too heterogeneous to conduct a meta-analysis. Among 219 analyzed patients, 106 (49.4%) had positive bacteremia. More frequent bacteria were S. viridans, A. actinomycetemcomitans P. gingivalis, M. micros and species Streptococcus and Actinomyces, although identification methods of microbiologic assays were different among studies. Clinical Implications Although half of the patients presented positive bacteremia after periodontal procedures, accurate results regarding the magnitude, duration and nature of bacteremia could not be confidentially assessed. PMID:24870125

Cost-effectiveness analyses of hepatitis A vaccine: a systematic review to explore the effect of methodological quality on the economic attractiveness of vaccination strategies.

PubMed

Anonychuk, Andrea M; Tricco, Andrea C; Bauch, Chris T; Pham, Ba'; Gilca, Vladimir; Duval, Bernard; John-Baptiste, Ava; Woo, Gloria; Krahn, Murray

2008-01-01

Hepatitis A vaccines have been available for more than a decade. Because the burden of hepatitis A virus has fallen in developed countries, the appropriate role of vaccination programmes, especially universal vaccination strategies, remains unclear. Cost-effectiveness analysis is a useful method of relating the costs of vaccination to its benefits, and may inform policy. This article systematically reviews the evidence on the cost effectiveness of hepatitis A vaccination in varying populations, and explores the effects of methodological quality and key modelling issues on the cost-effectiveness ratios.Cost-effectiveness/cost-utility studies of hepatitis A vaccine were identified via a series of literature searches (MEDLINE, EMBASE, HSTAR and SSCI). Citations and full-text articles were reviewed independently by two reviewers. Reference searching, author searches and expert consultation ensured literature saturation. Incremental cost-effectiveness ratios (ICERs) were abstracted for base-case analyses, converted to $US, year 2005 values, and categorised to reflect various levels of cost effectiveness. Quality of reporting, methodological issues and key modelling issues were assessed using frameworks published in the literature.Thirty-one cost-effectiveness studies (including 12 cost-utility analyses) were included from full-text article review (n = 58) and citation screening (n = 570). These studies evaluated universal mass vaccination (n = 14), targeted vaccination (n = 17) and vaccination of susceptibles (i.e. individuals initially screened for antibody and, if susceptible, vaccinated) [n = 13]. For universal vaccination, 50% of the ICERs were <$US20 000 per QALY or life-year gained. Analyses evaluating vaccination in children, particularly in high incidence areas, produced the most attractive ICERs. For targeted vaccination, cost effectiveness was highly dependent on the risk of infection.Incidence, vaccine cost and discount rate were the most influential parameters in sensitivity analyses. Overall, analyses that evaluated the combined hepatitis A/hepatitis B vaccine, adjusted incidence for under-reporting, included societal costs and that came from studies of higher methodological quality tended to have more attractive cost-effectiveness ratios. Methodological quality varied across studies. Major methodological flaws included inappropriate model type, comparator, incidence estimate and inclusion/exclusion of costs.

Surgical interventions for gastric cancer: a review of systematic reviews.

PubMed

He, Weiling; Tu, Jian; Huo, Zijun; Li, Yuhuang; Peng, Jintao; Qiu, Zhenwen; Luo, Dandong; Ke, Zunfu; Chen, Xinlin

2015-01-01

To evaluate methodological quality and the extent of concordance among meta-analysis and/or systematic reviews on surgical interventions for gastric cancer (GC). A comprehensive search of PubMed, Medline, EMBASE, the Cochrane library and the DARE database was conducted to identify the reviews comparing different surgical interventions for GC prior to April 2014. After applying included criteria, available data were summarized and appraised by the Oxman and Guyatt scale. Fifty six reviews were included. Forty five reviews (80.4%) were well conducted, with scores of adapted Oxman and Guyatt scale ≥ 14. The reviews differed in criteria for avoiding bias and assessing the validity of the primary studies. Many primary studies displayed major methodological flaws, such as randomization, allocation concealment, and dropouts and withdrawals. According to the concordance assessment, laparoscopy-assisted gastrectomy (LAG) was superior to open gastrectomy, and laparoscopy-assisted distal gastrectomy was superior to open distal gastrectomy in short-term outcomes. However, the concordance regarding other surgical interventions, such as D1 vs. D2 lymphadenectomy, and robotic gastrectomy vs. LAG were absent. Systematic reviews on surgical interventions for GC displayed relatively high methodological quality. The improvement of methodological quality and reporting was necessary for primary studies. The superiority of laparoscopic over open surgery was demonstrated. But concordance on other surgical interventions was rare, which needed more well-designed RCTs and systematic reviews.

The biomechanical differences between barefoot and shod distance running: a systematic review and preliminary meta-analysis.

PubMed

Hall, Jonathan P L; Barton, Christian; Jones, Paul Remy; Morrissey, Dylan

2013-12-01

Distance running continues to experience increased participation in the Western world, although it is associated with high injury rates. Barefoot running has been increasingly proposed as a means to prevent overuse injury due to various biomechanical differences, including reduced joint loading rates and altered kinematics and muscle activity patterns compared to shod running. The aim of this review was to systematically evaluate biomechanical differences between running barefoot and shod, including the quality of available evidence, in order to provide guidance on the phenomenon of barefoot running to the running and sports medicine communities. A comprehensive search of MEDLINE, Web of Knowledge and EMBASE from inception to January 2013 was performed. Trials evaluating injury-free recreational or competitive adults who participate in long-distance running (≥5 km), where a comparison of barefoot and shod running lower-limb kinetics, kinematics and/or electromyography were included. Studies examining sprinting and studies of single-subject design were excluded. Following initial searching, two reviewers identified a shortlist of relevant studies based on title and abstract, with the full text of these studies being tested against the inclusion criteria. References of included studies were examined and citation tracking was performed in Web of Knowledge. Two independent reviewers evaluated the methodological quality of each included study using a modified version of the Downs and Black quality index. Results of the quality assessment were used to identify high- and low-quality studies, data pooling was completed where possible and levels of evidence were determined based on the van Tulder criteria. Eighteen studies were identified, all of low methodological quality. Effect size (ES) calculation was possible for 12 studies. Pooled results indicate moderate evidence that barefoot running is associated with reduced peak ground reaction force (GRF), increased foot and ankle plantarflexion and increased knee flexion at ground contact compared with running in a neutral shoe. Limited evidence indicates barefoot running is associated with reduced impact GRF, reduced peak knee flexion and varus joint moments, and a higher stride frequency compared to a neutral shoe. Very limited to limited evidence also indicates power absorption at the knee is decreased while being increased at the ankle whilst barefoot running. Additionally, the effects of barefoot running on loading rate appear dependent on strike pattern adopted, with a forefoot strike pattern found to reduce loading rate, whilst a rearfoot strike pattern increases loading rate when running barefoot compared to shod. Key methodological weaknesses that must be addressed in future research were identified. Of particular note were absence of investigator blinding, infrequent intervention randomisation, small sample sizes and lack of evaluation following habituation. Two studies could not be retrieved because of publication in a non-English-language journal. Of particular note is that the validity of the body of work is compromised by the lack of evaluation after habituation, or re-training, of previously shod rearfoot-striking runners to barefoot forefoot-striking running styles. There has been a great deal of publicity for barefoot running, and many claims made about its effects and risks. Despite a large amount of biomechanical data available for meta-analysis, clear guidance for clinical practice is limited because of the low methodological quality of the associated studies. Preliminary biomechanical differences identified suggest barefoot running may be associated with positive biomechanical changes in regards to injury prevention, although this may be dependent on strike pattern adopted. Further research employing more robust methodology, which addresses weaknesses highlighted in this review, is needed to confirm current preliminary evidence. Additionally, prospective research would have higher validity were the biomechanical effects of habituating to barefoot running fully examined alongside an evaluation of prevention of repetitive use injury.

Psychosocial Interventions for Women with HIV/AIDS: A Critical Review

ERIC Educational Resources Information Center

Hernandez, Julieta P.; Macgowan, Mark J.

2015-01-01

Objective: Recent research on psychosocial interventions addressing the well-being of women with HIV/AIDS has brought new options for practitioners. This study critically reviews the treatment features, methodological quality, and efficacy of these interventions. Methods: A comprehensive search between 2000 and 2011 identified 19 studies employing…

Leadership Practices in German and UK Organisations

ERIC Educational Resources Information Center

McCarthy, Grace

2005-01-01

Purpose: The aim of this research was to determine whether leadership practices vary between German and UK organisations. Design/methodology/approach: The author used self-assessment documents submitted by German and UK organisations to the European Foundation for Quality Management (EFQM), to identify leadership practices in both countries. A…

Youth Expectations about Therapeutic Alliance in a Residential Setting

ERIC Educational Resources Information Center

Manso, Ana; Rauktis, Mary Elizabeth; Boyd, A. Suzanne

2008-01-01

This exploratory study used qualitative methods to better understand how youths in a residential setting perceive their relationships with the counselors. Using focus group methodology, the study focused on how youth describe the relationship, what staff qualities the youth are able to identify as important in engaging and maintaining the…

A novel methodology for interpreting air quality measurements from urban streets using CFD modelling

NASA Astrophysics Data System (ADS)

Solazzo, Efisio; Vardoulakis, Sotiris; Cai, Xiaoming

2011-09-01

In this study, a novel computational fluid dynamics (CFD) based methodology has been developed to interpret long-term averaged measurements of pollutant concentrations collected at roadside locations. The methodology is applied to the analysis of pollutant dispersion in Stratford Road (SR), a busy street canyon in Birmingham (UK), where a one-year sampling campaign was carried out between August 2005 and July 2006. Firstly, a number of dispersion scenarios are defined by combining sets of synoptic wind velocity and direction. Assuming neutral atmospheric stability, CFD simulations are conducted for all the scenarios, by applying the standard k-ɛ turbulence model, with the aim of creating a database of normalised pollutant concentrations at specific locations within the street. Modelled concentration for all wind scenarios were compared with hourly observed NO x data. In order to compare with long-term averaged measurements, a weighted average of the CFD-calculated concentration fields was derived, with the weighting coefficients being proportional to the frequency of each scenario observed during the examined period (either monthly or annually). In summary the methodology consists of (i) identifying the main dispersion scenarios for the street based on wind speed and directions data, (ii) creating a database of CFD-calculated concentration fields for the identified dispersion scenarios, and (iii) combining the CFD results based on the frequency of occurrence of each dispersion scenario during the examined period. The methodology has been applied to calculate monthly and annually averaged benzene concentration at several locations within the street canyon so that a direct comparison with observations could be made. The results of this study indicate that, within the simplifying assumption of non-buoyant flow, CFD modelling can aid understanding of long-term air quality measurements, and help assessing the representativeness of monitoring locations for population exposure studies.

The Impact of Trained Volunteer Mealtime Assistants on Dietary Intake and Satisfaction with Mealtime Care in Adult Hospital Inpatients: A Systematic Review.

PubMed

Howson, F F A; Sayer, A A; Roberts, H C

2017-01-01

Malnutrition is common in hospital inpatients and is associated with increased morbidity and mortality. Insufficient assistance at mealtimes can contribute to this and therefore trained volunteer mealtime assistants may be of benefit. To identify and review the current evidence for the impact of trained volunteer mealtime assistants on dietary intake and satisfaction with mealtime care in adult hospital inpatients. A systematic search of Medline, Embase and CINAHL was conducted to identify relevant articles. Articles of any methodology were considered. Quality assessment and data extraction were carried out by two reviewers independently. Participants were inpatients in a hospital setting, including rehabilitation units. Participants in long term care facilities were excluded. Articles that examined the effect of trained volunteer mealtime assistants on nutritional outcomes or satisfaction with mealtime care were included. 5576 articles were identified, of which 14 were included in the review. Nine were small research studies and five were quality improvement initiatives. The quality of eight studies was moderate, with one study being of lower quality. Eight articles reported dietary intake and seven demonstrated an improvement, with protein intakes at volunteer mealtimes increasing by 4.3g-10.1g and energy intakes by 44-105kcal. Ten articles reported positive staff, patient and volunteer feedback. No adverse events were reported. There is evidence from small studies and improvement projects that trained volunteer mealtime assistants are safe and improve satisfaction with mealtime care in hospital inpatients, although evidence for an effect on dietary intake was less consistent. Larger studies with robust methodology are required to confirm this.

Efficacy of Chinese herbal medicine on health-related quality of life (SF-36) in hypertensive patients: A systematic review and meta-analysis of randomized controlled trials.

PubMed

Jiao, Hua-Chen; Ju, Jian-Qing; Li, Yun-Lun; Ma, Xue-Sheng; Jiang, Hai-Qiang; Zhao, Jing; Shen, Zhen-Zhen; Yang, Wen-Qing

2015-06-01

This study aims to evaluate published randomized controlled trials (RCTs) of Chinese Herbal Medicine (CHM) improving health-related quality of life (HRQL) in hypertensive patients that employ the Short-Form 36-Item Health questionnaire (SF-36) as an outcome measure. Five electronic databases were searched up to October 2013 to identify RCTs of CHM for hypertension. The primary outcome was SF-36. Trial selection, data extraction, methodological quality assessment, and data analyses were conducted according to the Cochrane handbook. Eleven RCTs with total of 1043 participants were identified. The majority of the included trials were assessed to be of poor methodological quality and high clinical heterogeneity. Meta-analysis shows a significant improvement both in physical component summary (PCS) measure and mental component summary (MCS) measure of SF-36, with physical functioning (WMD=8.54[5.34, 11.74], p<0.001), role physical (WMD=13.32[7.03, 19.61], p<0.001), bodily pain (WMD=10.53[6.46, 14.60], p<0.001), general health (WMD=-5.56[2.09, 9.02], p<0.001), vitality (WMD=6.84[4.33, 9.53], p<0.001), social functioning (WMD=7.50[2.63, 12.36], p<0.001), role emotional (WMD=12.06[4.45, 19.68], p<0.001) and mental health (WMD=-5.68[2.90, 8.47], p<0.001). CHM can also decrease systolic blood pressure (WMD=-4.45 [-6.71, -2.19], p<0.001) and relieve symptoms related to hypertension. CHM appears to have beneficial effects on improvement of HRQL in hypertensive patients. However, the findings should be interpreted with caution due to the poor methodological quality and high clinical heterogeneity of the included trials. Further clinical trials should be carried out to provide more reliable evidence. Copyright © 2015 Elsevier Ltd. All rights reserved.

Fault region localization (FRL): collaborative product and process improvement based on field performance

NASA Astrophysics Data System (ADS)

Mannar, Kamal; Ceglarek, Darek

2005-11-01

Customer feedback in the form of warranty/field performance is an important and direct indicator of quality and robustness of a product. Linking warranty information to manufacturing measurements can identify key design parameters and process variables (DPs and PVs) that are related to warranty failures. Warranty data has been traditionally used in reliability studies to determine failure distributions and warranty cost. This paper proposes a novel Fault Region Localization (FRL) methodology to map warranty failures to manufacturing measurements (hence to DPs/PVs) to diagnose warranty failures and perform tolerance revaluation. The FRL methodology consists of two parts: 1. Identifying relations between warranty failures and DPs and PVs using the Generalized Rough Set (GRS) method. GRS is a supervised learning technique to identify specific DPs and PVs related to the given warranty failures and then determining the corresponding Warranty Fault Regions (WFR), Normal Region (NR) and Boundary region (BND). GRS expands traditional Rough Set method by allowing inclusion of noise and uncertainty of warranty data classes. 2. Revaluating the original tolerances of DPs/PVs based on the WFR and BND region identified. The FRL methodology is illustrated using case studies based on two warranty failures from the electronics industry.

Reliability of specific physical examination tests for the diagnosis of shoulder pathologies: a systematic review and meta-analysis.

PubMed

Lange, Toni; Matthijs, Omer; Jain, Nitin B; Schmitt, Jochen; Lützner, Jörg; Kopkow, Christian

2017-03-01

Shoulder pain in the general population is common and to identify the aetiology of shoulder pain, history, motion and muscle testing, and physical examination tests are usually performed. The aim of this systematic review was to summarise and evaluate intrarater and inter-rater reliability of physical examination tests in the diagnosis of shoulder pathologies. A comprehensive systematic literature search was conducted using MEDLINE, EMBASE, Allied and Complementary Medicine Database (AMED) and Physiotherapy Evidence Database (PEDro) through 20 March 2015. Methodological quality was assessed using the Quality Appraisal of Reliability Studies (QAREL) tool by 2 independent reviewers. The search strategy revealed 3259 articles, of which 18 finally met the inclusion criteria. These studies evaluated the reliability of 62 test and test variations used for the specific physical examination tests for the diagnosis of shoulder pathologies. Methodological quality ranged from 2 to 7 positive criteria of the 11 items of the QAREL tool. This review identified a lack of high-quality studies evaluating inter-rater as well as intrarater reliability of specific physical examination tests for the diagnosis of shoulder pathologies. In addition, reliability measures differed between included studies hindering proper cross-study comparisons. PROSPERO CRD42014009018. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Improvement of laboratory turnaround time using lean methodology.

PubMed

Gupta, Shradha; Kapil, Sahil; Sharma, Monica

2018-05-14

Purpose The purpose of this paper is to discuss the implementation of lean methodology to reduce the turnaround time (TAT) of a clinical laboratory in a super speciality hospital. Delays in report delivery lead to delayed diagnosis increased waiting time and decreased customer satisfaction. The reduction in TAT will lead to increased patient satisfaction, quality of care, employee satisfaction and ultimately the hospital's revenue. Design/methodology/approach The generic causes resulting in increasing TAT of clinical laboratories were identified using lean tools and techniques such as value stream mapping (VSM), Gemba, Pareto Analysis and Root Cause Analysis. VSM was used as a tool to analyze the current state of the process and further VSM was used to design the future state with suggestions for process improvements. Findings This study identified 12 major non-value added factors for the hematology laboratory and 5 major non-value added factors for the biochemistry lab which were acting as bottlenecks resulting in limiting throughput. A four-month research study by the authors together with hospital quality department and laboratory staff members led to reduction of the average TAT from 180 to 95minutes in the hematology lab and from 268 to 208 minutes in the biochemistry lab. Practical implications Very few improvement initiatives in Indian healthcare are based on industrial engineering tools and techniques, which might be due to a lack of interaction between healthcare and engineering. The study provides a positive outcome in terms of improving the efficiency of services in hospitals and identifies a scope for lean in the Indian healthcare sector. Social implications Applying lean in the Indian healthcare sector gives its own potential solution to the problem caused, due to a wide gap between lean accessibility and lean implementation. Lean helped in changing the mindset of an organization toward providing the highest quality of services with faster delivery at an optimal cost. Originality/value This paper is an effort to reduce the gap between healthcare and industrial engineering and enhancing the use of lean practices in Indian healthcare. The study is motivated toward implementing lean methodology successfully in services.

Exploring end of life priorities in Saudi males: usefulness of Q-methodology.

PubMed

Hammami, Muhammad M; Al Gaai, Eman; Hammami, Safa; Attala, Sahar

2015-11-26

Quality end-of-life care depends on understanding patients' end-of-life choices. Individuals and cultures may hold end-of-life priorities at different hierarchy. Forced ranking rather than independent rating, and by-person factor analysis rather than averaging may reveal otherwise masked typologies. We explored Saudi males' forced-ranked, end-of-life priorities and dis-priorities. Respondents (n = 120) rank-ordered 47 opinion statements on end-of-life care following a 9-category symmetrical distribution. Statements' scores were analyzed by averaging analysis and factor analysis (Q-methodology). Respondents' mean age was 32.1 years (range, 18-65); 52% reported average religiosity, 88 and 83% ≥ very good health and life-quality, respectively, and 100% ≥ high school education. Averaging analysis revealed that the extreme five end-of-life priorities were to, be at peace with God, be able to say the statement of faith, maintain dignity, resolve conflicts, and have religious death rituals respected, respectively. The extreme five dis-priorities were to, die in the hospital, not receive intensive care if in coma, die at peak of life, be informed about impending death by family/friends rather than doctor, and keep medical status confidential from family/friends, respectively. Q-methodology classified 67% of respondents into five highly transcendent opinion types. Type-I (rituals-averse, family-caring, monitoring-coping, life-quality-concerned) and Type-V (rituals-apt, family-centered, neutral-coping, life-quantity-concerned) reported the lowest and highest religiosity, respectively. Type-II (rituals-apt, family-dependent, monitoring-coping, life-quantity-concerned) and Type-III (rituals-silent, self/family-neutral, avoidance-coping, life-quality & quantity-concerned) reported the best and worst life-quality, respectively. Type-I respondents were the oldest with the lowest general health, in contrast to Type-IV (rituals-apt, self-centered, monitoring-coping, life-quality/quantity-neutral). Of the extreme 14 priorities/dis-priorities for the five types, 29, 14, 14, 50, and 36%, respectively, were not among the extreme 20 priorities/dis-priorities identified by averaging analysis for the entire cohort. 1) Transcendence was the extreme end-of-life priority, and dying in the hospital was the extreme dis-priority. 2) Quality of life was conceptualized differently with less emphasize on its physiological aspects. 3) Disclosure of terminal illness to family/close friends was preferred as long it is through the patient. 4) Q-methodology identified five types of constellations of end-of-life priorities and dis-priorities that may be related to respondents' demographics and are partially masked by averaging analysis.

Are validated outcome measures used in distal radial fractures truly valid?

PubMed Central

Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

2016-01-01

Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the validity on hypothesis testing are good. There is no evidence for the other measurement properties. Conclusion According to this systematic review, there is, at best, moderate evidence that the responsiveness of the PRWE and DASH are good, as are the reliability and validity of the PRWE. We recommend these PROMs in clinical studies in patients with distal radial fractures; however, more clinimetric studies of higher methodological quality are needed to adequately determine the other measurement properties. Cite this article: Dr Y. V. Kleinlugtenbelt. Are validated outcome measures used in distal radial fractures truly valid?: A critical assessment using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Bone Joint Res 2016;5:153–161. DOI: 10.1302/2046-3758.54.2000462. PMID:27132246

A systematic review of model-based economic evaluations of diagnostic and therapeutic strategies for lower extremity artery disease.

PubMed

Vaidya, Anil; Joore, Manuela A; ten Cate-Hoek, Arina J; Kleinegris, Marie-Claire; ten Cate, Hugo; Severens, Johan L

2014-01-01

Lower extremity artery disease (LEAD) is a sign of wide spread atherosclerosis also affecting coronary, cerebral and renal arteries and is associated with increased risk of cardiovascular events. Many economic evaluations have been published for LEAD due to its clinical, social and economic importance. The aim of this systematic review was to assess modelling methods used in published economic evaluations in the field of LEAD. Our review appraised and compared the general characteristics, model structure and methodological quality of published models. Electronic databases MEDLINE and EMBASE were searched until February 2013 via OVID interface. Cochrane database of systematic reviews, Health Technology Assessment database hosted by National Institute for Health research and National Health Services Economic Evaluation Database (NHSEED) were also searched. The methodological quality of the included studies was assessed by using the Philips' checklist. Sixteen model-based economic evaluations were identified and included. Eleven models compared therapeutic health technologies; three models compared diagnostic tests and two models compared a combination of diagnostic and therapeutic options for LEAD. Results of this systematic review revealed an acceptable to low methodological quality of the included studies. Methodological diversity and insufficient information posed a challenge for valid comparison of the included studies. In conclusion, there is a need for transparent, methodologically comparable and scientifically credible model-based economic evaluations in the field of LEAD. Future modelling studies should include clinically and economically important cardiovascular outcomes to reflect the wider impact of LEAD on individual patients and on the society.

Measuring attitudes towards the dying process: A systematic review of tools.

PubMed

Groebe, Bernadette; Strupp, Julia; Eisenmann, Yvonne; Schmidt, Holger; Schlomann, Anna; Rietz, Christian; Voltz, Raymond

2018-04-01

At the end of life, anxious attitudes concerning the dying process are common in patients in Palliative Care. Measurement tools can identify vulnerabilities, resources and the need for subsequent treatment to relieve suffering and support well-being. To systematically review available tools measuring attitudes towards dying, their operationalization, the method of measurement and the methodological quality including generalizability to different contexts. Systematic review according to the PRISMA Statement. Methodological quality of tools assessed by standardized review criteria. MEDLINE, PsycINFO, PsyndexTests and the Health and Psychosocial Instruments were searched from their inception to April 2017. A total of 94 identified studies reported the development and/or validation of 44 tools. Of these, 37 were questionnaires and 7 alternative measurement methods (e.g. projective measures). In 34 of 37 questionnaires, the emotional evaluation (e.g. anxiety) towards dying is measured. Dying is operationalized in general items ( n = 20), in several specific aspects of dying ( n = 34) and as dying of others ( n = 14). Methodological quality of tools was reported inconsistently. Nine tools reported good internal consistency. Of 37 tools, 4 were validated in a clinical sample (e.g. terminal cancer; Huntington disease), indicating questionable generalizability to clinical contexts for most tools. Many tools exist to measure attitudes towards the dying process using different endpoints. This overview can serve as decision framework on which tool to apply in which contexts. For clinical application, only few tools were available. Further validation of existing tools and potential alternative methods in various populations is needed.

Cross-cultural adaptation and measurement properties of generic and cancer-related patient-reported outcome measures (PROMs) for use with cancer patients in Brazil: a systematic review.

PubMed

Albach, Carlos Augusto; Wagland, Richard; Hunt, Katherine J

2018-04-01

This systematic review (1) identifies the current generic and cancer-related patient-reported outcome measures (PROMs) that have been cross-culturally adapted to Brazilian Portuguese and applied to cancer patients and (2) critically evaluates their cross-cultural adaptation (CCA) and measurement properties. Seven databases were searched for articles regarding the translation and evaluation of measurement properties of generic and cancer-related PROMs cross-culturally adapted to Brazilian Portuguese that are applied in adult (≥18 years old) cancer patients. The methodological quality of included studies was assessed using the COSMIN checklist. The bibliographic search retrieved 1674 hits, of which seven studies analysing eight instruments were included in this review. Data on the interpretability of scores were poorly reported. Overall, the quality of the CCA process was inconsistent throughout the studies. None of the included studies performed a cross-cultural validation. The evidence concerning the quality of measurement properties is limited by poor or fair methodological quality. Moreover, limited information regarding measurement properties was provided within the included papers. This review aids the selection process of Brazilian Portuguese PROMs for use in cancer patients. After acknowledging the methodological caveats and strengths of each tool, our opinion is that for quality of life and symptoms assessment the adapted FACT-G version and the ESAS could be recommended, respectively. Future research should rely on the already accepted standards of CCA and validation studies.

Inflammatory bowel disease-specific health-related quality of life instruments: a systematic review of measurement properties.

PubMed

Chen, Xin-Lin; Zhong, Liang-Huan; Wen, Yi; Liu, Tian-Wen; Li, Xiao-Ying; Hou, Zheng-Kun; Hu, Yue; Mo, Chuan-Wei; Liu, Feng-Bin

2017-09-15

This review aims to critically appraise and compare the measurement properties of inflammatory bowel disease (IBD)-specific health-related quality of life instruments. Medline, EMBASE and ISI Web of Knowledge were searched from their inception to May 2016. IBD-specific instruments for patients with Crohn's disease, ulcerative colitis or IBD were enrolled. The basic characteristics and domains of the instruments were collected. The methodological quality of measurement properties and measurement properties of the instruments were assessed. Fifteen IBD-specific instruments were included, which included twelve instruments for adult IBD patients and three for paediatric IBD patients. All of the instruments were developed in North American and European countries. The following common domains were identified: IBD-related symptoms, physical, emotional and social domain. The methodological quality was satisfactory for content validity; fair in internal consistency, reliability, structural validity, hypotheses testing and criterion validity; and poor in measurement error, cross-cultural validity and responsiveness. For adult IBD patients, the IBDQ-32 and its short version (SIBDQ) had good measurement properties and were the most widely used worldwide. For paediatric IBD patients, the IMPACT-III had good measurement properties and had more translated versions. Most methodological quality should be promoted, especially measurement error, cross-cultural validity and responsiveness. The IBDQ-32 was the most widely used instrument with good reliability and validity, followed by the SIBDQ and IMPACT-III. Further validation studies are necessary to support the use of other instruments.

Mobile and Web 2.0 interventions for weight management: an overview of review evidence and its methodological quality

PubMed Central

Smith, Jane R.; Samaha, Laya; Abraham, Charles

2016-01-01

Abstract Background : The use of Internet and related technologies for promoting weight management (WM), physical activity (PA), or dietary-related behaviours has been examined in many articles and systematic reviews. This overview aims to summarize and assess the quality of the review evidence specifically focusing on mobile and Web 2.0 technologies, which are the most utilized, currently available technologies. Methods: Following a registered protocol (CRD42014010323), we searched 16 databases for articles published in English until 31 December 2014 discussing the use of either mobile or Web 2.0 technologies to promote WM or related behaviors, i.e. diet and physical activity (PA). Two reviewers independently selected reviews and assessed their methodological quality using the AMSTAR checklist. Citation matrices were used to determine the overlap among reviews. Results: Forty-four eligible reviews were identified, 39 of which evaluated the effects of interventions using mobile or Web 2.0 technologies. Methodological quality was generally low with only 7 reviews (16%) meeting the highest standards. Suggestive evidence exists for positive effects of mobile technologies on weight-related outcomes and, to a lesser extent, PA. Evidence is inconclusive regarding Web 2.0 technologies. Conclusions : Reviews on mobile and Web 2.0 interventions for WM and related behaviors suggest that these technologies can, under certain circumstances, be effective, but conclusions are limited by poor review quality based on a heterogeneous evidence base. PMID:27335330

Evaluating the statistical methodology of randomized trials on dentin hypersensitivity management.

PubMed

Matranga, Domenica; Matera, Federico; Pizzo, Giuseppe

2017-12-27

The present study aimed to evaluate the characteristics and quality of statistical methodology used in clinical studies on dentin hypersensitivity management. An electronic search was performed for data published from 2009 to 2014 by using PubMed, Ovid/MEDLINE, and Cochrane Library databases. The primary search terms were used in combination. Eligibility criteria included randomized clinical trials that evaluated the efficacy of desensitizing agents in terms of reducing dentin hypersensitivity. A total of 40 studies were considered eligible for assessment of quality statistical methodology. The four main concerns identified were i) use of nonparametric tests in the presence of large samples, coupled with lack of information about normality and equality of variances of the response; ii) lack of P-value adjustment for multiple comparisons; iii) failure to account for interactions between treatment and follow-up time; and iv) no information about the number of teeth examined per patient and the consequent lack of cluster-specific approach in data analysis. Owing to these concerns, statistical methodology was judged as inappropriate in 77.1% of the 35 studies that used parametric methods. Additional studies with appropriate statistical analysis are required to obtain appropriate assessment of the efficacy of desensitizing agents.

Diagnostic accuracy of different caries risk assessment methods. A systematic review.

PubMed

Senneby, Anna; Mejàre, Ingegerd; Sahlin, Nils-Eric; Svensäter, Gunnel; Rohlin, Madeleine

2015-12-01

To evaluate the accuracy of different methods used to identify individuals with increased risk of developing dental coronal caries. Studies on following methods were included: previous caries experience, tests using microbiota, buffering capacity, salivary flow rate, oral hygiene, dietary habits and sociodemographic variables. QUADAS-2 was used to assess risk of bias. Sensitivity, specificity, predictive values, and likelihood ratios (LR) were calculated. Quality of evidence based on ≥3 studies of a method was rated according to GRADE. PubMed, Cochrane Library, Web of Science and reference lists of included publications were searched up to January 2015. From 5776 identified articles, 18 were included. Assessment of study quality identified methodological limitations concerning study design, test technology and reporting. No study presented low risk of bias in all domains. Three or more studies were found only for previous caries experience and salivary mutans streptococci and quality of evidence for these methods was low. Evidence regarding other methods was lacking. For previous caries experience, sensitivity ranged between 0.21 and 0.94 and specificity between 0.20 and 1. Tests using salivary mutans streptococci resulted in low sensitivity and high specificity. For children with primary teeth at baseline, pooled LR for a positive test was 3 for previous caries experience and 4 for salivary mutans streptococci, given a threshold ≥10(5) CFU/ml. Evidence on the validity of analysed methods used for caries risk assessment is limited. As methodological quality was low, there is a need to improve study design. Low validity for the analysed methods may lead to patients with increased risk not being identified, whereas some are falsely identified as being at risk. As caries risk assessment guides individualized decisions on interventions and intervals for patient recall, improved performance based on best evidence is greatly needed. Copyright © 2015 Elsevier Ltd. All rights reserved.

The need for a comprehensive expert system development methodology

NASA Technical Reports Server (NTRS)

Baumert, John; Critchfield, Anna; Leavitt, Karen

1988-01-01

In a traditional software development environment, the introduction of standardized approaches has led to higher quality, maintainable products on the technical side and greater visibility into the status of the effort on the management side. This study examined expert system development to determine whether it differed enough from traditional systems to warrant a reevaluation of current software development methodologies. Its purpose was to identify areas of similarity with traditional software development and areas requiring tailoring to the unique needs of expert systems. A second purpose was to determine whether existing expert system development methodologies meet the needs of expert system development, management, and maintenance personnel. The study consisted of a literature search and personal interviews. It was determined that existing methodologies and approaches to developing expert systems are not comprehensive nor are they easily applied, especially to cradle to grave system development. As a result, requirements were derived for an expert system development methodology and an initial annotated outline derived for such a methodology.

Assessing the Economics of Dengue: Results from a Systematic Review of the Literature and Expert Survey.

PubMed

Constenla, Dagna; Garcia, Cristina; Lefcourt, Noah

2015-11-01

The economics of dengue is complex and multifaceted. We performed a systematic review of the literature to provide a critical overview of the issues related to dengue economics research and to form a background with which to address the question of cost. Three literature databases were searched [PubMed, Embase and Latin American and Caribbean Health Sciences Literature (LILACS)], covering a period from 1980 to 2013, to identify papers meeting preset inclusion criteria. Studies were reviewed for methodological quality on the basis of a quality checklist developed for this purpose. An expert survey was designed to identify priority areas in dengue economics research and to identify gaps between the methodology and actual practice. Survey responses were combined with the literature review findings to determine stakeholder priorities in dengue economics research. The review identified over 700 papers. Forty-two of these papers met the selection criteria. The studies that were reviewed presented results from 32 dengue-endemic countries, underscoring the importance of dengue as a global public health problem. Cost analyses were the most common, with 21 papers, followed by nine cost-effectiveness analyses and seven cost-of-illness studies, indicating a relatively strong mix of methodologies. Dengue annual overall costs (in 2010 values) ranged from US$13.5 million (in Nicaragua) to $56 million (in Malaysia), showing cost variations across countries. Little consistency exists in the way costs were estimated and dengue interventions evaluated, making generalizations around costs difficult. The current evidence suggests that dengue costs are substantial because of the cost of hospital care and lost earnings. Further research in this area will broaden our understanding of the true economic impact of dengue.

Relationships between abstract features and methodological quality explained variations of social media activity derived from systematic reviews about psoriasis interventions.

PubMed

Ruano, J; Aguilar-Luque, M; Isla-Tejera, B; Alcalde-Mellado, P; Gay-Mimbrera, J; Hernandez-Romero, José Luis; Sanz-Cabanillas, J L; Maestre-López, B; González-Padilla, M; Carmona-Fernández, P J; Gómez-García, F; García-Nieto, A Vélez

2018-05-24

The aim of this study was to describe the relationship among abstract structure, readability, and completeness, and how these features may influence social media activity and bibliometric results, considering systematic reviews (SRs) about interventions in psoriasis classified by methodological quality. Systematic literature searches about psoriasis interventions were undertaken on relevant databases. For each review, methodological quality was evaluated using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool. Abstract extension, structure, readability, and quality and completeness of reporting were analyzed. Social media activity, which consider Twitter and Facebook mention counts, as well as Mendeley readers and Google scholar citations were obtained for each article. Analyses were conducted to describe any potential influence of abstract characteristics on review's social media diffusion. We classified 139 intervention SRs as displaying high/moderate/low methodological quality. We observed that abstract readability of SRs has been maintained high for last 20 years, although there are some differences based on their methodological quality. Free-format abstracts were most sensitive to the increase of text readability as compared with more structured abstracts (IMRAD or 8-headings), yielding opposite effects on their quality and completeness depending on the methodological quality: a worsening in low quality reviews and an improvement in those of high-quality. Both readability indices and PRISMA for Abstract total scores showed an inverse relationship with social media activity and bibliometric results in high methodological quality reviews but not in those of lower quality. Our results suggest that increasing abstract readability must be specially considered when writing free-format summaries of high-quality reviews, because this fact correlates with an improvement of their completeness and quality, and this may help to achieve broader social media visibility and article usage. Copyright © 2018 Elsevier Inc. All rights reserved.

Background qualitative analysis of the European Reference Life Cycle Database (ELCD) energy datasets - part I: fuel datasets.

PubMed

Garraín, Daniel; Fazio, Simone; de la Rúa, Cristina; Recchioni, Marco; Lechón, Yolanda; Mathieux, Fabrice

2015-01-01

The aim of this study is to identify areas of potential improvement of the European Reference Life Cycle Database (ELCD) fuel datasets. The revision is based on the data quality indicators described by the ILCD Handbook, applied on sectorial basis. These indicators evaluate the technological, geographical and time-related representativeness of the dataset and the appropriateness in terms of completeness, precision and methodology. Results show that ELCD fuel datasets have a very good quality in general terms, nevertheless some findings and recommendations in order to improve the quality of Life-Cycle Inventories have been derived. Moreover, these results ensure the quality of the fuel-related datasets to any LCA practitioner, and provide insights related to the limitations and assumptions underlying in the datasets modelling. Giving this information, the LCA practitioner will be able to decide whether the use of the ELCD fuel datasets is appropriate based on the goal and scope of the analysis to be conducted. The methodological approach would be also useful for dataset developers and reviewers, in order to improve the overall DQR of databases.

Balancing benefit and risk of medicines: a systematic review and classification of available methodologies.

PubMed

Mt-Isa, Shahrul; Hallgreen, Christine E; Wang, Nan; Callréus, Torbjörn; Genov, Georgy; Hirsch, Ian; Hobbiger, Stephen F; Hockley, Kimberley S; Luciani, Davide; Phillips, Lawrence D; Quartey, George; Sarac, Sinan B; Stoeckert, Isabelle; Tzoulaki, Ioanna; Micaleff, Alain; Ashby, Deborah

2014-07-01

The need for formal and structured approaches for benefit-risk assessment of medicines is increasing, as is the complexity of the scientific questions addressed before making decisions on the benefit-risk balance of medicines. We systematically collected, appraised and classified available benefit-risk methodologies to facilitate and inform their future use. A systematic review of publications identified benefit-risk assessment methodologies. Methodologies were appraised on their fundamental principles, features, graphical representations, assessability and accessibility. We created a taxonomy of methodologies to facilitate understanding and choice. We identified 49 methodologies, critically appraised and classified them into four categories: frameworks, metrics, estimation techniques and utility survey techniques. Eight frameworks describe qualitative steps in benefit-risk assessment and eight quantify benefit-risk balance. Nine metric indices include threshold indices to measure either benefit or risk; health indices measure quality-of-life over time; and trade-off indices integrate benefits and risks. Six estimation techniques support benefit-risk modelling and evidence synthesis. Four utility survey techniques elicit robust value preferences from relevant stakeholders to the benefit-risk decisions. Methodologies to help benefit-risk assessments of medicines are diverse and each is associated with different limitations and strengths. There is not a 'one-size-fits-all' method, and a combination of methods may be needed for each benefit-risk assessment. The taxonomy introduced herein may guide choice of adequate methodologies. Finally, we recommend 13 of 49 methodologies for further appraisal for use in the real-life benefit-risk assessment of medicines. Copyright © 2014 John Wiley & Sons, Ltd.

Lean interventions in healthcare: do they actually work? A systematic literature review.

PubMed

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-04-01

Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data on design, methods, interventions and key outcomes were extracted and collated. Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

The effectiveness of hydrotherapy in the management of rheumatoid arthritis: a systematic review.

PubMed

Al-Qubaeissy, Khamis Y; Fatoye, Francis A; Goodwin, Peter C; Yohannes, Abebaw M

2013-03-01

Hydrotherapy is frequently indicated for the rehabilitation of patients with rheumatoid arthritis (RA); nevertheless, there has been inadequate appraisal of its effectiveness. The potential benefits of hydrotherapy for patients with RA are to improve and/or maintain functional ability and quality of life. The aim of this systematic review was to evaluate the effectiveness of hydrotherapy in the management of patients with RA. AMED, CINAHL, EMBASE, MEDLINE, PubMed, Science Direct and Web of Science were searched between 1988 and May 2011. Keywords used were rheumatoid arthritis, hydrotherapy, aquatic physiotherapy, aqua therapy and water therapy. Searches were supplemented with hand searches of references of selected articles. Randomized controlled trials were assessed for their methodological quality using the Physiotherapy Evidence Database (PEDro) scale. This scale ranks the methodological quality of a study scoring 7 out of 10 as 'high quality', 5-6 as 'moderate quality' and less than 4 as 'poor quality'. Initially, 197 studies were identified. Six studies met the inclusion criteria for further analysis. The average methodological quality for all studies was 6.8 using the PEDro scale. Most of the studies reported favourable outcomes for a hydrotherapy intervention compared with no treatment or other interventions for patients with RA. Improvement was particularly noted in reducing pain, joint tenderness, mood and tension symptoms, and increasing grip strength and patient satisfaction with hydrotherapy treatment in the short term. There is some evidence to suggest that hydrotherapy has a positive role in reducing pain and improving the health status of patients with RA compared with no or other interventions in the short term. However, the long-term benefit is unknown. Further studies are needed. Copyright © 2012 John Wiley & Sons, Ltd.

Methodological quality of randomized trials published in the Journal of the American Podiatric Medical Association, 1999-2013.

PubMed

Landorf, Karl B; Menz, Hylton B; Armstrong, David G; Herbert, Robert D

2015-07-01

Randomized trials must be of high methodological quality to yield credible, actionable findings. The main aim of this project was to evaluate whether there has been an improvement in the methodological quality of randomized trials published in the Journal of the American Podiatric Medical Association (JAPMA). Randomized trials published in JAPMA during a 15-year period (January 1999 to December 2013) were evaluated. The methodological quality of randomized trials was evaluated using the PEDro scale (scores range from 0 to 10, with 0 being lowest quality). Linear regression was used to assess changes in methodological quality over time. A total of 1,143 articles were published in JAPMA between January 1999 and December 2013. Of these, 44 articles were reports of randomized trials. Although the number of randomized trials published each year increased, there was only minimal improvement in their methodological quality (mean rate of improvement = 0.01 points per year). The methodological quality of the trials studied was typically moderate, with a mean ± SD PEDro score of 5.1 ± 1.5. Although there were a few high-quality randomized trials published in the journal, most (84.1%) scored between 3 and 6. Although there has been an increase in the number of randomized trials published in JAPMA, there is substantial opportunity for improvement in the methodological quality of trials published in the journal. Researchers seeking to publish reports of randomized trials should seek to meet current best-practice standards in the conduct and reporting of their trials.

Ride quality research techniques: Section on general techniques

NASA Technical Reports Server (NTRS)

1977-01-01

Information is gathered about the methods currently used for the study of ride quality in a variety of transportation modes by a variety of research organizations, including universities, Federal agencies, contracting firms, and private industries. Detailed descriptions of these techniques and their strengths and weaknesses, and identifying the organizations using such methods are presented. The specific efforts of the Group's participants, as well as a variety of feasible approaches not currently in use, are presented as methodological alternatives under the three basic factors which must be considered in ride quality studies: research techniques, research environments, and choice of subjects.

Future developments in health care performance management

PubMed Central

Crema, Maria; Verbano, Chiara

2013-01-01

This paper highlights the challenges of performance management in health care, wherein multiple different objectives have to be pursued. The literature suggests starting with quality performance, following the sand cone theory, but considering a multidimensional concept of health care quality. Moreover, new managerial approaches coming from an industrial context and adapted to health care, such as lean management and risk management, can contribute to improving quality performance. Therefore, the opportunity to analyze them arises from studying their overlaps and links in order to identify possible synergies and to investigate the opportunity to develop an integrated methodology enabling improved performance. PMID:24255600

Land use change detection with LANDSAT-2 data for monitoring and predicting regional water quality degradation. [Arkansas

NASA Technical Reports Server (NTRS)

Macdonald, H.; Steele, K. (Principal Investigator); Waite, W.; Rice, R.; Shinn, M.; Dillard, T.; Petersen, C.

1977-01-01

The author has identified the following significant results. Comparison between LANDSAT 1 and 2 imagery of Arkansas provided evidence of significant land use changes during the 1972-75 time period. Analysis of Arkansas historical water quality information has shown conclusively that whereas point source pollution generally can be detected by use of water quality data collected by state and federal agencies, sampling methodologies for nonpoint source contamination attributable to surface runoff are totally inadequate. The expensive undertaking of monitoring all nonpoint sources for numerous watersheds can be lessened by implementing LANDSAT change detection analyses.

[Epidemiology of falls in the elderly in Spain: a systematic review, 2007].

PubMed

Silva Gama, Zenewton André da; Gómez Conesa, Antonia; Sobral Ferreira, Marta

2008-01-01

Falls in the elderly are a serious problem that results in large health care expenditures. To prevent them, it has been shown that the key is an epidemiologic knowledge of the target population. The purpose of this systematic review was to identify the incidence, risk factors and consequences of falls in the Spanish population, by analyzing the methodological quality of studies that provide these data. Two independent authors identified 54 studies through manual and electronic means (MEDLINE, Dialnet, Tesis en Red, TESEO y CSIC [ICYT, IME, ISOC]). A total of 13 studies performed in Spain with non-hospitalized elderly individuals older than 64 years of age were selected and assessed for their methodological quality. We found heterogeneity in the characteristics and quality of the studies, and a general inadequacy of data analyses. The risk factors and consequences must be viewed with caution, since in most of the studies a causal inference cannot be made. We showed that the current fall rates are at the same level as those of the first epidemiologic study published 15 years ago. We conclude that Spain has a high incidence of falls and needs studies on risk factors directed toward cause and effect in the community and comparisons among nursing homes. Finally, the physical, psychosocial and economic consequences must be investigated more thoroughly.

General aviation technology assessment

NASA Technical Reports Server (NTRS)

Jacobson, I. D.

1975-01-01

The existing problem areas in general aviation were investigated in order to identify those which can benefit from technological payoffs. The emphasis was placed on acceptance by the pilot/passenger in areas such as performance, safety, handling qualities, ride quality, etc. Inputs were obtained from three sectors: industry; government; and user, although slanted toward the user group. The results should only be considered preliminary due to the small sample sizes of the data. Trends are evident however and a general methodology for allocating effort in future programs is proposed.

Background qualitative analysis of the European reference life cycle database (ELCD) energy datasets - part II: electricity datasets.

PubMed

Garraín, Daniel; Fazio, Simone; de la Rúa, Cristina; Recchioni, Marco; Lechón, Yolanda; Mathieux, Fabrice

2015-01-01

The aim of this paper is to identify areas of potential improvement of the European Reference Life Cycle Database (ELCD) electricity datasets. The revision is based on the data quality indicators described by the International Life Cycle Data system (ILCD) Handbook, applied on sectorial basis. These indicators evaluate the technological, geographical and time-related representativeness of the dataset and the appropriateness in terms of completeness, precision and methodology. Results show that ELCD electricity datasets have a very good quality in general terms, nevertheless some findings and recommendations in order to improve the quality of Life-Cycle Inventories have been derived. Moreover, these results ensure the quality of the electricity-related datasets to any LCA practitioner, and provide insights related to the limitations and assumptions underlying in the datasets modelling. Giving this information, the LCA practitioner will be able to decide whether the use of the ELCD electricity datasets is appropriate based on the goal and scope of the analysis to be conducted. The methodological approach would be also useful for dataset developers and reviewers, in order to improve the overall Data Quality Requirements of databases.

An overall index of environmental quality in coal mining areas and energy facilities.

PubMed

Vatalis, Konstantinos I; Kaliampakos, Demetrios C

2006-12-01

An approach to measuring environmental quality and trends in coal mining and industrial areas was attempted in this work. For this purpose, the establishment of a reference scale characterizing the status of environmental quality is proposed by developing an Environmental Quality Index (EQI). The methodology involves three main components: social research, the opinion of environmental experts, and the combination of new or existing indices. A survey of public opinion was carried out to identify the main environmental problems in the region of interest. Environmental experts carried out a survey, and the weights of specific environmental problems were obtained through a fuzzy Delphi method and pairwise comparison. The weight attributed to each environmental problem was computed, using new or existing indices (subindices) in the relevant literature. The EQI comprises a combination of the subindices with their own weights. The methodology was applied to a heavily industrialized coal basin in northwestern Macedonia, Greece. The results show that the new index may be used as a reliable tool for evaluating environmental quality in different areas. In addition, the study of EQI trends on an interannual basis can provide useful information on the efficiency of environmental policies already implemented by the responsible authorities.

How to Conduct a Good Meta-Analysis in Gifted Education

ERIC Educational Resources Information Center

Steenbergen-Hu, Saiying; Olszewski-Kubilius, Paula

2016-01-01

This methodological brief introduces basic procedures and issues for conducting a high-quality meta-analysis in gifted education. Specifically, we discuss issues such as how to select a topic and formulate research problems, search for and identify qualified studies, code studies and extract data, choose and calculate effect sizes, analyze data,…

Integrated Postsecondary Education Data System Data Quality Study. Methodology Report. NCES 2005-175

ERIC Educational Resources Information Center

Jackson, Kenneth W.; Peecksen, Scott; Jang, Donsig; Sukasih, Amang

2005-01-01

The Integrated Postsecondary Education Data System (IPEDS) of the National Center for Education Statistics (NCES) was initiated in 1986 to collect data about all identified institutions whose primary purpose is to provide postsecondary education. Postsecondary education is defined within IPEDS as "the provision of a formal instructional…

Yoga and quality-of-life improvement in patients with breast cancer: a literature review.

PubMed

Levine, Alison Spatz; Balk, Judith L

2012-01-01

Women undergoing treatment for breast cancer often turn to complementary and alternative medicine (CAM), including yoga, for improvement of mood, quality of life (QOL), sleep, and treatment-related side effects. The extant literature was reviewed to examine the clinical effects of yoga practice on QOL for patients with breast cancer. QOL was defined as physical well-being, social functioning, emotional health, and function-al adaptation. Seven databases, including PubMed, Ovid MEDLINE, CINAHL, Embase, PsycINFO, Cochrane Library, and Web of Science were used to search for studies of patients with breast cancer that included a yoga intervention and QOL assessment. Attention was paid to assessing study population, outcome variables, the type of yoga intervention used, and methodological strengths and limitations. Seventy-one articles were identified that fit the search criteria. Although the literature provided evidence of QOL benefits of yoga for patients with breast cancer, no specific aspect of yoga was identified as being most advantageous. Although participation in yoga programs appeared to benefit patients with breast cancer, greater methodological rigor is required to understand the mechanisms that contribute to their effectiveness.

Systematic review of the effectiveness of mirror therapy in upper extremity function.

PubMed

Ezendam, Daniëlle; Bongers, Raoul M; Jannink, Michiel J A

2009-01-01

This review gives an overview of the current state of research regarding the effectiveness of mirror therapy in upper extremity function. A systematic literature search was performed to identify studies concerning mirror therapy in upper extremity. The included journal articles were reviewed according to a structured diagram and the methodological quality was assessed. Fifteen studies were identified and reviewed. Five different patient categories were studied: two studies focussed on mirror therapy after an amputation of the upper limb, five studies focussed on mirror therapy after stroke, five studies focussed on mirror therapy with complex regional pain syndrome type 1 (CRPS1) patients, one study on mirror therapy with complex regional pain syndrome type 2 (CRPS2) and two studies focussed on mirror therapy after hand surgery other than amputation. Most of the evidence for mirror therapy is from studies with weak methodological quality. The present review showed a trend that mirror therapy is effective in upper limb treatment of stroke patients and patients with CRPS, whereas the effectiveness in other patient groups has yet to be determined.

The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Systematic Review of Human Evidence for PFOA Effects on Fetal Growth

PubMed Central

Sutton, Patrice; Atchley, Dylan S.; Koustas, Erica; Lam, Juleen; Sen, Saunak; Robinson, Karen A.; Axelrad, Daniel A.; Woodruff, Tracey J.

2014-01-01

Background: The Navigation Guide methodology was developed to meet the need for a robust method of systematic and transparent research synthesis in environmental health science. We conducted a case study systematic review to support proof of concept of the method. Objective: We applied the Navigation Guide systematic review methodology to determine whether developmental exposure to perfluorooctanoic acid (PFOA) affects fetal growth in humans. Methods: We applied the first 3 steps of the Navigation Guide methodology to human epidemiological data: 1) specify the study question, 2) select the evidence, and 3) rate the quality and strength of the evidence. We developed a protocol, conducted a comprehensive search of the literature, and identified relevant studies using prespecified criteria. We evaluated each study for risk of bias and conducted meta-analyses on a subset of studies. We rated quality and strength of the entire body of human evidence. Results: We identified 18 human studies that met our inclusion criteria, and 9 of these were combined through meta-analysis. Through meta-analysis, we estimated that a 1-ng/mL increase in serum or plasma PFOA was associated with a –18.9 g (95% CI: –29.8, –7.9) difference in birth weight. We concluded that the risk of bias across studies was low, and we assigned a “moderate” quality rating to the overall body of human evidence. Conclusion: On the basis of this first application of the Navigation Guide systematic review methodology, we concluded that there is “sufficient” human evidence that developmental exposure to PFOA reduces fetal growth. Citation: Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1028–1039; http://dx.doi.org/10.1289/ehp.1307893 PMID:24968388

Applying ethnography to the study of context in healthcare quality and safety.

PubMed

Leslie, Myles; Paradis, Elise; Gropper, Michael A; Reeves, Scott; Kitto, Simon

2014-02-01

Translating and scaling healthcare quality improvement (QI) and patient safety interventions remains a significant challenge. Context has been identified as a major factor in this. QI and patient safety research have begun to focus on context, with ethnography seen as a promising methodology for understanding the professional, organisational and cultural aspects of context. While ethnography is used to investigate the context of a variety of QI and safety interventions, the challenges inherent in effectively importing a qualitative methodology and its social science practitioners into this work have been largely unexamined. We explain ethnography as a research practice grounded in theory and dependent on observations gathered and interpreted in particular ways. We then review the approach of health services literature to evaluating this sort of qualitative research. Although the study of context is an interest shared by both social scientists and healthcare QI and safety researchers, we identify three key points at which those 'exporting' ethnography as a methodology and those 'importing' it to deal with QI and safety challenges may diverge. We describe perspectival divergences on the methodology's mission, form and scale. At the level of mission we demonstrate how ethnography has been adapted to a 'describe and feed back' role in the service of QI. At the level of form, we show how the long-term embedded observation at the heart of ethnography can be adapted only so far to accommodate QI interests if both data quality and ethical standards are to be upheld. Finally, at the level of scale, we demonstrate one ethnographic study design that balances breadth of exposure with depth of experience in its observations and so generates a particular type of scalable findings. The effective export of ethnography into QI and safety research requires discussion and negotiation between social scientific and health services research perspectives, as well as creative approaches to producing self-reflexive data that will allow clinicians to understand their own context and so improve their own processes.

Nursing home staff members' subjective frames of reference on residents' achievement of ego integrity: A Q-methodology study.

PubMed

Lim, Sun-Young; Chang, Sung-Ok

2018-01-01

To discover the structure of the frames of reference for nursing home staff members' subjective judgment of residents' achievement of ego integrity. Q-methodology was applied. Twenty-eight staff members who were working in a nursing home sorted 34 Q-statements into the shape of a normal distribution. A centroid factor analysis and varimax rotation, using the PQ-method program, revealed four factors: identifying clues to residents' positive acceptance of their whole life span, identifying residents' ways of enjoying their current life, referencing residents' attitudes and competencies toward harmonious relationships, and identifying residents' integrated efforts to establish self-esteem. These subjective frames of reference need to be investigated in order to improve the relationships with nursing home residents and their quality of life. Consequently, the fundamental monitoring tools to help staff members make subjective judgments can be formed. © 2017 Japan Academy of Nursing Science.

31P NMR spectroscopy in the quality control and authentication of extra-virgin olive oil: a review of recent progress.

PubMed

Dais, Photis; Spyros, Apostolos

2007-05-01

This review is a brief account on the application of a novel methodology to the quality control and authentication of extra-virgin olive oil. This methodology is based on the derivatization of the labile hydrogens of functional groups, such as hydroxyl and carboxyl groups, of olive oil constituents with the phosphorus reagent 2-chloro-4,4,5,5-tetramethyldioxaphospholane, and the use of the (31)P chemical shifts to identify the phosphitylated compounds. Various experimental aspects such as pertinent instrumentation, sample preparation, acquisition parameters and properties of the phosphorus reagent are reviewed. The strategy to assign the (31)P signals of the phosphitylated model compounds and olive oil constituents by employing 1D and 2D NMR experiments is presented. Finally, the capability of this technique to assess the quality and the genuineness of extra-virgin olive oil and to detect fraud is discussed. Copyright (c) 2007 John Wiley & Sons, Ltd.

Clinical audit, a valuable tool to improve quality of care: General methodology and applications in nephrology.

PubMed

Esposito, Pasquale; Dal Canton, Antonio

2014-11-06

Evaluation and improvement of quality of care provided to the patients are of crucial importance in the daily clinical practice and in the health policy planning and financing. Different tools have been developed, including incident analysis, health technology assessment and clinical audit. The clinical audit consist of measuring a clinical outcome or a process, against well-defined standards set on the principles of evidence-based medicine in order to identify the changes needed to improve the quality of care. In particular, patients suffering from chronic renal diseases, present many problems that have been set as topics for clinical audit projects, such as hypertension, anaemia and mineral metabolism management. Although the results of these studies have been encouraging, demonstrating the effectiveness of audit, overall the present evidence is not clearly in favour of clinical audit. These findings call attention to the need to further studies to validate this methodology in different operating scenarios. This review examines the principle of clinical audit, focusing on experiences performed in nephrology settings.

The quality of instruments to assess the process of shared decision making: A systematic review

PubMed Central

Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

2018-01-01

Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations. PMID:29447193

Missing and accounted for: gaps and areas of wealth in the public health review literature

PubMed Central

2011-01-01

Background High-quality review evidence is useful for informing and influencing public health policy and practice decisions. However, certain topic areas lack representation in terms of the quantity and quality of review literature available. The objectives of this paper are to identify the quantity, as well as quality, of review-level evidence available on the effectiveness of public health interventions for public health decision makers. Methods Searches conducted on http://www.health-evidence.ca produced an inventory of public health review literature in 21 topic areas. Gaps and areas of wealth in the review literature, as well as the proportion of reviews rated methodologically strong, moderate, or weak were identified. The top 10 topic areas of interest for registered users and visitors of http://www.health-evidence.ca were extracted from user profile data and Google Analytics. Results Registered users' top three interests included: 1) healthy communities, 2) chronic diseases, and 3) nutrition. The top three preferences for visitors included: 1) chronic diseases, 2) physical activity, and 3) addiction/substance use. All of the topic areas with many (301+) available reviews were of interest to registered users and/or visitors (mental health, physical activity, addiction/substance use, adolescent health, child health, nutrition, adult health, and chronic diseases). Conversely, the majority of registered users and/or visitors did not have preference for topic areas with few (≤ 150) available reviews (food safety and inspection, dental health, environmental health) with the exception of social determinants of health and healthy communities. Across registered users' and visitors' topic areas of preference, 80.2% of the reviews were of well-done methodological quality, with 43.5% of reviews having a strong quality rating and 36.7% a moderate review quality rating. Conclusions In topic areas in which many reviews are available, higher level syntheses are needed to guide policy and practice. For other topic areas with few reviews, it is necessary to determine whether primary study evidence exists, or is needed, so that reviews can be conducted in the future. Considering that less than half of the reviews available on http://www.health-evidence.ca are of strong methodological quality, the quality of the review-level evidence needs to improve across the range of public health topic areas. PMID:21967658

Methodological quality assessment of paper-based systematic reviews published in oral health.

PubMed

Wasiak, J; Shen, A Y; Tan, H B; Mahar, R; Kan, G; Khoo, W R; Faggion, C M

2016-04-01

This study aimed to conduct a methodological assessment of paper-based systematic reviews (SR) published in oral health using a validated checklist. A secondary objective was to explore temporal trends on methodological quality. Two electronic databases (OVID Medline and OVID EMBASE) were searched for paper-based SR of interventions published in oral health from inception to October 2014. Manual searches of the reference lists of paper-based SR were also conducted. Methodological quality of included paper-based SR was assessed using an 11-item questionnaire, Assessment of Multiple Systematic Reviews (AMSTAR) checklist. Methodological quality was summarized using the median and inter-quartile range (IQR) of the AMSTAR score over different categories and time periods. A total of 643 paper-based SR were included. The overall median AMSTAR score was 4 (IQR 2-6). The highest median score (5) was found in the pain dentistry and periodontology fields, while the lowest median score (3) was found in implant dentistry, restorative dentistry, oral medicine, and prosthodontics. The number of paper-based SR per year and the median AMSTAR score increased over time (median score in 1990s was 2 (IQR 2-3), 2000s was 4 (IQR 2-5), and 2010 onwards was 5 (IQR 3-6)). Although the methodological quality of paper-based SR published in oral health has improved in the last few years, there is still scope for improving quality in most evaluated dental specialties. Large-scale assessment of methodological quality of dental SR highlights areas of methodological strengths and weaknesses that can be targeted in future publications to encourage better quality review methodology.

A call to improve sampling methodology and reporting in young novice driver research.

PubMed

Scott-Parker, B; Senserrick, T

2017-02-01

Young drivers continue to be over-represented in road crash fatalities despite a multitude of research, communication and intervention. Evidence-based improvement depends to a great extent upon research methodology quality and its reporting, with known limitations in the peer-review process. The aim of the current research was to review the scope of research methodologies applied in 'young driver' and 'teen driver' research and their reporting in four peer-review journals in the field between January 2006 and December 2013. In total, 806 articles were identified and assessed. Reporting omissions included participant gender (11% of papers), response rates (49%), retention rates (39%) and information regarding incentives (44%). Greater breadth and specific improvements in study designs and reporting are thereby identified as a means to further advance the field. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery

PubMed Central

Gudlaugsdottir, Katrin; Andrews, James

2017-01-01

Objective Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality. Background Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated. Methods Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality. Results 112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression. Conclusions There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians. PMID:28384296

METHODOLOGICAL QUALITY OF ECONOMIC EVALUATIONS ALONGSIDE TRIALS OF KNEE PHYSIOTHERAPY.

PubMed

García-Pérez, Lidia; Linertová, Renata; Arvelo-Martín, Alejandro; Guerra-Marrero, Carolina; Martínez-Alberto, Carlos Enrique; Cuéllar-Pompa, Leticia; Escobar, Antonio; Serrano-Aguilar, Pedro

2017-01-01

The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis. Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale. All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account. Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool.

PubMed

Ho, Robin S T; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel Y S; Chung, Vincent C H

2015-01-08

Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. To assess the methodological quality of MAs on COPD treatments. A cross-sectional study on MAs of COPD trials. MAs published during 2000-2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods.

Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool

PubMed Central

Ho, Robin ST; Wu, Xinyin; Yuan, Jinqiu; Liu, Siya; Lai, Xin; Wong, Samuel YS; Chung, Vincent CH

2015-01-01

Background: Meta-analysis (MA) of randomised trials is considered to be one of the best approaches for summarising high-quality evidence on the efficacy and safety of treatments. However, methodological flaws in MAs can reduce the validity of conclusions, subsequently impairing the quality of decision making. Aims: To assess the methodological quality of MAs on COPD treatments. Methods: A cross-sectional study on MAs of COPD trials. MAs published during 2000–2013 were sampled from the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effect. Methodological quality was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. Results: Seventy-nine MAs were sampled. Only 18% considered the scientific quality of primary studies when formulating conclusions and 49% used appropriate meta-analytic methods to combine findings. The problems were particularly acute among MAs on pharmacological treatments. In 48% of MAs the authors did not report conflict of interest. Fifty-eight percent reported harmful effects of treatment. Publication bias was not assessed in 65% of MAs, and only 10% had searched non-English databases. Conclusions: The methodological quality of the included MAs was disappointing. Consideration of scientific quality when formulating conclusions should be made explicit. Future MAs should improve on reporting conflict of interest and harm, assessment of publication bias, prevention of language bias and use of appropriate meta-analytic methods. PMID:25569783

A critical methodological review of discourse and conversation analysis studies of family therapy.

PubMed

Tseliou, Eleftheria

2013-12-01

Discourse (DA) and conversation (CA) analysis, two qualitative research methods, have been recently suggested as potentially promising for the study of family therapy due to common epistemological adherences and their potential for an in situ study of therapeutic dialog. However, to date, there is no systematic methodological review of the few existing DA and CA studies of family therapy. This study aims at addressing this lack by critically reviewing published DA and CA studies of family therapy on methodological grounds. Twenty-eight articles in total are reviewed in relation to certain methodological axes identified in the relevant literature. These include choice of method, framing of research question(s), data/sampling, type of analysis, epistemological perspective, content/type of knowledge claims, and attendance to criteria for good quality practice. It is argued that the reviewed studies show "glimpses" of the methods' potential for family therapy research despite the identification of certain "shortcomings" regarding their methodological rigor. These include unclearly framed research questions and the predominance of case study designs. They also include inconsistencies between choice of method, stated or unstated epistemological orientations and knowledge claims, and limited attendance to criteria for good quality practice. In conclusion, it is argued that DA and CA can add to the existing quantitative and qualitative methods for family therapy research. They can both offer unique ways for a detailed study of the actual therapeutic dialog, provided that future attempts strive for a methodologically rigorous practice and against their uncritical deployment. © FPI, Inc.

Application of quality improvement analytic methodology in emergency medicine research: A comparative evaluation.

PubMed

Harries, Bruce; Filiatrault, Lyne; Abu-Laban, Riyad B

2018-05-30

Quality improvement (QI) analytic methodology is rarely encountered in the emergency medicine literature. We sought to comparatively apply QI design and analysis techniques to an existing data set, and discuss these techniques as an alternative to standard research methodology for evaluating a change in a process of care. We used data from a previously published randomized controlled trial on triage-nurse initiated radiography using the Ottawa ankle rules (OAR). QI analytic tools were applied to the data set from this study and evaluated comparatively against the original standard research methodology. The original study concluded that triage nurse-initiated radiographs led to a statistically significant decrease in mean emergency department length of stay. Using QI analytic methodology, we applied control charts and interpreted the results using established methods that preserved the time sequence of the data. This analysis found a compelling signal of a positive treatment effect that would have been identified after the enrolment of 58% of the original study sample, and in the 6th month of this 11-month study. Our comparative analysis demonstrates some of the potential benefits of QI analytic methodology. We found that had this approach been used in the original study, insights regarding the benefits of nurse-initiated radiography using the OAR would have been achieved earlier, and thus potentially at a lower cost. In situations where the overarching aim is to accelerate implementation of practice improvement to benefit future patients, we believe that increased consideration should be given to the use of QI analytic methodology.

Systematic Review of the Effect of Pictorial Warnings on Cigarette Packages in Smoking Behavior

PubMed Central

Liu, Bojing; Greiner, Felix; Bremberg, Sven; Galanti, Rosaria

2014-01-01

We used a structured approach to assess whether active smokers presented with pictorial warnings on cigarette packages (PWCP) had a higher probability of quitting, reducing, and attempting to quit smoking than did unexposed smokers. We identified 21 articles from among nearly 2500 published between 1993 and 2013, prioritizing coverage over relevance or quality because we expected to find only a few studies with behavioral outcomes. We found very large heterogeneity across studies, poor or very poor methodological quality, and generally null or conflicting findings for any explored outcome. The evidence for or against the use of PWCP is insufficient, suggesting that any effect of PWCP on behavior would be modest. Determining the single impact of PWCP on behavior requires studies with strong methodological designs and longer follow-up periods. PMID:25122019

Methodological quality in randomised controlled trials of transcutaneous electric nerve stimulation for pain: low fidelity may explain negative findings.

PubMed

Bennett, Michael I; Hughes, Nicola; Johnson, Mark I

2011-06-01

The benefits of transcutaneous electrical nerve stimulation (TENS) for pain relief have not been reliably established, as most systematic reviews find poor methodological quality in many studies. The paradox within the evidence base for TENS is that despite identified sources of bias that may lead to an overestimation of treatment effects, no benefits for TENS can be clearly demonstrated. Conventional assessments of quality assume a single direction of bias, and little work has been undertaken examining other directions of bias. Our hypothesis was that low fidelity in studies (bias leading to an underestimation of treatment effects) may account for inconclusive findings. We included 38 studies from 3 recently published Cochrane systematic reviews that examined TENS for acute, chronic, and cancer pain. We extracted data relating to treatment allocation, application of TENS and to the assessment of outcomes. We quantified these data and judged this against standardised assessment criteria using a "traffic light" approach based on the number of studies reaching the standard. We identified significant sources of potential bias in both directions in relation to study design and implementation fidelity that have not been quantified previously. Suboptimal dosing of TENS and inappropriate outcome assessment were particularly prevalent weaknesses indicating low fidelity. We propose criteria for judging directions of bias in future studies of TENS that may be adapted to assess other trials in which implementation fidelity is important, such as other nonpharmacological interventions for pain. Poor implementation fidelity was identified as a significant source of bias in systematic reviews of TENS studies and might explain lack of consistent treatment effects of TENS in pain. Here, criteria for assessing methodology are proposed for use in designing future clinical trials of TENS. Copyright © 2010 International Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.

Measurement properties of the most commonly used Foot- and Ankle-Specific Questionnaires: the FFI, FAOS and FAAM. A systematic review.

PubMed

Sierevelt, I N; Zwiers, R; Schats, W; Haverkamp, D; Terwee, C B; Nolte, P A; Kerkhoffs, G M M J

2017-10-12

In the foot and ankle literature, a wide range of patient-reported outcome measures (PROMs) is used, however, consensus as to which PROMs are preferred is lacking. Selection of a PROM is among other reasons, often based on measurement properties without considering the methodological quality of the studies that evaluate these measurement properties. The aim of current study was first to identify the most frequently used foot and ankle-specific PROMs in recent orthopaedic foot and ankle literature, and second to conduct a systematic review to synthesize and critically appraise the measurement properties of these PROMS. Six PubMed indexed journals focussing on foot and ankle research were screened to identify most commonly used foot and ankle-specific PROMs over a 2 year period (2015-2016). Subsequently, a systematic literature search was performed in PubMed, EMBASE, SPORTDiscus and Scopus to identify relevant studies on their measurement properties. Methodological quality assessment was performed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist, criteria for good measurement properties were applied, and a level of evidence was determined for the measurement properties of each domain of the questionnaires. The three most frequently reported PROMs were the Foot Function Index (FFI), the Foot and Ankle Outcome Score (FAOS) and the Foot and Ankle Activity Measure (FAAM). Among 2046 unique citations, 50 studies were included evaluating these PROMs. Evidence to support the measurement properties of the FFI was mainly lacking due to poor methodological quality. More evidence was available for the measurement properties of the FAOS and the FAAM, but overall evidence supporting all measurement properties is not yet sufficient. The best available evidence retrieved in this review showed that the FAOS and the FAAM are promising outcome measures for evaluation of patients with foot and ankle conditions, but their shortcomings should be taken into account when interpreting results in clinical setting or trials. I.

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs.

PubMed

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed.

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs

PubMed Central

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed. PMID:27917143

[Methodological quality of articles on therapeutic procedures published in Cirugía Española. Evaluation of the period 2005-2008].

PubMed

Manterola, Carlos; Grande, Luís

2010-04-01

To determine methodological quality of therapy articles published in Cirugía Española and to study its association with the publication year, the centre of origin and subjects. A literature study which included all therapy articles published between 2005 and 2008. All kinds of clinical designs were considered, excluding editorials, review articles, letters to editor and experimental studies. Variables analysed included: year of publication, centre of origin, design, and methodological quality of articles. A valid and reliable scale was applied to determine methodological quality. A total of 243 articles [206 series of cases (84.8%), 27 cohort studies (11.1%), 9 clinical trials (3.7%) and 1 case control study (0.4%)] were found. Studies came preferentially from Catalonia and Valencia (22.3% and 12.3% respectively). Thematic areas most frequently found were hepato-bilio-pancreatic and colorectal surgery (20.0% and 16.6%, respectively). Average and median of the methodological quality score calculated for the entire series were 9.5+/-4.3 points and 8 points, respectively. Association between methodological quality and geographical area (p=0.0101), subject area (p=0.0267), and university origin (p=0.0369) was found. A significant increase of methodological quality by publication year was observed (p=0.0004). Methodological quality of therapy articles published in Cirugía Española between 2005 and 2008 is low; but an increase tendency with statistical significance was observed.

Methodological quality of meta-analyses of single-case experimental studies.

PubMed

Jamshidi, Laleh; Heyvaert, Mieke; Declercq, Lies; Fernández-Castilla, Belén; Ferron, John M; Moeyaert, Mariola; Beretvas, S Natasha; Onghena, Patrick; Van den Noortgate, Wim

2017-12-28

Methodological rigor is a fundamental factor in the validity and credibility of the results of a meta-analysis. Following an increasing interest in single-case experimental design (SCED) meta-analyses, the current study investigates the methodological quality of SCED meta-analyses. We assessed the methodological quality of 178 SCED meta-analyses published between 1985 and 2015 through the modified Revised-Assessment of Multiple Systematic Reviews (R-AMSTAR) checklist. The main finding of the current review is that the methodological quality of the SCED meta-analyses has increased over time, but is still low according to the R-AMSTAR checklist. A remarkable percentage of the studies (93.80% of the included SCED meta-analyses) did not even reach the midpoint score (22, on a scale of 0-44). The mean and median methodological quality scores were 15.57 and 16, respectively. Relatively high scores were observed for "providing the characteristics of the included studies" and "doing comprehensive literature search". The key areas of deficiency were "reporting an assessment of the likelihood of publication bias" and "using the methods appropriately to combine the findings of studies". Although the results of the current review reveal that the methodological quality of the SCED meta-analyses has increased over time, still more efforts are needed to improve their methodological quality. Copyright © 2017 Elsevier Ltd. All rights reserved.

Plantar pressure measurements and running-related injury: A systematic review of methods and possible associations.

PubMed

Mann, Robert; Malisoux, Laurent; Urhausen, Axel; Meijer, Kenneth; Theisen, Daniel

2016-06-01

Pressure-sensitive measuring devices have been identified as appropriate tools for measuring an array of parameters during running. It is unclear which biomechanical characteristics relate to running-related injury (RRI) and which data-processing techniques are most promising to detect this relationship. This systematic review aims to identify pertinent methodologies and characteristics measured using plantar pressure devices, and to summarise their associations with RRI. PubMed, Embase, CINAHL, ScienceDirect and Scopus were searched up until March 2015. Retrospective and prospective, biomechanical studies on running using any kind of pressure-sensitive device with RRI as an outcome were included. All studies involving regular or recreational runners were considered. The study quality was assessed and the measured parameters were summarised. One low quality, two moderate quality and five high quality studies were included. Five different subdivisions of plantar area were identified, as well as five instants and four phases of measurement during foot-ground contact. Overall many parameters were collated and subdivided as plantar pressure and force, plantar pressure and force location, contact area, timing and stride parameters. Differences between the injured and control group were found for mediolateral and anteroposterior displacement of force, contact area, velocity of force displacement, relative force-time integral, mediolateral force ratio, time to peak force and inter-stride correlative patterns. However, no consistent results were found between studies and no biomechanical risk patterns were apparent. Additionally, conflicting findings were reported for peak force in three studies. Based on these observations, we provide suggestions for improved methodology measurement of pertinent parameters for future studies. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.

[Quality appraisal of systematic reviews or meta-analysis on traditional Chinese medicine published in Chinese journals].

PubMed

Liu, Jian-ping; Xia, Yun

2007-04-01

To critically assess the quality of literature about systematic review or meta-analysis on traditional Chinese medicine (TCM) published in Chinese journals. Electronic searches in CNKI, VIP and Wanfang data-base were conducted to retrieve the systematic reviews or meta-analysis reports on TCM, including herbal medicine, needling, acupuncture and moxibustion, as well as integrative medicine, they were identified and extracted according to the 18 items of QUOROM (quality of reporting of meta-analyses) Statement and relative information. The appraisal was made taking the indexes mainly including objectives, source of data, methods of data extraction, quality assessment of the included studies, measurement data synthesis, etc. Eighty-two systematic reviews were identified, except 6 reviews were excluded for repeatedly published or didn't comply with the enrolled criterion, 76 reviews concerning 51 kinds of diseases were enrolled for appraisal. Among them, 70 reviews evaluated the efficacy of TCM, mainly on Chinese herbs and 9 on acupuncture and moxibustion. In majority of the reviews, randomised controlled trials were included and the data resources were described, but in 26 reviews only the Chinese databases were searched and the description about data extraction and analysis method were too simple; and 70% of reviews assessed the quality of the included studies; none used flow chart to express the process of selection, inclusion and exclusion of studies. Few reviews or Meta-analysis reports reached the international standard and there is insufficient description of methodology for conducting systematic reviews, so it is hardly to be repeated. The authors suggested that advanced methodological training is necessary for reviewers.

Simulation modeling for stratified breast cancer screening - a systematic review of cost and quality of life assumptions.

PubMed

Arnold, Matthias

2017-12-02

The economic evaluation of stratified breast cancer screening gains momentum, but produces also very diverse results. Systematic reviews so far focused on modeling techniques and epidemiologic assumptions. However, cost and utility parameters received only little attention. This systematic review assesses simulation models for stratified breast cancer screening based on their cost and utility parameters in each phase of breast cancer screening and care. A literature review was conducted to compare economic evaluations with simulation models of personalized breast cancer screening. Study quality was assessed using reporting guidelines. Cost and utility inputs were extracted, standardized and structured using a care delivery framework. Studies were then clustered according to their study aim and parameters were compared within the clusters. Eighteen studies were identified within three study clusters. Reporting quality was very diverse in all three clusters. Only two studies in cluster 1, four studies in cluster 2 and one study in cluster 3 scored high in the quality appraisal. In addition to the quality appraisal, this review assessed if the simulation models were consistent in integrating all relevant phases of care, if utility parameters were consistent and methodological sound and if cost were compatible and consistent in the actual parameters used for screening, diagnostic work up and treatment. Of 18 studies, only three studies did not show signs of potential bias. This systematic review shows that a closer look into the cost and utility parameter can help to identify potential bias. Future simulation models should focus on integrating all relevant phases of care, using methodologically sound utility parameters and avoiding inconsistent cost parameters.

What Is the Methodologic Quality of Human Therapy Studies in ISI Surgical Publications?

PubMed Central

Manterola, Carlos; Pineda, Viviana; Vial, Manuel; Losada, Héctor

2006-01-01

Objective: To determine the methodologic quality of therapy articles about humans published in ISI surgical journals, and to explore the association between methodologic quality, origin, and subject matter. Summary Background Data: It is supposed that ISI journals contain the best methodologic articles. Methods: This is a bibliometric study. All journals listed in the 2002 ISI under the subject heading of “Surgery” were included. A simple randomized sampling was conducted for selected journals (Annals of Surgery, The American Surgeon, Archives of Surgery, British Journal of Surgery, European Journal of Surgery, Journal of the American College of Surgeons, Surgery, and World Journal of Surgery). Published articles related to therapy on humans of the selected journals were reviewed and analyzed. All kinds of clinical designs were considered, excluding editorials, review articles, letters to the editor, and experimental studies. The variables considered were: place of origin, design, and the methodologic quality of articles, which was determined by applying a valid and reliable scale. The review was performed interchangeably and independently by 2 research teams. Descriptive and analytical statistics were used. Statistical significance was defined as P values less than 1%. Results: A total of 653 articles were studied. Studies came predominantly from the United States and Europe (43.6% and 36.8%, respectively). The subject areas most frequently found were digestive and hepatobiliopancreatic surgery (29.1% and 24.5%, respectively). Average and median methodologic quality scores of the entire series were 11.6 ± 4.9 points and 11 points, respectively. The association between methodologic quality and journals was determined. Also, the association between methodologic quality and origin was observed, but no association with subject area was verified. Conclusions: The methodologic quality of therapy articles published in the journals analyzed is low; however, statistical significance was determined between them. Association was observed between methodologic quality and origin, but not with subject matter. PMID:17060778

An effective and optimal quality control approach for green energy manufacturing using design of experiments framework and evolutionary algorithm

NASA Astrophysics Data System (ADS)

Saavedra, Juan Alejandro

Quality Control (QC) and Quality Assurance (QA) strategies vary significantly across industries in the manufacturing sector depending on the product being built. Such strategies range from simple statistical analysis and process controls, decision-making process of reworking, repairing, or scraping defective product. This study proposes an optimal QC methodology in order to include rework stations during the manufacturing process by identifying the amount and location of these workstations. The factors that are considered to optimize these stations are cost, cycle time, reworkability and rework benefit. The goal is to minimize the cost and cycle time of the process, but increase the reworkability and rework benefit. The specific objectives of this study are: (1) to propose a cost estimation model that includes energy consumption, and (2) to propose an optimal QC methodology to identify quantity and location of rework workstations. The cost estimation model includes energy consumption as part of the product direct cost. The cost estimation model developed allows the user to calculate product direct cost as the quality sigma level of the process changes. This provides a benefit because a complete cost estimation calculation does not need to be performed every time the processes yield changes. This cost estimation model is then used for the QC strategy optimization process. In order to propose a methodology that provides an optimal QC strategy, the possible factors that affect QC were evaluated. A screening Design of Experiments (DOE) was performed on seven initial factors and identified 3 significant factors. It reflected that one response variable was not required for the optimization process. A full factorial DOE was estimated in order to verify the significant factors obtained previously. The QC strategy optimization is performed through a Genetic Algorithm (GA) which allows the evaluation of several solutions in order to obtain feasible optimal solutions. The GA evaluates possible solutions based on cost, cycle time, reworkability and rework benefit. Finally it provides several possible solutions because this is a multi-objective optimization problem. The solutions are presented as chromosomes that clearly state the amount and location of the rework stations. The user analyzes these solutions in order to select one by deciding which of the four factors considered is most important depending on the product being manufactured or the company's objective. The major contribution of this study is to provide the user with a methodology used to identify an effective and optimal QC strategy that incorporates the number and location of rework substations in order to minimize direct product cost, and cycle time, and maximize reworkability, and rework benefit.

Interventions to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA: a systematic review.

PubMed

Clifford, Anton; McCalman, Janya; Bainbridge, Roxanne; Tsey, Komla

2015-04-01

This article describes the characteristics and reviews the methodological quality of interventions designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA. A total of 17 electronic databases and 13 websites for the period of 2002-13. Studies were included if they evaluated an intervention strategy designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, the USA or Canada. Information on the characteristics and methodological quality of included studies was extracted using standardized assessment tools. Sixteen published evaluations of interventions to improve cultural competency in health care for Indigenous peoples were identified: 11 for Indigenous peoples of the USA and 5 for Indigenous Australians. The main types of intervention strategies were education and training of the health workforce, culturally specific health programs and recruitment of an Indigenous health workforce. Main positive outcomes reported were improvements in health professionals' confidence, and patients' satisfaction with and access to health care. The methodological quality of evaluations and the reporting of key methodological criteria were variable. Particular problems included weak study designs, low or no reporting of consent rates, confounding and non-validated measurement instruments. There is a lack of evidence from rigorous evaluations on the effectiveness of interventions for improving cultural competency in health care for Indigenous peoples. Future evaluations should employ more rigorous study designs and extend their measurement of outcomes beyond those relating to health professionals, to those relating to the health of Indigenous peoples. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Multidrug Resistance among New Tuberculosis Cases: Detecting Local Variation through Lot Quality-Assurance Sampling

PubMed Central

Lynn Hedt, Bethany; van Leth, Frank; Zignol, Matteo; Cobelens, Frank; van Gemert, Wayne; Viet Nhung, Nguyen; Lyepshina, Svitlana; Egwaga, Saidi; Cohen, Ted

2012-01-01

Background Current methodology for multidrug-resistant TB (MDR TB) surveys endorsed by the World Health Organization provides estimates of MDR TB prevalence among new cases at the national level. On the aggregate, local variation in the burden of MDR TB may be masked. This paper investigates the utility of applying lot quality-assurance sampling to identify geographic heterogeneity in the proportion of new cases with multidrug resistance. Methods We simulated the performance of lot quality-assurance sampling by applying these classification-based approaches to data collected in the most recent TB drug-resistance surveys in Ukraine, Vietnam, and Tanzania. We explored three classification systems—two-way static, three-way static, and three-way truncated sequential sampling—at two sets of thresholds: low MDR TB = 2%, high MDR TB = 10%, and low MDR TB = 5%, high MDR TB = 20%. Results The lot quality-assurance sampling systems identified local variability in the prevalence of multidrug resistance in both high-resistance (Ukraine) and low-resistance settings (Vietnam). In Tanzania, prevalence was uniformly low, and the lot quality-assurance sampling approach did not reveal variability. The three-way classification systems provide additional information, but sample sizes may not be obtainable in some settings. New rapid drug-sensitivity testing methods may allow truncated sequential sampling designs and early stopping within static designs, producing even greater efficiency gains. Conclusions Lot quality-assurance sampling study designs may offer an efficient approach for collecting critical information on local variability in the burden of multidrug-resistant TB. Before this methodology is adopted, programs must determine appropriate classification thresholds, the most useful classification system, and appropriate weighting if unbiased national estimates are also desired. PMID:22249242

Systematic reviews of surgical procedures in children: quantity, coverage and quality.

PubMed

McGee, Richard G; Craig, Jonathan C; Rogerson, Thomas E; Webster, Angela C

2013-04-01

Systematic reviews have the potential to map those areas where children are under-represented in surgical research. We aimed to describe and evaluate the quantity, coverage and the quality of conduct and reporting of systematic reviews of surgical procedures in children. We searched four biomedical databases, a systematic review register, reference lists and conducted hand searching to identify relevant reviews. Two reviewers worked independently to critically appraise included studies and abstract data. We assessed reporting quality using the preferred reporting items for systematic reviews and meta-analysis statement and methodological quality using the Assessment of Multiple SysTemAtic Reviews tool. Fifteen systematic reviews were identified, representing 0.01% of all paediatric surgical citations in MEDLINE and Embase. Thirteen of the reviews were Cochrane reviews, and most reviews (12/15) addressed subspecialty interests such as otorhinolaryngology. The median number of included trials per systematic review was four (interquartile range 1 to 9.5), the median number of primary outcomes was 5.5 (interquartile range 3.5 to 7.5). In general, reporting and methodological quality was good although there were several omissions, particularly around completeness of reporting of statistical methods used, and utilisation of quality assessments in analyses. Outcomes were often not clearly defined and descriptions of procedures lacked sufficient detail to determine the similarities and differences among surgical procedures within the contributing trials. Systematic reviews of surgical procedures in children are rarely published. To improve the evidence base and guide research agendas, more systematic reviews should be conducted, using standard guidelines for conduct and reporting. © 2013 The Authors. Journal of Paediatrics and Child Health © 2013 Paediatrics and Child Health Division (Royal Australasian College of Physicians).

Multidrug resistance among new tuberculosis cases: detecting local variation through lot quality-assurance sampling.

PubMed

Hedt, Bethany Lynn; van Leth, Frank; Zignol, Matteo; Cobelens, Frank; van Gemert, Wayne; Nhung, Nguyen Viet; Lyepshina, Svitlana; Egwaga, Saidi; Cohen, Ted

2012-03-01

Current methodology for multidrug-resistant tuberculosis (MDR TB) surveys endorsed by the World Health Organization provides estimates of MDR TB prevalence among new cases at the national level. On the aggregate, local variation in the burden of MDR TB may be masked. This paper investigates the utility of applying lot quality-assurance sampling to identify geographic heterogeneity in the proportion of new cases with multidrug resistance. We simulated the performance of lot quality-assurance sampling by applying these classification-based approaches to data collected in the most recent TB drug-resistance surveys in Ukraine, Vietnam, and Tanzania. We explored 3 classification systems- two-way static, three-way static, and three-way truncated sequential sampling-at 2 sets of thresholds: low MDR TB = 2%, high MDR TB = 10%, and low MDR TB = 5%, high MDR TB = 20%. The lot quality-assurance sampling systems identified local variability in the prevalence of multidrug resistance in both high-resistance (Ukraine) and low-resistance settings (Vietnam). In Tanzania, prevalence was uniformly low, and the lot quality-assurance sampling approach did not reveal variability. The three-way classification systems provide additional information, but sample sizes may not be obtainable in some settings. New rapid drug-sensitivity testing methods may allow truncated sequential sampling designs and early stopping within static designs, producing even greater efficiency gains. Lot quality-assurance sampling study designs may offer an efficient approach for collecting critical information on local variability in the burden of multidrug-resistant TB. Before this methodology is adopted, programs must determine appropriate classification thresholds, the most useful classification system, and appropriate weighting if unbiased national estimates are also desired.

Integrated care programmes for adults with chronic conditions: a meta-review.

PubMed

Martínez-González, Nahara Anani; Berchtold, Peter; Ullman, Klara; Busato, André; Egger, Matthias

2014-10-01

To review systematic reviews and meta-analyses of integrated care programmes in chronically ill patients, with a focus on methodological quality, elements of integration assessed and effects reported. Meta-review of systematic reviews and meta-analyses identified in Medline (1946-March 2012), Embase (1980-March 2012), CINHAL (1981-March 2012) and the Cochrane Library of Systematic Reviews (issue 1, 2012). Methodological quality assessed by the 11-item Assessment of Multiple Systematic Reviews (AMSTAR) checklist; elements of integration assessed using a published list of 10 key principles of integration; effects on patient-centred outcomes, process quality, use of healthcare and costs. Twenty-seven systematic reviews were identified; conditions included chronic heart failure (CHF; 12 reviews), diabetes mellitus (DM; seven reviews), chronic obstructive pulmonary disease (COPD; seven reviews) and asthma (five reviews). The median number of AMSTAR checklist items met was five: few reviewers searched for unpublished literature or described the primary studies and interventions in detail. Most reviews covered comprehensive services across the care continuum or standardization of care through inter-professional teams, but organizational culture, governance structure or financial management were rarely assessed. A majority of reviews found beneficial effects of integration, including reduced hospital admissions and re-admissions (in CHF and DM), improved adherence to treatment guidelines (DM, COPD and asthma) or quality of life (DM). Few reviews showed reductions in costs. Systematic reviews of integrated care programmes were of mixed quality, assessed only some components of integration of care, and showed consistent benefits for some outcomes but not others. © The Author 2014. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

PubMed Central

Boulkedid, Rym; Abdoul, Hendy; Loustau, Marine; Sibony, Olivier; Alberti, Corinne

2011-01-01

Objective Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. Methodology and Main Finding Three electronic data bases were searched over a 30 years period (1978–2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. Conclusion The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys. PMID:21694759

Assessment of Patient Empowerment - A Systematic Review of Measures

PubMed Central

Barr, Paul J.; Scholl, Isabelle; Bravo, Paulina; Faber, Marjan J.; Elwyn, Glyn; McAllister, Marion

2015-01-01

Background Patient empowerment has gained considerable importance but uncertainty remains about the best way to define and measure it. The validity of empirical findings depends on the quality of measures used. This systematic review aims to provide an overview of studies assessing psychometric properties of questionnaires purporting to capture patient empowerment, evaluate the methodological quality of these studies and assess the psychometric properties of measures identified. Methods Electronic searches in five databases were combined with reference tracking of included articles. Peer-reviewed articles reporting psychometric testing of empowerment measures for adult patients in French, German, English, Portuguese and Spanish were included. Study characteristics, constructs operationalised and psychometric properties were extracted. The quality of study design, methods and reporting was assessed using the COSMIN checklist. The quality of psychometric properties was assessed using Terwee’s 2007 criteria. Findings 30 studies on 19 measures were included. Six measures are generic, while 13 were developed for a specific condition (N=4) or specialty (N=9). Most studies tested measures in English (N=17) or Swedish (N=6). Sample sizes of included studies varied from N=35 to N=8261. A range of patient empowerment constructs was operationalised in included measures. These were classified into four domains: patient states, experiences and capacities; patient actions and behaviours; patient self-determination within the healthcare relationship and patient skills development. Quality assessment revealed several flaws in methodological study quality with COSMIN scores mainly fair or poor. The overall quality of psychometric properties of included measures was intermediate to positive. Certain psychometric properties were not tested for most measures. Discussion Findings provide a basis from which to develop consensus on a core set of patient empowerment constructs and for further work to develop a (set of) appropriately validated measure(s) to capture this. The methodological quality of psychometric studies could be improved by adhering to published quality criteria. PMID:25970618

Water resources vulnerability assessment in the Adriatic Sea region: the case of Corfu Island.

PubMed

Kanakoudis, Vasilis; Tsitsifli, Stavroula; Papadopoulou, Anastasia; Cencur Curk, Barbara; Karleusa, Barbara

2017-09-01

Cross-border water resources management and protection is a complicated task to achieve, lacking a common methodological framework. Especially in the Adriatic region, water used for drinking water supply purposes pass from many different countries, turning its management into a hard task to achieve. During the DRINKADRIA project, a common methodological framework has been developed, for efficient and effective cross-border water supply and resources management, taking into consideration different resources types (surface and groundwater) emphasizing in drinking water supply intake. The common methodology for water resources management is based on four pillars: climate characteristics and climate change, water resources availability, quality, and security. The present paper assesses both present and future vulnerability of water resources in the Adriatic region, with special focus on Corfu Island, Greece. The results showed that climate change is expected to impact negatively on water resources availability while at the same time, water demand is expected to increase. Water quality problems will be intensified especially due to land use changes and salt water intrusion. The analysis identified areas where water resources are more vulnerable, allowing decision makers develop management strategies.

Improving the completion of Quality Improvement projects amongst psychiatry core trainees.

PubMed

Ewins, Liz

2015-01-01

Quality Improvement (QI) projects are seen increasingly as more valuable and effective in developing services than traditional audit. However, the development of this methodology has been slower in the mental health field and QI projects are new to most psychiatrists. This project describes a way of engaging trainees across Avon and Wiltshire Mental Health Partnership (AWP) Trust and the Severn School of Psychiatry in QI projects, using QI methodology itself. Through the implementation and development of training sessions and simple, low cost and sustainable interventions over a 10 month period, two thirds of core trainees and over a half of the advanced psychiatry trainees in the School are now participating in 28 individual QI projects and QI project methodology is to become embedded in the core psychiatry training course. As an additional positive outcome, specialty doctors, consultants, foundation doctors, GP trainees, medical students, as well as the wider multidisciplinary team, have all become engaged in QI projects alongside trainees, working with service users and their families to identify problems to tackle and ideas to test.

Implementation and evaluation of a multisite drug usage evaluation program across Australian hospitals - a quality improvement initiative

PubMed Central

2011-01-01

Background With the use of medicines being a broad and extensive part of health management, mechanisms to ensure quality use of medicines are essential. Drug usage evaluation (DUE) is an evidence-based quality improvement methodology, designed to improve the quality, safety and cost-effectiveness of drug use. The purpose of this paper is to describe a national DUE methodology used to improve health care delivery across the continuum through multi-faceted intervention involving audit and feedback, academic detailing and system change, and a qualitative assessment of the methodology, as illustrated by the Acute Postoperative Pain Management (APOP) project. Methods An established methodology, consisting of a baseline audit of inpatient medical records, structured patient interviews and general practitioner surveys, followed by an educational intervention and follow-up audit, is used. Australian hospitals, including private, public, metropolitan and regional, are invited to participate on a voluntary basis. De-identified data collected by hospitals are collated and evaluated nationally to provide descriptive comparative analyses. Hospitals benchmark their practices against state and national results to facilitate change. The educational intervention consists of academic detailing, group education, audit and feedback, point-of-prescribing prompts and system changes. A repeat data collection is undertaken to assess changes in practice. An online qualitative survey was undertaken to evaluate the APOP program. Qualitative assessment of hospitals' perceptions of the effectiveness of the overall DUE methodology and changes in procedure/prescribing/policy/clinical practice which resulted from participation were elicited. Results 62 hospitals participated in the APOP project. Among 23 respondents to the evaluation survey, 18 (78%) reported improvements in the documentation of pain scores at their hospital. 15 (65%) strongly agreed or agreed that participation in APOP directly resulted in increased prescribing of multimodal analgesia for pain relief in postoperative patients. Conclusions This national DUE program has facilitated the engagement and participation of a number of acute health care facilities to address issues relating to quality use of medicine. This approach has been perceived to be effective in helping them achieve improvements in patient care. PMID:21871132

Implementation and evaluation of a multisite drug usage evaluation program across Australian hospitals - a quality improvement initiative.

PubMed

Pulver, Lisa K; Wai, Angela; Maxwell, David J; Robertson, Marion B; Riddell, Steven

2011-08-29

With the use of medicines being a broad and extensive part of health management, mechanisms to ensure quality use of medicines are essential. Drug usage evaluation (DUE) is an evidence-based quality improvement methodology, designed to improve the quality, safety and cost-effectiveness of drug use. The purpose of this paper is to describe a national DUE methodology used to improve health care delivery across the continuum through multi-faceted intervention involving audit and feedback, academic detailing and system change, and a qualitative assessment of the methodology, as illustrated by the Acute Postoperative Pain Management (APOP) project. An established methodology, consisting of a baseline audit of inpatient medical records, structured patient interviews and general practitioner surveys, followed by an educational intervention and follow-up audit, is used. Australian hospitals, including private, public, metropolitan and regional, are invited to participate on a voluntary basis. De-identified data collected by hospitals are collated and evaluated nationally to provide descriptive comparative analyses. Hospitals benchmark their practices against state and national results to facilitate change. The educational intervention consists of academic detailing, group education, audit and feedback, point-of-prescribing prompts and system changes. A repeat data collection is undertaken to assess changes in practice.An online qualitative survey was undertaken to evaluate the APOP program. Qualitative assessment of hospitals' perceptions of the effectiveness of the overall DUE methodology and changes in procedure/prescribing/policy/clinical practice which resulted from participation were elicited. 62 hospitals participated in the APOP project. Among 23 respondents to the evaluation survey, 18 (78%) reported improvements in the documentation of pain scores at their hospital. 15 (65%) strongly agreed or agreed that participation in APOP directly resulted in increased prescribing of multimodal analgesia for pain relief in postoperative patients. This national DUE program has facilitated the engagement and participation of a number of acute health care facilities to address issues relating to quality use of medicine. This approach has been perceived to be effective in helping them achieve improvements in patient care.

Worldwide trends in volume and quality of published protocols of randomized controlled trials

PubMed Central

Alldinger, Ingo; Cieslak, Kasia P.; Wennink, Roos; Clarke, Mike; Ali, Usama Ahmed; Besselink, Marc G. H.

2017-01-01

Introduction Publishing protocols of randomized controlled trials (RCT) facilitates a more detailed description of study rational, design, and related ethical and safety issues, which should promote transparency. Little is known about how the practice of publishing protocols developed over time. Therefore, this study describes the worldwide trends in volume and methodological quality of published RCT protocols. Methods A systematic search was performed in PubMed and EMBASE, identifying RCT protocols published over a decade from 1 September 2001. Data were extracted on quality characteristics of RCT protocols. The primary outcome, methodological quality, was assessed by individual methodological characteristics (adequate generation of allocation, concealment of allocation and intention-to-treat analysis). A comparison was made by publication period (First, September 2001- December 2004; Second, January 2005-May 2008; Third, June 2008-September 2011), geographical region and medical specialty. Results The number of published RCT protocols increased from 69 in the first, to 390 in the third period (p<0.0001). Internal medicine and paediatrics were the most common specialty topics. Whereas most published RCT protocols in the first period originated from North America (n = 30, 44%), in the second and third period this was Europe (respectively, n = 65, 47% and n = 190, 48%, p = 0.02). Quality of RCT protocols was higher in Europe and Australasia, compared to North America (OR = 0.63, CI = 0.40–0.99, p = 0.04). Adequate generation of allocation improved with time (44%, 58%, 67%, p = 0.001), as did concealment of allocation (38%, 53%, 55%, p = 0.03). Surgical protocols had the highest quality among the three specialty topics used in this study (OR = 1.94, CI = 1.09–3.45, p = 0.02). Conclusion Publishing RCT protocols has become popular, with a five-fold increase in the past decade. The quality of published RCT protocols also improved, although variation between geographical regions and across medical specialties was seen. This emphasizes the importance of international standards of comprehensive training in RCT methodology. PMID:28296925

Integrating teamwork, clinician occupational well-being and patient safety - development of a conceptual framework based on a systematic review.

PubMed

Welp, Annalena; Manser, Tanja

2016-07-19

There is growing evidence that teamwork in hospitals is related to both patient outcomes and clinician occupational well-being. Furthermore, clinician well-being is associated with patient safety. Despite considerable research activity, few studies include all three concepts, and their interrelations have not yet been investigated systematically. To advance our understanding of these potentially complex interrelations we propose an integrative framework taking into account current evidence and research gaps identified in a systematic review. We conducted a literature search in six major databases (Medline, PsycArticles, PsycInfo, Psyndex, ScienceDirect, and Web of Knowledge). Inclusion criteria were: peer reviewed papers published between January 2000 and June 2015 investigating a statistical relationship between at least two of the three concepts; teamwork, patient safety, and clinician occupational well-being in hospital settings, including practicing nurses and physicians. We assessed methodological quality using a standardized rating system and qualitatively appraised and extracted relevant data, such as instruments, analyses and outcomes. The 98 studies included in this review were highly diverse regarding quality, methodology and outcomes. We found support for the existence of independent associations between teamwork, clinician occupational well-being and patient safety. However, we identified several conceptual and methodological limitations. The main barrier to advancing our understanding of the causal relationships between teamwork, clinician well-being and patient safety is the lack of an integrative, theory-based, and methodologically thorough approach investigating the three concepts simultaneously and longitudinally. Based on psychological theory and our findings, we developed an integrative framework that addresses these limitations and proposes mechanisms by which these concepts might be linked. Knowledge about the mechanisms underlying the relationships between these concepts helps to identify avenues for future research, aimed at benefiting clinicians and patients by using the synergies between teamwork, clinician occupational well-being and patient safety.

Analyzing the impacts of global trade and investment on non-communicable diseases and risk factors: a critical review of methodological approaches used in quantitative analyses.

PubMed

Cowling, Krycia; Thow, Anne Marie; Pollack Porter, Keshia

2018-05-24

A key mechanism through which globalization has impacted health is the liberalization of trade and investment, yet relatively few studies to date have used quantitative methods to investigate the impacts of global trade and investment policies on non-communicable diseases and risk factors. Recent reviews of this literature have found heterogeneity in results and a range of quality across studies, which may be in part attributable to a lack of conceptual clarity and methodological inconsistencies. This study is a critical review of methodological approaches used in the quantitative literature on global trade and investment and diet, tobacco, alcohol, and related health outcomes, with the objective of developing recommendations and providing resources to guide future robust, policy relevant research. A review of reviews, expert review, and reference tracing were employed to identify relevant studies, which were evaluated using a novel quality assessment tool designed for this research. Eight review articles and 34 quantitative studies were identified for inclusion. Important ways to improve this literature were identified and discussed: clearly defining exposures of interest and not conflating trade and investment; exploring mechanisms of broader relationships; increasing the use of individual-level data; ensuring consensus and consistency in key confounding variables; utilizing more sector-specific versus economy-wide trade and investment indicators; testing and adequately adjusting for autocorrelation and endogeneity when using longitudinal data; and presenting results from alternative statistical models and sensitivity analyses. To guide the development of future analyses, recommendations for international data sources for selected trade and investment indicators, as well as key gaps in the literature, are presented. More methodologically rigorous and consistent approaches in future quantitative studies on the impacts of global trade and investment policies on non-communicable diseases and risk factors can help to resolve inconsistencies of existing research and generate useful information to guide policy decisions.

Lean interventions in healthcare: do they actually work? A systematic literature review

PubMed Central

Moraros, John; Lemstra, Mark; Nwankwo, Chijioke

2016-01-01

Purpose Lean is a widely used quality improvement methodology initially developed and used in the automotive and manufacturing industries but recently expanded to the healthcare sector. This systematic literature review seeks to independently assess the effect of Lean or Lean interventions on worker and patient satisfaction, health and process outcomes, and financial costs. Data sources We conducted a systematic literature review of Medline, PubMed, Cochrane Library, CINAHL, Web of Science, ABI/Inform, ERIC, EMBASE and SCOPUS. Study selection Peer reviewed articles were included if they examined a Lean intervention and included quantitative data. Methodological quality was assessed using validated critical appraisal checklists. Publically available data collected by the Saskatchewan Health Quality Council and the Saskatchewan Union of Nurses were also analysed and reported separately. Data extraction Data on design, methods, interventions and key outcomes were extracted and collated. Results of data synthesis Our electronic search identified 22 articles that passed methodological quality review. Among the accepted studies, 4 were exclusively concerned with health outcomes, 3 included both health and process outcomes and 15 included process outcomes. Our study found that Lean interventions have: (i) no statistically significant association with patient satisfaction and health outcomes; (ii) a negative association with financial costs and worker satisfaction and (iii) potential, yet inconsistent, benefits on process outcomes like patient flow and safety. Conclusion While some may strongly believe that Lean interventions lead to quality improvements in healthcare, the evidence to date simply does not support this claim. More rigorous, higher quality and better conducted scientific research is required to definitively ascertain the impact and effectiveness of Lean in healthcare settings. PMID:26811118

Dementia ascertainment using existing data in UK longitudinal and cohort studies: a systematic review of methodology.

PubMed

Sibbett, Ruth A; Russ, Tom C; Deary, Ian J; Starr, John M

2017-07-03

Studies investigating the risk factors for or causation of dementia must consider subjects prior to disease onset. To overcome the limitations of prospective studies and self-reported recall of information, the use of existing data is key. This review provides a narrative account of dementia ascertainment methods using sources of existing data. The literature search was performed using: MEDLINE, EMBASE, PsychInfo and Web of Science. Included articles reported a UK-based study of dementia in which cases were ascertained using existing data. Existing data included that which was routinely collected and that which was collected for previous research. After removing duplicates, abstracts were screened and the remaining articles were included for full-text review. A quality tool was used to evaluate the description of the ascertainment methodology. Of the 3545 abstracts screened, 360 articles were selected for full-text review. 47 articles were included for final consideration. Data sources for ascertainment included: death records, national datasets, research databases and hospital records among others. 36 articles used existing data alone for ascertainment, of which 27 used only a single data source. The most frequently used source was a research database. Quality scores ranged from 7/16 to 16/16. Quality scores were better for articles with dementia ascertainment as an outcome. Some papers performed validation studies of dementia ascertainment and most indicated that observed rates of dementia were lower than expected. We identified a lack of consistency in dementia ascertainment methodology using existing data. With no data source identified as a "gold-standard", we suggest the use of multiple sources. Where possible, studies should access records with evidence to confirm the diagnosis. Studies should also calculate the dementia ascertainment rate for the population being studied to enable a comparison with an expected rate.

Four years of early benefit assessment of new drugs in Germany: a qualitative study on methodological requirements for quality of life data.

PubMed

Blome, Christine; Augustin, Matthias; Metin, Hidayet; Lohrberg, David

2017-03-01

Since 2011, an early benefit assessment (EBA) of new drugs constricts free price setting in Germany. According to the Pharmaceutical Market Restructuring Act (AMNOG), pharmaceutical companies are obliged to demonstrate added benefit of new drugs over comparative treatment. Benefit is usually evaluated by the Institute for Quality and Efficiency in Health Care (IQWiG). The final appraisal is made by the Federal Joint Committee, Germany's highest-ranking decision body in the health sector, triggering drug prize negotiations between companies and statutory health insurance funds. One of four evaluation criteria is quality of life (QoL). QoL outcomes have, however, only rarely been pivotal in EBAs. This study determined methodological requirements for QoL measurement and data presentation in the EBA. In a qualitative content analysis, documents of all EBAs completed by 2014 were searched for the term QoL. Relevant passages of all EBAs of 2011-2013 were independently extracted and reduced to key content by two researchers. Recurring patterns were identified and verified through comparison with EBAs of 2014. We identified a range of requirements regarding QoL assessment, analysis, presentation, and interpretation, which go beyond official regulations. Disease-specific questionnaires are preferred and have to be validated according to certain standards and in the respective patient group. Effects must exceed the minimal important difference, which in turn must be validated in compliance with specific requirements. Often, instruments were not accepted as QoL measures, sometimes inconsistently across EBAs. Another frequent reason for non-acceptance of QoL data was that more than 30 % of randomized patients could not be analyzed due to missing data. Non-compliance with methodological requirements for QoL evidence impairs chances for positive benefit evaluation.

Cognitive remediation in schizophrenia: A methodological appraisal of systematic reviews and meta-analyses.

PubMed

Bryce, Shayden; Sloan, Elise; Lee, Stuart; Ponsford, Jennie; Rossell, Susan

2016-04-01

Systematic reviews and meta-analyses are a primary source of evidence when evaluating the benefit(s) of cognitive remediation (CR) in schizophrenia. These studies are designed to rigorously synthesize scientific literature; however, cannot be assumed to be of high methodological quality. The aims of this report were to: 1) review the use of systematic reviews and meta-analyses regarding CR in schizophrenia; 2) conduct a systematic methodological appraisal of published reports examining the benefits of this intervention on core outcome domains; and 3) compare the correspondence between methodological and reporting quality. Electronic databases were searched for relevant articles. Twenty-one reviews met inclusion criteria and were scored according to the AMSTAR checklist-a validated scale of methodological quality. Five meta-analyses were also scored according to PRISMA statement to compare 'quality of conduct' with 'quality of reporting'. Most systematic reviews and meta-analyses shared strengths and fell within a 'medium' level of methodological quality. Nevertheless, there were consistent areas of potential weakness that were not addressed by most reviews. These included the lack of protocol registration, uncertainty regarding independent data extraction and consensus procedures, and the minimal assessment of publication bias. Moreover, quality of conduct may not necessarily parallel quality of reporting, suggesting that consideration of these methods independently may be important. Reviews concerning CR for schizophrenia are a valuable source of evidence. However, the methodological quality of these reports may require additional consideration. Enhancing quality of conduct is essential for enabling research literature to be interpreted with confidence. Copyright © 2016 Elsevier Ltd. All rights reserved.

Cumulative impact assessment: Application of a methodology

DOE Office of Scientific and Technical Information (OSTI.GOV)

Witmer, G.W.; Bain, M.B.; Irving, J.S.

We expanded upon the Federal Energy Regulatory Commission's (FERC) Cluster Impact Assessment Procedure (CIAP) to provide a practical methodology for assessing potential cumulative impacts from multiple hydroelectric projects within a river basin. The objectives in designing the methodology were to allow the evaluation of a large number of combinations of proposed projects and to minimize constraints on the use of ecological knowledge for planning and regulating hydroelectric development at the river basin level. Interactive workshops and evaluative matrices were used to identify preferred development scenarios in the Snohomish (Washington) and Salmon (Idaho) River Basins. Although the methodology achieved its basicmore » objectives, some difficulties were encountered. These revolved around issues of (1) data quality and quantity, (2) alternatives analysis, (3) determination of project interactions, (4) determination of cumulative impact thresholds, and (5) the use of evaluative techniques to express degrees of impact. 8 refs., 1 fig., 2 tabs.« less

Abstract analysis method facilitates filtering low-methodological quality and high-bias risk systematic reviews on psoriasis interventions.

PubMed

Gómez-García, Francisco; Ruano, Juan; Aguilar-Luque, Macarena; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesús; Hernández-Romero, José Luis; Sanz-Cabanillas, Juan Luis; Maestre-López, Beatriz; González-Padilla, Marcelino; Carmona-Fernández, Pedro J; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-29

Article summaries' information and structure may influence researchers/clinicians' decisions to conduct deeper full-text analyses. Specifically, abstracts of systematic reviews (SRs) and meta-analyses (MA) should provide structured summaries for quick assessment. This study explored a method for determining the methodological quality and bias risk of full-text reviews using abstract information alone. Systematic literature searches for SRs and/or MA about psoriasis were undertaken on MEDLINE, EMBASE, and Cochrane database. For each review, quality, abstract-reporting completeness, full-text methodological quality, and bias risk were evaluated using Preferred Reporting Items for Systematic Reviews and Meta-analyses for abstracts (PRISMA-A), Assessing the Methodological Quality of Systematic Reviews (AMSTAR), and ROBIS tools, respectively. Article-, author-, and journal-derived metadata were systematically extracted from eligible studies using a piloted template, and explanatory variables concerning abstract-reporting quality were assessed using univariate and multivariate-regression models. Two classification models concerning SRs' methodological quality and bias risk were developed based on per-item and total PRISMA-A scores and decision-tree algorithms. This work was supported, in part, by project ICI1400136 (JR). No funding was received from any pharmaceutical company. This study analysed 139 SRs on psoriasis interventions. On average, they featured 56.7% of PRISMA-A items. The mean total PRISMA-A score was significantly higher for high-methodological-quality SRs than for moderate- and low-methodological-quality reviews. SRs with low-bias risk showed higher total PRISMA-A values than reviews with high-bias risk. In the final model, only 'authors per review > 6' (OR: 1.098; 95%CI: 1.012-1.194), 'academic source of funding' (OR: 3.630; 95%CI: 1.788-7.542), and 'PRISMA-endorsed journal' (OR: 4.370; 95%CI: 1.785-10.98) predicted PRISMA-A variability. Reviews with a total PRISMA-A score < 6, lacking identification as SR or MA in the title, and lacking explanation concerning bias risk assessment methods were classified as low-methodological quality. Abstracts with a total PRISMA-A score ≥ 9, including main outcomes results and explanation bias risk assessment method were classified as having low-bias risk. The methodological quality and bias risk of SRs may be determined by abstract's quality and completeness analyses. Our proposal aimed to facilitate synthesis of evidence evaluation by clinical professionals lacking methodological skills. External validation is necessary.

Prevalence of Chronic Health Conditions in Children with Intellectual Disability: A Systematic Literature Review

ERIC Educational Resources Information Center

Oeseburg, Barth; Dijkstra, Geke J.; Groothoff, Johan W.; Reijneveld, Sijmen A.; Jansen, Danielle E. M. C.

2011-01-01

A systematic review of the prevalence rates of chronic health conditions in populations of children with intellectual disability was provided. We identified 2,994 relevant studies by searching Medline, Cinahl, and PsycINFO databases from 1996 to 2008. We included the 31 studies that had sufficient methodological quality. The 6 most prevalent…

Factors Associated with Social Interactions between Deaf Children and Their Hearing Peers: A Systematic Literature Review

ERIC Educational Resources Information Center

Batten, Georgina; Oakes, Peter M.; Alexander, Tim

2014-01-01

Research indicates that deaf children can have marked social difficulties compared with their hearing peers. Factors that influence these social interactions need to be reviewed to inform interventions. A systematic search of 5 key databases and 3 specialized journals identified 14 papers that met the inclusion criteria. Methodological quality of…

A Systematic Review of the Prevalence of Psychiatric Disorders in Adults with Intellectual Disability, 2003-2010

ERIC Educational Resources Information Center

Buckles, Jason; Luckasson, Ruth; Keefe, Elizabeth

2013-01-01

Research regarding the prevalence of psychiatric conditions co-occurring with intellectual disability in adults was reviewed. Particular attention was paid to the qualities of sampling and diagnostic methodology, which have been identified as needs in two recent reviews. Sixteen articles published in peer-reviewed journals between 2003 and 2009…

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed

Lexchin, J; Holbrook, A

1994-07-01

To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). Analytic study. All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion.

Evolution of the methodological quality of controlled clinical trials for myofascial trigger point treatments for the period 1978-2015: A systematic review.

PubMed

Stoop, Rahel; Clijsen, Ron; Leoni, Diego; Soldini, Emiliano; Castellini, Greta; Redaelli, Valentina; Barbero, Marco

2017-08-01

The methodological quality of controlled clinical trials (CCTs) of physiotherapeutic treatment modalities for myofascial trigger points (MTrP) has not been investigated yet. To detect the methodological quality of CCTs for physiotherapy treatments of MTrPs and demonstrating the possible increase over time. Systematic review. A systematic search was conducted in two databases, Physiotherapy Evidence Database (PEDro) and Medicine Medical Literature Analysis and Retrieval System online (MEDLINE), using the same keywords and selection procedure corresponding to pre-defined inclusion criteria. The methodological quality, assessed by the 11-item PEDro scale, served as outcome measure. The CCTs had to compare at least two interventions, where one intervention had to lay within the scope of physiotherapy. Participants had to be diagnosed with myofascial pain syndrome or trigger points (active or latent). A total of n = 230 studies was analysed. The cervico-thoracic region was the most frequently treated body part (n = 143). Electrophysical agent applications was the most frequent intervention. The average methodological quality reached 5.5 on the PEDro scale. A total of n = 6 studies scored the value of 9. The average PEDro score increased by 0.7 points per decade between 1978 and 2015. The average PEDro score of CCTs for MTrP treatments does not reach the cut-off of 6 proposed for moderate to high methodological quality. Nevertheless, a promising trend towards an increase of the average methodological quality of CCTs for MTrPs was recorded. More high-quality CCT studies with thorough research procedures are recommended to enhance methodological quality. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed Central

Lexchin, J; Holbrook, A

1994-01-01

OBJECTIVE: To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). DESIGN: Analytic study. DATA SOURCE: All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. MAIN OUTCOME MEASURES: Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. MAIN RESULTS: Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. CONCLUSIONS: Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion. PMID:8004560

What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary.

PubMed

Pollock, Michelle; Fernandes, Ricardo M; Becker, Lorne A; Featherstone, Robin; Hartling, Lisa

2016-11-14

Overviews of reviews (overviews) compile data from multiple systematic reviews to provide a single synthesis of relevant evidence for decision-making. Despite their increasing popularity, there is limited methodological guidance available for researchers wishing to conduct overviews. The objective of this scoping review is to identify and collate all published and unpublished documents containing guidance for conducting overviews examining the efficacy, effectiveness, and/or safety of healthcare interventions. Our aims were to provide a map of existing guidance documents; identify similarities, differences, and gaps in the guidance contained within these documents; and identify common challenges involved in conducting overviews. We conducted an iterative and extensive search to ensure breadth and comprehensiveness of coverage. The search involved reference tracking, database and web searches (MEDLINE, EMBASE, DARE, Scopus, Cochrane Methods Studies Database, Google Scholar), handsearching of websites and conference proceedings, and contacting overview producers. Relevant guidance statements and challenges encountered were extracted, edited, grouped, abstracted, and presented using a qualitative metasummary approach. We identified 52 guidance documents produced by 19 research groups. Relatively consistent guidance was available for the first stages of the overview process (deciding when and why to conduct an overview, specifying the scope, and searching for and including systematic reviews). In contrast, there was limited or conflicting guidance for the latter stages of the overview process (quality assessment of systematic reviews and their primary studies, collecting and analyzing data, and assessing quality of evidence), and many of the challenges identified were also related to these stages. An additional, overarching challenge identified was that overviews are limited by the methods, reporting, and coverage of their included systematic reviews. This compilation of methodological guidance for conducting overviews of healthcare interventions will facilitate the production of future overviews and can help authors address key challenges they are likely to encounter. The results of this project have been used to identify areas where future methodological research is required to generate empirical evidence for overview methods. Additionally, these results have been used to update the chapter on overviews in the next edition of the Cochrane Handbook for Systematic Reviews of Interventions.

A scoping review on the conduct and reporting of scoping reviews.

PubMed

Tricco, Andrea C; Lillie, Erin; Zarin, Wasifa; O'Brien, Kelly; Colquhoun, Heather; Kastner, Monika; Levac, Danielle; Ng, Carmen; Sharpe, Jane Pearson; Wilson, Katherine; Kenny, Meghan; Warren, Rachel; Wilson, Charlotte; Stelfox, Henry T; Straus, Sharon E

2016-02-09

Scoping reviews are used to identify knowledge gaps, set research agendas, and identify implications for decision-making. The conduct and reporting of scoping reviews is inconsistent in the literature. We conducted a scoping review to identify: papers that utilized and/or described scoping review methods; guidelines for reporting scoping reviews; and studies that assessed the quality of reporting of scoping reviews. We searched nine electronic databases for published and unpublished literature scoping review papers, scoping review methodology, and reporting guidance for scoping reviews. Two independent reviewers screened citations for inclusion. Data abstraction was performed by one reviewer and verified by a second reviewer. Quantitative (e.g. frequencies of methods) and qualitative (i.e. content analysis of the methods) syntheses were conducted. After searching 1525 citations and 874 full-text papers, 516 articles were included, of which 494 were scoping reviews. The 494 scoping reviews were disseminated between 1999 and 2014, with 45% published after 2012. Most of the scoping reviews were conducted in North America (53%) or Europe (38%), and reported a public source of funding (64%). The number of studies included in the scoping reviews ranged from 1 to 2600 (mean of 118). Using the Joanna Briggs Institute methodology guidance for scoping reviews, only 13% of the scoping reviews reported the use of a protocol, 36% used two reviewers for selecting citations for inclusion, 29% used two reviewers for full-text screening, 30% used two reviewers for data charting, and 43% used a pre-defined charting form. In most cases, the results of the scoping review were used to identify evidence gaps (85%), provide recommendations for future research (84%), or identify strengths and limitations (69%). We did not identify any guidelines for reporting scoping reviews or studies that assessed the quality of scoping review reporting. The number of scoping reviews conducted per year has steadily increased since 2012. Scoping reviews are used to inform research agendas and identify implications for policy or practice. As such, improvements in reporting and conduct are imperative. Further research on scoping review methodology is warranted, and in particular, there is need for a guideline to standardize reporting.

Chinese herbal medicine for cancer-related fatigue: a systematic review of randomized clinical trials.

PubMed

Su, Chun-Xiang; Wang, Li-Qiong; Grant, Suzanne J; Liu, Jian-Ping

2014-06-01

To assess the effectiveness and safety of Chinese herbal medicine for the treatment of cancer-related fatigue. We systematically searched seven electronic databases and two trial registries for randomized clinical trials of Chinese herbal medicine for cancer-related fatigue. Two authors independently extracted data and assessed the methodological quality of the included trials using the Cochrane risk of bias tool. Data were synthesized using RevMan 5.2 software. A total of 10 trials involving 751 participants with cancer-related fatigue were identified and the methodological quality of the included trials was generally poor. Chinese herbal medicine used alone or in combination with chemotherapy or supportive care showed significant relief in cancer-related fatigue compared to placebo, chemotherapy or supportive care based on single trials. Chinese herbal medicine plus chemotherapy or supportive care was superior to chemotherapy or supportive care in improving quality of life. Data from one trial demonstrated Chinese herbal medicine exerted a greater beneficial effect on relieving anxiety but no difference in alleviating depression. Seven trials reported adverse events and no severe adverse effects were found in Chinese herbal medicine groups. The findings from limited number of trials suggest that Chinese herbal medicine seems to be effective and safe in the treatment of cancer-related fatigue. However, the current evidence is insufficient to draw a confirmative conclusion due to the poor methodological quality of included trials. Thus, conducting rigorously designed trials on potential Chinese herbal medicine is warranted. Copyright © 2014 Elsevier Ltd. All rights reserved.

The use of cost per life year gained as a measurement of cost-effectiveness in Spain: a systematic review of recent publications.

PubMed

Rodríguez Barrios, José Manuel; Pérez Alcántara, Ferran; Crespo Palomo, Carlos; González García, Paloma; Antón De Las Heras, Enrique; Brosa Riestra, Max

2012-12-01

The objective of this study was to evaluate the methodological characteristics of cost-effectiveness evaluations carried out in Spain, since 1990, which include LYG as an outcome to measure the incremental cost-effectiveness ratio. A systematic review of published studies was conducted describing their characteristics and methodological quality. We analyse the cost per LYG results in relation with a commonly accepted Spanish cost-effectiveness threshold and the possible relation with the cost per quality adjusted life year (QALY) gained when they both were calculated for the same economic evaluation. A total of 62 economic evaluations fulfilled the selection criteria, 24 of them including the cost per QALY gained result as well. The methodological quality of the studies was good (55%) or very good (26%). A total of 124 cost per LYG results were obtained with a mean ratio of 49,529 and a median of 11,490 (standard deviation of 183,080). Since 2003, a commonly accepted Spanish threshold has been referenced by 66% of studies. A significant correlation was found between the cost per LYG and cost per QALY gained results (0.89 Spearman-Rho, 0.91 Pearson). There is an increasing interest for economic health care evaluations in Spain, and the quality of the studies is also improving. Although a commonly accepted threshold exists, further information is needed for decision-making as well as to identify the relationship between the costs per LYG and per QALY gained.

Best evidence on the educational effects of undergraduate portfolios.

PubMed

Buckley, Sharon; Coleman, Jamie; Khan, Khalid

2010-09-01

The great variety of portfolio types and schemes used in the education of health professionals is reflected in the extensive and diverse educational literature relating to portfolio use. We have recently completed a Best Evidence Medical Education (BEME) systematic review of the literature relating to the use of portfolios in the undergraduate setting that offers clinical teachers insights into both their effects on learning and issues to consider in portfolio implementation. Using a methodology based on BEME recommendations, we searched the literature relating to a range of health professions, identifying evidence for the effects of portfolios on undergraduate student learning, and assessing the methodological quality of each study. The higher quality studies in our review report that, when implemented appropriately, portfolios can improve students' ability to integrate theory with practice, can encourage their self-awareness and reflection, and can offer support for students facing difficult emotional situations. Portfolios can also enhance student-tutor relationships and prepare students for the rigours of postgraduate training. However, the time required to complete a portfolio may detract from students' clinical learning. An analysis of methodological quality against year of publication suggests that, across a range of health professions, the quality of the literature relating to the educational effects of portfolios is improving. However, further work is still required to build the evidence base for the educational effects of portfolios, particularly comparative studies that assess effects on learning directly. Our findings have implications for the design and implementation of portfolios in the undergraduate setting. © Blackwell Publishing Ltd 2010.

Tactical Approaches for Trading Science Objectives Against Measurements and Mission Design: Science Traceability Techniques at the Jet Propulsion Laboratory

NASA Astrophysics Data System (ADS)

Nash, A. E., III

2017-12-01

The most common approaches to identifying the most effective mission design to maximize science return from a potential set of competing alternative design approaches are often inefficient and inaccurate. Recently, Team-X at the Jet Propulsion Laboratory undertook an effort to improve both the speed and quality of science - measurement - mission design trade studies. We will report on the methodology & processes employed and their effectiveness in trade study speed and quality. Our results indicate that facilitated subject matter expert peers are the keys to speed and quality improvements in the effectiveness of science - measurement - mission design trade studies.

Crowding measures associated with the quality of emergency department care: a systematic review.

PubMed

Stang, Antonia S; Crotts, Jennifer; Johnson, David W; Hartling, Lisa; Guttmann, Astrid

2015-06-01

Despite the substantial body of literature on emergency department (ED) crowding, to the best of our knowledge, there is no agreement on the measure or measures that should be used to quantify crowding. The objective of this systematic review was to identify existing measures of ED crowding that have been linked to quality of care as defined by the Institute of Medicine (IOM) quality domains (safe, effective, patient-centered, efficient, timely, and equitable). Six major bibliographic databases were searched from January 1980 to January 2012, and hand searches were conducted of relevant journals and conference proceedings. Observational studies (cross-sectional, cohort, and case-control), quality improvement studies, quasi-experimental (e.g., before/after) studies, and randomized controlled trials were considered for inclusion. Studies that did not provide measures of ED crowding were excluded. Studies that did not provide quantitative data on the link between crowding measures and quality of care were also excluded. Two independent reviewers assessed study eligibility, completed data extraction, and assessed study quality using the Newcastle-Ottawa Quality Assessment Scale (NOS) for observational studies and a modified version of the NOS for cross-sectional studies. The search identified 7,413 articles. Thirty-two articles were included in the review: six cross-sectional, one case-control, 23 cohort, and two retrospective reviews of performance improvement data. Methodologic quality was moderate, with weaknesses in the reporting of study design and methodology. Overall, 15 of the crowding measures studied had quantifiable links to quality of care. The three measures most frequently linked to quality of care were the number of patients in the waiting room, ED occupancy (percentage of overall ED beds filled), and the number of admitted patients in the ED awaiting inpatient beds. None of the articles provided data on the link between crowding measures and the IOM domains reflecting equitable and efficient care. The results of this review provide data on the association between ED crowding measures and quality of care. Three simple crowding measures have been linked to quality of care in multiple publications. © 2015 by the Society for Academic Emergency Medicine.

Comparison of methodological quality of positive versus negative comparative studies published in Indian medical journals: a systematic review

PubMed Central

Charan, Jaykaran; Chaudhari, Mayur; Jackson, Ryan; Mhaskar, Rahul; Reljic, Tea; Kumar, Ambuj

2015-01-01

Objectives Published negative studies should have the same rigour of methodological quality as studies with positive findings. However, the methodological quality of negative versus positive studies is not known. The objective was to assess the reported methodological quality of positive versus negative studies published in Indian medical journals. Design A systematic review (SR) was performed of all comparative studies published in Indian medical journals with a clinical science focus and impact factor >1 between 2011 and 2013. The methodological quality of randomised controlled trials (RCTs) was assessed using the Cochrane risk of bias tool, and the Newcastle-Ottawa scale for observational studies. The results were considered positive if the primary outcome was statistically significant and negative otherwise. When the primary outcome was not specified, we used data on the first outcome reported in the history followed by the results section. Differences in various methodological quality domains between positive versus negative studies were assessed by Fisher's exact test. Results Seven journals with 259 comparative studies were included in this SR. 24% (63/259) were RCTs, 24% (63/259) cohort studies, and 49% (128/259) case–control studies. 53% (137/259) of studies explicitly reported the primary outcome. Five studies did not report sufficient data to enable us to determine if results were positive or negative. Statistical significance was determined by p value in 78.3% (199/254), CI in 2.8% (7/254), both p value and CI in 11.8% (30/254), and only descriptive in 6.3% (16/254) of studies. The overall methodological quality was poor and no statistically significant differences between reporting of methodological quality were detected between studies with positive versus negative findings. Conclusions There was no difference in the reported methodological quality of positive versus negative studies. However, the uneven reporting of positive versus negative studies (72% vs 28%) indicates a publication bias in Indian medical journals with an impact factor of >1. PMID:26109118

An overview of maternal separation effects on behavioural outcomes in mice: Evidence from a four-stage methodological systematic review.

PubMed

Tractenberg, Saulo G; Levandowski, Mateus L; de Azeredo, Lucas Araújo; Orso, Rodrigo; Roithmann, Laura G; Hoffmann, Emerson S; Brenhouse, Heather; Grassi-Oliveira, Rodrigo

2016-09-01

Early life stress (ELS) developmental effects have been widely studied by preclinical researchers. Despite the growing body of evidence from ELS models, such as the maternal separation paradigm, the reported results have marked inconsistencies. The maternal separation model has several methodological pitfalls that could influence the reliability of its results. Here, we critically review 94 mice studies that addressed the effects of maternal separation on behavioural outcomes. We also discuss methodological issues related to the heterogeneity of separation protocols and the quality of reporting methods. Our findings indicate a lack of consistency in maternal separation effects: major studies of behavioural and biological phenotypes failed to find significant deleterious effects. Furthermore, we identified several specific variations in separation methodological procedures. These methodological variations could contribute to the inconsistency of maternal separation effects by producing different degrees of stress exposure in maternal separation-reared pups. These methodological problems, together with insufficient reporting, might lead to inaccurate and unreliable effect estimates in maternal separation studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

Methodology of management of dredging operations II. Applications.

PubMed

Junqua, G; Abriak, N E; Gregoire, P; Dubois, V; Mac Farlane, F; Damidot, D

2006-04-01

This paper presents the new methodology of management of dredging operations. Derived partly from existing methodologies (OECD, PNUE, AIPCN), it aims to be more comprehensive, mixing the qualities and the complementarities of previous methodologies. The application of the methodology has been carried out on the site of the Port of Dunkirk (FRANCE). Thus, a characterization of the sediments of this site has allowed a zoning of the Port to be established in to zones of probable homogeneity of sediments. Moreover, sources of pollution have been identified, with an aim of prevention. Ways of waste improvement have also been developed, to answer regional needs, from a point of view of competitive and territorial intelligence. Their development has required a mutualisation of resources between professionals, research centres and local communities, according to principles of industrial ecology. Lastly, a tool of MultiCriteria Decision-Making Aid (M.C.D.M.A.) has been used to determine the most relevant scenario (or alternative, or action) for a dredging operation intended by the Port of Dunkirk. These applications have confirmed the relevance of this methodology for the management of dredging operations.

A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication.

PubMed

Moorhead, S Anne; Hazlett, Diane E; Harrison, Laura; Carroll, Jennifer K; Irwin, Anthea; Hoving, Ciska

2013-04-23

There is currently a lack of information about the uses, benefits, and limitations of social media for health communication among the general public, patients, and health professionals from primary research. To review the current published literature to identify the uses, benefits, and limitations of social media for health communication among the general public, patients, and health professionals, and identify current gaps in the literature to provide recommendations for future health communication research. This paper is a review using a systematic approach. A systematic search of the literature was conducted using nine electronic databases and manual searches to locate peer-reviewed studies published between January 2002 and February 2012. The search identified 98 original research studies that included the uses, benefits, and/or limitations of social media for health communication among the general public, patients, and health professionals. The methodological quality of the studies assessed using the Downs and Black instrument was low; this was mainly due to the fact that the vast majority of the studies in this review included limited methodologies and was mainly exploratory and descriptive in nature. Seven main uses of social media for health communication were identified, including focusing on increasing interactions with others, and facilitating, sharing, and obtaining health messages. The six key overarching benefits were identified as (1) increased interactions with others, (2) more available, shared, and tailored information, (3) increased accessibility and widening access to health information, (4) peer/social/emotional support, (5) public health surveillance, and (6) potential to influence health policy. Twelve limitations were identified, primarily consisting of quality concerns and lack of reliability, confidentiality, and privacy. Social media brings a new dimension to health care as it offers a medium to be used by the public, patients, and health professionals to communicate about health issues with the possibility of potentially improving health outcomes. Social media is a powerful tool, which offers collaboration between users and is a social interaction mechanism for a range of individuals. Although there are several benefits to the use of social media for health communication, the information exchanged needs to be monitored for quality and reliability, and the users' confidentiality and privacy need to be maintained. Eight gaps in the literature and key recommendations for future health communication research were provided. Examples of these recommendations include the need to determine the relative effectiveness of different types of social media for health communication using randomized control trials and to explore potential mechanisms for monitoring and enhancing the quality and reliability of health communication using social media. Further robust and comprehensive evaluation and review, using a range of methodologies, are required to establish whether social media improves health communication practice both in the short and long terms.

Methodology for Knowledge Synthesis of the Management of Vaccination Pain and Needle Fear.

PubMed

Taddio, Anna; McMurtry, C Meghan; Shah, Vibhuti; Yoon, Eugene W; Uleryk, Elizabeth; Pillai Riddell, Rebecca; Lang, Eddy; Chambers, Christine T; Noel, Melanie; MacDonald, Noni E

2015-10-01

A knowledge synthesis was undertaken to inform the development of a revised and expanded clinical practice guideline about managing vaccination pain in children to include the management of pain across the lifespan and the management of fear in individuals with high levels of needle fear. This manuscript describes the methodological details of the knowledge synthesis and presents the list of included clinical questions, critical and important outcomes, search strategy, and search strategy results. The Grading of Assessments, Recommendations, Development and Evaluation (GRADE) and Cochrane methodologies provided the general framework. The project team voted on clinical questions for inclusion and critically important and important outcomes. A broad search strategy was used to identify relevant randomized-controlled trials and quasi-randomized-controlled trials. Quality of research evidence was assessed using the Cochrane risk of bias tool and quality across studies was assessed using GRADE. Multiple measures of the same construct within studies (eg, observer-rated and parent-rated infant distress) were combined before pooling. The standardized mean difference and 95% confidence intervals (CI) or relative risk and 95% CI was used to express the effects of an intervention. Altogether, 55 clinical questions were selected for inclusion in the knowledge synthesis; 49 pertained to pain management during vaccine injections and 6 pertained to fear management in individuals with high levels of needle fear. Pain, fear, and distress were typically prioritized as critically important outcomes across clinical questions. The search strategy identified 136 relevant studies. This manuscript describes the methodological details of a knowledge synthesis about pain management during vaccination and fear management in individuals with high levels of needle fear. Subsequent manuscripts in this series will present the results for the included questions.

A Methodological Critique of the ProPublica Surgeon Scorecard

PubMed Central

Friedberg, Mark W.; Pronovost, Peter J.; Shahian, David M.; Safran, Dana Gelb; Bilimoria, Karl Y.; Elliott, Marc N.; Damberg, Cheryl L.; Dimick, Justin B.; Zaslavsky, Alan M.

2016-01-01

Abstract On July 14, 2015, ProPublica published its Surgeon Scorecard, which displays “Adjusted Complication Rates” for individual, named surgeons for eight surgical procedures performed in hospitals. Public reports of provider performance have the potential to improve the quality of health care that patients receive. A valid performance report can drive quality improvement and usefully inform patients' choices of providers. However, performance reports with poor validity and reliability are potentially damaging to all involved. This article critiques the methods underlying the Scorecard and identifies opportunities for improvement. Until these opportunities are addressed, the authors advise users of the Scorecard—most notably, patients who might be choosing their surgeons—not to consider the Scorecard a valid or reliable predictor of the health outcomes any individual surgeon is likely to provide. The authors hope that this methodological critique will contribute to the development of more-valid and more-reliable performance reports in the future. PMID:28083411

Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria.

PubMed

Lewis, Cara C; Fischer, Sarah; Weiner, Bryan J; Stanick, Cameo; Kim, Mimi; Martinez, Ruben G

2015-11-04

High-quality measurement is critical to advancing knowledge in any field. New fields, such as implementation science, are often beset with measurement gaps and poor quality instruments, a weakness that can be more easily addressed in light of systematic review findings. Although several reviews of quantitative instruments used in implementation science have been published, no studies have focused on instruments that measure implementation outcomes. Proctor and colleagues established a core set of implementation outcomes including: acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, sustainability (Adm Policy Ment Health Ment Health Serv Res 36:24-34, 2009). The Society for Implementation Research Collaboration (SIRC) Instrument Review Project employed an enhanced systematic review methodology (Implement Sci 2: 2015) to identify quantitative instruments of implementation outcomes relevant to mental or behavioral health settings. Full details of the enhanced systematic review methodology are available (Implement Sci 2: 2015). To increase the feasibility of the review, and consistent with the scope of SIRC, only instruments that were applicable to mental or behavioral health were included. The review, synthesis, and evaluation included the following: (1) a search protocol for the literature review of constructs; (2) the literature review of instruments using Web of Science and PsycINFO; and (3) data extraction and instrument quality ratings to inform knowledge synthesis. Our evidence-based assessment rating criteria quantified fundamental psychometric properties as well as a crude measure of usability. Two independent raters applied the evidence-based assessment rating criteria to each instrument to generate a quality profile. We identified 104 instruments across eight constructs, with nearly half (n = 50) assessing acceptability and 19 identified for adoption, with all other implementation outcomes revealing fewer than 10 instruments. Only one instrument demonstrated at least minimal evidence for psychometric strength on all six of the evidence-based assessment criteria. The majority of instruments had no information regarding responsiveness or predictive validity. Implementation outcomes instrumentation is underdeveloped with respect to both the sheer number of available instruments and the psychometric quality of existing instruments. Until psychometric strength is established, the field will struggle to identify which implementation strategies work best, for which organizations, and under what conditions.

A new approach to subjectively assess quality of plenoptic content

NASA Astrophysics Data System (ADS)

Viola, Irene; Řeřábek, Martin; Ebrahimi, Touradj

2016-09-01

Plenoptic content is becoming increasingly popular thanks to the availability of acquisition and display devices. Thanks to image-based rendering techniques, a plenoptic content can be rendered in real time in an interactive manner allowing virtual navigation through the captured scenes. This way of content consumption enables new experiences, and therefore introduces several challenges in terms of plenoptic data processing, transmission and consequently visual quality evaluation. In this paper, we propose a new methodology to subjectively assess the visual quality of plenoptic content. We also introduce a prototype software to perform subjective quality assessment according to the proposed methodology. The proposed methodology is further applied to assess the visual quality of a light field compression algorithm. Results show that this methodology can be successfully used to assess the visual quality of plenoptic content.

Quality and rigor of the concept mapping methodology: a pooled study analysis.

PubMed

Rosas, Scott R; Kane, Mary

2012-05-01

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed. Copyright © 2011 Elsevier Ltd. All rights reserved.

Optimization of oncological {sup 18}F-FDG PET/CT imaging based on a multiparameter analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Menezes, Vinicius O., E-mail: vinicius@radtec.com.br; Machado, Marcos A. D.; Queiroz, Cleiton C.

2016-02-15

Purpose: This paper describes a method to achieve consistent clinical image quality in {sup 18}F-FDG scans accounting for patient habitus, dose regimen, image acquisition, and processing techniques. Methods: Oncological PET/CT scan data for 58 subjects were evaluated retrospectively to derive analytical curves that predict image quality. Patient noise equivalent count rate and coefficient of variation (CV) were used as metrics in their analysis. Optimized acquisition protocols were identified and prospectively applied to 179 subjects. Results: The adoption of different schemes for three body mass ranges (<60 kg, 60–90 kg, >90 kg) allows improved image quality with both point spread functionmore » and ordered-subsets expectation maximization-3D reconstruction methods. The application of this methodology showed that CV improved significantly (p < 0.0001) in clinical practice. Conclusions: Consistent oncological PET/CT image quality on a high-performance scanner was achieved from an analysis of the relations existing between dose regimen, patient habitus, acquisition, and processing techniques. The proposed methodology may be used by PET/CT centers to develop protocols to standardize PET/CT imaging procedures and achieve better patient management and cost-effective operations.« less

A methodology to analyze the quality of health information on the internet: the example of diabetic neuropathy.

PubMed

Chumber, Sundeep; Huber, Jörg; Ghezzi, Pietro

2015-02-01

The purpose of this work was to evaluate the criteria used to assess the quality of information on diabetic neuropathy on the Internet. Different search engines (Google, Yahoo, Bing, and Ask) and 1 governmental health website (MedlinePlus) were studied. The websites returned (200 for each search engine) were then classified according to their affiliation (eg, commercial, professional, patient groups). A scoring system was devised from the literature to assess quality of information. Websites were also analyzed using the 2 most widely used instruments for assessing the quality of health information, the Journal of the American Medical Association (JAMA) scoring system and the Health On the Net Foundation (HON) certification. Professional websites or health portals scored better according to most criteria. Google and MedlinePlus returned results scoring significantly higher than other engines in some of the criteria. The use of different instruments gave different results and indicates that the JAMA score and the HON certification may not be sufficient ones. This methodology could be used to evaluate the reliability and trustworthiness of information on the Internet on different topics to identify topic areas or websites where the available information is not appropriate. © 2014 The Author(s).

Using the Malcolm Baldrige "are we making progress" survey for organizational self-assessment and performance improvement.

PubMed

Shields, Judith A; Jennings, Jerry L

2013-01-01

A national healthcare company applied the Malcolm Baldrige Criteria for Performance Excellence and its "Are We Making Progress?" survey as an annual organizational self-assessment to identify areas for improvement. For 6 years, Liberty Healthcare Corporation reviewed the survey results on an annual basis to analyze positive and negative trends, monitor company progress toward targeted goals and develop new initiatives to address emerging areas for improvement. As such, the survey provided a simple and inexpensive methodology to gain useful information from employees at all levels and from multiple service sites and business sectors. In particular, it provided a valuable framework for assessing and improving the employees' commitment to the company's mission and values, high standards and ethics, quality of work, and customer satisfaction. The methodology also helped the company to incorporate the philosophy and principles of continuous quality improvement in a unified fashion. Corporate and local leadership used the same measure to evaluate the performance of individual programs relative to each other, to the company as a whole, and to the "best practices" standard of highly successful companies that received the Malcolm Baldrige National Quality Award. © 2012 National Association for Healthcare Quality.

An integrated view of data quality in Earth observation

PubMed Central

Yang, X.; Blower, J. D.; Bastin, L.; Lush, V.; Zabala, A.; Masó, J.; Cornford, D.; Díaz, P.; Lumsden, J.

2013-01-01

Data quality is a difficult notion to define precisely, and different communities have different views and understandings of the subject. This causes confusion, a lack of harmonization of data across communities and omission of vital quality information. For some existing data infrastructures, data quality standards cannot address the problem adequately and cannot fulfil all user needs or cover all concepts of data quality. In this study, we discuss some philosophical issues on data quality. We identify actual user needs on data quality, review existing standards and specifications on data quality, and propose an integrated model for data quality in the field of Earth observation (EO). We also propose a practical mechanism for applying the integrated quality information model to a large number of datasets through metadata inheritance. While our data quality management approach is in the domain of EO, we believe that the ideas and methodologies for data quality management can be applied to wider domains and disciplines to facilitate quality-enabled scientific research. PMID:23230156

An integrated view of data quality in Earth observation.

PubMed

Yang, X; Blower, J D; Bastin, L; Lush, V; Zabala, A; Masó, J; Cornford, D; Díaz, P; Lumsden, J

2013-01-28

Data quality is a difficult notion to define precisely, and different communities have different views and understandings of the subject. This causes confusion, a lack of harmonization of data across communities and omission of vital quality information. For some existing data infrastructures, data quality standards cannot address the problem adequately and cannot fulfil all user needs or cover all concepts of data quality. In this study, we discuss some philosophical issues on data quality. We identify actual user needs on data quality, review existing standards and specifications on data quality, and propose an integrated model for data quality in the field of Earth observation (EO). We also propose a practical mechanism for applying the integrated quality information model to a large number of datasets through metadata inheritance. While our data quality management approach is in the domain of EO, we believe that the ideas and methodologies for data quality management can be applied to wider domains and disciplines to facilitate quality-enabled scientific research.

Challenges to inferring causality from viral information dispersion in dynamic social networks

NASA Astrophysics Data System (ADS)

Ternovski, John

2014-06-01

Understanding the mechanism behind large-scale information dispersion through complex networks has important implications for a variety of industries ranging from cyber-security to public health. With the unprecedented availability of public data from online social networks (OSNs) and the low cost nature of most OSN outreach, randomized controlled experiments, the "gold standard" of causal inference methodologies, have been used with increasing regularity to study viral information dispersion. And while these studies have dramatically furthered our understanding of how information disseminates through social networks by isolating causal mechanisms, there are still major methodological concerns that need to be addressed in future research. This paper delineates why modern OSNs are markedly different from traditional sociological social networks and why these differences present unique challenges to experimentalists and data scientists. The dynamic nature of OSNs is particularly troublesome for researchers implementing experimental designs, so this paper identifies major sources of bias arising from network mutability and suggests strategies to circumvent and adjust for these biases. This paper also discusses the practical considerations of data quality and collection, which may adversely impact the efficiency of the estimator. The major experimental methodologies used in the current literature on virality are assessed at length, and their strengths and limits identified. Other, as-yetunsolved threats to the efficiency and unbiasedness of causal estimators--such as missing data--are also discussed. This paper integrates methodologies and learnings from a variety of fields under an experimental and data science framework in order to systematically consolidate and identify current methodological limitations of randomized controlled experiments conducted in OSNs.

Prevalence of psychotic disorders and its association with methodological issues. A systematic review and meta-analyses

PubMed Central

Martín, Carlos; Pastor, Loly

2018-01-01

Objectives The purpose of this study is to provide an updated systematic review to identify studies describing the prevalence of psychosis in order to explore methodological factors that could account for the variation in prevalence estimates. Methods Studies with original data related to the prevalence of psychosis (published between 1990 and 2015) were identified via searching electronic databases and reviewing manual citations. Prevalence estimates were sorted according to prevalence type (point, 12-months and lifetime). The independent association between key methodological variables and the mean effect of prevalence was examined (prevalence type, case-finding setting, method of confirming diagnosis, international classification of diseases, diagnosis category, and study quality) by meta-analytical techniques and random-effects meta-regression. Results Seventy-three primary studies were included, providing a total of 101 estimates of prevalence rates of psychosis. Across these studies, the pooled median point and 12-month prevalence for persons was 3.89 and 4.03 per 1000 respectively; and the median lifetime prevalence was 7.49 per 1000. The result of the random-effects meta-regression analysis revealed a significant effect for the prevalence type, with higher rates of lifetime prevalence than 12-month prevalence (p<0.001). Studies conducted in the general population presented higher prevalence rates than those carried out in populations attended in health/social services (p = 0.006). Compared to the diagnosis of schizophrenia only, prevalence rates were higher in the probable psychotic disorder (p = 0.022) and non-affective psychosis (p = 0.009). Finally, a higher study quality is associated with a lower estimated prevalence of psychotic disorders (p<0.001). Conclusions This systematic review provides a comprehensive comparison of methodologies used in studies of the prevalence of psychosis, which can provide insightful information for future epidemiological studies in adopting the most relevant methodological approach. PMID:29649252

Diabetes-related emotional distress instruments: a systematic review of measurement properties.

PubMed

Lee, Jiyeon; Lee, Eun-Hyun; Kim, Chun-Ja; Moon, Seung Hei

2015-12-01

The objectives of this study were to identify all available diabetes-related emotional distress instruments and evaluate the evidence regarding their measurement properties to help in the selection of the most appropriate instrument for use in practice and research. A systematic literature search was performed. PubMed, Embase, CINAHL, and PsycINFO were searched systematically for articles on diabetes-related emotional distress instruments. The Consensus-based Standards for the Selection of Health Measurement Instruments checklist was used to evaluate the methodological quality of the identified studies. The quality of results with respect to the measurement properties of each study was evaluated using Terwee's quality criteria. An ancillary meta-analysis was performed. Of the 2345 articles yielded by the search, 19 full-text articles evaluating 6 diabetes-related emotional distress instruments were included in this study. No instrument demonstrated evidence for all measurement properties. The Problem Areas in Diabetes scale (PAID) was the most frequently studied and the best validated of the instruments. Pooled summary estimates of the correlation coefficient between the PAID and serum glycated hemoglobin revealed a positive but weak correlation. No diabetes-related emotional distress instrument demonstrated evidence for all measurement properties. No instrument was better than another, although the PAID was the best validated and is thus recommended for use. Further psychometric studies of the diabetes-related emotional distress instruments with rigorous methodologies are required. Copyright © 2015 Elsevier Ltd. All rights reserved.

Exploring resilience in nursing and midwifery students: a literature review.

PubMed

McGowan, Jennifer E; Murray, Karen

2016-10-01

The aim of this study was to explore the concepts of 'resilience' and 'hardiness' in nursing and midwifery students in educational settings and to identify educational interventions to promote resilience. Resilience in healthcare professionals has gained increasing attention globally, yet to date resilience and resilience education in nursing and midwifery students remain largely under-researched. An integrative literature review was planned, however, only quantitative evidence was identified therefore, a review of quantitative studies was undertaken using a systematic approach. A comprehensive search was undertaken using Medline, CINAHL, Embase, PsycINFO and Maternity and Infant Care databases January 1980-February 2015. Data were extracted using a specifically designed form and quality assessed using an appropriate checklist. A narrative summary of findings and statistical outcomes was undertaken. Eight quantitative studies were included. Research relating to resilience and resilience education in nursing and midwifery students is sparse. There is a weak evidence that resilience and hardiness is associated with slightly improved academic performance and decreased burnout. However, studies were heterogeneous in design and limited by poor methodological quality. No study specifically considered student midwives. A greater understanding of the theoretical underpinnings of resilience in nursing and midwifery students is essential for the development of educational resources. It is imperative that future research considers both nursing and midwifery training cohorts and should be of strong methodological quality. © 2016 John Wiley & Sons Ltd.

Quality of life and related concepts in Parkinson's disease: a systematic review.

PubMed

Den Oudsten, Brenda L; Van Heck, Guus L; De Vries, Jolanda

2007-08-15

Several studies have investigated the quality of life (QOL) of patients with Parkinson's disease (PD). The purpose of this study was to review the conceptual and methodological quality of quality of life (QOL) studies among patients with PD and to identify factors associated with poor (HR)QOL. Computerized bibliographic databases were screened for publications from 1960 to January 2007. According to a list of predefined criteria, the methodological quality of the 61 studies, was moderate. The term 'QOL' was often used inappropriately. In fact, almost all studies in this review actually assessed health status (HS) instead of QOL. The functioning of patients with PD on physical, social, and emotional domains is affected by PD. Their HS seems to be lower when compared to healthy persons or patients with other chronic diseases. HS studies augment the insight in self-perceived functioning. Therefore, HS is conceived as a valuable construct. However, QOL is also an important factor in health care. Attention towards QOL is needed in order to draw valid conclusions regarding a person's subjective experience of well-being in a broad sense. In order to accomplish this, future studies should apply the QOL concept with more rigor, should use an adequate operational definition, and should employ sound measures. Copyright (c) 2007 Movement Disorder Society.

What is covered by "cancer rehabilitation" in PubMed? A review of randomized controlled trials 1990-2011.

PubMed

Gudbergsson, Sævar Berg; Dahl, Alv A; Loge, Jon Håvard; Thorsen, Lene; Oldervoll, Line M; Grov, Ellen K

2015-02-01

This focused review examines randomized controlled studies included by the term "cancer rehabilitation" in PubMed. The research questions concern the type of interventions performed and their methodological quality. Using the Medical Subject Headings (MeSH) terms: neoplasm AND rehabilitation, all articles with randomized controlled studies that included adult cancer patients, written in English, were extracted from PubMed. Papers covering physical exercise, psychiatric/psychological treatment or social support only were excluded as they had been reviewed recently. Abstracts and papers were assessed by 3 pairs of reviewers, and descriptive information was extracted systematically. Methodological quality was rated on a 10-item index scale, and the cut-off for acceptable quality was set at ≥ 8. A total of 132 (19%) of the 683 identified papers met the eligibility criteria and were assessed in detail. The papers were grouped into 5 thematic categories: 44 physical; 15 art and expressive; 47 psycho-educative; 21 emotionally supportive; and 5 others. Good quality of design was observed in 32 studies, 18 of them uni-dimensional and 14 multi-dimensional. Published randomized controlled studies on cancer rehabilitation are heterogeneous in terms of content and samples, and are mostly characterized by suboptimal design quality. Future studies should be more specific and well-designed with sufficient statistical strength.

The integration of FMEA with other problem solving tools: A review of enhancement opportunities

NASA Astrophysics Data System (ADS)

Ng, W. C.; Teh, S. Y.; Low, H. C.; Teoh, P. C.

2017-09-01

Failure Mode Effect Analysis (FMEA) is one the most effective and accepted problem solving (PS) tools for most of the companies in the world. Since FMEA was first introduced in 1949, practitioners have implemented FMEA in various industries for their quality improvement initiatives. However, studies have shown that there are drawbacks that hinder the effectiveness of FMEA for continuous quality improvement from product design to manufacturing. Therefore, FMEA is integrated with other PS tools such as inventive problem solving methodology (TRIZ), Quality Function Deployment (QFD), Root Cause Analysis (RCA) and seven basic tools of quality to address the drawbacks. This study begins by identifying the drawbacks in FMEA. A comprehensive literature review on the integration of FMEA with other tools is carried out to categorise the integrations based on the drawbacks identified. The three categories are inefficiency of failure analysis, psychological inertia and neglect of customers’ perspective. This study concludes by discussing the gaps and opportunities in the integration for future research.

[What is the methodological quality of articles on therapeutic procedures published in Cirugía Española?].

PubMed

Manterola, Carlos; Busquets, Juli; Pascual, Marta; Grande, Luis

2006-02-01

The aim of this study was to determine the methodological quality of articles on therapeutic procedures published in Cirugía Española and to study its association with the publication year, center, and subject-matter. A bibliometric study that included all articles on therapeutic procedures published in Cirugía Española between 2001 and 2004 was performed. All kinds of clinical designs were considered, excluding editorials, review articles, letters to editor, and experimental studies. The variables analyzed were: year of publication, center, design, and methodological quality. Methodological quality was determined by a valid and reliable scale. Descriptive statistics (calculation of means, standard deviation and medians) and analytical statistics (Pearson's chi2, nonparametric, ANOVA and Bonferroni tests) were used. A total of 244 articles were studied (197 case series [81%], 28 cohort studies [12%], 17 clinical trials [7%], 1 cross sectional study and 1 case-control study [0.8%]). The studies were performed mainly in Catalonia and Murcia (22% and 16%, respectively). The most frequent subject areas were soft tissue and hepatobiliopancreatic surgery (23% and 19%, respectively). The mean and median of the methodological quality score calculated for the entire series was 10.2 +/- 3.9 points and 9.5 points, respectively. Methodological quality significantly increased by publication year (p < 0.001). An association between methodological quality and subject area was observed but no association was detected with the center performing the study. The methodological quality of articles on therapeutic procedures published in Cirugía Española between 2001 and 2004 is low. However, a statistically significant trend toward improvement was observed.

[Methodological quality and reporting quality evaluation of randomized controlled trials published in China Journal of Chinese Materia Medica].

PubMed

Yu, Dan-Dan; Xie, Yan-Ming; Liao, Xing; Zhi, Ying-Jie; Jiang, Jun-Jie; Chen, Wei

2018-02-01

To evaluate the methodological quality and reporting quality of randomized controlled trials(RCTs) published in China Journal of Chinese Materia Medica, we searched CNKI and China Journal of Chinese Materia webpage to collect RCTs since the establishment of the magazine. The Cochrane risk of bias assessment tool was used to evaluate the methodological quality of RCTs. The CONSORT 2010 list was adopted as reporting quality evaluating tool. Finally, 184 RCTs were included and evaluated methodologically, of which 97 RCTs were evaluated with reporting quality. For the methodological evaluating, 62 trials(33.70%) reported the random sequence generation; 9(4.89%) trials reported the allocation concealment; 25(13.59%) trials adopted the method of blinding; 30(16.30%) trials reported the number of patients withdrawing, dropping out and those lost to follow-up;2 trials （1.09%） reported trial registration and none of the trial reported the trial protocol; only 8(4.35%) trials reported the sample size estimation in details. For reporting quality appraising, 3 reporting items of 25 items were evaluated with high-quality,including: abstract, participants qualified criteria, and statistical methods; 4 reporting items with medium-quality, including purpose, intervention, random sequence method, and data collection of sites and locations; 9 items with low-quality reporting items including title, backgrounds, random sequence types, allocation concealment, blindness, recruitment of subjects, baseline data, harms, and funding;the rest of items were of extremely low quality(the compliance rate of reporting item<10%). On the whole, the methodological and reporting quality of RCTs published in the magazine are generally low. Further improvement in both methodological and reporting quality for RCTs of traditional Chinese medicine are warranted. It is recommended that the international standards and procedures for RCT design should be strictly followed to conduct high-quality trials. At the same time, in order to improve the reporting quality of randomized controlled trials, CONSORT standards should be adopted in the preparation of research reports and submissions. Copyright© by the Chinese Pharmaceutical Association.

Volume and methodological quality of randomized controlled trials in laparoscopic surgery: assessment over a 10-year period.

PubMed

Antoniou, Stavros A; Andreou, Alexandros; Antoniou, George A; Koch, Oliver O; Köhler, Gernot; Luketina, Ruzica-R; Bertsias, Antonios; Pointner, Rudolph; Granderath, Frank-Alexander

2015-11-01

Measures have been taken to improve methodological quality of randomized controlled trials (RCTs). This review systematically assessed the trends in volume and methodological quality of RCTs on minimally invasive surgery within a 10-year period. RCTs on minimally invasive surgery were searched in the 10 most cited general surgical journals and the 5 most cited journals of laparoscopic interest for the years 2002 and 2012. Bibliometric and methodological quality components were abstracted using the Scottish Intercollegiate Guidelines Network. The pooled number of RCTs from low-contribution regions demonstrated an increasing proportion of the total published RCTs, compensating for a concomitant decrease of the respective contributions from Europe and North America. International collaborations were more frequent in 2012. Acceptable or high quality RCTs accounted for 37.9% and 54.4% of RCTs published in 2002 and 2012, respectively. Components of external validity were poorly reported. Both the volume and the reporting quality of laparoscopic RCTs have increased from 2002 to 2012, but there seems to be ample room for improvement of methodological quality. Copyright © 2015 Elsevier Inc. All rights reserved.

Mapping the Medical Literature for High Quality Studies and Reviews for Age-specific Clinical Specialties

PubMed Central

Stevens, Adrienne L.; Wilczynski, Nancy L.; McKibbon, K. Ann; Haynes, R. Brian

2001-01-01

Objective: To identify a journal subset that publishes reports of high quality studies and reviews relating to age-specific clinical specialties, such as pediatrics and geriatrics. Design: Handsearch of 172 journals using explicit criteria to determine methodologic quality for generating evidence for clinical practice. Main outcome measure: Frequency of high quality articles and their top yielding journals. Results: Between 17% and 33% of articles published in age-specific specialties are of high quality for clinical use. Top yielding journals for the specialties ranged from 16 to 130. Conclusion: Handsearch of the clinical literature for the year 2000 reveals that high quality articles for some age-specific specialties are concentrated in a small subset of journals (eg, obstetrics), whereas articles for other specialties are widely scattered among a large number of journals (eg, adult medicine).

A Systematic Scoping Review of Yoga Intervention Components and Study Quality

PubMed Central

Elwy, A. Rani; Groessl, Erik J.; Eisen, Susan V.; Riley, Kristen; Maiya, Meghan; Lee, Jennifer P.; Sarkin, Andrew; Park, Crystal L.

2014-01-01

Context The scientific study of yoga requires rigorous methodology. This review aimed to systematically assess all studies of yoga interventions to: (1) determine yoga intervention characteristics; (2) examine methodologic quality of the subset of RCTs; and (3) explore how well these interventions are reported. Evidence acquisition Searches were conducted through April 2012 in PubMed, PsycInfo, Ageline, and Ovid’s Alternative and Complementary Medicine database using the text term yoga, and through handsearching five journals. Original studies were included if the intervention: (1) consisted of at least one yoga session with some type of health assessment; (2) targeted adults age ≥18 years; (3) was published in an English language peer–reviewed journal; and (4) was available for review. Evidence synthesis Of 3,062 studies identified, 465 studies in 30 countries were included. Analyses were conducted through 2013. Most interventions took place in India (n=228) or the U.S. (n=124), with intensity ranging from a single yoga session up to two sessions per day. Intervention lengths ranged from one session to 2 years. Asanas (poses) were mentioned as yoga components in 369 (79%) interventions, but were either minimally or not at all described in 200 (54%) of these. Most interventions (74%, n=336) did not include home practice. Of the included studies, 151 were RCTs. RCT quality was rated as poor. Conclusions This review highlights the inadequate reporting and methodologic limitations of current yoga intervention research, which limits study interpretation and comparability. Recommendations for future methodology and reporting are discussed. PMID:24996759

The relationship between return on investment and quality of study methodology in workplace health promotion programs.

PubMed

Baxter, Siyan; Sanderson, Kristy; Venn, Alison J; Blizzard, C Leigh; Palmer, Andrew J

2014-01-01

To determine the relationship between return on investment (ROI) and quality of study methodology in workplace health promotion programs. Data were obtained through a systematic literature search of National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE), Health Technology Database (HTA), Cost Effectiveness Analysis (CEA) Registry, EconLit, PubMed, Embase, Wiley, and Scopus. Included were articles written in English or German reporting cost(s) and benefit(s) and single or multicomponent health promotion programs on working adults. Return-to-work and workplace injury prevention studies were excluded. Methodological quality was graded using British Medical Journal Economic Evaluation Working Party checklist. Economic outcomes were presented as ROI. ROI was calculated as ROI = (benefits - costs of program)/costs of program. Results were weighted by study size and combined using meta-analysis techniques. Sensitivity analysis was performed using two additional methodological quality checklists. The influences of quality score and important study characteristics on ROI were explored. Fifty-one studies (61 intervention arms) published between 1984 and 2012 included 261,901 participants and 122,242 controls from nine industry types across 12 countries. Methodological quality scores were highly correlated between checklists (r = .84-.93). Methodological quality improved over time. Overall weighted ROI [mean ± standard deviation (confidence interval)] was 1.38 ± 1.97 (1.38-1.39), which indicated a 138% return on investment. When accounting for methodological quality, an inverse relationship to ROI was found. High-quality studies (n = 18) had a smaller mean ROI, 0.26 ± 1.74 (.23-.30), compared to moderate (n = 16) 0.90 ± 1.25 (.90-.91) and low-quality (n = 27) 2.32 ± 2.14 (2.30-2.33) studies. Randomized control trials (RCTs) (n = 12) exhibited negative ROI, -0.22 ± 2.41(-.27 to -.16). Financial returns become increasingly positive across quasi-experimental, nonexperimental, and modeled studies: 1.12 ± 2.16 (1.11-1.14), 1.61 ± 0.91 (1.56-1.65), and 2.05 ± 0.88 (2.04-2.06), respectively. Overall, mean weighted ROI in workplace health promotion demonstrated a positive ROI. Higher methodological quality studies provided evidence of smaller financial returns. Methodological quality and study design are important determinants.

Cost-utility analyses of drug therapies in breast cancer: a systematic review.

PubMed

Nerich, Virginie; Saing, Sopany; Gamper, Eva Maria; Kemmler, Georg; Daval, Franck; Pivot, Xavier; Holzner, Bernhard

2016-10-01

The economic evaluation (EE) of health care products has become a necessity. Their quality must be high in order to trust the results and make informed decisions. While cost-utility analyses (CUAs) should be preferred to cost-effectiveness analyses in the oncology area, the quality of breast cancer (BC)-related CUA has been given little attention so far. Thus, firstly, a systematic review of published CUA related to drug therapies for BC, gene expression profiling, and HER2 status testing was performed. Secondly, the quality of selected CUA was assessed and the factors associated with a high-quality CUA identified. The systematic literature search was conducted in PubMed, MEDLINE/EMBASE, and Cochrane to identify published CUA between 2000 and 2014. After screening and data extraction, the quality of each selected CUA was assessed by two independent reviewers, using the checklist proposed by Drummond et al. The analysis of factors associated with a high-quality CUA (defined as a Drummond score ≥7) was performed using a two-step approach. Our systematic review was based on 140 CUAs and showed a wide variety of methodological approaches, including differences in the perspective adopted, the time horizon, measurement of cost and effectiveness, and more specially health-state utility values (HSUVs). The median Drummond score was 7 [range 3-10]. Only one in two of the CUA (n = 74) had a Drummond score ≥7, synonymous of "high quality." The statistically significant predictors of a high-quality CUA were article with "gene expression profiling" topic (p = 0.001), consulting or pharmaceutical company as main location of first author (p = 0.004), and articles with both incremental cost-utility ratio and incremental cost-effectiveness ratio as outcomes of EE (p = 0.02). Our systematic review identified only 140 CUAs published over the past 15 years with one in two of high quality. It showed a wide variety of methodological approaches, especially focused on HSUVs. A critical appraisal of utility values is necessary to better understand one of the main difficulties encountered by authors and propose areas for improvement to increase the quality of CUA. Since the last 5 years, there is a tendency toward an improvement in the quality of these studies, probably coupled with economic context, a better and widely spreading of recommendations and thus appropriation by medical practitioners. That being said, there is an urgent need for mandatory use of European and international recommendations to ensure quality of such approaches and to allow easy comparison.

Symptom Clusters in Advanced Cancer Patients: An Empirical Comparison of Statistical Methods and the Impact on Quality of Life.

PubMed

Dong, Skye T; Costa, Daniel S J; Butow, Phyllis N; Lovell, Melanie R; Agar, Meera; Velikova, Galina; Teckle, Paulos; Tong, Allison; Tebbutt, Niall C; Clarke, Stephen J; van der Hoek, Kim; King, Madeleine T; Fayers, Peter M

2016-01-01

Symptom clusters in advanced cancer can influence patient outcomes. There is large heterogeneity in the methods used to identify symptom clusters. To investigate the consistency of symptom cluster composition in advanced cancer patients using different statistical methodologies for all patients across five primary cancer sites, and to examine which clusters predict functional status, a global assessment of health and global quality of life. Principal component analysis and exploratory factor analysis (with different rotation and factor selection methods) and hierarchical cluster analysis (with different linkage and similarity measures) were used on a data set of 1562 advanced cancer patients who completed the European Organization for the Research and Treatment of Cancer Quality of Life Questionnaire-Core 30. Four clusters consistently formed for many of the methods and cancer sites: tense-worry-irritable-depressed (emotional cluster), fatigue-pain, nausea-vomiting, and concentration-memory (cognitive cluster). The emotional cluster was a stronger predictor of overall quality of life than the other clusters. Fatigue-pain was a stronger predictor of overall health than the other clusters. The cognitive cluster and fatigue-pain predicted physical functioning, role functioning, and social functioning. The four identified symptom clusters were consistent across statistical methods and cancer types, although there were some noteworthy differences. Statistical derivation of symptom clusters is in need of greater methodological guidance. A psychosocial pathway in the management of symptom clusters may improve quality of life. Biological mechanisms underpinning symptom clusters need to be delineated by future research. A framework for evidence-based screening, assessment, treatment, and follow-up of symptom clusters in advanced cancer is essential. Copyright © 2016 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Integrated cost-effectiveness analysis of agri-environmental measures for water quality.

PubMed

Balana, Bedru B; Jackson-Blake, Leah; Martin-Ortega, Julia; Dunn, Sarah

2015-09-15

This paper presents an application of integrated methodological approach for identifying cost-effective combinations of agri-environmental measures to achieve water quality targets. The methodological approach involves linking hydro-chemical modelling with economic costs of mitigation measures. The utility of the approach was explored for the River Dee catchment in North East Scotland, examining the cost-effectiveness of mitigation measures for nitrogen (N) and phosphorus (P) pollutants. In-stream nitrate concentration was modelled using the STREAM-N and phosphorus using INCA-P model. Both models were first run for baseline conditions and then their effectiveness for changes in land management was simulated. Costs were based on farm income foregone, capital and operational expenditures. The costs and effects data were integrated using 'Risk Solver Platform' optimization in excel to produce the most cost-effective combination of measures by which target nutrient reductions could be attained at a minimum economic cost. The analysis identified different combination of measures as most cost-effective for the two pollutants. An important aspect of this paper is integration of model-based effectiveness estimates with economic cost of measures for cost-effectiveness analysis of land and water management options. The methodological approach developed is not limited to the two pollutants and the selected agri-environmental measures considered in the paper; the approach can be adapted to the cost-effectiveness analysis of any catchment-scale environmental management options. Copyright © 2015 Elsevier Ltd. All rights reserved.

Affirmative Action in the Quality of Higher Education: The Voices of Graduates of the University for All Program

ERIC Educational Resources Information Center

Felicetti, Vera Lucia; Morosini, Marilia Costa; Somers, Patricia

2013-01-01

This article is an overview of a doctoral dissertation which presents statements from graduates of the University for All Program (PROUNI) from a non-profit Brazilian university, who were admitted to university through this program. The methodology used was qualitative with a focus on textual analysis. The objective is to identify the outcomes…

Identifying haplotypes for flowering and QTLs for fruit quality in the RosBREED Michigan and Oregon strawberry (Fragaria ×ananassa) breeding sets using pedigree-based analysis [abstract

USDA-ARS?s Scientific Manuscript database

Strawberry (Fragaria ×ananassa) is consumed for its flavor and health benefits. Over the last two decades, several quantitative trait loci (QTL) analysis studies for consumer traits were conducted using low-density genetic maps. The previous studies utilized low-throughput genotyping methodologies. ...

Building Bridges to a Brighter Tomorrow: A Systematic Evidence Review of Interventions That Prepare Adolescents for Adulthood.

PubMed

Burrus, Barri B; Krieger, Kathleen; Rutledge, Regina; Rabre, Alexander; Axelson, Sarah; Miller, Audra; White, LeBretia; Jackson, Christine

2018-02-01

Data suggest that adverse social determinants during adolescence can set in motion a lifetime of poor social and health outcomes. Vulnerable youths are at particularly high risk in this regard. To identify and assess the current evidence base for adolescent-focused interventions designed to influence adulthood preparation that could affect longer-term social determinants. Using a systematic review methodology, we conducted an initial assessment of intervention evaluations targeting 6 adulthood preparation subject (APS) areas to assess the quality and character of the evidence base. The review is specific to evaluated interventions that address at least 1 of the 6 APS areas: healthy relationships, adolescent development, financial literacy, parent-child communication, educational and career success, and healthy life skills. The inclusion criteria were as follows: (1) published in English in an independent, peer-reviewed journal; (2) conducted in developed, English-speaking countries; (3) implemented an intervention that addressed at least 1 of the 6 APS areas, delivered in an in-person setting; (4) included youths at the 5th- through 12th-grade levels or aged 10 to 18 years at some point during intervention implementation; (5) included an evaluation component with a comparison group and baseline and follow-up measures; (6) included behavioral measures as outcomes; and (7) reported statistical significance levels for the behavioral outcome measures. We developed an abstraction form to capture details from each article, including key details of the intervention, such as services, implementer characteristics, and timing; adulthood preparation foci; evaluation design, methods, and key behavioral measures; and results, including key statistically significant results for behavior-based outcome measures. We assessed study quality by using several key factors, including randomization, baseline equivalence of treatment and control groups, attrition, and confounding factors. We characterized the quality of evidence as high, moderate, or low on the basis of the described design and execution of the research. Our assessment included only information stated explicitly in the manuscript. A total of 36 independent intervention evaluations met the criteria for inclusion. Of these, 27 (75%) included significant findings for behavioral outcomes related to adulthood preparation. Quality was mixed across studies. Of the 36 studies reviewed, 27 used a randomized controlled design (15 group randomization, 12 individual randomization), whereas the others used observational pre-post designs. Ten studies used mixed-methods approaches. Most (n = 32) studies used self-report questionnaires at baseline with a follow-up questionnaire, and 14 studies included multiple follow-up points. Of the studies reviewed, 7 studies received a high-quality rating, indicating no significant issues identified within our quality criteria. We rated 23 studies as moderate quality, indicating methodological challenges within 1 of the quality criteria categories. The most common reasons studies were down-rated were poor baseline equivalency across treatment groups (or no discussion of baseline equivalency) and high levels of attrition. Finally, 6 studies received a low-quality rating because of methodological challenges across multiple quality domains. The studies broadly represented the APS areas. We identified no systematic differences in study quality across the APS areas. Although some of the intervention results indicate behavioral changes that may be linked to adulthood preparation skills, many of the extant findings are derived from moderate- or poor-quality studies. Additional work is needed to build the evidence base by using methodologically rigorous implementation and evaluation designs and execution. Public Health Implications. Interventions designed to help adolescents better prepare for adulthood may have the potential to affect their longer-term social determinants of health and well-being. More theory-driven approaches and rigorously evaluated interventions could strengthen the evidence base and improve the effectiveness of these adulthood preparation interventions.

Building Bridges to a Brighter Tomorrow: A Systematic Evidence Review of Interventions That Prepare Adolescents for Adulthood

PubMed Central

Krieger, Kathleen; Rutledge, Regina; Rabre, Alexander; Axelson, Sarah; Miller, Audra; White, LeBretia; Jackson, Christine

2018-01-01

Background. Data suggest that adverse social determinants during adolescence can set in motion a lifetime of poor social and health outcomes. Vulnerable youths are at particularly high risk in this regard. Objectives. To identify and assess the current evidence base for adolescent-focused interventions designed to influence adulthood preparation that could affect longer-term social determinants. Search Methods. Using a systematic review methodology, we conducted an initial assessment of intervention evaluations targeting 6 adulthood preparation subject (APS) areas to assess the quality and character of the evidence base. The review is specific to evaluated interventions that address at least 1 of the 6 APS areas: healthy relationships, adolescent development, financial literacy, parent–child communication, educational and career success, and healthy life skills. Selection Criteria. The inclusion criteria were as follows: (1) published in English in an independent, peer-reviewed journal; (2) conducted in developed, English-speaking countries; (3) implemented an intervention that addressed at least 1 of the 6 APS areas, delivered in an in-person setting; (4) included youths at the 5th- through 12th-grade levels or aged 10 to 18 years at some point during intervention implementation; (5) included an evaluation component with a comparison group and baseline and follow-up measures; (6) included behavioral measures as outcomes; and (7) reported statistical significance levels for the behavioral outcome measures. Data Collection and Analysis. We developed an abstraction form to capture details from each article, including key details of the intervention, such as services, implementer characteristics, and timing; adulthood preparation foci; evaluation design, methods, and key behavioral measures; and results, including key statistically significant results for behavior-based outcome measures. We assessed study quality by using several key factors, including randomization, baseline equivalence of treatment and control groups, attrition, and confounding factors. We characterized the quality of evidence as high, moderate, or low on the basis of the described design and execution of the research. Our assessment included only information stated explicitly in the manuscript. Main Results. A total of 36 independent intervention evaluations met the criteria for inclusion. Of these, 27 (75%) included significant findings for behavioral outcomes related to adulthood preparation. Quality was mixed across studies. Of the 36 studies reviewed, 27 used a randomized controlled design (15 group randomization, 12 individual randomization), whereas the others used observational pre–post designs. Ten studies used mixed-methods approaches. Most (n = 32) studies used self-report questionnaires at baseline with a follow-up questionnaire, and 14 studies included multiple follow-up points. Of the studies reviewed, 7 studies received a high-quality rating, indicating no significant issues identified within our quality criteria. We rated 23 studies as moderate quality, indicating methodological challenges within 1 of the quality criteria categories. The most common reasons studies were down-rated were poor baseline equivalency across treatment groups (or no discussion of baseline equivalency) and high levels of attrition. Finally, 6 studies received a low-quality rating because of methodological challenges across multiple quality domains. The studies broadly represented the APS areas. We identified no systematic differences in study quality across the APS areas. Author’s Conclusions. Although some of the intervention results indicate behavioral changes that may be linked to adulthood preparation skills, many of the extant findings are derived from moderate- or poor-quality studies. Additional work is needed to build the evidence base by using methodologically rigorous implementation and evaluation designs and execution. Public Health Implications. Interventions designed to help adolescents better prepare for adulthood may have the potential to affect their longer-term social determinants of health and well-being. More theory-driven approaches and rigorously evaluated interventions could strengthen the evidence base and improve the effectiveness of these adulthood preparation interventions. PMID:29443561

Increasing physical activity through mobile device interventions: A systematic review.

PubMed

Muntaner, Adrià; Vidal-Conti, Josep; Palou, Pere

2016-09-01

Physical inactivity is a health problem that affects people worldwide and has been identified as the fourth largest risk factor for overall mortality (contributing to 6% of deaths globally). Many researchers have tried to increase physical activity levels through traditional methods without much success. Thus, many researchers are turning to mobile technology as an emerging method for changing health behaviours. This systematic review sought to summarise and update the existing scientific literature on increasing physical activity through mobile device interventions, taking into account the methodological quality of the studies. The articles were identified by searching the PubMed, SCOPUS and SPORTDiscus databases for studies published between January 2003 and December 2013. Studies investigating efforts to increase physical activity through mobile phone or even personal digital assistant interventions were included. The search results allowed the inclusion of 11 studies that gave rise to 12 publications. Six of the articles included in this review reported significant increases in physical activity levels. The number of studies using mobile devices for interventions has increased exponentially in the last few years, but future investigations with better methodological quality are needed to draw stronger conclusions regarding how to increase physical activity through mobile device interventions. © The Author(s) 2015.

Biomechanics of fencing sport: A scoping review

PubMed Central

Chen, Tony Lin-Wei; Wong, Duo Wai-Chi; Wang, Yan; Ren, Sicong; Yan, Fei

2017-01-01

Objectives The aim of our scoping review was to identify and summarize current evidence on the biomechanics of fencing to inform athlete development and injury prevention. Design Scoping review. Method Peer-reviewed research was identified from electronic databases using a structured keyword search. Details regarding experimental design, study group characteristics and measured outcomes were extracted from retrieved studies, summarized and information regrouped under themes for analysis. The methodological quality of the evidence was evaluated. Results Thirty-seven peer-reviewed studies were retrieved, the majority being observational studies conducted with experienced and elite athletes. The methodological quality of the evidence was “fair” due to the limited scope of research. Male fencers were the prevalent group studied, with the lunge and use of a foil weapon being the principal movement evaluated. Motion capture and pedabarography were the most frequently used data collection techniques. Conclusions Elite fencers exhibited sequential coordination of upper and lower limb movements with coherent patterns of muscle activation, compared to novice fencers. These elite features of neuromuscular coordination resulted in higher magnitudes of forward linear velocity of the body center of mass and weapon. Training should focus on explosive power. Sex- and equipment-specific effects could not be evaluated based on available research. PMID:28187164

Physical Activity and Safety From Crime Among Adults: A Systematic Review.

PubMed

da Silva, Inacio C; Payne, Valerie L; Hino, Adriano Akira; Varela, Andrea Ramirez; Reis, Rodrigo S; Ekelund, Ulf; Hallal, Pedro C

2016-06-01

The aim of this study was to review the evidence to date on the association between physical activity and safety from crime. Articles with adult populations of 500+ participants investigating the association between physical activity and safety from crime were included. A methodological quality assessment was conducted using an adapted version of the Downs and Black checklist. The literature search identified 15,864 articles. After assessment of titles, abstracts and full-texts, 89 articles were included. Most articles (84.3%) were derived from high-income countries and only 3 prospective articles were identified. Articles presented high methodological quality. In 38 articles (42.7%), at least one statistically significant association in the expected direction was reported (ie, safety from crime was positively associated with physical activity). Nine articles (10.1%) found an association in the unexpected direction and 42 (47.2%) did not find statistically significant associations. The results did not change when we analyzed articles separately by sex, age, type of measurement, or domains of physical activity evaluated. The current evidence, mostly based on cross-sectional studies, suggests a lack of association between physical activity and safety from crime. Prospective studies and natural experiments are needed, particularly in areas with wide crime variability.

Reporting characteristics of meta-analyses in orthodontics: methodological assessment and statistical recommendations.

PubMed

Papageorgiou, Spyridon N; Papadopoulos, Moschos A; Athanasiou, Athanasios E

2014-02-01

Ideally meta-analyses (MAs) should consolidate the characteristics of orthodontic research in order to produce an evidence-based answer. However severe flaws are frequently observed in most of them. The aim of this study was to evaluate the statistical methods, the methodology, and the quality characteristics of orthodontic MAs and to assess their reporting quality during the last years. Electronic databases were searched for MAs (with or without a proper systematic review) in the field of orthodontics, indexed up to 2011. The AMSTAR tool was used for quality assessment of the included articles. Data were analyzed with Student's t-test, one-way ANOVA, and generalized linear modelling. Risk ratios with 95% confidence intervals were calculated to represent changes during the years in reporting of key items associated with quality. A total of 80 MAs with 1086 primary studies were included in this evaluation. Using the AMSTAR tool, 25 (27.3%) of the MAs were found to be of low quality, 37 (46.3%) of medium quality, and 18 (22.5%) of high quality. Specific characteristics like explicit protocol definition, extensive searches, and quality assessment of included trials were associated with a higher AMSTAR score. Model selection and dealing with heterogeneity or publication bias were often problematic in the identified reviews. The number of published orthodontic MAs is constantly increasing, while their overall quality is considered to range from low to medium. Although the number of MAs of medium and high level seems lately to rise, several other aspects need improvement to increase their overall quality.

40 CFR Appendix C to Part 132 - Great Lakes Water Quality Initiative Methodologies for Development of Human Health Criteria and...

Code of Federal Regulations, 2011 CFR

2011-07-01

... LAKES SYSTEM Pt. 132, App. C Appendix C to Part 132—Great Lakes Water Quality Initiative Methodologies...; or consuming fish from the water, and water-related recreation activities using the Methodologies for... 40 Protection of Environment 22 2011-07-01 2011-07-01 false Great Lakes Water Quality Initiative...

40 CFR Appendix C to Part 132 - Great Lakes Water Quality Initiative Methodologies for Development of Human Health Criteria and...

Code of Federal Regulations, 2010 CFR

2010-07-01

... LAKES SYSTEM Pt. 132, App. C Appendix C to Part 132—Great Lakes Water Quality Initiative Methodologies...; or consuming fish from the water, and water-related recreation activities using the Methodologies for... 40 Protection of Environment 21 2010-07-01 2010-07-01 false Great Lakes Water Quality Initiative...

A Systematic Review of Economic Evaluation Methodologies Between Resource-Limited and Resource-Rich Countries: A Case of Rotavirus Vaccines.

PubMed

Thiboonboon, Kittiphong; Santatiwongchai, Benjarin; Chantarastapornchit, Varit; Rattanavipapong, Waranya; Teerawattananon, Yot

2016-12-01

For more than three decades, the number and influence of economic evaluations of healthcare interventions have been increasing and gaining attention from a policy level. However, concerns about the credibility of these studies exist, particularly in studies from low- and middle- income countries (LMICs). This analysis was performed to explore economic evaluations conducted in LMICs in terms of methodological variations, quality of reporting and evidence used for the analyses. These results were compared with those studies conducted in high-income countries (HICs). Rotavirus vaccine was selected as a case study, as it is one of the interventions that many studies in both settings have explored. The search to identify individual studies on rotavirus vaccines was performed in March 2014 using MEDLINE and the National Health Service Economic Evaluation Database. Only full economic evaluations, comparing cost and outcomes of at least two alternatives, were included for review. Selected criteria were applied to assess methodological variation, quality of reporting and quality of evidence used. Eighty-five studies were included, consisting of 45 studies in HICs and 40 studies in LMICs. Seventy-five percent of the studies in LMICs were published by researchers from HICs. Compared with studies in HICs, the LMIC studies showed less methodological variety. In terms of the quality of reporting, LMICs had a high adherence to technical criteria, but HICs ultimately proved to be better. The same trend applied for the quality of evidence used. Although the quality of economic evaluations in LMICs was not as high as those from HICs, it is of an acceptable level given several limitations that exist in these settings. However, the results of this study may not reflect the fact that LMICs have developed a better research capacity in the domain of health economics, given that most of the studies were in theory led by researchers from HICs. Putting more effort into fostering the development of both research infrastructure and capacity building as well as encouraging local engagement in LMICs is thus necessary.

Process, cost, and clinical quality: the initial oral contraceptive visit.

PubMed

McMullen, Michael J; Woolford, Samuel W; Moore, Charles L; Berger, Barry M

2013-01-01

To demonstrate how the analysis of clinical process, cost, and outcomes can identify healthcare improvements that reduce cost without sacrificing quality, using the example of the initial visit associated with oral contraceptive pill use. Cross-sectional study using data collected by HealthMETRICS between 1996 and 2009. Using data collected from 106 sites in 24 states, the unintended pregnancy (UIP) rate, effectiveness of patient education, and unit visit cost were calculated. Staff type providing education and placement of education were recorded. Two-way analysis of variance models were created and tested for significance to identify differences between groups. Sites using nonclinical staff to provide education outside the exam were associated with lower cost, higher education scores, and a UIP rate no different from that of sites using clinical staff. Sites also providing patient education during the physical examination were associated with higher cost, lower education scores, and a UIP rate no lower than that of sites providing education outside of the exam. Through analyzing process, cost, and quality, lower-cost processes that did not reduce clinical quality were identified. This methodology is applicable to other clinical services for identifying low-cost processes that do not result in lower clinical quality. By using nonclinical staff educators to provide education outside of the physical examination, sites could save an average of 32% of the total cost of the visit.

A systematic review of the therapeutic effects of Reiki.

PubMed

vanderVaart, Sondra; Gijsen, Violette M G J; de Wildt, Saskia N; Koren, Gideon

2009-11-01

Reiki is an ancient form of Japanese healing. While this healing method is widely used for a variety of psychologic and physical symptoms, evidence of its effectiveness is scarce and conflicting. The purpose of this systematic review was to try to evaluate whether Reiki produces a significant treatment effect. Studies were identified using an electronic search of Medline, EMBASE, Cochrane Library, and Google Scholar. Quality of reporting was evaluated using a modified CONSORT Criteria for Herbal Interventions, while methodological quality was assessed using the Jadad Quality score. Two (2) researchers selected articles based on the following features: placebo or other adequate control, clinical investigation on humans, intervention using a Reiki practitioner, and published in English. They independently extracted data on study design, inclusion criteria, type of control, sample size, result, and nature of outcome measures. The modified CONSORT Criteria indicated that all 12 trials meeting the inclusion criteria were lacking in at least one of the three key areas of randomization, blinding, and accountability of all patients, indicating a low quality of reporting. Nine (9) of the 12 trials detected a significant therapeutic effect of the Reiki intervention; however, using the Jadad Quality score, 11 of the 12 studies ranked "poor." The serious methodological and reporting limitations of limited existing Reiki studies preclude a definitive conclusion on its effectiveness. High-quality randomized controlled trials are needed to address the effectiveness of Reiki over placebo.

Is reflexology an effective intervention? A systematic review of randomised controlled trials.

PubMed

Ernst, Edzard

2009-09-07

To evaluate the evidence for and against the effectiveness of reflexology for treating any medical condition. Six electronic databases were searched from their inception to February 2009 to identify all relevant randomised controlled trials (RCTs). No language restrictions were applied. RCTs of reflexology delivered by trained reflexologists to patients with specific medical conditions. Condition studied, study design and controls, primary outcome measures, follow-up, and main results were extracted. 18 RCTs met all the inclusion criteria. The studies examined a range of conditions: anovulation, asthma, back pain, dementia, diabetes, cancer, foot oedema in pregnancy, headache, irritable bowel syndrome, menopause, multiple sclerosis, the postoperative state and premenstrual syndrome. There were > 1 studies for asthma, the postoperative state, cancer palliation and multiple sclerosis. Five RCTs yielded positive results. Methodological quality was evaluated using the Jadad scale. The methodological quality was often poor, and sample sizes were generally low. Most higher-quality trials did not generate positive findings. The best evidence available to date does not demonstrate convincingly that reflexology is an effective treatment for any medical condition.

Clinical audit, a valuable tool to improve quality of care: General methodology and applications in nephrology

PubMed Central

Esposito, Pasquale; Dal Canton, Antonio

2014-01-01

Evaluation and improvement of quality of care provided to the patients are of crucial importance in the daily clinical practice and in the health policy planning and financing. Different tools have been developed, including incident analysis, health technology assessment and clinical audit. The clinical audit consist of measuring a clinical outcome or a process, against well-defined standards set on the principles of evidence-based medicine in order to identify the changes needed to improve the quality of care. In particular, patients suffering from chronic renal diseases, present many problems that have been set as topics for clinical audit projects, such as hypertension, anaemia and mineral metabolism management. Although the results of these studies have been encouraging, demonstrating the effectiveness of audit, overall the present evidence is not clearly in favour of clinical audit. These findings call attention to the need to further studies to validate this methodology in different operating scenarios. This review examines the principle of clinical audit, focusing on experiences performed in nephrology settings. PMID:25374819

Identifying rural food deserts: Methodological considerations for food environment interventions.

PubMed

Lebel, Alexandre; Noreau, David; Tremblay, Lucie; Oberlé, Céline; Girard-Gadreau, Maurie; Duguay, Mathieu; Block, Jason P

2016-06-09

Food insecurity in an important public health issue and affects 13% of Canadian households. It is associated with poor accessibility to fresh, diverse and affordable food products. However, measurement of the food environment is challenging in rural settings since the proximity of food supply sources is unevenly distributed. The objective of this study was to develop a methodology to identify food deserts in rural environments. In-store evaluations of 25 food products were performed for all food stores located in four contiguous rural counties in Quebec. The quality of food products was estimated using four indices: freshness, affordability, diversity and the relative availability. Road network distance between all residences to the closest food store with a favourable score on the four dimensions was mapped to identify residential clusters located in deprived communities without reasonable access to a "good" food source. The result was compared with the food desert parameters proposed by the US Department of Agriculture (USDA), as well as with the perceptions of a group of regional stakeholders. When food quality was considered, food deserts appeared more prevalent than when only the USDA definition was used. Objective measurements of the food environment matched stakeholders' perceptions. Food stores' characteristics are different in rural areas and require an in-store estimation to identify potential rural food deserts. The objective measurements of the food environment combined with the field knowledge of stakeholders may help to shape stronger arguments to gain the support of decision-makers to develop relevant interventions.

The quality of mental disorder information websites: a review.

PubMed

Reavley, Nicola J; Jorm, Anthony F

2011-11-01

This paper reviews studies assessing the quality of websites providing information about mental disorders. The review included 31 articles identified by searching research databases in March 2010. Topics covered included affective disorders, anxiety disorders, eating disorders, substance use disorders and schizophrenia/psychosis. The largest number of articles (13) reported studies assessing affective disorder information quality. Methodologies varied in site selection and rating methods, with some of limited validity. Most concluded that quality was poor, although quality of affective disorder sites may be improving. There is currently very little understanding of the influence of website quality on user behaviour. Future quality assessments might use the criteria informed by key behaviour change theories. A possible approach to research on websites and user behaviour might be to develop an evaluation framework incorporating strategies from behaviour change models, key mental health literacy elements and health outcomes relevant to mental health promotion. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

The methodological and reporting quality of systematic reviews from China and the USA are similar.

PubMed

Tian, Jinhui; Zhang, Jun; Ge, Long; Yang, Kehu; Song, Fujian

2017-05-01

To compare the methodological and reporting quality of systematic reviews by authors from China and those from the United States (USA). From systematic reviews of randomized trials published in 2014 in English, we randomly selected 100 from China and 100 from the USA. The methodological quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) tool, and reporting quality assessed using the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) tool. Compared with systematic reviews from the USA, those from China were more likely to be a meta-analysis, published in low-impact journals, and a non-Cochrane review. The mean summary Assessing the Methodological Quality of Systematic Reviews score was 6.7 (95% confidence interval: 6.5, 7.0) for reviews from China and 6.6 (6.1, 7.1) for reviews from the USA, and the mean summary Preferred Reporting Items for Systematic Reviews and Meta-analyses score was 21.2 (20.7, 21.6) for reviews from China and 20.6 (19.9, 21.3) for reviews from the USA. The differences in summary quality scores between China and the USA were statistically nonsignificant after adjusting for multiple review factors. The overall methodological and reporting quality of systematic reviews by authors from China are similar to those from the USA, although the quality of systematic reviews from both countries could be further improved. Copyright © 2017 The Author(s). Published by Elsevier Inc. All rights reserved.

Methodological reporting quality of randomized controlled trials: A survey of seven core journals of orthopaedics from Mainland China over 5 years following the CONSORT statement.

PubMed

Zhang, J; Chen, X; Zhu, Q; Cui, J; Cao, L; Su, J

2016-11-01

In recent years, the number of randomized controlled trials (RCTs) in the field of orthopaedics is increasing in Mainland China. However, randomized controlled trials (RCTs) are inclined to bias if they lack methodological quality. Therefore, we performed a survey of RCT to assess: (1) What about the quality of RCTs in the field of orthopedics in Mainland China? (2) Whether there is difference between the core journals of the Chinese department of orthopedics and Orthopaedics Traumatology Surgery & Research (OTSR). This research aimed to evaluate the methodological reporting quality according to the CONSORT statement of randomized controlled trials (RCTs) in seven key orthopaedic journals published in Mainland China over 5 years from 2010 to 2014. All of the articles were hand researched on Chongqing VIP database between 2010 and 2014. Studies were considered eligible if the words "random", "randomly", "randomization", "randomized" were employed to describe the allocation way. Trials including animals, cadavers, trials published as abstracts and case report, trials dealing with subgroups analysis, or trials without the outcomes were excluded. In addition, eight articles selected from Orthopaedics Traumatology Surgery & Research (OTSR) between 2010 and 2014 were included in this study for comparison. The identified RCTs are analyzed using a modified version of the Consolidated Standards of Reporting Trials (CONSORT), including the sample size calculation, allocation sequence generation, allocation concealment, blinding and handling of dropouts. A total of 222 RCTs were identified in seven core orthopaedic journals. No trials reported adequate sample size calculation, 74 (33.4%) reported adequate allocation generation, 8 (3.7%) trials reported adequate allocation concealment, 18 (8.1%) trials reported adequate blinding and 16 (7.2%) trials reported handling of dropouts. In OTSR, 1 (12.5%) trial reported adequate sample size calculation, 4 (50.0%) reported adequate allocation generation, 1 (12.5%) trials reported adequate allocation concealment, 2 (25.0%) trials reported adequate blinding and 5 (62.5%) trials reported handling of dropouts. There were statistical differences as for sample size calculation and handling of dropouts between papers from Mainland China and OTSR (P<0.05). The findings of this study show that the methodological reporting quality of RCTs in seven core orthopaedic journals from the Mainland China is far from satisfaction and it needs to further improve to keep up with the standards of the CONSORT statement. Level III case control. Copyright © 2016 Elsevier Masson SAS. All rights reserved.

The impact of eHealth on the quality and safety of health care: a systematic overview.

PubMed

Black, Ashly D; Car, Josip; Pagliari, Claudia; Anandan, Chantelle; Cresswell, Kathrin; Bokun, Tomislav; McKinstry, Brian; Procter, Rob; Majeed, Azeem; Sheikh, Aziz

2011-01-18

There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care. We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking. There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and "techno-enthusiasts" as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption.

Is Article Methodological Quality Associated With Conflicts of Interest?: An Analysis of the Plastic Surgery Literature.

PubMed

Cho, Brian H; Lopez, Joseph; Means, Jessica; Lopez, Sandra; Milton, Jacqueline; Tufaro, Anthony P; May, James W; Dorafshar, Amir H

2017-12-01

Conflicts of interest (COI) are an emerging area of discussion within the field of plastic surgery. Recently, several reports have found that research studies that disclose COI are associated with publication of positive outcomes. We hypothesize that this association is driven by higher-quality studies receiving industry funding. This study aimed to investigate the association between industry support and study methodological quality. We reviewed all entries in Plastic and Reconstructive Surgery, Annals of Plastic Surgery, and Journal of Plastic, Reconstructive, and Aesthetic Surgery within a 1-year period encompassing 2013. All clinical research articles were analyzed. Studies were evaluated blindly for methodology quality based on a validated scoring system. An ordinal logistic regression model was used to examine the association between methodology score and COI. A total of 1474 articles were reviewed, of which 483 met our inclusion criteria. These articles underwent methodological quality scoring. Conflicts of interest were reported in 28 (5.8%) of these articles. After adjusting for article characteristics in the ordinal logistic regression analysis, there was no significant association between articles with COI and higher methodological scores (P = 0.7636). Plastic surgery studies that disclose COI are not associated with higher methodological quality when compared with studies that do not disclose COI. These findings suggest that although the presence of COI is associated with positive findings, the association is not shown to be driven by higher-quality studies.

Economic Evaluation of Obesity Prevention in Early Childhood: Methods, Limitations and Recommendations.

PubMed

Döring, Nora; Mayer, Susanne; Rasmussen, Finn; Sonntag, Diana

2016-09-13

Despite methodological advances in the field of economic evaluations of interventions, economic evaluations of obesity prevention programmes in early childhood are seldom conducted. The aim of the present study was to explore existing methods and applications of economic evaluations, examining their limitations and making recommendations for future cost-effectiveness assessments. A systematic literature search was conducted using PubMed, Cochrane Library, the British National Health Service Economic Evaluation Databases and EconLit. Eligible studies included trial-based or simulation-based cost-effectiveness analyses of obesity prevention programmes targeting preschool children and/or their parents. The quality of included studies was assessed. Of the six studies included, five were intervention studies and one was based on a simulation approach conducted on secondary data. We identified three main conceptual and methodological limitations of their economic evaluations: Insufficient conceptual approach considering the complexity of childhood obesity, inadequate measurement of effects of interventions, and lack of valid instruments to measure child-related quality of life and costs. Despite the need for economic evaluations of obesity prevention programmes in early childhood, only a few studies of varying quality have been conducted. Moreover, due to methodological and conceptual weaknesses, they offer only limited information for policy makers and intervention providers. We elaborate reasons for the limitations of these studies and offer guidance for designing better economic evaluations of early obesity prevention.

Economic Evaluation of Obesity Prevention in Early Childhood: Methods, Limitations and Recommendations

PubMed Central

Döring, Nora; Mayer, Susanne; Rasmussen, Finn; Sonntag, Diana

2016-01-01

Despite methodological advances in the field of economic evaluations of interventions, economic evaluations of obesity prevention programmes in early childhood are seldom conducted. The aim of the present study was to explore existing methods and applications of economic evaluations, examining their limitations and making recommendations for future cost-effectiveness assessments. A systematic literature search was conducted using PubMed, Cochrane Library, the British National Health Service Economic Evaluation Databases and EconLit. Eligible studies included trial-based or simulation-based cost-effectiveness analyses of obesity prevention programmes targeting preschool children and/or their parents. The quality of included studies was assessed. Of the six studies included, five were intervention studies and one was based on a simulation approach conducted on secondary data. We identified three main conceptual and methodological limitations of their economic evaluations: Insufficient conceptual approach considering the complexity of childhood obesity, inadequate measurement of effects of interventions, and lack of valid instruments to measure child-related quality of life and costs. Despite the need for economic evaluations of obesity prevention programmes in early childhood, only a few studies of varying quality have been conducted. Moreover, due to methodological and conceptual weaknesses, they offer only limited information for policy makers and intervention providers. We elaborate reasons for the limitations of these studies and offer guidance for designing better economic evaluations of early obesity prevention. PMID:27649218

The health-nutrition dimension: a methodological approach to assess the nutritional sustainability of typical agro-food products and the Mediterranean diet.

PubMed

Azzini, Elena; Maiani, Giuseppe; Turrini, Aida; Intorre, Federica; Lo Feudo, Gabriella; Capone, Roberto; Bottalico, Francesco; El Bilali, Hamid; Polito, Angela

2018-08-01

The aim of this paper is to provide a methodological approach to evaluate the nutritional sustainability of typical agro-food products, representing Mediterranean eating habits and included in the Mediterranean food pyramid. For each group of foods, suitable and easily measurable indicators were identified. Two macro-indicators were used to assess the nutritional sustainability of each product. The first macro-indicator, called 'business distinctiveness', takes into account the application of different regulations and standards regarding quality, safety and traceability as well as the origin of raw materials. The second macro-indicator, called 'nutritional quality', assesses product nutritional quality taking into account the contents of key compounds including micronutrients and bioactive phytochemicals. For each indicator a 0-10 scoring system was set up, with scores from 0 (unsustainable) to 10 (very sustainable), with 5 as a sustainability benchmark value. The benchmark value is the value from which a product can be considered sustainable. A simple formula was developed to produce a sustainability index. The proposed sustainability index could be considered a useful tool to describe both the qualitative and quantitative value of micronutrients and bioactive phytochemical present in foodstuffs. This methodological approach can also be applied beyond the Mediterranean, to food products in other world regions. © 2018 Society of Chemical Industry. © 2018 Society of Chemical Industry.

Characterization and effectiveness of pay-for-performance in ophthalmology: a systematic review.

PubMed

Herbst, Tim; Emmert, Martin

2017-06-05

To identify, characterize and compare existing pay-for-performance approaches and their impact on the quality of care and efficiency in ophthalmology. A systematic evidence-based review was conducted. English, French and German written literature published between 2000 and 2015 were searched in the following databases: Medline (via PubMed), NCBI web site, Scopus, Web of Knowledge, Econlit and the Cochrane Library. Empirical as well as descriptive articles were included. Controlled clinical trials, meta-analyses, randomized controlled studies as well as observational studies were included as empirical articles. Systematic characterization of identified pay-for-performance approaches (P4P approaches) was conducted according to the "Model for Implementing and Monitoring Incentives for Quality" (MIMIQ). Methodological quality of empirical articles was assessed according to the Critical Appraisal Skills Programme (CASP) checklists. Overall, 13 relevant articles were included. Eleven articles were descriptive and two articles included empirical analyses. Based on these articles, four different pay-for-performance approaches implemented in the United States were identified. With regard to quality and incentive elements, systematic comparison showed numerous differences between P4P approaches. Empirical studies showed isolated cost or quality effects, while a simultaneous examination of these effects was missing. Research results show that experiences with pay-for-performance approaches in ophthalmology are limited. Identified approaches differ with regard to quality and incentive elements restricting comparability. Two empirical studies are insufficient to draw strong conclusions about the effectiveness and efficiency of these approaches.

Interventions guided by analysis of quality indicators decrease the frequency of laryngospasm during pediatric anesthesia.

PubMed

Mc Donnell, Conor

2013-07-01

Clinical outcomes in pediatric anesthesia have improved significantly over the last 20-30 years but unexpected laryngospasm that is difficult to treat can still result in patient morbidity, increased postoperative medical management and unnecessary hospital admission. The incidence of laryngospasm in pediatric anesthesia is difficult to determine with incidences from 0.9% to as high as 14% quoted in the literature. Clinical experience in our institution suggests that laryngospasm is one of the more frequent unanticipated complications that occur under general anesthesia. Therefore, we applied quality improvement (QI) methodology to: (i) identify the etiology and contributing factors that lead to unanticipated incidents during pediatric anesthesia care; and (ii) decrease the incidence of laryngospasm during pediatric anesthesia care by focusing on awareness, preparedness, education and knowledge translation. We conducted a 30-month improvement project. Twelve months of baseline data describing unanticipated events during pediatric anesthesia care were collected prospectively in a single institution. Data were analyzed to identify leading causes of these unanticipated events and to identify key drivers to improve overall quality of care. Interventions focused on raising awareness of the impact of laryngospasm on quality of patient care, knowledge dissemination and the creation of a knowledge translation tool to encourage future early learning. The primary objective was to decrease the incidence of unanticipated calls for help due to laryngospasm by 50% over a 12-month period. During the 12-month baseline data period, laryngospasm was responsible for 33 instances (50%) of the 65 'calls for help' identified. The incidence of laryngospasm for which help was sought was 0.25% of all anesthetics performed during the baseline data period. After the introduction of our interventions, 16 (24%) of the 68 'calls for help' over the subsequent 16 months were attributed to laryngospasm. The incidence of laryngospasm for which help was sought during the second time period was 0.09% of all anesthetics performed. We applied QI methodology to identify potential improvements in the quality of anesthesia care we deliver to our patients. By designing a number of key drivers and interventions specifically focused on laryngospasm, we decreased the incidence of unanticipated calls for help due to laryngospasm by 50% and maintained this improvement to clinical care across a 12-month period. © 2012 John Wiley & Sons Ltd.

National working conditions surveys in Latin America: comparison of methodological characteristics

PubMed Central

Merino-Salazar, Pamela; Artazcoz, Lucía; Campos-Serna, Javier; Gimeno, David; Benavides, Fernando G.

2015-01-01

Background: High-quality and comparable data to monitor working conditions and health in Latin America are not currently available. In 2007, multiple Latin American countries started implementing national working conditions surveys. However, little is known about their methodological characteristics. Objective: To identify commonalities and differences in the methodologies of working conditions surveys (WCSs) conducted in Latin America through 2013. Methods: The study critically examined WCSs in Latin America between 2007 and 2013. Sampling design, data collection, and questionnaire content were compared. Results: Two types of surveys were identified: (1) surveys covering the entire working population and administered at the respondent's home and (2) surveys administered at the workplace. There was considerable overlap in the topics covered by the dimensions of employment and working conditions measured, but less overlap in terms of health outcomes, prevention resources, and activities. Conclusions: Although WCSs from Latin America are similar, there was heterogeneity across surveyed populations and location of the interview. Reducing differences in surveys between countries will increase comparability and allow for a more comprehensive understanding of occupational health in the region. PMID:26079314

National working conditions surveys in Latin America: comparison of methodological characteristics.

PubMed

Merino-Salazar, Pamela; Artazcoz, Lucía; Campos-Serna, Javier; Gimeno, David; Benavides, Fernando G

2015-01-01

High-quality and comparable data to monitor working conditions and health in Latin America are not currently available. In 2007, multiple Latin American countries started implementing national working conditions surveys. However, little is known about their methodological characteristics. To identify commonalities and differences in the methodologies of working conditions surveys (WCSs) conducted in Latin America through 2013. The study critically examined WCSs in Latin America between 2007 and 2013. Sampling design, data collection, and questionnaire content were compared. Two types of surveys were identified: (1) surveys covering the entire working population and administered at the respondent's home and (2) surveys administered at the workplace. There was considerable overlap in the topics covered by the dimensions of employment and working conditions measured, but less overlap in terms of health outcomes, prevention resources, and activities. Although WCSs from Latin America are similar, there was heterogeneity across surveyed populations and location of the interview. Reducing differences in surveys between countries will increase comparability and allow for a more comprehensive understanding of occupational health in the region.

Security Quality Requirements Engineering (SQUARE) Methodology

DTIC Science & Technology

2005-11-01

such as Joint Application Development and the Accelerated Requirements Method [Wood 89, Hubbard 99] • Soft Systems Methodology [Checkland 89...investigated were misuse cases [Jacobson 92], Soft Systems Methodology (SSM) [Checkland 89], Quality Function Deployment (QFD) [QFD 05], Con- trolled...html (2005). [Checkland 89] Checkland, Peter. Soft Systems Methodology . Rational Analysis for a Problematic World. New York, NY: John Wiley & Sons

Quality of meta-analyses in major leading gastroenterology and hepatology journals: A systematic review.

PubMed

Liu, Pengfei; Qiu, Yuanyu; Qian, Yuting; Chen, Xiao; Wang, Yiran; Cui, Jin; Zhai, Xiao

2017-01-01

To appraise the current reporting methodological quality of meta-analyses in five leading gastroenterology and hepatology journals, and to identify the variables associated with the reporting quality. We systematically searched the literature of meta-analyses in Gastroenterology, Gut, Hepatology, Journal of Hepatology (J HEPATOL) and American Journal of Gastroenterology (AM J GASTROENTEROL) from 2006 to 2008 and from 2012 to 2014. Characteristics were extracted based on the PRISMA statement and the AMSTAR tool. Country, number of patients, funding source were also revealed and descriptively reported. A total of 127 meta-analyses were enrolled in this study and were compared among journals, study years, and other characters. Compliances with the PRISMA statement and the AMSTAR checklist were 20.8 ± 4.2 out of a maximum of 27 and 7.6 ± 2.4 out of a maximum of 11, respectively. Some domains were poorly reported including describing a protocol and/or registration (item 5, 0.0%), describing methods, and giving results of additional analyses (item 16, 45.7% and item 23, 48.0%) for PRISMA and duplicating study selection and data extraction (item 2, 53.5%), and providing a list of included and excluded studies (item 5, 14.2%) for AMSTAR. Publication in recent years showed a significantly better methodological quality than those published in previous years. This study shows that methodological reporting quality of MAs in the major gastroenterology and hepatology journals has improved in recent years after the publication of the developed PRISMA statement, and it can be further improved. © 2016 Journal of Gastroenterology and Hepatology Foundation and John Wiley & Sons Australia, Ltd.

Critical appraisal of clinical trials in multiple system atrophy: Toward better quality.

PubMed

Castro Caldas, Ana; Levin, Johannes; Djaldetti, Ruth; Rascol, Olivier; Wenning, Gregor; Ferreira, Joaquim J

2017-10-01

Multiple system atrophy (MSA) is a rare neurodegenerative disease of undetermined cause. Although many clinical trials have been conducted, there is still no treatment that cures the disease or slows its progression. We sought to assess the clinical trials, methodology, and quality of reporting of clinical trails conducted in MSA patients. We conducted a systematic review of all trials with at least 1 MSA patient subject to any pharmacological/nonpharmacological interventions. Two independent reviewers evaluated the methodological characteristics and quality of reporting of trials. A total of 60 clinical trials were identified, including 1375 MSA patients. Of the trials, 51% (n = 31) were single-arm studies. A total of 28% (n = 17) had a parallel design, half of which (n = 13) were placebo controlled. Of the studies, 8 (13.3%) were conducted in a multicenter setting, 3 of which were responsible for 49.3% (n = 678) of the total included MSA patients. The description of primary outcomes was unclear in 60% (n = 40) of trials. Only 10 (16.7%) clinical trials clearly described the randomization process. Blinding of the participants, personnel, and outcome assessments were at high risk of bias in the majority of studies. The number of dropouts/withdrawals was high (n = 326, 23.4% among the included patients). Overall, the design and quality of reporting of the reviewed studies is unsatisfactory. The most frequent clinical trials were small and single centered. Inadequate reporting was related to the information on the randomization process, sequence generation, allocation concealment, blinding of participants, and sample size calculations. Although improved during the recent years, methodological quality and trial design need to be optimized to generate more informative results. © 2017 International Parkinson and Movement Disorder Society. © 2017 International Parkinson and Movement Disorder Society.

Reporting of health-related quality of life (HRQOL) data in oncology trials: a comparison of the European Organization for Research and Treatment of Cancer Quality of Life (EORTC QLQ-C30) and the Functional Assessment of Cancer Therapy-General (FACT-G).

PubMed

Smith, Adam B; Cocks, Kim; Parry, David; Taylor, Matthew

2014-04-01

The inclusion of patient-reported outcome (PRO) instruments to record patient health-related quality of life (HRQOL) data has virtually become the norm in oncology randomised controlled trials (RCTs). Despite this fact, recent concerns have focused on the quality of reporting of HRQOL. The primary aim of this study was to evaluate the quality of reporting of HRQOL data from two common instruments in oncology RCTs. A meta-review was undertaken of systematic reviews reporting HRQOL data collected using PRO instruments in oncology randomised controlled trials (RCTs). English language articles published between 2000 and 2012 were included and evaluated against a methodology checklist. Four hundred and thirty-five potential articles were identified. Six systematic reviews were included in the analysis. A total of 70,403 patients had completed PROs. The European Organization for Research and Treatment of Cancer QLQ-C30 and Functional Assessment of Cancer Therapy-General questionnaire accounted for 55 % of RCTs. Eighty per cent of RCTs had used psychometrically validated instruments; 70 % reported culturally valid instruments and almost all reported the assessment timing (96 %). Thirty per cent of RCTS reported clinical significance and missing data. In terms of methodological design, only 25 % of RCTs could be categorised as probably robust. The majority of oncology RCTs has shortcomings in terms of reporting HRQOL data when assessed against regulatory and methodology guidelines. These limitations will need to be addressed if HRQOL data are to be used to successfully support clinical decision-making, treatment options and labelling claims in oncology.

An appraisal of the utility or futility of ENT consultant postal questionnaires.

PubMed

Ryan, Stephen; Saunders, J; Clarke, E; Fenton, J E

2013-03-01

Despite an increase in ENT postal questionnaires, the quality of their methodology has been questioned (Ramphul et al. in J Laryngol Otol 119:175-178, 1). This retrospective study examined whether quality and utility of such questionnaires published since 2005 has improved. Seventeen consultant postal questionnaires published between 2005 and 2012 were reviewed. Quality of questionnaires was assessed using a 30-point score based on compliance with 15 criteria previously established to evaluate postal questionnaire study-design (Ramphul et al. in J Laryngol Otol 119:175-178, 1). Citation rates were used as an indicator of utility. The specific comments made in each citing paper was reviewed providing information on whether questionnaire findings (a) had an impact on clinical practice, (b) were the citing comments positive, (c) negative or (d) non-specific. Recurrent methodological flaws were identified in all questionnaires. The average score assigned was 44 %, versus 32 % previously reported (Ramphul et al. in J Laryngol Otol 119:175-178, 1) (P < 0.01, Student's t test). The low citation rate demonstrates poor utility for postal questionnaires. Citations were general non-specific referencing with no clear indication that questionnaire findings positively impacted clinical practice. In conclusion, although the quality of ENT postal questionnaire has improved since the original study (Ramphul et al. in J Laryngol Otol 119:175-178, 1), important recurring methodological flaws still exist. The poor utility, based on low citation rates, also reflects the continued deficiencies in design quality. It is recommended that authors of questionnaire-based research should ensure that guidelines for questionnaire design are adhered in order to improve the validity of findings and hence impact on clinical practice.

Is physiotherapy effective for children with complex regional pain syndrome type 1?

PubMed

Bialocerkowski, Andrea E; Daly, Anne

2012-01-01

This study synthesized current research evidence on the effectiveness of physiotherapy for the management of children diagnosed with complex regional pain syndrome type 1 (CRPS-1), to provide up-to-date physiotherapy treatment recommendations, and to identify areas that require further investigation. Nine electronic databases were searched for quantitative studies that evaluated the effect of physiotherapy on children with CRPS-1. The methodological quality of the studies was evaluated using the Critical Review Form. Data were extracted regarding the study design, participant characteristics, types of outcome measures used, and physiotherapy technique used and its effectiveness. The search strategy identified 303 potential studies, of which 12 met the inclusion criteria (1 randomized controlled trial, 1 comparative study, 10 case series). The methodological quality of all studies was rated as poor to fair. The "stand-alone" value of physiotherapy could not be determined as physiotherapy was prescribed in conjunction with psychological and medical interventions. There is low volume and poor-to-fair quality evidence which suggests that physiotherapy prescribed with other interventions may lead to short-term improvement in the signs and symptoms of CRPS-1 or functional ability in children with CRPS-1, and the relapse rate may be moderately high. High-quality studies are required in this area. These studies should evaluate a package of care (which includes physiotherapy); they should investigate the effects of physiotherapy treatments that have proven effectiveness in adults with CRPS-1; they should use psychometrically sound measures to evaluate outcome; and the nature of physiotherapy should be detailed in future publications to enable replication in the clinical setting.

Systematic review of measurement properties of self-reported instruments for evaluating self-care in adults.

PubMed

Matarese, Maria; Lommi, Marzia; De Marinis, Maria Grazia

2017-06-01

The aims of this study were as follows: to identify instruments developed to assess self-care in healthy adults; to determine the theory on which they were based; their validity and reliability properties and to synthesize the evidence on their measurement properties. Many instruments have been developed to assess self-care in many different populations and conditions. Clinicians and researchers should select the most appropriate self-care instrument based on the knowledge of their measurement properties. Systematic review of measurement instruments according to the protocol recommended by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. PubMed, Embase, PsycINFO, Scopus and CINAHL databases were searched from inception to December 2015. Studies testing measurement properties of self-report instruments assessing self-care in healthy adults, published in the English language and in peer review journals were selected. Two reviewers independently appraised the methodological quality of the studies with the COSMIN checklist and the quality of results using specific quality criteria. Twenty-six articles were included in the review testing the measurement properties of nine instruments. Seven instruments were based on Orem's Self-care theory. Not all the measurement properties were evaluated for the identified instruments. No self-care instrument showed strong evidence supporting the evaluated measurement properties. Despite the development of several instruments to assess self-care in the adult population, no instrument can be fully recommended to clinical nurses and researchers. Further studies of high methodological quality are needed to confirm the measurement properties of these instruments. © 2016 John Wiley & Sons Ltd.

Improving the wellbeing of staff who work in palliative care settings: A systematic review of psychosocial interventions.

PubMed

Hill, Rebecca C; Dempster, Martin; Donnelly, Michael; McCorry, Noleen K

2016-10-01

Staff in palliative care settings perform emotionally demanding roles which may lead to psychological distress including stress and burnout. Therefore, interventions have been designed to address these occupational risks. To investigate quantitative studies exploring the effectiveness of psychosocial interventions that attempt to improve psychological wellbeing of palliative care staff. A systematic review was conducted according to methodological guidance from UK Centre for Reviews and Dissemination. A search strategy was developed based on the initial scans of palliative care studies. Potentially eligible research articles were identified by searching the following databases: CINAHL, MEDLINE (Ovid), PsycINFO and Web of Science. Two reviewers independently screened studies against pre-set eligibility criteria. To assess quality, both researchers separately assessed the remaining studies using the Quality Assessment Tool for Quantitative Studies. A total of 1786 potentially eligible articles were identified - nine remained following screening and quality assessment. Study types included two randomised controlled trials, two non-randomised controlled trial designs, four one-group pre-post evaluations and one process evaluation. Studies took place in the United States and Canada (5), Europe (3) and Hong Kong (1). Interventions comprised a mixture of relaxation, education, support and cognitive training and targeted stress, fatigue, burnout, depression and satisfaction. The randomised controlled trial evaluations did not improve psychological wellbeing of palliative care staff. Only two of the quasi-experimental studies appeared to show improved staff wellbeing although these studies were methodologically weak. There is an urgent need to address the lack of intervention development work and high-quality research in this area. © The Author(s) 2016.

Practice Guideline Recommendations on Perioperative Fasting: A Systematic Review.

PubMed

Lambert, Eva; Carey, Sharon

2016-11-01

Traditionally, perioperative fasting consisted of being nil by mouth (NBM) from midnight before surgery and fasting postoperatively until recovery of bowel function. These outdated practices persist despite emerging evidence revealing that excessive fasting results in negative outcomes and delayed recovery. Various evidence-based, multimodal, enhanced recovery protocols incorporating minimized perioperative fasting have arisen to improve patient outcomes and streamline recovery, but implementation remains limited. This article aims to review current fasting guidelines, assess their quality, summarize relevant recommendations, and identify gaps in evidence. A systematic literature search of Medline and CINAHL and a manual search of relevant websites identified guidelines containing suitable grading systems and fasting recommendations. Guideline quality was assessed using the Appraisal of Guidelines Research and Evaluation (AGREE) tool. Grading systems were standardized to the American Society for Parenteral and Enteral Nutrition format and recommendations summarized based on grading and guideline quality. Nineteen guidelines were included. Rigor of development scores ranged from 29%-95%, with only 8 guidelines explicitly declaring the use of systematic methodology. Applicability scores were lowest, averaging 32%. Ten recommendation types were extracted and summarized. Strong and consistent evidence exists for the minimization of perioperative fasting, for a 2-hour preoperative fast after clear fluids, and for early recommencement of oral food and fluid intake postoperatively. This article presents several high-level recommendations ready for immediate implementation, while poorly graded and inconsistent recommendations reveal key areas for future research. Meanwhile, guideline quality requires improvement, especially regarding rigor of development and applicability, through systematic methodology, reporting transparency, and implementation strategies. © 2015 American Society for Parenteral and Enteral Nutrition.

78 FR 5810 - AHRQ Standing Workgroup for Quality Indicator Measure Specification

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-28

... AHRQ Quality Indicators (QIs), their technical specifications, and associated methodological issues.... The time- limited workgroup is more restricted to specific clinical or methodological issues, while..., data enhancements, and methodological advances. The standing workgroup may potentially provide guidance...

78 FR 22883 - AHRQ Standing Workgroup for Quality Indicator Measure Specification

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-17

... Quality Indicators (QIs), their technical specifications, and associated methodological issues. The...-limited workgroup is more restricted to specific clinical or methodological issues, while the standing... enhancements, and methodological advances. The standing workgroup may potentially provide guidance for the...

Protocol-developing meta-ethnography reporting guidelines (eMERGe).

PubMed

France, E F; Ring, N; Noyes, J; Maxwell, M; Jepson, R; Duncan, E; Turley, R; Jones, D; Uny, I

2015-11-25

Designing and implementing high-quality health care services and interventions requires robustly synthesised evidence. Syntheses of qualitative research studies can provide evidence of patients' experiences of health conditions; intervention feasibility, appropriateness and acceptability to patients; and advance understanding of health care issues. The unique, interpretive, theory-based meta-ethnography synthesis approach is suited to conveying patients' views and developing theory to inform service design and delivery. However, meta-ethnography reporting is often poor quality, which discourages trust in, and use of, meta-ethnography findings. Users of evidence syntheses require reports that clearly articulate analytical processes and findings. Tailored research reporting guidelines can raise reporting standards but none exists for meta-ethnography. This study aims to create an evidence-based meta-ethnography reporting guideline articulating the methodological standards and depth of reporting required to improve reporting quality. The mixed-methods design of this National Institute of Health Research-funded study (http://www.stir.ac.uk/emerge/) follows good practice in research reporting guideline development comprising: (1) a methodological systematic review (PROSPERO registration: CRD42015024709) to identify recommendations and guidance in conducting/reporting meta-ethnography; (2) a review and audit of published meta-ethnographies to identify good practice principles and develop standards in conduct/reporting; (3) an online workshop and Delphi studies to agree guideline content with 45 international qualitative synthesis experts and 45 other stakeholders including patients; (4) development and wide dissemination of the guideline and its accompanying detailed explanatory document, a report template for National Institute of Health Research commissioned meta-ethnographies, and training materials on guideline use. Meta-ethnography, devised in the field of education, is now used widely in other disciplines. Methodological advances relevant to meta-ethnography conduct exist. The extent of discipline-specific adaptations of meta-ethnography and the fit of any adaptions with the underpinning philosophy of meta-ethnography require investigation. Well-reported meta-ethnography findings could inform clinical decision-making. A bespoke meta-ethnography reporting guideline is needed to improve reporting quality, but to be effective potential users must know it exists, trust it and use it. Therefore, a rigorous study has been designed to develop and promote a guideline. By raising reporting quality, the guideline will maximise the likelihood that high-quality meta-ethnographies will contribute robust evidence to improve health care and patient outcomes.

40 CFR Appendix A to Part 132 - Great Lakes Water Quality Initiative Methodologies for Development of Aquatic Life Criteria and...

Code of Federal Regulations, 2010 CFR

2010-07-01

... LAKES SYSTEM Pt. 132, App. A Appendix A to Part 132—Great Lakes Water Quality Initiative Methodologies... 40 Protection of Environment 21 2010-07-01 2010-07-01 false Great Lakes Water Quality Initiative Methodologies for Development of Aquatic Life Criteria and Values A Appendix A to Part 132 Protection of...

40 CFR Appendix A to Part 132 - Great Lakes Water Quality Initiative Methodologies for Development of Aquatic Life Criteria and...

Code of Federal Regulations, 2011 CFR

2011-07-01

... LAKES SYSTEM Pt. 132, App. A Appendix A to Part 132—Great Lakes Water Quality Initiative Methodologies... 40 Protection of Environment 22 2011-07-01 2011-07-01 false Great Lakes Water Quality Initiative Methodologies for Development of Aquatic Life Criteria and Values A Appendix A to Part 132 Protection of...

Comparison of methodological quality of positive versus negative comparative studies published in Indian medical journals: a systematic review.

PubMed

Charan, Jaykaran; Chaudhari, Mayur; Jackson, Ryan; Mhaskar, Rahul; Reljic, Tea; Kumar, Ambuj

2015-06-24

Published negative studies should have the same rigour of methodological quality as studies with positive findings. However, the methodological quality of negative versus positive studies is not known. The objective was to assess the reported methodological quality of positive versus negative studies published in Indian medical journals. A systematic review (SR) was performed of all comparative studies published in Indian medical journals with a clinical science focus and impact factor >1 between 2011 and 2013. The methodological quality of randomised controlled trials (RCTs) was assessed using the Cochrane risk of bias tool, and the Newcastle-Ottawa scale for observational studies. The results were considered positive if the primary outcome was statistically significant and negative otherwise. When the primary outcome was not specified, we used data on the first outcome reported in the history followed by the results section. Differences in various methodological quality domains between positive versus negative studies were assessed by Fisher's exact test. Seven journals with 259 comparative studies were included in this SR. 24% (63/259) were RCTs, 24% (63/259) cohort studies, and 49% (128/259) case-control studies. 53% (137/259) of studies explicitly reported the primary outcome. Five studies did not report sufficient data to enable us to determine if results were positive or negative. Statistical significance was determined by p value in 78.3% (199/254), CI in 2.8% (7/254), both p value and CI in 11.8% (30/254), and only descriptive in 6.3% (16/254) of studies. The overall methodological quality was poor and no statistically significant differences between reporting of methodological quality were detected between studies with positive versus negative findings. There was no difference in the reported methodological quality of positive versus negative studies. However, the uneven reporting of positive versus negative studies (72% vs 28%) indicates a publication bias in Indian medical journals with an impact factor of >1. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Modifiable worker risk factors contributing to workplace absence: a stakeholder-centred best-evidence synthesis of systematic reviews.

PubMed

Wagner, Shannon; White, Marc; Schultz, Izabela; Murray, Eleanor; Bradley, Susan M; Hsu, Vernita; McGuire, Lisa; Schulz, Werner

2014-01-01

A challenge facing stakeholders is the identification and translation of relevant high quality research to inform policy and practice. This study engaged academic and community stakeholders in conducting a best evidence-synthesis to identify modifiable risk and protective worker factors across health conditions impacting work-related absence. To identify modifiable worker disability risk and protective factors across common health conditions impacting work-related absence. We searched Medline, Embase, CINHAL, The Cochrane Library, PsycINFO, BusinessSourceComplete, and ABI/Inform from 2000 to 2011. Quantitative, qualitative, or mixed methods systematic reviews of work-focused population were considered for inclusion. Two or more reviewers independently reviewed articles for inclusion and methodological screening. The search strategy, expert input and grey literature identified 2,467 unique records. One hundred and forty-two full text articles underwent comprehensive review. Twenty-four systematic reviews met eligibility criteria. Modifiable worker factors found to have consistent evidence across two or more health conditions included emotional distress, negative enduring psychology/personality factors, negative health and disability perception, decreased physical activity, lack of family support, poor general health, increased functional disability, increased pain, increased fatigue and lack of motivation to return to work. Systematic reviews are limited by availability of high quality studies, lack of consistency of methodological screening and reporting, and variability of outcome measures used.

The prevention of shin splints in sports: a systematic review of literature.

PubMed

Thacker, Stephen B; Gilchrist, Julie; Stroup, Donna F; Kimsey, C Dexter

2002-01-01

To review the published and unpublished evidence regarding risk factors associated with shin splints, assess the effectiveness of prevention strategies, and offer evidence-based recommendations to coaches, athletes, and researchers. We searched electronic data bases without language restriction, identified citations from reference sections of research papers retrieved, contacted experts in the field, and searched the Cochrane Collaboration. Of the 199 citations identified, we emphasized results of the four reports that compared methods to prevent shin splints. We assessed the methodologic quality of these reports by using a standardized instrument. The use of shock-absorbent insoles, foam heel pads, heel cord stretching, alternative footwear, as well as graduated running programs among military recruits have undergone assessment in controlled trials. There is no strong support for any of these interventions, and each of the four controlled trials is limited methodologically. Median quality scores in these four studies ranged from 29 to 47, and serious flaws in study design, control of bias, and statistical methods were identified. Our review yielded little objective evidence to support widespread use of any existing interventions to prevent shin splints. The most encouraging evidence for effective prevention of shin splints involves the use of shock-absorbing insoles. However, serious flaws in study design and implementation constrain the work in this field thus far. A rigorously implemented research program is critically needed to address this common sports medicine problem.

Linguistic validation and reliability properties are weak investigated of most dementia-specific quality of life measurements-a systematic review.

PubMed

Dichter, Martin Nikolaus; Schwab, Christian G G; Meyer, Gabriele; Bartholomeyczik, Sabine; Halek, Margareta

2016-02-01

For people with dementia, the concept of quality of life (Qol) reflects the disease's impact on the whole person. Thus, Qol is an increasingly used outcome measure in dementia research. This systematic review was performed to identify available dementia-specific Qol measurements and to assess the quality of linguistic validations and reliability studies of these measurements (PROSPERO 2013: CRD42014008725). The MEDLINE, CINAHL, EMBASE, PsycINFO, and Cochrane Methodology Register databases were systematically searched without any date restrictions. Forward and backward citation tracking were performed on the basis of selected articles. A total of 70 articles addressing 19 dementia-specific Qol measurements were identified; nine measurements were adapted to nonorigin countries. The quality of the linguistic validations varied from insufficient to good. Internal consistency was the most frequently tested reliability property. Most of the reliability studies lacked internal validity. Qol measurements for dementia are insufficiently linguistic validated and not well tested for reliability. None of the identified measurements can be recommended without further research. The application of international guidelines and quality criteria is strongly recommended for the performance of linguistic validations and reliability studies of dementia-specific Qol measurements. Copyright © 2016 Elsevier Inc. All rights reserved.

Economic evaluations of alcohol prevention interventions: Is the evidence sufficient? A review of methodological challenges.

PubMed

Hill, Sarah R; Vale, Luke; Hunter, David; Henderson, Emily; Oluboyede, Yemi

2017-12-01

Public health interventions have unique characteristics compared to health technologies, which present additional challenges for economic evaluation (EE). High quality EEs that are able to address the particular methodological challenges are important for public health decision-makers. In England, they are even more pertinent given the transition of public health responsibilities in 2013 from the National Health Service to local government authorities where new agents are shaping policy decisions. Addressing alcohol misuse is a globally prioritised public health issue. This article provides a systematic review of EE and priority-setting studies for interventions to prevent and reduce alcohol misuse published internationally over the past decade (2006-2016). This review appraises the EE and priority-setting evidence to establish whether it is sufficient to meet the informational needs of public health decision-makers. 619 studies were identified via database searches. 7 additional studies were identified via hand searching journals, grey literature and reference lists. 27 met inclusion criteria. Methods identified included cost-utility analysis (18), cost-effectiveness analysis (6), cost-benefit analysis (CBA) (1), cost-consequence analysis (CCA) (1) and return-on-investment (1). The review identified a lack of consideration of methodological challenges associated with evaluating public health interventions and limited use of methods such as CBA and CCA which have been recommended as potentially useful for EE in public health. No studies using other specific priority-setting tools were identified. Copyright © 2017 The Authors. Published by Elsevier B.V. All rights reserved.

Designing nursing excellence through a National Quality Forum nurse scholar program.

PubMed

Neumann, Julie A; Brady-Schluttner, Katherine A; Attlesey-Pries, Jacqueline M; Twedell, Diane M

2010-01-01

Closing the knowledge gap for current practicing nurses in the Institute of Medicine (IOM) core competencies is critical to providing safe patient care. The National Quality Forum (NQF) nurse scholar program is one organization's journey to close the gap in the IOM core competencies in a large teaching organization. The NQF nurse scholar program is positioned to provide a plan to assist current nurses to accelerate their learning about quality improvement, evidence-based practice, and informatics, 3 of the core competencies identified by the IOM, and focus on application of skills to NQF nurse-sensitive measures. Curriculum outline, educational methodologies, administrative processes, and aims of the project are discussed.

Quality in physical therapist clinical education: a systematic review.

PubMed

McCallum, Christine A; Mosher, Peter D; Jacobson, Peri J; Gallivan, Sean P; Giuffre, Suzanne M

2013-10-01

Many factors affect student learning throughout the clinical education (CE) component of professional (entry-level) physical therapist education curricula. Physical therapist education programs (PTEPs) manage CE, yet the material and human resources required to provide CE are generally overseen by community-based physical therapist practices. The purposes of this systematic review were: (1) to examine how the construct of quality is defined in CE literature and (2) to determine the methodological rigor of the available evidence on quality in physical therapist CE. This study was a systematic review of English-language journals using the American Physical Therapy Association's Open Door Portal to Evidence-Based Practice as the computer search engine. The search was categorized using terms for physical therapy and quality and for CE pedagogy and models or roles. Summary findings were characterized by 5 primary themes and 14 subthemes using a qualitative-directed content analysis. Fifty-four articles were included in the study. The primary quality themes were: CE framework, CE sites, structure of CE, assessment in CE, and CE faculty. The methodological rigor of the studies was critically appraised using a binary system based on the McMaster appraisal tools. Scores ranged from 3 to 14. Publication bias and outcome reporting bias may be inherent limitations to the results. The review found inconclusive evidence about what constitutes quality or best practice for physical therapist CE. Five key constructs of CE were identified that, when aggregated, could construe quality.

Highlights in emergency medicine medical education research: 2008.

PubMed

Farrell, Susan E; Coates, Wendy C; Khun, Gloria J; Fisher, Jonathan; Shayne, Philip; Lin, Michelle

2009-12-01

The purpose of this article is to highlight medical education research studies published in 2008 that were methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine. Through a PubMed search of the English language literature in 2008, 30 medical education research studies were independently identified as hypothesis-testing investigations and measurements of educational interventions. Six reviewers independently rated and scored all articles based on eight anchors, four of which related to methodologic criteria. Articles were ranked according to their total rating score. A ranking agreement among the reviewers of 83% was established a priori as a minimum for highlighting articles in this review. Five medical education research studies met the a priori criteria for inclusion and are reviewed and summarized here. Four of these employed experimental or quasi-experimental methodology. Although technology was not a component of the structured literature search employed to identify the candidate articles for this review, 14 of the articles identified, including four of the five highlighted articles, employed or studied technology as a focus of the educational research. Overall, 36% of the reviewed studies were supported by funding; three of the highlighted articles were funded studies. This review highlights quality medical education research studies published in 2008, with outcomes of relevance to teaching and education in emergency medicine. It focuses on research methodology, notes current trends in the use of technology for learning in emergency medicine, and suggests future avenues for continued rigorous study in education.

A methodological review of qualitative case study methodology in midwifery research.

PubMed

Atchan, Marjorie; Davis, Deborah; Foureur, Maralyn

2016-10-01

To explore the use and application of case study research in midwifery. Case study research provides rich data for the analysis of complex issues and interventions in the healthcare disciplines; however, a gap in the midwifery research literature was identified. A methodological review of midwifery case study research using recognized templates, frameworks and reporting guidelines facilitated comprehensive analysis. An electronic database search using the date range January 2005-December 2014: Maternal and Infant Care, CINAHL Plus, Academic Search Complete, Web of Knowledge, SCOPUS, Medline, Health Collection (Informit), Cochrane Library Health Source: Nursing/Academic Edition, Wiley online and ProQuest Central. Narrative evaluation was undertaken. Clearly worded questions reflected the problem and purpose. The application, strengths and limitations of case study methods were identified through a quality appraisal process. The review identified both case study research's applicability to midwifery and its low uptake, especially in clinical studies. Many papers included the necessary criteria to achieve rigour. The included measures of authenticity and methodology were varied. A high standard of authenticity was observed, suggesting authors considered these elements to be routine inclusions. Technical aspects were lacking in many papers, namely a lack of reflexivity and incomplete transparency of processes. This review raises the profile of case study research in midwifery. Midwives will be encouraged to explore if case study research is suitable for their investigation. The raised profile will demonstrate further applicability; encourage support and wider adoption in the midwifery setting. © 2016 John Wiley & Sons Ltd.

Authentic leadership in healthcare: a scoping review.

PubMed

Malila, Niina; Lunkka, Nina; Suhonen, Marjo

2018-02-05

Purpose The purpose of this paper is to review peer-reviewed original research articles on authentic leadership (AL) in health care to identify potential research gaps and present recommendations for future research. The objectives are to examine and map evidence of the main characteristics, research themes and methodologies in the studies. AL is a leader's non-authoritarian, ethical and transparent behaviour pattern. Design/methodology/approach A scoping review with thematic analysis was conducted. A three-step search strategy was used with database and manual searches. The included studies were composed of English language peer-reviewed original research articles referring to both AL and health care. Findings In total, 29 studies were included. The studies favoured Canadian nurses in acute care hospitals. AL was understood as its original definition. The review identified four research themes: well-being at work, patient care quality, work environment and AL promotion. Quantitative research methodology with the authentic leadership questionnaire and cross-sectional design were prevalent. Research limitations/implications Future research needs more variation in research themes, study populations, settings, organisations, work sectors, geographical origins and theory perspectives. Different research methodologies, such as qualitative and mixed methods research and longitudinal designs, should be used more. Originality/value This is presumably the first literature review to map the research on AL in health care.

Methodological quality and scientific impact of quantitative nursing education research over 18 months.

PubMed

Yucha, Carolyn B; Schneider, Barbara St Pierre; Smyer, Tish; Kowalski, Susan; Stowers, Eva

2011-01-01

The methodological quality of nursing education research has not been rigorously studied. The purpose of this study was to evaluate the methodological quality and scientific impact of nursing education research reports. The methodological quality of 133 quantitative nursing education research articles published between July 2006 and December 2007 was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).The mean (+/- SD) MERSQI score was 9.8 +/- 2.2. It correlated (p < .05) with several scientific impact indicators: citation counts from Scopus (r = .223), Google Scholar (r = .224), and journal impact factor (r = .216); it was not associated with Web of Science citation count, funding, or h Index. The similarities between this study's MERSQI ratings for nursing literature and those reported for the medical literature, coupled with the association with citation counts, suggest that the MERSQI is an appropriate instrument to evaluate the quality of nursing education research.

Is Hyperbaric Oxygen Therapy Effective for Traumatic Brain Injury? A Rapid Evidence Assessment of the Literature and Recommendations for the Field.

PubMed

Crawford, Cindy; Teo, Lynn; Yang, EunMee; Isbister, Caitlin; Berry, Kevin

This systematic review examines the efficacy of hyperbaric oxygen (HBO2) for traumatic brain injury (TBI) to make evidence-based recommendations for its application and future research. A comprehensive search was conducted to identify studies through 2014. Methodological quality was assessed and synthesis and interpretation of relevant data was performed. Twelve randomized trials were included. All mild TBI studies demonstrated minimal bias and no statistically significant differences between HBO2 and sham arms. Statistically significant improvement occurred over time within both groups. Moderate-to-severe TBI studies were of mixed quality, with majority of results favoring HBO2 compared with "standard care." The placebo analysis conducted was limited by lack of details. For mild TBI, results indicate HBO2 is no better than sham treatment. Improvements within both HBO2 and sham groups cannot be ignored. For acute treatment of moderate-to-severe TBI, although methodology appears flawed across some studies, because of the complexity of brain injury, HBO2 may be beneficial as a relatively safe adjunctive therapy if feasible. Further research should be considered to resolve the controversy surrounding this field, but only if methodological flaws are avoided and bias minimized.

The role of the therapeutic alliance on pain relief in musculoskeletal rehabilitation: A systematic review.

PubMed

Taccolini Manzoni, Ana Carolina; Bastos de Oliveira, Naiane Teixeira; Nunes Cabral, Cristina Maria; Aquaroni Ricci, Natalia

2018-02-05

The aim of this systematic review was to investigate the role of therapeutic alliance in pain relief in patients with musculoskeletal disorders treated by physiotherapy. Manual and database searches (Medline, Embase, ISI Web of Knowledge, CINAHL, PEDro, Lilacs, Cochrane Library, and PsycINFO) were performed with no restrictions of language and publication date. We included prospective studies with samples of patients undergoing physiotherapy for musculoskeletal conditions, with one measure of therapeutic alliance and the outcome pain. Methodological quality was assessed by the Methodological Index for Nonrandomized Studies and the Cochrane tool for risk of bias. Six articles from four studies were included out of the 936 manuscripts identified. All studies used samples composed of patients with chronic low back pain. Two studies applied therapeutic alliance incentive measures during treatment and reported significant improvement in pain. The remaining studies, without alliance incentives, showed divergence regarding the relationship between the therapeutic alliance and pain. Methodological quality analysis determined low risk of bias of the studies. A lack of studies on the therapeutic alliance regarding musculoskeletal physiotherapy was verified. Existing studies fail to provide evidence of a strong relationship between the therapeutic alliance and pain relief.

[Current situation of health surveys in Spain].

PubMed

Requena, María Luisa; Suárez, Mónica; Pérez, Óscar

2013-01-01

To describe the evolution of health interview surveys in Spain (as of 01/01/2012), whether national or regional, its main characteristics and methodology, and in the case of general health surveys (GHIS), its contents. An adapted version of Eurostat quality control template European Health Interview Survey Technical and Methodological Report was filled in by those responsible for GHIS in each region (autonomous communities) and at the national level. The first part (11 questions) gathers general information about health surveys, both GHIS and surveys targeted to specific populations or health problems (SHIS). The second part (109 questions) asks about methodological characteristics of most recent GHIS. 1) regional or supra-regional scope; 2) for the second part, GHIS currently active series. Quality control was performed using double data entry and validated by informants.100 HIS were identified. 16 were GHIS and 84 SHIS. 32 (38%) of the latter were national and 52 (62%) regional. Nutrition 21 (25%), drug use 10 (12%), opinion polls 7 (9%) and dental health 7 (9%) were the most frequent topics in SHIS. Highest GHIS density was reached after year 2000, with several surveys on field at a time (mode=3). 11 GHIS (2 national, 9 regional) met inclusion criteria for the second part. All complied with general quality benchmarks. Few differences were observed in content.GHIS show more similarities than differences in objectives, methods and content. Rationalization and harmonization are needed. Physical activity, alcohol consumption, quality of life and mental health instruments are not yet consensual. Valid and comparable data are required on health status and its determinants to inform health policy.

Inventory of Personal Factors Influencing Conditioned Pain Modulation in Healthy People: A Systematic Literature Review.

PubMed

Hermans, Linda; Van Oosterwijck, Jessica; Goubert, Dorien; Goudman, Lisa; Crombez, Geert; Calders, Patrick; Meeus, Mira

2016-07-01

Conditioned pain modulation (CPM) is believed to play an important role in the development and exacerbation of chronic pain, because dysfunction of CPM is associated with a shift in balance between pain facilitation and pain inhibition. In many patients with central sensitization, CPM is less efficacious. Besides that, efficacy of CPM is highly variable in healthy people. Consequently, it seems that several individual variables may influence CPM. A systematic review examining personal factors influencing CPM was conducted. This systematic review follows the PRISMA guidelines. "Pubmed" and "Web of Science" were searched using different synonyms of CPM. Full-text clinical reports addressing the influence of personal factors on CPM in healthy adults were included. Checklists for RCTs and case-control studies provided by the Dutch Institute for Healthcare Improvement (CBO) and the Dutch Cochrane Centre were utilized to assess methodological quality. Levels of evidence and strength of conclusion were assigned using the CBO guidelines. Forty-six articles were identified that reported the influence of personal factors on CPM. Quality assessment revealed 10 studies with a methodological quality less than 50% wherefore they were excluded (21.8%), resulting in a general total methodological quality score of 72.5%. Overall younger adult age, male gender, ovulatory phase, positive expectations, attention to the conditioning stimulus, and carrier of the 5-HTTLPR long allele result in better CPM. It is advised for future studies to take these factors into account. Further research regarding the influence of oral contraceptives, catastrophizing, information about conditioning stimulation, distraction, physical activity, and genetics on CPM magnitude is required. © 2015 World Institute of Pain.

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

Application of person-centered analytic methodology in longitudinal research: exemplars from the Women's Health Initiative Clinical Trial data.

PubMed

Zaslavsky, Oleg; Cochrane, Barbara B; Herting, Jerald R; Thompson, Hilaire J; Woods, Nancy F; Lacroix, Andrea

2014-02-01

Despite the variety of available analytic methods, longitudinal research in nursing has been dominated by use of a variable-centered analytic approach. The purpose of this article is to present the utility of person-centered methodology using a large cohort of American women 65 and older enrolled in the Women's Health Initiative Clinical Trial (N = 19,891). Four distinct trajectories of energy/fatigue scores were identified. Levels of fatigue were closely linked to age, socio-demographic factors, comorbidities, health behaviors, and poor sleep quality. These findings were consistent regardless of the methodological framework. Finally, we demonstrated that energy/fatigue levels predicted future hospitalization in non-disabled elderly. Person-centered methods provide unique opportunities to explore and statistically model the effects of longitudinal heterogeneity within a population. © 2013 Wiley Periodicals, Inc.

Breast cancer screening in developing countries

PubMed Central

da Costa Vieira, René Aloísio; Biller, Gabriele; Uemura, Gilberto; Ruiz, Carlos Alberto; Curado, Maria Paula

2017-01-01

Developing countries have limited healthcare resources and use different strategies to diagnose breast cancer. Most of the population depends on the public healthcare system, which affects the diagnosis of the tumor. Thus, the indicators observed in developed countries cannot be directly compared with those observed in developing countries because the healthcare infrastructures in developing countries are deficient. The aim of this study was to evaluate breast cancer screening strategies and indicators in developing countries. A systematic review and the Population, Intervention, Comparison, Outcomes, Timing, and Setting methodology were performed to identify possible indicators of presentation at diagnosis and the methodologies used in developing countries. We searched PubMed for the terms “Breast Cancer” or “Breast Cancer Screening” and “Developing Country” or “Developing Countries”. In all, 1,149 articles were identified. Of these articles, 45 full articles were selected, which allowed us to identify indicators related to epidemiology, diagnostic intervention (diagnostic strategy, diagnostic infrastructure, percentage of women undergoing mammography), quality of intervention (presentation of symptoms at diagnosis, time to diagnosis, early stage disease), comparisons (trend curves, subpopulations at risk) and survival among different countries. The identification of these indicators will improve the reporting of methodologies used in developing countries and will allow us to evaluate improvements in public health related to breast cancer. PMID:28492725

Quality of Diabetes Management in Saudi Arabia: A Review of Existing Barriers.

PubMed

Almutairi, Khalid M

2015-12-01

Diabetes mellitus is a complex disorder that requires continuous management and medical care. The purpose of this review is to identify and summarize the barriers that affect diabetes management in Saudi Arabia. Studies that have examined the quality of diabetes management in Saudi Arabia were identified through online and manual literature searches. Two researchers independently searched and assessed for inclusion/exclusion criteria. All studies were screened by a specialist for the significance of the review. Studies that were included were evaluated for relevance, methodological rigor, and credibility by giving a quality score based on Russell and Gregory's criteria. This review presents an overview of the quality of diabetes management and issues and barriers concerning the improvement of diabetes care in Saudi Arabia. The online literature search yielded 11 studies which met the inclusion criteria. Factors affecting the quality of diabetes care can be categorized into patient factors (such as adherence, compliance, attitudes, beliefs, knowledge, financial resources and co-morbidities) and healthcare providers' factors (including beliefs, attitudes and knowledge, patient - provider interaction and communication). The identified barriers, both from patients and healthcare providers, will help healthcare authorities to improve diabetes management in Saudi Arabia. Improvement of health awareness about disease and disease management should be tailored through continuous patient education. Continuous training and seminars will also expand providers' knowledge that will ensure quality and effective diabetes management.

[Clinical practice guidelines in Peru: evaluation of its quality using the AGREE II instrument].

PubMed

Canelo-Aybar, Carlos; Balbin, Graciela; Perez-Gomez, Ángela; Florez, Iván D

2016-01-01

To evaluate the methodological quality of clinical practice guidelines (CPGs) put into practice by the Peruvian Ministry of Health (MINSA), 17 CPGs from the ministry, published between 2009 and 2014, were independently evaluated by three methodologic experts using the AGREE II instrument. The score of AGREE II domains was low and very low in all CPGs: scope and purpose (medium, 44%), clarity of presentation (medium, 47%), participation of decision-makers (medium, 8%), methodological rigor (medium, 5%), applicability (medium, 5%), and editorial independence (medium, 8%). In conclusion, the methodological quality of CPGs implemented by the MINSA is low. Consequently, its use could not be recommended. The implementation of the methodology for the development of CPGs described in the recentlypublished CPG methodological preparation manual in Peru is a pressing need.

The internal audit of clinical areas: a pilot of the internal audit methodology in a health service emergency department.

PubMed

Brown, Alison; Santilli, Mario; Scott, Belinda

2015-12-01

Governing bodies of health services need assurance that major risks to achieving the health service objectives are being controlled. Currently, the main assurance mechanisms generated within the organization are through the review of implementation of policies and procedures and review of clinical audits and quality data. The governing bodies of health services need more robust, objective data to inform their understanding of the control of clinical risks. Internal audit provides a methodological framework that provides independent and objective assurance to the governing body on the control of significant risks. The article describes the pilot of the internal audit methodology in an emergency unit in a health service. An internal auditor was partnered with a clinical expert to assess the application of clinical criteria based on best practice guidelines. The pilot of the internal audit of a clinical area was successful in identifying significant clinical risks that required further management. The application of an internal audit methodology to a clinical area is a promising mechanism to gain robust assurance at the governance level regarding the management of significant clinical risks. This approach needs further exploration and trial in a range of health care settings. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Association between funding source, methodological quality and research outcomes in randomized controlled trials of synbiotics, probiotics and prebiotics added to infant formula: A Systematic Review

PubMed Central

2013-01-01

Background There is little or no information available on the impact of funding by the food industry on trial outcomes and methodological quality of synbiotics, probiotics and prebiotics research in infants. The objective of this study was to compare the methodological quality, outcomes of food industry sponsored trials versus non industry sponsored trials, with regards to supplementation of synbiotics, probiotics and prebiotics in infant formula. Methods A comprehensive search was conducted to identify published and unpublished randomized clinical trials (RCTs). Cochrane methodology was used to assess the risk of bias of included RCTs in the following domains: 1) sequence generation; 2) allocation concealment; 3) blinding; 4) incomplete outcome data; 5) selective outcome reporting; and 6) other bias. Clinical outcomes and authors’ conclusions were reported in frequencies and percentages. The association between source of funding, risk of bias, clinical outcomes and conclusions were assessed using Pearson’s Chi-square test and the Fisher’s exact test. A p-value < 0.05 was statistically significant. Results Sixty seven completed and 3 on-going RCTs were included. Forty (59.7%) were funded by food industry, 11 (16.4%) by non-industry entities and 16 (23.9%) did not specify source of funding. Several risk of bias domains, especially sequence generation, allocation concealment and blinding, were not adequately reported. There was no significant association between the source of funding and sequence generation, allocation concealment, blinding and selective reporting, majority of reported clinical outcomes or authors’ conclusions. On the other hand, source of funding was significantly associated with the domains of incomplete outcome data, free of other bias domains as well as reported antibiotic use and conclusions on weight gain. Conclusion In RCTs on infants fed infant formula containing probiotics, prebiotics or synbiotics, the source of funding did not influence the majority of outcomes in favour of the sponsors’ products. More non-industry funded research is needed to further assess the impact of funding on methodological quality, reported clinical outcomes and authors’ conclusions. PMID:24219082

Methodological Quality of Systematic Reviews Published in the Urological Literature from 1998 to 2012.

PubMed

Corbyons, Katherine; Han, Julia; Neuberger, Molly M; Dahm, Philipp

2015-11-01

Systematic reviews synthesize the current best evidence to address a clinical question. Given the growing emphasis on evidence-based clinical practice, systematic reviews are being increasingly sought after and published. We previously reported limitations in the methodological quality of 57 individual systematic reviews published from 1998 to 2008. We provide an update to our previous study, adding systematic reviews published from 2009 to 2012. We systematically searched PubMed® and hand searched the table of contents of 4 major urological journals to identify systematic reviews related to questions of prevention and therapy. Two independent reviewers with prior formal evidence-based medicine training assessed the methodological quality using the validated 11-point AMSTAR (A Measurement Tool to Assess Systematic Reviews) instrument. We performed predefined statistical hypothesis testing for differences by publication period (1998 to 2008 vs 2009 to 2012) and journal of publication. We performed statistical testing using SPSS®, version 23.0 with a 2-sided α of 0.05 using the Student t-test, ANOVA and the chi-square test. A total of 113 systematic reviews published from 2009 to 2012 met study inclusion criteria. The most common topics were oncology (44 reviews or 38.9%), voiding dysfunction (26 or 23.0%) and stones/endourology (13 or 11.5%). The largest contributor was European Urology (46 reviews or 40.7%), followed by BJU International (31 or 27.4%) and The Journal of Urology® (22 or 19.5%). The mean ± SD AMSTAR score for the 2009 to 2012 period was 5.3 ± 2.3 compared to 4.8 ± 2.0 for 1998 to 2008 with a mean difference of 0.5 (95% CI 0.2 to 1.2, p = 0.133). While the number of systematic reviews published in the urological literature has increased substantially, the methodological quality of these studies remains suboptimal. Systematic review authors and editors should make every effort to adhere to well established methodological standards to enhance the impact of their research efforts. Copyright © 2015 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Application of Advanced Nondestructive Evaluation Techniques for Cylindrical Composite Test Samples

NASA Technical Reports Server (NTRS)

Martin, Richard E.; Roth, Donald J.; Salem, Jonathan A.

2013-01-01

Two nondestructive methods were applied to composite cylinder samples pressurized to failure in order to determine manufacturing quality and monitor damage progression under load. A unique computed tomography (CT) image processing methodology developed at NASA Glenn Research was used to assess the condition of the as-received samples while acoustic emission (AE) monitoring was used to identify both the extent and location of damage within the samples up to failure. Results show the effectiveness of both of these methods in identifying potentially critical fabrication issues and their resulting impact on performance.

A Novel Clustering Methodology Based on Modularity Optimisation for Detecting Authorship Affinities in Shakespearean Era Plays

PubMed Central

Craig, Hugh; Berretta, Regina; Moscato, Pablo

2016-01-01

In this study we propose a novel, unsupervised clustering methodology for analyzing large datasets. This new, efficient methodology converts the general clustering problem into the community detection problem in graph by using the Jensen-Shannon distance, a dissimilarity measure originating in Information Theory. Moreover, we use graph theoretic concepts for the generation and analysis of proximity graphs. Our methodology is based on a newly proposed memetic algorithm (iMA-Net) for discovering clusters of data elements by maximizing the modularity function in proximity graphs of literary works. To test the effectiveness of this general methodology, we apply it to a text corpus dataset, which contains frequencies of approximately 55,114 unique words across all 168 written in the Shakespearean era (16th and 17th centuries), to analyze and detect clusters of similar plays. Experimental results and comparison with state-of-the-art clustering methods demonstrate the remarkable performance of our new method for identifying high quality clusters which reflect the commonalities in the literary style of the plays. PMID:27571416

Quality measures and assurance for AI (Artificial Intelligence) software

NASA Technical Reports Server (NTRS)

Rushby, John

1988-01-01

This report is concerned with the application of software quality and evaluation measures to AI software and, more broadly, with the question of quality assurance for AI software. Considered are not only the metrics that attempt to measure some aspect of software quality, but also the methodologies and techniques (such as systematic testing) that attempt to improve some dimension of quality, without necessarily quantifying the extent of the improvement. The report is divided into three parts Part 1 reviews existing software quality measures, i.e., those that have been developed for, and applied to, conventional software. Part 2 considers the characteristics of AI software, the applicability and potential utility of measures and techniques identified in the first part, and reviews those few methods developed specifically for AI software. Part 3 presents an assessment and recommendations for the further exploration of this important area.

Improvement of the customer satisfaction through Quality Assurance Matrix and QC-Story methods: A case study from automotive industry

NASA Astrophysics Data System (ADS)

Sicoe, G. M.; Belu, N.; Rachieru, N.; Nicolae, E. V.

2017-10-01

Presently, in the automotive industry, the tendency is to adapt permanently to the changes and introduce the market tendency in the new products that leads of the customer satisfaction. Many quality techniques were adopted in this field to continuous improvement of product and process quality and advantages were also gained. The present paper has focused on possibilities that offers the use of Quality Assurance Matrix (QAM) and Quality Control Story (QC Story) to provide largest protection against nonconformities in the production process, throughout a case study in the automotive industry. There is a direct relationship from the QAM to a QC Story analysis. The failures identified using QAM are treated with QC Story methodology. Using this methods, will help to decrease the PPM values and will increase the quality performance and the customer satisfaction.

Assessing the evidence of Six Sigma and Lean in the health care industry.

PubMed

DelliFraine, Jami L; Langabeer, James R; Nembhard, Ingrid M

2010-01-01

Popular quality improvement tools such as Six Sigma and Lean Systems (SS/L) claim to provide health care managers the opportunity to improve health care quality on the basis of sound methodology and data. However, it is unclear whether these 2 quality improvement tools actually improve health care quality. The authors conducted a comprehensive literature review to assess the empirical evidence relating SS/L to improved clinical outcomes, processes of care, and financial performance of health care organizations. The authors identified 177 articles on SS/L published in the last 10 years. However, only 34 of them reported any outcomes of the SS/L projects studied, and less than one-third of these articles included statistical analyses to test for significant changes in outcomes. This review demonstrates that there are significant gaps in the SS/L health care quality improvement literature and very weak evidence that SS/L improve health care quality.

Methodological reporting of randomized trials in five leading Chinese nursing journals.

PubMed

Shi, Chunhu; Tian, Jinhui; Ren, Dan; Wei, Hongli; Zhang, Lihuan; Wang, Quan; Yang, Kehu

2014-01-01

Randomized controlled trials (RCTs) are not always well reported, especially in terms of their methodological descriptions. This study aimed to investigate the adherence of methodological reporting complying with CONSORT and explore associated trial level variables in the Chinese nursing care field. In June 2012, we identified RCTs published in five leading Chinese nursing journals and included trials with details of randomized methods. The quality of methodological reporting was measured through the methods section of the CONSORT checklist and the overall CONSORT methodological items score was calculated and expressed as a percentage. Meanwhile, we hypothesized that some general and methodological characteristics were associated with reporting quality and conducted a regression with these data to explore the correlation. The descriptive and regression statistics were calculated via SPSS 13.0. In total, 680 RCTs were included. The overall CONSORT methodological items score was 6.34 ± 0.97 (Mean ± SD). No RCT reported descriptions and changes in "trial design," changes in "outcomes" and "implementation," or descriptions of the similarity of interventions for "blinding." Poor reporting was found in detailing the "settings of participants" (13.1%), "type of randomization sequence generation" (1.8%), calculation methods of "sample size" (0.4%), explanation of any interim analyses and stopping guidelines for "sample size" (0.3%), "allocation concealment mechanism" (0.3%), additional analyses in "statistical methods" (2.1%), and targeted subjects and methods of "blinding" (5.9%). More than 50% of trials described randomization sequence generation, the eligibility criteria of "participants," "interventions," and definitions of the "outcomes" and "statistical methods." The regression analysis found that publication year and ITT analysis were weakly associated with CONSORT score. The completeness of methodological reporting of RCTs in the Chinese nursing care field is poor, especially with regard to the reporting of trial design, changes in outcomes, sample size calculation, allocation concealment, blinding, and statistical methods.

Application of the Navigation Guide systematic review methodology to the evidence for developmental and reproductive toxicity of triclosan.

PubMed

Johnson, Paula I; Koustas, Erica; Vesterinen, Hanna M; Sutton, Patrice; Atchley, Dylan S; Kim, Allegra N; Campbell, Marlissa; Donald, James M; Sen, Saunak; Bero, Lisa; Zeise, Lauren; Woodruff, Tracey J

2016-01-01

There are reports of developmental and reproductive health effects associated with the widely used biocide triclosan. Apply the Navigation Guide systematic review methodology to answer the question: Does exposure to triclosan have adverse effects on human development or reproduction? We applied the first 3 steps of the Navigation Guide methodology: 1) Specify a study question, 2) Select the evidence, and 3) Rate quality and strength of the evidence. We developed a protocol, conducted a comprehensive search of the literature, and identified relevant studies using pre-specified criteria. We assessed the number and type of all relevant studies. We evaluated each included study for risk of bias and rated the quality and strength of the evidence for the selected outcomes. We conducted a meta-analysis on a subset of suitable data. We found 4282 potentially relevant records, and 81 records met our inclusion criteria. Of the more than 100 endpoints identified by our search, we focused our evaluation on hormone concentration outcomes, which had the largest human and non-human mammalian data set. Three human studies and 8 studies conducted in rats reported thyroxine levels as outcomes. The rat data were amenable to meta-analysis. Because only one of the human thyroxine studies quantified exposure, we did not conduct a meta-analysis of the human data. Through meta-analysis of the data for rats, we estimated for prenatal exposure a 0.09% (95% CI: -0.20, 0.02) reduction in thyroxine concentration per mg triclosan/kg-bw in fetal and young rats compared to control. For postnatal exposure we estimated a 0.31% (95% CI: -0.38, -0.23) reduction in thyroxine per mg triclosan/kg-bw, also compared to control. Overall, we found low to moderate risk of bias across the human studies and moderate to high risk of bias across the non-human studies, and assigned a "moderate/low" quality rating to the body of evidence for human thyroid hormone alterations and a "moderate" quality rating to the body of evidence for non-human thyroid hormone alterations. Based on this application of the Navigation Guide systematic review methodology, we concluded that there was "sufficient" non-human evidence and "inadequate" human evidence of an association between triclosan exposure and thyroxine concentrations, and consequently, triclosan is "possibly toxic" to reproductive and developmental health. Thyroid hormone disruption is an upstream indicator of developmental toxicity. Additional endpoints may be identified as being of equal or greater concern as other data are developed or evaluated. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Application of the Navigation Guide Systematic Review Methodology to the Evidence for Developmental and Reproductive Toxicity of Triclosan

PubMed Central

Johnson, Paula I.; Koustas, Erica; Vesterinen, Hanna M.; Sutton, Patrice; Atchley, Dylan S.; Kim, Allegra N.; Campbell, Marlissa; Donald, James M.; Sen, Saunak; Bero, Lisa; Zeise, Lauren; Woodruff, Tracey J.

2016-01-01

Background There are reports of developmental and reproductive health effects associated with the widely used biocide triclosan. Objective Apply the Navigation Guide systematic review methodology to answer the question: Does exposure to triclosan have adverse effects on human development or reproduction? Methods We applied the first 3 steps of the Navigation Guide methodology: 1) Specify a study question, 2) Select the evidence, and 3) Rate quality and strength of the evidence. We developed a protocol, conducted a comprehensive search of the literature, and identified relevant studies using pre-specified criteria. We assessed the number and type of all relevant studies. We evaluated each included study for risk of bias and rated the quality and strength of the evidence for the selected outcomes. We conducted a meta-analysis on a subset of suitable data. Results We found 4,282 potentially relevant records, and 81 records met our inclusion criteria. Of the more than 100 endpoints identified by our search, we focused our evaluation on hormone concentration outcomes, which had the largest human and non-human mammalian data set. Three human studies and 8 studies conducted in rats reported thyroxine levels as outcomes. The rat data were amenable to meta-analysis. Because only one of the human thyroxine studies quantified exposure, we did not conduct a meta-analysis of the human data. Through meta-analysis of the data for rats, we estimated for prenatal exposure a 0.09% (95% CI: −0.20, 0.02) reduction in thyroxine concentration per mg triclosan/kg-bw in fetal and young rats compared to control. For postnatal exposure we estimated a 0.31% (95% CI: −0.38, −0.23) reduction in thyroxine per mg triclosan/kg-bw, also compared to control. Overall we found low to moderate risk of bias across the human studies and moderate to high risk of bias across the non-human studies, and assigned a “moderate/low” quality rating to the body of evidence for human thyroid hormone alterations and a “moderate” quality rating to the body of evidence for non-human thyroid hormone alterations. Conclusion Based on this application of the Navigation Guide systematic review methodology, we concluded that there was “sufficient” non-human evidence and “inadequate” human evidence of an association between triclosan exposure and thyroxine concentrations, and consequently, triclosan is “possibly toxic” to reproductive and developmental health. Thyroid hormone disruption is an upstream indicator of developmental toxicity. Additional endpoints may be identified as being of equal or greater concern as other data are developed or evaluated. PMID:27156197

Quantitative comparison of cognitive behavioral therapy and music therapy research: a methodological best-practices analysis to guide future investigation for adult psychiatric patients.

PubMed

Silverman, Michael J

2008-01-01

While the music therapy profession is relatively young and small in size, it can treat a variety of clinical populations and has established a diverse research base. However, although the profession originated working with persons diagnosed with mental illnesses, there is a considerable lack of quantitative research concerning the effects of music therapy with this population. Music therapy clinicians and researchers have reported on this lack of evidence and the difficulty in conducting psychosocial research on their interventions (Choi, 1997; Silverman, 2003a). While published studies have provided suggestions for future research, no studies have provided detailed propositions for the methodology and design of meticulous high quality randomized controlled psychiatric music therapy research. How do other psychotherapies accomplish their databases and could the music therapy field borrow from their rigorous "methodological best practices" to strengthen its own literature base? Therefore, as the National Institutes of Mental Health state the treatment of choice for evidence-based psychotherapy is cognitive behavioral therapy (CBT), aspects of this psychotherapy's literature base were analyzed. The purpose of this literature analysis was to (a) analyze and identify components of high-quality quantitative CBT research for adult psychiatric consumers, (b) analyze and identify the variables and other elements of existing quantitative psychiatric music therapy research for adult consumers, and (c) compare the two data sets to identify the best methodological designs and variables for future quantitative music therapy research with the mental health population. A table analyzing randomized and thoroughly controlled studies involving the use of CBT for persons with severe mental illnesses is included to determine chief components of high-quality experimental research designs and implementation of quantitative clinical research. The table also shows the same analyzed components for existing quantitative psychiatric music therapy research with adult consumers, thus highlighting potential areas and elements for future investigations. A second table depicts a number of potential dependent measures and their sources to be evaluated in future music therapy studies. A third table providing suggestions for future research is derived from a synthesis of the tables and is included to guide researchers and encourage the advancement and expansion of the current literature base. The body of the paper is a discussion of the results of the literature analysis derived from the tables, meta-analyses, and reviews of literature. It is hoped that this report will lead to the addition of future high-quality quantitative research to the psychiatric music therapy literature base and thus provide evidence-based services to as many persons with mental illnesses as possible.

Methodological quality of systematic reviews on treatments for depression: a cross-sectional study.

PubMed

Chung, V C H; Wu, X Y; Feng, Y; Ho, R S T; Wong, S Y S; Threapleton, D

2017-05-02

Depression is one of the most common mental disorders and identifying effective treatment strategies is crucial for the control of depression. Well-conducted systematic reviews (SRs) and meta-analyses can provide the best evidence for supporting treatment decision-making. Nevertheless, the trustworthiness of conclusions can be limited by lack of methodological rigour. This study aims to assess the methodological quality of a representative sample of SRs on depression treatments. A cross-sectional study on the bibliographical and methodological characteristics of SRs published on depression treatments trials was conducted. Two electronic databases (the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects) were searched for potential SRs. SRs with at least one meta-analysis on the effects of depression treatments were considered eligible. The methodological quality of included SRs was assessed using the validated AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool. The associations between bibliographical characteristics and scoring on AMSTAR items were analysed using logistic regression analysis. A total of 358 SRs were included and appraised. Over half of included SRs (n = 195) focused on non-pharmacological treatments and harms were reported in 45.5% (n = 163) of all studies. Studies varied in methods and reporting practices: only 112 (31.3%) took the risk of bias among primary studies into account when formulating conclusions; 245 (68.4%) did not fully declare conflict of interests; 93 (26.0%) reported an 'a priori' design and 104 (29.1%) provided lists of both included and excluded studies. Results from regression analyses showed: more recent publications were more likely to report 'a priori' designs [adjusted odds ratio (AOR) 1.31, 95% confidence interval (CI) 1.09-1.57], to describe study characteristics fully (AOR 1.16, 95% CI 1.06-1.28), and to assess presence of publication bias (AOR 1.13, 95% CI 1.06-1.19), but were less likely to list both included and excluded studies (AOR 0.86, 95% CI 0.81-0.92). SRs published in journals with higher impact factor (AOR 1.14, 95% CI 1.04-1.25), completed by more review authors (AOR 1.12, 95% CI 1.01-1.24) and SRs on non-pharmacological treatments (AOR 1.62, 95% CI 1.01-2.59) were associated with better performance in publication bias assessment. The methodological quality of included SRs is disappointing. Future SRs should strive to improve rigour by considering of risk of bias when formulating conclusions, reporting conflict of interests and authors should explicitly describe harms. SR authors should also use appropriate methods to combine the results, prevent language and publication biases, and ensure timely updates.

The Rationale and Methodology for Development of a Competency Based Leadership Education and Training Program in the Navy.

ERIC Educational Resources Information Center

Scanland, Worth; Pepper, Dorothy

Numerous attempts by the U.S. Navy to identify leadership potential within its ranks and to train for such leadership skills have been mostly unsuccessful since the efforts were based upon very subjective perceptions of good leadership qualities. To address this problem, the Navy, with the assistance of Dr. David McClelland, has described a set of…

Human Error Assessment and Reduction Technique (HEART) and Human Factor Analysis and Classification System (HFACS)

NASA Technical Reports Server (NTRS)

Alexander, Tiffaney Miller

2017-01-01

Research results have shown that more than half of aviation, aerospace and aeronautics mishaps incidents are attributed to human error. As a part of Quality within space exploration ground processing operations, the identification and or classification of underlying contributors and causes of human error must be identified, in order to manage human error.This presentation will provide a framework and methodology using the Human Error Assessment and Reduction Technique (HEART) and Human Factor Analysis and Classification System (HFACS), as an analysis tool to identify contributing factors, their impact on human error events, and predict the Human Error probabilities (HEPs) of future occurrences. This research methodology was applied (retrospectively) to six (6) NASA ground processing operations scenarios and thirty (30) years of Launch Vehicle related mishap data. This modifiable framework can be used and followed by other space and similar complex operations.

Telemedicine security: a systematic review.

PubMed

Garg, Vaibhav; Brewer, Jeffrey

2011-05-01

Telemedicine is a technology-based alternative to traditional health care delivery. However, poor security measures in telemedicine services can have an adverse impact on the quality of care provided, regardless of the chronic condition being studied. We undertook a systematic review of 58 journal articles pertaining to telemedicine security. These articles were selected based on a keyword search on 14 relevant journals. The articles were coded to evaluate the methodology and to identify the key areas of research in security that are being reviewed. Seventy-six percent of the articles defined the security problem they were addressing, and only 47% formulated a research question pertaining to security. Sixty-one percent proposed a solution, and 20% of these tested the security solutions that they proposed. Prior research indicates inadequate reporting of methodology in telemedicine research. We found that to be true for security research as well. We also identified other issues such as using outdated security standards. © 2011 Diabetes Technology Society.

Telemedicine Security: A Systematic Review

PubMed Central

Garg, Vaibhav; Brewer, Jeffrey

2011-01-01

Telemedicine is a technology-based alternative to traditional health care delivery. However, poor security measures in telemedicine services can have an adverse impact on the quality of care provided, regardless of the chronic condition being studied. We undertook a systematic review of 58 journal articles pertaining to telemedicine security. These articles were selected based on a keyword search on 14 relevant journals. The articles were coded to evaluate the methodology and to identify the key areas of research in security that are being reviewed. Seventy-six percent of the articles defined the security problem they were addressing, and only 47% formulated a research question pertaining to security. Sixty-one percent proposed a solution, and 20% of these tested the security solutions that they proposed. Prior research indicates inadequate reporting of methodology in telemedicine research. We found that to be true for security research as well. We also identified other issues such as using outdated security standards. PMID:21722592

Use of Lot quality assurance sampling surveys to evaluate community health worker performance in rural Zambia: a case of Luangwa district.

PubMed

Mwanza, Moses; Zulu, Japhet; Topp, Stephanie M; Musonda, Patrick; Mutale, Wilbroad; Chilengi, Roma

2017-04-17

The Better Health Outcomes through Mentoring and Assessment (BHOMA) project is a cluster randomized controlled trial aimed at reducing age-standardized mortality rates in three rural districts through involvement of Community Health Workers (CHWs), Traditional Birth Attendants (TBAs), and Neighborhood Health Committees (NHCs). CHWs conduct quarterly surveys on all households using a questionnaire that captures key health events occurring within their catchment population. In order to validate contact with households, we utilize the Lot Quality Assurance Sampling (LQAS) methodology. In this study, we report experiences of applying the LQAS approach to monitor performance of CHWs in Luangwa District. Between April 2011 and December 2013, seven health facilities in Luangwa district were enrolled into the BHOMA project. The health facility catchment areas were divided into 33 geographic zones. Quality assurance was performed each quarter by randomly selecting zones representing about 90% of enrolled catchment areas from which 19 households per zone where also randomly identified. The surveys were conducted by CHW supervisors who had been trained on using the LQAS questionnaire. Information collected included household identity number (ID), whether the CHW visited the household, duration of the most recent visit, and what health information was discussed during the CHW visit. The threshold for success was set at 75% household outreach by CHWs in each zone. There are 4,616 total households in the 33 zones. This yielded a target of 32,212 household visits by community health workers during the 7 survey rounds. Based on the set cutoff point for passing the surveys (at least 75% households confirmed as visited), only one team of CHWs at Luangwa high school failed to reach the target during round 1 of the surveys; all the teams otherwise registered successful visits in all the surveys. We have employed the LQAS methodology for assurance that quarterly surveys were successfully done. This methodology proved helpful in identifying poorly performing CHWs and could be useful for evaluating CHW performance in other areas. Identifier: NCT01942278 . Date of Registration: September 2013.

Quality and reporting of diagnostic accuracy studies in TB, HIV and malaria: evaluation using QUADAS and STARD standards.

PubMed

Fontela, Patricia Scolari; Pant Pai, Nitika; Schiller, Ian; Dendukuri, Nandini; Ramsay, Andrew; Pai, Madhukar

2009-11-13

Poor methodological quality and reporting are known concerns with diagnostic accuracy studies. In 2003, the QUADAS tool and the STARD standards were published for evaluating the quality and improving the reporting of diagnostic studies, respectively. However, it is unclear whether these tools have been applied to diagnostic studies of infectious diseases. We performed a systematic review on the methodological and reporting quality of diagnostic studies in TB, malaria and HIV. We identified diagnostic accuracy studies of commercial tests for TB, malaria and HIV through a systematic search of the literature using PubMed and EMBASE (2004-2006). Original studies that reported sensitivity and specificity data were included. Two reviewers independently extracted data on study characteristics and diagnostic accuracy, and used QUADAS and STARD to evaluate the quality of methods and reporting, respectively. Ninety (38%) of 238 articles met inclusion criteria. All studies had design deficiencies. Study quality indicators that were met in less than 25% of the studies included adequate description of withdrawals (6%) and reference test execution (10%), absence of index test review bias (19%) and reference test review bias (24%), and report of uninterpretable results (22%). In terms of quality of reporting, 9 STARD indicators were reported in less than 25% of the studies: methods for calculation and estimates of reproducibility (0%), adverse effects of the diagnostic tests (1%), estimates of diagnostic accuracy between subgroups (10%), distribution of severity of disease/other diagnoses (11%), number of eligible patients who did not participate in the study (14%), blinding of the test readers (16%), and description of the team executing the test and management of indeterminate/outlier results (both 17%). The use of STARD was not explicitly mentioned in any study. Only 22% of 46 journals that published the studies included in this review required authors to use STARD. Recently published diagnostic accuracy studies on commercial tests for TB, malaria and HIV have moderate to low quality and are poorly reported. The more frequent use of tools such as QUADAS and STARD may be necessary to improve the methodological and reporting quality of future diagnostic accuracy studies in infectious diseases.

Quality and Reporting of Diagnostic Accuracy Studies in TB, HIV and Malaria: Evaluation Using QUADAS and STARD Standards

PubMed Central

Fontela, Patricia Scolari; Pant Pai, Nitika; Schiller, Ian; Dendukuri, Nandini; Ramsay, Andrew; Pai, Madhukar

2009-01-01

Background Poor methodological quality and reporting are known concerns with diagnostic accuracy studies. In 2003, the QUADAS tool and the STARD standards were published for evaluating the quality and improving the reporting of diagnostic studies, respectively. However, it is unclear whether these tools have been applied to diagnostic studies of infectious diseases. We performed a systematic review on the methodological and reporting quality of diagnostic studies in TB, malaria and HIV. Methods We identified diagnostic accuracy studies of commercial tests for TB, malaria and HIV through a systematic search of the literature using PubMed and EMBASE (2004–2006). Original studies that reported sensitivity and specificity data were included. Two reviewers independently extracted data on study characteristics and diagnostic accuracy, and used QUADAS and STARD to evaluate the quality of methods and reporting, respectively. Findings Ninety (38%) of 238 articles met inclusion criteria. All studies had design deficiencies. Study quality indicators that were met in less than 25% of the studies included adequate description of withdrawals (6%) and reference test execution (10%), absence of index test review bias (19%) and reference test review bias (24%), and report of uninterpretable results (22%). In terms of quality of reporting, 9 STARD indicators were reported in less than 25% of the studies: methods for calculation and estimates of reproducibility (0%), adverse effects of the diagnostic tests (1%), estimates of diagnostic accuracy between subgroups (10%), distribution of severity of disease/other diagnoses (11%), number of eligible patients who did not participate in the study (14%), blinding of the test readers (16%), and description of the team executing the test and management of indeterminate/outlier results (both 17%). The use of STARD was not explicitly mentioned in any study. Only 22% of 46 journals that published the studies included in this review required authors to use STARD. Conclusion Recently published diagnostic accuracy studies on commercial tests for TB, malaria and HIV have moderate to low quality and are poorly reported. The more frequent use of tools such as QUADAS and STARD may be necessary to improve the methodological and reporting quality of future diagnostic accuracy studies in infectious diseases. PMID:19915664

Reporting and methodological quality of survival analysis in articles published in Chinese oncology journals

PubMed Central

Zhu, Xiaoyan; Zhou, Xiaobin; Zhang, Yuan; Sun, Xiao; Liu, Haihua; Zhang, Yingying

2017-01-01

Abstract Survival analysis methods have gained widespread use in the filed of oncology. For achievement of reliable results, the methodological process and report quality is crucial. This review provides the first examination of methodological characteristics and reporting quality of survival analysis in articles published in leading Chinese oncology journals. To examine methodological and reporting quality of survival analysis, to identify some common deficiencies, to desirable precautions in the analysis, and relate advice for authors, readers, and editors. A total of 242 survival analysis articles were included to be evaluated from 1492 articles published in 4 leading Chinese oncology journals in 2013. Articles were evaluated according to 16 established items for proper use and reporting of survival analysis. The application rates of Kaplan–Meier, life table, log-rank test, Breslow test, and Cox proportional hazards model (Cox model) were 91.74%, 3.72%, 78.51%, 0.41%, and 46.28%, respectively, no article used the parametric method for survival analysis. Multivariate Cox model was conducted in 112 articles (46.28%). Follow-up rates were mentioned in 155 articles (64.05%), of which 4 articles were under 80% and the lowest was 75.25%, 55 articles were100%. The report rates of all types of survival endpoint were lower than 10%. Eleven of 100 articles which reported a loss to follow-up had stated how to treat it in the analysis. One hundred thirty articles (53.72%) did not perform multivariate analysis. One hundred thirty-nine articles (57.44%) did not define the survival time. Violations and omissions of methodological guidelines included no mention of pertinent checks for proportional hazard assumption; no report of testing for interactions and collinearity between independent variables; no report of calculation method of sample size. Thirty-six articles (32.74%) reported the methods of independent variable selection. The above defects could make potentially inaccurate, misleading of the reported results, or difficult to interpret. There are gaps in the conduct and reporting of survival analysis in studies published in Chinese oncology journals, severe deficiencies were noted. More endorsement by journals of the report guideline for survival analysis may improve articles quality, and the dissemination of reliable evidence to oncology clinicians. We recommend authors, readers, reviewers, and editors to consider survival analysis more carefully and cooperate more closely with statisticians and epidemiologists. PMID:29390340

Considering axiological integrity: a methodological analysis of qualitative evidence syntheses, and its implications for health professions education.

PubMed

Kelly, Martina; Ellaway, Rachel H; Reid, Helen; Ganshorn, Heather; Yardley, Sarah; Bennett, Deirdre; Dornan, Tim

2018-05-14

Qualitative evidence synthesis (QES) is a suite of methodologies that combine qualitative techniques with the synthesis of qualitative knowledge. They are particularly suited to medical education as these approaches pool findings from original qualitative studies, whilst paying attention to context and theoretical development. Although increasingly sophisticated use is being made of qualitative primary research methodologies in health professions education (HPE) the use of secondary qualitative reviews in HPE remains underdeveloped. This study examined QES methods applied to clinical humanism in healthcare as a way of advancing thinking around the use of QES in HPE in general. A systematic search strategy identified 49 reviews that fulfilled the inclusion criteria. Meta-study was used to develop an analytic summary of methodological characteristics, the role of theory, and the synthetic processes used in QES reviews. Fifteen reviews used a defined methodology, and 17 clearly explained the processes that led from data extraction to synthesis. Eight reviews adopted a specific theoretical perspective. Authors rarely described their reflexive relationship with their data. Epistemological positions tended to be implied rather than explicit. Twenty-five reviews included some form of quality appraisal, although it was often unclear how authors acted on its results. Reviewers under-reported qualitative approaches in their review methodologies, and tended to focus on elements such as systematicity and checklist quality appraisal that were more germane to quantitative evidence synthesis. A core concern was that the axiological (value) dimensions of the source materials were rarely considered let alone accommodated in the synthesis techniques used. QES can be used in HPE research but only with careful attention to maintaining axiological integrity.

Development of Methodology and Technology for Identifying and Quantifying Emission Products from Open Burning and Open Detonation Thermal Treatment Methods. BangBox Test Series. Volume 3. Quality Assurance and Quality Control

DTIC Science & Technology

1992-01-01

software. This document may not be cited for purposes of advertisement. I I I I I I I’ I , , I SECURITY CLASSIF!CATION 0a . T - S PAGE Form Aoprovea...8217, 3 DISTRIBUTION 1AVAILABSLITY OF REPORT N/A 2b DECLASSIFICATION/DOWNGRADING SCHEDULE Unlimited N/A 4 PERFORMING ORGANIZATION REPORT NUMBER( S ) S ...MONITORING ORGANIZATION REPORT NUMBER( S , 6a NAME OF PERFORMING ORGANIZATION 6b. OFFICE SYMBOL 7a NAME OF MONITORING ORGANIZATION Andrulis Research

Development of Methodology and Technology for Identifying and Quantifying Emission Products from Open Burning and Open Detonation Thermal Treatment Methods. Field Test Series A, B, and C. Volume 2, Part B. Quality Assurance and Quality Control. Appendices

DTIC Science & Technology

1992-01-01

the uncertainty. The above method can give an estimate of the precision of the * analysis. However, determining the accuracy can not be done as...speciation has been determined from analyzing model samples as well as comparison with other methods and combinations of other methods with this method . 3...laboratory. The output of the sensor is characterized over its working range and an appropriate response factor determined by linear regression of the

EHR-based disease registries to support integrated care in a health neighbourhood: an ontology-based methodology.

PubMed

Liaw, Siaw-Teng; Taggart, Jane; Yu, Hairong

2014-01-01

Disease registries derived from Electronic Health Records (EHRs) are widely used for chronic disease management. We approached registries from the perspective of integrated care in a health neighbourhood, considering data quality issues such as semantic interoperability (consistency), accuracy, completeness and duplication. Our proposition is that a realist ontological approach is required to accurately identify patients in an EHR or data repository, assess data quality and fitness for use by the multidisciplinary integrated care team. We report on this approach with routinely collected data in a practice based research network in Australia.

Development of Methodology and Technology for Identifying and Quantifying Emission Products from Open Burning and Open Detonation Thermal Treatment Methods. Field Test Series A, B, and C. Volume 2, Part A. Quality Assurance and Quality Control

DTIC Science & Technology

1992-01-01

instrument logbook was maintained, but all calibration printouts for the SFC/MS were put in a dedicated loose- leaf notebook. The temperature of the...to-date temperature - monitoring sheets were located at the freezer. Each worker maintained a project-specific personal logbook to enter data...driven 10-cm-diameter gate valve into a 1.5-m3 carbon-impregnated polyethylene ( Velostat 7") sampling bag. The bag, constructed of electrically

[Current state of competence assessment in nursing].

PubMed

Darmann-Finck, Ingrid; Reuschenbach, Bernd

2013-01-01

Competency measurement is central to the optimisation of outcome oriented educational processes in nursing, similar to the concept of evidence based practice. The classification of measurement tools provides the basis for describing the current state of research and development in relation to competence measurement in nursing science, and any gaps are identified. The article concludes with questioning the importance of outcome oriented quality orientation in order to achieve an increase in quality during training. Further methodological developments and qualitative studies are needed to examine the context specific processes of interaction and learning, beyond competence diagnostics. Copyright © 2012. Published by Elsevier GmbH.

Comparison of methodologic quality and study/report characteristics between quantitative clinical nursing and nursing education research articles.

PubMed

Schneider, Barbara St Pierre; Nicholas, Jennifer; Kurrus, Jeffrey E

2013-01-01

To compare the methodologic quality and study/report characteristics between quantitative clinical nursing and nursing education research articles. The methodologic quality of quantitative nursing education research needs to advance to a higher level. Clinical research can provide guidance for nursing education to reach this level. One hundred quantitative clinical research articles from-high impact journals published in 2007 and 37 education research articles from high impact journals published in 2006 to 2007 were chosen for analysis. Clinical articles had significantly higher quality scores than education articles in three domains: number of institutions studied, type of data, and outcomes. The findings indicate three ways in which nursing education researchers can strengthen the methodologic quality of their quantitative research. With this approach, greater funding may be secured for advancing the science of nursing education.

The research gap in chronic paediatric pain: A systematic review of randomised controlled trials.

PubMed

Boulkedid, R; Abdou, A Y; Desselas, E; Monégat, M; de Leeuw, T G; Avez-Couturier, J; Dugue, S; Mareau, C; Charron, B; Alberti, C; Kaguelidou, F

2018-02-01

Chronic pain is associated with significant functional and social impairment. The objective of this review was to assess the characteristics and quality of randomized controlled trials (RCTs) evaluating pain management interventions in children and adolescents with chronic pain. We performed a systematic search of PubMed, Embase and the Cochrane Library up to July 2017. We included RCTs that involved children and adolescents (3 months-18 years) and evaluated the use of pharmacological or non-pharmacological intervention(s) in the context of pain persisting or re-occurring for more than 3 months. Methodological quality was evaluated using the Cochrane Risk of Bias (ROB) Tool. A total of 58 RCTs were identified and numbers steadily increased over time. The majority were conducted in single hospital institutions, with no information on study funding. Median sample size was 47.5 participants (Q1,Q3: 32, 70). Forty-five percent of RCTs included both adults and children and the median of the mean ages at inclusion was 12.9 years (Q1,Q3: 11, 15). Testing of non-pharmacological interventions was predominant and only 5 RCTs evaluated analgesics or co-analgesics. Abdominal pain, headache/migraine and musculoskeletal pain were the most common types of chronic pain among participants. Methodological quality was poor with 90% of RCTs presenting a high or unclear ROB. Evaluation of analgesics targeting chronic pain relief in children and adolescents through RCTs is marginal. Infants and children with long-lasting painful conditions are insufficiently represented in RCTs. We discuss possible research constraints and challenges as well as methodologies to circumvent them. There is a substantial research gap regarding analgesic interventions for children and adolescents with chronic pain. Most clinical trials in the field focus on the evaluation of non-pharmacological interventions and are of low methodological quality. There is also a specific lack of trials involving infants and children and adolescents with long-lasting diseases. © 2017 European Pain Federation - EFIC®.

Accuracy of the Canadian C-spine rule and NEXUS to screen for clinically important cervical spine injury in patients following blunt trauma: a systematic review

PubMed Central

Michaleff, Zoe A.; Maher, Chris G.; Verhagen, Arianne P.; Rebbeck, Trudy; Lin, Chung-Wei Christine

2012-01-01

Background: There is uncertainty about the optimal approach to screen for clinically important cervical spine (C-spine) injury following blunt trauma. We conducted a systematic review to investigate the diagnostic accuracy of the Canadian C-spine rule and the National Emergency X-Radiography Utilization Study (NEXUS) criteria, 2 rules that are available to assist emergency physicians to assess the need for cervical spine imaging. Methods: We identified studies by an electronic search of CINAHL, Embase and MEDLINE. We included articles that reported on a cohort of patients who experienced blunt trauma and for whom clinically important cervical spine injury detectable by diagnostic imaging was the differential diagnosis; evaluated the diagnostic accuracy of the Canadian C-spine rule or NEXUS or both; and used an adequate reference standard. We assessed the methodologic quality using the Quality Assessment of Diagnostic Accuracy Studies criteria. We used the extracted data to calculate sensitivity, specificity, likelihood ratios and post-test probabilities. Results: We included 15 studies of modest methodologic quality. For the Canadian C-spine rule, sensitivity ranged from 0.90 to 1.00 and specificity ranged from 0.01 to 0.77. For NEXUS, sensitivity ranged from 0.83 to 1.00 and specificity ranged from 0.02 to 0.46. One study directly compared the accuracy of these 2 rules using the same cohort and found that the Canadian C-spine rule had better accuracy. For both rules, a negative test was more informative for reducing the probability of a clinically important cervical spine injury. Interpretation: Based on studies with modest methodologic quality and only one direct comparison, we found that the Canadian C-spine rule appears to have better diagnostic accuracy than the NEXUS criteria. Future studies need to follow rigorous methodologic procedures to ensure that the findings are as free of bias as possible. PMID:23048086

Development of an Online Library of Patient-Reported Outcome Measures in Gastroenterology: The GI-PRO Database

PubMed Central

Khanna, Puja; Agarwal, Nikhil; Khanna, Dinesh; Hays, Ron D.; Chang, Lin; Bolus, Roger; Melmed, Gil; Whitman, Cynthia B.; Kaplan, Robert M.; Ogawa, Rikke; Snyder, Bradley; Spiegel, Brennan M.R.

2014-01-01

OBJECTIVES Because gastrointestinal (GI) illnesses can cause physical, emotional, and social distress, patient-reported outcomes (PROs) are used to guide clinical decision making, conduct research, and seek drug approval. It is important to develop a mechanism for identifying, categorizing, and evaluating the over 100 GI PROs that exist. Here we describe a new, National Institutes of Health (NIH)-supported, online PRO clearinghouse—the GI-PRO database. METHODS Using a protocol developed by the NIH Patient-Reported Outcome Measurement Information System (PROMIS®), we performed a systematic review to identify English-language GI PROs. We abstracted PRO items and developed an online searchable item database. We categorized symptoms into content “bins” to evaluate a framework for GI symptom reporting. Finally, we assigned a score for the methodological quality of each PRO represented in the published literature (0–20 range; higher indicates better). RESULTS We reviewed 15,697 titles (κ > 0.6 for title and abstract selection), from which we identified 126 PROs. Review of the PROs revealed eight GI symptom “bins”: (i) abdominal pain, (ii) bloat/gas, (iii) diarrhea, (iv) constipation, (v) bowel incontinence/soilage, (vi) heartburn/reflux, (vii) swallowing, and (viii) nausea/vomiting. In addition to these symptoms, the PROs covered four psychosocial domains: (i) behaviors, (ii) cognitions, (iii) emotions, and (iv) psychosocial impact. The quality scores were generally low (mean 8.88±4.19; 0 (min)−20 (max)). In addition, 51% did not include patient input in developing the PRO, and 41% provided no information on score interpretation. CONCLUSIONS GI PROs cover a wide range of biopsychosocial symptoms. Although plentiful, GI PROs are limited by low methodological quality. Our online PRO library (www.researchcore.org/gipro/) can help in selecting PROs for clinical and research purposes. PMID:24343547

The Omaha System: a systematic review of the recent literature

PubMed Central

Topaz, Maxim; Golfenshtein, Nadya; Bowles, Kathryn H

2014-01-01

Background The Omaha System (OS) is one of the oldest of the American Nurses Association recognized standardized terminologies describing and measuring the impact of healthcare services. This systematic review presents the state of science on the use of the OS in practice, research, and education. Aims (1) To identify, describe and evaluate the publications on the OS between 2004 and 2011, (2) to identify major trends in the use of the OS in research, practice, and education, and (3) to suggest areas for future research. Methods Systematic search in the largest online healthcare databases (PUBMED, CINAHL, Scopus, PsycINFO, Ovid) from 2004 to 2011. Methodological quality of the reviewed research studies was evaluated. Results 56 publications on the OS were identified and analyzed. The methodological quality of the reviewed research studies was relatively high. Over time, publications’ focus shifted from describing clients’ problems toward outcomes research. There was an increasing application of advanced statistical methods and a significant portion of authors focused on classification and interoperability research. There was an increasing body of international literature on the OS. Little research focused on the theoretical aspects of the OS, the effective use of the OS in education, or cultural adaptations of the OS outside the USA. Conclusions The OS has a high potential to provide meaningful and high quality information about complex healthcare services. Further research on the OS should focus on its applicability in healthcare education, theoretical underpinnings and international validity. Researchers analyzing the OS data should address how they attempted to mitigate the effects of missing data in analyzing their results and clearly present the limitations of their studies. PMID:23744786

ACCF/AHA methodology for the development of quality measures for cardiovascular technology: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Performance Measures.

PubMed

Bonow, Robert O; Douglas, Pamela S; Buxton, Alfred E; Cohen, David J; Curtis, Jeptha P; Delong, Elizabeth; Drozda, Joseph P; Ferguson, T Bruce; Heidenreich, Paul A; Hendel, Robert C; Masoudi, Frederick A; Peterson, Eric D; Taylor, Allen J

2011-09-27

Consistent with the growing national focus on healthcare quality, the American College of Cardiology Foundation (ACCF) and the American Heart Association (AHA) have taken a leadership role over the past decade in developing measures of the quality of cardiovascular care by convening a joint ACCF/AHA Task Force on Performance Measures. The Task Force is charged with identifying the clinical topics appropriate for the development of performance measures and with assembling writing committees composed of clinical and methodological experts in collaboration with appropriate subspecialty societies. The Task Force has also created methodology documents that offer guidance in the development of process, outcome, composite, and efficiency measures. Cardiovascular performance measures using existing ACCF/AHA methodology are based on Class I or Class III guidelines recommendations, usually with Level A evidence. These performance measures, based on evidence-based ACCF/AHA guidelines, remain the most rigorous quality measures for both internal quality improvement and public reporting. However, many of the tools for diagnosis and treatment of cardiovascular disease involve advanced technologies, such as cardiac imaging, for which there are often no underlying guideline documents. Because these technologies affect the quality of cardiovascular care and also have the potential to contribute to cardiovascular health expenditures, there is a need for more critical assessment of the use of technology, including the development of quality and performance measures in areas in which guideline recommendations are absent. The evaluation of quality in the use of cardiovascular technologies requires consideration of multiple parameters that differ from other healthcare processes. The present document describes methodology for development of 2 new classes of quality measures in these situations, appropriate use measures and structure/safety measures. Appropriate use measures are based on specific indications, processes, or parameters of care for which high level of evidence data and Class I or Class III guideline recommendations may be lacking but are addressed in ACCF appropriate use criteria documents. Structure/safety measures represent measures developed to address structural aspects of the use of healthcare technology (e.g., laboratory accreditation, personnel training, and credentialing) or quality issues related to patient safety when there are neither guidelines recommendations nor appropriate use criteria. Although the strength of evidence for appropriate use measures and structure/safety measures may not be as strong as that for formal performance measures, they are quality measures that are otherwise rigorously developed, reviewed, tested, and approved in the same manner as ACCF/AHA performance measures. The ultimate goal of the present document is to provide direction in defining and measuring the appropriate use-avoiding not only underuse but also overuse and misuse-and proper application of cardiovascular technology and to describe how such appropriate use measures and structure/safety measures might be developed for the purposes of quality improvement and public reporting. It is anticipated that this effort will help focus the national dialogue on the use of cardiovascular technology and away from the current concerns about volume and cost alone to a more holistic emphasis on value.

Interventions to Improve the Oral Health of People with Dementia or Cognitive Impairment: A Review of the Literature.

PubMed

Siegel, E; Cations, M; Wright, C; Naganathan, V; Deutsch, A; Aerts, L; Brodaty, H

2017-01-01

Oral diseases and conditions are prevalent among older people with dementia and cognitive impairment. While many interventions have been advocated for use in this population, evidence for their effectiveness is unclear. Our objective was to review systematically the content and effectiveness of interventions and implementation strategies used to improve or maintain the oral health of people with dementia or cognitive impairment. Original studies published in English at any time until January 2015 were identified through electronic searches of the Medline, Embase, CINAHL, Scopus and Cochrane databases and hand searches of eligible studies and relevant reviews. Two investigators independently abstracted study characteristics and assessed the methodological quality of eligible studies. Results were presented as a narrative review because significant heterogeneity among included studies precluded a meta-analysis. The 18 included studies varied considerably in terms of size, scope and focus. Only two studies were identified that had been designed specifically for and examined exclusively in people with dementia or cognitive impairment. All studies were in residential care; none was population-based. While several studies reported positive effects, a number of methodological weaknesses were identified and the overall quality of included studies was poor. The specific outcomes targeted varied across studies but most studies focused almost exclusively on proximal clinical oral health outcomes such as levels of dental or denture plaque. Attempts to measure intervention integrity were limited and there was usually little or no effort to evaluate intervention effects over a sustained period. There is a lack of high quality evidence to support the effectiveness of oral health interventions and implementation strategies for older people with dementia or cognitive impairment. More rigorous, large scale research is needed in this area. Recommendations are provided to improve the overall quality of evaluation in this area. Emphasis must be placed on developing evidence-based, achievable and sustainable oral health strategies if the needs of people with dementia and cognitive impairment are to be met into the future.

Evidence-based decision-making in infectious diseases epidemiology, prevention and control: matching research questions to study designs and quality appraisal tools

PubMed Central

2014-01-01

Background The Project on a Framework for Rating Evidence in Public Health (PRECEPT) was initiated and is being funded by the European Centre for Disease Prevention and Control (ECDC) to define a methodology for evaluating and grading evidence and strength of recommendations in the field of public health, with emphasis on infectious disease epidemiology, prevention and control. One of the first steps was to review existing quality appraisal tools (QATs) for individual research studies of various designs relevant to this area, using a question-based approach. Methods Through team discussions and expert consultations, we identified 20 relevant types of public health questions, which were grouped into six domains, i.e. characteristics of the pathogen, burden of disease, diagnosis, risk factors, intervention, and implementation of intervention. Previously published systematic reviews were used and supplemented by expert consultation to identify suitable QATs. Finally, a matrix was constructed for matching questions to study designs suitable to address them and respective QATs. Key features of each of the included QATs were then analyzed, in particular in respect to its intended use, types of questions and answers, presence/absence of a quality score, and if a validation was performed. Results In total we identified 21 QATs and 26 study designs, and matched them. Four QATs were suitable for experimental quantitative study designs, eleven for observational quantitative studies, two for qualitative studies, three for economic studies, one for diagnostic test accuracy studies, and one for animal studies. Included QATs consisted of six to 28 items. Six of the QATs had a summary quality score. Fourteen QATs had undergone at least one validation procedure. Conclusions The results of this methodological study can be used as an inventory of potentially relevant questions, appropriate study designs and QATs for researchers and authorities engaged with evidence-based decision-making in infectious disease epidemiology, prevention and control. PMID:24886571

Evidence-based decision-making in infectious diseases epidemiology, prevention and control: matching research questions to study designs and quality appraisal tools.

PubMed

Harder, Thomas; Takla, Anja; Rehfuess, Eva; Sánchez-Vivar, Alex; Matysiak-Klose, Dorothea; Eckmanns, Tim; Krause, Gérard; de Carvalho Gomes, Helena; Jansen, Andreas; Ellis, Simon; Forland, Frode; James, Roberta; Meerpohl, Joerg J; Morgan, Antony; Schünemann, Holger; Zuiderent-Jerak, Teun; Wichmann, Ole

2014-05-21

The Project on a Framework for Rating Evidence in Public Health (PRECEPT) was initiated and is being funded by the European Centre for Disease Prevention and Control (ECDC) to define a methodology for evaluating and grading evidence and strength of recommendations in the field of public health, with emphasis on infectious disease epidemiology, prevention and control. One of the first steps was to review existing quality appraisal tools (QATs) for individual research studies of various designs relevant to this area, using a question-based approach. Through team discussions and expert consultations, we identified 20 relevant types of public health questions, which were grouped into six domains, i.e. characteristics of the pathogen, burden of disease, diagnosis, risk factors, intervention, and implementation of intervention. Previously published systematic reviews were used and supplemented by expert consultation to identify suitable QATs. Finally, a matrix was constructed for matching questions to study designs suitable to address them and respective QATs. Key features of each of the included QATs were then analyzed, in particular in respect to its intended use, types of questions and answers, presence/absence of a quality score, and if a validation was performed. In total we identified 21 QATs and 26 study designs, and matched them. Four QATs were suitable for experimental quantitative study designs, eleven for observational quantitative studies, two for qualitative studies, three for economic studies, one for diagnostic test accuracy studies, and one for animal studies. Included QATs consisted of six to 28 items. Six of the QATs had a summary quality score. Fourteen QATs had undergone at least one validation procedure. The results of this methodological study can be used as an inventory of potentially relevant questions, appropriate study designs and QATs for researchers and authorities engaged with evidence-based decision-making in infectious disease epidemiology, prevention and control.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Effect of periodontal treatment on preterm birth rate: a systematic review of meta-analyses.

PubMed

López, Néstor J; Uribe, Sergio; Martinez, Benjamín

2015-02-01

Preterm birth is a major cause of neonatal morbidity and mortality in both developed and developing countries. Preterm birth is a highly complex syndrome that includes distinct clinical subtypes in which many different causes may be involved. The results of epidemiological, molecular, microbiological and animal-model studies support a positive association between maternal periodontal disease and preterm birth. However, the results of intervention studies carried out to determine the effect of periodontal treatment on reducing the risk of preterm birth are controversial. This systematic review critically analyzes the methodological issues of meta-analyses of the studies to determine the effect of periodontal treatment to reduce preterm birth. The quality of the individual randomized clinical trials selected is of highest relevance for a systematic review. This article describes the methodological features that should be identified a priori and assessed individually to determine the quality of a randomized controlled trial performed to evaluate the effect of periodontal treatment on pregnancy outcomes. The AMSTAR and the PRISMA checklist tools were used to assess the quality of the six meta-analyses selected, and the bias domain of the Cochrane Collaboration's Tool was applied to evaluate each of the trials included in the meta-analyses. In addition, the methodological characteristics of each clinical trial were assessed. The majority of the trials included in the meta-analyses have significant methodological flaws that threaten their internal validity. The lack of effect of periodontal treatment on preterm birth rate concluded by four meta-analyses, and the positive effect of treatment for reducing preterm birth risk concluded by the remaining two meta-analyses are not based on consistent scientific evidence. Well-conducted randomized controlled trials using rigorous methodology, including appropriate definition of the exposure, adequate control of confounders for preterm birth and application of effective periodontal interventions to eliminate periodontal infection, are needed to confirm the positive association between periodontal disease and preterm birth. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Systematic review of health state utility values for acute myeloid leukemia.

PubMed

Forsythe, Anna; Brandt, Patricia S; Dolph, Mike; Patel, Sachin; Rabe, Adrian Paul J; Tremblay, Gabriel

2018-01-01

Cost-utility analyses for acute myeloid leukemia (AML) require health state utility values (HSUVs) in order to calculate quality-adjusted life-years (QALYs) for each health state. This study reviewed AML-related HSUVs that could be used in economic evaluation studies. EMBASE, MEDLINE, and Cochrane databases were searched from January 2000 to November 2016 for relevant studies that reported quality of life (QoL) and HSUVs in AML. Identified relevant European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 30 values were mapped to HSUVs. HSUVs for each health state in the AML treatment pathway were then collated. Ten relevant studies were identified. Six were cost-effectiveness analyses utilizing HSUVs for calculation of QALYs, one was an effectiveness analysis (incremental QALY), and two were QoL studies reporting AML-specific utilities. An additional study reported QoL for patients undergoing stem cell transplantation (SCT). Since no study reported HSUVs for relapse, values from a study of secondary AML patients who failed prior treatment for myelodysplastic syndrome were used. Where multiple HSUVs were available, collected values were given priority over assumed values. AML treatment (induction, consolidation, or SCT) was associated with decreased HSUV, while post-treatment complete remission led to increased HSUV. There are some methodologically robust HSUVs that can be directly used in economic evaluations for AML. Careful interpretation is advised considering significant differences in methodologies and patient population (inclusion, size). We need to develop HSUVs with larger-sized studies, making greater use of condition-specific data.

Evidence-based Frameworks for Teaching and Learning in Classical Singing Training: A Systematic Review.

PubMed

Crocco, Laura; Madill, Catherine J; McCabe, Patricia

2017-01-01

The study systematically reviews evidence-based frameworks for teaching and learning of classical singing training. This is a systematic review. A systematic literature search of 15 electronic databases following the Preferred Reporting Items for Systematic Reviews (PRISMA) guidelines was conducted. Eligibility criteria included type of publication, participant characteristics, intervention, and report of outcomes. Quality rating scales were applied to support assessment of the included literature. Data analysis was conducted using meta-aggregation. Nine papers met the inclusion criteria. No complete evidence-based teaching and learning framework was found. Thematic content analysis showed that studies either (1) identified teaching practices in one-to-one lessons, (2) identified student learning strategies in one-to-one lessons or personal practice sessions, and (3) implemented a tool to enhance one specific area of teaching and learning in lessons. The included studies showed that research in music education is not always specific to musical genre or instrumental group, with four of the nine studies including participant teachers and students of classical voice training only. The overall methodological quality ratings were low. Research in classical singing training has not yet developed an evidence-based framework for classical singing training. This review has found that introductory information on teaching and learning practices has been provided, and tools have been suggested for use in the evaluation of the teaching-learning process. High-quality methodological research designs are needed. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Gaps in the evidence for prevention and treatment of maternal anaemia: a review of systematic reviews.

PubMed

Parker, Jacqui A; Barroso, Filipa; Stanworth, Simon J; Spiby, Helen; Hopewell, Sally; Doree, Carolyn J; Renfrew, Mary J; Allard, Shubha

2012-06-24

Anaemia, in particular due to iron deficiency, is common in pregnancy with associated negative outcomes for mother and infant. However, there is evidence of significant variation in management. The objectives of this review of systematic reviews were to analyse and summarise the evidence base, identify gaps in the evidence and develop a research agenda for this important component of maternity care. Multiple databases were searched, including MEDLINE, EMBASE and The Cochrane Library. All systematic reviews relating to interventions to prevent and treat anaemia in the antenatal and postnatal period were eligible. Two reviewers independently assessed data inclusion, extraction and quality of methodology. 27 reviews were included, all reporting on the prevention and treatment of anaemia in the antenatal (n = 24) and postnatal periods (n = 3). Using AMSTAR as the assessment tool for methodological quality, only 12 of the 27 were rated as high quality reviews. The greatest number of reviews covered antenatal nutritional supplementation for the prevention of anaemia (n = 19). Iron supplementation was the most extensively researched, but with ongoing uncertainty about optimal dose and regimen. Few identified reviews addressed anaemia management post-partum or correlations between laboratory and clinical outcomes, and no reviews reported on clinical symptoms of anaemia. The review highlights evidence gaps including the management of anaemia in the postnatal period, screening for anaemia, and optimal interventions for treatment. Research priorities include developing standardised approaches to reporting of laboratory outcomes, and information on clinical outcomes relevant to the experiences of pregnant women.

An Evaluation of Web-Based Clinical Practice Guidelines for Managing Problems Associated with Cannabis Use

PubMed Central

Turner, Michael W; Rooke, Sally E; Langton, Julia M; Gates, Peter J

2012-01-01

Background Cannabis is the most widely used illicit substance, and multiple treatment options and avenues exist for managing its use. There has been an increase in the development of clinical practice guidelines (CPGs) to improve standards of care in this area, many of which are disseminated online. However, little is known about the quality and accessibility of these online CPGs. Objective The purpose of study 1 was to determine the extent to which cannabis-related CPGs disseminated online adhere to established methodological standards. The purpose of study 2 was to determine if treatment providers are familiar with these guidelines and to assess their perceived quality of these guidelines. Methods Study 1 involved a systematic search using the Google Scholar search engine and the National Drugs Sector Information Service (NDSIS) website of the Alcohol and Other Drugs Council of Australia (ADCA) to identify CPGs disseminated online. To be included in the current study, CPGs needed to be free of charge and provide guidance on psychological interventions for reducing cannabis use. Four trained reviewers independently assessed the quality of the 7 identified guidelines using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. Study 2 assessed 166 Australian cannabis-use treatment providers’ (mean age = 45.47 years, SD 12.14) familiarity with and opinions of these 7 guidelines using an online survey. Treatment providers were recruited using online advertisements that directed volunteers to a link to complete the survey, which was posted online for 6 months (January to June 2012). Primary study outcomes included quality scores and rates of guideline familiarity, guideline use, and discovery methods. Results Based on the AGREE II, the quality of CPGs varied considerably. Across different reporting domains, adherence to methodological standards ranged from 0% to 92%. Quality was lowest in the domains of rigor of development (50%), applicability (46%), and editorial independence (30%). Although examination of AGREE II domain scores demonstrated that the quality of the 7 guidelines could be divided into 3 categories (high quality, acceptable to low quality, and very low quality), review of treatment providers’ quality perceptions indicated all guidelines fell into 1 category (acceptable quality). Based on treatment providers’ familiarity with and usage rates of the CPGs, a combination of peer/colleagues, senior professionals, workshops, and Internet dissemination was deemed to be most effective for promoting cannabis use CPGs. Lack of time, guideline length, conflicts with theoretical orientation, and prior content knowledge were identified as barriers to guideline uptake. Conclusions Developers of CPGs should improve their reporting of development processes, conflicts of interest, and CPGs’ applicability to practice, while remaining cognizant that long guidelines may deter implementation. Treatment providers need to be aware that the quality of cannabis-related CPGs varies substantially. PMID:23249447

The effectiveness of structured exercise in the south Asian population with type 2 diabetes: a systematic review.

PubMed

Albalawi, Hani; Coulter, Elaine; Ghouri, Nazim; Paul, Lorna

2017-11-01

The impact of exercise interventions on south Asians with type 2 diabetes (T2DM), who have a higher T2DM incidence rate compared to other ethnic groups, is inconclusive. This study aimed to systematically review the effect of exercise interventions in south Asians with T2DM. Five electronic databases were searched up to April 2017 for controlled trials investigating the impact of exercise interventions on south Asian adults with T2DM. The PEDro scale was used to assess the quality of the included studies. Eighteen trials examining the effect of aerobic, resistance, balance or combined exercise programs met the eligibility criteria. All types of exercise were associated with improvements in glycemic control, blood pressure, waist circumference, blood lipids, muscle strength, functional mobility, quality of life or neuropathy progression. The majority of included studies were of poor methodological quality. Few studies compared different types or dose of exercise. In conclusion, this review supports the benefits of exercise for south Asians with T2DM, although it was not possible to identify the most effective exercise prescription. Further studies of good methodological quality are required to determine the most effective dosage and type of exercise to manage T2DM in this population.

Physical examination tests for the diagnosis of femoroacetabular impingement. A systematic review.

PubMed

Pacheco-Carrillo, Aitana; Medina-Porqueres, Ivan

2016-09-01

Numerous clinical tests have been proposed to diagnose FAI, but little is known about their diagnostic accuracy. To summarize and evaluate research on the accuracy of physical examination tests for diagnosis of FAI. A search of the PubMed, SPORTDiscus and CINAHL databases was performed. Studies were considered eligible if they compared the results of physical examination tests to those of a reference standard. Methodological quality and internal validity assessment was performed by two independent reviewers using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool. The systematic search strategy revealed 298 potential articles, five of which articles met the inclusion criteria. After assessment using the QUADAS score, four of the five articles were of high quality. Clinical tests included were Impingement sign, IROP test (Internal Rotation Over Pressure), FABER test (Flexion-Abduction-External Rotation), Stinchfield/RSRL (Resisted Straight Leg Raise) test, Scour test, Maximal squat test, and the Anterior Impingement test. IROP test, impingement sign, and FABER test showed the most sensitive values to identify FAI. The diagnostic accuracy of physical examination tests to assess FAI is limited due to its heterogenecity. There is a strong need for sound research of high methodological quality in this area. Copyright © 2016 Elsevier Ltd. All rights reserved.

Acupuncture for Functional Dyspepsia: What Strength Does It Have? A Systematic Review and Meta-Analysis of Randomized Controlled Trials

PubMed Central

Li, Jing; Li, Bo; Hu, Ya-Cai; Cai, Qiu-Han

2016-01-01

Background. Although the effectiveness of acupuncture therapy on functional dyspepsia (FD) has been systematically reviewed, the available reports are still contradictive and no robust evidence has been provided to date. Objective. To assess the current evidence of high quality on the effects of acupuncture for patients with FD. Methods. A comprehensive literature database search was conducted to identify randomized controlled trials (RCTs) comparing acupuncture therapies (including manual acupuncture and electroacupuncture) to sham acupuncture and medication use. A meta-analysis was performed following a strict methodology. Results. 16 RCTs involving 1436 participants were included. The majority of the trials were determined to be of low quality. Positive results were found for acupuncture in improving the Nepean Dyspepsia Index (NDI) and scores of the MOS 36-Item Short-Form Health Survey (SF-36), as well as in alleviating relevant symptoms (especially postprandial fullness and early satiation) of FD patients. Conclusion. Based on current available evidence, acupuncture therapy achieves statistically significant effect for FD in comparison with sham acupuncture and is superior to medication (prokinetic agents) in improving the symptoms and quality of life of FD patients. Nonetheless, despite stringent methodological analyses, the conclusion of our review still needs to be strengthened by additional RCTs of higher quality. PMID:28119758

Conservative treatment of tibialis posterior tendon dysfunction--a review.

PubMed

Bowring, Beverly; Chockalingam, Nachiappan

2010-03-01

Appropriate conservative treatment is considered essential to address symptoms associated with tibialis posterior tendon dysfunction (TPTD) and prevent its potential long-term disabling consequences. The main aim of this review, undertaken in 2007, was to evaluate the evidence from studies for the effects of conservative treatment modalities in the management of TPTD. This evidence could then be used as a basis for the development of a clinical guideline for the management of the condition. Studies were selected according to specific criteria and evaluated for methodological quality. As preliminary literature searches had identified no randomised controlled trials at the time of the review, studies of lower hierarchy were included. Five uncontrolled observational studies evaluating the outcomes of various orthotic treatments alone or in combination with other therapies were included in the review. Different study designs, methodological quality, population characteristics, interventions and outcome measures were found. Limited and poor quality evidence was found in this review regarding the conservative treatment of TPTD. Thus a cause-effect relationship between intervention and outcome could not be established nor an optimal conservative treatment regime for the condition. Further better quality research is warranted in this area to inform practice, particularly as there is no consensus in the literature regarding treatment of this condition. Copyright (c) 2009 Elsevier Ltd. All rights reserved.

A New Dimension of Health Care: Systematic Review of the Uses, Benefits, and Limitations of Social Media for Health Communication

PubMed Central

Hazlett, Diane E; Harrison, Laura; Carroll, Jennifer K; Irwin, Anthea; Hoving, Ciska

2013-01-01

Background There is currently a lack of information about the uses, benefits, and limitations of social media for health communication among the general public, patients, and health professionals from primary research. Objective To review the current published literature to identify the uses, benefits, and limitations of social media for health communication among the general public, patients, and health professionals, and identify current gaps in the literature to provide recommendations for future health communication research. Methods This paper is a review using a systematic approach. A systematic search of the literature was conducted using nine electronic databases and manual searches to locate peer-reviewed studies published between January 2002 and February 2012. Results The search identified 98 original research studies that included the uses, benefits, and/or limitations of social media for health communication among the general public, patients, and health professionals. The methodological quality of the studies assessed using the Downs and Black instrument was low; this was mainly due to the fact that the vast majority of the studies in this review included limited methodologies and was mainly exploratory and descriptive in nature. Seven main uses of social media for health communication were identified, including focusing on increasing interactions with others, and facilitating, sharing, and obtaining health messages. The six key overarching benefits were identified as (1) increased interactions with others, (2) more available, shared, and tailored information, (3) increased accessibility and widening access to health information, (4) peer/social/emotional support, (5) public health surveillance, and (6) potential to influence health policy. Twelve limitations were identified, primarily consisting of quality concerns and lack of reliability, confidentiality, and privacy. Conclusions Social media brings a new dimension to health care as it offers a medium to be used by the public, patients, and health professionals to communicate about health issues with the possibility of potentially improving health outcomes. Social media is a powerful tool, which offers collaboration between users and is a social interaction mechanism for a range of individuals. Although there are several benefits to the use of social media for health communication, the information exchanged needs to be monitored for quality and reliability, and the users’ confidentiality and privacy need to be maintained. Eight gaps in the literature and key recommendations for future health communication research were provided. Examples of these recommendations include the need to determine the relative effectiveness of different types of social media for health communication using randomized control trials and to explore potential mechanisms for monitoring and enhancing the quality and reliability of health communication using social media. Further robust and comprehensive evaluation and review, using a range of methodologies, are required to establish whether social media improves health communication practice both in the short and long terms. PMID:23615206

Determination of trigger levels for groundwater quality in landfills located in historically human-impacted areas.

PubMed

Stefania, Gennaro A; Zanotti, Chiara; Bonomi, Tullia; Fumagalli, Letizia; Rotiroti, Marco

2018-05-01

Landfills are one of the most recurrent sources of groundwater contamination worldwide. In order to limit their impacts on groundwater resources, current environmental regulations impose the adoption of proper measures for the protection of groundwater quality. For instance, in the EU member countries, the calculation of trigger levels for identifying significant adverse environmental effects on groundwater generated by landfills is required by the Landfill Directive 99/31/EC. Although the derivation of trigger levels could be relatively easy when groundwater quality data prior to the construction of a landfill are available, it becomes challenging when these data are missing and landfills are located in areas that are already impacted by historical contamination. This work presents a methodology for calculating trigger levels for groundwater quality in landfills located in areas where historical contaminations have deteriorated groundwater quality prior to their construction. This method is based on multivariate statistical analysis and involves 4 steps: (a) implementation of the conceptual model, (b) landfill monitoring data collection, (c) hydrochemical data clustering and (d) calculation of the trigger levels. The proposed methodology was applied on a case study in northern Italy, where a currently used lined landfill is located downstream of an old unlined landfill and others old unmapped waste deposits. The developed conceptual model stated that groundwater quality deterioration observed downstream of the lined landfill is due to a degrading leachate plume fed by the upgradient unlined landfill. The methodology led to the determination of two trigger levels for COD and NH 4 -N, the former for a zone representing the background hydrochemistry (28 and 9 mg/L for COD and NH 4 -N, respectively), the latter for the zone impacted by the degrading leachate plume from the upgradient unlined landfill (89 and 83 mg/L for COD and NH 4 -N, respectively). Copyright © 2018 Elsevier Ltd. All rights reserved.

Person-centredness in the care of older adults: a systematic review of questionnaire-based scales and their measurement properties.

PubMed

Wilberforce, Mark; Challis, David; Davies, Linda; Kelly, Michael P; Roberts, Chris; Loynes, Nik

2016-03-07

Person-centredness is promoted as a central feature of the long-term care of older adults. Measures are needed to assist researchers, service planners and regulators in assessing this feature of quality. However, no systematic review exists to identify potential instruments and to provide a critical appraisal of their measurement properties. A systematic review of measures of person-centredness was undertaken. Inclusion criteria restricted references to multi-item instruments designed for older adult services, or otherwise with measurement properties tested in an older adult population. A two-stage critical appraisal was conducted. First, the methodological quality of included references was assessed using the COSMIN toolkit. Second, seven measurement properties were rated using widely-recognised thresholds of acceptability. These results were then synthesised to provide an overall appraisal of the strength of evidence for each measurement property for each instrument. Eleven measures tested in 22 references were included. Six instruments were designed principally for use in long-stay residential facilities, and four were for ambulatory hospital or clinic-based services. Only one measure was designed mainly for completion by users of home care services. No measure could be assessed across all seven measurement properties. Despite some instruments having promising measurement properties, this was consistently undermined by the poor methodological quality underpinning them. Testing of hypotheses to support construct validity was of particularly low quality, whilst measurement error was rarely assessed. Two measures were identified as having been the subject of the most rigorous testing. The review is unable to unequivocally recommend any measures of person-centredness for use in older adult care. Researchers are advised to improve methodological rigour when testing instruments. Efforts may be best focused on testing a narrower range of measurement properties but to a higher standard, and ensuring that translations to new languages are resisted until strong measurement properties are demonstrated in the original tongue. Limitations of the review include inevitable semantic and conceptual challenges involved in defining 'person-centredness'. The review protocol was registered with PROSPERO (ref: CRD42014005935).

[Acceptance of lot sampling: its applicability to the evaluation of the primary care services portfolio].

PubMed

López-Picazo Ferrer, J

2001-05-15

To determine the applicability of the acceptance of lot quality assurance sampling (LQAS) in the primary care service portfolio, comparing its results with those given by classic evaluation. Compliance with the minimum technical norms (MTN) of the service of diabetic care was evaluated through the classic methodology (confidence 95%, accuracy 5%, representativeness of area, sample of 376 histories) and by LQAS (confidence 95%, power 80%, representativeness of primary care team (PCT), defining a lot by MTN and PCT, sample of 13 histories/PCT). Effort, information obtained and its operative nature were assessed. 44 PCTs from Murcia Primary Care Region. Classic methodology: compliance with MTN ranged between 91.1% (diagnosis, 95% CI, 84.2-94.0) and 30% (repercussion in viscera, 95% CI, 25.4-34.6). Objectives in three MTN were reached (diagnosis, history and EKG). LQAS: no MTN was accepted in all the PCTs, <01-diagnosis> being the most accepted (42 PCT, 95.6%) and <07-Funduscopy> the least accepted (24 PCT, 55.6%). In 9 PCT all were accepted (20.4%), and in 2 none were accepted (4.5%). Data were analysed through Pareto charts. Classic methodology offered accurate results, but did not identify which centres were those that did not comply (general focus). LQAS was preferable for evaluating MTN and probably coverage because: 1) it uses small samples, which foment internal quality-improvement initiatives; 2) it is easy and rapid to execute; 3) it identifies the PCT and criteria where there is an opportunity for improvement (specific focus), and 4) it can be used operatively for monitoring.

Prevalence of hypertension among adolescents: systematic review and meta-analysis.

PubMed

Gonçalves, Vivian Siqueira Santos; Galvão, Taís Freire; de Andrade, Keitty Regina Cordeiro; Dutra, Eliane Said; Bertolin, Maria Natacha Toral; de Carvalho, Kenia Mara Baiocchi; Pereira, Mauricio Gomes

2016-01-01

To estimate the prevalence of hypertension among adolescent Brazilian students. A systematic review of school-based cross-sectional studies was conducted. The articles were searched in the databases MEDLINE, Embase, Scopus, LILACS, SciELO, Web of Science, CAPES thesis database and Trip Database. In addition, we examined the lists of references of relevant studies to identify potentially eligible articles. No restrictions regarding publication date, language, or status applied. The studies were selected by two independent evaluators, who also extracted the data and assessed the methodological quality following eight criteria related to sampling, measuring blood pressure, and presenting results. The meta-analysis was calculated using a random effects model and analyses were performed to investigate heterogeneity. We retrieved 1,577 articles from the search and included 22 in the review. The included articles corresponded to 14,115 adolescents, 51.2% (n = 7,230) female. We observed a variety of techniques, equipment, and references used. The prevalence of hypertension was 8.0% (95%CI 5.0-11.0; I2 = 97.6%), 9.3% (95%CI 5.6-13.6; I2 = 96.4%) in males and 6.5% (95%CI 4.2-9.1; I2 = 94.2%) in females. The meta-regression failed to identify the causes of the heterogeneity among studies. Despite the differences found in the methodologies of the included studies, the results of this systematic review indicate that hypertension is prevalent in the Brazilian adolescent school population. For future investigations, we suggest the standardization of techniques, equipment, and references, aiming at improving the methodological quality of the studies.

DPP-4 inhibitors for the treatment of type 2 diabetes: a methodology overview of systematic reviews.

PubMed

Ling, Juan; Ge, Long; Zhang, Ding-Hua; Wang, Yong-Feng; Xie, Zhuo-Lin; Tian, Jin-Hui; Xiao, Xiao-Hui; Yang, Ke-Hu

2018-06-01

To evaluate the methodological quality of systematic reviews (SRs), and summarize evidence of important outcomes from dipeptidyl peptidase-4 inhibitors (DPP4-I) in treating type 2 diabetes mellitus (T2DM). We included SRs of DPP4-I for the treatment of T2DM until January, 2018 by searching the Cochrane Library, PubMed, EMBASE and three Chinese databases. We evaluated the methodological qualities with the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool and the GRADE (The Grading of Recommendations Assessment, Development and Evaluation) approach. Sixty-three SRs (a total of 2,603,140 participants) receiving DPP4-I for the treatment of T2DM were included. The results of AMSTAR showed that the lowest quality was "a list of studies (included and excluded) item" with only one (1.6%) study provided, followed by the "providing a priori design" item with only four (6.3%) studies conforming to this item, the next were "the status of publication (gray literature) used as an inclusion criterion item", with only 18 (28.9%) studies conforming to these items. Only seven (11.1%) studies scored more than nine points in AMSTAR, indicating high methodological quality. For GRADE, of the 128 outcomes, high quality evidence was provided in only 28 (21.9%), moderate in 70 (54.7%), low in 27 (21.1%), and very low in three (2.3%). The methodological quality of SRs of DPP4-I for type 2 diabetes mellitus is not high and there are common areas for improvement. Furthermore, the quality of evidence level is moderate and more high quality evidence is needed.

Epidemiology characteristics, reporting characteristics, and methodological quality of systematic reviews and meta-analyses on traditional Chinese medicine nursing interventions published in Chinese journals.

PubMed

Yang, Min; Jiang, Li; Wang, Aihong; Xu, Guihua

2017-02-01

To evaluate the epidemiological characteristics, reporting characteristics, and methodological quality of systematic reviews in the traditional Chinese medicine nursing field published in Chinese journals. The number of systematic reviews in the traditional Chinese medicine nursing field has increased, but their epidemiology, quality, and reporting characteristics have not been assessed completely. We generated an overview of reviews using a narrative approach. Four Chinese databases were searched for systematic reviews from inception to December 2015. The Preferred Reporting Items of Systematic Reviews and Meta-analyses and the Assessment of Multiple Systematic Reviews checklists were adopted to evaluate reporting and methodological quality, respectively. A total of 73 eligible systematic reviews, published from 2005 to 2015, were included. The deficiencies in reporting characteristics mainly lay in the lack of structured abstract or protocol, incomplete reporting of search strategies, study selection, and risk of bias. The deficiencies in methodological quality were reflected in the lack of a priori design and conflict of interest, incomplete literature searches, and assessment of publication bias. The quality of the evaluated reviews was unsatisfactory; attention should be paid to the improvement of reporting and methodological quality in the conduct of systematic reviews. © 2016 John Wiley & Sons Australia, Ltd.

A retrospective survey of the quality of reports and their correlates among randomized controlled trials of immunotherapy for Guillain-Barré syndrome.

PubMed

Lu, Liming; Luo, Gaoquan; Xiao, Fang

2013-08-01

This study aims to assess the quality of reports and their correlates in randomized controlled trials (RCTs) of immunotherapy for Guillain-Barré syndrome (GBS). A search was performed in multiple databases of reports published between April 1992 and November 2012. Reporting quality was assessed by items of the Consolidated Standards of Reporting Trials (CONSORT) 2010 Statement. An overall quality score (OQS) and a key methodological index score (MIS) were calculated for each trial. Factors associated with OQS and MIS were then identified. A total of 19 RCTs were included in the full text. The median OQS was 7.0, with a range of 1-10. However, the quality of reporting in items of 'flow chart' and 'ancillary analyses' was poor with a positive rate of less than 40%. The median MIS was 0 with a range of 0-2. Twelve (63.2%) did not report any of the three key methodological items. Specifically, the mean OQS increased by approximately 2.73 for manuscripts published in the New England Journal of Medicine, The Lancet, Pediatrics and Neurology (95% CI: 0.35-5.12; p < 0.05). Multivariate linear regression and the Poisson regression model could not be presented as the number of included trials was too small. The reporting quality in RCTs on immunotherapy for GBS was poor, which indicated that reporting in RCTs of immunotherapy for GBS needed substantial improvement in order to meet the guideline of the CONSORT Statement.

A Systematic Method for Reviewing and Analyzing Health Information on Consumer-Oriented Websites.

PubMed

Rew, Lynn; Saenz, Ashley; Walker, Lorraine O

2018-05-29

A discussion of a proposed method for analyzing the quality of consumer-oriented websites that provide health-related information. The quality of health information available to consumers online varies widely in quality. In an effort to improve the quality of online information, experts have undertaken systematic reviews on selected health topics; however, no standardized comprehensive methodology currently exists for such review. An eight-step method is recommended embracing the following steps: (1) select topic; (2) determine the purpose of the analysis; (3) select search terms and engines; (4) develop and apply website inclusion and exclusion criteria; (5) develop processes and tools to manage search results; (6) specify measures of quality; (7) compute readability; (8) evaluate websites. Each of these steps is illustrated in relation to the health topic of gynecomastia, a physical and mental health challenge for many adolescent males and young men. Although most extant analyses of consumer-oriented websites have focused on disease conditions and their treatment, website-analysis methodology would encourage analyses that fall into the nursing care domain. The method outlined in this paper is intended to provide nurses and others who work with specific patient populations with the tools needed for website analytic studies. Such studies provide a foundation for making recommendations about quality websites, as well as identifying gaps in online information for health consumers. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

A flood tide of systematic reviews on endodontic posts: methodological assessment using of R-AMSTAR.

PubMed

Schmitter, M; Sterzenbach, G; Faggion, C M; Krastl, G

2013-06-01

To help the dental practitioner solve a specific clinical problem, systematic reviews (SRs) are seen as the best guide. In addition to the unmanageable quantity of SRs, however, one should be aware of their variable quality. The present review describes the methodological quality of SRs on postendodontic restorations to work out the value of these reviews for the dental practitioner. SRs were searched in April 2012, independently and in triplicate. Post survival was used as measure of outcome. The methodological quality of included SRs was assessed with the Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) checklist. Kappa statistics were used to assess reviewer agreement. Three hundred sixty-three papers were retrieved from the initial search. Ten SRs were included. One SR achieved a high R-AMSTAR score, whereas the other nine SRs achieved scores that indicate a substantial lack of methodological quality. Especially the items "grey literature," "combination of findings," "likelihood of publication bias," and conflict of interest" showed low R-AMSTAR scores. The three reviews with the highest R-AMSTAR scores tended to conclude that fewer failures occurred when using nonmetal posts. The reviewer agreement was excellent (kappa ranged from 0.79 to 0.85) in the R-AMSTAR classification. The approach presented revealed a lack of SRs with high methodological quality. Thus, no decisive conclusion can be drawn with respect to this topic. It appears that there is a trend for the superiority of fiber-reinforced posts. SRs must be of high methodological quality. This can be achieved by taking into consideration the results of this review. Improved methodological quality would make SRs more supportive for the general practitioner.

Contrast-detail phantom scoring methodology.

PubMed

Thomas, Jerry A; Chakrabarti, Kish; Kaczmarek, Richard; Romanyukha, Alexander

2005-03-01

Published results of medical imaging studies which make use of contrast detail mammography (CDMAM) phantom images for analysis are difficult to compare since data are often not analyzed in the same way. In order to address this situation, the concept of ideal contrast detail curves is suggested. The ideal contrast detail curves are constructed based on the requirement of having the same product of the diameter and contrast (disk thickness) of the minimal correctly determined object for every row of the CDMAM phantom image. A correlation and comparison of five different quality parameters of the CDMAM phantom image determined for obtained ideal contrast detail curves is performed. The image quality parameters compared include: (1) contrast detail curve--a graph correlation between "minimal correct reading" diameter and disk thickness; (2) correct observation ratio--the ratio of the number of correctly identified objects to the actual total number of objects multiplied by 100; (3) image quality figure--the sum of the product of the diameter of the smallest scored object and its relative contrast; (4) figure-of-merit--the zero disk diameter value obtained from extrapolation of the contrast detail curve to the origin (e.g., zero disk diameter); and (5) k-factor--the product of the thickness and the diameter of the smallest correctly identified disks. The analysis carried out showed the existence of a nonlinear relationship between the above parameters, which means that use of different parameters of CDMAM image quality potentially can cause different conclusions about changes in image quality. Construction of the ideal contrast detail curves for CDMAM phantom is an attempt to determine the quantitative limits of the CDMAM phantom as employed for image quality evaluation. These limits are determined by the relationship between certain parameters of a digital mammography system and the set of the gold disks sizes in the CDMAM phantom. Recommendations are made on selections of CDMAM phantom regions which should be used for scoring at different image quality and which scoring methodology may be most appropriate. Special attention is also paid to the use of the CDMAM phantom for image quality assessment of digital mammography systems particularly in the vicinity of the Nyquist frequency.

Identification and description of controlled clinical trials published in Spanish Gynaecology and Obstetrics journals and risk of bias assessment of trials on assisted reproductive techniques.

PubMed

Gutarra-Vilchez, Rosa B; Pardo-Hernandez, Hector; Arévalo-Rodríguez, Ingrid; Buitrago, Diana; Bonfill, Xavier

2016-08-01

To identify and describe controlled clinical trials (CCTs) published in Spanish Gynaecology and Obstetrics journals. In addition, to assess the quality of the CCTs on Assisted Reproduction Techniques (ART) identified in this project. In order to identify eligible CCTs, all Spanish Gynaecology and Obstetrics journals were handsearched. Handsearching was conducted following the guidelines provided by the Cochrane Collaboration, which state that each journal article must be carefully reviewed, including original articles and other types of studies, letters to the editor, abstracts, and conference presentations. The results of the handsearching process were compared with an electronic search conducted in MEDLINE (PubMed). A descriptive analysis of the main characteristics of the identified CCTs was performed, as well as a methodological assessment of CCTs on ART. Sixteen Gynaecology and Obstetrics journals were identified, four of which have been indexed in MEDLINE at some point, although not currently. The journal with the most CCTs was "Progresos de Obstetricia y Ginecología". A total of 235 CCTs were published in these journals, of which 29 were on ART. Most CCTs (216, 91.9%) were carried out in a hospital setting; 201 (89.4%) were unicentric. Obstetrics was the most studied subspecialty (46.4%). Among CCTs on ART, the risk of bias was predominantly high. The number of CCTs published in Spanish Gynaecology and Obstetrics journals is limited. CCTs on ART present deficiencies in the report of results and low methodological quality. It is advised that authors and journals adhere to the CONSORT statement and to the Cochrane Collaboration recommendations to reduce risk of bias when designing and disseminating research projects. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Using Organization Risk Analyzer (ORA) to Explore the Relationship of Nursing Unit Communication to Patient Safety and Quality Outcomes

PubMed Central

Effken, Judith A.; Carley, Kathleen M.; Gephart, Sheila; Verran, Joyce A.; Bianchi, Denise; Reminga, Jeff; Brewer, Barbara

2011-01-01

Purpose We used Organization Risk Analyzer (ORA), a dynamic network analysis tool, to identify patient care unit communication patterns associated with patient safety and quality outcomes. Although ORA had previously had limited use in healthcare, we felt it could effectively model communication on patient care units. Methods Using a survey methodology, we collected communication network data from nursing staff on seven patient care units on two different days. Patient outcome data were collected via a separate survey. Results of the staff survey were used to represent the communication networks for each unit in ORA. We then used ORA's analysis capability to generate communication metrics for each unit. ORA's visualization capability was used to better understand the metrics. Results We identified communication patterns that correlated with two safety (falls and medication errors) and five quality (e.g., symptom management, complex self care, and patient satisfaction) outcome measures. Communication patterns differed substantially by shift. Conclusion The results demonstrate the utility of ORA for healthcare research and the relationship of nursing unit communication patterns to patient safety and quality outcomes. PMID:21536492

"Assessing the methodological quality of systematic reviews in radiation oncology: A systematic review".

PubMed

Hasan, Haroon; Muhammed, Taaha; Yu, Jennifer; Taguchi, Kelsi; Samargandi, Osama A; Howard, A Fuchsia; Lo, Andrea C; Olson, Robert; Goddard, Karen

2017-10-01

The objective of our study was to evaluate the methodological quality of systematic reviews and meta-analyses in Radiation Oncology. A systematic literature search was conducted for all eligible systematic reviews and meta-analyses in Radiation Oncology from 1966 to 2015. Methodological characteristics were abstracted from all works that satisfied the inclusion criteria and quality was assessed using the critical appraisal tool, AMSTAR. Regression analyses were performed to determine factors associated with a higher score of quality. Following exclusion based on a priori criteria, 410 studies (157 systematic reviews and 253 meta-analyses) satisfied the inclusion criteria. Meta-analyses were found to be of fair to good quality while systematic reviews were found to be of less than fair quality. Factors associated with higher scores of quality in the multivariable analysis were including primary studies consisting of randomized control trials, performing a meta-analysis, and applying a recommended guideline related to establishing a systematic review protocol and/or reporting. Systematic reviews and meta-analyses may introduce a high risk of bias if applied to inform decision-making based on AMSTAR. We recommend that decision-makers in Radiation Oncology scrutinize the methodological quality of systematic reviews and meta-analyses prior to assessing their utility to inform evidence-based medicine and researchers adhere to methodological standards outlined in validated guidelines when embarking on a systematic review. Copyright © 2017 Elsevier Ltd. All rights reserved.

The relationship between foot posture and plantar pressure during walking in adults: A systematic review.

PubMed

Buldt, Andrew K; Allan, Jamie J; Landorf, Karl B; Menz, Hylton B

2018-02-23

Foot posture is a risk factor for some lower limb injuries, however the underlying mechanism is not well understood. Plantar pressure analysis is one technique to investigate the interaction between foot posture and biomechanical function of the lower limb. The aim of this review was to investigate the relationship between foot posture and plantar pressure during walking. A systematic database search was conducted using MEDLINE, CINAHL, SPORTDiscus and Embase to identify studies that have assessed the relationship between foot posture and plantar pressure during walking. Included studies were assessed for methodological quality. Meta-analysis was not conducted due to heterogeneity between studies. Inconsistencies included foot posture classification techniques, gait analysis protocols, selection of plantar pressure parameters and statistical analysis approaches. Of the 4213 citations identified for title and abstract review, sixteen studies were included and underwent quality assessment; all were of moderate methodological quality. There was some evidence that planus feet display higher peak pressure, pressure-time integral, maximum force, force-time integral and contact area predominantly in the medial arch, central forefoot and hallux, while these variables are lower in the lateral and medial forefoot. In contrast, cavus feet display higher peak pressure and pressure-time integral in the heel and lateral forefoot, while pressure-time integral, maximum force, force-time integral and contact area are lower for the midfoot and hallux. Centre of pressure was more laterally deviated in cavus feet and more medially deviated in planus feet. Overall, effect sizes were moderate, but regression models could only explain a small amount of variance in plantar pressure variables. Despite these significant findings, future research would benefit from greater methodological rigour, particularly in relation to the use of valid foot posture measurement techniques, gait analysis protocols, and standardised approaches for analysis and reporting of plantar pressure variables. Copyright © 2018 Elsevier B.V. All rights reserved.

Systematic Review: FDA-Approved Prescription Medications for Adults With Constipation

PubMed Central

Lacy, Brian E.

2006-01-01

Constipation is a common, often chronic, gastrointestinal disorder that can negatively impact the lives of those it affects and can be difficult to treat satisfactorily. The objective of this systematic review is to identify and analyze the available published literature on US Food and Drug Administration–approved prescription therapies for adults with constipation (episodic and chronic) and to assess their place in therapy, based on the methodologic strength and results of identified clinical trials. Ovid MEDLINE, PubMed, and EMBASE databases were used to search the published literature. Studies were included if they were randomized and prospective, conducted in adults (age ≥18), published as full-length manuscripts in English, and compared the test agent with placebo or a comparator(s). Studies were excluded if they involved patients with constipation attributed to secondary causes. Because fully published manuscripts from phase III efficacy trials involving the recently approved medication lubiprostone were not available, a manual search was performed of abstracts from the two annual major gastroenterology meetings (American College of Gastroenterology and Digestive Disease Week) from the past 4 years. Data on study design; number, age, and sex of patients; duration of treatment period; primary efficacy variable; secondary efficacy variables; adverse events; and discontinuations because of adverse events were abstracted from eligible articles. Eligible studies were assessed using well-established recommendations and a preformatted standardized form. A scoring system, with scores ranging from 1 to 15, was used to individually and separately assess the methodologic quality of the studies. Results of this analysis indicate a general lack of methodologically high-quality clinical trials supporting the use of lactulose and PEG 3350 to treat patients with chronic constipation, but data support their use in acute, episodic constipation. Conversely, high-quality evidence for tegaserod and lubiprostone in patients with chronic constipation does exist, though conclusions regarding the role in therapy for lubiprostone are still in development. PMID:28325992

Integrating automated support for a software management cycle into the TAME system

NASA Technical Reports Server (NTRS)

Sunazuka, Toshihiko; Basili, Victor R.

1989-01-01

Software managers are interested in the quantitative management of software quality, cost and progress. An integrated software management methodology, which can be applied throughout the software life cycle for any number purposes, is required. The TAME (Tailoring A Measurement Environment) methodology is based on the improvement paradigm and the goal/question/metric (GQM) paradigm. This methodology helps generate a software engineering process and measurement environment based on the project characteristics. The SQMAR (software quality measurement and assurance technology) is a software quality metric system and methodology applied to the development processes. It is based on the feed forward control principle. Quality target setting is carried out before the plan-do-check-action activities are performed. These methodologies are integrated to realize goal oriented measurement, process control and visual management. A metric setting procedure based on the GQM paradigm, a management system called the software management cycle (SMC), and its application to a case study based on NASA/SEL data are discussed. The expected effects of SMC are quality improvement, managerial cost reduction, accumulation and reuse of experience, and a highly visual management reporting system.

Measurement properties of patient-reported outcome measures (PROMS) in Patellofemoral Pain Syndrome: a systematic review.

PubMed

Green, Andrew; Liles, Clive; Rushton, Alison; Kyte, Derek G

2014-12-01

This systematic review investigated the measurement properties of disease-specific patient-reported outcome measures used in Patellofemoral Pain Syndrome. Two independent reviewers conducted a systematic search of key databases (MEDLINE, EMBASE, AMED, CINHAL+ and the Cochrane Library from inception to August 2013) to identify relevant studies. A third reviewer mediated in the event of disagreement. Methodological quality was evaluated using the validated COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) tool. Data synthesis across studies determined the level of evidence for each patient-reported outcome measure. The search strategy returned 2177 citations. Following the eligibility review phase, seven studies, evaluating twelve different patient-reported outcome measures, met inclusion criteria. A 'moderate' level of evidence supported the structural validity of several measures: the Flandry Questionnaire, Anterior Knee Pain Scale, Functional Index Questionnaire, Eng and Pierrynowski Questionnaire and Visual Analogue Scales for 'usual' and 'worst' pain. In addition, there was a 'Limited' level of evidence supporting the test-retest reliability and validity (cross-cultural, hypothesis testing) of the Persian version of the Anterior Knee Pain Scale. Other measurement properties were evaluated with poor methodological quality, and many properties were not evaluated in any of the included papers. Current disease-specific outcome measures for Patellofemoral Pain Syndrome require further investigation. Future studies should evaluate all important measurement properties, utilising an appropriate framework such as COSMIN to guide study design, to facilitate optimal methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

Ultrasound for assessing disease activity in IBD patients: a systematic review of activity scores.

PubMed

Bots, S; Nylund, K; Löwenberg, M; Gecse, K; Gilja, O H; D'Haens, G

2018-04-19

Ultrasound (US) indices for assessing disease activity in IBD patients have never been critically reviewed. We aimed to systematically review the quality and reliability of available ultrasound (US) indices compared with reference standards for grading disease activity in IBD patients. Pubmed, Embase and Medline were searched from 1990 until June 2017. Relevant publications were identified through full text review after initial screening by 2 investigators. Data on methodology and index characteristics were collected. Study quality was assessed with a modified version of the Quadas-2 tool for risk of bias assessment. Of 20 studies with an US index, 11 studies met the inclusion criteria. Out of these 11 studies, 7 and 4 studied CD and UC activity indices, respectively. Parameters that were used in these indices included bowel wall thickness (BWT), Doppler signal (DS), wall layer stratification (WLS), compressibility, peristalsis, haustrations, fatty wrapping, contrast enhancement (CE) and strain pattern. Study quality was graded high in 5 studies, moderate in 3 studies and low in 3 studies. Ileocolonoscopy was used as the reference standard in 9 studies. In 1 study a combined index of ileocolonoscopy and barium contrast radiography and in 1 study histology was used as the reference standard. Only 5 studies used an established endoscopic index for comparison with US. Several US indices for assessing disease activity in IBD are available; however the methodology for development was suboptimal in most studies. For the development of future indices stringent methodological design is required.

Quality of Life, Perceptions, and Health Satisfaction of Older Adults with End-Stage Renal Disease: A Systematic Review.

PubMed

Balogun, Seki A; Balogun, Rasheed; Philbrick, John; Abdel-Rahman, Emaad

2017-04-01

To explore the quality of life (QOL), perceptions, and health satisfaction of older adults with end-stage renal disease (ESRD) undergoing renal replacement therapy (RRT). Systematic review of literature. Individuals with ESRD undergoing RRT aged 65 and older. Articles identified from PubMed database search from January 1994 to December 2014. The methodological quality of each of the selected articles was assessed using eight standards adapted from well-established research quality review criteria. Of the initial 1,401 articles identified, 23 met the inclusion criteria. The age range of study participants examined was 65 to 90. Seventy-eight percent of the studies met six or more of the methodological standards; 47% found overall health-related and mental component summary QOL scores in elderly adults with ESRD to be similar to or higher than those of age-matched controls or younger individuals, although the physical component summary QOL scores tended to be lower in older adults. Only six studies addressed health satisfaction and perceptions of elderly adults with ESRD, with widely variable findings. Few studies specifically examine QOL in elderly adults with ESRD undergoing RRT and even fewer address issues of perceptions and health satisfaction. However, the limited data from the QOL studies looks promising with a significant proportion showing similar or higher overall health-related and mental component summary QOL scores in elderly adults with ESRD. The very limited data on perceptions and health satisfaction of elderly adults with ESRD undergoing RRT makes it difficult to make any generalizable conclusions. Overall, more research is needed to examine these factors in elderly adults with ESRD. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Patient-reported outcomes in randomised controlled trials of gynaecological cancers: investigating methodological quality and impact on clinical decision-making.

PubMed

Efficace, Fabio; Jacobs, Marc; Pusic, Andrea; Greimel, Elfriede; Piciocchi, Alfonso; Kieffer, Jacobien M; Gilbert, Alexandra; Fayers, Peter; Blazeby, Jane

2014-07-01

The aim for this study is to investigate the methodological quality and potential impact on clinical decision making of patient reported outcome (PRO) assessment in randomised controlled trials (RCTs) in the gynaecological cancer sites. A systematic review identified RCTs published between January 2004 and June 2012. Relevant studies were evaluated using a pre-determined extraction form which included: (1) Trial demographics and clinical and PRO characteristics; (2) level of PRO reporting and (3) bias, assessed using the Cochrane Risk of Bias tool. All studies were additionally analysed in relation to their relevance in supporting clinical decision making. Fifty RCTs enrolling 24,991 patients were identified. In eight RCTs (16%) a PRO was the primary end-point. Twenty-one studies (42%) were carried out in a multi-national context. Where statistically significant PRO differences between treatments were found, it related in most cases to both symptoms and domains other than symptoms (n=17, 57%). The majority of studies (n=42, 84%) did not mention the mode of administration nor the methods of collecting PRO data. Statistical approaches for dealing with missing data were only explicitly mentioned in nine RCTs (18%). Sixteen RCTs (32%) were considered to be of high-quality and thus able to inform clinical decision making. Higher-quality PRO studies were generally associated with RCTs that were at a low risk of bias. This study showed that RCTs with PROs were generally well designed and conducted. In a third the information was very informative to fully understand the pros and cons of PROs treatment decision-making. Copyright © 2014 Elsevier Ltd. All rights reserved.