Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments.

PubMed

Vessey, Judith; Strout, Tania D; DiFazio, Rachel L; Walker, Allison

2014-12-01

Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified psychometric papers evaluating youth bullying measures. A systematic review of the literature was conducted using 4 electronic databases. Data extraction and appraisal of identified instruments were completed using a standardized method and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Thirty-one articles describing 27 self-report instruments were evaluated in our analysis. Quality assessments ranged from 18% to 91%, with 6 papers reaching or exceeding a quality score of 75%. Limited evidence supporting the reliability, validity, and responsiveness of existing youth bullying measures was identified. Evidence supporting the psychometric soundness of the instruments identified was limited. Many measures were in early development and additional evaluation is necessary to validate their psychometric properties. A pool of instruments possesses acceptable initial psychometric dependability for selected assessment purposes. These findings have significant implications for assessing youth bullying and designing and evaluating school-based interventions. © 2014, American School Health Association.

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews

PubMed Central

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-01-01

Objective To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines—for example, in enemas, foot massage and compressing the umbilicus. Design A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. Result We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. Conclusions There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. PMID:28186925

Screening guide for rapid assessment of liquefaction hazard at highway bridge sites

DOT National Transportation Integrated Search

1998-06-16

As an aid to seismic hazard assessment, this report provides a "screening guide" for systematic evaluation of liquefactin hazard at bridge sites and a guide for prioritizing sites for further investigation or mitigation. The guide presents a systemat...

23 CFR 630.1008 - State-level processes and procedures.

Code of Federal Regulations, 2011 CFR

2011-04-01

..., data and information resources, training, and periodic evaluation enable a systematic approach for... management procedures. States should develop and implement systematic procedures to assess work zone impacts... practices and State processes and procedures. (e) Process review. In order to assess the effectiveness of...

ITS evaluation and assessment issues : EC discussion paper

DOT National Transportation Integrated Search

1997-05-22

This paper has summarised the role and importance of systematic assessment and evaluation : when considering investment in Road Transport Telematics. The CONVERGE project recommends the use of five broad evaluation themes detailed above, to which we ...

Relation of completeness of reporting of health research to journals’ endorsement of reporting guidelines: systematic review

PubMed Central

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F

2014-01-01

Objective To assess whether the completeness of reporting of health research is related to journals’ endorsement of reporting guidelines. Design Systematic review. Data sources Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed “evaluations”) (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. Study selection English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Data extraction Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals’ websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors’ analysis, a mean summed score. Results 101 reporting guidelines were included. Of 15 249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. Conclusions The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals’ endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals’ endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Systematic review registration Not registered; no known register currently accepts protocols for methodology systematic reviews. PMID:24965222

New methods for the assessment of Parkinson's disease (2005 to 2015): A systematic review.

PubMed

Sánchez-Ferro, Álvaro; Elshehabi, Morad; Godinho, Catarina; Salkovic, Dina; Hobert, Markus A; Domingos, Josefa; van Uem, Janet Mt; Ferreira, Joaquim J; Maetzler, Walter

2016-09-01

The past decade has witnessed a highly dynamic and growing expansion of novel methods aimed at improving the assessment of Parkinson's disease with technology (NAM-PD) in laboratory, clinical, and home environments. However, the current state of NAM-PD regarding their maturity, feasibility, and usefulness in assessing the main PD features has not been systematically evaluated. A systematic review of articles published in the field from 2005 to 2015 was performed. Of 9,503 publications identified in PubMed and the Web of Science, 848 full papers were evaluated, and 588 original articles were assessed to evaluate the technological, demographic, clinimetric, and technology transfer readiness parameters of NAM-PD. Of the studies, 65% included fewer than 30 patients, < 50% employed a standard methodology to validate diagnostic tests, 8% confirmed their results in a different dataset, and 87% occurred in a clinic or lab. The axial features domain was the most frequently studied, followed by bradykinesia. Rigidity and nonmotor domains were rarely investigated. Only 6% of the systems reached a technology level that justified the hope of being included in clinical assessments in a useful time period. This systematic evaluation provides an overview of the current options for quantitative assessment of PD and what can be expected in the near future. There is a particular need for standardized and collaborative studies to confirm the results of preliminary initiatives, assess domains that are currently underinvestigated, and better validate the existing and upcoming NAM-PD. © 2016 International Parkinson and Movement Disorder Society. © 2016 International Parkinson and Movement Disorder Society.

The Design, Implementation, and Evaluation of Online Credit Nutrition Courses: A Systematic Review

ERIC Educational Resources Information Center

Cohen, Nancy L.; Carbone, Elena T.; Beffa-Negrini, Patricia A.

2011-01-01

Objective: To assess how postsecondary online nutrition education courses (ONEC) are delivered, determine ONEC effectiveness, identify theoretical models used, and identify future research needs. Design: Systematic search of database literature. Setting: Postsecondary education. Participants: Nine research articles evaluating postsecondary ONEC.…

Methodological quality and reporting of systematic reviews in hand and wrist pathology.

PubMed

Wasiak, J; Shen, A Y; Ware, R; O'Donohoe, T J; Faggion, C M

2017-10-01

The objective of this study was to assess methodological and reporting quality of systematic reviews in hand and wrist pathology. MEDLINE, EMBASE and Cochrane Library were searched from inception to November 2016 for relevant studies. Reporting quality was evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and methodological quality using a measurement tool to assess systematic reviews, the Assessment of Multiple Systematic Reviews (AMSTAR). Descriptive statistics and linear regression were used to identify features associated with improved methodological quality. A total of 91 studies were included in the analysis. Most reviews inadequately reported PRISMA items regarding study protocol, search strategy and bias and AMSTAR items regarding protocol, publication bias and funding. Systematic reviews published in a plastics journal, or which included more authors, were associated with higher AMSTAR scores. A large proportion of systematic reviews within hand and wrist pathology literature score poorly with validated methodological assessment tools, which may affect the reliability of their conclusions. I.

Constant-Murley Score: systematic review and standardized evaluation in different shoulder pathologies.

PubMed

Vrotsou, Kalliopi; Ávila, Mónica; Machón, Mónica; Mateo-Abad, Maider; Pardo, Yolanda; Garin, Olatz; Zaror, Carlos; González, Nerea; Escobar, Antonio; Cuéllar, Ricardo

2018-05-10

The objective of this study was to evaluate the psychometric properties of the Constant-Murley Score (CMS) in various shoulder pathologies, based on a systematic review and expert standardized evaluations. A systematic review was performed in MEDLINE and EMBASE databases. Titles and abstracts were reviewed and finally the included articles were grouped according to patients' pathologies. Two expert evaluators independently assessed the CMS properties of reliability, validity, responsiveness to change, interpretability and burden score in each group, using the EMPRO (Evaluating Measures of Patient Reported Outcomes) tool. The CMS properties were assessed per attribute and overall for each considered group. Only the concept and measurement model was assessed globally. Five individual pathologies (i.e. subacromial, fractures, arthritis, instability and frozen shoulder) and two additional groups (i.e. various pathologies and healthy subjects) were considered. Overall EMPRO scores ranged from 58.6 for subacromial to 30.6 points for instability. Responsiveness to change was the only quality to obtain at least 50 points across all groups, but for frozen shoulder. Insufficient information was obtained in relation to the concept and measurement model and great variability was seen in the other evaluated attributes. The current evidence does not support the CMS as a gold standard in shoulder evaluation. Its use is advisable for subacromial pathology; but data are inconclusive for other shoulder conditions. Prospective studies exploring the psychometric properties of the scale, particularly for fractures, arthritis, instability and frozen shoulder are needed. Systematic review.

A critical appraisal of the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing interventions: a systematic review of reviews.

PubMed

Jin, Ying-Hui; Wang, Guo-Hao; Sun, Yi-Rong; Li, Qi; Zhao, Chen; Li, Ge; Si, Jin-Hua; Li, Yan; Lu, Cui; Shang, Hong-Cai

2016-11-14

To assess the methodology and quality of evidence of systematic reviews and meta-analyses of traditional Chinese medical nursing (TCMN) interventions in Chinese journals. These interventions include acupressure, massage, Tai Chi, Qi Gong, electroacupuncture and use of Chinese herbal medicines-for example, in enemas, foot massage and compressing the umbilicus. A systematic literature search for systematic reviews and meta-analyses of TCMN interventions was performed. Review characteristics were extracted. The methodological quality and the quality of the evidence were evaluated using the Assessment of Multiple Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) approaches. We included 20 systematic reviews and meta-analyses, and a total of 11 TCMN interventions were assessed in the 20 reviews. The compliance with AMSTAR checklist items ranged from 4.5 to 8 and systematic reviews/meta-analyses were, on average, of medium methodological quality. The quality of the evidence we assessed ranged from very low to moderate; no high-quality evidence was found. The top two causes for downrating confidence in effect estimates among the 31 bodies of evidence assessed were the risk of bias and inconsistency. There is room for improvement in the methodological quality of systematic reviews/meta-analyses of TCMN interventions published in Chinese journals. Greater efforts should be devoted to ensuring a more comprehensive search strategy, clearer specification of the interventions of interest in the eligibility criteria and identification of meaningful outcomes for clinicians and patients (consumers). The overall quality of evidence among reviews remains suboptimal, which raise concerns about their roles in influencing clinical practice. Thus, the conclusions in reviews we assessed must be treated with caution and their roles in influencing clinical practice should be limited. A critical appraisal of systematic reviews/meta-analyses of TCMN interventions is particularly important to provide sound guidance for TCMN. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Frailty in trauma: A systematic review of the surgical literature for clinical assessment tools.

PubMed

McDonald, Victoria S; Thompson, Kimberly A; Lewis, Paul R; Sise, C Beth; Sise, Michael J; Shackford, Steven R

2016-05-01

Elderly trauma patients have outcomes worse than those of similarly injured younger patients. Although patient age and comorbidities explain some of the difference, the contribution of frailty to outcomes is largely unknown because of the lack of assessment tools developed specifically to assess frailty in the trauma population. This systematic review of the surgical literature identifies currently available frailty clinical assessment tools and evaluates the potential of each instrument to assess frailty in elderly patients with trauma. This review was registered with PROSPERO (the international prospective register of systematic reviews, registration number CRD42014015350). Publications in English from January 1995 to October 2014 were identified by a comprehensive search strategy in MEDLINE, EMBASE, and CINAHL, supplemented by manual screening of article bibliographies and subjected to three tiers of review. Forty-two studies reporting on frailty assessment tools were selected for analysis. Criteria for objectivity, feasibility in the trauma setting, and utility to predict trauma outcomes were formulated and used to evaluate the tools, including their subscales and individual items. Thirty-two unique frailty assessment tools were identified. Of those, 4 tools as a whole, 2 subscales, and 29 individual items qualified as objective, feasible, and useful in the clinical assessment of trauma patients. The single existing tool developed specifically to assess frailty in trauma did not meet evaluation criteria. Few frailty assessment tools in the surgical literature qualify as objective, feasible, and useful measures of frailty in the trauma population. However, a number of individual tool items and subscales could be combined to assess frailty in the trauma setting. Research to determine the accuracy of these measures and the magnitude of the contribution of frailty to trauma outcomes is needed. Systematic review, level III.

Ophthalmic adverse drug reactions to systemic drugs: a systematic review.

PubMed

Miguel, Ana; Henriques, Filipe; Azevedo, Luís Filipe; Pereira, Altamiro Costa

2014-03-01

To perform a comprehensive and systematic review regarding ophthalmic adverse drug reactions (ADRs) to systemic drugs to: (i) systematically summarize existing evidence, (ii) identify areas, ophthalmic ADRs or drugs that lacked systematization or assessment (namely drugs with original studies characterizing specific ophthalmic ADRs but without causality assessment nor without meta-analysis). Systematic review of several electronic databases (last search 1/7/2012): Medline, SCOPUS, ISI web of knowledge, ISI Conference Proceedings, International Pharmaceutical Abstracts and Google scholar. Search query included: eye, ocular, ophthalmic, ophthalmology, adverse and reaction. Inclusion criteria were: (i) Primary purpose was to assess an ophthalmic ADR to a systemic medication; (ii) Patient evaluation performed by an ophthalmologist; (iii) Studies that specified diagnostic criteria for an ocular ADR. Different types of studies were included and analyzed separately. Two independent reviewers assessed eligibility criteria, extracted data and evaluated risk of bias. From 562 studies found, 32 were included (1 systematic review to sildenafil, 11 narrative reviews, 1 trial, 1 prospective study, 6 transversal studies, 6 spontaneous reports and 6 case series). Drugs frequently involved included amiodarone, sildenafil, hydroxychloroquine and biphosphonates. Frequent ophthalmic ADRs included: keratopathy, dry eye and retinopathy. To increase evidence about ophthalmic ADRs, there is a need for performing specific systematic reviews, applying strictly the World Health Organization's (WHO) definition of ADR and WHO causality assessment of ADRs. Some ophthalmic ADRs may be frequent, but require ophthalmological examination; therefore, ophthalmologists' education and protocols of collaboration between other specialties whenever they prescribe high-risk drugs are suggestions for the future. Copyright © 2014 John Wiley & Sons, Ltd.

Maximizing the Impact of Systematic Reviews in Health Care Decision Making: A Systematic Scoping Review of Knowledge-Translation Resources

PubMed Central

Chambers, Duncan; Wilson, Paul M; Thompson, Carl A; Hanbury, Andria; Farley, Katherine; Light, Kate

2011-01-01

Context: Barriers to the use of systematic reviews by policymakers may be overcome by resources that adapt and present the findings in formats more directly tailored to their needs. We performed a systematic scoping review to identify such knowledge-translation resources and evaluations of them. Methods: Resources were eligible for inclusion in this study if they were based exclusively or primarily on systematic reviews and were aimed at health care policymakers at the national or local level. Resources were identified by screening the websites of health technology assessment agencies and systematic review producers, supplemented by an email survey. Electronic databases and proceedings of the Cochrane Colloquium and HTA International were searched as well for published and unpublished evaluations of knowledge-translation resources. Resources were classified as summaries, overviews, or policy briefs using a previously published classification. Findings: Twenty knowledge-translation resources were identified, of which eleven were classified as summaries, six as overviews, and three as policy briefs. Resources added value to systematic reviews by, for example, evaluating their methodological quality or assessing the reliability of their conclusions or their generalizability to particular settings. The literature search found four published evaluation studies of knowledge-translation resources, and the screening of abstracts and contact with authors found three more unpublished studies. The majority of studies reported on the perceived usefulness of the service, although there were some examples of review-based resources being used to assist actual decision making. Conclusions: Systematic review producers provide a variety of resources to help policymakers, of which focused summaries are the most common. More evaluations of these resources are required to ensure users’ needs are being met, to demonstrate their impact, and to justify their funding. PMID:21418315

Systematic literature reviews and meta-analyses: part 6 of a series on evaluation of scientific publications.

PubMed

Ressing, Meike; Blettner, Maria; Klug, Stefanie J

2009-07-01

Because of the rising number of scientific publications, it is important to have a means of jointly summarizing and assessing different studies on a single topic. Systematic literature reviews, meta-analyses of published data, and meta-analyses of individual data (pooled reanalyses) are now being published with increasing frequency. We here describe the essential features of these methods and discuss their strengths and weaknesses. This article is based on a selective literature search. The different types of review and meta-analysis are described, the methods used in each are outlined so that they can be evaluated, and a checklist is given for the assessment of reviews and meta-analyses of scientific articles. Systematic literature reviews provide an overview of the state of research on a given topic and enable an assessment of the quality of individual studies. They also allow the results of different studies to be evaluated together when these are inconsistent. Meta-analyses additionally allow calculation of pooled estimates of an effect. The different types of review and meta-analysis are discussed with examples from the literature on one particular topic. Systematic literature reviews and meta-analyses enable the research findings and treatment effects obtained in different individual studies to be summed up and evaluated.

CARDIOVASCULAR SCREENING OF YOUNG ATHLETES: A REVIEW OF ECONOMIC EVALUATIONS.

PubMed

Gerkens, Sophie; Van Brabandt, Hans; Desomer, Anja; Leonard, Christian; Neyt, Mattias

2017-01-01

Some experts have promoted preparticipative cardiovascular screening programs for young athletes and have claimed that such programs were cost-effective without performing a critical analysis of studies supporting this statement. In this systematic review, a critical assessment of economic evaluations on these programs is performed to determine if they really provide value for money. A systematic review of economic evaluations was performed on December 24, 2014. Web sites of health technology assessment agencies, the Cochrane database of systematic review, the National Health Service Economic Evaluation Database of the Cochrane Library, EMBASE, Medline, Psychinfo, and EconLit were searched to retrieve (reviews of) economic evaluations. No language or time restrictions were imposed and predefined selection criteria were used. Selected studies were critically assessed applying a structured data extraction sheet. Five relevant economic evaluations were critically assessed. Results of these studies were mixed. However, those in favor of screening made (methodological) incorrect choices, of which the most important one was not taking into account a no-screening alternative as comparator. Compared with no screening, other strategies (history and physical examination or history and physical examination plus electrocardiogram) were not considered cost-effective. Results of primary economic evaluations should not be blindly copied without critical assessment. Economic evaluations in this field lack the support of robust evidence. Negative consequences of screening (false positive findings, overtreatment) should also be taken into account and may cause more harm than good. A mass screening of young athletes for cardiovascular diseases does not provide value for money and should be discouraged.

Conducting systematic reviews of economic evaluations.

PubMed

Gomersall, Judith Streak; Jadotte, Yuri Tertilus; Xue, Yifan; Lockwood, Suzi; Riddle, Dru; Preda, Alin

2015-09-01

In 2012, a working group was established to review and enhance the Joanna Briggs Institute (JBI) guidance for conducting systematic review of evidence from economic evaluations addressing a question(s) about health intervention cost-effectiveness. The objective is to present the outcomes of the working group. The group conducted three activities to inform the new guidance: review of literature on the utility/futility of systematic reviews of economic evaluations and consideration of its implications for updating the existing methodology; assessment of the critical appraisal tool in the existing guidance against criteria that promotes validity in economic evaluation research and two other commonly used tools; and a workshop. The debate in the literature on the limitations/value of systematic review of economic evidence cautions that systematic reviews of economic evaluation evidence are unlikely to generate one size fits all answers to questions about the cost-effectiveness of interventions and their comparators. Informed by this finding, the working group adjusted the framing of the objectives definition in the existing JBI methodology. The shift is away from defining the objective as to determine one cost-effectiveness measure toward summarizing study estimates of cost-effectiveness and informed by consideration of the included study characteristics (patient, setting, intervention component, etc.), identifying conditions conducive to lowering costs and maximizing health benefits. The existing critical appraisal tool was included in the new guidance. The new guidance includes the recommendation that a tool designed specifically for the purpose of appraising model-based studies be used together with the generic appraisal tool for economic evaluations assessment to evaluate model-based evaluations. The guidance produced by the group offers reviewers guidance for each step of the systematic review process, which are the same steps followed in JBI reviews of other types of evidence. The updated JBI guidance will be useful for researchers wanting to synthesize evidence about economic questions, either as stand-alone reviews or part of comprehensive or mixed method evidence reviews. Although the updated methodology produced by the work of the working group has improved the JBI guidance for systematic reviews of economic evaluations, there are areas where further work is required. These include adjusting the critical appraisal tool to separate out questions addressing intervention cost and effectiveness measurement; providing more explicit guidance for assessing generalizability of findings; and offering a more robust method for evidence synthesis that facilitates achieving the more ambitious review objectives.

Use of Geriatric Assessment for Older Adults in the Oncology Setting: A Systematic Review

PubMed Central

2012-01-01

Background Geriatric assessment is a multidisciplinary diagnostic process that evaluates the older adult’s medical, psychological, social, and functional capacity. No systematic review of the use of geriatric assessment in oncology has been conducted. The goals of this systematic review were: 1) to provide an overview of all geriatric assessment instruments used in the oncology setting; 2) to examine the feasibility and psychometric properties of those instruments; and 3) to systematically evaluate the effectiveness of geriatric assessment in predicting or modifying outcomes (including the impact on treatment decision making, toxicity of treatment, and mortality). Methods We searched Medline, Embase, Psychinfo, Cinahl, and the Cochrane Library for articles published in English, French, Dutch, or German between January 1, 1996, and November 16, 2010, reporting on cross-sectional, longitudinal, interventional, or observational studies that assessed the feasibility or effectiveness of geriatric assessment instruments. The quality of articles was evaluated using relevant quality assessment frameworks. Results We identified 83 articles that reported on 73 studies. The quality of most studies was poor to moderate. Eleven studies examined psychometric properties or diagnostic accuracy of the geriatric assessment instruments used. The assessment generally took 10–45min. Geriatric assessment was most often completed to describe a patient’s health and functional status. Specific domains of geriatric assessment were associated with treatment toxicity in 6 of 9 studies and with mortality in 8 of 16 studies. Of the four studies that examined the impact of geriatric assessment on the cancer treatment decision, two found that geriatric assessment impacted 40%–50% of treatment decisions. Conclusion Geriatric assessment in the oncology setting is feasible, and some domains are associated with adverse outcomes. However, there is limited evidence that geriatric assessment impacted treatment decision making. Further research examining the effectiveness of geriatric assessment on treatment decisions and outcomes is needed. PMID:22851269

Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries.

PubMed

Angelis, Aris; Lange, Ansgar; Kanavos, Panos

2018-01-01

Although health technology assessment (HTA) systems base their decision making process either on economic evaluations or comparative clinical benefit assessment, a central aim of recent approaches to value measurement, including value based assessment and pricing, points towards the incorporation of supplementary evidence and criteria that capture additional dimensions of value. To study the practices, processes and policies of value-assessment for new medicines across eight European countries and the role of HTA beyond economic evaluation and clinical benefit assessment. A systematic (peer review and grey) literature review was conducted using an analytical framework examining: (1) 'Responsibilities and structure of HTA agencies'; (2) 'Evidence and evaluation criteria considered in HTAs'; (3) 'Methods and techniques applied in HTAs'; and (4) 'Outcomes and implementation of HTAs'. Study countries were France, Germany, England, Sweden, Italy, Netherlands, Poland and Spain. Evidence from the literature was validated and updated through two rounds of feedback involving primary data collection from national experts. All countries assess similar types of evidence; however, the specific criteria/endpoints used, their level of provision and requirement, and the way they are incorporated (e.g. explicitly vs. implicitly) varies across countries, with their relative importance remaining generally unknown. Incorporation of additional 'social value judgements' (beyond clinical benefit assessment) and economic evaluation could help explain heterogeneity in coverage recommendations and decision-making. More comprehensive and systematic assessment procedures characterised by increased transparency, in terms of selection of evaluation criteria, their importance and intensity of use, could lead to more rational evidence-based decision-making, possibly improving efficiency in resource allocation, while also raising public confidence and fairness.

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

Systematic Correlation Matrix Evaluation (SCoMaE) - a bottom-up, science-led approach to identifying indicators

NASA Astrophysics Data System (ADS)

Mengis, Nadine; Keller, David P.; Oschlies, Andreas

2018-01-01

This study introduces the Systematic Correlation Matrix Evaluation (SCoMaE) method, a bottom-up approach which combines expert judgment and statistical information to systematically select transparent, nonredundant indicators for a comprehensive assessment of the state of the Earth system. The methods consists of two basic steps: (1) the calculation of a correlation matrix among variables relevant for a given research question and (2) the systematic evaluation of the matrix, to identify clusters of variables with similar behavior and respective mutually independent indicators. Optional further analysis steps include (3) the interpretation of the identified clusters, enabling a learning effect from the selection of indicators, (4) testing the robustness of identified clusters with respect to changes in forcing or boundary conditions, (5) enabling a comparative assessment of varying scenarios by constructing and evaluating a common correlation matrix, and (6) the inclusion of expert judgment, for example, to prescribe indicators, to allow for considerations other than statistical consistency. The example application of the SCoMaE method to Earth system model output forced by different CO2 emission scenarios reveals the necessity of reevaluating indicators identified in a historical scenario simulation for an accurate assessment of an intermediate-high, as well as a business-as-usual, climate change scenario simulation. This necessity arises from changes in prevailing correlations in the Earth system under varying climate forcing. For a comparative assessment of the three climate change scenarios, we construct and evaluate a common correlation matrix, in which we identify robust correlations between variables across the three considered scenarios.

How comprehensive are research studies investigating the efficacy of technology-enhanced learning resources in anatomy education? A systematic review.

PubMed

Clunie, Lauren; Morris, Neil P; Joynes, Viktoria C T; Pickering, James D

2018-05-06

Anatomy education is at the forefront of integrating innovative technologies into its curricula. However, despite this rise in technology numerous authors have commented on the shortfall in efficacy studies to assess the impact such technology-enhanced learning (TEL) resources have on learning. To assess the range of evaluation approaches to TEL across anatomy education, a systematic review was conducted using MEDLINE, the Educational Resources Information Centre (ERIC), Scopus, and Google Scholar, with a total of 3,345 articles retrieved. Following the PRISMA method for reporting items, 153 articles were identified and reviewed against a published framework-the technology-enhanced learning evaluation model (TELEM). The model allowed published reports to be categorized according to evaluations at the level of (1) learner satisfaction, (2) learning gain, (3) learner impact, and (4) institutional impact. The results of this systematic review reveal that most evaluation studies into TEL within anatomy curricula were based on learner satisfaction, followed by module or course learning outcomes. Randomized controlled studies assessing learning gain with a specific TEL resource were in a minority, with no studies reporting a comprehensive assessment on the overall impact of introducing a specific TEL resource (e.g., return on investment). This systematic review has provided clear evidence that anatomy education is engaged in evaluating the impact of TEL resources on student education, although it remains at a level that fails to provide comprehensive causative evidence. Anat Sci Educ 11: 303-319. © 2017 American Association of Anatomists. © 2017 American Association of Anatomists.

SMART Security Cooperation Objectives: Improving DoD Planning and Guidance

DTIC Science & Technology

2016-01-01

integrate them into a system for assessing, monitoring, and evaluating security cooperation programs and activities. This report evaluates DoD’s...effectiveness in developing SMART security coopera- tion objectives that facilitate assessment, monitoring, and evaluation . It also proposes a systematic...Cooperation Ends, Ways, and Means . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 RAND Evaluation and Revision of Selected

Sequential assessment via daphnia and zebrafish for systematic toxicity screening of heterogeneous substances.

PubMed

Jang, Gun Hyuk; Park, Chang-Beom; Kang, Benedict J; Kim, Young Jun; Lee, Kwan Hyi

2016-09-01

Environment and organisms are persistently exposed by a mixture of various substances. However, the current evaluation method is mostly based on an individual substance's toxicity. A systematic toxicity evaluation of heterogeneous substances needs to be established. To demonstrate toxicity assessment of mixture, we chose a group of three typical ingredients in cosmetic sunscreen products that frequently enters ecosystems: benzophenone-3 (BP-3), ethylhexyl methoxycinnamate (EHMC), and titanium dioxide nanoparticle (TiO2 NP). We first determined a range of nominal toxic concentration of each ingredient or substance using Daphnia magna, and then for the subsequent organismal level phenotypic assessment, chose the wild-type zebrafish embryos. Any phenotype change, such as body deformation, led to further examinations on the specific organs of transgenic zebrafish embryos. Based on the systematic toxicity assessments of the heterogeneous substances, we offer a sequential environmental toxicity assessment protocol that starts off by utilizing Daphnia magna to determine a nominal concentration range of each substance and finishes by utilizing the zebrafish embryos to detect defects on the embryos caused by the heterogeneous substances. The protocol showed additive toxic effects of the mixtures. We propose a sequential environmental toxicity assessment protocol for the systematic toxicity screening of heterogeneous substances from Daphnia magna to zebrafish embryo in-vivo models. Copyright © 2016 Elsevier Ltd. All rights reserved.

Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review

PubMed Central

Krauth, David; Woodruff, Tracey J.

2013-01-01

Background: Results from animal toxicology studies are critical to evaluating the potential harm from exposure to environmental chemicals or the safety of drugs prior to human testing. However, there is significant debate about how to evaluate the methodology and potential biases of the animal studies. There is no agreed-upon approach, and a systematic evaluation of current best practices is lacking. Objective: We performed a systematic review to identify and evaluate instruments for assessing the risk of bias and/or other methodological criteria of animal studies. Method: We searched Medline (January 1966–November 2011) to identify all relevant articles. We extracted data on risk of bias criteria (e.g., randomization, blinding, allocation concealment) and other study design features included in each assessment instrument. Discussion: Thirty distinct instruments were identified, with the total number of assessed risk of bias, methodological, and/or reporting criteria ranging from 2 to 25. The most common criteria assessed were randomization (25/30, 83%), investigator blinding (23/30, 77%), and sample size calculation (18/30, 60%). In general, authors failed to empirically justify why these or other criteria were included. Nearly all (28/30, 93%) of the instruments have not been rigorously tested for validity or reliability. Conclusion: Our review highlights a number of risk of bias assessment criteria that have been empirically tested for animal research, including randomization, concealment of allocation, blinding, and accounting for all animals. In addition, there is a need for empirically testing additional methodological criteria and assessing the validity and reliability of a standard risk of bias assessment instrument. Citation: Krauth D, Woodruff TJ, Bero L. 2013. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121:985–992 (2013); http://dx.doi.org/10.1289/ehp.1206389 PMID:23771496

Systematic evaluation of non-animal test methods for skin sensitisation safety assessment.

PubMed

Reisinger, Kerstin; Hoffmann, Sebastian; Alépée, Nathalie; Ashikaga, Takao; Barroso, Joao; Elcombe, Cliff; Gellatly, Nicola; Galbiati, Valentina; Gibbs, Susan; Groux, Hervé; Hibatallah, Jalila; Keller, Donald; Kern, Petra; Klaric, Martina; Kolle, Susanne; Kuehnl, Jochen; Lambrechts, Nathalie; Lindstedt, Malin; Millet, Marion; Martinozzi-Teissier, Silvia; Natsch, Andreas; Petersohn, Dirk; Pike, Ian; Sakaguchi, Hitoshi; Schepky, Andreas; Tailhardat, Magalie; Templier, Marie; van Vliet, Erwin; Maxwell, Gavin

2015-02-01

The need for non-animal data to assess skin sensitisation properties of substances, especially cosmetics ingredients, has spawned the development of many in vitro methods. As it is widely believed that no single method can provide a solution, the Cosmetics Europe Skin Tolerance Task Force has defined a three-phase framework for the development of a non-animal testing strategy for skin sensitization potency prediction. The results of the first phase – systematic evaluation of 16 test methods – are presented here. This evaluation involved generation of data on a common set of ten substances in all methods and systematic collation of information including the level of standardisation, existing test data,potential for throughput, transferability and accessibility in cooperation with the test method developers.A workshop was held with the test method developers to review the outcome of this evaluation and to discuss the results. The evaluation informed the prioritisation of test methods for the next phase of the non-animal testing strategy development framework. Ultimately, the testing strategy – combined with bioavailability and skin metabolism data and exposure consideration – is envisaged to allow establishment of a data integration approach for skin sensitisation safety assessment of cosmetic ingredients.

Functional Assessment-Based Interventions for Students with or At-Risk for High-Incidence Disabilities: Field Testing Single-Case Synthesis Methods

ERIC Educational Resources Information Center

Common, Eric Alan; Lane, Kathleen Lynne; Pustejovsky, James E.; Johnson, Austin H.; Johl, Liane Elizabeth

2017-01-01

This systematic review investigated one systematic approach to designing, implementing, and evaluating functional assessment-based interventions (FABI) for use in supporting school-age students with or at-risk for high-incidence disabilities. We field tested several recently developed methods for single-case design syntheses. First, we appraised…

Revision of the Competency Standards for Occupational Therapy Driver Assessors: An overview of the evidence for the inclusion of cognitive and perceptual assessments within fitness-to-drive evaluations.

PubMed

Fields, Sally M; Unsworth, Carolyn A

2017-08-01

Determination of fitness-to-drive after illness or injury is a complex process typically requiring a comprehensive driving assessment, including off-road and on-road assessment components. The competency standards for occupational therapy driver assessors (Victoria, Australia) define the requirements for performance of a comprehensive driving assessment, and we are currently revising these. Assessment of cognitive and perceptual skills forms an important part of the off-road assessment. The aim of this systematic review of systematic reviews (known as an overview) is to identify what evidence exists for including assessment of cognitive and perceptual skills within fitness-to-drive evaluations to inform revision of the competency standards. Five electronic databases (MEDLINE, CINAHL, PsycINFO, The Cochrane Library, OT Seeker) were systematically searched. Systematic review articles were appraised by two authors for eligibility. Methodological quality was independently assessed using the AMSTAR tool. Narrative analysis was conducted to summarise the content of eligible reviews. A total of 1228 results were retrieved. Fourteen reviews met the inclusion criteria. Reviews indicated that the components of cognition and perception most frequently identified as being predictive of fitness-to-drive were executive function (n = 13), processing speed (n = 12), visuospatial skills, attention, memory and mental flexibility (n = 11). Components less indicative were perception, concentration (n = 10), praxis (n = 9), language (n = 7) and neglect (n = 6). This overview of systematic reviews supports the inclusion of assessment of a range of cognitive and perceptual skills as key elements in a comprehensive driver assessment and therefore should be included in the revised competency standards for occupational therapy driver assessors. © 2017 Occupational Therapy Australia.

Quality of systematic reviews: an example of studies comparing artificial disc replacement with fusion in the cervical spine.

PubMed

Tashani, Osama A; El-Tumi, Hanan; Aneiba, Khaled

2015-01-01

Cervical artificial disc replacement (C-ADR) is now an alternative to anterior cervical discectomy and fusion (ACDF). Many studies have evaluated the efficacy of C-ADR compared with ACDF. This led to a series of systematic reviews and meta-analyses to evaluate the evidence of the superiority of one intervention against the other. The aim of the study presented here was to evaluate the quality of these reviews and meta-analyses. Medline via Ovid, Embase, and Cochrane Library were searched using the keywords: (total disk replacement, prosthesis, implantation, discectomy, and arthroplasty) AND (cervical vertebrae, cervical spine, and spine) AND (systematic reviews, reviews, and meta-analysis). Screening and data extraction were conducted by two reviewers independently. Two reviewers then assessed the quality of the selected reviews and meta-analysis using 11-item AMSTAR score which is a validated measurement tool to assess the methodological quality of systematic reviews. Screening of full reports of 46 relevant abstracts resulted in the selection of 15 systematic reviews and/or meta-analyses as eligible for this study. The two reviewers' inter-rater agreement level was high as indicated by kappa of >0.72. The AMSTAR score of the reviews ranged from 3 to 11. Only one study (a Cochrane review) scored 100% (AMSTAR 11). Five studies scored below (AMSTAR 5) indicating low-quality reviews. The most significant drawbacks of reviews of a score below 5 were not using an extensive search strategy, failure to use the scientific quality of the included studies appropriately in formulating a conclusion, not assessing publication bias, and not reporting the excluded studies. With a significant exception of a Cochrane review, the methodological quality of systematic reviews evaluating the evidence of C-ADR versus ACDF has to be improved.

The search and selection for primary studies in systematic reviews published in dental journals indexed in MEDLINE was not fully reproducible.

PubMed

Faggion, Clovis Mariano; Huivin, Raquel; Aranda, Luisiana; Pandis, Nikolaos; Alarcon, Marco

2018-06-01

To evaluate whether the reporting of search strategies and the primary study selection process in dental systematic reviews is reproducible. A survey of systematic reviews published in MEDLINE-indexed dental journals from June 2015 to June 2016 was conducted. Study selection was performed independently by two authors, and the reproducibility of the selection process was assessed using a tool consisting of 12 criteria. Regression analyses were implemented to evaluate any associations between degrees of reporting (measured by the number of items positively answered) and journal impact factor (IF), presence of meta-analysis, and number of citations of the systematic review in Google Scholar. Five hundred and thirty systematic reviews were identified. Following our 12 criteria, none of the systematic reviews had complete reporting of the search strategies and selection process. Eight (1.5%) systematic reviews reported the list of excluded articles (with reasons for exclusion) after title and abstract assessment. Systematic reviews with more positive answers to the criteria were significantly associated with higher journal IF, number of citations, and inclusion of meta-analysis. Search strategies and primary study selection process in systematic reviews published in MEDLINE-indexed dental journals may not be fully reproducible. Copyright © 2018 Elsevier Inc. All rights reserved.

Investigating Key Psychometric Properties of the French Version of the Early Years Evaluation-Teacher Assessment

ERIC Educational Resources Information Center

Laurie, Robert; Sloat, Elizabeth

2016-01-01

This research investigates key psychometric properties of the French Early Years Evaluation-Teacher Assessment measure designed to systematically assess kindergarten children across five social and academic developmental domains: awareness of self and environment, social skills and behaviour, cognitive abilities, language and communication, and…

Evaluation of the ToxRTool's ability to rate the reliability of toxicological data for human health hazard assessments

EPA Science Inventory

Regulatory agencies often utilize results from peer reviewed publications for hazard assessments.A problem in doing so is the lack of well-accepted tools to objectively, efficiently and systematically assess the quality of published toxicological studies. Herein, we evaluated the...

Improving Accreditor's Evaluation of Experiential Learning Programs.

ERIC Educational Resources Information Center

Keeton, Morris T.

1980-01-01

Principles of good practice in assessing experiential learning include better self-evaluation of the learning outcomes of experiential components, systematic program auditing, and training of external evaluators. (SK)

The Marketing Audit as a Method of the Evaluation of the Marketing Plan

NASA Astrophysics Data System (ADS)

Vaňa, Kamil; Černá, Ľubica

2012-12-01

The growing complexity of the current market environment needs a more systematic evaluation process of the organizational marketing performance to deal with the dynamic market. This paper deals with marketing audit as a comprehensive assessment of all angles of marketing operation in an organization and also deals with systematic evaluation of plans, objectives, strategies, activities and organizational structure as well as marketing staff.

Applicability and feasibility of systematic review for performing evidence-based risk assessment in food and feed safety.

PubMed

Aiassa, E; Higgins, J P T; Frampton, G K; Greiner, M; Afonso, A; Amzal, B; Deeks, J; Dorne, J-L; Glanville, J; Lövei, G L; Nienstedt, K; O'connor, A M; Pullin, A S; Rajić, A; Verloo, D

2015-01-01

Food and feed safety risk assessment uses multi-parameter models to evaluate the likelihood of adverse events associated with exposure to hazards in human health, plant health, animal health, animal welfare, and the environment. Systematic review and meta-analysis are established methods for answering questions in health care, and can be implemented to minimize biases in food and feed safety risk assessment. However, no methodological frameworks exist for refining risk assessment multi-parameter models into questions suitable for systematic review, and use of meta-analysis to estimate all parameters required by a risk model may not be always feasible. This paper describes novel approaches for determining question suitability and for prioritizing questions for systematic review in this area. Risk assessment questions that aim to estimate a parameter are likely to be suitable for systematic review. Such questions can be structured by their "key elements" [e.g., for intervention questions, the population(s), intervention(s), comparator(s), and outcome(s)]. Prioritization of questions to be addressed by systematic review relies on the likely impact and related uncertainty of individual parameters in the risk model. This approach to planning and prioritizing systematic review seems to have useful implications for producing evidence-based food and feed safety risk assessment.

Quality of systematic reviews in pediatric oncology--a systematic review.

PubMed

Lundh, Andreas; Knijnenburg, Sebastiaan L; Jørgensen, Anders W; van Dalen, Elvira C; Kremer, Leontien C M

2009-12-01

To ensure evidence-based decision making in pediatric oncology systematic reviews are necessary. The objective of our study was to evaluate the methodological quality of all currently existing systematic reviews in pediatric oncology. We identified eligible systematic reviews through a systematic search of the literature. Data on clinical and methodological characteristics of the included systematic reviews were extracted. The methodological quality of the included systematic reviews was assessed using the overview quality assessment questionnaire, a validated 10-item quality assessment tool. We compared the methodological quality of systematic reviews published in regular journals with that of Cochrane systematic reviews. We included 117 systematic reviews, 99 systematic reviews published in regular journals and 18 Cochrane systematic reviews. The average methodological quality of systematic reviews was low for all ten items, but the quality of Cochrane systematic reviews was significantly higher than systematic reviews published in regular journals. On a 1-7 scale, the median overall quality score for all systematic reviews was 2 (range 1-7), with a score of 1 (range 1-7) for systematic reviews in regular journals compared to 6 (range 3-7) in Cochrane systematic reviews (p<0.001). Most systematic reviews in the field of pediatric oncology seem to have serious methodological flaws leading to a high risk of bias. While Cochrane systematic reviews were of higher methodological quality than systematic reviews in regular journals, some of them also had methodological problems. Therefore, the methodology of each individual systematic review should be scrutinized before accepting its results.

Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review.

PubMed

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F; Moher, David

2014-06-25

To assess whether the completeness of reporting of health research is related to journals' endorsement of reporting guidelines. Systematic review. Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed "evaluations") (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals' websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors' analysis, a mean summed score. 101 reporting guidelines were included. Of 15,249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals' endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals' endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Not registered; no known register currently accepts protocols for methodology systematic reviews. © Stevens et al 2014.

Core Professionalism Education in Surgery: A Systematic Review.

PubMed

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-03-15

Professionalism education is one of the major elements of surgical residency education. To evaluate the studies on core professionalism education programs in surgical professionalism education. Systematic review. This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

Systematic reviews of health economic evaluations: a protocol for a systematic review of characteristics and methods applied.

PubMed

Luhnen, Miriam; Prediger, Barbara; Neugebauer, Edmund A M; Mathes, Tim

2017-12-02

The number of systematic reviews of economic evaluations is steadily increasing. This is probably related to the continuing pressure on health budgets worldwide which makes an efficient resource allocation increasingly crucial. In particular in recent years, the introduction of several high-cost interventions presents enormous challenges regarding universal accessibility and sustainability of health care systems. An increasing number of health authorities, inter alia, feel the need for analyzing economic evidence. Economic evidence might effectively be generated by means of systematic reviews. Nevertheless, no standard methods seem to exist for their preparation so far. The objective of this study was to analyze the methods applied for systematic reviews of health economic evaluations (SR-HE) with a focus on the identification of common challenges. The planned study is a systematic review of the characteristics and methods actually applied in SR-HE. We will combine validated search filters developed for the retrieval of economic evaluations and systematic reviews to identify relevant studies in MEDLINE (via Ovid, 2015-present). To be eligible for inclusion, studies have to conduct a systematic review of full economic evaluations. Articles focusing exclusively on methodological aspects and secondary publications of health technology assessment (HTA) reports will be excluded. Two reviewers will independently assess titles and abstracts and then full-texts of studies for eligibility. Methodological features will be extracted in a standardized, beforehand piloted data extraction form. Data will be summarized with descriptive statistical measures and systematically analyzed focusing on differences/similarities and methodological weaknesses. The systematic review will provide a detailed overview of characteristics of SR-HE and the applied methods. Differences and methodological shortcomings will be detected and their implications will be discussed. The findings of our study can improve the recommendations on the preparation of SR-HE. This can increase the acceptance and usefulness of systematic reviews in health economics for researchers and medical decision makers. The review will not be registered with PROSPERO as it does not meet the eligibility criterion of dealing with clinical outcomes.

Standardized assessment of psychosocial factors and their influence on medically confirmed health outcomes in workers: a systematic review.

PubMed

Rosário, Susel; Fonseca, João A; Nienhaus, Albert; da Costa, José Torres

2016-01-01

Previous studies of psychosocial work factors have indicated their importance for workers' health. However, to what extent health problems can be attributed to the nature of the work environment or other psychosocial factors is not clear. No previous systematic review has used inclusion criteria based on specific medical evaluation of work-related health outcomes and the use of validated instruments for the assessment of the psychosocial (work) environment. The aim of this systematic review is to summarize the evidence assessing the relationship between the psychosocial work environment and workers' health based on studies that used standardized and validated instruments to assess the psychosocial work environment and that focused on medically confirmed health outcomes. A systematic review of the literature was carried out by searching the databases PubMed, B-ON, Science Direct, Psycarticles, Psychology and Behavioral Sciences Collection and the search engine (Google Scholar) using appropriate words for studies published from 2004 to 2014. This review follows the recommendations of the Statement for Reporting Systematic Reviews (PRISMA). Studies were included in the review if data on psychosocial validated assessment method(s) for the study population and specific medical evaluation of health-related work outcome(s) were presented. In total, the search strategy yielded 10,623 references, of which 10 studies (seven prospective cohort and three cross-sectional) met the inclusion criteria. Most studies (7/10) observed an adverse effect of poor psychosocial work factors on workers' health: 3 on sickness absence, 4 on cardiovascular diseases. The other 3 studies reported detrimental effects on sleep and on disease-associated biomarkers. A more consistent effect was observed in studies of higher methodological quality that used a prospective design jointly with the use of validated instruments for the assessment of the psychosocial (work) environment and clinical evaluation. More prospective studies are needed to assess the evidence of work-related psychosocial factors on workers´ health.

Evaluation of the CORDEX-Africa multi-RCM hindcast: systematic model errors

NASA Astrophysics Data System (ADS)

Kim, J.; Waliser, Duane E.; Mattmann, Chris A.; Goodale, Cameron E.; Hart, Andrew F.; Zimdars, Paul A.; Crichton, Daniel J.; Jones, Colin; Nikulin, Grigory; Hewitson, Bruce; Jack, Chris; Lennard, Christopher; Favre, Alice

2014-03-01

Monthly-mean precipitation, mean (TAVG), maximum (TMAX) and minimum (TMIN) surface air temperatures, and cloudiness from the CORDEX-Africa regional climate model (RCM) hindcast experiment are evaluated for model skill and systematic biases. All RCMs simulate basic climatological features of these variables reasonably, but systematic biases also occur across these models. All RCMs show higher fidelity in simulating precipitation for the west part of Africa than for the east part, and for the tropics than for northern Sahara. Interannual variation in the wet season rainfall is better simulated for the western Sahel than for the Ethiopian Highlands. RCM skill is higher for TAVG and TMAX than for TMIN, and regionally, for the subtropics than for the tropics. RCM skill in simulating cloudiness is generally lower than for precipitation or temperatures. For all variables, multi-model ensemble (ENS) generally outperforms individual models included in ENS. An overarching conclusion in this study is that some model biases vary systematically for regions, variables, and metrics, posing difficulties in defining a single representative index to measure model fidelity, especially for constructing ENS. This is an important concern in climate change impact assessment studies because most assessment models are run for specific regions/sectors with forcing data derived from model outputs. Thus, model evaluation and ENS construction must be performed separately for regions, variables, and metrics as required by specific analysis and/or assessments. Evaluations using multiple reference datasets reveal that cross-examination, quality control, and uncertainty estimates of reference data are crucial in model evaluations.

Constructing a Validity Argument for the Objective Structured Assessment of Technical Skills (OSATS): A Systematic Review of Validity Evidence

ERIC Educational Resources Information Center

Hatala, Rose; Cook, David A.; Brydges, Ryan; Hawkins, Richard

2015-01-01

In order to construct and evaluate the validity argument for the Objective Structured Assessment of Technical Skills (OSATS), based on Kane's framework, we conducted a systematic review. We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, Scopus, and selected reference lists through February 2013. Working in duplicate, we selected…

PRISM: Priority Symptom Management Project phase I: assessment.

PubMed

Ropka, M E; Spencer-Cisek, P

2001-01-01

To provide an overview of the process, goals, and outcome recommendations from the assessment phase of the Oncology Nursing Society's Priority Symptom Management (PRISM) project and to provide the foundation for a series of evidence-based practice and qualitative systematic review articles generated from the first phase of PRISM. Published articles, abstracts, and books; computerized databases; nonpublished research; personal communications; and proceedings of the PRISM summit meeting. Symptom management is a key component in quality cancer care. The assessment phase of PRISM yielded systematic reviews with an evidence-based framework to evaluate key symptoms, developed a framework for teaching and evaluating other symptoms, and recommended future ONS initiatives. Outcome recommendations from the PRISM summit targeted practice; professional and public education; research; and health policy. These activities provide background for subsequent evidence-based practice and qualitative systematic review articles that will focus on cancer symptom management.

Banxia Xiexin tang for gastro-oesophageal reflux disease: A protocol for a systematic review of controlled trials.

PubMed

Kang, Bohyung; Lee, Haesol; Choi, Youkyung; Jeon, Chanyong; Lee, Ju Ah

2018-04-01

Gastrooesophageal reflux disease (GORD) is one of the most common gastrointestinal diseases encountered in clinical practice. The aim of the present study is thus to systematically review the literature, including Asian studies, to assess the efficacy and safety of Banxia Xiexin tang (BXT) for the treatment of GORD. Eleven databases will be searched for studies conducted through March 2018. We will include randomized controlled trials (RCTs) of BXT as a treatment for GORD. All RCTs on BXT or related formulations will be included. The risk of bias will be assessed using the Cochrane Risk of Bias Assessment Tool, while confidence in the cumulative evidence will be evaluated using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) tool. This systematic review will be published in a peer-reviewed journal and will also be disseminated electronically and in print. The review will be updated to inform and guide healthcare practices. CRD42018087056.

Child maltreatment prevention: a systematic review of reviews.

PubMed

Mikton, Christopher; Butchart, Alexander

2009-05-01

To synthesize recent evidence from systematic and comprehensive reviews on the effectiveness of universal and selective child maltreatment prevention interventions, evaluate the methodological quality of the reviews and outcome evaluation studies they are based on, and map the geographical distribution of the evidence. A systematic review of reviews was conducted. The quality of the systematic reviews was evaluated with a tool for the assessment of multiple systematic reviews (AMSTAR), and the quality of the outcome evaluations was assessed using indicators of internal validity and of the construct validity of outcome measures. The review focused on seven main types of interventions: home visiting, parent education, child sex abuse prevention, abusive head trauma prevention, multi-component interventions, media-based interventions, and support and mutual aid groups. Four of the seven - home-visiting, parent education, abusive head trauma prevention and multi-component interventions - show promise in preventing actual child maltreatment. Three of them - home visiting, parent education and child sexual abuse prevention - appear effective in reducing risk factors for child maltreatment, although these conclusions are tentative due to the methodological shortcomings of the reviews and outcome evaluation studies they draw on. An analysis of the geographical distribution of the evidence shows that outcome evaluations of child maltreatment prevention interventions are exceedingly rare in low- and middle-income countries and make up only 0.6% of the total evidence base. Evidence for the effectiveness of four of the seven main types of interventions for preventing child maltreatment is promising, although it is weakened by methodological problems and paucity of outcome evaluations from low- and middle-income countries.

Rapid On-Site Evaluation of Fine-Needle Aspiration by Non-Cytopathologists: A Systematic Review and Meta-Analysis of Diagnostic Accuracy Studies for Adequacy Assessment.

PubMed

Pearson, Lauren; Factor, Rachel E; White, Sandra K; Walker, Brandon S; Layfield, Lester J; Schmidt, Robert L

2018-06-06

Rapid on-site evaluation (ROSE) has been shown to improve adequacy rates and reduce needle passes. ROSE is often performed by cytopathologists who have limited availability and may be costlier than alternatives. Several recent studies examined the use of alternative evaluators (AEs) for ROSE. A summary of this information could help inform guidelines regarding the use of AEs. The objective was to assess the accuracy of AEs compared to cytopathologists in assessing the adequacy of specimens during ROSE. This was a systematic review and meta-analysis. Reporting and study quality were assessed using the STARD guidelines and QUADAS-2. All steps were performed independently by two evaluators. Summary estimates were obtained using the hierarchal method in Stata v14. Heterogeneity was evaluated using Higgins' I2 statistic. The systematic review identified 13 studies that were included in the meta-analysis. Summary estimates of sensitivity and specificity for AEs were 97% (95% CI: 92-99%) and 83% (95% CI: 68-92%). There was wide variation in accuracy statistics between studies (I2 = 0.99). AEs sometimes have accuracy that is close to cytopathologists. However, there is wide variability between studies, so it is not possible to provide a broad guideline regarding the use of AEs. © 2018 S. Karger AG, Basel.

A systematic review of model-based economic evaluations of diagnostic and therapeutic strategies for lower extremity artery disease.

PubMed

Vaidya, Anil; Joore, Manuela A; ten Cate-Hoek, Arina J; Kleinegris, Marie-Claire; ten Cate, Hugo; Severens, Johan L

2014-01-01

Lower extremity artery disease (LEAD) is a sign of wide spread atherosclerosis also affecting coronary, cerebral and renal arteries and is associated with increased risk of cardiovascular events. Many economic evaluations have been published for LEAD due to its clinical, social and economic importance. The aim of this systematic review was to assess modelling methods used in published economic evaluations in the field of LEAD. Our review appraised and compared the general characteristics, model structure and methodological quality of published models. Electronic databases MEDLINE and EMBASE were searched until February 2013 via OVID interface. Cochrane database of systematic reviews, Health Technology Assessment database hosted by National Institute for Health research and National Health Services Economic Evaluation Database (NHSEED) were also searched. The methodological quality of the included studies was assessed by using the Philips' checklist. Sixteen model-based economic evaluations were identified and included. Eleven models compared therapeutic health technologies; three models compared diagnostic tests and two models compared a combination of diagnostic and therapeutic options for LEAD. Results of this systematic review revealed an acceptable to low methodological quality of the included studies. Methodological diversity and insufficient information posed a challenge for valid comparison of the included studies. In conclusion, there is a need for transparent, methodologically comparable and scientifically credible model-based economic evaluations in the field of LEAD. Future modelling studies should include clinically and economically important cardiovascular outcomes to reflect the wider impact of LEAD on individual patients and on the society.

The baby or the bath water? Lessons learned from the National Action Alliance for Suicide Prevention Research Prioritization Task Force literature review.

PubMed

Davis Molock, Sherry; Heekin, Janet M; Matlin, Samantha G; Barksdale, Crystal L; Gray, Ekwenzi; Booth, Chelsea L

2014-09-01

The Research Prioritization Task Force of the National Action Alliance for Suicide Prevention conducted a comprehensive literature review of suicide prevention/intervention trials to assess the quality of the scientific evidence. A literature "review of reviews" was conducted by searching the most widely used databases for mental health and public health research. The quality of the reviews was evaluated using the Revised Assessment of Multiple Systematic Reviews system; the quality of the scientific evidence for the suicide preventions/interventions was assessed using U.S. Preventive Services Task Force criteria. The reviews were limited to peer-reviewed publications with human subjects published in English. Ninety-eight systematic reviews and 45 primary sources on suicide prevention/interventions published between January 2000 and September 2012 were evaluated. The results suggest that the quality of both the systematic reviews and the scientific evidence for suicide preventions/interventions were mixed. The majority of the systematic reviews and prevention/interventions were evaluated as fair to poor in quality. There are many promising suicide prevention/intervention trials, but research findings are often inconclusive because of methodologic problems. Methodologic problems across systematic reviews include not conducting hand searches, not surveying gray literature, and being unable to aggregate data across studies. Methodologic problems with the scientific quality of the prevention/intervention trials include paucity of information on sample demographic characteristics, poorly defined outcomes, and excluding actively suicidal participants. Suggestions for ways to improve the quality of the systematic reviews and suicide preventions/interventions are provided. Copyright © 2014 American Journal of Preventive Medicine. All rights reserved.

Dental Students' Use of AMSTAR to Critically Appraise Systematic Reviews.

PubMed

Teich, Sorin T; Heima, Masahiro; Lang, Lisa

2015-09-01

The idea of basing clinical procedures upon evidence gathered by observation is less than 200 years old, with the first set of evidence-based position papers dating back only to the early 1970s. The relationship between evidence-based education and health outcomes is difficult to test and may be indirect, but teaching critical appraisal skills may be beneficial in developing knowledge. Systematic reviews have a central role in the process of clinical decision making in practice and therefore should be of high quality, following a rigorous protocol that can be evaluated with validated tools. The aim of this study was to assess how dental students utilized the Assessment of Multiple Systematic Reviews (AMSTAR) appraisal tool to evaluate systematic reviews in the context of a treatment planning course. During the in-class final exam, students were required to appraise the quality of a systematic review and to justify their answers. Of the 74 third-year students who took the exam, 100% answered all questions on the AMSTAR form. The mean number of correct answers was nine (SD=1.047, Min=6, Max=10), with no student providing all 11 correct answers. The fact that nearly 90% of the students provided eight or more correct answers suggests that AMSTAR can be used by students to evaluate the methodological quality of systematic reviews. It also was evident that although the AMSTAR tool requires less than 15 minutes to complete an evaluation, using it requires extensive training and repetition to achieve consistent and reliable results.

Towards a Better Understanding of the Legibility Bias in Performance Assessments: The Case of Gender-Based Inferences

ERIC Educational Resources Information Center

Greifeneder, Rainer; Zelt, Sarah; Seele, Tim; Bottenberg, Konstantin; Alt, Alexander

2012-01-01

Background: Handwriting legibility systematically biases evaluations in that highly legible handwriting results in more positive evaluations than less legible handwriting. Because performance assessments in educational contexts are not only based on computerized or multiple choice tests but often include the evaluation of handwritten work samples,…

SYSTEMATIC PROCEDURE FOR DESIGNING PROCESSES WITH MULTIPLE ENVIRONMENTAL OBJECTIVES

EPA Science Inventory

Evaluation of multiple objectives is very important in designing environmentally benign processes. It requires a systematic procedure for solving multiobjective decision-making problems, due to the complex nature of the problems, the need for complex assessments, and complicated ...

Systematic review and meta-analysis of the performance of clinical risk assessment instruments for screening for osteoporosis or low bone density

PubMed Central

Edwards, D. L.; Saleh, A. A.; Greenspan, S. L.

2015-01-01

Summary We performed a systematic review and meta-analysis of the performance of clinical risk assessment instruments for screening for DXA-determined osteoporosis or low bone density. Commonly evaluated risk instruments showed high sensitivity approaching or exceeding 90 % at particular thresholds within various populations but low specificity at thresholds required for high sensitivity. Simpler instruments, such as OST, generally performed as well as or better than more complex instruments. Introduction The purpose of the study is to systematically review the performance of clinical risk assessment instruments for screening for dual-energy X-ray absorptiometry (DXA)-determined osteoporosis or low bone density. Methods Systematic review and meta-analysis were performed. Multiple literature sources were searched, and data extracted and analyzed from included references. Results One hundred eight references met inclusion criteria. Studies assessed many instruments in 34 countries, most commonly the Osteoporosis Self-Assessment Tool (OST), the Simple Calculated Osteoporosis Risk Estimation (SCORE) instrument, the Osteoporosis Self-Assessment Tool for Asians (OSTA), the Osteoporosis Risk Assessment Instrument (ORAI), and body weight criteria. Meta-analyses of studies evaluating OST using a cutoff threshold of <1 to identify US postmenopausal women with osteoporosis at the femoral neck provided summary sensitivity and specificity estimates of 89 % (95%CI 82–96 %) and 41 % (95%CI 23–59 %), respectively. Meta-analyses of studies evaluating OST using a cutoff threshold of 3 to identify US men with osteoporosis at the femoral neck, total hip, or lumbar spine provided summary sensitivity and specificity estimates of 88 % (95%CI 79–97 %) and 55 % (95%CI 42–68 %), respectively. Frequently evaluated instruments each had thresholds and populations for which sensitivity for osteoporosis or low bone mass detection approached or exceeded 90 % but always with a trade-off of relatively low specificity. Conclusions Commonly evaluated clinical risk assessment instruments each showed high sensitivity approaching or exceeding 90 % for identifying individuals with DXA-determined osteoporosis or low BMD at certain thresholds in different populations but low specificity at thresholds required for high sensitivity. Simpler instruments, such as OST, generally performed as well as or better than more complex instruments. PMID:25644147

Interventions for preventing mother-to-child HIV transmission: protocol of an overview of systematic reviews.

PubMed

Wariki, Windy Mariane Virenia; Ota, Erika; Mori, Rintaro; Wiysonge, Charles S; Horvath, Hacsi; Read, Jennifer S

2017-06-21

Various interventions to prevent mother-to-child-transmission (MTCT) of HIV have been investigated and implemented. A number of systematic reviews assessing the efficacy of interventions for the prevention of MTCT of HIV reported antiretroviral prophylaxis, caesarean section before labour and before ruptured membranes, and complete avoidance of breastfeeding were efficacious for preventing MTCT of HIV. Recent WHO guidelines recommend lifelong antiretroviral therapy for all pregnant women for treatment of the woman's own HIV infection and for prevention of MTCT of HIV. Therefore, the objective of this overview is to evaluate the currently available systematic reviews of interventions for preventing MTCT of HIV, and to identify the current best evidence-based interventions for reducing the risk of MTCT of HIV. We will include only peer-reviewed systematic reviews of randomised or quasi-randomised controlled trials assessing the effects of interventions for preventing MTCT of HIV that target both HIV-infected women and children aged 2 years and younger born to HIV-infected women. We will search the Cochrane Database of Systematic Reviews, the Database of Abstracts of Reviews of Effectiveness, Ovid MEDLINE and EMBASE. We will assess review eligibility, the methodological quality of included systematic reviews using A Measurement Tool to Assess The Systematic Reviews and will extract data, comparing our results and resolving discrepancies by consensus. Finally, we will independently assess the certainty of the evidence using Grades of Recommendation, Assessment, Development and Evaluation. Ethics approval is not required. We will publish the results in a peer-reviewed journal and present at conferences, which will inform future research and will be useful for healthcare managers, administrators and policymakers to guide resource allocation decisions and optimisation of interventions to prevent the MTCT of HIV. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Diagnosing Alzheimer's disease: a systematic review of economic evaluations.

PubMed

Handels, Ron L H; Wolfs, Claire A G; Aalten, Pauline; Joore, Manuela A; Verhey, Frans R J; Severens, Johan L

2014-03-01

The objective of this study is to systematically review the literature on economic evaluations of interventions for the early diagnosis of Alzheimer's disease (AD) and related disorders and to describe their general and methodological characteristics. We focused on the diagnostic aspects of the decision models to assess the applicability of existing decision models for the evaluation of the recently revised diagnostic research criteria for AD. PubMed and the National Institute for Health Research Economic Evaluation database were searched for English-language publications related to economic evaluations on diagnostic technologies. Trial-based economic evaluations were assessed using the Consensus on Health Economic Criteria list. Modeling studies were assessed using the framework for quality assessment of decision-analytic models. The search retrieved 2109 items, from which eight decision-analytic modeling studies and one trial-based economic evaluation met all eligibility criteria. Diversity among the study objective and characteristics was considerable and, despite considerable methodological quality, several flaws were indicated. Recommendations were focused on diagnostic aspects and the applicability of existing models for the evaluation of recently revised diagnostic research criteria for AD. Copyright © 2014 The Alzheimer's Association. Published by Elsevier Inc. All rights reserved.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Non-Surgical Interventions for Adolescents with Idiopathic Scoliosis: An Overview of Systematic Reviews

PubMed Central

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Background Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Objectives Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Design Systematic overview of systematic reviews. Methods Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute’s hierarchies were applied to analyze the levels of evidence from included reviews. Results From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Conclusions Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. Protocol registry number CRD42013003538, PROSPERO PMID:25353954

Non-surgical interventions for adolescents with idiopathic scoliosis: an overview of systematic reviews.

PubMed

Płaszewski, Maciej; Bettany-Saltikov, Josette

2014-01-01

Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available. Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis. Systematic overview of systematic reviews. Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute's hierarchies were applied to analyze the levels of evidence from included reviews. From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established. Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence. CRD42013003538, PROSPERO.

Functional Assessments Used by Occupational Therapists with Older Adults at Risk of Activity and Participation Limitations: A Systematic Review

PubMed Central

Wales, Kylie; Clemson, Lindy; Lannin, Natasha; Cameron, Ian

2016-01-01

Introduction The use of functional assessments to evaluate patient change is complicated by a lack of consensus as to which assessment is most suitable for use with older adults. Objective: To identify and appraise the properties of assessments used to evaluate functional abilities in older adults. Methods A systematic review of randomised controlled trials of occupational therapy interventions was conducted up to 2012 to identify assessments used to measure function. Two authors screened and extracted data independently. A second search then identified papers investigating measurement properties of each assessment. Studies from the second search were included if: i) published in English, ii) the assessment was not modified from its original published form, iii) study aim was to evaluate the quality of the tool, iv) and was original research. Translated versions of assessments were excluded. Measurement quality was rated using the COSMIN checklist and Terwee criteria. Results Twenty-eight assessments were identified from the systematic search of occupational therapy interventions provided to older adults. Assessments were of varied measurement quality and many had been adapted (although still evaluated as though the original tool had been administered) potentially altering the conclusions drawn about measurement quality. Synthesis of best evidence established 15 functional assessments have not been tested in an older adult population. Conclusions The Functional Autonomy Measurement System (SMAF) appears to be a promising assessment for use with older adults. Only two tools (the SMAF and the Assessment of Motor and Process Skills (AMPS)) were deemed to be responsive to change when applied to older adults. Health professionals should use functional assessments that have been validated with their population and in their setting. There are reliable and valid assessments to capture the functional performance of older adults in community and hospital settings, although further refinement of these assessments may be necessary. PMID:26859678

Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: a systematic map.

PubMed

Daigneault, Pierre-Marc

2014-08-01

Stakeholder participation and evaluation use have attracted a lot of attention from practitioners, theorists and researchers. A common hypothesis is that participation is positively associated with evaluation use. Whereas the number of empirical studies conducted on this topic is impressive, quantitative research has held a minority position within this scientific production. This study mobilizes systematic review methods to 'map' the empirical literature that has quantitatively studied participation and use. The goal is to take stock and assess the strength of evidence of this literature (but not to synthesize the findings) and, based on this assessment, to provide directions for future research. Copyright © 2014 Elsevier Ltd. All rights reserved.

Measurement properties of instruments evaluating self-care and related concepts in people with chronic obstructive pulmonary disease: A systematic review.

PubMed

Clari, Marco; Matarese, Maria; Alvaro, Rosaria; Piredda, Michela; De Marinis, Maria Grazia

2016-01-01

The use of valid and reliable instruments for assessing self-care is crucial for the evaluation of chronic obstructive pulmonary disease (COPD) management programs. The aim of this review is to evaluate the measurement properties and theoretical foundations of instruments for assessing self-care and related concepts in people with COPD. A systematic review was conducted of articles describing the development and validation of self-care instruments. The methodological quality of the measurement properties was assessed using the COSMIN checklist. Ten studies were included evaluating five instruments: three for assessing self-care and self-management and two for assessing self-efficacy. The COPD Self-Efficacy Scale was the most studied instrument, but due to poor study methodological quality, evidence about its measurement properties is inconclusive. Evidence from the COPD Self-Management Scale is more promising, but only one study tested its properties. Due to inconclusive evidence of their measurement properties, no instrument can be recommended for clinical use. Copyright © 2016 Elsevier Inc. All rights reserved.

The reliability of physical examination tests for the diagnosis of anterior cruciate ligament rupture--A systematic review.

PubMed

Lange, Toni; Freiberg, Alice; Dröge, Patrik; Lützner, Jörg; Schmitt, Jochen; Kopkow, Christian

2015-06-01

Systematic literature review. Despite their frequent application in routine care, a systematic review on the reliability of clinical examination tests to evaluate the integrity of the ACL is missing. To summarize and evaluate intra- and interrater reliability research on physical examination tests used for the diagnosis of ACL tears. A comprehensive systematic literature search was conducted in MEDLINE, EMBASE and AMED until May 30th 2013. Studies were included if they assessed the intra- and/or interrater reliability of physical examination tests for the integrity of the ACL. Methodological quality was evaluated with the Quality Appraisal of Reliability Studies (QAREL) tool by two independent reviewers. 110 hits were achieved of which seven articles finally met the inclusion criteria. These studies examined the reliability of four physical examination tests. Intrarater reliability was assessed in three studies and ranged from fair to almost perfect (Cohen's k = 0.22-1.00). Interrater reliability was assessed in all included studies and ranged from slight to almost perfect (Cohen's k = 0.02-0.81). The Lachman test is the physical tests with the highest intrarater reliability (Cohen's k = 1.00), the Lachman test performed in prone position the test with the highest interrater reliability (Cohen's k = 0.81). Included studies were partly of low methodological quality. A meta-analysis could not be performed due to the heterogeneity in study populations, reliability measures and methodological quality of included studies. Systematic investigations on the reliability of physical examination tests to assess the integrity of the ACL are scarce and of varying methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

Aromatherapy for managing menopausal symptoms: A protocol for systematic review and meta-analysis.

PubMed

Choi, Jiae; Lee, Hye Won; Lee, Ju Ah; Lim, Hyun-Ja; Lee, Myeong Soo

2018-02-01

Aromatherapy is often used as a complementary therapy for women's health. This systematic review aims to evaluate the therapeutic effects of aromatherapy as a management for menopausal symptoms. Eleven electronic databases will be searched from inception to February 2018. Randomized controlled trials that evaluated any type of aromatherapy against any type of control in individuals with menopausal symptoms will be eligible. The methodological quality will be assessed using the Cochrane risk of bias tool. Two authors will independently assess each study for eligibility and risk of bias and to extract data. This study will provide a high quality synthesis of current evidence of aromatherapy for menopausal symptoms measured with Menopause Rating Scale, the Kupperman Index, the Greene Climacteric Scale, or other validated questionnaires. The conclusion of our systematic review will provide evidence to judge whether aromatherapy is an effective intervention for patient with menopausal women. Ethical approval will not be required, given that this protocol is for a systematic review. The systematic review will be published in a peer-reviewed journal. The review will also be disseminated electronically and in print. PROSPERO CRD42017079191.

Core Professionalism Education in Surgery: A Systematic Review

PubMed Central

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-01-01

Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable. PMID:29553464

A SYSTEMATIC PROCEDURE FOR DESIGNING PROCESSES WITH MULTIPLE ENVIRONMENTAL OBJECTIVES

EPA Science Inventory

Evaluation and analysis of multiple objectives are very important in designing environmentally benign processes. They require a systematic procedure for solving multi-objective decision-making problems due to the complex nature of the problems and the need for complex assessment....

Psychometric Properties of Language Assessments for Children Aged 4–12 Years: A Systematic Review

PubMed Central

Denman, Deborah; Speyer, Renée; Munro, Natalie; Pearce, Wendy M.; Chen, Yu-Wei; Cordier, Reinie

2017-01-01

Introduction: Standardized assessments are widely used by speech pathologists in clinical and research settings to evaluate the language abilities of school-aged children and inform decisions about diagnosis, eligibility for services and intervention. Given the significance of these decisions, it is important that assessments have sound psychometric properties. Objective: The aim of this systematic review was to examine the psychometric quality of currently available comprehensive language assessments for school-aged children and identify assessments with the best evidence for use. Methods: Using the PRISMA framework as a guideline, a search of five databases and a review of websites and textbooks was undertaken to identify language assessments and published material on the reliability and validity of these assessments. The methodological quality of selected studies was evaluated using the COSMIN taxonomy and checklist. Results: Fifteen assessments were evaluated. For most assessments evidence of hypothesis testing (convergent and discriminant validity) was identified; with a smaller number of assessments having some evidence of reliability and content validity. No assessments presented with evidence of structural validity, internal consistency or error measurement. Overall, all assessments were identified as having limitations with regards to evidence of psychometric quality. Conclusions: Further research is required to provide good evidence of psychometric quality for currently available language assessments. Of the assessments evaluated, the Assessment of Literacy and Language, the Clinical Evaluation of Language Fundamentals-5th Edition, the Clinical Evaluation of Language Fundamentals-Preschool: 2nd Edition and the Preschool Language Scales-5th Edition presented with most evidence and are thus recommended for use. PMID:28936189

Prevention and assessment of infectious diseases among children and adult migrants arriving to the European Union/European Economic Association: a protocol for a suite of systematic reviews for public health and health systems

PubMed Central

Mayhew, Alain D; Morton, Rachael L; Greenaway, Christina; Akl, Elie A; Rahman, Prinon; Zenner, Dominik; Pareek, Manish; Tugwell, Peter; Welch, Vivian; Meerpohl, Joerg; Alonso-Coello, Pablo; Hui, Charles; Biggs, Beverley-Ann; Requena-Méndez, Ana; Agbata, Eric; Noori, Teymur; Schünemann, Holger J

2017-01-01

Introduction The European Centre for Disease Prevention and Control is developing evidence-based guidance for voluntary screening, treatment and vaccine prevention of infectious diseases for newly arriving migrants to the European Union/European Economic Area. The objective of this systematic review protocol is to guide the identification, appraisal and synthesis of the best available evidence on prevention and assessment of the following priority infectious diseases: tuberculosis, HIV, hepatitis B, hepatitis C, measles, mumps, rubella, diphtheria, tetanus, pertussis, poliomyelitis (polio), Haemophilus influenza disease, strongyloidiasis and schistosomiasis. Methods and analysis The search strategy will identify evidence from existing systematic reviews and then update the effectiveness and cost-effectiveness evidence using prospective trials, economic evaluations and/or recently published systematic reviews. Interdisciplinary teams have designed logic models to help define study inclusion and exclusion criteria, guiding the search strategy and identifying relevant outcomes. We will assess the certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. Ethics and dissemination There are no ethical or safety issues. We anticipate disseminating the findings through open-access publications, conference abstracts and presentations. We plan to publish technical syntheses as GRADEpro evidence summaries and the systematic reviews as part of a special edition open-access publication on refugee health. We are following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Protocols reporting guideline. This protocol is registered in PROSPERO: CRD42016045798. PMID:28893741

Child maltreatment prevention: a systematic review of reviews

PubMed Central

Butchart, Alexander

2009-01-01

Abstract Objective To synthesize recent evidence from systematic and comprehensive reviews on the effectiveness of universal and selective child maltreatment prevention interventions, evaluate the methodological quality of the reviews and outcome evaluation studies they are based on, and map the geographical distribution of the evidence. Methods A systematic review of reviews was conducted. The quality of the systematic reviews was evaluated with a tool for the assessment of multiple systematic reviews (AMSTAR), and the quality of the outcome evaluations was assessed using indicators of internal validity and of the construct validity of outcome measures. Findings The review focused on seven main types of interventions: home visiting, parent education, child sex abuse prevention, abusive head trauma prevention, multi-component interventions, media-based interventions, and support and mutual aid groups. Four of the seven – home-visiting, parent education, abusive head trauma prevention and multi-component interventions – show promise in preventing actual child maltreatment. Three of them – home visiting, parent education and child sexual abuse prevention – appear effective in reducing risk factors for child maltreatment, although these conclusions are tentative due to the methodological shortcomings of the reviews and outcome evaluation studies they draw on. An analysis of the geographical distribution of the evidence shows that outcome evaluations of child maltreatment prevention interventions are exceedingly rare in low- and middle-income countries and make up only 0.6% of the total evidence base. Conclusion Evidence for the effectiveness of four of the seven main types of interventions for preventing child maltreatment is promising, although it is weakened by methodological problems and paucity of outcome evaluations from low- and middle-income countries. PMID:19551253

User Experience Evaluations in Rehabilitation Video Games for Children: A Systematic Mapping of the Literature.

PubMed

Rico-Olarte, Carolina; López, Diego M; Blobel, Bernd; Kepplinger, Sara

2017-01-01

In recent years, the interest in user experience (UX) evaluation methods for assessing technology solutions, especially in health systems for children with special needs like cognitive disabilities, has increased. Conduct a systematic mapping study to provide an overview in the field of UX evaluations in rehabilitation video games for children. The definition of research questions, the search for primary studies and the extraction of those studies by inclusion and exclusion criteria lead to the mapping of primary papers according to a classification scheme. Main findings from this study include the detection of the target population of the selected studies, the recognition of two different ways of evaluating UX: (i) user evaluation and (ii) system evaluation, and UX measurements and devices used. This systematic mapping specifies the research gaps identified for future research works in the area.

Systematic Planning for Educational Facilities.

ERIC Educational Resources Information Center

McGuffey, Carroll W.

This monograph provides a systematic approach to the problem of planning educational facilities. It first presents a conceptual framework for a general facilities planning and management system called Facilities Resource Allocation Management Evaluation System (FRAMES). The main components of FRAMES are identified as: (1) needs assessment, (2)…

Dietary Change Interventions for Undergraduate Populations: Systematic Review and Recommendations

ERIC Educational Resources Information Center

Pember, Sarah E.; Knowlden, Adam P.

2017-01-01

Background: Research demonstrates a decline in healthy eating behaviors during transitional years at university, potentially leading to weight gain and establishing maladaptive dietary habits. Purpose: This systematic review assessed the efficacy of previous nutrition interventions for undergraduates, evaluating design and implementation. Methods:…

Recommended guide for next generation of transportation design build procurement and contracting in the state of Georgia.

DOT National Transportation Integrated Search

2012-09-01

The overall objective of this research project is to develop a systematic approach that evaluates the appropriateness of Design Build Project Delivery System for a transportation project. State DOTs can benefit from this systematic assessment approac...

Evaluation Studies of Robotic Rollators by the User Perspective: A Systematic Review.

PubMed

Werner, Christian; Ullrich, Phoebe; Geravand, Milad; Peer, Angelika; Hauer, Klaus

2016-01-01

Robotic rollators enhance the basic functions of established devices by technically advanced physical, cognitive, or sensory support to increase autonomy in persons with severe impairment. In the evaluation of such ambient assisted living solutions, both the technical and user perspectives are important to prove usability, effectiveness and safety, and to ensure adequate device application. The aim of this systematic review is to summarize the methodology of studies evaluating robotic rollators with focus on the user perspective and to give recommendations for future evaluation studies. A systematic literature search up to December 31, 2014, was conducted based on the Cochrane Review methodology using the electronic databases PubMed and IEEE Xplore. Articles were selected according to the following inclusion criteria: evaluation studies of robotic rollators documenting human-robot interaction, no case reports, published in English language. Twenty-eight studies were identified that met the predefined inclusion criteria. Large heterogeneity in the definitions of the target user group, study populations, study designs and assessment methods was found across the included studies. No generic methodology to evaluate robotic rollators could be identified. We found major methodological shortcomings related to insufficient sample descriptions and sample sizes, and lack of appropriate, standardized and validated assessment methods. Long-term use in habitual environment was also not evaluated. Apart from the heterogeneity, methodological deficits in most of the identified studies became apparent. Recommendations for future evaluation studies include: clear definition of target user group, adequate selection of subjects, inclusion of other assistive mobility devices for comparison, evaluation of the habitual use of advanced prototypes, adequate assessment strategy with established, standardized and validated methods, and statistical analysis of study results. Assessment strategies may additionally focus on specific functionalities of the robotic rollators allowing an individually tailored assessment of innovative features to document their added value. © 2016 S. Karger AG, Basel.

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

"Assessing the methodological quality of systematic reviews in radiation oncology: A systematic review".

PubMed

Hasan, Haroon; Muhammed, Taaha; Yu, Jennifer; Taguchi, Kelsi; Samargandi, Osama A; Howard, A Fuchsia; Lo, Andrea C; Olson, Robert; Goddard, Karen

2017-10-01

The objective of our study was to evaluate the methodological quality of systematic reviews and meta-analyses in Radiation Oncology. A systematic literature search was conducted for all eligible systematic reviews and meta-analyses in Radiation Oncology from 1966 to 2015. Methodological characteristics were abstracted from all works that satisfied the inclusion criteria and quality was assessed using the critical appraisal tool, AMSTAR. Regression analyses were performed to determine factors associated with a higher score of quality. Following exclusion based on a priori criteria, 410 studies (157 systematic reviews and 253 meta-analyses) satisfied the inclusion criteria. Meta-analyses were found to be of fair to good quality while systematic reviews were found to be of less than fair quality. Factors associated with higher scores of quality in the multivariable analysis were including primary studies consisting of randomized control trials, performing a meta-analysis, and applying a recommended guideline related to establishing a systematic review protocol and/or reporting. Systematic reviews and meta-analyses may introduce a high risk of bias if applied to inform decision-making based on AMSTAR. We recommend that decision-makers in Radiation Oncology scrutinize the methodological quality of systematic reviews and meta-analyses prior to assessing their utility to inform evidence-based medicine and researchers adhere to methodological standards outlined in validated guidelines when embarking on a systematic review. Copyright © 2017 Elsevier Ltd. All rights reserved.

Pain assessment for people with dementia: a systematic review of systematic reviews of pain assessment tools.

PubMed

Lichtner, Valentina; Dowding, Dawn; Esterhuizen, Philip; Closs, S José; Long, Andrew F; Corbett, Anne; Briggs, Michelle

2014-12-17

There is evidence of under-detection and poor management of pain in patients with dementia, in both long-term and acute care. Accurate assessment of pain in people with dementia is challenging and pain assessment tools have received considerable attention over the years, with an increasing number of tools made available. Systematic reviews on the evidence of their validity and utility mostly compare different sets of tools. This review of systematic reviews analyses and summarises evidence concerning the psychometric properties and clinical utility of pain assessment tools in adults with dementia or cognitive impairment. We searched for systematic reviews of pain assessment tools providing evidence of reliability, validity and clinical utility. Two reviewers independently assessed each review and extracted data from them, with a third reviewer mediating when consensus was not reached. Analysis of the data was carried out collaboratively. The reviews were synthesised using a narrative synthesis approach. We retrieved 441 potentially eligible reviews, 23 met the criteria for inclusion and 8 provided data for extraction. Each review evaluated between 8 and 13 tools, in aggregate providing evidence on a total of 28 tools. The quality of the reviews varied and the reporting often lacked sufficient methodological detail for quality assessment. The 28 tools appear to have been studied in a variety of settings and with varied types of patients. The reviews identified several methodological limitations across the original studies. The lack of a 'gold standard' significantly hinders the evaluation of tools' validity. Most importantly, the samples were small providing limited evidence for use of any of the tools across settings or populations. There are a considerable number of pain assessment tools available for use with the elderly cognitive impaired population. However there is limited evidence about their reliability, validity and clinical utility. On the basis of this review no one tool can be recommended given the existing evidence.

Impact of ambient temperature on morbidity and mortality: An overview of reviews.

PubMed

Song, Xuping; Wang, Shigong; Hu, Yuling; Yue, Man; Zhang, Tingting; Liu, Yu; Tian, Jinhui; Shang, Kezheng

2017-05-15

The objectives were (i) to conduct an overview of systematic reviews to summarize evidence from and evaluate the methodological quality of systematic reviews assessing the impact of ambient temperature on morbidity and mortality; and (ii) to reanalyse meta-analyses of cold-induced cardiovascular morbidity in different age groups. The registration number is PROSPERO-CRD42016047179. PubMed, Embase, the Cochrane Library, Web of Science, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Global Health were systematically searched to identify systematic reviews. Two reviewers independently selected studies for inclusion, extracted data, and assessed quality. The Assessment of Multiple Systematic Reviews (AMSTAR) checklist was used to assess the methodological quality of included systematic reviews. Estimates of morbidity and mortality risk in association with heat exposure, cold exposure, heatwaves, cold spells and diurnal temperature ranges (DTRs) were the primary outcomes. Twenty-eight systematic reviews were included in the overview of systematic reviews. (i) The median (interquartile range) AMSTAR scores were 7 (1.75) for quantitative reviews and 3.5 (1.75) for qualitative reviews. (ii) Heat exposure was identified to be associated with increased risk of cardiovascular, cerebrovascular and respiratory mortality, but was not found to have an impact on cardiovascular or cerebrovascular morbidity. (iii) Reanalysis of the meta-analyses indicated that cold-induced cardiovascular morbidity increased in youth and middle-age (RR=1.009, 95% CI: 1.004-1.015) as well as the elderly (RR=1.013, 95% CI: 1.007-1.018). (iv) The definitions of temperature exposure adopted by different studies included various temperature indicators and thresholds. In conclusion, heat exposure seemed to have an adverse effect on mortality and cold-induced cardiovascular morbidity increased in the elderly. Developing definitions of temperature exposure at the regional level may contribute to more accurate evaluations of the health effects of temperature. Copyright © 2017 Elsevier B.V. All rights reserved.

Knee ultrasound from research to real practice: a systematic literature review of adult knee ultrasound assessment feasibility studies.

PubMed

Peltea, Alexandra; Berghea, Florian; Gudu, Tania; Ionescu, Ruxandra

2016-12-05

To identify and analyse existing data regarding knee ultrasound (US) feasibility in clinical practice. Material and methods: A systematic literature review was performed using the terms: ("knee") AND ("ultrasound" OR "ultrasonography") AND ("feasibility" OR "pilot" OR "proof of concept"). Feasibility studies regarding knee US or US aided maneuver involving knee joint, published during 2005-2015, were selected and evaluated against a complex framework constructed around mandatory key areas for feasibility studies: acceptability, demand, implementation, practicality, adaptation, integration and expansion. One hundred and fifty-nine publications were identified, of which 9 were included in the final analysis: 6 dealt with the development and implementation of novel US scores, while the rest focused on implementing MSUS in clinical practice, evaluating the usefulness of articular cartilage US assessment and the feasibility of sonography for intra-articular knee injections, respectively. Six studies quantified feasibility as time spent for the evaluation, with only two addressing areassuch as acceptability, implementation and practicality, although none of these systematically assessed all feasibility domains. Knee US feasibility is still poorly addressed; the time required for US assessment is the main area addressed. This information gap should be properly addressed in future works, in order to ensure the right place for this technique.

Speech and language interventions for infants aged 0 to 2 years at high risk for cerebral palsy: a systematic review

PubMed Central

Chorna, Olena; Hamm, Ellyn; Cummings, Caitlin; Fetters, Ashley; Maitre, Nathalie L

2017-01-01

Aim We evaluated the level of evidence of speech, language, and communication interventions for infants at high-risk for, or with a diagnosis of, cerebral palsy (CP) from 0 to 2 years old. Method We performed a systematic review of relevant terms. Articles were evaluated based on the level of methodological quality and evidence according to A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidelines. Results The search terms provided 17 publications consisting of speech or language interventions. There were no interventions in the high level of evidence category. The overall level of evidence was very low. Promising interventions included Responsivity and Prelinguistic Milieu Teaching and other parent–infant transaction frameworks. Interpretation There are few evidence-based interventions addressing speech, language, and communication needs of infants and toddlers at high risk for CP, and none for infants diagnosed with CP. Recommendation guidelines include parent–infant transaction programs. PMID:27897320

Economic evidence for the prevention and treatment of atopic eczema: a protocol for a systematic review.

PubMed

Sach, Tracey Helen; McManus, Emma; Mcmonagle, Christopher; Levell, Nick

2016-05-27

Eczema, synonymous with atopic eczema or atopic dermatitis, is a chronic skin disease that has a similar impact on health-related quality of life as other chronic diseases. The proposed research aims to provide a comprehensive systematic assessment of the economic evidence base available to inform economic modelling and decision making on interventions to prevent and treat eczema at any stage of the life course. Whilst the Global Resource of Eczema Trials (GREAT) database collects together the effectiveness evidence for eczema, there is currently no such systematic resource on the economics of eczema. It is important to gain an overview of the current state of the art of economic methods in the field of eczema in order to strengthen the economic evidence base further. The proposed study is a systematic review of the economic evidence surrounding interventions for the prevention and treatment of eczema. Relevant search terms will be used to search MEDLINE, EMBASE, Database of Abstracts of Reviews of Effects, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, National Health Service (NHS) Economic Evaluation Database, Health Technology Assessment, Cumulative Index to Nursing and Allied Health Literature, EconLit, Scopus, Cost-Effectiveness Analysis Registry and Web of Science in order to identify relevant evidence. To be eligible for inclusion studies will be primary empirical studies evaluating the cost, utility or full economic evaluation of interventions for preventing or treating eczema. Two reviewers will independently assess studies for eligibility and perform data abstraction. Evidence tables will be produced presenting details of study characteristics, costing methods, outcome methods and quality assessment. The methodological quality of studies will be assessed using accepted checklists. The systematic review is being undertaken to identify the type of economic evidence available, summarise the results of the available economic evidence and critically appraise the quality of economic evidence currently available to inform future economic modelling and resource allocation decisions about interventions to prevent or treat eczema. We aim to use the review to offer guidance about how to gather economic evidence in studies of eczema and/or what further research is necessary in order to inform this. PROSPERO CRD42015024633.

A narrative meta-review of a series of systematic and meta-analytic reviews on the intervention outcome for children with developmental co-ordination disorder.

PubMed

Miyahara, M; Lagisz, M; Nakagawa, S; Henderson, S E

2017-09-01

Systematic reviews and meta-analyses are considered to be the 'gold standards' for synthesizing research evidence in particular areas of enquiry. However, such reviews are only useful if they themselves are conducted to a sufficiently high standard. The aim of this study was to conduct a narrative meta-review of existing analyses of the effectiveness of interventions designed for children with developmental co-ordination disorder (DCD). A narrative meta-review of systematic and meta-analytic reviews aimed at evaluating the effectiveness of intervention for children with DCD was conducted on studies published between 1950 and 2014. We identified suitable reviews, using a modification of the Population, Intervention, Comparison, Outcome (PICO) system and evaluated their methodological quality using the Assessment of Multiple Systematic Reviews (AMSTAR). In addition, the consistency of the quality of evidence and classification of intervention approaches was assessed independently by two assessors. The literature search yielded a total of four appropriate reviews published in the selected time span. The Assessment of Multiple Systematic Reviews percentage quality scores assigned to each review ranged from 0% (low quality) to 55% (medium quality). Evaluation of the quality of evidence and classification of intervention approaches yielded a discrepancy rate of 25%. All reviews concluded that some kind of intervention was better than none at all. Although the quality of the reviews progressively improved over the years, the shortcomings identified need to be addressed before concrete evidence regarding the best approach to intervention for children with DCD can be specified. © 2016 John Wiley & Sons Ltd.

The use of GRADE approach in systematic reviews of animal studies.

PubMed

Wei, Dang; Tang, Kun; Wang, Qi; Estill, Janne; Yao, Liang; Wang, Xiaoqin; Chen, Yaolong; Yang, Kehu

2016-03-15

The application of GRADE (Grading of Recommendations Assessment, Development and Evaluation) in SR of animal studies can promote the translation from bench to bedside. We aim to explore the use of GRADE in systematic reviews of animal studies. We used a theoretical analysis method to explore the use of GRADE in SR of animal studies and applied in a SR of animal studies. Meanwhile, we presented and discussed our results in two international conferences. Five downgrade factors were considered as follows in systematic reviews of animal studies: 1) Risk of bias: the SYRCLE tool can be used for assessing the risk of bias of animal studies. 2) Indirectness: we can assess indirectness in systematic reviews of animal studies from the PICO. 3) Inconsistency: similarity of point estimates, extent of overlap of confidence intervals and statistical heterogeneity are also suitable to evaluate inconsistency of evidence from animal studies. 4) Imprecision: optimal information size (OIS) and 95% confidence intervals (CIs) are also suitable for systematic reviews of animal studies, like those of clinical trials. 5) Publication bias: we need to consider publication bias comprehensively through the qualitative and quantitative methods. The methods about the use of GRADE in systematic review of animal studies are explicit. However, the principle about GRADE in developing the policy based on the evidence from animal studies when there is an emergency of public health. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

What Are the Effects of Teaching Evidence-Based Health Care (EBHC)? Overview of Systematic Reviews

PubMed Central

Young, Taryn; Rohwer, Anke; Volmink, Jimmy; Clarke, Mike

2014-01-01

Background An evidence-based approach to health care is recognized internationally as a key competency for healthcare practitioners. This overview systematically evaluated and organized evidence from systematic reviews on teaching evidence-based health care (EBHC). Methods/Findings We searched for systematic reviews evaluating interventions for teaching EBHC to health professionals compared to no intervention or different strategies. Outcomes covered EBHC knowledge, skills, attitudes, practices and health outcomes. Comprehensive searches were conducted in April 2013. Two reviewers independently selected eligible reviews, extracted data and evaluated methodological quality. We included 16 systematic reviews, published between 1993 and 2013. There was considerable overlap across reviews. We found that 171 source studies included in the reviews related to 81 separate studies, of which 37 are in more than one review. Studies used various methodologies to evaluate educational interventions of varying content, format and duration in undergraduates, interns, residents and practicing health professionals. The evidence in the reviews showed that multifaceted, clinically integrated interventions, with assessment, led to improvements in knowledge, skills and attitudes. Interventions improved critical appraisal skills and integration of results into decisions, and improved knowledge, skills, attitudes and behaviour amongst practicing health professionals. Considering single interventions, EBHC knowledge and attitude were similar for lecture-based versus online teaching. Journal clubs appeared to increase clinical epidemiology and biostatistics knowledge and reading behavior, but not appraisal skills. EBHC courses improved appraisal skills and knowledge. Amongst practicing health professionals, interactive online courses with guided critical appraisal showed significant increase in knowledge and appraisal skills. A short workshop using problem-based approaches, compared to no intervention, increased knowledge but not appraisal skills. Conclusions EBHC teaching and learning strategies should focus on implementing multifaceted, clinically integrated approaches with assessment. Future rigorous research should evaluate minimum components for multifaceted interventions, assessment of medium to long-term outcomes, and implementation of these interventions. PMID:24489771

Psychometric properties of health related quality of life measures in acute coronary syndrome patients: a systematic review protocol.

PubMed

Brasil, Virginia; Oliveira, Gabriela; Moraes, Katarinne Lima

2018-02-01

The objective of this systematic review is to evaluate the psychometric properties and clinical utility of patient-reported outcome measures that assess health-related quality of life in patients with a clinical diagnosis of acute coronary syndrome.

Effectiveness of preventive and treatment interventions for primary headaches in the workplace: A systematic review of the literature.

PubMed

Lardon, Arnaud; Girard, Marie-Pier; Zaïm, Chérine; Lemeunier, Nadège; Descarreaux, Martin; Marchand, Andrée-Anne

2017-01-01

Aim The purpose of this systematic literature review is to assess the benefits of workplace-based occupational therapies and interventions, including acute and preventive medication, on headache intensity and frequency, related disability as well as work-related outcomes. Methods A search of the literature was conducted in PubMed, MEDLINE, Cochrane library, CINAHL and Embase using terms related to headache, workplace and occupational health. The Cochrane Collaboration's risk of bias assessment tool was used on individual studies to assess internal validity and the Grading of Recommendations Assessment, Development, and Evaluation system was applied to studies by clinical outcome and used to rate quality of evidence. Results Fifteen articles were included in the systematic review. None of them were classified as low risk of bias according to the Cochrane Collaboration's tool for assessing risk of bias. This systematic review found preliminary low-quality evidence suggesting that exercise and acupuncture can reduce workers' headache pain intensity, frequency and related disability. Conclusion Although this systematic review provided preliminary low evidence in favour of work-based intervention, studies with more rigorous designs and methodologies are needed to provide further evidence of the effectiveness of workplace-based headache management strategies.

Cost-effectiveness of surgical interventions for the management of osteoarthritis: a systematic review of the literature.

PubMed

Kamaruzaman, Hanin; Kinghorn, Philip; Oppong, Raymond

2017-05-10

The primary purpose of this study is to assess the existing evidence on the cost-effectiveness of surgical interventions for the management of knee and hip osteoarthritis by systematically reviewing published economic evaluation studies. A systematic review was conducted for the period 2004 to 2016. Electronic databases were searched to identify both trial and model based economic evaluation studies that evaluated surgical interventions for knee and hip osteoarthritis. A total of 23 studies met the inclusion criteria and an assessment of these studies showed that total knee arthroplasty (TKA), and total hip arthroplasty (THA) showed evidence of cost-effectiveness and improvement in quality of life of the patients when compared to non-operative and non-surgical procedures. On the other hand, even though delaying TKA and THA may lead to some cost savings in the short-run, the results from the study showed that this was not a cost-effective option. TKA and THA are cost-effective and should be recommended for the management of patients with end stage/severe knee and hip OA. However, there needs to be additional studies to assess the cost-effectiveness of other surgical interventions in order for definite conclusions to be reached.

Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement?

PubMed

Tunis, Adam S; McInnes, Matthew D F; Hanna, Ramez; Esmail, Kaisra

2013-11-01

To evaluate whether completeness of reporting of systematic reviews and meta-analyses in major radiology journals has changed since publication of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement; a secondary objective is to evaluate whether completeness of reporting (ie, PRISMA) is associated with study quality (ie, Assessing the Methodological Quality of Systematic Reviews [AMSTAR]). Systematic reviews and meta-analyses published in major radiology journals between January 2007 and December 2011 were identified by searching MEDLINE with the modified Montori method. Studies were reviewed independently by two investigators and assessed for adherence to the AMSTAR and PRISMA checklists. The average results were analyzed to assess for change in mean score before and after PRISMA publication and to assess results over time; a Pearson correlation coefficient was calculated to assess for any association between PRISMA and AMSTAR results. Included were 130 studies from 11 journals. Average PRISMA and AMSTAR results were 21.8 of 27 and 7.2 of 11, respectively. The average result was higher after publication of PRISMA, and PRISMA-reported items were 22.6 of 27 after publication of PRISMA versus 20.9 of 27 before publication of PRISMA; AMSTAR results were 7.7 of 11 after publication of PRISMA versus 6.7 of 11 before publication of PRISMA. There was a strong positive correlation (r = 0.86) between the PRISMA and AMSTAR results. There was high variability between journals. Radiology had the highest PRISMA reported items (24.7 of 27), and American Journal of Neuroradiology had the lowest (19.6 of 27). Two major areas for improvement include study protocol registration and assessment of risk of bias across studies (ie, publication bias). In major radiology journal studies, there was modest improvement in completeness of reporting of systematic reviews and meta-analyses, assessed by PRISMA, which was strongly associated with higher study quality, assessed by AMSTAR. http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.13130273/-/DC1. RSNA, 2013

Prevention and assessment of infectious diseases among children and adult migrants arriving to the European Union/European Economic Association: a protocol for a suite of systematic reviews for public health and health systems.

PubMed

Pottie, Kevin; Mayhew, Alain D; Morton, Rachael L; Greenaway, Christina; Akl, Elie A; Rahman, Prinon; Zenner, Dominik; Pareek, Manish; Tugwell, Peter; Welch, Vivian; Meerpohl, Joerg; Alonso-Coello, Pablo; Hui, Charles; Biggs, Beverley-Ann; Requena-Méndez, Ana; Agbata, Eric; Noori, Teymur; Schünemann, Holger J

2017-09-11

The European Centre for Disease Prevention and Control is developing evidence-based guidance for voluntary screening, treatment and vaccine prevention of infectious diseases for newly arriving migrants to the European Union/European Economic Area. The objective of this systematic review protocol is to guide the identification, appraisal and synthesis of the best available evidence on prevention and assessment of the following priority infectious diseases: tuberculosis, HIV, hepatitis B, hepatitis C, measles, mumps, rubella, diphtheria, tetanus, pertussis, poliomyelitis (polio), Haemophilus influenza disease, strongyloidiasis and schistosomiasis. The search strategy will identify evidence from existing systematic reviews and then update the effectiveness and cost-effectiveness evidence using prospective trials, economic evaluations and/or recently published systematic reviews. Interdisciplinary teams have designed logic models to help define study inclusion and exclusion criteria, guiding the search strategy and identifying relevant outcomes. We will assess the certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. There are no ethical or safety issues. We anticipate disseminating the findings through open-access publications, conference abstracts and presentations. We plan to publish technical syntheses as GRADEpro evidence summaries and the systematic reviews as part of a special edition open-access publication on refugee health. We are following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Protocols reporting guideline. This protocol is registered in PROSPERO: CRD42016045798. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Culturally Sensitive Risk Behavior Prevention Programs for African American Adolescents: A Systematic Analysis

ERIC Educational Resources Information Center

Metzger, Isha; Cooper, Shauna M.; Zarrett, Nicole; Flory, Kate

2013-01-01

The current review conducted a systematic assessment of culturally sensitive risk prevention programs for African American adolescents. Prevention programs meeting the inclusion and exclusion criteria were evaluated across several domains: (1) theoretical orientation and foundation; (2) methodological rigor; (3) level of cultural integration; (4)…

Methodologic quality of meta-analyses and systematic reviews on the Mediterranean diet and cardiovascular disease outcomes: a review.

PubMed

Huedo-Medina, Tania B; Garcia, Marissa; Bihuniak, Jessica D; Kenny, Anne; Kerstetter, Jane

2016-03-01

Several systematic reviews/meta-analyses published within the past 10 y have examined the associations of Mediterranean-style diets (MedSDs) on cardiovascular disease (CVD) risk. However, these reviews have not been evaluated for satisfying contemporary methodologic quality standards. This study evaluated the quality of recent systematic reviews/meta-analyses on MedSD and CVD risk outcomes by using an established methodologic quality scale. The relation between review quality and impact per publication value of the journal in which the article had been published was also evaluated. To assess compliance with current standards, we applied a modified version of the Assessment of Multiple Systematic Reviews (AMSTARMedSD) quality scale to systematic reviews/meta-analyses retrieved from electronic databases that had met our selection criteria: 1) used systematic or meta-analytic procedures to review the literature, 2) examined MedSD trials, and 3) had MedSD interventions independently or combined with other interventions. Reviews completely satisfied from 8% to 75% of the AMSTARMedSD items (mean ± SD: 31.2% ± 19.4%), with those published in higher-impact journals having greater quality scores. At a minimum, 60% of the 24 reviews did not disclose full search details or apply appropriate statistical methods to combine study findings. Only 5 of the reviews included participant or study characteristics in their analyses, and none evaluated MedSD diet characteristics. These data suggest that current meta-analyses/systematic reviews evaluating the effect of MedSD on CVD risk do not fully comply with contemporary methodologic quality standards. As a result, there are more research questions to answer to enhance our understanding of how MedSD affects CVD risk or how these effects may be modified by the participant or MedSD characteristics. To clarify the associations between MedSD and CVD risk, future meta-analyses and systematic reviews should not only follow methodologic quality standards but also include more statistical modeling results when data allow. © 2016 American Society for Nutrition.

Assessment and prevention of behavioural and social risk factors associated with oral cancer: protocol for a systematic review of clinical guidelines and systematic reviews to inform Primary Care dental professionals.

PubMed

Mathur, Sweta; Conway, David I; Worlledge-Andrew, Heather; Macpherson, Lorna M D; Ross, Alastair J

2015-12-22

Tobacco and alcohol are recognised as the major risk factors for both oral cavity (mouth) and oropharyngeal (throat) cancers, with increasing acceptance of the role of human papillomavirus (HPV) in the aetiology of oropharyngeal cancers. In addition, there is a significant increased risk for oral cancer among lower socioeconomic groups, males and older age groups. There is a growing evidence for the potential role of primary care professionals in smoking cessation and reducing alcohol-related harm. However, there are uncertainties about the best approaches/strategies to assess risk factors associated with oral cancer, effective components of preventive interventions for behaviour change and implementation strategies in primary care dental settings. Thus, in order to contribute to the prevention of oral cancer effectively, dental professionals need to assess patients on the major risk factors (tobacco, alcohol and HPV/sexual behaviours) and deliver appropriate prevention, taking into account the patient's sociodemographic context. The study aims to synthesise evidence on the best practice for undertaking an assessment of major behavioural risk factors associated with oral cancer and delivering effective behaviour change preventive interventions (e.g. advice, counselling, patient recall, signposting/referral to preventive services) by dental professionals in primary care dental settings. The study involves a systematic review and evidence appraisal. We will search for clinical guidelines and systematic reviews from the following databases: Cochrane Library, Ovid MEDLINE, EMBASE, Web of Science, PsychINFO, PubMed, TRIP and Google Scholar. We will also search websites of professional organisations/agencies and bibliographies/reference lists of selected papers. Quality will be assessed with the AGREE II (Appraisal of Guidelines for Research & Evaluation II) instrument for included clinical guidelines and the AMSTAR (A Measurement Tool to Assess Systematic Reviews) and ROBIS instruments for included systematic reviews. The best practice evidence will be assessed via a narrative synthesis of extracted data, considering publication quality. This systematic review will synthesise evidence on the best practice for oral cancer risk factor assessment and prevention and evaluate the relationship between available clinical guidelines and the review evidence base. This collation of evidence will be useful for making recommendations for future intervention, research and guideline development. PROSPERO CRD42015025289.

Review of reviews on exposures to synthetic organic chemicals and children's neurodevelopment: Methodological and interpretation challenges.

PubMed

LaKind, Judy S; Anthony, Laura G; Goodman, Michael

2017-01-01

Environmental epidemiology data are becoming increasingly important in public health decision making, which commonly incorporates a systematic review of multiple studies. This review addresses two fundamental questions: What is the quality of available reviews on associations between exposure to synthetic organic chemicals and neurodevelopmental outcomes? What is the value (e.g., quality and consistency) of the underlying literature? Published reviews on associations between synthetic organic environmental chemical exposures and neurodevelopmental outcomes in children were systematically evaluated. Seventy-four relevant reviews were identified, and these were evaluated with respect to four methodological characteristics: (1) systematic inclusion/exclusion criteria and reproducible methods for search and retrieval of studies; (2) structured evaluation of underlying data quality; (3) systematic assessment of consistency across specific exposure-outcome associations; and (4) evaluation of reporting/publication bias. None of the 74 reviews fully met the criteria for all four methodological characteristics. Only four reviews met two criteria, and six reviews fulfilled only one criterion. Perhaps more importantly, the higher quality reviews were not able to meet all of the criteria owing to the shortcomings of underlying studies, which lacked comparability in terms of specific research question of interest, overall design, exposure assessment, outcome ascertainment, and analytic methods. Thus, even the most thoughtful and rigorous review may be of limited value if the underlying literature includes investigations that address different hypotheses and are beset by methodological inconsistencies and limitations. Issues identified in this review of reviews illustrate considerable challenges that are facing assessments of epidemiological evidence.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

PubMed

Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

2018-01-01

To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review.

PubMed

Patterson, P Daniel; Weaver, Matthew D; Fabio, Anthony; Teasley, Ellen M; Renn, Megan L; Curtis, Brett R; Matthews, Margaret E; Kroemer, Andrew J; Xun, Xiaoshuang; Bizhanova, Zhadyra; Weiss, Patricia M; Sequeira, Denisse J; Coppler, Patrick J; Lang, Eddy S; Higgins, J Stephen

2018-02-15

This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. A systematic review study design was used and searched six databases, including one website. The research question guiding the search was developed a priori and registered with the PROSPERO database of systematic reviews: "Are there reliable and valid instruments for measuring fatigue among EMS personnel?" (2016:CRD42016040097). The primary outcome of interest was criterion-related validity. Important outcomes of interest included reliability (e.g., internal consistency), and indicators of sensitivity and specificity. Members of the research team independently screened records from the databases. Full-text articles were evaluated by adapting the Bolster and Rourke system for categorizing findings of systematic reviews, and the rated data abstracted from the body of literature as favorable, unfavorable, mixed/inconclusive, or no impact. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology was used to evaluate the quality of evidence. The search strategy yielded 1,257 unique records. Thirty-four unique experimental and non-experimental studies were determined relevant following full-text review. Nineteen studies reported on the reliability and/or validity of ten different fatigue survey instruments. Eighteen different studies evaluated the reliability and/or validity of four different sleepiness survey instruments. None of the retained studies reported sensitivity or specificity. Evidence quality was rated as very low across all outcomes. In this systematic review, limited evidence of the reliability and validity of 14 different survey instruments to assess the fatigue and/or sleepiness status of EMS personnel and related shift worker groups was identified.

Spatial abilities and anatomy knowledge assessment: A systematic review.

PubMed

Langlois, Jean; Bellemare, Christian; Toulouse, Josée; Wells, George A

2017-06-01

Anatomy knowledge has been found to include both spatial and non-spatial components. However, no systematic evaluation of studies relating spatial abilities and anatomy knowledge has been undertaken. The objective of this study was to conduct a systematic review of the relationship between spatial abilities test and anatomy knowledge assessment. A literature search was done up to March 20, 2014 in Scopus and in several databases on the OvidSP and EBSCOhost platforms. Of the 556 citations obtained, 38 articles were identified and fully reviewed yielding 21 eligible articles and their quality were formally assessed. Non-significant relationships were found between spatial abilities test and anatomy knowledge assessment using essays and non-spatial multiple-choice questions. Significant relationships were observed between spatial abilities test and anatomy knowledge assessment using practical examination, three-dimensional synthesis from two-dimensional views, drawing of views, and cross-sections. Relationships between spatial abilities test and anatomy knowledge assessment using spatial multiple-choice questions were unclear. The results of this systematic review provide evidence for spatial and non-spatial methods of anatomy knowledge assessment. Anat Sci Educ 10: 235-241. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

Systematic reviews of therapeutic interventions frequently consider patient-important outcomes.

PubMed

Ameur, Hayet; Ravaud, Philippe; Fayard, Florence; Riveros, Carolina; Dechartres, Agnes

2017-04-01

To determine whether recently published and ongoing systematic reviews of therapeutic interventions assess patient-important outcomes. For this methodological review, we searched MEDLINE via PubMed for recently published systematic reviews and online registry of systematic reviews (PROSPERO) for ongoing systematic reviews. We selected systematic reviews with meta-analyses of randomized controlled trials. We extracted all outcomes defined in the methods section and categorized them. Mortality, other clinical events, pain, quality of life, function, and therapeutic decisions were considered patient-important outcomes. We included 420 systematic reviews: 90 Cochrane reviews, 200 other published reviews, and 130 registered ongoing reviews. Primary outcomes were defined in 85 Cochrane reviews (95%), 98 (49%) other published reviews and all ongoing reviews. At least one patient-important outcome was defined as a primary outcome in 81/85 Cochrane reviews (95%), 78/98 other published reviews (80%), and 117/130 ongoing reviews (90%). Considering all outcomes assessed, at least one patient-important outcome was evaluated in 90/90 Cochrane reviews (100%), 189/200 other published reviews (95%), and 121/130 ongoing reviews (93%). Most recent systematic reviews aim to assess patient-important outcomes, which contrasts with RCTs. These results suggest some important gaps between primary and secondary research. Copyright © 2017 Elsevier Inc. All rights reserved.

Aromatherapy for managing menopausal symptoms

PubMed Central

Choi, Jiae; Lee, Hye Won; Lee, Ju Ah; Lim, Hyun-Ja; Lee, Myeong Soo

2018-01-01

Abstract Background: Aromatherapy is often used as a complementary therapy for women's health. This systematic review aims to evaluate the therapeutic effects of aromatherapy as a management for menopausal symptoms. Methods: Eleven electronic databases will be searched from inception to February 2018. Randomized controlled trials that evaluated any type of aromatherapy against any type of control in individuals with menopausal symptoms will be eligible. The methodological quality will be assessed using the Cochrane risk of bias tool. Two authors will independently assess each study for eligibility and risk of bias and to extract data. Results: This study will provide a high quality synthesis of current evidence of aromatherapy for menopausal symptoms measured with Menopause Rating Scale, the Kupperman Index, the Greene Climacteric Scale, or other validated questionnaires. Conclusions: The conclusion of our systematic review will provide evidence to judge whether aromatherapy is an effective intervention for patient with menopausal women. Ethics and dissemination: Ethical approval will not be required, given that this protocol is for a systematic review. The systematic review will be published in a peer-reviewed journal. The review will also be disseminated electronically and in print. Systematic review registration: PROSPERO CRD42017079191. PMID:29419673

Economic evaluation of HIV pre-exposure prophylaxis strategies: protocol for a methodological systematic review and quantitative synthesis.

PubMed

Thavorn, Kednapa; Kugathasan, Howsikan; Tan, Darrell H S; Moqueet, Nasheed; Baral, Stefan D; Skidmore, Becky; MacFadden, Derek; Simkin, Anna; Mishra, Sharmistha

2018-03-15

Pre-exposure prophylaxis (PrEP) with antiretrovirals is an efficacious and effective intervention to decrease the risk of HIV (human immunodeficiency virus) acquisition. Yet drug and delivery costs prohibit access in many jurisdictions. In the absence of guidelines for the synthesis of economic evaluations, we developed a protocol for a systematic review of economic evaluation studies for PrEP by drawing on best practices in systematic reviews and the conduct and reporting of economic evaluations. We aim to estimate the incremental cost per health outcome of PrEP compared with placebo, no PrEP, or other HIV prevention strategies; assess the methodological variability in, and quality of, economic evaluations of PrEP; estimate the incremental cost per health outcome of different PrEP implementation strategies; and quantify the potential sources of heterogeneity in outcomes. We will systematically search electronic databases (MEDLINE, Embase) and the gray literature. We will include economic evaluation studies that assess both costs and health outcomes of PrEP in HIV-uninfected individuals, without restricting language or year of publication. Two reviewers will independently screen studies using predefined inclusion criteria, extract data, and assess methodological quality using the Philips checklist, Second Panel on the Cost-effectiveness of Health and Medicines, and the International Society for Pharmacoeconomics and Outcomes Research recommendations. Outcomes of interest include incremental costs and outcomes in natural units or utilities, cost-effectiveness ratios, and net monetary benefit. We will perform descriptive and quantitative syntheses using sensitivity analyses of outcomes by population subgroups, HIV epidemic settings, study designs, baseline intervention contexts, key parameter inputs and assumptions, type of outcomes, economic perspectives, and willingness to pay values. Findings will guide future economic evaluation of PrEP strategies in terms of methodological and knowledge gaps, and will inform decisions on the efficient integration of PrEP into public health programs across epidemiologic and health system contexts. PROSPERO CRD42016038440 .

Evaluating a Technology Supported Interactive Response System during the Laboratory Section of a Histology Course

ERIC Educational Resources Information Center

Rinaldi, Vera D.; Lorr, Nancy A.; Williams, Kimberly

2017-01-01

Monitoring of student learning through systematic formative assessment is important for adjusting pedagogical strategies. However, traditional formative assessments, such as quizzes and written assignments, may not be sufficiently timely for making adjustments to a learning process. Technology supported formative assessment tools assess student…

What is the clinical effectiveness and cost-effectiveness of conservative interventions for tendinopathy? An overview of systematic reviews of clinical effectiveness and systematic review of economic evaluations.

PubMed

Long, Linda; Briscoe, Simon; Cooper, Chris; Hyde, Chris; Crathorne, Louise

2015-01-01

Lateral elbow tendinopathy (LET) is a common complaint causing characteristic pain in the lateral elbow and upper forearm, and tenderness of the forearm extensor muscles. It is thought to be an overuse injury and can have a major impact on the patient's social and professional life. The condition is challenging to treat and prone to recurrent episodes. The average duration of a typical episode ranges from 6 to 24 months, with most (89%) reporting recovery by 1 year. This systematic review aims to summarise the evidence concerning the clinical effectiveness and cost-effectiveness of conservative interventions for LET. A comprehensive search was conducted from database inception to 2012 in a range of databases including MEDLINE, EMBASE and Cochrane Databases. We conducted an overview of systematic reviews to summarise the current evidence concerning the clinical effectiveness and a systematic review for the cost-effectiveness of conservative interventions for LET. We identified additional randomised controlled trials (RCTs) that could contribute further evidence to existing systematic reviews. We searched MEDLINE, EMBASE, Allied and Complementary Medicine Database, Cumulative Index to Nursing and Allied Health Literature, Web of Science, The Cochrane Library and other important databases from inception to January 2013. A total of 29 systematic reviews published since 2003 matched our inclusion criteria. These were quality appraised using the Assessment of Multiple Systematic Reviews (AMSTAR) checklist; five were considered high quality and evaluated using a Grading of Recommendations, Assessment, Development and Evaluation approach. A total of 36 RCTs were identified that were not included in a systematic review and 29 RCTs were identified that had only been evaluated in an included systematic review of intermediate/low quality. These were then mapped to existing systematic reviews where further evidence could provide updates. Two economic evaluations were identified. The summary of findings from the review was based only on high-quality evidence (scoring of > 5 AMSTAR). Other limitations were that identified RCTs were not quality appraised and dichotomous outcomes were also not considered. Economic evaluations took effectiveness estimates from trials that had small sample sizes leading to uncertainty surrounding the effect sizes reported. This, in turn, led to uncertainty of the reported cost-effectiveness and, as such, no robust recommendations could be made in this respect. Clinical effectiveness evidence from the high-quality systematic reviews identified in this overview continues to suggest uncertainty as to the effectiveness of many conservative interventions for the treatment of LET. Although new RCT evidence has been identified with either placebo or active controls, there is uncertainty as to the size of effects reported within them because of the small sample size. Conclusions regarding cost-effectiveness are also unclear. We consider that, although updated or new systematic reviews may also be of value, the primary focus of future work should be on conducting large-scale, good-quality clinical trials using a core set of outcome measures (for defined time points) and appropriate follow-up. Subgroup analysis of existing RCT data may be beneficial to ascertain whether or not certain patient groups are more likely to respond to treatments. This study is registered as PROSPERO CRD42013003593. The National Institute for Health Research Health Technology Assessment programme.

Vending machine assessment methodology. A systematic review.

PubMed

Matthews, Melissa A; Horacek, Tanya M

2015-07-01

The nutritional quality of food and beverage products sold in vending machines has been implicated as a contributing factor to the development of an obesogenic food environment. How comprehensive, reliable, and valid are the current assessment tools for vending machines to support or refute these claims? A systematic review was conducted to summarize, compare, and evaluate the current methodologies and available tools for vending machine assessment. A total of 24 relevant research studies published between 1981 and 2013 met inclusion criteria for this review. The methodological variables reviewed in this study include assessment tool type, study location, machine accessibility, product availability, healthfulness criteria, portion size, price, product promotion, and quality of scientific practice. There were wide variations in the depth of the assessment methodologies and product healthfulness criteria utilized among the reviewed studies. Of the reviewed studies, 39% evaluated machine accessibility, 91% evaluated product availability, 96% established healthfulness criteria, 70% evaluated portion size, 48% evaluated price, 52% evaluated product promotion, and 22% evaluated the quality of scientific practice. Of all reviewed articles, 87% reached conclusions that provided insight into the healthfulness of vended products and/or vending environment. Product healthfulness criteria and complexity for snack and beverage products was also found to be variable between the reviewed studies. These findings make it difficult to compare results between studies. A universal, valid, and reliable vending machine assessment tool that is comprehensive yet user-friendly is recommended. Copyright © 2015 Elsevier Ltd. All rights reserved.

Quality of search strategies reported in systematic reviews published in stereotactic radiosurgery.

PubMed

Faggion, Clovis M; Wu, Yun-Chun; Tu, Yu-Kang; Wasiak, Jason

2016-06-01

Systematic reviews require comprehensive literature search strategies to avoid publication bias. This study aimed to assess and evaluate the reporting quality of search strategies within systematic reviews published in the field of stereotactic radiosurgery (SRS). Three electronic databases (Ovid MEDLINE(®), Ovid EMBASE(®) and the Cochrane Library) were searched to identify systematic reviews addressing SRS interventions, with the last search performed in October 2014. Manual searches of the reference lists of included systematic reviews were conducted. The search strategies of the included systematic reviews were assessed using a standardized nine-question form based on the Cochrane Collaboration guidelines and Assessment of Multiple Systematic Reviews checklist. Multiple linear regression analyses were performed to identify the important predictors of search quality. A total of 85 systematic reviews were included. The median quality score of search strategies was 2 (interquartile range = 2). Whilst 89% of systematic reviews reported the use of search terms, only 14% of systematic reviews reported searching the grey literature. Multiple linear regression analyses identified publication year (continuous variable), meta-analysis performance and journal impact factor (continuous variable) as predictors of higher mean quality scores. This study identified the urgent need to improve the quality of search strategies within systematic reviews published in the field of SRS. This study is the first to address how authors performed searches to select clinical studies for inclusion in their systematic reviews. Comprehensive and well-implemented search strategies are pivotal to reduce the chance of publication bias and consequently generate more reliable systematic review findings.

TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: content analysis and systematic review

PubMed Central

Dall, PM; Coulter, EH; Fitzsimons, CF; Skelton, DA; Chastin, SFM

2017-01-01

Objective Sedentary behaviour (SB) has distinct deleterious health outcomes, yet there is no consensus on best practice for measurement. This study aimed to identify the optimal self-report tool for population surveillance of SB, using a systematic framework. Design A framework, TAxonomy of Self-reported Sedentary behaviour Tools (TASST), consisting of four domains (type of assessment, recall period, temporal unit and assessment period), was developed based on a systematic inventory of existing tools. The inventory was achieved through a systematic review of studies reporting SB and tracing back to the original description. A systematic review of the accuracy and sensitivity to change of these tools was then mapped against TASST domains. Data sources Systematic searches were conducted via EBSCO, reference lists and expert opinion. Eligibility criteria for selecting studies The inventory included tools measuring SB in adults that could be self-completed at one sitting, and excluded tools measuring SB in specific populations or contexts. The systematic review included studies reporting on the accuracy against an objective measure of SB and/or sensitivity to change of a tool in the inventory. Results The systematic review initially identified 32 distinct tools (141 questions), which were used to develop the TASST framework. Twenty-two studies evaluated accuracy and/or sensitivity to change representing only eight taxa. Assessing SB as a sum of behaviours and using a previous day recall were the most promising features of existing tools. Accuracy was poor for all existing tools, with underestimation and overestimation of SB. There was a lack of evidence about sensitivity to change. Conclusions Despite the limited evidence, mapping existing SB tools onto the TASST framework has enabled informed recommendations to be made about the most promising features for a surveillance tool, identified aspects on which future research and development of SB surveillance tools should focus. Trial registration number International prospective register of systematic reviews (PROPSPERO)/CRD42014009851. PMID:28391233

A systematic review of clinical assessment for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Lee, Cindy Ching Siang; Wang, Wenru

2015-02-01

Consolidated clinical practicum prepares pre-registration nursing students to function as beginning practitioners. The clinical competencies of final-year nursing students provide a key indication of professional standards of practice and patient safety. Thus, clinical assessment of nursing students is a crucial issue for educators and administrators. The aim of this systematic review was to explore the clinical competency assessment for undergraduate nursing students. PubMed, CINAHL, ScienceDirect, Web of Science, and EBSCO were systematically searched from January 2000 to December 2013. The systematic review was in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Published quantitative and qualitative studies that examined clinical assessment practices and tools used in clinical nursing education were retrieved. Quality assessment, data extraction, and analysis were completed on all included studies. This review screened 2073 titles, abstracts and full-text records, resulting in 33 included studies. Two reviewers assessed the quality of the included studies. Fourteen quantitative and qualitative studies were identified for this evaluation. The evidence was ordered into emergent themes; the overarching themes were current practices in clinical assessment, issues of learning and assessment, development of assessment tools, and reliability and validity of assessment tools. There is a need to develop a holistic clinical assessment tool with reasonable level of validity and reliability. Clinical assessment is a robust activity and requires collaboration between clinical partners and academia to enhance the clinical experiences of students, the professional development of preceptors, and the clinical credibility of academics. Copyright © 2014 Elsevier Ltd. All rights reserved.

Measurement properties of self-report physical activity assessment tools in stroke: a protocol for a systematic review

PubMed Central

Martins, Júlia Caetano; Aguiar, Larissa Tavares; Nadeau, Sylvie; Scianni, Aline Alvim; Teixeira-Salmela, Luci Fuscaldi; Faria, Christina Danielli Coelho de Morais

2017-01-01

Introduction Self-report physical activity assessment tools are commonly used for the evaluation of physical activity levels in individuals with stroke. A great variety of these tools have been developed and widely used in recent years, which justify the need to examine their measurement properties and clinical utility. Therefore, the main objectives of this systematic review are to examine the measurement properties and clinical utility of self-report measures of physical activity and discuss the strengths and limitations of the identified tools. Methods and analysis A systematic review of studies that investigated the measurement properties and/or clinical utility of self-report physical activity assessment tools in stroke will be conducted. Electronic searches will be performed in five databases: Medical Literature Analysis and Retrieval System Online (MEDLINE) (PubMed), Excerpta Medica Database (EMBASE), Physiotherapy Evidence Database (PEDro), Literatura Latino-Americana e do Caribe em Ciências da Saúde (LILACS) and Scientific Electronic Library Online (SciELO), followed by hand searches of the reference lists of the included studies. Two independent reviewers will screen all retrieve titles, abstracts, and full texts, according to the inclusion criteria and will also extract the data. A third reviewer will be referred to solve any disagreement. A descriptive summary of the included studies will contain the design, participants, as well as the characteristics, measurement properties, and clinical utility of the self-report tools. The methodological quality of the studies will be evaluated using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist and the clinical utility of the identified tools will be assessed considering predefined criteria. This systematic review will follow the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) statement. Discussion This systematic review will provide an extensive review of the measurement properties and clinical utility of self-report physical activity assessment tools used in individuals with stroke, which would benefit clinicians and researchers. Trial registration number PROSPERO CRD42016037146. PMID:28193848

Eunkyosan for treatment of the common cold: A protocol for the systematic review of controlled trials.

PubMed

Lee, Hesol; Kang, Bohyung; Choi, Jun-Yong; Park, Sunju; Lee, Myeong Soo; Lee, Ju Ah

2018-05-01

Eunkyosan (EKS) is widely used for common colds in East Asian countries. Many clinical trials assessing the efficacy and safety of EKS formula for the treatment of common colds have been reported. This review will assess the clinical evidence for and against the use of EKS formula as a treatment for common colds. Fourteen databases will be searched from inception until March 2018. We will include randomized controlled trials (RCTs) assessing EKS decoctions for any type of common cold. All RCTs of decoctions or modified decoctions will be included. The methodological qualities of the RCTs will be assessed using the Cochrane Collaboration tool for assessing risk of bias, while confidence in the cumulative evidence will be evaluated using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) instrument. This systematic review will be published in a peer-reviewed journal and will also be disseminated electronically and in print. The review will be updated to inform and guide healthcare practices.Registration number: CRD42018087694.

Using Multiple Types of Studies in Systematic Reviews of Health Care Interventions – A Systematic Review

PubMed Central

Peinemann, Frank; Tushabe, Doreen Allen; Kleijnen, Jos

2013-01-01

Background A systematic review may evaluate different aspects of a health care intervention. To accommodate the evaluation of various research questions, the inclusion of more than one study design may be necessary. One aim of this study is to find and describe articles on methodological issues concerning the incorporation of multiple types of study designs in systematic reviews on health care interventions. Another aim is to evaluate methods studies that have assessed whether reported effects differ by study types. Methods and Findings We searched PubMed, the Cochrane Database of Systematic Reviews, and the Cochrane Methodology Register on 31 March 2012 and identified 42 articles that reported on the integration of single or multiple study designs in systematic reviews. We summarized the contents of the articles qualitatively and assessed theoretical and empirical evidence. We found that many examples of reviews incorporating multiple types of studies exist and that every study design can serve a specific purpose. The clinical questions of a systematic review determine the types of design that are necessary or sufficient to provide the best possible answers. In a second independent search, we identified 49 studies, 31 systematic reviews and 18 trials that compared the effect sizes between randomized and nonrandomized controlled trials, which were statistically different in 35%, and not different in 53%. Twelve percent of studies reported both, different and non-different effect sizes. Conclusions Different study designs addressing the same question yielded varying results, with differences in about half of all examples. The risk of presenting uncertain results without knowing for sure the direction and magnitude of the effect holds true for both nonrandomized and randomized controlled trials. The integration of multiple study designs in systematic reviews is required if patients should be informed on the many facets of patient relevant issues of health care interventions. PMID:24416098

Assessment Inventories, Surveys, and Templates for Evaluating Educational Technology Regional and Local Assistance Programs. Phase IV of the Comprehensive Study of Educational Technology Programs Authorized from 1984-1992.

ERIC Educational Resources Information Center

Far West Lab. for Educational Research and Development, San Francisco, CA.

This report on Phase IV, of a four-phase study, provided for the development of evaluation templates and instruments to be used by the California Department of Education to facilitate systematic assessment of state funded educational technology programs and projects. These assessment documents comprised the major data collection sources for the…

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews.

PubMed

Mayo-Wilson, Evan; Ng, Sueko Matsumura; Chuck, Roy S; Li, Tianjing

2017-09-05

Systematic reviews should inform American Academy of Ophthalmology (AAO) Preferred Practice Pattern® (PPP) guidelines. The quality of systematic reviews related to the forthcoming Preferred Practice Pattern® guideline (PPP) Refractive Errors & Refractive Surgery is unknown. We sought to identify reliable systematic reviews to assist the AAO Refractive Errors & Refractive Surgery PPP. Systematic reviews were eligible if they evaluated the effectiveness or safety of interventions included in the 2012 PPP Refractive Errors & Refractive Surgery. To identify potentially eligible systematic reviews, we searched the Cochrane Eyes and Vision United States Satellite database of systematic reviews. Two authors identified eligible reviews and abstracted information about the characteristics and quality of the reviews independently using the Systematic Review Data Repository. We classified systematic reviews as "reliable" when they (1) defined criteria for the selection of studies, (2) conducted comprehensive literature searches for eligible studies, (3) assessed the methodological quality (risk of bias) of the included studies, (4) used appropriate methods for meta-analyses (which we assessed only when meta-analyses were reported), (5) presented conclusions that were supported by the evidence provided in the review. We identified 124 systematic reviews related to refractive error; 39 met our eligibility criteria, of which we classified 11 to be reliable. Systematic reviews classified as unreliable did not define the criteria for selecting studies (5; 13%), did not assess methodological rigor (10; 26%), did not conduct comprehensive searches (17; 44%), or used inappropriate quantitative methods (3; 8%). The 11 reliable reviews were published between 2002 and 2016. They included 0 to 23 studies (median = 9) and analyzed 0 to 4696 participants (median = 666). Seven reliable reviews (64%) assessed surgical interventions. Most systematic reviews of interventions for refractive error are low methodological quality. Following widely accepted guidance, such as Cochrane or Institute of Medicine standards for conducting systematic reviews, would contribute to improved patient care and inform future research.

The Novel Language-Systematic Aphasia Screening SAPS: Screening-Based Therapy in Combination with Computerised Home Training

ERIC Educational Resources Information Center

Krzok, Franziska; Rieger, Verena; Niemann, Katharina; Nobis-Bosch, Ruth; Radermacher, Irmgard; Huber, Walter; Willmes, Klaus; Abel, Stefanie

2018-01-01

Background: SAPS--'Sprachsystematisches Aphasiescreening'--is a novel language-systematic aphasia screening developed for the German language, which already had been positively evaluated. It offers a fast assessment of modality-specific psycholinguistic components at different levels of complexity and the derivation of impairment-based treatment…

Measuring treatment outcomes in gambling disorders: a systematic review.

PubMed

Pickering, Dylan; Keen, Brittany; Entwistle, Gavin; Blaszczynski, Alex

2018-03-01

Considerable variation of outcome variables used to measure recovery in the gambling treatment literature has precluded effective cross-study evaluations and hindered the development of best-practice treatment methodologies. The aim of this systematic review was to describe current diffuse concepts of recovery in the gambling field by mapping the range of outcomes and measurement strategies used to evaluate treatments, and to identify more commonly accepted indices of recovery. A systematic search of six academic databases for studies evaluating treatments (psychological and pharmacological) for gambling disorders with a minimum 6-month follow-up. Data from eligible studies were tabulated and analysis conducted using a narrative approach. Guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) were adhered to. Thirty-four studies were reviewed systematically (RCTs = 17, comparative designs = 17). Sixty-three different outcome measures were identified: 25 (39.7%) assessed gambling-specific constructs, 36 (57.1%) assessed non-gambling specific constructs, and two instruments were used across both categories (3.2%). Self-report instruments ranged from psychometrically validated to ad-hoc author-designed questionnaires. Units of measurement were inconsistent, particularly in the assessment of gambling behaviour. All studies assessed indices of gambling behaviour and/or symptoms of gambling disorder. Almost all studies (n = 30; 88.2%) included secondary measures relating to psychiatric comorbidities, psychological processes linked to treatment approach, or global functioning and wellbeing. In research on gambling disorders, the incorporation of broader outcome domains that extend beyond disorder-specific symptoms and behaviours suggests a multi-dimensional conceptualization of recovery. Development of a single comprehensive scale to measure all aspects of gambling recovery could help to facilitate uniform reporting practices across the field. © 2017 The Authors. Addiction published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.

Evaluation of risk of bias assessment of trials in systematic reviews of oral health interventions, 1991-2014: A methodology study.

PubMed

Saltaji, Humam; Ospina, Maria B; Armijo-Olivo, Susan; Agarwal, Shruti; Cummings, Greta G; Amin, Maryam; Flores-Mir, Carlos

2016-09-01

The authors aimed to describe how often and by what means investigators assessed the risk of bias of clinical trials in systematic reviews of oral health interventions and to identify factors associated with risk of bias assessments. The authors selected therapeutic oral health systematic reviews published from 1991 through 2014. They extracted data related to the tools used for risk of bias assessment of primary studies and data related to other review characteristics. They descriptively analyzed the data and used multivariate logistic regression. The authors identified 1,114 oral health systematic reviews (130 Cochrane reviews and 984 non-Cochrane reviews). The investigators of the primary studies assessed risk of bias in 61.4% of the reviews, and the risk of bias assessments occurred more often in Cochrane reviews than in non-Cochrane reviews (100% versus 56.3%; P < .001) and in reviews published after the dissemination of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement (odds ratio [OR], 1.55; 95% confidence interval [CI], 1.17-2.06). Compared with the investigators of reviews of public oral health interventions, investigators of reviews of oral surgery were less likely to assess risk of bias (OR, 0.41; 95% CI, 0.25-0.67). Furthermore, the investigators of systematic reviews published in dental journals were less likely to assess risk of bias of individual trials (OR, 0.28; 95% CI, 0.19-0.41) compared with the investigators of reviews published in nondental journals. The investigators of primary studies did not undertake risk of bias assessment in a considerable portion of non-Cochrane oral health systematic reviews. The investigators of reviews published in dental journals were less likely to assess risk of bias than the investigators of reviews published in nondental journals. The results of this study provide evidence of the need for improving the conduct and reporting of oral health systematic reviews with respect to risk of bias assessment. Clinicians should determine to what extent the findings of a systematic review are valid on the basis of whether the investigators assessed and considered risk of bias during the interpretation of findings. Copyright © 2016 American Dental Association. Published by Elsevier Inc. All rights reserved.

Reach, engagement, and effectiveness: a systematic review of evaluation methodologies used in health promotion via social networking sites.

PubMed

Lim, Megan S C; Wright, Cassandra J C; Carrotte, Elise R; Pedrana, Alisa E

2016-02-01

Issue addressed Social networking sites (SNS) are increasingly popular platforms for health promotion. Advancements in SNS health promotion require quality evidence; however, interventions are often not formally evaluated. This study aims to describe evaluation practices used in SNS health promotion. Methods A systematic review was undertaken of Medline, PsycINFO, Scopus, EMBASE, CINAHL Plus, Communication and Mass Media Complete, and Cochrane Library databases. Articles published between 2006 and 2013 describing any health promotion intervention delivered using SNS were included. Results Forty-seven studies were included. There were two main evaluation approaches: closed designs (n=23), which used traditional research designs and formal recruitment procedures; and open designs (n=19), which evaluated the intervention in a real-world setting, allowing unknown SNS users to interact with the content without enrolling in research. Closed designs were unable to assess reach and engagement beyond their research sample. Open designs often relied on weaker study designs with no use of objective outcome measures and yielded low response rates. Conclusions Barriers to evaluation included low participation rates, high attrition, unknown representativeness and lack of comparison groups. Acceptability was typically assessed among those engaged with the intervention, with limited population data available to accurately assess intervention reach. Few studies were able to assess uptake of the intervention in a real-life setting while simultaneously assessing effectiveness of interventions with research rigour. So what? Through use of quasi-experimental or well designed before-after evaluations, in combination with detailed engagement metrics, it is possible to balance assessment of effectiveness and reach to evaluate SNS health promotion.

Evidence-based practice: extending the search to find material for the systematic review

PubMed Central

Helmer, Diane; Savoie, Isabelle; Green, Carolyn; Kazanjian, Arminée

2001-01-01

Background: Cochrane-style systematic reviews increasingly require the participation of librarians. Guidelines on the appropriate search strategy to use for systematic reviews have been proposed. However, research evidence supporting these recommendations is limited. Objective: This study investigates the effectiveness of various systematic search methods used to uncover randomized controlled trials (RCTs) for systematic reviews. Effectiveness is defined as the proportion of relevant material uncovered for the systematic review using extended systematic review search methods. The following extended systematic search methods are evaluated: searching subject-specific or specialized databases (including trial registries), hand searching, scanning reference lists, and communicating personally. Methods: Two systematic review projects were prospectively monitored regarding the method used to identify items as well as the type of items retrieved. The proportion of RCTs identified by each systematic search method was calculated. Results: The extended systematic search methods uncovered 29.2% of all items retrieved for the systematic reviews. The search of specialized databases was the most effective method, followed by scanning of reference lists, communicating personally, and hand searching. Although the number of items identified through hand searching was small, these unique items would otherwise have been missed. Conclusions: Extended systematic search methods are effective tools for uncovering material for the systematic review. The quality of the items uncovered has yet to be assessed and will be key in evaluating the value of the systematic search methods. PMID:11837256

Implementation of Systematic Review Tools in IRIS | Science ...

EPA Pesticide Factsheets

Currently, the number of chemicals present in the environment exceeds the ability of public health scientists to efficiently screen the available data in order to produce well-informed human health risk assessments in a timely manner. For this reason, the US EPA’s Integrated Risk Information System (IRIS) program has started implementing new software tools into the hazard characterization workflow. These automated tools aid in multiple phases of the systematic review process including scoping and problem formulation, literature search, and identification and screening of available published studies. The increased availability of these tools lays the foundation for automating or semi-automating multiple phases of the systematic review process. Some of these software tools include modules to facilitate a structured approach to study quality evaluation of human and animal data, although approaches are generally lacking for assessing complex mechanistic information, in particular “omics”-based evidence tools are starting to become available to evaluate these types of studies. We will highlight how new software programs, online tools, and approaches for assessing study quality can be better integrated to allow for a more efficient and transparent workflow of the risk assessment process as well as identify tool gaps that would benefit future risk assessments. Disclaimer: The views expressed here are those of the authors and do not necessarily represent the view

Can Systematic Reviews Inform GMO Risk Assessment and Risk Management?

PubMed

Kohl, Christian; Frampton, Geoff; Sweet, Jeremy; Spök, Armin; Haddaway, Neal Robert; Wilhelm, Ralf; Unger, Stefan; Schiemann, Joachim

2015-01-01

Systematic reviews represent powerful tools to identify, collect, synthesize, and evaluate primary research data on specific research questions in a highly standardized and reproducible manner. They enable the defensible synthesis of outcomes by increasing precision and minimizing bias whilst ensuring transparency of the methods used. This makes them especially valuable to inform evidence-based risk analysis and decision making in various topics and research disciplines. Although seen as a "gold standard" for synthesizing primary research data, systematic reviews are not without limitations as they are often cost, labor and time intensive and the utility of synthesis outcomes depends upon the availability of sufficient and robust primary research data. In this paper, we (1) consider the added value systematic reviews could provide when synthesizing primary research data on genetically modified organisms (GMO) and (2) critically assess the adequacy and feasibility of systematic review for collating and analyzing data on potential impacts of GMOs in order to better inform specific steps within GMO risk assessment and risk management. The regulatory framework of the EU is used as an example, although the issues we discuss are likely to be more widely applicable.

Allelopathic potential and systematic evaluation of organic extracts from Canavalia ensiformis leaves (Jack beans).

PubMed

Santos, Sonia; de Moraes, Maria de Lourdes Leite; da Silva Souza Filho, Antonio Pedro; Rezende, Maria Olímpia Oliveira

2005-01-01

This article describes the assessment of possible allelopathic potential of organic extracts obtained from leaves of Canavalia ensiformis under laboratory conditions. Furthermore, a systematic evaluation of these extracts was carried out using specific protocols developed in capillary electrophoresis (CE) to determine some groups of secondary metabolites. After the identification and quantification of compounds, the effects of compounds on germination of some common weeds was investigated, which are becoming a real problem in pastures in the state of Pará, Brazil.

A systematic way to assess compliance with human factors standards

DOT National Transportation Integrated Search

1996-01-01

Assessing the human factors : considerations associated : with the design or : evaluation of any major : new system can be a formidable challenge. : To make this more manageable, : the Federal Aviation Administrations : (FAA) Office of the Chief S...

Use of dietary assessment tools in randomized trials evaluating diet-based interventions in pregnancy: a systematic review of literature.

PubMed

Al Wattar, Bassel H; Mylrea-Lowndes, Bronacha; Morgan, Catrin; Moore, Amanda P; Thangaratinam, Shakila

2016-12-01

Accurate assessment of dietary intake in interventional trials is the key to evaluate changes in dietary behaviour and compliance. We evaluated the use of dietary assessment tools in randomized trials on diet-based interventions in pregnancy by a systematic review. We updated our previous search (until January 2012) on trials of diet and lifestyle interventions in pregnancy using Medline and EMBASE up to December 2015. Two independent reviewers undertook study selection and data extraction. We assessed the characteristics of dietary assessment tools, the timing and frequency of use and any validation undertaken.Two-thirds (39/58, 67%) of the included studies used some form of tools to assess dietary intake. Multiple days' food diaries were the most commonly used (23/39, 59%). Three studies (3/39, 8%) validated the used tools in a pregnant population. Three studies (3/39, 8%) prespecified the criteria for adherence to the intervention. The use of dietary assessment tools was not associated with study quality, year of publication, journal impact factor, type of journal and the study sample size. Although self-reporting dietary assessment tools are widely used in interventional dietary trials in pregnancy, the quality and applicability of existing tools are low.

Systematic overview and critical appraisal of meta-analyses of interventions in intensive care medicine.

PubMed

Koster, T M; Wetterslev, J; Gluud, C; Keus, F; van der Horst, I C C

2018-05-24

Meta-analysed intervention effect estimates are perceived to represent the highest level of evidence. However, such effects and the randomized clinical trials which are included in them need critical appraisal before the effects can be trusted. Critical appraisal of a predefined set of all meta-analyses on interventions in intensive care medicine to assess their quality and assessed the risks of bias in those meta-analyses having the best quality. We conducted a systematic search to select all meta-analyses of randomized clinical trials on interventions used in intensive care medicine. Selected meta-analyses were critically appraised for basic scientific criteria, (1) presence of an available protocol, (2) report of a full search strategy, and (3) use of any bias risk assessment of included trials. All meta-analyses which qualified these criteria were scrutinized by full "Risk of Bias in Systematic Reviews" ROBIS evaluation of 4 domains of risks of bias, and a "Preferred Reporting Items for Systematic Reviews and Meta-Analyses" PRISMA evaluation. We identified 467 meta-analyses. A total of 56 meta-analyses complied with these basic scientific criteria. We scrutinized the risks of bias in the 56 meta-analyses by full ROBIS evaluation and a PRISMA evaluation. Only 4 meta-analyses scored low risk of bias in all the 4 ROBIS domains and 41 meta-analyses reported all 27 items of the PRISMA checklist. In contrast with what might be perceived as the highest level of evidence only 0.9% of all meta-analyses were judged to have overall low risk of bias. © 2018 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Maternal Use of Weight Loss Products and the Risk of Neural Tube Defects in Offspring: A Systematic Literature Review.

PubMed

Hoang, Thanh T; Agopian, A J; Mitchell, Laura E

2018-01-15

Several studies have assessed potential associations between use of weight loss products in the periconceptional period and neural tube defects (NTDs). However, the individual studies are inconclusive and there has not been a systematic review of this literature. We conducted a systematic search, using Ovid MEDLINE and PubMed, to identify studies that evaluated the association between products used for weight loss and the risk of NTDs. Because many studies of birth defects only evaluate a composite birth defect outcome, we evaluated studies that defined the outcome as "any major birth defect" or as NTDs. We abstracted data on study design, exposure definition, outcome definition, covariates and effect size estimates from each article that met our inclusion criteria. For studies that evaluated a composite birth defect outcome, we also abstracted the number of NTD cases included in the composite outcome. We used a modified version of the Newcastle-Ottawa Scale to assess the quality of each article. We screened 865 citations and identified nine articles that met our inclusion criteria. The majority of studies reported positive associations between maternal use of weight loss products and birth defects (overall and NTDs). However, there were few significant associations and there was considerable heterogeneity in the specific exposures assessed across the nine studies. Our systematic review of weight loss products and NTDs indicates that the literature on this topic is sparse. Because several studies reported modest, positive associations between risk and use of weight loss products, additional studies are warranted. Birth Defects Research 110:48-55, 2018. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Anorexia nervosa and cancer: a protocol for a systematic review and meta-analysis of observational studies.

PubMed

Catalá-López, Ferrán; Hutton, Brian; Driver, Jane A; Ridao, Manuel; Valderas, José M; Gènova-Maleras, Ricard; Forés-Martos, Jaume; Alonso-Arroyo, Adolfo; Saint-Gerons, Diego Macías; Vieta, Eduard; Valencia, Alfonso; Tabarés-Seisdedos, Rafael

2017-07-11

Anorexia nervosa is characterized by a severe restriction of caloric intake, low body weight, fear of gaining weight or of becoming fat, and disturbance of body image. Pathogenesis of the disorder may include genetic predisposition, hormonal changes and a combination of environmental, psychosocial, and cultural factors. Cancer is the second leading cause of death worldwide. At present, no systematic reviews and meta-analyses have evaluated the risk of cancer in people with anorexia nervosa. The objective of this study will be to evaluate the association between anorexia nervosa and the risk of developing or dying from cancer. This study protocol is part of a systematic collection and assessment of multiple systematic reviews and meta-analyses (umbrella review) evaluating the association of cancer and multiple central nervous system disorders. We designed a specific protocol for a new systematic review and meta-analysis of observational studies of anorexia nervosa with risk of developing or dying from any cancer. Data sources will be PubMed, Embase, Scopus, Web of Science, and manual screening of references. Observational studies (case-control and cohort) in humans that examined the association between anorexia nervosa and risk of developing or dying from cancer will be sought. The primary outcomes will be cancer incidence and cancer mortality in association with anorexia nervosa. Secondary outcomes will be site-specific cancer incidence and mortality, respectively. Screening of abstracts and full texts, and data abstraction will be performed by two team members independently. Conflicts at all levels of screening and abstraction will be resolved through discussion. The quality of studies will be assessed by using the Ottawa-Newcastle scale by two team members independently. Random effects models will be conducted where appropriate. Subgroup and additional analyses will be conducted to explore the potential sources of heterogeneity. The World Cancer Research Fund (WCRF)/American Institute for Cancer Research (AICR) criteria and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach will be used for determining the quality of evidence for cancer outcomes. Findings from this systematic review will inform an ongoing umbrella review on cancer and central nervous system disorders. Our systematic review and meta-analysis of observational studies will establish the extent of the epidemiological evidence underlying the association between anorexia nervosa and cancer. PROSPERO CRD42017067462.

Communication skills assessment in the final postgraduate years to established practice: a systematic review.

PubMed

Gillis, Amy E; Morris, Marie C; Ridgway, Paul F

2015-01-01

Communication breakdown is a factor in the majority of all instances of medical error. Despite the importance, a relative paucity of time is invested in communication skills in postgraduate curricula. Our objective is to systematically review the literature to identify the current tools used to assess communication skills in postgraduate trainees in the latter 2 years of training and in established practice. Two reviewers independently reviewed the literature identifying communication skill assessment tools, for postgraduate trainees in the latter 2 years of training and in established practice following Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, and inclusion/exclusion criteria from January 1990 to 15 August 2014. PubMed/CINAHL/ERIC/EMBASE/PsycInfo/Psyc Articles/Cochrane. 222 articles were identified; after review, 34 articles fulfilled criteria for complete evaluation; the majority (26) had a high level of evidence scoring 3 or greater on the Best Evidence Medical Education guide. 22 articles used objective structured clinical examination/standardised patient (SP)-based formats in an assessment or training capacity. Evaluation tools included author-developed questionnaires and validated tools. Nineteen articles demonstrated an educational initiative. The reviewed literature is heterogeneous for objectives and measurement techniques for communication. Observed interactions, with patients or SPs, is the current favoured method of evaluation using author-developed questionnaires. The role of self-evaluation of skill level is questioned. The need for a validated assessment tool for communication skills is highlighted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Disability Policy Evaluation: Combining Logic Models and Systems Thinking

ERIC Educational Resources Information Center

Claes, Claudia; Ferket, Neelke; Vandevelde, Stijn; Verlet, Dries; De Maeyer, Jessica

2017-01-01

Policy evaluation focuses on the assessment of policy-related personal, family, and societal changes or benefits that follow as a result of the interventions, services, and supports provided to those persons to whom the policy is directed. This article describes a systematic approach to policy evaluation based on an evaluation framework and an…

Test Selection, Adaptation, and Evaluation: A Systematic Approach to Assess Nutritional Influences on Child Development in Developing Countries

ERIC Educational Resources Information Center

Prado, Elizabeth L.; Hartini, Sri; Rahmawati, Atik; Ismayani, Elfa; Hidayati, Astri; Hikmah, Nurul; Muadz, Husni; Apriatni, Mandri S.; Ullman, Michael T.; Shankar, Anuraj H.; Alcock, Katherine J.

2010-01-01

Background: Evaluating the impact of nutrition interventions on developmental outcomes in developing countries can be challenging since most assessment tests have been produced in and for developed country settings. Such tests may not be valid measures of children's abilities when used in a new context. Aims: We present several principles for the…

METHODOLOGICAL QUALITY OF ECONOMIC EVALUATIONS ALONGSIDE TRIALS OF KNEE PHYSIOTHERAPY.

PubMed

García-Pérez, Lidia; Linertová, Renata; Arvelo-Martín, Alejandro; Guerra-Marrero, Carolina; Martínez-Alberto, Carlos Enrique; Cuéllar-Pompa, Leticia; Escobar, Antonio; Serrano-Aguilar, Pedro

2017-01-01

The methodological quality of an economic evaluation performed alongside a clinical trial can be underestimated if the paper does not report key methodological features. This study discusses methodological assessment issues on the example of a systematic review on cost-effectiveness of physiotherapy for knee osteoarthritis. Six economic evaluation studies included in the systematic review and related clinical trials were assessed using the 10-question check-list by Drummond and the Physiotherapy Evidence Database (PEDro) scale. All economic evaluations were performed alongside a clinical trial but the studied interventions were too heterogeneous to be synthesized. Methodological quality of the economic evaluations reported in the papers was not free of drawbacks, and in some cases, it improved when information from the related clinical trial was taken into account. Economic evaluation papers dedicate little space to methodological features of related clinical trials; therefore, the methodological quality can be underestimated if evaluated separately from the trials. Future economic evaluations should follow more strictly the recommendations about methodology and the authors should pay special attention to the quality of reporting.

The Discrepancy Evaluation Model: A Systematic Approach for the Evaluation of Career Planning and Placement Programs.

ERIC Educational Resources Information Center

Buttram, Joan L.; Covert, Robert W.

The Discrepancy Evaluation Model (DEM), developed in 1966 by Malcolm Provus, provides information for program assessment and program improvement. Under the DEM, evaluation is defined as the comparison of an actual performance to a desired standard. The DEM embodies five stages of evaluation based upon a program's natural development: program…

Preoperative evaluation in infants and children: recommendations of the Italian Society of Pediatric and Neonatal Anesthesia and Intensive Care (SARNePI).

PubMed

Serafini, G; Ingelmo, P M; Astuto, M; Baroncini, S; Borrometi, F; Bortone, L; Ceschin, C; Gentili, A; Lampugnani, E; Mangia, G; Meneghini, L; Minardi, C; Montobbio, G; Pinzoni, F; Rosina, B; Rossi, C; Sahillioğlu, E; Sammartino, M; Sonzogni, R; Sonzogni, V; Tesoro, S; Tognon, C; Zadra, N

2014-04-01

The preoperative assessment involves the process of evaluating the patient's clinical condition, which is intended to define the physical status classification, eligibility for anesthesia and the risks associated with it, thus providing elements to select the most appropriate and individualized anesthetic plan. The aim of this recommendation was provide a framework reference for the preoperative evaluation assessment of pediatric patients undergoing elective surgery or diagnostic/therapeutic procedures. We obtained evidence concerning pediatric preoperative evaluation from a systematic search of the electronic databases MEDLINE and Embase between January 1998 and February 2012. We used the format developed by the Italian Center for Evaluation of the Effectiveness of Health Care's scoring system for assessing the level of evidence and strength of recommendations. We produce a set of consensus guidelines on the preoperative assessment and on the request for preoperative tests. A review of the existing literature supporting these recommendations is provided. In reaching consensus, emphasis was placed on the level of evidence, clinical relevance and the risk/benefit ratio. Preoperative evaluation is mandatory before any diagnostic or therapeutic procedure that requires the use of anesthesia or sedation. The systematic prescription of complementary tests in children should be abandoned, and replaced by a selective and rational prescription, based on the patient history and clinical examination performed during the preoperative evaluation.

Pain assessment tools: is the content appropriate for use in palliative care?

PubMed

Hølen, Jacob Chr; Hjermstad, Marianne Jensen; Loge, Jon Håvard; Fayers, Peter M; Caraceni, Augusto; De Conno, Franco; Forbes, Karen; Fürst, Carl Johan; Radbruch, Lukas; Kaasa, Stein

2006-12-01

Inadequate pain assessment prevents optimal treatment in palliative care. The content of pain assessment tools might limit their usefulness for proper pain assessment, but data on the content validity of the tools are scarce. The objective of this study was to examine the content of the existing pain assessment tools, and to evaluate the appropriateness of different dimensions and items for pain assessment in palliative care. A systematic search was performed to find pain assessment tools for patients with advanced cancer who were receiving palliative care. An ad hoc search with broader search criteria supplemented the systematic search. The items of the identified tools were allocated to appropriate dimensions. This was reviewed by an international panel of experts, who also evaluated the relevance of the different dimensions for pain assessment in palliative care. The systematic literature search generated 16 assessment tools while the ad hoc search generated 64. Ten pain dimensions containing 1,011 pain items were identified by the experts. The experts ranked intensity, temporal pattern, treatment and exacerbating/relieving factors, location, and interference with health-related quality of life as the most important dimensions. None of the assessment tools covered these dimensions satisfactorily. Most items were related to interference (231) and intensity (138). Temporal pattern (which includes breakthrough pain), ranked as the second most important dimension, was covered by 29 items only. Many tools include dimensions and items of limited relevance for patients with advanced cancer. This might reduce compliance and threaten the validity of the assessment. New tools should reflect the clinical relevance of different dimensions and be user-friendly.

An Ecological Perspective on Learning Progressions as Road Maps for Learning

ERIC Educational Resources Information Center

Engelhard, George, Jr.; Sullivan, Rubye K.

2011-01-01

The Black, Wilson, and Yao (this issue) provide a wide-ranging commentary and vision of the interrelationships among curriculum, pedagogy, and assessment. Specifically, they describe how the Berkeley Evaluation & Assessment Research (BEAR) Center Assessment System can be used to integrate and systematize these areas. This commentary focuses on…

Evaluation of Contextual Variability in Prediction of Reinforcer Effectiveness

ERIC Educational Resources Information Center

Pino, Olimpia; Dazzi, Carla

2005-01-01

Previous research has shown that stimulus preference assessments based on caregiver-opinion did not coincide with results of a more systematic method of assessing reinforcing value unless stimuli that were assessed to represent preferences were also preferred on paired stimulus presentation format, and that the relative preference based on the…

Developmental Assessment with Young Children: A Systematic Review of Battelle Studies

ERIC Educational Resources Information Center

Cunha, Ana C. B.; Berkovits, Michelle D.; Albuquerque, Karolina A.

2018-01-01

Developmental assessment scales are important tools for determining developmental delays and planning preventive interventions. One broad assessment scale used to evaluate child development is the Battelle Developmental Inventories (BDIs). The BDI-2 has a standardized version in English with good psychometric properties and a translated version in…

Prompt and Rater Effects in Second Language Writing Performance Assessment

ERIC Educational Resources Information Center

Lim, Gad S.

2009-01-01

Performance assessments have become the norm for evaluating language learners' writing abilities in international examinations of English proficiency. Two aspects of these assessments are usually systematically varied: test takers respond to different prompts, and their responses are read by different raters. This raises the possibility of undue…

A systematic review of novel technology for monitoring infant and newborn heart rate.

PubMed

Kevat, Ajay C; Bullen, Denise V R; Davis, Peter G; Kamlin, C Omar F

2017-05-01

Heart rate (HR) is a vital sign for assessing the need for resuscitation. We performed a systematic review of studies assessing novel methods of measuring HR in newborns and infants in the neonatal unit. Two investigators completed independent literature searches. Identified papers were independently evaluated, and relevant data were extracted and analysed. This systematic review identified seven new technologies, including camera-based photoplethysmography, reflectance pulse oximetry, laser Doppler methods, capacitive sensors, piezoelectric sensors, electromyography and a digital stethoscope. Clinicians should be aware of several of these, which may become available for clinical use in the near future. ©2017 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

Assessing medical professionalism: A systematic review of instruments and their measurement properties.

PubMed

Li, Honghe; Ding, Ning; Zhang, Yuanyuan; Liu, Yang; Wen, Deliang

2017-01-01

Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments' measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990-2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument's usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee's criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar's instrument for nursing students, Nurse Practitioners' Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies.

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature.

PubMed

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability.

Comparative Effectiveness of Dental Anatomy Carving Pedagogy: A Systematic Review.

PubMed

de Azevedo, Renato de A; da Rosa, Wellington Luiz de O; da Silva, Adriana F; Correa, Marcos B; Torriani, Marcos A; Lund, Rafael G

2015-08-01

The aim of this study was to review the effectiveness of methods used for teaching dental anatomy carving to dental students in operative dentistry as evaluated in published studies. This systematic review is described in accordance with the PRISMA statement. Two independent reviewers performed a systematic literature search of research published from January 1945 until May 2014. Seven databases were screened: MedLine (PubMed), Lilacs, IBECS, Web of Science, Scopus, SciELO, and The Cochrane Library. After removing duplicates, only studies using dental carving to assess the practical knowledge of anatomy were selected. The tabulated data were organized by title of article, names of authors, number of students assessed, assessment method, material used, groups tested, main results, and conclusions. The methodology quality was assessed according to the Cochrane Handbook for Systematic Reviews of Interventions. Initially, 2,258 studies were identified in all databases. Five articles met the eligibility criteria and were included in this review. According to these studies, the geometric method, teaching step-by-step along with the teacher, and adjuvant methods such as the use of tutors and teaching through digital media with DVDs proved to be effective in improving learning. There is no standard technique that is widely accepted for the teaching of dental carving, nor is there an appropriately validated method of evaluation to verify whether the teaching methods used are effective for the acquisition of skills and expertise in dental anatomy by students.

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery

PubMed Central

Gudlaugsdottir, Katrin; Andrews, James

2017-01-01

Objective Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality. Background Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated. Methods Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality. Results 112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression. Conclusions There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians. PMID:28384296

Real-Time Data Capture and Management Evaluation and Performance Measures : Evaluation Framework

DOT National Transportation Integrated Search

2011-09-01

Through connected vehicle research, the U.S. DOT Intelligent Transportation Systems Joint Program Office (ITS JPO) is leading an effort to assess the potential for systematic and dynamic data capture from vehicles, travelers and the transportation sy...

Accuracy of the Alberta Infant Motor Scale (AIMS) to detect developmental delay of gross motor skills in preterm infants: a systematic review.

PubMed

de Albuquerque, Plínio Luna; Lemos, Andrea; Guerra, Miriam Queiroz de Farias; Eickmann, Sophie Helena

2015-02-01

To assess, through a systematic review, the ability of Alberta Infant Motor Scale (AIMS) to diagnose delayed motor development in preterm infants. Systematic searches identified five studies meeting inclusion criteria. These studies were evaluated in terms of: participants' characteristics, main results and risk of bias. The risk of bias was assessed with the Quality Assessment of Diagnostic Accuracy Studies--second edition (QUADAS-2). All five studies included a high risk of bias in at least one of the assessed fields. The most frequent biases included were presented in patient selection and lost follow up. All studies used the Pearson correlation coefficient to assess the diagnostic capability of the Alberta Infant Motor Scale. None of the assessed studies used psychometric measures to analyze the data. Given the evidence, the research supporting the ability of Alberta Infant Motor Scale to diagnose delayed motor development in preterm infants presents limitations. Further studies are suggested in order to avoid the above-mentioned biases to assess the Alberta Infant Motor Scale accuracy in preterm babies.

Physical examination tests for the diagnosis of posterior cruciate ligament rupture: a systematic review.

PubMed

Kopkow, Christian; Freiberg, Alice; Kirschner, Stephan; Seidler, Andreas; Schmitt, Jochen

2013-11-01

Systematic literature review. To summarize and evaluate research on the accuracy of physical examination tests for diagnosis of posterior cruciate ligament (PCL) tear. Rupture of the PCL is a severe knee injury that can lead to delayed rehabilitation, instability, or chronic knee pathologies. To our knowledge, there is currently no systematic review of studies on the diagnostic accuracy of clinical examination tests to evaluate the integrity of the PCL. A comprehensive systematic literature search was conducted in MEDLINE from 1946, Embase from 1974, and the Allied and Complementary Medicine Database from 1985 until April 30, 2012. Studies were considered eligible if they compared the results of physical examination tests performed in the context of a PCL physical examination to those of a reference standard (arthroscopy, arthrotomy, magnetic resonance imaging). Methodological quality assessment was performed by 2 independent reviewers using the revised version of the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. The search strategy revealed 1307 articles, of which 11 met the inclusion criteria for this review. In these studies, 11 different physical examination tests were identified. Due to differences in study types, different patient populations, and methodological quality, meta-analysis was not indicated. Presently, most physical examination tests have not been evaluated sufficiently enough to be confident in their ability to either confirm or rule out a PCL tear. The diagnostic accuracy of physical examination tests to assess the integrity of the PCL is largely unknown. There is a strong need for further research in this area. Level of Evidence Diagnosis, level 3a.

Expert Involvement and Adherence to Medical Evidence in Medical Mobile Phone Apps: A Systematic Review.

PubMed

Subhi, Yousif; Bube, Sarah Hjartbro; Rolskov Bojsen, Signe; Skou Thomsen, Ann Sofia; Konge, Lars

2015-07-27

Both clinicians and patients use medical mobile phone apps. Anyone can publish medical apps, which leads to contents with variable quality that may have a serious impact on human lives. We herein provide an overview of the prevalence of expert involvement in app development and whether or not app contents adhere to current medical evidence. To systematically review studies evaluating expert involvement or adherence of app content to medical evidence in medical mobile phone apps. We systematically searched 3 databases (PubMed, The Cochrane Library, and EMBASE), and included studies evaluating expert involvement or adherence of app content to medical evidence in medical mobile phone apps. Two authors performed data extraction independently. Qualitative analysis of the included studies was performed. Based on inclusion criteria, 52 studies were included in this review. These studies assessed a total of 6520 apps. Studies dealt with a variety of medical specialties and topics. As much as 28 studies assessed expert involvement, which was found in 9-67% of the assessed apps. Thirty studies (including 6 studies that also assessed expert involvement) assessed adherence of app content to current medical evidence. Thirteen studies found that 10-87% of the assessed apps adhered fully to the compared evidence (published studies, recommendations, and guidelines). Seventeen studies found that none of the assessed apps (n=2237) adhered fully to the compared evidence. Most medical mobile phone apps lack expert involvement and do not adhere to relevant medical evidence.

Virtual reality-based simulators for spine surgery: a systematic review.

PubMed

Pfandler, Michael; Lazarovici, Marc; Stefan, Philipp; Wucherer, Patrick; Weigl, Matthias

2017-09-01

Virtual reality (VR)-based simulators offer numerous benefits and are very useful in assessing and training surgical skills. Virtual reality-based simulators are standard in some surgical subspecialties, but their actual use in spinal surgery remains unclear. Currently, only technical reviews of VR-based simulators are available for spinal surgery. Thus, we performed a systematic review that examined the existing research on VR-based simulators in spinal procedures. We also assessed the quality of current studies evaluating VR-based training in spinal surgery. Moreover, we wanted to provide a guide for future studies evaluating VR-based simulators in this field. This is a systematic review of the current scientific literature regarding VR-based simulation in spinal surgery. Five data sources were systematically searched to identify relevant peer-reviewed articles regarding virtual, mixed, or augmented reality-based simulators in spinal surgery. A qualitative data synthesis was performed with particular attention to evaluation approaches and outcomes. Additionally, all included studies were appraised for their quality using the Medical Education Research Study Quality Instrument (MERSQI) tool. The initial review identified 476 abstracts and 63 full texts were then assessed by two reviewers. Finally, 19 studies that examined simulators for the following procedures were selected: pedicle screw placement, vertebroplasty, posterior cervical laminectomy and foraminotomy, lumbar puncture, facet joint injection, and spinal needle insertion and placement. These studies had a low-to-medium methodological quality with a MERSQI mean score of 11.47 out of 18 (standard deviation=1.81). This review described the current state and applications of VR-based simulator training and assessment approaches in spinal procedures. Limitations, strengths, and future advancements of VR-based simulators for training and assessment in spinal surgery were explored. Higher-quality studies with patient-related outcome measures are needed. To establish further adaptation of VR-based simulators in spinal surgery, future evaluations need to improve the study quality, apply long-term study designs, and examine non-technical skills, as well as multidisciplinary team training. Copyright © 2017 Elsevier Inc. All rights reserved.

Cost-Effectiveness of HBV and HCV Screening Strategies – A Systematic Review of Existing Modelling Techniques

PubMed Central

Geue, Claudia; Wu, Olivia; Xin, Yiqiao; Heggie, Robert; Hutchinson, Sharon; Martin, Natasha K.; Fenwick, Elisabeth; Goldberg, David

2015-01-01

Introduction Studies evaluating the cost-effectiveness of screening for Hepatitis B Virus (HBV) and Hepatitis C Virus (HCV) are generally heterogeneous in terms of risk groups, settings, screening intervention, outcomes and the economic modelling framework. It is therefore difficult to compare cost-effectiveness results between studies. This systematic review aims to summarise and critically assess existing economic models for HBV and HCV in order to identify the main methodological differences in modelling approaches. Methods A structured search strategy was developed and a systematic review carried out. A critical assessment of the decision-analytic models was carried out according to the guidelines and framework developed for assessment of decision-analytic models in Health Technology Assessment of health care interventions. Results The overall approach to analysing the cost-effectiveness of screening strategies was found to be broadly consistent for HBV and HCV. However, modelling parameters and related structure differed between models, producing different results. More recent publications performed better against a performance matrix, evaluating model components and methodology. Conclusion When assessing screening strategies for HBV and HCV infection, the focus should be on more recent studies, which applied the latest treatment regimes, test methods and had better and more complete data on which to base their models. In addition to parameter selection and associated assumptions, careful consideration of dynamic versus static modelling is recommended. Future research may want to focus on these methodological issues. In addition, the ability to evaluate screening strategies for multiple infectious diseases, (HCV and HIV at the same time) might prove important for decision makers. PMID:26689908

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review.

PubMed

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; "simulation," "practice," "drill," "exercise," "instrument," "tool," "questionnaire," " measurement," "checklist," "scale," "test," "inventory," "battery," "evaluation," "assessment," "appraisal," "emergency," "disaster," "cricise," "hazard," "catastrophe,: "hospital", "prehospital," "health centers," "treatment centers," were used in combination with Boolean operators OR and AND. The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages.

Health information systems evaluation frameworks: A systematic review.

PubMed

Eslami Andargoli, Amirhossein; Scheepers, Helana; Rajendran, Diana; Sohal, Amrik

2017-01-01

Evaluation of health information systems (HISs) is complicated because of the complex nature of the health care domain. Various studies have proposed different frameworks to reduce the complexity in the assessment of these systems. The aim of these frameworks is to provide a set of guidelines for the evaluation of the adequacy of health care information systems. This paper aims to analyse studies on the evaluation of HISs by applying a content, context and process (CCP) framework to address the 'who', 'what', 'how', 'when', and 'why' of the evaluation processes used. This will allow for a better understanding of the relative strengths and weaknesses of various HISs evaluation frameworks, and will pave the way for developing a more complete framework for HISs. A systematic literature review on HIS evaluation studies was undertaken to identify the currently available HIS evaluation frameworks. Five academic databases were selected to conduct this systematic literature review. Most of the studies only address some, but not all, of the five main questions, i.e. the who, what, how, when, why, and that there was a lack of consensus in the way these questions were addressed. The critical role of context was also largely neglected in these studies. Evaluation of HISs is complex. The health care domain is highly context sensitive and in order to have a complete assessment of HISs, consideration of contextual factors is necessary. Specifically, to have the right set of criteria to measure the 'what', the answer to the 'who' of the evaluation is necessary. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluating information skills training in health libraries: a systematic review.

PubMed

Brettle, Alison

2007-12-01

Systematic reviews have shown that there is limited evidence to demonstrate that the information literacy training health librarians provide is effective in improving clinicians' information skills or has an impact on patient care. Studies lack measures which demonstrate validity and reliability in evaluating the impact of training. To determine what measures have been used; the extent to which they are valid and reliable; to provide guidance for health librarians who wish to evaluate the impact of their information skills training. Systematic review methodology involved searching seven databases, and personal files. Studies were included if they were about information skills training, used an objective measure to assess outcomes, and occurred in a health setting. Fifty-four studies were included in the review. Most outcome measures used in the studies were not tested for the key criteria of validity and reliability. Three tested for validity and reliability are described in more detail. Selecting an appropriate measure to evaluate the impact of training is a key factor in carrying out any evaluation. This systematic review provides guidance to health librarians by highlighting measures used in various circumstances, and those that demonstrate validity and reliability.

Yoga for Health Care in Korea: A Protocol for Systematic Review of Clinical Trials.

PubMed

Choi, Jiae; Jun, Ji Hee; Lee, Ju Ah; Lee, Myeong Soo

2016-08-01

This systematic review aims to evaluate the therapeutic effects of yoga therapy using an evidence-based approach and investigates the relationship between yoga and the meridian energies based on all available clinical studies in Korea. Sixteen electronic databases will be searched from the inception of the study until January 2016. All clinical evidences that evaluate any type of yoga and any type of control in individuals with any type of condition will be eligible. The methodological quality will be assessed using the Cochrane risk of bias tool for randomized clinical trials and the Newcastle-Ottawa scale for nonrandomized studies. Two authors will independently assess each study for eligibility and the risk of bias, and then they will extract the data. With its extensive, unbiased search of the Korean literature from various databases without any language restrictions, this systematic review will be useful for both practitioners in the field of yoga research as well as for patients. Copyright © 2016. Published by Elsevier B.V.

Adverse drug reactions due to drug-drug interactions with proton pump inhibitors: assessment of systematic reviews with AMSTAR method.

PubMed

Yucel, Emre; Sancar, Mesut; Yucel, Aylin; Okuyan, Betul

2016-01-01

Many systematic reviews resulted in claims on drug-drug interactions (DDIs) with proton pump inhibitors (PPIs). Such a large number begs for consensus on the clinical significance of findings. We critically evaluated the safety of PPI use with respect to DDIs with a meta-review of systematic reviews published between 1978 and 2015. We assessed the evidence by their reliability, repeatability, transparency, and objectivity according to the Assessment of Multiple Systematic Reviews (AMSTAR) criteria. Clinicians must assess risks for each PPI for certain comorbid conditions. DDIs don't substantiate class effect for PPIs; each PPI could induce unique DDIs. Concomitant use of PPIs with thienopyridines (e.g. clopidogrel) could be justified in patients without strong affinity to cytochrome CYP2C19 and with high risk of bleeding (e.g. patients with prior upper gastrointestinal bleeding, Helicobacter pylori infection, advanced age, steroid treatment, and nonsteroidal anti-inflammatory drug use). DDIs could occur in an AIDS subpopulation treated with highly active antiretroviral therapy (HAART). DDIs exist for cancer patients undergoing targeted therapy. Hypomagnesemia could increase in the setting of advanced age and polypharmacy. Omeprazole poses high risks owing to its pharmacokinetic DDI profile. Future systematic reviews should incorporate these additional risks for better clinical guidance.

A Systematic Review of the Use of Self-Assessment in Preclinical and Clinical Dental Education.

PubMed

Mays, Keith A; Branch-Mays, Grishondra L

2016-08-01

A desired outcome of dental and dental hygiene programs is the development of students' self-assessment skills. To that end, the Commission on Dental Accreditation states that "graduates must demonstrate the ability to self-assess." However, it is unclear that merely providing opportunity for self-assessment actually leads to the desired outcome. The aim of this study was to systematically review the literature on self-assessment in dental education. A search of English-language articles for the past 25 years (January 1, 1990, to June 30, 2015) was performed using MEDLINE Medical Subject Heading terms. Each abstract and/or article was validated for inclusion. The data collected included student classification, self-assessment environment, faculty assessment, training, faculty calibration, predictive value, and student perceptions. A qualitative analysis was also performed. From an initial list of 258 articles, 19 were selected for inclusion; exclusion criteria included studies that evaluated a non-preclinical or non-clinical exercise or whose subjects were not predoctoral dental or dental hygiene students. The results showed limited information regarding any kind of systematic training of students on how to perform a self-assessment. The majority of the studies also did not specify the impact of self-assessment on student performance. Self-assessment was primarily performed in the second year and in the preclinical environment. Students received feedback through a correlated faculty assessment in 73% of the studies, but 64% did not provide information regarding students' perceptions of self-assessment. There was a trend for students to be better self-assessors in studies in which a grade was connected to the process. In addition, there was a trend for better performing students to underrate themselves and for poorer performing students to overrate themselves and, overall, for students to score themselves higher than did their faculty evaluators. These findings suggest the need for greater attention to systematically teaching self-assessment in dental and dental hygiene curricula and for further research on the impact of self-assessment on desired outcomes.

Economic evaluations of angiotensin-converting enzyme inhibitors and angiotensin II receptor blockers in type 2 diabetic nephropathy: a systematic review

PubMed Central

2014-01-01

Background Structured comparison of pharmacoeconomic analyses for ACEIs and ARBs in patients with type 2 diabetic nephropathy is still lacking. This review aims to systematically review the cost-effectiveness of both ACEIs and ARBs in type 2 diabetic patients with nephropathy. Methods A systematic literature search was performed in MEDLINE and EMBASE for the period from November 1, 1999 to Oct 31, 2011. Two reviewers independently assessed the quality of the articles included and extracted data. All cost-effectiveness results were converted to 2011 Euros. Results Up to October 2011, 434 articles were identified. After full-text checking and quality assessment, 30 articles were finally included in this review involving 39 study settings. All 6 ACEIs studies were literature-based evaluations which synthesized data from different sources. Other 33 studies were directed at ARBs and were designed based on specific trials. The Markov model was the most common decision analytic method used in the evaluations. From the cost-effectiveness results, 37 out of 39 studies indicated either ACEIs or ARBs were cost-saving comparing with placebo/conventional treatment, such as amlodipine. A lack of evidence was assessed for valid direct comparison of cost-effectiveness between ACEIs and ARBs. Conclusion There is a lack of direct comparisons of ACEIs and ARBs in existing economic evaluations. Considering the current evidence, both ACEIs and ARBs are likely cost-saving comparing with conventional therapy, excluding such RAAS inhibitors. PMID:24428868

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

PubMed Central

Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.

2018-01-01

Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality. PMID:29750807

Evaluating Tasks for Performance-Based Assessments: Advice for Music Teachers

ERIC Educational Resources Information Center

Scott, Sheila

2004-01-01

Performance-based assessments allow teachers to systematically observe skills used or demonstrated by students when they create a product, construct a response, or make a presentation (McMillan 2001). These assessments are grounded in performance-based tasks that elicit students' responses in relation to the outcomes of instruction. The criteria…

Characterizing and Assessing Co-Curricular Activities for Graduate and Professional-School Students: Exploring the Value of Intentional Assessment Planning and Practice

ERIC Educational Resources Information Center

Waryas, Diane E.

2015-01-01

This chapter explores the importance of systematic evaluation of co-curricular activities directed at graduate- and professional- school students. Approaches to assessment and benefits of sound practice are presented along with the critical role that institutional researchers can play.

The Effectiveness of Using a Multiple Gating Approach to Discriminate among ADHD Subtypes

ERIC Educational Resources Information Center

Simonsen, Brandi M.; Bullis, Michael D.

2007-01-01

This study explored the ability of Systematically Progressive Assessment (SPA), a multiple gating approach for assessing students with attention-deficit/hyperactivity disorder (ADHD), to discriminate between subtypes of ADHD. A total of 48 students with ADHD (ages 6-11) were evaluated with three "gates" of assessment. Logistic regression analysis…

Economic evaluations of comprehensive geriatric assessment in surgical patients: a systematic review.

PubMed

Eamer, Gilgamesh; Saravana-Bawan, Bianka; van der Westhuizen, Brenden; Chambers, Thane; Ohinmaa, Arto; Khadaroo, Rachel G

2017-10-01

Seniors presenting with surgical disease face increased risk of postoperative morbidity and mortality and have increased treatment costs. Comprehensive Geriatric Assessment (CGA) is proposed to reduce morbidity, mortality, and the cost after surgery. A systematic review of CGA in emergency surgical patients was conducted. The primary outcome was cost-effectiveness; secondary outcomes were length of stay, return of function, and mortality. Inclusion and exclusion criteria were predefined. Systematic searches of MEDLINE, Embase, Cochrane, and National Health Service Economic Evaluation Database were performed. Text screening, bias assessment, and data extraction were performed by two authors. There were 560 articles identified; abstract review excluded 499 articles and full-text review excluded 53 articles. Eight studies were included; one nonorthopedic trauma and seven orthopedic trauma studies. Bias assessment revealed moderate to high risk of bias for all studies. Economic evaluation assessment identified two high-quality studies and six moderate or low quality studies. Pooled analysis from four studies assessed loss of function; loss of function decreased in the experimental arm (odds ratio 0.92, 95% confidence interval [CI]: 0.88-0.97). Pooled results for length of stay from five studies found a significant decrease (mean difference: -1.17, 95% CI: -1.63 to -0.71) after excluding the nonorthopedic trauma study. Pooled mortality was significantly decreased in seven studies (risk ratio: 0.78, 95% CI: 0.67-0.90). All studies decreased cost and improved health outcomes in a cost-effective manner. CGA improved return of function and mortality with reduced cost or improved utility. Our review suggests that CGA is economically dominant and the most cost-effective care model for orthogeriatric patients. Further research should examine other surgical fields. Copyright © 2017 Elsevier Inc. All rights reserved.

Conceptualization and Assessment of Hypersexual Disorder: A Systematic Review of the Literature.

PubMed

Montgomery-Graham, Stephanie

2017-04-01

Despite the rejection of hypersexual disorder (HD) as a new diagnosis in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), clinical and research interest in HD continues. To systematically review the existing scientific literature on the conceptualization and assessment of HD and out-of-control sexual behavior. Studies were identified from PsychInfo, PubMed, JSTOR, Google Scholar, and Scholar's Portal using an exhaustive list of key terms. Of 299 total articles identified and screened, 252 were excluded, and 47 are included in this review. To review two categories of articles: HD conceptualization and HD psychometric assessment. First, results of the review of theoretical conceptualizations of HD reflected a large proportion of the peer-reviewed literature devoted to discussing conceptualizations of HD without reaching consensus. Second, results of the review of HD psychometric assessments were analyzed using Hunsley and Mash's (2008) criteria to evaluate psychometric adequacy of evidence-based assessment measurements. The six most researched measurements of HD were evaluated, including the Hypersexual Disorder Screening Inventory, the Hypersexual Behavior Inventory, the Sexual Compulsivity Scale, the Sexual Addiction Screening Test, the Sexual Addiction Screening Test-Revised, and the Compulsive Sexual Behavior Inventory. Psychometric properties of the scales are reviewed, evaluated, and discussed. The Hypersexual Disorder Screening Inventory, the measurement proposed for the clinical screening of HD by the DSM-5 workgroup, currently has the strongest psychometric support. Future research and clinical directions are discussed in light of findings after the literature review and synthesis. Montgomery-Graham S. Conceptualization and Assessment of Hypersexual Disorder: A Systematic Review of the Literature. Sex Med Rev 2017;5:146-162. Copyright © 2016 International Society for Sexual Medicine. Published by Elsevier Inc. All rights reserved.

Development and application of a new grey dynamic hierarchy analysis system (GDHAS) for evaluating urban ecological security.

PubMed

Shao, Chaofeng; Tian, Xiaogang; Guan, Yang; Ju, Meiting; Xie, Qiang

2013-05-21

Selecting indicators based on the characteristics and development trends of a given study area is essential for building a framework for assessing urban ecological security. However, few studies have focused on how to select the representative indicators systematically, and quantitative research is lacking. We developed an innovative quantitative modeling approach called the grey dynamic hierarchy analytic system (GDHAS) for both the procedures of indicator selection and quantitative assessment of urban ecological security. Next, a systematic methodology based on the GDHAS is developed to assess urban ecological security comprehensively and dynamically. This assessment includes indicator selection, driving force-pressure-state-impact-response (DPSIR) framework building, and quantitative evaluation. We applied this systematic methodology to assess the urban ecological security of Tianjin, which is a typical coastal super megalopolis and the industry base in China. This case study highlights the key features of our approach. First, 39 representative indicators are selected for the evaluation index system from 62 alternative ones available through the GDHAS. Second, the DPSIR framework is established based on the indicators selected, and the quantitative assessment of the eco-security of Tianjin is conducted. The results illustrate the following: urban ecological security of Tianjin in 2008 was in alert level but not very stable; the driving force and pressure subsystems were in good condition, but the eco-security levels of the remainder of the subsystems were relatively low; the pressure subsystem was the key to urban ecological security; and 10 indicators are defined as the key indicators for five subsystems. These results can be used as the basis for urban eco-environmental management.

Development and Application of a New Grey Dynamic Hierarchy Analysis System (GDHAS) for Evaluating Urban Ecological Security

PubMed Central

Shao, Chaofeng; Tian, Xiaogang; Guan, Yang; Ju, Meiting; Xie, Qiang

2013-01-01

Selecting indicators based on the characteristics and development trends of a given study area is essential for building a framework for assessing urban ecological security. However, few studies have focused on how to select the representative indicators systematically, and quantitative research is lacking. We developed an innovative quantitative modeling approach called the grey dynamic hierarchy analytic system (GDHAS) for both the procedures of indicator selection and quantitative assessment of urban ecological security. Next, a systematic methodology based on the GDHAS is developed to assess urban ecological security comprehensively and dynamically. This assessment includes indicator selection, driving force-pressure-state-impact-response (DPSIR) framework building, and quantitative evaluation. We applied this systematic methodology to assess the urban ecological security of Tianjin, which is a typical coastal super megalopolis and the industry base in China. This case study highlights the key features of our approach. First, 39 representative indicators are selected for the evaluation index system from 62 alternative ones available through the GDHAS. Second, the DPSIR framework is established based on the indicators selected, and the quantitative assessment of the eco-security of Tianjin is conducted. The results illustrate the following: urban ecological security of Tianjin in 2008 was in alert level but not very stable; the driving force and pressure subsystems were in good condition, but the eco-security levels of the remainder of the subsystems were relatively low; the pressure subsystem was the key to urban ecological security; and 10 indicators are defined as the key indicators for five subsystems. These results can be used as the basis for urban eco-environmental management. PMID:23698700

Fatigue in patients with low grade glioma: systematic evaluation of assessment and prevalence.

PubMed

van Coevorden-van Loon, Ellen M P; Coomans, Marijke B; Heijenbrok-Kal, Majanka H; Ribbers, Gerard M; van den Bent, Martin J

2017-06-01

Fatigue is the most prevalent and disabling symptom in cancer patients. Yet, scientific literature on this topic is scarce and reports disparate results. This study systematically reviews how fatigue is assessed in patients with low-grade glioma and evaluates its prevalence in LGG patients. A systematic literature search was performed in PubMed, Embase and PsychINFO for articles reporting on fatigue in patients with LGG. Two reviewers independently extracted data from selected articles. Inclusion criteria were: (1) patients with suspected or confirmed LGG; (2) fatigue was assessed as primary or secondary outcome measure; (3) age≥ 18 years; (4) full-length article written in English or Dutch. In total, 19 articles were selected, including 971 patients. Seven self-assessment instruments were identified. Prevalence rates ranged from 39 to 77%. Fatigue was found to be a common side effect of treatment. The prevalence rates ranged from 20 to 76% when fatigue was reported as a mild or moderate side effect and fatigue was prevalent in 4% when reported as a severe side effect. Fatigue is a common problem in LGG patients that warrants more therapeutic and scientific attention. Gaining deeper insight in the underlying mechanisms of fatigue is essential in targeting therapy to individual patients.

Assessing personal talent determinants in young racquet sport players: a systematic review.

PubMed

Faber, Irene R; Bustin, Paul M J; Oosterveld, Frits G J; Elferink-Gemser, Marije T; Nijhuis-Van der Sanden, Maria W G

2016-01-01

Since junior performances have little predictive value for future success, other solutions are sought to assess a young player's potential. The objectives of this systematic review are (1) to provide an overview of instruments measuring personal talent determinants of young players in racquet sports, and (2) to evaluate these instruments regarding their validity for talent development. Electronic searches were conducted in PubMed, PsychINFO, Web of Knowledge, ScienceDirect and SPORTDiscus (1990 to 31 March 2014). Search terms represented tennis, table tennis, badminton and squash, the concept of talent, methods of testing and children. Thirty articles with information regarding over 100 instruments were included. Validity evaluation showed that instruments focusing on intellectual and perceptual abilities, and coordinative skills discriminate elite from non-elite players and/or are related to current performance, but their predictive validity is not confirmed. There is moderate evidence that the assessments of mental and goal management skills predict future performance. Data on instruments measuring physical characteristics prohibit a conclusion due to conflicting findings. This systematic review yielded an ambiguous end point. The lack of longitudinal studies precludes verification of the instrument's capacity to forecast future performance. Future research should focus on instruments assessing multidimensional talent determinants and their predictive value in longitudinal designs.

A Systematic Approach for Real-Time Operator Functional State Assessment

NASA Technical Reports Server (NTRS)

Zhang, Guangfan; Wang, Wei; Pepe, Aaron; Xu, Roger; Schnell, Thomas; Anderson, Nick; Heitkamp, Dean; Li, Jiang; Li, Feng; McKenzie, Frederick

2012-01-01

A task overload condition often leads to high stress for an operator, causing performance degradation and possibly disastrous consequences. Just as dangerous, with automated flight systems, an operator may experience a task underload condition (during the en-route flight phase, for example), becoming easily bored and finding it difficult to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, the disengaged operator may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss an approach for Operator Functional State (OFS) monitoring in a typical aviation environment. A systematic ground truth finding procedure has been designed based on subjective evaluations, performance measures, and strong physiological indicators. The derived OFS ground truth is continuous in time compared to a very sparse estimation of OFS based on an expert review or subjective evaluations. It can capture the variations of OFS during a mission to better guide through the training process of the OFS assessment model. Furthermore, an OFS assessment model framework based on advanced machine learning techniques was designed and the systematic approach was then verified and validated with experimental data collected in a high fidelity Boeing 737 simulator. Preliminary results show highly accurate engagement/disengagement detection making it suitable for real-time applications to assess pilot engagement.

The Validity of Individual Rorschach Variables: Systematic Reviews and Meta-Analyses of the Comprehensive System

ERIC Educational Resources Information Center

Mihura, Joni L.; Meyer, Gregory J.; Dumitrascu, Nicolae; Bombel, George

2013-01-01

We systematically evaluated the peer-reviewed Rorschach validity literature for the 65 main variables in the popular Comprehensive System (CS). Across 53 meta-analyses examining variables against externally assessed criteria (e.g., observer ratings, psychiatric diagnosis), the mean validity was r = 0.27 (k = 770) as compared to r = 0.08 (k = 386)…

Safety of ceftriaxone in paediatrics: a systematic review protocol.

PubMed

Zeng, Linan; Choonara, Imti; Zhang, Lingli; Xue, Song; Chen, Zhe; He, Miaomiao

2017-08-21

Ceftriaxone is widely used in children in the treatment of sepsis. However, concerns have been raised about the safety of ceftriaxone, especially in young children. The aim of this review is to systematically evaluate the safety of ceftriaxone in children of all age groups. MEDLINE, PubMed, Cochrane Central Register of Controlled Trials, EMBASE, CINAHL, International Pharmaceutical Abstracts and adverse drug reaction (ADR) monitoring systems will be systematically searched for randomised controlled trials (RCTs), cohort studies, case-control studies, cross-sectional studies, case series and case reports evaluating the safety of ceftriaxone in children. The Cochrane risk of bias tool, Newcastle-Ottawa and quality assessment tools developed by the National Institutes of Health will be used for quality assessment. Meta-analysis of the incidence of ADRs from RCTs and prospective studies will be done. Subgroup analyses will be performed for age and dosage regimen. Formal ethical approval is not required as no primary data are collected. This systematic review will be disseminated through a peer-reviewed publication and at conference meetings. CRD42017055428. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Gastroesophageal reflux, dental erosion, and halitosis in epidemiological surveys: a systematic review.

PubMed

Marsicano, Juliane A; de Moura-Grec, Patrícia G; Bonato, Rafaela C S; Sales-Peres, Matheus de Carvalho; Sales-Peres, Arsenio; Sales-Peres, Sílvia Helena de Carvalho

2013-02-01

In published studies, it has been suggested that dental wear is associated with gastroesophageal reflux disease (GERD). This systematic review was carried out to evaluate the association of GERD, dental erosion, and halitosis and to compare the indices adopted in epidemiological surveys. The Medline database (until October, 2011) was searched systematically to identify studies evaluating the prevalence of oral alterations, such as dental erosion and halitosis, in patients with GERD symptoms. Two reviewers analyzed all reports and the selected studies were evaluated according to the quality of evidence, using the validated Newcastle-Ottawa Quality Assessment Scale. Full-text copies of a total of 32 publications were obtained in duplicate. Sixteen publications were identified among the citations in the Bibliographic lists of studies that fulfilled the exclusion/inclusion criteria and quality of evidence. The relationship between dental erosion and GERD patients was significant in only seven studies. According to three studies, halitosis could be one of several extraesophageal symptoms or manifestations in GERD patients. In one study, it was found that the mucosa of GERD patients was significantly more acidic in comparison with that of the control group. This systematic review showed that there is a relationship between GERD and oral diseases (dental erosion and halitosis). The epidemiological surveys used different indices to analyze GERD and dental erosion. Further research could investigate the best method for assessing the two diseases.

TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: content analysis and systematic review.

PubMed

Dall, P M; Coulter, E H; Fitzsimons, C F; Skelton, D A; Chastin, Sfm

2017-04-08

Sedentary behaviour (SB) has distinct deleterious health outcomes, yet there is no consensus on best practice for measurement. This study aimed to identify the optimal self-report tool for population surveillance of SB, using a systematic framework. A framework, TAxonomy of Self-reported Sedentary behaviour Tools (TASST), consisting of four domains (type of assessment, recall period, temporal unit and assessment period), was developed based on a systematic inventory of existing tools. The inventory was achieved through a systematic review of studies reporting SB and tracing back to the original description. A systematic review of the accuracy and sensitivity to change of these tools was then mapped against TASST domains. Systematic searches were conducted via EBSCO, reference lists and expert opinion. The inventory included tools measuring SB in adults that could be self-completed at one sitting, and excluded tools measuring SB in specific populations or contexts. The systematic review included studies reporting on the accuracy against an objective measure of SB and/or sensitivity to change of a tool in the inventory. The systematic review initially identified 32 distinct tools (141 questions), which were used to develop the TASST framework. Twenty-two studies evaluated accuracy and/or sensitivity to change representing only eight taxa. Assessing SB as a sum of behaviours and using a previous day recall were the most promising features of existing tools. Accuracy was poor for all existing tools, with underestimation and overestimation of SB. There was a lack of evidence about sensitivity to change. Despite the limited evidence, mapping existing SB tools onto the TASST framework has enabled informed recommendations to be made about the most promising features for a surveillance tool, identified aspects on which future research and development of SB surveillance tools should focus. International prospective register of systematic reviews (PROPSPERO)/CRD42014009851. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Economic evaluations of follow-up strategies for cancer survivors: a systematic review and quality appraisal of the literature.

PubMed

Meregaglia, Michela; Cairns, John

2015-01-01

The aim of this study was to review and critically assess the health economics literature on post-treatment follow-up for adult cancer survivors. A systematic search was performed using PubMed, EMBASE and the Cochrane Library. The Consolidated Health Economic Evaluation Reporting Standards checklist was adopted to assess the quality of the included studies. Thirty-nine articles met the eligibility criteria. Around two thirds of the studies addressed the most common cancers (i.e., breast, colorectal, cervical and lung); 21 were based on a single clinical study, while the rest were modeling papers. All types of economic evaluations were represented other than cost-benefit analysis. The overall quality was generally high with an average proportion of 74% of checklist criteria fulfilled. The cost-effectiveness results supported the current trend towards less intensive, primary care-based and risk-adapted follow-up schemes.

Measurement properties of self-report physical activity assessment tools in stroke: a protocol for a systematic review.

PubMed

Martins, Júlia Caetano; Aguiar, Larissa Tavares; Nadeau, Sylvie; Scianni, Aline Alvim; Teixeira-Salmela, Luci Fuscaldi; Faria, Christina Danielli Coelho de Morais

2017-02-13

Self-report physical activity assessment tools are commonly used for the evaluation of physical activity levels in individuals with stroke. A great variety of these tools have been developed and widely used in recent years, which justify the need to examine their measurement properties and clinical utility. Therefore, the main objectives of this systematic review are to examine the measurement properties and clinical utility of self-report measures of physical activity and discuss the strengths and limitations of the identified tools. A systematic review of studies that investigated the measurement properties and/or clinical utility of self-report physical activity assessment tools in stroke will be conducted. Electronic searches will be performed in five databases: Medical Literature Analysis and Retrieval System Online (MEDLINE) (PubMed), Excerpta Medica Database (EMBASE), Physiotherapy Evidence Database (PEDro), Literatura Latino-Americana e do Caribe em Ciências da Saúde (LILACS) and Scientific Electronic Library Online (SciELO), followed by hand searches of the reference lists of the included studies. Two independent reviewers will screen all retrieve titles, abstracts, and full texts, according to the inclusion criteria and will also extract the data. A third reviewer will be referred to solve any disagreement. A descriptive summary of the included studies will contain the design, participants, as well as the characteristics, measurement properties, and clinical utility of the self-report tools. The methodological quality of the studies will be evaluated using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist and the clinical utility of the identified tools will be assessed considering predefined criteria. This systematic review will follow the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) statement. This systematic review will provide an extensive review of the measurement properties and clinical utility of self-report physical activity assessment tools used in individuals with stroke, which would benefit clinicians and researchers. PROSPERO CRD42016037146. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Interaction of Theory and Practice to Assess External Validity.

PubMed

Leviton, Laura C; Trujillo, Mathew D

2016-01-18

Variations in local context bedevil the assessment of external validity: the ability to generalize about effects of treatments. For evaluation, the challenges of assessing external validity are intimately tied to the translation and spread of evidence-based interventions. This makes external validity a question for decision makers, who need to determine whether to endorse, fund, or adopt interventions that were found to be effective and how to ensure high quality once they spread. To present the rationale for using theory to assess external validity and the value of more systematic interaction of theory and practice. We review advances in external validity, program theory, practitioner expertise, and local adaptation. Examples are provided for program theory, its adaptation to diverse contexts, and generalizing to contexts that have not yet been studied. The often critical role of practitioner experience is illustrated in these examples. Work is described that the Robert Wood Johnson Foundation is supporting to study treatment variation and context more systematically. Researchers and developers generally see a limited range of contexts in which the intervention is implemented. Individual practitioners see a different and often a wider range of contexts, albeit not a systematic sample. Organized and taken together, however, practitioner experiences can inform external validity by challenging the developers and researchers to consider a wider range of contexts. Researchers have developed a variety of ways to adapt interventions in light of such challenges. In systematic programs of inquiry, as opposed to individual studies, the problems of context can be better addressed. Evaluators have advocated an interaction of theory and practice for many years, but the process can be made more systematic and useful. Systematic interaction can set priorities for assessment of external validity by examining the prevalence and importance of context features and treatment variations. Practitioner interaction with researchers and developers can assist in sharpening program theory, reducing uncertainty about treatment variations that are consistent or inconsistent with the theory, inductively ruling out the ones that are harmful or irrelevant, and helping set priorities for more rigorous study of context and treatment variation. © The Author(s) 2016.

Economic Evaluation and Transferability of Physical Activity Programmes in Primary Prevention: A Systematic Review

PubMed Central

Wolfenstetter, Silke B.; Wenig, Christina M.

2010-01-01

This systematic review aims to assess the characteristics of, and the clinical and economic evidence provided by, economic evaluations of primary preventive physical exercise interventions, and to analyse their transferability to Germany using recommended checklists. Fifteen economic evaluations from seven different countries met eligibility criteria, with seven of the fifteen providing high economic evidence in the special country context. Most of the identified studies conclude that the investigated intervention provide good value for money compared with alternatives. However, this review shows a high variability of the costing methods between the studies, which limits comparability, generalisability and transferability of the results. PMID:20617050

Are cardiovascular disease risk assessment and management programmes cost effective? A systematic review of the evidence.

PubMed

Lee, John Tayu; Lawson, Kenny D; Wan, Yizhou; Majeed, Azeem; Morris, Stephen; Soljak, Michael; Millett, Christopher

2017-06-01

The World Health Organization recommends that countries implement population-wide cardiovascular disease (CVD) risk assessment and management programmes. The aim of this study was to conduct a systematic review to evaluate whether this recommendation is supported by cost-effectiveness evidence. Published economic evaluations were identified via electronic medical and social science databases (including Medline, Web of Science, and the NHS Economic Evaluation Database) from inception to March 2016. Study quality was evaluated using a modified version of the Consolidated Health Economic Evaluation Reporting Standards. Fourteen economic evaluations were included: five studies based on randomised controlled trials, seven studies based on observational studies and two studies using hypothetical modelling synthesizing secondary data. Trial based studies measured CVD risk factor changes over 1 to 3years, with modelled projections of longer term events. Programmes were either not, or only, cost-effective under non-verified assumptions such as sustained risk factor changes. Most observational and hypothetical studies suggested programmes were likely to be cost-effective; however, study deigns are subject to bias and subsequent empirical evidence has contradicted key assumptions. No studies assessed impacts on inequalities. In conclusion, recommendations for population-wide risk assessment and management programmes lack a robust, real world, evidence basis. Given implementation is resource intensive there is a need for robust economic evaluation, ideally conducted alongside trials, to assess cost effectiveness. Further, the efficiency and equity impact of different delivery models should be investigated, and also the combination of targeted screening with whole population interventions recognising that there multiple approaches to prevention. Copyright © 2017. Published by Elsevier Inc.

Can Systematic Reviews Inform GMO Risk Assessment and Risk Management?

PubMed Central

Kohl, Christian; Frampton, Geoff; Sweet, Jeremy; Spök, Armin; Haddaway, Neal Robert; Wilhelm, Ralf; Unger, Stefan; Schiemann, Joachim

2015-01-01

Systematic reviews represent powerful tools to identify, collect, synthesize, and evaluate primary research data on specific research questions in a highly standardized and reproducible manner. They enable the defensible synthesis of outcomes by increasing precision and minimizing bias whilst ensuring transparency of the methods used. This makes them especially valuable to inform evidence-based risk analysis and decision making in various topics and research disciplines. Although seen as a “gold standard” for synthesizing primary research data, systematic reviews are not without limitations as they are often cost, labor and time intensive and the utility of synthesis outcomes depends upon the availability of sufficient and robust primary research data. In this paper, we (1) consider the added value systematic reviews could provide when synthesizing primary research data on genetically modified organisms (GMO) and (2) critically assess the adequacy and feasibility of systematic review for collating and analyzing data on potential impacts of GMOs in order to better inform specific steps within GMO risk assessment and risk management. The regulatory framework of the EU is used as an example, although the issues we discuss are likely to be more widely applicable. PMID:26322307

Health economic evaluations in orthodontics: a systematic review

PubMed Central

Petrén, Sofia; Björnsson, Liselotte; Norlund, Anders; Bondemark, Lars

2016-01-01

Summary Background: Economic evaluation is assuming increasing importance as an integral component of health services research. Aim: To conduct a systematic review of the literature and assess the evidence from studies presenting orthodontic treatment outcomes and the related costs. Materials/methods: The literature review was conducted in four steps, according to Goodman’s model, in order to identify all studies evaluating economic aspects of orthodontic interventions. The search covered the databases Medline, Cinahl, Cochrane, Embase, Google Scholar, National Health Service Economic Evaluation Database, and SCOPUS, for the period from 1966 to September 2014. The inclusion criteria were as follows: randomized controlled trials or controlled clinical trials comparing at least two different orthodontic interventions, evaluation of both economic and orthodontic outcomes, and study populations of all ages. The quality of each included study was assessed as limited, moderate, or high. The overall evidence was assessed according to the GRADE system (The Grading of Recommendations Assessment, Development and Evaluation). Results: The applied terms for searches yielded 1838 studies, of which 989 were excluded as duplicates. Application of the inclusion and exclusion criteria identified 26 eligible studies for which the full-text versions were retrieved and scrutinized. At the final analysis, eight studies remained. Three studies were based on cost-effectiveness analyses and the other five on cost-minimization analysis. Two of the cost-minimization studies included a societal perspective, i.e. the sum of direct and indirect costs. The aims of most of the studies varied widely and of studies comparing equivalent treatment methods, few were of sufficiently high study quality. Thus, the literature to date provides an inadequate evidence base for economic aspects of orthodontic treatment. Conclusion: This systematic review disclosed that few orthodontic studies have presented both economic and clinical outcomes. There is currently insufficient evidence available about the health economics of orthodontic interventions. Further investigation is warranted. PMID:26070925

Health economic evaluations in orthodontics: a systematic review.

PubMed

Sollenius, Ola; Petrén, Sofia; Björnsson, Liselotte; Norlund, Anders; Bondemark, Lars

2016-06-01

Economic evaluation is assuming increasing importance as an integral component of health services research. To conduct a systematic review of the literature and assess the evidence from studies presenting orthodontic treatment outcomes and the related costs. The literature review was conducted in four steps, according to Goodman's model, in order to identify all studies evaluating economic aspects of orthodontic interventions. The search covered the databases Medline, Cinahl, Cochrane, Embase, Google Scholar, National Health Service Economic Evaluation Database, and SCOPUS, for the period from 1966 to September 2014. The inclusion criteria were as follows: randomized controlled trials or controlled clinical trials comparing at least two different orthodontic interventions, evaluation of both economic and orthodontic outcomes, and study populations of all ages. The quality of each included study was assessed as limited, moderate, or high. The overall evidence was assessed according to the GRADE system (The Grading of Recommendations Assessment, Development and Evaluation). The applied terms for searches yielded 1838 studies, of which 989 were excluded as duplicates. Application of the inclusion and exclusion criteria identified 26 eligible studies for which the full-text versions were retrieved and scrutinized. At the final analysis, eight studies remained. Three studies were based on cost-effectiveness analyses and the other five on cost-minimization analysis. Two of the cost-minimization studies included a societal perspective, i.e. the sum of direct and indirect costs. The aims of most of the studies varied widely and of studies comparing equivalent treatment methods, few were of sufficiently high study quality. Thus, the literature to date provides an inadequate evidence base for economic aspects of orthodontic treatment. This systematic review disclosed that few orthodontic studies have presented both economic and clinical outcomes. There is currently insufficient evidence available about the health economics of orthodontic interventions. Further investigation is warranted. © The Author 2015. Published by Oxford University Press on behalf of the European Orthodontic Society. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Novel sensing technology in fall risk assessment in older adults: a systematic review.

PubMed

Sun, Ruopeng; Sosnoff, Jacob J

2018-01-16

Falls are a major health problem for older adults with significant physical and psychological consequences. A first step of successful fall prevention is to identify those at risk of falling. Recent advancement in sensing technology offers the possibility of objective, low-cost and easy-to-implement fall risk assessment. The objective of this systematic review is to assess the current state of sensing technology on providing objective fall risk assessment in older adults. A systematic review was conducted in accordance to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis statement (PRISMA). Twenty-two studies out of 855 articles were systematically identified and included in this review. Pertinent methodological features (sensing technique, assessment activities, outcome variables, and fall discrimination/prediction models) were extracted from each article. Four major sensing technologies (inertial sensors, video/depth camera, pressure sensing platform and laser sensing) were reported to provide accurate fall risk diagnostic in older adults. Steady state walking, static/dynamic balance, and functional mobility were used as the assessment activity. A diverse range of diagnostic accuracy across studies (47.9% - 100%) were reported, due to variation in measured kinematic/kinetic parameters and modelling techniques. A wide range of sensor technologies have been utilized in fall risk assessment in older adults. Overall, these devices have the potential to provide an accurate, inexpensive, and easy-to-implement fall risk assessment. However, the variation in measured parameters, assessment tools, sensor sites, movement tasks, and modelling techniques, precludes a firm conclusion on their ability to predict future falls. Future work is needed to determine a clinical meaningful and easy to interpret fall risk diagnosis utilizing sensing technology. Additionally, the gap between functional evaluation and user experience to technology should be addressed.

Effectiveness of wearable defibrillators: systematic review and quality of evidence.

PubMed

Uyei, Jennifer; Braithwaite, R Scott

2014-04-01

The objectives of this systematic literature review were to identify all published literature on wearable defibrillators, assess the wearable defibrillator's efficacy and effectiveness in general and among specific patient groups, including post-myocardial infarction, post coronary artery bypass grafting or percutaneous coronary intervention, non-ischemic cardiomyopathy, and ischemic cardiomyopathy, and to evaluate the quality of evidence. The search and synthesis was informed by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement, and the quality of evidence was evaluated using the Grading of Recommendations Assessment, Development and Evaluation and the Newcastle Ottawa Scale. A total of thirty-six articles and conference abstracts from thirty-three studies were included in the review. It appears that wearable defibrillator use compared with no defibrillator use reduces the chance of ventricular tachycardia and ventricular fibrillation (VT/VF) associated deaths by an absolute risk reduction of approximately 1 percent, achieved by averting approximately 4/5th of all VT/VF associated deaths. The quality of evidence was low to very low quality, such that our confidence in the reported estimates is weak. To validate beneficial results, further investigation using robust study designs conducted by independent researchers is warranted.

Application of systematic review methodology to the field of nutrition.

PubMed

Lichtenstein, Alice H; Yetley, Elizabeth A; Lau, Joseph

2008-12-01

Systematic reviews represent a rigorous and transparent approach to synthesizing scientific evidence that minimizes bias. They evolved within the medical community to support development of clinical and public health practice guidelines, set research agendas, and formulate scientific consensus statements. The use of systematic reviews for nutrition-related topics is more recent. Systematic reviews provide independently conducted comprehensive and objective assessments of available information addressing precise questions. This approach to summarizing available data is a useful tool for identifying the state of science including knowledge gaps and associated research needs, supporting development of science-based recommendations and guidelines, and serving as the foundation for updates as new data emerge. Our objective is to describe the steps for performing systematic reviews and highlight areas unique to the discipline of nutrition that are important to consider in data assessment. The steps involved in generating systematic reviews include identifying staffing and planning for outside expert input, forming a research team, developing an analytic framework, developing and refining research questions, defining eligibility criteria, identifying search terms, screening abstracts according to eligibility criteria, retrieving articles for evaluation, constructing evidence and summary tables, assessing methodological quality and applicability, and synthesizing results including performing meta-analysis, if appropriate. Unique and at times challenging, nutrition-related considerations include baseline nutrient exposure, nutrient status, bioequivalence of bioactive compounds, bioavailability, multiple and interrelated biological functions, undefined nature of some interventions, and uncertainties in intake assessment. Systematic reviews are a valuable and independent component of decision-making processes by groups responsible for developing science-based recommendations and policies.

Systematic review of methods for evaluating healthcare research economic impact

PubMed Central

2010-01-01

Background The economic benefits of healthcare research require study so that appropriate resources can be allocated to this research, particularly in developing countries. As a first step, we performed a systematic review to identify the methods used to assess the economic impact of healthcare research, and the outcomes. Method An electronic search was conducted in relevant databases using a combination of specific keywords. In addition, 21 relevant Web sites were identified. Results The initial search yielded 8,416 articles. After studying titles, abstracts, and full texts, 18 articles were included in the analysis. Eleven other reports were found on Web sites. We found that the outcomes assessed as healthcare research payback included direct cost-savings, cost reductions in healthcare delivery systems, benefits from commercial advancement, and outcomes associated with improved health status. Two methods were used to study healthcare research payback: macro-economic studies, which examine the relationship between research studies and economic outcome at the aggregated level, and case studies, which examine specific research projects to assess economic impact. Conclusions Our study shows that different methods and outcomes can be used to assess the economic impacts of healthcare research. There is no unique methodological approach for the economic evaluation of such research. In our systematic search we found no research that had evaluated the economic return of research in low and middle income countries. We therefore recommend a consensus on practical guidelines at international level on the basis of more comprehensive methodologies (such as Canadian Academic of Health Science and payback frameworks) in order to build capacity, arrange for necessary informative infrastructures and promote necessary skills for economic evaluation studies. PMID:20196839

Systematic review on measurement properties of questionnaires assessing the neighbourhood environment in the context of youth physical activity behaviour

PubMed Central

2013-01-01

Background High-quality measurement instruments for assessing the neighbourhood environment are a prerequisite for identifying associations between the neighbourhood environment and a person’s physical activity. The aim of this systematic review was to identify reliable and valid questionnaires assessing neighbourhood environmental attributes in the context of physical activity behaviours in children and adolescents. In addition, current gaps and best practice models in instrumentation and their evaluation are discussed. Methods We conducted a systematic literature search using six databases (Web of Science, Medline, TRID, SportDISCUS, PsycARTICLES and PsycINFO). Two independent reviewers screened the identified English-language peer-reviewed journal articles. Only studies examining the measurement properties of self- or proxy-report questionnaires on any aspects of the neighbourhood environment in children and adolescents aged 3 to 18 years were included. The methodological quality of the included studies was assessed using the COSMIN checklists. Results We identified 13 questionnaires on attributes of the neighbourhood environment. Most of these studies were conducted in the United States (n = 7). Eight studies evaluated self-report measures, two studies evaluated parent-report measures and three studies included both administration types. While eight studies had poor methodological quality, we identified three questionnaires with substantial test-retest reliability and two questionnaires with acceptable convergent validity based on sufficient evidential basis. Conclusions Based on the results of this review, we recommend that cross-culturally adapted questionnaires should be used and that existing questionnaires should be evaluated especially in diverse samples and in countries other than the United States. Further, high-quality studies on measurement properties should be promoted and measurement models (formative vs. reflexive) should be specified to ensure that appropriate methods for psychometric testing are applied in future studies. PMID:23663328

Systematic review on measurement properties of questionnaires assessing the neighbourhood environment in the context of youth physical activity behaviour.

PubMed

Reimers, Anne K; Mess, Filip; Bucksch, Jens; Jekauc, Darko; Woll, Alexander

2013-05-11

High-quality measurement instruments for assessing the neighbourhood environment are a prerequisite for identifying associations between the neighbourhood environment and a person's physical activity. The aim of this systematic review was to identify reliable and valid questionnaires assessing neighbourhood environmental attributes in the context of physical activity behaviours in children and adolescents. In addition, current gaps and best practice models in instrumentation and their evaluation are discussed. We conducted a systematic literature search using six databases (Web of Science, Medline, TRID, SportDISCUS, PsycARTICLES and PsycINFO). Two independent reviewers screened the identified English-language peer-reviewed journal articles. Only studies examining the measurement properties of self- or proxy-report questionnaires on any aspects of the neighbourhood environment in children and adolescents aged 3 to 18 years were included. The methodological quality of the included studies was assessed using the COSMIN checklists. We identified 13 questionnaires on attributes of the neighbourhood environment. Most of these studies were conducted in the United States (n = 7). Eight studies evaluated self-report measures, two studies evaluated parent-report measures and three studies included both administration types. While eight studies had poor methodological quality, we identified three questionnaires with substantial test-retest reliability and two questionnaires with acceptable convergent validity based on sufficient evidential basis. Based on the results of this review, we recommend that cross-culturally adapted questionnaires should be used and that existing questionnaires should be evaluated especially in diverse samples and in countries other than the United States. Further, high-quality studies on measurement properties should be promoted and measurement models (formative vs. reflexive) should be specified to ensure that appropriate methods for psychometric testing are applied in future studies.

Assessing medical professionalism: A systematic review of instruments and their measurement properties

PubMed Central

Li, Honghe; Liu, Yang; Wen, Deliang

2017-01-01

Background Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments’ measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. Methods A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990–2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument’s usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee’s criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. Results After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar’s instrument for nursing students, Nurse Practitioners’ Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Conclusion Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies. PMID:28498838

Developing Learning Objectives for a Model Course to Prepare Adults for the Assessment of Prior, Non-Sponsored Learning by Portfolio Evaluation.

ERIC Educational Resources Information Center

Stevens, Mary A.

A study was conducted in order to develop a systematic method for the evaluation of students' prior, non-sponsored learning for the award of college credit at Blackhawk College (Illinois). It was determined that a course designed to prepare the student for assessment of prior learning was the best way for the institution to provide assistance to…

Protocol for a systematic review of instruments for the assessment of quality of life and well-being in children and adolescents with cerebral palsy.

PubMed

Mpundu-Kaambwa, Christine; Chen, Gang; Huynh, Elisabeth; Russo, Remo; Ratcliffe, Julie

2017-09-11

Cerebral palsy is the most common cause of physical disability in children and adolescents and is associated with impairments that may reduce the quality of life (QOL) of this population. Patient-reported outcome measures (PROMs) can facilitate the assessment of the effect of disease and treatment on QOL, from a patient viewpoint. The purpose of this systematic review is to identify PROMs that are used to measure QOL and subjective well-being (SWB) outcomes in young people with cerebral palsy and to evaluate the suitability of these PROMs for application in economic evaluations within this population. MEDLINE, Scopus, the Cochrane Library, Web of Science Core Collection, EconLit, PsycINFO, CINAHL, EMBASE and Informit will be systematically searched from inception to date of search. Published peer-reviewed, English-language articles reporting PROMs measuring QOL or SWB outcomes in children and adolescents with cerebral palsy will be included. One reviewer will conduct the initial search and screen titles and abstracts for potentially eligible studies. The search will be performed in November 2017. To reduce the likelihood of reviewer selection bias, two other reviewers will independently screen a randomly selected subsample (10%) of the citations. Two reviewers will then retrieve full texts of potentially eligible studies and assess them against predefined inclusion criteria. The suitability of selected PROMs for use in economic evaluations of young people with cerebral palsy will be assessed using the International Society of Quality of Life Research recommended Minimum Standards and the Patient-Centered Outcomes and Comparative Effectiveness Research checklist. A narrative synthesis of extracted data will be presented including study descriptive data, PROMs measurement properties, settings in which they were applied and the valuation methods. Recommendations for practice on the selection of PROMs for use in economic evaluations of children and adolescents with cerebral palsy will be presented. Ethical approval is not required as the proposed systematic review will not use primary data. The results of this study will be widely disseminated through publication in a peer-reviewed journal and conference presentation(s). International Prospective Register of Systematic Reviews number: CRD42016049746. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Cost-effectiveness of lung cancer screening and treatment methods: a systematic review of systematic reviews.

PubMed

Azar, Farbod Ebadifard; Azami-Aghdash, Saber; Pournaghi-Azar, Fatemeh; Mazdaki, Alireza; Rezapour, Aziz; Ebrahimi, Parvin; Yousefzadeh, Negar

2017-06-19

Due to extensive literature in the field of lung cancer and their heterogeneous results, the aim of this study was to systematically review of systematic reviews studies which reviewed the cost-effectiveness of various lung cancer screening and treatment methods. In this systematic review of systematic reviews study, required data were collected searching the following key words which selected from Mesh: "lung cancer", "lung oncology", "lung Carcinoma", "lung neoplasm", "lung tumors", "cost- effectiveness", "systematic review" and "Meta-analysis". The following databases were searched: PubMed, Cochrane Library electronic databases, Google Scholar, and Scopus. Two reviewers (RA and A-AS) evaluated the articles according to the checklist of "assessment of multiple systematic reviews" (AMSTAR) tool. Overall, information of 110 papers was discussed in eight systematic reviews. Authors focused on cost-effectiveness of lung cancer treatments in five systematic reviews. Targeted therapy options (bevacizumab, Erlotinib and Crizotinib) show an acceptable cost-effectiveness. Results of three studies failed to show cost-effectiveness of screening methods. None of the studies had used the meta-analysis method. The Quality of Health Economic Studies (QHES) tool and Drummond checklist were mostly used in assessing the quality of articles. Most perspective was related to the Payer (64 times) and the lowest was related to Social (11times). Most cases referred to Incremental analysis (82%) and also the lowest point of referral was related to Discounting (in 49% of the cases). The average quality score of included studies was calculated 9.2% from 11. Targeted therapy can be an option for the treatment of lung cancer. Evaluation of the cost-effectiveness of computerized tomographic colonography (CTC) in lung cancer screening is recommended. The perspective of the community should be more taken into consideration in studies of cost-effectiveness. Paying more attention to the topic of Discounting will be necessary in the studies.

Using systematic review in occupational safety and health.

PubMed

Howard, John; Piacentino, John; MacMahon, Kathleen; Schulte, Paul

2017-11-01

Evaluation of scientific evidence is critical in developing recommendations to reduce risk. Healthcare was the first scientific field to employ a systematic review approach for synthesizing research findings to support evidence-based decision-making and it is still the largest producer and consumer of systematic reviews. Systematic reviews in the field of occupational safety and health are being conducted, but more widespread use and adoption would strengthen assessments. In 2016, NIOSH asked RAND to develop a framework for applying the traditional systematic review elements to the field of occupational safety and health. This paper describes how essential systematic review elements can be adapted for use in occupational systematic reviews to enhance their scientific quality, objectivity, transparency, reliability, utility, and acceptability. Published 2017. This article is a U.S. Government work and is in the public domain in the USA.

A service evaluation of on-line image-guided radiotherapy to lower extremity sarcoma: Investigating the workload implications of a 3 mm action level for image assessment and correction prior to delivery.

PubMed

Taylor, C; Parker, J; Stratford, J; Warren, M

2018-05-01

Although all systematic and random positional setup errors can be corrected for in entirety during on-line image-guided radiotherapy, the use of a specified action level, below which no correction occurs, is also an option. The following service evaluation aimed to investigate the use of this 3 mm action level for on-line image assessment and correction (online, systematic set-up error and weekly evaluation) for lower extremity sarcoma, and understand the impact on imaging frequency and patient positioning error within one cancer centre. All patients were immobilised using a thermoplastic shell attached to a plastic base and an individual moulded footrest. A retrospective analysis of 30 patients was performed. Patient setup and correctional data derived from cone beam CT analysis was retrieved. The timing, frequency and magnitude of corrections were evaluated. The population systematic and random error was derived. 20% of patients had no systematic corrections over the duration of treatment, and 47% had one. The maximum number of systematic corrections per course of radiotherapy was 4, which occurred for 2 patients. 34% of episodes occurred within the first 5 fractions. All patients had at least one observed translational error during their treatment greater than 0.3 cm, and 80% of patients had at least one observed translational error during their treatment greater than 0.5 cm. The population systematic error was 0.14 cm, 0.10 cm, 0.14 cm and random error was 0.27 cm, 0.22 cm, 0.23 cm in the lateral, caudocranial and anteroposterial directions. The required Planning Target Volume margin for the study population was 0.55 cm, 0.41 cm and 0.50 cm in the lateral, caudocranial and anteroposterial directions. The 3 mm action level for image assessment and correction prior to delivery reduced the imaging burden and focussed intervention on patients that exhibited greater positional variability. This strategy could be an efficient deployment of departmental resources if full daily correction of positional setup error is not possible. Copyright © 2017. Published by Elsevier Ltd.

Assessing Preferences for AAC Options in Communication Interventions for Individuals with Developmental Disabilities: A Review of the Literature

ERIC Educational Resources Information Center

van der Meer, Larah; Sigafoos, Jeff; O'Reilly, Mark F.; Lancioni, Giulio E.

2011-01-01

We synthesized studies that assessed preference for using different augmentative and alternative communication (AAC) options. Studies were identified via systematic searches of electronic databases, journals, and reference lists. Studies were evaluated in terms of: (a) participants, (b) setting, (c) communication options assessed, (d) design, (e)…

A systematic review of measurement of endoscopic disease activity and mucosal healing in Crohn's disease: recommendations for clinical trial design.

PubMed

Khanna, Reena; Bouguen, Guillaume; Feagan, Brian G; DʼHaens, Geert; Sandborn, William J; Dubcenco, Elena; Baker, K Adam; Levesque, Barrett G

2014-10-01

Crohn's disease (CD) is a chronic idiopathic inflammatory disorder of the gastrointestinal tract. Recently, mucosal healing has been proposed as a goal of therapy because clinical symptoms are subjective. Evaluative indices that measure endoscopic disease activity are required to define mucosal healing for clinical trials. The primary objective of this systematic review was to assess the existing evaluative indices that measure disease activity in CD and evaluate their role as outcome measures in clinical trials. A systematic literature review was performed using MEDLINE (Ovid), EMBASE (Ovid), PubMed, the Cochrane Library (CENTRAL), and DDW abstracts to identify randomized controlled trials and controlled clinical trials that used a relevant evaluative index from inception to February 2013. The data obtained from these trials were reviewed and summarized. The initial literature searches identified 2300 citations. After duplicates were removed, 1454 studies remained. After application of the apriori inclusion and exclusion criteria, 109 articles were included and 3 were identified with handsearches. In total, 9 evaluative indices for CD were identified and reviewed. The Crohn's Disease Endoscopic Index of Severity (CDEIS) and the Simple Endoscopic Score in Crohn's Disease (SES-CD) are indices with the most extensively described operating properties. Both the endoscopic evaluative instrument selected and the definition chosen for mucosal healing affect the validity of assessing endoscopic disease activity during a clinical trial for CD. Currently, the CDEIS and SES-CD have the most data regarding operating properties; however, further validation is required.

Systematic reviews of surgical procedures in children: quantity, coverage and quality.

PubMed

McGee, Richard G; Craig, Jonathan C; Rogerson, Thomas E; Webster, Angela C

2013-04-01

Systematic reviews have the potential to map those areas where children are under-represented in surgical research. We aimed to describe and evaluate the quantity, coverage and the quality of conduct and reporting of systematic reviews of surgical procedures in children. We searched four biomedical databases, a systematic review register, reference lists and conducted hand searching to identify relevant reviews. Two reviewers worked independently to critically appraise included studies and abstract data. We assessed reporting quality using the preferred reporting items for systematic reviews and meta-analysis statement and methodological quality using the Assessment of Multiple SysTemAtic Reviews tool. Fifteen systematic reviews were identified, representing 0.01% of all paediatric surgical citations in MEDLINE and Embase. Thirteen of the reviews were Cochrane reviews, and most reviews (12/15) addressed subspecialty interests such as otorhinolaryngology. The median number of included trials per systematic review was four (interquartile range 1 to 9.5), the median number of primary outcomes was 5.5 (interquartile range 3.5 to 7.5). In general, reporting and methodological quality was good although there were several omissions, particularly around completeness of reporting of statistical methods used, and utilisation of quality assessments in analyses. Outcomes were often not clearly defined and descriptions of procedures lacked sufficient detail to determine the similarities and differences among surgical procedures within the contributing trials. Systematic reviews of surgical procedures in children are rarely published. To improve the evidence base and guide research agendas, more systematic reviews should be conducted, using standard guidelines for conduct and reporting. © 2013 The Authors. Journal of Paediatrics and Child Health © 2013 Paediatrics and Child Health Division (Royal Australasian College of Physicians).

Most systematic reviews of high methodological quality on psoriasis interventions are classified as high risk of bias using ROBIS tool.

PubMed

Gómez-García, Francisco; Ruano, Juan; Gay-Mimbrera, Jesus; Aguilar-Luque, Macarena; Sanz-Cabanillas, Juan Luis; Alcalde-Mellado, Patricia; Maestre-López, Beatriz; Carmona-Fernández, Pedro Jesús; González-Padilla, Marcelino; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-01

No gold standard exists to assess methodological quality of systematic reviews (SRs). Although Assessing the Methodological Quality of Systematic Reviews (AMSTAR) is widely accepted for analyzing quality, the ROBIS instrument has recently been developed. This study aimed to compare the capacity of both instruments to capture the quality of SRs concerning psoriasis interventions. Systematic literature searches were undertaken on relevant databases. For each review, methodological quality and bias risk were evaluated using the AMSTAR and ROBIS tools. Descriptive and principal component analyses were conducted to describe similarities and discrepancies between both assessment tools. We classified 139 intervention SRs as displaying high/moderate/low methodological quality and as high/low risk of bias. A high risk of bias was detected for most SRs classified as displaying high or moderate methodological quality by AMSTAR. When comparing ROBIS result profiles, responses to domain 4 signaling questions showed the greatest differences between bias risk assessments, whereas domain 2 items showed the least. When considering SRs published about psoriasis, methodological quality remains suboptimal, and the risk of bias is elevated, even for SRs exhibiting high methodological quality. Furthermore, the AMSTAR and ROBIS tools may be considered as complementary when conducting quality assessment of SRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Performance assessment of 3D surface imaging technique for medical imaging applications

NASA Astrophysics Data System (ADS)

Li, Tuotuo; Geng, Jason; Li, Shidong

2013-03-01

Recent development in optical 3D surface imaging technologies provide better ways to digitalize the 3D surface and its motion in real-time. The non-invasive 3D surface imaging approach has great potential for many medical imaging applications, such as motion monitoring of radiotherapy, pre/post evaluation of plastic surgery and dermatology, to name a few. Various commercial 3D surface imaging systems have appeared on the market with different dimension, speed and accuracy. For clinical applications, the accuracy, reproducibility and robustness across the widely heterogeneous skin color, tone, texture, shape properties, and ambient lighting is very crucial. Till now, a systematic approach for evaluating the performance of different 3D surface imaging systems still yet exist. In this paper, we present a systematic performance assessment approach to 3D surface imaging system assessment for medical applications. We use this assessment approach to exam a new real-time surface imaging system we developed, dubbed "Neo3D Camera", for image-guided radiotherapy (IGRT). The assessments include accuracy, field of view, coverage, repeatability, speed and sensitivity to environment, texture and color.

Methodology to assess clinical liver safety data.

PubMed

Merz, Michael; Lee, Kwan R; Kullak-Ublick, Gerd A; Brueckner, Andreas; Watkins, Paul B

2014-11-01

Analysis of liver safety data has to be multivariate by nature and needs to take into account time dependency of observations. Current standard tools for liver safety assessment such as summary tables, individual data listings, and narratives address these requirements to a limited extent only. Using graphics in the context of a systematic workflow including predefined graph templates is a valuable addition to standard instruments, helping to ensure completeness of evaluation, and supporting both hypothesis generation and testing. Employing graphical workflows interactively allows analysis in a team-based setting and facilitates identification of the most suitable graphics for publishing and regulatory reporting. Another important tool is statistical outlier detection, accounting for the fact that for assessment of Drug-Induced Liver Injury, identification and thorough evaluation of extreme values has much more relevance than measures of central tendency in the data. Taken together, systematical graphical data exploration and statistical outlier detection may have the potential to significantly improve assessment and interpretation of clinical liver safety data. A workshop was convened to discuss best practices for the assessment of drug-induced liver injury (DILI) in clinical trials.

RBANS Validity Indices: a Systematic Review and Meta-Analysis.

PubMed

Shura, Robert D; Brearly, Timothy W; Rowland, Jared A; Martindale, Sarah L; Miskey, Holly M; Duff, Kevin

2018-05-16

Neuropsychology practice organizations have highlighted the need for thorough evaluation of performance validity as part of the neuropsychological assessment process. Embedded validity indices are derived from existing measures and expand the scope of validity assessment. The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) is a brief instrument that quickly allows a clinician to assess a variety of cognitive domains. The RBANS also contains multiple embedded validity indicators. The purpose of this study was to synthesize the utility of those indicators to assess performance validity. A systematic search was completed, resulting in 11 studies for synthesis and 10 for meta-analysis. Data were synthesized on four indices and three subtests across samples of civilians, service members, and veterans. Sufficient data for meta-analysis were only available for the Effort Index, and related analyses indicated optimal cutoff scores of ≥1 (AUC = .86) and ≥ 3 (AUC = .85). However, outliers and heterogeneity were present indicating the importance of age and evaluation context. Overall, embedded validity indicators have shown adequate diagnostic accuracy across a variety of populations. Recommendations for interpreting these measures and future studies are provided.

The role of home-based information and communications technology interventions in chronic disease management: a systematic literature review.

PubMed

Gaikwad, Rekha; Warren, Jim

2009-06-01

This article presents a systematic literature review done to evaluate the feasibility and benefits of home-based information and communications technology enabled interventions for chronic disease management, with emphasis on their impact on health outcomes and costs. Relevant articles were retrieved from PubMed and evaluated using quality worksheets with pre-identified inclusion and exclusion criteria. Of the 256 articles retrieved, 27 were found to concord with the study criteria. Evaluation of the identified articles was conducted irrespective of study design, type of home-based intervention or chronic disease involved. The review demonstrates that HBIs applied to chronic disease management improve functional and cognitive patient outcomes and reduce healthcare spending. However, further research is needed to assess benefit in terms of evidence-based outcome indicators (that can provide a basis for meta-analysis), to confirm sustainable cost benefits, and to systematically collect data on physician satisfaction with patient management.

Is the coverage of google scholar enough to be used alone for systematic reviews

PubMed Central

2013-01-01

Background In searches for clinical trials and systematic reviews, it is said that Google Scholar (GS) should never be used in isolation, but in addition to PubMed, Cochrane, and other trusted sources of information. We therefore performed a study to assess the coverage of GS specifically for the studies included in systematic reviews and evaluate if GS was sensitive enough to be used alone for systematic reviews. Methods All the original studies included in 29 systematic reviews published in the Cochrane Database Syst Rev or in the JAMA in 2009 were gathered in a gold standard database. GS was searched for all these studies one by one to assess the percentage of studies which could have been identified by searching only GS. Results All the 738 original studies included in the gold standard database were retrieved in GS (100%). Conclusion The coverage of GS for the studies included in the systematic reviews is 100%. If the authors of the 29 systematic reviews had used only GS, no reference would have been missed. With some improvement in the research options, to increase its precision, GS could become the leading bibliographic database in medicine and could be used alone for systematic reviews. PMID:23302542

Life Cycle Comparison of Waste-to-Energy to Sanitary Landfill

EPA Science Inventory

Life cycle assessment (LCA) can be used to evaluate the environmental footprint of products, processes, and services. An LCA allows decision makers to compare products and processes through systematic evaluation of supply chains. Also known as a “cradle-to-grave” approach, LCA ev...

The Impact of Biologics and Tofacitinib on Cardiovascular Risk Factors and Outcomes in Patients with Rheumatic Disease: A Systematic Literature Review.

PubMed

Nurmohamed, Michael; Choy, Ernest; Lula, Sadiq; Kola, Blerina; DeMasi, Ryan; Accossato, Paola

2018-05-01

Rheumatic diseases are autoimmune, inflammatory diseases often associated with cardiovascular (CV) disease, a major cause of mortality in these patients. In recent years, treatment with biologic and targeted synthetic disease-modifying anti-rheumatic drugs (DMARDs), either as monotherapy or in combination with other drugs, have become the standard of treatment. In this systematic literature review, we evaluated the effect of treatment with biologic or tofacitinib on the CV risk and outcomes in these patients. A systematic search was performed in MEDLINE, Embase, the Cochrane Central Register of Controlled Trials, and Cochrane Database of Systematic Reviews for articles reporting on CV risk and events in patients with rheumatic disease treated with a biologic agent or tofacitinib. Articles identified were subjected to two levels of screening. Articles that passed the first level based on title and abstract were assessed on full-text evaluation. The quality of randomized clinical trials was assessed by Jadad scoring system and the quality of the other studies and abstracts was assessed using the Downs and Black instrument. The data extracted included study design, baseline patient characteristics, and measurements of CV risk and events. Of the 5722 articles identified in the initial search, screening yielded 105 unique publications from 90 unique studies (33 clinical trials, 39 prospective cohort studies, and an additional 18 retrospective studies) that reported CV risk outcomes. A risk of bias analysis for each type of report indicated that they were of good or excellent quality. Importantly, despite some limitations in data reported, there were no indications of significant increase in adverse CV events or risk in response to treatment with the agents evaluated. Treatment with biologic or tofacitinib appears to be well-tolerated with respect to CV outcomes in these patients.

[METHODS OF EVALUATION OF MUSCLE MASS: A SYSTEMATIC REVIEW OF RANDOMIZED CONTROLLED TRIALS].

PubMed

Moreira, Osvaldo Costa; de Oliveira, Cláudia Eliza Patrocínio; Candia-Luján, Ramón; Romero-Pérez, Ena Monserrat; de Paz Fernandez, José Antonio

2015-09-01

in recent years, research about muscle mass has gained popularity for their relationship to health. Thus precise measurement of muscle mass may have clinical application once may interfere with the diagnosis and prescription drug or drug treatment. to conduct a systematic review of the methods most used for evaluation of muscle mass in randomized controlled trials, with its advantages and disadvantages. we conducted a search of the data bases Pub- Med, Web of Science and Scopus, with words "muscle mass", "measurement", "assessment" and "evaluation", combined in this way: "muscle mass" AND (assessment OR measurement OR evaluation). 23 studies were recovered and analyzed, all in English. 69.56% only used a method for quantification of muscle mass; 69.57% used dual X-ray absorptiometry (DXA); in 45.46% the type of measure used was the body lean mass; and 51.61% chose the whole body as a site of measurement. in the randomized controlled trials analyzed the majority used just one method of assessment, with the DXA being the method most used, the body lean mass the measurement type most used and total body the most common site of measure. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Addressing equity in interventions to reduce air pollution in urban areas: a systematic review.

PubMed

Benmarhnia, Tarik; Rey, Lynda; Cartier, Yuri; Clary, Christelle M; Deguen, Séverine; Brousselle, Astrid

2014-12-01

We did a systematic review to assess quantitative studies investigating the association between interventions aiming to reduce air pollution, health benefits and equity effects. Three databases were searched for studies investigating the association between evaluated interventions aiming to reduce air pollution and heath-related benefits. We designed a two-stage selection process to judge how equity was assessed and we systematically determined if there was a heterogeneous effect of the intervention between subgroups or subareas. Of 145 identified articles, 54 were reviewed in-depth with eight satisfying the inclusion criteria. This systematic review showed that interventions aiming to reduce air pollution in urban areas have a positive impact on air quality and on mortality rates, but the documented effect on equity is less straightforward. Integration of equity in evidence-based public health is a great challenge nowadays. In this review we draw attention to the importance of considering equity in air pollution interventions. We also propose further methodological and theoretical challenges when assessing equity in interventions to reduce air pollution and we present opportunities to develop this research area.

Automatic Evaluations and Exercising: Systematic Review and Implications for Future Research.

PubMed

Schinkoeth, Michaela; Antoniewicz, Franziska

2017-01-01

The general purpose of this systematic review was to summarize, structure and evaluate the findings on automatic evaluations of exercising. Studies were eligible for inclusion if they reported measuring automatic evaluations of exercising with an implicit measure and assessed some kind of exercise variable. Fourteen nonexperimental and six experimental studies (out of a total N = 1,928) were identified and rated by two independent reviewers. The main study characteristics were extracted and the grade of evidence for each study evaluated. First, results revealed a large heterogeneity in the applied measures to assess automatic evaluations of exercising and the exercise variables. Generally, small to large-sized significant relations between automatic evaluations of exercising and exercise variables were identified in the vast majority of studies. The review offers a systematization of the various examined exercise variables and prompts to differentiate more carefully between actually observed exercise behavior (proximal exercise indicator) and associated physiological or psychological variables (distal exercise indicator). Second, a lack of transparent reported reflections on the differing theoretical basis leading to the use of specific implicit measures was observed. Implicit measures should be applied purposefully, taking into consideration the individual advantages or disadvantages of the measures. Third, 12 studies were rated as providing first-grade evidence (lowest grade of evidence), five represent second-grade and three were rated as third-grade evidence. There is a dramatic lack of experimental studies, which are essential for illustrating the cause-effect relation between automatic evaluations of exercising and exercise and investigating under which conditions automatic evaluations of exercising influence behavior. Conclusions about the necessity of exercise interventions targeted at the alteration of automatic evaluations of exercising should therefore not be drawn too hastily.

Automatic Evaluations and Exercising: Systematic Review and Implications for Future Research

PubMed Central

Schinkoeth, Michaela; Antoniewicz, Franziska

2017-01-01

The general purpose of this systematic review was to summarize, structure and evaluate the findings on automatic evaluations of exercising. Studies were eligible for inclusion if they reported measuring automatic evaluations of exercising with an implicit measure and assessed some kind of exercise variable. Fourteen nonexperimental and six experimental studies (out of a total N = 1,928) were identified and rated by two independent reviewers. The main study characteristics were extracted and the grade of evidence for each study evaluated. First, results revealed a large heterogeneity in the applied measures to assess automatic evaluations of exercising and the exercise variables. Generally, small to large-sized significant relations between automatic evaluations of exercising and exercise variables were identified in the vast majority of studies. The review offers a systematization of the various examined exercise variables and prompts to differentiate more carefully between actually observed exercise behavior (proximal exercise indicator) and associated physiological or psychological variables (distal exercise indicator). Second, a lack of transparent reported reflections on the differing theoretical basis leading to the use of specific implicit measures was observed. Implicit measures should be applied purposefully, taking into consideration the individual advantages or disadvantages of the measures. Third, 12 studies were rated as providing first-grade evidence (lowest grade of evidence), five represent second-grade and three were rated as third-grade evidence. There is a dramatic lack of experimental studies, which are essential for illustrating the cause-effect relation between automatic evaluations of exercising and exercise and investigating under which conditions automatic evaluations of exercising influence behavior. Conclusions about the necessity of exercise interventions targeted at the alteration of automatic evaluations of exercising should therefore not be drawn too hastily. PMID:29250022

Evaluation of Cross-Cultural Adaptation and Measurement Properties of STarT Back Screening Tool: A Systematic Review.

PubMed

Al Zoubi, Fadi M; Eilayyan, Owis; Mayo, Nancy E; Bussières, André E

2017-10-01

The purpose of this systematic review was to investigate the extent to which the STarT Back Screening Tool (SBST) has been evaluated for (1) the quality of translation of evidence for cross-cultural adaptation and (2) the measurement properties in languages other than English. A systematic search of 8 databases, including Medline, Embase, CINAHL, PsycINFO, AMED, Scopus, PubMed, and Web of Science, was performed. Electronic databases were searched for the period between 2008 and December 27, 2016. We included studies related to cross-cultural adaptation, including translation and assessment of the measurement properties of SBST. Study selection, translation, methodologic and quality assessments, and data extraction were performed independently by 2 reviewers. Of the 1566 citations retrieved, 17 studies were admissible, representing 11 different SBST versions in 10 languages. The quadratic weighted κ statistics of the 2 reviewers, for the translation, methodologic assessment, and quality assessment were 0.85, 0.76, and 0.83, respectively. For translation, only 2 versions (Belgian-French and Mandarin) fulfilled all requirements. None of the versions had tested all the measurement properties, and when performed, these were found to have been conducted inadequately. With regard to quality assessment, overall, the included versions had a "Poor" total summary score except 2 (Persian and Swiss-German), which were rated as "Fair." Few versions fully met the standard criteria for valid translation, and none of the versions tested all the measurement properties. There is a clear need for more accurate cross-cultural adaptation of SBST and greater attention to the quality of psychometric evaluation of the adapted versions of SBST. At this time, caution is recommended when using SBST in languages other than English. Copyright © 2017. Published by Elsevier Inc.

Instruments to Identify Prescription Medication Misuse, Abuse, and Related Events in Clinical Trials: An ACTTION Systematic Review.

PubMed

Smith, Shannon M; Paillard, Florence; McKeown, Andrew; Burke, Laurie B; Edwards, Robert R; Katz, Nathaniel P; Papadopoulos, Elektra J; Rappaport, Bob A; Slagle, Ashley; Strain, Eric C; Wasan, Ajay D; Turk, Dennis C; Dworkin, Robert H

2015-05-01

Measurement of inappropriate medication use events (eg, abuse or misuse) in clinical trials is important in characterizing a medication's abuse potential. However, no gold standard assessment of inappropriate use events in clinical trials has been identified. In this systematic review, we examine the measurement properties (ie, content validity, cross-sectional reliability and construct validity, longitudinal construct validity, ability to detect change, and responder definitions) of instruments assessing inappropriate use of opioid and nonopioid prescription medications to identify any that meet U.S. and European regulatory agencies' rigorous standards for outcome measures in clinical trials. Sixteen published instruments were identified, most of which were not designed for the selected concept of interest and context of use. For this reason, many instruments were found to lack adequate content validity (or documentation of content validity) to evaluate current inappropriate medication use events; for example, evaluating inappropriate use across the life span rather than current use, including items that did not directly assess inappropriate use (eg, questions about anger), or failing to capture information pertinent to inappropriate use events (eg, intention and route of administration). In addition, the psychometric data across all instruments were generally limited in scope. A further limitation is the heterogeneous, nonstandardized use of inappropriate medication use terminology. These observations suggest that available instruments are not well suited for assessing current inappropriate medication use within the specific context of clinical trials. Further effort is needed to develop reliable and valid instruments to measure current inappropriate medication use events in clinical trials. This systematic review evaluates the measurement properties of inappropriate medication use (eg, abuse or misuse) instruments to determine whether any meet regulatory standards for clinical trial outcome measures to assess abuse potential. Copyright © 2015 American Pain Society. All rights reserved.

Exercise Therapy in Juvenile Idiopathic Arthritis: A Systematic Review and Meta-Analysis.

PubMed

Kuntze, Gregor; Nesbitt, Colleen; Whittaker, Jackie L; Nettel-Aguirre, Alberto; Toomey, Clodagh; Esau, Shane; Doyle-Baker, Patricia K; Shank, Jena; Brooks, Julia; Benseler, Susanne; Emery, Carolyn A

2018-01-01

To conduct a systematic review to evaluate the efficacy of exercise interventions in improving outcomes across domains of functioning and disability in children and adolescents with juvenile idiopathic arthritis (JIA). Seven electronic databases were systematically searched up to November 16, 2016. Original data, analytic prospective design, physical therapy-led exercise intervention evaluation, children and adolescents with JIA, and assessment of functional, structural, activity, participation, or quality of life outcomes. Two authors screened search results, and discrepancies were resolved by consensus. Of 5037 potentially relevant studies, 9 randomized controlled trials and 1 cohort study were included and scored. Study quality (Downs and Black quality assessment tool) and level of evidence (Oxford Centre of Evidence-Based Medicine model) were assessed and meta-analysis conducted where appropriate. Alternatively, a descriptive summary approach was chosen. All randomized controlled trials were moderate-quality intervention studies (level 2b evidence; median Downs and Black score, 20 out of 32; range, 15-27). Interventions included aquatic, strengthening, proprioceptive, aerobic, and Pilates exercises. Pediatric activity capacity (Child Health Assessment Questionnaire) improved with exercise (mean difference, .45; 95% confidence interval, .05-.76). Furthermore, descriptive summaries indicated improved activity capacity, body function and structure (pain and muscle strength), and quality of life outcomes. Exercise therapy appears to be well tolerated and beneficial across clinically relevant outcomes in patients with JIA. The paucity of high-quality evidence and study heterogeneity limited the ability to provide conclusive, generalizing evidence for the efficacy of exercise therapy and to provide specific recommendations for clinical practice at this time. Future research evaluating exercise program implementation using validated outcomes and detailed adherence and safety assessment is needed to optimize clinical decision pathways in patients with JIA. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

A Systematic and Transparent Approach for Assessing the Methodological Quality of Intervention Effectiveness Research: The Study Design and Implementation Assessment Device (Study DIAD)

ERIC Educational Resources Information Center

Valentine, Jeffrey C.; Cooper, Harris

2008-01-01

Assessments of studies meant to evaluate the effectiveness of interventions, programs, and policies can serve an important role in the interpretation of research results. However, evidence suggests that available quality assessment tools have poor measurement characteristics and can lead to opposing conclusions when applied to the same body of…

[Assessment of Functioning when Conducting Occupational Capacity Evaluations--What is "Evidence-Based"?].

PubMed

Canela, Carlos; Schleifer, Roman; Dube, Anish; Hengartner, Michael P; Ebner, Gerhard; Seifritz, Erich; Liebrenz, Michael

2016-03-01

Occupational capacity evaluations have previously been subject to criticism for lacking in quality and consistency. To the authors' knowledge, there is no clear consensus on the best way to formally assess functioning within capacity evaluations. In this review we investigated different instruments that are used to assess functioning in occupational capacity evaluations. Systematic review of the literature. Though several instruments that assess functional capacity were found in our search, a specific validated instrument assessing occupational capacity as part of a larger psychiatric evaluation was not found. The limitations of the existing instruments on assessing functional capacity are discussed. Medical experts relying on instruments to conduct functional capacity evaluations should be cognizant of their limitations. The findings call for the development and use of an instrument specifically designed to assess the functional and occupational capacity of psychiatric patients, which is also likely to improve the quality of these reports. © Georg Thieme Verlag KG Stuttgart · New York.

Performance of a computer-based assessment of cognitive function measures in two cohorts of seniors

USDA-ARS?s Scientific Manuscript database

Computer-administered assessment of cognitive function is being increasingly incorporated in clinical trials, however its performance in these settings has not been systematically evaluated. The Seniors Health and Activity Research Program (SHARP) pilot trial (N=73) developed a computer-based tool f...

Measures of Self-Care Independence for Children with Osteochondrodysplasia: A Clinimetric Review

ERIC Educational Resources Information Center

Ireland, Penelope; Johnston, Leanne M.

2012-01-01

This systematic review evaluates the validity, reliability, and clinical utility of outcome measures used to assess self-care skills among children with congenital musculoskeletal conditions and assesses the applicability of these measures for children with osteochondrodysplasia aged 0-12 years. Electronic databases were searched to identify…

Patient-reported outcome instruments that evaluate adherence behaviours in adults with asthma: A systematic review of measurement properties.

PubMed

Gagné, Myriam; Boulet, Louis-Philippe; Pérez, Norma; Moisan, Jocelyne

2018-04-30

To systematically identify the measurement properties of patient-reported outcome instruments (PROs) that evaluate adherence to inhaled maintenance medication in adults with asthma. We conducted a systematic review of six databases. Two reviewers independently included studies on the measurement properties of PROs that evaluated adherence in asthmatic participants aged ≥18 years. Based on the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN), the reviewers (1) extracted data on internal consistency, reliability, measurement error, content validity, structural validity, hypotheses testing, cross-cultural validity, criterion validity, and responsiveness; (2) assessed the methodological quality of the included studies; (3) assessed the quality of the measurement properties (positive or negative); and (4) summarised the level of evidence (limited, moderate, or strong). We screened 6,068 records and included 15 studies (14 PROs). No studies evaluated measurement error or responsiveness. Based on methodological and measurement property quality assessments, we found limited positive evidence of: (a) internal consistency of the Adherence Questionnaire, Refined Medication Adherence Reason Scale (MAR-Scale), Medication Adherence Report Scale for Asthma (MARS-A), and Test of the Adherence to Inhalers (TAI); (b) reliability of the TAI; and (c) structural validity of the Adherence Questionnaire, MAR-Scale, MARS-A, and TAI. We also found limited negative evidence of: (d) hypotheses testing of Adherence Questionnaire; (e) reliability of the MARS-A; and (f) criterion validity of the MARS-A and TAI. Our results highlighted the need to conduct further high-quality studies that will positively evaluate the reliability, validity, and responsiveness of the available PROs. This article is protected by copyright. All rights reserved.

Behaviour change interventions for the management of Raynaud's phenomenon: a systematic review protocol.

PubMed

Daniels, Jo; Pauling, John D; Eccelston, Christopher

2017-08-04

Raynaud's phenomenon (RP) describes excessive peripheral vasospasm to cold exposure and/or emotional stress. RP episodes are associated with digital colour changes, pain and reduced quality of life. Pharmacological interventions are of low to moderate efficacy and often result in adverse effects such as facial flushing and headaches. Recommended lifestyle and behavioural interventions have not been evaluated. The objectives of the proposed systematic review are to assess the comparative safety and efficacy of behaviour change interventions for RP and identify what we can learn to inform future interventions. Studies eligible for inclusion include randomised controlled trials testing behaviour change interventions with a control comparator. A comprehensive search strategy will include peer review and grey literature up until 30 April 2017. Search databases will include Medline, Embase, PsychINFO and Cochrane. Initial sifting, eligibility, data extraction, risk of bias and quality assessment will be subject to review by two independent reviewers with a third reviewer resolving discrepancies. Risk of bias assessment will be performed using Cochrane risk of a bias assessment tool with quality of evidence assessed using Grading of Recommendations Assessment, Development and Evaluation(GRADE). A meta-analysis will be performed if there are sufficient data. Two subgroup analyses are planned: primary versus secondary RP outcomes; comparison of theoretically informed interventions with pragmatic interventions. This review does not require ethical approval as it will summarise published studies with non-identifiable data. This protocol complies with the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidelines. Findings will be disseminated in peer-reviewed articles and reported according to PRISMA. This review will make a significant contribution to the management of RP where no review of behaviour-change interventions currently exist. The synopsis and protocol for the proposed systematic review is registered in the International Prospective Register of Systematic Reviews (registration number CRD42017049643). © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Reducing symptoms of major depressive disorder through a systematic training of general emotion regulation skills: protocol of a randomized controlled trial.

PubMed

Ehret, Anna M; Kowalsky, Judith; Rief, Winfried; Hiller, Wolfgang; Berking, Matthias

2014-01-27

Major Depressive Disorder is one of the most challenging mental health problems of our time. Although effective psychotherapeutic treatments are available, many patients fail to demonstrate clinically significant improvements. Difficulties in emotion regulation have been identified as putative risk and maintaining factors for Major Depressive Disorder. Systematically enhancing adaptive emotion regulation skills should thus help reduce depressive symptom severity. However, at this point, no study has systematically evaluated effects of increasing adaptive emotion regulation skills application on symptoms of Major Depressive Disorder. In the intended study, we aim to evaluate stand-alone effects of a group-based training explicitly and exclusively targeting general emotion regulation skills on depressive symptom severity and assess whether this training augments the outcome of subsequent individual cognitive behavioral therapy for depression. In the evaluation of the Affect Regulation Training, we will conduct a prospective randomized-controlled trial. Effects of the Affect Regulation Training on depressive symptom severity and outcomes of subsequent individual therapy for depression will be compared with an active, common factor based treatment and a waitlist control condition. The study sample will include 120 outpatients meeting criteria for Major Depressive Disorder. Depressive symptom severity as assessed by the Hamilton Rating Scale will serve as our primary study outcome. Secondary outcomes will include further indicators of mental health and changes in adaptive emotion regulation skills application. All outcomes will be assessed at intake and at 10 points in time over the course of the 15-month study period. Measures will include self-reports, observer ratings, momentary ecological assessments, and will be complemented in subsamples by experimental investigations and the analysis of hair steroids. If findings should support the hypothesis that enhancing regulation skills reduces symptom severity in Major Depressive Disorder, systematic emotion regulation skills training can enhance the efficacy and efficiency of current treatments for this severe and highly prevalent disorder. This study is registered with ClinicalTrials.gov, number NCT01330485.

Overview of systematic reviews of therapeutic ranges: methodologies and recommendations for practice.

PubMed

Cooney, Lewis; Loke, Yoon K; Golder, Su; Kirkham, Jamie; Jorgensen, Andrea; Sinha, Ian; Hawcutt, Daniel

2017-06-02

Many medicines are dosed to achieve a particular therapeutic range, and monitored using therapeutic drug monitoring (TDM). The evidence base for a therapeutic range can be evaluated using systematic reviews, to ensure it continues to reflect current indications, doses, routes and formulations, as well as updated adverse effect data. There is no consensus on the optimal methodology for systematic reviews of therapeutic ranges. An overview of systematic reviews of therapeutic ranges was undertaken. The following databases were used: Cochrane Database of Systematic Reviews (CDSR), Database of Abstracts and Reviews of Effects (DARE) and MEDLINE. The published methodologies used when systematically reviewing the therapeutic range of a drug were analyzed. Step by step recommendations to optimize such systematic reviews are proposed. Ten systematic reviews that investigated the correlation between serum concentrations and clinical outcomes encompassing a variety of medicines and indications were assessed. There were significant variations in the methodologies used (including the search terms used, data extraction methods, assessment of bias, and statistical analyses undertaken). Therapeutic ranges should be population and indication specific and based on clinically relevant outcomes. Recommendations for future systematic reviews based on these findings have been developed. Evidence based therapeutic ranges have the potential to improve TDM practice. Current systematic reviews investigating therapeutic ranges have highly variable methodologies and there is no consensus of best practice when undertaking systematic reviews in this field. These recommendations meet a need not addressed by standard protocols.

Publication bias in dermatology systematic reviews and meta-analyses.

PubMed

Atakpo, Paul; Vassar, Matt

2016-05-01

Systematic reviews and meta-analyses in dermatology provide high-level evidence for clinicians and policy makers that influence clinical decision making and treatment guidelines. One methodological problem with systematic reviews is the under representation of unpublished studies. This problem is due in part to publication bias. Omission of statistically non-significant data from meta-analyses may result in overestimation of treatment effect sizes which may lead to clinical consequences. Our goal was to assess whether systematic reviewers in dermatology evaluate and report publication bias. Further, we wanted to conduct our own evaluation of publication bias on meta-analyses that failed to do so. Our study considered systematic reviews and meta-analyses from ten dermatology journals from 2006 to 2016. A PubMed search was conducted, and all full-text articles that met our inclusion criteria were retrieved and coded by the primary author. 293 articles were included in our analysis. Additionally, we formally evaluated publication bias in meta-analyses that failed to do so using trim and fill and cumulative meta-analysis by precision methods. Publication bias was mentioned in 107 articles (36.5%) and was formally evaluated in 64 articles (21.8%). Visual inspection of a funnel plot was the most common method of evaluating publication bias. Publication bias was present in 45 articles (15.3%), not present in 57 articles (19.5%) and not determined in 191 articles (65.2%). Using the trim and fill method, 7 meta-analyses (33.33%) showed evidence of publication bias. Although the trim and fill method only found evidence of publication bias in 7 meta-analyses, the cumulative meta-analysis by precision method found evidence of publication bias in 15 meta-analyses (71.4%). Many of the reviews in our study did not mention or evaluate publication bias. Further, of the 42 articles that stated following PRISMA reporting guidelines, 19 (45.2%) evaluated for publication bias. In comparison to other studies, we found that systematic reviews in dermatology were less likely to evaluate for publication bias. Evaluating and reporting the likelihood of publication bias should be standard practice in systematic reviews when appropriate. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature

PubMed Central

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R.; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability. PMID:28443022

Truancy Interventions: A Review of the Research Literature

ERIC Educational Resources Information Center

Sutphen, Richard D.; Ford, Janet P.; Flaherty, Chris

2010-01-01

Objectives: This article presents a systematic review of the literature on evaluative studies of truancy interventions. Method: Included studies evaluating truancy interventions appearing in peer-reviewed academic journals from 1990 to 2007. Findings: In total, 16 studies were assessed. Eight studies used group comparison designs and eight studies…

The Economic Cost of Substance Abuse Treatment in the State of Florida

ERIC Educational Resources Information Center

Alexandre, Pierre K.; Beulaygue, Isabelle C.; French, Michael T.; McCollister, Kathryn E.; Popovici, Ioana; Sayed, Bisma A.

2012-01-01

Objective: Public and private stakeholders of substance abuse treatment services require economic cost data to guide program evaluations and funding decisions. Background: Rigorous cost assessments have been conducted for several treatment programs across the United States, but a systematic and comprehensive evaluation of programs in a particular…

Systematic Research and Evaluation in a Rural Pennsylvania School District.

ERIC Educational Resources Information Center

Leopold, Greg; And Others

This report summarizes the evaluation of a rural school district in Pennsylvania and offers recommendations reflecting the district's goals for school improvement and construction. Specifically, the objectives of the study were to identify curricular needs of the district and individual schools; review and assess district facilities with respect…

A Systematic Approach to Evaluating Career Education Materials at the Local Level.

ERIC Educational Resources Information Center

Peat, Marwick, Mitchell and Co., Washington, DC.

The document contains an assessment instrument, developed by three teams of educators, designed to assist career education practitioners in identifying, classifying, and evaluating career education instructional materials to determine the usefulness of a particular unit of material in a specific local situation. It also contains suggestions of…

Benefits of the NADE Certification Process: Self-Knowledge, Informed Choices & Programmatic Strength

ERIC Educational Resources Information Center

Greci, Dana

2016-01-01

Research shows that systematic, ongoing program evaluation is needed to adequately assess the effectiveness of developmental programs. Ongoing evaluation provides both (1) validation of programs to educational institutions and legislators; and (2) impetus for program improvement. The author of this article works in the Developmental Education…

Three-dimensional Imaging Methods for Quantitative Analysis of Facial Soft Tissues and Skeletal Morphology in Patients with Orofacial Clefts: A Systematic Review

PubMed Central

Kuijpers, Mette A. R.; Chiu, Yu-Ting; Nada, Rania M.; Carels, Carine E. L.; Fudalej, Piotr S.

2014-01-01

Background Current guidelines for evaluating cleft palate treatments are mostly based on two-dimensional (2D) evaluation, but three-dimensional (3D) imaging methods to assess treatment outcome are steadily rising. Objective To identify 3D imaging methods for quantitative assessment of soft tissue and skeletal morphology in patients with cleft lip and palate. Data sources Literature was searched using PubMed (1948–2012), EMBASE (1980–2012), Scopus (2004–2012), Web of Science (1945–2012), and the Cochrane Library. The last search was performed September 30, 2012. Reference lists were hand searched for potentially eligible studies. There was no language restriction. Study selection We included publications using 3D imaging techniques to assess facial soft tissue or skeletal morphology in patients older than 5 years with a cleft lip with/or without cleft palate. We reviewed studies involving the facial region when at least 10 subjects in the sample size had at least one cleft type. Only primary publications were included. Data extraction Independent extraction of data and quality assessments were performed by two observers. Results Five hundred full text publications were retrieved, 144 met the inclusion criteria, with 63 high quality studies. There were differences in study designs, topics studied, patient characteristics, and success measurements; therefore, only a systematic review could be conducted. Main 3D-techniques that are used in cleft lip and palate patients are CT, CBCT, MRI, stereophotogrammetry, and laser surface scanning. These techniques are mainly used for soft tissue analysis, evaluation of bone grafting, and changes in the craniofacial skeleton. Digital dental casts are used to evaluate treatment and changes over time. Conclusion Available evidence implies that 3D imaging methods can be used for documentation of CLP patients. No data are available yet showing that 3D methods are more informative than conventional 2D methods. Further research is warranted to elucidate it. Systematic review registration International Prospective Register of Systematic Reviews, PROSPERO CRD42012002041 PMID:24710215

Interventions for domestic violence among pregnant women in low- and middle-income countries: a systematic review protocol.

PubMed

Sapkota, Diksha; Baird, Kathleen; Saito, Amornrat; Anderson, Debra

2017-12-12

Violence during pregnancy is a global problem, associated with serious health risks for both the mother and baby. Evaluation of interventions targeted for reducing or controlling domestic violence (DV) is still in its infancy, and the majority of findings are primarily from high-income countries (HICs). Therefore, there is an urgent need for generating evidence of DV interventions among pregnant women in low- and middle-income countries (LMICs). Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines will be employed to structure the review. A comprehensive search will be carried out via electronic databases including MEDLINE, CINAHL, Scopus, Embase, Web of Science, PsycINFO, and The Cochrane library. Gray literature will also be scrutinized for potential articles. An optimal search strategy has been developed following consultations with subject-matter experts and librarians. This search strategy will be adapted to the different databases. Experimental studies evaluating DV interventions among pregnant women from LMICs will be included in the review. The review will only include literature written in English. Two reviewers will independently screen and assess studies for inclusion in the review. A third author will resolve any discrepancies between the reviewers. Risk of bias will be assessed based on the Cochrane risk of bias assessment tool, and overall quality of the evidence will be judged using Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) criteria. Findings will be presented with the narrative synthesis, and if applicable, they will be further quantified using random-effects meta-analysis. Effect size, risk ratio for dichotomous variables, and standardized mean differences for continuous variables will be calculated for each outcome using Review Manager 5.3. Systematic reviews to evaluate the efficacy of interventions to address DV within the perinatal context have been limited. Hence, no one intervention has emerged as substantially effective towards addressing perinatal DV and associated health consequences. The evidence generated from this systematic review will inform researchers and policy makers about the effectiveness of existing DV interventions among pregnant women in LMICs and provide recommendations for future research in this area. This in turn will contribute towards violence prevention in LMICs. PROSPERO CRD42017073938.

Systematic development of a communication skills training course for physicians performing work disability assessments: from evidence to practice

PubMed Central

2011-01-01

Background Physicians require specific communication skills, because the face-to-face contact with their patients is an important source of information. Although physicians who perform work disability assessments attend some communication-related training courses during their professional education, no specialised and evidence-based communication skills training course is available for them. Therefore, the objectives of this study were: 1) to systematically develop a training course aimed at improving the communication skills of physicians during work disability assessment interviews with disability claimants, and 2) to plan an evaluation of the training course. Methods A physician-tailored communication skills training course was developed, according to the six steps of the Intervention Mapping protocol. Data were collected from questionnaire studies among physicians and claimants, a focus group study among physicians, a systematic review of the literature, and meetings with various experts. Determinants and performance objectives were formulated. A concept version of the training course was discussed with several experts before the final training course programme was established. The evaluation plan was developed by consulting experts, social insurance physicians, researchers, and policy-makers, and discussing with them the options for evaluation. Results A two-day post-graduate communication skills training course was developed, aimed at improving professional communication during work disability assessment interviews. Special focus was on active teaching strategies, such as practising the skills in role-play. An adoption and implementation plan was formulated, in which the infrastructure of the educational department of the institute that employs the physicians was utilised. Improvement in the skills and knowledge of the physicians who will participate in the training course will be evaluated in a randomised controlled trial. Conclusions The feasibility and practical relevance of the communication skills training course that was developed seem promising. Such a course may be relevant for physicians in many countries who perform work disability assessments. The development of the first training course of this type represents an important advancement in this field. PMID:21639871

The Effects of Coping Interventions on Ability to Perform Under Pressure

PubMed Central

Kent, Sofie; Devonport, Tracey J.; Lane, Andrew M.; Nicholls, Wendy; Friesen, Andrew P.

2018-01-01

The ability to perform under pressure is necessary to achieve goals in various domains of life. We conducted a systematic review to synthesise findings from applied studies that focus on interventions developed to enhance an individual’s ability to cope under performance pressure. Following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines, a comprehensive search of five electronic databases was conducted. This yielded 66,618 records, of which 23 peer review papers met inclusion criteria of containing an intervention that targeted coping skills for performing under pressure. Using the Standard Quality Assessment for evaluation of primary research papers (Kmet et al., 2004) to assess quality, included studies performed well on reporting research objectives, research design, and statistical procedures. Sixteen studies showed poor quality in controlling for potentially confounding factors and small sample sizes. A narrative aggregate synthesis identified intervention studies that provided an educational focus (n = 9), consultancy sessions (n = 6), simulation training (n = 5) and emotion regulation strategies (n = 3). Findings highlight a need to; 1) establish a contextualized pressure task which will generate high levels of ecological validity for participants. Having established a suitable pressure task, 2) research should assess the effects of pressure by evaluating conscious and nonconscious effects and associated coping mechanisms, which should inform the subsequent development of interventions, and 3) assess interventions to enhance understanding of the ways in which they improve coping with pressure, or may fail, and the mechanisms which may explain these outcomes. Key points Simulation studies that exposed individuals to ‘pressure’ settings produced the most consistent improvements to performance, in comparison to a control group. This systematic review highlights limitations with the design, execution, and evaluation of pressure interventions. Future research should attempt to better consider the approach used to generate meaningful performance pressures and assess the consequences of pressure by evaluating conscious and non-conscious effects and coping mechanisms through which coping with pressure might be improved. PMID:29535577

Systematic development of a communication skills training course for physicians performing work disability assessments: from evidence to practice.

PubMed

van Rijssen, H Jolanda; Schellart, Antonius J M; Anema, Johannes R; de Boer, Wout E L; van der Beek, Allard J

2011-06-03

Physicians require specific communication skills, because the face-to-face contact with their patients is an important source of information. Although physicians who perform work disability assessments attend some communication-related training courses during their professional education, no specialised and evidence-based communication skills training course is available for them. Therefore, the objectives of this study were: 1) to systematically develop a training course aimed at improving the communication skills of physicians during work disability assessment interviews with disability claimants, and 2) to plan an evaluation of the training course. A physician-tailored communication skills training course was developed, according to the six steps of the Intervention Mapping protocol. Data were collected from questionnaire studies among physicians and claimants, a focus group study among physicians, a systematic review of the literature, and meetings with various experts. Determinants and performance objectives were formulated. A concept version of the training course was discussed with several experts before the final training course programme was established. The evaluation plan was developed by consulting experts, social insurance physicians, researchers, and policy-makers, and discussing with them the options for evaluation. A two-day post-graduate communication skills training course was developed, aimed at improving professional communication during work disability assessment interviews. Special focus was on active teaching strategies, such as practising the skills in role-play. An adoption and implementation plan was formulated, in which the infrastructure of the educational department of the institute that employs the physicians was utilised. Improvement in the skills and knowledge of the physicians who will participate in the training course will be evaluated in a randomised controlled trial. The feasibility and practical relevance of the communication skills training course that was developed seem promising. Such a course may be relevant for physicians in many countries who perform work disability assessments. The development of the first training course of this type represents an important advancement in this field.

Early economic evaluation of emerging health technologies: protocol of a systematic review

PubMed Central

2014-01-01

Background The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. Methods/design This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status. Discussion This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives. PMID:25055987

Early economic evaluation of emerging health technologies: protocol of a systematic review.

PubMed

Pham, Ba'; Tu, Hong Anh Thi; Han, Dolly; Pechlivanoglou, Petros; Miller, Fiona; Rac, Valeria; Chin, Warren; Tricco, Andrea C; Paulden, Mike; Bielecki, Joanna; Krahn, Murray

2014-07-23

The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status. This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives.

Methodological quality evaluation of systematic reviews or meta-analyses on ERCC1 in non-small cell lung cancer: a systematic review.

PubMed

Tao, Huan; Zhang, Yueyuan; Li, Qian; Chen, Jin

2017-11-01

To assess the methodological quality of systematic reviews (SRs) or meta-analysis concerning the predictive value of ERCC1 in platinum chemotherapy of non-small cell lung cancer. We searched the PubMed, EMbase, Cochrane library, international prospective register of systematic reviews, Chinese BioMedical Literature Database, China National Knowledge Infrastructure, Wan Fang and VIP database for SRs or meta-analysis. The methodological quality of included literatures was evaluated by risk of bias in systematic review (ROBIS) scale. Nineteen eligible SRs/meta-analysis were included. The most frequently searched databases were EMbase (74%), PubMed, Medline and CNKI. Fifteen SRs did additional retrieval manually, but none of them retrieved the registration platform. 47% described the two-reviewers model in the screening for eligible original articles, and seven SRs described the two reviewers to extract data. In methodological quality assessment, inter-rater reliability Kappa was 0.87 between two reviewers. Research question were well related to all SRs in phase 1 and the eligibility criteria was suitable for each SR, and rated as 'low' risk bias. But the 'high' risk bias existed in all the SRs regarding methods used to identify and/or select studies, and data collection and study appraisal. More than two-third of SRs or meta-analysis were finished with high risk of bias in the synthesis, findings and the final phase. The study demonstrated poor methodological quality of SRs/meta-analysis assessing the predictive value of ERCC1 in chemotherapy among the NSCLC patients, especially the high performance bias. Registration or publishing the protocol is recommended in future research.

Third molar removal and its impact on quality of life: systematic review and meta-analysis.

PubMed

Duarte-Rodrigues, Lucas; Miranda, Ednele Fabyene Primo; Souza, Taiane Oliveira; de Paiva, Haroldo Neves; Falci, Saulo Gabriel Moreira; Galvão, Endi Lanza

2018-05-24

The purpose of this systematic review was to assess the impact of third molar removal on patient's quality of life. To address the study purpose, investigators designed and implemented a systematic review. The primary outcome variable was the quality of life after third molar extraction. An electronic search was conducted through March, 2017, on the PUBMED, Virtual Health Library (VHL), Web of Science, and OVID, to identify relevant literatures. Research studies (randomized or non-randomized clinical trials) were included that evaluated the quality of life in individuals before and after third molar extraction, using validated measures of oral health-related quality of life with quantitative approach, besides procedures performed under local anesthesia. The R software was used to measure the mean difference on the quality of life between the preoperative period and follow-up days. A total of 1141 studies were identified. Of this total, 13 articles were selected in the present systematic review, of which six studies were included in the meta-analysis. All of these 13 articles used the OHIP-14, and 4 of this 13 used OHQoLUK-16 to evaluate the quality of life. Regarding quality assessment, four of the 13 included studies in this review received a maximum score of 9 points, according to the Newcastle-Ottawa (NOS). The OHIP-14 mean score on the first postoperative day was 17.57 (95% CI 11.84-23.30, I 2  = 96%) higher than the preoperative period. On the seventh postoperative day, the quality of life assessed by OHIP-14 got worse again. This systematic review revealed that the highest negative impact on quality of life of individuals submitted to third molar surgery was observed on the first postoperative day, decreasing over the follow-up period.

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation.

PubMed

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7-8) versus Group B: 8 (7-9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals.

Quality Assessment of Studies Published in Open Access and Subscription Journals: Results of a Systematic Evaluation

PubMed Central

Pastorino, Roberta; Milovanovic, Sonja; Stojanovic, Jovana; Efremov, Ljupcho; Amore, Rosarita; Boccia, Stefania

2016-01-01

Introduction Along with the proliferation of Open Access (OA) publishing, the interest for comparing the scientific quality of studies published in OA journals versus subscription journals has also increased. With our study we aimed to compare the methodological quality and the quality of reporting of primary epidemiological studies and systematic reviews and meta-analyses published in OA and non-OA journals. Methods In order to identify the studies to appraise, we listed all OA and non-OA journals which published in 2013 at least one primary epidemiologic study (case-control or cohort study design), and at least one systematic review or meta-analysis in the field of oncology. For the appraisal, we picked up the first studies published in 2013 with case-control or cohort study design from OA journals (Group A; n = 12), and in the same time period from non-OA journals (Group B; n = 26); the first systematic reviews and meta-analyses published in 2013 from OA journals (Group C; n = 15), and in the same time period from non-OA journals (Group D; n = 32). We evaluated the methodological quality of studies by assessing the compliance of case-control and cohort studies to Newcastle and Ottawa Scale (NOS) scale, and the compliance of systematic reviews and meta-analyses to Assessment of Multiple Systematic Reviews (AMSTAR) scale. The quality of reporting was assessed considering the adherence of case-control and cohort studies to STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist, and the adherence of systematic reviews and meta-analyses to Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) checklist. Results Among case-control and cohort studies published in OA and non-OA journals, we did not observe significant differences in the median value of NOS score (Group A: 7 (IQR 7–8) versus Group B: 8 (7–9); p = 0.5) and in the adherence to STROBE checklist (Group A, 75% versus Group B, 80%; p = 0.1). The results did not change after adjustment for impact factor. The compliance with AMSTAR and adherence to PRISMA checklist were comparable between systematic reviews and meta-analyses published in OA and non-OA journals (Group C, 46.0% versus Group D, 55.0%; p = 0.06), (Group C, 72.0% versus Group D, 76.0%; p = 0.1), respectively). Conclusion The epidemiological studies published in OA journals in the field of oncology approach the same methodological quality and quality of reporting as studies published in non-OA journals. PMID:27167982

Recommendations for assessing the risk of bias in systematic reviews of health-care interventions.

PubMed

Viswanathan, Meera; Patnode, Carrie D; Berkman, Nancy D; Bass, Eric B; Chang, Stephanie; Hartling, Lisa; Murad, M Hassan; Treadwell, Jonathan R; Kane, Robert L

2018-05-01

Risk-of-bias assessment is a central component of systematic reviews, but little conclusive empirical evidence exists on the validity of such assessments. In the context of such uncertainty, we present pragmatic recommendations that promote transparency and reproducibility in processes, address methodological advances in the risk-of-bias assessment, and can be applied consistently across review topics. Epidemiological study design principles; available empirical evidence, risk-of-bias tools, and guidance; and workgroup consensus. We developed recommendations for assessing the risk of bias of studies of health-care interventions specific to framing the focus and scope of risk-of-bias assessment; selecting the risk-of-bias categories; choosing assessment instruments; and conducting, analyzing, and presenting results of risk-of-bias assessments. Key recommendations include transparency and reproducibility of judgments, separating risk of bias from other constructs such as applicability and precision, and evaluating the risk of bias per outcome. We recommend against certain past practices, such as focusing on reporting quality, relying solely on study design or numerical quality scores, and automatically downgrading for industry sponsorship. Risk-of-bias assessment remains a challenging but essential step in systematic reviews. We presented standards to promote transparency of judgments. Copyright © 2017 Elsevier Inc. All rights reserved.

Measuring quality of life in opioid-dependent people: a systematic review of assessment instruments.

PubMed

Strada, Lisa; Vanderplasschen, Wouter; Buchholz, Angela; Schulte, Bernd; Muller, Ashley E; Verthein, Uwe; Reimer, Jens

2017-12-01

Opioid dependence is a chronic relapsing disorder. Despite increasing research on quality of life (QOL) in people with opioid dependence, little attention has been paid to the instruments used. This systematic review examines the suitability of QOL instruments for use in opioid-dependent populations and the instruments' quality. A systematic search was performed in the databases Medline, PsycInfo, The Cochrane Library, and CINAHL. Articles were eligible if they assessed QOL of opioid-dependent populations using a validated QOL instrument. Item content relevance to opioid-dependent people was evaluated by means of content analysis, and instrument properties were assessed using minimum standards for patient-reported outcome measures. Eighty-nine articles were retrieved, yielding sixteen QOL instruments, of which ten were assessed in this review. Of the ten instruments, six were disease specific, but none for opioid dependence. Two instruments had good item content relevance. The conceptual and measurement model were described in seven instruments. Four instruments were developed with input from the respective target population. Eight instruments had low respondent and administrator burden. Psychometric properties were either not assessed in opioid-dependent populations or were inconclusive or moderate. No instrument scored perfectly on both the content and properties. The limited suitability of instruments for opioid-dependent people hinders accurate and sensitive measurement of QOL in this population. Future research is in need of an opioid dependence-specific QOL instrument to measure the true impact of the disease on people's lives and to evaluate treatment-related services.

The Assessment of a Tutoring Program to Meet CAS Standards Using a SWOT Analysis and Action Plan

ERIC Educational Resources Information Center

Fullmer, Patricia

2009-01-01

This article summarizes the use of SWOT (Strengths, Weaknesses, Opportunities, and Threats) analysis and subsequent action planning as a tool of self-assessment to meet CAS (Council for the Advancement of Standards in Higher Education) requirements for systematic assessment. The use of the evaluation results to devise improvements to increase the…

Teamwork Assessment Tools in Modern Surgical Practice: A Systematic Review

PubMed Central

Whittaker, George; Abboudi, Hamid; Khan, Muhammed Shamim; Dasgupta, Prokar; Ahmed, Kamran

2015-01-01

Introduction. Deficiencies in teamwork skills have been shown to contribute to the occurrence of adverse events during surgery. Consequently, several teamwork assessment tools have been developed to evaluate trainee nontechnical performance. This paper aims to provide an overview of these instruments and review the validity of each tool. Furthermore, the present paper aims to review the deficiencies surrounding training and propose several recommendations to address these issues. Methods. A systematic literature search was conducted to identify teamwork assessment tools using MEDLINE (1946 to August 2015), EMBASE (1974 to August 2015), and PsycINFO (1806 to August 2015) databases. Results. Eight assessment tools which encompass aspects of teamwork were identified. The Nontechnical Skills for Surgeons (NOTSS) assessment was found to possess the highest level of validity from a variety of sources; reliability and acceptability have also been established for this tool. Conclusions. Deficits in current surgical training pathways have prompted several recommendations to meet the evolving requirements of surgeons. Recommendations from the current paper include integration of teamwork training and assessment into medical school curricula, standardised formal training of assessors to ensure accurate evaluation of nontechnical skill acquisition, and integration of concurrent technical and nontechnical skills training throughout training. PMID:26425732

Measurement properties of existing clinical assessment methods evaluating scapular positioning and function. A systematic review.

PubMed

Larsen, Camilla Marie; Juul-Kristensen, Birgit; Lund, Hans; Søgaard, Karen

2014-10-01

The aims were to compile a schematic overview of clinical scapular assessment methods and critically appraise the methodological quality of the involved studies. A systematic, computer-assisted literature search using Medline, CINAHL, SportDiscus and EMBASE was performed from inception to October 2013. Reference lists in articles were also screened for publications. From 50 articles, 54 method names were identified and categorized into three groups: (1) Static positioning assessment (n = 19); (2) Semi-dynamic (n = 13); and (3) Dynamic functional assessment (n = 22). Fifteen studies were excluded for evaluation due to no/few clinimetric results, leaving 35 studies for evaluation. Graded according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN checklist), the methodological quality in the reliability and validity domains was "fair" (57%) to "poor" (43%), with only one study rated as "good". The reliability domain was most often investigated. Few of the assessment methods in the included studies that had "fair" or "good" measurement property ratings demonstrated acceptable results for both reliability and validity. We found a substantially larger number of clinical scapular assessment methods than previously reported. Using the COSMIN checklist the methodological quality of the included measurement properties in the reliability and validity domains were in general "fair" to "poor". None were examined for all three domains: (1) reliability; (2) validity; and (3) responsiveness. Observational evaluation systems and assessment of scapular upward rotation seem suitably evidence-based for clinical use. Future studies should test and improve the clinimetric properties, and especially diagnostic accuracy and responsiveness, to increase utility for clinical practice.

Electroacupuncture for women with stress urinary incontinence: Protocol for a systematic review and meta-analysis.

PubMed

Huang, Weixin; Li, Xiaohui; Wang, Yuanping; Yan, Xia; Wu, Siping

2017-12-01

Stress urinary incontinence (SUI) is a widespread complaint in the adult women. Electroacupuncture has been widely applied in the treatment of SUI. But its efficacy has not been evaluated scientifically and systematically. Therefore, we provide a protocol of systematic evaluation to assess the effectiveness and safety of electroacupuncture treatment on women with SUI. The retrieved databases include 3 English literature databases, namely PubMed, Embase, and Cochrane Library, and 3 Chinese literature databases, namely Chinese Biomedical Literature Database (CBM), China National Knowledge Infrastructure (CNKI), and Wanfang Database. The randomized controlled trials (RCTs) of the electroacupuncture treatment on women with SUI will be searched in the above-mentioned databases from the time when the respective databases were established to December 2017. The change from baseline in the amount of urine leakage measured by the 1-hour pad test will be accepted as the primary outcomes. We will use RevMan V.5.3 software as well to compute the data synthesis carefully when a meta-analysis is allowed. This study will provide a high-quality synthesis to assess the effectiveness and safety of electroacupuncture treatment on women with SUI. The conclusion of our systematic review will provide evidence to judge whether electroacupuncture is an effective intervention for women with SUI. PROSPERO CRD42017070947.

Community-based Interventions to Prevent Skin Cancer: Two Community Guide Systematic Reviews

PubMed Central

Sandhu, Paramjit K.; Elder, Randy; Patel, Mona; Saraiya, Mona; Holman, Dawn M.; Perna, Frank; Smith, Robert A.; Buller, David; Sinclair, Craig; Reeder, Anthony; Makin, Jen; McNoe, Bronwen; Glanz, Karen

2016-01-01

Context Skin cancer is a preventable and commonly diagnosed cancer in the U.S. Excessive ultraviolet radiation exposure is a known cause of skin cancer. This article presents updated results of two types of interventions evaluated in a previously published Community Guide systematic review: multicomponent community-wide (MCCW) interventions and mass media (MM) interventions when used alone. Evidence acquisition Studies assessing MCCW and MM interventions to prevent skin cancer by reducing ultraviolet radiation exposure were evaluated using Community Guide systematic review methods. Relevant studies published between 1966 and 2013 were included and analyzed for this review. Evidence synthesis Seven studies evaluating the effectiveness of MCCW interventions showed a median increase in sunscreen use of 10.8 percentage points (interquartile interval=7.3, 23.2); a small decrease in ultraviolet radiation exposure; a decrease in indoor tanning device use of 4.0 percentage points (95% CI=2.5, 5.5); and mixed results for other protective behaviors. Four studies evaluating the effectiveness of MM interventions found that they generally led to improved ultraviolet protection behaviors among children and adults. Conclusions The available evidence showed that MCCW interventions are effective in reducing ultraviolet radiation exposure by increasing sunscreen use. There was, however, insufficient evidence to determine the effectiveness of MM interventions alone in reducing ultraviolet radiation exposure, indicating a continuing need for more research in this field to improve assessment of effectiveness. PMID:27647053

Economic Evaluation of Interventions for Prevention of Hospital Acquired Infections: A Systematic Review.

PubMed

Arefian, Habibollah; Vogel, Monique; Kwetkat, Anja; Hartmann, Michael

2016-01-01

This systematic review sought to assess the costs and benefits of interventions preventing hospital-acquired infections and to evaluate methodological and reporting quality. We systematically searched Medline via PubMed and the National Health Service Economic Evaluation Database from 2009 to 2014. We included quasi-experimental and randomized trails published in English or German evaluating the economic impact of interventions preventing the four most frequent hospital-acquired infections (urinary tract infections, surgical wound infections, pneumonia, and primary bloodstream infections). Characteristics and results of the included articles were extracted using a standardized data collection form. Study and reporting quality were evaluated using SIGN and CHEERS checklists. All costs were adjusted to 2013 US$. Savings-to-cost ratios and difference values with interquartile ranges (IQRs) per month were calculated, and the effects of study characteristics on the cost-benefit results were analyzed. Our search returned 2067 articles, of which 27 met the inclusion criteria. The median savings-to-cost ratio across all studies reporting both costs and savings values was US $7.0 (IQR 4.2-30.9), and the median net global saving was US $13,179 (IQR 5,106-65,850) per month. The studies' reporting quality was low. Only 14 articles reported more than half of CHEERS items appropriately. Similarly, an assessment of methodological quality found that only four studies (14.8%) were considered high quality. Prevention programs for hospital acquired infections have very positive cost-benefit ratios. Improved reporting quality in health economics publications is required.

Comparison of tools for assessing the methodological quality of primary and secondary studies in health technology assessment reports in Germany.

PubMed

Dreier, Maren; Borutta, Birgit; Stahmeyer, Jona; Krauth, Christian; Walter, Ulla

2010-06-14

HEALTH CARE POLICY BACKGROUND: Findings from scientific studies form the basis for evidence-based health policy decisions. Quality assessments to evaluate the credibility of study results are an essential part of health technology assessment reports and systematic reviews. Quality assessment tools (QAT) for assessing the study quality examine to what extent study results are systematically distorted by confounding or bias (internal validity). The tools can be divided into checklists, scales and component ratings. What QAT are available to assess the quality of interventional studies or studies in the field of health economics, how do they differ from each other and what conclusions can be drawn from these results for quality assessments? A systematic search of relevant databases from 1988 onwards is done, supplemented by screening of the references, of the HTA reports of the German Agency for Health Technology Assessment (DAHTA) and an internet search. The selection of relevant literature, the data extraction and the quality assessment are carried out by two independent reviewers. The substantive elements of the QAT are extracted using a modified criteria list consisting of items and domains specific to randomized trials, observational studies, diagnostic studies, systematic reviews and health economic studies. Based on the number of covered items and domains, more and less comprehensive QAT are distinguished. In order to exchange experiences regarding problems in the practical application of tools, a workshop is hosted. A total of eight systematic methodological reviews is identified as well as 147 QAT: 15 for systematic reviews, 80 for randomized trials, 30 for observational studies, 17 for diagnostic studies and 22 for health economic studies. The tools vary considerably with regard to the content, the performance and quality of operationalisation. Some tools do not only include the items of internal validity but also the items of quality of reporting and external validity. No tool covers all elements or domains. Design-specific generic tools are presented, which cover most of the content criteria. The evaluation of QAT by using content criteria is difficult, because there is no scientific consensus on the necessary elements of internal validity, and not all of the generally accepted elements are based on empirical evidence. Comparing QAT with regard to contents neglects the operationalisation of the respective parameters, for which the quality and precision are important for transparency, replicability, the correct assessment and interrater reliability. QAT, which mix items on the quality of reporting and internal validity, should be avoided. There are different, design-specific tools available which can be preferred for quality assessment, because of its wider coverage of substantive elements of internal validity. To minimise the subjectivity of the assessment, tools with a detailed and precise operationalisation of the individual elements should be applied. For health economic studies, tools should be developed and complemented with instructions, which define the appropriateness of the criteria. Further research is needed to identify study characteristics that influence the internal validity of studies.

Design and Field Testing of a Systematic Procedure for Evaluating Vocational Programs. Final Report.

ERIC Educational Resources Information Center

Portland Public Schools, OR.

The purpose of a project was to design and field-test a system for evaluating the adequacy of the vocational curriculum utilized by the Vocational Village, an alternative school for the training of individuals who have experienced failure in other educational settings. Focus was on the development of an evaluation model which will assess the…

Quality Assessment of Economic Evaluations of Suicide and Self-Harm Interventions.

PubMed

Bustamante Madsen, Lizell; Eddleston, Michael; Schultz Hansen, Kristian; Konradsen, Flemming

2018-03-01

Death following self-harm constitutes a major global public health challenge and there is an urgent need for governments to implement cost-effective, national suicide prevention strategies. To conduct a systematic review and quality appraisal of the economic evaluations of interventions aimed at preventing suicidal behavior. A systematic literature search was performed in several literature databases to identify relevant articles published from 2003 to 2016. Drummond's 10-item appraisal tool was used to assess the methodological quality of the included studies. In total, 25 documents encompassing 30 economic evaluations were included in the review. Of the identified evaluations, 10 studies were found to be of poor quality, 14 were of average quality, and six studies were considered of good quality. The majority of evaluations found the interventions to be cost-effective. Several limitations were identified and discussed in the article. A notable few economic evaluations were identified. The studies were diverse, primarily set in high-income countries, and often based on modeling, emphasizing the need for more primary research into the topic. The discussion of suicide and self-harm prevention should be as nuanced as possible, including health economics along with cultural, social, and political aspects.

Effectiveness of acupuncture for cancer pain: protocol for an umbrella review and meta-analyses of controlled trials

PubMed Central

He, Yihan; Liu, Yihong; May, Brian H; Zhang, Anthony Lin; Zhang, Haibo; Lu, ChuanJian; Yang, Lihong; Guo, Xinfeng; Xue, Charlie Changli

2017-01-01

Introduction The National Comprehensive Cancer Network guidelines for adult cancer pain indicate that acupuncture and related therapies may be valuable additions to pharmacological interventions for pain management. Of the systematic reviews related to this topic, some concluded that acupuncture was promising for alleviating cancer pain, while others argued that the evidence was insufficient to support its effectiveness. Methods and analysis This review will consist of three components: (1) synthesis of findings from existing systematic reviews; (2) updated meta-analyses of randomised clinical trials and (3) analyses of results of other types of clinical studies. We will search six English and four Chinese biomedical databases, dissertations and grey literature to identify systematic reviews and primary clinical studies. Two reviewers will screen results of the literature searches independently to identify included reviews and studies. Data from included articles will be abstracted for assessment, analysis and summary. Two assessors will appraise the quality of systematic reviews using Assessment of Multiple Systematic Reviews; assess the randomised controlled trials using the Cochrane Collaboration’s risk of bias tool and other types of studies according to the Newcastle-Ottawa Scale. We will use ‘summary of evidence’ tables to present evidence from existing systematic reviews and meta-analyses. Using the primary clinical studies, we will conduct meta-analysis for each outcome, by grouping studies based on the type of acupuncture, the comparator and the specific type of pain. Sensitivity analyses are planned according to clinical factors, acupuncture method, methodological characteristics and presence of statistical heterogeneity as applicable. For the non-randomised studies, we will tabulate the characteristics, outcome measures and the reported results of each study. Consistencies and inconsistencies in evidence will be investigated and discussed. Finally, we will use the Grading of Recommendations Assessment, Development and Evaluation approach to evaluate the quality of the overall evidence. Ethics and dissemination There are no ethical considerations associated with this review. The findings will be disseminated in peer-reviewed journals or conference presentations. PROSPERO registration number CRD42017064113. PMID:29229658

Implementing assessments of robot-assisted technical skill in urological education: a systematic review and synthesis of the validity evidence.

PubMed

Goldenberg, Mitchell G; Lee, Jason Y; Kwong, Jethro C C; Grantcharov, Teodor P; Costello, Anthony

2018-03-31

To systematically review and synthesise the validity evidence supporting intraoperative and simulation-based assessments of technical skill in urological robot-assisted surgery (RAS), and make evidence-based recommendations for the implementation of these assessments in urological training. A literature search of the Medline, PsycINFO and Embase databases was performed. Articles using technical skill and simulation-based assessments in RAS were abstracted. Only studies involving urology trainees or faculty were included in the final analysis. Multiple tools for the assessment of technical robotic skill have been published, with mixed sources of validity evidence to support their use. These evaluations have been used in both the ex vivo and in vivo settings. Performance evaluations range from global rating scales to psychometrics, and assessments are carried out through automation, expert analysts, and crowdsourcing. There have been rapid expansions in approaches to RAS technical skills assessment, both in simulated and clinical settings. Alternative approaches to assessment in RAS, such as crowdsourcing and psychometrics, remain under investigation. Evidence to support the use of these metrics in high-stakes decisions is likely insufficient at present. © 2018 The Authors BJU International © 2018 BJU International Published by John Wiley & Sons Ltd.

Wearable Inertial Sensor Systems for Lower Limb Exercise Detection and Evaluation: A Systematic Review.

PubMed

O'Reilly, Martin; Caulfield, Brian; Ward, Tomas; Johnston, William; Doherty, Cailbhe

2018-05-01

Analysis of lower limb exercises is traditionally completed with four distinct methods: (1) 3D motion capture; (2) depth-camera-based systems; (3) visual analysis from a qualified exercise professional; and (4) self-assessment. Each method is associated with a number of limitations. The aim of this systematic review is to synthesise and evaluate studies which have investigated the capacity for inertial measurement unit (IMU) technologies to assess movement quality in lower limb exercises. A systematic review of studies identified through the databases of PubMed, ScienceDirect and Scopus was conducted. Articles written in English and published in the last 10 years which investigated an IMU system for the analysis of repetition-based targeted lower limb exercises were included. The quality of included studies was measured using an adapted version of the STROBE assessment criteria for cross-sectional studies. The studies were categorised into three groupings: exercise detection, movement classification or measurement validation. Each study was then qualitatively summarised. From the 2452 articles that were identified with the search strategies, 47 papers are included in this review. Twenty-six of the 47 included studies were deemed as being of high quality. Wearable inertial sensor systems for analysing lower limb exercises is a rapidly growing field of research. Research over the past 10 years has predominantly focused on validating measurements that the systems produce and classifying users' exercise quality. There have been very few user evaluation studies and no clinical trials in this field to date.

Scientific Evaluation and Review of Claims in Health Care (SEaRCH): A Streamlined, Systematic, Phased Approach for Determining "What Works" in Healthcare.

PubMed

Jonas, Wayne B; Crawford, Cindy; Hilton, Lara; Elfenbaum, Pamela

2017-01-01

Answering the question of "what works" in healthcare can be complex and requires the careful design and sequential application of systematic methodologies. Over the last decade, the Samueli Institute has, along with multiple partners, developed a streamlined, systematic, phased approach to this process called the Scientific Evaluation and Review of Claims in Health Care (SEaRCH™). The SEaRCH process provides an approach for rigorously, efficiently, and transparently making evidence-based decisions about healthcare claims in research and practice with minimal bias. SEaRCH uses three methods combined in a coordinated fashion to help determine what works in healthcare. The first, the Claims Assessment Profile (CAP), seeks to clarify the healthcare claim and question, and its ability to be evaluated in the context of its delivery. The second method, the Rapid Evidence Assessment of the Literature (REAL © ), is a streamlined, systematic review process conducted to determine the quantity, quality, and strength of evidence and risk/benefit for the treatment. The third method involves the structured use of expert panels (EPs). There are several types of EPs, depending on the purpose and need. Together, these three methods-CAP, REAL, and EP-can be integrated into a strategic approach to help answer the question "what works in healthcare?" and what it means in a comprehensive way. SEaRCH is a systematic, rigorous approach for evaluating healthcare claims of therapies, practices, programs, or products in an efficient and stepwise fashion. It provides an iterative, protocol-driven process that is customized to the intervention, consumer, and context. Multiple communities, including those involved in health service and policy, can benefit from this organized framework, assuring that evidence-based principles determine which healthcare practices with the greatest promise are used for improving the public's health and wellness.

The effect of rainfall measurement uncertainties on rainfall-runoff processes modelling.

PubMed

Stransky, D; Bares, V; Fatka, P

2007-01-01

Rainfall data are a crucial input for various tasks concerning the wet weather period. Nevertheless, their measurement is affected by random and systematic errors that cause an underestimation of the rainfall volume. Therefore, the general objective of the presented work was to assess the credibility of measured rainfall data and to evaluate the effect of measurement errors on urban drainage modelling tasks. Within the project, the methodology of the tipping bucket rain gauge (TBR) was defined and assessed in terms of uncertainty analysis. A set of 18 TBRs was calibrated and the results were compared to the previous calibration. This enables us to evaluate the ageing of TBRs. A propagation of calibration and other systematic errors through the rainfall-runoff model was performed on experimental catchment. It was found that the TBR calibration is important mainly for tasks connected with the assessment of peak values and high flow durations. The omission of calibration leads to up to 30% underestimation and the effect of other systematic errors can add a further 15%. The TBR calibration should be done every two years in order to catch up the ageing of TBR mechanics. Further, the authors recommend to adjust the dynamic test duration proportionally to generated rainfall intensity.

Developing a tool for systematic inclusion of non-academic factors in dental school admissions: towards building diversity in the dental workforce.

PubMed

Lopez, Naty; Self, Karl; Karnitz, Jeff

2009-12-01

This retrospective study aimed to determine the ability of a self-designed evaluation instrument to identify applicants who should be invited for an interview and to assess applications including non-academic factors in a consistent and systematic manner. The instrument was constructed using information culled from the American Dental Education Association Associated American Dental Schools Application Service (ADEA AADSAS) applications including academic (DAT, GPA) and non-academic qualifications (work experience, volunteer and extracurricular activities, rural and ethnic background, essays). Weights were assigned to each item assessed. Using applications received during the 2006 and 2007 admissions cycles, the instrument identified who should have been invited for interview. Descriptive statistics and specificity and sensitivity tests were conducted. The instrument allowed for a systematic quantitative assessment of non-academic factors that was part of the overall evaluation of applicants. Results show differences in non-academic scores of minority compared to non-minority applicants, males compared to females, and those who were offered interviews compared to those not interviewed. It is possible that some applicants who were not offered interviews could have gained a chance to be looked at more closely on a second round of review if non-academic factors were considered.

Systematic instruction for individuals with acquired brain injury: Results of a randomized controlled trial

PubMed Central

Powell, Laurie Ehlhardt; Glang, Ann; Ettel, Deborah; Todis, Bonnie; Sohlberg, McKay; Albin, Richard

2012-01-01

The goal of this study was to experimentally evaluate systematic instruction compared with trial-and-error learning (conventional instruction) applied to assistive technology for cognition (ATC), in a double blind, pretest-posttest, randomized controlled trial. Twenty-nine persons with moderate-severe cognitive impairments due to acquired brain injury (15 in systematic instruction group; 14 in conventional instruction) completed the study. Both groups received 12, 45-minute individual training sessions targeting selected skills on the Palm Tungsten E2 personal digital assistant (PDA). A criterion-based assessment of PDA skills was used to evaluate accuracy, fluency/efficiency, maintenance, and generalization of skills. There were no significant differences between groups at immediate posttest with regard to accuracy and fluency. However, significant differences emerged at 30-day follow-up in favor of systematic instruction. Furthermore, systematic instruction participants performed significantly better at immediate posttest generalizing trained PDA skills when interacting with people other than the instructor. These results demonstrate that systematic instruction applied to ATC results in better skill maintenance and generalization than trial-and-error learning for individuals with moderate-severe cognitive impairments due to acquired brain injury. Implications, study limitations, and directions for future research are discussed. PMID:22264146

Effect of resveratrol supplementation on cognitive performance and mood in adults: a systematic literature review and meta-analysis of randomized controlled trials.

PubMed

Marx, Wolfgang; Kelly, Jaimon T; Marshall, Skye; Cutajar, Jennifer; Annois, Brigitte; Pipingas, Andrew; Tierney, Audrey; Itsiopoulos, Catherine

2018-06-01

The aim of this systematic review was to evaluate clinical trial data regarding the effect of resveratrol supplementation on cognitive performance and mood in populations that are healthy and in the clinical setting. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, a systematic literature review of randomized controlled trials was conducted. A meta-analysis was also conducted to determine treatment effect on the following cognitive domains and mental processes: processing speed, number facility, memory, and mood. Risk of bias was assessed using the Cochrane Collaboration Risk of Bias tool. Quality of the body of evidence was assessed by evidence for each outcome related to cognitive function for which data was assessed using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE). Ten studies were included. Three studies found resveratrol supplementation significantly improved some measures of cognitive performance, 2 reported mixed findings, and 5 found no effect. When data were pooled, resveratrol supplementation had a significant effect on delayed recognition (standardized mean difference [SMD], 0.39; 95% confidence interval [CI], 0.08-0.70; I2 = 0%; P = 0.01; n = 3 studies; n = 166 participants) and negative mood (SMD, -0.18; 95%CI, -0.31 to -0.05; I2 = 0%; P = 0.006; n = 3 studies; n = 163 participants). Included studies generally had low risk of bias and were of moderate or high quality. The results of this review indicate that resveratrol supplementation might improve select measures of cognitive performance; however, the current literature is inconsistent and limited.

Physical Activity and Exercise Interventions in the Workplace Impacting Work Outcomes: A Stakeholder-Centered Best Evidence Synthesis of Systematic Reviews.

PubMed

White, M I; Dionne, C E; Wärje, O; Koehoorn, M; Wagner, S L; Schultz, I Z; Koehn, C; Williams-Whitt, K; Harder, H G; Pasca, R; Hsu, V; McGuire, L; Schulz, W; Kube, D; Wright, M D

2016-04-01

The prevention of work disability is beneficial to employees and employers, and mitigates unnecessary societal costs associated with social welfare. Many service providers and employers have initiated workplace interventions designed to reduce unnecessary work disability. To conduct a best-evidence synthesis of systematic reviews on workplace interventions that address physical activities or exercise and their impact on workplace absence, work productivity or financial outcomes. Using a participatory research approach, academics and stakeholders identified inclusion and exclusion criteria, built an abstraction table, evaluated systematic review quality and relevance, and interpreted the combined findings. A minimum of two scientists participated in a methodological review of the literature followed by a consensus process. Stakeholders and researchers participated as a collaborative team. 3363 unique records were identified, 115 full text articles and 46 systematic reviews were included, 18 assessed the impact of physical fitness or exercise interventions. 11 focused on general workers rather than workers who were absent from work at baseline; 16 of the reviews assessed work absence, 4 assessed productivity and 6 assessed financial impacts. The strongest evidence supports the use of short, simple exercise or fitness programs for both workers at work and those absent from work at baseline. For workers at work, simple exercise programs (1-2 modal components) appear to provide similar benefits to those using more complex multimodal interventions. For workers off-work with subacute low back pain, there is evidence that some complex exercise programs may be more effective than simple exercise interventions, especially if they involve workplace stakeholder engagement, communication and coordination with employers and other stakeholders. The development and utilization of standardized definitions, methods and measures and blinded evaluation would improve research quality and strengthen stakeholder-centered guidance.

Systematic review protocol of interventions to improve the psychological well-being of general practitioners.

PubMed

Murray, Marylou; Murray, Lois; Donnelly, Michael

2015-09-22

The challenges and complexities faced by general practitioners are increasing, and there are concerns about their well-being. Consequently, attention has been directed towards developing and evaluating interventions and strategies to improve general practitioner well-being and their capacity to cope with workplace challenges. This systematic review aims to evaluate research evidence regarding the effectiveness of interventions designed to improve general practitioner well-being. Eligible studies will include programmes developed to improve psychological well-being that have assessed outcomes using validated tools pertaining to well-being and related outcomes. Only programmes that have been evaluated using controlled study designs will be reviewed. An appropriately developed search strategy will be applied to six electronic databases: the Cochrane Database of Systematic Reviews, MEDLINE, Embase, CINAHL, PsycINFO and Web of Science. Studies will be screened in two stages by two independent reviewers. A third reviewer will arbitrate when required. Pre-specified inclusion and exclusion criteria will be assessed during a pilot phase early on in the review process. The Cochrane data extraction form will be adapted and applied to each eligible study by two independent reviewers, and each study will be appraised critically using standardised checklists from the Cochrane Handbook. Methodological quality will be taken into account in the analysis of the data and the synthesis of results. A narrative synthesis will be undertaken if data is unsuited to a meta-analysis. The systematic review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidance. This will be the first systematic review on this topic, and the evidence synthesis will aid decision-making by general practitioners, policy makers and planners regarding ways in which to improve GP well-being. Findings will be disseminated at general practitioner meetings, conferences and in professional and peer-reviewed journals. PROSPERO CRD42015017899.

Innovative Training for Occupational Health and Infection Control Workplace Assessment in Health Care

ERIC Educational Resources Information Center

O'Hara, Lyndsay; Bryce, Elizabeth Ann; Scharf, Sydney; Yassi, Annalee

2012-01-01

A user-friendly, high quality workplace assessment field guide and an accompanying worksheet are invaluable tools for recognizing hazards in the hospital environment. These tools ensure that both front line workers as well as health and safety and infection control professionals can systematically evaluate hazards and formulate recommendations.…

An Evaluation Design for the Educational Programs for Pupils Who Are Orthopedically Handicapped.

ERIC Educational Resources Information Center

South Carolina State Dept. of Education, Columbia. Office of Programs for the Handicapped.

The booklet provides forms for the teacher of the orthopedically handicapped to use in systematically collecting data and designing an appropriate educational blueprint for each student. Pupil development assessment sheets include columns for recording assessment date, date of mastery, level of achievement, and comments for each behavioral…

Muscle Oximetry in Sports Science: A Systematic Review.

PubMed

Perrey, Stephane; Ferrari, Marco

2018-03-01

Since the introduction (in 2006) of commercially available portable wireless muscle oximeters, the use of muscle near-infrared spectroscopy (NIRS) technology is gaining in popularity as an application to observe changes in muscle metabolism and muscle oxygenation during and after exercise or training interventions in both laboratory and applied sports settings. The objectives of this systematic review were to highlight the application of muscle oximetry in evaluating oxidative skeletal muscle performance to sport activities and emphasize how this technology has been applied to exercise and training. Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed in a systematic fashion to search, assess and synthesize existing literature on this topic. The Scopus and MEDLINE/PubMed electronic databases were searched to 1 March 2017. Potential inclusions were screened against eligibility criteria relating to recreationally trained to elite athletes, with or without training programs, who must have assessed physiological variables monitored by commercial oximeters or NIRS instrumentation. Of the 14,609 identified records, only 57 studies met the eligibility criteria. This systematic review highlighted a number of key findings in 16 sporting activities. Overall, NIRS information can be used as a marker of skeletal muscle oxidative capacity and for analyzing muscle performance factors. Although NIRS instrumentation is promising in evaluating oxidative skeletal muscle performance when used in sport settings, there is still the need for further instrumental development and randomized/longitudinal trials to support the detailed advantages of muscle oximetry utilization in sports science.

What do we know about managing Dupuytren's disease cost-effectively?

PubMed

Dritsaki, Melina; Rivero-Arias, Oliver; Gray, Alastair; Ball, Catherine; Nanchahal, Jagdeep

2018-01-25

Dupuytren's disease (DD) is a common and progressive, fibroproliferative disorder of the palmar and digital fascia of the hand. Various treatments have been recommended for advanced disease or to retard progression of early disease and to prevent deterioration of the finger contracture and quality of life. Recent studies have tried to evaluate the clinical and cost-effectiveness of therapies for DD, but there is currently no systematic assessment and appraisal of the economic evaluations. A systematic literature review was conducted, following PRISMA guidelines, to identify studies reporting economic evaluations of interventions for managing DD. Databases searched included the Ovid MEDLINE/Embase (without time restriction), National Health Service (NHS) Economic Evaluation Database (all years) and the National Institute for Health Research (NIHR) Journals Library) Health Technology Assessment (HTA). Cost-effectiveness analyses of treating DD were identified and their quality was assessed using the CHEERS assessment tool for quality of reporting and Phillips checklist for model evaluation. A total of 103 studies were screened, of which 4 met the study inclusion criteria. Two studies were from the US, one from the UK and one from Canada. They all assessed the same interventions for advanced DD, namely collagenase Clostridium histolyticum injection, percutaneous needle fasciotomy and partial fasciectomy. All studies conducting a cost-utility analysis, two implemented a decision analytic model and two a Markov model approach. None of them were based on a single randomised controlled trial, but rather synthesised evidence from various sources. Studies varied in their time horizon, sources of utility estimates and perspective of analysis. The overall quality of study reporting was good based on the CHEERS checklist. The quality of the model reporting in terms of model structure, data synthesis and model consistency varied across the included studies. Cost-effectiveness analyses for patients with advanced DD are limited and have applied different approaches with respect to modelling. Future studies should improve the way they are conducted and report their findings according to established guidance for conducting economic modelling of health care technologies. The protocol was registered ( CRD42016032989 ; date 08/01/2016) with the PROSPERO international prospective register of systematic reviews.

Surgical versus injection treatment for injection-confirmed chronic sacroiliac joint pain

PubMed Central

Spiker, William Ryan; Lawrence, Brandon D.; Raich, Annie L.; Skelly, Andrea C.; Brodke, Darrel S.

2012-01-01

Study design: Systematic review. Study rationale: Chronic sacroiliac joint pain (CSJP) is a common clinical entity with highly controversial treatment options. A recent systematic review compared surgery with denervation, but the current systematic review compares outcomes of surgical intervention with therapeutic injection for the treatment of CSJP and serves as the next step for evaluating current evidence on the comparative effectiveness of treatments for non-traumatic sacroiliac joint pain. Objective or clinical question: In adult patients with injection-confirmed CSJP, does surgical treatment lead to better outcomes and fewer complications than injection therapy? Methods: A systematic review of the English-language literature was undertaken for articles published between 1970 and June 2012. Electronic databases and reference lists of key articles were searched to identify studies evaluating surgery or injection treatment for injection-confirmed CSJP. Studies involving traumatic onset or non-injection–confirmed CSJP were excluded. Two independent reviewers assessed the level of evidence quality using the grading of recommendations assessment, development and evaluation (GRADE) system, and disagreements were resolved by consensus. Results: We identified twelve articles (seven surgical and five injection treatment) meeting our inclusion criteria. Regardless of the type of treatment, most studies reported over 40% improvement in pain as measured by Visual Analog Scale or Numeric rating Scale score. Regardless of the type of treatment, most studies reported over 20% improvement in functionality. Most complications were reported in the surgical studies. Conclusion: Surgical fusion and therapeutic injections can likely provide pain relief, improve quality of life, and improve work status. The comparative effectiveness of these interventions cannot be evaluated with the current literature. PMID:23526911

Intelligent interface design and evaluation

NASA Technical Reports Server (NTRS)

Greitzer, Frank L.

1988-01-01

Intelligent interface concepts and systematic approaches to assessing their functionality are discussed. Four general features of intelligent interfaces are described: interaction efficiency, subtask automation, context sensitivity, and use of an appropriate design metaphor. Three evaluation methods are discussed: Functional Analysis, Part-Task Evaluation, and Operational Testing. Design and evaluation concepts are illustrated with examples from a prototype expert system interface for environmental control and life support systems for manned space platforms.

Revista de Investigacion Educativa, 2000 (Journal of Educational Research, 2000).

ERIC Educational Resources Information Center

Revista de Investigacion Educativa, 2000

2000-01-01

Articles in this volume focus on the following: teacher evaluation and quality management in education; steps toward a comprehensive and systematic staff evaluation; opinions of university students on teaching methods at science faculties; design of a scale to assess the ability to jump for the use in elementary school physical education; effects…

Measuring the Youth Bullying Experience: A Systematic Review of the Psychometric Properties of Available Instruments

ERIC Educational Resources Information Center

Vessey, Judith; Strout, Tania D.; DiFazio, Rachel L.; Walker, Allison

2014-01-01

Background: Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified…

An Evaluation of the Technical Adequacy of a Revised Measure of Quality Indicators of Transition

ERIC Educational Resources Information Center

Morningstar, Mary E.; Lee, Hyunjoo; Lattin, Dana L.; Murray, Angela K.

2016-01-01

This study confirmed the reliability and validity of the Quality Indicators of Exemplary Transition Programs Needs Assessment-2 (QI-2). Quality transition program indicators were identified through a systematic synthesis of transition research, policies, and program evaluation measures. To verify reliability and validity of the QI-2, we…

A Systematic Review and Psychometric Evaluation of Adaptive Behavior Scales and Recommendations for Practice

ERIC Educational Resources Information Center

Floyd, Randy G.; Shands, Elizabeth I.; Alfonso, Vincent C.; Phillips, Jessica F.; Autry, Beth K.; Mosteller, Jessica A.; Skinner, Mary; Irby, Sarah

2015-01-01

Adaptive behavior scales are vital in assessing children and adolescents who experience a range of disabling conditions in school settings. This article presents the results of an evaluation of the design characteristics, norming, scale characteristics, reliability and validity evidence, and bias identification studies supporting 14…

Professional Competencies and Jurisdictional Claims in Evaluative Bibliometrics: The Educational Mandate of Academic Librarians

ERIC Educational Resources Information Center

Petersohn, Sabrina

2016-01-01

Quantitative metrics in research assessment are proliferating all over the world. The demand has led to an increase in bibliometric practitioners and service providers. Their professional roles and competencies have not yet been subject to systematic study. This paper focuses on one important service provider in evaluative bibliometrics--academic…

A Systematic Review of the Empirical Literature on Intercessory Prayer

ERIC Educational Resources Information Center

Hodge, David R.

2007-01-01

Perhaps surprisingly, many social workers appear to use intercessory prayer in direct practice settings. To help inform practitioners' use of this intervention, this article evaluates the empirical literature on the topic using the following three methods: (a) an individual assessment of each study, (b) an evaluation of intercessory prayer as an…

Abstract analysis method facilitates filtering low-methodological quality and high-bias risk systematic reviews on psoriasis interventions.

PubMed

Gómez-García, Francisco; Ruano, Juan; Aguilar-Luque, Macarena; Alcalde-Mellado, Patricia; Gay-Mimbrera, Jesús; Hernández-Romero, José Luis; Sanz-Cabanillas, Juan Luis; Maestre-López, Beatriz; González-Padilla, Marcelino; Carmona-Fernández, Pedro J; García-Nieto, Antonio Vélez; Isla-Tejera, Beatriz

2017-12-29

Article summaries' information and structure may influence researchers/clinicians' decisions to conduct deeper full-text analyses. Specifically, abstracts of systematic reviews (SRs) and meta-analyses (MA) should provide structured summaries for quick assessment. This study explored a method for determining the methodological quality and bias risk of full-text reviews using abstract information alone. Systematic literature searches for SRs and/or MA about psoriasis were undertaken on MEDLINE, EMBASE, and Cochrane database. For each review, quality, abstract-reporting completeness, full-text methodological quality, and bias risk were evaluated using Preferred Reporting Items for Systematic Reviews and Meta-analyses for abstracts (PRISMA-A), Assessing the Methodological Quality of Systematic Reviews (AMSTAR), and ROBIS tools, respectively. Article-, author-, and journal-derived metadata were systematically extracted from eligible studies using a piloted template, and explanatory variables concerning abstract-reporting quality were assessed using univariate and multivariate-regression models. Two classification models concerning SRs' methodological quality and bias risk were developed based on per-item and total PRISMA-A scores and decision-tree algorithms. This work was supported, in part, by project ICI1400136 (JR). No funding was received from any pharmaceutical company. This study analysed 139 SRs on psoriasis interventions. On average, they featured 56.7% of PRISMA-A items. The mean total PRISMA-A score was significantly higher for high-methodological-quality SRs than for moderate- and low-methodological-quality reviews. SRs with low-bias risk showed higher total PRISMA-A values than reviews with high-bias risk. In the final model, only 'authors per review > 6' (OR: 1.098; 95%CI: 1.012-1.194), 'academic source of funding' (OR: 3.630; 95%CI: 1.788-7.542), and 'PRISMA-endorsed journal' (OR: 4.370; 95%CI: 1.785-10.98) predicted PRISMA-A variability. Reviews with a total PRISMA-A score < 6, lacking identification as SR or MA in the title, and lacking explanation concerning bias risk assessment methods were classified as low-methodological quality. Abstracts with a total PRISMA-A score ≥ 9, including main outcomes results and explanation bias risk assessment method were classified as having low-bias risk. The methodological quality and bias risk of SRs may be determined by abstract's quality and completeness analyses. Our proposal aimed to facilitate synthesis of evidence evaluation by clinical professionals lacking methodological skills. External validation is necessary.

A systematic approach to baseline assessment of nursing documentation and enterprise-wide prioritization for electronic conversion.

PubMed

Dykes, Patricia C; Spurr, Cindy; Gallagher, Joan; Li, Qi; Ives Erickson, Jeanette

2006-01-01

An important challenge associated with making the transition from paper to electronic documentation systems is achieving consensus regarding priorities for electronic conversion across diverse groups. In our work we focus on applying a systematic approach to evaluating the baseline state of nursing documentation across a large healthcare system and establishing a unified vision for electronic conversion. A review of the current state of nursing documentation across PHS was conducted using structured tools. Data from this assessment was employed to facilitate an evidence-based approach to decision-making regarding conversion to electronic documentation at local and PHS levels. In this paper we present highlights of the assessment process and the outcomes of this multi-site collaboration.

The clinimetric qualities of patient-assessed instruments for measuring chronic ankle instability: a systematic review.

PubMed

Eechaute, Christophe; Vaes, Peter; Van Aerschot, Lieve; Asman, Sara; Duquet, William

2007-01-18

The assessment of outcomes from the patient's perspective becomes more recognized in health care. Also in patients with chronic ankle instability, the degree of present impairments, disabilities and participation problems should be documented from the perspective of the patient. The decision about which patient-assessed instrument is most appropriate for clinical practice should be based upon systematic reviews. Only rating scales constructed for patients with acute ligament injuries were systematically reviewed in the past. The aim of this study was to review systematically the clinimetric qualities of patient-assessed instruments designed for patients with chronic ankle instability. A computerized literature search of Medline, Embase, Cinahl, Web of Science, Sport Discus and the Cochrane Controlled Trial Register was performed to identify eligible instruments. Two reviewers independently evaluated the clinimetric qualities of the selected instruments using a criteria list. The inter-observer reliability of both the selection procedure and the clinimetric evaluation was calculated using modified kappa coefficients. The inter-observer reliability of the selection procedure was excellent (k = .86). Four instruments met the eligibility criteria: the Ankle Joint Functional Assessment Tool (AJFAT), the Functional Ankle Outcome Score (FAOS), the Foot and Ankle Disability Index (FADI) and the Functional Ankle Ability Measure (FAAM). The inter-observer reliability of the quality assessment was substantial to excellent (k between .64 and .88). Test-retest reliability was demonstrated for the FAOS, the FADI and the FAAM but not for the AJFAT. The FAOS and the FAAM met the criteria for content validity and construct validity. For none of the studied instruments, the internal consistency was sufficiently demonstrated. The presence of floor- and ceiling effects was assessed for the FAOS but ceiling effects were present for all subscales. Responsiveness was demonstrated for the AJFAT, FADI and the FAAM. Only for the FAAM, a minimal clinical important difference (MCID) was presented. The FADI and the FAAM can be considered as the most appropriate, patient-assessed tools to quantify functional disabilities in patients with chronic ankle instability. The clinimetric qualities of the FAAM need to be further demonstrated in a specific population of patients with chronic ankle instability.

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews

PubMed Central

2013-01-01

Background Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. Methods This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. Results A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. Conclusion There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words) PMID:23331384

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews.

PubMed

Wells, Cherie; Kolt, Gregory S; Marshall, Paul; Hill, Bridget; Bialocerkowski, Andrea

2013-01-19

Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words).

Measurement properties of quality of life measurement instruments for infants, children and adolescents with eczema: protocol for a systematic review.

PubMed

Heinl, Daniel; Prinsen, Cecilia A C; Drucker, Aaron M; Ofenloch, Robert; Humphreys, Rosemary; Sach, Tracey; Flohr, Carsten; Apfelbacher, Christian

2016-02-09

Eczema is a common chronic or chronically relapsing, inflammatory skin disease that exerts a substantial negative impact on quality of life (QoL). The Harmonising Outcome Measures for Eczema (HOME) initiative has used a consensus-based process which identified QoL as one of the four core outcome domains to be assessed in all eczema clinical trials. A number of measurement instruments exist to measure QoL in infants, children, and adolescents with eczema, and there is a great variability in both content and quality of the instruments used. Therefore, the objective of the proposed research is to comprehensively and systematically assess the measurement properties of the existing measurement instruments that were developed and/or validated for the measurement of patient-reported QoL in infants, children, and adolescents with eczema. This study is a systematic review of the measurement properties of patient-reported measures of QoL developed and/or validated for infants, children, and adolescents with eczema. A systematic literature search will be carried out in MEDLINE via PubMed and EMBASE using a selection of relevant search terms. Eligible studies will be primary empirical studies evaluating, describing, or comparing measurement properties of QoL instruments for infants, children, and adolescents with eczema. Two reviewers will independently perform eligibility assessment and data abstraction. Evidence tables will be used to record study characteristics, instrument characteristics, measurement properties, and interpretability. The adequacy of the measurement properties will be assessed using predefined criteria. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist will be used to evaluate the methodological quality of included studies. A best evidence synthesis will be undertaken if more than one study has examined a particular measurement property. The proposed systematic review will yield a comprehensive assessment of measurement properties of existing QoL instruments in infants, children, and adolescents with eczema. The results will serve as a basis to recommend a QoL measurement instrument for infants, one for children, and one for adolescents for use in future clinical trials. PROSPERO CRD42015023483.

Complementary and alternative medicine for post-traumatic stress disorder symptoms: A systematic review

PubMed Central

Wahbeh, Helané; Senders, Angela; Neuendorf, Rachel; Cayton, Julien

2014-01-01

Objectives To 1) characterize complementary and alternative medicine (CAM) studies for posttraumatic stress disorder symptoms (PTSD), 2) evaluate the quality of these studies, and 3) systematically grade the scientific evidence for individual CAM modalities for PTSD. Design Systematic Review. Eight data sources were searched. Selection criteria included any study design assessing PTSD outcomes and any CAM intervention. The body of evidence for each modality was assessed with the Natural Standard evidence-based, validated grading rationale.™ Results and Conclusions Thirty-three studies (n=1329) were reviewed. Scientific evidence of benefit for PTSD was Strong for repetitive transcranial magnetic stimulation and Good for acupuncture, hypnotherapy, meditation, and visualization. Evidence was Unclear or Conflicting for biofeedback, relaxation, Emotional Freedom and Thought Field therapies, yoga, and natural products. Considerations for clinical applications and future research recommendations are discussed. PMID:24676593

Systematic review adherence to methodological or reporting quality.

PubMed

Pussegoda, Kusala; Turner, Lucy; Garritty, Chantelle; Mayhew, Alain; Skidmore, Becky; Stevens, Adrienne; Boutron, Isabelle; Sarkis-Onofre, Rafael; Bjerre, Lise M; Hróbjartsson, Asbjørn; Altman, Douglas G; Moher, David

2017-07-19

Guidelines for assessing methodological and reporting quality of systematic reviews (SRs) were developed to contribute to implementing evidence-based health care and the reduction of research waste. As SRs assessing a cohort of SRs is becoming more prevalent in the literature and with the increased uptake of SR evidence for decision-making, methodological quality and standard of reporting of SRs is of interest. The objective of this study is to evaluate SR adherence to the Quality of Reporting of Meta-analyses (QUOROM) and PRISMA reporting guidelines and the A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Overview Quality Assessment Questionnaire (OQAQ) quality assessment tools as evaluated in methodological overviews. The Cochrane Library, MEDLINE®, and EMBASE® databases were searched from January 1990 to October 2014. Title and abstract screening and full-text screening were conducted independently by two reviewers. Reports assessing the quality or reporting of a cohort of SRs of interventions using PRISMA, QUOROM, OQAQ, or AMSTAR were included. All results are reported as frequencies and percentages of reports and SRs respectively. Of the 20,765 independent records retrieved from electronic searching, 1189 reports were reviewed for eligibility at full text, of which 56 reports (5371 SRs in total) evaluating the PRISMA, QUOROM, AMSTAR, and/or OQAQ tools were included. Notable items include the following: of the SRs using PRISMA, over 85% (1532/1741) provided a rationale for the review and less than 6% (102/1741) provided protocol information. For reports using QUOROM, only 9% (40/449) of SRs provided a trial flow diagram. However, 90% (402/449) described the explicit clinical problem and review rationale in the introduction section. Of reports using AMSTAR, 30% (534/1794) used duplicate study selection and data extraction. Conversely, 80% (1439/1794) of SRs provided study characteristics of included studies. In terms of OQAQ, 37% (499/1367) of the SRs assessed risk of bias (validity) in the included studies, while 80% (1112/1387) reported the criteria for study selection. Although reporting guidelines and quality assessment tools exist, reporting and methodological quality of SRs are inconsistent. Mechanisms to improve adherence to established reporting guidelines and methodological assessment tools are needed to improve the quality of SRs.

Methological quality of systematic reviews and meta-analyses on acupuncture for stroke: A review of review.

PubMed

Chen, Xin-Lin; Mo, Chuan-Wei; Lu, Li-Ya; Gao, Ri-Yang; Xu, Qian; Wu, Min-Feng; Zhou, Qian-Yi; Hu, Yue; Zhou, Xuan; Li, Xian-Tao

2017-11-01

To assess the methodological quality of systematic reviews and meta-analyses regarding acupuncture intervention for stroke and the primary studies within them. Two researchers searched PubMed, Cumulative index to Nursing and Allied Health Literature, Embase, ISI Web of Knowledge, Cochrane, Allied and Complementary Medicine, Ovid Medline, Chinese Biomedical Literature Database, China National Knowledge Infrastructure, Wanfang and Traditional Chinese Medical Database to identify systematic reviews and meta-analyses about acupuncture for stroke published from the inception to December 2016. Review characteristics and the criteria for assessing the primary studies within reviews were extracted. The methodological quality of the reviews was assessed using adapted Oxman and Guyatt Scale. The methodological quality of primary studies was also assessed. Thirty-two eligible reviews were identified, 15 in English and 17 in Chinese. The English reviews were scored higher than the Chinese reviews (P=0.025), especially in criteria for avoiding bias and the scope of search. All reviews used the quality criteria to evaluate the methodological quality of primary studies, but some criteria were not comprehensive. The primary studies, in particular the Chinese reviews, had problems with randomization, allocation concealment, blinding, dropouts and withdrawals, intent-to-treat analysis and adverse events. Important methodological flaws were found in Chinese systematic reviews and primary studies. It was necessary to improve the methodological quality and reporting quality of both the systematic reviews published in China and primary studies on acupuncture for stroke.

Diagnostic validity of methods for assessment of swallowing sounds: a systematic review.

PubMed

Taveira, Karinna Veríssimo Meira; Santos, Rosane Sampaio; Leão, Bianca Lopes Cavalcante de; Neto, José Stechman; Pernambuco, Leandro; Silva, Letícia Korb da; De Luca Canto, Graziela; Porporatti, André Luís

2018-02-03

Oropharyngeal dysphagia is a highly prevalent comorbidity in neurological patients and presents a serious health threat, which may lead to outcomes of aspiration pneumonia, ranging from hospitalization to death. This assessment proposes a non-invasive, acoustic-based method to differentiate between individuals with and without signals of penetration and aspiration. This systematic review evaluated the diagnostic validity of different methods for assessment of swallowing sounds, when compared to Videofluroscopic of Swallowing Study (VFSS) to detect oropharyngeal dysphagia. Articles in which the primary objective was to evaluate the accuracy of swallowing sounds were searched in five electronic databases with no language or time limitations. Accuracy measurements described in the studies were transformed to construct receiver operating characteristic curves and forest plots with the aid of Review Manager v. 5.2 (The Nordic Cochrane Centre, Copenhagen, Denmark). The methodology of the selected studies was evaluated using the Quality Assessment Tool for Diagnostic Accuracy Studies-2. The final electronic search revealed 554 records, however only 3 studies met the inclusion criteria. The accuracy values (area under the curve) were 0.94 for microphone, 0.80 for Doppler, and 0.60 for stethoscope. Based on limited evidence and low methodological quality because few studies were included, with a small sample size, from all index testes found for this systematic review, Doppler showed excellent diagnostic accuracy for the discrimination of swallowing sounds, whereas microphone-reported good accuracy discrimination of swallowing sounds of dysphagic patients and stethoscope showed best screening test. Copyright © 2018 Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial. Published by Elsevier Editora Ltda. All rights reserved.

Influence of Familiarization and Competitive Level on the Reliability of Countermovement Vertical Jump Kinetic and Kinematic Variables.

PubMed

Nibali, Maria L; Tombleson, Tom; Brady, Philip H; Wagner, Phillip

2015-10-01

Understanding typical variation of vertical jump (VJ) performance and confounding sources of its typical variability (i.e., familiarization and competitive level) is pertinent in the routine monitoring of athletes. We evaluated the presence of systematic error (learning effect) and nonuniformity of error (heteroscedasticity) across VJ performances of athletes that differ in competitive level and quantified the reliability of VJ kinetic and kinematic variables relative to the smallest worthwhile change (SWC). One hundred thirteen high school athletes, 30 college athletes, and 35 professional athletes completed repeat VJ trials. Average eccentric rate of force development (RFD), average concentric (CON) force, CON impulse, and jump height measurements were obtained from vertical ground reaction force (VGRF) data. Systematic error was assessed by evaluating changes in the mean of repeat trials. Heteroscedasticity was evaluated by plotting the difference score (trial 2 - trial 1) against the mean of the trials. Variability of jump variables was calculated as the typical error (TE) and coefficient of variation (%CV). No substantial systematic error (effect size range: -0.07 to 0.11) or heteroscedasticity was present for any of the VJ variables. Vertical jump can be performed without the need for familiarization trials, and the variability can be conveyed as either the raw TE or the %CV. Assessment of VGRF variables is an effective and reliable means of assessing VJ performance. Average CON force and CON impulse are highly reliable (%CV: 2.7% ×/÷ 1.10), although jump height was the only variable to display a %CV ≤SWC. Eccentric RFD is highly variable yet should not be discounted from VJ assessments on this factor alone because it may be sensitive to changes in response to training or fatigue that exceed the TE.

The methodological quality of systematic reviews published in high-impact nursing journals: a review of the literature.

PubMed

Pölkki, Tarja; Kanste, Outi; Kääriäinen, Maria; Elo, Satu; Kyngäs, Helvi

2014-02-01

To analyse systematic review articles published in the top 10 nursing journals to determine the quality of the methods employed within them. Systematic review is defined as a scientific research method that synthesises high-quality scientific knowledge on a given topic. The number of such reviews in nursing science has increased dramatically during recent years, but their methodological quality has not previously been assessed. A review of the literature using a narrative approach. Ranked impact factor scores for nursing journals were obtained from the Journal Citation Report database of the Institute of Scientific Information (ISI Web of Knowledge). All issues from the years 2009 and 2010 of the top 10 ranked journals were included. CINAHL and MEDLINE databases were searched to locate studies using the search terms 'systematic review' and 'systematic literature review'. A total of 39 eligible studies were identified. Their methodological quality was evaluated through the specific criteria of quality assessment, description of synthesis and strengths and weaknesses reported in the included studies. Most of the eligible systematic reviews included several different designs or types of quantitative study. The majority included a quality assessment, and a total of 17 different criteria were identified. The method of synthesis was mentioned in about half of the reviews, the most common being narrative synthesis. The weaknesses of reviews were discussed, while strengths were rarely highlighted. The methodological quality of the systematic reviews examined varied considerably, although they were all published in nursing journals with a high-impact factor. Despite the fact that systematic reviews are considered the most robust source of research evidence, they vary in methodological quality. This point is important to consider in clinical practice when applying the results to patient care. © 2013 Blackwell Publishing Ltd.

The role of fluorine-18-fluorodeoxyglucose positron emission tomography in evaluating the response to tyrosine-kinase inhibitors in patients with metastatic primary renal cell carcinoma.

PubMed

Caldarella, Carmelo; Muoio, Barbara; Isgrò, Maria Antonietta; Porfiri, Emilio; Treglia, Giorgio; Giovanella, Luca

2014-09-01

Positron emission tomography-computed tomography (PET-CT) using fluorodeoxyglucose (FDG) is increasingly used in the evaluation of patients with advanced renal cell carcinoma (RCC), primarily for staging purposes. The aim of this paper is to perform a systematic review about the usefulness of PET-CT using FDG in response assessment after treatment with tyrosine-kinase inhibitors (TKIs) in patients with advanced RCC. The scientific literature about the role of PET-CT using FDG in the assessment of response to treatment with TKIs in patients affected by advanced RCC was systematically reviewed. Seven studies about the role of PET-CT using FDG in the response assessment after treatment with TKIs (essentially sunitinib and sorafenib) in advanced RCC were retrieved in full-text and analysed, to determine the predictive role of this morpho-functional imaging method on patient outcome. To date, the role of PET-CT using FDG in evaluating the response to TKIs in metastatic RCC patients is still not well defined, partly due to heterogeneity of available studies; however, PET-CT reveals potential role for the selection of patients undergoing therapy with TKIs. The use of contrast-enhanced PET-CT appears to be promising for a "multi-dimensional" evaluation of treatment response in these patients.

Improving patient safety through the systematic evaluation of patient outcomes

PubMed Central

Forster, Alan J.; Dervin, Geoff; Martin, Claude; Papp, Steven

2012-01-01

Despite increased advocacy for patient safety and several large-scale programs designed to reduce preventable harm, most notably surgical checklists, recent data evaluating entire health systems suggests that we are no further ahead in improving patient safety and that hospital complications are no less frequent now than in the 1990s. We suggest that the failure to systematically measure patient safety is the reason for our limited progress. In addition to defining patient safety outcomes and describing their financial and clinical impact, we argue why the failure to implement patient safety measurement systems has compromised the ability to move the agenda forward. We also present an overview of how patient safety can be assessed and the strengths and weaknesses of each method and comment on some of the consequences created by the absence of a systematic measurement system. PMID:23177520

A protocol for a systematic review of non-randomised evaluations of strategies to improve participant recruitment to randomised controlled trials.

PubMed

Gardner, Heidi R; Fraser, Cynthia; MacLennan, Graeme; Treweek, Shaun

2016-08-02

Randomised controlled trials guard against selection bias and therefore offer the fairest way of evaluating healthcare interventions such as medicinal products, devices and services. Recruitment to trials can be extremely difficult, and poor recruitment can lead to extensions to both time and budget and may result in an underpowered study which does not satisfactorily answer the original research question. In the worst cases, a trial may be abandoned, causing huge waste. The evidence to support the choice of recruitment interventions is currently weak. Non-randomised evaluations of recruitment interventions are currently rejected on grounds of poor methodological quality, but systematic evaluation and assessment of this substantial body of work (using Grading of Recommendations Assessment, Development and Evaluation (GRADE) where possible) may provide useful information to support and inform the recruitment decisions of trialists and the research priorities of methodology researchers. The following databases will be searched for relevant studies: Cochrane Methodology Register, MEDLINE, EMBASE, CINAHL and PsycINFO. Any non-randomised study that includes a comparison of two or more interventions to improve recruitment to randomised controlled trials will be included. We will not apply any restrictions on publication date, language or journal. The primary outcome will be the number of individuals or centres recruited into a randomised controlled trial. The secondary outcome will be cost per recruit. Two reviewers will independently screen abstracts for eligible studies, and then, full texts of potentially relevant records will be reviewed. Disagreements will be resolved through discussion. The methodological quality of studies will be assessed using the Cochrane risk of bias tool for non-randomised studies, and the GRADE system will be used if studies are pooled. This review aims to summarise the evidence on methods used to improve recruitment to randomised controlled trials. Carrying out a systematic review including only data from non-randomised studies is a novel approach, and one which some may argue is futile. However, we believe that the systematic evaluation of what is likely to be a substantial amount of research activity is necessary, worthwhile, and will yield valuable results for the clinical trials community regardless of whether the outcomes find in favour of one or more interventions. Should the results of this review suggest that non-randomised evaluations do have something to offer trialists planning their recruitment strategies, the review may be combined in the future with the Cochrane review of randomised evaluations to produce a full review of recruitment strategies encompassing both randomised and non-randomised evaluation methods. PROSPERO CRD42016037718.

Prioritizing Chemicals for Risk Assessment Using Chemoinformatics: Examples from the IARC Monographs on Pesticides.

PubMed

Guha, Neela; Guyton, Kathryn Z; Loomis, Dana; Barupal, Dinesh Kumar

2016-12-01

Identifying cancer hazards is the first step towards cancer prevention. The International Agency for Research on Cancer (IARC) Monographs Programme, which has evaluated nearly 1,000 agents for their carcinogenic potential since 1971, typically selects agents for hazard identification on the basis of public nominations, expert advice, published data on carcinogenicity, and public health importance. Here, we present a novel and complementary strategy for identifying agents for hazard evaluation using chemoinformatics, database integration, and automated text mining. To inform selection among a broad range of pesticides nominated for evaluation, we identified and screened nearly 6,000 relevant chemical structures, after which we systematically compiled information on 980 pesticides, creating network maps that allowed cluster visualization by chemical similarity, pesticide class, and publicly available information concerning cancer epidemiology, cancer bioassays, and carcinogenic mechanisms. For the IARC Monograph meetings that took place in March and June 2015, this approach supported high-priority evaluation of glyphosate, malathion, parathion, tetrachlorvinphos, diazinon, p,p'-dichlorodiphenyltrichloroethane (DDT), lindane, and 2,4-dichlorophenoxyacetic acid (2,4-D). This systematic approach, accounting for chemical similarity and overlaying multiple data sources, can be used by risk assessors as well as by researchers to systematize, inform, and increase efficiency in selecting and prioritizing agents for hazard identification, risk assessment, regulation, or further investigation. This approach could be extended to an array of outcomes and agents, including occupational carcinogens, drugs, and foods. Citation: Guha N, Guyton KZ, Loomis D, Barupal DK. 2016. Prioritizing chemicals for risk assessment using chemoinformatics: examples from the IARC Monographs on Pesticides. Environ Health Perspect 124:1823-1829; http://dx.doi.org/10.1289/EHP186.

Prioritizing Chemicals for Risk Assessment Using Chemoinformatics: Examples from the IARC Monographs on Pesticides

PubMed Central

Guha, Neela; Guyton, Kathryn Z.; Loomis, Dana; Barupal, Dinesh Kumar

2016-01-01

Background: Identifying cancer hazards is the first step towards cancer prevention. The International Agency for Research on Cancer (IARC) Monographs Programme, which has evaluated nearly 1,000 agents for their carcinogenic potential since 1971, typically selects agents for hazard identification on the basis of public nominations, expert advice, published data on carcinogenicity, and public health importance. Objectives: Here, we present a novel and complementary strategy for identifying agents for hazard evaluation using chemoinformatics, database integration, and automated text mining. Discussion: To inform selection among a broad range of pesticides nominated for evaluation, we identified and screened nearly 6,000 relevant chemical structures, after which we systematically compiled information on 980 pesticides, creating network maps that allowed cluster visualization by chemical similarity, pesticide class, and publicly available information concerning cancer epidemiology, cancer bioassays, and carcinogenic mechanisms. For the IARC Monograph meetings that took place in March and June 2015, this approach supported high-priority evaluation of glyphosate, malathion, parathion, tetrachlorvinphos, diazinon, p,p′-dichlorodiphenyltrichloroethane (DDT), lindane, and 2,4-dichlorophenoxyacetic acid (2,4-D). Conclusions: This systematic approach, accounting for chemical similarity and overlaying multiple data sources, can be used by risk assessors as well as by researchers to systematize, inform, and increase efficiency in selecting and prioritizing agents for hazard identification, risk assessment, regulation, or further investigation. This approach could be extended to an array of outcomes and agents, including occupational carcinogens, drugs, and foods. Citation: Guha N, Guyton KZ, Loomis D, Barupal DK. 2016. Prioritizing chemicals for risk assessment using chemoinformatics: examples from the IARC Monographs on Pesticides. Environ Health Perspect 124:1823–1829; http://dx.doi.org/10.1289/EHP186 PMID:27164621

Developing an evidence-based Guide to Community Preventive Services--methods. The Task Force on Community Preventive Services.

PubMed

Briss, P A; Zaza, S; Pappaioanou, M; Fielding, J; Wright-De Agüero, L; Truman, B I; Hopkins, D P; Mullen, P D; Thompson, R S; Woolf, S H; Carande-Kulis, V G; Anderson, L; Hinman, A R; McQueen, D V; Teutsch, S M; Harris, J R

2000-01-01

Systematic reviews and evidence-based recommendations are increasingly important for decision making in health and medicine. Over the past 20 years, information on the science of synthesizing research results has exploded. However, some approaches to systematic reviews of the effectiveness of clinical preventive services and medical care may be less appropriate for evaluating population-based interventions. Furthermore, methods for linking evidence to recommendations are less well developed than methods for synthesizing evidence. The Guide to Community Preventive Services: Systematic Reviews and Evidence-Based Recommendations (the Guide) will evaluate and make recommendations on population-based and public health interventions. This paper provides an overview of the Guide's process to systematically review evidence and translate that evidence into recommendations. The Guide reviews evidence on effectiveness, the applicability of effectiveness data, (i.e., the extent to which available effectiveness data is thought to apply to additional populations and settings), the intervention's other effects (i.e., important side effects), economic impact, and barriers to implementation of interventions. The steps for obtaining and evaluating evidence into recommendations involve: (1) forming multidisciplinary chapter development teams, (2) developing a conceptual approach to organizing, grouping, selecting and evaluating the interventions in each chapter; (3) selecting interventions to be evaluated; (4) searching for and retrieving evidence; (5) assessing the quality of and summarizing the body of evidence of effectiveness; (6) translating the body of evidence of effectiveness into recommendations; (7) considering information on evidence other than effectiveness; and (8) identifying and summarizing research gaps. Systematic reviews of and evidence-based recommendations for population-health interventions are challenging and methods will continue to evolve. However, using an evidence-based approach to identify and recommend effective interventions directed at specific public health goals may reduce errors in how information is collected and interpreted, identify important gaps in current knowledge thus guiding further research, and enhance the Guide users' ability to assess whether recommendations are valid and prudent from their own perspectives. Over time, all of these advantages could help to increase agreement regarding appropriate community health strategies and help to increase their implementation.

Publication Bias and Nonreporting Found in Majority of Systematic Reviews and Meta-analyses in Anesthesiology Journals.

PubMed

Hedin, Riley J; Umberham, Blake A; Detweiler, Byron N; Kollmorgen, Lauren; Vassar, Matt

2016-10-01

Systematic reviews and meta-analyses are used by clinicians to derive treatment guidelines and make resource allocation decisions in anesthesiology. One cause for concern with such reviews is the possibility that results from unpublished trials are not represented in the review findings or data synthesis. This problem, known as publication bias, results when studies reporting statistically nonsignificant findings are left unpublished and, therefore, not included in meta-analyses when estimating a pooled treatment effect. In turn, publication bias may lead to skewed results with overestimated effect sizes. The primary objective of this study is to determine the extent to which evaluations for publication bias are conducted by systematic reviewers in highly ranked anesthesiology journals and which practices reviewers use to mitigate publication bias. The secondary objective of this study is to conduct publication bias analyses on the meta-analyses that did not perform these assessments and examine the adjusted pooled effect estimates after accounting for publication bias. This study considered meta-analyses and systematic reviews from 5 peer-reviewed anesthesia journals from 2007 through 2015. A PubMed search was conducted, and full-text systematic reviews that fit inclusion criteria were downloaded and coded independently by 2 authors. Coding was then validated, and disagreements were settled by consensus. In total, 207 systematic reviews were included for analysis. In addition, publication bias evaluation was performed for 25 systematic reviews that did not do so originally. We used Egger regression, Duval and Tweedie trim and fill, and funnel plots for these analyses. Fifty-five percent (n = 114) of the reviews discussed publication bias, and 43% (n = 89) of the reviews evaluated publication bias. Funnel plots and Egger regression were the most common methods for evaluating publication bias. Publication bias was reported in 34 reviews (16%). Thirty-six of the 45 (80.0%) publication bias analyses indicated the presence of publication bias by trim and fill analysis, whereas Egger regression indicated publication bias in 23 of 45 (51.1%) analyses. The mean absolute percent difference between adjusted and observed point estimates was 15.5%, the median was 6.2%, and the range was 0% to 85.5%. Many of these reviews reported following published guidelines such as PRISMA or MOOSE, yet only half appropriately addressed publication bias in their reviews. Compared with previous research, our study found fewer reviews assessing publication bias and greater likelihood of publication bias among reviews not performing these evaluations.

Evidence of the clinical effectiveness of cognitive pharmaceutical services for aged patients.

PubMed

Sáez-Benito, Loreto; Fernandez-Llimos, Fernando; Feletto, Eleonora; Gastelurrutia, Miguel Angel; Martinez-Martinez, Fernando; Benrimoj, Shalom I

2013-07-01

cognitive pharmaceutical services (CPSs) encompass a variety of pharmacists' interventions to optimise pharmacotherapy. The clinical effectiveness of CPSs for aged patients remains controversial. to analyse and describe the evidence of the clinical effectiveness of CPSs in aged patients by means of performing a systematic review of systematic reviews. using the recommended methodology by Cochrane, a search was undertaken for systematic reviews of the clinical effectiveness of CPSs in MEDLINE, EMBASE, DOAJ, SCIELO and COCHRANE LIBRARY. Reviews were assessed using the Assessment of Multiple Systematic Reviews (AMSTAR) instrument. Quality of the evidence in the reviews was ranked using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. a total of 14 systematic reviews and one meta-analysis were analysed. The overall quality of the reviews was moderate. High and moderate strength of evidence was found for the positive effect of certain CPSs on reducing the number and improving the appropriateness of medicines. There was conflicting evidence of the effect on adherence. There was limited evidence of high and moderate strength on clinical outcomes. No positive evidence was found on mortality, hospitalisations, functional capacity and cognitive function. No systematic reviews reported the effect on the level of control of health problems. certain types of CPSs reduce the number of medicines and improve the appropriateness of prescriptions. Longer follow-up periods and/or the use of surrogate clinical variables measuring the short-term impact are required to demonstrate the effect on clinical outcomes.

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Multitask protocols to evaluate activities of daily living performance in people with COPD: a systematic review.

PubMed

Paes, Thaís; Machado, Felipe Vilaça Cavallari; Cavalheri, Vinícius; Pitta, Fabio; Hernandes, Nidia Aparecida

2017-07-01

People with chronic obstructive pulmonary disease (COPD) present symptoms such as dyspnea and fatigue, which hinder their performance in activities of daily living (ADL). A few multitask protocols have been developed to assess ADL performance in this population, although measurement properties of such protocols were not yet systematically reviewed. Areas covered: Studies were included if an assessment of the ability to perform ADL was conducted in people with COPD using a (objective) performance-based protocol. The search was conducted in the following databases: Pubmed, EMBASE, Cochrane Library, PEDro, CINAHL and LILACS. Furthermore, hand searches were conducted. Expert commentary: Up to this moment, only three protocols had measurement properties described: the Glittre ADL Test, the Monitored Functional Task Evaluation and the Londrina ADL Protocol were shown to be valid and reliable whereas only the Glittre ADL Test was shown to be responsive to change after pulmonary rehabilitation. These protocols can be used in laboratory settings and clinical practice to evaluate ADL performance in people with COPD, although there is need for more in-depth information on their validity, reliability and especially responsiveness due to the growing interest in the accurate assessment of ADL performance in this population.

A systematic review of balance and fall risk assessments with mobile phone technology.

PubMed

Roeing, Kathleen L; Hsieh, Katherine L; Sosnoff, Jacob J

2017-11-01

Falls are a major health concern for older adults. Preventative measures can help reduce the incidence and severity of falls. Methods for assessing balance and fall risk factors are necessary to effectively implement preventative measures. Research groups are currently developing mobile applications to enable seniors, caregivers, and clinicians to monitor balance and fall risk. The following systematic review assesses the current state of mobile health apps for testing balance as a fall risk factor. Thirteen studies were identified and included in the review and analyzed based on study design, population, sample size, measures of balance, main outcome measures, and evaluation of validity and reliability. All studies successfully tested their applications, but only 38% evaluated the validity, and 23% evaluated the reliability of their applications. Of those, all applications were found to accurately and reliably measure balance on select variables. Four of the 13 studies included special populations groups. Out of the 13 studies, 12 reported clinicians as their intended user and seven reported seniors as their intended user. Further research should examine the validity of mobile health applications as well as report on the application's usability. Copyright © 2017 Elsevier B.V. All rights reserved.

Simulation modeling for stratified breast cancer screening - a systematic review of cost and quality of life assumptions.

PubMed

Arnold, Matthias

2017-12-02

The economic evaluation of stratified breast cancer screening gains momentum, but produces also very diverse results. Systematic reviews so far focused on modeling techniques and epidemiologic assumptions. However, cost and utility parameters received only little attention. This systematic review assesses simulation models for stratified breast cancer screening based on their cost and utility parameters in each phase of breast cancer screening and care. A literature review was conducted to compare economic evaluations with simulation models of personalized breast cancer screening. Study quality was assessed using reporting guidelines. Cost and utility inputs were extracted, standardized and structured using a care delivery framework. Studies were then clustered according to their study aim and parameters were compared within the clusters. Eighteen studies were identified within three study clusters. Reporting quality was very diverse in all three clusters. Only two studies in cluster 1, four studies in cluster 2 and one study in cluster 3 scored high in the quality appraisal. In addition to the quality appraisal, this review assessed if the simulation models were consistent in integrating all relevant phases of care, if utility parameters were consistent and methodological sound and if cost were compatible and consistent in the actual parameters used for screening, diagnostic work up and treatment. Of 18 studies, only three studies did not show signs of potential bias. This systematic review shows that a closer look into the cost and utility parameter can help to identify potential bias. Future simulation models should focus on integrating all relevant phases of care, using methodologically sound utility parameters and avoiding inconsistent cost parameters.

[Clinical evaluation of the optic disc in glaucoma].

PubMed

Greslechner, R; Spiegel, D

2016-10-01

Glaucoma is defined as a progressive neuropathy of the optic nerve, characterized by specific changes of the optic disc, parapapillary region, and retinal nerve fiber layer. Characteristic glaucomatous changes of the optic disc, parapapillary region, and retinal nerve fiber layer are discussed and their ophthalmoscopic examination is described. A literature search in the PubMed database was conducted. A systematic step-by-step approach to a qualitative and quantitative ophthalmoscopic evaluation of the optic disc regarding glaucomatous damage is presented. A systematic, clinical, qualitative, and quantitative assessment of the optic disc can be performed with little effort and forms the basis for diagnosis and treatment of glaucoma.

An evaluation of malingering screens with competency to stand trial patients: a known-groups comparison.

PubMed

Vitacco, Michael J; Rogers, Richard; Gabel, Jason; Munizza, Janice

2007-06-01

The assessment of malingering is a fundamental component of forensic evaluations that should be considered with each referral. In systematizing the evaluation of malingering, one option is the standardized administration of screens as an initial step. The current study assessed the effectiveness of three common screening measures: the Miller Forensic Assessment of Symptoms Test (M-FAST; Miller, 2001), the Structured Inventory of Malingered Symptomatology (SIMS; Widows & Smith, 2004), and the Evaluation of Competency to Stand Trial-Revised Atypical Presentation Scale (ECST-R ATP; Rogers, Tillbrook, & Sewell, 2004). Using the Structured Interview of Reported Symptoms (SIRS) as the external criterion, 100 patients involved in competency to stand trial evaluations were categorized as either probable malingerers (n=21) or nonmalingerers (n=79). Each malingering scale produced robust effect sizes in this known-groups comparison. Results are discussed in relation to the comprehensive assessment of malingering within a forensic context.

Corticosteroid Administration to Prevent Complications of Anterior Cervical Spine Fusion: A Systematic Review

PubMed Central

Zadegan, Shayan Abdollah; Jazayeri, Seyed Behnam; Abedi, Aidin; Bonaki, Hirbod Nasiri; Vaccaro, Alexander R.; Rahimi-Movaghar, Vafa

2017-01-01

Study Design: Systematic review. Objectives: Anterior cervical approach is associated with complications such as dysphagia and airway compromise. In this study, we aimed to systematically review the literature on the efficacy and safety of corticosteroid administration as a preventive measure of such complications in anterior cervical spine surgery with fusion. Methods: Following a systematic literature search of MEDLINE, Embase, and Cochrane databases in July 2016, all comparative human studies that evaluated the effect of steroids for prevention of complications in anterior cervical spine surgery with fusion were included, irrespective of number of levels and language. Risk of bias was assessed using MINORS (Methodological Index for Non-Randomized Studies) checklist and Cochrane Back and Neck group recommendations, for nonrandomized and randomized studies, respectively. Results: Our search yielded 556 articles, of which 9 studies (7 randomized controlled trials and 2 non–randomized controlled trials) were included in the final review. Dysphagia was the most commonly evaluated complication, and in most studies, its severity or incidence was significantly lower in the steroid group. Although prevertebral soft tissue swelling was less commonly assessed, the results were generally in favor of steroid use. The evidence for airway compromise and length of hospitalization was inconclusive. Steroid-related complications were rare, and in both studies that evaluated the fusion rate, it was comparable between steroid and control groups in long-term follow-up. Conclusions: Current literature supports the use of steroids for prevention of complications in anterior cervical spine surgery with fusion. However, evidence is limited by substantial risk of bias and small number of studies reporting key outcomes. PMID:29796378

Agriculture, food, and nutrition interventions that facilitate sustainable food production and impact health: an overview of systematic reviews.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Galvão, Luiz A C

2016-08-01

Objectives To identify the agriculture, food, and nutrition security interventions that facilitate sustainable food production and have a positive impact on health. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations through a comprehensive search of 17 databases and 10 websites. The search employed a pre-defined protocol with clear inclusion criteria. Both grey and peer-reviewed literature published in English, Spanish, and Portuguese between 1 January 1997 and November 2013 were included. To classify as "sustainable," interventions needed to aim to positively impact at least two dimensions of the integrated framework for sustainable development and include measures of health impact. Results Fifteen systematic reviews and seven economic evaluations met the inclusion criteria. All interventions had some impact on health or on risk factors for health outcomes, except those related to genetically modified foods. Impact on health inequalities was rarely measured. All interventions with economic evaluations were very cost-effective, had cost savings, or net benefits. In addition to impacting health (inclusive social development), all interventions had the potential to impact on inclusive economic development, and some, on environmental sustainability, though these effects were rarely assessed. Conclusions What is needed now is careful implementation of interventions with expected positive health impacts but with concurrent, rigorous evaluation. Possible impact on health inequalities needs to be considered and measured by future primary studies and systematic reviews, as does impact of interventions on all dimensions of sustainable development.

Lack of evidence on mental health and well-being impacts of individual-level interventions for vulnerable adolescents: systematic mapping review.

PubMed

Vojt, G; Skivington, K; Sweeting, H; Campbell, M; Fenton, C; Thomson, H

2018-05-30

To review empirical evaluations of individual-level interventions intended to improve mental health or well-being for vulnerable adolescents. This is a systematic mapping review. Thirteen databases covering academic and gray literature were searched for published reviews and randomised controlled trials, and gray literature (2005-2016) and the results quality-assessed to prioritise best available evidence. We aimed to identify well-conducted systematic reviews and trials that evaluated individual-level interventions, for mental health/well-being outcomes, where the population was adolescents aged 10-24 years in any of 12 vulnerable groups at high risk of poor health outcomes (e.g. homeless, offenders, 'looked after', carers). Thirty systematic reviews and 16 additional trials were identified. There was insufficient evidence to identify promising individual-level interventions that improve the mental health/well-being of any of the vulnerable groups. Despite Western policy to promote health and well-being among vulnerable young people, the dearth of evidence suggests a lack of interest in evaluating interventions targeting these groups in respect of their mental health/well-being outcomes. Copyright © 2018 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Developing a Systematic Corrosion Control Evaluation Approach in Flint

EPA Science Inventory

Presentation covers what the projects were that were recommended by the Flint Safe Drinking Water Task Force for corrosion control assessment for Flint, focusing on the sequential sampling project, the pipe rigs, and pipe scale analyses.

Clinical and economic assessment of different general population strategies of pertussis vaccine booster regarding number of doses and age of application for reducing whooping cough disease burden: a systematic review.

PubMed

Rodríguez-Cobo, Iria; Chen, Yen-Fu; Olowokure, Babatunde; Litchfield, Ian

2008-12-09

Pertussis continues to be an important cause of morbidity and mortality in children too young to be fully protected despite high vaccination coverage. This has been attributed to waning immunity in older people, leading to the development of strategies to increase levels of immunity. A systematic review was conducted to assess the clinical and cost effectiveness of four population-based strategies for pertussis booster vaccination: single booster at 12-24 months old, single pre-school booster, single adolescent booster and multiple boosters in adulthood every 10 years. Electronic databases and Internet resources were searched to June 2006. Nine observational studies, four mathematical models and eight economic evaluations were included, evaluating four different strategies. Strong evidence to recommend any of these strategies was not found.

Assessments of Intellectually Gifted Students With(out) Characteristic(s) of ASD: An Explorative Evaluation among Diagnosticians in Various Psycho-Educational Organisations

ERIC Educational Resources Information Center

Burger-Veltmeijer, Agnes E. J.; Minnaert, Alexander E. M. G.; van den Bosch, Els J.

2015-01-01

Recently, Burger-Veltmeijer, Minnaert & Van den Bosch (2014) constructed a conceptual framework, called the Strengths and Weaknesses Heuristic ("S&W Heuristic") which might provide systematicity and coherence in research as well as psycho-educational praxis, regarding assessments of Intellectually Gifted (IG) students with…

The University of Texas at El Paso Writing Assessment, Fall 1983: A Report.

ERIC Educational Resources Information Center

Dick, John A. R.; And Others

Intended for use in curriculum planning, course development, and program evaluation, this report contains data from a study of the writing abilities of entering freshman students at the University of Texas at El Paso. The first chapter of the report provides background information concerning the need for systematic assessment of the writing…

Exploring the Potential for and Promise of Incorporating Distributive and Procedural Justices into Post-Secondary Assessment of Student Learning

ERIC Educational Resources Information Center

Grace, Christine Cooper

2017-01-01

This paper explores the potential of incorporating constructs of distributive justice and procedural justice into summative assessment of student learning in higher education. I systematically compare the process used by managers to evaluate employee performance in organizations--performance appraisal (PA)--with processes used by professors to…

A review of systematic reviews of the cost-effectiveness of hormone therapy, chemotherapy, and targeted therapy for breast cancer.

PubMed

Diaby, Vakaramoko; Tawk, Rima; Sanogo, Vassiki; Xiao, Hong; Montero, Alberto J

2015-05-01

Breast cancer is a global health concern. In fact, breast cancer is the primary cause of death among women worldwide and constitutes the most expensive malignancy to treat. As health care resources are finite, decisions regarding the adoption and coverage of breast cancer treatments are increasingly being based on "value for money," i.e., cost-effectiveness. As the evidence about the cost-effectiveness of breast cancer treatments is abundant, therefore difficult to navigate, systematic reviews of published systematic reviews offer the advantage of bringing together the results of separate systematic reviews in a single report. As a consequence, this paper presents an overview of systematic reviews of the cost-effectiveness of hormone therapy, chemotherapy, and targeted therapy for breast cancer to inform policy and reimbursement decision-making. A systematic review was conducted of published systematic reviews documenting cost-effectiveness analyses of breast cancer treatments from 2000 to 2014. Systematic reviews identified through a literature search of health and economic databases were independently assessed against inclusion and exclusion criteria. Systematic reviews of original evaluations were included only if they targeted breast cancer patients and specific breast cancer treatments (hormone therapy, chemotherapy, and targeted therapy only), documented incremental cost-effectiveness ratios, and were reported in the English language. The search strategy used a combination of these key words: "breast cancer," "systematic review/meta-analysis," and "cost-effectiveness/economics." Data were extracted using predefined extraction forms and qualitatively appraised using the assessment of multiple systematic reviews (AMSTAR) tool. The literature search resulted in 511 bibliographic records, of which ten met our inclusion criteria. Five reviews were conducted in the early-stage breast cancer setting and five reviews in the metastatic setting. In early-stage breast cancer, evidence about trastuzumab value differed by age. Trastuzumab was cost-effective only in women with HER2-positive breast cancer younger than 65 years and over a life-time horizon. The cost-effectiveness of trastuzumab in HER2-positive metastatic breast cancer yielded conflicting results. The same conclusions were reached in comparisons between vinorelbine and taxanes. In both early stage and advanced/metastatic breast cancer, newer aromatase inhibitors (AIs) have proved cost-effective compared to older treatments. This overview of systematic reviews shows that there is heterogeneity in the evidence concerning the cost-effectiveness of hormone therapy, chemotherapy, and targeted therapy for breast cancer. The cost-effectiveness of these treatments depends not only on the comparators but the context, i.e., adjuvant or metastatic setting, subtype of patient population, and perspective adopted. Decisions involving the cost-effectiveness of breast cancer treatments could be made easier and more transparent by better harmonizing the reporting of economic evaluations assessing the value of these treatments.

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students’ academic success. PMID:27031506

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

KDIGO Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors.

PubMed

Lentine, Krista L; Kasiske, Bertram L; Levey, Andrew S; Adams, Patricia L; Alberú, Josefina; Bakr, Mohamed A; Gallon, Lorenzo; Garvey, Catherine A; Guleria, Sandeep; Li, Philip Kam-Tao; Segev, Dorry L; Taler, Sandra J; Tanabe, Kazunari; Wright, Linda; Zeier, Martin G; Cheung, Michael; Garg, Amit X

2017-08-01

The 2017 Kidney Disease: Improving Global Outcomes (KDIGO) Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors is intended to assist medical professionals who evaluate living kidney donor candidates and provide care before, during and after donation. The guideline development process followed the Grades of Recommendation Assessment, Development, and Evaluation (GRADE) approach and guideline recommendations are based on systematic reviews of relevant studies that included critical appraisal of the quality of the evidence and the strength of recommendations. However, many recommendations, for which there was no evidence or no systematic search for evidence was undertaken by the Evidence Review Team, were issued as ungraded expert opinion recommendations. The guideline work group concluded that a comprehensive approach to risk assessment should replace decisions based on assessments of single risk factors in isolation. Original data analyses were undertaken to produce a "proof-in-concept" risk-prediction model for kidney failure to support a framework for quantitative risk assessment in the donor candidate evaluation and defensible shared decision making. This framework is grounded in the simultaneous consideration of each candidate's profile of demographic and health characteristics. The processes and framework for the donor candidate evaluation are presented, along with recommendations for optimal care before, during, and after donation. Limitations of the evidence are discussed, especially regarding the lack of definitive prospective studies and clinical outcome trials. Suggestions for future research, including the need for continued refinement of long-term risk prediction and novel approaches to estimating donation-attributable risks, are also provided.In citing this document, the following format should be used: Kidney Disease: Improving Global Outcomes (KDIGO) Living Kidney Donor Work Group. KDIGO Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors. Transplantation. 2017;101(Suppl 8S):S1-S109.

Protocol for a systematic review of psychological interventions for cancer-related fatigue in post-treatment cancer survivors.

PubMed

Corbett, Teresa; Devane, Declan; Walsh, Jane C; Groarke, AnnMarie; McGuire, Brian E

2015-12-04

Fatigue is a common symptom in cancer patients that can persist beyond the curative treatment phase. Some evidence has been reported for interventions for fatigue during active treatment. However, to date, there is no systematic review on psychological interventions for fatigue after the completion of curative treatment for cancer. This is a protocol for a systematic review that aims to evaluate the effectiveness of psychological interventions for cancer-related fatigue in post-treatment cancer survivors. This systematic review protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) database. We will search the Cochrane Central Register of Controlled Trials (CENTRAL; The Cochrane Library), PubMed, MEDLINE, EMBASE, CINAHL, PsycINFO, and relevant sources of grey literature. Randomised controlled trials (RCTs) which have evaluated psychological interventions in adult cancer patients after the completion of treatment, with fatigue as an outcome measure, will be included. Two review authors will independently extract data from the selected studies and assess the methodological quality using the Cochrane Collaboration Risk of Bias Tool. Most existing evidence on cancer-related fatigue is from those in active cancer treatment. This systematic review and meta-analysis will build upon previous evaluations of psychological interventions in people during and after cancer treatment. With the growing need for stage-specific research in cancer, this review seeks to highlight a gap in current practice and to strengthen the evidence base of randomised controlled trials in the area. PROSPERO CRD42014015219.

Teamwork Assessment Tools in Obstetric Emergencies: A Systematic Review.

PubMed

Onwochei, Desire N; Halpern, Stephen; Balki, Mrinalini

2017-06-01

Team-based training and simulation can improve patient safety, by improving communication, decision making, and performance of team members. Currently, there is no general consensus on whether or not a specific assessment tool is better adapted to evaluate teamwork in obstetric emergencies. The purpose of this qualitative systematic review was to find the tools available to assess team effectiveness in obstetric emergencies. We searched Embase, Medline, PubMed, Web of Science, PsycINFO, CINAHL, and Google Scholar for prospective studies that evaluated nontechnical skills in multidisciplinary teams involving obstetric emergencies. The search included studies from 1944 until January 11, 2016. Data on reliability and validity measures were collected and used for interpretation. A descriptive analysis was performed on the data. Thirteen studies were included in the final qualitative synthesis. All the studies assessed teams in the context of obstetric simulation scenarios, but only six included anesthetists in the simulations. One study evaluated their teamwork tool using just validity measures, five using just reliability measures, and one used both. The most reliable tools identified were the Clinical Teamwork Scale, the Global Assessment of Obstetric Team Performance, and the Global Rating Scale of performance. However, they were still lacking in terms of quality and validity. More work needs to be conducted to establish the validity of teamwork tools for nontechnical skills, and the development of an ideal tool is warranted. Further studies are required to assess how outcomes, such as performance and patient safety, are influenced when using these tools.

What Adherence Measures Should Be Used in Trials of Home-Based Rehabilitation Interventions? A Systematic Review of the Validity, Reliability, and Acceptability of Measures.

PubMed

Frost, Rachael; Levati, Sara; McClurg, Doreen; Brady, Marian; Williams, Brian

2017-06-01

To systematically review methods for measuring adherence used in home-based rehabilitation trials and to evaluate their validity, reliability, and acceptability. In phase 1 we searched the CENTRAL database, NHS Economic Evaluation Database, and Health Technology Assessment Database (January 2000 to April 2013) to identify adherence measures used in randomized controlled trials of allied health professional home-based rehabilitation interventions. In phase 2 we searched the databases of MEDLINE, Embase, CINAHL, Allied and Complementary Medicine Database, PsycINFO, CENTRAL, ProQuest Nursing and Allied Health, and Web of Science (inception to April 2015) for measurement property assessments for each measure. Studies assessing the validity, reliability, or acceptability of adherence measures. Two reviewers independently extracted data on participant and measure characteristics, measurement properties evaluated, evaluation methods, and outcome statistics and assessed study quality using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. In phase 1 we included 8 adherence measures (56 trials). In phase 2, from the 222 measurement property assessments identified in 109 studies, 22 high-quality measurement property assessments were narratively synthesized. Low-quality studies were used as supporting data. StepWatch Activity Monitor validly and acceptably measured short-term step count adherence. The Problematic Experiences of Therapy Scale validly and reliably assessed adherence to vestibular rehabilitation exercises. Adherence diaries had moderately high validity and acceptability across limited populations. The Borg 6 to 20 scale, Bassett and Prapavessis scale, and Yamax CW series had insufficient validity. Low-quality evidence supported use of the Joint Protection Behaviour Assessment. Polar A1 series heart monitors were considered acceptable by 1 study. Current rehabilitation adherence measures are limited. Some possess promising validity and acceptability for certain parameters of adherence, situations, and populations and should be used in these situations. Rigorous evaluation of adherence measures in a broader range of populations is needed. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

An evaluation of instruments for scoring physiological and behavioral cues of pain, non-pain related distress, and adequacy of analgesia and sedation in pediatric mechanically ventilated patients: A systematic review.

PubMed

Dorfman, Tamara L; Sumamo Schellenberg, Elizabeth; Rempel, Gwen R; Scott, Shannon D; Hartling, Lisa

2014-04-01

Advancing technology allows for successful treatment of children with life-threatening illnesses. Effectively assessing and optimally treating a child's distress during their stay in the Pediatric Intensive Care Unit (PICU) is paramount. Objective measures of distress in mechanically ventilated pediatric patients are increasingly available but few have been evaluated. The objectives of this systematic review were to identify available instruments appropriate for measuring physiological and behavioral cues of pain, non-pain related distress, and adequacy of analgesia and sedation in mechanically ventilated pediatric patients, and evaluate these instruments in terms of their psychometric properties. A systematic review of original and validation reports of objective instruments to measure pain and non-pain related distress, and adequacy of analgesia and sedation in mechanically ventilated PICU patients was undertaken. A comprehensive search was conducted in 10 databases from January 1970 to June 2011. Reference lists of relevant articles were reviewed to identify additional articles. Studies were included in the review if they met pre-established eligibility criteria. Two independent reviewers reviewed studies for inclusion, assessed quality, and extracted data. Twenty-five articles were included, identifying 15 instruments. The instruments had different foci including: assessing pain, non-pain related distress, and sedation (n=2); assessing pain exclusively (n=4); assessing sedation exclusively (n=7), assessing sedation in mechanically ventilated muscle relaxed PICU patients (n=1); and assessing delirium in mechanically ventilated PICU patients (n=1). The Comfort Scale demonstrated the greatest clinical utility in the assessment of pain, non-pain related distress, and sedation in mechanically ventilated pediatric patients. Modified FLACC and the MAPS are more appropriate, however, for the assessment of procedural pain and other brief painful events. More work is required on instruments for the assessment of distress in mechanically ventilated muscle relaxed PICU patients, and the assessment of delirium in PICU patients. This review provides essential information to guide PICU clinicians in choosing instruments to assess pain, non-pain related distress, and adequacy of analgesia and sedation in mechanically ventilated pediatric patients. Effective knowledge translation is essential in the implementation, adoption, and successful use of these instruments. Copyright © 2013 Elsevier Ltd. All rights reserved.

A systematic review of studies evaluating diffusion and dissemination of selected cancer control interventions.

PubMed

Ellis, Peter; Robinson, Paula; Ciliska, Donna; Armour, Tanya; Brouwers, Melissa; O'Brien, Mary Ann; Sussman, Jonathan; Raina, Parminder

2005-09-01

With this review, the authors sought to determine what strategies have been evaluated (including the outcomes assessed) to disseminate cancer control interventions that promote the uptake of behavior change. Five topic areas along the cancer care continuum (smoking cessation, healthy diet, mammography, cervical cancer screening, and control of cancer pain) were selected to be representative. A systematic review was conducted of primary studies evaluating dissemination of a cancer control intervention. Thirty-one studies were identified that evaluated dissemination strategies in the 5 topic areas. No strong evidence currently exists to recommend any one dissemination strategy as effective in promoting the uptake of cancer control interventions. The authors conclude that there is a strong need for more research into dissemination of cancer control interventions. Future research should consider methodological issues such as the most appropriate study design and outcomes to be evaluated. (c) 2005 APA, all rights reserved

A Model for Evaluating the Effectiveness of Middle Managers' Training Courses: Evidence from a Major Banking Organization in Greece

ERIC Educational Resources Information Center

Galanou, Ekaterini; Priporas, Constantinos-Vasilios

2009-01-01

Contemporary management thinking embraces the organizational training theory that sustainable success rests, to a great extent, upon a systematic evaluation of training interventions. However, the evidence indicates that few organizations take adequate steps to assess and analyse the quality and outcomes of their training. The authors seek to…

A process evaluation of systematic risk and needs assessment for caregivers in specialised palliative care.

PubMed

Thomsen, Kia Toft; Guldin, Mai-Britt; Nielsen, Mette Kjærgaard; Ollars, Chaitali Laura; Jensen, Anders Bonde

2017-04-08

Caregiving is strenuous and it may be associated with adverse psychological outcomes. During the palliative care trajectory, there are unique opportunities for providing support and preventing poor bereavement outcome. However, the tasks of palliative care staff in relation to caregivers are often unclear in the daily practice. Assessment is recommended to establish risk and needs and standards for caregiver support are available. Still, the feasibility of applying these standards among caregivers in everyday clinical practice has not been tested so far. This study tested the feasibility of an intervention based on key elements of the "Bereavement support standards for specialist palliative care services" in a Danish specialised palliative home care team. We followed the UK Medical Research Council's guidelines for the process evaluation of complex interventions. The intervention consisted of: 1. Systematic risk and needs assessment for caregivers at care entry; 2. Interdisciplinary conference to prepare a support plan; 3. Targeted support; 4. The establishment of an electronic medical record for caregivers to document targeted support. Outcomes included the reach, fidelity and acceptability of the intervention as well as the assessment of contextual factors. The intervention reached 76 of 164 caregivers (46%). The interdisciplinary risk assessment and documentation of a support plan was conducted in 57 (75%) of the enrolled caregivers. Finally, a separate medical record was established according to the intervention blueprint for 62% of caregivers receiving targeted support. After managing initial challenges, palliative care staff reported that the intervention was useful and acceptable. The intervention proved feasible and useful. Still, we identified barriers to the implementation which should be taken into consideration when planning implementation of a systematic risk and needs assessment and in the establishment of medical records for caregivers.

Patient-Reported Outcome questionnaires for hip arthroscopy: a systematic review of the psychometric evidence

PubMed Central

2011-01-01

Background Hip arthroscopies are often used in the treatment of intra-articular hip injuries. Patient-reported outcomes (PRO) are an important parameter in evaluating treatment. It is unclear which PRO questionnaires are specifically available for hip arthroscopy patients. The aim of this systematic review was to investigate which PRO questionnaires are valid and reliable in the evaluation of patients undergoing hip arthroscopy. Methods A search was conducted in Pubmed, Medline, CINAHL, the Cochrane Library, Pedro, EMBASE and Web of Science from 1931 to October 2010. Studies assessing the quality of PRO questionnaires in the evaluation of patients undergoing hip arthroscopy were included. The quality of the questionnaires was evaluated by the psychometric properties of the outcome measures. The quality of the articles investigating the questionnaires was assessed by the COSMIN list. Results Five articles identified three questionnaires; the Modified Harris Hip Score (MHHS), the Nonarthritic Hip Score (NAHS) and the Hip Outcome Score (HOS). The NAHS scored best on the content validity, whereas the HOS scored best on agreement, internal consistency, reliability and responsiveness. The quality of the articles describing the HOS scored highest. The NAHS is the best quality questionnaire. The articles describing the HOS are the best quality articles. Conclusions This systematic review shows that there is no conclusive evidence for the use of a single patient-reported outcome questionnaire in the evaluation of patients undergoing hip arthroscopy. Based on available psychometric evidence we recommend using a combination of the NAHS and the HOS for patients undergoing hip arthroscopy. PMID:21619610

Economic Evaluation of Interventions for Prevention of Hospital Acquired Infections: A Systematic Review

PubMed Central

Kwetkat, Anja

2016-01-01

Objective This systematic review sought to assess the costs and benefits of interventions preventing hospital-acquired infections and to evaluate methodological and reporting quality. Methods We systematically searched Medline via PubMed and the National Health Service Economic Evaluation Database from 2009 to 2014. We included quasi-experimental and randomized trails published in English or German evaluating the economic impact of interventions preventing the four most frequent hospital-acquired infections (urinary tract infections, surgical wound infections, pneumonia, and primary bloodstream infections). Characteristics and results of the included articles were extracted using a standardized data collection form. Study and reporting quality were evaluated using SIGN and CHEERS checklists. All costs were adjusted to 2013 US$. Savings-to-cost ratios and difference values with interquartile ranges (IQRs) per month were calculated, and the effects of study characteristics on the cost-benefit results were analyzed. Results Our search returned 2067 articles, of which 27 met the inclusion criteria. The median savings-to-cost ratio across all studies reporting both costs and savings values was US $7.0 (IQR 4.2–30.9), and the median net global saving was US $13,179 (IQR 5,106–65,850) per month. The studies’ reporting quality was low. Only 14 articles reported more than half of CHEERS items appropriately. Similarly, an assessment of methodological quality found that only four studies (14.8%) were considered high quality. Conclusions Prevention programs for hospital acquired infections have very positive cost-benefit ratios. Improved reporting quality in health economics publications is required. PMID:26731736

Measuring women's childbirth experiences: a systematic review for identification and analysis of validated instruments.

PubMed

Nilvér, Helena; Begley, Cecily; Berg, Marie

2017-06-29

Women's childbirth experience can have immediate as well as long-term positive or negative effects on their life, well-being and health. When evaluating and drawing conclusions from research results, women's experiences of childbirth should be one aspect to consider. Researchers and clinicians need help in finding and selecting the most suitable instrument for their purpose. The aim of this study was therefore to systematically identify and present validated instruments measuring women's childbirth experience. A systematic review was conducted in January 2016 with a comprehensive search in the bibliographic databases PubMed, CINAHL, Scopus, The Cochrane Library and PsycINFO. Included instruments measured women's childbirth experiences. Papers were assessed independently by two reviewers for inclusion, and quality assessment of included instruments was made by two reviewers independently and in pairs using Terwee et al's criteria for evaluation of psychometric properties. In total 5189 citations were screened, of which 5106 were excluded by title and abstract. Eighty-three full-text papers were reviewed, and 37 papers were excluded, resulting in 46 included papers representing 36 instruments. These instruments demonstrated a wide range in purpose and content as well as in the quality of psychometric properties. This systematic review provides an overview of existing instruments measuring women's childbirth experiences and can support researchers to identify appropriate instruments to be used, and maybe adapted, in their specific contexts and research purpose.

How Executive Functions Are Evaluated in Children and Adolescents with Cerebral Palsy? A Systematic Review

PubMed Central

Pereira, Armanda; Lopes, Sílvia; Magalhães, Paula; Sampaio, Adriana; Chaleta, Elisa; Rosário, Pedro

2018-01-01

Aims: The aim of the present study was to examine how executive functions are assessed in children and adolescents with Cerebral Palsy. Method: A systematic literature review was conducted using four bibliographic databases (WebScience, Scopus, PubMed, and Psycinfo), and only studies that evaluated at least one executive function were selected. Both the research and reporting of results were based on Cochrane's recommendations and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines. Results: The instrument most frequently used was the D-KEFS. All studies point to the existence of impairments in the executive functions among children and adolescents with Cerebral Palsy with an impact on several cognitive and life domains. Interpretation: There is a need to further systematize the research protocols to study the executive functions and their assessment in the intervention context. Findings of this review presented a diversity of tests (e.g., D-KEFS) or tasks (e.g., The inhibitory ability task) used with children with Cerebral Palsy. However, no information was given about adaptations performed to the test/task to meet Cerebral Palsy's specificities. Future research could consider including this information, which is key both to researchers and practitioners. The results of this study have important implications and suggestions for future avenues and guidelines for research and practice. PMID:29467685

Building work engagement: A systematic review and meta-analysis investigating the effectiveness of work engagement interventions.

PubMed

Knight, Caroline; Patterson, Malcolm; Dawson, Jeremy

2017-07-01

Low work engagement may contribute towards decreased well-being and work performance. Evaluating, boosting and sustaining work engagement are therefore of interest to many organisations. However, the evidence on which to base interventions has not yet been synthesised. A systematic review with meta-analysis was conducted to assess the evidence for the effectiveness of work engagement interventions. A systematic literature search identified controlled workplace interventions employing a validated measure of work engagement. Most used the Utrecht Work Engagement Scale (UWES). Studies containing the relevant quantitative data underwent random-effects meta-analyses. Results were assessed for homogeneity, systematic sampling error, publication bias and quality. Twenty studies met the inclusion criteria and were categorised into four types of interventions: (i) personal resource building; (ii) job resource building; (iii) leadership training; and (iv) health promotion. The overall effect on work engagement was small, but positive, k  = 14, Hedges g  = 0.29, 95%-CI = 0.12-0.46. Moderator analyses revealed a significant result for intervention style, with a medium to large effect for group interventions. Heterogeneity between the studies was high, and the success of implementation varied. More studies are needed, and researchers are encouraged to collaborate closely with organisations to design interventions appropriate to individual contexts and settings, and include evaluations of intervention implementation. © 2016 The Authors. Journal of Organizational Behavior published by John Wiley & Sons, Ltd.

Costing evidence for health care decision-making in Austria: A systematic review.

PubMed

Mayer, Susanne; Kiss, Noemi; Łaszewska, Agata; Simon, Judit

2017-01-01

With rising healthcare costs comes an increasing demand for evidence-informed resource allocation using economic evaluations worldwide. Furthermore, standardization of costing and reporting methods both at international and national levels are imperative to make economic evaluations a valid tool for decision-making. The aim of this review is to assess the availability and consistency of costing evidence that could be used for decision-making in Austria. It describes systematically the current economic evaluation and costing studies landscape focusing on the applied costing methods and their reporting standards. Findings are discussed in terms of their likely impacts on evidence-based decision-making and potential suggestions for areas of development. A systematic literature review of English and German language peer-reviewed as well as grey literature (2004-2015) was conducted to identify Austrian economic analyses. The databases MEDLINE, EMBASE, SSCI, EconLit, NHS EED and Scopus were searched. Publication and study characteristics, costing methods, reporting standards and valuation sources were systematically synthesised and assessed. A total of 93 studies were included. 87% were journal articles, 13% were reports. 41% of all studies were full economic evaluations, mostly cost-effectiveness analyses. Based on relevant standards the most commonly observed limitations were that 60% of the studies did not clearly state an analytical perspective, 25% of the studies did not provide the year of costing, 27% did not comprehensively list all valuation sources, and 38% did not report all applied unit costs. There are substantial inconsistencies in the costing methods and reporting standards in economic analyses in Austria, which may contribute to a low acceptance and lack of interest in economic evaluation-informed decision making. To improve comparability and quality of future studies, national costing guidelines should be updated with more specific methodological guidance and a national reference cost library should be set up to allow harmonisation of valuation methods.

Systematic Review of Health Economic Evaluation Studies Developed in Brazil from 1980 to 2013.

PubMed

Decimoni, Tassia Cristina; Leandro, Roseli; Rozman, Luciana Martins; Craig, Dawn; Iglesias, Cynthia P; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2018-01-01

Brazil has sought to use economic evaluation to support healthcare decision-making processes. While a number of health economic evaluations (HEEs) have been conducted, no study has systematically reviewed the quality of Brazilian HEE. The objective of this systematic review was to provide an overview regarding the state of HEE research and to evaluate the number, characteristics, and quality of reporting of published HEE studies conducted in a Brazilian setting. We systematically searched electronic databases (MEDLINE, EMBASE, Latin American, and Caribbean Literature on Health Sciences Database, Scientific Electronic Library Online, NHS Economic Evaluation Database, health technology assessment Database, Bireme, and Biblioteca Virtual em Saúde Economia da Saúde ); citation indexes (SCOPUS, Web of Science), and Sistema de Informação da Rede Brasileira de Avaliação de Tecnologia em Saúde . Partial and full HEEs published between 1980 and 2013 that referred to a Brazilian setting were considered for inclusion. In total, 535 studies were included in the review, 36.8% of these were considered to be full HEE. The category of healthcare technologies more frequently assessed were procedures (34.8%) and drugs (28.8%) which main objective was treatment (72.1%). Forty-four percent of the studies reported their funding source and 36% reported a conflict of interest. Overall, the full HEE quality of reporting was satisfactory. But some items were generally poorly reported and significant improvement is required: (1) methods used to estimate healthcare resource use quantities and unit costs, (2) methods used to estimate utility values, (3) sources of funding, and (4) conflicts of interest. A steady number of HEE have been published in Brazil since 1980. To improve their contribution to inform national healthcare policy efforts need to be made to enhance the quality of reporting of HEEs and promote improvements in the way HEEs are designed, implemented (i.e., using sound methods for HEEs) and reported.

Costing evidence for health care decision-making in Austria: A systematic review

PubMed Central

Mayer, Susanne; Kiss, Noemi; Łaszewska, Agata

2017-01-01

Background With rising healthcare costs comes an increasing demand for evidence-informed resource allocation using economic evaluations worldwide. Furthermore, standardization of costing and reporting methods both at international and national levels are imperative to make economic evaluations a valid tool for decision-making. The aim of this review is to assess the availability and consistency of costing evidence that could be used for decision-making in Austria. It describes systematically the current economic evaluation and costing studies landscape focusing on the applied costing methods and their reporting standards. Findings are discussed in terms of their likely impacts on evidence-based decision-making and potential suggestions for areas of development. Methods A systematic literature review of English and German language peer-reviewed as well as grey literature (2004–2015) was conducted to identify Austrian economic analyses. The databases MEDLINE, EMBASE, SSCI, EconLit, NHS EED and Scopus were searched. Publication and study characteristics, costing methods, reporting standards and valuation sources were systematically synthesised and assessed. Results A total of 93 studies were included. 87% were journal articles, 13% were reports. 41% of all studies were full economic evaluations, mostly cost-effectiveness analyses. Based on relevant standards the most commonly observed limitations were that 60% of the studies did not clearly state an analytical perspective, 25% of the studies did not provide the year of costing, 27% did not comprehensively list all valuation sources, and 38% did not report all applied unit costs. Conclusion There are substantial inconsistencies in the costing methods and reporting standards in economic analyses in Austria, which may contribute to a low acceptance and lack of interest in economic evaluation-informed decision making. To improve comparability and quality of future studies, national costing guidelines should be updated with more specific methodological guidance and a national reference cost library should be set up to allow harmonisation of valuation methods. PMID:28806728

Systematic documentation of new vaccine introduction in selected countries of the Latin American Region.

PubMed

de Oliveira, Lúcia H; Toscano, Cristiana M; Sanwogou, N Jennifer; Ruiz-Matus, Cuauhtémoc; Tambini, Gina; Roses-Periago, Mirta; Andrus, Jon K

2013-07-02

Countries in Latin America were among the first developing countries to introduce new vaccines, particularly rotavirus (RV) and pneumococcal conjugate vaccines (PCVs), into their national immunization schedules. Experiences and lessons learned from these countries are valuable to donors, immunization partners, and policy makers in other countries wishing to make informed decisions on vaccine introduction. In order to enhance knowledge and promote understanding of the process of new vaccine introduction in the Latin American Region, with particular focus on RV and PCV, we conducted a systematic qualitative assessment. We evaluated the decision-making process, documented the structure in place, and reviewed key factors pertaining to new vaccine introduction. These include country morbidity and mortality data available prior to vaccine introduction, funding sources and mechanisms for vaccine introduction, challenges of implementation, and assessment of vaccine impact. From March 2010 to April 2011, we evaluated a subset of countries that had introduced RV and/or PCV in the past five years through interviews with key informants at the country level and through a systematic review of published data, gray literature, official technical documents, and country-specific health indicators. Countries evaluated were Bolivia, Brazil, Nicaragua, Peru, and Venezuela. In all countries, the potential of new vaccines to reduce mortality, as established by Millennium Development Goal 4, was an important consideration leading to vaccine introduction. Several factors-the availability of funds, the existence of sufficient evidence for vaccine introduction, and the feasibility of sustainable financing-were identified as crucial components of the decision-making process in the countries evaluated. The decision making process regarding new vaccine introduction in the countries evaluated does not follow a systematic approach. Nonetheless, existing evidence on efficacy, potential impact, and cost-effectiveness of vaccine introduction, even if not local data, was important in the decision making process for vaccine introduction. Copyright © 2013 Elsevier Ltd. All rights reserved.

OPPE, FPPE, QPS, and why the alphabet soup of physician assessment is essential for safer patient care.

PubMed

Loftus, Michael L

Creating a successful quality and patient safety program requires a multifaceted approach that systematically reviews overall systems and processes, but also creates a standardized framework for evaluating individual practitioner performance on a routine basis. There are two required elements of competency assessment that are typically tied to the hospital credentialing process: ongoing professional practice evaluation (OPPE) and focused professional practice evaluation (FPPE). Each of these processes are mandated by the Joint Commission, and form an important cornerstone for ensuring adequate physician performance and knowledge base. Copyright © 2017. Published by Elsevier Inc.

Assessment Tools for Peripheral Neuropathy in Pediatric Oncology: A Systematic Review From the Children's Oncology Group.

PubMed

Smolik, Suzanne; Arland, Lesley; Hensley, Mary Ann; Schissel, Debra; Shepperd, Barbara; Thomas, Kristin; Rodgers, Cheryl

Peripheral neuropathy is a known side effect of several chemotherapy agents, including vinca alkaloids and platinum-based chemotherapy. Early recognition and monitoring of this side effect is an important role of the pediatric oncology nurse. There are a variety of peripheral neuropathy assessment tools currently in use, but the usefulness of these tools in identifying and grading neuropathy in children varies, and there is currently no standardized tool in place to evaluate peripheral neuropathy in pediatric oncology. A systematic review was performed to identify the peripheral neuropathy assessment tools that best evaluate the early onset and progression of peripheral neuropathy in pediatric patients receiving vincristine. Because of the limited information available in pediatric oncology, this review was extended to any pediatric patient with neuropathy. A total of 8 studies were included in the evidence synthesis. Based on available evidence, the pediatric-modified Total Neuropathy Scale (ped-m TNS) and the Total Neuropathy Score-pediatric version (TNS-PV) are recommended for the assessment of vincristine-induced peripheral neuropathy in children 6 years of age and older. In addition, several studies demonstrated that subjective symptoms alone are not adequate to assess for vincristine-induced peripheral neuropathy. Nursing assessment of peripheral neuropathy should be an integral and regular part of patient care throughout the course of chemotherapy treatment.

Is the evaluation of risk of bias in periodontology and implant dentistry comprehensive? A systematic review.

PubMed

Faggion, Clovis Mariano; Listl, Stefan; Alarcón, Marco Antonio

2015-05-01

The objective of this study was to assess how authors of systematic reviews (SRs) with meta-analyses published in periodontology and implant dentistry evaluate risk of bias (ROB) in primary studies included in these reviews. A literature search for SRs with meta-analyses was performed in PubMed and Cochrane library databases up to July 20th 2014. The reference lists of included articles were screened for further reviews. The standards of evaluating ROB in primary studies were evaluated by using a 14-item checklist based on the Cochrane approach for evaluating ROB. Standards in ROB evaluations in Cochrane and paper-based SRs were compared using the Fisher's exact test. All searches, data extraction and evaluations were performed independently and in duplicate. Seventy SRs were included (45 paper-based and 25 Cochrane SRs, respectively). The median percentage of items addressed was 58% (interquartile range 4-100%). Cochrane SRs more frequently included ROB assessments than paper-based reviews in terms of examiner blinding (p = 0.0026), selective outcome reporting (p = 0.0207) and other bias (p = 0.0241). The ROB evaluation in primary studies currently included in SRs with meta-analyses in periodontology and implant dentistry is not sufficiently comprehensive. Cochrane SRs have more comprehensive ROB evaluation than paper-based reviews. © 2015 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Clinical and cost-effectiveness of non-medical prescribing: A systematic review of randomised controlled trials

PubMed Central

Marriott, John; Graham-Clarke, Emma; Shirley, Debra; Rushton, Alison

2018-01-01

Objective To evaluate the clinical and cost-effectiveness of non-medical prescribing (NMP). Design Systematic review. Two reviewers independently completed searches, eligibility assessment and assessment of risk of bias. Data sources Pre-defined search terms/combinations were utilised to search electronic databases. In addition, hand searches of reference lists, key journals and grey literature were employed alongside consultation with authors/experts. Eligibility criteria for included studies Randomised controlled trials (RCTs) evaluating clinical or cost-effectiveness of NMP. Measurements reported on one or more outcome(s) of: pain, function, disability, health, social impact, patient-safety, costs-analysis, quality adjusted life years (QALYs), patient satisfaction, clinician perception of clinical and functional outcomes. Results Three RCTs from two countries were included (n = 932 participants) across primary and tertiary care settings. One RCT was assessed as low risk of bias, one as high risk of bias and one as unclear risk of bias. All RCTs evaluated clinical effectiveness with one also evaluating cost-effectiveness. Clinical effectiveness was evaluated using a range of safety and patient-reported outcome measures. Participants demonstrated significant improvement in outcomes when receiving NMP compared to treatment as usual (TAU) in all RCTs. An associated cost analysis showed NMP to be more expensive than TAU (regression coefficient p = 0.0000), however experimental groups generated increased QALYs compared to TAU. Conclusion Limited evidence with overall unclear risk of bias exists evaluating clinical and cost-effectiveness of NMP across all professions and clinical settings. GRADE assessment revealed moderate quality evidence. Evidence suggests that NMP is safe and can provide beneficial clinical outcomes. Benefits to the health economy remain unclear, with the cost-effectiveness of NMP assessed by a single pilot RCT of low risk of bias. Adequately powered low risk of bias RCTs evaluating clinical and cost effectiveness are required to evaluate NMP across clinical specialities, professions and settings. Registration PROSPERO (CRD42015017212). PMID:29509763

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review.

PubMed

Cordier, Reinie; Speyer, Renée; Chen, Yu-Wei; Wilkes-Gillan, Sarah; Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments.

Multidimensional measures validated for home health needs of older persons: A systematic review.

PubMed

de Rossi Figueiredo, Daniela; Paes, Lucilene Gama; Warmling, Alessandra Martins; Erdmann, Alacoque Lorenzini; de Mello, Ana Lúcia Schaefer Ferreira

2018-01-01

To conduct a systematic review of the literature on valid and reliable multidimensional instruments to assess home health needs of older persons. Systematic review. Electronic databases, PubMed/Medline, Web of Science, Scopus, Cumulative Index to Nursing and Allied Health Literature, Scientific Electronic Library Online and the Latin American and Caribbean Health Sciences Information. All English, Portuguese and Spanish literature which included studies of reliability and validity of instruments that assessed at least two dimensions: physical, psychological, social support and functional independence, self-rated health behaviors and contextual environment and if such instruments proposed interventions after evaluation and/or monitoring changes over a period of time. Older persons aged 60 years or older. Of the 2397 studies identified, 32 were considered eligible. Two-thirds of the instruments proposed the physical, psychological, social support and functional independence dimensions. Inter-observer and intra-observer reliability and internal consistency values were 0.7 or above. More than two-thirds of the studies included validity (n=26) and more than one validity was tested in 15% (n=4) of these. Only 7% (n=2) proposed interventions after evaluation and/or monitoring changes over a period of time. Although the multidimensional assessment was performed, and the reliability values of the reviewed studies were satisfactory, different validity tests were not present in several studies. A gap at the instrument conception was observed related to interventions after evaluation and/or monitoring changes over a period of time. Further studies with this purpose are necessary for home health needs of the older persons. Copyright © 2017 Elsevier Ltd. All rights reserved.

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review

PubMed Central

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

OBJECTIVE: Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. METHODS: This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; “simulation,” “practice,” “drill,” “exercise,” “instrument,” “tool,” “questionnaire,” “ measurement,” “checklist,” “scale,” “test,” “inventory,” “battery,” “evaluation,” “assessment,” “appraisal,” “emergency,” “disaster,” “cricise,” “hazard,” “catastrophe,: “hospital”, “prehospital,” “health centers,” “treatment centers,” were used in combination with Boolean operators OR and AND. RESULTS: The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. CONCLUSION: Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages. PMID:29417075

The Quality of Systematic Reviews in Head and Neck Microsurgery: A Perspective from Plastic Surgery and Otolaryngology.

PubMed

Sun, Beatrice J; Tijerina, Jonathan; Nazerali, Rahim S; Lee, Gordon K

2018-05-01

In recent years, there has been a push to publish higher level of evidence studies in medicine, particularly in plastic surgery. Well-conducted systematic reviews are considered the strongest level of evidence in medicine, recently becoming the key process indicators for quality delivery. A varying quality of systematic reviews, however, has led to concerns of their validity in clinical decision-making. We perform a quality analysis of systematic reviews published in head and neck microsurgery by the surgical specialties of plastic surgery and otolaryngology. An evaluation of systematic reviews published on microsurgery in 13 high-impact surgical journals was conducted by searching PubMed and Scopus. Two authors independently performed searches, screened for eligibility, and extracted data from included articles. Discrepancies were resolved by discussion and consensus. Assessment of Multiple Systematic Reviews (AMSTAR) criteria were used to assess methodological quality. The initial database search retrieved 166 articles. After removing duplicates, screening titles and abstracts, 26 articles remained for full text review. Seven did not focus on head and neck microsurgery and were further excluded, leaving 19 systematic reviews for final analysis. Of those, 10 systematic reviews were published by otolaryngology, and 9 were published by plastic surgery. Median AMSTAR score was 8 for otolaryngology, 7 for plastic surgery, and 8 overall, reflecting "fair to good" quality. The number of systematic reviews on head and neck microsurgery markedly increased over time. Of note, both the AMSTAR score and the number of systematic reviews published by plastic surgery have steadily increased from 2014 to 2016, whereas those published by otolaryngology have remained relatively stable since 2010. Our review shows a trend toward publishing more systematic reviews. The increasing quantity and quality of systematic reviews published by plastic surgeons indicates recognition in the need for higher levels of evidence in plastic surgery, as well as growing interest and advances in microsurgery. Given these trends, familiarity with quality assessment guidelines, such as AMSTAR, will remain important in providing a basis for building relevant value-based quality measures.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina.

PubMed

Zhang, Xiaoxia; Wang, Hui; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina

PubMed Central

Zhang, Xiaoxia; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved. PMID:26539221

[Measurement of shoulder disability in the athlete: a systematic review].

PubMed

Fayad, F; Mace, Y; Lefevre-Colau, M M; Poiraudeau, S; Rannou, F; Revel, M

2004-08-01

To identify all available shoulder disability questionnaires and to examine those that could be used for athlete. We systematically reviewed the literature in Medline using the keywords shoulder, function, scale, index, score, questionnaire, disability, quality of life, assessment, and evaluation. We searched for scales used for athletes with the keywords scale name AND (sport OR athlete). Data were completed by using the "Guide des Outils de Mesure et d'Evaluation en Médecine Physique et de Réadaptation" textbook. Analysis took into account the clinimetric quality of the instruments and the number of items specifically related to sports. A total of 37 instruments have been developed to measure disease-, shoulder-specific or upper extremity specific outcome. Older instruments were developed before the advent of modern measurement methods. They usually combined objective and subjective measures. Recent instruments were designed with use of more advanced methods. Most are self-administered questionnaires. Fourteen scales included items assessing sport activity. Four of these scales have been used to assess shoulder disability in athlete. Six scales have been used to assess such disability but do not have specific items related to sports. There is no gold standard for assessing shoulder outcome in the general population and no validated outcome instruments specifically for athletes. We suggest the use of ASES, WOSI and WORC scales for evaluating shoulder function in the recreational athletes. The DASH scale should be evaluated in this population. The principal criterion in evaluating shoulder function in the high level athlete is a return to the same level of sport performance. Further studies are required to identify measurement tools for shoulder disability that have a high predictive value for return to sport.

A systematic review finds limited data on measurement properties of instruments measuring outcomes in adult intensive care unit survivors.

PubMed

Robinson, Karen A; Davis, Wesley E; Dinglas, Victor D; Mendez-Tellez, Pedro A; Rabiee, Anahita; Sukrithan, Vineeth; Yalamanchilli, Ramakrishna; Turnbull, Alison E; Needham, Dale M

2017-02-01

There is a growing number of studies evaluating the physical, cognitive, mental health, and health-related quality of life (HRQOL) outcomes of adults surviving critical illness. However, there is little consensus on the most appropriate instruments to measure these outcomes. To inform the development of such consensus, we conducted a systematic review of the performance characteristics of instruments measuring physical, cognitive, mental health, and HRQOL outcomes in adult intensive care unit (ICU) survivors. We searched PubMed, Embase, PsycInfo, Cumulative Index of Nursing and Allied Health Literature, and The Cochrane Library in March 2015. We also conducted manual searches of reference lists of eligible studies and relevant review articles. Two people independently selected studies, completed data abstraction, and assessed the quality of eligible studies using the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) initiative checklist. We identified 20 studies which explicitly evaluated measurement properties for 21 different instruments assessing outcomes in ICU survivors. Eleven of the instruments assessed quality of life, with few instruments assessing other domains. Of the nine measurement properties evaluated on the COSMIN checklist, six were assessed in <10% of the evaluations. Overall quality of eligible studies was generally poor to fair based on the COSMIN checklist. Although an increasing number of studies measure physical, cognitive, mental health, and HRQOL outcomes in adult ICU survivors, data on the measurement properties of such instruments are sparse and generally of poor to fair quality. Empirical analyses evaluating the performance of instruments in adult ICU survivors are needed to advance research in this field. Copyright © 2016 Elsevier Inc. All rights reserved.

Complementary and Alternative Medicine for Posttraumatic Stress Disorder Symptoms: A Systematic Review.

PubMed

Wahbeh, Helané; Senders, Angela; Neuendorf, Rachel; Cayton, Julien

2014-07-01

To (1) characterize complementary and alternative medicine studies for posttraumatic stress disorder symptoms, (2) evaluate the quality of these studies, and (3) systematically grade the scientific evidence for individual CAM modalities for posttraumatic stress disorder. Systematic review. Eight data sources were searched. Selection criteria included any study design assessing posttraumatic stress disorder outcomes and any complementary and alternative medicine intervention. The body of evidence for each modality was assessed with the Natural Standard evidence-based, validated grading rationale. Thirty-three studies (n = 1329) were reviewed. Scientific evidence of benefit for posttraumatic stress disorder was strong for repetitive transcranial magnetic stimulation and good for acupuncture, hypnotherapy, meditation, and visualization. Evidence was unclear or conflicting for biofeedback, relaxation, Emotional Freedom and Thought Field therapies, yoga, and natural products. Considerations for clinical applications and future research recommendations are discussed. © The Author(s) 2014.

Systematic evaluation of clinical practice guidelines for pharmacogenomics.

PubMed

Beckett, Robert D; Kisor, David F; Smith, Thomas; Vonada, Brooke

2018-06-01

To systematically assess methodological quality of pharmacogenomics clinical practice guidelines. Guidelines published through 2017 were reviewed by at least three independent reviewers using the AGREE II instrument, which consists of 23 items grouped into 6 domains and 2 items representing an overall assessment. Items were assessed on a seven-point rating scale, and aggregate quality scores were calculated. 31 articles were included. All guidelines were published as peer-reviewed articles and 90% (n = 28) were endorsed by professional organizations. Mean AGREE II domain scores (maximum score 100%) ranged from 46.6 ± 11.5% ('applicability') to 78.9 ± 11.4% ('clarity of presentation'). Median overall quality score was 72.2% (IQR: 61.1-77.8%). Quality of pharmacogenomics guidelines was generally high, but variable, for most AGREE II domains.

Review of systematic reviews on acute procedural pain in children in the hospital setting

PubMed Central

Stinson, Jennifer; Yamada, Janet; Dickson, Alison; Lamba, Jasmine; Stevens, Bonnie

2008-01-01

BACKGROUND: Acute pain is a common experience for hospitalized children. Despite mounting research on treatments for acute procedure-related pain, it remains inadequately treated. OBJECTIVE: To critically appraise all systematic reviews on the effectiveness of acute procedure-related pain management in hospitalized children. METHODS: Published systematic reviews and meta-analyses on pharmacological and nonpharmacological management of acute procedure-related pain in hospitalized children aged one to 18 years were evaluated. Electronic searches were conducted in the Cochrane Database of Systematic Reviews, Medline, EMBASE, the Cumulative Index to Nursing and Allied Health Literature and PsycINFO. Two reviewers independently selected articles for review and assessed their quality using a validated seven-point quality assessment measure. Any disagreements were resolved by a third reviewer. RESULTS: Of 1469 published articles on interventions for acute pain in hospitalized children, eight systematic reviews met the inclusion criteria and were included in the analysis. However, only five of these reviews were of high quality. Critical appraisal of pharmacological pain interventions indicated that amethocaine was superior to EMLA (AstraZeneca Canada Inc) for reducing needle pain. Distraction and hypnosis were nonpharmacological interventions effective for management of acute procedure-related pain in hospitalized children. CONCLUSIONS: There is growing evidence of rigorous evaluations of both pharmacological and nonpharmacological strategies for acute procedure-related pain in children; however, the evidence underlying some commonly used strategies is limited. The present review will enable the creation of a future research plan to facilitate clinical decision making and to develop clinical policy for managing acute procedure-related pain in children. PMID:18301816

The effect of mobile application interventions on influencing healthy maternal behaviour and improving perinatal health outcomes: a systematic review protocol.

PubMed

Daly, Lisa M; Horey, Dell; Middleton, Philippa F; Boyle, Frances M; Flenady, Vicki

2017-02-08

Perinatal morbidity and mortality remain significant public health issues globally, with enduring impact on the health and well-being of women and their families. Pregnant women who adopt, practice and maintain healthy behaviours can potentially improve the health of themselves and their babies. Mobile applications are an increasingly popular mode of accessing, storing and sharing health information among pregnant women. The main objective of this review is to evaluate the effects of mobile application interventions during pregnancy on maternal behaviour and associated maternal and infant outcomes. This review will include randomised and non-randomised studies which tested use of mobile applications designed to improve either maternal knowledge or behaviours to address known risk factors associated with adverse perinatal health outcomes. This review will include studies which included pregnant women and/or women during birth. The search strategy will utilise a combination of keywords and MeSH terms. Literature databases such as PubMed, Embase, The Cochrane Library, CINAHL and WHO Global Health Library will be searched. Two reviewers will independently screen retrieved citations to determine if they meet inclusion criteria. Studies will be selected that provide information about interventions commenced in early pregnancy, late pregnancy or labour. Comparisons to be made include mobile applications versus interventions relying on paper-based or text-messaging-based communication; interpersonal communication such as face-to-face or telephone conversation; and no intervention or standard care. Quality assessment of included randomised studies will utilise established guidelines provided in the Cochrane Handbook for Systematic Reviews of Interventions. Quality assessment of non-randomised studies will be based on the Risk of Bias in Non-randomised Studies-of Interventions (ROBINS-I) assessment tool. Quality of the evidence will be evaluated using the Grades of Recommendation, Assessment, Development and Evaluation (GRADE) approach. Separate comparisons and analyses for primary and secondary outcomes will be performed. Results of the review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. This systematic review will identify and synthesize evidence about the effect of interventions delivered through mobile applications on influencing maternal behaviour and improving perinatal health outcomes. PROSPERO CRD42016037344 .

Community gardening, community farming and other local community-based gardening interventions to prevent overweight and obesity in high-income and middle-income countries: protocol for a systematic review

PubMed Central

Romppel, Matthias; Molnar, Sandra; Buchberger, Barbara; van den Berg, Agnes; Gartlehner, Gerald; Lhachimi, Stefan K

2017-01-01

Introduction The worldwide prevalence of overweight/obesity has continued to rise over the last decades. To reverse this trend, public health authorities are exploring cost-effective interventions, especially in high-income and middle-income countries. Community gardening offers a unique opportunity for individuals to enhance physical activity levels and improve their diet. However, synthesised evidence on the short-term or long-term effectiveness and on the costs of community gardening interventions to prevent overweight/obesity remains limited. Therefore, this review will investigate: (1) the effectiveness of voluntary participation in community gardening compared with no or a control intervention on overweight/obesity and associated health outcomes, (2) effects on different subgroups of populations and (3) the costs of community gardening interventions. Methods and analysis We will conduct a systematic review, limited to evaluations of community gardening interventions with controlled quantitative and interrupted time series designs. To identify relevant articles, we will systematically search 12 academic and 5 grey literature databases, as well as 2 trial registers and 6 websites. Articles will then be assessed for eligibility based on a predefined set of criteria. At least two independent reviewers will assess each article for relevance, before evaluating the methodological quality and potential bias of the studies. Data relevant to the objectives of this review will be extracted and cross-validated. Any disagreements will be mediated by a third reviewer. If feasible, meta-analyses of primary outcomes (overweight/obesity, physical activity, food intake, energy intake) will be conducted. We will use the Grading of Recommendations Assessment, Development and Evaluation method to assess the overall quality of evidence. Ethics and dissemination For this review, no ethical approval is required as we will only extract and analyse secondary data. We aim to submit the final review manuscript to an open access journal for publication and disseminate results via conferences and social media. Trial registration number International Prospective Register of Systematic Reviews (PROSPERO)(CRD42017043696). PMID:28619783

Community gardening, community farming and other local community-based gardening interventions to prevent overweight and obesity in high-income and middle-income countries: protocol for a systematic review.

PubMed

Heise, Thomas L; Romppel, Matthias; Molnar, Sandra; Buchberger, Barbara; Berg, Agnes van den; Gartlehner, Gerald; Lhachimi, Stefan K

2017-06-15

The worldwide prevalence of overweight/obesity has continued to rise over the last decades. To reverse this trend, public health authorities are exploring cost-effective interventions, especially in high-income and middle-income countries. Community gardening offers a unique opportunity for individuals to enhance physical activity levels and improve their diet. However, synthesised evidence on the short-term or long-term effectiveness and on the costs of community gardening interventions to prevent overweight/obesity remains limited. Therefore, this review will investigate: (1) the effectiveness of voluntary participation in community gardening compared with no or a control intervention on overweight/obesity and associated health outcomes, (2) effects on different subgroups of populations and (3) the costs of community gardening interventions. We will conduct a systematic review, limited to evaluations of community gardening interventions with controlled quantitative and interrupted time series designs. To identify relevant articles, we will systematically search 12 academic and 5 grey literature databases, as well as 2 trial registers and 6 websites. Articles will then be assessed for eligibility based on a predefined set of criteria. At least two independent reviewers will assess each article for relevance, before evaluating the methodological quality and potential bias of the studies. Data relevant to the objectives of this review will be extracted and cross-validated. Any disagreements will be mediated by a third reviewer. If feasible, meta-analyses of primary outcomes (overweight/obesity, physical activity, food intake, energy intake) will be conducted. We will use the Grading of Recommendations Assessment, Development and Evaluation method to assess the overall quality of evidence. For this review, no ethical approval is required as we will only extract and analyse secondary data. We aim to submit the final review manuscript to an open access journal for publication and disseminate results via conferences and social media. International Prospective Register of Systematic Reviews (PROSPERO)(CRD42017043696). © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

A systematic nurse-led approach to withdrawal risk screening, prevention and treatment among inpatients with an alcohol use disorder in an ear, nose, throat and jaw surgery department-A formative evaluation.

PubMed

Leuenberger, Deborah Linda; Fierz, Katharina; Hinck, Andreas; Bodmer, Daniel; Hasemann, Wolfgang

2017-02-01

Among patients with head and neck cancer comorbid alcohol use disorder is frequent which contributes to higher risk of developing perioperative alcohol withdrawal syndrome/delirium or delirium due to medical conditions. Although guidelines emphasize prevention and treatment of alcohol withdrawal in hospitalized patients, a validated systematic approach for management of these patients is still lacking. Our aim was to formatively evaluate our newly developed systematic approach in view of nurses' adherence to screening patients for regular alcohol consumption and managing their withdrawal symptoms using the Clinical Institute Withdrawal Assessment of Alcohol Scale, Revised. We conducted a formative evaluation to improve the project's design and performance and used a retrospective chart review in a consecutive sample of all adult inpatients with head and neck cancer being assigned for surgery in a university hospital. Our bundle of interventions consisted of nurses' screenings for regular alcohol consumption, withdrawal risk assessment, offering patients a substitution therapy, nurses' assessments of withdrawal symptoms and symptom oriented withdrawal management. Proximate endpoints were analyzed descriptively at each component of the bundle in terms of frequencies and severity of withdrawal symptoms, frequencies of nurses' and doctors' screenings and nurses' assessments performed as required. Between 2013 and 2014, 87 inpatients met inclusion criteria and screenings by doctors/ nurses revealed 49 alcohol consumers, where six screenings were omitted by nurses and six by doctors. Twenty-one consumers were at risk and six of them developed an alcohol withdrawal syndrome. None of the 87 showed an alcohol withdrawal delirium, but five developed a delirium due to medical conditions. Nurses correctly conducted all preventive elements of the intervention bundle in 14 (58%) patients at risk but overall, only performed 50% of the required assessments. Although nurses safely managed patients' symptoms, nurses' adherence to the interventions was suboptimal and requires stronger leadership. Copyright © 2016 Elsevier Inc. All rights reserved.

Steps toward improving ethical evaluation in health technology assessment: a proposed framework.

PubMed

Assasi, Nazila; Tarride, Jean-Eric; O'Reilly, Daria; Schwartz, Lisa

2016-06-06

While evaluation of ethical aspects in health technology assessment (HTA) has gained much attention during the past years, the integration of ethics in HTA practice still presents many challenges. In response to the increasing demand for expansion of health technology assessment (HTA) methodology to include ethical issues more systematically, this article reports on a multi-stage study that aimed at construction of a framework for improving the integration of ethics in HTA. The framework was developed through the following phases: 1) a systematic review and content analysis of guidance documents for ethics in HTA; 2) identification of factors influencing the integration of ethical considerations in HTA; 3) preparation of an action-oriented framework based on the key elements of the existing guidance documents and identified barriers to and facilitators of their implementation; and 4) expert consultation and revision of the framework. The proposed framework consists of three main components: an algorithmic flowchart, which exhibits the different steps of an ethical inquiry throughout the HTA process, including: defining the objectives and scope of the evaluation, stakeholder analysis, assessing organizational capacity, framing ethical evaluation questions, ethical analysis, deliberation, and knowledge translation; a stepwise guide, which focuses on the task objectives and potential questions that are required to be addressed at each step; and a list of some commonly recommended or used tools to help facilitate the evaluation process. The proposed framework can be used to support and promote good practice in integration of ethics into HTA. However, further validation of the framework through case studies and expert consultation is required to establish its utility for HTA practice.

Evaluation of multi-level social learning for sustainable landscapes: perspective of a development initiative in Bergslagen, Sweden.

PubMed

Axelsson, Robert; Angelstam, Per; Myhrman, Lennart; Sädbom, Stefan; Ivarsson, Milis; Elbakidze, Marine; Andersson, Kenneth; Cupa, Petr; Diry, Christian; Doyon, Frederic; Drotz, Marcus K; Hjorth, Arne; Hermansson, Jan Olof; Kullberg, Thomas; Lickers, F Henry; McTaggart, Johanna; Olsson, Anders; Pautov, Yurij; Svensson, Lennart; Törnblom, Johan

2013-03-01

To implement policies about sustainable landscapes and rural development necessitates social learning about states and trends of sustainability indicators, norms that define sustainability, and adaptive multi-level governance. We evaluate the extent to which social learning at multiple governance levels for sustainable landscapes occur in 18 local development initiatives in the network of Sustainable Bergslagen in Sweden. We mapped activities over time, and interviewed key actors in the network about social learning. While activities resulted in exchange of experiences and some local solutions, a major challenge was to secure systematic social learning and make new knowledge explicit at multiple levels. None of the development initiatives used a systematic approach to secure social learning, and sustainability assessments were not made systematically. We discuss how social learning can be improved, and how a learning network of development initiatives could be realized.

Functional Analysis of Problem Behavior: A Systematic Approach for Identifying Idiosyncratic Variables

PubMed Central

Roscoe, Eileen M.; Schlichenmeyer, Kevin J.; Dube, William V.

2015-01-01

When inconclusive functional analysis (FA) outcomes occur, a number of modifications have been made to enhance the putative establishing operation or consequence associated with behavioral maintenance. However, a systematic method for identifying relevant events to test during modified FAs has not been evaluated. The purpose of this study was to develop and evaluate a technology for systematically identifying events to test in a modified FA after an initial FA led to inconclusive outcomes. Six individuals whose initial FA showed little or no responding or high levels only in the control condition participated. An indirect assessment (IA) questionnaire developed for identifying idiosyncratic variables was administered, and a descriptive analysis (DA) was conducted. Results from the IA only or a combination of the IA and DA were used to inform modified FA test and control conditions. Conclusive FA outcomes were obtained with five of the six participants during the modified FA phase. PMID:25930176

Implants for orthodontic anchorage

PubMed Central

Zheng, Xiaowen; Sun, Yannan; Zhang, Yimei; Cai, Ting; Sun, Feng; Lin, Jiuxiang

2018-01-01

Abstract Implantanchorage continues to receive much attention as an important orthodontic anchorage. Since the development of orthodontic implants, the scope of applications has continued to increase. Although multiple reviews detailing implants have been published, no comprehensive evaluations have been performed. Thus, the purpose of this study was to comprehensively evaluate the effects of implants based on data published in review articles. An electronic search of the Cochrane Library, Medline, Embase, Ebsco and Sicencedirect for reviews with “orthodontic” and “systematic review or meta analysis” in the title, abstract, keywords, or full text was performed. A subsequent manual search was then performed to identify reviews concerning orthodontic implants. A manual search of the orthodontic journals American Journal of Orthodontics and Dentofacial Orthopedics (AJODO), European Journal of Orthodontics (EJO), and Angle Othodontist was also performed. Such systematic reviews that evaluated the efficacy and safety of orthodontic implants were used to indicate success rates and molar movements. A total of 23 reviews were included in the analysis. The quality of each review was assessed using a measurement tool for Assessment of Multiple Systematic Reviews (AMSTAR), and the review chosen to summarize outcomes had a quality score of >6. Most reviews were less than moderate quality. Success rates of implants ranged in a broad scope, and movement of the maxillary first molar was superior with implants compared with traditional anchorage. PMID:29595673

Use of methodological tools for assessing the quality of studies in periodontology and implant dentistry: a systematic review.

PubMed

Faggion, Clovis M; Huda, Fahd; Wasiak, Jason

2014-06-01

To evaluate the methodological approaches used to assess the quality of studies included in systematic reviews (SRs) in periodontology and implant dentistry. Two electronic databases (PubMed and Cochrane Database of Systematic Reviews) were searched independently to identify SRs examining interventions published through 2 September 2013. The reference lists of included SRs and records of 10 specialty dental journals were searched manually. Methodological approaches were assessed using seven criteria based on the Cochrane Handbook for Systematic Reviews of Interventions. Temporal trends in methodological quality were also explored. Of the 159 SRs with meta-analyses included in the analysis, 44 (28%) reported the use of domain-based tools, 15 (9%) reported the use of checklists and 7 (4%) reported the use of scales. Forty-two (26%) SRs reported use of more than one tool. Criteria were met heterogeneously; authors of 15 (9%) publications incorporated the quality of evidence of primary studies into SRs, whereas 69% of SRs reported methodological approaches in the Materials/Methods section. Reporting of four criteria was significantly better in recent (2010-2013) than in previous publications. The analysis identified several methodological limitations of approaches used to assess evidence in studies included in SRs in periodontology and implant dentistry. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Gathering Validity Evidence for Surgical Simulation: A Systematic Review.

PubMed

Borgersen, Nanna Jo; Naur, Therese M H; Sørensen, Stine M D; Bjerrum, Flemming; Konge, Lars; Subhi, Yousif; Thomsen, Ann Sofia S

2018-06-01

To identify current trends in the use of validity frameworks in surgical simulation, to provide an overview of the evidence behind the assessment of technical skills in all surgical specialties, and to present recommendations and guidelines for future validity studies. Validity evidence for assessment tools used in the evaluation of surgical performance is of paramount importance to ensure valid and reliable assessment of skills. We systematically reviewed the literature by searching 5 databases (PubMed, EMBASE, Web of Science, PsycINFO, and the Cochrane Library) for studies published from January 1, 2008, to July 10, 2017. We included original studies evaluating simulation-based assessments of health professionals in surgical specialties and extracted data on surgical specialty, simulator modality, participant characteristics, and the validity framework used. Data were synthesized qualitatively. We identified 498 studies with a total of 18,312 participants. Publications involving validity assessments in surgical simulation more than doubled from 2008 to 2010 (∼30 studies/year) to 2014 to 2016 (∼70 to 90 studies/year). Only 6.6% of the studies used the recommended contemporary validity framework (Messick). The majority of studies used outdated frameworks such as face validity. Significant differences were identified across surgical specialties. The evaluated assessment tools were mostly inanimate or virtual reality simulation models. An increasing number of studies have gathered validity evidence for simulation-based assessments in surgical specialties, but the use of outdated frameworks remains common. To address the current practice, this paper presents guidelines on how to use the contemporary validity framework when designing validity studies.

Lack of consensus on optimal acetabular cup orientation because of variation in assessment methods in total hip arthroplasty: a systematic review.

PubMed

Snijders, Thom E; Willemsen, Koen; van Gaalen, Steven M; Castelein, Rene M; Weinans, Harrie; de Gast, Arthur

2018-05-01

Dislocation is one of the main reasons for revision of total hip arthroplasty but dislocation rates have not changed in the past decades, compromising patients' well-being. Acetabular cup orientation plays a key role in implant stability and has been widely studied. This article investigates whether there is a consensus on optimal cup orientation, which is necessary when using a navigation system. A systematic search of the literature in the PubMed, Embase and Cochrane databases was performed (March 2017) to identify articles that investigated the direct relationship between cup orientation and dislocation, including a thorough evaluation of postoperative cup orientation assessment methods. Twenty eight relevant articles evaluating a direct relation between dislocation and cup orientation could not come to a consensus. The key reason is a lack of uniformity in the assessment of cup orientation. Cup orientation is assessed with different imaging modalities, different methodologies, different definitions for inclination and anteversion, several reference planes and distinct patient positions. All available studies lack uniformity in cup orientation assessment; therefore it is impossible to reach consensus on optimal cup orientation. Using navigation systems for placement of the cup is inevitably flawed when using different definitions in the preoperative planning, peroperative placement and postoperative evaluation. Further methodological development is required to assess cup orientation. Consequently, the postoperative assessment should be uniform, thus differentiating between anterior and posterior dislocation, use the same definitions for inclination and anteversion with the same reference plane and with the patient in the same position.

Economic evaluations on centralisation of specialised healthcare services: a systematic review of methods

PubMed Central

Bhattarai, Nawaraj; McMeekin, Peter; Price, Christopher; Vale, Luke

2016-01-01

Objective To systematically review and appraise the quality of economic evaluations assessing centralisation of specialised healthcare services. Methods A systematic review to identify economic evaluations on centralisation of any specialised healthcare service. Full economic evaluations comparing costs and consequences of centralisation of any specialised healthcare service were eligible for inclusion. Methodological characteristics of included studies were appraised using checklists adapted from recommended guidelines. Results A total of 64 full-text articles met the inclusion criteria. Two studies were conducted in the UK. Most of the studies used volume of activity as a proxy measure of centralisation. The methods used to assess centralisation were heterogeneous. Studies differed in terms of study design used and aspect of centralisation they considered. There were major limitations in studies. Only 12 studies reported the study perspective. Charges which are not true representation of costs were used by 17 studies to assess cost outcomes. Only 10 reported the detailed breakdown of the cost components used in their analysis. Discounting was necessary in 14 studies but was reported only in 7 studies. Sensitivity analyses were included by less than one-third of the studies. The applicability of the identified studies to a setting other than the one they were conducted in is questionable, given variations in the organisation of services and healthcare costs. Centralisation as a concept has also been variably and narrowly defined as activity of specific services which may not reflect the wider aspects of centralisation. Conclusions Confounded and biased information coming from studies without standardised methods may mislead decision-makers towards making wrong decisions on centralisation. It is important to improve the methodology and reporting of economic evaluations in order to provide more robust and transferable evidence. Wider aspects of healthcare centralisation should be considered in the estimates of costs and health outcomes. PMID:27154484

Systematic literature review of clinical trials evaluating pharmacotherapy for overactive bladder in elderly patients: An assessment of trial quality.

PubMed

Kistler, Kristin D; Xu, Yingxin; Zou, Kelly H; Ntanios, Fady; Chapman, Douglass S; Luo, Xuemei

2018-01-01

Overactive bladder (OAB) disproportionately affects older-aged adults, yet most randomized controlled trials (RCTs) underrepresent patients ≥65. This systematic literature review (SLR) identified RCTs evaluating β-3 adrenergic agonists or muscarinic antagonists in elderly patients with OAB, and compared study quality across trials. MEDLINE ® , Embase ® , and Cochrane Collaboration Central Register of Clinical Trials databases were searched from inception through April 28, 2015 to identify published, peer-reviewed RCT reports evaluating β-3 adrenergic agonists or muscarinic antagonists in elderly OAB patients (either ≥65 years or study-described as "elderly"). To assess study quality of RCT reports, we focused on internal/external validity, assessed via two scales: the validated Effective Public Health Practice Project [EPHPP]): Quality Assessment Tool for Quantitative Studies, and a tool commissioned by the Agency for Healthcare Research and Quality (AHRQ). Database searches yielded 1380 records that were then screened according to predefined inclusion/exclusion criteria. We included eight papers meeting study criteria. Despite scientific community efforts to improve RCT reporting standards, published reports still include incomplete and inconsistent reporting-of subject attrition, baseline patient characteristics, inclusion/exclusion criteria, and other important details. Only three of the eight OAB RCTs in this review received quality ratings of Strong (EPHPP) or Fair (AHRQ) and were multicenter with large samples. Despite the prevalence of OAB among older age individuals, relatively few RCTs evaluate OAB treatments explicitly among elderly subjects. The findings from this quality assessment suggest some areas for improvement in both conduct and reporting of future RCTs assessing OAB treatment in elderly. © 2017 Wiley Periodicals, Inc.

Moving from data collection to application: a systematic literature review of surgical capacity assessments and their applications.

PubMed

Carlson, Lucas C; Lin, Joseph A; Ameh, Emmanuel A; Mulwafu, Wakisa; Donkor, Peter; Derbew, Miliard; Rodas, Edgar; Mkandawire, Nyengo C; Dhanaraj, Mitra; Yangni-Angate, Herve; Sani, Rachid; Labib, Mohamed; Barbero, Roxana; Clarke, Damian; Smith, Martin D; Sherman, Lawrence; Mutyaba, Frederick A; Alexander, Philip; Hadley, Larry G P; VanRooyen, Michael J; Kushner, Adam L

2015-04-01

Over the past decade, assessments of surgical capacity in low- and middle-income countries (LMICs) have contributed to our understanding of barriers to the delivery of surgical services in a number of countries. It is yet unclear, however, how the findings of these assessments have been applied and built upon within the published literature. A systematic literature review of surgical capacity assessments in LMICs was performed to evaluate current levels of understanding of global surgical capacity and to identify areas for future study. A reverse snowballing method was then used to follow-up citations of the identified studies to assess how this research has been applied and built upon in the literature. Twenty-one papers reporting the findings of surgical capacity assessments conducted in 17 different LMICs in South Asia, East Asia and Pacific, Latin America and the Caribbean, and sub-Saharan Africa were identified. These studies documented substantial deficits in human resources, infrastructure, equipment, and supplies. Only seven additional papers were identified which applied or built upon the studies. Among these, capacity assessment findings were most commonly used to develop novel tools and intervention strategies, but they were also used as baseline measurements against which updated capacity assessments were compared. While the global surgery community has made tremendous progress in establishing baseline values of surgical capacity in LMICs around the world, further work is necessary to build upon and apply the foundational knowledge established through these efforts. Capacity assessment data should be coordinated and used in ongoing research efforts to monitor and evaluate progress in global surgery and to develop targeted intervention strategies. Intervention strategy development may also be further incorporated into the evaluation process itself.

A systematic review of childhood maltreatment assessments in population-representative surveys since 1990.

PubMed

Hovdestad, Wendy; Campeau, Aimée; Potter, Dawn; Tonmyr, Lil

2015-01-01

Population-representative surveys that assess childhood maltreatment and health are a valuable resource to explore the implications of child maltreatment for population health. Systematic identification and evaluation of such surveys is needed to facilitate optimal use of their data and to inform future research. To inform researchers of the existence and nature of population-representative surveys relevant to understanding links between childhood maltreatment and health; to evaluate the assessment of childhood maltreatment in this body of work. We included surveys that: 1) were representative of the non-institutionalized population of any size nation or of any geopolitical region ≥ 10 million people; 2) included a broad age range (≥ 40 years); 3) measured health; 4) assessed childhood maltreatment retrospectively; and 5) were conducted since 1990. We used Internet and database searching (including CINAHL, Embase, ERIC, Global Health, MEDLINE, PsycINFO, Scopus, Social Policy and Practice: January 1990 to March 2014), expert consultation, and other means to identify surveys and associated documentation. Translations of non-English survey content were verified by fluent readers of survey languages. We developed checklists to abstract and evaluate childhood maltreatment content. Fifty-four surveys from 39 countries met inclusion criteria. Sample sizes ranged from 1,287-51,945 and response rates from 15%-96%. Thirteen surveys assessed neglect, 15 emotional abuse; 18 exposure to family violence; 26 physical abuse; 48 sexual abuse. Fourteen surveys assessed more than three types; six of these were conducted since 2010. In nine surveys childhood maltreatment assessments were detailed (+10 items for at least one type of maltreatment). Seven surveys' assessments had known reliability and/or validity. Data from 54 surveys can be used to explore the population health relevance of child maltreatment. Assessment of childhood maltreatment is not comprehensive but there is evidence of recent improvement.

A systematic approach for evaluating and scoring human data.

PubMed

Money, Chris D; Tomenson, John A; Penman, Michael G; Boogaard, Peter J; Jeffrey Lewis, R

2013-07-01

An approach is described for how the quality of human data can be systematically assessed and categorised. The approach mirrors the animal data quality considerations set out by Klimisch et al., in order that human data quality can be addressed in a complementary manner and to help facilitate transparent (and repeatable) weight of evidence comparisons. Definitions are proposed for the quality and adequacy of data. Quality is differentiated into four categories. A description of how the scheme can be used for evaluating data reliability, especially for use when contributing entries to the IUCLID database, is shown. A discussion of how the criteria might also be used when determining overall data relevance is included. The approach is intended to help harmonise human data evaluation processes worldwide. Copyright © 2013 Elsevier Inc. All rights reserved.

Study Sensitivity: Evaluating the Ability to Detect Effects in Systematic Reviews of Chemical Exposures

PubMed Central

Cooper, Glinda S.; Lunn, Ruth M.; Ågerstrand, Marlene; Glenn, Barbara S.; Kraft, Andrew D.; Luke, April M.; Ratcliffe, Jennifer M.

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as “sensitivity”, is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and sensitivity can be used to identify the most informative studies, to evaluate the confidence of the findings from individual studies and to identify those study elements that may help to explain heterogeneity across the body of literature. PMID:27156196

Measurement properties of asthma-specific quality-of-life measures: protocol for a systematic review.

PubMed

Apfelbacher, Christian; Paudyal, Priya; Bülbül, Alpaslan; Smith, Helen

2014-07-24

Asthma is a frequent chronic inflammatory disease of the airways, and the assessment of health-related quality of life (HrQoL) is important in both research and routine care. Various asthma-specific measures of HrQoL exist but there is uncertainty which measures are best suited for use in research and routine care. Therefore, the aim of the proposed research is a comprehensive systematic assessment of the measurement properties of the existing measures that were developed to measure asthma-specific quality of life. This study is a systematic review of the measurement properties of asthma-specific measures of health-related quality of life. PubMed and Embase will be searched using a selection of relevant search terms. Eligible studies will be primary empirical studies evaluating, describing or comparing measurement properties of asthma-specific HRQL tools. Eligibility assessment and data abstraction will be performed independently by two reviewers. Evidence tables will be generated for study characteristics, instrument characteristics, measurement properties and interpretability. The quality of the measurement properties will be assessed using predefined criteria. Methodological quality of studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. A best evidence synthesis will be undertaken if more than one study have investigated a particular measurement property. The proposed systematic review will produce a comprehensive assessment of measurement properties of existing measures of asthma-specific health-related quality of life. We also aim to derive recommendations in order to help researchers and practitioners alike in the choice of instrument. PROSPERO registration number: CRD42014010491.

Indicator development methodology for volunteer tourism in host communities: creating a low-cost, locally applicable, rapid assessment tool

Treesearch

Christopher A. Lupoli; Wayde C. Morse; Conner Bailey; John Schelhas

2015-01-01

Two prominent critiques of volunteer tourism are that it is a top-down imposed form of development treating host communities as passive recipients of international aid, and that the impacts of volunteer tourism in host communities are not systematically evaluated. To address this we identified a pre-existing participatory methodology for assessing community...

Standards for Teaching about the Federal Reserve System: An Initiative by Two Federal Reserve Banks

ERIC Educational Resources Information Center

Bosshardt, William D.; Grimes, Paul W.; Suiter, Mary C.

2011-01-01

In the fall of 2008, the Federal Reserve Banks of Atlanta and St. Louis began a systematic evaluation of their economic and personal finance educational outreach programs. Both banks were interested in developing tools to assess the success of their existing economic and financial education programs. However, before any assessment could begin, a…

Effectiveness of Acupuncture for Primary Ovarian Insufficiency: A Systematic Review and Meta-Analysis.

PubMed

Jo, Junyoung; Lee, Yoon Jae; Lee, Hyangsook

2015-01-01

Objective. This systematic review aimed to assess current evidence from randomized controlled trials (RCTs) on the effects of acupuncture for patients with primary ovarian insufficiency (POI). Methods. We searched twelve databases to identify relevant studies published before July 2014. The outcomes were serum follicle-stimulating hormone (FSH) levels and resumption of menstruation. Two reviewers independently assessed the risk of bias using the Cochrane's tool, extracted the results, and evaluated the overall level of the evidence using Grading of Recommendations Assessment, Development, and Evaluation (GRADE) criteria. Results. Eight RCTs were selected. Acupuncture significantly lowered serum FSH levels and more women receiving acupuncture reported resumption of menses. However, the results should be interpreted with caution due to a small number of participants, high risk of bias for blinding, and likely publication bias. The level of evidence for FSH level and resumption of menses were assessed as "low" using GRADE. Conclusion. The current evidence on acupuncture for POI is insufficient to draw a firm conclusion due to scarcity of studies with a low risk of bias and likely publication bias. Further rigorously designed and conducted studies are needed to confirm the effectiveness and safety of acupuncture in patients with POI.

The impact of eHealth on the quality and safety of health care: a systematic overview.

PubMed

Black, Ashly D; Car, Josip; Pagliari, Claudia; Anandan, Chantelle; Cresswell, Kathrin; Bokun, Tomislav; McKinstry, Brian; Procter, Rob; Majeed, Azeem; Sheikh, Aziz

2011-01-18

There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care. We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking. There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and "techno-enthusiasts" as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption.

Models and applications for measuring the impact of health research: update of a systematic review for the Health Technology Assessment programme.

PubMed

Raftery, James; Hanney, Steve; Greenhalgh, Trish; Glover, Matthew; Blatch-Jones, Amanda

2016-10-01

This report reviews approaches and tools for measuring the impact of research programmes, building on, and extending, a 2007 review. (1) To identify the range of theoretical models and empirical approaches for measuring the impact of health research programmes; (2) to develop a taxonomy of models and approaches; (3) to summarise the evidence on the application and use of these models; and (4) to evaluate the different options for the Health Technology Assessment (HTA) programme. We searched databases including Ovid MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature and The Cochrane Library from January 2005 to August 2014. This narrative systematic literature review comprised an update, extension and analysis/discussion. We systematically searched eight databases, supplemented by personal knowledge, in August 2014 through to March 2015. The literature on impact assessment has much expanded. The Payback Framework, with adaptations, remains the most widely used approach. It draws on different philosophical traditions, enhancing an underlying logic model with an interpretative case study element and attention to context. Besides the logic model, other ideal type approaches included constructionist, realist, critical and performative. Most models in practice drew pragmatically on elements of several ideal types. Monetisation of impact, an increasingly popular approach, shows a high return from research but relies heavily on assumptions about the extent to which health gains depend on research. Despite usually requiring systematic reviews before funding trials, the HTA programme does not routinely examine the impact of those trials on subsequent systematic reviews. The York/Patient-Centered Outcomes Research Institute and the Grading of Recommendations Assessment, Development and Evaluation toolkits provide ways of assessing such impact, but need to be evaluated. The literature, as reviewed here, provides very few instances of a randomised trial playing a major role in stopping the use of a new technology. The few trials funded by the HTA programme that may have played such a role were outliers. The findings of this review support the continued use of the Payback Framework by the HTA programme. Changes in the structure of the NHS, the development of NHS England and changes in the National Institute for Health and Care Excellence's remit pose new challenges for identifying and meeting current and future research needs. Future assessments of the impact of the HTA programme will have to take account of wider changes, especially as the Research Excellence Framework (REF), which assesses the quality of universities' research, seems likely to continue to rely on case studies to measure impact. The HTA programme should consider how the format and selection of case studies might be improved to aid more systematic assessment. The selection of case studies, such as in the REF, but also more generally, tends to be biased towards high-impact rather than low-impact stories. Experience for other industries indicate that much can be learnt from the latter. The adoption of researchfish ® (researchfish Ltd, Cambridge, UK) by most major UK research funders has implications for future assessments of impact. Although the routine capture of indexed research publications has merit, the degree to which researchfish will succeed in collecting other, non-indexed outputs and activities remains to be established. There were limitations in how far we could address challenges that faced us as we extended the focus beyond that of the 2007 review, and well beyond a narrow focus just on the HTA programme. Research funders can benefit from continuing to monitor and evaluate the impacts of the studies they fund. They should also review the contribution of case studies and expand work on linking trials to meta-analyses and to guidelines. The National Institute for Health Research HTA programme.

Evaluation of rear-end bus collisions and identification of possible solutions.

DOT National Transportation Integrated Search

2014-03-01

The purpose of this project was to conduct a systematic study to examine rear-end : collisions between motorists and public transit buses to achieve the following objectives: : determine if rear-end collisions are increasing; conduct an assessment to...

Interventions and assessment tools addressing key concepts people need to know to appraise claims about treatment effects: a systematic mapping review.

PubMed

Austvoll-Dahlgren, Astrid; Nsangi, Allen; Semakula, Daniel

2016-12-29

People's ability to appraise claims about treatment effects is crucial for informed decision-making. Our objective was to systematically map this area of research in order to (a) provide an overview of interventions targeting key concepts that people need to understand to assess treatment claims and (b) to identify assessment tools used to evaluate people's understanding of these concepts. The findings of this review provide a starting point for decisions about which key concepts to address when developing new interventions, and which assessment tools should be considered. We conducted a systematic mapping review of interventions and assessment tools addressing key concepts important for people to be able to assess treatment claims. A systematic literature search was done by a reserach librarian in relevant databases. Judgement about inclusion of studies and data collection was done by at least two researchers. We included all quantitative study designs targeting one or more of the key concepts, and targeting patients, healthy members of the public, and health professionals. The studies were divided into four categories: risk communication and decision aids, evidence-based medicine and critical appraisal, understanding of controlled trials, and science education. Findings were summarised descriptively. We included 415 studies, of which the interventions and assessment tools we identified included only a handful of the key concepts. The most common key concepts in interventions were "Treatments usually have beneficial and harmful effects," "Treatment comparisons should be fair," "Compare like with like," and "Single studies can be misleading." A variety of assessment tools were identified, but only four assessment tools included 10 or more key concepts. There is great potential for developing learning and assessment tools targeting key concepts that people need to understand to assess claims about treatment effects. There is currently no instrument covering assessment of all these key concepts.

Cumulative Risk Assessment: An Overview of Methodological Approaches for Evaluating Combined Health Effects from Exposure to Multiple Environmental Stressors

PubMed Central

Sexton, Ken

2012-01-01

Systematic evaluation of cumulative health risks from the combined effects of multiple environmental stressors is becoming a vital component of risk-based decisions aimed at protecting human populations and communities. This article briefly examines the historical development of cumulative risk assessment as an analytical tool, and discusses current approaches for evaluating cumulative health effects from exposure to both chemical mixtures and combinations of chemical and nonchemical stressors. A comparison of stressor-based and effects-based assessment methods is presented, and the potential value of focusing on viable risk management options to limit the scope of cumulative evaluations is discussed. The ultimate goal of cumulative risk assessment is to provide answers to decision-relevant questions based on organized scientific analysis; even if the answers, at least for the time being, are inexact and uncertain. PMID:22470298

An Econometric Approach to Evaluate Navy Advertising Efficiency.

DTIC Science & Technology

1996-03-01

This thesis uses an econometric approach to systematically and comprehensively analyze Navy advertising and recruiting data to determine Navy... advertising cost efficiency in the Navy recruiting process. Current recruiting and advertising cost data are merged into an appropriate data base and...evaluated using multiple regression techniques to find assessments of the relationships between Navy advertising expenditures and recruit contracts attained

School-Based Smoking Prevention Programs for Adolescents in South Korea: A Systematic Review

ERIC Educational Resources Information Center

Park, Eunok

2006-01-01

The number of research papers evaluating programs designed to prevent adolescent smoking have increased in the last 13 years in Korea. The purpose of this study was to evaluate these programs, to review the features of the studies and to systemically assess the results on the knowledge about, and attitude to, smoking and smoking behavior. Database…

Where is students' research in evidence-informed decision-making in health? Assessing productivity and use of postgraduate students' research in low- and middle-income countries: a systematic review.

PubMed

Obuku, E A; Lavis, J N; Kinengyere, A; Mafigiri, D K; Sengooba, F; Karamagi, C; Sewankambo, N K

2017-03-09

Investing in research that is not accessible or used is a waste of resources and an injustice to human subject participants. Post-graduate students' research in institutions of higher learning involves considerable time, effort and money, warranting evaluation of the return on investment. Although individual studies addressing research productivity of post-graduate students are available, a synthesis of these results in low-income settings has not been undertaken. Our first aim is to identify the types of approaches that increase productivity and those that increase the application of medical post-graduate students' research and to assess their effectiveness. Our second aim is to assess the determinants of post-graduate students' research productivity. We propose a two-stage systematic review. We will electronically search for published and grey literature in PubMed/MEDLINE and the ERIC databases, as well as contact authors, research administration units of universities, and other key informants as appropriate. In stage one, we will map the nature of the evidence available using a knowledge translation framework adapted from existing literature. We will perform duplicate screening and selection of articles, data abstraction, and risk of bias assessments for included primary studies as described in the Cochrane handbook for systematic reviews. Our primary outcome is publication output as a measure of research productivity, whilst we defined research use as citations in peer-reviewed journals or policy-related documents as our secondary outcome. In stage two, we will perform a structured narrative synthesis of the findings and advance to quantitative meta-analysis if the number of studies are adequate and their heterogeneity is low. Adapting the Grading, Recommendations, Assessment, Development and Evaluation (GRADE) approach, we will assess the overall quality of evidence for effects, and report our results in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. We will share our findings with universities, other training institutions, civil society, funders as well as government departments in charge of education and health particularly in low- and middle-income countries.

Infusion phlebitis assessment measures: a systematic review.

PubMed

Ray-Barruel, Gillian; Polit, Denise F; Murfield, Jenny E; Rickard, Claire M

2014-04-01

Phlebitis is a common and painful complication of peripheral intravenous cannulation. The aim of this review was to identify the measures used in infusion phlebitis assessment and evaluate evidence regarding their reliability, validity, responsiveness and feasibility. We conducted a systematic literature review of the Cochrane library, Ovid MEDLINE and EBSCO CINAHL until September 2013. All English-language studies (randomized controlled trials, prospective cohort and cross-sectional) that used an infusion phlebitis scale were retrieved and analysed to determine which symptoms were included in each scale and how these were measured. We evaluated studies that reported testing the psychometric properties of phlebitis assessment scales using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines. Infusion phlebitis was the primary outcome measure in 233 studies. Fifty-three (23%) of these provided no actual definition of phlebitis. Of the 180 studies that reported measuring phlebitis incidence and/or severity, 101 (56%) used a scale and 79 (44%) used a definition alone. We identified 71 different phlebitis assessment scales. Three scales had undergone some psychometric analyses, but no scale had been rigorously tested. Many phlebitis scales exist, but none has been thoroughly validated for use in clinical practice. A lack of consensus on phlebitis measures has likely contributed to disparities in reported phlebitis incidence, precluding meaningful comparison of phlebitis rates. © 2014 The Authors. Journal of Evaluation in Clinical Practice published by John Wiley & Sons, Ltd.

Checklist to operationalize measurement characteristics of patient-reported outcome measures.

PubMed

Francis, David O; McPheeters, Melissa L; Noud, Meaghan; Penson, David F; Feurer, Irene D

2016-08-02

The purpose of this study was to advance a checklist of evaluative criteria designed to assess patient-reported outcome (PRO) measures' developmental measurement properties and applicability, which can be used by systematic reviewers, researchers, and clinicians with a varied range of expertise in psychometric measure development methodology. A directed literature search was performed to identify original studies, textbooks, consensus guidelines, and published reports that propose criteria for assessing the quality of PRO measures. Recommendations from these sources were iteratively distilled into a checklist of key attributes. Preliminary items underwent evaluation through 24 cognitive interviews with clinicians and quantitative researchers. Six measurement theory methodological novices independently applied the final checklist to assess six PRO measures encompassing a variety of methods, applications, and clinical constructs. Agreement between novice and expert scores was assessed. The distillation process yielded an 18-item checklist with six domains: (1) conceptual model, (2) content validity, (3) reliability, (4) construct validity, (5) scoring and interpretation, and (6) respondent burden and presentation. With minimal instruction, good agreement in checklist item ratings was achieved between quantitative researchers with expertise in measurement theory and less experienced clinicians (mean kappa 0.70; range 0.66-0.87). We present a simplified checklist that can help guide systematic reviewers, researchers, and clinicians with varied measurement theory expertise to evaluate the strengths and weakness of candidate PRO measures' developmental properties and the appropriateness for specific applications.

The pancreatic surgery registry (StuDoQ|Pancreas) of the German Society for General and Visceral Surgery (DGAV) - presentation and systematic quality evaluation.

PubMed

Wellner, Ulrich F; Klinger, Carsten; Lehmann, Kai; Buhr, Heinz; Neugebauer, Edmund; Keck, Tobias

2017-04-05

Pancreatic resections are among the most complex procedures in visceral surgery. While mortality has decreased substantially over the past decades, morbidity remains high. The volume-outcome correlation in pancreatic surgery is among the strongest in the field of surgery. The German Society for General and Visceral Surgery (DGAV) established a national registry for quality control, risk assessment and outcomes research in pancreatic surgery in Germany (DGAV SuDoQ|Pancreas). Here, we present the aims and scope of the DGAV StuDoQ|Pancreas Registry. A systematic assessment of registry quality is performed based on the recommendations of the German network for outcomes research (DNVF). The registry quality was assessed by consensus criteria of the DNVF in regard to the domains Systematics and Appropriateness, Standardization, Validity of the sampling procedure, Validity of data collection, Validity of statistical analysis and reports, and General demands for registry quality. In summary, DGAV StuDoQ|Pancreas meets most of the criteria of a high-quality clinical registry. The DGAV StuDoQ|Pancreas provides a valuable platform for quality assessment, outcomes research as well as randomized registry trials in pancreatic surgery.

An optimal search filter for retrieving systematic reviews and meta-analyses

PubMed Central

2012-01-01

Background Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters. Methods This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter. Results Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened. Conclusions The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity. PMID:22512835

A study to assess the long-term stability of the ionization chamber reference system in the LNMRI

NASA Astrophysics Data System (ADS)

Trindade Filho, O. L.; Conceição, D. A.; da Silva, C. J.; Delgado, J. U.; de Oliveira, A. E.; Iwahara, A.; Tauhata, L.

2018-03-01

Ionization chambers are used as secondary standard in order to maintain the calibration factors of radionuclides in the activity measurements in metrology laboratories. Used as radionuclide calibrator in nuclear medicine clinics to control dose in patients, its long-term performance is not evaluated systematically. A methodology for long-term evaluation for its stability is monitored and checked. Historical data produced monthly of 2012 until 2017, by an ionization chamber, electrometer and 226Ra, were analyzed via control chart, aiming to follow the long-term performance. Monitoring systematic errors were consistent within the limits of control, demonstrating the quality of measurements in compliance with ISO17025.

Systematic review of the behavioural assessment of pain in cats.

PubMed

Merola, Isabella; Mills, Daniel S

2016-02-01

The objectives were to review systematically the range of assessment tools used in cats to detect the behavioural expression of pain and the evidence of their quality; and to examine behavioural metrics (considering both the sensory and affective domains) used to assess pain. A search of PubMed and ScienceDirect, alongside articles known to the authors, from 2000 onwards, for papers in English was performed. This was followed by a manual search of the references within the primary data sources. Only peer-reviewed publications that provided information on the assessment tool used to evaluate the behavioural expression of pain in cats, in conscious animals (not anaesthetised cats), were included. No previous systematic reviews were identified. One hundred papers were included in the final assessment. Studies were primarily related to the assessment of pain in relation to surgical procedures, and no clear distinction was made concerning the onset of acute and chronic pain. Ten broad types of instrument to assess pain were identified, and generally the quality of evidence to support the use of the various instruments was poor. Only one specific instrument (UNESP-Botucatu scale) had published evidence of validity, reliability and sensitivity at the level of a randomised control trial, but with a positive rather than placebo control, and limited to its use in the ovariohysterectomy situation. The metrics used within the tools appeared to focus primarily on the sensory aspect of pain, with no study clearly discriminating between the sensory and affective components of pain. Further studies are required to provide a higher quality of evidence for methods used to assess pain in cats. Furthermore, a consistent definition for acute and chronic pain is needed. Tools need to be validated that can detect pain in a range of conditions and by different evaluators (veterinary surgeons and owners), which consider both the sensory and emotional aspects of pain. © ISFM and AAFP 2015.

Are we measuring what matters in health technology assessment of disease management? Systematic literature review.

PubMed

Steuten, Lotte; Vrijhoef, Bert; Severens, Hans; van Merode, Frits; Spreeuwenberg, Cor

2006-01-01

An overview was produced of indicators currently used to assess disease management programs and, based on these findings, provide a framework regarding sets of indicators that should be used when taking the aims and types of disease management programs into account. A systematic literature review was performed. Thirty-six studies met the inclusion criteria. It appeared that a link between aims of disease management and evaluated structure, process, as well as outcome indicators does not exist in a substantial part of published studies on disease management of diabetes and asthma/chronic obstructive pulmonary disease, especially when efficiency of care is concerned. Furthermore, structure indicators are largely missing from the evaluations, although these are of major importance for the interpretation of outcomes for purposes of decision-making. Efficiency of disease management is mainly evaluated by means of process indicators; the use of outcome indicators is less common. Within a framework, structure, process, and outcome indicators for effectiveness and efficiency are recommended for each type of disease management program. The link between aims of disease management and evaluated structure, process, and outcome indicators does not exist in a substantial part of published studies on disease management. The added value of this study mainly lies in the development of a framework to guide the choice of indicators for health technology assessment of disease management.

Blood-letting therapy for the common cold: A protocol for a systematic review of controlled trials.

PubMed

Lee, Ju Ah; Hong, Minna; Lee, Myeong Soo; Yoon, Seong Hoon; Choi, Jun-Yong

2017-12-01

Many people experience the common cold, but there is currently no special treatment. For this reason, complementary and alternative medicine (CAM) therapies are used to improve the symptoms of the common cold. Blood-letting therapy (BL) is a CAM therapy that has been used for over 2000 years to treat various diseases. However, few studies have provided evidence for the efficacy and safety of BL for the common cold. This study aims to assess the effectiveness and safety of BL for the common cold. A total of 11 databases will be searched for studies conducted through June 2017. We will include randomized controlled trials assessing BL for the common cold. All randomized controlled trials on BL or related interventions will be included. Risk of bias will be assessed using the Cochrane Risk of Bias Assessment Tool, while confidence in the accumulated evidence will be evaluated using the Grading of Recommendations Assessment, Development and Evaluation instrument. This systematic review will be published in a peer-reviewed journal and will also be disseminated electronically and in print. The review will be updated to inform and guide healthcare practices. Copyright © 2017 The Authors. Published by Wolters Kluwer Health, Inc. All rights reserved.

Assessment and Treatment of Cognition and Communication Skills in Adults With Acquired Brain Injury via Telepractice: A Systematic Review.

PubMed

Coleman, Jaumeiko J; Frymark, Tobi; Franceschini, Nicole M; Theodoros, Deborah G

2015-05-01

This is a systematic review of assessment and treatment of cognitive and communicative abilities of individuals with acquired brain injury via telepractice versus in person. The a priori clinical questions were informed by previous research that highlights the importance of considering any functional implications of outcomes, determining disorder- and setting-specific concerns, and measuring the potential impact of diagnostic accuracy and treatment efficacy data on interpretation of findings. A literature search of multiple databases (e.g., PubMed) was conducted using key words and study inclusion criteria associated with the clinical questions. Ten group studies were accepted that addressed assessment of motor speech, language, and cognitive impairments; assessment of motor speech and language activity limitations/participation restrictions; and treatment of cognitive impairments and activity limitations/participation restrictions. In most cases, equivalence of outcomes was noted across service delivery methods. Limited findings, lack of diagnostic accuracy and treatment efficacy data, and heterogeneity of assessments and interventions precluded robust evaluation of clinical implications for telepractice equivalence and the broader area of telepractice efficacy. Future research is needed that will build upon current knowledge through replication. In addition, further evaluation at the impairment and activity limitation/participation restriction levels is needed.

MRI and CBCT image registration of temporomandibular joint: a systematic review.

PubMed

Al-Saleh, Mohammed A Q; Alsufyani, Noura A; Saltaji, Humam; Jaremko, Jacob L; Major, Paul W

2016-05-10

The purpose of the present review is to systematically and critically analyze the available literature regarding the importance, applicability, and practicality of (MRI), computerized tomography (CT) or cone-beam CT (CBCT) image registration for TMJ anatomy and assessment. A systematic search of 4 databases; MEDLINE, EMBASE, EBM reviews and Scopus, was conducted by 2 reviewers. An additional manual search of the bibliography was performed. All articles discussing the magnetic resonance imaging MRI and CT or CBCT image registration for temporomandibular joint (TMJ) visualization or assessment were included. Only 3 articles satisfied the inclusion criteria. All included articles were published within the last 7 years. Two articles described MRI to CT multimodality image registration as a complementary tool to visualize TMJ. Both articles used images of one patient only to introduce the complementary concept of MRI-CT fused image. One article assessed the reliability of using MRI-CBCT registration to evaluate the TMJ disc position and osseous pathology for 10 temporomandibular disorder (TMD) patients. There are very limited studies of MRI-CT/CBCT registration to reach a conclusion regarding its accuracy or clinical use in the temporomandibular joints.

Factors influencing workplace health promotion intervention: a qualitative systematic review.

PubMed

Rojatz, Daniela; Merchant, Almas; Nitsch, Martina

2017-10-01

Although workplace health promotion (WHP) has evolved over the last 40 years, systematically collected knowledge on factors influencing the functioning of WHP is scarce. Therefore, a qualitative systematic literature review was carried out to systematically identify and synthesize factors influencing the phases of WHP interventions: needs assessment, planning, implementation and evaluation. Research evidence was identified by searching electronic databases (Scopus, PubMed, Social Sciences Citation Index, ASSIA, ERIC, IBBS and PsycINFO) from 1998 to 2013, as well as by cross-checking reference lists of included peer-reviewed articles. The inclusion criteria were: original empirical research, description of WHP, description of barriers to and/or facilitators of the planning, implementation and/or evaluation of WHP. Finally, 54 full texts were included. From these, influencing factors were extracted and summarized using thematic analysis. The majority of influencing factors referred to the implementation phase, few dealt with planning and/or evaluation and none with needs assessment. The influencing factors were condensed into topics with respect to factors at contextual level (e.g. economic crisis); factors at organizational level (e.g. management support); factors at intervention level (e.g. quality of intervention concept); factors at implementer level (e.g. resources); factors at participant level (e.g. commitment to intervention) and factors referring to methodological and data aspects (e.g. data-collection issues). Factors regarding contextual issues and organizational aspects were identified across three phases. Therefore, future research and practice should consider not only the influencing factors at different levels, but also at different phases of WHP interventions. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ohi, J.

Supporting analysis and assessments can provide a sound analytic foundation and focus for program planning, evaluation, and coordination, particularly if issues of hydrogen production, distribution, storage, safety, and infrastructure can be analyzed in a comprehensive and systematic manner. The overall purpose of this activity is to coordinate all key analytic tasks-such as technology and market status, opportunities, and trends; environmental costs and benefits; and regulatory constraints and opportunities-within a long-term and systematic analytic foundation for program planning and evaluation. Within this context, the purpose of the project is to help develop and evaluate programmatic pathway options that incorporate near andmore » mid-term strategies to achieve the long-term goals of the Hydrogen Program. In FY 95, NREL will develop a comprehensive effort with industry, state and local agencies, and other federal agencies to identify and evaluate programmatic pathway options to achieve the long-term goals of the Program. Activity to date is reported.« less

A systematic literature review of US definitions, scoring systems and validity according to the OMERACT filter for tendon lesion in RA and other inflammatory joint diseases.

PubMed

Alcalde, María; D'Agostino, Maria Antonietta; Bruyn, George A W; Möller, Ingrid; Iagnocco, Annamaria; Wakefield, Richard J; Naredo, Esperanza

2012-07-01

To present the published data concerning the US assessment of tendon lesions as well as the US metric properties investigated in inflammatory arthritis. A systematic literature search of PubMed, Embase and the Cochrane Library was performed. Selection criteria were original articles in the English language reporting US, Doppler, tenosynovitis and other tendon lesions in patients with RA and other inflammatory arthritis. Data extraction focused on the definition and quantification of US-detected tenosynovitis and other tendon abnormalities and the metric properties of US according to the OMERACT filter for evaluating the above tendon lesions. Thirty-three of 192 identified articles were included in the review. Most articles were case series (42%) or case-control (33%) studies describing hand and/or foot tenosynovitis in RA patients. The majority of older articles used only B-mode, whereas the most recent studies have incorporated Doppler mode. Definition of tenosynovitis or other tendon lesion was provided in 70% of the evaluated studies. Most of the studies (61%) used a binary score for evaluating tendon abnormalities. Concerning the OMERACT filter, 24 (73%) articles dealt with construct validity. The comparator most commonly used was clinical assessment and MRI. There were few studies assessing criterion validity. Some studies evaluated reliability (36%), responsiveness (21%) and feasibility (12%). US seems a promising tool for evaluating inflammatory tendon lesions. However, further validation is necessary for implementation in clinical practice and trials.

Assessment of the wish to hasten death in patients with advanced disease: A systematic review of measurement instruments.

PubMed

Bellido-Pérez, Mercedes; Monforte-Royo, Cristina; Tomás-Sábado, Joaquín; Porta-Sales, Josep; Balaguer, Albert

2017-06-01

Patients with advanced conditions may present a wish to hasten death. Assessing this wish is complex due to the nature of the phenomenon and the difficulty of conceptualising it. To identify and analyse existing instruments for assessing the wish to hasten death and to rate their reported psychometric properties. Systematic review based on PRISMA guidelines. The COnsensus-based Standards for the selection of health Measurement INstruments checklist was used to evaluate the methodological quality of validation studies and the measurement properties of the instrument described. The CINAHL, PsycINFO, Pubmed and Web of Science databases were searched from inception to November 2015. A total of 50 articles involving assessment of the wish to hasten death were included. Eight concerned instrument validation and were evaluated using COnsensus-based Standards for the selection of health Measurement INstruments criteria. They reported data for between two and seven measurement properties, with ratings between fair and excellent. Of the seven instruments identified, the Desire for Death Rating Scale or the Schedule of Attitudes toward Hastened Death feature in 48 of the 50 articles. The Schedule of Attitudes toward Hastened Death is the most widely used and is the instrument whose psychometric properties have been most often analysed. Versions of the Schedule of Attitudes toward Hastened Death are available in five languages other than the original English. This systematic review has analysed existing instruments for assessing the wish to hasten death. It has also explored the methodological quality of studies that have examined the measurement properties of these instruments and offers ratings of the reported properties. These results will be useful to clinicians and researchers with an interest in a phenomenon of considerable relevance to advanced patients.

Assessment of the wish to hasten death in patients with advanced disease: A systematic review of measurement instruments

PubMed Central

Bellido-Pérez, Mercedes; Monforte-Royo, Cristina; Tomás-Sábado, Joaquín; Porta-Sales, Josep; Balaguer, Albert

2016-01-01

Background: Patients with advanced conditions may present a wish to hasten death. Assessing this wish is complex due to the nature of the phenomenon and the difficulty of conceptualising it. Aim: To identify and analyse existing instruments for assessing the wish to hasten death and to rate their reported psychometric properties. Design: Systematic review based on PRISMA guidelines. The COnsensus-based Standards for the selection of health Measurement INstruments checklist was used to evaluate the methodological quality of validation studies and the measurement properties of the instrument described. Data sources: The CINAHL, PsycINFO, Pubmed and Web of Science databases were searched from inception to November 2015. Results: A total of 50 articles involving assessment of the wish to hasten death were included. Eight concerned instrument validation and were evaluated using COnsensus-based Standards for the selection of health Measurement INstruments criteria. They reported data for between two and seven measurement properties, with ratings between fair and excellent. Of the seven instruments identified, the Desire for Death Rating Scale or the Schedule of Attitudes toward Hastened Death feature in 48 of the 50 articles. The Schedule of Attitudes toward Hastened Death is the most widely used and is the instrument whose psychometric properties have been most often analysed. Versions of the Schedule of Attitudes toward Hastened Death are available in five languages other than the original English. Conclusion: This systematic review has analysed existing instruments for assessing the wish to hasten death. It has also explored the methodological quality of studies that have examined the measurement properties of these instruments and offers ratings of the reported properties. These results will be useful to clinicians and researchers with an interest in a phenomenon of considerable relevance to advanced patients. PMID:28124578

Photons Revisited

NASA Astrophysics Data System (ADS)

Batic, Matej; Begalli, Marcia; Han, Min Cheol; Hauf, Steffen; Hoff, Gabriela; Kim, Chan Hyeong; Kim, Han Sung; Grazia Pia, Maria; Saracco, Paolo; Weidenspointner, Georg

2014-06-01

A systematic review of methods and data for the Monte Carlo simulation of photon interactions is in progress: it concerns a wide set of theoretical modeling approaches and data libraries available for this purpose. Models and data libraries are assessed quantitatively with respect to an extensive collection of experimental measurements documented in the literature to determine their accuracy; this evaluation exploits rigorous statistical analysis methods. The computational performance of the associated modeling algorithms is evaluated as well. An overview of the assessment of photon interaction models and results of the experimental validation are presented.

Assessing Risk/Benefit for Trials Using Preclinical Evidence: A Proposal

PubMed Central

Kimmelman, Jonathan; Henderson, Valerie C.

2015-01-01

Abstract Moral evaluation of risk/benefit in early phase studies requires assessing the clinical promise of a candidate intervention using preclinical evidence. Yet there is little to guide ethics committees, investigators, sponsors or other stakeholders morally charged with making these assessments (“evaluators”). In what follows, we draw on published guidelines for preclinical study design to develop a structured process for assessing the clinical promise of new interventions. In the first step, evaluators gather all relevant preclinical studies, assess the magnitude of treatment effects, and determine clinical promise in light of various threats to valid clinical inference. In the second step, evaluators adjust assessments of clinical promise from preclinical studies by examining how other agents in the same reference class-and supported by similar evidence- have fared in clinical development. Assessments of clinical promise can then be fed into moral evaluation of risk and benefit in early phase trials. Though our approach has limitations, it offers a systematic and transparent method for assessing risk/benefit in early phase trials of novel interventions. PMID:26463620

Oral health promotion reduces plaque and gingival bleeding in the short term.

PubMed

Hausen, Hannu

2005-01-01

Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, Health Technology Assessment Database, UK National Health Service Economic Evaluation Database, Cochrane Central Register of Controlled Trials and Medline. There were no date limits or language restriction. Systematic reviews and controlled trials (randomised or quasi-randomised) assessing reductions in dental plaque levels and/or gingival bleeding (gingivitis) and comparing health education/health promotion interventions that did not involve clinical professional input or the use of pharmacological interventions, such as antiplaque agents were included. Studies involving only special groups, such as orthodontic or medically compromised patients or assessing only denture plaque, were excluded. A range of data were extracted from systematic reviews and trials, quality assessment was undertaken, and a qualitative overview of the findings was provided. Twenty-six potentially relevant studies were identified. Six reports of five systematic reviews and 13 trials were discussed: four studies were not assessed as one was published in Polish and three could not be located.A wide range of educational and behavioural interventions were considered. These did not generally include clinical interventions and social or environmental approaches. The reviews have a number of limitations so their conclusions should be viewed with a degree of caution. However, the majority of studies achieved short-term reductions in plaque and gingival bleeding. Precise estimates of the improvement are difficult to assess because of the range and diversity of outcome measures used. The results of two meta-analyses indicate a reduction in plaque levels of 32-37%. Of 13 recently published trials evaluating educational interventions, five were set in schools, four focused on adults either in a clinical or workplace setting, three targeted older people, and one, infants. The design quality of the trials was variable. Allocation concealment was clearly described in two trials only, but blind outcome assessment was described in most of the trials and so were dropout rates. Other problems included a lack of controls, use of single blinding and relatively short follow-up. Positive effects on plaque and/or bleeding outcomes were seen in eight studies with no difference in five studies, of which only two employed a control group. Nevertheless, for the two trials that compared various approaches, reductions in plaque and gingival bleeding were generally observed in all groups over the trial period. None of the studies produced a negative effect. Although all the studies evaluated educational interventions, there was no clear indication that any particular type or style of educational approach was more effective than any other. Reductions in plaque and gingival bleeding were seen in the short term in the majority of studies reviewed. The clinical and public health significance of these changes is, however, questionable. Future studies should use longer follow-up periods to assess whether short-term beneficial changes are sustained. Other forms of oral health promotion require better quality evaluation if they are to be used to improve periodontal health.

A systematic review of factors affecting driving and public transportation among youth and young adults with acquired brain injury.

PubMed

Lindsay, Sally; Stoica, Andrei

2017-01-01

Although many people with an acquired brain injury (ABI) encounter difficulties with executive functioning and memory which could negatively affect driving, few people are assessed for fitness to drive after injury. The purpose of this systematic review was to synthesize the literature on factors affecting driving and public transportation among youth and young adults with ABI, post injury. Seven databases were systematically searched for articles from 1980 to 2016. Studies were screened independently by two researchers who performed the data extraction. Study quality was appraised using the Standard Quality Assessment Criteria (Kmet) for evaluating primary research from a variety of fields. Of the 6577 studies identified in the search, 25 met the inclusion criteria, which involved 1527 participants with ABI (mean age = 25.1) across eight countries. Six studies focused on driving assessment and fitness to drive, ten on driving performance or risk of accidents and nine studies explored issues related to accessing or navigating public transportation. Quality assessment of the included studies ranged from 0.60 to 0.95. Our findings highlight several gaps in clinical practice and research along with a critical need for enhanced fitness to drive assessments and transportation-related training for young people with ABI.

Health technology assessment. Evaluation of biomedical innovative technologies.

PubMed

Turchetti, Giuseppe; Spadoni, Enza; Geisler, Eliezer Elie

2010-01-01

This article describes health technology assessment (HTA) as an evaluation tool that applies systematic methods of inquiry to the generation and use of health technologies and new products. The focus of this article is on the contributions of HTA to the management of the new product development effort in the biomedical organization. Critical success factors (CSFs) are listed, and their role in assessing success is defined and explained. One of the conclusions of this article is that HTA is a powerful tool for managers in the biomedical sector, allowing them to better manage their innovation effort in their continuing struggle for competitiveness and survival.

Economic evaluation of drug abuse treatment and HIV prevention programs in pregnant women: a systematic review.

PubMed

Ruger, Jennifer Prah; Lazar, Christina M

2012-01-01

Drug abuse and transmission of HIV during pregnancy are public health problems that adversely affect pregnant women, their children and surrounding communities. Programs that address this vulnerable population have the ability to be cost-effective due to resulting cost savings for mother, child and society. Economic evaluations of programs that address these issues are an important tool to better understand the costs of services and create sustainable healthcare systems. This study critically examined economic evaluations of drug abuse treatment and HIV prevention programs in pregnant women. A systematic review was conducted using the criteria recommended by the Panel on Cost-Effectiveness in Health and Medicine and the British Medical Journal (BMJ) checklist for economic evaluations. The search identified 6 economic studies assessing drug abuse treatment for pregnant women, and 12 economic studies assessing programs that focus on prevention of mother-to-child transmission (PMTCT) of HIV. Results show that many programs for drug abuse treatment and PMTCT among pregnant women are cost-effective or even cost-saving. This study identified several shortcomings in methodology and lack of standardization of current economic evaluations. Efforts to address methodological challenges will help make future studies more comparable and have more influence on policy makers, clinicians and the public. Copyright © 2011 Elsevier Ltd. All rights reserved.

A systematic review of health economic evaluation in adjuvant breast radiotherapy: Quality counted by numbers.

PubMed

Monten, Chris; Veldeman, Liv; Verhaeghe, Nick; Lievens, Yolande

2017-11-01

Evolving practice in adjuvant breast radiotherapy inevitably impacts healthcare budgets. This is reflected in a rise of health economic evaluations (HEE) in this domain. The available HEE literature was analysed qualitatively and quantitatively, using available instruments. HEEs published between 1/1/2000 and 31/10/2016 were retrieved through a systematic search in Medline, Cochrane and Embase. A quality-assessment using CHEERS (Consolidated Health Economic Evaluation Reporting Standards) was translated into a quantitative score and compared with Tufts Medical Centre CEA registry and Quality of Health Economic Studies (QHES) results. Twenty cost-effectiveness analyses (CEA) and thirteen cost comparisons (CC) were analysed. In qualitative evaluation, valuation or justification of data sources, population heterogeneity and discussion on generalizability, in addition to declaration on funding, were often absent or incomplete. After quantification, the average CHEERS-scores were 74% (CI 66.9-81.1%) and 75.6% (CI 70.7-80.5%) for CEAs and CCs respectively. CEA-scores did not differ significantly from Tufts and QHES-scores. Quantitative CHEERS evaluation is feasible and yields comparable results to validated instruments. HEE in adjuvant breast radiotherapy is of acceptable quality, however, further efforts are needed to improve comprehensive reporting of all data, indispensable for assessing relevance, reliability and generalizability of results. Copyright © 2017 Elsevier B.V. All rights reserved.

A Systematic Review of Tools Used to Assess Team Leadership in Health Care Action Teams.

PubMed

Rosenman, Elizabeth D; Ilgen, Jonathan S; Shandro, Jamie R; Harper, Amy L; Fernandez, Rosemarie

2015-10-01

To summarize the characteristics of tools used to assess leadership in health care action (HCA) teams. HCA teams are interdisciplinary teams performing complex, critical tasks under high-pressure conditions. The authors conducted a systematic review of the PubMed/MEDLINE, CINAHL, ERIC, EMBASE, PsycINFO, and Web of Science databases, key journals, and review articles published through March 2012 for English-language articles that applied leadership assessment tools to HCA teams in all specialties. Pairs of reviewers assessed identified articles for inclusion and exclusion criteria and abstracted data on study characteristics, tool characteristics, and validity evidence. Of the 9,913 abstracts screened, 83 studies were included. They described 61 team leadership assessment tools. Forty-nine tools (80%) provided behaviors, skills, or characteristics to define leadership. Forty-four tools (72%) assessed leadership as one component of a larger assessment, 13 tools (21%) identified leadership as the primary focus of the assessment, and 4 (7%) assessed leadership style. Fifty-three studies (64%) assessed leadership at the team level; 29 (35%) did so at the individual level. Assessments of simulated (n = 55) and live (n = 30) patient care events were performed. Validity evidence included content validity (n = 75), internal structure (n = 61), relationship to other variables (n = 44), and response process (n = 15). Leadership assessment tools applied to HCA teams are heterogeneous in content and application. Comparisons between tools are limited by study variability. A systematic approach to team leadership tool development, evaluation, and implementation will strengthen understanding of this important competency.

The current state of cancer family history collection tools in primary care: a systematic review.

PubMed

Qureshi, Nadeem; Carroll, June C; Wilson, Brenda; Santaguida, Pasqualina; Allanson, Judith; Brouwers, Melissa; Raina, Parminder

2009-07-01

Systematic collection of family history is a prerequisite for identifying genetic risk. This study reviewed tools applicable to the primary care assessment of family history of breast, colorectal, ovarian, and prostate cancer. MEDLINE, EMBASE, CINAHL, and Cochrane Central were searched for publications. All primary study designs were included. Characteristics of the studies, the family history collection tools, and the setting were evaluated. Of 40 eligible studies, 18 relevant family history tools were identified, with 11 developed for use in primary care. Most collected information on more than one cancer and on affected relatives used self-administered questionnaires and paper-based formats. Eleven tools had been evaluated relative to current practice, demonstrating 46-78% improvement in data recording over family history recording in patient charts and 75-100% agreement with structured genetic interviews. Few tools have been developed specifically for primary care settings. The few that have been evaluated performed well. The very limited evidence, which depends in part on extrapolation from studies in settings other than primary care, suggests that systematic tools may add significant family health information compared with current primary care practice. The effect of their use on health outcomes has not been evaluated.

The evaluation of family functioning by the family assessment device: a systematic review of studies in adult clinical populations.

PubMed

Staccini, Laura; Tomba, Elena; Grandi, Silvana; Keitner, Gabor I

2015-03-01

A large body of research, documenting the impact of a family's functioning on health outcomes, highlights the importance of introducing the evaluation of patients' family dynamics into clinical judgment. The Family Assessment Device (FAD) is a self-report questionnaire designed to assess specific dimensions of family functioning. This qualitative systematic review, which follows PRISMA guidelines, aimed to identify the FAD's clinimetric properties and to report the incremental utility of its inclusion in clinical settings. A thorough literature search was performed, using both computerized and manual searches, yielding a total of 148 studies that were included in this review. The FAD has been extensively used in a variety of research contexts. In the majority of studies it was able to discriminate between clinical populations and controls and among groups of patients with different illnesses. The FAD also showed good test-retest and concurrent reliability, and modest sensitivity to change after treatment. FAD-dysfunctional family functioning was related to several patient clinical outcomes, including lower recovery rates and adherence to treatment, longer recovery time, poorer quality of life, and increased risk of relapse and drop-out. The present review demonstrates that the FAD is a suitable instrument for the evaluation of family functioning both in clinical and research settings. © 2014 Family Process Institute.

A systematic review of substance misuse assessment packages.

PubMed

Sweetman, Jennifer; Raistrick, Duncan; Mdege, Noreen D; Crosby, Helen

2013-07-01

Health-care systems globally are moving away from process measures of performance to payments for outcomes achieved. It follows that there is a need for a selection of proven quality tools that are suitable for undertaking comprehensive assessments and outcomes assessments. This review aimed to identify and evaluate existing comprehensive assessment packages. The work is part of a national program in the UK, Collaborations in Leadership of Applied Health Research and Care. Systematic searches were carried out across major databases to identify instruments designed to assess substance misuse. For those instruments identified, searches were carried out using the Cochrane Library, Embase, Ovid MEDLINE(®) and PsychINFO to identify articles reporting psychometric data. From 595 instruments, six met the inclusion criteria: Addiction Severity Index; Chemical Use, Abuse and Dependence Scale; Form 90; Maudsley Addiction Profile; Measurements in the Addictions for Triage and Evaluation; and Substance Abuse Outcomes Module. The most common reasons for exclusion were that instruments were: (i) designed for a specific substance (239); (ii) not designed for use in addiction settings (136); (iii) not providing comprehensive assessment (89); and (iv) not suitable as an outcome measure (20). The six packages are very different and suited to different uses. No package had adequate evaluation of their properties and so the emphasis should be on refining a small number of tools with very general application rather than creating new ones. An alternative to using 'off-the-shelf' packages is to create bespoke packages from well-validated, single-construct scales. [ © 2013 Australasian Professional Society on Alcohol and other Drugs.

Intra- and interobserver reliability of the Eaton classification for trapeziometacarpal arthritis: a systematic review.

PubMed

Berger, Aaron J; Momeni, Arash; Ladd, Amy L

2014-04-01

Trapeziometacarpal, or thumb carpometacarpal (CMC), arthritis is a common problem with a variety of treatment options. Although widely used, the Eaton radiographic staging system for CMC arthritis is of questionable clinical utility, as disease severity does not predictably correlate with symptoms or treatment recommendations. A possible reason for this is that the classification itself may not be reliable, but the literature on this has not, to our knowledge, been systematically reviewed. We therefore performed a systematic review to determine the intra- and interobserver reliability of the Eaton staging system. We systematically reviewed English-language studies published between 1973 and 2013 to assess the degree of intra- and interobserver reliability of the Eaton classification for determining the stage of trapeziometacarpal joint arthritis and pantrapezial arthritis based on plain radiographic imaging. Search engines included: PubMed, Scopus(®), and CINAHL. Four studies, which included a total of 163 patients, met our inclusion criteria and were evaluated. The level of evidence of the studies included in this analysis was determined using the Oxford Centre for Evidence Based Medicine Levels of Evidence Classification by two independent observers. A limited number of studies have been performed to assess intra- and interobserver reliability of the Eaton classification system. The four studies included were determined to be Level 3b. These studies collectively indicate that the Eaton classification demonstrates poor to fair interobserver reliability (kappa values: 0.11-0.56) and fair to moderate intraobserver reliability (kappa values: 0.54-0.657). Review of the literature demonstrates that radiographs assist in the assessment of CMC joint disease, but there is not a reliable system for classification of disease severity. Currently, diagnosis and treatment of thumb CMC arthritis are based on the surgeon's qualitative assessment combining history, physical examination, and radiographic evaluation. Inconsistent agreement using the current common radiographic classification system suggests a need for better radiographic tools to quantify disease severity.

Cost effective interventions for the prevention of cardiovascular disease in low and middle income countries: a systematic review.

PubMed

Shroufi, Amir; Chowdhury, Rajiv; Anchala, Raghupathy; Stevens, Sarah; Blanco, Patricia; Han, Tha; Niessen, Louis; Franco, Oscar H

2013-03-28

While there is good evidence to show that behavioural and lifestyle interventions can reduce cardiovascular disease risk factors in affluent settings, less evidence exists in lower income settings.This study systematically assesses the evidence on cost-effectiveness for preventive cardiovascular interventions in low and middle-income settings. Systematic review of economic evaluations on interventions for prevention of cardiovascular disease. PubMed, Web of Knowledge, Scopus and Embase, Opensigle, the Cochrane database, Business Source Complete, the NHS Economic Evaluations Database, reference lists and email contact with experts. we included economic evaluations conducted in adults, reporting the effect of interventions to prevent cardiovascular disease in low and middle income countries as defined by the World Bank. The primary outcome was a change in cardiovascular disease occurrence including coronary heart disease, heart failure and stroke. After selection of the studies, data were extracted by two independent investigators using a previously constructed tool and quality was evaluated using Drummond's quality assessment score. From 9731 search results we found 16 studies, which presented economic outcomes for interventions to prevent cardiovascular disease in low and middle income settings, with most of these reporting positive cost effectiveness results.When the same interventions were evaluated across settings, within and between papers, the likelihood of an intervention being judged cost effective was generally lower in regions with lowest gross national income. While population based interventions were in most cases more cost effective, cost effectiveness estimates for individual pharmacological interventions were overall based upon a stronger evidence base. While more studies of cardiovascular preventive interventions are needed in low and mid income settings, the available high-level of evidence supports a wide range of interventions for the prevention of cardiovascular disease as being cost effective across all world regions.

A review of systematic reviews of the cost-effectiveness of hormone therapy, chemotherapy, and targeted therapy for breast cancer

PubMed Central

Diaby, Vakaramoko; Xiao, Hong; Montero, Alberto J.

2015-01-01

Breast cancer is a global health concern. In fact, breast cancer is the primary cause of death among women worldwide and constitutes the most expensive malignancy to treat. As health care resources are finite, decisions regarding the adoption and coverage of breast cancer treatments are increasingly being based on “value for money,” i.e., cost-effectiveness. As the evidence about the cost-effectiveness of breast cancer treatments is abundant, therefore difficult to navigate, systematic reviews of published systematic reviews offer the advantage of bringing together the results of separate systematic reviews in a single report. As a consequence, this paper presents an overview of systematic reviews of the cost-effectiveness of hormone therapy, chemotherapy, and targeted therapy for breast cancer to inform policy and reimbursement decision-making. A systematic review was conducted of published systematic reviews documenting cost-effectiveness analyses of breast cancer treatments from 2000 to 2014. Systematic reviews identified through a literature search of health and economic databases were independently assessed against inclusion and exclusion criteria. Systematic reviews of original evaluations were included only if they targeted breast cancer patients and specific breast cancer treatments (hormone therapy, chemotherapy, and targeted therapy only), documented incremental cost-effectiveness ratios, and were reported in the English language. The search strategy used a combination of these key words: “breast cancer,” “systematic review/meta-analysis,” and “cost-effectiveness/economics.” Data were extracted using predefined extraction forms and qualitatively appraised using the assessment of multiple systematic reviews (AMSTAR) tool. The literature search resulted in 511 bibliographic records, of which ten met our inclusion criteria. Five reviews were conducted in the early-stage breast cancer setting and five reviews in the metastatic setting. In early-stage breast cancer, evidence about trastuzumab value differed by age. Trastuzumab was cost-effective only in women with HER2-positive breast cancer younger than 65 years and over a life-time horizon. The cost-effectiveness of trastuzumab in HER2-positive metastatic breast cancer yielded conflicting results. The same conclusions were reached in comparisons between vinorelbine and taxanes. In both early stage and advanced/metastatic breast cancer, newer aromatase inhibitors (AIs) have proved cost-effective compared to older treatments. This overview of systematic reviews shows that there is heterogeneity in the evidence concerning the cost-effectiveness of hormone therapy, chemotherapy, and targeted therapy for breast cancer. The cost-effectiveness of these treatments depends not only on the comparators but the context, i.e., adjuvant or metastatic setting, subtype of patient population, and perspective adopted. Decisions involving the cost-effectiveness of breast cancer treatments could be made easier and more transparent by better harmonizing the reporting of economic evaluations assessing the value of these treatments. PMID:25893588

Ovarian cancer in Lynch syndrome; a systematic review.

PubMed

Helder-Woolderink, J M; Blok, E A; Vasen, H F A; Hollema, H; Mourits, M J; De Bock, G H

2016-03-01

The aim was to systematically review the characteristics of ovarian cancer in women with Lynch syndrome (LS) and evaluate the role of surveillance in detection of ovarian cancer in LS. All studies between 1979 and 2015 of women with ovarian cancer and LS or at 50% risk of LS were evaluated. Two reviewers independently evaluated eligible studies and extracted data on age at diagnosis, histological type, FIGO stage, and way of detection according to pre-specified criteria. The studies were assessed for quality using the Newcastle-Ottawa quality assessment scales. The quality score of the 49 identified studies was at least 6 out of 8 and provide clinical information on 747 LS women with ovarian cancer. The mean age at diagnosis was 45.3 (range 19-82) years. Most frequent mutations were MSH2 (47%) and MLH1 (38%). Histopathological data were available for 445 women. The most frequently reported histological type was mixed type (mucinous/endometrioid/clear cell carcinomas) (n = 136; 31%). Most tumours (281, 65%) were diagnosed at an early stage (FIGO I/II). Six studies evaluating the effect of surveillance of ovarian cancer, reported that seven of 22 (32%) ovarian cancers were found during surveillance, 6/7 (86%) were detected at an early stage. This systematic review describes that ovarian cancer in women with LS has a wide age-range of onset, is often diagnosed at an early stage with frequently endometrioid/clear cell histology. Data about the role of surveillance in detection of ovarian cancer in women with LS are scarce however detection at an early stage seems possible. Copyright © 2015 Elsevier Ltd. All rights reserved.

Child-Report Measures of Occupational Performance: A Systematic Review

PubMed Central

Totino, Rebekah; Doma, Kenji; Leicht, Anthony; Brown, Nicole; Cuomo, Belinda

2016-01-01

Introduction Improving occupational performance is a key service of occupational therapists and client-centred approach to care is central to clinical practice. As such it is important to comprehensively evaluate the quality of psychometric properties reported across measures of occupational performance; in order to guide assessment and treatment planning. Objective To systematically review the literature on the psychometric properties of child-report measures of occupational performance for children ages 2–18 years. Methods A systematic search of the following six electronic databases was conducted: CINAHL; PsycINFO; EMBASE; PubMed; the Health and Psychosocial Instruments (HAPI) database; and Google Scholar. The quality of the studies was evaluated against the COSMIN taxonomy of measurement properties and the overall quality of psychometric properties was evaluated using pre-set psychometric criteria. Results Fifteen articles and one manual were reviewed to assess the psychometric properties of the six measures–the PEGS, MMD, CAPE, PAC, COSA, and OSA- which met the inclusion criteria. Most of the measures had conducted good quality studies to evaluate the psychometric properties of measures (PEGS, CAPE, PAC, OSA); however, the quality of the studies for two of these measures was relatively weak (MMD, COSA). When integrating the quality of the psychometric properties of the measures with the quality of the studies, the PAC stood out as having superior psychometric qualities. Conclusions The overall quality of the psychometric properties of most measures was limited. There is a need for continuing research into the psychometric properties of child-report measures of occupational performance, and to revise and improve the psychometric properties of existing measures. PMID:26808674

A Systematic Review of Cardiovascular Outcomes-Based Cost-Effectiveness Analyses of Lipid-Lowering Therapies.

PubMed

Wei, Ching-Yun; Quek, Ruben G W; Villa, Guillermo; Gandra, Shravanthi R; Forbes, Carol A; Ryder, Steve; Armstrong, Nigel; Deshpande, Sohan; Duffy, Steven; Kleijnen, Jos; Lindgren, Peter

2017-03-01

Previous reviews have evaluated economic analyses of lipid-lowering therapies using lipid levels as surrogate markers for cardiovascular disease. However, drug approval and health technology assessment agencies have stressed that surrogates should only be used in the absence of clinical endpoints. The aim of this systematic review was to identify and summarise the methodologies, weaknesses and strengths of economic models based on atherosclerotic cardiovascular disease event rates. Cost-effectiveness evaluations of lipid-lowering therapies using cardiovascular event rates in adults with hyperlipidaemia were sought in Medline, Embase, Medline In-Process, PubMed and NHS EED and conference proceedings. Search results were independently screened, extracted and quality checked by two reviewers. Searches until February 2016 retrieved 3443 records, from which 26 studies (29 publications) were selected. Twenty-two studies evaluated secondary prevention (four also assessed primary prevention), two considered only primary prevention and two included mixed primary and secondary prevention populations. Most studies (18) based treatment-effect estimates on single trials, although more recent evaluations deployed meta-analyses (5/10 over the last 10 years). Markov models (14 studies) were most commonly used and only one study employed discrete event simulation. Models varied particularly in terms of health states and treatment-effect duration. No studies used a systematic review to obtain utilities. Most studies took a healthcare perspective (21/26) and sourced resource use from key trials instead of local data. Overall, reporting quality was suboptimal. This review reveals methodological changes over time, but reporting weaknesses remain, particularly with respect to transparency of model reporting.

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

PubMed

Fransen, Annemarie F; de Boer, Liza; Kienhorst, Dieneke; Truijens, Sophie E; van Runnard Heimel, Pieter J; Oei, S Guid

2017-09-01

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability. Copyright © 2017. Published by Elsevier B.V.

Assessing the Quality of Economic Evaluations of FDA Novel Drug Approvals: A Systematic Review.

PubMed

Woersching, Alex L; Borrego, Matthew E; Raisch, Dennis W

2016-12-01

To systematically review and assess the quality of the novel drugs' economic evaluation literature in print during the drugs' early commercial availability following US regulatory approval. MEDLINE and the United Kingdom National Health Service Economic Evaluation Database were searched from 1946 through December 2011 for economic evaluations of the 50 novel drugs approved by the FDA in 2008 and 2009. The inclusion criteria were English-language, peer-reviewed, original economic evaluations (cost-utility, cost-effectiveness, cost-minimization, and cost-benefit analyses). We extracted and analyzed data from 36 articles considering 19 of the 50 drugs. Two reviewers assessed each publication's quality using the Quality of Health Economic Studies (QHES) instrument and summarized study quality on a 100-point scale. Study quality had a mean of 70.0 ± 16.2 QHES points. The only study characteristics associated with QHES score (with P < 0.05) were having used modeling or advanced statistics, 75.1 versus 61.9 without; using quality-adjusted life years as an outcome, 75.9 versus 64.7 without; and cost-utility versus cost-minimization analysis, 75.9 versus 58.7. Studies most often satisfied quality aspects about stating study design choices and least often satisfied aspects about justifying design choices. The reviewed literature considered a minority of the 2008-2009 novel drugs and had mixed study quality. Cost-effectiveness stakeholders might benefit from efforts to improve the quality and quantity of literature examining novel drugs. Editors and reviewers may support quality improvement by stringently imposing economic evaluation guidelines about justifying study design choices. © The Author(s) 2016.

Building work engagement: A systematic review and meta‐analysis investigating the effectiveness of work engagement interventions

PubMed Central

Patterson, Malcolm; Dawson, Jeremy

2016-01-01

Summary Low work engagement may contribute towards decreased well‐being and work performance. Evaluating, boosting and sustaining work engagement are therefore of interest to many organisations. However, the evidence on which to base interventions has not yet been synthesised. A systematic review with meta‐analysis was conducted to assess the evidence for the effectiveness of work engagement interventions. A systematic literature search identified controlled workplace interventions employing a validated measure of work engagement. Most used the Utrecht Work Engagement Scale (UWES). Studies containing the relevant quantitative data underwent random‐effects meta‐analyses. Results were assessed for homogeneity, systematic sampling error, publication bias and quality. Twenty studies met the inclusion criteria and were categorised into four types of interventions: (i) personal resource building; (ii) job resource building; (iii) leadership training; and (iv) health promotion. The overall effect on work engagement was small, but positive, k = 14, Hedges g = 0.29, 95%‐CI = 0.12–0.46. Moderator analyses revealed a significant result for intervention style, with a medium to large effect for group interventions. Heterogeneity between the studies was high, and the success of implementation varied. More studies are needed, and researchers are encouraged to collaborate closely with organisations to design interventions appropriate to individual contexts and settings, and include evaluations of intervention implementation. © 2016 The Authors. Journal of Organizational Behavior published by John Wiley & Sons, Ltd. PMID:28781428

Patient Navigation in Breast Cancer Treatment and Survivorship: A Systematic Review.

PubMed

Baik, Sharon H; Gallo, Linda C; Wells, Kristen J

2016-07-25

Patient navigation is an intervention approach that improves cancer outcomes by reducing barriers and facilitating timely access to cancer care. Little is known about the benefits of patient navigation during breast cancer treatment and survivorship. This systematic review evaluates the efficacy of patient navigation in improving treatment and survivorship outcomes in women with breast cancer. The review included experimental and quasi-experimental studies of patient navigation programs that target breast cancer treatment and breast cancer survivorship. Articles were systematically obtained through electronic database searches of PubMed/MEDLINE, PsycINFO, Web of Science, CINAHL, and Cochrane Library. The Effective Public Health Practice Project Quality Assessment Tool was used to evaluate the methodologic quality of individual studies. Thirteen studies met the inclusion criteria. Most were of moderate to high quality. Outcomes targeted included timeliness of treatment initiation, adherence to cancer treatment, and adherence to post-treatment surveillance mammography. Heterogeneity of outcome assessments precluded a meta-analysis. Overall, results demonstrated that patient navigation increases surveillance mammography rates, but only minimal evidence was found with regard to its effectiveness in improving breast cancer treatment outcomes. This study is the most comprehensive systematic review of patient navigation research focused on improving breast cancer treatment and survivorship. Minimal research has indicated that patient navigation may be effective for post-treatment surveillance; however, more studies are needed to draw definitive conclusions about the efficacy of patient navigation during and after cancer treatment. © 2016 by American Society of Clinical Oncology.

Patient Navigation in Breast Cancer Treatment and Survivorship: A Systematic Review

PubMed Central

Baik, Sharon H.; Gallo, Linda C.

2016-01-01

Purpose Patient navigation is an intervention approach that improves cancer outcomes by reducing barriers and facilitating timely access to cancer care. Little is known about the benefits of patient navigation during breast cancer treatment and survivorship. This systematic review evaluates the efficacy of patient navigation in improving treatment and survivorship outcomes in women with breast cancer. Methods The review included experimental and quasi-experimental studies of patient navigation programs that target breast cancer treatment and breast cancer survivorship. Articles were systematically obtained through electronic database searches of PubMed/MEDLINE, PsycINFO, Web of Science, CINAHL, and Cochrane Library. The Effective Public Health Practice Project Quality Assessment Tool was used to evaluate the methodologic quality of individual studies. Results Thirteen studies met the inclusion criteria. Most were of moderate to high quality. Outcomes targeted included timeliness of treatment initiation, adherence to cancer treatment, and adherence to post-treatment surveillance mammography. Heterogeneity of outcome assessments precluded a meta-analysis. Overall, results demonstrated that patient navigation increases surveillance mammography rates, but only minimal evidence was found with regard to its effectiveness in improving breast cancer treatment outcomes. Conclusion This study is the most comprehensive systematic review of patient navigation research focused on improving breast cancer treatment and survivorship. Minimal research has indicated that patient navigation may be effective for post-treatment surveillance; however, more studies are needed to draw definitive conclusions about the efficacy of patient navigation during and after cancer treatment. PMID:27458298

Measuring HIV-related stigma among healthcare providers: a systematic review.

PubMed

Alexandra Marshall, S; Brewington, Krista M; Kathryn Allison, M; Haynes, Tiffany F; Zaller, Nickolas D

2017-11-01

In the United States, HIV-related stigma in the healthcare setting is known to affect the utilization of prevention and treatment services. Multiple HIV/AIDS stigma scales have been developed to assess the attitudes and behaviors of the general population in the U.S. towards people living with HIV/AIDS, but fewer scales have been developed to assess HIV-related stigma among healthcare providers. This systematic review aimed to identify and evaluate the measurement tools used to assess HIV stigma among healthcare providers in the U.S. The five studies selected quantitatively assessed the perceived HIV stigma among healthcare providers from the patient or provider perspective, included HIV stigma as a primary outcome, and were conducted in the U.S. These five studies used adapted forms of four HIV stigma scales. No standardized measure was identified. Assessment of HIV stigma among providers is valuable to better understand how this phenomenon may impact health outcomes and to inform interventions aiming to improve healthcare delivery and utilization.

Instruments to assess the perception of physicians in the decision-making process of specific clinical encounters: a systematic review

PubMed Central

Légaré, France; Moher, David; Elwyn, Glyn; LeBlanc, Annie; Gravel, Karine

2007-01-01

Background The measurement of processes and outcomes that reflect the complexity of the decision-making process within specific clinical encounters is an important area of research to pursue. A systematic review was conducted to identify instruments that assess the perception physicians have of the decision-making process within specific clinical encounters. Methods For every year available up until April 2007, PubMed, PsycINFO, Current Contents, Dissertation Abstracts and Sociological Abstracts were searched for original studies in English or French. Reference lists from retrieved studies were also consulted. Studies were included if they reported a self-administered instrument evaluating physicians' perceptions of the decision-making process within specific clinical encounters, contained sufficient description to permit critical appraisal and presented quantitative results based on administering the instrument. Two individuals independently assessed the eligibility of the instruments and abstracted information on their conceptual underpinnings, main evaluation domain, development, format, reliability, validity and responsiveness. They also assessed the quality of the studies that reported on the development of the instruments with a modified version of STARD. Results Out of 3431 records identified and screened for evaluation, 26 potentially relevant instruments were assessed; 11 met the inclusion criteria. Five instruments were published before 1995. Among those published after 1995, five offered a corresponding patient version. Overall, the main evaluation domains were: satisfaction with the clinical encounter (n = 2), mutual understanding between health professional and patient (n = 2), mental workload (n = 1), frustration with the clinical encounter (n = 1), nurse-physician collaboration (n = 1), perceptions of communication competence (n = 2), degree of comfort with a decision (n = 1) and information on medication (n = 1). For most instruments (n = 10), some reliability and validity criteria were reported in French or English. Overall, the mean number of items on the modified version of STARD was 12.4 (range: 2 to 18). Conclusion This systematic review provides a critical appraisal and repository of instruments that assess the perception physicians have of the decision-making process within specific clinical encounters. More research is needed to pursue the validation of the existing instruments and the development of patient versions. This will help researchers capture the complexity of the decision-making process within specific clinical encounters. PMID:17937801

A Corpus-Driven Design of a Test for Assessing the ESL Collocational Competence of University Students

ERIC Educational Resources Information Center

Jaen, Maria Moreno

2007-01-01

This paper reports an assessment of the collocational competence of students of English Linguistics at the University of Granada. This was carried out to meet a two-fold purpose. On the one hand, we aimed to establish a solid corpus-driven approach based upon a systematic and reliable framework for the evaluation of collocational competence in…

Cervical screening programmes: can automation help? Evidence from systematic reviews, an economic analysis and a simulation modelling exercise applied to the UK.

PubMed

Willis, B H; Barton, P; Pearmain, P; Bryan, S; Hyde, C

2005-03-01

To assess the effectiveness and cost-effectiveness of adding automated image analysis to cervical screening programmes. Searching of all major electronic databases to the end of 2000 was supplemented by a detailed survey for unpublished UK literature. Four systematic reviews were conducted according to recognised guidance. The review of 'clinical effectiveness' included studies assessing reproducibility and impact on health outcomes and processes in addition to evaluations of test accuracy. A discrete event simulation model was developed, although the economic evaluation ultimately relied on a cost-minimisation analysis. The predominant finding from the systematic reviews was the very limited amount of rigorous primary research. None of the included studies refers to the only commercially available automated image analysis device in 2002, the AutoPap Guided Screening (GS) System. The results of the included studies were debatably most compatible with automated image analysis being equivalent in test performance to manual screening. Concerning process, there was evidence that automation does lead to reductions in average slide processing times. In the PRISMATIC trial this was reduced from 10.4 to 3.9 minutes, a statistically significant and practically important difference. The economic evaluation tentatively suggested that the AutoPap GS System may be efficient. The key proviso is that credible data become available to support that the AutoPap GS System has test performance and processing times equivalent to those obtained for PAPNET. The available evidence is still insufficient to recommend implementation of automated image analysis systems. The priority for action remains further research, particularly the 'clinical effectiveness' of the AutoPap GS System. Assessing the cost-effectiveness of introducing automation alongside other approaches is also a priority.

Methodological Quality Assessment of Meta-Analyses and Systematic Reviews of Probiotics in Inflammatory Bowel Disease and Pouchitis.

PubMed

Dong, Jinpei; Teng, Guigen; Wei, Tiantong; Gao, Wen; Wang, Huahong

2016-01-01

Probiotics are widely used for the induction and maintenance of remission in inflammatory bowel disease (IBD) and pouchitis. There are a large number of meta-analyses (MAs)/ systematic reviews (SRs) on this subject, the methodological quality of which has not been evaluated. This study aimed to evaluate the methodological quality of and summarize the evidence obtained from MAs/SRs of probiotic treatments for IBD and pouchitis patients. The PubMed, EMBASE, Cochrane Library and China National Knowledge Infrastructure (CNKI) databases were searched to identify Chinese and English language MAs/SRs of the use of probiotics for IBD and pouchitis. The Assessment of Multiple Systematic Reviews (AMSTAR) scale was used to assess the methodological quality of the studies. A total of 36 MAs/SRs were evaluated. The AMSTAR scores of the included studies ranged from 1 to 10, and the average score was 5.81. According to the Canadian Agency for Drugs and Technologies in Health, 4 articles were classified as high quality, 24 articles were classified as moderate quality, and 8 articles were classified as low quality. Most of the MAs/SRs suggested that probiotics had potential benefits for patients with ulcerative colitis (UC), but failed to show effectiveness in the induction and maintenance of remission in Crohn's disease (CD). The probiotic preparation VSL#3 may play a beneficial role in pouchitis. The overall methodological quality of the current MAs/SRs in the field of probiotics for IBD and pouchitis was found to be low to moderate. More MAs/SRs of high quality are required to support using probiotics to treat IBD and pouchitis.

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review

PubMed Central

Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Introduction Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. Objective To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. Methods A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. Conclusions The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments. PMID:26151362

Systematic monitoring and evaluation of M7 scanner performance and data quality

NASA Technical Reports Server (NTRS)

Stewart, S.; Christenson, D.; Larsen, L.

1974-01-01

An investigation was conducted to provide the information required to maintain data quality of the Michigan M7 Multispectral scanner by systematic checks on specific system performance characteristics. Data processing techniques which use calibration data gathered routinely every mission have been developed to assess current data quality. Significant changes from past data quality are thus identified and attempts made to discover their causes. Procedures for systematic monitoring of scanner data quality are discussed. In the solar reflective region, calculations of Noise Equivalent Change in Radiance on a permission basis are compared to theoretical tape-recorder limits to provide an estimate of overall scanner performance. M7 signal/noise characteristics are examined.

Integration of care for hypertension and diabetes: a scoping review assessing the evidence from systematic reviews and evaluating reporting.

PubMed

Yiu, Kristy C; Rohwer, Anke; Young, Taryn

2018-06-20

With the rise in pre-mature mortality rate from non-communicable disease (NCD), there is a need for evidence-based interventions. We evaluated existing systematic reviews on effectiveness of integration of healthcare services, in particular with focus on delivery of care designed to improve health and process outcomes in people with multi-morbidity, where at least one of the conditions was diabetes or hypertension. We searched MEDLINE, EMBASE, Cochrane Library, and Health Evidence to November 8, 2016 and consulted experts. One review author screened titles, abstracts and two review authors independently screened short listed full-texts and selected reviews for inclusion. We considered systematic reviews evaluating integration of care, compared to usual care, for people with multi-morbidity. One review author extracted data and another author verified it. Two review authors independently evaluated risk of bias using ROBIS and AMSTAR. Inter-rater reliability was analysed for ROBIS and AMSTAR using Cohen's kappa and percent agreement. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist was used to assess reporting. We identified five systematic reviews on integration of care. Four reviews focused on comorbid diabetes and depression and two covered hypertension and comorbidities of cardiovascular disease, depression, or diabetes. Interventions were poorly described. The health outcomes evaluated included risk of all-cause mortality, measures of depression, cholesterol levels, HbA1c levels, effect of depression on HbA1c levels, symptom improvement, systolic blood pressure, and hypertension control. Process outcomes included access and utilisation of healthcare services, costs, and quality of care. Overall, three reviews had a low and medium risk of bias according to ROBIS and AMSTAR respectively, while two reviews had high risk of bias as judged by both ROBIS and AMSTAR. Findings have demonstrated that collaborative care in general resulted in better health and process outcomes when compared to usual care for both depression and diabetes and hypertension and diabetes. Several knowledge gaps were identified on integration of care for comorbidities with diabetes and/or hypertension: limited research on this topic for hypertension, limited reviews that included primary studies based in low-middle income countries, and limited reviews on collaborative care for communicable and NCDs.

Corporate Entrepreneurship Assessment Instrument (CEAI): Systematic Validation of a Measure

DTIC Science & Technology

2006-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE THESIS...the United States Government. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION...DISTRIBUTION UNLIMITED. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE

The Effect of Technical Performance on Patient Outcomes in Surgery: A Systematic Review.

PubMed

Fecso, Andras B; Szasz, Peter; Kerezov, Georgi; Grantcharov, Teodor P

2017-03-01

Systematic review of the effect of intraoperative technical performance on patient outcomes. The operating room is a high-stakes, high-risk environment. As a result, the quality of surgical interventions affecting patient outcomes has been the subject of discussion and research for years. MEDLINE, EMBASE, PsycINFO, and Cochrane databases were searched. All surgical specialties were eligible for inclusion. Data were reviewed in regards to the methods by which technical performance was measured, what patient outcomes were assessed, and how intraoperative technical performance affected patient outcomes. Quality of evidence was assessed using the Medical Education Research Study Quality Instrument (MERSQI). Of the 12,758 studies initially identified, 24 articles (7775 total participants) were ultimately included in this review. Seventeen studies assessed the performance of the faculty alone, 2 assessed both the faculty and trainees, 1 assessed trainees alone, and in 4 studies, the level of the operating surgeon was not specified. In 18 studies, a performance assessment tool was used. Patient outcomes were evaluated using intraoperative complications, short-term morbidity, long-term morbidity, short-term mortality, and long-term mortality. The average MERSQI score was 11.67 (range 9.5-14.5). Twenty-one studies demonstrated that superior technical performance was related to improved patient outcomes. The results of this systematic review demonstrated that superior technical performance positively affects patient outcomes. Despite this initial evidence, more robust research is needed to directly assess intraoperative technical performance and its effect on postoperative patient outcomes using meaningful assessment instruments and reliable processes.

Radiological Determination of Postoperative Cervical Fusion: A Systematic Review.

PubMed

Rhee, John M; Chapman, Jens R; Norvell, Daniel C; Smith, Justin; Sherry, Ned A; Riew, K Daniel

2015-07-01

Systematic review. To determine best criteria for radiological determination of postoperative subaxial cervical fusion to be applied to current clinical practice and ongoing future research assessing fusion to standardize assessment and improve comparability. Despite availability of multiple imaging modalities and criteria, there remains no method of determining cervical fusion with absolute certainty, nor clear consensus on specific criteria to be applied. A systematic search in MEDLINE/Cochrane Collaboration Library (through March 2014). Included studies assessed C2 to C7 via anterior or posterior approach, at 12 weeks or more postoperative, with any graft or implant. Overall body of evidence with respect to 6 posited key questions was determined using Grading of Recommendations Assessment, Development and Evaluation and Agency for Healthcare Research and Quality precepts. Of plain radiographical modalities, there is moderate evidence that the interspinous process motion method (<1 mm) is more accurate than the Cobb angle method for assessing anterior cervical fusion. Of the advanced imaging modalities, there is moderate evidence that computed tomography (CT) is more accurate and reliable than magnetic resonance imaging in assessing anterior cervical fusion. There is insufficient evidence regarding the optimal modality and criteria for assessing posterior cervical fusions and insufficient evidence to support a single time point after surgery as being optimal for determining fusion, although some evidence suggest that reliability of radiography and CT improves with increasing time postoperatively. We recommend using less than 1-mm motion as the initial modality for determining anterior cervical arthrodesis for both clinical and research applications. If further imaging is needed because of indeterminate radiographical evaluation, we recommend CT, which has relatively high accuracy and reliability, but due to greater radiation exposure and cost, it is not routinely suggested. We recommend that plain radiographs also be the initial method of determining posterior cervical fusion but suggest a lower threshold for obtaining CT scans because dynamic radiographs may not be as useful if spinous processes have been removed by laminectomy. 1.

A systematic review of systematic reviews on interventions for caregivers of people with chronic conditions.

PubMed

Corry, Margarita; While, Alison; Neenan, Kathleen; Smith, Valerie

2015-04-01

To evaluate the effectiveness of interventions to support caregivers of people with selected chronic conditions. Informal caregivers provide millions of care hours each week contributing to significant healthcare savings. Despite much research evaluating a range of interventions for caregivers, their impact remains unclear. A systematic review of systematic reviews of interventions to support caregivers of people with selected chronic conditions. The electronic databases of PubMed, CINAHL, British Nursing Index, PsycINFO, Social Science Index (January 1990-May 2014) and The Cochrane Library (Issue 6, June 2014), were searched using Medical Subject Heading and index term combinations of the keywords caregiver, systematic review, intervention and named chronic conditions. Papers were included if they reported a systematic review of interventions for caregivers of people with chronic conditions. The methodological quality of the included reviews was independently assessed by two reviewers using R-AMSTAR. Data were independently extracted by two reviewers using a pre-designed data extraction form. Narrative synthesis of review findings was used to present the results. Eight systematic reviews were included. There was evidence that education and support programme interventions improved caregiver quality of life. Information-giving interventions improved caregiver knowledge for stroke caregivers. Education, support and information-giving interventions warrant further investigation across caregiver groups. A large-scale funded programme for caregiver research is required to ensure that studies are of high quality to inform service development across settings. © 2014 John Wiley & Sons Ltd.

Association between ambient air pollution and diabetes mellitus in Europe and North America: systematic review and meta-analysis.

PubMed

Eze, Ikenna C; Hemkens, Lars G; Bucher, Heiner C; Hoffmann, Barbara; Schindler, Christian; Künzli, Nino; Schikowski, Tamara; Probst-Hensch, Nicole M

2015-05-01

Air pollution is hypothesized to be a risk factor for diabetes. Epidemiological evidence is inconsistent and has not been systematically evaluated. We systematically reviewed epidemiological evidence on the association between air pollution and diabetes, and synthesized results of studies on type 2 diabetes mellitus (T2DM). We systematically searched electronic literature databases (last search, 29 April 2014) for studies reporting the association between air pollution (particle concentration or traffic exposure) and diabetes (type 1, type 2, or gestational). We systematically evaluated risk of bias and role of potential confounders in all studies. We synthesized reported associations with T2DM in meta-analyses using random-effects models and conducted various sensitivity analyses. We included 13 studies (8 on T2DM, 2 on type 1, 3 on gestational diabetes), all conducted in Europe or North America. Five studies were longitudinal, 5 cross-sectional, 2 case-control, and 1 ecologic. Risk of bias, air pollution assessment, and confounder control varied across studies. Dose-response effects were not reported. Meta-analyses of 3 studies on PM2.5 (particulate matter ≤ 2.5 μm in diameter) and 4 studies on NO2 (nitrogen dioxide) showed increased risk of T2DM by 8-10% per 10-μg/m3 increase in exposure [PM2.5: 1.10 (95% CI: 1.02, 1.18); NO2: 1.08 (95% CI: 1.00, 1.17)]. Associations were stronger in females. Sensitivity analyses showed similar results. Existing evidence indicates a positive association of air pollution and T2DM risk, albeit there is high risk of bias. High-quality studies assessing dose-response effects are needed. Research should be expanded to developing countries where outdoor and indoor air pollution are high.

A Practical Guide to Conducting a Systematic Review and Meta-analysis of Health State Utility Values.

PubMed

Petrou, Stavros; Kwon, Joseph; Madan, Jason

2018-05-10

Economic analysts are increasingly likely to rely on systematic reviews and meta-analyses of health state utility values to inform the parameter inputs of decision-analytic modelling-based economic evaluations. Beyond the context of economic evaluation, evidence from systematic reviews and meta-analyses of health state utility values can be used to inform broader health policy decisions. This paper provides practical guidance on how to conduct a systematic review and meta-analysis of health state utility values. The paper outlines a number of stages in conducting a systematic review, including identifying the appropriate evidence, study selection, data extraction and presentation, and quality and relevance assessment. The paper outlines three broad approaches that can be used to synthesise multiple estimates of health utilities for a given health state or condition, namely fixed-effect meta-analysis, random-effects meta-analysis and mixed-effects meta-regression. Each approach is illustrated by a synthesis of utility values for a hypothetical decision problem, and software code is provided. The paper highlights a number of methodological issues pertinent to the conduct of meta-analysis or meta-regression. These include the importance of limiting synthesis to 'comparable' utility estimates, for example those derived using common utility measurement approaches and sources of valuation; the effects of reliance on limited or poorly reported published data from primary utility assessment studies; the use of aggregate outcomes within analyses; approaches to generating measures of uncertainty; handling of median utility values; challenges surrounding the disentanglement of utility estimates collected serially within the context of prospective observational studies or prospective randomised trials; challenges surrounding the disentanglement of intervention effects; and approaches to measuring model validity. Areas of methodological debate and avenues for future research are highlighted.

Measurement properties of patient reported outcome measures for spondyloarthritis: A systematic review.

PubMed

Png, Kelly; Kwan, Yu Heng; Leung, Ying Ying; Phang, Jie Kie; Lau, Jia Qi; Lim, Ka Keat; Chew, Eng Hui; Low, Lian Leng; Tan, Chuen Seng; Thumboo, Julian; Fong, Warren; Østbye, Truls

2018-03-21

This systematic review aimed to identify studies investigating measurement properties of patient reported outcome measures (PROMs) for spondyloarthritis (SpA), and to evaluate their methodological quality and level of evidence relating to the measurement properties of PROMs. This systematic review was guided by the preferred reporting items for systematic review and meta-analysis (PRISMA). Articles published before 30 June 2017 were retrieved from PubMed ® , Embase ® , and PsychINFO ® (Ovid). Methodological quality and level of evidence were evaluated according to recommendations from the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). We identified 60 unique PROMs from 125 studies in 39 countries. Twenty-one PROMs were validated for two or more SpA subtypes. The literature examined hypothesis testing (82.4%) most frequently followed by reliability (60.0%). A percentage of 77.7% and 42.7% of studies that assessed PROMs for hypothesis testing and reliability, respectively had "fair" or better methodological quality. Among the PROMs identified, 41.7% were studied in ankylosing spondylitis (AS) only and 23.3% were studied in psoriatic arthritis (PsA) only. The more extensively assessed PROMs included the ankylosing spondylitis quality of life (ASQoL) and bath ankylosing spondylitis functional index (BASFI) for ankylosing spondylitis, and the psoriatic arthritis quality of life questionnaire (VITACORA-19) for psoriatic arthritis. This study identified 60 unique PROMs through a systematic review and synthesized evidence of the measurement properties of the PROMs. There is a lack of validation of PROMs for use across SpA subtypes. Future studies may consider validating PROMs for use across different SpA subtypes. Copyright © 2018 Elsevier Inc. All rights reserved.

A proposed framework for the systematic review and integrated assessment (SYRINA) of endocrine disrupting chemicals.

PubMed

Vandenberg, Laura N; Ågerstrand, Marlene; Beronius, Anna; Beausoleil, Claire; Bergman, Åke; Bero, Lisa A; Bornehag, Carl-Gustaf; Boyer, C Scott; Cooper, Glinda S; Cotgreave, Ian; Gee, David; Grandjean, Philippe; Guyton, Kathryn Z; Hass, Ulla; Heindel, Jerrold J; Jobling, Susan; Kidd, Karen A; Kortenkamp, Andreas; Macleod, Malcolm R; Martin, Olwenn V; Norinder, Ulf; Scheringer, Martin; Thayer, Kristina A; Toppari, Jorma; Whaley, Paul; Woodruff, Tracey J; Rudén, Christina

2016-07-14

The issue of endocrine disrupting chemicals (EDCs) is receiving wide attention from both the scientific and regulatory communities. Recent analyses of the EDC literature have been criticized for failing to use transparent and objective approaches to draw conclusions about the strength of evidence linking EDC exposures to adverse health or environmental outcomes. Systematic review methodologies are ideal for addressing this issue as they provide transparent and consistent approaches to study selection and evaluation. Objective methods are needed for integrating the multiple streams of evidence (epidemiology, wildlife, laboratory animal, in vitro, and in silico data) that are relevant in assessing EDCs. We have developed a framework for the systematic review and integrated assessment (SYRINA) of EDC studies. The framework was designed for use with the International Program on Chemical Safety (IPCS) and World Health Organization (WHO) definition of an EDC, which requires appraisal of evidence regarding 1) association between exposure and an adverse effect, 2) association between exposure and endocrine disrupting activity, and 3) a plausible link between the adverse effect and the endocrine disrupting activity. Building from existing methodologies for evaluating and synthesizing evidence, the SYRINA framework includes seven steps: 1) Formulate the problem; 2) Develop the review protocol; 3) Identify relevant evidence; 4) Evaluate evidence from individual studies; 5) Summarize and evaluate each stream of evidence; 6) Integrate evidence across all streams; 7) Draw conclusions, make recommendations, and evaluate uncertainties. The proposed method is tailored to the IPCS/WHO definition of an EDC but offers flexibility for use in the context of other definitions of EDCs. When using the SYRINA framework, the overall objective is to provide the evidence base needed to support decision making, including any action to avoid/minimise potential adverse effects of exposures. This framework allows for the evaluation and synthesis of evidence from multiple evidence streams. Finally, a decision regarding regulatory action is not only dependent on the strength of evidence, but also the consequences of action/inaction, e.g. limited or weak evidence may be sufficient to justify action if consequences are serious or irreversible.

The assessment of creativity in creativity/psychopathology research - a systematic review.

PubMed

Thys, E; Sabbe, B; De Hert, M

2014-01-01

The possible link between creativity and psychopathology has been a long time focus of research up to the present day. However, this research is hampered by methodological problems, especially the definition and assessment of creativity. This makes interpretation and comparison of studies difficult and possibly accounts for the contradictory results of this research. In this systematic review of the literature, research articles in the field of creativity and psychopathology were searched for creativity assessment tools. The tools used in the collected articles are presented and discussed. The results indicate that a multitude of creativity assessment tools were used, that many studies only used one tool to assess creativity and that most of these tools were only used in a limited number of studies. A few assessment tools stand out by a more frequent use, also outside psychopathological research, and more solid psychometric properties. Most scales used to evaluate creativity have poor psychometric properties. The scattered methodology to assess creativity compromises the generalizability and validity of this research. The field should creatively develop new validated instruments.

The psychometric properties and practicability of self-report instruments to identify medication nonadherence in adult transplant patients: a systematic review.

PubMed

Dobbels, Fabienne; Berben, Lut; De Geest, Sabina; Drent, Gerda; Lennerling, Annette; Whittaker, Clare; Kugler, Christiane

2010-07-27

Nonadherence to immunosuppressive therapy is recognized as a key prognostic indicator for poor posttransplantation long-term outcomes. Several methods aiming to measure medication nonadherence have been suggested in the literature. Although combining measurement methods is regarded as the gold standard for measuring nonadherence, self-report is generally considered a central component of adherence assessment. However, no systematic review currently exists to determine which instrument(s) are most appropriate for use in transplant populations. The transplant360 Task Force first performed a survey of the self-report adherence instruments currently used in European centers. Next, a systematic literature review of self-report instruments assessing medication adherence in chronically ill patients was conducted. Self-report instruments were evaluated to assess those which were: (a) short and easy to score; (b) assessed both the taking and timing of medication intake; and (c) had established reliability and validity. Fourteen instruments were identified from our survey of European centers, of which the Basel Assessment of Adherence Scale for Immunosuppressives met the aforementioned criteria. The systematic review found 20 self-report instruments, of which only two qualified for use in transplantation, that is, the Brief Antiretroviral Adherence Index and the Medication Adherence Self-Report Inventory. The three selected self-report scales may assist transplant professionals in detecting nonadherence. However, these scales were only validated in patients with HIV. Although HIV shares similar characteristics with transplantation, including the importance of taking and timing of medication, further validation in transplant populations is required.

Promoting Excellence in Nursing Education (PENE): Pross evaluation model.

PubMed

Pross, Elizabeth A

2010-08-01

The purpose of this article is to examine the Promoting Excellence in Nursing Education (PENE) Pross evaluation model. A conceptual evaluation model, such as the one described here, may be useful to nurse academicians in the ongoing evaluation of educational programs, especially those with goals of excellence. Frameworks for evaluating nursing programs are necessary because they offer a way to systematically assess the educational effectiveness of complex nursing programs. This article describes the conceptual framework and its tenets of excellence. Copyright 2009 Elsevier Ltd. All rights reserved.

Methodological quality of systematic reviews on influenza vaccination.

PubMed

Remschmidt, Cornelius; Wichmann, Ole; Harder, Thomas

2014-03-26

There is a growing body of evidence on the risks and benefits of influenza vaccination in various target groups. Systematic reviews are of particular importance for policy decisions. However, their methodological quality can vary considerably. To investigate the methodological quality of systematic reviews on influenza vaccination (efficacy, effectiveness, safety) and to identify influencing factors. A systematic literature search on systematic reviews on influenza vaccination was performed, using MEDLINE, EMBASE and three additional databases (1990-2013). Review characteristics were extracted and the methodological quality of the reviews was evaluated using the assessment of multiple systematic reviews (AMSTAR) tool. U-test, Kruskal-Wallis test, chi-square test, and multivariable linear regression analysis were used to assess the influence of review characteristics on AMSTAR-score. Fourty-six systematic reviews fulfilled the inclusion criteria. Average methodological quality was high (median AMSTAR-score: 8), but variability was large (AMSTAR range: 0-11). Quality did not differ significantly according to vaccination target group. Cochrane reviews had higher methodological quality than non-Cochrane reviews (p=0.001). Detailed analysis showed that this was due to better study selection and data extraction, inclusion of unpublished studies, and better reporting of study characteristics (all p<0.05). In the adjusted analysis, no other factor, including industry sponsorship or journal impact factor had an influence on AMSTAR score. Systematic reviews on influenza vaccination showed large differences regarding their methodological quality. Reviews conducted by the Cochrane collaboration were of higher quality than others. When using systematic reviews to guide the development of vaccination recommendations, the methodological quality of a review in addition to its content should be considered. Copyright © 2014 Elsevier Ltd. All rights reserved.

A systematic review on the quality of measurement techniques for the assessment of burn wound depth or healing potential.

PubMed

Jaspers, Mariëlle E H; van Haasterecht, Ludo; van Zuijlen, Paul P M; Mokkink, Lidwine B

2018-06-22

Reliable and valid assessment of burn wound depth or healing potential is essential to treatment decision-making, to provide a prognosis, and to compare studies evaluating different treatment modalities. The aim of this review was to critically appraise, compare and summarize the quality of relevant measurement properties of techniques that aim to assess burn wound depth or healing potential. A systematic literature search was performed using PubMed, EMBASE and Cochrane Library. Two reviewers independently evaluated the methodological quality of included articles using an adapted version of the Consensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. A synthesis of evidence was performed to rate the measurement properties for each technique and to draw an overall conclusion on quality of the techniques. Thirty-six articles were included, evaluating various techniques, classified as (1) laser Doppler techniques; (2) thermography or thermal imaging; (3) other measurement techniques. Strong evidence was found for adequate construct validity of laser Doppler imaging (LDI). Moderate evidence was found for adequate construct validity of thermography, videomicroscopy, and spatial frequency domain imaging (SFDI). Only two studies reported on the measurement property reliability. Furthermore, considerable variation was observed among comparator instruments. Considering the evidence available, it appears that LDI is currently the most favorable technique; thereby assessing burn wound healing potential. Additional research is needed into thermography, videomicroscopy, and SFDI to evaluate their full potential. Future studies should focus on reliability and measurement error, and provide a precise description of which construct is aimed to measure. Copyright © 2018 Elsevier Ltd and ISBI. All rights reserved.

Tools for observational gait analysis in patients with stroke: a systematic review.

PubMed

Ferrarello, Francesco; Bianchi, Valeria Anna Maria; Baccini, Marco; Rubbieri, Gaia; Mossello, Enrico; Cavallini, Maria Chiara; Marchionni, Niccolò; Di Bari, Mauro

2013-12-01

Stroke severely affects walking ability, and assessment of gait kinematics is important in defining diagnosis, planning treatment, and evaluating interventions in stroke rehabilitation. Although observational gait analysis is the most common approach to evaluate gait kinematics, tools useful for this purpose have received little attention in the scientific literature and have not been thoroughly reviewed. The aims of this systematic review were to identify tools proposed to conduct observational gait analysis in adults with a stroke, to summarize evidence concerning their quality, and to assess their implementation in rehabilitation research and clinical practice. An extensive search was performed of original articles reporting on visual/observational tools developed to investigate gait kinematics in adults with a stroke. Two reviewers independently selected studies, extracted data, assessed quality of the included studies, and scored the metric properties and clinical utility of each tool. Rigor in reporting metric properties and dissemination of the tools also was evaluated. Five tools were identified, not all of which had been tested adequately for their metric properties. Evaluation of content validity was partially satisfactory. Reliability was poorly investigated in all but one tool. Concurrent validity and sensitivity to change were shown for 3 and 2 tools, respectively. Overall, adequate levels of quality were rarely reached. The dissemination of the tools was poor. Based on critical appraisal, the Gait Assessment and Intervention Tool shows a good level of quality, and its use in stroke rehabilitation is recommended. Rigorous studies are needed for the other tools in order to establish their usefulness.

Interventions to support people with dementia and their caregivers during the transition from home care to nursing home care: A systematic review.

PubMed

Müller, Christian; Lautenschläger, Sindy; Meyer, Gabriele; Stephan, Astrid

2017-06-01

During the transition of people with dementia from home to nursing home family caregivers often feel burdened. We aimed to 1) identify interventions which support people with dementia and their caregivers in the transition from home care to nursing home care, 2) synthesize the evidence for efficacy of these interventions, and 3) examine whether the identified interventions have been systematically developed, evaluated and implemented according to the Medical Research Council guidance on complex interventions. A systematic review of randomised controlled trials was conducted according to the recommendations specified in the Cochrane Handbook for Intervention Reviews. The review protocol was registered in PROSPERO (2015: CRD42015019839). Reporting follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement. MEDLINE, CENTRAL, PsycINFO, CINAHL, OTseeker, and PEDro, were searched. Other sources included Google Scholar, and ALOIS. Two reviewers independently assessed the eligibility of the articles. Data extraction was performed by one reviewer and verified independently by another. The Cochrane Risk of Bias tool was used for critical appraisal. Development and evaluation of the identified interventions were assessed, taking the Medical Research Council guidance into account. Review findings were synthesized narratively. The search yielded 1278 records. Five studies were included, all conducted in the United States (4 RCTs and 1 cRCT with a total of 695 participants). The psychosocial interventions were individual and family counseling via telephone or ad hoc all of which addressed only informal caregivers. The intervention components, content and mode of delivery differed widely with inconsistent results. Significant intervention effects were found for the reduction of caregivers' depressive symptoms, burden, feeling of guilt, emotional distress, overload, and interactions with staff. Other outcomes, i.e. stress, placement adaptation, role overload, and role captivity, were not statistically significantly affected. The assessment for bias risk across studies varied from moderate to low. Only two studies tested the feasibility of the intervention before full scale evaluation, none evaluated the implementation process according to the Medical Research Council framework. We identified only a few studies with heterogeneous outcomes; evidence regarding the effectiveness of psychosocial interventions is thus insufficient. Further research is needed focusing on the development and evaluation of complex psychosocial interventions and more well-designed RCTs with larger sample sizes based on a rigorous methodology. Reporting on feasibility and implementation processes of interventions should be guaranteed, since it is crucial to evaluate transferability across care settings. Copyright © 2017 Elsevier Ltd. All rights reserved.

Identification of key characteristics of male reproductive toxicants as an approach for screening and sorting mechanistic evidence.

EPA Science Inventory

The application of systematic review practices in human health assessment includes integration of multi-disciplinary evidence from epidemiological, experimental, and mechanistic studies. Although mode of action analysis relies on the evaluation of mechanistic and toxicological ou...

[Distance education in neonatal nursing scenarios: a systematic review].

PubMed

Freire, Laís Machado; Paula, Mariane Andreza de; Duarte, Elysangela Dittz; Bueno, Mariana

2015-06-01

Identify resources that support learning mediated by technology in the field of neonatal nursing. Systematic review with searches conducted in MEDLINE, LILACS and SciELO. Titles and abstracts were independently evaluated by two experts. Of the 2,051 references, 203 full-text articles were analyzed, resulting in the inclusion of nine studies on semiotics and semiology, cardiopulmonary resuscitation, general aspects of neonatal care, diagnostic reasoning and assessment of pain. Only two articles addressed the development of educational strategies and seven papers described the assessment of these strategies by experts and/or users. Distance education is an important resource for education, and its improvement and updating, and it particularly adds advantages for neonatal nursing by approximating teaching and real-life situations and by minimizing the exposure of newborns for teaching purposes. The lack of educational initiatives mediated by technology suggests the need for the development, evaluation and dissemination of educational resources focused on nursing care of newborns and their families.

The local food environment and diet: A systematic review

PubMed Central

Caspi, Caitlin E.; Sorensen, Glorian; Subramanian, S.V.; Kawachi, Ichiro

2013-01-01

Despite growing attention to the problem of obesogenic environments, there has not been a comprehensive review evaluating the food environment-diet relationship. This study aims to evaluate this relationship in the current literature, focusing specifically on the method of exposure assessment (GIS, survey, or store audit). This study also explores 5 dimensions of “food access” (availability, accessibility, affordability, accommodation, acceptability) using a conceptual definition proposed by Penchansky and Thomas (1981). Articles were retrieved through a systematic keyword search in Web of Science and supplemented by the reference lists of included studies. Thirty-eight studies were reviewed and categorized by the exposure assessment method and the conceptual dimensions of access it captured. GIS-based measures were the most common measures, but were less consistently associated with diet than other measures. Few studies examined dimensions of affordability, accommodation, and acceptability. Because GIS-based measures on their own may not capture important non-geographic dimensions of access, a set of recommendations for future researchers is outlined. PMID:22717379

The local food environment and diet: a systematic review.

PubMed

Caspi, Caitlin E; Sorensen, Glorian; Subramanian, S V; Kawachi, Ichiro

2012-09-01

Despite growing attention to the problem of obesogenic environments, there has not been a comprehensive review evaluating the food environment-diet relationship. This study aims to evaluate this relationship in the current literature, focusing specifically on the method of exposure assessment (GIS, survey, or store audit). This study also explores 5 dimensions of "food access" (availability, accessibility, affordability, accommodation, acceptability) using a conceptual definition proposed by Penchansky and Thomas (1981). Articles were retrieved through a systematic keyword search in Web of Science and supplemented by the reference lists of included studies. Thirty-eight studies were reviewed and categorized by the exposure assessment method and the conceptual dimensions of access it captured. GIS-based measures were the most common measures, but were less consistently associated with diet than other measures. Few studies examined dimensions of affordability, accommodation, and acceptability. Because GIS-based measures on their own may not capture important non-geographic dimensions of access, a set of recommendations for future researchers is outlined. Copyright © 2012 Elsevier Ltd. All rights reserved.

Review Article: Influenza Transmission on Aircraft: A Systematic Literature Review.

PubMed

Leitmeyer, Katrin; Adlhoch, Cornelia

2016-09-01

Air travel is associated with the spread of influenza through infected passengers and potentially through in-flight transmission. Contact tracing after exposure to influenza is not performed systematically. We performed a systematic literature review to evaluate the evidence for influenza transmission aboard aircraft. Using PubMed and EMBASE databases, we identified and critically appraised identified records to assess the evidence of such transmission to passengers seated in close proximity to the index cases. We also developed a bias assessment tool to evaluate the quality of evidence provided in the retrieved studies. We identified 14 peer-reviewed publications describing contact tracing of passengers after possible exposure to influenza virus aboard an aircraft. Contact tracing during the initial phase of the influenza A(H1N1)pdm09 pandemic was described in 11 publications. The studies describe the follow-up of 2,165 (51%) of 4,252 traceable passengers. Altogether, 163 secondary cases were identified resulting in an overall secondary attack rate among traced passengers of 7.5%. Of these secondary cases, 68 (42%) were seated within two rows of the index case. We found an overall moderate quality of evidence for transmission of influenza virus aboard an aircraft. The major limiting factor was the comparability of the studies. A majority of secondary cases was identified at a greater distance than two rows from the index case. A standardized approach for initiating, conducting, and reporting contact tracing could help to increase the evidence base for better assessing influenza transmission aboard aircraft.

Disability Policy Evaluation: Combining Logic Models and Systems Thinking.

PubMed

Claes, Claudia; Ferket, Neelke; Vandevelde, Stijn; Verlet, Dries; De Maeyer, Jessica

2017-07-01

Policy evaluation focuses on the assessment of policy-related personal, family, and societal changes or benefits that follow as a result of the interventions, services, and supports provided to those persons to whom the policy is directed. This article describes a systematic approach to policy evaluation based on an evaluation framework and an evaluation process that combine the use of logic models and systems thinking. The article also includes an example of how the framework and process have recently been used in policy development and evaluation in Flanders (Belgium), as well as four policy evaluation guidelines based on relevant published literature.

A systematic review of instruments for assessing parent satisfaction with family-centred care in neonatal intensive care units.

PubMed

Dall'Oglio, Immacolata; Mascolo, Rachele; Gawronski, Orsola; Tiozzo, Emanuela; Portanova, Anna; Ragni, Angela; Alvaro, Rosaria; Rocco, Gennaro; Latour, Jos M

2018-03-01

This systematic review synthesised and described instruments measuring parent satisfaction with the increasing standard practice of family-centred care (FCC) in neonatal intensive care units. We evaluated 11 studies published from January 2006 to March 2016: two studies validated a parent satisfaction questionnaire, and nine developed or modified previous questionnaires to use as outcome measures in their local settings. Most instruments were not tested on reliability and validity. Only two validated instruments included all six of the FCC principles and could assess parent satisfaction with FCC in neonatal intensive care units and be considered as outcome indicators for further research. ©2017 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand

PubMed Central

2013-01-01

Background Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. Methods A systematic search of 17 electronic databases and 13 websites for the period 1981–2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Results Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. Conclusions There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise. PMID:23663493

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand.

PubMed

Clifford, Anton C; Doran, Christopher M; Tsey, Komla

2013-05-13

Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. A systematic search of 17 electronic databases and 13 websites for the period 1981-2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise.

Self-evaluation of assessment programs: a cross-case analysis.

PubMed

Baartman, Liesbeth K J; Prins, Frans J; Kirschner, Paul A; van der Vleuten, Cees P M

2011-08-01

The goal of this article is to contribute to the validation of a self-evaluation method, which can be used by schools to evaluate the quality of their Competence Assessment Program (CAP). The outcomes of the self-evaluations of two schools are systematically compared: a novice school with little experience in competence-based education and assessment, and an innovative school with extensive experience. The self-evaluation was based on 12 quality criteria for CAPs, including both validity and reliability, and criteria stressing the importance of the formative function of assessment, such as meaningfulness and educational consequences. In each school, teachers, management and examination board participated. Results show that the two schools use different approaches to assure assessment quality. The innovative school seems to be more aware of its own strengths and weaknesses, to have a more positive attitude towards teachers, students, and educational innovations, and to explicitly involve stakeholders (i.e., teachers, students, and the work field) in their assessments. This school also had a more explicit vision of the goal of competence-based education and could design its assessments in accordance with these goals. Copyright © 2011 Elsevier Ltd. All rights reserved.

Hospital-related cost of sepsis: A systematic review.

PubMed

Arefian, Habibollah; Heublein, Steffen; Scherag, André; Brunkhorst, Frank Martin; Younis, Mustafa Z; Moerer, Onnen; Fischer, Dagmar; Hartmann, Michael

2017-02-01

This article systematically reviews research on the costs of sepsis and, as a secondary aim, evaluates the quality of economic evaluations reported in peer-reviewed journals. We systematically searched the MEDLINE, National Health Service (Abstracts of Reviews of Effects, Economic Evaluation and Health Technology Assessment), Cost-effectiveness Analysis Registry and Web of Knowledge databases for studies published between January 2005 and June 2015. We selected original articles that provided cost and cost-effectiveness analyses, defined sepsis and described their cost calculation method. Only studies that considered index admissions and re-admissions in the first 30 days were published in peer-reviewed journals and used standard treatments were considered. All costs were adjusted to 2014 US dollars. Medians and interquartile ranges (IQRs) for various costs of sepsis were calculated. The quality of economic studies was assessed using the Drummond 10-item checklist. Overall, 37 studies met our eligibility criteria. The median of the mean hospital-wide cost of sepsis per patient was $32,421 (IQR $20,745-$40,835), and the median of the mean ICU cost of sepsis per patient was $27,461 (IQR $16,007-$31,251). Overall, the quality of economic studies was low. Estimates of the hospital-related costs of sepsis varied considerably across the included studies depending on the method used for cost calculation, the type of sepsis and the population that was examined. A standard model for conducting cost improve the quality of studies on the costs of sepsis. Copyright © 2016 The British Infection Association. All rights reserved.

Case definitions for chronic fatigue syndrome/myalgic encephalomyelitis (CFS/ME): a systematic review

PubMed Central

Brurberg, Kjetil Gundro; Fønhus, Marita Sporstøl; Larun, Lillebeth; Flottorp, Signe; Malterud, Kirsti

2014-01-01

Objective To identify case definitions for chronic fatigue syndrome/myalgic encephalomyelitis (CFS/ME), and explore how the validity of case definitions can be evaluated in the absence of a reference standard. Design Systematic review. Setting International. Participants A literature search, updated as of November 2013, led to the identification of 20 case definitions and inclusion of 38 validation studies. Primary and secondary outcome measure Validation studies were assessed for risk of bias and categorised according to three validation models: (1) independent application of several case definitions on the same population, (2) sequential application of different case definitions on patients diagnosed with CFS/ME with one set of diagnostic criteria or (3) comparison of prevalence estimates from different case definitions applied on different populations. Results A total of 38 studies contributed data of sufficient quality and consistency for evaluation of validity, with CDC-1994/Fukuda as the most frequently applied case definition. No study rigorously assessed the reproducibility or feasibility of case definitions. Validation studies were small with methodological weaknesses and inconsistent results. No empirical data indicated that any case definition specifically identified patients with a neuroimmunological condition. Conclusions Classification of patients according to severity and symptom patterns, aiming to predict prognosis or effectiveness of therapy, seems useful. Development of further case definitions of CFS/ME should be given a low priority. Consistency in research can be achieved by applying diagnostic criteria that have been subjected to systematic evaluation. PMID:24508851

Validated questionnaires heighten detection of difficult asthma comorbidities.

PubMed

Radhakrishna, Naghmeh; Tay, Tunn Ren; Hore-Lacy, Fiona; Stirling, Robert; Hoy, Ryan; Dabscheck, Eli; Hew, Mark

2017-04-01

Multiple extra-pulmonary comorbidities contribute to difficult asthma, but their diagnosis can be challenging and time consuming. Previous data on comorbidity detection have focused on clinical assessment, which may miss certain conditions. We aimed to locate relevant validated screening questionnaires to identify extra-pulmonary comorbidities that contribute to difficult asthma, and evaluate their performance during a difficult asthma evaluation. MEDLINE was searched to identify key extra-pulmonary comorbidities that contribute to difficult asthma. Screening questionnaires were chosen based on ease of use, presence of a cut-off score, and adequate validation to help systematically identify comorbidities. In a consecutive series of 86 patients referred for systematic evaluation of difficult asthma, questionnaires were administered prior to clinical consultation. Six difficult asthma comorbidities and corresponding screening questionnaires were found: sinonasal disease (allergic rhinitis and chronic rhinosinusitis), vocal cord dysfunction, dysfunctional breathing, obstructive sleep apnea, anxiety and depression, and gastro-oesophageal reflux disease. When the questionnaires were added to the referring clinician's impression, the detection of all six comorbidities was significantly enhanced. The average time for questionnaire administration was approximately 40 minutes. The use of validated screening questionnaires heightens detection of comorbidities in difficult asthma. The availability of data from a battery of questionnaires prior to consultation can save time and allow clinicians to systematically assess difficult asthma patients and to focus on areas of particular concern. Such an approach would ensure that all contributing comorbidities have been addressed before significant treatment escalation is considered.

The reliability and validity of ultrasound to quantify muscles in older adults: a systematic review

PubMed Central

Scafoglieri, Aldo; Jager‐Wittenaar, Harriët; Hobbelen, Johannes S.M.; van der Schans, Cees P.

2017-01-01

Abstract This review evaluates the reliability and validity of ultrasound to quantify muscles in older adults. The databases PubMed, Cochrane, and Cumulative Index to Nursing and Allied Health Literature were systematically searched for studies. In 17 studies, the reliability (n = 13) and validity (n = 8) of ultrasound to quantify muscles in community‐dwelling older adults (≥60 years) or a clinical population were evaluated. Four out of 13 reliability studies investigated both intra‐rater and inter‐rater reliability. Intraclass correlation coefficient (ICC) scores for reliability ranged from −0.26 to 1.00. The highest ICC scores were found for the vastus lateralis, rectus femoris, upper arm anterior, and the trunk (ICC = 0.72 to 1.000). All included validity studies found ICC scores ranging from 0.92 to 0.999. Two studies describing the validity of ultrasound to predict lean body mass showed good validity as compared with dual‐energy X‐ray absorptiometry (r 2 = 0.92 to 0.96). This systematic review shows that ultrasound is a reliable and valid tool for the assessment of muscle size in older adults. More high‐quality research is required to confirm these findings in both clinical and healthy populations. Furthermore, ultrasound assessment of small muscles needs further evaluation. Ultrasound to predict lean body mass is feasible; however, future research is required to validate prediction equations in older adults with varying function and health. PMID:28703496

Systematic procedure for designing processes with multiple environmental objectives.

PubMed

Kim, Ki-Joo; Smith, Raymond L

2005-04-01

Evaluation of multiple objectives is very important in designing environmentally benign processes. It requires a systematic procedure for solving multiobjective decision-making problems due to the complex nature of the problems, the need for complex assessments, and the complicated analysis of multidimensional results. In this paper, a novel systematic procedure is presented for designing processes with multiple environmental objectives. This procedure has four steps: initialization, screening, evaluation, and visualization. The first two steps are used for systematic problem formulation based on mass and energy estimation and order of magnitude analysis. In the third step, an efficient parallel multiobjective steady-state genetic algorithm is applied to design environmentally benign and economically viable processes and to provide more accurate and uniform Pareto optimal solutions. In the last step a new visualization technique for illustrating multiple objectives and their design parameters on the same diagram is developed. Through these integrated steps the decision-maker can easily determine design alternatives with respect to his or her preferences. Most importantly, this technique is independent of the number of objectives and design parameters. As a case study, acetic acid recovery from aqueous waste mixtures is investigated by minimizing eight potential environmental impacts and maximizing total profit. After applying the systematic procedure, the most preferred design alternatives and their design parameters are easily identified.

Interventions to improve the use of systematic reviews in decision-making by health system managers, policy makers and clinicians.

PubMed

Murthy, Lakshmi; Shepperd, Sasha; Clarke, Mike J; Garner, Sarah E; Lavis, John N; Perrier, Laure; Roberts, Nia W; Straus, Sharon E

2012-09-12

Systematic reviews provide a transparent and robust summary of existing research. However, health system managers, national and local policy makers and healthcare professionals can face several obstacles when attempting to utilise this evidence. These include constraints operating within the health system, dealing with a large volume of research evidence and difficulties in adapting evidence from systematic reviews so that it is locally relevant. In an attempt to increase the use of systematic review evidence in decision-making a number of interventions have been developed. These include summaries of systematic review evidence that are designed to improve the accessibility of the findings of systematic reviews (often referred to as information products) and changes to organisational structures, such as employing specialist groups to synthesise the evidence to inform local decision-making. To identify and assess the effects of information products based on the findings of systematic review evidence and organisational supports and processes designed to support the uptake of systematic review evidence by health system managers, policy makers and healthcare professionals. We searched The Cochrane Library, MEDLINE, EMBASE, CINAHL, Web of Science, and Health Economic Evaluations Database. We also handsearched two journals (Implementation Science and Evidence and Policy), Cochrane Colloquium abstracts, websites of key organisations and reference lists of studies considered for inclusion. Searches were run from 1992 to March 2011 on all databases, an update search to March 2012 was run on MEDLINE only. Randomised controlled trials (RCTs), interrupted time-series (ITS) and controlled before-after studies (CBA) of interventions designed to aid the use of systematic reviews in healthcare decision-making were considered. Two review authors independently extracted the data and assessed the study quality. We extracted the median value across similar outcomes for each study and reported the range of values for each median value. We calculated the median of the two middlemost values if an even number of outcomes were reported. We included eight studies evaluating the effectiveness of different interventions designed to support the uptake of systematic review evidence. The overall quality of the evidence was very low to moderate.Two cluster RCTs evaluated the effectiveness of multifaceted interventions, which contained access to systematic reviews relevant to reproductive health, to change obstetric care; the high baseline performance in some of the key clinical indicators limited the findings of these studies. There were no statistically significant effects on clinical practice for all but one of the clinical indicators in selected obstetric units in Thailand (median effect size 4.2%, range -11.2% to 18.2%) and none in Mexico (median effect size 3.5%, range 0.1% to 19.0%). In the second cluster RCT there were no statistically significant differences in selected obstetric units in the UK (median effect RR 0.92; range RR 0.57 to RR 1.10). One RCT evaluated the perceived understanding and ease of use of summary of findings tables in Cochrane Reviews. The median effect of the differences in responses for the acceptability of including summary of findings tables in Cochrane Reviews versus not including them was 16%, range 1% to 28%. One RCT evaluated the effect of an analgesic league table, derived from systematic review evidence, and there was no statistically significant effect on self-reported pain. Only one RCT evaluated an organisational intervention (which included a knowledge broker, access to a repository of systematic reviews and provision of tailored messages), and reported no statistically significant difference in evidence informed programme planning.Three interrupted time series studies evaluated the dissemination of printed bulletins based on evidence from systematic reviews. A statistically significant reduction in the rates of surgery for glue ear in children under 10 years (mean annual decline of -10.1%; 95% CI -7.9 to -12.3) and in children under 15 years (quarterly reduction -0.044; 95% CI -0.080 to -0.011) was reported. The distribution to general practitioners of a bulletin on the treatment of depression was associated with a statistically significant lower prescribing rate each quarter than that predicted by the rates of prescribing observed before the distribution of the bulletin (8.2%; P = 0.005). Mass mailing a printed bulletin which summarises systematic review evidence may improve evidence-based practice when there is a single clear message, if the change is relatively simple to accomplish, and there is a growing awareness by users of the evidence that a change in practice is required. If the intention is to develop awareness and knowledge of systematic review evidence, and the skills for implementing this evidence, a multifaceted intervention that addresses each of these aims may be required, though there is insufficient evidence to support this approach.

A systematic review of dynamics in climate risk and vulnerability assessments

NASA Astrophysics Data System (ADS)

Jurgilevich, Alexandra; Räsänen, Aleksi; Groundstroem, Fanny; Juhola, Sirkku

2017-01-01

Understanding climate risk is crucial for effective adaptation action, and a number of assessment methodologies have emerged. We argue that the dynamics of the individual components in climate risk and vulnerability assessments has received little attention. In order to highlight this, we systematically reviewed 42 sub-national climate risk and vulnerability assessments. We analysed the assessments using an analytical framework with which we evaluated (1) the conceptual approaches to vulnerability and exposure used, (2) if current or future risks were assessed, and (3) if and how changes over time (i.e. dynamics) were considered. Of the reviewed assessments, over half addressed future risks or vulnerability; and of these future-oriented studies, less than 1/3 considered both vulnerability and exposure dynamics. While the number of studies that include dynamics is growing, and while all studies included socio-economic aspects, often only biophysical dynamics was taken into account. We discuss the challenges of assessing socio-economic and spatial dynamics, particularly the poor availability of data and methods. We suggest that future-oriented studies assessing risk dynamics would benefit from larger stakeholder involvement, discussion of the assessment purpose, the use of multiple methods, inclusion of uncertainty/sensitivity analyses and pathway approaches.

Does journal endorsement of reporting guidelines influence the completeness of reporting of health research? A systematic review protocol

PubMed Central

2012-01-01

Background Reporting of health research is often inadequate and incomplete. Complete and transparent reporting is imperative to enable readers to assess the validity of research findings for use in healthcare and policy decision-making. To this end, many guidelines, aimed at improving the quality of health research reports, have been developed for reporting a variety of research types. Despite efforts, many reporting guidelines are underused. In order to increase their uptake, evidence of their effectiveness is important and will provide authors, peer reviewers and editors with an important resource for use and implementation of pertinent guidance. The objective of this study was to assess whether endorsement of reporting guidelines by journals influences the completeness of reporting of health studies. Methods Guidelines providing a minimum set of items to guide authors in reporting a specific type of research, developed with explicit methodology, and using a consensus process will be identified from an earlier systematic review and from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network’s reporting guidelines library. MEDLINE, EMBASE, the Cochrane Methodology Register and Scopus will be searched for evaluations of those reporting guidelines; relevant evaluations from the recently conducted CONSORT systematic review will also be included. Single data extraction with 10% verification of study characteristics, 20% of outcomes and complete verification of aspects of study validity will be carried out. We will include evaluations of reporting guidelines that assess the completeness of reporting: (1) before and after journal endorsement, and/or (2) between endorsing and non-endorsing journals. For a given guideline, analyses will be conducted for individual and the total sum of items. When possible, standard, pooled effects with 99% confidence intervals using random effects models will be calculated. Discussion Evidence on which guidelines have been evaluated and which are associated with improved completeness of reporting is important for various stakeholders, including editors who consider which guidelines to endorse in their journal editorial policies. PMID:22626029

Economic evaluation of manual therapy for musculoskeletal diseases: a protocol for a systematic review and narrative synthesis of evidence.

PubMed

Kim, Chang-Gon; Mun, Su-Jeong; Kim, Ka-Na; Shin, Byung-Cheul; Kim, Nam-Kwen; Lee, Dong-Hyo; Lee, Jung-Han

2016-05-13

Manual therapy is the non-surgical conservative management of musculoskeletal disorders using the practitioner's hands on the patient's body for diagnosing and treating disease. The aim of this study is to systematically review trial-based economic evaluations of manual therapy relative to other interventions used for the management of musculoskeletal diseases. Randomised clinical trials (RCTs) on the economic evaluation of manual therapy for musculoskeletal diseases will be included in the review. The following databases will be searched from their inception: Medline, Embase, Cochrane Central Register of Controlled Trials (CENTRAL), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Econlit, Mantis, Index to Chiropractic Literature, Science Citation Index, Social Science Citation Index, Allied and Complementary Medicine Database (AMED), Cochrane Database of Systematic Reviews (CDSR), National Health Service Database of Abstracts of Reviews of Effects (NHS DARE), National Health Service Health Technology Assessment Database (NHS HTA), National Health Service Economic Evaluation Database (NHS EED), CENTRAL, five Korean medical databases (Oriental Medicine Advanced Searching Integrated System (OASIS), Research Information Service System (RISS), DBPIA, Korean Traditional Knowledge Portal (KTKP) and KoreaMed) and three Chinese databases (China National Knowledge Infrastructure (CNKI), VIP and Wanfang). The evidence for the cost-effectiveness, cost-utility and cost-benefit of manual therapy for musculoskeletal diseases will be assessed as the primary outcome. Health-related quality of life and adverse effects will be assessed as secondary outcomes. We will critically appraise the included studies using the Cochrane risk of bias tool and the Drummond checklist. Results will be summarised using Slavin's qualitative best-evidence synthesis approach. The results of the study will be disseminated via a peer-reviewed journal and/or conference presentations. PROSPERO CRD42015026757. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Food groups and risk of chronic disease: a protocol for a systematic review and network meta-analysis of cohort studies.

PubMed

Schwingshackl, Lukas; Chaimani, Anna; Bechthold, Angela; Iqbal, Khalid; Stelmach-Mardas, Marta; Hoffmann, Georg; Schwedhelm, Carolina; Schlesinger, Sabrina; Boeing, Heiner

2016-07-27

There is a lack of systematic and comprehensive evaluations whether food intakes lower or increase risk of chronic diseases. In this network meta-analysis of prospective cohort studies, we aim to evaluate the effects of different foods on risk of chronic diseases. We will search PubMed and EMBASE. This will be supplemented by a hand search and author contacts. Citations, abstracts, and relevant papers will be screened for eligibility by two reviewers independently. Prospective cohort studies will be included if they meet the following criteria: (1) evaluate the association of single food or food groups with all-cause mortality, cardiovascular diseases (incidence and mortality), cancer (incidence and mortality) or risk of type 2 diabetes. The following food groups will be evaluated: whole grains, refined grains, vegetables, fruits, nuts, legumes, eggs, dairy products, fish, red meat, processed meat and sugar-sweetened beverages; (2) include participants ≥18 years of age; and (3) study population were free of outcome(s) of interest at the onset of the study. To assess study quality, we will extract the following characteristics: study size, duration of follow-up, dietary assessment method, assessment of outcome and adjustment factors. If the identified studies appear sufficiently similar within and across the different comparisons between pairs of food groups, we will estimate summary-relative effects using random effects network meta-analysis. Subgroup and meta-regression analyses will be performed stratified by different follow-up cut-points, geographical region and sex. This is a presentation of the study protocol only. Results and conclusions are pending completion of this study. Our systematic review will be of great value to national and international authorities for evidence-based nutritional recommendation/guidelines, regarding the implementation of food-based dietary guidelines for prevention of chronic diseases. Moreover, our results can be implemented to develop new diet quality indices/scores. PROSPERO CRD42016037069.

The effect of a geriatric evaluation on treatment decisions for older cancer patients--a systematic review.

PubMed

Hamaker, Marije E; Schiphorst, Anandi H; ten Bokkel Huinink, Daan; Schaar, Cees; van Munster, Barbara C

2014-03-01

The aim of this systematic review is to summarise all available data on the effect of a geriatric evaluation on the multidisciplinary treatment of older cancer patients, focussing on oncologic treatment decisions and the implementation of non-oncologic interventions. A systematic search in MEDLINE and EMBASE for studies on the effect of a geriatric evaluation on oncologic and non-oncologic treatment for older cancer patients. Literature search identified 1654 reports (624 from Medline and 1030 from Embase), of which 10 studies were included in the review. Three studies used a geriatric consultation while seven used a geriatric assessment performed by a cancer specialist, healthcare worker or (research) nurse. Six studies addressed a change in oncologic treatment, the initial treatment plan was modified in a median of 39% of patients after geriatric evaluation, of which two thirds resulted in less intensive treatment. Seven studies focused on the implementation of non-oncologic interventions based on the results of the geriatric evaluation; all but one reported that interventions were suggested for over 70% of patients, even in studies that did not focus specifically on frail older patients. In the other study, implementation of non-oncologic interventions was left to the cancer specialist's discretion. A geriatric evaluation has significant impact on oncologic and non-oncologic treatment decisions in older cancer patients and deserves consideration in the oncologic work-up for these patients.

Conceptualising the effectiveness of impact assessment processes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chanchitpricha, Chaunjit, E-mail: chaunjit@g.sut.ac.th; Bond, Alan, E-mail: alan.bond@uea.ac.uk; Unit for Environmental Sciences and Management School of Geo and Spatial Sciences, Internal Box 375, North West University

2013-11-15

This paper aims at conceptualising the effectiveness of impact assessment processes through the development of a literature-based framework of criteria to measure impact assessment effectiveness. Four categories of effectiveness were established: procedural, substantive, transactive and normative, each containing a number of criteria; no studies have previously brought together all four of these categories into such a comprehensive, criteria-based framework and undertaken systematic evaluation of practice. The criteria can be mapped within a cycle/or cycles of evaluation, based on the ‘logic model’, at the stages of input, process, output and outcome to enable the identification of connections between the criteria acrossmore » the categories of effectiveness. This framework is considered to have potential application in measuring the effectiveness of many impact assessment processes, including strategic environmental assessment (SEA), environmental impact assessment (EIA), social impact assessment (SIA) and health impact assessment (HIA). -- Highlights: • Conceptualising effectiveness of impact assessment processes. • Identification of factors influencing effectiveness of impact assessment processes. • Development of criteria within a framework for evaluating IA effectiveness. • Applying the logic model to examine connections between effectiveness criteria.« less

Interventions for preventing, delaying the onset, or decreasing the burden of frailty: an overview of systematic reviews.

PubMed

Wilson, Michael G; Béland, François; Julien, Dominic; Gauvin, Lise; Guindon, G Emmanuel; Roy, Denis; Campbell, Kaitryn; Comeau, Donna G; Davidson, Heather; Raina, Parminder; Sattler, Deborah; Vrkljan, Brenda

2015-09-25

Many systematic reviews have evaluated the effectiveness of interventions to prevent, delay, or decrease frailty symptoms, but no effort has been made to identify, map, and synthesize the findings from reviews across the full spectrum of interventions. Our objectives are to (1) synthesize findings from all existing systematic reviews evaluating interventions for preventing, delaying the onset, or decreasing the burden of frailty symptoms; (2) examine different conceptualizations of frailty that have been used in the development and implementation of interventions; and (3) inform policy by convening a stakeholder dialogue with Canadian health-system leaders. We will conduct an overview of systematic reviews to identify and synthesize all of the systematic reviews addressing interventions to preventing, delaying the onset, or decreasing the burden of frailty symptoms. To identify relevant systematic reviews, we will conduct database searches for published and grey literature as well as contact key experts and search reference lists of included reviews. Two reviewers will independently review all search results for inclusion and then conceptually map, extract key findings (including the conceptualization/definition of frailty used) and assess the methodological quality of all included reviews. We will then synthesize the findings by producing a 'gap map' (i.e. mapping reviews in a matrix according to the interventions and outcomes assessed), and narratively synthesize the key messages across reviews related to type of interventions. Following the completion of the synthesis, we will use the findings to develop an evidence brief that mobilizes the best available evidence about the problem related to preventing, delaying the onset, or decreasing the burden of frailty symptoms in older adults, policy and programmatic options to address the problem and implementation considerations. The evidence brief will then be used as the input into a stakeholder dialogue, which will engage 18-22 Canadian health-system leaders (including policymakers, health providers, researchers, and other stakeholders) in 'off-the-record' deliberations to inform future actions and policymaking. PROSPERO CRD42015022082.

Effectiveness of Non-Pharmacological Interventions to Prevent Falls in Older People: A Systematic Overview. The SENATOR Project ONTOP Series

PubMed Central

Rimland, Joseph M.; Abraha, Iosief; Dell’Aquila, Giuseppina; Cruz-Jentoft, Alfonso; Soiza, Roy; Gudmusson, Adalsteinn; Petrovic, Mirko; O’Mahony, Denis; Todd, Chris; Cherubini, Antonio

2016-01-01

Background Falls are common events in older people, which cause considerable morbidity and mortality. Non-pharmacological interventions are an important approach to prevent falls. There are a large number of systematic reviews of non-pharmacological interventions, whose evidence needs to be synthesized in order to facilitate evidence-based clinical decision making. Objectives To systematically examine reviews and meta-analyses that evaluated non-pharmacological interventions to prevent falls in older adults in the community, care facilities and hospitals. Methods We searched the electronic databases Pubmed, the Cochrane Database of Systematic Reviews, EMBASE, CINAHL, PsycINFO, PEDRO and TRIP from January 2009 to March 2015, for systematic reviews that included at least one comparative study, evaluating any non-pharmacological intervention, to prevent falls amongst older adults. The quality of the reviews was assessed using AMSTAR and ProFaNE taxonomy was used to organize the interventions. Results Fifty-nine systematic reviews were identified which consisted of single, multiple and multifactorial non-pharmacological interventions to prevent falls in older people. The most frequent ProFaNE defined interventions were exercises either alone or combined with other interventions, followed by environment/assistive technology interventions comprising environmental modifications, assistive and protective aids, staff education and vision assessment/correction. Knowledge was the third principle class of interventions as patient education. Exercise and multifactorial interventions were the most effective treatments to reduce falls in older adults, although not all types of exercise were equally effective in all subjects and in all settings. Effective exercise programs combined balance and strength training. Reviews with a higher AMSTAR score were more likely to contain more primary studies, to be updated and to perform meta-analysis. Conclusions The aim of this overview of reviews of non-pharmacological interventions to prevent falls in older people in different settings, is to support clinicians and other healthcare workers with clinical decision-making by providing a comprehensive perspective of findings. PMID:27559744

A Systematic Review of the Level of Evidence in Economic Evaluations of Medical Devices: The Example of Vertebroplasty and Kyphoplasty.

PubMed

Martelli, Nicolas; Devaux, Capucine; van den Brink, Hélène; Pineau, Judith; Prognon, Patrice; Borget, Isabelle

2015-01-01

Economic evaluations are far less frequently reported for medical devices than for drugs. In addition, little is known about the quality of existing economic evaluations, particularly for innovative devices, such as those used in vertebroplasty and kyphoplasty. To assess the level of evidence provided by the available economic evaluations for vertebroplasty and kyphoplasty. A systematic review of articles in English or French listed in the MEDLINE, PASCAL, COCHRANE and National Health Service Economic Evaluation databases, with limits on publication date (up to the date of the review, March 2014). We included only economic evaluations of vertebroplasty or kyphoplasty. Editorial and methodological articles were excluded. Data were extracted from articles by two authors working independently and using two analysis grids to measure the quality of economic evaluations. Twenty-one studies met our inclusion criteria. All were published between 2008 and 2014. Eighteen (86%) were full economic evaluations. Cost-effectiveness analysis (CEA) was the most frequent type of economic evaluation, and was present in 11 (52%) studies. Only three CEAs complied fully with the British Medical Journal checklist. The quality of the data sources used in the 21 studies was high, but the CEAs conforming to methodological guidelines did not use high-quality data sources for all components of the analysis. This systematic review shows that the level of evidence in economic evaluations of vertebroplasty and kyphoplasty is low, despite the recent publication of a large number of studies. This finding highlights the challenges to be faced to improve the quality of economic evaluations of medical devices.

Factors associated with mortality due to neonatal pneumonia in India: a protocol for systematic review and planned meta-analysis.

PubMed

Nair, N Sreekumaran; Lewis, Leslie Edward; Lakiang, Theophilus; Godinho, Myron; Murthy, Shruti; Venkatesh, Bhumika T

2017-09-06

India contributes to the highest number of neonatal deaths globally. It also has the greatest number of pneumonia-related neonatal deaths in the developing world. We aim to systematically review the evidence for the factors associated with mortality due to neonatal pneumonia in the Indian context, to address the lack of consolidated evidence on this important issue. This protocol is part of a series of three reviews on neonatal pneumonia in India. Observational studies reporting on outcome of neonatal pneumonia in the Indian context, and published in English in peer-reviewed and indexed journals will be eligible for inclusion. Outcomes of this review will be the factors determining mortality due to neonatal pneumonia. A total of nine databases will be searched. Electronic and hand searching of published and grey literature will be performed. Selection of studies will be done in title, abstract and full text screening stages. Risk of bias, independently assessed by two authors, will be evaluated. Meta-analysis will be performed and heterogeneity assessed. Pooled effect estimates will be stated with 95% confidence intervals. Narrative synthesis will be done where meta-analysis cannot be performed. Publication bias will be evaluated and sensitivity analysis performed according to study quality. Quality of this review will be evaluated using AMSTAR (Assessing the Methodological quality of Systematic Reviews) and GRADE (Grades of Recommendation, Assessment, Development & Evaluation). A summary of findings table will be reported using GRADEPro. Since this is a review involving analysis of secondary data which is available in the public domain, and does not involve human participants, ethical approval was not required. The findings of the study will be shared with all stakeholders of this research. Knowledge dissemination workshops will be conducted with relevant stakeholders to transfer the evidence, tailored to the stakeholder (eg, policy briefs, publications, information booklets, etc). © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Using heuristic evaluations to assess the safety of health information systems.

PubMed

Carvalho, Christopher J; Borycki, Elizabeth M; Kushniruk, Andre W

2009-01-01

Health information systems (HISs) are typically seen as a mechanism for reducing medical errors. There is, however, evidence to prove that technology may actually be the cause of errors. As a result, it is crucial to fully test any system prior to its implementation. At present, evidence-based evaluation heuristics do not exist for assessing aspects of interface design that lead to medical errors. A three phase study was conducted to develop evidence-based heuristics for evaluating interfaces. Phase 1 consisted of a systematic review of the literature. In Phase 2 a comprehensive list of 33 evaluation heuristics was developed based on the review that could be used to test for potential technology induced errors. Phase 3 involved applying these healthcare specific heuristics to evaluate a HIS.

Outcome following phrenic nerve transfer to musculocutaneous nerve in patients with traumatic brachial palsy: a qualitative systematic review.

PubMed

de Mendonça Cardoso, Marcio; Gepp, Ricardo; Correa, José Fernando Guedes

2016-09-01

The phrenic nerve can be transferred to the musculocutaneous nerve in patients with traumatic brachial plexus palsy in order to recover biceps strength, but the results are controversial. There is also a concern about pulmonary function after phrenic nerve transection. In this paper, we performed a qualitative systematic review, evaluating outcomes after this procedure. A systematic review of published studies was undertaken in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement. Data were extracted from the selected papers and related to: publication, study design, outcome (biceps strength in accordance with BMRC and pulmonary function) and population. Study quality was assessed using the "strengthening the reporting of observational studies in epidemiology" (STROBE) standard or the CONSORT checklist, depending on the study design. Seven studies were selected for this systematic review after applying inclusion and exclusion criteria. One hundred twenty-four patients completed follow-up, and most of them were graded M3 or M4 (70.1 %) for biceps strength at the final evaluation. Pulmonary function was analyzed in five studies. It was not possible to perform a statistical comparison between studies because the authors used different parameters for evaluation. Most of the patients exhibited a decrease in pulmonary function tests immediately after surgery, with recovery in the following months. Study quality was determined using STROBE in six articles, and the global score varied from 8 to 21. Phrenic nerve transfer to the musculocutaneous nerve can recover biceps strength ≥M3 (BMRC) in most patients with traumatic brachial plexus injury. Early postoperative findings revealed that the development of pulmonary symptoms is rare, but it cannot be concluded that the procedure is safe because there is no study evaluating pulmonary function in old age.

Performance Assessment of Communicable Disease Surveillance in Disasters: A Systematic Review

PubMed Central

Babaie, Javad; Ardalan, Ali; Vatandoost, Hasan; Goya, Mohammad Mehdi; Akbarisari, Ali

2015-01-01

Background: This study aimed to identify the indices and frameworks that have been used to assess the performance of communicable disease surveillance (CDS) in response to disasters and other emergencies, including infectious disease outbreaks. Method: In this systematic review, PubMed, Google Scholar, Scopus, ScienceDirect, ProQuest databases and grey literature were searched until the end of 2013. All retrieved titles were examined in accordance with inclusion criteria. Abstracts of the relevant titles were reviewed and eligible abstracts were included in a list for data abstraction. Finally, the study variables were extracted. Results: Sixteen articles and one book were found relevant to our study objectives. In these articles, 31 criteria and 35 indicators were used or suggested for the assessment/evaluation of the performance of surveillance systems in disasters. The Centers for Disease Control (CDC) updated guidelines for the evaluation of public health surveillance systems were the most widely used. Conclusion: Despite the importance of performance assessment in improving CDS in response to disasters, there is a lack of clear and accepted frameworks. There is also no agreement on the use of existing criteria and indices. The only relevant framework is the CDC guideline, which is a common framework for assessing public health surveillance systems as a whole. There is an urgent need to develop appropriate frameworks, criteria, and indices for specifically assessing the performance of CDS in response to disasters and other emergencies, including infectious diseases outbreaks. Key words: Disasters, Emergencies, Communicable Diseases, Surveillance System, Performance Assessment PMID:25774323

KDIGO Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors

PubMed Central

Lentine, Krista L.; Kasiske, Bertram L.; Levey, Andrew S.; Adams, Patricia L.; Alberú, Josefina; Bakr, Mohamed A.; Gallon, Lorenzo; Garvey, Catherine A.; Guleria, Sandeep; Li, Philip Kam-Tao; Segev, Dorry L.; Taler, Sandra J.; Tanabe, Kazunari; Wright, Linda; Zeier, Martin G.; Cheung, Michael; Garg, Amit X.

2017-01-01

Abstract The 2017 Kidney Disease: Improving Global Outcomes (KDIGO) Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors is intended to assist medical professionals who evaluate living kidney donor candidates and provide care before, during and after donation. The guideline development process followed the Grades of Recommendation Assessment, Development, and Evaluation (GRADE) approach and guideline recommendations are based on systematic reviews of relevant studies that included critical appraisal of the quality of the evidence and the strength of recommendations. However, many recommendations, for which there was no evidence or no systematic search for evidence was undertaken by the Evidence Review Team, were issued as ungraded expert opinion recommendations. The guideline work group concluded that a comprehensive approach to risk assessment should replace decisions based on assessments of single risk factors in isolation. Original data analyses were undertaken to produce a “proof-in-concept” risk-prediction model for kidney failure to support a framework for quantitative risk assessment in the donor candidate evaluation and defensible shared decision making. This framework is grounded in the simultaneous consideration of each candidate's profile of demographic and health characteristics. The processes and framework for the donor candidate evaluation are presented, along with recommendations for optimal care before, during, and after donation. Limitations of the evidence are discussed, especially regarding the lack of definitive prospective studies and clinical outcome trials. Suggestions for future research, including the need for continued refinement of long-term risk prediction and novel approaches to estimating donation-attributable risks, are also provided. In citing this document, the following format should be used: Kidney Disease: Improving Global Outcomes (KDIGO) Living Kidney Donor Work Group. KDIGO Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors. Transplantation. 2017;101(Suppl 8S):S1–S109. PMID:28742762

Content and psychometric evaluations of questionnaires for assessing physical function in people with neck disorders: a systematic review of the literature.

PubMed

Wiitavaara, Birgitta; Heiden, Marina

2017-06-02

The purpose was to investigate how physical function is assessed in people with musculoskeletal disorders (MSD) in the neck. Specifically, we aimed to determine: (1) Which questionnaires are used to assess physical function in people with MSD in the neck? (2) What do those questionnaires measure? (3) What are the measurement properties of the questionnaires? A systematic review was performed to identify questionnaires and psychometric evaluations. The content of the questionnaires was categorized according to the International Classification of Function, Disability and Health, and the psychometric properties were quality-rated using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. Ten questionnaires and 32 articles evaluating measurement properties were analyzed. Most questionnaires covered only the components body functions and activity and participation, more often activity participation than body function. Internal consistency was adequate in most questionnaires, whereas responsiveness was generally low. Neck Disability Index was most evaluated, but the evaluations of all questionnaires tended to cover most properties in the checklist. The questionnaires differed substantially in items and extent to which their psychometric properties had been evaluated. Focus of measurement was on activities in daily life rather than physical function as such. Implications for Rehabilitation To provide early diagnostics and effective treatment for patients with neck disorders, valid and reliable instruments that measure relevant aspects of the disorders are needed. This paper presents an overview of content and quality of questionnaires used to assess physical function in neck disorders, which may facilitate informed decisions about which measurement instruments to use when evaluating the course of neck disorders. Most of the questionnaires need more testing to judge the quality, however the NDI was the most frequently tested questionnaire. The COnsensus-based Standards for the selection of health Measurement INstruments checklist is a useful tool in relation to psychometric testing of questionnaires, but clear definitions of interpretation of the quality criteria in each study would enhance comparability of results.

Post-fall decision tree development and implementation.

PubMed

Gordon, Bonita M; Wnek, Theresa Frissora; Glorius, Nancy; Hasdorff, Carmen; Shiverski, Joyce; Ginn, Janet

2010-01-01

Care and evaluation after a patient's fall require a number of steps to ensure that appropriate care is given and injury is minimized. Astute and appropriate assessment skills with strategic interventions and communication can minimize the harm from a fall. Post-Fall Decision Guidelines were developed to guide care and treatment and to identify potential complications after a patient has fallen. This systematic approach mobilizes the steps of communication, using the Situation-Background-Assessment-Recommendation (SBAR) format, and guides assessment interventions.

Integrating the Curriculum: Quality and Relevance for Special Needs Children.

ERIC Educational Resources Information Center

Wessel, Janet A.

A comprehensive, integrated physical education system that has quality and relevance for handicapped students and their nonhandicapped peers is proposed. The Achievement Based Curriculum (ABC) Model is a systematic decision-making process for an instructional system that incorporates curriculum, instruction, assessment, and evaluation in one…

Assessment of Biochemical and Behavioral Effects of Carbaryl and Methomyl in Brown-Norway Rats from Preweaning to Sensecence

EPA Science Inventory

Factors impacting life stage-specific sensitivity to chemicals include toxicokinetic and toxicodynamic changes. To evaluate age-related differences in the biochemical and behavioral impacts of two typical N-methyl carbamate pesticides, we systematically compared their dose-respo...

Assessing the effectiveness of safeguards at a medium-sized spent-fuel reprocessing facility

DOE Office of Scientific and Technical Information (OSTI.GOV)

Higinbotham, W.; Fishbone, L.G.; Suda, S.

1983-01-01

In order to evaluate carefully and systematically the effectiveness of safeguards at nuclear-fuel-cycle facilities, the International Atomic Energy Agency has adopted a safeguards effectiveness assessment methodology. The methodology has been applied to a well-characterized, medium-sized, spent-fuel reprocessing plant to understand how explicit safeguards inspection procedures would serve to expose conceivable nuclear materials diversion schemes, should such diversion occur.

Wasted research when systematic reviews fail to provide a complete and up-to-date evidence synthesis: the example of lung cancer.

PubMed

Créquit, Perrine; Trinquart, Ludovic; Yavchitz, Amélie; Ravaud, Philippe

2016-01-20

Multiple treatments are frequently available for a given condition, and clinicians and patients need a comprehensive, up-to-date synthesis of evidence for all competing treatments. We aimed to quantify the waste of research related to the failure of systematic reviews to provide a complete and up-to-date evidence synthesis over time. We performed a series of systematic overviews and networks of randomized trials assessing the gap between evidence covered by systematic reviews and available trials of second-line treatments for advanced non-small cell lung cancer. We searched the Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, MEDLINE, EMBASE, and other resources sequentially by year from 2009 to March 2, 2015. We sequentially compared the amount of evidence missing from systematic reviews to the randomized evidence available for inclusion each year. We constructed cumulative networks of randomized evidence over time and evaluated the proportion of trials, patients, treatments, and treatment comparisons not covered by systematic reviews on December 31 each year from 2009 to 2015. We identified 77 trials (28,636 patients) assessing 47 treatments with 54 comparisons and 29 systematic reviews (13 published after 2013). From 2009 to 2015, the evidence covered by existing systematic reviews was consistently incomplete: 45 % to 70 % of trials; 30 % to 58 % of patients; 40 % to 66 % of treatments; and 38 % to 71 % of comparisons were missing. In the cumulative networks of randomized evidence, 10 % to 17 % of treatment comparisons were partially covered by systematic reviews and 55 % to 85 % were partially or not covered. We illustrate how systematic reviews of a given condition provide a fragmented, out-of-date panorama of the evidence for all treatments. This waste of research might be reduced by the development of live cumulative network meta-analyses.

Doctor performance assessment in daily practise: does it help doctors or not? A systematic review.

PubMed

Overeem, Karlijn; Faber, Marjan J; Arah, Onyebuchi A; Elwyn, Glyn; Lombarts, Kiki M J M H; Wollersheim, Hub C; Grol, Richard P T M

2007-11-01

Continuous assessment of individual performance of doctors is crucial for life-long learning and quality of care. Policy-makers and health educators should have good insights into the strengths and weaknesses of the methods available. The aim of this study was to systematically evaluate the feasibility of methods, the psychometric properties of instruments that are especially important for summative assessments, and the effectiveness of methods serving formative assessments used in routine practise to assess the performance of individual doctors. We searched the MEDLINE (1966-January 2006), PsychINFO (1972-January 2006), CINAHL (1982-January 2006), EMBASE (1980-January 2006) and Cochrane (1966-2006) databases for English language articles, and supplemented this with a hand-search of reference lists of relevant studies and bibliographies of review articles. Studies that aimed to assess the performance of individual doctors in routine practise were included. Two reviewers independently abstracted data regarding study design, setting and findings related to reliability, validity, feasibility and effectiveness using a standard data abstraction form. A total of 64 articles met our inclusion criteria. We observed 6 different methods of evaluating performance: simulated patients; video observation; direct observation; peer assessment; audit of medical records, and portfolio or appraisal. Peer assessment is the most feasible method in terms of costs and time. Little psychometric assessment of the instruments has been undertaken so far. Effectiveness of formative assessments is poorly studied. All systems but 2 rely on a single method to assess performance. There is substantial potential to assess performance of doctors in routine practise. The longterm impact and effectiveness of formative performance assessments on education and quality of care remains hardly known. Future research designs need to pay special attention to unmasking effectiveness in terms of performance improvement.

Neuropathic pain screening questionnaires have limited measurement properties. A systematic review.

PubMed

Mathieson, Stephanie; Maher, Christopher G; Terwee, Caroline B; Folly de Campos, Tarcisio; Lin, Chung-Wei Christine

2015-08-01

The Douleur Neuropathique 4 (DN4), ID Pain, Leeds Assessment of Neuropathic Symptoms and Signs (LANSS), PainDETECT, and Neuropathic Pain Questionnaire have been recommended as screening questionnaires for neuropathic pain. This systematic review aimed to evaluate the measurement properties (eg, criterion validity and reliability) of these questionnaires. Online database searches were conducted and two independent reviewers screened studies and extracted data. Methodological quality of included studies and the measurement properties were assessed against established criteria. A modified Grading of Recommendations Assessment, Development and Evaluation approach was used to summarize the level of evidence. Thirty-seven studies were included. Most studies recruited participants from pain clinics. The original version of the DN4 (French) and Neuropathic Pain Questionnaire (English) had the most number of satisfactory measurement properties. The ID Pain (English) demonstrated satisfactory hypothesis testing and reliability, but all other properties tested were unsatisfactory. The LANSS (English) was unsatisfactory for all properties, except specificity. The PainDETECT (English) demonstrated satisfactory hypothesis testing and criterion validity. In general, the cross-cultural adaptations had less evidence than the original versions. Overall, the DN4 and Neuropathic Pain Questionnaire were most suitable for clinical use. These screening questionnaires should not replace a thorough clinical assessment. Crown Copyright © 2015. Published by Elsevier Inc. All rights reserved.

How effective is drug testing as a workplace safety strategy? A systematic review of the evidence.

PubMed

Pidd, Ken; Roche, Ann M

2014-10-01

The growing prevalence of workplace drug testing and the narrow scope of previous reviews of the evidence base necessitate a comprehensive review of research concerning the efficacy of drug testing as a workplace strategy. A systematic qualitative review of relevant research published between January 1990 and January 2013 was undertaken. Inclusion criteria were studies that evaluated the effectiveness of drug testing in deterring employee drug use or reducing workplace accident or injury rates. Methodological adequacy was assessed using a published assessment tool specifically designed to assess the quality of intervention studies. A total of 23 studies were reviewed and assessed, six of which reported on the effectiveness of testing in reducing employee drug use and 17 which reported on occupational accident or injury rates. No studies involved randomised control trials. Only one study was assessed as demonstrating strong methodological rigour. That study found random alcohol testing reduced fatal accidents in the transport industry. The majority of studies reviewed contained methodological weaknesses including; inappropriate study design, limited sample representativeness, the use of ecological data to evaluate individual behaviour change and failure to adequately control for potentially confounding variables. This latter finding is consistent with previous reviews and indicates the evidence base for the effectiveness of testing in improving workplace safety is at best tenuous. Better dissemination of the current evidence in relation to workplace drug testing is required to support evidence-informed policy and practice. There is also a pressing need for more methodologically rigorous research to evaluate the efficacy and utility of drug testing. Copyright © 2014 Elsevier Ltd. All rights reserved.

Enhancing Education Activities for Health Care Trainees and Professionals Using Audience Response Systems: A Systematic Review.

PubMed

Grzeskowiak, Luke E; Thomas, Alicia E; To, Josephine; Phillips, Adam J; Reeve, Emily

2015-01-01

This review examines the effect of incorporating clickers within practice-based education sessions on educational outcomes of health care trainees and professionals. A systematic literature review was conducted on primary research studies published up until August 2014. Studies were identified by database searching (Ovid MEDLINE, EMBASE, CINAHL, Scopus, Web of Science, and PsychInfo), citation searching, and reference list checking. Studies were restricted to those evaluating the use of clickers as part of the provision of postgraduate education or continuing education programs and were evaluated according to Kirkpatrick's four levels of training evaluation (reaction, learning, behavior, and results). Seventeen studies met the eligibility criteria. Twelve studies assessed learner and/or speaker reactions, with feedback overwhelmingly positive in all studies. Reported learner benefits included increased attentiveness, engagement, and enjoyment of presentations. Speakers reported that using clickers engaged the audience and assisted in assessing audience comprehension. Eight studies assessed learning outcomes. Higher level evidence obtained from four randomized studies demonstrated significant improvements in knowledge with the use of clickers compared with traditional didactic presentations, but no differences when clickers were compared with an interactive lecture with integrated questions. No studies adequately assessed higher level educational outcomes (behavior and results). Although the use of clickers improves learning environment and learner satisfaction, the limited high-quality data for improvements in learning and behavior outcomes make it uncertain whether the acceptance and implementation of clickers within routine practice-based education programs are warranted at this stage.

Study sensitivity: Evaluating the ability to detect effects in systematic reviews of chemical exposures.

PubMed

Cooper, Glinda S; Lunn, Ruth M; Ågerstrand, Marlene; Glenn, Barbara S; Kraft, Andrew D; Luke, April M; Ratcliffe, Jennifer M

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as "sensitivity", is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and sensitivity can be used to identify the most informative studies, to evaluate the confidence of the findings from individual studies and to identify those study elements that may help to explain heterogeneity across the body of literature. Copyright © 2016. Published by Elsevier Ltd.

Cost-effectiveness of adherence-enhancing interventions: a systematic review.

PubMed

Simon-Tuval, Tzahit; Neumann, Peter J; Greenberg, Dan

2016-01-01

Low patient adherence to health-related interventions is a major barrier to achieving healthcare goals and is associated with very high avoidable costs. Although several studies suggest that adherence-enhancing interventions can improve health outcomes, economic evaluations of these interventions are scarce. Systematic reviews published to date are limited to interventions to enhance adherence to pharmaceuticals or to specific diseases and interventions. The authors' objective was to examine the evidence regarding the cost-effectiveness of adherence-enhancing interventions in healthcare and what conclusion could be drawn about these interventions. The present systematic review included 43 original studies and assessed the current evidence regarding the cost-effectiveness of a broad array of interventions aimed at enhancing adherence to medications, medical devices, screening tests and lifestyle behaviors. The authors found that although the majority of adherence-enhancing interventions were cost-effective or cost-saving, variation exists within different intervention types. Further research on the sustainability of adherence improvements is needed in order to accurately evaluate interventions' long-term benefits.

The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview

PubMed Central

Black, Ashly D.; Car, Josip; Pagliari, Claudia; Anandan, Chantelle; Cresswell, Kathrin; Bokun, Tomislav; McKinstry, Brian; Procter, Rob; Majeed, Azeem; Sheikh, Aziz

2011-01-01

Background There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care. Methods and Findings We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking. Conclusions There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and “techno-enthusiasts” as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption. Please see later in the article for the Editors' Summary PMID:21267058

HTGR plant availability and reliability evaluations. Volume I. Summary of evaluations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cadwallader, G.J.; Hannaman, G.W.; Jacobsen, F.K.

1976-12-01

The report (1) describes a reliability assessment methodology for systematically locating and correcting areas which may contribute to unavailability of new and uniquely designed components and systems, (2) illustrates the methodology by applying it to such components in a high-temperature gas-cooled reactor (Public Service Company of Colorado's Fort St. Vrain 330-MW(e) HTGR), and (3) compares the results of the assessment with actual experience. The methodology can be applied to any component or system; however, it is particularly valuable for assessments of components or systems which provide essential functions, or the failure or mishandling of which could result in relatively largemore » economic losses.« less

Six-minute walk test as a determinant of the functional capacity of children and adolescents with cystic fibrosis: A systematic review.

PubMed

Andrade Lima, Cibelle; Dornelas de Andrade, Armèle; Campos, Shirley Lima; Brandão, Daniella Cunha; Mourato, Ianny Pereira; Britto, Murilo Carlos Amorim de

2018-04-01

Cystic Fibrosis (CF) is a multisystem disorder. The involvement of the respiratory system is frequent and culminates in dyspnea and exercise intolerance. Functional capacity is an important diagnostic tool, because it reflects the cardiorespiratory status, quality of life and prognosis. This systematic review aims to assess the reproducibility and validity of the six minute walk test (6MWT) to reflect the functional capacity of children and adolescents with cystic fibrosis, and also the correlation between 6MWT and lung function. Searches for articles were performed in eight databases using MeSH/DeCS keywords. A total of 695 articles were found and, after verifying all eligibility criteria, six articles were included for analysis and scoring regarding the methodological quality according to the QUADAS scale (Quality Assessment of Diagnostic Accuracy Studies). All articles had good methodology (QUADAS between 9 and 11 points). The 6MWT is not correlated with lung function. There is a strong indication that the 6MWT is a reproducible test to assess the functional capacity of children and adolescents with CF. The validity assessment could not be reached because the studies included in this systematic review did not use adequate statistical tools to carry out such an evaluation. Copyright © 2018 Elsevier Ltd. All rights reserved.

Systematic review: questionnaires for assessment of gastroesophageal reflux disease.

PubMed

Bolier, E A; Kessing, B F; Smout, A J; Bredenoord, A J

2015-01-01

Numerous questionnaires with a wide variety of characteristics have been developed for the assessment of gastroesophageal reflux disease (GERD). Four well-defined dimensions are noticeable in these GERD questionnaires, which are symptoms, response to treatment, diagnosis, and burden on the quality of life of GERD patients. The aim of this review is to develop a complete overview of all available questionnaires, categorized per dimension of the assessment of GERD. A systematic search of the literature up to January 2013 using the Pubmed database and the Embase database, and search of references and conference abstract books were conducted. A total number of 65 questionnaires were extracted and evaluated. Thirty-nine questionnaires were found applicable for the assessment of GERD symptoms, three of which are generic gastrointestinal questionnaires. For the assessment of response to treatment, 14 questionnaires were considered applicable. Seven questionnaires with diagnostic purposes were found. In the assessment of quality of life in GERD patients, 18 questionnaires were found and evaluated. Twenty questionnaires were found to be used for more than one assessment dimension, and eight questionnaires were found for GERD assessment in infants and/or children. A wide variety of GERD questionnaires is available, of which the majority is used for assessment of GERD symptoms. Questionnaires differ in aspects such as design, validation and translations. Also, numerous multidimensional questionnaires are available, of which the Reflux Disease Questionnaire is widely applicable. We provided an overview of GERD questionnaires to aid investigators and clinicians in their search for the most appropriate questionnaire for their specific purposes. © 2013 International Society for Diseases of the Esophagus.

Systematic Assessment of the Impact of User Roles on Network Flow Patterns

DTIC Science & Technology

2017-09-01

Protocol SNMP Simple Network Management Protocol SQL Structured Query Language SSH Secure Shell SYN TCP Sync Flag SVDD Support Vector Data Description SVM...and evaluating users based on roles provide the best approach for defining normal digital behaviors? People are individuals, with different interests...activities on the network. We evaluate the assumption that users sharing similar roles exhibit similar network behaviors, and contrast the level of similarity

[Medical and biologic aspects of regulation and evaluation of microclimate: results and prospects of further studies].

PubMed

Afanas'eva, R F

2008-01-01

The article deals with basic points concerning influence of microclimate on humans and tasks of its regulation in contemporary conditions. The authors described universality of microclimate from viewpoint of producing functional state and health state of human, so microclimate should be assessed consistently and systematically through all aspects of its influence, with complex approach to evaluation (clothing, physical activity, etc.).

New Developments in the Technology Readiness Assessment Process in US DOE-EM - 13247

DOE Office of Scientific and Technical Information (OSTI.GOV)

Krahn, Steven; Sutter, Herbert; Johnson, Hoyt

2013-07-01

A Technology Readiness Assessment (TRA) is a systematic, metric-based process and accompanying report that evaluates the maturity of the technologies used in systems; it is designed to measure technology maturity using the Technology Readiness Level (TRL) scale pioneered by the National Aeronautics and Space Administration (NASA) in the 1980's. More recently, DoD has adopted and provided systematic guidance for performing TRAs and determining TRLs. In 2007 the GAO recommended that the DOE adopt the NASA/DoD methodology for evaluating technology maturity. Earlier, in 2006-2007, DOE-EM had conducted pilot TRAs on a number of projects at Hanford and Savannah River. In Marchmore » 2008, DOE-EM issued a process guide, which established TRAs as an integral part of DOE-EM's Project Management Critical Decision Process. Since the development of its detailed TRA guidance in 2008, DOE-EM has continued to accumulate experience in the conduct of TRAs and the process for evaluating technology maturity. DOE has developed guidance on TRAs applicable department-wide. DOE-EM's experience with the TRA process, the evaluations that led to recently developed proposed revisions to the DOE-EM TRA/TMP Guide; the content of the proposed changes that incorporate the above lessons learned and insights are described. (authors)« less

Validity of Dietary Assessment in Athletes: A Systematic Review

PubMed Central

Beck, Kathryn L.; Gifford, Janelle A.; Slater, Gary; Flood, Victoria M.; O’Connor, Helen

2017-01-01

Dietary assessment methods that are recognized as appropriate for the general population are usually applied in a similar manner to athletes, despite the knowledge that sport-specific factors can complicate assessment and impact accuracy in unique ways. As dietary assessment methods are used extensively within the field of sports nutrition, there is concern the validity of methodologies have not undergone more rigorous evaluation in this unique population sub-group. The purpose of this systematic review was to compare two or more methods of dietary assessment, including dietary intake measured against biomarkers or reference measures of energy expenditure, in athletes. Six electronic databases were searched for English-language, full-text articles published from January 1980 until June 2016. The search strategy combined the following keywords: diet, nutrition assessment, athlete, and validity; where the following outcomes are reported but not limited to: energy intake, macro and/or micronutrient intake, food intake, nutritional adequacy, diet quality, or nutritional status. Meta-analysis was performed on studies with sufficient methodological similarity, with between-group standardized mean differences (or effect size) and 95% confidence intervals (CI) being calculated. Of the 1624 studies identified, 18 were eligible for inclusion. Studies comparing self-reported energy intake (EI) to energy expenditure assessed via doubly labelled water were grouped for comparison (n = 11) and demonstrated mean EI was under-estimated by 19% (−2793 ± 1134 kJ/day). Meta-analysis revealed a large pooled effect size of −1.006 (95% CI: −1.3 to −0.7; p < 0.001). The remaining studies (n = 7) compared a new dietary tool or instrument to a reference method(s) (e.g., food record, 24-h dietary recall, biomarker) as part of a validation study. This systematic review revealed there are limited robust studies evaluating dietary assessment methods in athletes. Existing literature demonstrates the substantial variability between methods, with under- and misreporting of intake being frequently observed. There is a clear need for careful validation of dietary assessment methods, including emerging technical innovations, among athlete populations. PMID:29207495

Systematic reviews of workplace injury interventions: what are we missing?

PubMed

Lipscomb, Hester J; Pompeii, Lisa A; Myers, D J; Schoenfisch, Ashley L; Dement, J M

2009-01-01

There are pitfalls associated with applying a biomedical model with its emphasis on experimental designs to the evaluation of workplace injury interventions. Evaluation over enough time is essential in occupational safety when interventions are expected to have a latent effect as well as to assess sustained effects. Controlled trials are not well-suited to this task and are not even possible in circumstances where a policy change, such as legislative action, affects a population of workers simultaneously. Social context influences occupational injury interventions, their evaluation and the wider generalization of findings but is lost in the pooling of data for meta-analyses. Some of these issues can be addressed through recognition of the contribution of diverse observational methodologies in intervention evaluation, improvement and maintenance of robust surveillance systems, and inclusion of qualitative methodologies not typically embraced by epidemiologists or medical researchers. Through consideration of an evaluation of a legislative effort to prevent falls from height in construction, we demonstrate lack of flexibility in current methods used for evaluating time series analyses in systematic reviews of occupational injury intervention effectiveness. These include the manner in which downward change in slope is assessed and the call to demonstrate a significant initial downward change in level. We illustrate essential contextual detail regarding this intervention that is lost in the pooling of data from multiple studies into a combined measure of effect. This reduction of occupational injury intervention evaluation to one of pure statistical significance is ill-conceived, irresponsible, and should be stopped.

Assessment of generalizability, applicability and predictability (GAP) for evaluating external validity in studies of universal family-based prevention of alcohol misuse in young people: systematic methodological review of randomized controlled trials.

PubMed

Fernandez-Hermida, Jose Ramon; Calafat, Amador; Becoña, Elisardo; Tsertsvadze, Alexander; Foxcroft, David R

2012-09-01

To assess external validity characteristics of studies from two Cochrane Systematic Reviews of the effectiveness of universal family-based prevention of alcohol misuse in young people. Two reviewers used an a priori developed external validity rating form and independently assessed three external validity dimensions of generalizability, applicability and predictability (GAP) in randomized controlled trials. The majority (69%) of the included 29 studies were rated 'unclear' on the reporting of sufficient information for judging generalizability from sample to study population. Ten studies (35%) were rated 'unclear' on the reporting of sufficient information for judging applicability to other populations and settings. No study provided an assessment of the validity of the trial end-point measures for subsequent mortality, morbidity, quality of life or other economic or social outcomes. Similarly, no study reported on the validity of surrogate measures using established criteria for assessing surrogate end-points. Studies evaluating the benefits of family-based prevention of alcohol misuse in young people are generally inadequate at reporting information relevant to generalizability of the findings or implications for health or social outcomes. Researchers, study authors, peer reviewers, journal editors and scientific societies should take steps to improve the reporting of information relevant to external validity in prevention trials. © 2012 The Authors. Addiction © 2012 Society for the Study of Addiction.

Probiotics for the Treatment of Infantile Colic: A Systematic Review.

PubMed

Schreck Bird, Anna; Gregory, Philip J; Jalloh, Mohamed A; Risoldi Cochrane, Zara; Hein, Darren J

2017-06-01

To evaluate whether clinical data support the safety and efficacy of probiotics for the management of infantile colic. Probiotics have been suggested as a potential strategy for infantile colic, and the specific species that have been studied in healthy infants are considered to be safe. A systematic review was conducted to identify randomized controlled trials (RCTs) evaluating the use of probiotic supplementation in infants with colic. RCTs with a primary end point assessing crying or fussing time were selected. A meta-analysis comparing "responders" to "nonresponders" in infants receiving probiotic versus control was conducted. The quality of trials selected was assessed. Five RCTs assessing 2 different strains of the probiotic Lactobacillus reuteri in mostly breastfed infants were identified. Analysis of response rates showed that infants receiving probiotics had a 2.3-fold greater chance of having a 50% or greater decrease in crying/fussing time compared to controls ( P = .01). Probiotic supplementation was not associated with any adverse events. Supplementation with the probiotic L. reuteri in breastfed infants appears to be safe and effective for the management of infantile colic. Further research is needed to determine the role of probiotics in infants who are formula-fed.

Estimating functional cognition in older adults using observational assessments of task performance in complex everyday activities: A systematic review and evaluation of measurement properties.

PubMed

Wesson, Jacqueline; Clemson, Lindy; Brodaty, Henry; Reppermund, Simone

2016-09-01

Functional cognition is a relatively new concept in assessment of older adults with mild cognitive impairment or dementia. Instruments need to be reliable and valid, hence we conducted a systematic review of observational assessments of task performance used to estimate functional cognition in this population. Two separate database searches were conducted: firstly to identify instruments; and secondly to identify studies reporting on the psychometric properties of the instruments. Studies were analysed using a published checklist and their quality reviewed according to specific published criteria. Clinical utility was reviewed and the information formulated into a best evidence synthesis. We found 21 instruments and included 58 studies reporting on measurement properties. The majority of studies were rated as being of fair methodological quality and the range of properties investigated was restricted. Most instruments had studies reporting on construct validity (hypothesis testing), none on content validity and there were few studies reporting on reliability. Overall the evidence on psychometric properties is lacking and there is an urgent need for further evaluation of instruments. Copyright © 2016 Elsevier Ltd. All rights reserved.

A systematic review of patient reported outcomes in phase II or III clinical trials of myelodysplastic syndromes and acute myeloid leukemia.

PubMed

Bryant, Ashley Leak; Drier, Sarah W; Lee, Sejin; Bennett, Antonia V

2018-06-07

The purpose of this systematic literature review was to identify clinical trials of MDS and AML that included patient-reported outcome (PRO) instruments, and to summarize the symptom and other health related quality of life (HRQOL) concepts most frequently assessed and the PRO instruments that were used. Sixteen manuscripts describing 14 distinct trials met all criteria (i.e., phase 2 or 3 clinical trial for MDS or AML which included PRO assessment) and were published between 1996-2017. In trials evaluating anemia, PRO scores showed significant improvement in relevant domains (e.g. fatigue, function) among patients identified as responders. In trials evaluating the impact of anti-cancer therapies, improvements the baseline to end of treatment were observed in physical functioning and HRQOL, however the rates of missing data in many of the trials was high or unreported. PRO instruments have the ability to capture changes over time in patients' function and well-being, and PRO instruments and guidance documents are available to support the assessment of HRQOL in AML/MDS clinical trials. Copyright © 2018. Published by Elsevier Ltd.

Brazilian medicinal plants to treat upper respiratory tract and bronchial illness: systematic review and meta-analyses-study protocol.

PubMed

Lopes, Luciane C; Silva, Maria Carolina O; Motta, Cristiane Bergamashi; Macho Quirós, Antonio; Biavatti, Maique Weber; de Oliveira, Jardel Corrêa; Guyatt, Gordon

2014-07-23

Respiratory illness, often associated with cough and sputum, is frequent. In Brazil, herbal medicines are often recommended as a first-line treatment for respiratory illness. There exists uncertainty regarding the effectiveness of these treatments. No systematic review has evaluated Brazilian medicinal plants (BMP) to treat upper respiratory tract and bronchial illness (URTI). We will conduct a systematic review and, if appropriate, a series of meta-analyses evaluating the safety and effectiveness of BMP for URTI. Eligible randomised controlled trials and observational studies will enrol adult or paediatric patients presenting with URTI treated by BMP approved by the Brazilian Health Surveillance Agency compared with placebo, no treatment or an alternative therapy. Our search will include the Cochrane Central Register of Controlled Trials (CENTRAL), which contains the Cochrane Acute Respiratory Illness Group's Specialized Register; MEDLINE; EMBASE; CINAHL (Cumulative Index to Nursing and Allied Health Literature); Web of Science; AMED; LILACS; CAB abstracts; clinical trial.gov; the WHO Trial Register and the Brazilian thesis database (CAPES) without any language restrictions. Outcomes of interest are time to resolution of clinical symptoms and/or signs (cough, sputum production or activity limitations), severity of symptoms prior to resolution and major/minor adverse events. Teams of reviewers will, independently and in duplicate, screen titles and abstracts and the complete full text to determine eligibility. For eligible studies, reviewers will perform data abstraction and assess risk of bias of eligible trials. When appropriate, we will conduct meta-analyses. We will also assess the quality of body of evidence (confidence in estimates of effect) for each of the outcomes using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. The systematic review will be published in a peer-reviewed journal. Brief reports of review findings will be disseminated directly to appropriate audiences via email and other modes of communication. The review will guide healthcare practice and policy in Brazil. Prospero CRD42014007057. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Brazilian medicinal plants to treat upper respiratory tract and bronchial illness: systematic review and meta-analyses—study protocol

PubMed Central

Lopes, Luciane C; Silva, Maria Carolina O; Motta, Cristiane Bergamashi; Macho Quirós, Antonio; Biavatti, Maique Weber; de Oliveira, Jardel Corrêa; Guyatt, Gordon

2014-01-01

Introduction Respiratory illness, often associated with cough and sputum, is frequent. In Brazil, herbal medicines are often recommended as a first-line treatment for respiratory illness. There exists uncertainty regarding the effectiveness of these treatments. No systematic review has evaluated Brazilian medicinal plants (BMP) to treat upper respiratory tract and bronchial illness (URTI). Methods and analysis We will conduct a systematic review and, if appropriate, a series of meta-analyses evaluating the safety and effectiveness of BMP for URTI. Eligible randomised controlled trials and observational studies will enrol adult or paediatric patients presenting with URTI treated by BMP approved by the Brazilian Health Surveillance Agency compared with placebo, no treatment or an alternative therapy. Our search will include the Cochrane Central Register of Controlled Trials (CENTRAL), which contains the Cochrane Acute Respiratory Illness Group's Specialized Register; MEDLINE; EMBASE; CINAHL (Cumulative Index to Nursing and Allied Health Literature); Web of Science; AMED; LILACS; CAB abstracts; clinical trial.gov; the WHO Trial Register and the Brazilian thesis database (CAPES) without any language restrictions. Outcomes of interest are time to resolution of clinical symptoms and/or signs (cough, sputum production or activity limitations), severity of symptoms prior to resolution and major/minor adverse events. Teams of reviewers will, independently and in duplicate, screen titles and abstracts and the complete full text to determine eligibility. For eligible studies, reviewers will perform data abstraction and assess risk of bias of eligible trials. When appropriate, we will conduct meta-analyses. We will also assess the quality of body of evidence (confidence in estimates of effect) for each of the outcomes using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. Ethics and dissemination The systematic review will be published in a peer-reviewed journal. Brief reports of review findings will be disseminated directly to appropriate audiences via email and other modes of communication. The review will guide healthcare practice and policy in Brazil. Trial registration number Prospero CRD42014007057. PMID:25056973

The effectiveness of pneumococcal polysaccharide vaccine 23 (PPV23) in the general population of 50 years of age and older: A systematic review and meta-analysis.

PubMed

Kraicer-Melamed, Hannah; O'Donnell, Shauna; Quach, Caroline

2016-03-18

Two pneumococcal vaccines currently exist and have been recommended for the prevention of pneumococcal infection in adults 65 years of age and older: the 23-valent polysaccharide (PPV23) and the conjugate 13-valent (PCV13) vaccine. To evaluate and summarize the results from all studies reporting on the vaccine effectiveness of PPV23 in preventing invasive pneumococcal disease (IPD) and community-acquired pneumonia (CAP) in individuals over the age of 50. Systematic database searches were completed in PubMed, Medline, Embase, CINAHL, Web of Science, and Cochrane. Google Scholar and hand searches of seminal articles and past systematic reviews were employed. Studies were included if they independently evaluated the effect of PPV23 on IPD and/or CAP in adults (50+). Data extraction and quality assessment were both completed independently by two researchers. Quality was assessed using the National Advisory Committee on Immunization methodology for quality assessment. All conflicts were resolved by consensus. The vaccine effectiveness for PPV23 in preventing IPD was 50% (95% CI: 21%-69%) for cohort studies and 54% (95% CI: 32%-69%) for case-control studies. The VE estimates for CAP were 4% (95% CI: -26%-26%) for trials, 17% (95% CI: -26%-45%) for cohort studies, and 7% (95% CI: -10%-21%) for case-control studies. The vaccine effectiveness of PPV23 in preventing IPD and all-cause CAP was consistent with past systematic reviews and similar to the estimates that were reported in the CAPiTA trial evaluating the vaccine effectiveness of PCV13. Consistent benefits were also reported across ecological studies and reports of surveillance data for the general population 50 years and older. The results suggests that the current practice of vaccinating the adults 65 years of age and older with PPV23 would have similar benefits to PCV13 in preventing potential cases of all-serotype IPD and all-cause CAP. Copyright © 2016 Elsevier Ltd. All rights reserved.

The role of multimedia in surgical skills training and assessment.

PubMed

Shariff, Umar; Seretis, Charalampos; Lee, Doreen; Balasubramanian, Saba P

2016-06-01

Multimedia is an educational resource that can be used to supplement surgical skills training. The aim of this review was to determine the role of multimedia in surgical training and assessment by performing a systematic review of the literature. A systematic review for published articles was conducted on the following databases: PubMed/MEDLINE (1992 to November 2014), SCOPUS (1992 to November 2014) and EMBASE (1992 to November 2014). For each study the educational content, study design, surgical skill assessed and outcomes were recorded. A standard data extraction form was created to ensure systematic retrieval of relevant information. 21 studies were included; 14 randomized controlled trials (RCTs) and 7 non-randomized controlled trials (Non-RCTs). Technical skills were assessed in 7 RCTs and 3 non-RCTs; cognitive skills were assessed in 9 RCTs and 4 non-RCTs. In controlled studies, multimedia was associated with significant improvement in technical skills (4 studies; 4 RCTs) and cognitive skills (7 studies; 6 RCTs). In two studies multimedia was inferior in comparison to conventional teaching. Evaluation of multimedia (9 studies) demonstrated strongly favourable results. This review suggests that multimedia effectively facilitates both technical and cognitive skills acquisition and is well accepted as an educational resource. Copyright © 2015 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

Family-based interventions for substance misuse: a systematic review of systematic reviews--protocol.

PubMed

Akram, Yasmin; Copello, Alex; Moore, David

2014-08-15

Worldwide, there are an estimated 15 million individuals with drug use disorders and over five times as many with alcohol use disorders (WHO 1:2, 2005). Most individuals with substance misuse have families who are affected. Initial scoping searches identified an expanse of broad and disparate studies and reviews on the family interventions for substance misuse. This systematic review of systematic reviews aims to bring together the expanse of research on the effectiveness of family-based interventions in substance misuse.Initial scoping searches identified an expanse of broad and disparate studies and reviews on the family interventions for substance misuse. This systematic review of systematic reviews aims to bring together the expanse of research on the effectiveness of family-based interventions in substance misuse. Extensive electronic and manual searches will be undertaken. Screening, data extraction and quality assessment will be undertaken by two reviewers with disagreements resolved through discussion.The inclusion criteria will be that the study is a systematically undertaken review, the population is individuals with substance misuse problems and the interventions include a family-focused component. Reviews that focus on prevention rather than treatment will be excluded. The reviews will be assessed for quality and relevance. The evidence from included systematic reviews will be mapped by focus of intervention (promoting engagement of user into treatment/joint involvement in treatment of user/treating family member in own right) for both adults and adolescents for drug and/or alcohol misusers to allow assessment of the density of available evidence. The higher-quality, up-to-date evidence for each domain will be identified and described, and conclusions will be drawn with limitations of the evidence highlighted. This systematic review of systematic reviews will be an efficient and robust way of looking at the current state of the evidence in the field of family-based interventions for substance misuse. It will evaluate all the available systematic-review-level literature to report on the effectiveness of family-based psychological interventions in improving substance-related outcomes and improving health and wellbeing of substance misusers and/or their families. This will inform future treatment policies and commissioning decisions.In addition, it will identify areas of poor quality, inconsistency and gaps in the evidence base for family-based psychological interventions in substance misuse with respect to secondary evidence in order to inform future research. PROSPERO CRD42014006834.