A Methodological Critique of "Interventions for Boys with Conduct Problems"

ERIC Educational Resources Information Center

Kent, Ronald; And Others

1976-01-01

Kent criticizes Patterson's study on treating the behavior problems of boys, on several methodological bases concluding that more rigorous research is required in this field. Patterson answers Kent's criticisms arguing that they are not based on sound grounds. Patterson offers further evidence to support the efficacy of his treatment procedures.…

Study designs for identifying risk compensation behavior among users of biomedical HIV prevention technologies: balancing methodological rigor and research ethics.

PubMed

Underhill, Kristen

2013-10-01

The growing evidence base for biomedical HIV prevention interventions - such as oral pre-exposure prophylaxis, microbicides, male circumcision, treatment as prevention, and eventually prevention vaccines - has given rise to concerns about the ways in which users of these biomedical products may adjust their HIV risk behaviors based on the perception that they are prevented from infection. Known as risk compensation, this behavioral adjustment draws on the theory of "risk homeostasis," which has previously been applied to phenomena as diverse as Lyme disease vaccination, insurance mandates, and automobile safety. Little rigorous evidence exists to answer risk compensation concerns in the biomedical HIV prevention literature, in part because the field has not systematically evaluated the study designs available for testing these behaviors. The goals of this Commentary are to explain the origins of risk compensation behavior in risk homeostasis theory, to reframe risk compensation as a testable response to the perception of reduced risk, and to assess the methodological rigor and ethical justification of study designs aiming to isolate risk compensation responses. Although the most rigorous methodological designs for assessing risk compensation behavior may be unavailable due to ethical flaws, several strategies can help investigators identify potential risk compensation behavior during Phase II, Phase III, and Phase IV testing of new technologies. Where concerns arise regarding risk compensation behavior, empirical evidence about the incidence, types, and extent of these behavioral changes can illuminate opportunities to better support the users of new HIV prevention strategies. This Commentary concludes by suggesting a new way to conceptualize risk compensation behavior in the HIV prevention context. Copyright © 2013 Elsevier Ltd. All rights reserved.

Study designs for identifying risk compensation behavior among users of biomedical HIV prevention technologies: Balancing methodological rigor and research ethics

PubMed Central

Underhill, Kristen

2014-01-01

The growing evidence base for biomedical HIV prevention interventions – such as oral pre-exposure prophylaxis, microbicides, male circumcision, treatment as prevention, and eventually prevention vaccines – has given rise to concerns about the ways in which users of these biomedical products may adjust their HIV risk behaviors based on the perception that they are prevented from infection. Known as risk compensation, this behavioral adjustment draws on the theory of “risk homeostasis,” which has previously been applied to phenomena as diverse as Lyme disease vaccination, insurance mandates, and automobile safety. Little rigorous evidence exists to answer risk compensation concerns in the biomedical HIV prevention literature, in part because the field has not systematically evaluated the study designs available for testing these behaviors. The goals of this Commentary are to explain the origins of risk compensation behavior in risk homeostasis theory, to reframe risk compensation as a testable response to the perception of reduced risk, and to assess the methodological rigor and ethical justification of study designs aiming to isolate risk compensation responses. Although the most rigorous methodological designs for assessing risk compensation behavior may be unavailable due to ethical flaws, several strategies can help investigators identify potential risk compensation behavior during Phase II, Phase III, and Phase IV testing of new technologies. Where concerns arise regarding risk compensation behavior, empirical evidence about the incidence, types, and extent of these behavioral changes can illuminate opportunities to better support the users of new HIV prevention strategies. This Commentary concludes by suggesting a new way to conceptualize risk compensation behavior in the HIV prevention context. PMID:23597916

Clinical relevance in anesthesia journals.

PubMed

Lauritsen, Jakob; Møller, Ann M

2006-04-01

The purpose of this review is to present the latest knowledge and research on the definition and distribution of clinically relevant articles in anesthesia journals. It will also discuss the importance of the chosen methodology and outcome of articles. In the last few years, more attention has been paid to evidence-based medicine in anesthesia. Several articles on the subject have focused on the need to base clinical decisions on sound research employing both methodological rigor and clinically relevant outcomes. The number of systematic reviews in anesthesia literature is increasing as well as the focus on diminishing the number of surrogate outcomes. It has been shown that the impact factor is not a valid measure of establishing the level of clinical relevance to a journal. This review presents definitions of clinically relevant anesthesia articles. A clinically relevant article employs both methodological rigor and a clinically relevant outcome. The terms methodological rigor and clinical outcomes are fully discussed in the review as well as problems with journal impact factors.

Do we need methodological theory to do qualitative research?

PubMed

Avis, Mark

2003-09-01

Positivism is frequently used to stand for the epistemological assumption that empirical science based on principles of verificationism, objectivity, and reproducibility is the foundation of all genuine knowledge. Qualitative researchers sometimes feel obliged to provide methodological alternatives to positivism that recognize their different ethical, ontological, and epistemological commitments and have provided three theories: phenomenology, grounded theory, and ethnography. The author argues that positivism was a doomed attempt to define empirical foundations for knowledge through a rigorous separation of theory and evidence; offers a pragmatic, coherent view of knowledge; and suggests that rigorous, rational empirical investigation does not need methodological theory. Therefore, qualitative methodological theory is unnecessary and counterproductive because it hinders critical reflection on the relation between methodological theory and empirical evidence.

Mathematics interventions for children and adolescents with Down syndrome: a research synthesis.

PubMed

Lemons, C J; Powell, S R; King, S A; Davidson, K A

2015-08-01

Many children and adolescents with Down syndrome fail to achieve proficiency in mathematics. Researchers have suggested that tailoring interventions based on the behavioural phenotype may enhance efficacy. The research questions that guided this review were (1) what types of mathematics interventions have been empirically evaluated with children and adolescents with Down syndrome?; (2) do the studies demonstrate sufficient methodological rigor?; (3) is there evidence of efficacy for the evaluated mathematics interventions?; and (4) to what extent have researchers considered aspects of the behavioural phenotype in selecting, designing and/or implementing mathematics interventions for children and adolescents with Down syndrome? Nine studies published between 1989 and 2012 were identified for inclusion. Interventions predominantly focused on early mathematics skills and reported positive outcomes. However, no study met criteria for methodological rigor. Further, no authors explicitly considered the behavioural phenotype. Additional research using rigorous experimental designs is needed to evaluate the efficacy of mathematics interventions for children and adolescents with Down syndrome. Suggestions for considering the behavioural phenotype in future research are provided. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Balancing Methodological Rigor and the Needs of Research Participants: A Debate on Alternative Approaches to Sensitive Research.

PubMed

Chan, T M Simon; Teram, Eli; Shaw, Ian

2017-01-01

Despite growing consideration of the needs of research participants in studies related to sensitive issues, discussions of alternative ways to design sensitive research are scarce. Structured as an exchange between two researchers who used different approaches in their studies with childhood sexual abuse survivors, in this article, we seek to advance understanding of methodological and ethical issues in designing sensitive research. The first perspective, which is termed protective, promotes the gradual progression of participants from a treatment phase into a research phase, with the ongoing presence of a researcher and a social worker in both phases. In the second perspective, which is termed minimalist, we argue for clear boundaries between research and treatment processes, limiting the responsibility of researchers to ensuring that professional support is available to participants who experience emotional difficulties. Following rebuttals, lessons are drawn for ethical balancing between methodological rigor and the needs of participants. © The Author(s) 2015.

Development of Pain Endpoint Models for Use in Prostate Cancer Clinical Trials and Drug Approval

DTIC Science & Technology

2017-10-01

publication delineating key methodological components of pain studies in prostate cancer. KEYWORDS Pain, metastatic castrate resistant prostate cancer...pain palliation and pain progression in prostate cancer clinical trials that are feasible, methodologically rigorous, and meet regulatory...requirements for drug approval and labeling. The primary aim of this award is to conduct an observational longitudinal study in men with castrate-resistant

What Are Naturally Occurring School Lotteries and How Do We Identify Them? Reflections on Methodology

ERIC Educational Resources Information Center

Unterman, Rebecca

2018-01-01

This post is one in a series highlighting MDRC's methodological work. In the past decade, rapid growth in the number of charter schools and school district choice systems has provided education researchers with exciting opportunities to use naturally occurring pockets of randomization to rigorously study the effects of policy-relevant education…

Sign Language Studies with Chimpanzees and Children.

ERIC Educational Resources Information Center

Van Cantfort, Thomas E.; Rimpau, James B.

1982-01-01

Reviews methodologies of sign language studies with chimpanzees and compares major findings of those studies with studies of human children. Considers relevance of input conditions for language acquisition, evidence used to demonstrate linguistic achievements, and application of rigorous testing procedures in developmental psycholinguistics.…

Clinical and cost outcomes of multifactorial, cardiovascular risk management interventions in worksites: a comprehensive review and analysis.

PubMed

Pelletier, K R

1997-12-01

This paper is a critical review of the clinical and cost outcome evaluation studies of multifactorial, comprehensive, cardiovascular risk management programs in worksites. A comprehensive international literature search conducted under the auspices of the National Heart, Lung and Blood Institute identified 17 articles based on 12 studies that examined the clinical outcomes of multifactorial, comprehensive programs. These articles were identified through MEDLINE, manual searches of recent journals, and through direct inquiries to worksite health promotion researchers. All studies were conducted between 1978 and 1995, with 1978 being the date of the first citation of a methodologically rigorous evaluation. Of the 12 research studies, only 8 utilized the worksite as both the unit of assignment and as the unit of analysis. None of the studies analyzed adequately for cost effectiveness. Given this limitation, this review briefly considers the relevant worksite research that has demonstrated cost outcomes. Worksite-based, multifactorial cardiovascular intervention programs reviewed for this article varied widely in the comprehensiveness, intensity, and duration of both the interventions and evaluations. Results from randomized trials suggest that providing opportunities for individualized, cardiovascular risk reduction counseling for high-risk employees within the context of comprehensive programming may be the critical component of an effective worksite intervention. Despite the many limitations of the current methodologies of the 12 studies, the majority of the research to date indicates the following: (1) favorable clinical and cost outcomes; (2) that more recent and more rigorously designed research tends to support rather than refute earlier and less rigorously designed studies; and (3) that rather than interpreting the methodological flaws and diversity as inherently negative, one may consider it as indicative of a robust phenomena evident in many types of worksites, with diverse employees, differing interventions, and varying degrees of methodological sophistication. Results of these studies reviewed provide both cautious optimism about the effectiveness of these worksite programs and insights regarding the essential components and characteristics of successful programs.

A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation.

PubMed

Acosta, Joie D; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S

2016-01-01

Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014-2015 school year. The study's rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area.

Developing methods for systematic reviewing in health services delivery and organization: an example from a review of access to health care for people with learning disabilities. Part 2. Evaluation of the literature--a practical guide.

PubMed

Alborz, Alison; McNally, Rosalind

2004-12-01

To develop methods to facilitate the 'systematic' review of evidence from a range of methodologies on diffuse or 'soft' topics, as exemplified by 'access to health care'. Twenty-eight bibliographic databases, research registers, organizational websites or library catalogues. Reference lists from identified studies. Contact with experts and service users. Current awareness and contents alerting services in the area of learning disabilities. Inclusion criteria were English language literature from 1980 onwards, relating to people with learning disabilities of any age and all study designs. The main criteria for assessment was relevance to Guillifords' model of access to health care which was adapted to the circumstances of people with learning disabilities. Selected studies were evaluated for scientific rigour then data was extracted and the results synthesized. Quality assessment was by an initial set of 'generic' quality indicators. This enabled further evidence selection before evaluation of findings according to specific criteria for qualitative, quantitative or mixed-method studies. Eighty-two studies were fully evaluated. Five studies were rated 'highly rigorous', 22 'rigorous', 46 'less rigorous' and nine 'poor' papers were retained as the sole evidence covering aspects of the guiding model. The majority of studies were quantitative but used only descriptive statistics. Most evidence lacked methodological detail, which often lowered final quality ratings. The application of a consistent structure to quality evaluation can facilitate data appraisal, extraction and synthesis across a range of methodologies in diffuse or 'soft' topics. Synthesis can be facilitated further by using software, such as the microsoft 'access' database, for managing information.

Reviewing the methodology of an integrative review.

PubMed

Hopia, Hanna; Latvala, Eila; Liimatainen, Leena

2016-12-01

Whittemore and Knafl's updated description of methodological approach for integrative review was published in 2005. Since then, the five stages of the approach have been regularly used as a basic conceptual structure of the integrative reviews conducted by nursing researchers. However, this methodological approach is seldom examined from the perspective of how systematically and rigorously the stages are implemented in the published integrative reviews. To appraise the selected integrative reviews on the basis of the methodological approach according to the five stages published by Whittemore and Knafl in 2005. A literature review was used in this study. CINAHL (Cumulative Index to Nursing and Allied Health), PubMed, OVID (Journals@Ovid) and the Cochrane Library databases were searched for integrative reviews published between 2002 and 2014. Papers were included if they used the methodological approach described by Whittemore and Knafl, were published in English and were focused on nursing education or nursing expertise. A total of 259 integrative review publications for potential inclusion were identified. Ten integrative reviews fulfilled the inclusion criteria. Findings from the studies were extracted and critically examined according to the five methodological stages. The reviews assessed followed the guidelines of the stated methodology approach to different extents. The stages of literature search, data evaluation and data analysis were fairly poorly formulated and only partially implemented in the studies included in the sample. The other two stages, problem identification and presentation, followed those described in the methodological approach quite well. Increasing use of research in clinical practice is inevitable, and therefore, integrative reviews can play a greater role in developing evidence-based nursing practices. Because of this, nurse researchers should pay more attention to sound integrative nursing research to systematise the review process and make it more rigorous. © 2016 Nordic College of Caring Science.

Systematic review of mobile health behavioural interventions to improve uptake of HIV testing for vulnerable and key populations.

PubMed

Conserve, Donaldson F; Jennings, Larissa; Aguiar, Carolina; Shin, Grace; Handler, Lara; Maman, Suzanne

2017-02-01

Introduction This systematic narrative review examined the empirical evidence on the effectiveness of mobile health (mHealth) behavioural interventions designed to increase the uptake of HIV testing among vulnerable and key populations. Methods MEDLINE/PubMed, Embase, Web of Science, and Global Health electronic databases were searched. Studies were eligible for inclusion if they were published between 2005 and 2015, evaluated an mHealth intervention, and reported an outcome relating to HIV testing. We also reviewed the bibliographies of retrieved studies for other relevant citations. The methodological rigor of selected articles was assessed, and narrative analyses were used to synthesize findings from mixed methodologies. Results A total of seven articles met the inclusion criteria. Most mHealth interventions employed a text-messaging feature and were conducted in middle- and high-income countries. The methodological rigor was moderate among studies. The current literature suggests that mHealth interventions can have significant positive effects on HIV testing initiation among vulnerable and key populations, as well as the general public. In some cases, null results were observed. Qualitative themes relating to the use of mobile technologies to increase HIV testing included the benefits of having low-cost, confidential, and motivational communication. Reported barriers included cellular network restrictions, poor linkages with physical testing services, and limited knowledge of appropriate text-messaging dose. Discussion MHealth interventions may prove beneficial in reducing the proportion of undiagnosed persons living with HIV, particularly among vulnerable and key populations. However, more rigorous and tailored interventions are needed to assess the effectiveness of widespread use.

Systematic review of mobile-health behavioral interventions to improve uptake of HIV testing for vulnerable and key populations

PubMed Central

Conserve, Donaldson F.; Jennings, Larissa; Aguiar, Carolina; Shin, Grace; Handler, Lara; Maman, Suzanne

2016-01-01

Objective This systematic narrative review examined the empirical evidence on the effectiveness of mobile health (mHealth) behavioral interventions designed to increase uptake of HIV testing among vulnerable and key populations. Methods MEDLINE/PubMed, Embase, Web of Science, and Global Health electronic databases were searched. Studies were eligible for inclusion if they were published between 2005 and 2015, evaluated an mHealth intervention, and reported an outcome relating to HIV testing. We also reviewed the bibliographies of retrieved studies for other relevant citations. The methodological rigor of selected articles was assessed, and narrative analyses were used to synthesize findings from mixed methodologies. Results A total of seven articles met the inclusion criteria. Most mHealth interventions employed a text-messaging feature and were conducted in middle- and high-income countries. The methodological rigor was moderate among studies. The current literature suggests that mHealth interventions can have significant positive effects on HIV testing initiation among vulnerable and key populations, as well as the general public. In some cases, null results were observed. Qualitative themes relating to use of mobile technologies to increase HIV testing included the benefits of having low-cost, confidential, and motivational communication. Reported barriers included cellular network restrictions, poor linkages with physical testing services, and limited knowledge of appropriate text-messaging dose. Conclusions MHealth interventions may prove beneficial in reducing the proportion of undiagnosed persons living with HIV, particularly among vulnerable and key populations. However, more rigorous and tailored intervention trials are needed to assess the effectiveness of widespread use. PMID:27056905

Stigma-related experiences in non-communicable respiratory diseases: A systematic review.

PubMed

Rose, Shiho; Paul, Christine; Boyes, Allison; Kelly, Brian; Roach, Della

2017-08-01

The stigma of non-communicable respiratory diseases (NCRDs), whether perceived or otherwise, can be an important element of a patient's experience of his/her illness and a contributing factor to poor psychosocial, treatment and clinical outcomes. This systematic review examines the evidence regarding the associations between stigma-related experiences and patient outcomes, comparing findings across a range of common NCRDs. Electronic databases and manual searches were conducted to identify original quantitative research published to December 2015. Articles focussing on adult patient samples diagnosed with asthma, chronic obstructive pulmonary disease (COPD), cystic fibrosis, lung cancer or mesothelioma, and included a measurement of stigma-related experience (i.e. perceived stigma, shame, blame or guilt), were eligible for inclusion. Included articles were described for study characteristics, outcome scores, correlates between stigma-related experiences and patient outcomes and methodological rigor. Twenty-five articles were eligible for this review, with most ( n = 20) related to lung cancer. No articles for cystic fibrosis were identified. Twenty unique scales were used, with low to moderate stigma-related experiences reported overall. The stigma-related experiences significantly correlated with all six patient-related domains explored (psychosocial, quality of life, behavioral, physical, treatment and work), which were investigated more widely in COPD and lung cancer samples. No studies adequately met all criteria for methodological rigor. The inter-connectedness of stigma-related experiences to other aspects of patient experiences highlight that an integrated approach is needed to address this important issue. Future studies should adopt more rigorous methodology, including streamlining measures, to provide robust evidence.

Psychotherapy via Videoconferencing: A Review

ERIC Educational Resources Information Center

Simpson, Susan

2009-01-01

Research into the use of videoconferencing for clinical purposes, in particular psychotherapy, is gradually expanding. A number of case studies and case series have suggested that videoconferencing can be clinically effective and acceptable to patients. Nevertheless, there is a lack of methodologically rigorous studies with adequate sample sizes…

45 CFR 156.275 - Accreditation of QHP issuers.

Code of Federal Regulations, 2012 CFR

2012-10-01

... QHP issuers codified in § 156.230(a)(2) and (a)(3). (3) Methodological and scoring criteria for accreditation. Recognized accrediting entities must use transparent and rigorous methodological and scoring...

Methods of Quality Appraisal for Studies Reviewed by Evidence Clearinghouses

ERIC Educational Resources Information Center

Wilson, Sandra Jo; Tanner-Smith, Emily

2015-01-01

This presentation will discuss quality appraisal methods for assessing research studies used in systematic reviews, research syntheses, and evidence-based practice repositories such as the What Works Clearinghouse. The different ways that the methodological rigor and risk of bias of primary studies included in syntheses is assessed means that…

45 CFR 156.275 - Accreditation of QHP issuers.

Code of Federal Regulations, 2013 CFR

2013-10-01

... issuers codified in § 156.230(a)(2) and (a)(3). (3) Methodological and scoring criteria for accreditation. Recognized accrediting entities must use transparent and rigorous methodological and scoring criteria. (4...

45 CFR 156.275 - Accreditation of QHP issuers.

Code of Federal Regulations, 2014 CFR

2014-10-01

... issuers codified in § 156.230(a)(2) and (a)(3). (3) Methodological and scoring criteria for accreditation. Recognized accrediting entities must use transparent and rigorous methodological and scoring criteria. (4...

Systematic methodological review: developing a framework for a qualitative semi-structured interview guide.

PubMed

Kallio, Hanna; Pietilä, Anna-Maija; Johnson, Martin; Kangasniemi, Mari

2016-12-01

To produce a framework for the development of a qualitative semi-structured interview guide. Rigorous data collection procedures fundamentally influence the results of studies. The semi-structured interview is a common data collection method, but methodological research on the development of a semi-structured interview guide is sparse. Systematic methodological review. We searched PubMed, CINAHL, Scopus and Web of Science for methodological papers on semi-structured interview guides from October 2004-September 2014. Having examined 2,703 titles and abstracts and 21 full texts, we finally selected 10 papers. We analysed the data using the qualitative content analysis method. Our analysis resulted in new synthesized knowledge on the development of a semi-structured interview guide, including five phases: (1) identifying the prerequisites for using semi-structured interviews; (2) retrieving and using previous knowledge; (3) formulating the preliminary semi-structured interview guide; (4) pilot testing the guide; and (5) presenting the complete semi-structured interview guide. Rigorous development of a qualitative semi-structured interview guide contributes to the objectivity and trustworthiness of studies and makes the results more plausible. Researchers should consider using this five-step process to develop a semi-structured interview guide and justify the decisions made during it. © 2016 John Wiley & Sons Ltd.

Standards and Methodological Rigor in Pulmonary Arterial Hypertension Preclinical and Translational Research.

PubMed

Provencher, Steeve; Archer, Stephen L; Ramirez, F Daniel; Hibbert, Benjamin; Paulin, Roxane; Boucherat, Olivier; Lacasse, Yves; Bonnet, Sébastien

2018-03-30

Despite advances in our understanding of the pathophysiology and the management of pulmonary arterial hypertension (PAH), significant therapeutic gaps remain for this devastating disease. Yet, few innovative therapies beyond the traditional pathways of endothelial dysfunction have reached clinical trial phases in PAH. Although there are inherent limitations of the currently available models of PAH, the leaky pipeline of innovative therapies relates, in part, to flawed preclinical research methodology, including lack of rigour in trial design, incomplete invasive hemodynamic assessment, and lack of careful translational studies that replicate randomized controlled trials in humans with attention to adverse effects and benefits. Rigorous methodology should include the use of prespecified eligibility criteria, sample sizes that permit valid statistical analysis, randomization, blinded assessment of standardized outcomes, and transparent reporting of results. Better design and implementation of preclinical studies can minimize inherent flaws in the models of PAH, reduce the risk of bias, and enhance external validity and our ability to distinguish truly promising therapies form many false-positive or overstated leads. Ideally, preclinical studies should use advanced imaging, study several preclinical pulmonary hypertension models, or correlate rodent and human findings and consider the fate of the right ventricle, which is the major determinant of prognosis in human PAH. Although these principles are widely endorsed, empirical evidence suggests that such rigor is often lacking in pulmonary hypertension preclinical research. The present article discusses the pitfalls in the design of preclinical pulmonary hypertension trials and discusses opportunities to create preclinical trials with improved predictive value in guiding early-phase drug development in patients with PAH, which will need support not only from researchers, peer reviewers, and editors but also from academic institutions, funding agencies, and animal ethics authorities. © 2018 American Heart Association, Inc.

A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation

PubMed Central

Acosta, Joie D.; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S.

2017-01-01

Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014–2015 school year. The study’s rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area. PMID:28936104

Chinese Students' Satisfaction of the Study Abroad Experience

ERIC Educational Resources Information Center

Wang, Qinggang; Taplin, Ross; Brown, Alistair M.

2011-01-01

Purpose: Building upon McLeod and Wainwright's paradigm for rigorous scientific assessment of study abroad programs, this paper aims to use social learning theory to assess mainland Chinese students' satisfaction of the Chinese Curtin Student Accounting Academic Programme. Design/methodology/approach: A sample of mainland Chinese students enrolled…

The Relevancy of Large-Scale, Quantitative Methodologies in Middle Grades Education Research

ERIC Educational Resources Information Center

Mertens, Steven B.

2006-01-01

This article examines the relevancy of large-scale, quantitative methodologies in middle grades education research. Based on recommendations from national advocacy organizations, the need for more large-scale, quantitative research, combined with the application of more rigorous methodologies, is presented. Subsequent sections describe and discuss…

A METHODOLOGY FOR ESTIMATING UNCERTAINTY OF A DISTRIBUTED HYDROLOGIC MODEL: APPLICATION TO POCONO CREEK WATERSHED

EPA Science Inventory

Utility of distributed hydrologic and water quality models for watershed management and sustainability studies should be accompanied by rigorous model uncertainty analysis. However, the use of complex watershed models primarily follows the traditional {calibrate/validate/predict}...

What Is the Efficacy of Teaching Psychotherapy to Psychiatry Residents and Medical Students?

PubMed

Truong, Anh; Wu, Peter; Diez-Barroso, Ramon; Coverdale, John

2015-10-01

Because there are no formal reviews, the authors set out to identify and evaluate studies on teaching psychotherapy to psychiatry residents and medical students. PubMed, Embase, and PsycINFO were searched for papers with outcomes on teaching psychotherapy. Search terms included psychotherapy, teaching, residents, medical students, supportive, psychodynamic, cognitive, behavioral, learning, training, skills, competency, and mentalization. Nine studies were found that met inclusion criteria. There were seven studies of psychiatry residents and two of medical students. Only two of the research designs had comparison groups, and these were both randomized controlled trials, while seven of the other designs were pretest and posttest. Teaching methods, course content, and outcome measures varied widely across studies. Common methodological problems included a lack of control, low numbers of subjects as learners, and a lack of validity of the outcome measures. Only one of the studies was judged to be methodologically rigorous. These findings establish a priority for undertaking additional rigorously designed studies in evaluating the teaching of psychotherapy to psychiatry residents and medical students.

Systematic review of the quality of prognosis studies in systemic lupus erythematosus.

PubMed

Lim, Lily S H; Lee, Senq J; Feldman, Brian M; Gladman, Dafna D; Pullenayegum, Eleanor; Uleryk, Elizabeth; Silverman, Earl D

2014-10-01

Prognosis studies examine outcomes and/or seek to identify predictors or factors associated with outcomes. Many prognostic factors have been identified in systemic lupus erythematosus (SLE), but few have been consistently found across studies. We hypothesized that this is due to a lack of rigor of study designs. This study aimed to systematically assess the methodologic quality of prognosis studies in SLE. A search of prognosis studies in SLE was performed using MEDLINE and Embase, from January 1990 to June 2011. A representative sample of 150 articles was selected using a random number generator and assessed by 2 reviewers. Each study was assessed by a risk of bias tool according to 6 domains: study participation, study attrition, measurement of prognostic factors, measurement of outcomes, measurement/adjustment for confounders, and appropriateness of statistical analysis. Information about missing data was also collected. A cohort design was used in 71% of studies. High risk of bias was found in 65% of studies for confounders, 57% for study participation, 56% for attrition, 36% for statistical analyses, 20% for prognostic factors, and 18% for outcome. Missing covariate or outcome information was present in half of the studies. Only 6 studies discussed reasons for missing data and 2 imputed missing data. Lack of rigorous study design, especially in addressing confounding, study participation and attrition, and inadequately handled missing data, has limited the quality of prognosis studies in SLE. Future prognosis studies should be designed with consideration of these factors to improve methodologic rigor. Copyright © 2014 by the American College of Rheumatology.

Reconciling the Rigor-Relevance Dilemma in Intellectual Capital Research

ERIC Educational Resources Information Center

Andriessen, Daniel

2004-01-01

This paper raises the issue of research methodology for intellectual capital and other types of management research by focusing on the dilemma of rigour versus relevance. The more traditional explanatory approach to research often leads to rigorous results that are not of much help to solve practical problems. This paper describes an alternative…

Age Differences in Five Personality Domains across the Life Span

ERIC Educational Resources Information Center

Allemand, Mathias; Zimprich, Daniel; Hendriks, A. A. Jolijn

2008-01-01

The present study addresses the issue of age differences in 5 personality domains across the life span in a cross-sectional study. In contrast to most previous studies, the present study follows a methodologically more rigorous approach to warrant that age-related differences in personality structure and mean level can be meaningfully compared. It…

How Do Professional Learning Communities Foster Strong Career and Technical Education Programs of Study in Illinois Public High Schools?

ERIC Educational Resources Information Center

Custable, Wendy

2013-01-01

This research study examines how Illinois public high school Career and Technical Education educational leaders employ best practices in providing all students rigorous, relevant, and equitable learning experiences within a professional learning community structure. This study utilized a mixed method two-tier case study methodology. Tier one…

Comparative effectiveness research methodology using secondary data: A starting user's guide.

PubMed

Sun, Maxine; Lipsitz, Stuart R

2018-04-01

The use of secondary data, such as claims or administrative data, in comparative effectiveness research has grown tremendously in recent years. We believe that the current review can help investigators relying on secondary data to (1) gain insight into both the methodologies and statistical methods, (2) better understand the necessity of a rigorous planning before initiating a comparative effectiveness investigation, and (3) optimize the quality of their investigations. Specifically, we review concepts of adjusted analyses and confounders, methods of propensity score analyses, and instrumental variable analyses, risk prediction models (logistic and time-to-event), decision-curve analysis, as well as the interpretation of the P value and hypothesis testing. Overall, we hope that the current review article can help research investigators relying on secondary data to perform comparative effectiveness research better understand the necessity of a rigorous planning before study start, and gain better insight in the choice of statistical methods so as to optimize the quality of the research study. Copyright © 2017 Elsevier Inc. All rights reserved.

Innovative Mixed-Methods Research: Moving beyond Design Technicalities to Epistemological and Methodological Realizations

ERIC Educational Resources Information Center

Riazi, A. Mehdi

2016-01-01

Mixed-methods research (MMR), as an inter-discourse (quantitative and qualitative) methodology, can provide applied linguistics researchers the opportunity to draw on and integrate the strengths of the two research methodological approaches in favour of making more rigorous inferences about research problems. In this article, the argument is made…

The quality of the evidence base for clinical pathway effectiveness: room for improvement in the design of evaluation trials.

PubMed

Rotter, Thomas; Kinsman, Leigh; James, Erica; Machotta, Andreas; Steyerberg, Ewout W

2012-06-18

The purpose of this article is to report on the quality of the existing evidence base regarding the effectiveness of clinical pathway (CPW) research in the hospital setting. The analysis is based on a recently published Cochrane review of the effectiveness of CPWs. An integral component of the review process was a rigorous appraisal of the methodological quality of published CPW evaluations. This allowed the identification of strengths and limitations of the evidence base for CPW effectiveness. We followed the validated Cochrane Effective Practice and Organisation of Care Group (EPOC) criteria for randomized and non-randomized clinical pathway evaluations. In addition, we tested the hypotheses that simple pre-post studies tend to overestimate CPW effects reported. Out of the 260 primary studies meeting CPW content criteria, only 27 studies met the EPOC study design criteria, with the majority of CPW studies (more than 70 %) excluded from the review on the basis that they were simple pre-post evaluations, mostly comparing two or more annual patient cohorts. Methodologically poor study designs are often used to evaluate CPWs and this compromises the quality of the existing evidence base. Cochrane EPOC methodological criteria, including the selection of rigorous study designs along with detailed descriptions of CPW development and implementation processes, are recommended for quantitative evaluations to improve the evidence base for the use of CPWs in hospitals.

Returning to Work after Cancer: Quantitative Studies and Prototypical Narratives

PubMed Central

Steiner, John F.; Nowels, Carolyn T.; Main, Deborah S.

2009-01-01

Objective A combination of quantitative data and illustrative narratives may allow cancer survivorship researchers to disseminate their research findings more broadly. We identified recent, methodologically rigorous quantitative studies on return to work after cancer, summarized the themes from these studies, and illustrated those themes with narratives of individual cancer survivors. Methods We reviewed English-language studies of return to work for adult cancer survivors through June, 2008, and identified 13 general themes from papers that met methodological criteria (population-based sampling, prospective and longitudinal assessment, detailed assessment of work, evaluation of economic impact, assessment of moderators of work return, and large sample size). We drew survivorship narratives from a prior qualitative research study to illustrate these themes. Results Nine quantitative studies met 4 or more of our 6 methodological criteria. These studies suggested that most cancer survivors could return to work without residual disabilities. Cancer site, clinical prognosis, treatment modalities, socioeconomic status, and attributes of the job itself influenced the likelihood of work return. Three narratives - a typical survivor who returned to work after treatment, an individual unable to return to work, and an inspiring survivor who returned to work despite substantial barriers - illustrated many of the themes from the quantitative literature while providing additional contextual details. Conclusion Illustrative narratives can complement the findings of cancer survivorship research if researchers are rigorous and transparent in the selection, analysis, and retelling of those stories. PMID:19507264

Rigorous, robust and systematic: Qualitative research and its contribution to burn care. An integrative review.

PubMed

Kornhaber, Rachel Anne; de Jong, A E E; McLean, L

2015-12-01

Qualitative methods are progressively being implemented by researchers for exploration within healthcare. However, there has been a longstanding and wide-ranging debate concerning the relative merits of qualitative research within the health care literature. This integrative review aimed to exam the contribution of qualitative research in burns care and subsequent rehabilitation. Studies were identified using an electronic search strategy using the databases PubMed, Cumulative Index of Nursing and Allied Health Literature (CINAHL), Excerpta Medica database (EMBASE) and Scopus of peer reviewed primary research in English between 2009 to April 2014 using Whittemore and Knafl's integrative review method as a guide for analysis. From the 298 papers identified, 26 research papers met the inclusion criteria. Across all studies there was an average of 22 participants involved in each study with a range of 6-53 participants conducted across 12 nations that focussed on burns prevention, paediatric burns, appropriate acquisition and delivery of burns care, pain and psychosocial implications of burns trauma. Careful and rigorous application of qualitative methodologies promotes and enriches the development of burns knowledge. In particular, the key elements in qualitative methodological process and its publication are critical in disseminating credible and methodologically sound qualitative research. Copyright © 2015 Elsevier Ltd and ISBI. All rights reserved.

Recommendations for Writing Case Study Articles for Publication in the "Journal of College Counseling"

ERIC Educational Resources Information Center

Scholl, Mark B.

2017-01-01

The author presents recommendations for writing case studies for publication in the "Journal of College Counseling." Recommendations fall into 2 categories: (a) ethical considerations and (b) criteria essential to methodological rigor (e.g., Hyett, Kenny, & Dickson-Swift, 2014). The article is intended to guide and encourage…

76 FR 32971 - Proposed Priority for the Disability and Rehabilitation Research Projects and Centers Program

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-07

... and systematic search of the research literature on a topic for relevant studies, which are then evaluated using pre-determined, objective criteria for relevance and methodological rigor. In a systematic review, the evidence from relevant studies that meet the pre-determined criteria is then analyzed and...

A Methodological Self-Study of Quantitizing: Negotiating Meaning and Revealing Multiplicity

ERIC Educational Resources Information Center

Seltzer-Kelly, Deborah; Westwood, Sean J.; Pena-Guzman, David M.

2012-01-01

This inquiry developed during the process of "quantitizing" qualitative data the authors had gathered for a mixed methods curriculum efficacy study. Rather than providing the intended rigor to their data coding process, their use of an intercoder reliability metric prompted their investigation of the multiplicity and messiness that, as they…

A methodology for the rigorous verification of plasma simulation codes

NASA Astrophysics Data System (ADS)

Riva, Fabio

2016-10-01

The methodology used to assess the reliability of numerical simulation codes constitutes the Verification and Validation (V&V) procedure. V&V is composed by two separate tasks: the verification, which is a mathematical issue targeted to assess that the physical model is correctly solved, and the validation, which determines the consistency of the code results, and therefore of the physical model, with experimental data. In the present talk we focus our attention on the verification, which in turn is composed by the code verification, targeted to assess that a physical model is correctly implemented in a simulation code, and the solution verification, that quantifies the numerical error affecting a simulation. Bridging the gap between plasma physics and other scientific domains, we introduced for the first time in our domain a rigorous methodology for the code verification, based on the method of manufactured solutions, as well as a solution verification based on the Richardson extrapolation. This methodology was applied to GBS, a three-dimensional fluid code based on a finite difference scheme, used to investigate the plasma turbulence in basic plasma physics experiments and in the tokamak scrape-off layer. Overcoming the difficulty of dealing with a numerical method intrinsically affected by statistical noise, we have now generalized the rigorous verification methodology to simulation codes based on the particle-in-cell algorithm, which are employed to solve Vlasov equation in the investigation of a number of plasma physics phenomena.

Systematic review of communication partner training in aphasia: methodological quality.

PubMed

Cherney, Leora R; Simmons-Mackie, Nina; Raymer, Anastasia; Armstrong, Elizabeth; Holland, Audrey

2013-10-01

Twenty-three studies identified from a previous systematic review examining the effects of communication partner training on persons with aphasia and their communication partners were evaluated for methodological quality. Two reviewers rated the studies on defined methodological quality criteria relevant to each study design. There were 11 group studies, seven single-subject participant design studies, and five qualitative studies. Quality scores were derived for each study. The mean inter-rater reliability of scores for each study design ranged from 85-93%, with Cohen's Kappa indicating substantial agreement between raters. Methodological quality of research on communication partner training in aphasia was highly varied. Overall, group studies employed the least rigorous methodology as compared to single subject and qualitative research. Only two of 11 group studies complied with more than half of the quality criteria. No group studies reported therapist blinding and only one group study reported participant blinding. Across all types of studies, the criterion of treatment fidelity was most commonly omitted. Failure to explicitly report certain methodological quality criteria may account for low ratings. Using methodological rating scales specific to the type of study design may help improve the methodological quality of aphasia treatment studies, including those on communication partner training.

Defining quantitative stream disturbance gradients and the additive role of habitat variation to explain macroinvertebrate taxa richness

EPA Science Inventory

Most studies dealing with the use of ecological indicators and other applied ecological research relies on some definition or concept of what constitutes least-, intermediate- and most-disturbed condition. Currently, most rigorous methodologies designed to define those conditions...

Contributing Meaning to Research in Developmental Disabilities: Integrating Participatory Action and Methodological Rigor

ERIC Educational Resources Information Center

Powers, Laurie E.

2017-01-01

Action research approaches reflecting power sharing by academic and community researchers, full engagement of community partners across all study phases, and ongoing commitment to partnership and capacity building have been increasingly embraced, particularly in research affecting marginalized populations. Findings suggest action research…

On optics of human meridians

NASA Astrophysics Data System (ADS)

Yang, Hongqin; Xie, Shusen; Li, Hui; Wang, Yuhua

2009-04-01

A new concept and its methodology for studying human meridians are presented based on rigorous and scientific observation on the objective existence of human meridians in view of biomedical optics. According to this methodology, the infrared radiant characteristics of acupuncture meridians over human body and the optical transport properties of light propagating along the meridian are reported. This study, thus, confirms the existence of acupuncture meridians, sheds new light on an approach to investigation of human meridians and offers a new perspective in understanding the potential meridian functions such as energy and information transfer and physiological regulation.

Simulation-Based Probabilistic Tsunami Hazard Analysis: Empirical and Robust Hazard Predictions

NASA Astrophysics Data System (ADS)

De Risi, Raffaele; Goda, Katsuichiro

2017-08-01

Probabilistic tsunami hazard analysis (PTHA) is the prerequisite for rigorous risk assessment and thus for decision-making regarding risk mitigation strategies. This paper proposes a new simulation-based methodology for tsunami hazard assessment for a specific site of an engineering project along the coast, or, more broadly, for a wider tsunami-prone region. The methodology incorporates numerous uncertain parameters that are related to geophysical processes by adopting new scaling relationships for tsunamigenic seismic regions. Through the proposed methodology it is possible to obtain either a tsunami hazard curve for a single location, that is the representation of a tsunami intensity measure (such as inundation depth) versus its mean annual rate of occurrence, or tsunami hazard maps, representing the expected tsunami intensity measures within a geographical area, for a specific probability of occurrence in a given time window. In addition to the conventional tsunami hazard curve that is based on an empirical statistical representation of the simulation-based PTHA results, this study presents a robust tsunami hazard curve, which is based on a Bayesian fitting methodology. The robust approach allows a significant reduction of the number of simulations and, therefore, a reduction of the computational effort. Both methods produce a central estimate of the hazard as well as a confidence interval, facilitating the rigorous quantification of the hazard uncertainties.

Control group design: enhancing rigor in research of mind-body therapies for depression.

PubMed

Kinser, Patricia Anne; Robins, Jo Lynne

2013-01-01

Although a growing body of research suggests that mind-body therapies may be appropriate to integrate into the treatment of depression, studies consistently lack methodological sophistication particularly in the area of control groups. In order to better understand the relationship between control group selection and methodological rigor, we provide a brief review of the literature on control group design in yoga and tai chi studies for depression, and we discuss challenges we have faced in the design of control groups for our recent clinical trials of these mind-body complementary therapies for women with depression. To address the multiple challenges of research about mind-body therapies, we suggest that researchers should consider 4 key questions: whether the study design matches the research question; whether the control group addresses performance, expectation, and detection bias; whether the control group is ethical, feasible, and attractive; and whether the control group is designed to adequately control for nonspecific intervention effects. Based on these questions, we provide specific recommendations about control group design with the goal of minimizing bias and maximizing validity in future research.

Control Group Design: Enhancing Rigor in Research of Mind-Body Therapies for Depression

PubMed Central

Kinser, Patricia Anne; Robins, Jo Lynne

2013-01-01

Although a growing body of research suggests that mind-body therapies may be appropriate to integrate into the treatment of depression, studies consistently lack methodological sophistication particularly in the area of control groups. In order to better understand the relationship between control group selection and methodological rigor, we provide a brief review of the literature on control group design in yoga and tai chi studies for depression, and we discuss challenges we have faced in the design of control groups for our recent clinical trials of these mind-body complementary therapies for women with depression. To address the multiple challenges of research about mind-body therapies, we suggest that researchers should consider 4 key questions: whether the study design matches the research question; whether the control group addresses performance, expectation, and detection bias; whether the control group is ethical, feasible, and attractive; and whether the control group is designed to adequately control for nonspecific intervention effects. Based on these questions, we provide specific recommendations about control group design with the goal of minimizing bias and maximizing validity in future research. PMID:23662111

Studying Sexual Aggression: A Review of the Evolution and Validity of Laboratory Paradigms

PubMed Central

Davis, Kelly Cue; George, William H.; Nagayama Hall, Gordon C.; Parrott, Dominic J.; Tharp, Andra Teten; Stappenbeck, Cynthia A.

2018-01-01

Objective Researchers have endeavored for decades to develop and implement experimental assessments of sexual aggression and its precursors to capitalize on the many scientific advantages offered by laboratory experiments, such as rigorous control of key variables and identification of causal relationships. The purpose of this review is to provide an overview of and commentary on the evolution of these laboratory-based methods. Conclusions To date, two primary types of sexual aggression laboratory studies have been developed: those that involve behavioral analogues of sexual aggression and those that assess postulated precursors to sexually aggressive behavior. Although the study of sexual aggression in the laboratory is fraught with methodological challenges, validity concerns, and ethical considerations, advances in the field have resulted in greater methodological rigor, more precise dependent measures, and improved experimental validity, reliability, and realism. Because highly effective sexual aggression prevention strategies remain elusive, continued laboratory-based investigation of sexual aggression coupled with translation of critical findings to the development and modification of sexual aggression prevention programs remains an important task for the field. PMID:29675289

Advances in Families and Health Research in the 21st Century

ERIC Educational Resources Information Center

Carr, Deborah; Springer, Kristen W.

2010-01-01

We review research on families and health published between 2000 and 2009 and highlight key themes and findings from innovative, methodologically rigorous studies. Whereas research in prior decades focused primarily on whether family structure affects child and adult health, contemporary research examines the contextual and processual factors that…

School Uniforms: A Qualitative Analysis of Aims and Accomplishments at Two Christian Schools

ERIC Educational Resources Information Center

Firmin, Michael; Smith, Suzanne; Perry, Lynsey

2006-01-01

Employing rigorous qualitative research methodology, we studied the implementation of two schools' uniform policies. Their primary intents were to eliminate competition, teach young people to dress appropriately, decrease nonacademic distractions, and lower the parental clothing costs. The young people differed with adults regarding whether or not…

Relationship of Evidence-Based Practice and Treatments: A Survey of Community Mental Health Providers

ERIC Educational Resources Information Center

DiMeo, Michelle A.; Moore, G. Kurt; Lichtenstein, Carolyn

2012-01-01

Evidence-based treatments (EBTs) are "interventions" that have been proven effective through rigorous research methodologies. Evidence-based practice (EBP), however, refers to a "decision-making process" that integrates the best available research, clinician expertise, and client characteristics. This study examined community mental health service…

When is good, good enough? Methodological pragmatism for sustainable guideline development.

PubMed

Browman, George P; Somerfield, Mark R; Lyman, Gary H; Brouwers, Melissa C

2015-03-06

Continuous escalation in methodological and procedural rigor for evidence-based processes in guideline development is associated with increasing costs and production delays that threaten sustainability. While health research methodologists are appropriately responsible for promoting increasing rigor in guideline development, guideline sponsors are responsible for funding such processes. This paper acknowledges that other stakeholders in addition to methodologists should be more involved in negotiating trade-offs between methodological procedures and efficiency in guideline production to produce guidelines that are 'good enough' to be trustworthy and affordable under specific circumstances. The argument for reasonable methodological compromise to meet practical circumstances is consistent with current implicit methodological practice. This paper proposes a conceptual tool as a framework to be used by different stakeholders in negotiating, and explicitly reporting, reasonable compromises for trustworthy as well as cost-worthy guidelines. The framework helps fill a transparency gap in how methodological choices in guideline development are made. The principle, 'when good is good enough' can serve as a basis for this approach. The conceptual tool 'Efficiency-Validity Methodological Continuum' acknowledges trade-offs between validity and efficiency in evidence-based guideline development and allows for negotiation, guided by methodologists, of reasonable methodological compromises among stakeholders. Collaboration among guideline stakeholders in the development process is necessary if evidence-based guideline development is to be sustainable.

Teaching Mathematical Word Problem Solving: The Quality of Evidence for Strategy Instruction Priming the Problem Structure

ERIC Educational Resources Information Center

Jitendra, Asha K.; Petersen-Brown, Shawna; Lein, Amy E.; Zaslofsky, Anne F.; Kunkel, Amy K.; Jung, Pyung-Gang; Egan, Andrea M.

2015-01-01

This study examined the quality of the research base related to strategy instruction priming the underlying mathematical problem structure for students with learning disabilities and those at risk for mathematics difficulties. We evaluated the quality of methodological rigor of 18 group research studies using the criteria proposed by Gersten et…

Mental Disorders among Gifted and Nongifted Youth: A Selected Review of the Epidemiologic Literature

ERIC Educational Resources Information Center

Martin, Laurie T.; Burns, Rachel M.; Schonlau, Matthias

2010-01-01

Given the ongoing debate over whether giftedness is associated with mental health disorders, there is a great need to highlight and compare results from the most methodologically rigorous studies. Surprisingly, the vast majority of literature reviews and background sections of research articles include studies that do not directly compare gifted…

Evidence-Based Psychosocial Treatments for Children and Adolescents Exposed to Traumatic Events

ERIC Educational Resources Information Center

Silverman, Wendy K.; Ortiz, Claudio D.; Viswesvaran, Chockalingham; Burns, Barbara J.; Kolko, David J.; Putnam, Frank W.; Amaya-Jackson, Lisa

2008-01-01

The article reviews the current status (1993-2007) of psychosocial treatments for children and adolescents who have been exposed to traumatic events. Twenty-one treatment studies are evaluated using criteria from Nathan and Gorman (2002) along a continuum of methodological rigor ranging from Type 1 to Type 6. All studies were, at a minimum, robust…

Evidence-Based Psychosocial Treatments for Phobic and Anxiety Disorders in Children and Adolescents

ERIC Educational Resources Information Center

Silverman, Wendy K.; Pina, Armando A.; Viswesvaran, Chockalingam

2008-01-01

The article reviews psychosocial treatments for phobic and anxiety disorders in youth. Using criteria from Nathan and Gorman (2002), 32 studies are evaluated along a continuum of methodological rigor. In addition, the treatments evaluated in each of the 32 studies are classified according to Chambless et al.'s (1996) and Chambless and Hollon's…

Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles

PubMed Central

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-01-01

Objectives Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. Data Sources All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. Study Design All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Principal Findings Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ2(1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ2(1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Conclusion Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports. PMID:22092040

The importance of stories in understanding people's relationship to food: narrative inquiry methodology has much to offer the public health nutrition researcher and practitioner.

PubMed

O'Kane, Gabrielle; Pamphilon, Barbara

2016-03-01

Despite the usefulness of quantitative research, qualitative research methodologies are equally needed to allow researchers to better understand the important social and environmental factors affecting food choice and eating habits. The present paper contributes insights from narrative inquiry, a well-established qualitative methodology, to a food-related doctoral research study. The connections between food shoppers and the producer, family, friends and others in the food system, between eaters and the earth, and how these connections affect people's meaning-making of food and pathways to food citizenship, were explored in the research. The research used narrative inquiry methodology and focus groups for data collection. Five different food-ways in the Canberra region of Australia were selected for the present research; that is, community gardens, community-supported agriculture, farmers' markets, fresh food markets and supermarkets. Fifty-two people voluntarily attended eight focus groups with four to nine participants in each. From a practical perspective, the present paper offers a guide to the way in which narrative inquiry has been applied to one research project. The paper describes the application of narrative inquiry methodology, revealing the important place of narratives in generating new knowledge. The paper further outlines how phased narrative analysis can lead to a defensible and rigorous interpretive framework grounded in the data generated from people's stories and meaning-making. We argue that individual, social and system change will not be possible without further rigorous qualitative studies to inform and complement the empirical basis of public health nutrition practice.

Systematic reviews and meta-analyses on treatment of asthma: critical evaluation

PubMed Central

Jadad, Alejandro R; Moher, Michael; Browman, George P; Booker, Lynda; Sigouin, Christopher; Fuentes, Mario; Stevens, Robert

2000-01-01

Objective To evaluate the clinical, methodological, and reporting aspects of systematic reviews and meta-analyses on the treatment of asthma and to compare those published by the Cochrane Collaboration with those published in paper based journals. Design Analysis of studies identified from Medline, CINAHL, HealthSTAR, EMBASE, Cochrane Library, personal collections, and reference lists. Studies Articles describing a systematic review or a meta-analysis of the treatment of asthma that were published as a full report, in any language or format, in a peer reviewed journal or the Cochrane Library. Main outcome measures General characteristics of studies reviewed and methodological characteristics (sources of articles; language restrictions; format, design, and publication status of studies included; type of data synthesis; and methodological quality). Results 50 systematic reviews and meta-analyses were included. More than half were published in the past two years. Twelve reviews were published in the Cochrane Library and 38 were published in 22 peer reviewed journals. Forced expiratory volume in one second was the most frequently used outcome, but few reviews evaluated the effect of treatment on costs or patient preferences. Forty reviews were judged to have serious or extensive flaws. All six reviews associated with industry were in this group. Seven of the 10 most rigorous reviews were published in the Cochrane Library. Conclusions Most reviews published in peer reviewed journals or funded by industry have serious methodological flaws that limit their value to guide decisions. Cochrane reviews are more rigorous and better reported than those published in peer reviewed journals. PMID:10688558

A systematic review of grounded theory studies in physiotherapy.

PubMed

Ali, Nancy; May, Stephen; Grafton, Kate

2018-05-23

This systematic review aimed at appraising the methodological rigor of grounded theory research published in the field of physiotherapy to assess how the methodology is understood and applied. A secondary aim was to provide research implications drawn from the findings to guide future grounded theory methodology (GTM) research. A systematic search was conducted in MEDLINE, CINHAL, SPORT Discus, Science Direct, PubMed, Scopus, and Web of Science to identify studies in the field of physiotherapy that reported using GTM and/or methods in the study title and/or abstract. The descriptive characteristics and methodological quality of eligible studies were examined using grounded theory methodology assessment guidelines. The review included 68 studies conducted between 1998 and 2017. The findings showed that GTM is becoming increasingly used by physiotherapy researchers. Thirty-six studies (53%) demonstrated a good understanding and appropriate application of GTM. Thirty-two studies (47%) presented descriptive findings and were considered to be of poor methodological quality. There are several key tenets of GTM that are integral to the iterative process of qualitative theorizing and need to be applied throughout all research practices including sampling, data collection, and analysis.

Creativity and psychopathology: a systematic review.

PubMed

Thys, Erik; Sabbe, Bernard; De Hert, Marc

2014-01-01

The possible link between creativity and psychopathology has been a long-time focus of research up to the present day. However, the research results in this field are heterogeneous and contradictory. Links between creativity and specific psychiatric disorders have been confirmed and refuted in different studies. This disparity is partly explained by the methodological challenges peculiar to this field. In this systematic review of the literature from 1950, research articles in the field of creativity and psychopathology are presented, focusing on the methodology and results of the collected studies. This review confirms the methodological problems and the heterogeneity of the study designs and results. The assessment of psychopathology, but more so of creativity, remains a fundamental challenge. On the whole, study results cautiously confirm an association between creativity and both bipolar disorder and schizotypy. The research on creativity and psychopathology is hampered by serious methodological problems. Study results are to be interpreted with caution and future research needs more methodological rigor. © 2014 S. Karger AG, Basel.

Methodological quality and scientific impact of quantitative nursing education research over 18 months.

PubMed

Yucha, Carolyn B; Schneider, Barbara St Pierre; Smyer, Tish; Kowalski, Susan; Stowers, Eva

2011-01-01

The methodological quality of nursing education research has not been rigorously studied. The purpose of this study was to evaluate the methodological quality and scientific impact of nursing education research reports. The methodological quality of 133 quantitative nursing education research articles published between July 2006 and December 2007 was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).The mean (+/- SD) MERSQI score was 9.8 +/- 2.2. It correlated (p < .05) with several scientific impact indicators: citation counts from Scopus (r = .223), Google Scholar (r = .224), and journal impact factor (r = .216); it was not associated with Web of Science citation count, funding, or h Index. The similarities between this study's MERSQI ratings for nursing literature and those reported for the medical literature, coupled with the association with citation counts, suggest that the MERSQI is an appropriate instrument to evaluate the quality of nursing education research.

Methodology discourses as boundary work in the construction of engineering education.

PubMed

Beddoes, Kacey

2014-04-01

Engineering education research is a new field that emerged in the social sciences over the past 10 years. This analysis of engineering education research demonstrates that methodology discourses have played a central role in the construction and development of the field of engineering education, and that they have done so primarily through boundary work. This article thus contributes to science and technology studies literature by examining the role of methodology discourses in an emerging social science field. I begin with an overview of engineering education research before situating the case within relevant bodies of literature on methodology discourses and boundary work. I then identify two methodology discourses--rigor and methodological diversity--and discuss how they contribute to the construction and development of engineering education research. The article concludes with a discussion of how the findings relate to prior research on methodology discourses and boundary work and implications for future research.

The Applicability of Course Experience Questionnaire for a Malaysian University Context

ERIC Educational Resources Information Center

Thien, Lei Mee; Ong, Mei Yean

2016-01-01

Purpose: The purpose of this study is to examine the applicability of Course Experience Questionnaire (CEQ) in a Malaysian university context. Design/methodology/approach: The CEQ was translated into Malay language using rigorous cross-cultural adaptation procedures. The Malay version CEQ was administered to 190 undergraduate students in one…

Undertaking Experiments in Social Sciences: Sequential, Multiple Time Series Designs for Consideration

ERIC Educational Resources Information Center

Phan, Huy P.; Ngu, Bing H.

2017-01-01

In social sciences, the use of stringent methodological approaches is gaining increasing emphasis. Researchers have recognized the limitations of cross-sectional, non-manipulative data in the study of causality. True experimental designs, in contrast, are preferred as they represent rigorous standards for achieving causal flows between variables.…

Uncovering the Psychometric Properties of Scales Measuring Individualist and Collectivist Orientations

ERIC Educational Resources Information Center

Paquet, Stephanie L.; Kline, Theresa J. B.

2009-01-01

Cross-cultural research in many psychology-related fields is becoming commonplace. To further the research in a methodologically rigorous fashion it is critical to be able to measure adequately the constructs under investigation. This study (N = 238) examined three measures used to assess individualist and collectivist orientations. The internal…

Assessing Student Achievement in Large-Scale Educational Programs Using Hierarchical Propensity Scores

ERIC Educational Resources Information Center

Vaughan, Angela L.; Lalonde, Trent L.; Jenkins-Guarnieri, Michael A.

2014-01-01

Many researchers assessing the efficacy of educational programs face challenges due to issues with non-randomization and the likelihood of dependence between nested subjects. The purpose of the study was to demonstrate a rigorous research methodology using a hierarchical propensity score matching method that can be utilized in contexts where…

Sex Differences in the Response of Children with ADHD to Once-Daily Formulations of Methylphenidate

ERIC Educational Resources Information Center

Sonuga-Barke, J. S.; Coghill, David; Markowitz, John S.; Swanson, James M.; Vandenberghe, Mieke; Hatch, Simon J.

2007-01-01

Objectives: Studies of sex differences in methylphenidate response by children with attention-deficit/hyperactivity disorder have lacked methodological rigor and statistical power. This paper reports an examination of sex differences based on further analysis of data from a comparison of two once-daily methylphenidate formulations (the COMACS…

Examining Foundations of Qualitative Research: A Review of Social Work Dissertations, 2008-2010

ERIC Educational Resources Information Center

Gringeri, Christina; Barusch, Amanda; Cambron, Christopher

2013-01-01

This study examined the treatment of epistemology and methodological rigor in qualitative social work dissertations. Template-based review was conducted on a random sample of 75 dissertations completed between 2008 and 2010. For each dissertation, we noted the presence or absence of four markers of epistemology: theory, paradigm, reflexivity, and…

A Review of Interventions To Increase Driving Safety among Teenage Drivers.

ERIC Educational Resources Information Center

Mattox, John R., II

Young drivers across the United States represent a persistent traffic safety problem. Many interventions have been imposed on these drivers but few studies have evaluated the impact of these interventions on risky behaviors or traffic safety measures. To fill this gap, a review was undertaken to examine the most rigorous methodological evaluations…

Practice as Research: A Fine Art Contextual Study

ERIC Educational Resources Information Center

Adams, Suze

2014-01-01

This paper examines the dynamic interplay between practice and theory in practice-led research in the visual arts. Building on recent debate around the issue and following appropriately rigorous models, the importance of locating a suitable methodology to adequately reflect the integrated process of research practice in written as well as visual…

A Study of Best Practices in Training Transfer and Proposed Model of Transfer

ERIC Educational Resources Information Center

Burke, Lisa A.; Hutchins, Holly M.

2008-01-01

Data were gathered from a sample of training professionals of an American Society of Training and Development (ASTD) chapter in the southern United States regarding best practices for supporting training transfer. Content analysis techniques, based on a rigorous methodology proposed by Insch, Moore, & Murphy (1997), were used to analyze the…

The translation and cultural adaptation of the Child Behavior Checklist for use in Israel (Hebrew), Korea, the US (Spanish), India (Malayalam and Kannada), and Spain

PubMed Central

Wild, Diane; Furtado, Tamzin; Angalakuditi, Mallik

2012-01-01

Background The Child Behavior Checklist (CBCL) is a caregiver rating scale for assessing the behavioral profile of children. It was developed in the US, and has been extensively translated and used in a large number of studies internationally. Objective The objective of this study was to translate the CBCL into six languages using a rigorous translation methodology, placing particular emphasis on cultural adaptation and ensuring that the measure has content validity with carers of children with epilepsy. Methods A rigorous translation and cultural adaptation methodology was used. This is a process which includes two forward translations, reconciliation, two back-translations, and cognitive debriefing interviews with five carers of children with epilepsy in each country. In addition, a series of open-ended questions were asked of the carers in order to provide evidence of content validity. Results A number of cultural adaptations were made during the translation process. This included adaptations to the examples of sports and hobbies. An addition of “milk delivery” was made to the job examples in the Malayalam translation. In addition, two sexual problem items were removed from the Hebrew translation for Israel. Conclusion An additional six translations of the CBCL are now available for use in multinational studies. These translations have evidence of content validity for use with parents of children with epilepsy and have been appropriately culturally adapted so that they are acceptable for use in the target countries. The study highlights the importance of a rigorous translation process and the process of cultural adaptation. PMID:22715318

The Specificity of Observational Studies in Physical Activity and Sports Sciences: Moving Forward in Mixed Methods Research and Proposals for Achieving Quantitative and Qualitative Symmetry.

PubMed

Anguera, M Teresa; Camerino, Oleguer; Castañer, Marta; Sánchez-Algarra, Pedro; Onwuegbuzie, Anthony J

2017-01-01

Mixed methods studies are been increasingly applied to a diversity of fields. In this paper, we discuss the growing use-and enormous potential-of mixed methods research in the field of sport and physical activity. A second aim is to contribute to strengthening the characteristics of mixed methods research by showing how systematic observation offers rigor within a flexible framework that can be applied to a wide range of situations. Observational methodology is characterized by high scientific rigor and flexibility throughout its different stages and allows the objective study of spontaneous behavior in natural settings, with no external influence. Mixed methods researchers need to take bold yet thoughtful decisions regarding both substantive and procedural issues. We present three fundamental and complementary ideas to guide researchers in this respect: we show why studies of sport and physical activity that use a mixed methods research approach should be included in the field of mixed methods research, we highlight the numerous possibilities offered by observational methodology in this field through the transformation of descriptive data into quantifiable code matrices, and we discuss possible solutions for achieving true integration of qualitative and quantitative findings.

Complicating Methodological Transparency

ERIC Educational Resources Information Center

Bridges-Rhoads, Sarah; Van Cleave, Jessica; Hughes, Hilary E.

2016-01-01

A historical indicator of the quality, validity, and rigor of qualitative research has been the documentation and disclosure of the behind-the-scenes work of the researcher. In this paper, we use what we call "methodological data" as a tool to complicate the possibility and desirability of such transparency. Specifically, we draw on our…

Understanding information exchange during disaster response: Methodological insights from infocentric analysis

Treesearch

Toddi A. Steelman; Branda Nowell; Deena Bayoumi; Sarah McCaffrey

2014-01-01

We leverage economic theory, network theory, and social network analytical techniques to bring greater conceptual and methodological rigor to understand how information is exchanged during disasters. We ask, "How can information relationships be evaluated more systematically during a disaster response?" "Infocentric analysis"—a term and...

What are scoping studies? A review of the nursing literature.

PubMed

Davis, Kathy; Drey, Nick; Gould, Dinah

2009-10-01

Scoping studies are increasingly undertaken as distinct activities. The interpretation, methodology and expectations of scoping are highly variable. This suggests that conceptually, scoping is a poorly defined ambiguous term. The distinction between scoping as an integral preliminary process in the development of a research proposal or a formative, methodologically rigorous activity in its own right has not been extensively examined. The aim of this review is to explore the nature and status of scoping studies within the nursing literature and develop a working definition to ensure consistency in the future use of scoping as a research related activity. This paper follows an interpretative scoping review methodology. An explicit systematic search strategy included literary and web-based key word searches and advice from key researchers. Electronic sources included bibliographic and national research register databases and a general browser. The scoping studies varied widely in terms of intent, procedural and methodological rigor. An atheoretical stance was common although explicit conceptual clarification and development of a topic was limited. Four different levels of inquiry ranging from preliminary descriptive surveys to more substantive conceptual approaches were conceptualised. These levels reflected differing dimensional distinctions in which some activities constitute research whereas in others the scoping activities appear to fall outside the remit of research. Reconnaissance emerges as a common synthesising construct to explain the purpose of scoping. Scoping studies in relation to nursing are embryonic and continue to evolve. Its main strengths lie in its ability to extract the essence of a diverse body of evidence giving it meaning and significance that is both developmental and intellectually creative. As with other approaches to research and evidence synthesis a more standardized approach is required.

Children's concepts of physical illness: a review and critique of the cognitive-developmental literature.

PubMed

Burbach, D J; Peterson, L

1986-01-01

Cognitive-developmental studies relevant to children's concepts of physical illness are reviewed and critiqued. Although numerous methodological weaknesses make firm conclusions difficult, most data appear to suggest that children's concepts of illness do evolve in a systematic and predictable sequence consistent with Piaget's theory of cognitive development. Methodological weaknesses identified include poor description of samples, assessment instruments, and procedures; lack of control over potential observer bias, expectancy effects, and other confounding variables; and minimal attention to reliability and validity issues. Increased methodological rigor and a further explication of the specific and unique ways in which children's concepts of illness develop over the course of cognitive development could substantially increase the value of these studies for professionals in pediatric health care settings.

How to do a grounded theory study: a worked example of a study of dental practices

PubMed Central

2011-01-01

Background Qualitative methodologies are increasingly popular in medical research. Grounded theory is the methodology most-often cited by authors of qualitative studies in medicine, but it has been suggested that many 'grounded theory' studies are not concordant with the methodology. In this paper we provide a worked example of a grounded theory project. Our aim is to provide a model for practice, to connect medical researchers with a useful methodology, and to increase the quality of 'grounded theory' research published in the medical literature. Methods We documented a worked example of using grounded theory methodology in practice. Results We describe our sampling, data collection, data analysis and interpretation. We explain how these steps were consistent with grounded theory methodology, and show how they related to one another. Grounded theory methodology assisted us to develop a detailed model of the process of adapting preventive protocols into dental practice, and to analyse variation in this process in different dental practices. Conclusions By employing grounded theory methodology rigorously, medical researchers can better design and justify their methods, and produce high-quality findings that will be more useful to patients, professionals and the research community. PMID:21902844

How to do a grounded theory study: a worked example of a study of dental practices.

PubMed

Sbaraini, Alexandra; Carter, Stacy M; Evans, R Wendell; Blinkhorn, Anthony

2011-09-09

Qualitative methodologies are increasingly popular in medical research. Grounded theory is the methodology most-often cited by authors of qualitative studies in medicine, but it has been suggested that many 'grounded theory' studies are not concordant with the methodology. In this paper we provide a worked example of a grounded theory project. Our aim is to provide a model for practice, to connect medical researchers with a useful methodology, and to increase the quality of 'grounded theory' research published in the medical literature. We documented a worked example of using grounded theory methodology in practice. We describe our sampling, data collection, data analysis and interpretation. We explain how these steps were consistent with grounded theory methodology, and show how they related to one another. Grounded theory methodology assisted us to develop a detailed model of the process of adapting preventive protocols into dental practice, and to analyse variation in this process in different dental practices. By employing grounded theory methodology rigorously, medical researchers can better design and justify their methods, and produce high-quality findings that will be more useful to patients, professionals and the research community.

Approaching the investigation of plasma turbulence through a rigorous verification and validation procedure: A practical example

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ricci, P., E-mail: paolo.ricci@epfl.ch; Riva, F.; Theiler, C.

In the present work, a Verification and Validation procedure is presented and applied showing, through a practical example, how it can contribute to advancing our physics understanding of plasma turbulence. Bridging the gap between plasma physics and other scientific domains, in particular, the computational fluid dynamics community, a rigorous methodology for the verification of a plasma simulation code is presented, based on the method of manufactured solutions. This methodology assesses that the model equations are correctly solved, within the order of accuracy of the numerical scheme. The technique to carry out a solution verification is described to provide a rigorousmore » estimate of the uncertainty affecting the numerical results. A methodology for plasma turbulence code validation is also discussed, focusing on quantitative assessment of the agreement between experiments and simulations. The Verification and Validation methodology is then applied to the study of plasma turbulence in the basic plasma physics experiment TORPEX [Fasoli et al., Phys. Plasmas 13, 055902 (2006)], considering both two-dimensional and three-dimensional simulations carried out with the GBS code [Ricci et al., Plasma Phys. Controlled Fusion 54, 124047 (2012)]. The validation procedure allows progress in the understanding of the turbulent dynamics in TORPEX, by pinpointing the presence of a turbulent regime transition, due to the competition between the resistive and ideal interchange instabilities.« less

Methodological reporting in qualitative, quantitative, and mixed methods health services research articles.

PubMed

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-04-01

Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ(2) (1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ(2) (1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports. © Health Research and Educational Trust.

The state of research on the effects of therapeutic touch.

PubMed

Easter, A

1997-06-01

Therapeutic Touch is investigated using an integrative review of the literature. Using Ganong's (1987) methodology, the article explores the research question, What is the state of development of research regarding Therapeutic Touch? by analyzing primary research reports from 23 articles in 14 referred journals. The findings of the review indicate positive regard for the use of Therapeutic Touch. All research points to the need for further study in this area. Research methods used are satisfactory, but more rigorous methodologies would promote a more scientific contribution to the body of literature on Therapeutic Touch.

The Navigation Guide Systematic Review Methodology: A Rigorous and Transparent Method for Translating Environmental Health Science into Better Health Outcomes

PubMed Central

Sutton, Patrice

2014-01-01

Background: Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. Objectives: We sought to develop a proof of concept of the “Navigation Guide,” a systematic and transparent method of research synthesis in environmental health. Discussion: The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of “risk of bias,” and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a “moderate” quality rating to human observational studies and combining diverse evidence streams. Conclusions: The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm. Citation: Woodruff TJ, Sutton P. 2014. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122:1007–1014; http://dx.doi.org/10.1289/ehp.1307175 PMID:24968373

[Radiotherapy phase I trials' methodology: Features].

PubMed

Rivoirard, R; Vallard, A; Langrand-Escure, J; Guy, J-B; Ben Mrad, M; Yaoxiong, X; Diao, P; Méry, B; Pigne, G; Rancoule, C; Magné, N

2016-12-01

In clinical research, biostatistical methods allow the rigorous analysis of data collection and should be defined from the trial design to obtain the appropriate experimental approach. Thus, if the main purpose of phase I is to determine the dose to use during phase II, methodology should be finely adjusted to experimental treatment(s). Today, the methodology for chemotherapy and targeted therapy is well known. For radiotherapy and chemoradiotherapy phase I trials, the primary endpoint must reflect both effectiveness and potential treatment toxicities. Methodology should probably be complex to limit failures in the following phases. However, there are very few data about methodology design in the literature. The present study focuses on these particular trials and their characteristics. It should help to raise existing methodological patterns shortcomings in order to propose new and better-suited designs. Copyright © 2016 Société française de radiothérapie oncologique (SFRO). Published by Elsevier SAS. All rights reserved.

Interventions to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA: a systematic review.

PubMed

Clifford, Anton; McCalman, Janya; Bainbridge, Roxanne; Tsey, Komla

2015-04-01

This article describes the characteristics and reviews the methodological quality of interventions designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA. A total of 17 electronic databases and 13 websites for the period of 2002-13. Studies were included if they evaluated an intervention strategy designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, the USA or Canada. Information on the characteristics and methodological quality of included studies was extracted using standardized assessment tools. Sixteen published evaluations of interventions to improve cultural competency in health care for Indigenous peoples were identified: 11 for Indigenous peoples of the USA and 5 for Indigenous Australians. The main types of intervention strategies were education and training of the health workforce, culturally specific health programs and recruitment of an Indigenous health workforce. Main positive outcomes reported were improvements in health professionals' confidence, and patients' satisfaction with and access to health care. The methodological quality of evaluations and the reporting of key methodological criteria were variable. Particular problems included weak study designs, low or no reporting of consent rates, confounding and non-validated measurement instruments. There is a lack of evidence from rigorous evaluations on the effectiveness of interventions for improving cultural competency in health care for Indigenous peoples. Future evaluations should employ more rigorous study designs and extend their measurement of outcomes beyond those relating to health professionals, to those relating to the health of Indigenous peoples. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

[A Methodological Quality Assessment of South Korean Nursing Research using Structural Equation Modeling in South Korea].

PubMed

Kim, Jung-Hee; Shin, Sujin; Park, Jin-Hwa

2015-04-01

The purpose of this study was to evaluate the methodological quality of nursing studies using structural equation modeling in Korea. Databases of KISS, DBPIA, and National Assembly Library up to March 2014 were searched using the MeSH terms 'nursing', 'structure', 'model'. A total of 152 studies were screened. After removal of duplicates and non-relevant titles, 61 papers were read in full. Of the sixty-one articles retrieved, 14 studies were published between 1992 and 2000, 27, between 2001 and 2010, and 20, between 2011 and March 2014. The methodological quality of the review examined varied considerably. The findings of this study suggest that more rigorous research is necessary to address theoretical identification, two indicator rule, distribution of sample, treatment of missing values, mediator effect, discriminant validity, convergent validity, post hoc model modification, equivalent models issues, and alternative models issues should be undergone. Further research with robust consistent methodological study designs from model identification to model respecification is needed to improve the validity of the research.

Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools

ERIC Educational Resources Information Center

Wendt, Oliver; Miller, Bridget

2012-01-01

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

Self-Management for Primary School Students Demonstrating Problem Behavior in Regular Classrooms: Evidence Review of Single-Case Design Research

ERIC Educational Resources Information Center

Busacca, Margherita L.; Anderson, Angelika; Moore, Dennis W.

2015-01-01

This review evaluates self-management literature targeting problem behaviors of primary school students in general education settings. Thirty-one single-case design studies met inclusion criteria, of which 16 demonstrated adequate methodological rigor, according to What Works Clearinghouse (WWC) design standards. Visual analysis and WWC…

Facts Are More Important than Novelty: Replication in the Education Sciences

ERIC Educational Resources Information Center

Makel, Matthew C.; Plucker, Jonathan A.

2014-01-01

Despite increased attention to methodological rigor in education research, the field has focused heavily on experimental design and not on the merit of replicating important results. The present study analyzed the complete publication history of the current top 100 education journals ranked by 5-year impact factor and found that only 0.13% of…

Updated Design Standards and Guidance from the What Works Clearinghouse: Regression Discontinuity Designs and Cluster Designs

ERIC Educational Resources Information Center

Cole, Russell; Deke, John; Seftor, Neil

2016-01-01

The What Works Clearinghouse (WWC) maintains design standards to identify rigorous, internally valid education research. As education researchers advance new methodologies, the WWC must revise its standards to include an assessment of the new designs. Recently, the WWC has revised standards for two emerging study designs: regression discontinuity…

Transmission and Prevention of Mood Disorders among Children of Affectively Ill Parents: A Review

ERIC Educational Resources Information Center

Beardslee, William R.; Gladstone, Tracy R. G.; O'Connor, Erin E.

2011-01-01

Objective: To provide a conceptual review of the literature on children of depressed parents over the past 12 years. Method: This selective review focused on published studies that delineate the diagnosis of depression in parents, have large samples, describe children 6 to 17 years old, and are methodologically rigorous. The review emphasized…

76 FR 51056 - Notice of Random Assignment Study To Evaluate the YouthBuild Program; Request for Comment

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-17

... assigned to the control group can re-apply to the YouthBuild program. The Department is soliciting comments... ``utilize appropriate methodology and research designs, including the use of control groups chosen by.... Accordingly, ETA is conducting a multisite control group evaluation to provide rigorous estimates [[Page 51058...

Applying Quality Indicators to Single-Case Research Designs Used in Special Education: A Systematic Review

ERIC Educational Resources Information Center

Moeller, Jeremy D.; Dattilo, John; Rusch, Frank

2015-01-01

This study examined how specific guidelines and heuristics have been used to identify methodological rigor associated with single-case research designs based on quality indicators developed by Horner et al. Specifically, this article describes how literature reviews have applied Horner et al.'s quality indicators and evidence-based criteria.…

Implementing Quality Criteria in Designing and Conducting a Sequential Quan [right arrow] Qual Mixed Methods Study of Student Engagement with Learning Applied Research Methods Online

ERIC Educational Resources Information Center

Ivankova, Nataliya V.

2014-01-01

In spite of recent methodological developments related to quality assurance in mixed methods research, practical examples of how to implement quality criteria in designing and conducting sequential QUAN [right arrow] QUAL mixed methods studies to ensure the process is systematic and rigorous remain scarce. This article discusses a three-step…

School Psychology as a Relational Enterprise: The Role and Process of Qualitative Methodology

ERIC Educational Resources Information Center

Newman, Daniel S.; Clare, Mary M.

2016-01-01

The purpose of this article is to explore the application of qualitative research to establishing a more complete understanding of relational processes inherent in school psychology practice. We identify the building blocks of rigorous qualitative research design through a conceptual overview of qualitative paradigms, methodologies, methods (i.e.,…

Staff Acceptance of Tele-ICU Coverage

PubMed Central

Chan, Paul S.; Cram, Peter

2011-01-01

Background: Remote coverage of ICUs is increasing, but staff acceptance of this new technology is incompletely characterized. We conducted a systematic review to summarize existing research on acceptance of tele-ICU coverage among ICU staff. Methods: We searched for published articles pertaining to critical care telemedicine systems (aka, tele-ICU) between January 1950 and March 2010 using PubMed, Cumulative Index to Nursing and Allied Health Literature, Global Health, Web of Science, and the Cochrane Library and abstracts and presentations delivered at national conferences. Studies were included if they provided original qualitative or quantitative data on staff perceptions of tele-ICU coverage. Studies were imported into content analysis software and coded by tele-ICU configuration, methodology, participants, and findings (eg, positive and negative staff evaluations). Results: Review of 3,086 citations yielded 23 eligible studies. Findings were grouped into four categories of staff evaluation: overall acceptance level of tele-ICU coverage (measured in 70% of studies), impact on patient care (measured in 96%), impact on staff (measured in 100%), and organizational impact (measured in 48%). Overall acceptance was high, despite initial ambivalence. Favorable impact on patient care was perceived by > 82% of participants. Staff impact referenced enhanced collaboration, autonomy, and training, although scrutiny, malfunctions, and contradictory advice were cited as potential barriers. Staff perceived the organizational impact to vary. An important limitation of available studies was a lack of rigorous methodology and validated survey instruments in many studies. Conclusions: Initial reports suggest high levels of staff acceptance of tele-ICU coverage, but more rigorous methodologic study is required. PMID:21051386

Disciplining Bioethics: Towards a Standard of Methodological Rigor in Bioethics Research

PubMed Central

Adler, Daniel; Shaul, Randi Zlotnik

2012-01-01

Contemporary bioethics research is often described as multi- or interdisciplinary. Disciplines are characterized, in part, by their methods. Thus, when bioethics research draws on a variety of methods, it crosses disciplinary boundaries. Yet each discipline has its own standard of rigor—so when multiple disciplinary perspectives are considered, what constitutes rigor? This question has received inadequate attention, as there is considerable disagreement regarding the disciplinary status of bioethics. This disagreement has presented five challenges to bioethics research. Addressing them requires consideration of the main types of cross-disciplinary research, and consideration of proposals aiming to ensure rigor in bioethics research. PMID:22686634

A Methodology for Conducting Integrative Mixed Methods Research and Data Analyses

PubMed Central

Castro, Felipe González; Kellison, Joshua G.; Boyd, Stephen J.; Kopak, Albert

2011-01-01

Mixed methods research has gained visibility within the last few years, although limitations persist regarding the scientific caliber of certain mixed methods research designs and methods. The need exists for rigorous mixed methods designs that integrate various data analytic procedures for a seamless transfer of evidence across qualitative and quantitative modalities. Such designs can offer the strength of confirmatory results drawn from quantitative multivariate analyses, along with “deep structure” explanatory descriptions as drawn from qualitative analyses. This article presents evidence generated from over a decade of pilot research in developing an integrative mixed methods methodology. It presents a conceptual framework and methodological and data analytic procedures for conducting mixed methods research studies, and it also presents illustrative examples from the authors' ongoing integrative mixed methods research studies. PMID:22167325

Methodological Rigor in Preclinical Cardiovascular Studies

PubMed Central

Ramirez, F. Daniel; Motazedian, Pouya; Jung, Richard G.; Di Santo, Pietro; MacDonald, Zachary D.; Moreland, Robert; Simard, Trevor; Clancy, Aisling A.; Russo, Juan J.; Welch, Vivian A.; Wells, George A.

2017-01-01

Rationale: Methodological sources of bias and suboptimal reporting contribute to irreproducibility in preclinical science and may negatively affect research translation. Randomization, blinding, sample size estimation, and considering sex as a biological variable are deemed crucial study design elements to maximize the quality and predictive value of preclinical experiments. Objective: To examine the prevalence and temporal patterns of recommended study design element implementation in preclinical cardiovascular research. Methods and Results: All articles published over a 10-year period in 5 leading cardiovascular journals were reviewed. Reports of in vivo experiments in nonhuman mammals describing pathophysiology, genetics, or therapeutic interventions relevant to specific cardiovascular disorders were identified. Data on study design and animal model use were collected. Citations at 60 months were additionally examined as a surrogate measure of research impact in a prespecified subset of studies, stratified by individual and cumulative study design elements. Of 28 636 articles screened, 3396 met inclusion criteria. Randomization was reported in 21.8%, blinding in 32.7%, and sample size estimation in 2.3%. Temporal and disease-specific analyses show that the implementation of these study design elements has overall not appreciably increased over the past decade, except in preclinical stroke research, which has uniquely demonstrated significant improvements in methodological rigor. In a subset of 1681 preclinical studies, randomization, blinding, sample size estimation, and inclusion of both sexes were not associated with increased citations at 60 months. Conclusions: Methodological shortcomings are prevalent in preclinical cardiovascular research, have not substantially improved over the past 10 years, and may be overlooked when basing subsequent studies. Resultant risks of bias and threats to study validity have the potential to hinder progress in cardiovascular medicine as preclinical research often precedes and informs clinical trials. Stroke research quality has uniquely improved in recent years, warranting a closer examination for interventions to model in other cardiovascular fields. PMID:28373349

Methodological Rigor in Preclinical Cardiovascular Studies: Targets to Enhance Reproducibility and Promote Research Translation.

PubMed

Ramirez, F Daniel; Motazedian, Pouya; Jung, Richard G; Di Santo, Pietro; MacDonald, Zachary D; Moreland, Robert; Simard, Trevor; Clancy, Aisling A; Russo, Juan J; Welch, Vivian A; Wells, George A; Hibbert, Benjamin

2017-06-09

Methodological sources of bias and suboptimal reporting contribute to irreproducibility in preclinical science and may negatively affect research translation. Randomization, blinding, sample size estimation, and considering sex as a biological variable are deemed crucial study design elements to maximize the quality and predictive value of preclinical experiments. To examine the prevalence and temporal patterns of recommended study design element implementation in preclinical cardiovascular research. All articles published over a 10-year period in 5 leading cardiovascular journals were reviewed. Reports of in vivo experiments in nonhuman mammals describing pathophysiology, genetics, or therapeutic interventions relevant to specific cardiovascular disorders were identified. Data on study design and animal model use were collected. Citations at 60 months were additionally examined as a surrogate measure of research impact in a prespecified subset of studies, stratified by individual and cumulative study design elements. Of 28 636 articles screened, 3396 met inclusion criteria. Randomization was reported in 21.8%, blinding in 32.7%, and sample size estimation in 2.3%. Temporal and disease-specific analyses show that the implementation of these study design elements has overall not appreciably increased over the past decade, except in preclinical stroke research, which has uniquely demonstrated significant improvements in methodological rigor. In a subset of 1681 preclinical studies, randomization, blinding, sample size estimation, and inclusion of both sexes were not associated with increased citations at 60 months. Methodological shortcomings are prevalent in preclinical cardiovascular research, have not substantially improved over the past 10 years, and may be overlooked when basing subsequent studies. Resultant risks of bias and threats to study validity have the potential to hinder progress in cardiovascular medicine as preclinical research often precedes and informs clinical trials. Stroke research quality has uniquely improved in recent years, warranting a closer examination for interventions to model in other cardiovascular fields. © 2017 The Authors.

[Qualitative research methodology in health care].

PubMed

Bedregal, Paula; Besoain, Carolina; Reinoso, Alejandro; Zubarew, Tamara

2017-03-01

Health care research requires different methodological approaches such as qualitative and quantitative analyzes to understand the phenomena under study. Qualitative research is usually the least considered. Central elements of the qualitative method are that the object of study is constituted by perceptions, emotions and beliefs, non-random sampling by purpose, circular process of knowledge construction, and methodological rigor throughout the research process, from quality design to the consistency of results. The objective of this work is to contribute to the methodological knowledge about qualitative research in health services, based on the implementation of the study, “The transition process from pediatric to adult services: perspectives from adolescents with chronic diseases, caregivers and health professionals”. The information gathered through the qualitative methodology facilitated the understanding of critical points, barriers and facilitators of the transition process of adolescents with chronic diseases, considering the perspective of users and the health team. This study allowed the design of a transition services model from pediatric to adult health services based on the needs of adolescents with chronic diseases, their caregivers and the health team.

Instructional System Development (ISD) in the Armed Services: Methodology and Application. Final Report, August 25, 1977 through March 19, 1979.

ERIC Educational Resources Information Center

Vineberg, Robert; Joyner, John N.

Instructional System Development (ISD) methodologies and practices were examined in the Army, Navy, Marine Corps, and Air Force, each of which prescribes the ISD system involving rigorous derivation of training requirements from job requirements, selection of instructional strategies to maximize training efficiency, and revision of instruction…

Translating Oral Health-Related Quality of Life Measures: Are There Alternative Methodologies?

ERIC Educational Resources Information Center

Brondani, Mario; He, Sarah

2013-01-01

Translating existing sociodental indicators to another language involves a rigorous methodology, which can be costly. Free-of-charge online translator tools are available, but have not been evaluated in the context of research involving quality of life measures. To explore the value of using online translator tools to develop oral health-related…

Teacher-Generated Final Exams in High School Science: Content, Rigor, and Assessment Literacy

NASA Astrophysics Data System (ADS)

Lach, Michael

This study investigates a large collection of teacher-generated end-of-semester final exams from Chicago Public School high school science classrooms in order to explore the depth and breadth of content that students learn in science classrooms. Teachers focus on a specific set of scientific content that is driven by district guidelines and popular textbooks but not particularly aligned to standards. To most teachers, rigor means coverage instead of intellectual press. The assessments, while unsophisticated, seem to be delivering what is expected of them---a way to mimic the most basic format of the ACT exam quickly. There was little variation among high poverty and low poverty schools, matching national data and indicating issues that are more due to a particular culture of science teaching and learning than driven by particular contexts. The study identifies implications for the observed homogeneity of final exam rigor and content, identifies gaps between how the routine of final exams are design and implemented in schools, and discusses similar methodological efforts that could enhance the ability of schools and districts to access useful information about the technical core of instruction.

An integrative research review of instruments measuring religious involvement: implications for nursing research with African Americans.

PubMed

Mokel, Melissa Jennifer; Shellman, Juliette M

2013-01-01

Many instruments in which religious involvement is measured often (a) contain unclear, poorly developed constructs; (b) lack methodological rigor in scale development; and (c) contain language and content culturally incongruent with the religious experiences of diverse ethnic groups. The primary aims of this review were to (a) synthesize the research on instruments designed to measure religious involvement, (b) evaluate the methodological quality of instruments that measure religious involvement, and (c) examine these instruments for conceptual congruency with African American religious involvement. An updated integrative research review method guided the process (Whittemore & Knafl, 2005). 152 articles were reviewed and 23 articles retrieved. Only 3 retained instruments were developed under methodologically rigorous conditions. All 3 instruments were congruent with a conceptual model of African American religious involvement. The Fetzer Multidimensional Measure of Religious Involvement and Spirituality (FMMRS; Idler et al., 2003) was found to have favorable characteristics. Further examination and psychometric testing is warranted to determine its acceptability, readability, and cultural sensitivity in an African American population.

The Specificity of Observational Studies in Physical Activity and Sports Sciences: Moving Forward in Mixed Methods Research and Proposals for Achieving Quantitative and Qualitative Symmetry

PubMed Central

Anguera, M. Teresa; Camerino, Oleguer; Castañer, Marta; Sánchez-Algarra, Pedro; Onwuegbuzie, Anthony J.

2017-01-01

Mixed methods studies are been increasingly applied to a diversity of fields. In this paper, we discuss the growing use—and enormous potential—of mixed methods research in the field of sport and physical activity. A second aim is to contribute to strengthening the characteristics of mixed methods research by showing how systematic observation offers rigor within a flexible framework that can be applied to a wide range of situations. Observational methodology is characterized by high scientific rigor and flexibility throughout its different stages and allows the objective study of spontaneous behavior in natural settings, with no external influence. Mixed methods researchers need to take bold yet thoughtful decisions regarding both substantive and procedural issues. We present three fundamental and complementary ideas to guide researchers in this respect: we show why studies of sport and physical activity that use a mixed methods research approach should be included in the field of mixed methods research, we highlight the numerous possibilities offered by observational methodology in this field through the transformation of descriptive data into quantifiable code matrices, and we discuss possible solutions for achieving true integration of qualitative and quantitative findings. PMID:29312061

Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review.

PubMed

Eysenbach, Gunther; Powell, John; Kuss, Oliver; Sa, Eun-Ryoung

The quality of consumer health information on the World Wide Web is an important issue for medicine, but to date no systematic and comprehensive synthesis of the methods and evidence has been performed. To establish a methodological framework on how quality on the Web is evaluated in practice, to determine the heterogeneity of the results and conclusions, and to compare the methodological rigor of these studies, to determine to what extent the conclusions depend on the methodology used, and to suggest future directions for research. We searched MEDLINE and PREMEDLINE (1966 through September 2001), Science Citation Index (1997 through September 2001), Social Sciences Citation Index (1997 through September 2001), Arts and Humanities Citation Index (1997 through September 2001), LISA (1969 through July 2001), CINAHL (1982 through July 2001), PsychINFO (1988 through September 2001), EMBASE (1988 through June 2001), and SIGLE (1980 through June 2001). We also conducted hand searches, general Internet searches, and a personal bibliographic database search. We included published and unpublished empirical studies in any language in which investigators searched the Web systematically for specific health information, evaluated the quality of Web sites or pages, and reported quantitative results. We screened 7830 citations and retrieved 170 potentially eligible full articles. A total of 79 distinct studies met the inclusion criteria, evaluating 5941 health Web sites and 1329 Web pages, and reporting 408 evaluation results for 86 different quality criteria. Two reviewers independently extracted study characteristics, medical domains, search strategies used, methods and criteria of quality assessment, results (percentage of sites or pages rated as inadequate pertaining to a quality criterion), and quality and rigor of study methods and reporting. Most frequently used quality criteria used include accuracy, completeness, readability, design, disclosures, and references provided. Fifty-five studies (70%) concluded that quality is a problem on the Web, 17 (22%) remained neutral, and 7 studies (9%) came to a positive conclusion. Positive studies scored significantly lower in search (P =.02) and evaluation (P =.04) methods. Due to differences in study methods and rigor, quality criteria, study population, and topic chosen, study results and conclusions on health-related Web sites vary widely. Operational definitions of quality criteria are needed.

Some guidelines for conducting research in applied behavioral pharmacology.

PubMed

van Haaren, Frans; Weeden, Marc

2013-01-01

The Journal of Applied Behavior Analysis (JABA) has published a number of articles on the behavioral effects of psychomotor stimulant drugs in individuals with attention deficit hyperactivity disorder. Some additional JABA publications have included investigations of the behavioral effects of other drugs. However, a review of these articles revealed many methodological differences among studies, which makes it difficult to evaluate the relative contribution of each research effort to the overall database. In this context, we offer some guidelines to solidify the methodological rigor of behavior pharmacological research published in JABA. © Society for the Experimental Analysis of Behavior.

Rigorously Assessing Whether the Data Backs the Back School

PubMed Central

Vinh, David T.; Johnson, Craig W.; Phelps, Cynthia L.

2003-01-01

A rigorous between-subjects methodology employing independent random samples and having broad clinical applicability was designed and implemented to evaluate the effectiveness of back safety and patient transfer training interventions for both hospital nurses and nursing assistants. Effects upon self-efficacy, cognitive, and affective measures are assessed for each of three back safety procedures. The design solves the problem of obtaining randomly assigned independent controls where all experimental subjects must participate in the training interventions. PMID:14728544

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand

PubMed Central

2013-01-01

Background Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. Methods A systematic search of 17 electronic databases and 13 websites for the period 1981–2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Results Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. Conclusions There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise. PMID:23663493

A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand.

PubMed

Clifford, Anton C; Doran, Christopher M; Tsey, Komla

2013-05-13

Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. A systematic search of 17 electronic databases and 13 websites for the period 1981-2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise.

Advances in knowledge-based software engineering

NASA Technical Reports Server (NTRS)

Truszkowski, Walt

1991-01-01

The underlying hypothesis of this work is that a rigorous and comprehensive software reuse methodology can bring about a more effective and efficient utilization of constrained resources in the development of large-scale software systems by both government and industry. It is also believed that correct use of this type of software engineering methodology can significantly contribute to the higher levels of reliability that will be required of future operational systems. An overview and discussion of current research in the development and application of two systems that support a rigorous reuse paradigm are presented: the Knowledge-Based Software Engineering Environment (KBSEE) and the Knowledge Acquisition fo the Preservation of Tradeoffs and Underlying Rationales (KAPTUR) systems. Emphasis is on a presentation of operational scenarios which highlight the major functional capabilities of the two systems.

Medicine, methodology, and values: trade-offs in clinical science and practice.

PubMed

Ho, Vincent K Y

2011-01-01

The current guidelines of evidence-based medicine (EBM) presuppose that clinical research and clinical practice should advance from rigorous scientific tests as they generate reliable, value-free knowledge. Under this presupposition, hypotheses postulated by doctors and patients in the process of their decision making are preferably tested in randomized clinical trials (RCTs), and in systematic reviews and meta-analyses summarizing outcomes from multiple RCTs. Since testing under this scheme is predominantly focused on the criteria of generality and precision achieved through methodological rigor, at the cost of the criterion of realism, translating test results to clinical practice is often problematic. Choices concerning which methodological criteria should have priority are inevitable, however, as clinical trials, and scientific research in general, cannot meet all relevant criteria at the same time. Since these choices may be informed by considerations external to science, we must acknowledge that science cannot be value-free in a strict sense, and this invites a more prominent role for value-laden considerations in evaluating clinical research. The urgency for this becomes even more apparent when we consider the important yet implicit role of scientific theories in EBM, which may also be subjected to methodological evaluation and for which selectiveness in methodological focus is likewise inevitable.

Culture and neuroscience: additive or synergistic?

PubMed Central

Dapretto, Mirella; Iacoboni, Marco

2010-01-01

The investigation of cultural phenomena using neuroscientific methods—cultural neuroscience (CN)—is receiving increasing attention. Yet it is unclear whether the integration of cultural study and neuroscience is merely additive, providing additional evidence of neural plasticity in the human brain, or truly synergistic, yielding discoveries that neither discipline could have achieved alone. We discuss how the parent fields to CN: cross-cultural psychology, psychological anthropology and cognitive neuroscience inform the investigation of the role of cultural experience in shaping the brain. Drawing on well-established methodologies from cross-cultural psychology and cognitive neuroscience, we outline a set of guidelines for CN, evaluate 17 CN studies in terms of these guidelines, and provide a summary table of our results. We conclude that the combination of culture and neuroscience is both additive and synergistic; while some CN methodologies and findings will represent the direct union of information from parent fields, CN studies employing the methodological rigor required by this logistically challenging new field have the potential to transform existing methodologies and produce unique findings. PMID:20083533

Subthreshold posttraumatic stress disorder: A meta-analytic review of DSM-IV prevalence and a proposed DSM-5 approach to measurement.

PubMed

Brancu, Mira; Mann-Wrobel, Monica; Beckham, Jean C; Wagner, H Ryan; Elliott, Alyssa; Robbins, Allison T; Wong, Madrianne; Berchuck, Ania E; Runnals, Jennifer J

2016-03-01

Subthreshold posttraumatic stress disorder (PTSD) is a chronic condition that is often ignored, the cumulative effects of which can negatively impact an individual's quality of life and overall health care costs. However, subthreshold PTSD prevalence rates and impairment remain unclear due to variations in research methodology. This study examined the existing literature in order to recommend approaches to standardize subthreshold PTSD assessment. We conducted (a) a meta-analysis of subthreshold PTSD prevalence rates and (b) compared functional impairment associated with the 3 most commonly studied subthreshold PTSD definitions. Meta-analytic results revealed that the average prevalence rate of subthreshold PTSD across studies was 14.7%, with a lower rate (12.6%) among the most methodologically rigorous studies and higher rate (15.6%) across less rigorous studies. There were significant methodological differences among reviewed studies with regard to definition, measurement, and population. Different definitions led to prevalence rates ranging between 13.7% and 16.4%. Variability in prevalence rates most related to population and sample composition, with trauma type and community (vs. epidemiological) samples significantly impacting heterogeneity. Qualitative information gathered from studies presenting functional correlates supported current evidence that psychological and behavioral parameters were worse among subthreshold PTSD groups compared with no-PTSD groups, but not as severe as impairment in PTSD groups. Several studies also reported significant increased risk of suicidality and hopelessness as well as higher health care utilization rates among those with subthreshold PTSD (compared with trauma exposed no-PTSD samples). Based on findings, we propose recommendations for developing a standard approach to evaluation of subthreshold PTSD. (c) 2016 APA, all rights reserved).

Prejudice reduction: what works? A review and assessment of research and practice.

PubMed

Paluck, Elizabeth Levy; Green, Donald P

2009-01-01

This article reviews the observational, laboratory, and field experimental literatures on interventions for reducing prejudice. Our review places special emphasis on assessing the methodological rigor of existing research, calling attention to problems of design and measurement that threaten both internal and external validity. Of the hundreds of studies we examine, a small fraction speak convincingly to the questions of whether, why, and under what conditions a given type of intervention works. We conclude that the causal effects of many widespread prejudice-reduction interventions, such as workplace diversity training and media campaigns, remain unknown. Although some intergroup contact and cooperation interventions appear promising, a much more rigorous and broad-ranging empirical assessment of prejudice-reduction strategies is needed to determine what works.

Chase: Control of Heterogeneous Autonomous Sensors for Situational Awareness

DTIC Science & Technology

2016-08-03

remained the discovery and analysis of new foundational methodology for information collection and fusion that exercises rigorous feedback control over...simultaneously achieve quantified information and physical objectives. New foundational methodology for information collection and fusion that exercises...11.2.1. In the general area of novel stochastic systems analysis it seems appropriate to mention the pioneering work on non -Bayesian distributed learning

How to Map Theory: Reliable Methods Are Fruitless Without Rigorous Theory.

PubMed

Gray, Kurt

2017-09-01

Good science requires both reliable methods and rigorous theory. Theory allows us to build a unified structure of knowledge, to connect the dots of individual studies and reveal the bigger picture. Some have criticized the proliferation of pet "Theories," but generic "theory" is essential to healthy science, because questions of theory are ultimately those of validity. Although reliable methods and rigorous theory are synergistic, Action Identification suggests psychological tension between them: The more we focus on methodological details, the less we notice the broader connections. Therefore, psychology needs to supplement training in methods (how to design studies and analyze data) with training in theory (how to connect studies and synthesize ideas). This article provides a technique for visually outlining theory: theory mapping. Theory mapping contains five elements, which are illustrated with moral judgment and with cars. Also included are 15 additional theory maps provided by experts in emotion, culture, priming, power, stress, ideology, morality, marketing, decision-making, and more (see all at theorymaps.org ). Theory mapping provides both precision and synthesis, which helps to resolve arguments, prevent redundancies, assess the theoretical contribution of papers, and evaluate the likelihood of surprising effects.

Postoperative cognitive dysfunction and its relationship to cognitive reserve in elderly total joint replacement patients.

PubMed

Scott, J E; Mathias, J L; Kneebone, A C; Krishnan, J

2017-06-01

Whether total joint replacement (TJR) patients are susceptible to postoperative cognitive dysfunction (POCD) remains unclear due to inconsistencies in research methodologies. Moreover, cognitive reserve may moderate the development of POCD after TJR, but has not been investigated in this context. The current study investigated POCD after TJR, and its relationship with cognitive reserve, using a more rigorous methodology than has previously been utilized. Fifty-three older adults (aged 50+) scheduled for TJR were assessed pre and post surgery (6 months). Forty-five healthy controls matched for age, gender, and premorbid IQ were re-assessed after an equivalent interval. Cognition, cognitive reserve, and physical and mental health were all measured. Standardized regression-based methods were used to assess cognitive changes, while controlling for the confounding effect of repeated cognitive testing. TJR patients only demonstrated a significant decline in Trail Making Test Part B (TMT B) performance, compared to controls. Cognitive reserve only predicted change in TMT B scores among a subset of TJR patients. Specifically, patients who showed the most improvement pre to post surgery had significantly higher reserve than those who showed the greatest decline. The current study provides limited evidence of POCD after TJR when examined using a rigorous methodology, which controlled for practice effects. Cognitive reserve only predicted performance within a subset of the TJR sample. However, the role of reserve in more cognitively compromised patients remains to be determined.

Methodological quality of meta-analyses of single-case experimental studies.

PubMed

Jamshidi, Laleh; Heyvaert, Mieke; Declercq, Lies; Fernández-Castilla, Belén; Ferron, John M; Moeyaert, Mariola; Beretvas, S Natasha; Onghena, Patrick; Van den Noortgate, Wim

2017-12-28

Methodological rigor is a fundamental factor in the validity and credibility of the results of a meta-analysis. Following an increasing interest in single-case experimental design (SCED) meta-analyses, the current study investigates the methodological quality of SCED meta-analyses. We assessed the methodological quality of 178 SCED meta-analyses published between 1985 and 2015 through the modified Revised-Assessment of Multiple Systematic Reviews (R-AMSTAR) checklist. The main finding of the current review is that the methodological quality of the SCED meta-analyses has increased over time, but is still low according to the R-AMSTAR checklist. A remarkable percentage of the studies (93.80% of the included SCED meta-analyses) did not even reach the midpoint score (22, on a scale of 0-44). The mean and median methodological quality scores were 15.57 and 16, respectively. Relatively high scores were observed for "providing the characteristics of the included studies" and "doing comprehensive literature search". The key areas of deficiency were "reporting an assessment of the likelihood of publication bias" and "using the methods appropriately to combine the findings of studies". Although the results of the current review reveal that the methodological quality of the SCED meta-analyses has increased over time, still more efforts are needed to improve their methodological quality. Copyright © 2017 Elsevier Ltd. All rights reserved.

Effectiveness of Culturally Appropriate Adaptations to Juvenile Justice Services

PubMed Central

Vergara, Andrew T.; Kathuria, Parul; Woodmass, Kyler; Janke, Robert; Wells, Susan J.

2017-01-01

Despite efforts to increase cultural competence of services within juvenile justice systems, disproportional minority contact (DMC) persists throughout Canada and the United States. Commonly cited approaches to decreasing DMC include large-scale systemic changes as well as enhancement of the cultural relevance and responsiveness of services delivered. Cultural adaptations to service delivery focus on prevention, decision-making, and treatment services to reduce initial contact, minimize unnecessary restraint, and reduce recidivism. Though locating rigorous testing of these approaches compared to standard interventions is difficult, this paper identifies and reports on such research. The Cochrane guidelines for systematic literature reviews and meta-analyses served as a foundation for study methodology. Databases such as Legal Periodicals and Books were searched through June 2015. Three studies were sufficiently rigorous to identify the effect of the cultural adaptations, and three studies that are making potentially important contributions to the field were also reviewed. PMID:29468092

Adding a Time-Series Design Element to the Success Case Method to Improve Methodological Rigor: An Application for Nonprofit Program Evaluation

ERIC Educational Resources Information Center

Coryn, Chris L. S.; Schroter, Daniela C.; Hanssen, Carl E.

2009-01-01

Brinkerhoff's Success Case Method (SCM) was developed with the specific purpose of assessing the impact of organizational interventions (e.g., training and coaching) on business goals by analyzing extreme groups using case study techniques and storytelling. As an efficient and cost-effective method of evaluative inquiry, SCM is attractive in other…

How to conduct a qualitative meta-analysis: Tailoring methods to enhance methodological integrity.

PubMed

Levitt, Heidi M

2018-05-01

Although qualitative research has long been of interest in the field of psychology, meta-analyses of qualitative literatures (sometimes called meta-syntheses) are still quite rare. Like quantitative meta-analyses, these methods function to aggregate findings and identify patterns across primary studies, but their aims, procedures, and methodological considerations may vary. This paper explains the function of qualitative meta-analyses and their methodological development. Recommendations have broad relevance but are framed with an eye toward their use in psychotherapy research. Rather than arguing for the adoption of any single meta-method, this paper advocates for considering how procedures can best be selected and adapted to enhance a meta-study's methodological integrity. Through the paper, recommendations are provided to help researchers identify procedures that can best serve their studies' specific goals. Meta-analysts are encouraged to consider the methodological integrity of their studies in relation to central research processes, including identifying a set of primary research studies, transforming primary findings into initial units of data for a meta-analysis, developing categories or themes, and communicating findings. The paper provides guidance for researchers who desire to tailor meta-analytic methods to meet their particular goals while enhancing the rigor of their research.

Social validity in single-case research: A systematic literature review of prevalence and application.

PubMed

Snodgrass, Melinda R; Chung, Moon Y; Meadan, Hedda; Halle, James W

2018-03-01

Single-case research (SCR) has been a valuable methodology in special education research. Montrose Wolf (1978), an early pioneer in single-case methodology, coined the term "social validity" to refer to the social importance of the goals selected, the acceptability of procedures employed, and the effectiveness of the outcomes produced in applied investigations. Since 1978, many contributors to SCR have included social validity as a feature of their articles and several authors have examined the prevalence and role of social validity in SCR. We systematically reviewed all SCR published in six highly-ranked special education journals from 2005 to 2016 to establish the prevalence of social validity assessments and to evaluate their scientific rigor. We found relatively low, but stable prevalence with only 28 publications addressing all three factors of the social validity construct (i.e., goals, procedures, outcomes). We conducted an in-depth analysis of the scientific rigor of these 28 publications. Social validity remains an understudied construct in SCR, and the scientific rigor of social validity assessments is often lacking. Implications and future directions are discussed. Copyright © 2018 Elsevier Ltd. All rights reserved.

Circular instead of hierarchical: methodological principles for the evaluation of complex interventions

PubMed Central

Walach, Harald; Falkenberg, Torkel; Fønnebø, Vinjar; Lewith, George; Jonas, Wayne B

2006-01-01

Background The reasoning behind evaluating medical interventions is that a hierarchy of methods exists which successively produce improved and therefore more rigorous evidence based medicine upon which to make clinical decisions. At the foundation of this hierarchy are case studies, retrospective and prospective case series, followed by cohort studies with historical and concomitant non-randomized controls. Open-label randomized controlled studies (RCTs), and finally blinded, placebo-controlled RCTs, which offer most internal validity are considered the most reliable evidence. Rigorous RCTs remove bias. Evidence from RCTs forms the basis of meta-analyses and systematic reviews. This hierarchy, founded on a pharmacological model of therapy, is generalized to other interventions which may be complex and non-pharmacological (healing, acupuncture and surgery). Discussion The hierarchical model is valid for limited questions of efficacy, for instance for regulatory purposes and newly devised products and pharmacological preparations. It is inadequate for the evaluation of complex interventions such as physiotherapy, surgery and complementary and alternative medicine (CAM). This has to do with the essential tension between internal validity (rigor and the removal of bias) and external validity (generalizability). Summary Instead of an Evidence Hierarchy, we propose a Circular Model. This would imply a multiplicity of methods, using different designs, counterbalancing their individual strengths and weaknesses to arrive at pragmatic but equally rigorous evidence which would provide significant assistance in clinical and health systems innovation. Such evidence would better inform national health care technology assessment agencies and promote evidence based health reform. PMID:16796762

[Assessment of the methodological quality of theses submitted to the Faculty of Medicine Fez].

PubMed

Boly, A; Tachfouti, N; Zohoungbogbo, I S S; Achhab, Y El; Nejjari, C

2014-06-09

A thesis in medicine is a scientific work which allows a medical student to acquire a Doctor of Medicine degree. It is therefore recommended that theses presented by students fulfill essential methodological criteria in order to obtain scientifically credible results and recommendations. The aim of this study was to assess the methodology of thesis presented to the Faculty of Medicine in Fez in 2008. We developed an evaluation table containing questions on the different sections of the IMRAD structure on which these theses were based and we estimated the proportion of theses that conformed to each criterion. There were 160 theses on various specialties presented in 2008. The majority of the theses (79.3%) were case series. Research questions were clearly expressed in 62.0% but the primary objectives were pertinent in only 52.0%. Our study shows that there were important deficiencies in the methodological rigor of the theses and very little representation of the theses in publications.

Ethical Dilemmas for the Computational Linguist in the Business World.

ERIC Educational Resources Information Center

McCallum-Bayliss, Heather

1993-01-01

Reports on a computer application in which collaboration did not precede project design. Important project parameters established without author input presented ethical dilemmas in balancing contract obligations and methodological rigor. (Author/CK)

Impact of quality of research on patient outcomes in the Institute of Medicine 2013 report on dietary sodium.

PubMed

Lucko, Aaron; Doktorchik, Chelsea Ta; Campbell, Norm Rc

2018-02-01

The 2013 Institute of Medicine report entitled "Sodium Intake in Populations: Assessment of Evidence" found inconsistent evidence of health benefit with dietary sodium intake <2300 mg/d. Different studies reported benefit and harm of population dietary intake <2300 mg/d. The Institute of Medicine committee, however, did not assess whether the methodology used in each of the studies was appropriate to examine dietary sodium and health outcomes. This review investigates the association of methodological rigor and outcomes of studies in the Institute of Medicine report. For the 13 studies that met all methodological criteria, nine found a detrimental impact of high sodium consumption on health, one found a health benefit, and in three the effect was unclear (P = .068). For the 22 studies that failed to meet all criteria, 11 showed a detrimental impact, four a health benefit, and seven had unclear effects from increasing dietary sodium (P = .42). ©2018 Wiley Periodicals, Inc.

Using qualitative mixed methods to study small health care organizations while maximising trustworthiness and authenticity.

PubMed

Phillips, Christine B; Dwan, Kathryn; Hepworth, Julie; Pearce, Christopher; Hall, Sally

2014-11-19

The primary health care sector delivers the majority of health care in western countries through small, community-based organizations. However, research into these healthcare organizations is limited by the time constraints and pressure facing them, and the concern by staff that research is peripheral to their work. We developed Q-RARA-Qualitative Rapid Appraisal, Rigorous Analysis-to study small, primary health care organizations in a way that is efficient, acceptable to participants and methodologically rigorous. Q-RARA comprises a site visit, semi-structured interviews, structured and unstructured observations, photographs, floor plans, and social scanning data. Data were collected over the course of one day per site and the qualitative analysis was integrated and iterative. We found Q-RARA to be acceptable to participants and effective in collecting data on organizational function in multiple sites without disrupting the practice, while maintaining a balance between speed and trustworthiness. The Q-RARA approach is capable of providing a richly textured, rigorous understanding of the processes of the primary care practice while also allowing researchers to develop an organizational perspective. For these reasons the approach is recommended for use in small-scale organizations both within and outside the primary health care sector.

Culture and symptom reporting at menopause.

PubMed

Melby, Melissa K; Lock, Margaret; Kaufert, Patricia

2005-01-01

The purpose of the present paper is to review recent research on the relationship of culture and menopausal symptoms and propose a biocultural framework that makes use of both biological and cultural parameters in future research. Medline was searched for English-language articles published from 2000 to 2004 using the keyword 'menopause' in the journals--Menopause, Maturitas, Climacteric, Social Science and Medicine, Medical Anthropology Quarterly, Journal of Women's Health, Journal of the American Medical Association, American Journal of Epidemiology, Lancet and British Medical Journal, excluding articles concerning small clinical samples, surgical menopause or HRT. Additionally, references of retrieved articles and reviews were hand-searched. Although a large number of studies and publications exist, methodological differences limit attempts at comparison or systematic review. We outline a theoretical framework in which relevant biological and cultural variables can be operationalized and measured, making it possible for rigorous comparisons in the future. Several studies carried out in Japan, North America and Australia, using similar methodology but different culture/ethnic groups, indicate that differences in symptom reporting are real and highlight the importance of biocultural research. We suggest that both biological variation and cultural differences contribute to the menopausal transition, and that more rigorous data collection is required to elucidate how biology and culture interact in female ageing.

Teaching Medical Ethics in Graduate and Undergraduate Medical Education: A Systematic Review of Effectiveness.

PubMed

de la Garza, Santiago; Phuoc, Vania; Throneberry, Steven; Blumenthal-Barby, Jennifer; McCullough, Laurence; Coverdale, John

2017-08-01

One objective was to identify and review studies on teaching medical ethics to psychiatry residents. In order to gain insights from other disciplines that have published research in this area, a second objective was to identify and review studies on teaching medical ethics to residents across all other specialties of training and on teaching medical students. PubMed, EMBASE, and PsycINFO were searched for controlled trials on teaching medical ethics with quantitative outcomes. Search terms included ethics, bioethics, medical ethics, medical students, residents/registrars, teaching, education, outcomes, and controlled trials. Nine studies were found that met inclusion criteria, including five randomized controlled trails and four controlled non-randomized trials. Subjects included medical students (5 studies), surgical residents (2 studies), internal medicine house officers (1 study), and family medicine preceptors and their medical students (1 study). Teaching methods, course content, and outcome measures varied considerably across studies. Common methodological issues included a lack of concealment of allocation, a lack of blinding, and generally low numbers of subjects as learners. One randomized controlled trial which taught surgical residents using a standardized patient was judged to be especially methodologically rigorous. None of the trials incorporated psychiatry residents. Ethics educators should undertake additional rigorously controlled trials in order to secure a strong evidence base for the design of medical ethics curricula. Psychiatry ethics educators can also benefit from the findings of trials in other disciplines and in undergraduate medical education.

How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations.

PubMed Central

Ennett, S T; Tobler, N S; Ringwalt, C L; Flewelling, R L

1994-01-01

OBJECTIVES. Project DARE (Drug Abuse Resistance Education) is the most widely used school-based drug use prevention program in the United States, but the findings of rigorous evaluations of its effectiveness have not been considered collectively. METHODS. We used meta-analytic techniques to review eight methodologically rigorous DARE evaluations. Weighted effect size means for several short-term outcomes also were compared with means reported for other drug use prevention programs. RESULTS. The DARE effect size for drug use behavior ranged from .00 to .11 across the eight studies; the weighted mean for drug use across studies was .06. For all outcomes considered, the DARE effect size means were substantially smaller than those of programs emphasizing social and general competencies and using interactive teaching strategies. CONCLUSIONS. DARE's short-term effectiveness for reducing or preventing drug use behavior is small and is less than for interactive prevention programs. PMID:8092361

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs.

PubMed

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed.

The Development of a Checklist to Enhance Methodological Quality in Intervention Programs

PubMed Central

Chacón-Moscoso, Salvador; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2016-01-01

The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed. PMID:27917143

Aberrant Motor Development in Three Disabilities: Directions for Research and Practice.

ERIC Educational Resources Information Center

Stack, Dale M.; Minnes, Patricia M.

1989-01-01

Reviews literature concerning Down Syndrome, visual impairment, and cerebral palsy in children. Emphasizes the continued need for advances in intervention strategies and technology and the more general need for methodological rigor in research. (RJC)

Essential methodological considerations when using grounded theory.

PubMed

Achora, Susan; Matua, Gerald Amandu

2016-07-01

To suggest important methodological considerations when using grounded theory. A research method widely used in nursing research is grounded theory, at the centre of which is theory construction. However, researchers still struggle with some of its methodological issues. Although grounded theory is widely used to study and explain issues in nursing practice, many researchers are still failing to adhere to its rigorous standards. Researchers should articulate the focus of their investigations - the substantive area of interest as well as the focal population. This should be followed by a succinct explanation of the strategies used to collect and analyse data, supported by clear coding processes. Finally, the resolution of the core issues, including the core category and related categories, should be explained to advance readers' understanding. Researchers should endeavour to understand the tenets of grounded theory. This enables 'neophytes' in particular to make methodological decisions that will improve their studies' rigour and fit with grounded theory. This paper complements the current dialogue on improving the understanding of grounded theory methodology in nursing research. The paper also suggests important procedural decisions researchers need to make to preserve their studies' scientific merit and fit with grounded theory.

Hydration: certain basic aspects for developing technical and scientific parameters into the nutrition knowledge

PubMed

Perales-García, Aránzazu; Estévez-Martínez, Isabel; Urrialde, Rafael

2016-07-12

Introduction: Hydration is defined as the water intake coming from food and beverages. Its study has become an area by itself, within the nutrition field. Meaning that in 2010 the European Food Safety Authority (EFSA) approved the water intake recommendations, but the study of this topic implies a rigorous methodology, which represents several issues. Objective: Showing as a glance the main methodological issues in hydration studies. Material and methods: Bibliographic revision of scientific literature. Results: The main methodological issues presented are: sample selection (investigation field and sample design), selection of the method to evaluate hydration status (dilution techniques, bioelectrical impedance, plasmatic and urinary indicators, changes in body composition, water losses and clinic symptoms) selection of the method to evaluate water intake (biomarker, questionnaires, informatics programs, smartphone use, 24-h register, dietary history and food frequency questionnaire), and the main sources of hydration. Conclusions: Hydration status should be understood as a routine model, with daily frequency, according to gender, age, physical activity and environmental conditions. Furthermore, the correct design of the methodology has a special importance in order to take into account all the aspects

Unilateral Vocal Fold Paralysis: A Systematic Review of Speech-Language Pathology Management.

PubMed

Walton, Chloe; Conway, Erin; Blackshaw, Helen; Carding, Paul

2017-07-01

Dysphonia due to unilateral vocal fold paralysis (UVFP) can be characterized by hoarseness and weakness, resulting in a significant impact on patients' activity and participation. Voice therapy provided by a speech-language pathologist is designed to maximize vocal function and improve quality of life. The purpose of this paper is to systematically review literature surrounding the effectiveness of speech-language pathology intervention for the management of UVFP in adults. This is a systematic review. Electronic databases were searched using a range of key terms including dysphonia, vocal fold paralysis, and speech-language pathology. Eligible articles were extracted and reviewed by the authors for risk of bias, methodology, treatment efficacy, and clinical outcomes. Of the 3311 articles identified, 12 met the inclusion criteria: seven case series and five comparative studies. All 12 studies subjectively reported positive effects following the implementation of voice therapy for UVFP; however, the heterogeneity of participant characteristics, voice therapy, and voice outcome resulted in a low level of evidence. There is presently a lack of methodological rigor and clinical efficacy in the speech-language pathology management of dysphonia arising from UVFP in adults. Reasons for this reduced efficacy can be attributed to the following: (1) no standardized speech-language pathology intervention; (2) no consistency of assessment battery; (3) the variable etiology and clinical presentation of UVFP; and (4) inconsistent timing, frequency, and intensity of treatment. Further research is required to develop the evidence for the management of UVFP incorporating controlled treatment protocols and more rigorous clinical methodology. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Dense Velocity Field of Turkey

NASA Astrophysics Data System (ADS)

Ozener, H.; Aktug, B.; Dogru, A.; Tasci, L.

2017-12-01

While the GNSS-based crustal deformation studies in Turkey date back to early 1990s, a homogenous velocity field utilizing all the available data is still missing. Regional studies employing different site distributions, observation plans, processing software and methodology not only create reference frame variations but also heterogeneous stochastic models. While the reference frame effect between different velocity fields could easily be removed by estimating a set of rotations, the homogenization of the stochastic models of the individual velocity fields requires a more detailed analysis. Using a rigorous Variance Component Estimation (VCE) methodology, we estimated the variance factors for each of the contributing velocity fields and combined them into a single homogenous velocity field covering whole Turkey. Results show that variance factors between velocity fields including the survey mode and continuous observations can vary a few orders of magnitude. In this study, we present the most complete velocity field in Turkey rigorously combined from 20 individual velocity fields including the 146 station CORS network and totally 1072 stations. In addition, three GPS campaigns were performed along the North Anatolian Fault and Aegean Region to fill the gap between existing velocity fields. The homogenously combined new velocity field is nearly complete in terms of geographic coverage, and will serve as the basis for further analyses such as the estimation of the deformation rates and the determination of the slip rates across main fault zones.

Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

ERIC Educational Resources Information Center

Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

2015-01-01

When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…

Validity of High-School Grades in Predicting Student Success beyond the Freshman Year: High-School Record vs. Standardized Tests as Indicators of Four-Year College Outcomes. Research & Occasional Paper Series: CSHE.6.07

ERIC Educational Resources Information Center

Geiser, Saul; Santelices, Maria Veronica

2007-01-01

High-school grades are often viewed as an unreliable criterion for college admissions, owing to differences in grading standards across high schools, while standardized tests are seen as methodologically rigorous, providing a more uniform and valid yardstick for assessing student ability and achievement. The present study challenges that…

The "Performance of Rotavirus and Oral Polio Vaccines in Developing Countries" (PROVIDE) study: description of methods of an interventional study designed to explore complex biologic problems.

PubMed

Kirkpatrick, Beth D; Colgate, E Ross; Mychaleckyj, Josyf C; Haque, Rashidul; Dickson, Dorothy M; Carmolli, Marya P; Nayak, Uma; Taniuchi, Mami; Naylor, Caitlin; Qadri, Firdausi; Ma, Jennie Z; Alam, Masud; Walsh, Mary Claire; Diehl, Sean A; Petri, William A

2015-04-01

Oral vaccines appear less effective in children in the developing world. Proposed biologic reasons include concurrent enteric infections, malnutrition, breast milk interference, and environmental enteropathy (EE). Rigorous study design and careful data management are essential to begin to understand this complex problem while assuring research subject safety. Herein, we describe the methodology and lessons learned in the PROVIDE study (Dhaka, Bangladesh). A randomized clinical trial platform evaluated the efficacy of delayed-dose oral rotavirus vaccine as well as the benefit of an injectable polio vaccine replacing one dose of oral polio vaccine. This rigorous infrastructure supported the additional examination of hypotheses of vaccine underperformance. Primary and secondary efficacy and immunogenicity measures for rotavirus and polio vaccines were measured, as well as the impact of EE and additional exploratory variables. Methods for the enrollment and 2-year follow-up of a 700 child birth cohort are described, including core laboratory, safety, regulatory, and data management practices. Intense efforts to standardize clinical, laboratory, and data management procedures in a developing world setting provide clinical trials rigor to all outcomes. Although this study infrastructure requires extensive time and effort, it allows optimized safety and confidence in the validity of data gathered in complex, developing country settings. © The American Society of Tropical Medicine and Hygiene.

Fault detection in mechanical systems with friction phenomena: an online neural approximation approach.

PubMed

Papadimitropoulos, Adam; Rovithakis, George A; Parisini, Thomas

2007-07-01

In this paper, the problem of fault detection in mechanical systems performing linear motion, under the action of friction phenomena is addressed. The friction effects are modeled through the dynamic LuGre model. The proposed architecture is built upon an online neural network (NN) approximator, which requires only system's position and velocity. The friction internal state is not assumed to be available for measurement. The neural fault detection methodology is analyzed with respect to its robustness and sensitivity properties. Rigorous fault detectability conditions and upper bounds for the detection time are also derived. Extensive simulation results showing the effectiveness of the proposed methodology are provided, including a real case study on an industrial actuator.

[Clinical practice guidelines in Peru: evaluation of its quality using the AGREE II instrument].

PubMed

Canelo-Aybar, Carlos; Balbin, Graciela; Perez-Gomez, Ángela; Florez, Iván D

2016-01-01

To evaluate the methodological quality of clinical practice guidelines (CPGs) put into practice by the Peruvian Ministry of Health (MINSA), 17 CPGs from the ministry, published between 2009 and 2014, were independently evaluated by three methodologic experts using the AGREE II instrument. The score of AGREE II domains was low and very low in all CPGs: scope and purpose (medium, 44%), clarity of presentation (medium, 47%), participation of decision-makers (medium, 8%), methodological rigor (medium, 5%), applicability (medium, 5%), and editorial independence (medium, 8%). In conclusion, the methodological quality of CPGs implemented by the MINSA is low. Consequently, its use could not be recommended. The implementation of the methodology for the development of CPGs described in the recentlypublished CPG methodological preparation manual in Peru is a pressing need.

Methodological standards and patient-centeredness in comparative effectiveness research: the PCORI perspective.

PubMed

2012-04-18

Rigorous methodological standards help to ensure that medical research produces information that is valid and generalizable, and are essential in patient-centered outcomes research (PCOR). Patient-centeredness refers to the extent to which the preferences, decision-making needs, and characteristics of patients are addressed, and is the key characteristic differentiating PCOR from comparative effectiveness research. The Patient Protection and Affordable Care Act signed into law in 2010 created the Patient-Centered Outcomes Research Institute (PCORI), which includes an independent, federally appointed Methodology Committee. The Methodology Committee is charged to develop methodological standards for PCOR. The 4 general areas identified by the committee in which standards will be developed are (1) prioritizing research questions, (2) using appropriate study designs and analyses, (3) incorporating patient perspectives throughout the research continuum, and (4) fostering efficient dissemination and implementation of results. A Congressionally mandated PCORI methodology report (to be issued in its first iteration in May 2012) will begin to provide standards in each of these areas, and will inform future PCORI funding announcements and review criteria. The work of the Methodology Committee is intended to enable generation of information that is relevant and trustworthy for patients, and to enable decisions that improve patient-centered outcomes.

Darwinism and positivism as methodological influences on the development of psychology.

PubMed

Mackenzie, B

1976-10-01

The methodological significance of evolutionary theory for psychology may be distinguished from its substantive or theoretical significance. The methodological significance was that evolutionay theory broadened the current conceptors of scientific method and rendered them relatively independent of physics. It thereby made the application of the "scientific method" to psychology much more feasible than it had been previously, and thus established the possibility of a wide-ranging scientific psychology for the first time. The methodological eclecticism that made scientific psychology possible did not, however, remain a feature of psychology for very long. Psychology's methodology rapidly became restricted and codified through the influence of, and in imitation of, the rigorously positivistic orientation of physics around the turn of the twentieth century.

Application of systematic review methodology to the field of nutrition

USDA-ARS?s Scientific Manuscript database

Systematic reviews represent a rigorous and transparent approach of synthesizing scientific evidence that minimizes bias. They evolved within the medical community to support development of clinical and public health practice guidelines, set research agendas and formulate scientific consensus state...

Revised Planning Methodology For Signalized Intersections And Operational Analysis Of Exclusive Left-Turn Lanes, Part-II: Models And Procedures (Final Report)

DOT National Transportation Integrated Search

1996-04-01

THIS REPORT ALSO DESCRIBES THE PROCEDURES FOR DIRECT ESTIMATION OF INTERSECTION CAPACITY WITH SIMULATION, INCLUDING A SET OF RIGOROUS STATISTICAL TESTS FOR SIMULATION PARAMETER CALIBRATION FROM FIELD DATA.

Numerical parametric studies of spray combustion instability

NASA Technical Reports Server (NTRS)

Pindera, M. Z.

1993-01-01

A coupled numerical algorithm has been developed for studies of combustion instabilities in spray-driven liquid rocket engines. The model couples gas and liquid phase physics using the method of fractional steps. Also introduced is a novel, efficient methodology for accounting for spray formation through direct solution of liquid phase equations. Preliminary parametric studies show marked sensitivity of spray penetration and geometry to droplet diameter, considerations of liquid core, and acoustic interactions. Less sensitivity was shown to the combustion model type although more rigorous (multi-step) formulations may be needed for the differences to become apparent.

Tactics for mechanized reasoning: a commentary on Milner (1984) ‘The use of machines to assist in rigorous proof’

PubMed Central

Gordon, M. J. C.

2015-01-01

Robin Milner's paper, ‘The use of machines to assist in rigorous proof’, introduces methods for automating mathematical reasoning that are a milestone in the development of computer-assisted theorem proving. His ideas, particularly his theory of tactics, revolutionized the architecture of proof assistants. His methodology for automating rigorous proof soundly, particularly his theory of type polymorphism in programing, led to major contributions to the theory and design of programing languages. His citation for the 1991 ACM A.M. Turing award, the most prestigious award in computer science, credits him with, among other achievements, ‘probably the first theoretically based yet practical tool for machine assisted proof construction’. This commentary was written to celebrate the 350th anniversary of the journal Philosophical Transactions of the Royal Society. PMID:25750147

Why Open-Ended Survey Questions Are Unlikely to Support Rigorous Qualitative Insights.

PubMed

LaDonna, Kori A; Taylor, Taryn; Lingard, Lorelei

2018-03-01

Health professions education researchers are increasingly relying on a combination of quantitative and qualitative research methods to explore complex questions in the field. This important and necessary development, however, creates new methodological challenges that can affect both the rigor of the research process and the quality of the findings. One example is "qualitatively" analyzing free-text responses to survey or assessment instrument questions. In this Invited Commentary, the authors explain why analysis of such responses rarely meets the bar for rigorous qualitative research. While the authors do not discount the potential for free-text responses to enhance quantitative findings or to inspire new research questions, they caution that these responses rarely produce data rich enough to generate robust, stand-alone insights. The authors consider exemplars from health professions education research and propose strategies for treating free-text responses appropriately.

PRECEPT: an evidence assessment framework for infectious disease epidemiology, prevention and control.

PubMed

Harder, Thomas; Takla, Anja; Eckmanns, Tim; Ellis, Simon; Forland, Frode; James, Roberta; Meerpohl, Joerg J; Morgan, Antony; Rehfuess, Eva; Schünemann, Holger; Zuiderent-Jerak, Teun; de Carvalho Gomes, Helena; Wichmann, Ole

2017-10-01

Decisions in public health should be based on the best available evidence, reviewed and appraised using a rigorous and transparent methodology. The Project on a Framework for Rating Evidence in Public Health (PRECEPT) defined a methodology for evaluating and grading evidence in infectious disease epidemiology, prevention and control that takes different domains and question types into consideration. The methodology rates evidence in four domains: disease burden, risk factors, diagnostics and intervention. The framework guiding it has four steps going from overarching questions to an evidence statement. In step 1, approaches for identifying relevant key areas and developing specific questions to guide systematic evidence searches are described. In step 2, methodological guidance for conducting systematic reviews is provided; 15 study quality appraisal tools are proposed and an algorithm is given for matching a given study design with a tool. In step 3, a standardised evidence-grading scheme using the Grading of Recommendations Assessment, Development and Evaluation Working Group (GRADE) methodology is provided, whereby findings are documented in evidence profiles. Step 4 consists of preparing a narrative evidence summary. Users of this framework should be able to evaluate and grade scientific evidence from the four domains in a transparent and reproducible way.

PRECEPT: an evidence assessment framework for infectious disease epidemiology, prevention and control

PubMed Central

Harder, Thomas; Takla, Anja; Eckmanns, Tim; Ellis, Simon; Forland, Frode; James, Roberta; Meerpohl, Joerg J; Morgan, Antony; Rehfuess, Eva; Schünemann, Holger; Zuiderent-Jerak, Teun; de Carvalho Gomes, Helena; Wichmann, Ole

2017-01-01

Decisions in public health should be based on the best available evidence, reviewed and appraised using a rigorous and transparent methodology. The Project on a Framework for Rating Evidence in Public Health (PRECEPT) defined a methodology for evaluating and grading evidence in infectious disease epidemiology, prevention and control that takes different domains and question types into consideration. The methodology rates evidence in four domains: disease burden, risk factors, diagnostics and intervention. The framework guiding it has four steps going from overarching questions to an evidence statement. In step 1, approaches for identifying relevant key areas and developing specific questions to guide systematic evidence searches are described. In step 2, methodological guidance for conducting systematic reviews is provided; 15 study quality appraisal tools are proposed and an algorithm is given for matching a given study design with a tool. In step 3, a standardised evidence-grading scheme using the Grading of Recommendations Assessment, Development and Evaluation Working Group (GRADE) methodology is provided, whereby findings are documented in evidence profiles. Step 4 consists of preparing a narrative evidence summary. Users of this framework should be able to evaluate and grade scientific evidence from the four domains in a transparent and reproducible way. PMID:29019317

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina.

PubMed

Zhang, Xiaoxia; Wang, Hui; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved.

An Overview of Meta-Analyses of Danhong Injection for Unstable Angina

PubMed Central

Zhang, Xiaoxia; Chang, Yanxu; Wang, Yuefei; Lei, Xiang; Fu, Shufei; Zhang, Junhua

2015-01-01

Objective. To systematically collect evidence and evaluate the effects of Danhong injection (DHI) for unstable angina (UA). Methods. A comprehensive search was conducted in seven electronic databases up to January 2015. The methodological and reporting quality of included studies was assessed by using AMSTAR and PRISMA. Result. Five articles were included. The conclusions suggest that DHI plus conventional medicine treatment was effective for UA pectoris treatment, could alleviate symptoms of angina and ameliorate electrocardiograms. Flaws of the original studies and systematic reviews weaken the strength of evidence. Limitations of the methodology quality include performing an incomprehensive literature search, lacking detailed characteristics, ignoring clinical heterogeneity, and not assessing publication bias and other forms of bias. The flaws of reporting systematic reviews included the following: not providing a structured summary, no standardized search strategy. For the pooled findings, researchers took statistical heterogeneity into consideration, but clinical and methodology heterogeneity were ignored. Conclusion. DHI plus conventional medicine treatment generally appears to be effective for UA treatment. However, the evidence is not hard enough due to methodological flaws in original clinical trials and systematic reviews. Furthermore, rigorous designed randomized controlled trials are also needed. The methodology and reporting quality of systematic reviews should be improved. PMID:26539221

Social media and outbreaks of emerging infectious diseases: A systematic review of literature.

PubMed

Tang, Lu; Bie, Bijie; Park, Sung-Eun; Zhi, Degui

2018-04-05

The public often turn to social media for information during emerging infectious diseases (EIDs) outbreaks. This study identified the major approaches and assessed the rigors in published research articles on EIDs and social media. We searched 5 databases for published journal articles on EIDs and social media. We then evaluated these articles in terms of EIDs studied, social media examined, theoretical frameworks, methodologic approaches, and research findings. Thirty articles were included in the analysis (published between January 1, 2010, and March 1, 2016). EIDs that received most scholarly attention were H1N1 (or swine flu, n = 15), Ebola virus (n = 10), and H7N9 (or avian flu/bird flu, n = 2). Twitter was the most often studied social media (n = 17), followed by YouTube (n = 6), Facebook (n = 6), and blogs (n = 6). Three major approaches in this area of inquiry are identified: (1) assessment of the public's interest in and responses to EIDs, (2) examination of organizations' use of social media in communicating EIDs, and (3) evaluation of the accuracy of EID-related medical information on social media. Although academic studies of EID communication on social media are on the rise, they still suffer from a lack of theorization and a need for more methodologic rigor. Copyright © 2018 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Elsevier Inc. All rights reserved.

Understanding the metabolic and health effects of low-calorie sweeteners: methodological considerations and implications for future research

PubMed Central

Sylvetsky, Allison C.; Blau, Jenny E.; Rother, Kristina I.

2016-01-01

Consumption of foods, beverages, and packets containing low-calorie sweeteners (LCS) has increased markedly across gender, age, race/ethnicity, weight status, and socioeconomic subgroups. However, well-controlled intervention studies rigorously evaluating the health effects of LCS in humans are limited. One of the key questions is whether LCS are indeed a beneficial strategy for weight management and prevention of obesity. The current review discusses several methodological considerations in the design and interpretation of these studies. Specifically, we focus on the selection of study participants, inclusion of an appropriate control, importance of considering habitual LCS exposure, selection of specific LCS, dose and route of LCS administration, choice of study outcomes, and the context and generalizability of the study findings. These critical considerations will guide the design of future studies and thus assist in understanding the health effects of LCS. PMID:26936185

Understanding the metabolic and health effects of low-calorie sweeteners: methodological considerations and implications for future research.

PubMed

Sylvetsky, Allison C; Blau, Jenny E; Rother, Kristina I

2016-06-01

Consumption of foods, beverages, and packets containing low-calorie sweeteners (LCS) has increased markedly across gender, age, race/ethnicity, weight status, and socio-economic subgroups. However, well-controlled intervention studies rigorously evaluating the health effects of LCS in humans are limited. One of the key questions is whether LCS are indeed a beneficial strategy for weight management and prevention of obesity. The current review discusses several methodological considerations in the design and interpretation of these studies. Specifically, we focus on the selection of study participants, inclusion of an appropriate control, importance of considering habitual LCS exposure, selection of specific LCS, dose and route of LCS administration, choice of study outcomes, and the context and generalizability of the study findings. These critical considerations will guide the design of future studies and thus assist in understanding the health effects of LCS.

What makes a phenomenological study phenomenological? An analysis of peer-reviewed empirical nursing studies.

PubMed

Norlyk, Annelise; Harder, Ingegerd

2010-03-01

This article contributes to the debate about phenomenology as a research approach in nursing by providing a systematic review of what nurse researchers hold as phenomenology in published empirical studies. Based on the assumption that presentations of phenomenological approaches in peer-reviewed journals have consequences for the quality of future research, the aim was to analyze articles presenting phenomenological studies and, in light of the findings, raise a discussion about addressing scientific criteria. The analysis revealed considerable variations, ranging from brief to detailed descriptions of the stated phenomenological approach, and from inconsistencies to methodological clarity and rigor. Variations, apparent inconsistencies, and omissions made it unclear what makes a phenomenological study phenomenological. There is a need for clarifying how the principles of the phenomenological philosophy are implemented in a particular study before publishing. This should include an articulation of methodological keywords of the investigated phenomenon, and how an open attitude was adopted.

Exercise as Treatment for Anxiety: Systematic Review and Analysis.

PubMed

Stonerock, Gregory L; Hoffman, Benson M; Smith, Patrick J; Blumenthal, James A

2015-08-01

Exercise has been shown to reduce symptoms of anxiety, but few studies have studied exercise in individuals preselected because of their high anxiety. The objective of this study is to review and critically evaluate studies of exercise training in adults with either high levels of anxiety or an anxiety disorder. We conducted a systematic review of randomized clinical trials (RCTs) in which anxious adults were randomized to an exercise or nonexercise control condition. Data were extracted concerning anxiety outcomes and study design. Existing meta-analyses were also reviewed. Evidence from 12 RCTs suggested benefits of exercise, for select groups, similar to established treatments and greater than placebo. However, most studies had significant methodological limitations, including small sample sizes, concurrent therapies, and inadequate assessment of adherence and fitness levels. Exercise may be a useful treatment for anxiety, but lack of data from rigorous, methodologically sound RCTs precludes any definitive conclusions about its effectiveness.

Anti-tobacco mass media and socially disadvantaged groups: a systematic and methodological review.

PubMed

Guillaumier, Ashleigh; Bonevski, Billie; Paul, Chris

2012-07-01

Only a limited amount of research has been conducted to explore whether there are socioeconomic status differences in responses to mass media. However, the methodological quality of this evidence has not been assessed, limiting confidence in conclusions that can be drawn regarding study outcomes. A systematic review of the effectiveness of anti-tobacco mass media campaigns with socially disadvantaged groups was conducted, and the methodological quality of included studies was assessed. Medline, The Cochrane Library, PsycInfo, Embase and Web of Science were searched using MeSH and keywords for quantitative studies conducted in Western countries prior to March 2012. A methodological quality assessment and narrative analysis of included studies was undertaken. Seventeen relevant studies (reported in 18 papers) were identified; however, weak study designs and selection bias were common characteristics, limiting strong conclusions about effectiveness. Using predominantly non-cessation related outcome measures reviewed papers indicated mixed results for mass media tobacco control campaign effectiveness among various social groups. Most studies assessed mass media impact on low socioeconomic status groups rather than highly socially disadvantaged groups. Methodological rigour of evaluations in this field must be improved to aid understanding regarding the effectiveness of mass media campaigns in driving cessation among disadvantaged groups. The results of this review indicate a gap in methodologically rigorous research into the effectiveness of mass media campaigns among socially disadvantaged groups, particularly the highly disadvantaged. © 2012 Australasian Professional Society on Alcohol and other Drugs.

Methodological Issues in Trials of Complementary and Alternative Medicine Interventions

PubMed Central

Sikorskii, Alla; Wyatt, Gwen; Victorson, David; Faulkner, Gwen; Rahbar, Mohammad Hossein

2010-01-01

Background Complementary and alternative medicine (CAM) use is widespread among cancer patients. Information on safety and efficacy of CAM therapies is needed for both patients and health care providers. Well-designed randomized clinical trials (RCTs) of CAM therapy interventions can inform both clinical research and practice. Objectives To review important issues that affect the design of RCTs for CAM interventions. Methods Using the methods component of the Consolidated Standards for Reporting Trials (CONSORT) as a guiding framework, and a National Cancer Institute-funded reflexology study as an exemplar, methodological issues related to participants, intervention, objectives, outcomes, sample size, randomization, blinding, and statistical methods were reviewed. Discussion Trials of CAM interventions designed and implemented according to appropriate methodological standards will facilitate the needed scientific rigor in CAM research. Interventions in CAM can be tested using proposed methodology, and the results of testing will inform nursing practice in providing safe and effective supportive care and improving the well-being of patients. PMID:19918155

A prototype software methodology for the rapid evaluation of biomanufacturing process options.

PubMed

Chhatre, Sunil; Francis, Richard; O'Donovan, Kieran; Titchener-Hooker, Nigel J; Newcombe, Anthony R; Keshavarz-Moore, Eli

2007-10-01

A three-layered simulation methodology is described that rapidly evaluates biomanufacturing process options. In each layer, inferior options are screened out, while more promising candidates are evaluated further in the subsequent, more refined layer, which uses more rigorous models that require more data from time-consuming experimentation. Screening ensures laboratory studies are focused only on options showing the greatest potential. To simplify the screening, outputs of production level, cost and time are combined into a single value using multi-attribute-decision-making techniques. The methodology was illustrated by evaluating alternatives to an FDA (U.S. Food and Drug Administration)-approved process manufacturing rattlesnake antivenom. Currently, antivenom antibodies are recovered from ovine serum by precipitation/centrifugation and proteolyzed before chromatographic purification. Alternatives included increasing the feed volume, replacing centrifugation with microfiltration and replacing precipitation/centrifugation with a Protein G column. The best alternative used a higher feed volume and a Protein G step. By rapidly evaluating the attractiveness of options, the methodology facilitates efficient and cost-effective process development.

[The efficacy of music and music therapy in the neuromotor rehabilitation].

PubMed

Raglio, Alfredo

2012-01-01

This article review includes the controlled and randomized controlled trials about the use of music and music therapy techniques in the neuromotor rehabilitation. The paper defines the music therapy and delineates the neuroscientific bases and rehabilitative potential of music and music therapy interventions. Significant results are present in the stroke and Parkinson's disease rehabilitation. The Author's conclusions suggest the need of more rigorous studies based on clear procedures and strong methodological research criteria.

Review of the effect of music interventions on symptoms of anxiety and depression in older adults with mild dementia.

PubMed

Petrovsky, Darina; Cacchione, Pamela Z; George, Maureen

2015-10-01

Treatment of anxiety and depression, the most common psychiatric symptoms in older adults with mild dementia, requires innovative approaches due to the high cost and significant side effects associated with traditional pharmacological interventions. Alternative non-pharmacological therapies, such as music, when used in conjunction with pharmacological treatment, have the potential to alleviate symptoms of anxiety and depression in older adults diagnosed with mild dementia. The purpose of this review was to examine the evidence of music's efficacy in improving symptoms of anxiety and depression in older adults with mild dementia. Four databases (Medline, CINAHL, PsychInfo, PubMed) were searched using the terms "music," "music therapy," "music intervention," "singing," "dementia," "anxiety," and/or "depression," identifying ten studies that met the inclusion and exclusion criteria. The poor methodological rigor of the studies precluded reaching consensus on the efficacy of a music intervention in alleviating symptoms of anxiety and depression in older adults with mild dementia. There was inconclusive evidence as to whether music interventions are effective in alleviating symptoms of anxiety and depression in older adults with mild dementia due to the poor methodological rigor. However, with improved designs guided by a deeper understanding of how music engages the aging brain, music may emerge as an important adjunct therapy to improving the lives of older adults with mild dementia.

Exercise as Treatment for Anxiety: Systematic Review and Analysis

PubMed Central

Stonerock, Gregory L.; Hoffman, Benson M.; Smith, Patrick J.; Blumenthal, James A.

2015-01-01

Background Exercise has been shown to reduce symptoms of anxiety, but few studies have studied exercise in individuals pre-selected because of their high anxiety. Purpose To review and critically evaluate studies of exercise training in adults with either high levels of anxiety or an anxiety disorder. Methods We conducted a systematic review of randomized clinical trials (RCTs) in which anxious adults were randomized to an exercise or non-exercise control condition. Data were extracted concerning anxiety outcomes and study design. Existing meta-analyses were also reviewed. Results Evidence from 12 RCTs suggested benefits of exercise, for select groups, similar to established treatments and greater than placebo. However, most studies had significant methodological limitations, including small sample sizes, concurrent therapies, and inadequate assessment of adherence and fitness levels. Conclusions Exercise may be a useful treatment for anxiety, but lack of data from rigorous, methodologically sound RCTs precludes any definitive conclusions about its effectiveness. PMID:25697132

Teaching mathematical word problem solving: the quality of evidence for strategy instruction priming the problem structure.

PubMed

Jitendra, Asha K; Petersen-Brown, Shawna; Lein, Amy E; Zaslofsky, Anne F; Kunkel, Amy K; Jung, Pyung-Gang; Egan, Andrea M

2015-01-01

This study examined the quality of the research base related to strategy instruction priming the underlying mathematical problem structure for students with learning disabilities and those at risk for mathematics difficulties. We evaluated the quality of methodological rigor of 18 group research studies using the criteria proposed by Gersten et al. and 10 single case design (SCD) research studies using criteria suggested by Horner et al. and the What Works Clearinghouse. Results indicated that 14 group design studies met the criteria for high-quality or acceptable research, whereas SCD studies did not meet the standards for an evidence-based practice. Based on these findings, strategy instruction priming the mathematics problem structure is considered an evidence-based practice using only group design methodological criteria. Implications for future research and for practice are discussed. © Hammill Institute on Disabilities 2013.

Masculinity, Racism, Social Support, and Colorectal Cancer Screening Uptake Among African American Men: A Systematic Review.

PubMed

Rogers, Charles R; Mitchell, Jamie A; Franta, Gabriel J; Foster, Margaret J; Shires, Deirdre

2017-09-01

Colorectal cancer (CRC) is highly preventable when CRC screening is utilized, yet CRC screening completion among African American men is relatively low and their mortality rates remain 50% higher juxtaposed to their White counterparts. Since a growing body of literature indicates masculinity, racism, and social support each have strong influences on CRC screening uptake, this systematic review examined the connections between these three sociocultural factors and CRC screening uptake among African American men. Potential studies were retrieved from MEDLINE, CINAHL, EMBASE, and PsycINFO. Cited reference searching for the final sample was employed to identify and assess additional studies for inclusion using Scopus. The methodological quality of the reviewed evidence was also evaluated. Nineteen studies met inclusion/exclusion criteria. Thirteen studies employed nonexperimental research designs; a quasi-experimental design was present in four, and two utilized experimental designs. Studies were published between 2000 and 2014; the majority between 2009 and 2013. Social support was most frequently addressed (84%) while masculinity and racism were equally studied with paucity (11%) for their influence on CRC screening. After evaluating conceptual and methodological characteristics of the studies, 42% fell below average in quality and rigor. The need for increased attention to the sociocultural correlates of CRC screening for African American men are highlighted in this systematic review, and important recommendations for research and practice are provided. Alongside a call for more rigorous research, further research examining the influence of masculinity and racism on CRC screening completion among African American men is warranted.

Pretesting Qualitative Data Collection Procedures to Facilitate Methodological Adherence and Team Building in Nigeria.

PubMed

Hurst, Samantha; Arulogun, Oyedunni S; Owolabi, Ayowa O; Akinyemi, Rufus; Uvere, Ezinne; Warth, Stephanie; Ovbiagele, Bruce

Qualitative methods are becoming widely used and increasingly accepted in biomedical research involving teams formed by experts from developing and developed practice environments. Resources are rare in offering guidance on how to surmount challenges of team integration and resolution of complicated logistical issues in a global setting. In this article we present a critical reflection of lessons learned and necessary steps taken to achieve methodological coherence and international team synergy. A series of 10 pretest interviews were conducted to assess instrumentation rigor and formulate measures to address any limitations or threats to bias and management procedures before carrying out the formal phase of qualitative research, contributing to an evidence-based stroke-preventive care clinical trial study. The experience of pretesting notably helped to identify obstacles and thus increase the methodological and social reliability central to conducting credible qualitative research, while also ensuring both personal and professional fulfillment of our team members.

Formal verification of human-automation interaction

NASA Technical Reports Server (NTRS)

Degani, Asaf; Heymann, Michael

2002-01-01

This paper discusses a formal and rigorous approach to the analysis of operator interaction with machines. It addresses the acute problem of detecting design errors in human-machine interaction and focuses on verifying the correctness of the interaction in complex and automated control systems. The paper describes a systematic methodology for evaluating whether the interface provides the necessary information about the machine to enable the operator to perform a specified task successfully and unambiguously. It also addresses the adequacy of information provided to the user via training material (e.g., user manual) about the machine's behavior. The essentials of the methodology, which can be automated and applied to the verification of large systems, are illustrated by several examples and through a case study of pilot interaction with an autopilot aboard a modern commercial aircraft. The expected application of this methodology is an augmentation and enhancement, by formal verification, of human-automation interfaces.

Is There a Consensus on Consensus Methodology? Descriptions and Recommendations for Future Consensus Research.

PubMed

Waggoner, Jane; Carline, Jan D; Durning, Steven J

2016-05-01

The authors of this article reviewed the methodology of three common consensus methods: nominal group process, consensus development panels, and the Delphi technique. The authors set out to determine how a majority of researchers are conducting these studies, how they are analyzing results, and subsequently the manner in which they are reporting their findings. The authors conclude with a set of guidelines and suggestions designed to aid researchers who choose to use the consensus methodology in their work.Overall, researchers need to describe their inclusion criteria. In addition to this, on the basis of the current literature the authors found that a panel size of 5 to 11 members was most beneficial across all consensus methods described. Lastly, the authors agreed that the statistical analyses done in consensus method studies should be as rigorous as possible and that the predetermined definition of consensus must be included in the ultimate manuscript. More specific recommendations are given for each of the three consensus methods described in the article.

Methodological challenges of validating a clinical decision-making tool in the practice environment.

PubMed

Brennan, Caitlin W; Daly, Barbara J

2015-04-01

Validating a measurement tool intended for use in the practice environment poses challenges that may not be present when validating a tool intended solely for research purposes. The aim of this article is to describe the methodological challenges of validating a clinical decision-making tool, the Oncology Acuity Tool, which nurses use to make nurse assignment and staffing decisions prospectively each shift. Data were derived from a larger validation study, during which several methodological challenges arose. Revisions to the tool, including conducting iterative feedback cycles with end users, were necessary before the validation study was initiated. The "true" value of patient acuity is unknown, and thus, two approaches to inter-rater reliability assessment were used. Discordant perspectives existed between experts and end users. Balancing psychometric rigor with clinical relevance may be achieved through establishing research-practice partnerships, seeking active and continuous feedback with end users, and weighing traditional statistical rules of thumb with practical considerations. © The Author(s) 2014.

Do childhood vaccines have non-specific effects on mortality?

PubMed Central

Cooper, William O.; Boyce, Thomas G.; Wright, Peter F.; Griffin, Marie R.

2003-01-01

A recent article by Kristensen et al. suggested that measles vaccine and bacille Calmette-Gu rin (BCG) vaccine might reduce mortality beyond what is expected simply from protection against measles and tuberculosis. Previous reviews of the potential effects of childhood vaccines on mortality have not considered methodological features of reviewed studies. Methodological considerations play an especially important role in observational assessments, in which selection factors for vaccination may be difficult to ascertain. We reviewed 782 English language articles on vaccines and childhood mortality and found only a few whose design met the criteria for methodological rigor. The data reviewed suggest that measles vaccine delivers its promised reduction in mortality, but there is insufficient evidence to suggest a mortality benefit above that caused by its effect on measles disease and its sequelae. Our review of the available data in the literature reinforces how difficult answering these considerations has been and how important study design will be in determining the effect of specific vaccines on all-cause mortality. PMID:14758409

Recruiting vulnerable populations into research: a systematic review of recruitment interventions.

PubMed

UyBico, Stacy J; Pavel, Shani; Gross, Cary P

2007-06-01

Members of vulnerable populations are underrepresented in research studies. To evaluate and synthesize the evidence regarding interventions to enhance enrollment of vulnerable populations into health research studies. Studies were identified by searching MEDLINE, the Web of Science database, personal sources, hand searching of related journals, and article references. Studies that contained data on recruitment interventions for vulnerable populations (minority, underserved, poor, rural, urban, or inner city) and for which the parent study (study for which recruitment was taking place) was an intervention study were included. A total of 2,648 study titles were screened and 48 articles met inclusion criteria, representing 56 parent studies. Two investigators extracted data from each study. African Americans were the most frequently targeted population (82% of the studies), while 46% targeted Hispanics/Latinos. Many studies assessed 2 or more interventions, including social marketing (82% of studies), community outreach (80%), health system recruitment (52%), and referrals (28%). The methodologic rigor varied substantially. Only 40 studies (71%) incorporated a control group and 21% used statistical analysis to compare interventions. Social marketing, health system, and referral recruitment were each found to be the most successful intervention about 35-45% of the studies in which they were attempted, while community outreach was the most successful intervention in only 2 of 16 studies (13%) in which it was employed. People contacted as a result of social marketing were no less likely to enroll than people contacted through other mechanisms. Further work with greater methodologic rigor is needed to identify evidence-based strategies for increasing minority enrollment in research studies; community outreach, as an isolated strategy, may be less successful than other strategies.

Recruiting Vulnerable Populations into Research: A Systematic Review of Recruitment Interventions

PubMed Central

UyBico, Stacy J.; Pavel, Shani

2007-01-01

Background Members of vulnerable populations are underrepresented in research studies. Objective To evaluate and synthesize the evidence regarding interventions to enhance enrollment of vulnerable populations into health research studies. Data sources Studies were identified by searching MEDLINE, the Web of Science database, personal sources, hand searching of related journals, and article references. Studies that contained data on recruitment interventions for vulnerable populations (minority, underserved, poor, rural, urban, or inner city) and for which the parent study (study for which recruitment was taking place) was an intervention study were included. A total of 2,648 study titles were screened and 48 articles met inclusion criteria, representing 56 parent studies. Two investigators extracted data from each study. Results African Americans were the most frequently targeted population (82% of the studies), while 46% targeted Hispanics/Latinos. Many studies assessed 2 or more interventions, including social marketing (82% of studies), community outreach (80%), health system recruitment (52%), and referrals (28%). The methodologic rigor varied substantially. Only 40 studies (71%) incorporated a control group and 21% used statistical analysis to compare interventions. Social marketing, health system, and referral recruitment were each found to be the most successful intervention about 35–45% of the studies in which they were attempted, while community outreach was the most successful intervention in only 2 of 16 studies (13%) in which it was employed. People contacted as a result of social marketing were no less likely to enroll than people contacted through other mechanisms. Conclusions Further work with greater methodologic rigor is needed to identify evidence-based strategies for increasing minority enrollment in research studies; community outreach, as an isolated strategy, may be less successful than other strategies. PMID:17375358

Sexuality Research in Iran: A Focus on Methodological and Ethical Considerations.

PubMed

Rahmani, Azam; Merghati-Khoei, Effat; Moghaddam-Banaem, Lida; Zarei, Fatemeh; Montazeri, Ali; Hajizadeh, Ebrahim

2015-07-01

Research on sensitive topics, such as sexuality, could raise technical, methodological, ethical, political, and legal challenges. The aim of this paper was to draw the methodological challenges which the authors confronted during sexuality research with young population in the Iranian culture. This study was an exploratory mixed method one conducted in 2013-14. We interviewed 63 young women aged 18-34 yr in qualitative phase and 265 young women in quantitative phase in (university and non-university) dormitories and in an Adolescent Friendly Center. Data were collected using focus group discussions and individual interviews in the qualitative phase. We employed conventional content analysis to analyze the data. To enhance the rigor of the data, multiple data collection methods, maximum variation sampling, and peer checks were applied. Five main themes emerged from the data: interaction with opposite sex, sexual risk, sexual protective, sex education, and sexual vulnerability. Challenges while conducting sex research have been discussed. These challenges included assumption of promiscuity, language of silence and privacy concerns, and sex segregation policy. We described the strategies applied in our study and the rationales for each strategy. Strategies applied in the present study can be employed in contexts with the similar methodological and moral concerns.

Pedagogy and Academic Success in Prelicensure Nursing Education.

PubMed

Murray, Teri A

2016-01-01

The purpose of this article is to provide a brief description of the New Careers in Nursing (NCIN) program; highlight the features of the NCIN Preentry Immersion program designed to help students achieve academic success; introduce two NCIN innovation teaching projects that used active learning strategies to foster student engagement; and conduct an integrative review on the pedagogies used to foster academic success in nursing education. The integrative review revealed that interactive pedagogies fostered student engagement and increased the students' knowledge acquisition, competence, confidence, and satisfaction. Significant variations in the methodological rigor for the studies included in this review were noted in addition to nebulousness between nursing education research and evaluation. The review validated the need for more rigorous research in nursing education to improve the students' academic experience and subsequent success of all nursing students, including those from underrepresented or disadvantaged backgrounds, enrolled in prelicensure nursing education programs. Copyright © 2016 Elsevier Inc. All rights reserved.

Adaptive characterization of recrystallization kinetics in IF steel by electron backscatter diffraction.

PubMed

Kim, Dong-Kyu; Park, Won-Woong; Lee, Ho Won; Kang, Seong-Hoon; Im, Yong-Taek

2013-12-01

In this study, a rigorous methodology for quantifying recrystallization kinetics by electron backscatter diffraction is proposed in order to reduce errors associated with the operator's skill. An adaptive criterion to determine adjustable grain orientation spread depending on the recrystallization stage is proposed to better identify the recrystallized grains in the partially recrystallized microstructure. The proposed method was applied in characterizing the microstructure evolution during annealing of interstitial-free steel cold rolled to low and high true strain levels of 0.7 and 1.6, respectively. The recrystallization kinetics determined by the proposed method was found to be consistent with the standard method of Vickers microhardness. The application of the proposed method to the overall recrystallization stages showed that it can be used for the rigorous characterization of progressive microstructure evolution, especially for the severely deformed material. © 2013 The Authors Journal of Microscopy © 2013 Royal Microscopical Society.

The Holy Trinity of Methodological Rigor: A Skeptical View

ERIC Educational Resources Information Center

Coryn, Chris L. S.

2007-01-01

The author discusses validation hierarchies grounded in the tradition of quantitative research that generally consists of the criteria of validity, reliability and objectivity and compares this with similar criteria developed by the qualitative tradition, described as trustworthiness, dependability and confirmability. Although these quantitative…

Quality in physical therapist clinical education: a systematic review.

PubMed

McCallum, Christine A; Mosher, Peter D; Jacobson, Peri J; Gallivan, Sean P; Giuffre, Suzanne M

2013-10-01

Many factors affect student learning throughout the clinical education (CE) component of professional (entry-level) physical therapist education curricula. Physical therapist education programs (PTEPs) manage CE, yet the material and human resources required to provide CE are generally overseen by community-based physical therapist practices. The purposes of this systematic review were: (1) to examine how the construct of quality is defined in CE literature and (2) to determine the methodological rigor of the available evidence on quality in physical therapist CE. This study was a systematic review of English-language journals using the American Physical Therapy Association's Open Door Portal to Evidence-Based Practice as the computer search engine. The search was categorized using terms for physical therapy and quality and for CE pedagogy and models or roles. Summary findings were characterized by 5 primary themes and 14 subthemes using a qualitative-directed content analysis. Fifty-four articles were included in the study. The primary quality themes were: CE framework, CE sites, structure of CE, assessment in CE, and CE faculty. The methodological rigor of the studies was critically appraised using a binary system based on the McMaster appraisal tools. Scores ranged from 3 to 14. Publication bias and outcome reporting bias may be inherent limitations to the results. The review found inconclusive evidence about what constitutes quality or best practice for physical therapist CE. Five key constructs of CE were identified that, when aggregated, could construe quality.

Mixed methods research design for pragmatic psychoanalytic studies.

PubMed

Tillman, Jane G; Clemence, A Jill; Stevens, Jennifer L

2011-10-01

Calls for more rigorous psychoanalytic studies have increased over the past decade. The field has been divided by those who assert that psychoanalysis is properly a hermeneutic endeavor and those who see it as a science. A comparable debate is found in research methodology, where qualitative and quantitative methods have often been seen as occupying orthogonal positions. Recently, Mixed Methods Research (MMR) has emerged as a viable "third community" of research, pursuing a pragmatic approach to research endeavors through integrating qualitative and quantitative procedures in a single study design. Mixed Methods Research designs and the terminology associated with this emerging approach are explained, after which the methodology is explored as a potential integrative approach to a psychoanalytic human science. Both qualitative and quantitative research methods are reviewed, as well as how they may be used in Mixed Methods Research to study complex human phenomena.

Substance abuse prevention intervention research with Hispanic populations.

PubMed

Castro, Felipe González; Barrera, Manuel; Pantin, Hilda; Martinez, Charles; Felix-Ortiz, Maria; Rios, Rebeca; Lopez, Vera A; Lopez, Cristy

2006-09-01

Selected studies with specific relevance to substance abuse prevention interventions with Hispanic youth and families were examined to identify prior findings and emerging issues that may guide the design of future substance abuse prevention intervention research and its implementation with Hispanic populations. The origins of prevention research and role of risk and protective factors are examined, including culturally-specific risk and protective factors for Hispanic populations. Correlational studies, non-experimental interventions, and randomized controlled trials were examined for the period of 1974-2003. The literature search yielded 15 articles selected for this review that exhibited adequate methodological rigor. An added search for more recent studies identified three additional articles, for a total of 18 prevention intervention articles that were reviewed. Theoretical and methodological issues and recommendations are presented for future research aimed at improving the efficacy and effectiveness of future prevention intervention studies and their cultural relevance for Hispanic populations.

Observations of fallibility in applications of modern programming methodologies

NASA Technical Reports Server (NTRS)

Gerhart, S. L.; Yelowitz, L.

1976-01-01

Errors, inconsistencies, or confusing points are noted in a variety of published algorithms, many of which are being used as examples in formulating or teaching principles of such modern programming methodologies as formal specification, systematic construction, and correctness proving. Common properties of these points of contention are abstracted. These properties are then used to pinpoint possible causes of the errors and to formulate general guidelines which might help to avoid further errors. The common characteristic of mathematical rigor and reasoning in these examples is noted, leading to some discussion about fallibility in mathematics, and its relationship to fallibility in these programming methodologies. The overriding goal is to cast a more realistic perspective on the methodologies, particularly with respect to older methodologies, such as testing, and to provide constructive recommendations for their improvement.

Institutions and national development in Latin America: a comparative study

PubMed Central

Portes, Alejandro; Smith, Lori D.

2013-01-01

We review the theoretical and empirical literatures on the role of institutions on national development as a prelude to present a more rigorous and measurable definition of the concept and a methodology to study this relationship at the national and subnational levels. The existing research literature features conflicting definitions of the concept of “institutions” and empirical tests based mostly on reputational indices, with countries as units of analysis. The present study’s methodology is based on a set of five strategic organizations studied comparatively in five Latin American countries. These include key federal agencies, public administrative organizations, and stock exchanges. Systematic analysis of results show a pattern of differences between economically-oriented institutions and those entrusted with providing basic services to the general population. Consistent differences in institutional quality also emerge across countries, despite similar levels of economic development. Using the algebraic methods developed by Ragin, we test six hypotheses about factors determining the developmental character of particular institutions. Implications of results for theory and for methodological practices of future studies in this field are discussed. PMID:26543407

The neuroscience of mindfulness meditation.

PubMed

Tang, Yi-Yuan; Hölzel, Britta K; Posner, Michael I

2015-04-01

Research over the past two decades broadly supports the claim that mindfulness meditation - practiced widely for the reduction of stress and promotion of health - exerts beneficial effects on physical and mental health, and cognitive performance. Recent neuroimaging studies have begun to uncover the brain areas and networks that mediate these positive effects. However, the underlying neural mechanisms remain unclear, and it is apparent that more methodologically rigorous studies are required if we are to gain a full understanding of the neuronal and molecular bases of the changes in the brain that accompany mindfulness meditation.

Methodological quality of behavioural weight loss studies: a systematic review

PubMed Central

Lemon, S. C.; Wang, M. L.; Haughton, C. F.; Estabrook, D. P.; Frisard, C. F.; Pagoto, S. L.

2018-01-01

Summary This systematic review assessed the methodological quality of behavioural weight loss intervention studies conducted among adults and associations between quality and statistically significant weight loss outcome, strength of intervention effectiveness and sample size. Searches for trials published between January, 2009 and December, 2014 were conducted using PUBMED, MEDLINE and PSYCINFO and identified ninety studies. Methodological quality indicators included study design, anthropometric measurement approach, sample size calculations, intent-to-treat (ITT) analysis, loss to follow-up rate, missing data strategy, sampling strategy, report of treatment receipt and report of intervention fidelity (mean = 6.3). Indicators most commonly utilized included randomized design (100%), objectively measured anthropometrics (96.7%), ITT analysis (86.7%) and reporting treatment adherence (76.7%). Most studies (62.2%) had a follow-up rate >75% and reported a loss to follow-up analytic strategy or minimal missing data (69.9%). Describing intervention fidelity (34.4%) and sampling from a known population (41.1%) were least common. Methodological quality was not associated with reporting a statistically significant result, effect size or sample size. This review found the published literature of behavioural weight loss trials to be of high quality for specific indicators, including study design and measurement. Identified for improvement include utilization of more rigorous statistical approaches to loss to follow up and better fidelity reporting. PMID:27071775

Enhancing rigor and practice of scoping reviews in social policy research: considerations from a worked example on the Americans with disabilities act.

PubMed

Harris, Sarah Parker; Gould, Robert; Fujiura, Glenn

2015-01-01

There is increasing theoretical consideration about the use of systematic and scoping reviews of evidence in informing disability and rehabilitation research and practice. Indicative of this trend, this journal published a piece by Rumrill, Fitzgerald and Merchant in 2010 explaining the utility and process for conducting reviews of intervention-based research. There is still need to consider how to apply such rigor when conducting more exploratory reviews of heterogeneous research. This article explores the challenges, benefits, and procedures for conducting rigorous exploratory scoping reviews of diverse evidence. The article expands upon Rumrill, Fitzgerald and Merchant's framework and considers its application to more heterogeneous evidence on the impact of social policy. A worked example of a scoping review of the Americans with Disabilities Act is provided with a procedural framework for conducting scoping reviews on the effects of a social policy. The need for more nuanced techniques for enhancing rigor became apparent during the review process. There are multiple methodological steps that can enhance the utility of exploratory scoping reviews. The potential of systematic consideration during the exploratory review process is shown as a viable method to enhance the rigor in reviewing diverse bodies of evidence.

Analytical Methodology Used To Assess/Refine Observatory Thermal Vacuum Test Conditions For the Landsat 8 Data Continuity Mission

NASA Technical Reports Server (NTRS)

Fantano, Louis

2015-01-01

Thermal and Fluids Analysis Workshop Silver Spring, MD NCTS 21070-15 The Landsat 8 Data Continuity Mission, which is part of the United States Geologic Survey (USGS), launched February 11, 2013. A Landsat environmental test requirement mandated that test conditions bound worst-case flight thermal environments. This paper describes a rigorous analytical methodology applied to assess refine proposed thermal vacuum test conditions and the issues encountered attempting to satisfy this requirement.

A Methodological Analysis of Randomized Clinical Trials of Computer-Assisted Therapies for Psychiatric Disorders: Toward Improved Standards for an Emerging Field

PubMed Central

Kiluk, Brian D.; Sugarman, Dawn E.; Nich, Charla; Gibbons, Carly J.; Martino, Steve; Rounsaville, Bruce J.; Carroll, Kathleen M.

2013-01-01

Objective Computer-assisted therapies offer a novel, cost-effective strategy for providing evidence-based therapies to a broad range of individuals with psychiatric disorders. However, the extent to which the growing body of randomized trials evaluating computer-assisted therapies meets current standards of methodological rigor for evidence-based interventions is not clear. Method A methodological analysis of randomized clinical trials of computer-assisted therapies for adult psychiatric disorders, published between January 1990 and January 2010, was conducted. Seventy-five studies that examined computer-assisted therapies for a range of axis I disorders were evaluated using a 14-item methodological quality index. Results Results indicated marked heterogeneity in study quality. No study met all 14 basic quality standards, and three met 13 criteria. Consistent weaknesses were noted in evaluation of treatment exposure and adherence, rates of follow-up assessment, and conformity to intention-to-treat principles. Studies utilizing weaker comparison conditions (e.g., wait-list controls) had poorer methodological quality scores and were more likely to report effects favoring the computer-assisted condition. Conclusions While several well-conducted studies have indicated promising results for computer-assisted therapies, this emerging field has not yet achieved a level of methodological quality equivalent to those required for other evidence-based behavioral therapies or pharmacotherapies. Adoption of more consistent standards for methodological quality in this field, with greater attention to potential adverse events, is needed before computer-assisted therapies are widely disseminated or marketed as evidence based. PMID:21536689

A Critical Review of Methods to Evaluate the Impact of FDA Regulatory Actions

PubMed Central

Briesacher, Becky A.; Soumerai, Stephen B.; Zhang, Fang; Toh, Sengwee; Andrade, Susan E.; Wagner, Joann L.; Shoaibi, Azadeh; Gurwitz, Jerry H.

2013-01-01

Purpose To conduct a synthesis of the literature on methods to evaluate the impacts of FDA regulatory actions, and identify best practices for future evaluations. Methods We searched MEDLINE for manuscripts published between January 1948 and August 2011 that included terms related to FDA, regulatory actions, and empirical evaluation; the review additionally included FDA-identified literature. We used a modified Delphi method to identify preferred methodologies. We included studies with explicit methods to address threats to validity, and identified designs and analytic methods with strong internal validity that have been applied to other policy evaluations. Results We included 18 studies out of 243 abstracts and papers screened. Overall, analytic rigor in prior evaluations of FDA regulatory actions varied considerably; less than a quarter of studies (22%) included control groups. Only 56% assessed changes in the use of substitute products/services, and 11% examined patient health outcomes. Among studies meeting minimal criteria of rigor, 50% found no impact or weak/modest impacts of FDA actions and 33% detected unintended consequences. Among those studies finding significant intended effects of FDA actions, all cited the importance of intensive communication efforts. There are preferred methods with strong internal validity that have yet to be applied to evaluations of FDA regulatory actions. Conclusions Rigorous evaluations of the impact of FDA regulatory actions have been limited and infrequent. Several methods with strong internal validity are available to improve trustworthiness of future evaluations of FDA policies. PMID:23847020

Rater methodology for stroboscopy: a systematic review.

PubMed

Bonilha, Heather Shaw; Focht, Kendrea L; Martin-Harris, Bonnie

2015-01-01

Laryngeal endoscopy with stroboscopy (LES) remains the clinical gold standard for assessing vocal fold function. LES is used to evaluate the efficacy of voice treatments in research studies and clinical practice. LES as a voice treatment outcome tool is only as good as the clinician interpreting the recordings. Research using LES as a treatment outcome measure should be evaluated based on rater methodology and reliability. The purpose of this literature review was to evaluate the rater-related methodology from studies that use stroboscopic findings as voice treatment outcome measures. Systematic literature review. Computerized journal databases were searched for relevant articles using terms: stroboscopy and treatment. Eligible articles were categorized and evaluated for the use of rater-related methodology, reporting of number of raters, types of raters, blinding, and rater reliability. Of the 738 articles reviewed, 80 articles met inclusion criteria. More than one-third of the studies included in the review did not report the number of raters who participated in the study. Eleven studies reported results of rater reliability analysis with only two studies reporting good inter- and intrarater reliability. The comparability and use of results from treatment studies that use LES are limited by a lack of rigor in rater methodology and variable, mostly poor, inter- and intrarater reliability. To improve our ability to evaluate and use the findings from voice treatment studies that use LES features as outcome measures, greater consistency of reporting rater methodology characteristics across studies and improved rater reliability is needed. Copyright © 2015 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes.

PubMed

Woodruff, Tracey J; Sutton, Patrice

2014-10-01

Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. We sought to develop a proof of concept of the "Navigation Guide," a systematic and transparent method of research synthesis in environmental health. The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of "risk of bias," and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a "moderate" quality rating to human observational studies and combining diverse evidence streams. The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm.

Risk Assessment and Decision-Making at the Local Level:?Who does what when, how, and to what extent?

EPA Science Inventory

Problem: Exposure to multiple stressors increases the likelihood of an adverse response in human and ecosystem communities. Challenge: A rigorous and scientifically robust assessment methodology is needed to characterize stressors and receptors of interest, calculate risk estimat...

Strengthening the Scholarship of Teaching and Learning via Experimentation

ERIC Educational Resources Information Center

LoSchiavo, Frank M.; Shatz, Mark A.; Poling, Devereaux A.

2008-01-01

In recent years, national policy experts have questioned the overall quality of educational research, and they have suggested that researchers strengthen their scientific methods by maximizing the use of experimental designs. To promote more rigorous methodology, we discuss several new and often-overlooked opportunities for incorporating…

Medical Students Cultural Attitudes: The Health Belief Attitudes Survey

ERIC Educational Resources Information Center

Corley, James Earl; Massie, F. Stanford, Jr.; Medrano, Martha; Estrada, Carlos A.

2016-01-01

Cultural competent care is the ability to deliver effective medical care to people from different cultures. The lack of methodological rigor and paucity of psychometric properties information of the instruments limits the generalizability of cultural competency educational interventions. We examined cultural attitudes of first year medical…

Emerging Educational Institutional Decision-Making Matrix

ERIC Educational Resources Information Center

Ashford-Rowe, Kevin H.; Holt, Marnie

2011-01-01

The "emerging educational institutional decision-making matrix" is developed to allow educational institutions to adopt a rigorous and consistent methodology of determining which of the myriad of emerging educational technologies will be the most compelling for the institution, particularly ensuring that it is the educational or pedagogical but…

Is ginseng an ergogenic aid?

PubMed

Bahrke, Michael S; Morgan, William P; Stegner, Aaron

2009-06-01

Ginseng is one of the most popular herbal supplements in the world. Although it is used for the treatment and prevention of many ailments, it is also used to increase work efficiency and is purported to increase energy and physical stamina. Athletes use ginseng for its alleged performance-enhancing attributes. However, many studies examining the pharmacological effects of ginseng on physical performance have not employed sound scientific design and methodology. The purpose of this review is to provide an update on published empirical research focusing primarily on the efficacy of ginseng with respect to physical and athletic performance. Despite attempts in recent investigations to improve on the scientific rigor used in examining the ergogenic properties of ginseng, the authors conclude that many of the same methodological shortcomings observed in earlier studies persist. Enhanced physical performance after ginseng administration in well-designed investigations remains to be demonstrated.

A Practical Engineering Approach to Predicting Fatigue Crack Growth in Riveted Lap Joints

NASA Technical Reports Server (NTRS)

Harris, Charles E.; Piascik, Robert S.; Newman, James C., Jr.

1999-01-01

An extensive experimental database has been assembled from very detailed teardown examinations of fatigue cracks found in rivet holes of fuselage structural components. Based on this experimental database, a comprehensive analysis methodology was developed to predict the onset of widespread fatigue damage in lap joints of fuselage structure. Several computer codes were developed with specialized capabilities to conduct the various analyses that make up the comprehensive methodology. Over the past several years, the authors have interrogated various aspects of the analysis methods to determine the degree of computational rigor required to produce numerical predictions with acceptable engineering accuracy. This study led to the formulation of a practical engineering approach to predicting fatigue crack growth in riveted lap joints. This paper describes the practical engineering approach and compares predictions with the results from several experimental studies.

A Practical Engineering Approach to Predicting Fatigue Crack Growth in Riveted Lap Joints

NASA Technical Reports Server (NTRS)

Harris, C. E.; Piascik, R. S.; Newman, J. C., Jr.

2000-01-01

An extensive experimental database has been assembled from very detailed teardown examinations of fatigue cracks found in rivet holes of fuselage structural components. Based on this experimental database, a comprehensive analysis methodology was developed to predict the onset of widespread fatigue damage in lap joints of fuselage structure. Several computer codes were developed with specialized capabilities to conduct the various analyses that make up the comprehensive methodology. Over the past several years, the authors have interrogated various aspects of the analysis methods to determine the degree of computational rigor required to produce numerical predictions with acceptable engineering accuracy. This study led to the formulation of a practical engineering approach to predicting fatigue crack growth in riveted lap joints. This paper describes the practical engineering approach and compares predictions with the results from several experimental studies.

Anti-bullying interventions in schools: a systematic literature review.

PubMed

Silva, Jorge Luiz da; Oliveira, Wanderlei Abadio de; Mello, Flávia Carvalho Malta de; Andrade, Luciane Sá de; Bazon, Marina Rezende; Silva, Marta Angélica Iossi

2017-07-01

This paper presents a systematic literature review addressing rigorously planned and assessed interventions intended to reduce school bullying. The search for papers was performed in four databases (Lilacs, Psycinfo, Scielo and Web of Science) and guided by the question: What are the interventions used to reduce bullying in schools? Only case-control studies specifically focusing on school bullying without a time frame were included. The methodological quality of investigations was assessed using the SIGN checklist. A total of 18 papers composed the corpus of analysis and all were considered to have high methodological quality. The interventions conducted in the revised studies were divided into four categories: multi-component or whole-school, social skills training, curricular, and computerized. The review synthesizes knowledge that can be used to contemplate practices and intervention programs in the education and health fields with a multidisciplinary nature.

Use of software engineering techniques in the design of the ALEPH data acquisition system

NASA Astrophysics Data System (ADS)

Charity, T.; McClatchey, R.; Harvey, J.

1987-08-01

The SASD methodology is being used to provide a rigorous design framework for various components of the ALEPH data acquisition system. The Entity-Relationship data model is used to describe the layout and configuration of the control and acquisition systems and detector components. State Transition Diagrams are used to specify control applications such as run control and resource management and Data Flow Diagrams assist in decomposing software tasks and defining interfaces between processes. These techniques encourage rigorous software design leading to enhanced functionality and reliability. Improved documentation and communication ensures continuity over the system life-cycle and simplifies project management.

Non-pharmacological sleep interventions for youth with chronic health conditions: a critical review of the methodological quality of the evidence.

PubMed

Brown, Cary A; Kuo, Melissa; Phillips, Leah; Berry, Robyn; Tan, Maria

2013-07-01

Restorative sleep is clearly linked with well-being in youth with chronic health conditions. This review addresses the methodological quality of non-pharmacological sleep intervention (NPSI) research for youth with chronic health conditions. The Guidelines for Critical Review (GCR) and the Effective Public Health Practice Project Quality Assessment Tool (EPHPP) were used in the review. The search yielded 31 behavioural and 10 non-behavioural NPSI for review. Most studies had less than 10 participants. Autism spectrum disorders, attention deficit/hyperactivity disorders, down syndrome, intellectual disabilities, and visual impairments were the conditions that most studies focused upon. The global EPHPP scores indicated most reviewed studies were of weak quality. Only 7 studies were rated as moderate, none were strong. Studies rated as weak quality frequently had recruitment issues; non-blinded participants/parents and/or researchers; and used outcome measures without sound psychometric properties. Little conclusive evidence exists for NPSIs in this population. However, NPSIs are widely used and these preliminary studies demonstrate promising outcomes. There have not been any published reports of negative outcomes that would preclude application of the different NPSIs on a case-by-case basis guided by clinical judgement. These findings support the need for more rigorous, applied research. • Methodological Quality of Sleep Research • Disordered sleep (DS) in youth with chronic health conditions is pervasive and is important to rehabilitation therapists because DS contributes to significant functional problems across psychological, physical and emotional domains. • Rehabilitation therapists and other healthcare providers receive little education about disordered sleep and are largely unaware of the range of assessment and non-pharmacological intervention strategies that exist. An evidence-based website of pediatric sleep resources can be found at http://www.SleepRight.ualberta.ca • The current research on non-pharmacological sleep interventions (NPSI) for youth with health conditions is methodologically weak. However, consistently positive outcomes reported in the literature demonstrate that pragmatic interventions such as bright light therapy, activity, massage and behavioral interventions are promising areas. No studies found reasons that a trail of a NPSI matched to the youth's context and condition should not attempted. More rigorous clinically relevant study of pragmatic non-pharmacological interventions appropriate for therapists' and parents' needs is required.

Developing the DESCARTE Model: The Design of Case Study Research in Health Care.

PubMed

Carolan, Clare M; Forbat, Liz; Smith, Annetta

2016-04-01

Case study is a long-established research tradition which predates the recent surge in mixed-methods research. Although a myriad of nuanced definitions of case study exist, seminal case study authors agree that the use of multiple data sources typify this research approach. The expansive case study literature demonstrates a lack of clarity and guidance in designing and reporting this approach to research. Informed by two reviews of the current health care literature, we posit that methodological description in case studies principally focuses on description of case study typology, which impedes the construction of methodologically clear and rigorous case studies. We draw from the case study and mixed-methods literature to develop the DESCARTE model as an innovative approach to the design, conduct, and reporting of case studies in health care. We examine how case study fits within the overall enterprise of qualitatively driven mixed-methods research, and the potential strengths of the model are considered. © The Author(s) 2015.

Macroergonomic analysis and design for improved safety and quality performance.

PubMed

Kleiner, B M

1999-01-01

Macroergonomics, which emerged historically after sociotechnical systems theory, quality management, and ergonomics, is presented as the basis for a needed integrative methodology. A macroergonomics methodology was presented in some detail to demonstrate how aspects of microergonomics, total quality management (TQM), and sociotechnical systems (STS) can be triangulated in a common approach. In the context of this methodology, quality and safety were presented as 2 of several important performance criteria. To demonstrate aspects of the methodology, 2 case studies were summarized with safety and quality performance results where available. The first case manipulated both personnel and technical factors to achieve a "safety culture" at a nuclear site. The concept of safety culture is defined in INSAG-4 (International Atomic Energy Agency, 1991). as "that assembly of characteristics and attitudes in organizations and individuals which establishes that, as an overriding priority, nuclear plant safety issues receive the attention warranted by their significance." The second case described a tire manufacturing intervention to improve quality (as defined by Sink and Tuttle, 1989) through joint consideration of technical and social factors. It was suggested that macroergonomics can yield greater performance than can be achieved through ergonomic intervention alone. Whereas case studies help to make the case, more rigorous formative and summative research is needed to refine and validate the proposed methodology respectively.

75 FR 71131 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-22

... impacts. To complete this task with scientific rigor, it will be necessary to collect high quality survey... instruments, methodologies, procedures, and analytical techniques for this task. Moreover, they have been pilot tested in 11 States. The tools and techniques were submitted for review, and were approved, by...

The role of reporting standards in producing robust literature reviews

NASA Astrophysics Data System (ADS)

Haddaway, Neal Robert; Macura, Biljana

2018-06-01

Literature reviews can help to inform decision-making, yet they may be subject to fatal bias if not conducted rigorously as `systematic reviews'. Reporting standards help authors to provide sufficient methodological detail to allow verification and replication, clarifying when key steps, such as critical appraisal, have been omitted.

Pick One! Conducting Preference Assessments with Students with Significant Disabilities

ERIC Educational Resources Information Center

Cannella-Malone, Helen I.; Sabielny, Linsey M.; Jimenez, Eliseo D.; Miller, Megan M.

2013-01-01

Research has demonstrated that people with significant intellectual, developmental, and physical disabilities can indicate clear preferences through methodologically rigorous assessments. Once preferred items have been identified, they can be used to reinforce new behaviors, which can assist in the development of a meaningful learning experience.…

There's Education, and Then There's Education in Medicine

ERIC Educational Resources Information Center

Royal, Kenneth D.; Rinaldo, Jason C. B.

2016-01-01

Introduction: For some time now the field of medical education has been criticized by many of its stakeholders. Countless debates have been presented in the literature regarding the quality of medical education research, adequacy of methodological rigor, and other concerns. Methods: At present, the views expressed have largely come from physicians…

Culturally Sensitive Risk Behavior Prevention Programs for African American Adolescents: A Systematic Analysis

ERIC Educational Resources Information Center

Metzger, Isha; Cooper, Shauna M.; Zarrett, Nicole; Flory, Kate

2013-01-01

The current review conducted a systematic assessment of culturally sensitive risk prevention programs for African American adolescents. Prevention programs meeting the inclusion and exclusion criteria were evaluated across several domains: (1) theoretical orientation and foundation; (2) methodological rigor; (3) level of cultural integration; (4)…

Identifying Evidence-Based Special Education Interventions from Single-Subject Research

ERIC Educational Resources Information Center

Freeman, Jennifer; Sugai, George

2013-01-01

Special educators are required to use evidence-based academic and behavioral interventions in their classrooms (U.S. Department of Education, 2010). No rigorous and comprehensive database currently exists to support educators. Within the field of special education, single-subject research is the primary research methodology (Horner, Carr, Halle,…

Rigorous Measures of Implementation: A Methodological Framework for Evaluating Innovative STEM Programs

ERIC Educational Resources Information Center

Cassata-Widera, Amy; Century, Jeanne; Kim, Dae Y.

2011-01-01

The practical need for multidimensional measures of fidelity of implementation (FOI) of reform-based science, technology, engineering, and mathematics (STEM) instructional materials, combined with a theoretical need in the field for a shared conceptual framework that could support accumulating knowledge on specific enacted program elements across…

An Ethical Frame for Research with Immigrant Families

ERIC Educational Resources Information Center

Nguyen, Jacqueline; Hernández, María G.; Saetermoe, Carrie L.; Suárez-Orozco, Carola

2013-01-01

In this introduction, the editors give an overview of the ways the volume addresses the growing individual and institutional calls for increased clarity and rigor in methodological, ethical, and practical research policies and guidelines for conducting research with immigrant individuals, families, and communities. In addition to summarizing the…

78 FR 9815 - Final Priorities, Requirements, Definitions, and Selection Criteria-Supporting Effective Educator...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-02-12

... that can demonstrate impact through other methodological approaches such as a quasi-experimental design... definition of ``relevant outcome.'' Lastly, quasi-experimental designs are already included in the definition... paragraph (b) of this definition, provided they are rigorous and comparable across schools. (b) For non...

Driven and No Regrets: A Qualitative Analysis of Students Earning Baccalaureate Degrees in Three Years

ERIC Educational Resources Information Center

Firmin, Michael W.; Gilson, Krista Merrick

2007-01-01

Using rigorous qualitative research methodology, twenty-four college students receiving their undergraduate degrees in three years were interviewed. Following analysis of the semi-structured interview transcripts and coding, themes emerged, indicating that these students possessed self-discipline, self-motivation, and drive. Overall, the results…

Cognitive Responses of Students Who Witness Classroom Cheating

ERIC Educational Resources Information Center

Firmin, Michael W.; Burger, Amanda; Blosser, Matthew

2007-01-01

We arranged for 82 General Psychology students (51 females, 31 males) to observe peers in a course cheating situation. Individual, in-depth, qualitative interviews following the experiment we were conducting, using rigorous coding and grounded theory methodology for analysis. Results showed students to experience particular cognitive stages as…

Relationship between financial speculation and food prices or price volatility: applying the principles of evidence-based medicine to current debates in Germany.

PubMed

Bozorgmehr, Kayvan; Gabrysch, Sabine; Müller, Olaf; Neuhann, Florian; Jordan, Irmgard; Knipper, Michael; Razum, Oliver

2013-10-16

There is an unresolved debate about the potential effects of financial speculation on food prices and price volatility. Germany's largest financial institution and leading global investment bank recently decided to continue investing in agricultural commodities, stating that there is little empirical evidence to support the notion that the growth of agricultural-based financial products has caused price increases or volatility. The statement is supported by a recently published literature review, which concludes that financial speculation does not have an adverse effect on the functioning of the agricultural commodities market. As public health professionals concerned with global food insecurity, we have appraised the methodological quality of the review using a validated and reliable appraisal tool. The appraisal revealed major shortcomings in the methodological quality of the review. These were particularly related to intransparencies in the search strategy and in the selection/presentation of studies and findings; the neglect of the possibility of publication bias; a lack of objective or rigorous criteria for assessing the scientific quality of included studies and for the formulation of conclusions. Based on the results of our appraisal, we conclude that it is not justified to reject the hypothesis that financial speculation might have adverse effects on food prices/price volatility. We hope to initiate reflections about scientific standards beyond the boundaries of disciplines and call for high quality, rigorous systematic reviews on the effects of financial speculation on food prices or price volatility.

Systematic Reviews and Meta-Analyses of Home Telemonitoring Interventions for Patients With Chronic Diseases: A Critical Assessment of Their Methodological Quality

PubMed Central

2013-01-01

Background Systematic reviews and meta-analyses of home telemonitoring interventions for patients with chronic diseases have increased over the past decade and become increasingly important to a wide range of clinicians, policy makers, and other health care stakeholders. While a few criticisms about their methodological rigor and synthesis approaches have recently appeared, no formal appraisal of their quality has been conducted yet. Objective The primary aim of this critical review was to evaluate the methodology, quality, and reporting characteristics of prior reviews that have investigated the effects of home telemonitoring interventions in the context of chronic diseases. Methods Ovid MEDLINE, the Database of Abstract of Reviews of Effects (DARE), and Health Technology Assessment Database (HTA) of the Cochrane Library were electronically searched to find relevant systematic reviews, published between January 1966 and December 2012. Potential reviews were screened and assessed for inclusion independently by three reviewers. Data pertaining to the methods used were extracted from each included review and examined for accuracy by two reviewers. A validated quality assessment instrument, R-AMSTAR, was used as a framework to guide the assessment process. Results Twenty-four reviews, nine of which were meta-analyses, were identified from more than 200 citations. The bibliographic search revealed that the number of published reviews has increased substantially over the years in this area and although most reviews focus on studying the effects of home telemonitoring on patients with congestive heart failure, researcher interest has extended to other chronic diseases as well, such as diabetes, hypertension, chronic obstructive pulmonary disease, and asthma. Nevertheless, an important number of these reviews appear to lack optimal scientific rigor due to intrinsic methodological issues. Also, the overall quality of reviews does not appear to have improved over time. While several criteria were met satisfactorily by either all or nearly all reviews, such as the establishment of an a priori design with inclusion and exclusion criteria, use of electronic searches on multiple databases, and reporting of studies characteristics, there were other important areas that needed improvement. Duplicate data extraction, manual searches of highly relevant journals, inclusion of gray and non-English literature, assessment of the methodological quality of included studies and quality of evidence were key methodological procedures that were performed infrequently. Furthermore, certain methodological limitations identified in the synthesis of study results have affected the results and conclusions of some reviews. Conclusions Despite the availability of methodological guidelines that can be utilized to guide the proper conduct of systematic reviews and meta-analyses and eliminate potential risks of bias, this knowledge has not yet been fully integrated in the area of home telemonitoring. Further efforts should be made to improve the design, conduct, reporting, and publication of systematic reviews and meta-analyses in this area. PMID:23880072

Guidelines for the Design and Conduct of Clinical Studies in Knee Articular Cartilage Repair

PubMed Central

Mithoefer, Kai; Saris, Daniel B.F.; Farr, Jack; Kon, Elizaveta; Zaslav, Kenneth; Cole, Brian J.; Ranstam, Jonas; Yao, Jian; Shive, Matthew; Levine, David; Dalemans, Wilfried; Brittberg, Mats

2011-01-01

Objective: To summarize current clinical research practice and develop methodological standards for objective scientific evaluation of knee cartilage repair procedures and products. Design: A comprehensive literature review was performed of high-level original studies providing information relevant for the design of clinical studies on articular cartilage repair in the knee. Analysis of cartilage repair publications and synopses of ongoing trials were used to identify important criteria for the design, reporting, and interpretation of studies in this field. Results: Current literature reflects the methodological limitations of the scientific evidence available for articular cartilage repair. However, clinical trial databases of ongoing trials document a trend suggesting improved study designs and clinical evaluation methodology. Based on the current scientific information and standards of clinical care, detailed methodological recommendations were developed for the statistical study design, patient recruitment, control group considerations, study endpoint definition, documentation of results, use of validated patient-reported outcome instruments, and inclusion and exclusion criteria for the design and conduct of scientifically sound cartilage repair study protocols. A consensus statement among the International Cartilage Repair Society (ICRS) and contributing authors experienced in clinical trial design and implementation was achieved. Conclusions: High-quality clinical research methodology is critical for the optimal evaluation of current and new cartilage repair technologies. In addition to generally applicable principles for orthopedic study design, specific criteria and considerations apply to cartilage repair studies. Systematic application of these criteria and considerations can facilitate study designs that are scientifically rigorous, ethical, practical, and appropriate for the question(s) being addressed in any given cartilage repair research project. PMID:26069574

From screening to synthesis: using nvivo to enhance transparency in qualitative evidence synthesis.

PubMed

Houghton, Catherine; Murphy, Kathy; Meehan, Ben; Thomas, James; Brooker, Dawn; Casey, Dympna

2017-03-01

To explore the experiences and perceptions of healthcare staff caring for people with dementia in the acute setting. This article focuses on the methodological process of conducting framework synthesis using nvivo for each stage of the review: screening, data extraction, synthesis and critical appraisal. Qualitative evidence synthesis brings together many research findings in a meaningful way that can be used to guide practice and policy development. For this purpose, synthesis must be conducted in a comprehensive and rigorous way. There has been previous discussion on how using nvivo can assist in enhancing and illustrate the rigorous processes involved. Qualitative framework synthesis. Twelve documents, or research reports, based on nine studies, were included for synthesis. The benefits of using nvivo are outlined in terms of facilitating teams of researchers to systematically and rigorously synthesise findings. nvivo functions were used to conduct a sensitivity analysis. Some valuable lessons were learned, and these are presented to assist and guide researchers who wish to use similar methods in future. Ultimately, good qualitative evidence synthesis will provide practitioners and policymakers with significant information that will guide decision-making on many aspects of clinical practice. The example provided explored how people with dementia are cared for acute settings. © 2016 The Authors. Journal of Clinical Nursing Published by John Wiley & Sons Ltd.

[Iridology: a systematic review].

PubMed

Salles, Léia Fortes; Silva, Maria Júlia Paes

2008-09-01

This study is a literature review about Iridology/Irisdiagnose in the period from 1970 to 2005. The objective was to identify the worldwide scientific publications (articles) in this field and the opinions about the method. Twenty-five articles were found, four of them from Brazilian authors. About the category, 1 was literature review, 12 research studies and 12 updates, historical reviews or editorials. The countries that have contributed more with the studies were Brazil and Russia. Fifteen of those are in favor of the method and 10 are against it. In conclusion, it is necessary to develop more studies inside the methodological rigor, once Iridology brings hope to preventive medicine.

Promotion of Physical Activity Using Point-of-Decision Prompts in Berlin Underground Stations

PubMed Central

Müller-Riemenschneider, Falk; Nocon, Marc; Reinhold, Thomas; Willich, Stefan N.

2010-01-01

To evaluate point-of-decision prompts in the promotion of stair use in Germany, motivational posters were placed at three underground stations in Berlin. The proportion of passengers using stairs or stairways was counted before, during installation, and two weeks after removal of posters. In total, 5,467 passersby were counted. Stair use increased significantly in women, but not in men. The present pilot study thereby shows that the use of point-of-decision prompts is also feasible in Germany and it provides some evidence of effectiveness. Methodologically rigorous studies are warranted to confirm these findings. PMID:20948947

Do health care institutions value research? A mixed methods study of barriers and facilitators to methodological rigor in pediatric randomized trials.

PubMed

Hamm, Michele P; Scott, Shannon D; Klassen, Terry P; Moher, David; Hartling, Lisa

2012-10-18

Pediatric randomized controlled trials (RCTs) are susceptible to a high risk of bias. We examined the barriers and facilitators that pediatric trialists face in the design and conduct of unbiased trials. We used a mixed methods design, with semi-structured interviews building upon the results of a quantitative survey. We surveyed Canadian (n=253) and international (n=600) pediatric trialists regarding their knowledge and awareness of bias and their perceived barriers and facilitators in conducting clinical trials. We then interviewed 13 participants from different subspecialties and geographic locations to gain a more detailed description of how their experiences and attitudes towards research interacted with trial design and conduct. The survey response rate was 23.0% (186/807). 68.1% of respondents agreed that bias is a problem in pediatric RCTs and 72.0% felt that there is sufficient evidence to support changing some aspects of how trials are conducted. Knowledge related to bias was variable, with inconsistent awareness of study design features that may introduce bias into a study. Interview participants highlighted a lack of formal training in research methods, a negative research culture, and the pragmatics of trial conduct as barriers. Facilitators included contact with knowledgeable and supportive colleagues and infrastructure for research. A lack of awareness of bias and negative attitudes towards research present significant barriers in terms of conducting methodologically rigorous pediatric RCTs. Knowledge translation efforts must focus on these issues to ensure the relevance and validity of trial results.

The allure of the waterpipe: a narrative review of factors affecting the epidemic rise in waterpipe smoking among young persons globally

PubMed Central

Akl, E A; Ward, K D; Bteddini, D; Khaliel, R; Alexander, A C; Lotfi, T; Alaouie, H; Afifi, R A

2015-01-01

Objective The objective of this narrative review is to highlight the determinants of the epidemic rise in waterpipe tobacco smoking (WTS) among youth globally. The Ecological Model of Health Promotion (EMHP) was the guiding framework for the review. Data sources The following electronic databases were searched: Cochrane library, MEDLINE, EMBASE, PsycINFO, Web of Science and CINAHL Plus with Full Text. Search terms included waterpipe and its many variant terms. Study selection Articles were included if they were published between 1990 and 2014, were in English, were available in full text and included the age group 10–29 years. Data extraction Articles which analysed determinants of WTS at any of the levels of the EMHP were retained regardless of methodological rigour: 131 articles are included. Articles were coded in a standard template that abstracted methods as well as results. Data synthesis The review found that methodologies used to assess determinants of WTS among youth were often conventional and lacked rigor: 3/4 of the studies were cross-sectional surveys and most enrolled non-representative samples. Within the framework, the review identified determinants of WTS at the intrapersonal, interpersonal, organisational, community and policy levels. Conclusions The review suggests potential interventions to control WTS among youth, with emphasis on creative utilisation of social media, and tobacco control policies that include the specificities of WTS. The review further suggests the need for rigorous qualitative work to better contextualise determinants, and prospective observational and experimental studies that track and manipulate them to assess their viability as intervention targets. PMID:25618895

Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review.

PubMed

Gotovac, Sandra; Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

2018-04-01

The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families.

Group-based social skills interventions for adolescents with higher-functioning autism spectrum disorder: a review and looking to the future

PubMed Central

McMahon, Camilla M; Lerner, Matthew D; Britton, Noah

2013-01-01

In this paper, we synthesize the current literature on group-based social skills interventions (GSSIs) for adolescents (ages 10–20 years) with higher-functioning autism spectrum disorder and identify key concepts that should be addressed in future research on GSSIs. We consider the research participants, the intervention, the assessment of the intervention, and the research methodology and results to be integral and interconnected components of the GSSI literature, and we review each of these components respectively. Participant characteristics (eg, age, IQ, sex) and intervention characteristics (eg, targeted social skills, teaching strategies, duration and intensity) vary considerably across GSSIs; future research should evaluate whether participant and intervention characteristics mediate/moderate intervention efficacy. Multiple assessments (eg, parent-report, child-report, social cognitive assessments) are used to evaluate the efficacy of GSSIs; future research should be aware of the limitations of current measurement approaches and employ more accurate, sensitive, and comprehensive measurement approaches. Results of GSSIs are largely inconclusive, with few consistent findings across studies (eg, high parent and child satisfaction with the intervention); future research should employ more rigorous methodological standards for evaluating efficacy. A better understanding of these components in the current GSSI literature and a more sophisticated and rigorous analysis of these components in future research will lend clarity to key questions regarding the efficacy of GSSIs for individuals with autism spectrum disorder. PMID:23956616

Partnerships for the Design, Conduct, and Analysis of Effectiveness, and Implementation Research: Experiences of the Prevention Science and Methodology Group

PubMed Central

Brown, C. Hendricks; Kellam, Sheppard G.; Kaupert, Sheila; Muthén, Bengt O.; Wang, Wei; Muthén, Linda K.; Chamberlain, Patricia; PoVey, Craig L.; Cady, Rick; Valente, Thomas W.; Ogihara, Mitsunori; Prado, Guillermo J.; Pantin, Hilda M.; Gallo, Carlos G.; Szapocznik, José; Czaja, Sara J.; McManus, John W.

2012-01-01

What progress prevention research has made comes through strategic partnerships with communities and institutions that host this research, as well as professional and practice networks that facilitate the diffusion of knowledge about prevention. We discuss partnership issues related to the design, analysis, and implementation of prevention research and especially how rigorous designs, including random assignment, get resolved through a partnership between community stakeholders, institutions, and researchers. These partnerships shape not only study design, but they determine the data that can be collected and how results and new methods are disseminated. We also examine a second type of partnership to improve the implementation of effective prevention programs into practice. We draw on social networks to studying partnership formation and function. The experience of the Prevention Science and Methodology Group, which itself is a networked partnership between scientists and methodologists, is highlighted. PMID:22160786

Partnerships for the design, conduct, and analysis of effectiveness, and implementation research: experiences of the prevention science and methodology group.

PubMed

Brown, C Hendricks; Kellam, Sheppard G; Kaupert, Sheila; Muthén, Bengt O; Wang, Wei; Muthén, Linda K; Chamberlain, Patricia; PoVey, Craig L; Cady, Rick; Valente, Thomas W; Ogihara, Mitsunori; Prado, Guillermo J; Pantin, Hilda M; Gallo, Carlos G; Szapocznik, José; Czaja, Sara J; McManus, John W

2012-07-01

What progress prevention research has made comes through strategic partnerships with communities and institutions that host this research, as well as professional and practice networks that facilitate the diffusion of knowledge about prevention. We discuss partnership issues related to the design, analysis, and implementation of prevention research and especially how rigorous designs, including random assignment, get resolved through a partnership between community stakeholders, institutions, and researchers. These partnerships shape not only study design, but they determine the data that can be collected and how results and new methods are disseminated. We also examine a second type of partnership to improve the implementation of effective prevention programs into practice. We draw on social networks to studying partnership formation and function. The experience of the Prevention Science and Methodology Group, which itself is a networked partnership between scientists and methodologists, is highlighted.

Augmented assessment as a means to augmented reality.

PubMed

Bergeron, Bryan

2006-01-01

Rigorous scientific assessment of educational technologies typically lags behind the availability of the technologies by years because of the lack of validated instruments and benchmarks. Even when the appropriate assessment instruments are available, they may not be applied because of time and monetary constraints. Work in augmented reality, instrumented mannequins, serious gaming, and similar promising educational technologies that haven't undergone timely, rigorous evaluation, highlights the need for assessment methodologies that address the limitations of traditional approaches. The most promising augmented assessment solutions incorporate elements of rapid prototyping used in the software industry, simulation-based assessment techniques modeled after methods used in bioinformatics, and object-oriented analysis methods borrowed from object oriented programming.

Ginger as an antiemetic modality for chemotherapy-induced nausea and vomiting: a systematic review and meta-analysis.

PubMed

Lee, Jiyeon; Oh, Heeyoung

2013-03-01

To evaluate the effect of ginger as an antiemetic modality for the control of chemotherapy-induced nausea and vomiting (CINV). Databases searched included MEDLINE® (PubMed), Embase, CINAHL®, Cochrane Central Register of Controlled Trials, Korean Studies Information Service System, Research Information Sharing Service by the Korean Education and Research Information Service, and Dissertation Central. A systematic review was conducted of five randomized, controlled trials involving 872 patients with cancer. Ginger was compared with placebo or metoclopramide. The participant characteristics, chemotherapy regimen and antiemetic control, ginger preparation and protocol, measurements, results of the studies, adherence to the treatment protocol, and side effects were reviewed systematically. The incidence and severity of acute and delayed CINV were subject to meta-analysis. The incidence of acute nausea (p = 0.67), incidence of acute vomiting (p = 0.37), and severity of acute nausea (p = 0.12) did not differ significantly between the ginger and control groups. Current evidence does not support the use of ginger for the control of CINV. Ginger did not contribute to control of the incidence of acute nausea and vomiting or of the severity of acute nausea. Ginger has long been regarded as a traditional antiemetic modality, but its effectiveness remains to be established. The findings of this study could be incorporated into clinical guidelines, such as the Oncology Nursing Society's Putting Evidence Into Practice resources. Current evidence supports the need for more methodologically rigorous studies in this area. Although ginger is known as a traditional antiemetic, current evidence does not support the effect of ginger in CINV control. The findings of this study inform healthcare providers that its effectiveness remains to be established from methodologically rigorous future trials.

Exploring Graduate Students' Understanding of Research: Links between Identity and Research Conceptions

ERIC Educational Resources Information Center

Ross, Karen; Dennis, Barbara; Zhao, Pengfei; Li, Peiwei

2017-01-01

We are in an era that calls for increasing "training" in educational research methodologies. When the National Research Council (2004) calls for training in educational research that is "rigorous" and "relevant," the focus strongly emphasizes WHAT should be taught instead of WHO is being engaged in the learning.…

Learning Transfer--Validation of the Learning Transfer System Inventory in Portugal

ERIC Educational Resources Information Center

Velada, Raquel; Caetano, Antonio; Bates, Reid; Holton, Ed

2009-01-01

Purpose: The purpose of this paper is to analyze the construct validity of learning transfer system inventory (LTSI) for use in Portugal. Furthermore, it also aims to analyze whether LTSI dimensions differ across individual variables such as gender, age, educational level and job tenure. Design/methodology/approach: After a rigorous translation…

Empirical Data and Emerging Power Critiques: Lessons Learned

ERIC Educational Resources Information Center

Stockman, Caroline

2016-01-01

This paper evidences the importance of maintaining a dynamic interpretive stance in e-learning research. In particular, it shows how a rigorous methodology, tailored to the research question, overlooked the importance of power and knowledge in technology acceptance research for education. It was perhaps the affordance of the mixed methods design,…

Physical Activity Benefits and Needs in Adults with Intellectual Disabilities: Systematic Review of the Literature

ERIC Educational Resources Information Center

Bartlo, Pamela; Klein, Penelope J.

2011-01-01

Regular physical activity is vital for adult individuals with intellectual disabilities. The purpose of this review was to assess critically the evidence on effectiveness of physical activity interventions for adults with intellectual disability. An electronic database search was conducted. Research was then assessed for methodological rigor, and…

Post-Baccalaureate Teacher Certification Programs: Strategies for Enhancement, Improvement, and Peaceful Co-existence with Traditional Teacher Certification Programs.

ERIC Educational Resources Information Center

Duhon-Haynes, Gwendolyn; And Others

This paper examines alternative certification programs in terms of entrance requirements, supervision and mentoring, and post-certification professional support. A good alternative program uses rigorous screening processes to ensure the selection of qualified teacher interns; provides high-quality preservice training in methodology, classroom…

Shaping Social Work Science: What Should Quantitative Researchers Do?

ERIC Educational Resources Information Center

Guo, Shenyang

2015-01-01

Based on a review of economists' debates on mathematical economics, this article discusses a key issue for shaping the science of social work--research methodology. The article describes three important tasks quantitative researchers need to fulfill in order to enhance the scientific rigor of social work research. First, to test theories using…

Making the Switch: Lightbulbs, Literacy, and Service-Learning

ERIC Educational Resources Information Center

Chiaravalloti, Laura A.

2009-01-01

Service-learning is an instructional methodology teachers can use to foster student engagement in rigorous curricula. Through service-learning, middle level students see that what they are learning in school is real and important, and that they can be valued, contributing members of society. In this article, the Titans team at Remington Middle…

Differential Response: Response to Hughes and Colleagues

ERIC Educational Resources Information Center

Samuels, Bryan; Brown, Brett Vaughn

2013-01-01

In their critique of differential response (DR), Hughes and colleagues raise a number of important issues that are central to broader efforts at the Administration on Children, Youth, and Families (ACYF) including the need for greater reliance on evidence-based practice in child welfare, more rigorous evaluation methodologies, and a robust set of…

Evaluating Interactive Policy Making on Biotechnology: The Case of the Dutch Ministry of Health, Welfare and Sport

ERIC Educational Resources Information Center

Broerse, Jacqueline E. W.; de Cock Buning, Tjard; Roelofsen, Anneloes; Bunders, Joske F. G.

2009-01-01

Public engagement is increasingly advocated and applied in the development and implementation of technological innovations. However, initiatives so far are rarely considered effective. There is a need for more methodological rigor and insight into conducive conditions. The authors developed an evaluative framework and assessed accordingly the…

Pedagogy of Freedom. Ethics, Democracy, and Civic Courage.

ERIC Educational Resources Information Center

Freire, Paulo

This translation of Paulo Friere's last book is a utopian text that suggests that, among other things, education is a specifically human act of intervening in the world. Chapter 1 presents introductory reflections. Chapter 2, There Is No Teaching without Learning, includes a discussion of Methodological Rigor; Research; Respect for What Students…

Graphical Descriptives: A Way to Improve Data Transparency and Methodological Rigor in Psychology.

PubMed

Tay, Louis; Parrigon, Scott; Huang, Qiming; LeBreton, James M

2016-09-01

Several calls have recently been issued to the social sciences for enhanced transparency of research processes and enhanced rigor in the methodological treatment of data and data analytics. We propose the use of graphical descriptives (GDs) as one mechanism for responding to both of these calls. GDs provide a way to visually examine data. They serve as quick and efficient tools for checking data distributions, variable relations, and the potential appropriateness of different statistical analyses (e.g., do data meet the minimum assumptions for a particular analytic method). Consequently, we believe that GDs can promote increased transparency in the journal review process, encourage best practices for data analysis, and promote a more inductive approach to understanding psychological data. We illustrate the value of potentially including GDs as a step in the peer-review process and provide a user-friendly online resource (www.graphicaldescriptives.org) for researchers interested in including data visualizations in their research. We conclude with suggestions on how GDs can be expanded and developed to enhance transparency. © The Author(s) 2016.

Multi-Disciplinary Knowledge Synthesis for Human Health Assessment on Earth and in Space

NASA Astrophysics Data System (ADS)

Christakos, G.

We discuss methodological developments in multi-disciplinary knowledge synthesis (KS) of human health assessment. A theoretical KS framework can provide the rational means for the assimilation of various information bases (general, site-specific etc.) that are relevant to the life system of interest. KS-based techniques produce a realistic representation of the system, provide a rigorous assessment of the uncertainty sources, and generate informative health state predictions across space-time. The underlying epistemic cognition methodology is based on teleologic criteria and stochastic logic principles. The mathematics of KS involves a powerful and versatile spatiotemporal random field model that accounts rigorously for the uncertainty features of the life system and imposes no restriction on the shape of the probability distributions or the form of the predictors. KS theory is instrumental in understanding natural heterogeneities, assessing crucial human exposure correlations and laws of physical change, and explaining toxicokinetic mechanisms and dependencies in a spatiotemporal life system domain. It is hoped that a better understanding of KS fundamentals would generate multi-disciplinary models that are useful for the maintenance of human health on Earth and in Space.

At the cross-roads of participatory research and biomarker discovery in autism: the need for empirical data.

PubMed

Yusuf, Afiqah; Elsabbagh, Mayada

2015-12-15

Identifying biomarkers for autism can improve outcomes for those affected by autism. Engaging the diverse stakeholders in the research process using community-based participatory research (CBPR) can accelerate biomarker discovery into clinical applications. However, there are limited examples of stakeholder involvement in autism research, possibly due to conceptual and practical concerns. We evaluate the applicability of CBPR principles to biomarker discovery in autism and critically review empirical studies adopting these principles. Using a scoping review methodology, we identified and evaluated seven studies using CBPR principles in biomarker discovery. The limited number of studies in biomarker discovery adopting CBPR principles coupled with their methodological limitations suggests that such applications are feasible but challenging. These studies illustrate three CBPR themes: community assessment, setting global priorities, and collaboration in research design. We propose that further research using participatory principles would be useful in accelerating the pace of discovery and the development of clinically meaningful biomarkers. For this goal to be successful we advocate for increased attention to previously identified conceptual and methodological challenges to participatory approaches in health research, including improving scientific rigor and developing long-term partnerships among stakeholders.

Guidelines for reporting methodological challenges and evaluating potential bias in dementia research

PubMed Central

Weuve, Jennifer; Proust-Lima, Cécile; Power, Melinda C.; Gross, Alden L.; Hofer, Scott M.; Thiébaut, Rodolphe; Chêne, Geneviève; Glymour, M. Maria; Dufouil, Carole

2015-01-01

Clinical and population research on dementia and related neurologic conditions, including Alzheimer’s disease, faces several unique methodological challenges. Progress to identify preventive and therapeutic strategies rests on valid and rigorous analytic approaches, but the research literature reflects little consensus on “best practices.” We present findings from a large scientific working group on research methods for clinical and population studies of dementia, which identified five categories of methodological challenges as follows: (1) attrition/sample selection, including selective survival; (2) measurement, including uncertainty in diagnostic criteria, measurement error in neuropsychological assessments, and practice or retest effects; (3) specification of longitudinal models when participants are followed for months, years, or even decades; (4) time-varying measurements; and (5) high-dimensional data. We explain why each challenge is important in dementia research and how it could compromise the translation of research findings into effective prevention or care strategies. We advance a checklist of potential sources of bias that should be routinely addressed when reporting dementia research. PMID:26397878

A framework for measurement and harmonization of pediatric multiple sclerosis etiologic research studies: The Pediatric MS Tool-Kit.

PubMed

Magalhaes, Sandra; Banwell, Brenda; Bar-Or, Amit; Fortier, Isabel; Hanwell, Heather E; Lim, Ming; Matt, Georg E; Neuteboom, Rinze F; O'Riordan, David L; Schneider, Paul K; Pugliatti, Maura; Shatenstein, Bryna; Tansey, Catherine M; Wassmer, Evangeline; Wolfson, Christina

2018-06-01

While studying the etiology of multiple sclerosis (MS) in children has several methodological advantages over studying etiology in adults, studies are limited by small sample sizes. Using a rigorous methodological process, we developed the Pediatric MS Tool-Kit, a measurement framework that includes a minimal set of core variables to assess etiological risk factors. We solicited input from the International Pediatric MS Study Group to select three risk factors: environmental tobacco smoke (ETS) exposure, sun exposure, and vitamin D intake. To develop the Tool-Kit, we used a Delphi study involving a working group of epidemiologists, neurologists, and content experts from North America and Europe. The Tool-Kit includes six core variables to measure ETS, six to measure sun exposure, and six to measure vitamin D intake. The Tool-Kit can be accessed online ( www.maelstrom-research.org/mica/network/tool-kit ). The goals of the Tool-Kit are to enhance exposure measurement in newly designed pediatric MS studies and comparability of results across studies, and in the longer term to facilitate harmonization of studies, a methodological approach that can be used to circumvent issues of small sample sizes. We believe the Tool-Kit will prove to be a valuable resource to guide pediatric MS researchers in developing study-specific questionnaire.

Methodological considerations when translating “burnout”☆

PubMed Central

Squires, Allison; Finlayson, Catherine; Gerchow, Lauren; Cimiotti, Jeannie P.; Matthews, Anne; Schwendimann, Rene; Griffiths, Peter; Busse, Reinhard; Heinen, Maude; Brzostek, Tomasz; Moreno-Casbas, Maria Teresa; Aiken, Linda H.; Sermeus, Walter

2014-01-01

No study has systematically examined how researchers address cross-cultural adaptation of burnout. We conducted an integrative review to examine how researchers had adapted the instruments to the different contexts. We reviewed the Content Validity Indexing scores for the Maslach Burnout Inventory-Human Services Survey from the 12-country comparative nursing workforce study, RN4CAST. In the integrative review, multiple issues related to translation were found in existing studies. In the cross-cultural instrument analysis, 7 out of 22 items on the instrument received an extremely low kappa score. Investigators may need to employ more rigorous cross-cultural adaptation methods when attempting to measure burnout. PMID:25343131

A person-centered approach to study intimacy and sexuality in residential care facility (RCF) clients with dementia: Methodological considerations and a guide to study design.

PubMed

Roelofs, Tineke S M; Luijkx, Katrien G; Embregts, Petri J C M

2017-01-01

The person-centered perspective of residential care facility (RCF) residents with dementia with regard to their intimate and sexual lives is largely neglected in research. We aim to provide methodological considerations and reflections on a performed qualitative study. Recommendations and a guide to study design are provided to inform and encourage future research on the inclusion of people with dementia as participants. Methodological recommendations and reflections are described in chronological order of the procedure. Fragments of interviews are included for further illustration and clarification. Considering preparation, close involvement of clinical practice, and extensive deliberation regarding study design tended to be important. Considering procedure, investment in contacts with clinical practice and authorized representatives; an introduction meeting; person-centered inclusion and consent; profound skills in interviewing participants with dementia; and flexibility in data collection were proven of importance. Considering data analysis and study quality, including field notes and aiming at a balance between study quality and practicability to enhance study 'rigor' were found important. Including the person-centered perspective in research on intimacy and sexuality of RCF residents with dementia, is challenging and takes a flexible and creative approach. It is, however, worthwhile to close the gap in literature.

A systematic review of the clinical evidence to guide treatment recommendations in breast reconstruction based on patient- reported outcome measures and health-related quality of life.

PubMed

Winters, Zoë Ellen; Benson, John R; Pusic, Andrea L

2010-12-01

Advances in breast cancer diagnosis and management have produced significant improvements in disease-free and breast cancer related survival. Consequently, there is increasing focus on the quality of long-term cancer survivorship. Of the 44,000 women diagnosed annually in the United Kingdom, 30% to 40% are required to undergo mastectomy. During the past 30 years, significant technical advances in breast reconstruction have increased performance of this surgical practice as a means to potentially improve health-related quality of life (HRQoL) for breast cancer survivors. Breast reconstruction studies increasingly aim to assess more discriminating outcomes based on the patients' own perception of the surgical result and its effect on HRQoL. This incremental output in HRQoL evaluation is being fuelled by both healthcare providers and official bodies such as the Food and Drug Administration, together with demands for more comprehensive comparative effectiveness data to permit fully informed consent by patients. In this systematic review, the authors apply inclusion and exclusion criteria to effectively screen 1012 abstracts identified in the field of HRQoL in breast reconstruction between 1978 and 2009. Each study was evaluated with respect to its design and statistical methodology. Each was reviewed with a recommended standard checklist of methodological requirements as described by Efficace et al (J Clin Oncol. 2003;21:3502-3511). A total of 34 papers that included HRQL outcomes in breast reconstruction were identified and reviewed in detail. The majority of studies were retrospective in nature with significant inherent limitations. Specifically, they were compromised by potentially biased patient recall. Most of these studies lacked both an a priori outcome of interest and statistical rigor jeopardizing estimations of potential effect size. In addition, more than 90% of the studies failed to report or describe missing data. Thirteen studies provided level I (n = 2) and II (n = 11) evidence. While these studies benefited from more robust design, the majority used generic instruments such as 36-item short form (SF-36), which may not be sufficiently sensitive to measure changes consequent to breast reconstruction (ie, effect on body image or psychosocial well-being). Furthermore, these studies were generally underpowered to detect meaningful clinical difference or to permit subgroup analyses. Further limitations included reliance on single center design that may negatively impact generalizability and deficiencies in reporting the number and types of surgical complications, which potentially has an effect on HRQoL outcomes. This systematic review reveals tendency for sound scientific methodology in HRQoL to be undermined by poorly designed and underpowered studies. In the current healthcare environment, patients and providers increasingly seek meaningful data to guide clinical decisions; policy makers are similarly in need of a rigorous patient-centered, comparative effectiveness data to inform national level decision-making. In light of this and the limitations of the existing published data, there is a pressing need for further Level I and II evidence in the form of randomized controlled trials as well as well-designed, multicenter prospective longitudinal studies in breast reconstruction. Such studies should incorporate sensitive and condition-specific patient-report outcome measures, provide adequate sample sizes, and respect established guidelines for rigorous HRQoL methodology.

A design and implementation methodology for diagnostic systems

NASA Technical Reports Server (NTRS)

Williams, Linda J. F.

1988-01-01

A methodology for design and implementation of diagnostic systems is presented. Also discussed are the advantages of embedding a diagnostic system in a host system environment. The methodology utilizes an architecture for diagnostic system development that is hierarchical and makes use of object-oriented representation techniques. Additionally, qualitative models are used to describe the host system components and their behavior. The methodology architecture includes a diagnostic engine that utilizes a combination of heuristic knowledge to control the sequence of diagnostic reasoning. The methodology provides an integrated approach to development of diagnostic system requirements that is more rigorous than standard systems engineering techniques. The advantages of using this methodology during various life cycle phases of the host systems (e.g., National Aerospace Plane (NASP)) include: the capability to analyze diagnostic instrumentation requirements during the host system design phase, a ready software architecture for implementation of diagnostics in the host system, and the opportunity to analyze instrumentation for failure coverage in safety critical host system operations.

Cost comparisons and methodological heterogeneity in cost-of-illness studies: the example of colorectal cancer.

PubMed

Ó Céilleachair, Alan J; Hanly, Paul; Skally, Máiréad; O'Neill, Ciaran; Fitzpatrick, Patricia; Kapur, Kanika; Staines, Anthony; Sharp, Linda

2013-04-01

Colorectal cancer (CRC) is the third most common cancer worldwide with over 1 million new cases diagnosed each year. Advances in treatment and survival are likely to have increased lifetime costs of managing the disease. Cost-of-illness (COI) studies are key building blocks in economic evaluations of interventions and comparative effectiveness research. We systematically reviewed and critiqued the COI literature on CRC. We searched several databases for CRC COI studies published in English, between January 2000 and February 2011. Information was abstracted on: setting, patient population, top-down/bottom-up costing, incident/prevalent approach, payer perspective, time horizon, costs included, cost source, and per-person costs. We developed a framework to compare study methodologies and assess homogeneity/heterogeneity. A total of 26 papers met the inclusion criteria. There was extensive methodological heterogeneity. Studies included case-control studies based on claims/reimbursement data (10), examinations of patient charts (5), and analysis of claims data (4). Epidemiological approaches varied (prevalent, 6; incident, 8; mixed, 10; unclear, 4). Time horizons ranged from 1 year postdiagnosis to lifetime. Seventeen studies used top-down costing. Twenty-five studies included healthcare-payer direct medical costs; 2 included indirect costs; 1 considered patient costs. There was broad agreement in how studies accounted for time, but few studies described costs in sufficient detail to allow replication. In general, costs were not comparable between studies. Methodological heterogeneity and lack of transparency made it almost impossible to compare CRC costs between studies or over time. For COI studies to be more useful and robust there is need for clear and rigorous guidelines around methodological and reporting "best practice."

Looking Inward: Philosophical and Methodological Perspectives on Phenomenological Self-Reflection.

PubMed

Pool, Natalie M

2018-07-01

Engaging in early and ongoing self-reflection during interpretive phenomenological research is critical for ensuring trustworthiness or rigor. However, the lack of guidelines and clarity about the role of self-reflection in this methodology creates both theoretical and procedural confusion. The purpose of this article is to describe key philosophical underpinnings, characteristics, and hallmarks of the process of self-reflection in interpretive phenomenological investigation and to provide a list of guidelines that facilitate this process. Excerpts from an interpretive phenomenological study are used to illustrate characteristics of quality self-reflection. The guidelines are intended to be particularly beneficial for novice researchers who may find self-reflective writing to be daunting and unclear. Facilitating use of self-reflection may strengthen both the interpretive phenomenological body of work as well as that of all qualitative research.

Highlights in emergency medicine medical education research: 2008.

PubMed

Farrell, Susan E; Coates, Wendy C; Khun, Gloria J; Fisher, Jonathan; Shayne, Philip; Lin, Michelle

2009-12-01

The purpose of this article is to highlight medical education research studies published in 2008 that were methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine. Through a PubMed search of the English language literature in 2008, 30 medical education research studies were independently identified as hypothesis-testing investigations and measurements of educational interventions. Six reviewers independently rated and scored all articles based on eight anchors, four of which related to methodologic criteria. Articles were ranked according to their total rating score. A ranking agreement among the reviewers of 83% was established a priori as a minimum for highlighting articles in this review. Five medical education research studies met the a priori criteria for inclusion and are reviewed and summarized here. Four of these employed experimental or quasi-experimental methodology. Although technology was not a component of the structured literature search employed to identify the candidate articles for this review, 14 of the articles identified, including four of the five highlighted articles, employed or studied technology as a focus of the educational research. Overall, 36% of the reviewed studies were supported by funding; three of the highlighted articles were funded studies. This review highlights quality medical education research studies published in 2008, with outcomes of relevance to teaching and education in emergency medicine. It focuses on research methodology, notes current trends in the use of technology for learning in emergency medicine, and suggests future avenues for continued rigorous study in education.

Methods for the guideline-based development of quality indicators--a systematic review

PubMed Central

2012-01-01

Background Quality indicators (QIs) are used in many healthcare settings to measure, compare, and improve quality of care. For the efficient development of high-quality QIs, rigorous, approved, and evidence-based development methods are needed. Clinical practice guidelines are a suitable source to derive QIs from, but no gold standard for guideline-based QI development exists. This review aims to identify, describe, and compare methodological approaches to guideline-based QI development. Methods We systematically searched medical literature databases (Medline, EMBASE, and CINAHL) and grey literature. Two researchers selected publications reporting methodological approaches to guideline-based QI development. In order to describe and compare methodological approaches used in these publications, we extracted detailed information on common steps of guideline-based QI development (topic selection, guideline selection, extraction of recommendations, QI selection, practice test, and implementation) to predesigned extraction tables. Results From 8,697 hits in the database search and several grey literature documents, we selected 48 relevant references. The studies were of heterogeneous type and quality. We found no randomized controlled trial or other studies comparing the ability of different methodological approaches to guideline-based development to generate high-quality QIs. The relevant publications featured a wide variety of methodological approaches to guideline-based QI development, especially regarding guideline selection and extraction of recommendations. Only a few studies reported patient involvement. Conclusions Further research is needed to determine which elements of the methodological approaches identified, described, and compared in this review are best suited to constitute a gold standard for guideline-based QI development. For this research, we provide a comprehensive groundwork. PMID:22436067

Enhancing Validity When Researching the "Other": Insights from Pierre Bourdieu's Theory of Social Science Research Practice

ERIC Educational Resources Information Center

Naidoo, Devika

2014-01-01

This article explores aspects of Pierre Bourdieu's theory of social science research practice and discusses their relevance for enhancing validity when researching the "other." Aspects such as: a relational way of thinking about concepts, epistemology and methodology; the rigorous construction of the object of research; and…

DEMONSTRATION AND EVALUATION OF STRUCTURAL BENEFIT TRANSFER AND BAYESIAN BENEFIT TRANSFER FOR VALUING WELFARE IMPACTS OF SALTWATER BEACH QUALITY CHANGES

EPA Science Inventory

The main methodological contribution lies in the demonstration and evaluation of these two BT methods, which are not in common use, in a new application (valuing beach closures). Another important contribution is the use of the NSRE data for rigorous nonmarket valuation ap...

Rates of Student-Reported Antisocial Behavior, School Suspensions, and Arrests in Victoria, Australia and Washington State, United States

ERIC Educational Resources Information Center

Hemphill, Sheryl A.; McMorris, Barbara J.; Toumbourou, John W.; Herrenkohl, Todd I.; Catalano, Richard F.; Mathers, Megan

2007-01-01

Background: Few methodologically rigorous international comparisons of student-reported antisocial behavior have been conducted. This paper examines whether there are differences in the frequency of both antisocial behavior and societal responses to antisocial behavior in Victoria, Australia and Washington State, United States. These 2 states were…

Making a Difference: The Future of HPT in Sustaining Best-Practice International Capacity Development

ERIC Educational Resources Information Center

Kelly, Steven J.; Coughlin, Patrick C.; Novak, M. Mari

2012-01-01

Over the past decade, human performance technology (HPT) has become an important source of rigor and application in support of best practices in capacity development. HPT shares common principles with the Organisation for Economic Co-operation and Development best practices. This article explores HPT's critical role as the methodology of choice…

Considerations for the Systematic Analysis and Use of Single-Case Research

ERIC Educational Resources Information Center

Horner, Robert H.; Swaminathan, Hariharan; Sugai, George; Smolkowski, Keith

2012-01-01

Single-case research designs provide a rigorous research methodology for documenting experimental control. If single-case methods are to gain wider application, however, a need exists to define more clearly (a) the logic of single-case designs, (b) the process and decision rules for visual analysis, and (c) an accepted process for integrating…

A Very Short, Fairly Interesting and Reasonably Cheap Book about Qualitative Research. Very Short, Fairly Interesting & Reasonably Cheap Books

ERIC Educational Resources Information Center

Silverman, David

2007-01-01

In this book, the author shows how good research can be methodologically inventive, empirically rigorous, theoretically-alive and practically relevant. Using materials ranging from photographs to novels and newspaper stories this book demonstrates that getting to grips with these issues means asking fundamental questions about how we are…

Measuring Knowledge of Natural Selection: A Comparison of the CINS, an Open-Response Instrument, and an Oral Interview

ERIC Educational Resources Information Center

Nehm, Ross H.; Schonfeld, Irvin Sam

2008-01-01

Growing recognition of the central importance of fostering an in-depth understanding of natural selection has, surprisingly, failed to stimulate work on the development and rigorous evaluation of instruments that measure knowledge of it. We used three different methodological tools, the Conceptual Inventory of Natural Selection (CINS), a modified…

A Holistic Approach to Science Education: Disciplinary, Affective, and Equitable

ERIC Educational Resources Information Center

Mehta, Rohit; Mehta, Swati; Seals, Christopher

2017-01-01

In this chapter, we argue that science education is more than the high stakes, rigorous practices and methodology that students often find dull and uninspiring. We present that aesthetic and humanistic motivations, such as wonder, curiosity, and social justice, are also inherent reasons for doing science. In the MSUrbanSTEM program, we designed an…

Methodological idiosyncracies, frameworks and challenges of non-pharmaceutical and non-technical treatment interventions.

PubMed

Schünemann, Holger J

2013-01-01

In this brief article which summarises a presentation given at the "6. Diskussionsforum zur Nutzenbewertung im Gesundheitswesen" of the German Ministry of Education and Research "Gesundheitsforschungsrat (GFR)" and the Institute for Quality and Efficiency in Healthcare (IQWiG) I will analyse some methodological idiosyncrasies of studies evaluating non-pharmacological non-technical interventions (NPNTI). I will focus on how the methodological framework of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group may support design and appraisal of NPNTI. Specific design features that may be of particular value in NPNTI research, such as expertise-based randomised controlled trials, will be briefly described. Finally, based on an example, I will argue that - despite the methodological idiosyncrasies - there is neither a sufficient reason to accept different standards for the assessment of the confidence in the evidence from NPNTI nor for using study designs that are less rigorous compared to "simpler" interventions but that special measures have to be taken to reduce the risk of bias. The example that will be used in this article will primarily come from the field of respiratory rehabilitation, a typical multi-component or complex intervention and by definition a complex NPNTI, which has been evaluated in many randomised controlled trials. (As supplied by publisher). Copyright © 2013. Published by Elsevier GmbH.

Methodological factors conducting research with incarcerated persons with diabetes.

PubMed

Reagan, Louise; Shelton, Deborah

2016-02-01

The aim of this study was to describe methodological issues specific to conducting research with incarcerated vulnerable populations who have diabetes. Much has been written about the ethical and logistical challenges of conducting research with vulnerable incarcerated populations. However, conducting research with incarcerated persons with diabetes is associated with additional issues related to research design, measurement, sampling and recruitment, and data collection procedures. A cross-sectional study examining the relationships of diabetes knowledge, illness representation and self-care behaviors with glycemic control in 124 incarcerated persons was conducted and serves as the basis for describing methodological factors for the conduct of research with an incarcerated population with diabetes. Within this incarcerated population with diabetes, sampling bias due to gender inequity, recruitment of participants not using insulin, self-reported vision impairment, and a lack of standardized instruments especially for measuring diabetes self-care were methodological challenges. Clinical factors that serve as potential barriers for study conduct were identified as risk for hypoglycemia due to insulin timing and other activities. Conducting research with incarcerated persons diagnosed with diabetes requires attention to a set of methodological concerns above and beyond that of the ethical and legal regulations for protecting the rights of this vulnerable population. To increase opportunities for conducting rigorous as well as facility- and patient-friendly research, researchers need to blend their knowledge of diabetes with an understanding of prison rules and routines. Copyright © 2015 Elsevier Inc. All rights reserved.

Combining rigour with relevance: a novel methodology for testing Chinese herbal medicine.

PubMed

Flower, Andrew; Lewith, George; Little, Paul

2011-03-24

There is a need to develop an evidence base for Chinese herbal medicine (CHM) that is both rigorous and reflective of good practice. This paper proposes a novel methodology to test individualised herbal decoctions using a randomised, double blinded, placebo controlled clinical trial. A feasibility study was conducted to explore the role of CHM in the treatment of endometriosis. Herbal formulae were pre-cooked and dispensed as individual doses in sealed plastic sachets. This permitted the development and testing of a plausible placebo decoction. Participants were randomised at a distant pharmacy to receive either an individualised herbal prescription or a placebo. The trial met the predetermined criteria for good practice. Neither the participants nor the practitioner-researcher could reliably identify group allocation. Of the 28 women who completed the trial, in the placebo group (n=15) 3 women (20%) correctly guessed they were on placebo, 8 (53%) thought they were on herbs and 4 (27%) did not know which group they had been allocated to. In the active group (n=13) 2 (15%) though they were on placebo, 8 (62%) thought they were on herbs and 3 (23%) did not know. Randomisation, double blinding and allocation concealment were successful and the study model appeared to be feasible and effective. It is now possible to subject CHM to rigorous scientific scrutiny without compromising model validity. Improvement in the design of the placebo using food colourings and flavourings instead of dried food will help guarantee the therapeutic inertia of the placebo decoction. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

How Root Cause Analysis Can Improve the Value Methodology

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wixson, James Robert

2002-05-01

Root cause analysis (RCA) is an important methodology that can be integrated with the VE Job Plan to generate superior results from the VE Methodology. The point at which RCA is most appropriate is after the function analysis and FAST Model have been built and functions for improvement have been chosen. These functions are then subjected to a simple, but, rigorous RCA to get to the root cause of their deficiencies, whether it is high cost/poor value, poor quality, or poor reliability. Once the most probable causes for these problems have been arrived at, better solutions for improvement can bemore » developed in the creativity phase because the team better understands the problems associated with these functions.« less

Methodological issues in the design and analyses of neonatal research studies: Experience of the NICHD Neonatal Research Network.

PubMed

Das, Abhik; Tyson, Jon; Pedroza, Claudia; Schmidt, Barbara; Gantz, Marie; Wallace, Dennis; Truog, William E; Higgins, Rosemary D

2016-10-01

Impressive advances in neonatology have occurred over the 30 years of life of The Eunice Kennedy Shriver National Institute of Child Health and Human Development Neonatal Research Network (NRN). However, substantial room for improvement remains in investigating and further developing the evidence base for improving outcomes among the extremely premature. We discuss some of the specific methodological challenges in the statistical design and analysis of randomized trials and observational studies in this population. Challenges faced by the NRN include designing trials for unusual or rare outcomes, accounting for and explaining center variations, identifying other subgroup differences, and balancing safety and efficacy concerns between short-term hospital outcomes and longer-term neurodevelopmental outcomes. In conclusion, the constellation of unique patient characteristics in neonates calls for broad understanding and careful consideration of the issues identified in this article for conducting rigorous studies in this population. Copyright © 2016 Elsevier Inc. All rights reserved.

Yoga in the schools: a systematic review of the literature.

PubMed

Serwacki, Michelle L; Cook-Cottone, Catherine

2012-01-01

The objective of this research was to examine the evidence for delivering yoga-based interventions in schools. An electronic literature search was conducted to identify peer-reviewed, published studies in which yoga and a meditative component (breathing practices or meditation) were taught to youths in a school setting. Pilot studies, single cohort, quasi-experimental, and randomized clinical trials were considered. quality was evaluated and summarized. Twelve published studies were identified. Samples for which yoga was implemented as an intervention included youths with autism, intellectual disability, learning disability, and emotional disturbance, as well as typically developing youths. Although effects of participating in school-based yoga programs appeared to be beneficial for the most part, methodological limitations, including lack of randomization, small samples, limited detail regarding the intervention, and statistical ambiguities curtailed the ability to provide definitive conclusions or recommendations. Findings speak to the need for greater methodological rigor and an increased understanding of the mechanisms of success for school-based yoga interventions.

Pitfalls and Potentials of Crowd Science: a Meta-Analysis of Contextual Influences

NASA Astrophysics Data System (ADS)

Klippel, A.; Sparks, K.; Wallgrün, J. O.

2015-08-01

Crowd science is becoming an integral part of research in many disciplines. The research discussed in this paper lies at the intersection of spatial and behavioral sciences, two of the greatest beneficiaries of crowd science. As a young methodological development, crowd science needs attention from the perspective of a rigorous evaluation of the data collected to explore potentials as well as limitations (pitfalls). Our research has addressed a variety of contextual effects on the validity of crowdsourced data such as cultural, linguistic, regional, as well as methodological differences that we will discuss here in light of semantics.

A call for transparent reporting to optimize the predictive value of preclinical research

PubMed Central

Landis, Story C.; Amara, Susan G.; Asadullah, Khusru; Austin, Chris P.; Blumenstein, Robi; Bradley, Eileen W.; Crystal, Ronald G.; Darnell, Robert B.; Ferrante, Robert J.; Fillit, Howard; Finkelstein, Robert; Fisher, Marc; Gendelman, Howard E.; Golub, Robert M.; Goudreau, John L.; Gross, Robert A.; Gubitz, Amelie K.; Hesterlee, Sharon E.; Howells, David W.; Huguenard, John; Kelner, Katrina; Koroshetz, Walter; Krainc, Dimitri; Lazic, Stanley E.; Levine, Michael S.; Macleod, Malcolm R.; McCall, John M.; Moxley, Richard T.; Narasimhan, Kalyani; Noble, Linda J.; Perrin, Steve; Porter, John D.; Steward, Oswald; Unger, Ellis; Utz, Ursula; Silberberg, Shai D.

2012-01-01

The US National Institute of Neurological Disorders and Stroke convened major stakeholders in June 2012 to discuss how to improve the methodological reporting of animal studies in grant applications and publications. The main workshop recommendation is that at a minimum studies should report on sample-size estimation, whether and how animals were randomized, whether investigators were blind to the treatment, and the handling of data. We recognize that achieving a meaningful improvement in the quality of reporting will require a concerted effort by investigators, reviewers, funding agencies and journal editors. Requiring better reporting of animal studies will raise awareness of the importance of rigorous study design to accelerate scientific progress. PMID:23060188

A call for transparent reporting to optimize the predictive value of preclinical research.

PubMed

Landis, Story C; Amara, Susan G; Asadullah, Khusru; Austin, Chris P; Blumenstein, Robi; Bradley, Eileen W; Crystal, Ronald G; Darnell, Robert B; Ferrante, Robert J; Fillit, Howard; Finkelstein, Robert; Fisher, Marc; Gendelman, Howard E; Golub, Robert M; Goudreau, John L; Gross, Robert A; Gubitz, Amelie K; Hesterlee, Sharon E; Howells, David W; Huguenard, John; Kelner, Katrina; Koroshetz, Walter; Krainc, Dimitri; Lazic, Stanley E; Levine, Michael S; Macleod, Malcolm R; McCall, John M; Moxley, Richard T; Narasimhan, Kalyani; Noble, Linda J; Perrin, Steve; Porter, John D; Steward, Oswald; Unger, Ellis; Utz, Ursula; Silberberg, Shai D

2012-10-11

The US National Institute of Neurological Disorders and Stroke convened major stakeholders in June 2012 to discuss how to improve the methodological reporting of animal studies in grant applications and publications. The main workshop recommendation is that at a minimum studies should report on sample-size estimation, whether and how animals were randomized, whether investigators were blind to the treatment, and the handling of data. We recognize that achieving a meaningful improvement in the quality of reporting will require a concerted effort by investigators, reviewers, funding agencies and journal editors. Requiring better reporting of animal studies will raise awareness of the importance of rigorous study design to accelerate scientific progress.

The Methodological Quality and Effectiveness of Technology-Based Smoking Cessation Interventions for Disadvantaged Groups: A Systematic Review and Meta-analysis.

PubMed

Boland, Veronica C; Stockings, Emily A; Mattick, Richard P; McRobbie, Hayden; Brown, Jamie; Courtney, Ryan J

2018-02-07

To assess the methodological quality and effectiveness of technology-based smoking cessation interventions in disadvantaged groups. Four databases (EMBASE, Cochrane, Medline, and PsycInfo) were searched for studies conducted from 1980 to May 2016. Randomized controlled trials that compared a behavioral smoking cessation intervention delivered primarily through a technology-based platform (eg, mobile phone) with a no-intervention comparison group among disadvantaged smokers were included. Three reviewers assessed all relevant studies for inclusion, and one reviewer extracted study, participant and intervention-level data, with a subset crosschecked by a second reviewer. Thirteen studies targeting disadvantaged smokers (n =4820) were included. Only one study scored highly in terms of methodological rigor on EPOC criteria for judging risk of bias. Of the 13 studies using a technology-based platform, most utilized websites (n = 5) or computer programs (n = 5), and seven additionally offered nicotine replacement therapy. Technology-based interventions increased the odds of smoking cessation for disadvantaged groups at 1 month (odds ratio [OR] 1.70, 95% confidence interval [CI] 1.10, 2.63), 3 months (OR 1.30, 95% CI 1.07, 1.59), 6 months (OR 1.29, 95% CI 1.03, 1.62), and 18 months post-intervention (OR 1.83, 95% CI 1.11, 3.01). Few methodologically rigorous studies were identified. Mobile phone text-messaging, computer- and website-delivered quit support showed promise at increasing quit rates among Indigenous, psychiatric and inpatient substance use disorder patients. Further research is needed to address the role technology-based interventions have on overcoming health inequalities to meet the needs of disadvantaged groups. This review provides the first quantitative evidence of the effectiveness of a range of technology-based smoking cessation interventions among disadvantaged smokers, with separate estimates on the basis of intervention type, and cessation outcome measure. Providing cost-effective, easily accessible and real-time smoking cessation treatment is needed, and innovative technology-based platforms will help reach this endpoint. These interventions need to be tested in larger scale randomized controlled trial designs and target broader disadvantaged groups. Data collection beyond 6 months is also needed in order to establish the efficacy of these intervention approaches on long-term cessation rates among disadvantaged population groups. © The Author(s) 2016. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Community-based HIV/AIDS interventions to promote psychosocial well-being among people living with HIV/AIDS: a literature review

PubMed Central

Wu, Liyun; Li, Xiaoming

2013-01-01

Background: This review explores the current community-based psychosocial interventions among people living with HIV/AIDS (PLWHA) across the globe. Methods: Evaluation studies were retrieved and reviewed regarding study location, characteristics of participants, study design, intervention strategies, outcome indicators, and intervention findings. Results: The 28 studies spanned a broad range of intervention strategies, including coping skills, treatment and cure, cultural activities, community involvement, knowledge education, voluntary counseling and testing, peer-group support, three-layered service provision, child-directed group intervention, adult mentoring, and support group interventions. Regardless of study designs, all studies reported positive intervention effects, ranging from a reduction in HIV/AIDS stigma, loneliness, marginalization, distress, depression, anger, and anxiety to an increase in self-esteem, self-efficacy, coping skills, and quality of life. Conclusion: Although the existing studies have limitation with regard to program coverage, intensity, scope, and methodological challenges, they underscore the importance of developing community-based interventions to promote psychosocial well-being among PLWHA. Future studies need to employ more rigorous methodology and integrate contextual and institutional factors when implementing effective interventions. PMID:25264499

A systematic review of the effects of mindfulness interventions on cortisol.

PubMed

O'Leary, Karen; O'Neill, Siobhan; Dockray, Samantha

2016-09-01

Cortisol is increasingly included in examinations of mindfulness intervention effects as an indicator of efficacy; however, the association of cortisol and mindfulness has yet to be rigorously evaluated. A systematic review of six studies examining mindfulness intervention effects on cortisol was conducted. Inconsistent results were found for mindfulness effects on cortisol. Significant changes in cortisol levels were observed in within-participants studies but not observed in randomised controlled trial designs. Mindfulness may influence cortisol, but findings are inconclusive. Mindfulness pathways and methodological differences influence variations in mindfulness effects. Robust protocols are needed to adequately examine mindfulness effects on cortisol. © The Author(s) 2015.

The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation.

PubMed

Lewis, Cara C; Stanick, Cameo F; Martinez, Ruben G; Weiner, Bryan J; Kim, Mimi; Barwick, Melanie; Comtois, Katherine A

2015-01-08

Identification of psychometrically strong instruments for the field of implementation science is a high priority underscored in a recent National Institutes of Health working meeting (October 2013). Existing instrument reviews are limited in scope, methods, and findings. The Society for Implementation Research Collaboration Instrument Review Project's objectives address these limitations by identifying and applying a unique methodology to conduct a systematic and comprehensive review of quantitative instruments assessing constructs delineated in two of the field's most widely used frameworks, adopt a systematic search process (using standard search strings), and engage an international team of experts to assess the full range of psychometric criteria (reliability, construct and criterion validity). Although this work focuses on implementation of psychosocial interventions in mental health and health-care settings, the methodology and results will likely be useful across a broad spectrum of settings. This effort has culminated in a centralized online open-access repository of instruments depicting graphical head-to-head comparisons of their psychometric properties. This article describes the methodology and preliminary outcomes. The seven stages of the review, synthesis, and evaluation methodology include (1) setting the scope for the review, (2) identifying frameworks to organize and complete the review, (3) generating a search protocol for the literature review of constructs, (4) literature review of specific instruments, (5) development of an evidence-based assessment rating criteria, (6) data extraction and rating instrument quality by a task force of implementation experts to inform knowledge synthesis, and (7) the creation of a website repository. To date, this multi-faceted and collaborative search and synthesis methodology has identified over 420 instruments related to 34 constructs (total 48 including subconstructs) that are relevant to implementation science. Despite numerous constructs having greater than 20 available instruments, which implies saturation, preliminary results suggest that few instruments stem from gold standard development procedures. We anticipate identifying few high-quality, psychometrically sound instruments once our evidence-based assessment rating criteria have been applied. The results of this methodology may enhance the rigor of implementation science evaluations by systematically facilitating access to psychometrically validated instruments and identifying where further instrument development is needed.

Acupuncture-Related Techniques for Psoriasis: A Systematic Review with Pairwise and Network Meta-Analyses of Randomized Controlled Trials.

PubMed

Yeh, Mei-Ling; Ko, Shu-Hua; Wang, Mei-Hua; Chi, Ching-Chi; Chung, Yu-Chu

2017-12-01

There has be a large body of evidence on the pharmacological treatments for psoriasis, but whether nonpharmacological interventions are effective in managing psoriasis remains largely unclear. This systematic review conducted pairwise and network meta-analyses to determine the effects of acupuncture-related techniques on acupoint stimulation for the treatment of psoriasis and to determine the order of effectiveness of these remedies. This study searched the following databases from inception to March 15, 2016: Medline, PubMed, Cochrane Central Register of Controlled Trials, EBSCO (including Academic Search Premier, American Doctoral Dissertations, and CINAHL), Airiti Library, and China National Knowledge Infrastructure. Randomized controlled trials (RCTs) on the effects of acupuncture-related techniques on acupoint stimulation as intervention for psoriasis were independently reviewed by two researchers. A total of 13 RCTs with 1,060 participants were included. The methodological quality of included studies was not rigorous. Acupoint stimulation, compared with nonacupoint stimulation, had a significant treatment for psoriasis. However, the most common adverse events were thirst and dry mouth. Subgroup analysis was further done to confirm that the short-term treatment effect was superior to that of the long-term effect in treating psoriasis. Network meta-analysis identified acupressure or acupoint catgut embedding, compared with medication, and had a significant effect for improving psoriasis. It was noted that acupressure was the most effective treatment. Acupuncture-related techniques could be considered as an alternative or adjuvant therapy for psoriasis in short term, especially of acupressure and acupoint catgut embedding. This study recommends further well-designed, methodologically rigorous, and more head-to-head randomized trials to explore the effects of acupuncture-related techniques for treating psoriasis.

Methodology, Methods, and Metrics for Testing and Evaluating Augmented Cognition Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Greitzer, Frank L.

The augmented cognition research community seeks cognitive neuroscience-based solutions to improve warfighter performance by applying and managing mitigation strategies to reduce workload and improve the throughput and quality of decisions. The focus of augmented cognition mitigation research is to define, demonstrate, and exploit neuroscience and behavioral measures that support inferences about the warfighter’s cognitive state that prescribe the nature and timing of mitigation. A research challenge is to develop valid evaluation methodologies, metrics and measures to assess the impact of augmented cognition mitigations. Two considerations are external validity, which is the extent to which the results apply to operational contexts;more » and internal validity, which reflects the reliability of performance measures and the conclusions based on analysis of results. The scientific rigor of the research methodology employed in conducting empirical investigations largely affects the validity of the findings. External validity requirements also compel us to demonstrate operational significance of mitigations. Thus it is important to demonstrate effectiveness of mitigations under specific conditions. This chapter reviews some cognitive science and methodological considerations in designing augmented cognition research studies and associated human performance metrics and analysis methods to assess the impact of augmented cognition mitigations.« less

Methodological adequacy of articles published in two open-access Brazilian cardiology periodicals.

PubMed

Macedo, Cristiane Rufino; Silva, Davi Leite da; Puga, Maria Eduarda

2010-01-01

The use of rigorous scientific methods has contributed towards developing scientific articles of excellent methodological quality. This has made it possible to promote their citation and increase the impact factor. Brazilian periodicals have had to adapt to certain quality standards demanded by these indexing organizations, such as the content and the number of original articles published in each issue. This study aimed to evaluate the methodological adequacy of two Brazilian periodicals within the field of cardiology that are indexed in several databases and freely accessible through the Scientific Electronic Library Online (SciELO), and which are now indexed by the Web of Science (Institute for Scientific Information, ISI). Descriptive study at Brazilian Cochrane Center. All the published articles were evaluated according to merit assessment (content) and form assessment (performance). Ninety-six percent of the articles analyzed presented study designs that were adequate for answering the objectives. These two Brazilian periodicals within the field of cardiology published methodologically adequate articles, since they followed the quality standards. Thus, these periodicals can be considered both for consultation and as vehicles for publishing future articles. For further analyses, it is essential to apply other indicators of scientific activity such as bibliometrics, which evaluates quantitative aspects of the production, dissemination and use of information, and scientometrics, which is also concerned with the development of science policies, within which it is often superimposed on bibliometrics.

Skin Bleaching and Dermatologic Health of African and Afro-Caribbean Populations in the US: New Directions for Methodologically Rigorous, Multidisciplinary, and Culturally Sensitive Research.

PubMed

Benn, Emma K T; Alexis, Andrew; Mohamed, Nihal; Wang, Yan-Hong; Khan, Ikhlas A; Liu, Bian

2016-12-01

Skin-bleaching practices, such as using skin creams and soaps to achieve a lighter skin tone, are common throughout the world and are triggered by cosmetic reasons that oftentimes have deep historical, economic, sociocultural, and psychosocial roots. Exposure to chemicals in the bleaching products, notably, mercury (Hg), hydroquinone, and steroids, has been associated with a variety of adverse health effects, such as Hg poisoning and exogenous ochronosis. In New York City (NYC), skin care product use has been identified as an important route of Hg exposure, especially among Caribbean-born blacks and Dominicans. However, surprisingly sparse information is available on the epidemiology of the health impacts of skin-bleaching practices among these populations. We highlight the dearth of large-scale, comprehensive, community-based, clinical, and translational research in this area, especially the limited skin-bleaching-related research among non-White populations in the US. We offer five new research directions, including investigating the known and under-studied health consequences among populations for which the skin bleach practice is newly emerging at an alarming rate using innovative laboratory and statistical methods. We call for conducting methodologically rigorous, multidisciplinary, and culturally sensitive research in order to provide insights into the root and the epidemiological status of the practice and provide evidence of exposure-outcome associations, with an ultimate goal of developing potential intervention strategies to reduce the health burdens of skin-bleaching practice.

Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review

PubMed Central

Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

2018-01-01

Introduction The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. Methods A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Results Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Discussion Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Conclusion Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families. PMID:29662521

Navigating the grounded theory terrain. Part 1.

PubMed

Hunter, Andrew; Murphy, Kathy; Grealish, Annmarie; Casey, Dympna; Keady, John

2011-01-01

The decision to use grounded theory is not an easy one and this article aims to illustrate and explore the methodological complexity and decision-making process. It explores the decision making of one researcher in the first two years of a grounded theory PhD study looking at the psychosocial training needs of nurses and healthcare assistants working with people with dementia in residential care. It aims to map out three different approaches to grounded theory: classic, Straussian and constructivist. In nursing research, grounded theory is often referred to but it is not always well understood. This confusion is due in part to the history of grounded theory methodology, which is one of development and divergent approaches. Common elements across grounded theory approaches are briefly outlined, along with the key differences of the divergent approaches. Methodological literature pertaining to the three chosen grounded theory approaches is considered and presented to illustrate the options and support the choice made. The process of deciding on classical grounded theory as the version best suited to this research is presented. The methodological and personal factors that directed the decision are outlined. The relative strengths of Straussian and constructivist grounded theories are reviewed. All three grounded theory approaches considered offer the researcher a structured, rigorous methodology, but researchers need to understand their choices and make those choices based on a range of methodological and personal factors. In the second article, the final methodological decision will be outlined and its research application described.

Insights into the concept of fish welfare.

PubMed

Volpato, Gilson Luiz; Gonçalves-de-Freitas, Eliane; Fernandes-de-Castilho, Marisa

2007-05-04

Fish welfare issues are predicated on understanding whether fish are sentient beings. Therefore, we analyzed the logic of the methodologies used for studying this attribute. We conclude that empirical science is unable to prove or to disprove that fish are sentient beings. Thus, we propose a combined ethical-scientific approach for considering fish as sentient beings. The most difficult ongoing question is to determine which conditions fish prefer. Approaches to assess fish preferences should be rigorously and cautiously employed. In light of these considerations, attempts to establish physiological standards for fish welfare are discouraged, and a preference-based definition of fish welfare is proposed.

Manpower Substitution and Productivity in Medical Practice

PubMed Central

Reinhardt, Uwe E.

1973-01-01

Probably in response to the often alleged physician shortage in this country, concerted research efforts are under way to identify technically feasible opportunities for manpower substitution in the production of ambulatory health care. The approaches range from descriptive studies of the effect of task delegation on output of medical services to rigorous mathematical modeling of health care production by means of linear or continuous production functions. In this article the distinct methodological approaches underlying mathematical models are presented in synopsis, and their inherent strengths and weaknesses are contrasted. The discussion includes suggestions for future research directions. Images Fig. 2 PMID:4586735

Collaborative Evaluation of a High School Prevention Curriculum: How Methods of Collaborative Evaluation Enhanced a Randomized Control Trial to Inform Program Improvement

ERIC Educational Resources Information Center

Orsini, Muhsin Michael; Wyrick, David L.; Milroy, Jeffrey J.

2012-01-01

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

Comparing Analysis Frames for Visual Data Sets: Using Pupil Views Templates to Explore Perspectives of Learning

ERIC Educational Resources Information Center

Wall, Kate; Higgins, Steve; Remedios, Richard; Rafferty, Victoria; Tiplady, Lucy

2013-01-01

A key challenge of visual methodology is how to combine large-scale qualitative data sets with epistemologically acceptable and rigorous analysis techniques. The authors argue that a pragmatic approach drawing on ideas from mixed methods is helpful to open up the full potential of visual data. However, before one starts to "mix" the…

Reflections on Recent Research Into Animal-Assisted Interventions in the Military and Beyond.

PubMed

Rumayor, Christina B; Thrasher, Amy M

2017-11-25

The purpose of the present review was threefold: to address the current state of Animal-Assisted Interactions (AAI) within the military; to summarize recent literature (within the past three years) in the field of AAI; and to discuss trends in AAI research since 2014. With regard to AAI within the military, several canine interaction programs have been utilized to assist service members in coping with various issues. Therapy dogs have been deployed with Combat-Operational Stress Control units; they have been integrated into medical clinics and behavioral health treatment programs in garrison; and policy has been developed to address the use of therapy animals in military treatment facilities. General research in AAI has demonstrated efficacy for certain presenting issues (stress management, trauma, autism spectrum disorder) and specific populations (children, the elderly, acute care patients). Overall trends in research include calls for increased consideration for animal welfare in AAI and increased rigor in research methodology. Current research supports the structured use of therapy dogs in the treatment of various disorders and with specific populations, including military service members and veterans; however, the need for additional research with rigorous methodology remains.

A ten-year review of the literature on the use of standardized patients in teaching and learning: 1996-2005.

PubMed

May, Win; Park, Joo Hyun; Lee, Justin P

2009-06-01

Although there is a growing body of literature on the educational use of standardized patients (SP) in teaching and learning, there have been no reviews on their value. To determine whether the educational use of SPs has an effect on the knowledge, skills, and behaviour of learners in the health professions. English-language articles covering the period 1996-2005 were reviewed to address the issue of to what extent has the use of SPs affected the knowledge, skills and performance of learners. Out of 797 abstracts, 69 articles, which met the review criteria, were selected. An adaptation of Kirkpatrick's model was used to classify and analyse the articles. Most of the learners were students in medicine and nursing. SPs were used mostly to teach communication skills and clinical skills. The study designs were case-control (29%), pre-test/post-test (24.6%), post-test only (26.1%) and qualitative studies (20.3%). METHODOLOGICAL ISSUES: Most of the studies had weak research designs. More rigorous designs with control or comparison groups should be used in future research. Most studies reported that the educational use of SPs was valuable. More rigorous studies would support the evidence-based use of SPs in teaching and learning.

Acceptance and commitment therapy in the treatment of anxiety: a systematic review.

PubMed

Swain, Jessica; Hancock, Karen; Hainsworth, Cassandra; Bowman, Jenny

2013-12-01

With a lifetime prevalence of approximately 17% among community-dwelling adults, anxiety disorders are among the most pervasive of contemporary psychiatric afflictions. Traditional Cognitive Behaviour Therapy (CBT) is currently the first line evidence-based psychosocial intervention for the treatment of anxiety. Previous research, however, has found that a significant proportion of patients do not respond to traditional CBT or exhibit residual symptomatology at treatment cessation. Additionally, there is a paucity of evidence among child populations and for the comparative effectiveness of alternative interventions. Acceptance and Commitment Therapy (ACT) has a growing empirical base demonstrating its efficacy for an array of problems. A systematic review was conducted to examine the evidence for ACT in the treatment of anxiety. PsycInfo, PsycArticles, PsycExtra, Medline and Proquest databases were searched, reference lists examined and citation searches conducted. Two independent reviewers analysed results, determined study eligibility and assessed methodological quality. Thirty-eight studies met inclusion criteria (total n=323). The spectrum of DSM-IV anxiety disorders as well as test and public speaking anxiety were examined. Studies were predominantly between-group design and case studies, with few employing control comparisons. Several methodological issues limit conclusions; however results provide preliminary support for ACT. Larger scale, methodologically rigorous trials are needed to consolidate these findings. © 2013.

A Theoretical Framework for Lagrangian Descriptors

NASA Astrophysics Data System (ADS)

Lopesino, C.; Balibrea-Iniesta, F.; García-Garrido, V. J.; Wiggins, S.; Mancho, A. M.

This paper provides a theoretical background for Lagrangian Descriptors (LDs). The goal of achieving rigorous proofs that justify the ability of LDs to detect invariant manifolds is simplified by introducing an alternative definition for LDs. The definition is stated for n-dimensional systems with general time dependence, however we rigorously prove that this method reveals the stable and unstable manifolds of hyperbolic points in four particular 2D cases: a hyperbolic saddle point for linear autonomous systems, a hyperbolic saddle point for nonlinear autonomous systems, a hyperbolic saddle point for linear nonautonomous systems and a hyperbolic saddle point for nonlinear nonautonomous systems. We also discuss further rigorous results which show the ability of LDs to highlight additional invariants sets, such as n-tori. These results are just a simple extension of the ergodic partition theory which we illustrate by applying this methodology to well-known examples, such as the planar field of the harmonic oscillator and the 3D ABC flow. Finally, we provide a thorough discussion on the requirement of the objectivity (frame-invariance) property for tools designed to reveal phase space structures and their implications for Lagrangian descriptors.

An Opportunity for Convergence? Understanding the Prevalence and Risk of Distracted Driving Through the Use of Crash Databases, Crash Investigations, and Other Approaches

PubMed Central

Angell, Linda S.

2014-01-01

A variety of methodologies for understanding the prevalence of distracted driving, its risk, and other aspects of driver secondary activity, have been used in the last 15 years. Although the current trend is toward naturalistic driving studies, each methodology contributes certain elements to a better understanding that could emerge from a convergence of these efforts. However, if differing methods are to contribute to a common and robust understanding of driver distraction, it is critical to understand the strengths and limitations of each method. This paper reviews several of the non-naturalistic methods. It suggests that “convergence science” – a more concerted and rigorous effort to bring different approaches together into an integrative whole – may offer benefits for identification and definition of issues and countermeasure development to improve driving safety. PMID:24776226

The Complex Nature of Bilinguals' Language Usage Modulates Task-Switching Outcomes

PubMed Central

Yang, Hwajin; Hartanto, Andree; Yang, Sujin

2016-01-01

In view of inconsistent findings regarding bilingual advantages in executive functions (EF), we reviewed the literature to determine whether bilinguals' different language usage causes measureable changes in the shifting aspects of EF. By drawing on the theoretical framework of the adaptive control hypothesis—which postulates a critical link between bilinguals' varying demands on language control and adaptive cognitive control (Green and Abutalebi, 2013), we examined three factors that characterize bilinguals' language-switching experience: (a) the interactional context of conversational exchanges, (b) frequency of language switching, and (c) typology of code-switching. We also examined whether methodological variations in previous task-switching studies modulate task-specific demands on control processing and lead to inconsistencies in the literature. Our review demonstrates that not only methodological rigor but also a more finely grained, theory-based approach will be required to understand the cognitive consequences of bilinguals' varied linguistic practices in shifting EF. PMID:27199800

Entangled trajectories Hamiltonian dynamics for treating quantum nuclear effects

NASA Astrophysics Data System (ADS)

Smith, Brendan; Akimov, Alexey V.

2018-04-01

A simple and robust methodology, dubbed Entangled Trajectories Hamiltonian Dynamics (ETHD), is developed to capture quantum nuclear effects such as tunneling and zero-point energy through the coupling of multiple classical trajectories. The approach reformulates the classically mapped second-order Quantized Hamiltonian Dynamics (QHD-2) in terms of coupled classical trajectories. The method partially enforces the uncertainty principle and facilitates tunneling. The applicability of the method is demonstrated by studying the dynamics in symmetric double well and cubic metastable state potentials. The methodology is validated using exact quantum simulations and is compared to QHD-2. We illustrate its relationship to the rigorous Bohmian quantum potential approach, from which ETHD can be derived. Our simulations show a remarkable agreement of the ETHD calculation with the quantum results, suggesting that ETHD may be a simple and inexpensive way of including quantum nuclear effects in molecular dynamics simulations.

Sequential Stereotype Priming: A Meta-Analysis.

PubMed

Kidder, Ciara K; White, Katherine R; Hinojos, Michelle R; Sandoval, Mayra; Crites, Stephen L

2017-08-01

Psychological interest in stereotype measurement has spanned nearly a century, with researchers adopting implicit measures in the 1980s to complement explicit measures. One of the most frequently used implicit measures of stereotypes is the sequential priming paradigm. The current meta-analysis examines stereotype priming, focusing specifically on this paradigm. To contribute to ongoing discussions regarding methodological rigor in social psychology, one primary goal was to identify methodological moderators of the stereotype priming effect-whether priming is due to a relation between the prime and target stimuli, the prime and target response, participant task, stereotype dimension, stimulus onset asynchrony (SOA), and stimuli type. Data from 39 studies yielded 87 individual effect sizes from 5,497 participants. Analyses revealed that stereotype priming is significantly moderated by the presence of prime-response relations, participant task, stereotype dimension, target stimulus type, SOA, and prime repetition. These results carry both practical and theoretical implications for future research on stereotype priming.

[Satisfaction and perceived quality of people insured by the Social Health Protection in Mexico. Methodological foundations].

PubMed

Saturno-Hernández, Pedro J; Gutiérrez-Reyes, Juan Pablo; Vieyra-Romero, Waldo Ivan; Romero-Martínez, Martín; O'Shea-Cuevas, Gabriel Jaime; Lozano-Herrera, Javier; Tavera-Martínez, Sonia; Hernández-Ávila, Mauricio

2016-01-01

To describe the conceptual framework and methods for implementation and analysis of the satisfaction survey of the Mexican System for Social Protection in Health. We analyze the methodological elements of the 2013, 2014 and 2015 surveys, including the instrument, sampling method and study design, conceptual framework, and characteristics and indicators of the analysis. The survey captures information on perceived quality and satisfaction. Sampling has national and State representation. Simple and composite indicators (index of satisfaction and rate of reported quality problems) are built and described. The analysis is completed using Pareto diagrams, correlation between indicators and association with satisfaction by means of multivariate models. The measurement of satisfaction and perceived quality is a complex but necessary process to comply with regulations and to identify strategies for improvement. The described survey presents a design and rigorous analysis focused on its utility for improving.

Guidelines for reporting methodological challenges and evaluating potential bias in dementia research.

PubMed

Weuve, Jennifer; Proust-Lima, Cécile; Power, Melinda C; Gross, Alden L; Hofer, Scott M; Thiébaut, Rodolphe; Chêne, Geneviève; Glymour, M Maria; Dufouil, Carole

2015-09-01

Clinical and population research on dementia and related neurologic conditions, including Alzheimer's disease, faces several unique methodological challenges. Progress to identify preventive and therapeutic strategies rests on valid and rigorous analytic approaches, but the research literature reflects little consensus on "best practices." We present findings from a large scientific working group on research methods for clinical and population studies of dementia, which identified five categories of methodological challenges as follows: (1) attrition/sample selection, including selective survival; (2) measurement, including uncertainty in diagnostic criteria, measurement error in neuropsychological assessments, and practice or retest effects; (3) specification of longitudinal models when participants are followed for months, years, or even decades; (4) time-varying measurements; and (5) high-dimensional data. We explain why each challenge is important in dementia research and how it could compromise the translation of research findings into effective prevention or care strategies. We advance a checklist of potential sources of bias that should be routinely addressed when reporting dementia research. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Pragmatic critical realism: could this methodological approach expand our understanding of employment relations?

PubMed

Mearns, Susan Lesley

2011-01-01

This paper seeks to highlight the need for employment relations academics and researchers to expand their use of research methodologies in order for them to enable the advancement of theoretical debate within their discipline. It focuses on the contribution that pragmatical critical realism has made to the field of perception and argues that it would add value to the subject of employment relations. It is a theoretically centred review of pragmatical critical realism and the possible contribution this methodology would make to the field of employment relations. The paper concludes that the employment relationship does not take place in a vacuum rather it is focussed on the interaction between imperfect individuals. Therefore, their interactions are moulded by emotions which can not be explored thoroughly or even acknowledged through a positivists' rigorous but limited acknowledgment of what constitutes 'knowledge' and development of theory. While not rejecting the contribution that quantitative data or positivism have made to the field, the study concludes that pragmatic critical realism has a lot to offer the development of the area and its theoretical foundations.

Interventions to address parenting and parental substance abuse: conceptual and methodological considerations.

PubMed

Neger, Emily N; Prinz, Ronald J

2015-07-01

Parental substance abuse is a serious problem affecting the well-being of children and families. The co-occurrence of parental substance abuse and problematic parenting is recognized as a major public health concern. This review focuses on 21 outcome studies that tested dual treatment of substance abuse and parenting. A summary of theoretical conceptualizations of the connections between substance abuse and parenting provides a backdrop for the review. Outcomes of the dual treatment studies were generally positive with respect to reduction of parental substance use and improvement of parenting. Research in this area varied in methodological rigor and needs to overcome challenges regarding design issues, sampling frame, and complexities inherent in such a high-risk population. This area of work can be strengthened by randomized controlled trials, use of mixed-methods outcome measures, consideration of parent involvement with child protective services, involvement of significant others in treatment, provision of concrete supports for treatment attendance and facilitative public policies. Copyright © 2015 Elsevier Ltd. All rights reserved.

Interventions to Address Parenting and Parental Substance Abuse: Conceptual and Methodological Considerations

PubMed Central

Neger, Emily N.; Prinz, Ronald J.

2015-01-01

Parental substance abuse is a serious problem affecting the well-being of children and families. The co-occurrence of parental substance abuse and problematic parenting is recognized as a major public health concern. This review focuses on 21 outcome studies that tested dual treatment of substance abuse and parenting. A summary of theoretical conceptualizations of the connections between substance abuse and parenting provides a backdrop for the review. Outcomes of the dual treatment studies were generally positive with respect to reduction of parental substance use and improvement of parenting. Research in this area varied in methodological rigor and needs to overcome challenges regarding design issues, sampling frame, and complexities inherent in such a high-risk population. This area of work can be strengthened by randomized controlled trials, use of mixed-methods outcome measures, consideration of parent involvement with child protective services, involvement of significant others in treatment, provision of concrete supports for treatment attendance and facilitative public policies. PMID:25939033

Improving utility of evidence synthesis for healthy public policy: the three Rs (relevance, rigor, and readability [and resources]).

PubMed

Thomson, Hilary

2013-08-01

Systematic reviews have the potential to promote knowledge exchange between researchers and decision-makers. Review planning requires engagement with evidence users to ensure preparation of relevant reviews, and well-conducted reviews should provide accessible and reliable synthesis to support decision-making. Yet, systematic reviews are not routinely referred to by decision-makers, and innovative approaches to improve the utility of reviews is needed. Evidence synthesis for healthy public policy is typically complex and methodologically challenging. Although not lessening the value of reviews, these challenges can be overwhelming and threaten their utility. Using the interrelated principles of relevance, rigor, and readability, and in light of available resources, this article considers how utility of evidence synthesis for healthy public policy might be improved.

Improving Utility of Evidence Synthesis for Healthy Public Policy: the Three Rs (Relevance, Rigor, and Readability [and Resources])

PubMed Central

2013-01-01

Systematic reviews have the potential to promote knowledge exchange between researchers and decision-makers. Review planning requires engagement with evidence users to ensure preparation of relevant reviews, and well-conducted reviews should provide accessible and reliable synthesis to support decision-making. Yet, systematic reviews are not routinely referred to by decision-makers, and innovative approaches to improve the utility of reviews is needed. Evidence synthesis for healthy public policy is typically complex and methodologically challenging. Although not lessening the value of reviews, these challenges can be overwhelming and threaten their utility. Using the interrelated principles of relevance, rigor, and readability, and in light of available resources, this article considers how utility of evidence synthesis for healthy public policy might be improved. PMID:23763400

A Systematic Scoping Review of Yoga Intervention Components and Study Quality

PubMed Central

Elwy, A. Rani; Groessl, Erik J.; Eisen, Susan V.; Riley, Kristen; Maiya, Meghan; Lee, Jennifer P.; Sarkin, Andrew; Park, Crystal L.

2014-01-01

Context The scientific study of yoga requires rigorous methodology. This review aimed to systematically assess all studies of yoga interventions to: (1) determine yoga intervention characteristics; (2) examine methodologic quality of the subset of RCTs; and (3) explore how well these interventions are reported. Evidence acquisition Searches were conducted through April 2012 in PubMed, PsycInfo, Ageline, and Ovid’s Alternative and Complementary Medicine database using the text term yoga, and through handsearching five journals. Original studies were included if the intervention: (1) consisted of at least one yoga session with some type of health assessment; (2) targeted adults age ≥18 years; (3) was published in an English language peer–reviewed journal; and (4) was available for review. Evidence synthesis Of 3,062 studies identified, 465 studies in 30 countries were included. Analyses were conducted through 2013. Most interventions took place in India (n=228) or the U.S. (n=124), with intensity ranging from a single yoga session up to two sessions per day. Intervention lengths ranged from one session to 2 years. Asanas (poses) were mentioned as yoga components in 369 (79%) interventions, but were either minimally or not at all described in 200 (54%) of these. Most interventions (74%, n=336) did not include home practice. Of the included studies, 151 were RCTs. RCT quality was rated as poor. Conclusions This review highlights the inadequate reporting and methodologic limitations of current yoga intervention research, which limits study interpretation and comparability. Recommendations for future methodology and reporting are discussed. PMID:24996759

How effective is drug testing as a workplace safety strategy? A systematic review of the evidence.

PubMed

Pidd, Ken; Roche, Ann M

2014-10-01

The growing prevalence of workplace drug testing and the narrow scope of previous reviews of the evidence base necessitate a comprehensive review of research concerning the efficacy of drug testing as a workplace strategy. A systematic qualitative review of relevant research published between January 1990 and January 2013 was undertaken. Inclusion criteria were studies that evaluated the effectiveness of drug testing in deterring employee drug use or reducing workplace accident or injury rates. Methodological adequacy was assessed using a published assessment tool specifically designed to assess the quality of intervention studies. A total of 23 studies were reviewed and assessed, six of which reported on the effectiveness of testing in reducing employee drug use and 17 which reported on occupational accident or injury rates. No studies involved randomised control trials. Only one study was assessed as demonstrating strong methodological rigour. That study found random alcohol testing reduced fatal accidents in the transport industry. The majority of studies reviewed contained methodological weaknesses including; inappropriate study design, limited sample representativeness, the use of ecological data to evaluate individual behaviour change and failure to adequately control for potentially confounding variables. This latter finding is consistent with previous reviews and indicates the evidence base for the effectiveness of testing in improving workplace safety is at best tenuous. Better dissemination of the current evidence in relation to workplace drug testing is required to support evidence-informed policy and practice. There is also a pressing need for more methodologically rigorous research to evaluate the efficacy and utility of drug testing. Copyright © 2014 Elsevier Ltd. All rights reserved.

[I want to breastfeed my baby: Unvealing the experiences of women who lived process difficulties in their breastfeeding].

PubMed

Lucchini Raies, Camila; Márquez Doren, Francisca; Rivera Martínez, María Soledad

2017-01-01

Breastfeeding is the most beneficial feeding practice for infants. However, it is not always the first choice for mothers and their encouragement and support from health professionals is variable. To understand the experience of mothers who had difficulties with their breastfeeding process. A phenomenological study was conducted in a University Health center. Twelve breastfeeding women were included. Data collection technique was in depth interviews, taped recorded with participants’ consent. Phenomenological analysis of data followed Streubert´s method. The rigor of the study was guarded by criteria for qualitative research and the research process. Ethical aspects were sheltered through the informed consent process, confidentiality and methodological rigor. The experience of living difficulties in the breastfeeding process is revealed in five comprehensive categories: recognizing the difficulties with breastfeeding; emotional impact when unable to breastfeed; motivation to overcome the difficulty and ask for help; support for breastfeeding recovery; and transition process from stress and anxiety to peace, gratification and empowerment. The understanding of this experience is qualitative evidence that contributes to a comprehensive understanding of the situation of each mother and child, allowing to improve support care interventions in health.

On the evidentiary standards for nutrition advice.

PubMed

Jukola, Saana

2018-06-01

This paper evaluates the application of evidentiary standards originating from evidence-based medicine in nutrition advice. It shows that it is problematic to criticize nutrition recommendations for not being based on randomized controlled trials. Due to practical, ethical and methodological and reasons, it is difficult to conduct rigorous randomized controlled trials for acquiring evidence that is relevant for achieving the goals of population-level nutrition recommendations. Given the non-epistemic goals of the dietary recommendations, criteria of acceptable evidence should be adapted to the goals of the practice and the practical, ethical, and methodological constraints of the situation. Copyright © 2018 Elsevier Ltd. All rights reserved.

Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare.

PubMed

Nicolay, C R; Purkayastha, S; Greenhalgh, A; Benn, J; Chaturvedi, S; Phillips, N; Darzi, A

2012-03-01

The demand for the highest-quality patient care coupled with pressure on funding has led to the increasing use of quality improvement (QI) methodologies from the manufacturing industry. The aim of this systematic review was to identify and evaluate the application and effectiveness of these QI methodologies to the field of surgery. MEDLINE, the Cochrane Database, Allied and Complementary Medicine Database, British Nursing Index, Cumulative Index to Nursing and Allied Health Literature, Embase, Health Business(™) Elite, the Health Management Information Consortium and PsycINFO(®) were searched according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement. Empirical studies were included that implemented a described QI methodology to surgical care and analysed a named outcome statistically. Some 34 of 1595 articles identified met the inclusion criteria after consensus from two independent investigators. Nine studies described continuous quality improvement (CQI), five Six Sigma, five total quality management (TQM), five plan-do-study-act (PDSA) or plan-do-check-act (PDCA) cycles, five statistical process control (SPC) or statistical quality control (SQC), four Lean and one Lean Six Sigma; 20 of the studies were undertaken in the USA. The most common aims were to reduce complications or improve outcomes (11), to reduce infection (7), and to reduce theatre delays (7). There was one randomized controlled trial. QI methodologies from industry can have significant effects on improving surgical care, from reducing infection rates to increasing operating room efficiency. The evidence is generally of suboptimal quality, and rigorous randomized multicentre studies are needed to bring evidence-based management into the same league as evidence-based medicine. Copyright © 2011 British Journal of Surgery Society Ltd. Published by John Wiley & Sons, Ltd.

Methodologic Considerations for the Study of Childhood Sexual Abuse in Sexual Health Outcome Research: A Comprehensive Review.

PubMed

Kilimnik, Chelsea D; Pulverman, Carey S; Meston, Cindy M

2018-04-01

Childhood sexual abuse (CSA) has been a topic of interest in sexual health research for decades, yet literature on the sexual health correlates of CSA has been hindered by methodologic inconsistencies that have resulted in discrepant samples and mixed results. To review the major methodologic inconsistencies in the field, explore the scientific and clinical impact of these inconsistencies, and propose methodologic approaches to increase consistency and generalizability to the general population of women with CSA histories. A comprehensive literature review was conducted to assess the methodologic practices used in examining CSA and sexual health outcomes. Methodologic decisions of researchers examining sexual health outcomes of CSA. There are a number of inconsistencies in the methods used to examine CSA in sexual health research across the domains of CSA operationalization, recruitment language, and measurement approaches to CSA experiences. The examination of CSA and sexual health correlates is an important research endeavor that needs rigorous methodologic approaches. We propose recommendations to increase the utility of CSA research in sexual health. We recommend the use of a developmentally informed operationalization of childhood and adolescence, rather than age cutoffs. Researchers are encouraged to use a broad operationalization of sexual abuse such that different abuse characteristics can be measured, reported, and examined in the role of sexual health outcomes. We recommend inclusive recruitment approaches to capture the full range of CSA experiences and transparency in reporting these methods. The field also could benefit from the validation of existing self-report instruments for assessing CSA and detailed reporting of the instruments used in research studies. The use of more consistent research practices could improve the state of knowledge on the relation between CSA and sexual health. Kilimnik CD, Pulverman CS, Meston CM. Methodologic Considerations for the Study of Childhood Sexual Abuse in Sexual Health Outcome Research: A Comprehensive Review. Sex Med Rev 2018;6:176-187. Copyright © 2018 International Society for Sexual Medicine. Published by Elsevier Inc. All rights reserved.

Enhancement of carer skills and patient function in the non-pharmacological management of frontotemporal dementia (FTD): A call for randomised controlled studies

PubMed Central

O'Connor, Claire M.; Clemson, Lindy; da Silva, Thaís Bento Lima; Piguet, Olivier; Hodges, John R.; Mioshi, Eneida

2013-01-01

FTD is a unique condition which manifests with a range of behavioural symptoms, marked dysfunction in activities of daily living (ADL) and increased levels of carer burden as compared to carers of other dementias. No efficacious pharmacological interventions to treat FTD currently exist, and research on pharmacological symptom management is variable. The few studies on non-pharmacological interventions in FTD focus on either the carer or the patients' symptoms, and lack methodological rigour. This paper reviews and discusses current studies utilising non-pharmacological approaches, exposing the clear need for more rigorous methodologies to be applied in this field. Finally, a successful randomised controlled trial helped reduce behaviours of concern in dementia, and through implementing participation in tailored activities, the FTD-specific Tailored Activities Program (TAP) is presented. Crucially, this protocol has scope to target both the person with FTD and their carer. This paper highlights that studies in this area would help to elucidate the potential for using activities to reduce characteristic behaviours in FTD, improving quality of life and the caregiving experience in FTD. PMID:29213832

Economic benefits of meteorological services

NASA Astrophysics Data System (ADS)

Freebairn, John W.; Zillman, John W.

2002-03-01

There is an increasing need for more rigorous and more broadly based determination of the economic value of meteorological services as an aid to decision-making on the appropriate level of funding to be committed to their provision at the national level. This paper develops an overall framework for assessment of the economic value of meteorological services based on the recognition that most national meteorological infrastructure and services possess the non rival properties of public goods. Given this overall framework for determination of both total and marginal benefits, four main methodologies appropriate for use in valuation studies - market prices, normative or prescriptive decision-making models, descriptive behavioural response studies and contingent valuation studies - are outlined and their strengths and limitations described. Notwithstanding the methodological limitations and the need for a much more comprehensive set of studies for the various application sectors, it is clear that the actual and potential benefits to individuals, firms, industry sectors and national economies from state-of-the-art meteorological and related services are substantial and that, at this stage, they are inadequately recognised and insufficiently exploited in many countries.

Current Status of Renal Denervation in Hypertension.

PubMed

Briasoulis, Alexander; Bakris, George L

2016-11-01

Over the past 7 years, prospective cohorts and small randomized controlled studies showed that renal denervation therapy (RDN) in patients with resistant hypertension is safe but associated with variable effects on BP which are not substantially better than medical therapy alone. The failure of the most rigorously designed randomized sham-control study, SYMPLICITY HTN-3, to meet the efficacy endpoints has raised several methodological concerns. However, recently reported studies and ongoing trials with improved procedural characteristics, identification of patients with true treatment-resistant hypertension on appropriate antihypertensive regimens further explore potential benefits of RDN. The scope of this review is to summarize evidence from currently completed studies on RDN and discuss future perspectives of RDN therapy in patients with resistant hypertension.

The Challenge of Timely, Responsive and Rigorous Ethics Review of Disaster Research: Views of Research Ethics Committee Members.

PubMed

Hunt, Matthew; Tansey, Catherine M; Anderson, James; Boulanger, Renaud F; Eckenwiler, Lisa; Pringle, John; Schwartz, Lisa

2016-01-01

Research conducted following natural disasters such as earthquakes, floods or hurricanes is crucial for improving relief interventions. Such research, however, poses ethical, methodological and logistical challenges for researchers. Oversight of disaster research also poses challenges for research ethics committees (RECs), in part due to the rapid turnaround needed to initiate research after a disaster. Currently, there is limited knowledge available about how RECs respond to and appraise disaster research. To address this knowledge gap, we investigated the experiences of REC members who had reviewed disaster research conducted in low- or middle-income countries. We used interpretive description methodology and conducted in-depth interviews with 15 respondents. Respondents were chairs, members, advisors, or coordinators from 13 RECs, including RECs affiliated with universities, governments, international organizations, a for-profit REC, and an ad hoc committee established during a disaster. Interviews were analyzed inductively using constant comparative techniques. Through this process, three elements were identified as characterizing effective and high-quality review: timeliness, responsiveness and rigorousness. To ensure timeliness, many RECs rely on adaptations of review procedures for urgent protocols. Respondents emphasized that responsive review requires awareness of and sensitivity to the particularities of disaster settings and disaster research. Rigorous review was linked with providing careful assessment of ethical considerations related to the research, as well as ensuring independence of the review process. Both the frequency of disasters and the conduct of disaster research are on the rise. Ensuring effective and high quality review of disaster research is crucial, yet challenges, including time pressures for urgent protocols, exist for achieving this goal. Adapting standard REC procedures may be necessary. However, steps should be taken to ensure that ethics review of disaster research remains diligent and thorough.

Cultural Competence in the Treatment of Addictions: Theory, Practice and Evidence.

PubMed

Gainsbury, Sally M

2017-07-01

Culturally and linguistically diverse (CALD) populations often have high rates of addictive disorders, but lower rates of treatment seeking and completion than the mainstream population. A significant barrier to treatment is the lack of culturally relevant and appropriate treatment. A literature review was conducted to identify relevant literature related to cultural competence in mental health services delivery and specifically treatment for addictive disorders. Several theoretical models of cultural competence in therapy have been developed, but the lack of rigorous research limits the empirical evidence available. Research indicates that culturally competent treatment practices including providing therapy and materials in the client's language, knowledge, understanding and appreciation for cultural perspectives and nuances, involving the wider family and community and training therapists can enhance client engagement, retention and treatment outcomes for substance use and gambling. Further methodologically rigorous research is needed to isolate the impact of cultural competence for the treatment of addictions and guide research to determine treatment efficacy within specific CALD populations. Training therapists and recruiting therapists and researchers from CALD communities is important to ensure an ongoing focus and improved outcomes for CALD populations due to the importance of engaging these populations with addiction treatment. Copyright © 2016 John Wiley & Sons, Ltd. Key Practitioner Message: The treatment needs of culturally diverse individuals with addictions are often not met. Theoretical models can guide therapists in incorporating cultural competence. Culturally targeted treatments increase recruitment, retention and treatment outcomes. Cultural competence includes matching clinicians and clients on linguistic and cultural backgrounds as well as being mindful of the impact of culture on client's experience of addiction problems. Few methodologically rigorous trials have been conducted to guide treatment practices and research needs to be incorporated into existing culturally relevant treatment services. Copyright © 2016 John Wiley & Sons, Ltd.

The Challenge of Timely, Responsive and Rigorous Ethics Review of Disaster Research: Views of Research Ethics Committee Members

PubMed Central

Hunt, Matthew; Tansey, Catherine M.

2016-01-01

Background Research conducted following natural disasters such as earthquakes, floods or hurricanes is crucial for improving relief interventions. Such research, however, poses ethical, methodological and logistical challenges for researchers. Oversight of disaster research also poses challenges for research ethics committees (RECs), in part due to the rapid turnaround needed to initiate research after a disaster. Currently, there is limited knowledge available about how RECs respond to and appraise disaster research. To address this knowledge gap, we investigated the experiences of REC members who had reviewed disaster research conducted in low- or middle-income countries. Methods We used interpretive description methodology and conducted in-depth interviews with 15 respondents. Respondents were chairs, members, advisors, or coordinators from 13 RECs, including RECs affiliated with universities, governments, international organizations, a for-profit REC, and an ad hoc committee established during a disaster. Interviews were analyzed inductively using constant comparative techniques. Results Through this process, three elements were identified as characterizing effective and high-quality review: timeliness, responsiveness and rigorousness. To ensure timeliness, many RECs rely on adaptations of review procedures for urgent protocols. Respondents emphasized that responsive review requires awareness of and sensitivity to the particularities of disaster settings and disaster research. Rigorous review was linked with providing careful assessment of ethical considerations related to the research, as well as ensuring independence of the review process. Conclusion Both the frequency of disasters and the conduct of disaster research are on the rise. Ensuring effective and high quality review of disaster research is crucial, yet challenges, including time pressures for urgent protocols, exist for achieving this goal. Adapting standard REC procedures may be necessary. However, steps should be taken to ensure that ethics review of disaster research remains diligent and thorough. PMID:27327165

Testability/Diagnostics Design Encyclopedia

DTIC Science & Technology

1990-09-01

weapon system that is pushing the state of the art and produced In limited numbers, with questionable historical data on their operation, one can...designs with questionable basis and justification. Unfortunately, this process has not been transformed from an art to a rigorous methodology...REQUIREMENT #2.1 - On-the-job training - Formal school training o O-Level data acquieitlonico01ectlon system (and data management) o Requirements to

Challenging Preservice Teacher Beliefs about the Past: The Influence of a Course Designed to Shift Ways of Knowing about History Teaching and Learning

ERIC Educational Resources Information Center

Reddy, Kimberly

2013-01-01

"School history" has long since been characterized by teacher-centered lectures and student passivity, which deviates substantially from the inquiry-based and rigorous methodology historians use to actively reconstruct the past. While recent efforts have been made to move toward a more investigative approach in classrooms, little if any…

VII. The history of physical activity and academic performance research: informing the future.

PubMed

Castelli, Darla M; Centeio, Erin E; Hwang, Jungyun; Barcelona, Jeanne M; Glowacki, Elizabeth M; Calvert, Hannah G; Nicksic, Hildi M

2014-12-01

The study of physical activity, physical fitness, and academic performance research are reviewed from a historical perspective, by providing an overview of existing publications focused on children and adolescents. Using rigorous inclusion criteria, the studies were quantified and qualified using both meta-analytic and descriptive evaluations analyses, first by time-period and then as an overall summary, particularly focusing on secular trends and future directions. This review is timely because the body of literature is growing exponentially, resulting in the emergence of new terminology, methodologies, and identification of mediating and moderating factors. Implications and recommendations for future research are summarized. © 2014 The Society for Research in Child Development, Inc.

Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review

PubMed Central

Krauth, David; Woodruff, Tracey J.

2013-01-01

Background: Results from animal toxicology studies are critical to evaluating the potential harm from exposure to environmental chemicals or the safety of drugs prior to human testing. However, there is significant debate about how to evaluate the methodology and potential biases of the animal studies. There is no agreed-upon approach, and a systematic evaluation of current best practices is lacking. Objective: We performed a systematic review to identify and evaluate instruments for assessing the risk of bias and/or other methodological criteria of animal studies. Method: We searched Medline (January 1966–November 2011) to identify all relevant articles. We extracted data on risk of bias criteria (e.g., randomization, blinding, allocation concealment) and other study design features included in each assessment instrument. Discussion: Thirty distinct instruments were identified, with the total number of assessed risk of bias, methodological, and/or reporting criteria ranging from 2 to 25. The most common criteria assessed were randomization (25/30, 83%), investigator blinding (23/30, 77%), and sample size calculation (18/30, 60%). In general, authors failed to empirically justify why these or other criteria were included. Nearly all (28/30, 93%) of the instruments have not been rigorously tested for validity or reliability. Conclusion: Our review highlights a number of risk of bias assessment criteria that have been empirically tested for animal research, including randomization, concealment of allocation, blinding, and accounting for all animals. In addition, there is a need for empirically testing additional methodological criteria and assessing the validity and reliability of a standard risk of bias assessment instrument. Citation: Krauth D, Woodruff TJ, Bero L. 2013. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121:985–992 (2013); http://dx.doi.org/10.1289/ehp.1206389 PMID:23771496

Fieldwork Methodology in South American Maritime Archaeology: A Critical Review

NASA Astrophysics Data System (ADS)

Argüeso, Amaru; Ciarlo, Nicolás C.

2017-12-01

In archaeology, data obtained from the analysis of material evidence (i.e., the archaeological record) from extensive excavations have been a significant means for the ultimate development of interpretations about human life in the past. Therefore, the methodological procedures and tools employed during fieldwork are of crucial importance due to their effect on the information likely to be recovered. In the case of maritime archaeology, the development of rigorous methods and techniques allowed for reaching outcomes as solid as those from the work performed on land. These improvements constituted one of the principal supports—if not, the most important pillar—for its acceptance as a scientific field of study. Over time, the growing diversity of sites under study (e.g., shipwrecks, ports, dockyards, and prehistoric settlements) and the underwater environments encountered made it clear that there was a need for the application of specific methodological criteria, in accordance with the particularities of the sites and of each study (e.g., the research aims and the available resources). This article presents some ideas concerning the methodologies used in South American investigations that have exhibited a strong emphasis on the analysis of historical shipwrecks (the sixteenth to twentieth centuries). Based on a state-of-the-knowledge review of these research projects, in particular where excavations were conducted, the article focuses on the details of the main strategies adopted and results achieved. The ideas proposed in this article can be useful as a starting point for future activities of surveying, recording, and excavating shipwrecks.

Prediction of driving capacity after traumatic brain injury: a systematic review.

PubMed

Ortoleva, Claudia; Brugger, Camille; Van der Linden, Martial; Walder, Bernhard

2012-01-01

To review the current evidence on predictors for the ability to return to driving after traumatic brain injury. Systematic searches were conducted in MEDLINE, PsycINFO, EMBASE, and CINAHL up to March 1, 2010. Studies were rigorously rated for their methodological content and quality and standardized data were extracted from eligible studies. We screened 2341 articles, of which 7 satisfied our inclusion criteria. Five studies were of limited quality because of undefined, unrepresentative samples and/or absence of blinding. Studies mentioned 38 candidate predictors and tested 37. The candidate predictors most frequently mentioned were "selective attention" and "divided attention" in 4/7 studies, and "executive functions" and "processing speed," both in 3/7 studies. No association with driving was observed for 19 candidate predictors. Eighteen candidate predictors from 3 domains were associated with driving capacity: patient and trauma characteristics, neuropsychological assessments, and general assessments; 10 candidate predictors were tested in only one study and 8 in more than one study. The results of associations were contradictory for all but one: time between trauma and driving evaluation. There is no sound basis at present for predicting driving capacity after traumatic brain injury because most studies have methodological limitations.

Cognitive remediation in schizophrenia: A methodological appraisal of systematic reviews and meta-analyses.

PubMed

Bryce, Shayden; Sloan, Elise; Lee, Stuart; Ponsford, Jennie; Rossell, Susan

2016-04-01

Systematic reviews and meta-analyses are a primary source of evidence when evaluating the benefit(s) of cognitive remediation (CR) in schizophrenia. These studies are designed to rigorously synthesize scientific literature; however, cannot be assumed to be of high methodological quality. The aims of this report were to: 1) review the use of systematic reviews and meta-analyses regarding CR in schizophrenia; 2) conduct a systematic methodological appraisal of published reports examining the benefits of this intervention on core outcome domains; and 3) compare the correspondence between methodological and reporting quality. Electronic databases were searched for relevant articles. Twenty-one reviews met inclusion criteria and were scored according to the AMSTAR checklist-a validated scale of methodological quality. Five meta-analyses were also scored according to PRISMA statement to compare 'quality of conduct' with 'quality of reporting'. Most systematic reviews and meta-analyses shared strengths and fell within a 'medium' level of methodological quality. Nevertheless, there were consistent areas of potential weakness that were not addressed by most reviews. These included the lack of protocol registration, uncertainty regarding independent data extraction and consensus procedures, and the minimal assessment of publication bias. Moreover, quality of conduct may not necessarily parallel quality of reporting, suggesting that consideration of these methods independently may be important. Reviews concerning CR for schizophrenia are a valuable source of evidence. However, the methodological quality of these reports may require additional consideration. Enhancing quality of conduct is essential for enabling research literature to be interpreted with confidence. Copyright © 2016 Elsevier Ltd. All rights reserved.

Systematic review of SMART Recovery: Outcomes, process variables, and implications for research.

PubMed

Beck, Alison K; Forbes, Erin; Baker, Amanda L; Kelly, Peter J; Deane, Frank P; Shakeshaft, Anthony; Hunt, David; Kelly, John F

2017-02-01

Clinical guidelines recommend Self-Management and Recovery Training (SMART Recovery) and 12-step models of mutual aid as important sources of long-term support for addiction recovery. Methodologically rigorous reviews of the efficacy and potential mechanisms of change are available for the predominant 12-step approach. A similarly rigorous exploration of SMART Recovery has yet to be undertaken. We aim to address this gap by providing a systematic overview of the evidence for SMART Recovery in adults with problematic alcohol, substance, and/or behavioral addiction, including (i) a commentary on outcomes assessed, process variables, feasibility, current understanding of mental health outcomes, and (ii) a critical evaluation of the methodology. We searched six electronic peer-reviewed and four gray literature databases for English-language SMART Recovery literature. Articles were classified, assessed against standardized criteria, and checked by an independent assessor. Twelve studies (including three evaluations of effectiveness) were identified. Alcohol-related outcomes were the primary focus. Standardized assessment of nonalcohol substance use was infrequent. Information about behavioral addiction was restricted to limited prevalence data. Functional outcomes were rarely reported. Feasibility was largely indexed by attendance. Economic analysis has not been undertaken. Little is known about the variables that may influence treatment outcome, but attendance represents a potential candidate. Assessment and reporting of mental health status was poor. Although positive effects were found, the modest sample and diversity of methods prevent us from making conclusive remarks about efficacy. Further research is needed to understand the clinical and public health utility of SMART as a viable recovery support option. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Family interventions in traumatized immigrants and refugees: A systematic review.

PubMed

Slobodin, Ortal; de Jong, Joop T V M

2015-12-01

The importance of the family as a unit in the aftermath of trauma necessitates the use of family interventions among immigrants and refugees. While abundant clinical material suggests that family-based trauma interventions are applicable across cultures, very little is known about the extent to which family treatment modalities are effective for immigrants and refugees. We conducted a systematic review of intervention studies that have been designed or modified specifically for traumatized immigrant and refugee families. The terms "trauma," "family," and "immigrants/refugees/culture" were used along with different terms for "intervention." Studies with no research methodology were excluded. Only 6 experimental studies met our inclusion criteria; 4 of them describe school-based interventions and 2 present multifamily support groups. The shortage of research in this area does not allow clear conclusions about the effectiveness of family interventions for traumatized immigrants or refugees. The complexity of employing methodologically rigorous research in small communities is discussed. Future trials should go beyond the individualistic approach and focus on posttraumatic stress disorder to address family-level processes, such as family relationship, communication, and resilience. © The Author(s) 2015.

Testability of evolutionary game dynamics based on experimental economics data

NASA Astrophysics Data System (ADS)

Wang, Yijia; Chen, Xiaojie; Wang, Zhijian

2017-11-01

Understanding the dynamic processes of a real game system requires an appropriate dynamics model, and rigorously testing a dynamics model is nontrivial. In our methodological research, we develop an approach to testing the validity of game dynamics models that considers the dynamic patterns of angular momentum and speed as measurement variables. Using Rock-Paper-Scissors (RPS) games as an example, we illustrate the geometric patterns in the experiment data. We then derive the related theoretical patterns from a series of typical dynamics models. By testing the goodness-of-fit between the experimental and theoretical patterns, we show that the validity of these models can be evaluated quantitatively. Our approach establishes a link between dynamics models and experimental systems, which is, to the best of our knowledge, the most effective and rigorous strategy for ascertaining the testability of evolutionary game dynamics models.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Reynolds, William; Weber, Marta S.; Farber, Robert M.

Social Media provide an exciting and novel view into social phenomena. The vast amounts of data that can be gathered from the Internet coupled with massively parallel supercomputers such as the Cray XMT open new vistas for research. Conclusions drawn from such analysis must recognize that social media are distinct from the underlying social reality. Rigorous validation is essential. This paper briefly presents results obtained from computational analysis of social media - utilizing both blog and twitter data. Validation of these results is discussed in the context of a framework of established methodologies from the social sciences. Finally, an outlinemore » for a set of supporting studies is proposed.« less

Strengthening the implementation of Health in All Policies: a methodology for realist explanatory case studies.

PubMed

Shankardass, Ketan; Renahy, Emilie; Muntaner, Carles; O'Campo, Patricia

2015-05-01

To address macro-social and economic determinants of health and equity, there has been growing use of intersectoral action by governments around the world. Health in All Policies (HiAP) initiatives are a special case where governments use cross-sectoral structures and relationships to systematically address health in policymaking by targeting broad health determinants rather than health services alone. Although many examples of HiAP have emerged in recent decades, the reasons for their successful implementation--and for implementation failures--have not been systematically studied. Consequently, rigorous evidence based on systematic research of the social mechanisms that have regularly enabled or hindered implementation in different jurisdictions is sparse. We describe a novel methodology for explanatory case studies that use a scientific realist perspective to study the implementation of HiAP. Our methodology begins with the formulation of a conceptual framework to describe contexts, social mechanisms and outcomes of relevance to the sustainable implementation of HiAP. We then describe the process of systematically explaining phenomena of interest using evidence from literature and key informant interviews, and looking for patterns and themes. Finally, we present a comparative example of how Health Impact Assessment tools have been utilized in Sweden and Quebec to illustrate how this methodology uses evidence to first describe successful practices for implementation of HiAP and then refine the initial framework. The methodology that we describe helps researchers to identify and triangulate rich evidence describing social mechanisms and salient contextual factors that characterize successful practices in implementing HiAP in specific jurisdictions. This methodology can be applied to study the implementation of HiAP and other forms of intersectoral action to reduce health inequities involving multiple geographic levels of government in diverse settings. Published by Oxford University Press in association with The London School of Hygiene and Tropical Medicine © The Author 2014; all rights reserved.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed

Lexchin, J; Holbrook, A

1994-07-01

To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). Analytic study. All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

PubMed Central

Lexchin, J; Holbrook, A

1994-01-01

OBJECTIVE: To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). DESIGN: Analytic study. DATA SOURCE: All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. MAIN OUTCOME MEASURES: Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. MAIN RESULTS: Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. CONCLUSIONS: Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion. PMID:8004560

NORMATIVE ACCOUNTING THEORY AND THE THEORY OF DECISION,

DTIC Science & Technology

The paper discusses an approach to the construction of normative accounting theory with respect to both methodology and substance. The method of...postulation and deduction is outlined, with particular emphasis on its role in the social sciences in general and in accounting in particular. It is...suggested that a formal link must be established between the (normative) theory of decision and accounting , and that rigorous (economic) theories of the

Assessments of species' vulnerability to climate change: From pseudo to science

USGS Publications Warehouse

Wade, Alisa A.; Hand, Brian K.; Kovach, Ryan; Muhlfeld, Clint C.; Waples, Robin S.; Luikart, Gordon

2017-01-01

Climate change vulnerability assessments (CCVAs) are important tools to plan for and mitigate potential impacts of climate change. However, CCVAs often lack scientific rigor, which can ultimately lead to poor conservation prioritization and associated ecological and economic costs. We discuss the need to improve comparability and consistency of CCVAs and either validate their findings or improve assessment of CCVA uncertainty and sensitivity to methodological assumptions.

Transcranial direct current stimulation (tDCS) to improve naming ability in post-stroke aphasia: A critical review.

PubMed

ALHarbi, Mohammed F; Armijo-Olivo, Susan; Kim, Esther S

2017-08-14

Transcranial Direct Current Stimulation (tDCS) is a non-invasive neuromodulation tool that can be used to influence cortical brain activity to induce measurable behavioral changes. Although there is growing evidence that tDCS combined with behavioural language therapy could boost language recovery in patients with post-stroke aphasia, there is great variability in patient characteristics, treatment protocols, and outcome measures in these studies that poses challenges for analyzing the evidence. The purpose of this study is to critically analyze the methodological rigor of the evidence regarding the use of tDCS for post-stroke anomia. This critical review was conducted by searching four databases (MEDLINE, EMBase, PsycINFO, and CINAHL). Nineteen studies fully met the inclusion criteria. Three critical appraisal tools and Robey and Schultz's (1998) five- phase model for conducting clinical outcome research were adopted to evaluate and analyze the current level of evidence. Methodological issues of the studies were also identified. The current level of evidence for using tDCS for anomia is at the pre-efficacy level with emerging evidence at the efficacy level. Lack of proper evaluation of carry-over effects in cross-over studies, lack of or unclear randomization, allocation concealment, and incomplete data handling were the main methodological issues that could threaten the validity of the tDCS for anomia studies. Several methodological issues have been identified in pre-efficacy studies that pose challenges in determining whether tDCS is a beneficial adjunct to behavioral aphasia therapy. Future studies need to improve the quality of the methods used to investigate the effect of tDCS for anomia. Copyright © 2017 Elsevier B.V. All rights reserved.

Evidence mapping: illustrating an emerging methodology to improve evidence-based practice in youth mental health.

PubMed

Hetrick, Sarah E; Parker, Alexandra G; Callahan, Patrick; Purcell, Rosemary

2010-12-01

Within the field of evidence-based practice, a process termed 'evidence mapping' is emerging as a less exhaustive yet systematic and replicable methodology that allows an understanding of the extent and distribution of evidence in a broad clinical area, highlighting both what is known and where gaps in evidence exist. This article describes the general principles of mapping methodology by using illustrations derived from our experience conducting an evidence map of interventions for youth mental-health disorders. Evidence maps are based on an explicit research question relating to the field of enquiry, which may vary in depth, but should be informed by end-users. The research question then drives the search for, and collection of, appropriate studies utilizing explicit and reproducible methods at each stage. This includes clear definition of components of the research question, development of a thorough and reproducible search strategy, development of explicit inclusion and exclusion criteria, and transparent decisions about the level of information to be obtained from each study. Evidence mapping is emerging as a rigorous methodology for gathering and disseminating up-to-date information to end-users. Thoughtful planning and assessment of available resources (e.g. staff, time, budget) are required by those applying this methodology to their particular field of clinical enquiry given the potential scope of the work. The needs of the end-user need to be balanced with available resources. Information derived needs to be effectively communicated, with the uptake of that evidence into clinical practice the ultimate aim. © 2010 The Authors. Journal compilation © 2010 Blackwell Publishing Ltd.

How to conduct a high-quality original study on a diagnostic research topic.

PubMed

Yao, Xiaomei; Vella, Emily

2017-09-01

As health research methodologists and journal reviewers, we noticed that the methodological rigor of many publications on diagnostic or prognostic topics in the medical literature could be improved. We present a concise and clear series of reviews to help clinicians and health researchers to master the basic key components of how to conduct a high-quality original study or systematic review on a diagnostic or prognostic research topic from a methodological perspective. This is the first review of the series, which focuses on how to conduct a high-quality diagnostic study. We are introducing four aspects: clarifying the objectives; generating an appropriate research question; planning the study design; and reporting and analyzing data. This review highlights that diagnostic test accuracy outcomes are surrogates for patient outcomes, a diagnostic test has three roles, the "PIRO" components should be included in a diagnostic research question, a new study should be registered, multiple index tests can be compared in one study, and prevalence affects test accuracy outcomes. This review also emphasizes reporting any thresholds, calculating sample size, and performing a two-by-three table to calculate diagnostic outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wixson, J. R.

Root cause analysis (RCA) is an important methodology that can be integrated with the VE Job Plan to generate superior results from the VE Methodology. The point at which RCA is most appropriate is after the function analysis and FAST Model have been built and functions for improvement have been chosen. These functions are then subjected to a simple, but, rigorous RCA to get to the root cause of their deficiencies, whether it is high cost/poor value, poor quality, or poor reliability. Once the most probable causes for these problems have been arrived at, better solutions for improvement can bemore » developed in the creativity phase because the team better understands the problems associated with these functions.« less

US adolescents’ friendship networks and health risk behaviors: a systematic review of studies using social network analysis and Add Health data

PubMed Central

Goodson, Patricia

2015-01-01

Background. Documented trends in health-related risk behaviors among US adolescents have remained high over time. Studies indicate relationships among mutual friends are a major influence on adolescents’ risky behaviors. Social Network Analysis (SNA) can help understand friendship ties affecting individual adolescents’ engagement in these behaviors. Moreover, a systematic literature review can synthesize findings from a range of studies using SNA, as well as assess these studies’ methodological quality. Review findings also can help health educators and promoters develop more effective programs. Objective. This review systematically examined studies of the influence of friendship networks on adolescents’ risk behaviors, which utilized SNA and the Add Health data (a nationally representative sample). Methods. We employed the Matrix Method to synthesize and evaluate 15 published studies that met our inclusion and exclusion criteria, retrieved from the Add Health website and 3 major databases (Medline, Eric, and PsycINFO). Moreover, we assigned each study a methodological quality score (MQS). Results. In all studies, friendship networks among adolescents promoted their risky behaviors, including drinking alcohol, smoking, sexual intercourse, and marijuana use. The average MQS was 4.6, an indicator of methodological rigor (scale: 1–9). Conclusion. Better understanding of risky behaviors influenced by friends can be useful for health educators and promoters, as programs targeting friendships might be more effective. Additionally, the overall MQ of these reviewed studies was good, as average scores fell above the scale’s mid-point. PMID:26157622

Toward a new approach to the study of personality in culture.

PubMed

Cheung, Fanny M; van de Vijver, Fons J R; Leong, Frederick T L

2011-10-01

We review recent developments in the study of culture and personality measurement. Three approaches are described: an etic approach that focuses on establishing measurement equivalence in imported measures of personality, an emic (indigenous) approach that studies personality in specific cultures, and a combined emic-etic approach to personality. We propose the latter approach as a way of combining the methodological rigor of the etic approach and the cultural sensitivity of the emic approach. The combined approach is illustrated by two examples: the first with origins in Chinese culture and the second in South Africa. The article ends with a discussion of the theoretical and practical implications of the combined emic-etic approach for the study of culture and personality and for psychology as a science.

Social and behavioral interventions for improving quality of life of HIV infected people receiving antiretroviral therapy: a systematic review and meta-analysis.

PubMed

Bhatta, Dharma Nand; Liabsuetrakul, Tippawan; McNeil, Edward B

2017-04-24

Improvement in quality of life is crucial for HIV infected people. Social and behavioral interventions have been implemented in different contexts to improve the quality of life among HIV infected people. This review appraises the evidence for available interventions that focused on quality of life of HIV infected people receiving antiretroviral therapy (ART). We searched electronic databases for randomized controlled trials of interventions to improve the quality of life of HIV infected people receiving ART. We searched PUBMED and the Cochrane Centre Register of Controlled Trials (CENTRAL) with the terms "social", "behavioral", "educational", "quality of life", "HIV", and "RCT". Searches were conducted for articles published from 1980 to December 16, 2015. Standardized data abstraction methods and searching steps were applied. Twenty-eight studies reported the impact of social or behavioral interventions in quality of life among HIV infected people, of which 15 were conducted in United States of America. A total of 4136 participants were enrolled. Of the 28 studies, four studies included females, two studies included males and remaining studies excluded both males and females. The overall reported methodological quality of the studies was subject to a high risk of bias and the study criteria were unclear in most studies. Twenty-one studies reported a significant intervention effect on at least one quality of life domain. Meta-analyses showed significant improvement in general health, mental health, physical function and environment domains of quality of life among intervention groups. However, the expected impact of the intervention was low to moderate because the rigorousness of the studies was low, information was limited, the sample sizes were small and other the quality of the study designs were poor. Although the available evidence suggests that existing social and behavioral interventions can improve some quality of life domains, the quality of evidence was insufficient to support the notion that these interventions can improve the overall quality of life of HIV infected people receiving ART. Well-designed and rigorous randomized controlled trials with high methodological quality are required.

Behavioral interventions for agitation in older adults with dementia: an evaluative review.

PubMed

Spira, Adam P; Edelstein, Barry A

2006-06-01

Older adults with dementia commonly exhibit agitated behavior that puts them at risk of injury and institutionalization and is associated with caregiver stress. A range of theoretical approaches has produced numerous interventions to manage these behavior problems. This paper critically reviews the empirical literature on behavioral interventions to reduce agitation in older adults with dementia. A literature search yielded 23 articles that met inclusion criteria. These articles described interventions that targeted wandering, disruptive vocalization, physical aggression, other agitated behaviors and a combination of these behaviors. Studies are summarized individually and then evaluated. Behavioral interventions targeting agitated behavior exhibited by older adults with dementia show considerable promise. A number of methodological issues must be addressed to advance this research area. Problem areas include inconsistent use of functional assessment techniques, failure to report quantitative findings and inadequate demonstrations of experimental control. The reviewed studies collectively provide evidence that warrants optimism regarding the application of behavioral principles to the management of agitation among older adults with dementia. Although the results of some studies were mixed and several studies revealed methodological shortcomings, many of them offered innovations that can be used in future, more rigorously designed, intervention studies.

Health coaching to improve healthy lifestyle behaviors: an integrative review.

PubMed

Olsen, Jeanette M; Nesbitt, Bonnie J

2010-01-01

Chronic diseases account for 70% of U.S. deaths. Health coaching may help patients adopt healthy lifestyle behaviors that prevent and control diseases. This integrative review analyzed health coaching studies for evidence of effectiveness and to identify key program features. Multiple electronic databases were utilized, yielding a final sample of 15 documents. The search was limited to peer-reviewed research articles published between 1999 and 2008. Studies were further analyzed if they (1) specifically cited coaching as a program intervention, and (2) applied the intervention to research. Articles describing various quantitative and qualitative methodologies were critically analyzed using a systematic method. Data were synthesized using a matrix format according to purpose, method, intervention, findings, critique, and quality rating. All 15 studies utilized nonprobability sampling, 7 (47%) with randomized intervention and control groups. Significant improvements in one or more of the behaviors of nutrition, physical activity, weight management, or medication adherence were identified in six (40%) of the studies. Common features of effective programs were goal setting (73%), motivational interviewing (27%), and collaboration with health care providers (20%). Health coaching studies with well-specified methodologies and more rigorous designs are needed to strengthen findings; however, this behavioral change intervention suggests promise.

Reverse Engineering Validation using a Benchmark Synthetic Gene Circuit in Human Cells

PubMed Central

Kang, Taek; White, Jacob T.; Xie, Zhen; Benenson, Yaakov; Sontag, Eduardo; Bleris, Leonidas

2013-01-01

Multi-component biological networks are often understood incompletely, in large part due to the lack of reliable and robust methodologies for network reverse engineering and characterization. As a consequence, developing automated and rigorously validated methodologies for unraveling the complexity of biomolecular networks in human cells remains a central challenge to life scientists and engineers. Today, when it comes to experimental and analytical requirements, there exists a great deal of diversity in reverse engineering methods, which renders the independent validation and comparison of their predictive capabilities difficult. In this work we introduce an experimental platform customized for the development and verification of reverse engineering and pathway characterization algorithms in mammalian cells. Specifically, we stably integrate a synthetic gene network in human kidney cells and use it as a benchmark for validating reverse engineering methodologies. The network, which is orthogonal to endogenous cellular signaling, contains a small set of regulatory interactions that can be used to quantify the reconstruction performance. By performing successive perturbations to each modular component of the network and comparing protein and RNA measurements, we study the conditions under which we can reliably reconstruct the causal relationships of the integrated synthetic network. PMID:23654266

Reverse engineering validation using a benchmark synthetic gene circuit in human cells.

PubMed

Kang, Taek; White, Jacob T; Xie, Zhen; Benenson, Yaakov; Sontag, Eduardo; Bleris, Leonidas

2013-05-17

Multicomponent biological networks are often understood incompletely, in large part due to the lack of reliable and robust methodologies for network reverse engineering and characterization. As a consequence, developing automated and rigorously validated methodologies for unraveling the complexity of biomolecular networks in human cells remains a central challenge to life scientists and engineers. Today, when it comes to experimental and analytical requirements, there exists a great deal of diversity in reverse engineering methods, which renders the independent validation and comparison of their predictive capabilities difficult. In this work we introduce an experimental platform customized for the development and verification of reverse engineering and pathway characterization algorithms in mammalian cells. Specifically, we stably integrate a synthetic gene network in human kidney cells and use it as a benchmark for validating reverse engineering methodologies. The network, which is orthogonal to endogenous cellular signaling, contains a small set of regulatory interactions that can be used to quantify the reconstruction performance. By performing successive perturbations to each modular component of the network and comparing protein and RNA measurements, we study the conditions under which we can reliably reconstruct the causal relationships of the integrated synthetic network.

Application of Six Sigma/CAP methodology: controlling blood-product utilization and costs.

PubMed

Neri, Robert A; Mason, Cindy E; Demko, Lisa A

2008-01-01

Blood-product components are a limited commodity whose cost is rising. Many patients benefit from their use, but patients who receive transfusions face an unnecessary increased risk for developing infections; fatal, febrile, or allergic reactions; and circulatory overload. To improve patient care, safety, and resource stewardship, transfusion practices must be evaluated for appropriateness (Wilson et al. 2002). A multihospital health system undertook a rigorous study of blood-product utilization patterns and management processes to address cost-control problems in the organization. The system leveraged two process improvement tools widely implemented outside of the healthcare industry: (1) Six Sigma methodology to identify blood-utilization drivers and to standardize transfusion practice, and (2) change acceleration process model to drive effective change. The initiative resulted in a decreased rate of inappropriate transfusions of packed red blood cell from 16 percent to less than 5 percent, improved clinician use of a blood-component order form, establishment of internal benchmarks, enhanced laboratory-to-clinician communication, and better blood-product expense control. The project further demonstrated how out-of-industry tools and methodologies can be adopted, adapted, and systematically applied to generate positive change (Black and Revere 2006).

Making Sense of Studies That Claim Benefits of Frenotomy in the Absence of Classic Tongue-Tie.

PubMed

Douglas, Pamela

2017-08-01

By performing an in-depth analysis of one high profile example, this article aims to help breastfeeding support professionals understand the methodological flaws that characterize recent studies claiming to show the efficacy of frenotomy for the diagnoses of posterior tongue-tie and upper lip-tie. The example study does not address definitional confusion or control for the effects of the passage of time. It does not consider the effects of caring attention, validation, and lactation consultant support. It also does not consider the extensive research over the past three decades that has established that reflux in the first 6 months of life is benign, even though increased reflux frequency may correlate with unsettled infant behavior. The study authors relied on the hypothesis that reflux is caused by excessive air swallowing in infants with poor latch due to posterior tongue-tie and upper lip-tie, which lacks credible physiological mechanisms or supporting evidence. The authors' claim that conducting a randomized controlled trial to investigate the efficacy of frenotomy would be unethical contradicts the basic principles of good science. This article argues that our breastfeeding women and their babies deserve the most rigorous scientific methods available, and acknowledgment of the biases inherent in less rigorous research, if we are to make appropriate decisions concerning intervention with frenotomy and to prevent unnecessary oral surgery.

Age differences in implicit memory: conceptual, perceptual, or methodological?

PubMed

Mitchell, David B; Bruss, Peter J

2003-12-01

The authors examined age differences in conceptual and perceptual implicit memory via word-fragment completion, word-stem completion, category exemplar generation, picture-fragment identification, and picture naming. Young, middle-aged, and older participants (N = 60) named pictures and words at study. Limited test exposure minimized explicit memory contamination, yielding no reliable age differences and equivalent cross-format effects. In contrast, explicit memory and neuropsychological measures produced significant age differences. In a follow-up experiment, 24 young adults were informed a priori about implicit testing. Their priming was equivalent to the main experiment, showing that test trial time restrictions limit explicit memory strategies. The authors concluded that most implicit memory processes remain stable across adulthood and suggest that explicit contamination be rigorously monitored in aging studies.

Covariance propagation in spectral indices

DOE PAGES

Griffin, P. J.

2015-01-09

In this study, the dosimetry community has a history of using spectral indices to support neutron spectrum characterization and cross section validation efforts. An important aspect to this type of analysis is the proper consideration of the contribution of the spectrum uncertainty to the total uncertainty in calculated spectral indices (SIs). This study identifies deficiencies in the traditional treatment of the SI uncertainty, provides simple bounds to the spectral component in the SI uncertainty estimates, verifies that these estimates are reflected in actual applications, details a methodology that rigorously captures the spectral contribution to the uncertainty in the SI, andmore » provides quantified examples that demonstrate the importance of the proper treatment the spectral contribution to the uncertainty in the SI.« less

Study of the quality characteristics in cold-smoked salmon (Salmo salar) originating from pre- or post-rigor raw material.

PubMed

Birkeland, S; Akse, L

2010-01-01

Improved slaughtering procedures in the salmon industry have caused a delayed onset of rigor mortis and, thus, a potential for pre-rigor secondary processing. The aim of this study was to investigate the effect of rigor status at time of processing on quality traits color, texture, sensory, microbiological, in injection salted, and cold-smoked Atlantic salmon (Salmo salar). Injection of pre-rigor fillets caused a significant (P<0.001) contraction (-7.9%± 0.9%) on the caudal-cranial axis. No significant differences in instrumental color (a*, b*, C*, or h*), texture (hardness), or sensory traits (aroma, color, taste, and texture) were observed between pre- or post-rigor processed fillets; however, post-rigor (1477 ± 38 g) fillets had a significant (P>0.05) higher fracturability than pre-rigor fillets (1369 ± 71 g). Pre-rigor fillets were significantly (P<0.01) lighter, L*, (39.7 ± 1.0) than post-rigor fillets (37.8 ± 0.8) and had significantly lower (P<0.05) aerobic plate count (APC), 1.4 ± 0.4 log CFU/g against 2.6 ± 0.6 log CFU/g, and psychrotrophic count (PC), 2.1 ± 0.2 log CFU/g against 3.0 ± 0.5 log CFU/g, than post-rigor processed fillets. This study showed that similar quality characteristics can be obtained in cold-smoked products processed either pre- or post-rigor when using suitable injection salting protocols and smoking techniques. © 2010 Institute of Food Technologists®

[Methodological novelties applied to the anthropology of food: agent-based models and social networks analysis].

PubMed

Díaz Córdova, Diego

2016-01-01

The aim of this article is to introduce two methodological strategies that have not often been utilized in the anthropology of food: agent-based models and social networks analysis. In order to illustrate these methods in action, two cases based in materials typical of the anthropology of food are presented. For the first strategy, fieldwork carried out in Quebrada de Humahuaca (province of Jujuy, Argentina) regarding meal recall was used, and for the second, elements of the concept of "domestic consumption strategies" applied by Aguirre were employed. The underlying idea is that, given that eating is recognized as a "total social fact" and, therefore, as a complex phenomenon, the methodological approach must also be characterized by complexity. The greater the number of methods utilized (with the appropriate rigor), the better able we will be to understand the dynamics of feeding in the social environment.

[Systematic Review of the Methodology Quality in Lung Cancer Screening Guidelines].

PubMed

Li, Jiang; Su, Kai; Li, Fang; Tang, Wei; Huang, Yao; Wang, Le; Huang, Huiyao; Shi, Jufang; Dai, Min

2016-10-20

Lung cancer is the most common malignancy and screening can decrease the mortality. High quality screening guideline is necessary and important for effective work. Our study is to review and evaluate the basic characteristics and methodology quality of the current global lung cancer screening guidelines so as to provide useful information for domestic study in the future. Electronic searches were done in English and Chinese databases including PubMed, the Cochrane Library, Web of Science, Embase, CNKI, CBM, Wanfang, and some cancer official websites. Articles were screened according to the predefined inclusion and exclusion criteria by two researchers. The quality of guidelines was assessed by AGREE II. At last, a total of 11 guidelines with methodology were included. The guidelines were issued mainly by USA (81%). Canada and China developed one, respectively. As for quality, the average score in the "Scale and objective" of all guidelines was 80, the average score in the "Participants" was 52, the average score in the "rigorism" was 50, the average score in the "clarity" was 76, the average score in the "application" was 43 and the average score in the "independence" was 59. The highest average score was found in 2013 and 2015. Canada guideline had higher quality in six domains. 7 guidelines were evaluated as A level. The number of clinical guidelines showed an increasing trend. Most guidelines were issued by developed countries with heavy burden. Multi-country contribution to one guideline was another trend. Evidence-based methodology was accepted globally in the guideline development.

Qualitative studies using in-depth interviews with older people from multiple language groups: methodological systematic review.

PubMed

Fryer, Caroline; Mackintosh, Shylie; Stanley, Mandy; Crichton, Jonathan

2012-01-01

This paper is a report of a methodological review of language appropriate practice in qualitative research, when language groups were not determined prior to participant recruitment. When older people from multiple language groups participate in research using in-depth interviews, additional challenges are posed for the trustworthiness of findings. This raises the question of how such challenges are addressed. The Cumulative Index to Nursing and Allied Health Literature, Scopus, Embase, Web of Science, Ageline, PsycINFO, Sociological abstracts, Google Scholar and Allied and Complementary Medicine databases were systematically searched for the period 1840 to September 2009. The combined search terms of 'ethnic', 'cultural', 'aged', 'health' and 'qualitative' were used. In this methodological review, studies were independently appraised by two authors using a quality appraisal tool developed for the review, based on a protocol from the McMaster University Occupational Therapy Evidence-Based Practice Research Group. Nine studies were included. Consideration of language diversity within research process was poor for all studies. The role of language assistants was largely absent from study methods. Only one study reported using participants' preferred languages for informed consent. More examples are needed of how to conduct rigorous in-depth interviews with older people from multiple language groups, when languages are not determined before recruitment. This will require both researchers and funding bodies to recognize the importance to contemporary healthcare of including linguistically diverse people in participant samples. © 2011 The Authors. Journal of Advanced Nursing © 2011 Blackwell Publishing Ltd.

Complementary medicine, self-help, and lifestyle interventions for obsessive compulsive disorder (OCD) and the OCD spectrum: a systematic review.

PubMed

Sarris, Jerome; Camfield, David; Berk, Michael

2012-05-01

In Obsessive Compulsive Disorder (OCD) current standard pharmacotherapies may be of limited efficacy. Non-conventional interventions such as Complementary and Alternative Medicine (CAM), self-help techniques, and lifestyle interventions are commonly used by sufferers of OCD, however to date no systematic review of this specific area exists. We conducted a systematic review of studies using CAM, self-help, and lifestyle interventions for treatment of OCD and trichotillomania (TTM). PubMed, PsycINFO, China Academic Journals Full-text Database, The Cochrane Library and CINAHL were searched (up to Jan 11th 2011), for controlled clinical trials using non-conventional interventions for OCD. A quality analysis using a purpose-designed scale and an estimation of effect sizes (Cohen's d) where data was available, were also calculated. The literature search revealed 14 studies that met inclusion criteria. Methodological quality of nutraceutical studies (nutrients and herbal medicines) were rated as high (mean 8.6/10), whereas mind-body or self-help studies were poorer (mean 6.1/10). In OCD, tentative evidentiary support from methodologically weak studies was found for mindfulness meditation (d=0.63), electroacupuncture (d=1.16), and kundalini yoga (d=1.61). Better designed studies using the nutrient glycine (d=1.10), and traditional herbal medicines milk thistle (insufficient data for calculating d) and borage (d=1.67) also revealed positive results. A rigorous study showed that N-acetylcysteine (d=1.31) was effective in TTM, while self-help technique "movement decoupling" also demonstrated efficacy (d=0.94). Mixed evidence was found for myo-inositol (mean d=0.98). Controlled studies suggest that St John's wort, EPA, and meridian-tapping are ineffective in treating OCD. While several studies were positive, these were un-replicated and commonly used small samples. This precludes firm confidence in the strength of clinical effect. Preliminary evidence however is encouraging, and more rigorous research of some of the more hypothesis-based interventions in the treatment of OCD and TTM may be indicated. Copyright © 2011 Elsevier B.V. All rights reserved.

The FoReVer Methodology: A MBSE Framework for Formal Verification

NASA Astrophysics Data System (ADS)

Baracchi, Laura; Mazzini, Silvia; Cimatti, Alessandro; Tonetta, Stefano; Garcia, Gerald

2013-08-01

The need for high level of confidence and operational integrity in critical space (software) systems is well recognized in the Space industry and has been addressed so far through rigorous System and Software Development Processes and stringent Verification and Validation regimes. The Model Based Space System Engineering process (MBSSE) derived in the System and Software Functional Requirement Techniques study (SSFRT) focused on the application of model based engineering technologies to support the space system and software development processes, from mission level requirements to software implementation through model refinements and translations. In this paper we report on our work in the ESA-funded FoReVer project where we aim at developing methodological, theoretical and technological support for a systematic approach to the space avionics system development, in phases 0/A/B/C. FoReVer enriches the MBSSE process with contract-based formal verification of properties, at different stages from system to software, through a step-wise refinement approach, with the support for a Software Reference Architecture.

Comparison of regression coefficient and GIS-based methodologies for regional estimates of forest soil carbon stocks.

PubMed

Campbell, J Elliott; Moen, Jeremie C; Ney, Richard A; Schnoor, Jerald L

2008-03-01

Estimates of forest soil organic carbon (SOC) have applications in carbon science, soil quality studies, carbon sequestration technologies, and carbon trading. Forest SOC has been modeled using a regression coefficient methodology that applies mean SOC densities (mass/area) to broad forest regions. A higher resolution model is based on an approach that employs a geographic information system (GIS) with soil databases and satellite-derived landcover images. Despite this advancement, the regression approach remains the basis of current state and federal level greenhouse gas inventories. Both approaches are analyzed in detail for Wisconsin forest soils from 1983 to 2001, applying rigorous error-fixing algorithms to soil databases. Resulting SOC stock estimates are 20% larger when determined using the GIS method rather than the regression approach. Average annual rates of increase in SOC stocks are 3.6 and 1.0 million metric tons of carbon per year for the GIS and regression approaches respectively.

Matching-pursuit/split-operator-Fourier-transform computations of thermal correlation functions.

PubMed

Chen, Xin; Wu, Yinghua; Batista, Victor S

2005-02-08

A rigorous and practical methodology for evaluating thermal-equilibrium density matrices, finite-temperature time-dependent expectation values, and time-correlation functions is described. The method involves an extension of the matching-pursuit/split-operator-Fourier-transform method to the solution of the Bloch equation via imaginary-time propagation of the density matrix and the evaluation of Heisenberg time-evolution operators through real-time propagation in dynamically adaptive coherent-state representations.

Study Designs and Evaluation Models for Emergency Department Public Health Research

PubMed Central

Broderick, Kerry B.; Ranney, Megan L.; Vaca, Federico E.; D’Onofrio, Gail; Rothman, Richard E.; Rhodes, Karin V.; Becker, Bruce; Haukoos, Jason S.

2011-01-01

Public health research requires sound design and thoughtful consideration of potential biases that may influence the validity of results. It also requires careful implementation of protocols and procedures that are likely to translate from the research environment to actual clinical practice. This article is the product of a breakout session from the 2009 Academic Emergency Medicine consensus conference entitled “Public Health in the ED: Screening, Surveillance, and Intervention” and serves to describe in detail aspects of performing emergency department (ED)-based public health research, while serving as a resource for current and future researchers. In doing so, the authors describe methodologic features of study design, participant selection and retention, and measurements and analyses pertinent to public health research. In addition, a number of recommendations related to research methods and future investigations related to public health work in the ED are provided. Public health investigators are poised to make substantial contributions to this important area of research, but this will only be accomplished by employing sound research methodology in the context of rigorous program evaluation. PMID:20053232

Sex and Gender Differences Research Design for Basic, Clinical and Population Studies: Essentials for Investigators.

PubMed

Rich-Edwards, Janet W; Kaiser, Ursula B; Chen, Grace L; Manson, JoAnn E; Goldstein, Jill

2018-04-12

A sex and gender-informed perspective increases rigor, promotes discovery, and expands the relevance of biomedical research. In the current era of accountability to present data for males and females, thoughtful and deliberate methodology can improve study design and inference in sex and gender differences research. We address issues of motivation, subject selection, sample size, data collection, analysis, and interpretation, considering implications for basic, clinical, and population research. In particular, we focus on methods to test sex/gender differences as effect modification or interaction, and discuss why some inferences from sex-stratified data should be viewed with caution. Without careful methodology, the pursuit of sex difference research, despite a mandate from funding agencies, will result in a literature of contradiction. However, given the historic lack of attention to sex differences, the absence of evidence for sex differences is not necessarily evidence of the absence of sex differences. Thoughtfully conceived and conducted sex and gender differences research is needed to drive scientific and therapeutic discovery for all sexes and genders.

Tai Chi for Essential Hypertension

PubMed Central

Wang, Jie; Feng, Bo; Yang, Xiaochen; Liu, Wei; Teng, Fei; Li, Shengjie; Xiong, Xingjiang

2013-01-01

Objectives. To assess the current clinical evidence of Tai Chi for essential hypertension (EH). Search Strategy. 7 electronic databases were searched until 20 April, 2013. Inclusion Criteria. We included randomized trials testing Tai Chi versus routine care or antihypertensive drugs. Trials testing Tai Chi combined with antihypertensive drugs versus antihypertensive drugs were also included. Data Extraction and Analyses. Study selection, data extraction, quality assessment, and data analyses were conducted according to the Cochrane standards. Results. 18 trials were included. Methodological quality of the trials was low. 14 trials compared Tai Chi with routine care. 1 trial compared Tai Chi with antihypertensive drugs. Meta-analysis all showed significant effect of TaiChi in lowering blood pressure (BP). 3 trials compared Tai Chi plus antihypertensive drugs with antihypertensive drugs. Positive results in BP were found in the other 2 combination groups. Most of the trials did not report adverse events, and the safety of Tai Chi is still uncertain. Conclusions. There is some encouraging evidence of Tai Chi for EH. However, due to poor methodological quality of included studies, the evidence remains weak. Rigorously designed trials are needed to confirm the evidence. PMID:23986780

Parametric assessment of climate change impacts of automotive material substitution.

PubMed

Geyer, Roland

2008-09-15

Quantifying the net climate change impact of automotive material substitution is not a trivial task. It requires the assessment of the mass reduction potential of automotive materials, the greenhouse gas (GHG) emissions from their production and recycling, and their impact on GHG emissions from vehicle use. The model presented in this paper is based on life cycle assessment (LCA) and completely parameterized, i.e., its computational structure is separated from the required input data, which is not traditionally done in LCAs. The parameterization increases scientific rigor and transparency of the assessment methodology, facilitates sensitivity and uncertainty analysis of the results, and also makes it possible to compare different studies and explain their disparities. The state of the art of the modeling methodology is reviewed and advanced. Assessment of the GHG emission impacts of material recycling through consequential system expansion shows that our understanding of this issue is still incomplete. This is a critical knowledge gap since a case study shows thatfor materials such as aluminum, the GHG emission impacts of material production and recycling are both of the same size as the use phase savings from vehicle mass reduction.

Yoga and quality-of-life improvement in patients with breast cancer: a literature review.

PubMed

Levine, Alison Spatz; Balk, Judith L

2012-01-01

Women undergoing treatment for breast cancer often turn to complementary and alternative medicine (CAM), including yoga, for improvement of mood, quality of life (QOL), sleep, and treatment-related side effects. The extant literature was reviewed to examine the clinical effects of yoga practice on QOL for patients with breast cancer. QOL was defined as physical well-being, social functioning, emotional health, and function-al adaptation. Seven databases, including PubMed, Ovid MEDLINE, CINAHL, Embase, PsycINFO, Cochrane Library, and Web of Science were used to search for studies of patients with breast cancer that included a yoga intervention and QOL assessment. Attention was paid to assessing study population, outcome variables, the type of yoga intervention used, and methodological strengths and limitations. Seventy-one articles were identified that fit the search criteria. Although the literature provided evidence of QOL benefits of yoga for patients with breast cancer, no specific aspect of yoga was identified as being most advantageous. Although participation in yoga programs appeared to benefit patients with breast cancer, greater methodological rigor is required to understand the mechanisms that contribute to their effectiveness.

Quantifying construction and demolition waste: An analytical review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wu, Zezhou; Yu, Ann T.W., E-mail: bsannyu@polyu.edu.hk; Shen, Liyin

2014-09-15

Highlights: • Prevailing C and D waste quantification methodologies are identified and compared. • One specific methodology cannot fulfill all waste quantification scenarios. • A relevance tree for appropriate quantification methodology selection is proposed. • More attentions should be paid to civil and infrastructural works. • Classified information is suggested for making an effective waste management plan. - Abstract: Quantifying construction and demolition (C and D) waste generation is regarded as a prerequisite for the implementation of successful waste management. In literature, various methods have been employed to quantify the C and D waste generation at both regional and projectmore » levels. However, an integrated review that systemically describes and analyses all the existing methods has yet to be conducted. To bridge this research gap, an analytical review is conducted. Fifty-seven papers are retrieved based on a set of rigorous procedures. The characteristics of the selected papers are classified according to the following criteria - waste generation activity, estimation level and quantification methodology. Six categories of existing C and D waste quantification methodologies are identified, including site visit method, waste generation rate method, lifetime analysis method, classification system accumulation method, variables modelling method and other particular methods. A critical comparison of the identified methods is given according to their characteristics and implementation constraints. Moreover, a decision tree is proposed for aiding the selection of the most appropriate quantification method in different scenarios. Based on the analytical review, limitations of previous studies and recommendations of potential future research directions are further suggested.« less

Designing a mixed methods study in primary care.

PubMed

Creswell, John W; Fetters, Michael D; Ivankova, Nataliya V

2004-01-01

Mixed methods or multimethod research holds potential for rigorous, methodologically sound investigations in primary care. The objective of this study was to use criteria from the literature to evaluate 5 mixed methods studies in primary care and to advance 3 models useful for designing such investigations. We first identified criteria from the social and behavioral sciences to analyze mixed methods studies in primary care research. We then used the criteria to evaluate 5 mixed methods investigations published in primary care research journals. Of the 5 studies analyzed, 3 included a rationale for mixing based on the need to develop a quantitative instrument from qualitative data or to converge information to best understand the research topic. Quantitative data collection involved structured interviews, observational checklists, and chart audits that were analyzed using descriptive and inferential statistical procedures. Qualitative data consisted of semistructured interviews and field observations that were analyzed using coding to develop themes and categories. The studies showed diverse forms of priority: equal priority, qualitative priority, and quantitative priority. Data collection involved quantitative and qualitative data gathered both concurrently and sequentially. The integration of the quantitative and qualitative data in these studies occurred between data analysis from one phase and data collection from a subsequent phase, while analyzing the data, and when reporting the results. We recommend instrument-building, triangulation, and data transformation models for mixed methods designs as useful frameworks to add rigor to investigations in primary care. We also discuss the limitations of our study and the need for future research.

A rigorous approach to investigating common assumptions about disease transmission: Process algebra as an emerging modelling methodology for epidemiology.

PubMed

McCaig, Chris; Begon, Mike; Norman, Rachel; Shankland, Carron

2011-03-01

Changing scale, for example, the ability to move seamlessly from an individual-based model to a population-based model, is an important problem in many fields. In this paper, we introduce process algebra as a novel solution to this problem in the context of models of infectious disease spread. Process algebra allows us to describe a system in terms of the stochastic behaviour of individuals, and is a technique from computer science. We review the use of process algebra in biological systems, and the variety of quantitative and qualitative analysis techniques available. The analysis illustrated here solves the changing scale problem: from the individual behaviour we can rigorously derive equations to describe the mean behaviour of the system at the level of the population. The biological problem investigated is the transmission of infection, and how this relates to individual interactions.

Animal-assisted intervention for autism spectrum disorder: a systematic literature review.

PubMed

O'Haire, Marguerite E

2013-07-01

The inclusion of animals in therapeutic activities, known as animal-assisted intervention (AAI), has been suggested as a treatment practice for autism spectrum disorder (ASD). This paper presents a systematic review of the empirical research on AAI for ASD. Fourteen studies published in peer-reviewed journals qualified for inclusion. The presentation of AAI was highly variable across the studies. Reported outcomes included improvements for multiple areas of functioning known to be impaired in ASD, namely increased social interaction and communication as well as decreased problem behaviors, autistic severity, and stress. Yet despite unanimously positive outcomes, most studies were limited by many methodological weaknesses. This review demonstrates that there is preliminary "proof of concept" of AAI for ASD and highlights the need for further, more rigorous research.

Review of reviews on exposures to synthetic organic chemicals and children's neurodevelopment: Methodological and interpretation challenges.

PubMed

LaKind, Judy S; Anthony, Laura G; Goodman, Michael

2017-01-01

Environmental epidemiology data are becoming increasingly important in public health decision making, which commonly incorporates a systematic review of multiple studies. This review addresses two fundamental questions: What is the quality of available reviews on associations between exposure to synthetic organic chemicals and neurodevelopmental outcomes? What is the value (e.g., quality and consistency) of the underlying literature? Published reviews on associations between synthetic organic environmental chemical exposures and neurodevelopmental outcomes in children were systematically evaluated. Seventy-four relevant reviews were identified, and these were evaluated with respect to four methodological characteristics: (1) systematic inclusion/exclusion criteria and reproducible methods for search and retrieval of studies; (2) structured evaluation of underlying data quality; (3) systematic assessment of consistency across specific exposure-outcome associations; and (4) evaluation of reporting/publication bias. None of the 74 reviews fully met the criteria for all four methodological characteristics. Only four reviews met two criteria, and six reviews fulfilled only one criterion. Perhaps more importantly, the higher quality reviews were not able to meet all of the criteria owing to the shortcomings of underlying studies, which lacked comparability in terms of specific research question of interest, overall design, exposure assessment, outcome ascertainment, and analytic methods. Thus, even the most thoughtful and rigorous review may be of limited value if the underlying literature includes investigations that address different hypotheses and are beset by methodological inconsistencies and limitations. Issues identified in this review of reviews illustrate considerable challenges that are facing assessments of epidemiological evidence.

Stakeholder-Driven Quality Improvement: A Compelling Force for Clinical Practice Guidelines.

PubMed

Rosenfeld, Richard M; Wyer, Peter C

2018-01-01

Clinical practice guideline development should be driven by rigorous methodology, but what is less clear is where quality improvement enters the process: should it be a priority-guiding force, or should it enter only after recommendations are formulated? We argue for a stakeholder-driven approach to guideline development, with an overriding goal of quality improvement based on stakeholder perceptions of needs, uncertainties, and knowledge gaps. In contrast, the widely used topic-driven approach, which often makes recommendations based only on randomized controlled trials, is driven by epidemiologic purity and evidence rigor, with quality improvement a downstream consideration. The advantages of a stakeholder-driven versus a topic-driven approach are highlighted by comparisons of guidelines for otitis media with effusion, thyroid nodules, sepsis, and acute bacterial rhinosinusitis. These comparisons show that stakeholder-driven guidelines are more likely to address the quality improvement needs and pressing concerns of clinicians and patients, including understudied populations and patients with multiple chronic conditions. Conversely, a topic-driven approach often addresses "typical" patients, based on research that may not reflect the needs of high-risk groups excluded from studies because of ethical issues or a desire for purity of research design.

The benefits of health information exchange: an updated systematic review.

PubMed

Menachemi, Nir; Rahurkar, Saurabh; Harle, Christopher A; Vest, Joshua R

2018-04-28

Widespread health information exchange (HIE) is a national objective motivated by the promise of improved care and a reduction in costs. Previous reviews have found little rigorous evidence that HIE positively affects these anticipated benefits. However, early studies of HIE were methodologically limited. The purpose of the current study is to review the recent literature on the impact of HIE. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to conduct our systematic review. PubMed and Scopus databases were used to identify empirical articles that evaluated HIE in the context of a health care outcome. Our search strategy identified 24 articles that included 63 individual analyses. The majority of the studies were from the United States representing 9 states; and about 40% of the included analyses occurred in a handful of HIEs from the state of New York. Seven of the 24 studies used designs suitable for causal inference and all reported some beneficial effect from HIE; none reported adverse effects. The current systematic review found that studies with more rigorous designs all reported benefits from HIE. Such benefits include fewer duplicated procedures, reduced imaging, lower costs, and improved patient safety. We also found that studies evaluating community HIEs were more likely to find benefits than studies that evaluated enterprise HIEs or vendor-mediated exchanges. Overall, these finding bode well for the HIEs ability to deliver on anticipated improvements in care delivery and reduction in costs.

The role of physical exercise in cognitive recovery after traumatic brain injury: A systematic review.

PubMed

Morris, Timothy; Gomes Osman, Joyce; Tormos Muñoz, Jose Maria; Costa Miserachs, David; Pascual Leone, Alvaro

2016-11-22

There is a growing body of evidence revealing exercise-induced effects on brain structure and cognitive function across the lifespan. Animal models of traumatic brain injury also suggest exercise is capable of modulating not only the pathophysiological changes following trauma but also the associated cognitive deficits. To evaluate the effect of physical exercise on cognitive impairment following traumatic brain injury in humans. A systematic search of the PubMed database was performed using the search terms "cognition" and "executive function, memory or attention", "traumatic brain injury" and "physical exercise". Adult human traumatic brain injury studies that assessed cognitive function as an outcome measure (primary or secondary) and used physical exercise as a treatment (single or combined) were assessed by two independent reviewers. Data was extracted under the guidance of the population intervention comparison outcome framework wherein, characteristics of included studies (exercise duration, intensity, combined or single intervention, control groups and cognitive measures) were collected, after which, methodological quality (Cochrane criteria) was assessed. A total of 240 citations were identified, but only 6 met our inclusion criteria (3 from search records, 3 from reference lists. Only a small number of studies have evaluated the effect of exercise on cognition following traumatic brain injury in humans, and of those, assessment of efficacy is difficult due to low methodological strength and a high risk of different types of bias. Evidence of an effect of physical exercise on cognitive recovery suggests further studies should explore this treatment option with greater methodological approaches. Recommendations to reduce risk of bias and methodological shortfalls are discussed and include stricter inclusion criteria to create homogenous groups and larger patient pools, more rigorous cognitive assessments and the study and reporting of additional and combined rehabilitation techniques.

The 1,5-H-shift in 1-butoxy: A case study in the rigorous implementation of transition state theory for a multirotamer system

NASA Astrophysics Data System (ADS)

Vereecken, Luc; Peeters, Jozef

2003-09-01

The rigorous implementation of transition state theory (TST) for a reaction system with multiple reactant rotamers and multiple transition state conformers is discussed by way of a statistical rate analysis of the 1,5-H-shift in 1-butoxy radicals, a prototype reaction for the important class of H-shift reactions in atmospheric chemistry. Several approaches for deriving a multirotamer TST expression are treated: oscillator versus (hindered) internal rotor models; distinguishable versus indistinguishable atoms; and direct count methods versus degeneracy factors calculated by (simplified) direct count methods or from symmetry numbers and number of enantiomers, where applicable. It is shown that the various treatments are fully consistent, even if the TST expressions themselves appear different. The 1-butoxy H-shift reaction is characterized quantum chemically using B3LYP-DFT; the performance of this level of theory is compared to other methods. Rigorous application of the multirotamer TST methodology in an harmonic oscillator approximation based on this data yields a rate coefficient of k(298 K,1 atm)=1.4×105 s-1, and an Arrhenius expression k(T,1 atm)=1.43×1011 exp(-8.17 kcal mol-1/RT) s-1, which both closely match the experimental recommendations in the literature. The T-dependence is substantially influenced by the multirotamer treatment, as well as by the tunneling and fall-off corrections. The present results are compared to those of simplified TST calculations based solely on the properties of the lowest energy 1-butoxy rotamer.

A framework for evaluating e-health: Systematic review of studies assessing the quality of health information and services for patients on the Internet

PubMed Central

Eysenbach, Gunther

2000-01-01

Context A recent concern and topic of many publications in the last three years has been the quality of health information and services for the public on the Internet. Objectives To identify and summarize studies published in the peer-reviewed literature evaluating the quality of information and services for consumers on the Internet, including information published on web sites, information on newsgroups and mailing lists and other venues such as email contacts with doctors, as well as studies evaluating the quality of ehealth services such as cyberdoctors and cyberpharmacies. Data Sources MEDLINE and PREMEDLINE (1966 - May 2000), Science Citation Index (1992-May 2000), Social Sciences Citation Index (1992- May 2000), Arts and Humanities Citation Index (1992-May 2000) and a personal bibliographic database. Study Selection We included empirical studies where investigators searched the Internet systematically for specific health information or clearly define a set of specific services to be included, evaluated the quality of information or services found, and reported quantitative data. Data Extraction Study characteristics, medical domain, search strategies used, quality criteria and methodology of quality assessment, results (number of sites rated as sufficient pertaining to a quality), quality and rigor of study methodology and reporting. Data Synthesis A total of 41 studies met the inclusion criteria, dealing either with content of websites, information on e-commerce sites, quality of online-care or community venues. A) Content: 29 evaluated information on websites, of those 5 evaluated information on websites from the field of pediatrics, 3 from oncology, 3 pharmacology information, 2 nutrition information, 4 general clinical information and 12 specific information from other clinical disciplines. Studies varied widely in methodology, quality and results. Among the 29 studies dealing with quality of health information on websites, one study evaluated the authority of source, 19 studies checked sites for presence or absences of technical criteria (such as disclosure of sponsorship, authorship, presence of references or last update), three evaluated readability, 20 evaluated the accuracy of information, and 12 content completeness. B) E-Commerce: Three studies dealt with drug information on e-commerce sites. To evaluate the quality authors extracted prices, checked for completeness of online-history taking and/or information provided on the site e.g. pertaining to contraindications or the presence/absence of disclaimers and/or liability waivers. Only one of these three studies actually used the service by ordering drugs, allowing to evaluate quality of online-advice, qualification of cyberdocs, delivery time, reasons for non-delivery. C) Care: Five studies dealt with the quality of online consultations, of them one dealt with advice given by ordinary physicians in response to a unsolicited fictionous patient request, two evaluated the responses of cyberdocs soliciting patient requests, and two evaluated advice given in response to a request for an online prescription directed to drug e-commerce sites. D) Community: Seven studies evaluated messages on mailing lists or usenet newsgroups. Two studies collected messages from a venue and evaluated them for accuracy, two studies posted a "test" message on a newsgroup and evaluated the accuracy of responses. In three studies authors used the cumulative impact factor of the published research of the mailing list contributors as an indicator for the qualification of the authors and thus as quality indicator of the mailing list. Of the 23 studies evaluating accuracy and/or completeness of information provided on websites, 10 used guidelines as gold standard (all of the to extract a-priori criteria), five used peer-reviewed literature (all to compare information a posteriori), two used textbooks, one used consensus among the raters and three used the personal experience or opinion of the author. All three studies which compared information against personal opinion came to a positive conclusion regarding the accuracy of information, while all of the more rigorous studies comparing information against guidelines concluded that much of the information found on the web were of low quality. In two cases it was not reported where the gold standard comes from. 9 studies used more than one rater to assess a website, 6 of them provided some sort of information on inter-observer variability. Conclusions Methodology, results and conclusions of investigators vary widely. There is a wide variability even regarding the evaluation of formal criteria such as authorship and references. Differences in study conclusions regarding the quality of Internet information are likely a result of difference in study rigor, evaluation criteria and topic chosen. All but five studies concluded that quality is a problem on the Internet. The rigor of these five studies coming to a more positive conclusion as expressed in a "assessment quality score" was significantly inferior to the remaining studies. Although there were two comparative studies of the quality of information on the Internet compared with information found outside of the Internet, there is little evidence that health information found on the Internet is worse than health information in traditional media. A conceptual and methodological framework is presented for describing, comparing, and analyzing the structure and quality of e-health, based on Donabedians quality measures of structure, process and outcome.

Attentional responses to stimuli associated with a reward can occur in the absence of knowledge of their predictive values.

PubMed

Leganes-Fonteneau, Mateo; Scott, Ryan; Duka, Theodora

2018-04-02

Classical conditioning theories of addiction suggest that stimuli associated with rewards acquire incentive salience, inducing emotional and attentional conditioned responses. It is not clear whether those responses occur without contingency awareness (CA), i.e. are based on explicit or implicit learning processes. Examining implicit aspects of stimulus-reward associations can improve our understanding of addictive behaviours, supporting treatment and prevention strategies. However, the acquisition of conditioned responses without CA has yet to be rigorously demonstrated, as the existing literature shows a lack of methodological agreement regarding the measurement of implicit and explicit processes. The purpose of two experiments presented here was to study the emotional value acquired by CS through implicit emotional and attentional processes, trying to overcome critical methodological issues. Experiment 1 (n = 48) paired two stimuli categories (houses/buildings) with high (HR) or low (LR) probabilities of monetary reward. An Emotional Attentional Blink revealed preferential attention for HR over LR regardless of CA; while pleasantness ratings were unaffected, probably due to the intrinsic nature of CS. Experiment 2 (n = 60) replicated the effect of conditioning on the Emotional Attentional Blink utilising abstract CS (octagons/squares). In addition increased pleasantness for HR over LR was found significant overall, and marginally significant for Aware but not for Unaware participants. Here CA was rigorously determined using a signal-detection analysis and metacognitive-awareness measurements. Bayesian analyses verified the unconscious nature of the learning. These findings demonstrate that attentional conditioned responses can occur without CA and advance our understanding of the mechanisms by which implicit conditioning can occur and becomes observable. Furthermore, these results can highlight how addictive behaviours might develop. Copyright © 2017 Elsevier B.V. All rights reserved.

Improving the outcomes of children affected by parental substance abuse: a review of randomized controlled trials

PubMed Central

Calhoun, Stacy; Conner, Emma; Miller, Melodi; Messina, Nena

2015-01-01

Substance abuse is a major public health concern that impacts not just the user but also the user’s family. The effect that parental substance abuse has on children has been given substantial attention over the years. Findings from the literature suggest that children of substance-abusing parents have a high risk of developing physical and mental health and behavioral problems. A number of intervention programs have been developed for parents who have a substance abuse problem. There have also been a number of interventions that have been developed for children who have at least one parent with a substance abuse problem. However, it remains unclear how we can best mitigate the negative effects that parental substance abuse has on children due to the scarcity of evaluations that utilize rigorous methodologies such as experimental designs. The purpose of this study is to review randomized controlled trials of intervention programs targeting parents with substance abuse problems and/or children with at least one parent with a substance abuse problem in order to identify programs that show some promise in improving the behavioral and mental health outcomes of children affected by parental substance abuse. Four randomized controlled trials that met our eligibility criteria were identified using major literature search engines. The findings from this review suggest that interventions that focus on improving parenting practices and family functioning may be effective in reducing problems in children affected by parental substance abuse. However, further research utilizing rigorous methodologies are needed in order to identify other successful interventions that can improve the outcomes of these children long after the intervention has ended. PMID:25670915

Comparative Effectiveness Research in Oncology

PubMed Central

2013-01-01

Although randomized controlled trials represent the gold standard for comparative effective research (CER), a number of additional methods are available when randomized controlled trials are lacking or inconclusive because of the limitations of such trials. In addition to more relevant, efficient, and generalizable trials, there is a need for additional approaches utilizing rigorous methodology while fully recognizing their inherent limitations. CER is an important construct for defining and summarizing evidence on effectiveness and safety and comparing the value of competing strategies so that patients, providers, and policymakers can be offered appropriate recommendations for optimal patient care. Nevertheless, methodological as well as political and social challenges for CER remain. CER requires constant and sophisticated methodological oversight of study design and analysis similar to that required for randomized trials to reduce the potential for bias. At the same time, if appropriately conducted, CER offers an opportunity to identify the most effective and safe approach to patient care. Despite rising and unsustainable increases in health care costs, an even greater challenge to the implementation of CER arises from the social and political environment questioning the very motives and goals of CER. Oncologists and oncology professional societies are uniquely positioned to provide informed clinical and methodological expertise to steer the appropriate application of CER toward critical discussions related to health care costs, cost-effectiveness, and the comparative value of the available options for appropriate care of patients with cancer. PMID:23697601

Cochrane Qualitative and Implementation Methods Group guidance series-paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings.

PubMed

Noyes, Jane; Booth, Andrew; Flemming, Kate; Garside, Ruth; Harden, Angela; Lewin, Simon; Pantoja, Tomas; Hannes, Karin; Cargo, Margaret; Thomas, James

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method implementation evidence. Choice of appropriate methodologies, methods, and tools is essential when developing a rigorous protocol and conducting the synthesis. Cochrane authors who conduct qualitative evidence syntheses have thus far used a small number of relatively simple methods to address similarly written questions. Cochrane has invested in methodological work to develop new tools and to encourage the production of exemplar reviews to show the value of more innovative methods that address a wider range of questions. In this paper, in the series, we report updated guidance on the selection of tools to assess methodological limitations in qualitative studies and methods to extract and synthesize qualitative evidence. We recommend application of Grades of Recommendation, Assessment, Development, and Evaluation-Confidence in the Evidence from Qualitative Reviews to assess confidence in qualitative synthesized findings. This guidance aims to support review authors to undertake a qualitative evidence synthesis that is intended to be integrated subsequently with the findings of one or more Cochrane reviews of the effects of similar interventions. The review of intervention effects may be undertaken concurrently with or separate to the qualitative evidence synthesis. We encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

X-Phi and Carnapian Explication.

PubMed

Shepherd, Joshua; Justus, James

2015-04-01

The rise of experimental philosophy (x-phi) has placed metaphilosophical questions, particularly those concerning concepts, at the center of philosophical attention. X-phi offers empirically rigorous methods for identifying conceptual content, but what exactly it contributes towards evaluating conceptual content remains unclear. We show how x-phi complements Rudolf Carnap's underappreciated methodology for concept determination, explication. This clarifies and extends x-phi's positive philosophical import, and also exhibits explication's broad appeal. But there is a potential problem: Carnap's account of explication was limited to empirical and logical concepts, but many concepts of interest to philosophers (experimental and otherwise) are essentially normative. With formal epistemology as a case study, we show how x-phi assisted explication can apply to normative domains.

A technical guide to tDCS, and related non-invasive brain stimulation tools

PubMed Central

Woods, AJ; Antal, A; Bikson, M; Boggio, PS; Brunoni, AR; Celnik, P; Cohen, LG; Fregni, F; Herrmann, CS; Kappenman, ES; Knotkova, H; Liebetanz, D; Miniussi, C; Miranda, PC; Paulus, W; Priori, A; Reato, D; Stagg, C; Wenderoth, N; Nitsche, MA

2015-01-01

Transcranial electrical stimulation (tES), including transcranial direct and alternating current stimulation (tDCS, tACS) are non-invasive brain stimulation techniques increasingly used for modulation of central nervous system excitability in humans. Here we address methodological issues required for tES application. This review covers technical aspects of tES, as well as applications like exploration of brain physiology, modelling approaches, tES in cognitive neurosciences, and interventional approaches. It aims to help the reader to appropriately design and conduct studies involving these brain stimulation techniques, understand limitations and avoid shortcomings, which might hamper the scientific rigor and potential applications in the clinical domain. PMID:26652115

Analyzing qualitative data with computer software.

PubMed Central

Weitzman, E A

1999-01-01

OBJECTIVE: To provide health services researchers with an overview of the qualitative data analysis process and the role of software within it; to provide a principled approach to choosing among software packages to support qualitative data analysis; to alert researchers to the potential benefits and limitations of such software; and to provide an overview of the developments to be expected in the field in the near future. DATA SOURCES, STUDY DESIGN, METHODS: This article does not include reports of empirical research. CONCLUSIONS: Software for qualitative data analysis can benefit the researcher in terms of speed, consistency, rigor, and access to analytic methods not available by hand. Software, however, is not a replacement for methodological training. PMID:10591282

Second Chances: Investigating Athletes’ Experiences of Talent Transfer

PubMed Central

2015-01-01

Talent transfer initiatives seek to transfer talented, mature individuals from one sport to another. Unfortunately talent transfer initiatives seem to lack an evidence-based direction and a rigorous exploration of the mechanisms underpinning the approach. The purpose of this exploratory study was to identify the factors which successfully transferring athletes cite as facilitative of talent transfer. In contrast to the anthropometric and performance variables that underpin current talent transfer initiatives, participants identified a range of psycho-behavioral and environmental factors as key to successful transfer. We argue that further research into the mechanisms of talent transfer is needed in order to provide a strong evidence base for the methodologies employed in these initiatives. PMID:26600303

Second Chances: Investigating Athletes' Experiences of Talent Transfer.

PubMed

MacNamara, Áine; Collins, Dave

2015-01-01

Talent transfer initiatives seek to transfer talented, mature individuals from one sport to another. Unfortunately talent transfer initiatives seem to lack an evidence-based direction and a rigorous exploration of the mechanisms underpinning the approach. The purpose of this exploratory study was to identify the factors which successfully transferring athletes cite as facilitative of talent transfer. In contrast to the anthropometric and performance variables that underpin current talent transfer initiatives, participants identified a range of psycho-behavioral and environmental factors as key to successful transfer. We argue that further research into the mechanisms of talent transfer is needed in order to provide a strong evidence base for the methodologies employed in these initiatives.

A Qualitative Assessment of the Content Validity of the ICECAP-A and EQ-5D-5L and Their Appropriateness for Use in Health Research

PubMed Central

Keeley, Thomas; Al-Janabi, Hareth; Lorgelly, Paula; Coast, Joanna

2013-01-01

Purpose The ICECAP-A and EQ-5D-5L are two index measures appropriate for use in health research. Assessment of content validity allows understanding of whether a measure captures the most relevant and important aspects of a concept. This paper reports a qualitative assessment of the content validity and appropriateness for use of the eq-5D-5L and ICECAP-A measures, using novel methodology. Methods In-depth semi-structured interviews were conducted with research professionals in the UK and Australia. Informants were purposively sampled based on their professional role. Data were analysed in an iterative, thematic and constant comparative manner. A two stage investigation - the comparative direct approach - was developed to address the methodological challenges of the content validity research and allow rigorous assessment. Results Informants viewed the ICECAP-A as an assessment of the broader determinants of quality of life, but lacking in assessment of health-related determinants. The eq-5D-5L was viewed as offering good coverage of health determinants, but as lacking in assessment of these broader determinants. Informants held some concerns about the content or wording of the Self-care, Pain/Discomfort and Anxiety/Depression items (EQ-5D-5L) and the Enjoyment, Achievement and attachment items (ICECAP-A). Conclusion Using rigorous qualitative methodology the results suggest that the ICECAP-A and EQ-5D-5L hold acceptable levels of content validity and are appropriate for use in health research. This work adds expert opinion to the emerging body of research using patients and public to validate these measures. PMID:24367708

Do behavioral scientists really understand HIV-related sexual risk behavior? A systematic review of longitudinal and experimental studies predicting sexual behavior.

PubMed

Huebner, David M; Perry, Nicholas S

2015-10-01

Behavioral interventions to reduce sexual risk behavior depend on strong health behavior theory. By identifying the psychosocial variables that lead causally to sexual risk, theories provide interventionists with a guide for how to change behavior. However, empirical research is critical to determining whether a particular theory adequately explains sexual risk behavior. A large body of cross-sectional evidence, which has been reviewed elsewhere, supports the notion that certain theory-based constructs (e.g., self-efficacy) are correlates of sexual behavior. However, given the limitations of inferring causality from correlational research, it is essential that we review the evidence from more methodologically rigorous studies (i.e., longitudinal and experimental designs). This systematic review identified 44 longitudinal studies in which investigators attempted to predict sexual risk from psychosocial variables over time. We also found 134 experimental studies (i.e., randomized controlled trials of HIV interventions), but of these only 9 (6.7 %) report the results of mediation analyses that might provide evidence for the validity of health behavior theories in predicting sexual behavior. Results show little convergent support across both types of studies for most traditional, theoretical predictors of sexual behavior. This suggests that the field must expand the body of empirical work that utilizes the most rigorous study designs to test our theoretical assumptions. The inconsistent results of existing research would indicate that current theoretical models of sexual risk behavior are inadequate, and may require expansion or adaptation.

Design Evolution and Methodology for Pumpkin Super-Pressure Balloons

NASA Astrophysics Data System (ADS)

Farley, Rodger

The NASA Ultra Long Duration Balloon (ULDB) program has had many technical development issues discovered and solved along its road to success as a new vehicle. It has the promise of being a sub-satellite, a means to launch up to 2700 kg to 33.5 km altitude for 100 days from a comfortable mid-latitude launch point. Current high-lift long duration ballooning is accomplished out of Antarctica with zero-pressure balloons, which cannot cope with the rigors of diurnal cycles. The ULDB design is still evolving, the product of intense analytical effort, scaled testing, improved manufacturing, and engineering intuition. The past technical problems, in particular the s-cleft deformation, their solutions, future challenges, and the methodology of pumpkin balloon design will generally be described.

Formal specification and mechanical verification of SIFT - A fault-tolerant flight control system

NASA Technical Reports Server (NTRS)

Melliar-Smith, P. M.; Schwartz, R. L.

1982-01-01

The paper describes the methodology being employed to demonstrate rigorously that the SIFT (software-implemented fault-tolerant) computer meets its requirements. The methodology uses a hierarchy of design specifications, expressed in the mathematical domain of multisorted first-order predicate calculus. The most abstract of these, from which almost all details of mechanization have been removed, represents the requirements on the system for reliability and intended functionality. Successive specifications in the hierarchy add design and implementation detail until the PASCAL programs implementing the SIFT executive are reached. A formal proof that a SIFT system in a 'safe' state operates correctly despite the presence of arbitrary faults has been completed all the way from the most abstract specifications to the PASCAL program.

Reflections on the added value of using mixed methods in the SCAPE study.

PubMed

Murphy, Kathy; Casey, Dympna; Devane, Declan; Meskell, Pauline; Higgins, Agnes; Elliot, Naomi; Lalor, Joan; Begley, Cecily

2014-03-01

To reflect on the added value that a mixed method design gave in a large national evaluation study of specialist and advanced practice (SCAPE), and to propose a reporting guide that could help make explicit the added value of mixed methods in other studies. Recently, researchers have focused on how to carry out mixed methods research (MMR) rigorously. The value-added claims for MMR include the capacity to exploit the strengths and compensate for weakness inherent in single designs, generate comprehensive description of phenomena, produce more convincing results for funders or policy-makers and build methodological expertise. Data illustrating value added claims were drawn from the SCAPE study. Studies about the purpose of mixed methods were identified from a search of literature. The authors explain why and how they undertook components of the study, and propose a guideline to facilitate such studies. If MMR is to become the third methodological paradigm, then articulation of what extra benefit MMR adds to a study is essential. The authors conclude that MMR has added value and found the guideline useful as a way of making value claims explicit. The clear articulation of the procedural aspects of mixed-methods research, and identification of a guideline to facilitate such research, will enable researchers to learn more effectively from each other.

Systematic design of membership functions for fuzzy-logic control: A case study on one-stage partial nitritation/anammox treatment systems.

PubMed

Boiocchi, Riccardo; Gernaey, Krist V; Sin, Gürkan

2016-10-01

A methodology is developed to systematically design the membership functions of fuzzy-logic controllers for multivariable systems. The methodology consists of a systematic derivation of the critical points of the membership functions as a function of predefined control objectives. Several constrained optimization problems corresponding to different qualitative operation states of the system are defined and solved to identify, in a consistent manner, the critical points of the membership functions for the input variables. The consistently identified critical points, together with the linguistic rules, determine the long term reachability of the control objectives by the fuzzy logic controller. The methodology is highlighted using a single-stage side-stream partial nitritation/Anammox reactor as a case study. As a result, a new fuzzy-logic controller for high and stable total nitrogen removal efficiency is designed. Rigorous simulations are carried out to evaluate and benchmark the performance of the controller. The results demonstrate that the novel control strategy is capable of rejecting the long-term influent disturbances, and can achieve a stable and high TN removal efficiency. Additionally, the controller was tested, and showed robustness, against measurement noise levels typical for wastewater sensors. A feedforward-feedback configuration using the present controller would give even better performance. In comparison, a previously developed fuzzy-logic controller using merely expert and intuitive knowledge performed worse. This proved the importance of using a systematic methodology for the derivation of the membership functions for multivariable systems. These results are promising for future applications of the controller in real full-scale plants. Furthermore, the methodology can be used as a tool to help systematically design fuzzy logic control applications for other biological processes. Copyright © 2016 Elsevier Ltd. All rights reserved.

Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review.

PubMed

Jünger, Saskia; Payne, Sheila A; Brine, Jenny; Radbruch, Lukas; Brearley, Sarah G

2017-09-01

The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care. To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care. A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE. Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting. A total of 30 empirical studies (1997-2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a 'round' or a 'modified Delphi study'. Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.

A systematic review of early prognostic factors for persistent pain following acute orthopedic trauma

PubMed Central

Clay, Fiona J; Watson, Wendy L; Newstead, Stuart V; McClure, Roderick J

2012-01-01

BACKGROUND: Acute orthopedic trauma contributes substantially to the global burden of disease. OBJECTIVES: The present systematic review aimed to summarize the current knowledge concerning prognostic factors for the presence of persistent pain, pain severity and pain-related disability following acute orthopedic trauma involving a spectrum of pathologies to working-age adults. METHODS: The Ovid MEDLINE and EMBASE databases were searched for level II prognostic studies published between January 1996 and October 2010. Studies that were longitudinal and reported results with multivariate analyses appropriate for prognostic studies were included. Studies that addressed two specific injury types that have been the subject of previous reviews, namely, injuries to the spinal column and amputations, were excluded. RESULTS: The searches yielded 992 studies; 10 studies met the inclusion criteria and were rated for methodological quality. Seventeen factors were considered in more than one cohort. There was strong evidence supporting the association of female sex, older age, high pain intensity, preinjury anxiety or depression, and fewer years of education with persistent pain outcomes. There was moderate evidence supporting the association between postinjury depression or anxiety with persistent pain, and that injury severity was not a risk factor for ongoing pain. CONCLUSION: Many individuals experience persistent pain following acute trauma. Due to the lack of studies, the use of different constructs to measure the same factor and the methodological limitations associated with many of the studies, the present review was only able to reliably identify a limited set of factors that predicted persistent pain. Recommendations for the conduct of future methodologically rigorous studies of persistent pain are provided. PMID:22518366

Effect of Pre-rigor Salting Levels on Physicochemical and Textural Properties of Chicken Breast Muscles.

PubMed

Kim, Hyun-Wook; Hwang, Ko-Eun; Song, Dong-Heon; Kim, Yong-Jae; Ham, Youn-Kyung; Yeo, Eui-Joo; Jeong, Tae-Jun; Choi, Yun-Sang; Kim, Cheon-Jei

2015-01-01

This study was conducted to evaluate the effect of pre-rigor salting level (0-4% NaCl concentration) on physicochemical and textural properties of pre-rigor chicken breast muscles. The pre-rigor chicken breast muscles were de-boned 10 min post-mortem and salted within 25 min post-mortem. An increase in pre-rigor salting level led to the formation of high ultimate pH of chicken breast muscles at post-mortem 24 h. The addition of minimum of 2% NaCl significantly improved water holding capacity, cooking loss, protein solubility, and hardness when compared to the non-salting chicken breast muscle (p<0.05). On the other hand, the increase in pre-rigor salting level caused the inhibition of myofibrillar protein degradation and the acceleration of lipid oxidation. However, the difference in NaCl concentration between 3% and 4% had no great differences in the results of physicochemical and textural properties due to pre-rigor salting effects (p>0.05). Therefore, our study certified the pre-rigor salting effect of chicken breast muscle salted with 2% NaCl when compared to post-rigor muscle salted with equal NaCl concentration, and suggests that the 2% NaCl concentration is minimally required to ensure the definite pre-rigor salting effect on chicken breast muscle.

Effect of Pre-rigor Salting Levels on Physicochemical and Textural Properties of Chicken Breast Muscles

PubMed Central

Choi, Yun-Sang

2015-01-01

This study was conducted to evaluate the effect of pre-rigor salting level (0-4% NaCl concentration) on physicochemical and textural properties of pre-rigor chicken breast muscles. The pre-rigor chicken breast muscles were de-boned 10 min post-mortem and salted within 25 min post-mortem. An increase in pre-rigor salting level led to the formation of high ultimate pH of chicken breast muscles at post-mortem 24 h. The addition of minimum of 2% NaCl significantly improved water holding capacity, cooking loss, protein solubility, and hardness when compared to the non-salting chicken breast muscle (p<0.05). On the other hand, the increase in pre-rigor salting level caused the inhibition of myofibrillar protein degradation and the acceleration of lipid oxidation. However, the difference in NaCl concentration between 3% and 4% had no great differences in the results of physicochemical and textural properties due to pre-rigor salting effects (p>0.05). Therefore, our study certified the pre-rigor salting effect of chicken breast muscle salted with 2% NaCl when compared to post-rigor muscle salted with equal NaCl concentration, and suggests that the 2% NaCl concentration is minimally required to ensure the definite pre-rigor salting effect on chicken breast muscle. PMID:26761884

Classroom Talk for Rigorous Reading Comprehension Instruction

ERIC Educational Resources Information Center

Wolf, Mikyung Kim; Crosson, Amy C.; Resnick, Lauren B.

2004-01-01

This study examined the quality of classroom talk and its relation to academic rigor in reading-comprehension lessons. Additionally, the study aimed to characterize effective questions to support rigorous reading comprehension lessons. The data for this study included 21 reading-comprehension lessons in several elementary and middle schools from…

Lower-Secondary Introductory Chemistry Course: A Novel Approach Based on Science-Education Theories, with Emphasis on the Macroscopic Approach, and the Delayed Meaningful Teaching of the Concepts of Molecule and Atom

ERIC Educational Resources Information Center

Tsaparlis, Georgios; Kolioulis, Dimitrios; Pappa, Eleni

2010-01-01

We present a programme for a novel introductory lower-secondary chemistry course (seventh or eighth grade) that aims at the application of theories of science education, and in particular of conceptual/meaningful learning and of teaching methodology that encourages active and inquiry forms of learning The approach is rigorous with careful use of…

Methodology for estimation of total body composition in laboratory mammals

NASA Technical Reports Server (NTRS)

Pace, N.; Rahlmann, D. F.; Smith, A. H.

1979-01-01

A standardized dissection and chemical analysis procedure was developed for individual animals of several species in the size range mouse to monkey (15 g to 15 kg). The standardized procedure permits rigorous comparisons to be made both interspecifically and intraspecifically of organ weights and gross chemical composition in mammalian species series, and was applied successfully to laboratory mice, hamsters, rats, guinea pigs, and rabbits, as well as to macaque monkeys. The procedure is described in detail.

Examining the Statistical Rigor of Test and Evaluation Results in the Live, Virtual and Constructive Environment

DTIC Science & Technology

2011-06-01

Committee Meeting. 23 June 2008. Bjorkman, Eileen A. and Frank B. Gray . “Testing in a Joint Environment 2004-2008: Findings, Conclusions and...the LVC joint test environment to evaluate system performance and joint mission effectiveness (Bjorkman and Gray 2009a). The LVC battlespace...attack (Bjorkman and Gray 2009b). Figure 3 - JTEM Methodology (Bjorkman 2008) A key INTEGRAL FIRE lesson learned was realizing the need for each

A novel methodology for litho-to-etch pattern fidelity correction for SADP process

NASA Astrophysics Data System (ADS)

Chen, Shr-Jia; Chang, Yu-Cheng; Lin, Arthur; Chang, Yi-Shiang; Lin, Chia-Chi; Lai, Jun-Cheng

2017-03-01

For 2x nm node semiconductor devices and beyond, more aggressive resolution enhancement techniques (RETs) such as source-mask co-optimization (SMO), litho-etch-litho-etch (LELE) and self-aligned double patterning (SADP) are utilized for the low k1 factor lithography processes. In the SADP process, the pattern fidelity is extremely critical since a slight photoresist (PR) top-loss or profile roughness may impact the later core trim process, due to its sensitivity to environment. During the subsequent sidewall formation and core removal processes, the core trim profile weakness may worsen and induces serious defects that affect the final electrical performance. To predict PR top-loss, a rigorous lithography simulation can provide a reference to modify mask layouts; but it takes a much longer run time and is not capable of full-field mask data preparation. In this paper, we first brought out an algorithm which utilizes multi-intensity levels from conventional aerial image simulation to assess the physical profile through lithography to core trim etching steps. Subsequently, a novel correction method was utilized to improve the post-etch pattern fidelity without the litho. process window suffering. The results not only matched PR top-loss in rigorous lithography simulation, but also agreed with post-etch wafer data. Furthermore, this methodology can also be incorporated with OPC and post-OPC verification to improve core trim profile and final pattern fidelity at an early stage.

Trends in Mediation Analysis in Nursing Research: Improving Current Practice.

PubMed

Hertzog, Melody

2018-06-01

The purpose of this study was to describe common approaches used by nursing researchers to test mediation models and evaluate them within the context of current methodological advances. MEDLINE was used to locate studies testing a mediation model and published from 2004 to 2015 in nursing journals. Design (experimental/correlation, cross-sectional/longitudinal, model complexity) and analysis (method, inclusion of test of mediated effect, violations/discussion of assumptions, sample size/power) characteristics were coded for 456 studies. General trends were identified using descriptive statistics. Consistent with findings of reviews in other disciplines, evidence was found that nursing researchers may not be aware of the strong assumptions and serious limitations of their analyses. Suggestions for strengthening the rigor of such studies and an overview of current methods for testing more complex models, including longitudinal mediation processes, are presented.

Methodological tools for the collection and analysis of participant observation data using grounded theory.

PubMed

Laitinen, Heleena; Kaunonen, Marja; Astedt-Kurki, Päivi

2014-11-01

To give clarity to the analysis of participant observation in nursing when implementing the grounded theory method. Participant observation (PO) is a method of collecting data that reveals the reality of daily life in a specific context. In grounded theory, interviews are the primary method of collecting data but PO gives a distinctive insight, revealing what people are really doing, instead of what they say they are doing. However, more focus is needed on the analysis of PO. An observational study carried out to gain awareness of nursing care and its electronic documentation in four acute care wards in hospitals in Finland. Discussion of using the grounded theory method and PO as a data collection tool. The following methodological tools are discussed: an observational protocol, jotting of notes, microanalysis, the use of questioning, constant comparison, and writing and illustrating. Each tool has specific significance in collecting and analysing data, working in constant interaction. Grounded theory and participant observation supplied rich data and revealed the complexity of the daily reality of acute care. In this study, the methodological tools provided a base for the study at the research sites and outside. The process as a whole was challenging. It was time-consuming and it required rigorous and simultaneous data collection and analysis, including reflective writing. Using these methodological tools helped the researcher stay focused from data collection and analysis to building theory. Using PO as a data collection method in qualitative nursing research provides insights. It is not commonly discussed in nursing research and therefore this study can provide insight, which cannot be seen or revealed by using other data collection methods. Therefore, this paper can produce a useful tool for those who intend to use PO and grounded theory in their nursing research.

Use of evidence-based practice in an aid organisation: a proposal to deal with the variety in terminology and methodology.

PubMed

De Buck, Emmy; Pauwels, Nele S; Dieltjens, Tessa; Vandekerckhove, Philippe

2014-03-01

As part of its strategy Belgian Red Cross-Flanders underpins all its activities with evidence-based guidelines and systematic reviews. The aim of this publication is to describe in detail the methodology used to achieve this goal within an action-oriented organisation, in a timely and cost-effective way. To demonstrate transparency in our methods, we wrote a methodological charter describing the way in which we develop evidence-based materials to support our activities. Criteria were drawn up for deciding on project priority and the choice of different types of projects (scoping reviews, systematic reviews and evidence-based guidelines). While searching for rigorous and realistically attainable methodological standards, we encountered a wide variety in terminology and methodology used in the field of evidence-based practice. Terminologies currently being used by different organisations and institutions include systematic reviews, systematic literature searches, evidence-based guidelines, rapid reviews, pragmatic systematic reviews, and rapid response service. It is not always clear what the definition and methodology is behind these terms and whether they are used consistently. We therefore describe the terminology and methodology used by Belgian Red Cross-Flanders; criteria for making methodological choices and details on the methodology we use are given. In our search for an appropriate methodology, taking into account time and resource constraints, we encountered an enormous variety of methodological approaches and terminology used for evidence-based materials. In light of this, we recommend that authors of evidence-based guidelines and reviews are transparent and clear about the methodology used. To be transparent about our approach, we developed a methodological charter. This charter may inspire other organisations that want to use evidence-based methodology to support their activities.

A narrative review of studies of refusal of psychotropic medication in acute inpatient psychiatric care.

PubMed

Owiti, J A; Bowers, L

2011-09-01

This paper offers a narrative review of the 22 studies of medication refusal in acute psychiatry. Because of varied definitions of medication refusal, diverse methodologies and few rigorous studies, it has not been possible to draw firm conclusions on the average rate of refusal of psychotropic medications in acute psychiatry. However, it is clear that medication refusal is common and leads to poor outcomes characterized by higher rates of seclusion, restraint, threats of, and actual, assaults and longer hospitalizations. There are no statistically significant differences between refusers and acceptors in gender, marital status and preadmission living arrangements. Although no firm conclusions on the influence of ethnicity, status at admission and diagnosis on refusal, the refusers are more likely to have higher number of previous hospitalizations and history of prior refusal. The review indicates that staff factors such as the use of temporary staff, lack of confidence in ward staff and ineffective ward structure are associated with higher rates of medication refusal. Comprehensive knowledge of why, and how, patients refuse medication is lacking. Research on medication refusal is still fragmented, of variable methodological quality and lacks an integrating model. © 2011 Blackwell Publishing.

EVA Health and Human Performance Benchmarking Study

NASA Technical Reports Server (NTRS)

Abercromby, A. F.; Norcross, J.; Jarvis, S. L.

2016-01-01

Multiple HRP Risks and Gaps require detailed characterization of human health and performance during exploration extravehicular activity (EVA) tasks; however, a rigorous and comprehensive methodology for characterizing and comparing the health and human performance implications of current and future EVA spacesuit designs does not exist. This study will identify and implement functional tasks and metrics, both objective and subjective, that are relevant to health and human performance, such as metabolic expenditure, suit fit, discomfort, suited postural stability, cognitive performance, and potentially biochemical responses for humans working inside different EVA suits doing functional tasks under the appropriate simulated reduced gravity environments. This study will provide health and human performance benchmark data for humans working in current EVA suits (EMU, Mark III, and Z2) as well as shirtsleeves using a standard set of tasks and metrics with quantified reliability. Results and methodologies developed during this test will provide benchmark data against which future EVA suits, and different suit configurations (eg, varied pressure, mass, CG) may be reliably compared in subsequent tests. Results will also inform fitness for duty standards as well as design requirements and operations concepts for future EVA suits and other exploration systems.

Perspective: Randomized Controlled Trials Are Not a Panacea for Diet-Related Research12

PubMed Central

Hébert, James R; Frongillo, Edward A; Adams, Swann A; Turner-McGrievy, Gabrielle M; Hurley, Thomas G; Miller, Donald R; Ockene, Ira S

2016-01-01

Research into the role of diet in health faces a number of methodologic challenges in the choice of study design, measurement methods, and analytic options. Heavier reliance on randomized controlled trial (RCT) designs is suggested as a way to solve these challenges. We present and discuss 7 inherent and practical considerations with special relevance to RCTs designed to study diet: 1) the need for narrow focus; 2) the choice of subjects and exposures; 3) blinding of the intervention; 4) perceived asymmetry of treatment in relation to need; 5) temporal relations between dietary exposures and putative outcomes; 6) strict adherence to the intervention protocol, despite potential clinical counter-indications; and 7) the need to maintain methodologic rigor, including measuring diet carefully and frequently. Alternatives, including observational studies and adaptive intervention designs, are presented and discussed. Given high noise-to-signal ratios interjected by using inaccurate assessment methods in studies with weak or inappropriate study designs (including RCTs), it is conceivable and indeed likely that effects of diet are underestimated. No matter which designs are used, studies will require continued improvement in the assessment of dietary intake. As technology continues to improve, there is potential for enhanced accuracy and reduced user burden of dietary assessments that are applicable to a wide variety of study designs, including RCTs. PMID:27184269

Stress and anxiety among nursing students: A review of intervention strategies in literature between 2009 and 2015.

PubMed

Turner, Katrina; McCarthy, Valerie Lander

2017-01-01

Undergraduate nursing students experience significant stress and anxiety, inhibiting learning and increasing attrition. Twenty-six intervention studies were identified and evaluated, updating a previous systematic review which categorized interventions targeting: (1) stressors, (2) coping, or (3) appraisal. The majority of interventions in this review aimed to reduce numbers or intensity of stressors through curriculum development (12) or to improve students' coping skills (8). Two studies reported interventions using only cognitive reappraisal while three interventions combined reappraisal with other approaches. Strength of evidence was limited by choice of study design, sample size, and lack of methodological rigor. Some statistically significant support was found for interventions focused on reducing stressors through curriculum development or improving students' coping skills. No statistically significant studies using reappraisal, either alone or in combination with other approaches, were identified, although qualitative findings suggested the potential benefits of this approach do merit further study. Progress was noted since 2008 in the increased number of studies and greater use of validated outcome measures but the review concluded further methodologically sound, adequately powered studies, especially randomized controlled trials, are needed to determine which interventions are effective to address the issue of excessive stress and anxiety among undergraduate nursing students. Copyright © 2016 Elsevier Ltd. All rights reserved.

Quality of life and related concepts in Parkinson's disease: a systematic review.

PubMed

Den Oudsten, Brenda L; Van Heck, Guus L; De Vries, Jolanda

2007-08-15

Several studies have investigated the quality of life (QOL) of patients with Parkinson's disease (PD). The purpose of this study was to review the conceptual and methodological quality of quality of life (QOL) studies among patients with PD and to identify factors associated with poor (HR)QOL. Computerized bibliographic databases were screened for publications from 1960 to January 2007. According to a list of predefined criteria, the methodological quality of the 61 studies, was moderate. The term 'QOL' was often used inappropriately. In fact, almost all studies in this review actually assessed health status (HS) instead of QOL. The functioning of patients with PD on physical, social, and emotional domains is affected by PD. Their HS seems to be lower when compared to healthy persons or patients with other chronic diseases. HS studies augment the insight in self-perceived functioning. Therefore, HS is conceived as a valuable construct. However, QOL is also an important factor in health care. Attention towards QOL is needed in order to draw valid conclusions regarding a person's subjective experience of well-being in a broad sense. In order to accomplish this, future studies should apply the QOL concept with more rigor, should use an adequate operational definition, and should employ sound measures. Copyright (c) 2007 Movement Disorder Society.

34 CFR 691.16 - Rigorous secondary school program of study.

Code of Federal Regulations, 2011 CFR

2011-07-01

...: biology, chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than... 34 Education 4 2011-07-01 2011-07-01 false Rigorous secondary school program of study. 691.16... Procedures § 691.16 Rigorous secondary school program of study. (a)(1) For each award year commencing with...

34 CFR 691.16 - Rigorous secondary school program of study.

Code of Federal Regulations, 2013 CFR

2013-07-01

...: biology, chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than... 34 Education 4 2013-07-01 2013-07-01 false Rigorous secondary school program of study. 691.16... Procedures § 691.16 Rigorous secondary school program of study. (a)(1) For each award year commencing with...

34 CFR 691.16 - Rigorous secondary school program of study.

Code of Federal Regulations, 2014 CFR

2014-07-01

...: biology, chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than... 34 Education 4 2014-07-01 2014-07-01 false Rigorous secondary school program of study. 691.16... Procedures § 691.16 Rigorous secondary school program of study. (a)(1) For each award year commencing with...

34 CFR 691.16 - Rigorous secondary school program of study.

Code of Federal Regulations, 2012 CFR

2012-07-01

...: biology, chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than... 34 Education 4 2012-07-01 2012-07-01 false Rigorous secondary school program of study. 691.16... Procedures § 691.16 Rigorous secondary school program of study. (a)(1) For each award year commencing with...

"Rigor for What?" Social Studies Teacher Conceptions and Enactments of Instructional Rigor

ERIC Educational Resources Information Center

Gibbs, Brian

2017-01-01

Taken from a larger qualitative study, this article argues that rather than an encompassing uniform definition, rigor, as understood and enacted by social studies teachers, exists on a complicated spectrum. Teacher placement on this spectrum was influenced by teacher life experience, teacher interpretation of student need, pedagogy employed, how…

Systematic Review of Knowledge Translation Strategies to Promote Research Uptake in Child Health Settings.

PubMed

Albrecht, Lauren; Archibald, Mandy; Snelgrove-Clarke, Erna; Scott, Shannon D

2016-01-01

Strategies to assist evidence-based decision-making for healthcare professionals are crucial to ensure high quality patient care and outcomes. The goal of this systematic review was to identify and synthesize the evidence on knowledge translation interventions aimed at putting explicit research evidence into child health practice. A comprehensive search of thirteen electronic databases was conducted, restricted by date (1985-2011) and language (English). Articles were included if: 1) studies were randomized controlled trials (RCT), controlled clinical trials (CCT), or controlled before-and-after (CBA) studies; 2) target population was child health professionals; 3) interventions implemented research in child health practice; and 4) outcomes were measured at the professional/process, patient, or economic level. Two reviewers independently extracted data and assessed methodological quality. Study data were aggregated and analyzed using evidence tables. Twenty-one studies (13 RCT, 2 CCT, 6 CBA) were included. The studies employed single (n=9) and multiple interventions (n=12). The methodological quality of the included studies was largely moderate (n=8) or weak (n=11). Of the studies with moderate to strong methodological quality ratings, three demonstrated consistent, positive effect(s) on the primary outcome(s); effective knowledge translation interventions were two single, non-educational interventions and one multiple, educational intervention. This multidisciplinary systematic review in child health setting identified effective knowledge translation strategies assessed by the most rigorous research designs. Given the overall poor quality of the research literature, specific recommendations were made to improve knowledge translation efforts in child health. Copyright © 2016 Elsevier Inc. All rights reserved.

Critical appraisal of questionnaires to assess functional impairment in individuals with mild cognitive impairment.

PubMed

Kaur, Navaldeep; Belchior, Patricia; Gelinas, Isabelle; Bier, Nathalie

2016-09-01

Mild deficits in instrumental activities of daily living (IADLs) have consistently been reported in the individuals with mild cognitive impairment (MCI). A variety of functional assessment tools, including self-and informant report questionnaires and performance-based measures, have been employed in MCI. Previously, a limited focus has been directed at appraising the quality of questionnaires. The goal of this study was to identify the questionnaires that have been validated in the MCI population. Additionally, the quality of validation studies and psychometric attributes of these questionnaires were appraised. Relevant articles were systematically searched in PsychINFO, Ovid MEDLINE, and CINAHL against specific eligibility criteria. To evaluate the methodology of the psychometric studies, the COSMIN checklist was employed. Also, the psychometric properties of the assessment tools were evaluated based upon Terwee's criteria. A total of five psychometric studies and questionnaires were critically evaluated. Varying psychometric properties were available for the chosen tools. None of the studies received the best possible rating for their methodological quality. It was found that questionnaires with high discriminative ability to distinguish MCI from other diagnostic groups were: Disability Assessment in Dementia-6 (DAD-6), Functional Activity Questionnaire (FAQ), and Alzheimer's Disease Cooperative Study/Activities of Daily Living scale adapted for MCI patients (ADCS-MCI-ADL-24). Psychometric studies with strong methodological rigor are required in the future. Considering the fact that IADL decline has been associated with dementia, early detection of functional difficulties in MCI needs to be encouraged as it will allow suitable and timely interventions to prolong functional independence of affected individuals.

[Risk scores for the development of venous thromboembolism in ambulatory patients and in patients hospitalized for acute medical disease].

PubMed

Junod, A

2015-10-28

The recognition of an increased risk of VTE following surgery has initiated a similar investigation in: 1) Ambulatory subjects. In this group, the Qthrombosis score has identified 8 to 11 risk factors. The incidence of VTE is of the order of 0,15%/year. 2) The patients admitted to hospital for an acute medical disease. Nine scores are available for analysis. Results are difficult to interpret because of confusing factors: the inclusion of symptomatic VTE only or both symptomatic and asymptomatic VTE; the uncontrolled prescription of thromboprophylaxis. VTE incidence over 3 months varies between 15 and 0,5%, but is around 1% in the most recent studies. New studies, with a more rigorous methodological approach, are needed.

Economic evaluation of medical tests at the early phases of development: a systematic review of empirical studies.

PubMed

Frempong, Samuel N; Sutton, Andrew J; Davenport, Clare; Barton, Pelham

2018-02-01

There is little specific guidance on the implementation of cost-effectiveness modelling at the early stage of test development. The aim of this study was to review the literature in this field to examine the methodologies and tools that have been employed to date. Areas Covered: A systematic review to identify relevant studies in established literature databases. Five studies were identified and included for narrative synthesis. These studies revealed that there is no consistent approach in this growing field. The perspective of patients and the potential for value of information (VOI) to provide information on the value of future research is often overlooked. Test accuracy is an essential consideration, with most studies having described and included all possible test results in their analysis, and conducted extensive sensitivity analyses on important parameters. Headroom analysis was considered in some instances but at the early development stage (not the concept stage). Expert commentary: The techniques available to modellers that can demonstrate the value of conducting further research and product development (i.e. VOI analysis, headroom analysis) should be better utilized. There is the need for concerted efforts to develop rigorous methodology in this growing field to maximize the value and quality of such analysis.

Substance Use and Recidivism Outcomes for Prison-Based Drug and Alcohol Interventions.

PubMed

de Andrade, Dominique; Ritchie, Jessica; Rowlands, Michael; Mann, Emily; Hides, Leanne

2018-05-04

We conducted a systematic review to examine the substance use and recidivism outcomes of prison-based substance use interventions. We searched public health, criminology, and psychology databases, and conducted forward and backward snowballing methods to identify additional studies. Studies were included if they were published between January 1, 2000 and June 30, 2017; were published in English; and reported substance use and/or recidivism outcomes of prison-based substance use interventions. Studies were reviewed for methodological rigor using the Effective Public Health Practice Project's Quality Assessment Tool for Quantitative Studies. Our search returned 49 studies: 6 were methodologically strong, 20 were moderate, and 23 were weak. Results suggest therapeutic communities are effective in reducing recidivism and, to a lesser extent substance use after release. There is also evidence to suggest that opioid maintenance treatment is effective in reducing the risk of drug use after release from prison for opioid users. Furthermore, care after release from prison appears to enhance treatment effects for both types of interventions. Results provide evidence that policymakers can use to make informed decisions on best-practice approaches when addressing prisoner substance dependence and improving long-term outcomes. This comprehensive review highlights the difficulties of conducting quality research in the prison setting and suggests innovative study design for future research.

Rigor or mortis: best practices for preclinical research in neuroscience.

PubMed

Steward, Oswald; Balice-Gordon, Rita

2014-11-05

Numerous recent reports document a lack of reproducibility of preclinical studies, raising concerns about potential lack of rigor. Examples of lack of rigor have been extensively documented and proposals for practices to improve rigor are appearing. Here, we discuss some of the details and implications of previously proposed best practices and consider some new ones, focusing on preclinical studies relevant to human neurological and psychiatric disorders. Copyright © 2014 Elsevier Inc. All rights reserved.

A Case Study to Explore Rigorous Teaching and Testing Practices to Narrow the Achievement Gap

ERIC Educational Resources Information Center

Isler, Tesha

2012-01-01

The problem examined in this study: Does the majority of teachers use rigorous teaching and testing practices? The purpose of this qualitative exploratory case study was to explore the classroom techniques of six effective teachers who use rigorous teaching and testing practices. The hypothesis for this study is that the examination of the…

Mixed methods in psychotherapy research: A review of method(ology) integration in psychotherapy science.

PubMed

Bartholomew, Theodore T; Lockard, Allison J

2018-06-13

Mixed methods can foster depth and breadth in psychological research. However, its use remains in development in psychotherapy research. Our purpose was to review the use of mixed methods in psychotherapy research. Thirty-one studies were identified via the PRISMA systematic review method. Using Creswell & Plano Clark's typologies to identify design characteristics, we assessed each study for rigor and how each used mixed methods. Key features of mixed methods designs and these common patterns were identified: (a) integration of clients' perceptions via mixing; (b) understanding group psychotherapy; (c) integrating methods with cases and small samples; (d) analyzing clinical data as qualitative data; and (e) exploring cultural identities in psychotherapy through mixed methods. The review is discussed with respect to the value of integrating multiple data in single studies to enhance psychotherapy research. © 2018 Wiley Periodicals, Inc.

Experimental evaluation of rigor mortis. V. Effect of various temperatures on the evolution of rigor mortis.

PubMed

Krompecher, T

1981-01-01

Objective measurements were carried out to study the evolution of rigor mortis on rats at various temperatures. Our experiments showed that: (1) at 6 degrees C rigor mortis reaches full development between 48 and 60 hours post mortem, and is resolved at 168 hours post mortem; (2) at 24 degrees C rigor mortis reaches full development at 5 hours post mortem, and is resolved at 16 hours post mortem; (3) at 37 degrees C rigor mortis reaches full development at 3 hours post mortem, and is resolved at 6 hours post mortem; (4) the intensity of rigor mortis grows with increase in temperature (difference between values obtained at 24 degrees C and 37 degrees C); and (5) and 6 degrees C a "cold rigidity" was found, in addition to and independent of rigor mortis.

Methodology for a vaginal and urinary microbiome study in women with mixed urinary incontinence.

PubMed

Komesu, Yuko M; Richter, Holly E; Dinwiddie, Darrell L; Siddiqui, Nazema Y; Sung, Vivian W; Lukacz, Emily S; Ridgeway, Beri; Arya, Lily A; Zyczynski, Halina M; Rogers, Rebecca G; Gantz, Marie

2017-05-01

We describe the rationale and methods of a study designed to compare vaginal and urinary microbiomes in women with mixed urinary incontinence (MUI) and similarly aged, asymptomatic controls. This paper delineates the methodology of a supplementary microbiome study nested in an ongoing randomized controlled trial comparing a standardized perioperative behavioral/pelvic floor exercise intervention plus midurethral sling versus midurethral sling alone for MUI. Women in the parent study had at least "moderate bother" from urgency and stress urinary incontinence symptoms (SUI) on validated questionnaire and confirmed MUI on bladder diary. Controls had no incontinence symptoms. All participants underwent vaginal and urine collection for DNA analysis and conventional urine culture. Standardized protocols were designed, and a central lab received samples for subsequent polymerase chain reaction (PCR) amplification and sequencing of the bacterial16S ribosomal RNA (rRNA) gene. The composition of bacterial communities will be determined by dual amplicon sequencing of variable regions 1-3 and 4-6 from vaginal and urine specimens to compare the microbiome of patients with controls. Sample-size estimates determined that 126 MUI and 84 control participants were sufficient to detect a 20 % difference in predominant urinary genera, with 80 % power and 0.05 significance level. Specimen collection commenced January 2015 and finished April 2016. DNA was extracted and stored for subsequent evaluation. Methods papers sharing information regarding development of genitourinary microbiome studies, particularly with control populations, are few. We describe the rigorous methodology developed for a novel urogenital microbiome study in women with MUI.

Metamethod study of qualitative psychotherapy research on clients' experiences: Review and recommendations.

PubMed

Levitt, Heidi M; Pomerville, Andrew; Surace, Francisco I; Grabowski, Lauren M

2017-11-01

A metamethod study is a qualitative meta-analysis focused upon the methods and procedures used in a given research domain. These studies are rare in psychological research. They permit both the documentation of the informal standards within a field of research and recommendations for future work in that area. This paper presents a metamethod analysis of a substantial body of qualitative research that focused on clients' experiences in psychotherapy (109 studies). This review examined the ways that methodological integrity has been established across qualitative research methods. It identified the numbers of participants recruited and the form of data collection used (e.g., semistructured interviews, diaries). As well, it examined the types of checks employed to increase methodological integrity, such as participant counts, saturation, reflexivity techniques, participant feedback, or consensus and auditing processes. Central findings indicated that the researchers quite flexibly integrated procedures associated with one method into studies using other methods in order to strengthen their rigor. It appeared normative to adjust procedures to advance methodological integrity. These findings encourage manuscript reviewers to assess the function of procedures within a study rather than to require researchers to adhere to the set of procedures associated with a method. In addition, when epistemological approaches were mentioned they were overwhelmingly constructivist in nature, despite the increasing use of procedures traditionally associated with objectivist perspectives. It is recommended that future researchers do more to explicitly describe the functions of their procedures so that they are coherently situated within the epistemological approaches in use. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Trends in Study Methods Used in Undergraduate Medical Education Research, 1969–2007

PubMed Central

Baernstein, Amy; Liss, Hillary K.; Carney, Patricia A.; Elmore, Joann G.

2011-01-01

Context Evidence-based medical education requires rigorous studies appraising educational efficacy. Objectives To assess trends over time in methods used to evaluate undergraduate medical education interventions and to identify whether participation of medical education departments or centers is associated with more rigorous methods. Data Sources The PubMed, Cochrane Controlled Trials Registry, Campbell Collaboration, and ERIC databases (January 1966–March 2007) were searched using terms equivalent to students, medical and education, medical crossed with all relevant study designs. Study Selection We selected publications in all languages from every fifth year, plus the most recent 12 months, that evaluated an educational intervention for undergraduate medical students. Four hundred seventy-two publications met criteria for review. Data Extraction Data were abstracted on number of participants; types of comparison groups; whether outcomes assessed were objective, subjective, and/or validated; timing of outcome assessments; funding; and participation of medical education departments and centers. Ten percent of publications were independently abstracted by 2 authors to assess validity of the data abstraction. Results The annual number of publications increased over time from 1 (1969–1970) to 147 (2006–2007). In the most recent year, there was a mean of 145 medical student participants; 9 (6%) recruited participants from multiple institutions; 80 (54%) used comparison groups; 37 (25%) used randomized control groups; 91 (62%) had objective outcomes; 23 (16%) had validated outcomes; 35 (24%) assessed an outcome more than 1 month later; 21 (14%) estimated statistical power; and 66 (45%) reported funding. In 2006–2007, medical education department or center participation, reported in 46 (31%) of the recent publications, was associated only with enrolling more medical student participants (P = .04); for all studies from 1969 to 2007, it was associated only with measuring an objective outcome (P = .048). Between 1969 and 2007, the percentage of publications reporting statistical power and funding increased; percentages did not change for other study features. Conclusions The annual number of published studies of undergraduate medical education interventions demonstrating methodological rigor has been increasing. However, considerable opportunities for improvement remain. PMID:17785648

Combining qualitative and quantitative research within mixed method research designs: a methodological review.

PubMed

Östlund, Ulrika; Kidd, Lisa; Wengström, Yvonne; Rowa-Dewar, Neneh

2011-03-01

It has been argued that mixed methods research can be useful in nursing and health science because of the complexity of the phenomena studied. However, the integration of qualitative and quantitative approaches continues to be one of much debate and there is a need for a rigorous framework for designing and interpreting mixed methods research. This paper explores the analytical approaches (i.e. parallel, concurrent or sequential) used in mixed methods studies within healthcare and exemplifies the use of triangulation as a methodological metaphor for drawing inferences from qualitative and quantitative findings originating from such analyses. This review of the literature used systematic principles in searching CINAHL, Medline and PsycINFO for healthcare research studies which employed a mixed methods approach and were published in the English language between January 1999 and September 2009. In total, 168 studies were included in the results. Most studies originated in the United States of America (USA), the United Kingdom (UK) and Canada. The analytic approach most widely used was parallel data analysis. A number of studies used sequential data analysis; far fewer studies employed concurrent data analysis. Very few of these studies clearly articulated the purpose for using a mixed methods design. The use of the methodological metaphor of triangulation on convergent, complementary, and divergent results from mixed methods studies is exemplified and an example of developing theory from such data is provided. A trend for conducting parallel data analysis on quantitative and qualitative data in mixed methods healthcare research has been identified in the studies included in this review. Using triangulation as a methodological metaphor can facilitate the integration of qualitative and quantitative findings, help researchers to clarify their theoretical propositions and the basis of their results. This can offer a better understanding of the links between theory and empirical findings, challenge theoretical assumptions and develop new theory. Copyright © 2010 Elsevier Ltd. All rights reserved.

Exploring Student Perceptions of Rigor Online: Toward a Definition of Rigorous Learning

ERIC Educational Resources Information Center

Duncan, Heather E.; Range, Bret; Hvidston, David

2013-01-01

Technological advances in the last decade have impacted delivery methods of university courses. More and more courses are offered in a variety of formats. While academic rigor is a term often used, its definition is less clear. This mixed-methods study explored graduate student conceptions of rigor in the online learning environment embedded…

Information interventions for recovery following vehicle-related trauma to persons of working age: a systematic review of the literature.

PubMed

Clay, Fiona J; Collie, Alex; McClure, Roderick J

2012-06-01

Given the burden associated with vehicle-related trauma, there is interest in time and cost effective methods of providing information to assist recovery. This systematic review aims to address the question: "Do targeted early information interventions improve outcomes following vehicle--related injuries for persons of working age?" Ovid Medline, EMBASE, PsychINFO and Cochrane databases were searched for studies published between 1990-April 2011. Included studies were randomized or pseudo--randomized controlled trials of information interventions delivered to working age persons following vehicle-related injuries. Two reviewers independently selected and appraised the studies. Sixteen publications (13 primary studies) met the inclusion criteria and were assessed for bias. Hetero-geneity in terms of the information interventions and measured outcomes was encountered. In 4 of the included studies, the intervention was positively associated with at least one outcome reported. Methodological issues limited the conclusions that could be drawn. Following vehicle-related trauma, people often experience difficulties in ongoing functioning. The current evidence neither supports nor fails to support the effectiveness of information interventions in promoting injury recovery. There is a need for larger more methodologically and conceptually rigorous randomized controlled trials that better consider the type and timing of the intervention.

Rigor in Agricultural Education Research Reporting: Implications for the Discipline

ERIC Educational Resources Information Center

Fuhrman, Nicholas E.; Ladewig, Howard

2008-01-01

Agricultural education has been criticized for publishing research lacking many of the rigorous qualities found in publications of other disciplines. A few agricultural education researchers have suggested strategies for improving the rigor with which agricultural education studies report on methods and findings. The purpose of this study was to…

The future of fMRI in cognitive neuroscience.

PubMed

Poldrack, Russell A

2012-08-15

Over the last 20 years, fMRI has revolutionized cognitive neuroscience. Here I outline a vision for what the next 20 years of fMRI in cognitive neuroscience might look like. Some developments that I hope for include increased methodological rigor, an increasing focus on connectivity and pattern analysis as opposed to "blobology", a greater focus on selective inference powered by open databases, and increased use of ontologies and computational models to describe underlying processes. Copyright © 2011 Elsevier Inc. All rights reserved.

Virtual reality: A new track in psychological research.

PubMed

de la Rosa, Stephan; Breidt, Martin

2018-05-10

One major challenge of social interaction research is to achieve high experimental control over social interactions to allow for rigorous scientific reasoning. Virtual reality (VR) promises this level of control. Pan and Hamilton guide us with a detailed review on existing and future possibilities and challenges of using VR for social interaction research. Here, we extend the discussion to methodological and practical implications when using VR. © 2018 The Authors. British Journal of Psychology published by John Wiley & Sons Ltd on behalf of British Psychological Society.

Designing A Mixed Methods Study In Primary Care

PubMed Central

Creswell, John W.; Fetters, Michael D.; Ivankova, Nataliya V.

2004-01-01

BACKGROUND Mixed methods or multimethod research holds potential for rigorous, methodologically sound investigations in primary care. The objective of this study was to use criteria from the literature to evaluate 5 mixed methods studies in primary care and to advance 3 models useful for designing such investigations. METHODS We first identified criteria from the social and behavioral sciences to analyze mixed methods studies in primary care research. We then used the criteria to evaluate 5 mixed methods investigations published in primary care research journals. RESULTS Of the 5 studies analyzed, 3 included a rationale for mixing based on the need to develop a quantitative instrument from qualitative data or to converge information to best understand the research topic. Quantitative data collection involved structured interviews, observational checklists, and chart audits that were analyzed using descriptive and inferential statistical procedures. Qualitative data consisted of semistructured interviews and field observations that were analyzed using coding to develop themes and categories. The studies showed diverse forms of priority: equal priority, qualitative priority, and quantitative priority. Data collection involved quantitative and qualitative data gathered both concurrently and sequentially. The integration of the quantitative and qualitative data in these studies occurred between data analysis from one phase and data collection from a subsequent phase, while analyzing the data, and when reporting the results. DISCUSSION We recommend instrument-building, triangulation, and data transformation models for mixed methods designs as useful frameworks to add rigor to investigations in primary care. We also discuss the limitations of our study and the need for future research. PMID:15053277

[Argumentation and construction of validity in Carlos Matus' situational strategic planning].

PubMed

Rivera, Francisco Javier Uribe

2011-09-01

This study analyzes the process of producing a situational plan according to a benchmark from the philosophy of language and argumentation theory. The basic approach used in the analysis was developed by Carlos Matus. Specifically, the study seeks to identify the inherent argumentative structure and patterns in the situational explanation and regulatory design in a plan's operations, taking argumentative approaches from pragma-dialectics and informal logic as the analytical parameters. The explanation of a health problem is used to illustrate the study. Methodologically, the study is based on the existing literature on the subject and case analyses. The study concludes with the proposition that the use of the specific references means introducing greater rigor into both the analysis of the validity of causal arguments and the design of proposals for interventions, in order for them to be more conclusive in achieving a plan's objectives.

A systematic review of randomized trials of mind-body interventions for PTSD.

PubMed

Niles, Barbara L; Mori, DeAnna L; Polizzi, Craig; Pless Kaiser, Anica; Weinstein, Elizabeth S; Gershkovich, Marina; Wang, Chenchen

2018-05-10

To systematically review outcomes from randomized controlled trials (RCTs) of mind-body treatments for PTSD. Inclusion criteria based on guidelines for assessing risk of bias were used to evaluate articles identified through electronic literature searches. Twenty-two RCTs met inclusion standards. In most of the nine mindfulness and six yoga studies, significant between-group effects were found indicating moderate to large effect size advantages for these treatments. In all seven relaxation RCT's, relaxation was used as a control condition and five studies reported significant between-group differences on relevant PTSD outcomes in favor of the target treatments. However, there were large within-group symptom improvements in the relaxation condition for the majority of studies. Although many studies are limited by methodologic weaknesses, recent studies have increased rigor and, in aggregate, the results for mindfulness, yoga, and relaxation are promising. Recommendations for design of future mind-body trials are offered. © 2018 Wiley Periodicals, Inc.

Evidence Base Update for Psychosocial Treatments for Pediatric Obsessive-Compulsive Disorder

PubMed Central

Freeman, Jennifer; Garcia, Abbe; Frank, Hannah; Benito, Kristen; Conelea, Christine; Walther, Michael; Edmunds, Julie

2013-01-01

Objective Pediatric Obsessive Compulsive Disorder (OCD) is a chronic and impairing condition that often persists into adulthood. Barrett and colleagues (2008), in this journal, provided a detailed review of evidence based psychosocial treatments for youth with OCD. The current review provides an evidence base update of the pediatric OCD psychosocial treatment literature with particular attention to advances in the field as well as to the methodological challenges inherent in evaluating such findings. Method Psychosocial treatment studies conducted since the last review are described and evaluated according to methodological rigor and evidence-based classification using the JCCAP evidence based treatment (EBT) evaluation criteria (Southam-Gerow and Prinstein, this issue). Results Findings from this review clearly converge in support of CBT as an effective and appropriate first line treatment for youth with OCD (either alone or in combination with medication). Although no treatment for pediatric OCD has yet to be designated as “well established”, both individual and individual family based treatments have been shown to be “probably efficacious.” Conclusions Moderators and predictors of treatment outcome are discussed as are the areas where we have advanced the field and the areas where we have room to grow. The methodological and clinical challenges inherent in a review of the evidence base are reviewed. Finally, future research directions are outlined. PMID:23746138

Experimental evaluation of rigor mortis. III. Comparative study of the evolution of rigor mortis in different sized muscle groups in rats.

PubMed

Krompecher, T; Fryc, O

1978-01-01

The use of new methods and an appropriate apparatus has allowed us to make successive measurements of rigor mortis and a study of its evolution in the rat. By a comparative examination on the front and hind limbs, we have determined the following: (1) The muscular mass of the hind limbs is 2.89 times greater than that of the front limbs. (2) In the initial phase rigor mortis is more pronounced in the front limbs. (3) The front and hind limbs reach maximum rigor mortis at the same time and this state is maintained for 2 hours. (4) Resolution of rigor mortis is accelerated in the front limbs during the initial phase, but both front and hind limbs reach complete resolution at the same time.

The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review.

PubMed

Zeng, Xiantao; Zhang, Yonggang; Kwong, Joey S W; Zhang, Chao; Li, Sheng; Sun, Feng; Niu, Yuming; Du, Liang

2015-02-01

To systematically review the methodological assessment tools for pre-clinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline. We searched PubMed, the Cochrane Handbook for Systematic Reviews of Interventions, Joanna Briggs Institute (JBI) Reviewers Manual, Centre for Reviews and Dissemination, Critical Appraisal Skills Programme (CASP), Scottish Intercollegiate Guidelines Network (SIGN), and the National Institute for Clinical Excellence (NICE) up to May 20th, 2014. Two authors selected studies and extracted data; quantitative analysis was performed to summarize the characteristics of included tools. We included a total of 21 assessment tools for analysis. A number of tools were developed by academic organizations, and some were developed by only a small group of researchers. The JBI developed the highest number of methodological assessment tools, with CASP coming second. Tools for assessing the methodological quality of randomized controlled studies were most abundant. The Cochrane Collaboration's tool for assessing risk of bias is the best available tool for assessing RCTs. For cohort and case-control studies, we recommend the use of the Newcastle-Ottawa Scale. The Methodological Index for Non-Randomized Studies (MINORS) is an excellent tool for assessing non-randomized interventional studies, and the Agency for Healthcare Research and Quality (ARHQ) methodology checklist is applicable for cross-sectional studies. For diagnostic accuracy test studies, the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool is recommended; the SYstematic Review Centre for Laboratory animal Experimentation (SYRCLE) risk of bias tool is available for assessing animal studies; Assessment of Multiple Systematic Reviews (AMSTAR) is a measurement tool for systematic reviews/meta-analyses; an 18-item tool has been developed for appraising case series studies, and the Appraisal of Guidelines, Research and Evaluation (AGREE)-II instrument is widely used to evaluate clinical practice guidelines. We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided. © 2015 Chinese Cochrane Center, West China Hospital of Sichuan University and Wiley Publishing Asia Pty Ltd.

Evaluating sex as a biological variable in preclinical research: the devil in the details.

PubMed

Tannenbaum, Cara; Schwarz, Jaclyn M; Clayton, Janine A; de Vries, Geert J; Sullivan, Casey

2016-01-01

Translating policy into action is a complex task, with much debate surrounding the process whereby US and Canadian health funding agencies intend to integrate sex and gender science as an integral component of methodological rigor and reporting in health research. Effective January 25, 2016, the US National Institutes of Health implemented a policy that expects scientists to account for the possible role of sex as a biological variable (SABV) in vertebrate animal and human studies. Applicants for NIH-funded research and career development awards will be asked to explain how they plan to factor consideration of SABV into their research design, analysis, and reporting; strong justification will be required for proposing single-sex studies. The Canadian Institutes of Health Research is revising their peer review accreditation process to ensure that peer reviewers are skilled in applying a critical lens to protocols that should be incorporating sex and gender science. The current paper outlines the components that peer reviewers in North America will be asked to assess when considering whether SABV is appropriately integrated into research designs, analyses, and reporting. Consensus argues against narrowly defining rules of engagement in applying SABV, with criteria provided for reviewers as guidance only. Scores will not be given for each criterion; applications will be judged on the overall merit of scientific innovation, rigor, reproducibility, and potential impact.

Geometry of behavioral spaces: A computational approach to analysis and understanding of agent based models and agent behaviors

NASA Astrophysics Data System (ADS)

Cenek, Martin; Dahl, Spencer K.

2016-11-01

Systems with non-linear dynamics frequently exhibit emergent system behavior, which is important to find and specify rigorously to understand the nature of the modeled phenomena. Through this analysis, it is possible to characterize phenomena such as how systems assemble or dissipate and what behaviors lead to specific final system configurations. Agent Based Modeling (ABM) is one of the modeling techniques used to study the interaction dynamics between a system's agents and its environment. Although the methodology of ABM construction is well understood and practiced, there are no computational, statistically rigorous, comprehensive tools to evaluate an ABM's execution. Often, a human has to observe an ABM's execution in order to analyze how the ABM functions, identify the emergent processes in the agent's behavior, or study a parameter's effect on the system-wide behavior. This paper introduces a new statistically based framework to automatically analyze agents' behavior, identify common system-wide patterns, and record the probability of agents changing their behavior from one pattern of behavior to another. We use network based techniques to analyze the landscape of common behaviors in an ABM's execution. Finally, we test the proposed framework with a series of experiments featuring increasingly emergent behavior. The proposed framework will allow computational comparison of ABM executions, exploration of a model's parameter configuration space, and identification of the behavioral building blocks in a model's dynamics.

Geometry of behavioral spaces: A computational approach to analysis and understanding of agent based models and agent behaviors.

PubMed

Cenek, Martin; Dahl, Spencer K

2016-11-01

Systems with non-linear dynamics frequently exhibit emergent system behavior, which is important to find and specify rigorously to understand the nature of the modeled phenomena. Through this analysis, it is possible to characterize phenomena such as how systems assemble or dissipate and what behaviors lead to specific final system configurations. Agent Based Modeling (ABM) is one of the modeling techniques used to study the interaction dynamics between a system's agents and its environment. Although the methodology of ABM construction is well understood and practiced, there are no computational, statistically rigorous, comprehensive tools to evaluate an ABM's execution. Often, a human has to observe an ABM's execution in order to analyze how the ABM functions, identify the emergent processes in the agent's behavior, or study a parameter's effect on the system-wide behavior. This paper introduces a new statistically based framework to automatically analyze agents' behavior, identify common system-wide patterns, and record the probability of agents changing their behavior from one pattern of behavior to another. We use network based techniques to analyze the landscape of common behaviors in an ABM's execution. Finally, we test the proposed framework with a series of experiments featuring increasingly emergent behavior. The proposed framework will allow computational comparison of ABM executions, exploration of a model's parameter configuration space, and identification of the behavioral building blocks in a model's dynamics.

Validation of a multi-phase plant-wide model for the description of the aeration process in a WWTP.

PubMed

Lizarralde, I; Fernández-Arévalo, T; Beltrán, S; Ayesa, E; Grau, P

2018-02-01

This paper introduces a new mathematical model built under the PC-PWM methodology to describe the aeration process in a full-scale WWTP. This methodology enables a systematic and rigorous incorporation of chemical and physico-chemical transformations into biochemical process models, particularly for the description of liquid-gas transfer to describe the aeration process. The mathematical model constructed is able to reproduce biological COD and nitrogen removal, liquid-gas transfer and chemical reactions. The capability of the model to describe the liquid-gas mass transfer has been tested by comparing simulated and experimental results in a full-scale WWTP. Finally, an exploration by simulation has been undertaken to show the potential of the mathematical model. Copyright © 2017 Elsevier Ltd. All rights reserved.

Geoscience Education Research Methods: Thinking About Sample Size

NASA Astrophysics Data System (ADS)

Slater, S. J.; Slater, T. F.; CenterAstronomy; Physics Education Research

2011-12-01

Geoscience education research is at a critical point in which conditions are sufficient to propel our field forward toward meaningful improvements in geosciences education practices. Our field has now reached a point where the outcomes of our research is deemed important to endusers and funding agencies, and where we now have a large number of scientists who are either formally trained in geosciences education research, or who have dedicated themselves to excellence in this domain. At this point we now must collectively work through our epistemology, our rules of what methodologies will be considered sufficiently rigorous, and what data and analysis techniques will be acceptable for constructing evidence. In particular, we have to work out our answer to that most difficult of research questions: "How big should my 'N' be??" This paper presents a very brief answer to that question, addressing both quantitative and qualitative methodologies. Research question/methodology alignment, effect size and statistical power will be discussed, in addition to a defense of the notion that bigger is not always better.

On Robust Methodologies for Managing Public Health Care Systems

PubMed Central

Nimmagadda, Shastri L.; Dreher, Heinz V.

2014-01-01

Authors focus on ontology-based multidimensional data warehousing and mining methodologies, addressing various issues on organizing, reporting and documenting diabetic cases and their associated ailments, including causalities. Map and other diagnostic data views, depicting similarity and comparison of attributes, extracted from warehouses, are used for understanding the ailments, based on gender, age, geography, food-habits and other hereditary event attributes. In addition to rigor on data mining and visualization, an added focus is on values of interpretation of data views, from processed full-bodied diagnosis, subsequent prescription and appropriate medications. The proposed methodology, is a robust back-end application, for web-based patient-doctor consultations and e-Health care management systems through which, billions of dollars spent on medical services, can be saved, in addition to improving quality of life and average life span of a person. Government health departments and agencies, private and government medical practitioners including social welfare organizations are typical users of these systems. PMID:24445953

Sidney Blatt's Object Relations Inventory: Contributions and Future Directions.

PubMed

Huprich, Steven K; Auerbach, John S; Porcerelli, John H; Bupp, Lindsey L

2016-01-01

In this article, we provide a historical overview of the Object Relations Inventory (ORI) and related methods for the assessment of object relations constructed by Sidney Blatt and colleagues (e.g., Blatt, Bers, & Schaffer, 1992 ; Blatt, Wein, Chevron, & Quinlan, 1979 ; Diamond, Kaslow, Coonerty, & Blatt, 1990 ). We clarify terminology that has been used inconsistently in the literature, especially by way of differentiating the methods used to collect descriptions of significant figures, such as the ORI and its predecessor, the Parental Description (PD) task, and the rating scales that Blatt and colleagues constructed to rate those descriptions. We provide a tabular summary of empirical studies of the measure and offer a critical review of those aspects of the instrument that require further empirical investigation and methodological rigor.

Implementation of the nudged elastic band method in a dislocation dynamics formalism: Application to dislocation nucleation

NASA Astrophysics Data System (ADS)

Geslin, Pierre-Antoine; Gatti, Riccardo; Devincre, Benoit; Rodney, David

2017-11-01

We propose a framework to study thermally-activated processes in dislocation glide. This approach is based on an implementation of the nudged elastic band method in a nodal mesoscale dislocation dynamics formalism. Special care is paid to develop a variational formulation to ensure convergence to well-defined minimum energy paths. We also propose a methodology to rigorously parametrize the model on atomistic data, including elastic, core and stacking fault contributions. To assess the validity of the model, we investigate the homogeneous nucleation of partial dislocation loops in aluminum, recovering the activation energies and loop shapes obtained with atomistic calculations and extending these calculations to lower applied stresses. The present method is also applied to heterogeneous nucleation on spherical inclusions.

Hydrological drought in southeast Australia over the last five centuries: new insights from a multi-archive palaeoclimate streamflow reconstruction

NASA Astrophysics Data System (ADS)

Henley, B.; Peel, M. C.; Nathan, R.; Karoly, D. J.

2017-12-01

South-eastern Australia experienced one of the most intense and prolonged droughts in the observed record over the period 1997-2009, widely termed the Millennium drought. Water managers are faced with major challenges in understanding this drought and preparing for future variability and change. In this study, we use a newly collated network of annual resolution palaeoclimate data, a novel reconstruction methodology and rigorous treatment of uncertainties to reconstruct water supply system inflows in a critical water supply catchment in southern Australia. Our new reconstruction allows us to investigate the intensity, frequency and duration of severe hydrological drought several centuries into the past, and to integrate knowledge from instrumental and palaeoclimate data.

Strengthening the evidence base for health programming in humanitarian crises.

PubMed

Ager, A; Burnham, G; Checchi, F; Gayer, M; Grais, R F; Henkens, M; Massaquoi, M B F; Nandy, R; Navarro-Colorado, C; Spiegel, P

2014-09-12

Given the growing scale and complexity of responses to humanitarian crises, it is important to develop a stronger evidence base for health interventions in such contexts. Humanitarian crises present unique challenges to rigorous and effective research, but there are substantial opportunities for scientific advance. Studies need to focus where the translation of evidence from noncrisis scenarios is not viable and on ethical ways of determining what happens in the absence of an intervention. Robust methodologies suited to crisis settings have to be developed and used to assess interventions with potential for delivery at scale. Strengthening research capacity in the low- to middle-income countries that are vulnerable to crises is also crucial. Copyright © 2014, American Association for the Advancement of Science.

Deployment of paired pushnets from jet-propelled kayaks to sample ichthyoplankton

USGS Publications Warehouse

Acre, Matthew R.; Grabowski, Timothy B.

2015-01-01

Accessing and effectively sampling the off-channel habitats that are considered crucial for early life stages of freshwater fishes constitute a difficult challenge when common ichthyoplankton survey methods, such as push nets, are used. We describe a new method of deploying push nets from jet-propelled kayaks to enable the sampling of previously inaccessible off-channel habitats. The described rig is also functional in more open and accessible habitats, such as the main channel of rivers or reservoirs. Although further evaluation is necessary to ensure that results are comparable across studies, the described push-net system offers a statistically rigorous methodology that generates replicate samples from a wide range of freshwater habitats that were previously inaccessible to this gear type.

Temporal discounting: basic research and the analysis of socially important behavior.

PubMed Central

Critchfield, T S; Kollins, S H

2001-01-01

Recent basic research on human temporal discounting is reviewed to illustrate procedures, summarize key findings, and draw parallels with both nonhuman animal research and conceptual writings on self-control. Lessons derived from this research are then applied to the challenge of analyzing socially important behaviors such as drug abuse, eating and exercise, and impulsiveness associated with attention deficit hyperactivity disorder. Attending to the broader temporal context in which behavior occurs may aid in the analysis of socially important behavior. Applying this perspective to the study of behavior in natural environments also highlights the importance of combining methodological flexibility with conceptual rigor to promote the extension of applied behavior analysis to a broader array of socially important behaviors. PMID:11317983

A technical guide to tDCS, and related non-invasive brain stimulation tools.

PubMed

Woods, A J; Antal, A; Bikson, M; Boggio, P S; Brunoni, A R; Celnik, P; Cohen, L G; Fregni, F; Herrmann, C S; Kappenman, E S; Knotkova, H; Liebetanz, D; Miniussi, C; Miranda, P C; Paulus, W; Priori, A; Reato, D; Stagg, C; Wenderoth, N; Nitsche, M A

2016-02-01

Transcranial electrical stimulation (tES), including transcranial direct and alternating current stimulation (tDCS, tACS) are non-invasive brain stimulation techniques increasingly used for modulation of central nervous system excitability in humans. Here we address methodological issues required for tES application. This review covers technical aspects of tES, as well as applications like exploration of brain physiology, modelling approaches, tES in cognitive neurosciences, and interventional approaches. It aims to help the reader to appropriately design and conduct studies involving these brain stimulation techniques, understand limitations and avoid shortcomings, which might hamper the scientific rigor and potential applications in the clinical domain. Copyright © 2015 International Federation of Clinical Neurophysiology. All rights reserved.

X-Phi and Carnapian Explication

PubMed Central

Shepherd, Joshua; Justus, James

2015-01-01

The rise of experimental philosophy (x-phi) has placed metaphilosophical questions, particularly those concerning concepts, at the center of philosophical attention. X-phi offers empirically rigorous methods for identifying conceptual content, but what exactly it contributes towards evaluating conceptual content remains unclear. We show how x-phi complements Rudolf Carnap’s underappreciated methodology for concept determination, explication. This clarifies and extends x-phi’s positive philosophical import, and also exhibits explication’s broad appeal. But there is a potential problem: Carnap’s account of explication was limited to empirical and logical concepts, but many concepts of interest to philosophers (experimental and otherwise) are essentially normative. With formal epistemology as a case study, we show how x-phi assisted explication can apply to normative domains. PMID:26345713

Experimental evaluation of rigor mortis. VI. Effect of various causes of death on the evolution of rigor mortis.

PubMed

Krompecher, T; Bergerioux, C; Brandt-Casadevall, C; Gujer, H R

1983-07-01

The evolution of rigor mortis was studied in cases of nitrogen asphyxia, drowning and strangulation, as well as in fatal intoxications due to strychnine, carbon monoxide and curariform drugs, using a modified method of measurement. Our experiments demonstrated that: (1) Strychnine intoxication hastens the onset and passing of rigor mortis. (2) CO intoxication delays the resolution of rigor mortis. (3) The intensity of rigor may vary depending upon the cause of death. (4) If the stage of rigidity is to be used to estimate the time of death, it is necessary: (a) to perform a succession of objective measurements of rigor mortis intensity; and (b) to verify the eventual presence of factors that could play a role in the modification of its development.

The What, the Why, and the How: A Review of Racial Microaggressions Research in Psychology

PubMed Central

Derthick, Annie O.; David, E. J. R.; Saw, Anne; Okazaki, Sumie

2016-01-01

Since the publication of Sue et al. (Am Psychol 62:271–286, 2007a, b) seminal article, there has been an enormous scholarly interest in psychology on this construct of racial microaggressions—subtle everyday experiences of racism. In this paper, we provide a review of racial microaggressions research literature in psychology since 2007, following the publication of the first comprehensive taxonomy of racial microaggressions, which provided a conceptual framework and directions for research related to racial microaggressions. However, our review suggests that important conceptual and methodological issues remain to be addressed in the three domains: (1) what are racial microaggressions and who do they impact; (2) why are racial microaggressions important to examine; and (3) how are racial microaggressions currently studied and how might we improve the methodologies used to study racial microaggressions. We propose recommendations to further facilitate racial microaggressions research, improve the scientific rigor of racial microaggressions research, and contribute toward a more complete and sophisticated understanding of the concept and consequences of racial microaggressions—a construct that is undoubtedly salient and psychologically relevant among many members of racial minority groups. PMID:26913088

Effect of Medicinal Herbs on Primary Dysmenorrhoea- a Systematic Review

PubMed Central

Mirabi, Parvaneh; Alamolhoda, Seideh Hanieh; Esmaeilzadeh, Seddigheh; Mojab, Faraz

2014-01-01

Conventional treatment for primary dysmenorrhoea has a failure rate of 20% to 25% and may be contraindicated or not tolerated by some women. Herbal medicine may be a suitable alternative. To determine the efficacy and safety of Iranian herbal medicine for primary dysmenorrhea when compared with placebo, no treatment, and other treatment. Electronic searches of the Cochrane Menstrual Disorders and Dysmenorrhoea Group Register of controlled trials, Scopus, Google Scholar, Medline, Pubmed were performed to identify relevant randomized controlled trials (RCTs). The study abstraction and quality assessment of all studies were undertaken following the detailed descriptions of these categories as described in the JADAD Criteria for Systematic Reviews of Interventions. 25 RCTs involving a total of women were included in the review. The review found promising evidence in the form of RCTs for the use of herbal medicine in the treatment of primary dysmenorrhoea compared with pharmacological treatment. However, the results were limited by methodological flaws. Further rigorous no penetrating placebo-controlled RCTs are warranted. The review found promising evidence supporting the use of herbal medicine for primary dysmenorrhoea; however, results are limited by the poor methodological quality of the included trials. PMID:25276177

Animal-Assisted Intervention for trauma: a systematic literature review.

PubMed

O'Haire, Marguerite E; Guérin, Noémie A; Kirkham, Alison C

2015-01-01

Animals have a long history of inclusion in psychiatric treatment. There has been a recent growth in the empirical study of this practice, known as Animal-Assisted Intervention (AAI). We conducted a systematic review of the empirical literature on AAI for trauma, including posttraumatic stress disorder (PTSD). Ten studies qualified for inclusion, including six peer-reviewed journal articles and four unpublished theses. Participants were predominantly survivors of child abuse, in addition to military veterans. The presentation of AAI was highly variable across the studies. The most common animal species were dogs and horses. The most prevalent outcomes were reduced depression, PTSD symptoms, and anxiety. There was a low level of methodological rigor in most studies, indicating the preliminary nature of this area of investigation. We conclude that AAI may provide promise as a complementary treatment option for trauma, but that further research is essential to establish feasibility, efficacy, and manualizable protocols.

Animal-Assisted Intervention for trauma: a systematic literature review

PubMed Central

O'Haire, Marguerite E.; Guérin, Noémie A.; Kirkham, Alison C.

2015-01-01

Animals have a long history of inclusion in psychiatric treatment. There has been a recent growth in the empirical study of this practice, known as Animal-Assisted Intervention (AAI). We conducted a systematic review of the empirical literature on AAI for trauma, including posttraumatic stress disorder (PTSD). Ten studies qualified for inclusion, including six peer-reviewed journal articles and four unpublished theses. Participants were predominantly survivors of child abuse, in addition to military veterans. The presentation of AAI was highly variable across the studies. The most common animal species were dogs and horses. The most prevalent outcomes were reduced depression, PTSD symptoms, and anxiety. There was a low level of methodological rigor in most studies, indicating the preliminary nature of this area of investigation. We conclude that AAI may provide promise as a complementary treatment option for trauma, but that further research is essential to establish feasibility, efficacy, and manualizable protocols. PMID:26300817

Minor Children of Palliative Patients: A Systematic Review of Psychosocial Family Interventions

PubMed Central

Krattenmacher, Thomas; Beierlein, Volker; Grimm, Johann Christian; Bergelt, Corinna; Romer, Georg; Möller, Birgit

2012-01-01

Abstract Although the whole family is affected by a parent's palliative disease, palliative care research does not yet routinely consider patients' minor children. Children's and adolescents' psychosocial functioning may be impaired during prolonged parental disease with poor prognosis. Therefore, more and more health care providers are establishing clinical initiatives for families of palliative patients with minor children. However, the number of these family interventions, as well as their theoretical and empirical backgrounds and evidence base, has yet to be determined. The purpose of this study was to systematically review structured and published interventions for this target group, as well as empirical studies on these interventions. The evidence base and impact of interventions on families were considered. Literature published between 1980 and present focusing on psychosocial family-, child- or parent-centered interventions during palliative care was retrieved from PsycINFO®, Embase, MEDLINE®, CINAHL®, and PSYNDEX databases. Five interventions met the inclusion criteria. Programs focused on different populations, had diverse empirical and theoretical backgrounds and features, and were evaluated by studies of varying methodological quality. This systematic review illustrates the lack of well designed and elaborated intervention concepts and evaluation studies in this field, highlighting the necessity of conceptual and methodological rigor to inform clinical practice on a sustainable basis in the future. PMID:22849598

Effect of periodontal treatment on preterm birth rate: a systematic review of meta-analyses.

PubMed

López, Néstor J; Uribe, Sergio; Martinez, Benjamín

2015-02-01

Preterm birth is a major cause of neonatal morbidity and mortality in both developed and developing countries. Preterm birth is a highly complex syndrome that includes distinct clinical subtypes in which many different causes may be involved. The results of epidemiological, molecular, microbiological and animal-model studies support a positive association between maternal periodontal disease and preterm birth. However, the results of intervention studies carried out to determine the effect of periodontal treatment on reducing the risk of preterm birth are controversial. This systematic review critically analyzes the methodological issues of meta-analyses of the studies to determine the effect of periodontal treatment to reduce preterm birth. The quality of the individual randomized clinical trials selected is of highest relevance for a systematic review. This article describes the methodological features that should be identified a priori and assessed individually to determine the quality of a randomized controlled trial performed to evaluate the effect of periodontal treatment on pregnancy outcomes. The AMSTAR and the PRISMA checklist tools were used to assess the quality of the six meta-analyses selected, and the bias domain of the Cochrane Collaboration's Tool was applied to evaluate each of the trials included in the meta-analyses. In addition, the methodological characteristics of each clinical trial were assessed. The majority of the trials included in the meta-analyses have significant methodological flaws that threaten their internal validity. The lack of effect of periodontal treatment on preterm birth rate concluded by four meta-analyses, and the positive effect of treatment for reducing preterm birth risk concluded by the remaining two meta-analyses are not based on consistent scientific evidence. Well-conducted randomized controlled trials using rigorous methodology, including appropriate definition of the exposure, adequate control of confounders for preterm birth and application of effective periodontal interventions to eliminate periodontal infection, are needed to confirm the positive association between periodontal disease and preterm birth. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Chinese medicine shenfu injection for heart failure: a systematic review and meta-analysis.

PubMed

Wen-Ting, Song; Fa-Feng, Cheng; Li, Xu; Cheng-Ren, Lin; Jian-Xun, Liu

2012-01-01

Objective. Heart failure (HF) is a global public health problem. Early literature studies manifested that Shenfu injection (SFI) is one of the most commonly used traditional Chinese patent medicine for HF in China. This article intended to systematically evaluate the efficacy and safety of SFI for HF. Methods. An extensive search was performed within 6 English and Chinese electronic database up to November 2011. Ninety-nine randomized controlled trails (RCTs) were collected, irrespective of languages. Two authors extracted data and assessed the trial quality independently. RevMan 5.0.2 was used for data analysis. Results. Compared with routine treatment and/or device support, SFI combined with routine treatment and/or device support showed better effect on clinical effect rate, mortality, heart rate, NT-proBNP and 6-minute walk distance. Results in ultrasonic cardiography also showed that SFI combined with routine treatment improved heart function of HF patients. There were no significant difference in blood pressure between SFI and routine treatment groups. Adverse events were reported in thirteen trails with thirteen specific symptoms, while no serious adverse effect was reported. Conclusion. SFI appear to be effective for treating HF. However, further rigorously designed RCTs are warranted because of insufficient methodological rigor in the majority of included trials.

The case for treatment fidelity in active music interventions: why and how.

PubMed

Wiens, Natalie; Gordon, Reyna L

2018-05-04

As the volume of studies testing the benefits of active music-making interventions increases exponentially, it is important to document what exactly is happening during music treatment sessions in order to provide evidence for the mechanisms through which music training affects other domains. Thus, to complement systematic and rigorous attention to outcomes of the treatment, we outline four vital components of treatment fidelity and discuss their implementation in nonmusic- and music-based interventions. We then describe the design of Music Impacting Language Expertise (MILEStone), a new intervention that aims to improve grammar skills in children with specific language impairment by increasing sensitivity to rhythmic structure, which may enhance general temporal processing and sensitivity to syntactic structure. We describe the approach to addressing treatment fidelity in MILEStone adapted from intervention research from other fields, including a behavioral coding system to track instructional episodes and child participation, a treatment manual, activity checklists, provider training and monitoring, a home practice log, and teacher ratings of participant engagement. This approach takes an important first step in modeling a formalized procedure for assessing treatment fidelity in active music-making intervention research, as a means of increasing methodological rigor in support of evidence-based practice in clinical and educational settings. © 2018 New York Academy of Sciences.

Predictive QSAR modeling workflow, model applicability domains, and virtual screening.

PubMed

Tropsha, Alexander; Golbraikh, Alexander

2007-01-01

Quantitative Structure Activity Relationship (QSAR) modeling has been traditionally applied as an evaluative approach, i.e., with the focus on developing retrospective and explanatory models of existing data. Model extrapolation was considered if only in hypothetical sense in terms of potential modifications of known biologically active chemicals that could improve compounds' activity. This critical review re-examines the strategy and the output of the modern QSAR modeling approaches. We provide examples and arguments suggesting that current methodologies may afford robust and validated models capable of accurate prediction of compound properties for molecules not included in the training sets. We discuss a data-analytical modeling workflow developed in our laboratory that incorporates modules for combinatorial QSAR model development (i.e., using all possible binary combinations of available descriptor sets and statistical data modeling techniques), rigorous model validation, and virtual screening of available chemical databases to identify novel biologically active compounds. Our approach places particular emphasis on model validation as well as the need to define model applicability domains in the chemistry space. We present examples of studies where the application of rigorously validated QSAR models to virtual screening identified computational hits that were confirmed by subsequent experimental investigations. The emerging focus of QSAR modeling on target property forecasting brings it forward as predictive, as opposed to evaluative, modeling approach.

Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

PubMed

Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

2012-04-01

Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.

Elevating the quality of disability and rehabilitation research: mandatory use of the reporting guidelines.

PubMed

Chan, Leighton; Heinemann, Allen W; Roberts, Jason

2014-01-01

Note from the AJOT Editor-in-Chief: Since 2010, the American Journal of Occupational Therapy (AJOT) has adopted reporting standards based on the Consolidated Standards of Reporting Trials (CONSORT) Statement and American Psychological Association (APA) guidelines in an effort to publish transparent clinical research that can be easily evaluated for methodological and analytical rigor (APA Publications and Communications Board Working Group on Journal Article Reporting Standards, 2008; Moher, Schulz, & Altman, 2001). AJOT has now joined 28 other major rehabilitation and disability journals in a collaborative initiative to enhance clinical research reporting standards through adoption of the EQUATOR Network reporting guidelines, described below. Authors will now be required to use these guidelines in the preparation of manuscripts that will be submitted to AJOT. Reviewers will also use these guidelines to evaluate the quality and rigor of all AJOT submissions. By adopting these standards we hope to further enhance the quality and clinical applicability of articles to our readers. Copyright © 2014 by the American Occupational Therapy Association, Inc.

Integration of the Response Surface Methodology with the Compromise Decision Support Problem in Developing a General Robust Design Procedure

NASA Technical Reports Server (NTRS)

Chen, Wei; Tsui, Kwok-Leung; Allen, Janet K.; Mistree, Farrokh

1994-01-01

In this paper we introduce a comprehensive and rigorous robust design procedure to overcome some limitations of the current approaches. A comprehensive approach is general enough to model the two major types of robust design applications, namely, robust design associated with the minimization of the deviation of performance caused by the deviation of noise factors (uncontrollable parameters), and robust design due to the minimization of the deviation of performance caused by the deviation of control factors (design variables). We achieve mathematical rigor by using, as a foundation, principles from the design of experiments and optimization. Specifically, we integrate the Response Surface Method (RSM) with the compromise Decision Support Problem (DSP). Our approach is especially useful for design problems where there are no closed-form solutions and system performance is computationally expensive to evaluate. The design of a solar powered irrigation system is used as an example. Our focus in this paper is on illustrating our approach rather than on the results per se.

Infinitely dilute partial molar properties of proteins from computer simulation.

PubMed

Ploetz, Elizabeth A; Smith, Paul E

2014-11-13

A detailed understanding of temperature and pressure effects on an infinitely dilute protein's conformational equilibrium requires knowledge of the corresponding infinitely dilute partial molar properties. Established molecular dynamics methodologies generally have not provided a way to calculate these properties without either a loss of thermodynamic rigor, the introduction of nonunique parameters, or a loss of information about which solute conformations specifically contributed to the output values. Here we implement a simple method that is thermodynamically rigorous and possesses none of the above disadvantages, and we report on the method's feasibility and computational demands. We calculate infinitely dilute partial molar properties for two proteins and attempt to distinguish the thermodynamic differences between a native and a denatured conformation of a designed miniprotein. We conclude that simple ensemble average properties can be calculated with very reasonable amounts of computational power. In contrast, properties corresponding to fluctuating quantities are computationally demanding to calculate precisely, although they can be obtained more easily by following the temperature and/or pressure dependence of the corresponding ensemble averages.

Rigor and reproducibility in research with transcranial electrical stimulation: An NIMH-sponsored workshop.

PubMed

Bikson, Marom; Brunoni, Andre R; Charvet, Leigh E; Clark, Vincent P; Cohen, Leonardo G; Deng, Zhi-De; Dmochowski, Jacek; Edwards, Dylan J; Frohlich, Flavio; Kappenman, Emily S; Lim, Kelvin O; Loo, Colleen; Mantovani, Antonio; McMullen, David P; Parra, Lucas C; Pearson, Michele; Richardson, Jessica D; Rumsey, Judith M; Sehatpour, Pejman; Sommers, David; Unal, Gozde; Wassermann, Eric M; Woods, Adam J; Lisanby, Sarah H

Neuropsychiatric disorders are a leading source of disability and require novel treatments that target mechanisms of disease. As such disorders are thought to result from aberrant neuronal circuit activity, neuromodulation approaches are of increasing interest given their potential for manipulating circuits directly. Low intensity transcranial electrical stimulation (tES) with direct currents (transcranial direct current stimulation, tDCS) or alternating currents (transcranial alternating current stimulation, tACS) represent novel, safe, well-tolerated, and relatively inexpensive putative treatment modalities. This report seeks to promote the science, technology and effective clinical applications of these modalities, identify research challenges, and suggest approaches for addressing these needs in order to achieve rigorous, reproducible findings that can advance clinical treatment. The National Institute of Mental Health (NIMH) convened a workshop in September 2016 that brought together experts in basic and human neuroscience, electrical stimulation biophysics and devices, and clinical trial methods to examine the physiological mechanisms underlying tDCS/tACS, technologies and technical strategies for optimizing stimulation protocols, and the state of the science with respect to therapeutic applications and trial designs. Advances in understanding mechanisms, methodological and technological improvements (e.g., electronics, computational models to facilitate proper dosing), and improved clinical trial designs are poised to advance rigorous, reproducible therapeutic applications of these techniques. A number of challenges were identified and meeting participants made recommendations made to address them. These recommendations align with requirements in NIMH funding opportunity announcements to, among other needs, define dosimetry, demonstrate dose/response relationships, implement rigorous blinded trial designs, employ computational modeling, and demonstrate target engagement when testing stimulation-based interventions for the treatment of mental disorders. Published by Elsevier Inc.

Rigor and reproducibility in research with transcranial electrical stimulation: An NIMH-sponsored workshop

PubMed Central

Bikson, Marom; Brunoni, Andre R.; Charvet, Leigh E.; Clark, Vincent P.; Cohen, Leonardo G.; Deng, Zhi-De; Dmochowski, Jacek; Edwards, Dylan J.; Frohlich, Flavio; Kappenman, Emily S.; Lim, Kelvin O.; Loo, Colleen; Mantovani, Antonio; McMullen, David P.; Parra, Lucas C.; Pearson, Michele; Richardson, Jessica D.; Rumsey, Judith M.; Sehatpour, Pejman; Sommers, David; Unal, Gozde; Wassermann, Eric M.; Woods, Adam J.; Lisanby, Sarah H.

2018-01-01

Background Neuropsychiatric disorders are a leading source of disability and require novel treatments that target mechanisms of disease. As such disorders are thought to result from aberrant neuronal circuit activity, neuromodulation approaches are of increasing interest given their potential for manipulating circuits directly. Low intensity transcranial electrical stimulation (tES) with direct currents (transcranial direct current stimulation, tDCS) or alternating currents (transcranial alternating current stimulation, tACS) represent novel, safe, well-tolerated, and relatively inexpensive putative treatment modalities. Objective This report seeks to promote the science, technology and effective clinical applications of these modalities, identify research challenges, and suggest approaches for addressing these needs in order to achieve rigorous, reproducible findings that can advance clinical treatment. Methods The National Institute of Mental Health (NIMH) convened a workshop in September 2016 that brought together experts in basic and human neuroscience, electrical stimulation biophysics and devices, and clinical trial methods to examine the physiological mechanisms underlying tDCS/tACS, technologies and technical strategies for optimizing stimulation protocols, and the state of the science with respect to therapeutic applications and trial designs. Results Advances in understanding mechanisms, methodological and technological improvements (e.g., electronics, computational models to facilitate proper dosing), and improved clinical trial designs are poised to advance rigorous, reproducible therapeutic applications of these techniques. A number of challenges were identified and meeting participants made recommendations made to address them. Conclusions These recommendations align with requirements in NIMH funding opportunity announcements to, among other needs, define dosimetry, demonstrate dose/response relationships, implement rigorous blinded trial designs, employ computational modeling, and demonstrate target engagement when testing stimulation-based interventions for the treatment of mental disorders. PMID:29398575

Accuracy of the Canadian C-spine rule and NEXUS to screen for clinically important cervical spine injury in patients following blunt trauma: a systematic review

PubMed Central

Michaleff, Zoe A.; Maher, Chris G.; Verhagen, Arianne P.; Rebbeck, Trudy; Lin, Chung-Wei Christine

2012-01-01

Background: There is uncertainty about the optimal approach to screen for clinically important cervical spine (C-spine) injury following blunt trauma. We conducted a systematic review to investigate the diagnostic accuracy of the Canadian C-spine rule and the National Emergency X-Radiography Utilization Study (NEXUS) criteria, 2 rules that are available to assist emergency physicians to assess the need for cervical spine imaging. Methods: We identified studies by an electronic search of CINAHL, Embase and MEDLINE. We included articles that reported on a cohort of patients who experienced blunt trauma and for whom clinically important cervical spine injury detectable by diagnostic imaging was the differential diagnosis; evaluated the diagnostic accuracy of the Canadian C-spine rule or NEXUS or both; and used an adequate reference standard. We assessed the methodologic quality using the Quality Assessment of Diagnostic Accuracy Studies criteria. We used the extracted data to calculate sensitivity, specificity, likelihood ratios and post-test probabilities. Results: We included 15 studies of modest methodologic quality. For the Canadian C-spine rule, sensitivity ranged from 0.90 to 1.00 and specificity ranged from 0.01 to 0.77. For NEXUS, sensitivity ranged from 0.83 to 1.00 and specificity ranged from 0.02 to 0.46. One study directly compared the accuracy of these 2 rules using the same cohort and found that the Canadian C-spine rule had better accuracy. For both rules, a negative test was more informative for reducing the probability of a clinically important cervical spine injury. Interpretation: Based on studies with modest methodologic quality and only one direct comparison, we found that the Canadian C-spine rule appears to have better diagnostic accuracy than the NEXUS criteria. Future studies need to follow rigorous methodologic procedures to ensure that the findings are as free of bias as possible. PMID:23048086

Clinical Laboratory Evaluation of Electronic Cigarettes/Electronic Nicotine Delivery Systems: Methodological Challenges

PubMed Central

Blank, Melissa D.; Breland, Alison B.; Cobb, Caroline O.; Spindle, Tory; Ramôa, Carolina; Eissenberg, Thomas

2017-01-01

Objective Evaluating electronic cigarettes (ECIGs) in the clinical laboratory is critical to understanding their effects. However, laboratory evaluation of ECIGs can be challenging, as they are a novel, varied, and evolving class of products. The objective of this paper is to describe some methodological challenges to the clinical laboratory evaluation of ECIGs. Methods The authors gathered information about challenges involved in the laboratory evaluation of ECIGs. Challenges were categorized and solutions provided when possible. Results Methods used to study combustible cigarettes may need to be adapted to account for ECIG novelty and differences within the class. Challenges to ECIG evaluation can include issues related to 1) identification of ECIG devices and liquids, 2) determination of short -term ECIG abstinence, 3) measurement of use behavior, and 4) assessment of dependence. These challenges are discussed, and some suggestions to inform ECIG evaluation using clinical laboratory methods are provided. Conclusions Awareness of challenges and developing, validating, and reporting methods used to address them aids interpretation of results and replication efforts, thus enhancing the rigor of science used to protect public health through appropriate, empirically-based, ECIG regulation. PMID:28819633

Clinical Laboratory Evaluation of Electronic Cigarettes/Electronic Nicotine Delivery Systems: Methodological Challenges.

PubMed

Blank, Melissa D; Breland, Alison B; Cobb, Caroline O; Spindle, Tory; Ramôa, Carolina; Eissenberg, Thomas

2016-10-01

Evaluating electronic cigarettes (ECIGs) in the clinical laboratory is critical to understanding their effects. However, laboratory evaluation of ECIGs can be challenging, as they are a novel, varied, and evolving class of products. The objective of this paper is to describe some methodological challenges to the clinical laboratory evaluation of ECIGs. The authors gathered information about challenges involved in the laboratory evaluation of ECIGs. Challenges were categorized and solutions provided when possible. Methods used to study combustible cigarettes may need to be adapted to account for ECIG novelty and differences within the class. Challenges to ECIG evaluation can include issues related to 1) identification of ECIG devices and liquids, 2) determination of short -term ECIG abstinence, 3) measurement of use behavior, and 4) assessment of dependence. These challenges are discussed, and some suggestions to inform ECIG evaluation using clinical laboratory methods are provided. Awareness of challenges and developing, validating, and reporting methods used to address them aids interpretation of results and replication efforts, thus enhancing the rigor of science used to protect public health through appropriate, empirically-based, ECIG regulation.

An overview of prevention research: issues, answers, and new agendas.

PubMed Central

Howard, J; Taylor, J A; Ganikos, M L; Holder, H D; Godwin, D F; Taylor, E D

1988-01-01

Efforts to curtail alcohol abuse and alcoholism can be divided into primary, secondary, and tertiary prevention. Primary prevention attempts to stop a problem or illness from occurring in the first place. Secondary prevention identifies persons in the early stages of problematic or illness behavior and refers them for counseling or treatment, which is considered tertiary prevention. Five research areas concerned with primary and secondary prevention are selected for discussion: youth, the mass media, the worksite, blacks and Hispanics, and alcohol-related behavior that increases the risk of AIDS. Several of these themes have been in the forefront of alcohol prevention research; others such as AIDS are emergent areas of injury. The discussion to follow briefly summarizes research approaches, key findings, methodological shortcomings, and suggested issues for future investigation. Although scientifically solid prevention studies have been conducted, more rigorous, more comprehensive, and more innovative research is needed. Given the dynamic sociocultural and economic systems in which prevention occurs, research techniques that can address this complexity are required. A range of appropriate methodologies is described. PMID:3141964

Estimation of integral curves from high angular resolution diffusion imaging (HARDI) data.

PubMed

Carmichael, Owen; Sakhanenko, Lyudmila

2015-05-15

We develop statistical methodology for a popular brain imaging technique HARDI based on the high order tensor model by Özarslan and Mareci [10]. We investigate how uncertainty in the imaging procedure propagates through all levels of the model: signals, tensor fields, vector fields, and fibers. We construct asymptotically normal estimators of the integral curves or fibers which allow us to trace the fibers together with confidence ellipsoids. The procedure is computationally intense as it blends linear algebra concepts from high order tensors with asymptotical statistical analysis. The theoretical results are illustrated on simulated and real datasets. This work generalizes the statistical methodology proposed for low angular resolution diffusion tensor imaging by Carmichael and Sakhanenko [3], to several fibers per voxel. It is also a pioneering statistical work on tractography from HARDI data. It avoids all the typical limitations of the deterministic tractography methods and it delivers the same information as probabilistic tractography methods. Our method is computationally cheap and it provides well-founded mathematical and statistical framework where diverse functionals on fibers, directions and tensors can be studied in a systematic and rigorous way.

Estimation of integral curves from high angular resolution diffusion imaging (HARDI) data

PubMed Central

Carmichael, Owen; Sakhanenko, Lyudmila

2015-01-01

We develop statistical methodology for a popular brain imaging technique HARDI based on the high order tensor model by Özarslan and Mareci [10]. We investigate how uncertainty in the imaging procedure propagates through all levels of the model: signals, tensor fields, vector fields, and fibers. We construct asymptotically normal estimators of the integral curves or fibers which allow us to trace the fibers together with confidence ellipsoids. The procedure is computationally intense as it blends linear algebra concepts from high order tensors with asymptotical statistical analysis. The theoretical results are illustrated on simulated and real datasets. This work generalizes the statistical methodology proposed for low angular resolution diffusion tensor imaging by Carmichael and Sakhanenko [3], to several fibers per voxel. It is also a pioneering statistical work on tractography from HARDI data. It avoids all the typical limitations of the deterministic tractography methods and it delivers the same information as probabilistic tractography methods. Our method is computationally cheap and it provides well-founded mathematical and statistical framework where diverse functionals on fibers, directions and tensors can be studied in a systematic and rigorous way. PMID:25937674

Design and rationale of a comparative effectiveness trial evaluating transcendental meditation against established therapies for PTSD.

PubMed

Rutledge, Thomas; Nidich, Sanford; Schneider, Robert H; Mills, Paul J; Salerno, John; Heppner, Pia; Gomez, Mayra A; Gaylord-King, Carolyn; Rainforth, Maxwell

2014-09-01

Although meditation therapies such as the Transcendental Meditation (TM) technique are commonly used to assist with stress and stress-related diseases, there remains a lack of rigorous clinical trial research establishing the relative efficacy of these treatments overall and for populations with psychiatric illness. This study uses a comparative effectiveness design to assess the relative benefits of TM to those obtained from a gold-standard cognitive behavioral therapy for posttraumatic stress disorder (PTSD) in a Veteran population. This paper describes the rationale and design of an in progress randomized controlled trial comparing TM to an established cognitive behavioral treatment - Prolonged Exposure (PE) - and an active control condition (health education [HE]) for PTSD. This trial will recruit 210 Veterans meeting DSM-IV criteria for PTSD, with testing conducted at 0 and 3 months for PTSD symptoms, depression, mood disturbance, quality of life, behavioral factors, and physiological/biochemical and gene expression mechanisms using validated measures. The study hypothesis is that TM will be noninferior to PE and superior to HE on changes in PTSD symptoms, using the Clinician Administered PTSD Scale (CAPS). The described study represents a methodologically rigorous protocol evaluating the benefits of TM for PTSD. The projected results will help to establish the overall efficacy of TM for PTSD among Veterans, identify bio-behavioral mechanisms through which TM and PE may improve PTSD symptoms, and will permit conclusions regarding the relative value of TM against currently established therapies for PTSD. Published by Elsevier Inc.

The quality of quality of life publications in the spinal literature: are we getting any better?

PubMed

Street, John; Lenehan, Brian; Fisher, Charles

2009-11-01

Criteria for methodological quality have been widely accepted in many fields of surgical practice. These criteria include those of Velanovich and Gill and Feinstein. No such analysis of the spine surgery literature has ever been reported. This study is a systematic review of the quality of life (QOL) publications to determine if the recent interest in QOL measurements following spinal surgery has been accompanied by an improvement in the quality of the papers published. The archives of the journals Journal of Neurosurgery: Spine, Spine, Journal of Spinal Disorders & Techniques, European Spine Journal, and The Spine Journal, for the years 2000-2004 inclusive, were examined, and all publications reporting QOL outcomes were analyzed. Each paper was scored according to the criteria of Velanovich and Gill and Feinstein, and the methodological quality of these manuscripts-and any time-dependent changes-were determined. During the study period, the total number of articles published increased by 36%, while the number of QOL articles increased by 102%. According to the criteria of Velanovich, there was a statistically significant improvement in the quality of the publications over the study period (p = 0.0394). In 2000, only 27% of outcome measures were disease specific, 77% were valid, and 77% were appropriate for the study design. In 2004, 43% were disease specific, 88% were valid, and 89% were appropriate. In 2000, 53% of studies used appropriate statistical analysis compared with 100 and 96% for 2003 and 2004, respectively. There was no demonstrable improvement in the fulfillment of the more rigorous Gill and Feinstein criteria for any of the 5 journals over the period of the study. The authors' study illustrates a moderate improvement in the quality of these publications over the study period but much methodological improvement is required.

The economic burden of diabetes in India: a review of the literature.

PubMed

Yesudian, Charles A K; Grepstad, Mari; Visintin, Erica; Ferrario, Alessandra

2014-12-02

Diabetes and its complications are a major cause of morbidity and mortality in India, and the prevalence of type 2 diabetes is on the rise. This calls for an assessment of the economic burden of the disease. To conduct a critical review of the literature on cost of illness studies of diabetes and its complications in India. A comprehensive literature review addressing the study objective was conducted. An extraction table and a scoring system to assess the quality of the studies reviewed were developed. A total of nineteen articles from different regions of India met the study inclusion criteria. The third party payer perspective was the most common study design (17 articles) while fewer articles (n =2) reported on costs from a health system or societal perspective. All the articles included direct costs and only a few (n =4) provided estimates for indirect costs based on income loss for patients and carers. Drug costs proved to be a significant cost component in several studies (n =12). While middle and high-income groups had higher expenditure in absolute terms, costs constituted a higher proportion of income for the poor. The economic burden was highest among urban groups. The overall quality of the studies is low due to a number of methodological weaknesses. The most frequent epidemiological approach employed was the prevalence-based one (n =18) while costs were mainly estimated using a bottom up approach (n =15). The body of literature on the costs of diabetes and its complications in India provides a fragmented picture that has mostly concentrated on the direct costs borne by individuals rather than the healthcare system. There is a need to develop a robust methodology to perform methodologically rigorous and transparent cost of illness studies to inform policy decisions.

An ex post facto evaluation framework for place-based police interventions.

PubMed

Braga, Anthony A; Hureau, David M; Papachristos, Andrew V

2011-12-01

A small but growing body of research evidence suggests that place-based police interventions generate significant crime control gains. While place-based policing strategies have been adopted by a majority of U.S. police departments, very few agencies make a priori commitments to rigorous evaluations. Recent methodological developments were applied to conduct a rigorous ex post facto evaluation of the Boston Police Department's Safe Street Team (SST) hot spots policing program. A nonrandomized quasi-experimental design was used to evaluate the violent crime control benefits of the SST program at treated street segments and intersections relative to untreated street segments and intersections. Propensity score matching techniques were used to identify comparison places in Boston. Growth curve regression models were used to analyze violent crime trends at treatment places relative to control places. UNITS OF ANALYSIS: Using computerized mapping and database software, a micro-level place database of violent index crimes at all street segments and intersections in Boston was created. Yearly counts of violent index crimes between 2000 and 2009 at the treatment and comparison street segments and intersections served as the key outcome measure. The SST program was associated with a statistically significant reduction in violent index crimes at the treatment places relative to the comparison places without displacing crime into proximate areas. To overcome the challenges of evaluation in real-world settings, evaluators need to continuously develop innovative approaches that take advantage of new theoretical and methodological approaches.

Paternal Influences on Adolescent Sexual Risk Behaviors: A Structured Literature Review

PubMed Central

Bouris, Alida; Lee, Jane; McCarthy, Katharine; Michael, Shannon L.; Pitt-Barnes, Seraphine; Dittus, Patricia

2012-01-01

BACKGROUND AND OBJECTIVE: To date, most parent-based research has neglected the role of fathers in shaping adolescent sexual behavior and has focused on mothers. The objective of this study was to conduct a structured review to assess the role of paternal influence on adolescent sexual behavior and to assess the methodological quality of the paternal influence literature related to adolescent sexual behavior. METHODS: We searched electronic databases: PubMed, PsychINFO, Social Services Abstracts, Family Studies Abstracts, Sociological Abstracts, and the Cumulative Index to Nursing and Allied Health Literature. Studies published between 1980 and 2011 that targeted adolescents 11 to 18 years and focused on paternal parenting processes were included. Methodological quality was assessed by using an 11-item scoring system. RESULTS: Thirteen articles were identified and reviewed. Findings suggest paternal factors are independently associated with adolescent sexual behavior relative to maternal factors. The most commonly studied paternal influence was emotional qualities of the father-adolescent relationship. Paternal communication about sex was most consistently associated with adolescent sexual behavior, whereas paternal attitudes about sex was least associated. Methodological limitations include a tendency to rely on cross-sectional design, nonprobability sampling methods, and focus on sexual debut versus broader sexual behavior. CONCLUSIONS: Existing research preliminarily suggests fathers influence the sexual behavior of their adolescent children; however, more rigorous research examining diverse facets of paternal influence on adolescent sexual behavior is needed. We provide recommendations for primary care providers and public health practitioners to better incorporate fathers into interventions designed to reduce adolescent sexual risk behavior. PMID:23071205

WHAT IS THE ROLE OF COMMUNITY PREFERENCE INFORMATION IN HEALTH TECHNOLOGY ASSESSMENT DECISION MAKING? A CASE STUDY OF COLORECTAL CANCER SCREENING.

PubMed

Wortley, Sally; Flitcroft, Kathy; Howard, Kirsten

2015-01-01

The aim of this study was to determine the role of community preference information from discrete choice studies of colorectal cancer (CRC) screening in health technology assessment (HTA) reports and subsequent policy decisions. We undertook a systematic review of discrete choice studies of CRC screening. Included studies were reviewed to assess the policy context of the research. For those studies that cited a recent or pending review of CRC screening, further searches were undertaken to determine the extent to which community preference information was incorporated into the HTA decision-making process. Eight discrete choice studies that evaluated preferences for CRC screening were identified. Four of these studies referred to a national or local review of CRC screening in three countries: Australia, Canada, and the Netherlands. Our review of subsequently released health policy documents showed that while consideration was given to community views on CRC, policy was not informed by discrete choice evidence. Preferences and values of patients are increasingly being considered "evidence" to be incorporated into HTA reports. Discrete choice methodology is a rigorous quantitative method for eliciting preferences and while as a methodology it is growing in profile, it would appear that the results of such research are not being systematically translated or integrated into HTA reports. A formalized approach is needed to incorporate preference literature into the HTA decision-making process.

A Rigorous Test of the Fit of the Circumplex Model to Big Five Personality Data: Theoretical and Methodological Issues and Two Large Sample Empirical Tests.

PubMed

DeGeest, David Scott; Schmidt, Frank

2015-01-01

Our objective was to apply the rigorous test developed by Browne (1992) to determine whether the circumplex model fits Big Five personality data. This test has yet to be applied to personality data. Another objective was to determine whether blended items explained correlations among the Big Five traits. We used two working adult samples, the Eugene-Springfield Community Sample and the Professional Worker Career Experience Survey. Fit to the circumplex was tested via Browne's (1992) procedure. Circumplexes were graphed to identify items with loadings on multiple traits (blended items), and to determine whether removing these items changed five-factor model (FFM) trait intercorrelations. In both samples, the circumplex structure fit the FFM traits well. Each sample had items with dual-factor loadings (8 items in the first sample, 21 in the second). Removing blended items had little effect on construct-level intercorrelations among FFM traits. We conclude that rigorous tests show that the fit of personality data to the circumplex model is good. This finding means the circumplex model is competitive with the factor model in understanding the organization of personality traits. The circumplex structure also provides a theoretically and empirically sound rationale for evaluating intercorrelations among FFM traits. Even after eliminating blended items, FFM personality traits remained correlated.

Analyzing the impacts of global trade and investment on non-communicable diseases and risk factors: a critical review of methodological approaches used in quantitative analyses.

PubMed

Cowling, Krycia; Thow, Anne Marie; Pollack Porter, Keshia

2018-05-24

A key mechanism through which globalization has impacted health is the liberalization of trade and investment, yet relatively few studies to date have used quantitative methods to investigate the impacts of global trade and investment policies on non-communicable diseases and risk factors. Recent reviews of this literature have found heterogeneity in results and a range of quality across studies, which may be in part attributable to a lack of conceptual clarity and methodological inconsistencies. This study is a critical review of methodological approaches used in the quantitative literature on global trade and investment and diet, tobacco, alcohol, and related health outcomes, with the objective of developing recommendations and providing resources to guide future robust, policy relevant research. A review of reviews, expert review, and reference tracing were employed to identify relevant studies, which were evaluated using a novel quality assessment tool designed for this research. Eight review articles and 34 quantitative studies were identified for inclusion. Important ways to improve this literature were identified and discussed: clearly defining exposures of interest and not conflating trade and investment; exploring mechanisms of broader relationships; increasing the use of individual-level data; ensuring consensus and consistency in key confounding variables; utilizing more sector-specific versus economy-wide trade and investment indicators; testing and adequately adjusting for autocorrelation and endogeneity when using longitudinal data; and presenting results from alternative statistical models and sensitivity analyses. To guide the development of future analyses, recommendations for international data sources for selected trade and investment indicators, as well as key gaps in the literature, are presented. More methodologically rigorous and consistent approaches in future quantitative studies on the impacts of global trade and investment policies on non-communicable diseases and risk factors can help to resolve inconsistencies of existing research and generate useful information to guide policy decisions.

Message Variability and Heterogeneity: A Core Challenge for Communication Research

PubMed Central

Slater, Michael D.; Peter, Jochen; Valkenberg, Patti

2015-01-01

Messages are central to human social experience, and pose key conceptual and methodological challenges in the study of communication. In response to these challenges, we outline a systematic approach to conceptualizing, operationalizing, and analyzing messages. At the conceptual level, we distinguish between two core aspects of messages: message variability (the defined and operationalized features of messages) and message heterogeneity (the undefined and unmeasured features of messages), and suggest preferred approaches to defining message variables. At the operational level, we identify message sampling, selection, and research design strategies responsive to issues of message variability and heterogeneity in experimental and survey research. At the analytical level, we highlight effective techniques to deal with message variability and heterogeneity. We conclude with seven recommendations to increase rigor in the study of communication through appropriately addressing the challenges presented by messages. PMID:26681816

Children's Antisocial Behavior, Mental Health, Drug Use, and Educational Performance After Parental Incarceration

PubMed Central

Murray, Joseph; Farrington, David P.; Sekol, Ivana

2012-01-01

Unprecedented numbers of children experience parental incarceration worldwide. Families and children of prisoners can experience multiple difficulties after parental incarceration, including traumatic separation, loneliness, stigma, confused explanations to children, unstable childcare arrangements, strained parenting, reduced income, and home, school, and neighborhood moves. Children of incarcerated parents often have multiple, stressful life events before parental incarceration. Theoretically, children with incarcerated parents may be at risk for a range of adverse behavioral outcomes. A systematic review was conducted to synthesize empirical evidence on associations between parental incarceration and children's later antisocial behavior, mental health problems, drug use, and educational performance. Results from 40 studies (including 7,374 children with incarcerated parents and 37,325 comparison children in 50 samples) were pooled in a meta-analysis. The most rigorous studies showed that parental incarceration is associated with higher risk for children's antisocial behavior, but not for mental health problems, drug use, or poor educational performance. Studies that controlled for parental criminality or children's antisocial behavior before parental incarceration had a pooled effect size of OR = 1.4 (p < .01), corresponding to about 10% increased risk for antisocial behavior among children with incarcerated parents, compared with peers. Effect sizes did not decrease with number of covariates controlled. However, the methodological quality of many studies was poor. More rigorous tests of the causal effects of parental incarceration are needed, using randomized designs and prospective longitudinal studies. Criminal justice reforms and national support systems might be needed to prevent harmful consequences of parental incarceration for children. PMID:22229730

Children's antisocial behavior, mental health, drug use, and educational performance after parental incarceration: a systematic review and meta-analysis.

PubMed

Murray, Joseph; Farrington, David P; Sekol, Ivana

2012-03-01

Unprecedented numbers of children experience parental incarceration worldwide. Families and children of prisoners can experience multiple difficulties after parental incarceration, including traumatic separation, loneliness, stigma, confused explanations to children, unstable childcare arrangements, strained parenting, reduced income, and home, school, and neighborhood moves. Children of incarcerated parents often have multiple, stressful life events before parental incarceration. Theoretically, children with incarcerated parents may be at risk for a range of adverse behavioral outcomes. A systematic review was conducted to synthesize empirical evidence on associations between parental incarceration and children's later antisocial behavior, mental health problems, drug use, and educational performance. Results from 40 studies (including 7,374 children with incarcerated parents and 37,325 comparison children in 50 samples) were pooled in a meta-analysis. The most rigorous studies showed that parental incarceration is associated with higher risk for children's antisocial behavior, but not for mental health problems, drug use, or poor educational performance. Studies that controlled for parental criminality or children's antisocial behavior before parental incarceration had a pooled effect size of OR = 1.4 (p < .01), corresponding to about 10% increased risk for antisocial behavior among children with incarcerated parents, compared with peers. Effect sizes did not decrease with number of covariates controlled. However, the methodological quality of many studies was poor. More rigorous tests of the causal effects of parental incarceration are needed, using randomized designs and prospective longitudinal studies. Criminal justice reforms and national support systems might be needed to prevent harmful consequences of parental incarceration for children.

Music for medical indications in the neonatal period: a systematic review of randomised controlled trials.

PubMed

Hartling, L; Shaik, M S; Tjosvold, L; Leicht, R; Liang, Y; Kumar, M

2009-09-01

To conduct a systematic review of the efficacy of music for medical indications in term or preterm neonates. We searched 17 electronic databases, subject bibliographies, reference lists and trials registries. Two reviewers independently screened studies for inclusion, assessed methodological quality, and extracted data. Meta-analysis was not feasible due to heterogeneity in outcomes so a qualitative analysis is presented. Nine randomised trials were included. The methodological quality was generally poor (median Jadad score = 1). The outcomes most commonly reported were physiological measures (heart rate (HR), respiratory rate, oxygen saturation (SaO2)), behavioural state and pain. Six studies evaluated music for the painful procedures circumcision (three trials) and heel prick (three trials). For circumcisions, one high quality pilot study (n = 23) showed benefits of music for the outcomes of HR, SaO2 and pain, while two low quality studies showed no difference. For heel prick, three low quality studies provided some evidence that music may be beneficial primarily for measures of behaviour and pain. The remaining studies evaluated the use of music in preterm infants to improve physiological and behavioural parameters (n = 31; benefits observed for behavioural parameters), to reinforce non-nutritive sucking via use of a pacifier activated lullaby (n = 32; significant increase in feeding rates), and to influence physiological stability and behaviours in infants with chronic lung disease (n = 22; no significant differences for outcomes assessed). The heterogeneity in study populations, interventions and outcomes precludes definitive conclusions around efficacy. There is preliminary evidence for some therapeutic benefits of music for specific indications; however, these findings need to be confirmed in methodologically rigorous trials.

Mental health interventions for children exposed to disasters and terrorism.

PubMed

Pfefferbaum, Betty; Newman, Elana; Nelson, Summer D

2014-02-01

The purpose of this review is to describe interventions used with children who are exposed to disasters and terrorism and to present information about the potential benefits of these interventions. A literature search conducted in January 2013 using relevant databases and literature known to the authors that was not generated by the search yielded a total of 85 studies appropriate for review. Intervention approaches used with children exposed to disasters and terrorism included preparedness interventions, psychological first aid, psychological debriefing, psychoeducation, cognitive behavioral techniques, exposure and narrative techniques, eye movement desensitization and reprocessing, and traumatic grief interventions. The investigation of these interventions is complex, and studies varied in methodological rigor (e.g., sample size, the use of control groups, outcomes measured). Given the limitations in the currently available empirical information, this review integrates the literature, draws tentative conclusions about the current state of knowledge, and suggests future directions for study.

Using collaborative research to facilitate student learning.

PubMed

Thompson, C J; McNeill, J A; Sherwood, G D; Starck, P L

2001-08-01

Developing research partnerships between academia and the service sector is an innovative way to meet the demand for high-quality, cost-effective, and clinically oriented research. Undergraduate student participation in clinical research is an educational strategy to facilitate positive mindsets toward research. This article outlines the methodological steps in recruiting and training undergraduate students for clinical research teams to benefit nurse educators, nurse researchers, students, and institutional partners. Student volunteers collected data for a study examining patient satisfaction with pain management practices. The research proposal was used to demonstrate principles of the research process and to familiarize the students with the study. A detailed study protocol guided the entire team through the project. Student sensitivity to pain assessment and management was enhanced. Learning the research process and the students' appreciation for the rigors of research were reinforced using this experiential model. Student evaluation of the research experience is presented.

Stress management training for military trainees returned to duty after a mental health evaluation: effect on graduation rates.

PubMed

Cigrang, J A; Todd, S L; Carbone, E G

2000-01-01

A significant proportion of people entering the military are discharged within the first 6 months of enlistment. Mental health related problems are often cited as the cause of discharge. This study evaluated the utility of stress inoculation training in helping reduce the attrition of a sample of Air Force trainees at risk for discharge from basic military training. Participants were 178 trainees referred for a psychological evaluation from basic training. Participants were randomly assigned to a 2-session stress management group or a usual-care control condition. Compared with past studies that used less rigorous methodology, this study did not find that exposure to stress management information increased the probability of graduating basic military training. Results are discussed in terms of possible reasons for the lack of treatment effects and directions for future research.

Parents' nonstandard work schedules and child well-being: a critical review of the literature.

PubMed

Li, Jianghong; Johnson, Sarah E; Han, Wen-Jui; Andrews, Sonia; Kendall, Garth; Strazdins, Lyndall; Dockery, Alfred

2014-02-01

This paper provides a comprehensive review of empirical evidence linking parental nonstandard work schedules to four main child developmental outcomes: internalizing and externalizing problems, cognitive development, and body mass index. We evaluated the studies based on theory and methodological rigor (longitudinal data, representative samples, consideration of selection and information bias, confounders, moderators, and mediators). Of 23 studies published between 1980 and 2012 that met the selection criteria, 21 reported significant associations between nonstandard work schedules and an adverse child developmental outcome. The associations were partially mediated through parental depressive symptoms, low quality parenting, reduced parent-child interaction and closeness, and a less supportive home environment. These associations were more pronounced in disadvantaged families and when parents worked such schedules full time. We discuss the nuance, strengths, and limitations of the existing studies, and propose recommendations for future research.