75 FR 2523 - Office of Innovation and Improvement; Overview Information; Arts in Education Model Development...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-01-15

... that is based on rigorous scientifically based research methods to assess the effectiveness of a...) Relies on measurements or observational methods that provide reliable and valid data across evaluators... of innovative, cohesive models that are based on research and have demonstrated that they effectively...

Methods of Quality Appraisal for Studies Reviewed by Evidence Clearinghouses

ERIC Educational Resources Information Center

Wilson, Sandra Jo; Tanner-Smith, Emily

2015-01-01

This presentation will discuss quality appraisal methods for assessing research studies used in systematic reviews, research syntheses, and evidence-based practice repositories such as the What Works Clearinghouse. The different ways that the methodological rigor and risk of bias of primary studies included in syntheses is assessed means that…

Rigour and Complexity in Educational Research. Conducting Educational Research

ERIC Educational Resources Information Center

Berry, Kathleen; Kincheloe, Joe

2004-01-01

What does it mean to engage in rigorous research? What does a researcher need to know to produce such research? What is specifically involved in multiple method bricolage research? In an era where talk abounds about scientific rigour and evidence-based research in education, this groundbreaking book presents a new and compelling examination of…

Autism and Pervasive Developmental Disorders

ERIC Educational Resources Information Center

Volkmar, Fred R.; Lord, Catherine; Bailey, Anthony; Schultz, Robert T.; Klin, Ami

2004-01-01

The quantity and quality of research into autism and related conditions have increased dramatically in recent years. Consequently we selectively review key accomplishments and highlight directions for future research. More consistent approaches to diagnosis and more rigorous assessment methods have significantly advanced research, although the…

The Navigation Guide Systematic Review Methodology: A Rigorous and Transparent Method for Translating Environmental Health Science into Better Health Outcomes

PubMed Central

Sutton, Patrice

2014-01-01

Background: Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. Objectives: We sought to develop a proof of concept of the “Navigation Guide,” a systematic and transparent method of research synthesis in environmental health. Discussion: The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of “risk of bias,” and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a “moderate” quality rating to human observational studies and combining diverse evidence streams. Conclusions: The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm. Citation: Woodruff TJ, Sutton P. 2014. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122:1007–1014; http://dx.doi.org/10.1289/ehp.1307175 PMID:24968373

Realizing Scientific Methods for Cyber Security

DOE Office of Scientific and Technical Information (OSTI.GOV)

Carroll, Thomas E.; Manz, David O.; Edgar, Thomas W.

There is little doubt among cyber security researchers about the lack of scientic rigor that underlies much of the liter-ature. The issues are manifold and are well documented. Further complicating the problem is insufficient scientic methods to address these issues. Cyber security melds man and machine: we inherit the challenges of computer science, sociology, psychology, and many other elds and create new ones where these elds interface. In this paper we detail a partial list of challenges imposed by rigorous science and survey how other sciences have tackled them, in the hope of applying a similar approach to cyber securitymore » science. This paper is by no means comprehensive: its purpose is to foster discussion in the community on how we can improve rigor in cyber security science.« less

Technology-Aided Instruction and Intervention for Students with ASD: A Meta-Analysis Using Novel Methods of Estimating Effect Sizes for Single-Case Research

ERIC Educational Resources Information Center

Barton, Erin E.; Pustejovsky, James E.; Maggin, Daniel M.; Reichow, Brian

2017-01-01

The adoption of methods and strategies validated through rigorous, experimentally oriented research is a core professional value of special education. We conducted a systematic review and meta-analysis examining the experimental literature on Technology-Aided Instruction and Intervention (TAII) using research identified as part of the National…

Implementing Quality Criteria in Designing and Conducting a Sequential Quan [right arrow] Qual Mixed Methods Study of Student Engagement with Learning Applied Research Methods Online

ERIC Educational Resources Information Center

Ivankova, Nataliya V.

2014-01-01

In spite of recent methodological developments related to quality assurance in mixed methods research, practical examples of how to implement quality criteria in designing and conducting sequential QUAN [right arrow] QUAL mixed methods studies to ensure the process is systematic and rigorous remain scarce. This article discusses a three-step…

The impact of rigorous mathematical thinking as learning method toward geometry understanding

NASA Astrophysics Data System (ADS)

Nugraheni, Z.; Budiyono, B.; Slamet, I.

2018-05-01

To reach higher order thinking skill, needed to be mastered the conceptual understanding. RMT is a unique realization of the cognitive conceptual construction approach based on Mediated Learning Experience (MLE) theory by Feurstein and Vygotsky’s sociocultural theory. This was quasi experimental research which was comparing the experimental class that was given Rigorous Mathematical Thinking (RMT) as learning method and control class that was given Direct Learning (DL) as the conventional learning activity. This study examined whether there was different effect of two learning method toward conceptual understanding of Junior High School students. The data was analyzed by using Independent t-test and obtained a significant difference of mean value between experimental and control class on geometry conceptual understanding. Further, by semi-structure interview known that students taught by RMT had deeper conceptual understanding than students who were taught by conventional way. By these result known that Rigorous Mathematical Thinking (RMT) as learning method have positive impact toward Geometry conceptual understanding.

A Meta-Analysis of Single-Subject Research on Behavioral Momentum to Enhance Success in Students with Autism.

PubMed

Cowan, Richard J; Abel, Leah; Candel, Lindsay

2017-05-01

We conducted a meta-analysis of single-subject research studies investigating the effectiveness of antecedent strategies grounded in behavioral momentum for improving compliance and on-task performance for students with autism. First, we assessed the research rigor of those studies meeting our inclusionary criteria. Next, in order to apply a universal metric to help determine the effectiveness of this category of antecedent strategies investigated via single-subject research methods, we calculated effect sizes via omnibus improvement rate differences (IRDs). Outcomes provide additional support for behavioral momentum, especially interventions incorporating the high-probability command sequence. Implications for research and practice are discussed, including the consideration of how single-subject research is systematically reviewed to assess the rigor of studies and assist in determining overall intervention effectiveness .

Health Promotion in Small Business

PubMed Central

McCoy, Kira; Stinson, Kaylan; Scott, Kenneth; Tenney, Liliana; Newman, Lee S.

2015-01-01

Objective To assess the evidence regarding the adoption and efficacy of worksite health promotion programs (WHPPs) in small businesses. Methods Peer-reviewed research articles were identified from a database search. Included articles were published before July 2013, described a study that used an experimental or quasiexperimental design and either assessed adoption of WHPPs or conducted interventions in businesses with fewer than 500 employees. A review team scored the study’s rigor using the WHO-adapted GRADEprofiler “quality of evidence” criteria. Results Of the 84 retrieved articles, 19 met study inclusion criteria. Of these, only two met criteria for high rigor. Conclusions Fewer small businesses adopt WHPPs compared with large businesses. Two high-rigor studies found that employees were healthier postintervention. Higher quality research is needed to better understand why small businesses rarely adopt wellness programs and to demonstrate the value of such programs. PMID:24905421

Biomedical text mining for research rigor and integrity: tasks, challenges, directions.

PubMed

Kilicoglu, Halil

2017-06-13

An estimated quarter of a trillion US dollars is invested in the biomedical research enterprise annually. There is growing alarm that a significant portion of this investment is wasted because of problems in reproducibility of research findings and in the rigor and integrity of research conduct and reporting. Recent years have seen a flurry of activities focusing on standardization and guideline development to enhance the reproducibility and rigor of biomedical research. Research activity is primarily communicated via textual artifacts, ranging from grant applications to journal publications. These artifacts can be both the source and the manifestation of practices leading to research waste. For example, an article may describe a poorly designed experiment, or the authors may reach conclusions not supported by the evidence presented. In this article, we pose the question of whether biomedical text mining techniques can assist the stakeholders in the biomedical research enterprise in doing their part toward enhancing research integrity and rigor. In particular, we identify four key areas in which text mining techniques can make a significant contribution: plagiarism/fraud detection, ensuring adherence to reporting guidelines, managing information overload and accurate citation/enhanced bibliometrics. We review the existing methods and tools for specific tasks, if they exist, or discuss relevant research that can provide guidance for future work. With the exponential increase in biomedical research output and the ability of text mining approaches to perform automatic tasks at large scale, we propose that such approaches can support tools that promote responsible research practices, providing significant benefits for the biomedical research enterprise. Published by Oxford University Press 2017. This work is written by a US Government employee and is in the public domain in the US.

Power of Statistical Tests Used to Address Nonresponse Error in the "Journal of Agricultural Education"

ERIC Educational Resources Information Center

Johnson, Donald M.; Shoulders, Catherine W.

2017-01-01

As members of a profession committed to the dissemination of rigorous research pertaining to agricultural education, authors publishing in the Journal of Agricultural Education (JAE) must seek methods to evaluate and, when necessary, improve their research methods. The purpose of this study was to describe how authors of manuscripts published in…

Trends in Methodological Rigor in Intervention Research Published in School Psychology Journals

ERIC Educational Resources Information Center

Burns, Matthew K.; Klingbeil, David A.; Ysseldyke, James E.; Petersen-Brown, Shawna

2012-01-01

Methodological rigor in intervention research is important for documenting evidence-based practices and has been a recent focus in legislation, including the No Child Left Behind Act. The current study examined the methodological rigor of intervention research in four school psychology journals since the 1960s. Intervention research has increased…

A Draft Conceptual Framework of Relevant Theories to Inform Future Rigorous Research on Student Service-Learning Outcomes

ERIC Educational Resources Information Center

Whitley, Meredith A.

2014-01-01

While the quality and quantity of research on service-learning has increased considerably over the past 20 years, researchers as well as governmental and funding agencies have called for more rigor in service-learning research. One key variable in improving rigor is using relevant existing theories to improve the research. The purpose of this…

To Your Health: NLM update transcript - Improving medical research rigor?

MedlinePlus

... be a well-tailored solution to enhance the quantitative rigor of medical research, suggests a viewpoint recently published in the Journal ... about 96 percent of medical and public health research articles (that report ... more quantitative rigor would attract widespread attention — if not high ...

Evaluating Rigor in Qualitative Methodology and Research Dissemination

ERIC Educational Resources Information Center

Trainor, Audrey A.; Graue, Elizabeth

2014-01-01

Despite previous and successful attempts to outline general criteria for rigor, researchers in special education have debated the application of rigor criteria, the significance or importance of small n research, the purpose of interpretivist approaches, and the generalizability of qualitative empirical results. Adding to these complications, the…

PRO development: rigorous qualitative research as the crucial foundation.

PubMed

Lasch, Kathryn Eilene; Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-10-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity.

PRO development: rigorous qualitative research as the crucial foundation

PubMed Central

Marquis, Patrick; Vigneux, Marc; Abetz, Linda; Arnould, Benoit; Bayliss, Martha; Crawford, Bruce; Rosa, Kathleen

2010-01-01

Recently published articles have described criteria to assess qualitative research in the health field in general, but very few articles have delineated qualitative methods to be used in the development of Patient-Reported Outcomes (PROs). In fact, how PROs are developed with subject input through focus groups and interviews has been given relatively short shrift in the PRO literature when compared to the plethora of quantitative articles on the psychometric properties of PROs. If documented at all, most PRO validation articles give little for the reader to evaluate the content validity of the measures and the credibility and trustworthiness of the methods used to develop them. Increasingly, however, scientists and authorities want to be assured that PRO items and scales have meaning and relevance to subjects. This article was developed by an international, interdisciplinary group of psychologists, psychometricians, regulatory experts, a physician, and a sociologist. It presents rigorous and appropriate qualitative research methods for developing PROs with content validity. The approach described combines an overarching phenomenological theoretical framework with grounded theory data collection and analysis methods to yield PRO items and scales that have content validity. PMID:20512662

Empirical Data and Emerging Power Critiques: Lessons Learned

ERIC Educational Resources Information Center

Stockman, Caroline

2016-01-01

This paper evidences the importance of maintaining a dynamic interpretive stance in e-learning research. In particular, it shows how a rigorous methodology, tailored to the research question, overlooked the importance of power and knowledge in technology acceptance research for education. It was perhaps the affordance of the mixed methods design,…

Systematically Identifying Relevant Research: Case Study on Child Protection Social Workers' Resilience

ERIC Educational Resources Information Center

McFadden, Paula; Taylor, Brian J.; Campbell, Anne; McQuilkin, Janice

2012-01-01

Context: The development of a consolidated knowledge base for social work requires rigorous approaches to identifying relevant research. Method: The quality of 10 databases and a web search engine were appraised by systematically searching for research articles on resilience and burnout in child protection social workers. Results: Applied Social…

Rigorous Photogrammetric Processing of CHANG'E-1 and CHANG'E-2 Stereo Imagery for Lunar Topographic Mapping

NASA Astrophysics Data System (ADS)

Di, K.; Liu, Y.; Liu, B.; Peng, M.

2012-07-01

Chang'E-1(CE-1) and Chang'E-2(CE-2) are the two lunar orbiters of China's lunar exploration program. Topographic mapping using CE-1 and CE-2 images is of great importance for scientific research as well as for preparation of landing and surface operation of Chang'E-3 lunar rover. In this research, we developed rigorous sensor models of CE-1 and CE-2 CCD cameras based on push-broom imaging principle with interior and exterior orientation parameters. Based on the rigorous sensor model, the 3D coordinate of a ground point in lunar body-fixed (LBF) coordinate system can be calculated by space intersection from the image coordinates of con-jugate points in stereo images, and the image coordinates can be calculated from 3D coordinates by back-projection. Due to uncer-tainties of the orbit and the camera, the back-projected image points are different from the measured points. In order to reduce these inconsistencies and improve precision, we proposed two methods to refine the rigorous sensor model: 1) refining EOPs by correcting the attitude angle bias, 2) refining the interior orientation model by calibration of the relative position of the two linear CCD arrays. Experimental results show that the mean back-projection residuals of CE-1 images are reduced to better than 1/100 pixel by method 1 and the mean back-projection residuals of CE-2 images are reduced from over 20 pixels to 0.02 pixel by method 2. Consequently, high precision DEM (Digital Elevation Model) and DOM (Digital Ortho Map) are automatically generated.

76 FR 39860 - Proposed Agency Information Collection

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-07

... ``Broad Program Area Categories'' (BPACs) for purposes of conducting the research. For each evaluation... data collection methods than those prescribed for high-rigor. For example, data may be collected by... methods to produce energy savings and outcome estimates. A range of qualitative, quantitative (survey), on...

Rigorous Science: a How-To Guide.

PubMed

Casadevall, Arturo; Fang, Ferric C

2016-11-08

Proposals to improve the reproducibility of biomedical research have emphasized scientific rigor. Although the word "rigor" is widely used, there has been little specific discussion as to what it means and how it can be achieved. We suggest that scientific rigor combines elements of mathematics, logic, philosophy, and ethics. We propose a framework for rigor that includes redundant experimental design, sound statistical analysis, recognition of error, avoidance of logical fallacies, and intellectual honesty. These elements lead to five actionable recommendations for research education. Copyright © 2016 Casadevall and Fang.

Strengthening the Scholarship of Teaching and Learning via Experimentation

ERIC Educational Resources Information Center

LoSchiavo, Frank M.; Shatz, Mark A.; Poling, Devereaux A.

2008-01-01

In recent years, national policy experts have questioned the overall quality of educational research, and they have suggested that researchers strengthen their scientific methods by maximizing the use of experimental designs. To promote more rigorous methodology, we discuss several new and often-overlooked opportunities for incorporating…

Reviewing the research methods literature: principles and strategies illustrated by a systematic overview of sampling in qualitative research.

PubMed

Gentles, Stephen J; Charles, Cathy; Nicholas, David B; Ploeg, Jenny; McKibbon, K Ann

2016-10-11

Overviews of methods are potentially useful means to increase clarity and enhance collective understanding of specific methods topics that may be characterized by ambiguity, inconsistency, or a lack of comprehensiveness. This type of review represents a distinct literature synthesis method, although to date, its methodology remains relatively undeveloped despite several aspects that demand unique review procedures. The purpose of this paper is to initiate discussion about what a rigorous systematic approach to reviews of methods, referred to here as systematic methods overviews, might look like by providing tentative suggestions for approaching specific challenges likely to be encountered. The guidance offered here was derived from experience conducting a systematic methods overview on the topic of sampling in qualitative research. The guidance is organized into several principles that highlight specific objectives for this type of review given the common challenges that must be overcome to achieve them. Optional strategies for achieving each principle are also proposed, along with discussion of how they were successfully implemented in the overview on sampling. We describe seven paired principles and strategies that address the following aspects: delimiting the initial set of publications to consider, searching beyond standard bibliographic databases, searching without the availability of relevant metadata, selecting publications on purposeful conceptual grounds, defining concepts and other information to abstract iteratively, accounting for inconsistent terminology used to describe specific methods topics, and generating rigorous verifiable analytic interpretations. Since a broad aim in systematic methods overviews is to describe and interpret the relevant literature in qualitative terms, we suggest that iterative decision making at various stages of the review process, and a rigorous qualitative approach to analysis are necessary features of this review type. We believe that the principles and strategies provided here will be useful to anyone choosing to undertake a systematic methods overview. This paper represents an initial effort to promote high quality critical evaluations of the literature regarding problematic methods topics, which have the potential to promote clearer, shared understandings, and accelerate advances in research methods. Further work is warranted to develop more definitive guidance.

Ethics Training of Law Enforcement Officers: The Optimum Means of Conveyance

ERIC Educational Resources Information Center

Redden, Donald L.

2010-01-01

The current research was designed to furnish an unpretentious but rigorous examination of the subject of ethics education, seeking the most commanding and useful method to deliver the curriculum. A review of the literature revealed several methods currently used to teach ethics. The respondents examined the various methods, noted the positive and…

Improved methods for distribution loss evaluation. Volume 1: analytic and evaluative techniques. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Flinn, D.G.; Hall, S.; Morris, J.

This volume describes the background research, the application of the proposed loss evaluation techniques, and the results. The research identified present loss calculation methods as appropriate, provided care was taken to represent the various system elements in sufficient detail. The literature search of past methods and typical data revealed that extreme caution in using typical values (load factor, etc.) should be taken to ensure that all factors were referred to the same time base (daily, weekly, etc.). The performance of the method (and computer program) proposed in this project was determined by comparison of results with a rigorous evaluation ofmore » losses on the Salt River Project system. This rigorous evaluation used statistical modeling of the entire system as well as explicit enumeration of all substation and distribution transformers. Further tests were conducted at Public Service Electric and Gas of New Jersey to check the appropriateness of the methods in a northern environment. Finally sensitivity tests indicated data elements inaccuracy of which would most affect the determination of losses using the method developed in this project.« less

Qualitative Methods in Mental Health Services Research

PubMed Central

Palinkas, Lawrence A.

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This paper reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the papers included in this special series along with representative examples from the literature. Qualitative methods are used to provide a “thick description” or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods, but often differ with respect to study design, data collection and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semi-structured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research. PMID:25350675

Qualitative and mixed methods in mental health services and implementation research.

PubMed

Palinkas, Lawrence A

2014-01-01

Qualitative and mixed methods play a prominent role in mental health services research. However, the standards for their use are not always evident, especially for those not trained in such methods. This article reviews the rationale and common approaches to using qualitative and mixed methods in mental health services and implementation research based on a review of the articles included in this special series along with representative examples from the literature. Qualitative methods are used to provide a "thick description" or depth of understanding to complement breadth of understanding afforded by quantitative methods, elicit the perspective of those being studied, explore issues that have not been well studied, develop conceptual theories or test hypotheses, or evaluate the process of a phenomenon or intervention. Qualitative methods adhere to many of the same principles of scientific rigor as quantitative methods but often differ with respect to study design, data collection, and data analysis strategies. For instance, participants for qualitative studies are usually sampled purposefully rather than at random and the design usually reflects an iterative process alternating between data collection and analysis. The most common techniques for data collection are individual semistructured interviews, focus groups, document reviews, and participant observation. Strategies for analysis are usually inductive, based on principles of grounded theory or phenomenology. Qualitative methods are also used in combination with quantitative methods in mixed-method designs for convergence, complementarity, expansion, development, and sampling. Rigorously applied qualitative methods offer great potential in contributing to the scientific foundation of mental health services research.

A Randomized Study of How Physicians Interpret Research Funding Disclosures

PubMed Central

Kesselheim, Aaron S.; Robertson, Christopher T.; Myers, Jessica A.; Rose, Susannah L.; Gillet, Victoria; Ross, Kathryn M.; Glynn, Robert J.; Joffe, Steven; Avorn, Jerry

2012-01-01

BACKGROUND The effects of clinical-trial funding on the interpretation of trial results are poorly understood. We examined how such support affects physicians’ reactions to trials with a high, medium, or low level of methodologic rigor. METHODS We presented 503 board-certified internists with abstracts that we designed describing clinical trials of three hypothetical drugs. The trials had high, medium, or low methodologic rigor, and each report included one of three support disclosures: funding from a pharmaceutical company, NIH funding, or none. For both factors studied (rigor and funding), one of the three possible variations was randomly selected for inclusion in the abstracts. Follow-up questions assessed the physicians’ impressions of the trials’ rigor, their confidence in the results, and their willingness to prescribe the drugs. RESULTS The 269 respondents (53.5% response rate) perceived the level of study rigor accurately. Physicians reported that they would be less willing to prescribe drugs tested in low-rigor trials than those tested in medium-rigor trials (odds ratio, 0.64; 95% confidence interval [CI], 0.46 to 0.89; P = 0.008) and would be more willing to prescribe drugs tested in high-rigor trials than those tested in medium-rigor trials (odds ratio, 3.07; 95% CI, 2.18 to 4.32; P<0.001). Disclosure of industry funding, as compared with no disclosure of funding, led physicians to downgrade the rigor of a trial (odds ratio, 0.63; 95% CI, 0.46 to 0.87; P = 0.006), their confidence in the results (odds ratio, 0.71; 95% CI, 0.51 to 0.98; P = 0.04), and their willingness to prescribe the hypothetical drugs (odds ratio, 0.68; 95% CI, 0.49 to 0.94; P = 0.02). Physicians were half as willing to prescribe drugs studied in industry-funded trials as they were to prescribe drugs studied in NIH-funded trials (odds ratio, 0.52; 95% CI, 0.37 to 0.71; P<0.001). These effects were consistent across all levels of methodologic rigor. CONCLUSIONS Physicians discriminate among trials of varying degrees of rigor, but industry sponsorship negatively influences their perception of methodologic quality and reduces their willingness to believe and act on trial findings, independently of the trial’s quality. These effects may influence the translation of clinical research into practice. PMID:22992075

Longitudinal Research with Sexual Assault Survivors: A Methodological Review

ERIC Educational Resources Information Center

Campbell, Rebecca; Sprague, Heather Brown; Cottrill, Sara; Sullivan, Cris M.

2011-01-01

Longitudinal research designs are relatively rare in the academic literature on rape and sexual assault despite their tremendous methodological rigor and scientific utility. In the interest of promoting wider use of such methods, we conducted a methodological review of projects that have used prospective longitudinal designs to study the…

Examining Multidimensional Middle Grade Outcomes after Early Elementary School Grade Retention

ERIC Educational Resources Information Center

Hwang, Sophia; Cappella, Elise; Schwartz, Kate

2016-01-01

Recently, researchers have begun to employ rigorous statistical methods and developmentally-informed theories to evaluate outcomes for students retained in non-kindergarten early elementary school. However, the majority of this research focuses on academic outcomes. Gaps remain regarding retention's effects on psychosocial outcomes important to…

Faster, Richer, Better: Rapid Appraisal Techniques for the Study of IS Implementation in Virtual Communities

ERIC Educational Resources Information Center

Wilkins, Linda; Swatman, Paula; Castleman, Tanya

2004-01-01

A major issue in Information Systems (IS) research is how to combine relevance and rigor (Benbasat & Zmud, 1999) and reduce the widening gap between research results and adoption (Dunn, 1994). Qualitative researchers make use of interpretivist methods to add richness and depth to their understanding of user problems. Interpretivist methods…

Considerations for the Systematic Analysis and Use of Single-Case Research

ERIC Educational Resources Information Center

Horner, Robert H.; Swaminathan, Hariharan; Sugai, George; Smolkowski, Keith

2012-01-01

Single-case research designs provide a rigorous research methodology for documenting experimental control. If single-case methods are to gain wider application, however, a need exists to define more clearly (a) the logic of single-case designs, (b) the process and decision rules for visual analysis, and (c) an accepted process for integrating…

Rigor or Reliability and Validity in Qualitative Research: Perspectives, Strategies, Reconceptualization, and Recommendations.

PubMed

Cypress, Brigitte S

Issues are still raised even now in the 21st century by the persistent concern with achieving rigor in qualitative research. There is also a continuing debate about the analogous terms reliability and validity in naturalistic inquiries as opposed to quantitative investigations. This article presents the concept of rigor in qualitative research using a phenomenological study as an exemplar to further illustrate the process. Elaborating on epistemological and theoretical conceptualizations by Lincoln and Guba, strategies congruent with qualitative perspective for ensuring validity to establish the credibility of the study are described. A synthesis of the historical development of validity criteria evident in the literature during the years is explored. Recommendations are made for use of the term rigor instead of trustworthiness and the reconceptualization and renewed use of the concept of reliability and validity in qualitative research, that strategies for ensuring rigor must be built into the qualitative research process rather than evaluated only after the inquiry, and that qualitative researchers and students alike must be proactive and take responsibility in ensuring the rigor of a research study. The insights garnered here will move novice researchers and doctoral students to a better conceptual grasp of the complexity of reliability and validity and its ramifications for qualitative inquiry.

Building "Applied Linguistic Historiography": Rationale, Scope, and Methods

ERIC Educational Resources Information Center

Smith, Richard

2016-01-01

In this article I argue for the establishment of "Applied Linguistic Historiography" (ALH), that is, a new domain of enquiry within applied linguistics involving a rigorous, scholarly, and self-reflexive approach to historical research. Considering issues of rationale, scope, and methods in turn, I provide reasons why ALH is needed and…

A Methodology for Conducting Integrative Mixed Methods Research and Data Analyses

PubMed Central

Castro, Felipe González; Kellison, Joshua G.; Boyd, Stephen J.; Kopak, Albert

2011-01-01

Mixed methods research has gained visibility within the last few years, although limitations persist regarding the scientific caliber of certain mixed methods research designs and methods. The need exists for rigorous mixed methods designs that integrate various data analytic procedures for a seamless transfer of evidence across qualitative and quantitative modalities. Such designs can offer the strength of confirmatory results drawn from quantitative multivariate analyses, along with “deep structure” explanatory descriptions as drawn from qualitative analyses. This article presents evidence generated from over a decade of pilot research in developing an integrative mixed methods methodology. It presents a conceptual framework and methodological and data analytic procedures for conducting mixed methods research studies, and it also presents illustrative examples from the authors' ongoing integrative mixed methods research studies. PMID:22167325

Designing a mixed methods study in primary care.

PubMed

Creswell, John W; Fetters, Michael D; Ivankova, Nataliya V

2004-01-01

Mixed methods or multimethod research holds potential for rigorous, methodologically sound investigations in primary care. The objective of this study was to use criteria from the literature to evaluate 5 mixed methods studies in primary care and to advance 3 models useful for designing such investigations. We first identified criteria from the social and behavioral sciences to analyze mixed methods studies in primary care research. We then used the criteria to evaluate 5 mixed methods investigations published in primary care research journals. Of the 5 studies analyzed, 3 included a rationale for mixing based on the need to develop a quantitative instrument from qualitative data or to converge information to best understand the research topic. Quantitative data collection involved structured interviews, observational checklists, and chart audits that were analyzed using descriptive and inferential statistical procedures. Qualitative data consisted of semistructured interviews and field observations that were analyzed using coding to develop themes and categories. The studies showed diverse forms of priority: equal priority, qualitative priority, and quantitative priority. Data collection involved quantitative and qualitative data gathered both concurrently and sequentially. The integration of the quantitative and qualitative data in these studies occurred between data analysis from one phase and data collection from a subsequent phase, while analyzing the data, and when reporting the results. We recommend instrument-building, triangulation, and data transformation models for mixed methods designs as useful frameworks to add rigor to investigations in primary care. We also discuss the limitations of our study and the need for future research.

Using Microanalytical Simulation Methods in Educational Evaluation: An Exploratory Study

ERIC Educational Resources Information Center

Sondergeld, Toni A.; Beltyukova, Svetlana A.; Fox, Christine M.; Stone, Gregory E.

2012-01-01

Scientifically based research used to inform evidence based school reform efforts has been required by the federal government in order to receive grant funding since the reenactment of No Child Left Behind (2002). Educational evaluators are thus faced with the challenge to use rigorous research designs to establish causal relationships. However,…

Assessing Student Achievement in Large-Scale Educational Programs Using Hierarchical Propensity Scores

ERIC Educational Resources Information Center

Vaughan, Angela L.; Lalonde, Trent L.; Jenkins-Guarnieri, Michael A.

2014-01-01

Many researchers assessing the efficacy of educational programs face challenges due to issues with non-randomization and the likelihood of dependence between nested subjects. The purpose of the study was to demonstrate a rigorous research methodology using a hierarchical propensity score matching method that can be utilized in contexts where…

School Psychology as a Relational Enterprise: The Role and Process of Qualitative Methodology

ERIC Educational Resources Information Center

Newman, Daniel S.; Clare, Mary M.

2016-01-01

The purpose of this article is to explore the application of qualitative research to establishing a more complete understanding of relational processes inherent in school psychology practice. We identify the building blocks of rigorous qualitative research design through a conceptual overview of qualitative paradigms, methodologies, methods (i.e.,…

The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes.

PubMed

Woodruff, Tracey J; Sutton, Patrice

2014-10-01

Synthesizing what is known about the environmental drivers of health is instrumental to taking prevention-oriented action. Methods of research synthesis commonly used in environmental health lag behind systematic review methods developed in the clinical sciences over the past 20 years. We sought to develop a proof of concept of the "Navigation Guide," a systematic and transparent method of research synthesis in environmental health. The Navigation Guide methodology builds on best practices in research synthesis in evidence-based medicine and environmental health. Key points of departure from current methods of expert-based narrative review prevalent in environmental health include a prespecified protocol, standardized and transparent documentation including expert judgment, a comprehensive search strategy, assessment of "risk of bias," and separation of the science from values and preferences. Key points of departure from evidence-based medicine include assigning a "moderate" quality rating to human observational studies and combining diverse evidence streams. The Navigation Guide methodology is a systematic and rigorous approach to research synthesis that has been developed to reduce bias and maximize transparency in the evaluation of environmental health information. Although novel aspects of the method will require further development and validation, our findings demonstrated that improved methods of research synthesis under development at the National Toxicology Program and under consideration by the U.S. Environmental Protection Agency are fully achievable. The institutionalization of robust methods of systematic and transparent review would provide a concrete mechanism for linking science to timely action to prevent harm.

Exploring Student Perceptions of Rigor Online: Toward a Definition of Rigorous Learning

ERIC Educational Resources Information Center

Duncan, Heather E.; Range, Bret; Hvidston, David

2013-01-01

Technological advances in the last decade have impacted delivery methods of university courses. More and more courses are offered in a variety of formats. While academic rigor is a term often used, its definition is less clear. This mixed-methods study explored graduate student conceptions of rigor in the online learning environment embedded…

Moving beyond Data Transcription: Rigor as Issue in Representation of Digital Literacies

ERIC Educational Resources Information Center

Hagood, Margaret Carmody; Skinner, Emily Neil

2015-01-01

Rigor in qualitative research has been based upon criteria of credibility, dependability, confirmability, and transferability. Drawing upon articles published during our editorship of the "Journal of Adolescent & Adult Literacy," we illustrate how the use of digital data in research study reporting may enhance these areas of rigor,…

How LIS Scholars Conceptualize Rigor in Qualitative Data

ERIC Educational Resources Information Center

Dempsey, Paula R.

2018-01-01

This study investigated how library and information science (LIS) scholars who used qualitative data explained and justified their methods. It analyzed research tasks mentioned in the methods sections of 151 peer-reviewed LIS studies published from 2011 to 2015 and in a survey of their authors. The study assumed that professors of LIS would…

Rigorous Science: a How-To Guide

PubMed Central

Fang, Ferric C.

2016-01-01

ABSTRACT Proposals to improve the reproducibility of biomedical research have emphasized scientific rigor. Although the word “rigor” is widely used, there has been little specific discussion as to what it means and how it can be achieved. We suggest that scientific rigor combines elements of mathematics, logic, philosophy, and ethics. We propose a framework for rigor that includes redundant experimental design, sound statistical analysis, recognition of error, avoidance of logical fallacies, and intellectual honesty. These elements lead to five actionable recommendations for research education. PMID:27834205

A critical methodological review of discourse and conversation analysis studies of family therapy.

PubMed

Tseliou, Eleftheria

2013-12-01

Discourse (DA) and conversation (CA) analysis, two qualitative research methods, have been recently suggested as potentially promising for the study of family therapy due to common epistemological adherences and their potential for an in situ study of therapeutic dialog. However, to date, there is no systematic methodological review of the few existing DA and CA studies of family therapy. This study aims at addressing this lack by critically reviewing published DA and CA studies of family therapy on methodological grounds. Twenty-eight articles in total are reviewed in relation to certain methodological axes identified in the relevant literature. These include choice of method, framing of research question(s), data/sampling, type of analysis, epistemological perspective, content/type of knowledge claims, and attendance to criteria for good quality practice. It is argued that the reviewed studies show "glimpses" of the methods' potential for family therapy research despite the identification of certain "shortcomings" regarding their methodological rigor. These include unclearly framed research questions and the predominance of case study designs. They also include inconsistencies between choice of method, stated or unstated epistemological orientations and knowledge claims, and limited attendance to criteria for good quality practice. In conclusion, it is argued that DA and CA can add to the existing quantitative and qualitative methods for family therapy research. They can both offer unique ways for a detailed study of the actual therapeutic dialog, provided that future attempts strive for a methodologically rigorous practice and against their uncritical deployment. © FPI, Inc.

Designing A Mixed Methods Study In Primary Care

PubMed Central

Creswell, John W.; Fetters, Michael D.; Ivankova, Nataliya V.

2004-01-01

BACKGROUND Mixed methods or multimethod research holds potential for rigorous, methodologically sound investigations in primary care. The objective of this study was to use criteria from the literature to evaluate 5 mixed methods studies in primary care and to advance 3 models useful for designing such investigations. METHODS We first identified criteria from the social and behavioral sciences to analyze mixed methods studies in primary care research. We then used the criteria to evaluate 5 mixed methods investigations published in primary care research journals. RESULTS Of the 5 studies analyzed, 3 included a rationale for mixing based on the need to develop a quantitative instrument from qualitative data or to converge information to best understand the research topic. Quantitative data collection involved structured interviews, observational checklists, and chart audits that were analyzed using descriptive and inferential statistical procedures. Qualitative data consisted of semistructured interviews and field observations that were analyzed using coding to develop themes and categories. The studies showed diverse forms of priority: equal priority, qualitative priority, and quantitative priority. Data collection involved quantitative and qualitative data gathered both concurrently and sequentially. The integration of the quantitative and qualitative data in these studies occurred between data analysis from one phase and data collection from a subsequent phase, while analyzing the data, and when reporting the results. DISCUSSION We recommend instrument-building, triangulation, and data transformation models for mixed methods designs as useful frameworks to add rigor to investigations in primary care. We also discuss the limitations of our study and the need for future research. PMID:15053277

Considering Research Outcomes as Essential Tools for Medical Education Decision Making.

PubMed

Miller, Karen Hughes; Miller, Bonnie M; Karani, Reena

2015-11-01

As medical educators face the challenge of incorporating new content, learning methods, and assessment techniques into the curriculum, the need for rigorous medical education research to guide efficient and effective instructional planning increases. When done properly, well-designed education research can provide guidance for complex education decision making. In this Commentary, the authors consider the 2015 Research in Medical Education (RIME) research and review articles in terms of the critical areas in teaching and learning that they address. The broad categories include (1) assessment (the largest collection of RIME articles, including both feedback from learners and instructors and the reliability of learner assessment), (2) the institution's impact on the learning environment, (3) what can be learned from program evaluation, and (4) emerging issues in faculty development. While the articles in this issue are broad in scope and potential impact, the RIME committee noted few studies of sufficient rigor focusing on areas of diversity and diverse learners. Although challenging to investigate, the authors encourage continuing innovation in research focused on these important areas.

New tools for Content Innovation and data sharing: Enhancing reproducibility and rigor in biomechanics research.

PubMed

Guilak, Farshid

2017-03-21

We are currently in one of the most exciting times for science and engineering as we witness unprecedented growth in our computational and experimental capabilities to generate new data and models. To facilitate data and model sharing, and to enhance reproducibility and rigor in biomechanics research, the Journal of Biomechanics has introduced a number of tools for Content Innovation to allow presentation, sharing, and archiving of methods, models, and data in our articles. The tools include an Interactive Plot Viewer, 3D Geometric Shape and Model Viewer, Virtual Microscope, Interactive MATLAB Figure Viewer, and Audioslides. Authors are highly encouraged to make use of these in upcoming journal submissions. Copyright © 2017 Elsevier Ltd. All rights reserved.

Rigor, vigor, and the study of health disparities

PubMed Central

Adler, Nancy; Bush, Nicole R.; Pantell, Matthew S.

2012-01-01

Health disparities research spans multiple fields and methods and documents strong links between social disadvantage and poor health. Associations between socioeconomic status (SES) and health are often taken as evidence for the causal impact of SES on health, but alternative explanations, including the impact of health on SES, are plausible. Studies showing the influence of parents’ SES on their children’s health provide evidence for a causal pathway from SES to health, but have limitations. Health disparities researchers face tradeoffs between “rigor” and “vigor” in designing studies that demonstrate how social disadvantage becomes biologically embedded and results in poorer health. Rigorous designs aim to maximize precision in the measurement of SES and health outcomes through methods that provide the greatest control over temporal ordering and causal direction. To achieve precision, many studies use a single SES predictor and single disease. However, doing so oversimplifies the multifaceted, entwined nature of social disadvantage and may overestimate the impact of that one variable and underestimate the true impact of social disadvantage on health. In addition, SES effects on overall health and functioning are likely to be greater than effects on any one disease. Vigorous designs aim to capture this complexity and maximize ecological validity through more complete assessment of social disadvantage and health status, but may provide less-compelling evidence of causality. Newer approaches to both measurement and analysis may enable enhanced vigor as well as rigor. Incorporating both rigor and vigor into studies will provide a fuller understanding of the causes of health disparities. PMID:23045672

Using qualitative mixed methods to study small health care organizations while maximising trustworthiness and authenticity.

PubMed

Phillips, Christine B; Dwan, Kathryn; Hepworth, Julie; Pearce, Christopher; Hall, Sally

2014-11-19

The primary health care sector delivers the majority of health care in western countries through small, community-based organizations. However, research into these healthcare organizations is limited by the time constraints and pressure facing them, and the concern by staff that research is peripheral to their work. We developed Q-RARA-Qualitative Rapid Appraisal, Rigorous Analysis-to study small, primary health care organizations in a way that is efficient, acceptable to participants and methodologically rigorous. Q-RARA comprises a site visit, semi-structured interviews, structured and unstructured observations, photographs, floor plans, and social scanning data. Data were collected over the course of one day per site and the qualitative analysis was integrated and iterative. We found Q-RARA to be acceptable to participants and effective in collecting data on organizational function in multiple sites without disrupting the practice, while maintaining a balance between speed and trustworthiness. The Q-RARA approach is capable of providing a richly textured, rigorous understanding of the processes of the primary care practice while also allowing researchers to develop an organizational perspective. For these reasons the approach is recommended for use in small-scale organizations both within and outside the primary health care sector.

Commentary: Writing and Evaluating Qualitative Research Reports

PubMed Central

Thompson, Deborah; Aroian, Karen J.; McQuaid, Elizabeth L.; Deatrick, Janet A.

2016-01-01

Objective To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. Methods A question and answer format is used to address considerations for writing and evaluating qualitative research. Results and Conclusions When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field’s ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. PMID:27118271

From screening to synthesis: using nvivo to enhance transparency in qualitative evidence synthesis.

PubMed

Houghton, Catherine; Murphy, Kathy; Meehan, Ben; Thomas, James; Brooker, Dawn; Casey, Dympna

2017-03-01

To explore the experiences and perceptions of healthcare staff caring for people with dementia in the acute setting. This article focuses on the methodological process of conducting framework synthesis using nvivo for each stage of the review: screening, data extraction, synthesis and critical appraisal. Qualitative evidence synthesis brings together many research findings in a meaningful way that can be used to guide practice and policy development. For this purpose, synthesis must be conducted in a comprehensive and rigorous way. There has been previous discussion on how using nvivo can assist in enhancing and illustrate the rigorous processes involved. Qualitative framework synthesis. Twelve documents, or research reports, based on nine studies, were included for synthesis. The benefits of using nvivo are outlined in terms of facilitating teams of researchers to systematically and rigorously synthesise findings. nvivo functions were used to conduct a sensitivity analysis. Some valuable lessons were learned, and these are presented to assist and guide researchers who wish to use similar methods in future. Ultimately, good qualitative evidence synthesis will provide practitioners and policymakers with significant information that will guide decision-making on many aspects of clinical practice. The example provided explored how people with dementia are cared for acute settings. © 2016 The Authors. Journal of Clinical Nursing Published by John Wiley & Sons Ltd.

Increasing the Rigor of Procedural Fidelity Assessment: An Empirical Comparison of Direct Observation and Permanent Product Review Methods

ERIC Educational Resources Information Center

Sanetti, Lisa M. Hagermoser; Collier-Meek, Melissa A.

2014-01-01

Although it is widely accepted that procedural fidelity data are important for making valid decisions about intervention effectiveness, there is little empirical guidance for researchers and practitioners regarding how to assess procedural fidelity. A first step in moving procedural fidelity assessment research forward is to develop a…

Establishing Interventions via a Theory-Driven Single Case Design Research Cycle

ERIC Educational Resources Information Center

Kilgus, Stephen P.; Riley-Tillman, T. Chris; Kratochwill, Thomas R.

2016-01-01

Recent studies have suggested single case design (SCD) intervention research is subject to publication bias, wherein studies are more likely to be published if they possess large or statistically significant effects and use rigorous experimental methods. The nature of SCD and the purposes for which it might be used could suggest that large effects…

What Do We Know and How Well Do We Know It? Identifying Practice-Based Insights in Education

ERIC Educational Resources Information Center

Miller, Barbara; Pasley, Joan

2012-01-01

Knowledge derived from practice forms a significant portion of the knowledge base in the education field, yet is not accessible using existing empirical research methods. This paper describes a systematic, rigorous, grounded approach to collecting and analysing practice-based knowledge using the authors' research in teacher leadership as an…

Bridging Gaps and Preserving Memories through Oral History Research and Writing

ERIC Educational Resources Information Center

Dayton-Wood, Amy; Hammonds, Laren; Matherson, Lisa; Tollison, Leah

2012-01-01

In spring of 2010, three high school teachers and their students paired with a college teacher and her advanced writing class to collaborate on oral history research and writing. While many people think of oral history as "just stories," the authors introduce it to students as a rigorous method for documenting historical events, cultural…

Growing a Professional Identity: A Grounded Theory of the Educational Experience of Baccalaureate Nursing Students

ERIC Educational Resources Information Center

Goodolf, Dawn M.

2013-01-01

Nursing students experience high levels of stress while enrolled in baccalaureate nursing programs. Research has focused on the contributors of stress such as the responsibilities of patient care, the overwhelming amount of information, high stakes methods of evaluation, and rigorous course schedules. Little research has been found on the personal…

When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

PubMed

Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

2016-10-01

Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

Rigorous, robust and systematic: Qualitative research and its contribution to burn care. An integrative review.

PubMed

Kornhaber, Rachel Anne; de Jong, A E E; McLean, L

2015-12-01

Qualitative methods are progressively being implemented by researchers for exploration within healthcare. However, there has been a longstanding and wide-ranging debate concerning the relative merits of qualitative research within the health care literature. This integrative review aimed to exam the contribution of qualitative research in burns care and subsequent rehabilitation. Studies were identified using an electronic search strategy using the databases PubMed, Cumulative Index of Nursing and Allied Health Literature (CINAHL), Excerpta Medica database (EMBASE) and Scopus of peer reviewed primary research in English between 2009 to April 2014 using Whittemore and Knafl's integrative review method as a guide for analysis. From the 298 papers identified, 26 research papers met the inclusion criteria. Across all studies there was an average of 22 participants involved in each study with a range of 6-53 participants conducted across 12 nations that focussed on burns prevention, paediatric burns, appropriate acquisition and delivery of burns care, pain and psychosocial implications of burns trauma. Careful and rigorous application of qualitative methodologies promotes and enriches the development of burns knowledge. In particular, the key elements in qualitative methodological process and its publication are critical in disseminating credible and methodologically sound qualitative research. Copyright © 2015 Elsevier Ltd and ISBI. All rights reserved.

Efficacy methods to evaluate health communication and marketing campaigns.

PubMed

Evans, W Douglas; Uhrig, Jennifer; Davis, Kevin; McCormack, Lauren

2009-06-01

Communication and marketing are growing areas of health research, but relatively few rigorous efficacy studies have been conducted in these fields. In this article, we review recent health communication and marketing efficacy research, present two case studies that illustrate some of the considerations in making efficacy design choices, and advocate for greater emphasis on rigorous health communication and marketing efficacy research and the development of a research agenda. Much of the outcomes research in health communication and marketing, especially mass media, utilizes effectiveness designs conducted in real time, in the media markets or communities in which messages are delivered. Such evaluations may be impractical or impossible, however, imiting opportunities to advance the state of health communication and marketing research and the knowledge base on effective campaign strategies, messages, and channels. Efficacy and effectiveness studies use similar measures of behavior change. Efficacy studies, however, offer greater opportunities for experimental control, message exposure, and testing of health communication and marketing theory. By examining the literature and two in-depth case studies, we identify advantages and limitations to efficacy studies. We also identify considerations for when to adopt efficacy and effectiveness methods, alone or in combination. Finally, we outline a research agenda to investigate issues of internal and external validity, mode of message presentation, differences between marketing and message strategies, and behavioral outcomes.

Mixed methods in psychotherapy research: A review of method(ology) integration in psychotherapy science.

PubMed

Bartholomew, Theodore T; Lockard, Allison J

2018-06-13

Mixed methods can foster depth and breadth in psychological research. However, its use remains in development in psychotherapy research. Our purpose was to review the use of mixed methods in psychotherapy research. Thirty-one studies were identified via the PRISMA systematic review method. Using Creswell & Plano Clark's typologies to identify design characteristics, we assessed each study for rigor and how each used mixed methods. Key features of mixed methods designs and these common patterns were identified: (a) integration of clients' perceptions via mixing; (b) understanding group psychotherapy; (c) integrating methods with cases and small samples; (d) analyzing clinical data as qualitative data; and (e) exploring cultural identities in psychotherapy through mixed methods. The review is discussed with respect to the value of integrating multiple data in single studies to enhance psychotherapy research. © 2018 Wiley Periodicals, Inc.

The Challenge of Timely, Responsive and Rigorous Ethics Review of Disaster Research: Views of Research Ethics Committee Members

PubMed Central

Hunt, Matthew; Tansey, Catherine M.

2016-01-01

Background Research conducted following natural disasters such as earthquakes, floods or hurricanes is crucial for improving relief interventions. Such research, however, poses ethical, methodological and logistical challenges for researchers. Oversight of disaster research also poses challenges for research ethics committees (RECs), in part due to the rapid turnaround needed to initiate research after a disaster. Currently, there is limited knowledge available about how RECs respond to and appraise disaster research. To address this knowledge gap, we investigated the experiences of REC members who had reviewed disaster research conducted in low- or middle-income countries. Methods We used interpretive description methodology and conducted in-depth interviews with 15 respondents. Respondents were chairs, members, advisors, or coordinators from 13 RECs, including RECs affiliated with universities, governments, international organizations, a for-profit REC, and an ad hoc committee established during a disaster. Interviews were analyzed inductively using constant comparative techniques. Results Through this process, three elements were identified as characterizing effective and high-quality review: timeliness, responsiveness and rigorousness. To ensure timeliness, many RECs rely on adaptations of review procedures for urgent protocols. Respondents emphasized that responsive review requires awareness of and sensitivity to the particularities of disaster settings and disaster research. Rigorous review was linked with providing careful assessment of ethical considerations related to the research, as well as ensuring independence of the review process. Conclusion Both the frequency of disasters and the conduct of disaster research are on the rise. Ensuring effective and high quality review of disaster research is crucial, yet challenges, including time pressures for urgent protocols, exist for achieving this goal. Adapting standard REC procedures may be necessary. However, steps should be taken to ensure that ethics review of disaster research remains diligent and thorough. PMID:27327165

Methodological reporting in qualitative, quantitative, and mixed methods health services research articles.

PubMed

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-04-01

Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ(2) (1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ(2) (1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports. © Health Research and Educational Trust.

Harnessing Implementation Science to Increase the Impact of Health Disparity Research

PubMed Central

Chinman, Matthew; Woodward, Eva N.; Curran, Geoffrey M.; Hausmann, Leslie R. M.

2017-01-01

Background Health disparities are differences in health or health care between groups based on social, economic, and/or environmental disadvantage. Disparity research often follows three steps: detecting (Phase 1), understanding (Phase 2), and reducing (Phase 3), disparities. While disparities have narrowed over time, many remain. Objectives We argue that implementation science could enhance disparities research by broadening the scope of Phase 2 studies and offering rigorous methods to test disparity-reducing implementation strategies in Phase 3 studies. Methods We briefly review the focus of Phase 2 and Phase 3 disparities research. We then provide a decision tree and case examples to illustrate how implementation science frameworks and research designs could further enhance disparity research. Results Most health disparities research emphasizes patient and provider factors as predominant mechanisms underlying disparities. Applying implementation science frameworks like the Consolidated Framework for Implementation Research could help disparities research widen its scope in Phase 2 studies and, in turn, develop broader disparities-reducing implementation strategies in Phase 3 studies. Many Phase 3 studies of disparity reducing implementation strategies are similar to case studies, whose designs are not able to fully test causality. Implementation science research designs offer rigorous methods that could accelerate the pace at which equity is achieved in real world practice. Conclusions Disparities can be considered a “special case” of implementation challenges—when evidence-based clinical interventions are delivered to, and received by, vulnerable populations at lower rates. Bringing together health disparities research and implementation science could advance equity more than either could achieve on their own. PMID:28806362

Mixed methods research design for pragmatic psychoanalytic studies.

PubMed

Tillman, Jane G; Clemence, A Jill; Stevens, Jennifer L

2011-10-01

Calls for more rigorous psychoanalytic studies have increased over the past decade. The field has been divided by those who assert that psychoanalysis is properly a hermeneutic endeavor and those who see it as a science. A comparable debate is found in research methodology, where qualitative and quantitative methods have often been seen as occupying orthogonal positions. Recently, Mixed Methods Research (MMR) has emerged as a viable "third community" of research, pursuing a pragmatic approach to research endeavors through integrating qualitative and quantitative procedures in a single study design. Mixed Methods Research designs and the terminology associated with this emerging approach are explained, after which the methodology is explored as a potential integrative approach to a psychoanalytic human science. Both qualitative and quantitative research methods are reviewed, as well as how they may be used in Mixed Methods Research to study complex human phenomena.

Qualitative research: the "what," "why," "who," and "how"!

PubMed

Cypress, Brigitte S

2015-01-01

There has been a general view of qualitative research as a lower level form of inquiry and the diverse conceptualizations of what it is, its use or utility, its users, the process of how it is conducted, and its scientific merit. This fragmented understanding and varied ways in which qualitative research is conceived, synthesized, and presented have a myriad of implications in demonstrating and enhancing the utilization of its findings and the ways and skills required in transforming knowledge gained from it. The purpose of this article is to define qualitative research and discuss its significance in research, the questions it addresses, its characteristics, methods and criteria for rigor, and the type of results it can offer. A framework for understanding the "what," "why," "who," and "how" of qualitative research; the different approaches; and the strategies to achieve trustworthiness are presented. Qualitative research provides insights into health-related phenomena and seeks to understand and interpret subjective experience and thus humanizes health care and can enrich further research inquiries and be made clearer and more rigorous as it is relevant to the perspective and goals of nursing.

Rigor Revisited: Scaffolding College Student Learning by Incorporating Their Lived Experiences

ERIC Educational Resources Information Center

Castillo-Montoya, Milagros

2018-01-01

This chapter explores how students' lived experiences contribute to the rigor of their thinking. Insights from research indicate faculty can enhance rigor by accounting for the many ways it may surface in the classroom. However, to see this type of rigor, we must revisit the way we conceptualize it for higher education.

Research Centers: Ecstasies & Agonies [in HRD].

ERIC Educational Resources Information Center

1995

These four papers are from a symposium facilitated by Gene Roth on research centers at the 1995 Academy of Human Resource Development (HRD) conference. "Research: The Thin Blue Line between Rigor and Reality" (Michael Leimbach) discusses the need for HRD research to increase its speed and rigor and help organizations focus on capability…

Pedagogical Training and Research in Engineering Education

ERIC Educational Resources Information Center

Wankat, Phillip C.

2008-01-01

Ferment in engineering has focused increased attention on undergraduate engineering education, and has clarified the need for rigorous research in engineering education. This need has spawned the new research field of Engineering Education and greatly increased interest in earning Ph.D. degrees based on rigorous engineering education research.…

Studies on the estimation of the postmortem interval. 3. Rigor mortis (author's transl).

PubMed

Suzutani, T; Ishibashi, H; Takatori, T

1978-11-01

The authors have devised a method for classifying rigor mortis into 10 types based on its appearance and strength in various parts of a cadaver. By applying the method to the findings of 436 cadavers which were subjected to medico-legal autopsies in our laboratory during the last 10 years, it has been demonstrated that the classifying method is effective for analyzing the phenomenon of onset, persistence and disappearance of rigor mortis statistically. The investigation of the relationship between each type of rigor mortis and the postmortem interval has demonstrated that rigor mortis may be utilized as a basis for estimating the postmortem interval but the values have greater deviation than those described in current textbooks.

Research design issues for evaluating complex multicomponent interventions in neighborhoods and communities.

PubMed

Komro, Kelli A; Flay, Brian R; Biglan, Anthony; Wagenaar, Alexander C

2016-03-01

Major advances in population health will not occur unless we translate existing knowledge into effective multicomponent interventions, implement and maintain these in communities, and develop rigorous translational research and evaluation methods to ensure continual improvement and sustainability. We discuss challenges and offer approaches to evaluation that are key for translational research stages 3 to 5 to advance optimized adoption, implementation, and maintenance of effective and replicable multicomponent strategies. The major challenges we discuss concern (a) multiple contexts of evaluation/research, (b) complexity of packages of interventions, and (c) phases of evaluation/research questions. We suggest multiple alternative research designs that maintain rigor but accommodate these challenges and highlight the need for measurement systems. Longitudinal data collection and a standardized continuous measurement system are fundamental to the evaluation and refinement of complex multicomponent interventions. To be useful to T3-T5 translational research efforts in neighborhoods and communities, such a system would include assessments of the reach, implementation, effects on immediate outcomes, and effects of the comprehensive intervention package on more distal health outcomes.

The Academic Performance of Catholic Schools.

ERIC Educational Resources Information Center

Morris, Andrew B.

1994-01-01

Although the (British) government's "league tables" may be an inappropriate method of comparing schools' relative effectiveness, analysis of the 1992 examination results points to Catholic schools' apparent success. A summary of the limited research evidence on Catholic school effectiveness suggests that a rigorous study of their…

¡Si, Se Puede! Achieving Academic Excellence Online

ERIC Educational Resources Information Center

Lumbreras, Ricardo, Jr.; Rupley, William H.

2017-01-01

Twenty-first century learners in post-secondary educational environments find themselves involved in online learning. Acquiring graduate degrees, especially for working professionals, has precipitated the need for effective, rigorous, relevant, and timely coursework online. Utilizing the qualitative research method of auto-ethnographic reporting,…

Illustrating idiographic methods for translation research: moderation effects, natural clinical experiments, and complex treatment-by-subgroup interactions.

PubMed

Ridenour, Ty A; Wittenborn, Andrea K; Raiff, Bethany R; Benedict, Neal; Kane-Gill, Sandra

2016-03-01

A critical juncture in translation research involves the preliminary studies of intervention tools, provider training programs, policies, and other mechanisms used to leverage knowledge garnered at one translation stage into another stage. Potentially useful for such studies are rigorous techniques for conducting within-subject clinical trials, which have advanced incrementally over the last decade. However, these methods have largely not been utilized within prevention or translation contexts. The purpose of this manuscript is to demonstrate the flexibility, wide applicability, and rigor of idiographic clinical trials for preliminary testing of intervention mechanisms. Specifically demonstrated are novel uses of state-space modeling for testing intervention mechanisms of short-term outcomes, identifying heterogeneity in and moderation of within-person treatment mechanisms, a horizontal line plot to refine sampling design during the course of a clinic-based experimental study, and the need to test a treatment's efficacy as treatment is administered along with (e.g., traditional 12-month outcomes).

Evaluative Criteria for Qualitative Research in Health Care: Controversies and Recommendations

PubMed Central

Cohen, Deborah J.; Crabtree, Benjamin F.

2008-01-01

PURPOSE We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. METHODS We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. RESULTS Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. CONCLUSION Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges. PMID:18626033

Research strategies that result in optimal data collection from the patient medical record

PubMed Central

Gregory, Katherine E.; Radovinsky, Lucy

2010-01-01

Data obtained from the patient medical record are often a component of clinical research led by nurse investigators. The rigor of the data collection methods correlates to the reliability of the data and, ultimately, the analytical outcome of the study. Research strategies for reliable data collection from the patient medical record include the development of a precise data collection tool, the use of a coding manual, and ongoing communication with research staff. PMID:20974093

Rigor and reproducibility in research with transcranial electrical stimulation: An NIMH-sponsored workshop

PubMed Central

Bikson, Marom; Brunoni, Andre R.; Charvet, Leigh E.; Clark, Vincent P.; Cohen, Leonardo G.; Deng, Zhi-De; Dmochowski, Jacek; Edwards, Dylan J.; Frohlich, Flavio; Kappenman, Emily S.; Lim, Kelvin O.; Loo, Colleen; Mantovani, Antonio; McMullen, David P.; Parra, Lucas C.; Pearson, Michele; Richardson, Jessica D.; Rumsey, Judith M.; Sehatpour, Pejman; Sommers, David; Unal, Gozde; Wassermann, Eric M.; Woods, Adam J.; Lisanby, Sarah H.

2018-01-01

Background Neuropsychiatric disorders are a leading source of disability and require novel treatments that target mechanisms of disease. As such disorders are thought to result from aberrant neuronal circuit activity, neuromodulation approaches are of increasing interest given their potential for manipulating circuits directly. Low intensity transcranial electrical stimulation (tES) with direct currents (transcranial direct current stimulation, tDCS) or alternating currents (transcranial alternating current stimulation, tACS) represent novel, safe, well-tolerated, and relatively inexpensive putative treatment modalities. Objective This report seeks to promote the science, technology and effective clinical applications of these modalities, identify research challenges, and suggest approaches for addressing these needs in order to achieve rigorous, reproducible findings that can advance clinical treatment. Methods The National Institute of Mental Health (NIMH) convened a workshop in September 2016 that brought together experts in basic and human neuroscience, electrical stimulation biophysics and devices, and clinical trial methods to examine the physiological mechanisms underlying tDCS/tACS, technologies and technical strategies for optimizing stimulation protocols, and the state of the science with respect to therapeutic applications and trial designs. Results Advances in understanding mechanisms, methodological and technological improvements (e.g., electronics, computational models to facilitate proper dosing), and improved clinical trial designs are poised to advance rigorous, reproducible therapeutic applications of these techniques. A number of challenges were identified and meeting participants made recommendations made to address them. Conclusions These recommendations align with requirements in NIMH funding opportunity announcements to, among other needs, define dosimetry, demonstrate dose/response relationships, implement rigorous blinded trial designs, employ computational modeling, and demonstrate target engagement when testing stimulation-based interventions for the treatment of mental disorders. PMID:29398575

Phase matrix induced symmetrics for multiple scattering using the matrix operator method

NASA Technical Reports Server (NTRS)

Hitzfelder, S. J.; Kattawar, G. W.

1973-01-01

Entirely rigorous proofs of the symmetries induced by the phase matrix into the reflection and transmission operators used in the matrix operator theory are given. Results are obtained for multiple scattering in both homogeneous and inhomogeneous atmospheres. These results will be useful to researchers using the method since large savings in computer time and storage are obtainable.

Reconciling the Rigor-Relevance Dilemma in Intellectual Capital Research

ERIC Educational Resources Information Center

Andriessen, Daniel

2004-01-01

This paper raises the issue of research methodology for intellectual capital and other types of management research by focusing on the dilemma of rigour versus relevance. The more traditional explanatory approach to research often leads to rigorous results that are not of much help to solve practical problems. This paper describes an alternative…

Mixed methods research in music therapy research.

PubMed

Bradt, Joke; Burns, Debra S; Creswell, John W

2013-01-01

Music therapists have an ethical and professional responsibility to provide the highest quality care possible to their patients. Much of the time, high quality care is guided by evidence-based practice standards that integrate the most current, available research in making decisions. Accordingly, music therapists need research that integrates multiple ways of knowing and forms of evidence. Mixed methods research holds great promise for facilitating such integration. At this time, there have not been any methodological articles published on mixed methods research in music therapy. The purpose of this article is to introduce mixed methods research as an approach to address research questions relevant to music therapy practice. This article describes the core characteristics of mixed methods research, considers paradigmatic issues related to this research approach, articulates major challenges in conducting mixed methods research, illustrates four basic designs, and provides criteria for evaluating the quality of mixed methods articles using examples of mixed methods research from the music therapy literature. Mixed methods research offers unique opportunities for strengthening the evidence base in music therapy. Recommendations are provided to ensure rigorous implementation of this research approach.

Forty years of quality-of-life research in congenital heart disease: Temporal trends in conceptual and methodological rigor.

PubMed

Bratt, Ewa-Lena; Moons, Philip

2015-09-15

The first study on quality of life (QoL) in patients with congenital heart disease was published 40 years ago. Since then, the number of QoL articles on these patients has grown exponentially. We conducted a systematic literature review of all empirical studies on QoL in patients with congenital heart disease published since 1974, with the aim of determining the range of conceptual and methodological rigor of studies and identifying temporal trends in these parameters. PubMed, Embase, and Cinahl were searched for empirical studies addressing QoL in children, adolescents, or adults with congenital heart disease, published between January 1, 1974, and December 31, 2014. We applied 10 review criteria that were previously developed by Gill and Feinstein in 1994 and further refined by Moons et al. in 2004. Overall, 234 articles were reviewed. We found slight but non-significant temporal improvements in conceptual and methodological rigor and in use of assessment methods. This indicates a trend toward a more professional and exacting approach in QoL assessments. However, the majority of articles still had substantial conceptual and methodological deficits. Furthermore, we observed that citation of the publications of Gill and Feinstein and Moons et al. in published QoL research is associated with higher quality scores, suggesting that these articles have a positive impact on conceptual and methodological caliber. Despite 40 years of QoL research in this field, this review shows that major weaknesses in methodological rigor remain highly prevalent, which may make QoL studies inconclusive. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

An integrative research review of instruments measuring religious involvement: implications for nursing research with African Americans.

PubMed

Mokel, Melissa Jennifer; Shellman, Juliette M

2013-01-01

Many instruments in which religious involvement is measured often (a) contain unclear, poorly developed constructs; (b) lack methodological rigor in scale development; and (c) contain language and content culturally incongruent with the religious experiences of diverse ethnic groups. The primary aims of this review were to (a) synthesize the research on instruments designed to measure religious involvement, (b) evaluate the methodological quality of instruments that measure religious involvement, and (c) examine these instruments for conceptual congruency with African American religious involvement. An updated integrative research review method guided the process (Whittemore & Knafl, 2005). 152 articles were reviewed and 23 articles retrieved. Only 3 retained instruments were developed under methodologically rigorous conditions. All 3 instruments were congruent with a conceptual model of African American religious involvement. The Fetzer Multidimensional Measure of Religious Involvement and Spirituality (FMMRS; Idler et al., 2003) was found to have favorable characteristics. Further examination and psychometric testing is warranted to determine its acceptability, readability, and cultural sensitivity in an African American population.

Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles

PubMed Central

Wisdom, Jennifer P; Cavaleri, Mary A; Onwuegbuzie, Anthony J; Green, Carla A

2012-01-01

Objectives Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. Data Sources All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. Study Design All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Principal Findings Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ2(1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ2(1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Conclusion Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports. PMID:22092040

Revisiting the scientific method to improve rigor and reproducibility of immunohistochemistry in reproductive science.

PubMed

Manuel, Sharrón L; Johnson, Brian W; Frevert, Charles W; Duncan, Francesca E

2018-04-21

Immunohistochemistry (IHC) is a robust scientific tool whereby cellular components are visualized within a tissue, and this method has been and continues to be a mainstay for many reproductive biologists. IHC is highly informative if performed and interpreted correctly, but studies have shown that the general use and reporting of appropriate controls in IHC experiments is low. This omission of the scientific method can result in data that lacks rigor and reproducibility. In this editorial, we highlight key concepts in IHC controls and describe an opportunity for our field to partner with the Histochemical Society to adopt their IHC guidelines broadly as researchers, authors, ad hoc reviewers, editorial board members, and editors-in-chief. Such cross-professional society interactions will ensure that we produce the highest quality data as new technologies emerge that still rely upon the foundations of classic histological and immunohistochemical principles.

Herbal medicine development: a plea for a rigorous scientific foundation.

PubMed

Lietman, Paul S

2012-09-01

Science, including rigorous basic scientific research and rigorous clinical research, must underlie both the development and the clinical use of herbal medicines. Yet almost none of the hundreds or thousands of articles that are published each year on some aspect of herbal medicines, adheres to 3 simple but profound scientific principles must underlie all of herbal drug development or clinical use. Three fundamental principles that should underlie everyone's thinking about the development and/or clinical use of any herbal medicine. (1) There must be standardization and regulation (rigorously enforced) of the product being studied or being used clinically. (2) There must be scientific proof of a beneficial clinical effect for something of value to the patient and established by rigorous clinical research. (3) There must be scientific proof of safety (acceptable toxicity) for the patient and established by rigorous clinical research. These fundamental principles of science have ramifications for both the scientist and the clinician. It is critically important that both the investigator and the prescriber know exactly what is in the studied or recommended product and how effective and toxic it is. We will find new and useful drugs from natural sources. However, we will have to learn how to study herbal medicines rigorously, and we will have to try to convince the believers in herbal medicines of the wisdom and even the necessity of a rigorous scientific approach to herbal medicine development. Both biomedical science and practicing physicians must enthusiastically accept the responsibility for searching for truth in the discovery and development of new herbal medicines, in the truthful teaching about herbal medicines from a scientific perspective, and in the scientifically proven clinical use of herbal medicines.

An Integrative, Multilevel, and Transdisciplinary Research Approach to Challenges of Work, Family, and Health

PubMed Central

Bray, Jeremy W.; Kelly, Erin L.; Hammer, Leslie B.; Almeida, David M.; Dearing, James W.; King, Rosalind B.; Buxton, Orfeu M.

2013-01-01

Recognizing a need for rigorous, experimental research to support the efforts of workplaces and policymakers in improving the health and wellbeing of employees and their families, the National Institutes of Health and the Centers for Disease Control and Prevention formed the Work, Family & Health Network (WFHN). The WFHN is implementing an innovative multisite study with a rigorous experimental design (adaptive randomization, control groups), comprehensive multilevel measures, a novel and theoretically based intervention targeting the psychosocial work environment, and translational activities. This paper describes challenges and benefits of designing a multilevel and transdisciplinary research network that includes an effectiveness study to assess intervention effects on employees, families, and managers; a daily diary study to examine effects on family functioning and daily stress; a process study to understand intervention implementation; and translational research to understand and inform diffusion of innovation. Challenges were both conceptual and logistical, spanning all aspects of study design and implementation. In dealing with these challenges, however, the WFHN developed innovative, transdisciplinary, multi-method approaches to conducting workplace research that will benefit both the research and business communities. PMID:24618878

Harnessing Implementation Science to Increase the Impact of Health Equity Research.

PubMed

Chinman, Matthew; Woodward, Eva N; Curran, Geoffrey M; Hausmann, Leslie R M

2017-09-01

Health disparities are differences in health or health care between groups based on social, economic, and/or environmental disadvantage. Disparity research often follows 3 steps: detecting (phase 1), understanding (phase 2), and reducing (phase 3), disparities. Although disparities have narrowed over time, many remain. We argue that implementation science could enhance disparities research by broadening the scope of phase 2 studies and offering rigorous methods to test disparity-reducing implementation strategies in phase 3 studies. We briefly review the focus of phase 2 and phase 3 disparities research. We then provide a decision tree and case examples to illustrate how implementation science frameworks and research designs could further enhance disparity research. Most health disparities research emphasizes patient and provider factors as predominant mechanisms underlying disparities. Applying implementation science frameworks like the Consolidated Framework for Implementation Research could help disparities research widen its scope in phase 2 studies and, in turn, develop broader disparities-reducing implementation strategies in phase 3 studies. Many phase 3 studies of disparity-reducing implementation strategies are similar to case studies, whose designs are not able to fully test causality. Implementation science research designs offer rigorous methods that could accelerate the pace at which equity is achieved in real-world practice. Disparities can be considered a "special case" of implementation challenges-when evidence-based clinical interventions are delivered to, and received by, vulnerable populations at lower rates. Bringing together health disparities research and implementation science could advance equity more than either could achieve on their own.

75 FR 5291 - Office of Special Education and Rehabilitative Services; Overview Information; Technology and...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-02

... two phases: (1) Development and (2) research on effectiveness. Abstracts of projects funded under... approaches. Phase 2 projects must subject technology-based approaches to rigorous field-based research to... disabilities; (2) Present a justification, based on scientifically rigorous research or theory, that supports...

76 FR 12343 - Technology and Media Services for Individuals With Disabilities-Steppingstones of Technology...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-03-07

... two phases: (1) Development and (2) research on effectiveness. Abstracts of projects funded under... approaches. Phase 2 projects must subject technology-based approaches to rigorous field-based research to... scientifically rigorous research or theory, that demonstrates the potential effectiveness of the technology-based...

Educational Research as Disciplined Inquiry: Examining the Facets of Rigor in Our Work.

ERIC Educational Resources Information Center

Munby, Hugh

This paper explores how facets of the concept "rigor" might be applied to questions about the validity and reliability of research independently of the research modes. The focus of the critical lens could then be on how to assess the contribution of various forms of research rather than on the "paradigm wars" and arguments…

Feasibility, appropriateness, meaningfulness and effectiveness of patient participation at bedside shift reporting: mixed-method research protocol.

PubMed

Malfait, Simon; Eeckloo, Kristof; Lust, Elisa; Van Biesen, Wim; Van Hecke, Ann

2017-02-01

To evaluate the feasibility, appropriateness, meaningfulness and effectiveness of bedside shift reporting in a minimum of five interventions and five control wards. Hospitals continually improve their quality of care. Next to improvements in clinical performance, more patient participation is stimulated through different methods. Methods to enhance patient participation such as bedside shift reporting lack rigorously performed research to determine their feasibility, appropriateness, meaningfulness and effectiveness. Small-scale research and a previous pilot study indicate that bedside shift reporting improves patient participation, nurse-nurse communication and nurse-patient communication. The development, implementation and evaluation of bedside shift report are based on the Medical Research Council framework for complex interventions in health care. A matched, controlled, mixed-method, longitudinal study design will be used. The Feasibility-Appropriateness-Meaningfulness-Effectiveness framework will be applied for the quantitative and qualitative evaluation of bedside shift report. A tailored intervention and implementation process for bedside shift report will be developed using diagnostic interviews, co-design and acceptability testing. The intervention will be evaluated before implementation and three times after implementation. Individual and focus group interviews will be performed. Questionnaires, observations and analysis of the medical records and administrative databases will be completed. This study was funded in October 2015. Research Ethics Committee approval was granted in March 2016. There is a pressing need for rigorous research into the effects of interventions for improving patient participation. This study addresses the significance of bedside shift report as an intervention to improve quality of care, communication and patient participation within a large-scale, matched, controlled research design. © 2016 John Wiley & Sons Ltd.

The state of research on the effects of therapeutic touch.

PubMed

Easter, A

1997-06-01

Therapeutic Touch is investigated using an integrative review of the literature. Using Ganong's (1987) methodology, the article explores the research question, What is the state of development of research regarding Therapeutic Touch? by analyzing primary research reports from 23 articles in 14 referred journals. The findings of the review indicate positive regard for the use of Therapeutic Touch. All research points to the need for further study in this area. Research methods used are satisfactory, but more rigorous methodologies would promote a more scientific contribution to the body of literature on Therapeutic Touch.

There's Education, and Then There's Education in Medicine

ERIC Educational Resources Information Center

Royal, Kenneth D.; Rinaldo, Jason C. B.

2016-01-01

Introduction: For some time now the field of medical education has been criticized by many of its stakeholders. Countless debates have been presented in the literature regarding the quality of medical education research, adequacy of methodological rigor, and other concerns. Methods: At present, the views expressed have largely come from physicians…

Explaining the Sex Difference in Dyslexia

ERIC Educational Resources Information Center

Arnett, Anne B.; Pennington, Bruce F.; Peterson, Robin L.; Willcutt, Erik G.; DeFries, John C.; Olson, Richard K.

2017-01-01

Background: Males are diagnosed with dyslexia more frequently than females, even in epidemiological samples. This may be explained by greater variance in males' reading performance. Methods: We expand on previous research by rigorously testing the variance difference theory, and testing for mediation of the sex difference by cognitive correlates.…

A Writing-Intensive, Methods-Based Laboratory Course for Undergraduates

ERIC Educational Resources Information Center

Colabroy, Keri L.

2011-01-01

Engaging undergraduate students in designing and executing original research should not only be accompanied by technique training but also intentional instruction in the critical analysis and writing of scientific literature. The course described here takes a rigorous approach to scientific reading and writing using primary literature as the model…

Towards Evidence-Based Practice in Language Intervention for Bilingual Children

ERIC Educational Resources Information Center

Thordardottir, Elin

2010-01-01

Evidence-based practice requires that clinical decisions be based on evidence from rigorously controlled research studies. At this time, very few studies have directly examined the efficacy of clinical intervention methods for bilingual children. Clinical decisions for this population cannot, therefore, be based on the strongest forms of research…

Challenges and Strategies for Research in Prisons

PubMed Central

Apa, Zoltán L.; Bai, Ruo Yu; Mukherejee, Dhritiman V.; Herzig, Carolyn T. A.; Koenigsmann, Carl; Lowy, Franklin D.; Larson, Elaine L.

2013-01-01

In this article, we discuss some of the challenges encountered while conducting research in two maximum security prisons and approaches we found helpful to facilitate the research process through the development of collaborative relationships, the establishment of prison contacts, and the implementation of rigorous research methods. As a result of our experiences, we have been successful at maintaining a high rate of inmate participation (>80%) and a well-functioning multidisciplinary team. The approaches described may be useful to other investigators planning to conduct research in a challenging setting such as prisons. PMID:22924569

Do health care institutions value research? A mixed methods study of barriers and facilitators to methodological rigor in pediatric randomized trials.

PubMed

Hamm, Michele P; Scott, Shannon D; Klassen, Terry P; Moher, David; Hartling, Lisa

2012-10-18

Pediatric randomized controlled trials (RCTs) are susceptible to a high risk of bias. We examined the barriers and facilitators that pediatric trialists face in the design and conduct of unbiased trials. We used a mixed methods design, with semi-structured interviews building upon the results of a quantitative survey. We surveyed Canadian (n=253) and international (n=600) pediatric trialists regarding their knowledge and awareness of bias and their perceived barriers and facilitators in conducting clinical trials. We then interviewed 13 participants from different subspecialties and geographic locations to gain a more detailed description of how their experiences and attitudes towards research interacted with trial design and conduct. The survey response rate was 23.0% (186/807). 68.1% of respondents agreed that bias is a problem in pediatric RCTs and 72.0% felt that there is sufficient evidence to support changing some aspects of how trials are conducted. Knowledge related to bias was variable, with inconsistent awareness of study design features that may introduce bias into a study. Interview participants highlighted a lack of formal training in research methods, a negative research culture, and the pragmatics of trial conduct as barriers. Facilitators included contact with knowledgeable and supportive colleagues and infrastructure for research. A lack of awareness of bias and negative attitudes towards research present significant barriers in terms of conducting methodologically rigorous pediatric RCTs. Knowledge translation efforts must focus on these issues to ensure the relevance and validity of trial results.

Rigorous mathematical modelling for a Fast Corrector Power Supply in TPS

NASA Astrophysics Data System (ADS)

Liu, K.-B.; Liu, C.-Y.; Chien, Y.-C.; Wang, B.-S.; Wong, Y. S.

2017-04-01

To enhance the stability of beam orbit, a Fast Orbit Feedback System (FOFB) eliminating undesired disturbances was installed and tested in the 3rd generation synchrotron light source of Taiwan Photon Source (TPS) of National Synchrotron Radiation Research Center (NSRRC). The effectiveness of the FOFB greatly depends on the output performance of Fast Corrector Power Supply (FCPS); therefore, the design and implementation of an accurate FCPS is essential. A rigorous mathematical modelling is very useful to shorten design time and improve design performance of a FCPS. A rigorous mathematical modelling derived by the state-space averaging method for a FCPS in the FOFB of TPS composed of a full-bridge topology is therefore proposed in this paper. The MATLAB/SIMULINK software is used to construct the proposed mathematical modelling and to conduct the simulations of the FCPS. Simulations for the effects of the different resolutions of ADC on the output accuracy of the FCPS are investigated. A FCPS prototype is realized to demonstrate the effectiveness of the proposed rigorous mathematical modelling for the FCPS. Simulation and experimental results show that the proposed mathematical modelling is helpful for selecting the appropriate components to meet the accuracy requirements of a FCPS.

Communicating to Policymakers: What to Do with Ambiguous Results from Three Impact Studies of the Same Education Program

ERIC Educational Resources Information Center

Hartry, Ardice

2013-01-01

This paper considers one challenge from recent emphasis on rigorous research for decision-making in education: the interpretation of non-replicated findings. Under Clinton and Bush, the federal government called for and funded highly rigorous research. The "gold-standard" for research was randomized-control trials (RCTs), which…

Useful, Used, and Peer Approved: The Importance of Rigor and Accessibility in Postsecondary Research and Evaluation. WISCAPE Viewpoints

ERIC Educational Resources Information Center

Vaade, Elizabeth; McCready, Bo

2012-01-01

Traditionally, researchers, policymakers, and practitioners have perceived a tension between rigor and accessibility in quantitative research and evaluation in postsecondary education. However, this study indicates that both producers and consumers of these studies value high-quality work and clear findings that can reach multiple audiences. The…

Operations Research / Operations Analysis Orientation Course Curriculum for NATO Nations (Programme d’initiation a la recherche / l’analyse operationnelle pour les pays de l’OTAN)

DTIC Science & Technology

2014-09-01

The NATO Science and Technology Organization Science & Technology (S& T ) in the NATO context is defined as the selective and rigorous...generation and application of state-of-the-art, validated knowledge for defence and security purposes. S& T activities embrace scientific research...engineering, operational research and analysis, synthesis, integration and validation of knowledge derived through the scientific method. In NATO, S& T is

A Replication of Failure, Not a Failure to Replicate

ERIC Educational Resources Information Center

Holden, Gary; Barker, Kathleen; Kuppens, Sofie; Rosenberg, Gary; LeBreton, Jonathan

2015-01-01

Purpose: The increasing role of systematic reviews in knowledge production demands greater rigor in the literature search process. The performance of the Social Work Abstracts (SWA) database has been examined multiple times over the past three decades. The current study is a replication within this line of research. Method: Issue-level coverage…

Multiple Imputation of Multilevel Missing Data-Rigor versus Simplicity

ERIC Educational Resources Information Center

Drechsler, Jörg

2015-01-01

Multiple imputation is widely accepted as the method of choice to address item-nonresponse in surveys. However, research on imputation strategies for the hierarchical structures that are typically found in the data in educational contexts is still limited. While a multilevel imputation model should be preferred from a theoretical point of view if…

Complexity, Representation and Practice: Case Study as Method and Methodology

ERIC Educational Resources Information Center

Miles, Rebecca

2015-01-01

While case study is considered a common approach to examining specific and particular examples in research disciplines such as law, medicine and psychology, in the social sciences case study is often treated as a lesser, flawed or undemanding methodology which is less valid, reliable or theoretically rigorous than other methodologies. Building on…

Study Strategies Have Meager Support: A Review with Recommendations for Implementation.

ERIC Educational Resources Information Center

Hadwin, Allyson Fiona; Winne, Philip H.

1996-01-01

Research on the effects of teaching study strategies, in situations where students could choose study methods used in everyday courses, is reviewed. Among the few studies meeting rigorous criteria, none investigated whether students could adapt study tactics beyond the training context. Cautious recommendations are made for concept mapping,…

Vibrational algorithms for quantitative crystallographic analyses of hydroxyapatite-based biomaterials: II, application to decayed human teeth.

PubMed

Adachi, Tetsuya; Pezzotti, Giuseppe; Yamamoto, Toshiro; Ichioka, Hiroaki; Boffelli, Marco; Zhu, Wenliang; Kanamura, Narisato

2015-05-01

A systematic investigation, based on highly spectrally resolved Raman spectroscopy, was undertaken to research the efficacy of vibrational assessments in locating chemical and crystallographic fingerprints for the characterization of dental caries and the early detection of non-cavitated carious lesions. Raman results published by other authors have indicated possible approaches for this method. However, they conspicuously lacked physical insight at the molecular scale and, thus, the rigor necessary to prove the efficacy of this spectroscopy method. After solving basic physical challenges in a companion paper, we apply them here in the form of newly developed Raman algorithms for practical dental research. Relevant differences in mineral crystallite (average) orientation and texture distribution were revealed for diseased enamel at different stages compared with healthy mineralized enamel. Clear spectroscopy features could be directly translated in terms of a rigorous and quantitative classification of crystallography and chemical characteristics of diseased enamel structures. The Raman procedure enabled us to trace back otherwise invisible characteristics in early caries, in the translucent zone (i.e., the advancing front of the disease) and in the body of lesion of cavitated caries.

A CUMULATIVE MIGRATION METHOD FOR COMPUTING RIGOROUS TRANSPORT CROSS SECTIONS AND DIFFUSION COEFFICIENTS FOR LWR LATTICES WITH MONTE CARLO

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhaoyuan Liu; Kord Smith; Benoit Forget

2016-05-01

A new method for computing homogenized assembly neutron transport cross sections and dif- fusion coefficients that is both rigorous and computationally efficient is proposed in this paper. In the limit of a homogeneous hydrogen slab, the new method is equivalent to the long-used, and only-recently-published CASMO transport method. The rigorous method is used to demonstrate the sources of inaccuracy in the commonly applied “out-scatter” transport correction. It is also demonstrated that the newly developed method is directly applicable to lattice calculations per- formed by Monte Carlo and is capable of computing rigorous homogenized transport cross sections for arbitrarily heterogeneous lattices.more » Comparisons of several common transport cross section ap- proximations are presented for a simple problem of infinite medium hydrogen. The new method has also been applied in computing 2-group diffusion data for an actual PWR lattice from BEAVRS benchmark.« less

Preserving pre-rigor meat functionality for beef patty production.

PubMed

Claus, J R; Sørheim, O

2006-06-01

Three methods were examined for preserving pre-rigor meat functionality in beef patties. Hot-boned semimembranosus muscles were processed as follows: (1) pre-rigor ground, salted, patties immediately cooked; (2) pre-rigor ground, salted and stored overnight; (3) pre-rigor injected with brine; and (4) post-rigor ground and salted. Raw patties contained 60% lean beef, 19.7% beef fat trim, 1.7% NaCl, 3.6% starch, and 15% water. Pre-rigor processing occurred at 3-3.5h postmortem. Patties made from pre-rigor ground meat had higher pH values; greater protein solubility; firmer, more cohesive, and chewier texture; and substantially lower cooking losses than the other treatments. Addition of salt was sufficient to reduce the rate and extent of glycolysis. Brine injection of intact pre-rigor muscles resulted in some preservation of the functional properties but not as pronounced as with salt addition to pre-rigor ground meat.

Leveraging Rigorous Local Evaluations to Understand Contradictory Findings

ERIC Educational Resources Information Center

Boulay, Beth; Martin, Carlos; Zief, Susan; Granger, Robert

2013-01-01

Contradictory findings from "well-implemented" rigorous evaluations invite researchers to identify the differences that might explain the contradictions, helping to generate testable hypotheses for new research. This panel will examine efforts to ensure that the large number of local evaluations being conducted as part of four…

Analyzing qualitative data with computer software.

PubMed Central

Weitzman, E A

1999-01-01

OBJECTIVE: To provide health services researchers with an overview of the qualitative data analysis process and the role of software within it; to provide a principled approach to choosing among software packages to support qualitative data analysis; to alert researchers to the potential benefits and limitations of such software; and to provide an overview of the developments to be expected in the field in the near future. DATA SOURCES, STUDY DESIGN, METHODS: This article does not include reports of empirical research. CONCLUSIONS: Software for qualitative data analysis can benefit the researcher in terms of speed, consistency, rigor, and access to analytic methods not available by hand. Software, however, is not a replacement for methodological training. PMID:10591282

Ambiguity, logic, simplicity, and dynamics: Wittgensteinian evaluative criteria in peer review of quantitative research on categorization.

PubMed

Shimp, Charles P

2004-06-30

Research on categorization has changed over time, and some of these changes resemble how Wittgenstein's views changed from his Tractatus Logico-Philosophicus to his Philosophical Investigations. Wittgenstein initially focused on unambiguous, abstract, parsimonious, logical propositions and rules, and on independent, static, "atomic facts." This approach subsequently influenced the development of logical positivism and thereby may have indirectly influenced method and theory in research on categorization: much animal research on categorization has focused on learning simple, static, logical rules unambiguously interrelating small numbers of independent features. He later rejected logical simplicity and rigor and focused instead on Gestalt ideas about figure-ground reversals and context, the ambiguity of family resemblance, and the function of details of everyday language. Contemporary contextualism has been influenced by this latter position, some features of which appear in contemporary empirical research on categorization. These developmental changes are illustrated by research on avian local and global levels of visual perceptual analysis, categorization of rectangles and moving objects, and artificial grammar learning. Implications are described for peer review of quantitative theory in which ambiguity, logical rigor, simplicity, or dynamics are designed to play important roles.

Alternative approaches to research in physical therapy: positivism and phenomenology.

PubMed

Shepard, K F; Jensen, G M; Schmoll, B J; Hack, L M; Gwyer, J

1993-02-01

This article presents philosophical approaches to research in physical therapy. A comparison is made to demonstrate how the research purpose, research design, research methods, and research data differ when one approaches research from the philosophical perspective of positivism (predominantly quantitative) as compared with the philosophical perspective of phenomenology (predominantly qualitative). Differences between the two approaches are highlighted by examples from research articles published in Physical Therapy. The authors urge physical therapy researchers to become familiar with the tenets, rigor, and knowledge gained from the use of both approaches in order to increase their options in conducting research relevant to the practice of physical therapy.

Rigor or mortis: best practices for preclinical research in neuroscience.

PubMed

Steward, Oswald; Balice-Gordon, Rita

2014-11-05

Numerous recent reports document a lack of reproducibility of preclinical studies, raising concerns about potential lack of rigor. Examples of lack of rigor have been extensively documented and proposals for practices to improve rigor are appearing. Here, we discuss some of the details and implications of previously proposed best practices and consider some new ones, focusing on preclinical studies relevant to human neurological and psychiatric disorders. Copyright © 2014 Elsevier Inc. All rights reserved.

Is Collaborative, Community-Engaged Scholarship More Rigorous than Traditional Scholarship? On Advocacy, Bias, and Social Science Research

ERIC Educational Resources Information Center

Warren, Mark R.; Calderón, José; Kupscznk, Luke Aubry; Squires, Gregory; Su, Celina

2018-01-01

Contrary to the charge that advocacy-oriented research cannot meet social science research standards because it is inherently biased, the authors of this article argue that collaborative, community-engaged scholarship (CCES) must meet high standards of rigor if it is to be useful to support equity-oriented, social justice agendas. In fact, they…

Accelerating Biomedical Discoveries through Rigor and Transparency.

PubMed

Hewitt, Judith A; Brown, Liliana L; Murphy, Stephanie J; Grieder, Franziska; Silberberg, Shai D

2017-07-01

Difficulties in reproducing published research findings have garnered a lot of press in recent years. As a funder of biomedical research, the National Institutes of Health (NIH) has taken measures to address underlying causes of low reproducibility. Extensive deliberations resulted in a policy, released in 2015, to enhance reproducibility through rigor and transparency. We briefly explain what led to the policy, describe its elements, provide examples and resources for the biomedical research community, and discuss the potential impact of the policy on translatability with a focus on research using animal models. Importantly, while increased attention to rigor and transparency may lead to an increase in the number of laboratory animals used in the near term, it will lead to more efficient and productive use of such resources in the long run. The translational value of animal studies will be improved through more rigorous assessment of experimental variables and data, leading to better assessments of the translational potential of animal models, for the benefit of the research community and society. Published by Oxford University Press on behalf of the Institute for Laboratory Animal Research 2017. This work is written by (a) US Government employee(s) and is in the public domain in the US.

Conducting a multicentre and multinational qualitative study on patient transitions.

PubMed

Johnson, Julie K; Barach, Paul; Vernooij-Dassen, Myrra

2012-12-01

A multicentre, multinational research study requires careful planning and coordination to accomplish the aims of the study and to ensure systematic and rigorous examination of all project methods and data collected. The aim of this paper is to describe the approach we used during the HANDOVER Project to develop a multicentre, multinational research project for studying transitions of patient care while creating a community of practice for the researchers. We highlight the process used to assure the quality of a multicentre qualitative study and to create a codebook for data analysis as examples of attending to the community of practice while conducting rigorous qualitative research. Essential elements for the success of this multinational, multilanguage research project included recruiting a strong research team, explicit planning for decision-making processes to be used throughout the project, acknowledging the differences among the study settings and planning the protocols to capitalise upon those differences. Although not commonly discussed in reports of large research projects, there is an underlying, concurrent stream of activities to develop a cohesive team that trusts and respects one another's skills and that engage independent researchers in a group process that contributes to achieving study goals. We discuss other lessons learned and offer recommendations for other teams planning multicentre research.

Tenderness of pre- and post rigor lamb longissimus muscle.

PubMed

Geesink, Geert; Sujang, Sadi; Koohmaraie, Mohammad

2011-08-01

Lamb longissimus muscle (n=6) sections were cooked at different times post mortem (prerigor, at rigor, 1dayp.m., and 7 days p.m.) using two cooking methods. Using a boiling waterbath, samples were either cooked to a core temperature of 70 °C or boiled for 3h. The latter method was meant to reflect the traditional cooking method employed in countries where preparation of prerigor meat is practiced. The time postmortem at which the meat was prepared had a large effect on the tenderness (shear force) of the meat (P<0.01). Cooking prerigor and at rigor meat to 70 °C resulted in higher shear force values than their post rigor counterparts at 1 and 7 days p.m. (9.4 and 9.6 vs. 7.2 and 3.7 kg, respectively). The differences in tenderness between the treatment groups could be largely explained by a difference in contraction status of the meat after cooking and the effect of ageing on tenderness. Cooking pre and at rigor meat resulted in severe muscle contraction as evidenced by the differences in sarcomere length of the cooked samples. Mean sarcomere lengths in the pre and at rigor samples ranged from 1.05 to 1.20 μm. The mean sarcomere length in the post rigor samples was 1.44 μm. Cooking for 3 h at 100 °C did improve the tenderness of pre and at rigor prepared meat as compared to cooking to 70 °C, but not to the extent that ageing did. It is concluded that additional intervention methods are needed to improve the tenderness of prerigor cooked meat. Copyright © 2011 Elsevier B.V. All rights reserved.

Response to Ridgeway, Dunston, and Qian: On Methodological Rigor: Has Rigor Mortis Set In?

ERIC Educational Resources Information Center

Baldwin, R. Scott; Vaughn, Sharon

1993-01-01

Responds to an article in the same issue of the journal presenting a meta-analysis of reading research. Expresses concern that the authors' conclusions will promote a slavish adherence to a methodology and a rigidity of thought that reading researchers can ill afford. (RS)

Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

PubMed

Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

2017-01-01

Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

Methods for Influencing Social Policy: The Role of Social Experiments.

PubMed

Shinn, Marybeth

2016-12-01

Research methods in community psychology have grown more diverse since the Swampscott conference, but rigorous social experiments maintain a place among the multiplicity of methods that can promote community psychology values. They are particularly influential in policy circles. Two examples of social experiments to end homelessness for different populations illustrate their role. Both studies show that offering extremely poor and disenfranchised people autonomy and the resources they seek works better than "helping" them to overcome deficits in ways designed by well-meaning service providers. Experiments are neither the first nor the last method community psychologists should employ, but are a critical part of the field's armamentarium for systems change. © Society for Community Research and Action 2016.

Using Framework Analysis in nursing research: a worked example.

PubMed

Ward, Deborah J; Furber, Christine; Tierney, Stephanie; Swallow, Veronica

2013-11-01

To demonstrate Framework Analysis using a worked example and to illustrate how criticisms of qualitative data analysis including issues of clarity and transparency can be addressed. Critics of the analysis of qualitative data sometimes cite lack of clarity and transparency about analytical procedures; this can deter nurse researchers from undertaking qualitative studies. Framework Analysis is flexible, systematic, and rigorous, offering clarity, transparency, an audit trail, an option for theme-based and case-based analysis and for readily retrievable data. This paper offers further explanation of the process undertaken which is illustrated with a worked example. Data were collected from 31 nursing students in 2009 using semi-structured interviews. The data collected are not reported directly here but used as a worked example for the five steps of Framework Analysis. Suggestions are provided to guide researchers through essential steps in undertaking Framework Analysis. The benefits and limitations of Framework Analysis are discussed. Nurses increasingly use qualitative research methods and need to use an analysis approach that offers transparency and rigour which Framework Analysis can provide. Nurse researchers may find the detailed critique of Framework Analysis presented in this paper a useful resource when designing and conducting qualitative studies. Qualitative data analysis presents challenges in relation to the volume and complexity of data obtained and the need to present an 'audit trail' for those using the research findings. Framework Analysis is an appropriate, rigorous and systematic method for undertaking qualitative analysis. © 2013 Blackwell Publishing Ltd.

Mechanical properties of frog skeletal muscles in iodoacetic acid rigor.

PubMed Central

Mulvany, M J

1975-01-01

1. Methods have been developed for describing the length: tension characteristics of frog skeletal muscles which go into rigor at 4 degrees C following iodoacetic acid poisoning either in the presence of Ca2+ (Ca-rigor) or its absence (Ca-free-rigor). 2. Such rigor muscles showed less resistance to slow stretch (slow rigor resistance) that to fast stretch (fast rigor resistance). The slow and fast rigor resistances of Ca-free-rigor muscles were much lower than those of Ca-rigor muscles. 3. The slow rigor resistance of Ca-rigor muscles was proportional to the amount of overlap between the contractile filaments present when the muscles were put into rigor. 4. Withdrawing Ca2+ from Ca-rigor muscles (induced-Ca-free rigor) reduced their slow and fast rigor resistances. Readdition of Ca2+ (but not Mg2+, Mn2+ or Sr2+) reversed the effect. 5. The slow and fast rigor resistances of Ca-rigor muscles (but not of Ca-free-rigor muscles) decreased with time. 6.The sarcomere structure of Ca-rigor and induced-Ca-free rigor muscles stretched by 0.2lo was destroyed in proportion to the amount of stretch, but the lengths of the remaining intact sarcomeres were essentially unchanged. This suggests that there had been a successive yielding of the weakeast sarcomeres. 7. The difference between the slow and fast rigor resistance and the effect of calcium on these resistances are discussed in relation to possible variations in the strength of crossbridges between the thick and thin filaments. Images Plate 1 Plate 2 PMID:1082023

Mixed Methods in Biomedical and Health Services Research

PubMed Central

Curry, Leslie A.; Krumholz, Harlan M.; O’Cathain, Alicia; Plano Clark, Vicki L.; Cherlin, Emily; Bradley, Elizabeth H.

2013-01-01

Mixed methods studies, in which qualitative and quantitative methods are combined in a single program of inquiry, can be valuable in biomedical and health services research, where the complementary strengths of each approach can yield greater insight into complex phenomena than either approach alone. Although interest in mixed methods is growing among science funders and investigators, written guidance on how to conduct and assess rigorous mixed methods studies is not readily accessible to the general readership of peer-reviewed biomedical and health services journals. Furthermore, existing guidelines for publishing mixed methods studies are not well known or applied by researchers and journal editors. Accordingly, this paper is intended to serve as a concise, practical resource for readers interested in core principles and practices of mixed methods research. We briefly describe mixed methods approaches and present illustrations from published biomedical and health services literature, including in cardiovascular care, summarize standards for the design and reporting of these studies, and highlight four central considerations for investigators interested in using these methods. PMID:23322807

Lichen elements as pollution indicators: evaluation of methods for large monitoring programmes

Treesearch

Susan Will-Wolf; Sarah Jovan; Michael C. Amacher

2017-01-01

Lichen element content is a reliable indicator for relative air pollution load in research and monitoring programmes requiring both efficiency and representation of many sites. We tested the value of costly rigorous field and handling protocols for sample element analysis using five lichen species. No relaxation of rigour was supported; four relaxed protocols generated...

Cost-Effectiveness Analysis of Early Reading Programs: A Demonstration with Recommendations for Future Research

ERIC Educational Resources Information Center

Hollands, Fiona M.; Kieffer, Michael J.; Shand, Robert; Pan, Yilin; Cheng, Henan; Levin, Henry M.

2016-01-01

We review the value of cost-effectiveness analysis for evaluation and decision making with respect to educational programs and discuss its application to early reading interventions. We describe the conditions for a rigorous cost-effectiveness analysis and illustrate the challenges of applying the method in practice, providing examples of programs…

How Do Professional Learning Communities Foster Strong Career and Technical Education Programs of Study in Illinois Public High Schools?

ERIC Educational Resources Information Center

Custable, Wendy

2013-01-01

This research study examines how Illinois public high school Career and Technical Education educational leaders employ best practices in providing all students rigorous, relevant, and equitable learning experiences within a professional learning community structure. This study utilized a mixed method two-tier case study methodology. Tier one…

A Journey of Surprises: Rivers Reveal Their Secrets to Idaho Students Researching Water Quality through Rigorous Scientific Inquiry.

ERIC Educational Resources Information Center

Boss, Suzie

2002-01-01

Idaho secondary students learn the scientific method through outdoor environmental projects related to water quality monitoring. A program trains teachers to design project-based learning and provides extensive followup support. Five-day summer workshops immerse teachers in the types of projects they will orchestrate with their own students.…

What We Are Learning about Early Education in Sub-Saharan Africa

ERIC Educational Resources Information Center

Gove, Amber

2017-01-01

This commentary discusses the three articles in this (2017) issue. The articles expand the published research base on the effectiveness of early education in the sub-Saharan Africa countries of Zambia, Kenya, and the Democratic Republic of Congo (DRC). Each of the three articles employs rigorous methods to better understand the impact of…

Evaluative criteria for qualitative research in health care: controversies and recommendations.

PubMed

Cohen, Deborah J; Crabtree, Benjamin F

2008-01-01

We wanted to review and synthesize published criteria for good qualitative research and develop a cogent set of evaluative criteria. We identified published journal articles discussing criteria for rigorous research using standard search strategies then examined reference sections of relevant journal articles to identify books and book chapters on this topic. A cross-publication content analysis allowed us to identify criteria and understand the beliefs that shape them. Seven criteria for good qualitative research emerged: (1) carrying out ethical research; (2) importance of the research; (3) clarity and coherence of the research report; (4) use of appropriate and rigorous methods; (5) importance of reflexivity or attending to researcher bias; (6) importance of establishing validity or credibility; and (7) importance of verification or reliability. General agreement was observed across publications on the first 4 quality dimensions. On the last 3, important divergent perspectives were observed in how these criteria should be applied to qualitative research, with differences based on the paradigm embraced by the authors. Qualitative research is not a unified field. Most manuscript and grant reviewers are not qualitative experts and are likely to embrace a generic set of criteria rather than those relevant to the particular qualitative approach proposed or reported. Reviewers and researchers need to be aware of this tendency and educate health care researchers about the criteria appropriate for evaluating qualitative research from within the theoretical and methodological framework from which it emerges.

Challenges in Building Usable Knowledge in Education

ERIC Educational Resources Information Center

Hedges, Larry V.

2018-01-01

The scientific rigor of education research has improved dramatically since the year 2000. Much of the credit for this improvement is deserved by Institute of Education Sciences (IES) policies that helped create a demand for rigorous research; increased human capital capacity to carry out such work; provided funding for the work itself; and…

Critical Analysis of Strategies for Determining Rigor in Qualitative Inquiry.

PubMed

Morse, Janice M

2015-09-01

Criteria for determining the trustworthiness of qualitative research were introduced by Guba and Lincoln in the 1980s when they replaced terminology for achieving rigor, reliability, validity, and generalizability with dependability, credibility, and transferability. Strategies for achieving trustworthiness were also introduced. This landmark contribution to qualitative research remains in use today, with only minor modifications in format. Despite the significance of this contribution over the past four decades, the strategies recommended to achieve trustworthiness have not been critically examined. Recommendations for where, why, and how to use these strategies have not been developed, and how well they achieve their intended goal has not been examined. We do not know, for example, what impact these strategies have on the completed research. In this article, I critique these strategies. I recommend that qualitative researchers return to the terminology of social sciences, using rigor, reliability, validity, and generalizability. I then make recommendations for the appropriate use of the strategies recommended to achieve rigor: prolonged engagement, persistent observation, and thick, rich description; inter-rater reliability, negative case analysis; peer review or debriefing; clarifying researcher bias; member checking; external audits; and triangulation. © The Author(s) 2015.

A feminist response to Weitzer.

PubMed

Dines, Gail

2012-04-01

In his review of my book Pornland: How Porn has Hijacked our Sexuality, Ronald Weitzer claims that anti-porn feminists are incapable of objective, rigorous research because they operate within the "oppression paradigm," which he defines as "a perspective that depicts all types of sex work as exploitive, violent, and perpetuating gender inequality." (VAW, 2011, 666). This article argues that while anti-porn feminists do indeed see pornography as exploitive, such a position is rooted in the rigorous theories and methods of cultural studies developed by critical media scholars such as Stuart Hall and Antonio Gramsci. Pornland applies a cultural studies approach by exploring how porn images are part of a wider system of sexist representations that legitimize and normalize the economic, political and legal oppression of women.

Collaboratory for the Study of Earthquake Predictability

NASA Astrophysics Data System (ADS)

Schorlemmer, D.; Jordan, T. H.; Zechar, J. D.; Gerstenberger, M. C.; Wiemer, S.; Maechling, P. J.

2006-12-01

Earthquake prediction is one of the most difficult problems in physical science and, owing to its societal implications, one of the most controversial. The study of earthquake predictability has been impeded by the lack of an adequate experimental infrastructure---the capability to conduct scientific prediction experiments under rigorous, controlled conditions and evaluate them using accepted criteria specified in advance. To remedy this deficiency, the Southern California Earthquake Center (SCEC) is working with its international partners, which include the European Union (through the Swiss Seismological Service) and New Zealand (through GNS Science), to develop a virtual, distributed laboratory with a cyberinfrastructure adequate to support a global program of research on earthquake predictability. This Collaboratory for the Study of Earthquake Predictability (CSEP) will extend the testing activities of SCEC's Working Group on Regional Earthquake Likelihood Models, from which we will present first results. CSEP will support rigorous procedures for registering prediction experiments on regional and global scales, community-endorsed standards for assessing probability-based and alarm-based predictions, access to authorized data sets and monitoring products from designated natural laboratories, and software to allow researchers to participate in prediction experiments. CSEP will encourage research on earthquake predictability by supporting an environment for scientific prediction experiments that allows the predictive skill of proposed algorithms to be rigorously compared with standardized reference methods and data sets. It will thereby reduce the controversies surrounding earthquake prediction, and it will allow the results of prediction experiments to be communicated to the scientific community, governmental agencies, and the general public in an appropriate research context.

Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

PubMed

Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

2012-04-01

Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.

Stages in the research process.

PubMed

Gelling, Leslie

2015-03-04

Research should be conducted in a systematic manner, allowing the researcher to progress from a general idea or clinical problem to scientifically rigorous research findings that enable new developments to improve clinical practice. Using a research process helps guide this process. This article is the first in a 26-part series on nursing research. It examines the process that is common to all research, and provides insights into ten different stages of this process: developing the research question, searching and evaluating the literature, selecting the research approach, selecting research methods, gaining access to the research site and data, pilot study, sampling and recruitment, data collection, data analysis, and dissemination of results and implementation of findings.

Rigor in electronic health record knowledge representation: Lessons learned from a SNOMED CT clinical content encoding exercise.

PubMed

Monsen, Karen A; Finn, Robert S; Fleming, Thea E; Garner, Erin J; LaValla, Amy J; Riemer, Judith G

2016-01-01

Rigor in clinical knowledge representation is necessary foundation for meaningful interoperability, exchange and reuse of electronic health record (EHR) data. It is critical for clinicians to understand principles and implications of using clinical standards for knowledge representation within EHRs. To educate clinicians and students about knowledge representation and to evaluate their success of applying the manual lookups method for assigning Systematized Nomenclature of Medicine Clinical Terms (SNOMED CT) concept identifiers using formally mapped concepts from the Omaha System interface terminology. Clinicians who were students in a doctoral nursing program conducted 21 lookups for Omaha System terms in publicly available SNOMED CT browsers. Lookups were deemed successful if results matched exactly with the corresponding code from the January 2013 SNOMED CT-Omaha System terminology cross-map. Of the 21 manual lookups attempted, 12 (57.1%) were successful. Errors were due to semantic gaps differences in granularity and synonymy or partial term matching. Achieving rigor in clinical knowledge representation across settings, vendors and health systems is a globally recognized challenge. Cross-maps have potential to improve rigor in SNOMED CT encoding of clinical data. Further research is needed to evaluate outcomes of using of terminology cross-maps to encode clinical terms with SNOMED CT concept identifiers based on interface terminologies.

Experimental evaluation of rigor mortis. VI. Effect of various causes of death on the evolution of rigor mortis.

PubMed

Krompecher, T; Bergerioux, C; Brandt-Casadevall, C; Gujer, H R

1983-07-01

The evolution of rigor mortis was studied in cases of nitrogen asphyxia, drowning and strangulation, as well as in fatal intoxications due to strychnine, carbon monoxide and curariform drugs, using a modified method of measurement. Our experiments demonstrated that: (1) Strychnine intoxication hastens the onset and passing of rigor mortis. (2) CO intoxication delays the resolution of rigor mortis. (3) The intensity of rigor may vary depending upon the cause of death. (4) If the stage of rigidity is to be used to estimate the time of death, it is necessary: (a) to perform a succession of objective measurements of rigor mortis intensity; and (b) to verify the eventual presence of factors that could play a role in the modification of its development.

A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation

ERIC Educational Resources Information Center

Acosta, Joie D.; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S.

2016-01-01

Restorative practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this article describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI)…

Graphical Descriptives: A Way to Improve Data Transparency and Methodological Rigor in Psychology.

PubMed

Tay, Louis; Parrigon, Scott; Huang, Qiming; LeBreton, James M

2016-09-01

Several calls have recently been issued to the social sciences for enhanced transparency of research processes and enhanced rigor in the methodological treatment of data and data analytics. We propose the use of graphical descriptives (GDs) as one mechanism for responding to both of these calls. GDs provide a way to visually examine data. They serve as quick and efficient tools for checking data distributions, variable relations, and the potential appropriateness of different statistical analyses (e.g., do data meet the minimum assumptions for a particular analytic method). Consequently, we believe that GDs can promote increased transparency in the journal review process, encourage best practices for data analysis, and promote a more inductive approach to understanding psychological data. We illustrate the value of potentially including GDs as a step in the peer-review process and provide a user-friendly online resource (www.graphicaldescriptives.org) for researchers interested in including data visualizations in their research. We conclude with suggestions on how GDs can be expanded and developed to enhance transparency. © The Author(s) 2016.

Rigorous Program Evaluations on a Budget: How Low-Cost Randomized Controlled Trials Are Possible in Many Areas of Social Policy

ERIC Educational Resources Information Center

Coalition for Evidence-Based Policy, 2012

2012-01-01

The increasing ability of social policy researchers to conduct randomized controlled trials (RCTs) at low cost could revolutionize the field of performance-based government. RCTs are widely judged to be the most credible method of evaluating whether a social program is effective, overcoming the demonstrated inability of other, more common methods…

Collaborative Evaluation of a High School Prevention Curriculum: How Methods of Collaborative Evaluation Enhanced a Randomized Control Trial to Inform Program Improvement

ERIC Educational Resources Information Center

Orsini, Muhsin Michael; Wyrick, David L.; Milroy, Jeffrey J.

2012-01-01

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

Meta-Analysis of the Effectiveness of Individual Intervention in the Controlled Multisensory Environment (Snoezelen[R]) for Individuals with Intellectual Disability

ERIC Educational Resources Information Center

Lotan, Meir; Gold, Christian

2009-01-01

Background: The Snoezelen[R] is a multisensory intervention approach that has been implemented with various populations. Due to an almost complete absence of rigorous research in this field, the confirmation of this approach as an effective therapeutic intervention is warranted. Method: To evaluate the therapeutic influence of the…

Quantifying Peer Interactions for Research and Clinical Use: The Manchester Inventory for Playground Observation

ERIC Educational Resources Information Center

Gibson, Jenny; Hussain, Jamilla; Holsgrove, Samina; Adams, Catherine; Green, Jonathan

2011-01-01

Direct observation of peer relating is potentially a sensitive and ecologically valid measure of child social functioning, but there has been a lack of standardised methods. The Manchester Inventory for Playground Observation (MIPO) was developed as a practical yet rigorous assessment of this kind for 5-11 year olds. We report on the initial…

Qualitative research methods for medical educators.

PubMed

Hanson, Janice L; Balmer, Dorene F; Giardino, Angelo P

2011-01-01

This paper provides a primer for qualitative research in medical education. Our aim is to equip readers with a basic understanding of qualitative research and prepare them to judge the goodness of fit between qualitative research and their own research questions. We provide an overview of the reasons for choosing a qualitative research approach and potential benefits of using these methods for systematic investigation. We discuss developing qualitative research questions, grounding research in a philosophical framework, and applying rigorous methods of data collection, sampling, and analysis. We also address methods to establish the trustworthiness of a qualitative study and introduce the reader to ethical concerns that warrant special attention when planning qualitative research. We conclude with a worksheet that readers may use for designing a qualitative study. Medical educators ask many questions that carefully designed qualitative research would address effectively. Careful attention to the design of qualitative studies will help to ensure credible answers that will illuminate many of the issues, challenges, and quandaries that arise while doing the work of medical education. Copyright © 2011 Academic Pediatric Association. All rights reserved.

[A new formula for the measurement of rigor mortis: the determination of the FRR-index (author's transl)].

PubMed

Forster, B; Ropohl, D; Raule, P

1977-07-05

The manual examination of rigor mortis as currently used and its often subjective evaluation frequently produced highly incorrect deductions. It is therefore desirable that such inaccuracies should be replaced by the objective measuring of rigor mortis at the extremities. To that purpose a method is described which can also be applied in on-the-spot investigations and a new formula for the determination of rigor mortis--indices (FRR) is introduced.

Commentary: Writing and Evaluating Qualitative Research Reports.

PubMed

Wu, Yelena P; Thompson, Deborah; Aroian, Karen J; McQuaid, Elizabeth L; Deatrick, Janet A

2016-06-01

To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field's ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. © The Author 2016. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Rigor in Qualitative Social Work Research: A Review of Strategies Used in Published Articles

ERIC Educational Resources Information Center

Barusch, Amanda; Gringeri, Christina; George, Molly

2011-01-01

This study was conducted to describe strategies used by social work researchers to enhance the rigor of their qualitative work. A template was developed and used to review a random sample of 100 articles drawn from social work journals listed in the "2005 Journal Citation Reports: Science and Social Sciences Edition." Results suggest that the most…

Cost estimation: An expert-opinion approach. [cost analysis of research projects using the Delphi method (forecasting)

NASA Technical Reports Server (NTRS)

Buffalano, C.; Fogleman, S.; Gielecki, M.

1976-01-01

A methodology is outlined which can be used to estimate the costs of research and development projects. The approach uses the Delphi technique a method developed by the Rand Corporation for systematically eliciting and evaluating group judgments in an objective manner. The use of the Delphi allows for the integration of expert opinion into the cost-estimating process in a consistent and rigorous fashion. This approach can also signal potential cost-problem areas. This result can be a useful tool in planning additional cost analysis or in estimating contingency funds. A Monte Carlo approach is also examined.

Rigor and reproducibility in research with transcranial electrical stimulation: An NIMH-sponsored workshop.

PubMed

Bikson, Marom; Brunoni, Andre R; Charvet, Leigh E; Clark, Vincent P; Cohen, Leonardo G; Deng, Zhi-De; Dmochowski, Jacek; Edwards, Dylan J; Frohlich, Flavio; Kappenman, Emily S; Lim, Kelvin O; Loo, Colleen; Mantovani, Antonio; McMullen, David P; Parra, Lucas C; Pearson, Michele; Richardson, Jessica D; Rumsey, Judith M; Sehatpour, Pejman; Sommers, David; Unal, Gozde; Wassermann, Eric M; Woods, Adam J; Lisanby, Sarah H

Neuropsychiatric disorders are a leading source of disability and require novel treatments that target mechanisms of disease. As such disorders are thought to result from aberrant neuronal circuit activity, neuromodulation approaches are of increasing interest given their potential for manipulating circuits directly. Low intensity transcranial electrical stimulation (tES) with direct currents (transcranial direct current stimulation, tDCS) or alternating currents (transcranial alternating current stimulation, tACS) represent novel, safe, well-tolerated, and relatively inexpensive putative treatment modalities. This report seeks to promote the science, technology and effective clinical applications of these modalities, identify research challenges, and suggest approaches for addressing these needs in order to achieve rigorous, reproducible findings that can advance clinical treatment. The National Institute of Mental Health (NIMH) convened a workshop in September 2016 that brought together experts in basic and human neuroscience, electrical stimulation biophysics and devices, and clinical trial methods to examine the physiological mechanisms underlying tDCS/tACS, technologies and technical strategies for optimizing stimulation protocols, and the state of the science with respect to therapeutic applications and trial designs. Advances in understanding mechanisms, methodological and technological improvements (e.g., electronics, computational models to facilitate proper dosing), and improved clinical trial designs are poised to advance rigorous, reproducible therapeutic applications of these techniques. A number of challenges were identified and meeting participants made recommendations made to address them. These recommendations align with requirements in NIMH funding opportunity announcements to, among other needs, define dosimetry, demonstrate dose/response relationships, implement rigorous blinded trial designs, employ computational modeling, and demonstrate target engagement when testing stimulation-based interventions for the treatment of mental disorders. Published by Elsevier Inc.

Electron-Ion Dynamics with Time-Dependent Density Functional Theory: Towards Predictive Solar Cell Modeling: Final Technical Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Maitra, Neepa

2016-07-14

This project investigates the accuracy of currently-used functionals in time-dependent density functional theory, which is today routinely used to predict and design materials and computationally model processes in solar energy conversion. The rigorously-based electron-ion dynamics method developed here sheds light on traditional methods and overcomes challenges those methods have. The fundamental research undertaken here is important for building reliable and practical methods for materials discovery. The ultimate goal is to use these tools for the computational design of new materials for solar cell devices of high efficiency.

Using Grounded Theory Method to Capture and Analyze Health Care Experiences

PubMed Central

Foley, Geraldine; Timonen, Virpi

2015-01-01

Objective Grounded theory (GT) is an established qualitative research method, but few papers have encapsulated the benefits, limits, and basic tenets of doing GT research on user and provider experiences of health care services. GT can be used to guide the entire study method, or it can be applied at the data analysis stage only. Methods We summarize key components of GT and common GT procedures used by qualitative researchers in health care research. We draw on our experience of conducting a GT study on amyotrophic lateral sclerosis patients’ experiences of health care services. Findings We discuss why some approaches in GT research may work better than others, particularly when the focus of study is hard-to-reach population groups. We highlight the flexibility of procedures in GT to build theory about how people engage with health care services. Conclusion GT enables researchers to capture and understand health care experiences. GT methods are particularly valuable when the topic of interest has not previously been studied. GT can be applied to bring structure and rigor to the analysis of qualitative data. PMID:25523315

Accuracy and performance of 3D mask models in optical projection lithography

NASA Astrophysics Data System (ADS)

Agudelo, Viviana; Evanschitzky, Peter; Erdmann, Andreas; Fühner, Tim; Shao, Feng; Limmer, Steffen; Fey, Dietmar

2011-04-01

Different mask models have been compared: rigorous electromagnetic field (EMF) modeling, rigorous EMF modeling with decomposition techniques and the thin mask approach (Kirchhoff approach) to simulate optical diffraction from different mask patterns in projection systems for lithography. In addition, each rigorous model was tested for two different formulations for partially coherent imaging: The Hopkins assumption and rigorous simulation of mask diffraction orders for multiple illumination angles. The aim of this work is to closely approximate results of the rigorous EMF method by the thin mask model enhanced with pupil filtering techniques. The validity of this approach for different feature sizes, shapes and illumination conditions is investigated.

Methods used and lessons learnt in conducting document reviews of medical and allied health curricula - a key step in curriculum evaluation.

PubMed

Rohwer, Anke; Schoonees, Anel; Young, Taryn

2014-11-02

This paper describes the process, our experience and the lessons learnt in doing document reviews of health science curricula. Since we could not find relevant literature to guide us on how to approach these reviews, we feel that sharing our experience would benefit researchers embarking on similar projects. We followed a rigorous, transparent, pre-specified approach that included the preparation of a protocol, a pre-piloted data extraction form and coding schedule. Data were extracted, analysed and synthesised. Quality checks were included at all stages of the process. The main lessons we learnt related to time and project management, continuous quality assurance, selecting the software that meets the needs of the project, involving experts as needed and disseminating the findings to relevant stakeholders. A complete curriculum evaluation comprises, apart from a document review, interviews with students and lecturers to assess the learnt and taught curricula respectively. Rigorous methods must be used to ensure an objective assessment.

Ned Hall Didn't Have to Get a Haircut: Or, Why We Haven't Learned Much about International Marketing in the Last 25 Years.

ERIC Educational Resources Information Center

Graham, John L.; Gronhaug, Kjell

1989-01-01

The limitations of the knowledge production system in international marketing are considered, and dissertations in international marketing are analyzed. The findings suggest that research in the area is driven by standards of rigor and a distinct "methods basis," which are often inappropriate for the study of important problems in…

Automatic and user-centric approaches to video summary evaluation

NASA Astrophysics Data System (ADS)

Taskiran, Cuneyt M.; Bentley, Frank

2007-01-01

Automatic video summarization has become an active research topic in content-based video processing. However, not much emphasis has been placed on developing rigorous summary evaluation methods and developing summarization systems based on a clear understanding of user needs, obtained through user centered design. In this paper we address these two topics and propose an automatic video summary evaluation algorithm adapted from teh text summarization domain.

Engagement, Alignment, and Rigor as Vital Signs of High-Quality Instruction: A Classroom Visit Protocol for Instructional Improvement and Research

ERIC Educational Resources Information Center

Early, Diane M.; Rogge, Ronald D.; Deci, Edward L.

2014-01-01

This paper investigates engagement (E), alignment (A), and rigor (R) as vital signs of high-quality teacher instruction as measured by the EAR Classroom Visit Protocol, designed by the Institute for Research and Reform in Education (IRRE). Findings indicated that both school leaders and outside raters could learn to score the protocol with…

Beyond Compliance Checking: A Situated Approach to Visual Research Ethics.

PubMed

Lenette, Caroline; Botfield, Jessica R; Boydell, Katherine; Haire, Bridget; Newman, Christy E; Zwi, Anthony B

2018-03-19

Visual research methods like photography and digital storytelling are increasingly used in health and social sciences research as participatory approaches that benefit participants, researchers, and audiences. Visual methods involve a number of additional ethical considerations such as using identifiable content and ownership of creative outputs. As such, ethics committees should use different assessment frameworks to consider research protocols with visual methods. Here, we outline the limitations of ethics committees in assessing projects with a visual focus and highlight the sparse knowledge on how researchers respond when they encounter ethical challenges in the practice of visual research. We propose a situated approach in relation to visual methodologies that encompasses a negotiated, flexible approach, given that ethical issues usually emerge in relation to the specific contexts of individual research projects. Drawing on available literature and two case studies, we identify and reflect on nuanced ethical implications in visual research, like tensions between aesthetics and research validity. The case studies highlight strategies developed in-situ to address the challenges two researchers encountered when using visual research methods, illustrating that some practice implications are not necessarily addressed using established ethical clearance procedures. A situated approach can ensure that visual research remains ethical, engaging, and rigorous.

How does tele-learning compare with other forms of education delivery? A systematic review of tele-learning educational outcomes for health professionals.

PubMed

Tomlinson, Jo; Shaw, Tim; Munro, Ana; Johnson, Ros; Madden, D Lynne; Phillips, Rosemary; McGregor, Deborah

2013-11-01

Telecommuniciation technologies, including audio and videoconferencing facilities, afford geographically dispersed health professionals the opportunity to connect and collaborate with others. Recognised for enabling tele-consultations and tele-collaborations between teams of health care professionals and their patients, these technologies are also well suited to the delivery of distance learning programs, known as tele-learning. To determine whether tele-learning delivery methods achieve equivalent learning outcomes when compared with traditional face-to-face education delivery methods. A systematic literature review was commissioned by the NSW Ministry of Health to identify results relevant to programs applying tele-learning delivery methods in the provision of education to health professionals. The review found few studies that rigorously compared tele-learning with traditional formats. There was some evidence, however, to support the premise that tele-learning models achieve comparable learning outcomes and that participants are generally satisfied with and accepting of this delivery method. The review illustrated that tele-learning technologies not only enable distance learning opportunities, but achieve comparable learning outcomes to traditional face-to-face models. More rigorous evidence is required to strengthen these findings and should be the focus of future tele-learning research.

Development and Content Validation of the Transition Readiness Inventory Item Pool for Adolescent and Young Adult Survivors of Childhood Cancer.

PubMed

Schwartz, Lisa A; Hamilton, Jessica L; Brumley, Lauren D; Barakat, Lamia P; Deatrick, Janet A; Szalda, Dava E; Bevans, Katherine B; Tucker, Carole A; Daniel, Lauren C; Butler, Eliana; Kazak, Anne E; Hobbie, Wendy L; Ginsberg, Jill P; Psihogios, Alexandra M; Ver Hoeve, Elizabeth; Tuchman, Lisa K

2017-10-01

The development of the Transition Readiness Inventory (TRI) item pool for adolescent and young adult childhood cancer survivors is described, aiming to both advance transition research and provide an example of the application of NIH Patient Reported Outcomes Information System methods. Using rigorous measurement development methods including mixed methods, patient and parent versions of the TRI item pool were created based on the Social-ecological Model of Adolescent and young adult Readiness for Transition (SMART). Each stage informed development and refinement of the item pool. Content validity ratings and cognitive interviews resulted in 81 content valid items for the patient version and 85 items for the parent version. TRI represents the first multi-informant, rigorously developed transition readiness item pool that comprehensively measures the social-ecological components of transition readiness. Discussion includes clinical implications, the application of TRI and the methods to develop the item pool to other populations, and next steps for further validation and refinement. © The Author 2017. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Using Grounded Theory Method to Capture and Analyze Health Care Experiences.

PubMed

Foley, Geraldine; Timonen, Virpi

2015-08-01

Grounded theory (GT) is an established qualitative research method, but few papers have encapsulated the benefits, limits, and basic tenets of doing GT research on user and provider experiences of health care services. GT can be used to guide the entire study method, or it can be applied at the data analysis stage only. We summarize key components of GT and common GT procedures used by qualitative researchers in health care research. We draw on our experience of conducting a GT study on amyotrophic lateral sclerosis patients' experiences of health care services. We discuss why some approaches in GT research may work better than others, particularly when the focus of study is hard-to-reach population groups. We highlight the flexibility of procedures in GT to build theory about how people engage with health care services. GT enables researchers to capture and understand health care experiences. GT methods are particularly valuable when the topic of interest has not previously been studied. GT can be applied to bring structure and rigor to the analysis of qualitative data. © Health Research and Educational Trust.

Developing the DESCARTE Model: The Design of Case Study Research in Health Care.

PubMed

Carolan, Clare M; Forbat, Liz; Smith, Annetta

2016-04-01

Case study is a long-established research tradition which predates the recent surge in mixed-methods research. Although a myriad of nuanced definitions of case study exist, seminal case study authors agree that the use of multiple data sources typify this research approach. The expansive case study literature demonstrates a lack of clarity and guidance in designing and reporting this approach to research. Informed by two reviews of the current health care literature, we posit that methodological description in case studies principally focuses on description of case study typology, which impedes the construction of methodologically clear and rigorous case studies. We draw from the case study and mixed-methods literature to develop the DESCARTE model as an innovative approach to the design, conduct, and reporting of case studies in health care. We examine how case study fits within the overall enterprise of qualitatively driven mixed-methods research, and the potential strengths of the model are considered. © The Author(s) 2015.

Near infrared spectroscopy as an on-line method to quantitatively determine glycogen and predict ultimate pH in pre rigor bovine M. longissimus dorsi.

PubMed

Lomiwes, D; Reis, M M; Wiklund, E; Young, O A; North, M

2010-12-01

The potential of near infrared (NIR) spectroscopy as an on-line method to quantify glycogen and predict ultimate pH (pH(u)) of pre rigor beef M. longissimus dorsi (LD) was assessed. NIR spectra (538 to 1677 nm) of pre rigor LD from steers, cows and bulls were collected early post mortem and measurements were made for pre rigor glycogen concentration and pH(u). Spectral and measured data were combined to develop models to quantify glycogen and predict the pH(u) of pre rigor LD. NIR spectra and pre rigor predicted values obtained from quantitative models were shown to be poorly correlated against glycogen and pH(u) (r(2)=0.23 and 0.20, respectively). Qualitative models developed to categorize each muscle according to their pH(u) were able to correctly categorize 42% of high pH(u) samples. Optimum qualitative and quantitative models derived from NIR spectra found low correlation between predicted values and reference measurements. Copyright © 2010 The American Meat Science Association. Published by Elsevier Ltd.. All rights reserved.

A Systematic Review of Interventions to Enhance Healthy Lifestyle Behaviors in Adolescents Delivered via Mobile Phone Text Messaging.

PubMed

Loescher, Lois J; Rains, Stephen A; Kramer, Sandra S; Akers, Chelsie; Moussa, Renee

2018-05-01

To systematically review healthy lifestyle interventions targeted to adolescents and delivered using text messaging (TM). PubMed, Embase, CINAHL, PsycINFO, and Web of Science databases. Study Inclusion Criteria: Research articles published during 2011 to 2014; analyses focused on intervention targeting adolescents (10-19 years), with healthy lifestyle behaviors as main variables, delivered via mobile phone-based TM. The authors extracted data from 27 of 281 articles using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses method. Adolescent and setting characteristics, study design and rigor, intervention effectiveness, challenges, and risk of bias. Across studies, 16 (59.3%) of 27 included non-Caucasians. The gender was split for 22 (81.5%) of 27 studies. Thirteen studies were randomized controlled trials. There was heterogeneity among targeted conditions, rigor of methods, and intervention effects. Interventions for monitoring/adherence (n = 8) reported more positive results than those for health behavior change (n = 19). Studies that only included message delivered via TM (n = 14) reported more positive effects than studies integrating multiple intervention components. Interventions delivered using TM presented minimal challenges, but selection and performance bias were observed across studies. Interventions delivered using TM have the potential, under certain conditions, to improve healthy lifestyle behaviors in adolescents. However, the rigor of studies varies, and established theory and validated measures have been inconsistently incorporated.

The "Performance of Rotavirus and Oral Polio Vaccines in Developing Countries" (PROVIDE) study: description of methods of an interventional study designed to explore complex biologic problems.

PubMed

Kirkpatrick, Beth D; Colgate, E Ross; Mychaleckyj, Josyf C; Haque, Rashidul; Dickson, Dorothy M; Carmolli, Marya P; Nayak, Uma; Taniuchi, Mami; Naylor, Caitlin; Qadri, Firdausi; Ma, Jennie Z; Alam, Masud; Walsh, Mary Claire; Diehl, Sean A; Petri, William A

2015-04-01

Oral vaccines appear less effective in children in the developing world. Proposed biologic reasons include concurrent enteric infections, malnutrition, breast milk interference, and environmental enteropathy (EE). Rigorous study design and careful data management are essential to begin to understand this complex problem while assuring research subject safety. Herein, we describe the methodology and lessons learned in the PROVIDE study (Dhaka, Bangladesh). A randomized clinical trial platform evaluated the efficacy of delayed-dose oral rotavirus vaccine as well as the benefit of an injectable polio vaccine replacing one dose of oral polio vaccine. This rigorous infrastructure supported the additional examination of hypotheses of vaccine underperformance. Primary and secondary efficacy and immunogenicity measures for rotavirus and polio vaccines were measured, as well as the impact of EE and additional exploratory variables. Methods for the enrollment and 2-year follow-up of a 700 child birth cohort are described, including core laboratory, safety, regulatory, and data management practices. Intense efforts to standardize clinical, laboratory, and data management procedures in a developing world setting provide clinical trials rigor to all outcomes. Although this study infrastructure requires extensive time and effort, it allows optimized safety and confidence in the validity of data gathered in complex, developing country settings. © The American Society of Tropical Medicine and Hygiene.

Qualitative Research in Emergency Care Part I: Research Principles and Common Applications.

PubMed

Choo, Esther K; Garro, Aris C; Ranney, Megan L; Meisel, Zachary F; Morrow Guthrie, Kate

2015-09-01

Qualitative methods are increasingly being used in emergency care research. Rigorous qualitative methods can play a critical role in advancing the emergency care research agenda by allowing investigators to generate hypotheses, gain an in-depth understanding of health problems or specific populations, create expert consensus, and develop new intervention and dissemination strategies. This article, Part I of a two-article series, provides an introduction to general principles of applied qualitative health research and examples of its common use in emergency care research, describing study designs and data collection methods most relevant to our field, including observation, individual interviews, and focus groups. In Part II of this series, we will outline the specific steps necessary to conduct a valid and reliable qualitative research project, with a focus on interview-based studies. These elements include building the research team, preparing data collection guides, defining and obtaining an adequate sample, collecting and organizing qualitative data, and coding and analyzing the data. We also discuss potential ethical considerations unique to qualitative research as it relates to emergency care research. © 2015 by the Society for Academic Emergency Medicine.

Qualitative Research in Emergency Care Part I: Research Principles and Common Applications

PubMed Central

Choo, Esther K.; Garro, Aris; Ranney, Megan L.; Meisel, Zachary; Guthrie, Kate Morrow

2015-01-01

Qualitative methods are increasingly being used in emergency care research. Rigorous qualitative methods can play a critical role in advancing the emergency care research agenda by allowing investigators to generate hypotheses, gain an in-depth understanding of health problems or specific populations, create expert consensus, and develop new intervention and dissemination strategies. This article, Part I of a two-article series, provides an introduction to general principles of applied qualitative health research and examples of its common use in emergency care research, describing study designs and data collection methods most relevant to our field, including observation, individual interviews, and focus groups. In Part II of this series, we will outline the specific steps necessary to conduct a valid and reliable qualitative research project, with a focus on interview-based studies. These elements include building the research team, preparing data collection guides, defining and obtaining an adequate sample, collecting and organizing qualitative data, and coding and analyzing the data. We also discuss potential ethical considerations unique to qualitative research as it relates to emergency care research. PMID:26284696

Using mixed methods effectively in prevention science: designs, procedures, and examples.

PubMed

Zhang, Wanqing; Watanabe-Galloway, Shinobu

2014-10-01

There is growing interest in using a combination of quantitative and qualitative methods to generate evidence about the effectiveness of health prevention, services, and intervention programs. With the emerging importance of mixed methods research across the social and health sciences, there has been an increased recognition of the value of using mixed methods for addressing research questions in different disciplines. We illustrate the mixed methods approach in prevention research, showing design procedures used in several published research articles. In this paper, we focused on two commonly used mixed methods designs: concurrent and sequential mixed methods designs. We discuss the types of mixed methods designs, the reasons for, and advantages of using a particular type of design, and the procedures of qualitative and quantitative data collection and integration. The studies reviewed in this paper show that the essence of qualitative research is to explore complex dynamic phenomena in prevention science, and the advantage of using mixed methods is that quantitative data can yield generalizable results and qualitative data can provide extensive insights. However, the emphasis of methodological rigor in a mixed methods application also requires considerable expertise in both qualitative and quantitative methods. Besides the necessary skills and effective interdisciplinary collaboration, this combined approach also requires an open-mindedness and reflection from the involved researchers.

Is There a Consensus on Consensus Methodology? Descriptions and Recommendations for Future Consensus Research.

PubMed

Waggoner, Jane; Carline, Jan D; Durning, Steven J

2016-05-01

The authors of this article reviewed the methodology of three common consensus methods: nominal group process, consensus development panels, and the Delphi technique. The authors set out to determine how a majority of researchers are conducting these studies, how they are analyzing results, and subsequently the manner in which they are reporting their findings. The authors conclude with a set of guidelines and suggestions designed to aid researchers who choose to use the consensus methodology in their work.Overall, researchers need to describe their inclusion criteria. In addition to this, on the basis of the current literature the authors found that a panel size of 5 to 11 members was most beneficial across all consensus methods described. Lastly, the authors agreed that the statistical analyses done in consensus method studies should be as rigorous as possible and that the predetermined definition of consensus must be included in the ultimate manuscript. More specific recommendations are given for each of the three consensus methods described in the article.

Post mortem rigor development in the Egyptian goose (Alopochen aegyptiacus) breast muscle (pectoralis): factors which may affect the tenderness.

PubMed

Geldenhuys, Greta; Muller, Nina; Frylinck, Lorinda; Hoffman, Louwrens C

2016-01-15

Baseline research on the toughness of Egyptian goose meat is required. This study therefore investigates the post mortem pH and temperature decline (15 min-4 h 15 min post mortem) in the pectoralis muscle (breast portion) of this gamebird species. It also explores the enzyme activity of the Ca(2+)-dependent protease (calpain system) and the lysosomal cathepsins during the rigor mortis period. No differences were found for any of the variables between genders. The pH decline in the pectoralis muscle occurs quite rapidly (c = -0.806; ultimate pH ∼ 5.86) compared with other species and it is speculated that the high rigor temperature (>20 °C) may contribute to the increased toughness. No calpain I was found in Egyptian goose meat and the µ/m-calpain activity remained constant during the rigor period, while a decrease in calpastatin activity was observed. The cathepsin B, B & L and H activity increased over the rigor period. Further research into the connective tissue content and myofibrillar breakdown during aging is required in order to know if the proteolytic enzymes do in actual fact contribute to tenderisation. © 2015 Society of Chemical Industry.

Double Sampling with Multiple Imputation to Answer Large Sample Meta-Research Questions: Introduction and Illustration by Evaluating Adherence to Two Simple CONSORT Guidelines

PubMed Central

Capers, Patrice L.; Brown, Andrew W.; Dawson, John A.; Allison, David B.

2015-01-01

Background: Meta-research can involve manual retrieval and evaluation of research, which is resource intensive. Creation of high throughput methods (e.g., search heuristics, crowdsourcing) has improved feasibility of large meta-research questions, but possibly at the cost of accuracy. Objective: To evaluate the use of double sampling combined with multiple imputation (DS + MI) to address meta-research questions, using as an example adherence of PubMed entries to two simple consolidated standards of reporting trials guidelines for titles and abstracts. Methods: For the DS large sample, we retrieved all PubMed entries satisfying the filters: RCT, human, abstract available, and English language (n = 322, 107). For the DS subsample, we randomly sampled 500 entries from the large sample. The large sample was evaluated with a lower rigor, higher throughput (RLOTHI) method using search heuristics, while the subsample was evaluated using a higher rigor, lower throughput (RHITLO) human rating method. Multiple imputation of the missing-completely at-random RHITLO data for the large sample was informed by: RHITLO data from the subsample; RLOTHI data from the large sample; whether a study was an RCT; and country and year of publication. Results: The RHITLO and RLOTHI methods in the subsample largely agreed (phi coefficients: title = 1.00, abstract = 0.92). Compliance with abstract and title criteria has increased over time, with non-US countries improving more rapidly. DS + MI logistic regression estimates were more precise than subsample estimates (e.g., 95% CI for change in title and abstract compliance by year: subsample RHITLO 1.050–1.174 vs. DS + MI 1.082–1.151). As evidence of improved accuracy, DS + MI coefficient estimates were closer to RHITLO than the large sample RLOTHI. Conclusion: Our results support our hypothesis that DS + MI would result in improved precision and accuracy. This method is flexible and may provide a practical way to examine large corpora of literature. PMID:25988135

Intentional research design in implementation science: implications for the use of nomothetic and idiographic assessment.

PubMed

Lyon, Aaron R; Connors, Elizabeth; Jensen-Doss, Amanda; Landes, Sara J; Lewis, Cara C; McLeod, Bryce D; Rutt, Christopher; Stanick, Cameo; Weiner, Bryan J

2017-09-01

The advancement of implementation science is dependent on identifying assessment strategies that can address implementation and clinical outcome variables in ways that are valid, relevant to stakeholders, and scalable. This paper presents a measurement agenda for implementation science that integrates the previously disparate assessment traditions of idiographic and nomothetic approaches. Although idiographic and nomothetic approaches are both used in implementation science, a review of the literature on this topic suggests that their selection can be indiscriminate, driven by convenience, and not explicitly tied to research study design. As a result, they are not typically combined deliberately or effectively. Thoughtful integration may simultaneously enhance both the rigor and relevance of assessments across multiple levels within health service systems. Background on nomothetic and idiographic assessment is provided as well as their potential to support research in implementation science. Drawing from an existing framework, seven structures (of various sequencing and weighting options) and five functions (Convergence, Complementarity, Expansion, Development, Sampling) for integrating conceptually distinct research methods are articulated as they apply to the deliberate, design-driven integration of nomothetic and idiographic assessment approaches. Specific examples and practical guidance are provided to inform research consistent with this framework. Selection and integration of idiographic and nomothetic assessments for implementation science research designs can be improved. The current paper argues for the deliberate application of a clear framework to improve the rigor and relevance of contemporary assessment strategies.

Experimental evaluation of rigor mortis. III. Comparative study of the evolution of rigor mortis in different sized muscle groups in rats.

PubMed

Krompecher, T; Fryc, O

1978-01-01

The use of new methods and an appropriate apparatus has allowed us to make successive measurements of rigor mortis and a study of its evolution in the rat. By a comparative examination on the front and hind limbs, we have determined the following: (1) The muscular mass of the hind limbs is 2.89 times greater than that of the front limbs. (2) In the initial phase rigor mortis is more pronounced in the front limbs. (3) The front and hind limbs reach maximum rigor mortis at the same time and this state is maintained for 2 hours. (4) Resolution of rigor mortis is accelerated in the front limbs during the initial phase, but both front and hind limbs reach complete resolution at the same time.

The Second Life Researcher Toolkit - An Exploration of Inworld Tools, Methods and Approaches for Researching Educational Projects in Second Life

NASA Astrophysics Data System (ADS)

Moschini, Elena

Academics are beginning to explore the educational potential of Second LifeTM (SL) by setting up inworld educational activities and projects. Given the relative novelty of the use of virtual world environments in higher education many such projects are still at pilot stage. However the initial pilot and experimentation stage will have to be followed by a rigorous evaluation process as for more traditional teaching projects. The chapter addresses issues about SL research tools and research methods. It introduces a "researcher toolkit" that includes: the various stages in the evaluation of SL educational projects and the theoretical framework that can inform such projects; an outline of the inworld tools that can be utilised or customised for academic research purposes; a review of methods for collecting feedback from participants and of the main ethical issues involved in researching virtual world environments; a discussion on the technical skills required to operate a research project in SL. The chapter also offers an indication of the inworld opportunities for the dissemination of SL research findings.

Interview-based Qualitative Research in Emergency Care Part II: Data Collection, Analysis and Results Reporting.

PubMed

Ranney, Megan L; Meisel, Zachary F; Choo, Esther K; Garro, Aris C; Sasson, Comilla; Morrow Guthrie, Kate

2015-09-01

Qualitative methods are increasingly being used in emergency care research. Rigorous qualitative methods can play a critical role in advancing the emergency care research agenda by allowing investigators to generate hypotheses, gain an in-depth understanding of health problems or specific populations, create expert consensus, and develop new intervention and dissemination strategies. In Part I of this two-article series, we provided an introduction to general principles of applied qualitative health research and examples of its common use in emergency care research, describing study designs and data collection methods most relevant to our field (observation, individual interviews, and focus groups). Here in Part II of this series, we outline the specific steps necessary to conduct a valid and reliable qualitative research project, with a focus on interview-based studies. These elements include building the research team, preparing data collection guides, defining and obtaining an adequate sample, collecting and organizing qualitative data, and coding and analyzing the data. We also discuss potential ethical considerations unique to qualitative research as it relates to emergency care research. © 2015 by the Society for Academic Emergency Medicine.

Interview-Based Qualitative Research in Emergency Care Part II: Data Collection, Analysis and Results Reporting

PubMed Central

Ranney, Megan L.; Meisel, Zachary; Choo, Esther K.; Garro, Aris; Sasson, Comilla; Morrow, Kathleen

2015-01-01

Qualitative methods are increasingly being used in emergency care research. Rigorous qualitative methods can play a critical role in advancing the emergency care research agenda by allowing investigators to generate hypotheses, gain an in-depth understanding of health problems or specific populations, create expert consensus, and develop new intervention and dissemination strategies. In Part I of this two-article series, we provided an introduction to general principles of applied qualitative health research and examples of its common use in emergency care research, describing study designs and data collection methods most relevant to our field (observation, individual interviews, and focus groups). Here in Part II of this series, we outline the specific steps necessary to conduct a valid and reliable qualitative research project, with a focus on interview-based studies. These elements include building the research team, preparing data collection guides, defining and obtaining an adequate sample, collecting and organizing qualitative data, and coding and analyzing the data. We also discuss potential ethical considerations unique to qualitative research as it relates to emergency care research. PMID:26284572

Adjoint-Based Algorithms for Adaptation and Design Optimizations on Unstructured Grids

NASA Technical Reports Server (NTRS)

Nielsen, Eric J.

2006-01-01

Schemes based on discrete adjoint algorithms present several exciting opportunities for significantly advancing the current state of the art in computational fluid dynamics. Such methods provide an extremely efficient means for obtaining discretely consistent sensitivity information for hundreds of design variables, opening the door to rigorous, automated design optimization of complex aerospace configuration using the Navier-Stokes equation. Moreover, the discrete adjoint formulation provides a mathematically rigorous foundation for mesh adaptation and systematic reduction of spatial discretization error. Error estimates are also an inherent by-product of an adjoint-based approach, valuable information that is virtually non-existent in today's large-scale CFD simulations. An overview of the adjoint-based algorithm work at NASA Langley Research Center is presented, with examples demonstrating the potential impact on complex computational problems related to design optimization as well as mesh adaptation.

Systematic methodological review: developing a framework for a qualitative semi-structured interview guide.

PubMed

Kallio, Hanna; Pietilä, Anna-Maija; Johnson, Martin; Kangasniemi, Mari

2016-12-01

To produce a framework for the development of a qualitative semi-structured interview guide. Rigorous data collection procedures fundamentally influence the results of studies. The semi-structured interview is a common data collection method, but methodological research on the development of a semi-structured interview guide is sparse. Systematic methodological review. We searched PubMed, CINAHL, Scopus and Web of Science for methodological papers on semi-structured interview guides from October 2004-September 2014. Having examined 2,703 titles and abstracts and 21 full texts, we finally selected 10 papers. We analysed the data using the qualitative content analysis method. Our analysis resulted in new synthesized knowledge on the development of a semi-structured interview guide, including five phases: (1) identifying the prerequisites for using semi-structured interviews; (2) retrieving and using previous knowledge; (3) formulating the preliminary semi-structured interview guide; (4) pilot testing the guide; and (5) presenting the complete semi-structured interview guide. Rigorous development of a qualitative semi-structured interview guide contributes to the objectivity and trustworthiness of studies and makes the results more plausible. Researchers should consider using this five-step process to develop a semi-structured interview guide and justify the decisions made during it. © 2016 John Wiley & Sons Ltd.

Optical properties of electrohydrodynamic convection patterns: rigorous and approximate methods.

PubMed

Bohley, Christian; Heuer, Jana; Stannarius, Ralf

2005-12-01

We analyze the optical behavior of two-dimensionally periodic structures that occur in electrohydrodynamic convection (EHC) patterns in nematic sandwich cells. These structures are anisotropic, locally uniaxial, and periodic on the scale of micrometers. For the first time, the optics of these structures is investigated with a rigorous method. The method used for the description of the electromagnetic waves interacting with EHC director patterns is a numerical approach that discretizes directly the Maxwell equations. It works as a space-grid-time-domain method and computes electric and magnetic fields in time steps. This so-called finite-difference-time-domain (FDTD) method is able to generate the fields with arbitrary accuracy. We compare this rigorous method with earlier attempts based on ray-tracing and analytical approximations. Results of optical studies of EHC structures made earlier based on ray-tracing methods are confirmed for thin cells, when the spatial periods of the pattern are sufficiently large. For the treatment of small-scale convection structures, the FDTD method is without alternatives.

Enabling Open Science for Health Research: Collaborative Informatics Environment for Learning on Health Outcomes (CIELO).

PubMed

Payne, Philip; Lele, Omkar; Johnson, Beth; Holve, Erin

2017-07-31

There is an emergent and intensive dialogue in the United States with regard to the accessibility, reproducibility, and rigor of health research. This discussion is also closely aligned with the need to identify sustainable ways to expand the national research enterprise and to generate actionable results that can be applied to improve the nation's health. The principles and practices of Open Science offer a promising path to address both goals by facilitating (1) increased transparency of data and methods, which promotes research reproducibility and rigor; and (2) cumulative efficiencies wherein research tools and the output of research are combined to accelerate the delivery of new knowledge in proximal domains, thereby resulting in greater productivity and a reduction in redundant research investments. AcademyHealth's Electronic Data Methods (EDM) Forum implemented a proof-of-concept open science platform for health research called the Collaborative Informatics Environment for Learning on Health Outcomes (CIELO). The EDM Forum conducted a user-centered design process to elucidate important and high-level requirements for creating and sustaining an open science paradigm. By implementing CIELO and engaging a variety of potential users in its public beta testing, the EDM Forum has been able to elucidate a broad range of stakeholder needs and requirements related to the use of an open science platform focused on health research in a variety of "real world" settings. Our initial design and development experience over the course of the CIELO project has provided the basis for a vigorous dialogue between stakeholder community members regarding the capabilities that will add the greatest value to an open science platform for the health research community. A number of important questions around user incentives, sustainability, and scalability will require further community dialogue and agreement. ©Philip Payne, Omkar Lele, Beth Johnson, Erin Holve. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 31.07.2017.

How to Help Students Conceptualize the Rigorous Definition of the Limit of a Sequence

ERIC Educational Resources Information Center

Roh, Kyeong Hah

2010-01-01

This article suggests an activity, called the epsilon-strip activity, as an instructional method for conceptualization of the rigorous definition of the limit of a sequence via visualization. The article also describes the learning objectives of each instructional step of the activity, and then provides detailed instructional methods to guide…

Scientific rigor through videogames.

PubMed

Treuille, Adrien; Das, Rhiju

2014-11-01

Hypothesis-driven experimentation - the scientific method - can be subverted by fraud, irreproducibility, and lack of rigorous predictive tests. A robust solution to these problems may be the 'massive open laboratory' model, recently embodied in the internet-scale videogame EteRNA. Deploying similar platforms throughout biology could enforce the scientific method more broadly. Copyright © 2014 Elsevier Ltd. All rights reserved.

Rigorous simulations of a helical core fiber by the use of transformation optics formalism.

PubMed

Napiorkowski, Maciej; Urbanczyk, Waclaw

2014-09-22

We report for the first time on rigorous numerical simulations of a helical-core fiber by using a full vectorial method based on the transformation optics formalism. We modeled the dependence of circular birefringence of the fundamental mode on the helix pitch and analyzed the effect of a birefringence increase caused by the mode displacement induced by a core twist. Furthermore, we analyzed the complex field evolution versus the helix pitch in the first order modes, including polarization and intensity distribution. Finally, we show that the use of the rigorous vectorial method allows to better predict the confinement loss of the guided modes compared to approximate methods based on equivalent in-plane bending models.

Translational Educational Research

PubMed Central

Issenberg, S. Barry; Cohen, Elaine R.; Barsuk, Jeffrey H.; Wayne, Diane B.

2012-01-01

Medical education research contributes to translational science (TS) when its outcomes not only impact educational settings, but also downstream results, including better patient-care practices and improved patient outcomes. Simulation-based medical education (SBME) has demonstrated its role in achieving such distal results. Effective TS also encompasses implementation science, the science of health-care delivery. Educational, clinical, quality, and safety goals can only be achieved by thematic, sustained, and cumulative research programs, not isolated studies. Components of an SBME TS research program include motivated learners, curriculum grounded in evidence-based learning theory, educational resources, evaluation of downstream results, a productive research team, rigorous research methods, research resources, and health-care system acceptance and implementation. National research priorities are served from translational educational research. National funding priorities should endorse the contribution and value of translational education research. PMID:23138127

Opening up the black box: an introduction to qualitative research methods in anaesthesia.

PubMed

Shelton, C L; Smith, A F; Mort, M

2014-03-01

Qualitative research methods are a group of techniques designed to allow the researcher to understand phenomena in their natural setting. A wide range is used, including focus groups, interviews, observation, and discourse analysis techniques, which may be used within research approaches such as grounded theory or ethnography. Qualitative studies in the anaesthetic setting have been used to define excellence in anaesthesia, explore the reasons behind drug errors, investigate the acquisition of expertise and examine incentives for hand-hygiene in the operating theatre. Understanding how and why people act the way they do is essential for the advancement of anaesthetic practice, and rigorous, well-designed qualitative research can generate useful data and important insights. Meticulous social scientific methods, transparency, reproducibility and reflexivity are markers of quality in qualitative research. Tools such as the consolidated criteria for reporting qualitative research checklist and the critical appraisal skills programme are available to help authors, reviewers and readers unfamiliar with qualitative research assess its merits. © 2013 The Association of Anaesthetists of Great Britain and Ireland.

Review and Synthesize Completed Research Through Systematic Review.

PubMed

Hopp, Lisa; Rittenmeyer, Leslie

2015-10-01

The evidence-based health care movement has generated new opportunity for scholars to generate synthesized sources of evidence. Systematic reviews are rigorous forms of synthesized evidence that scholars can conduct if they have requisite skills, time, and access to excellent library resources. Systematic reviews play an important role in synthesizing what is known and unknown about a particular health issue. Thus, they have a synergistic relationship with primary research. They can both inform clinical decisions when the evidence is adequate and identify gaps in knowledge to inform research priorities. Systematic reviews can be conducted of quantitative and qualitative evidence to answer many types of questions. They all share characteristics of rigor that arise from a priori protocol development, transparency, exhaustive searching, dual independent reviewers who critically appraise studies using standardized tools, rigor in synthesis, and peer review at multiple stages in the conduct and reporting of the systematic review. © The Author(s) 2015.

Single-case synthesis tools I: Comparing tools to evaluate SCD quality and rigor.

PubMed

Zimmerman, Kathleen N; Ledford, Jennifer R; Severini, Katherine E; Pustejovsky, James E; Barton, Erin E; Lloyd, Blair P

2018-03-03

Tools for evaluating the quality and rigor of single case research designs (SCD) are often used when conducting SCD syntheses. Preferred components include evaluations of design features related to the internal validity of SCD to obtain quality and/or rigor ratings. Three tools for evaluating the quality and rigor of SCD (Council for Exceptional Children, What Works Clearinghouse, and Single-Case Analysis and Design Framework) were compared to determine if conclusions regarding the effectiveness of antecedent sensory-based interventions for young children changed based on choice of quality evaluation tool. Evaluation of SCD quality differed across tools, suggesting selection of quality evaluation tools impacts evaluation findings. Suggestions for selecting an appropriate quality and rigor assessment tool are provided and across-tool conclusions are drawn regarding the quality and rigor of studies. Finally, authors provide guidance for using quality evaluations in conjunction with outcome analyses when conducting syntheses of interventions evaluated in the context of SCD. Copyright © 2018 Elsevier Ltd. All rights reserved.

Upgrading geometry conceptual understanding and strategic competence through implementing rigorous mathematical thinking (RMT)

NASA Astrophysics Data System (ADS)

Nugraheni, Z.; Budiyono, B.; Slamet, I.

2018-03-01

To reach higher order thinking skill, needed to be mastered the conceptual understanding and strategic competence as they are two basic parts of high order thinking skill (HOTS). RMT is a unique realization of the cognitive conceptual construction approach based on Feurstein with his theory of Mediated Learning Experience (MLE) and Vygotsky’s sociocultural theory. This was quasi-experimental research which compared the experimental class that was given Rigorous Mathematical Thinking (RMT) as learning method and the control class that was given Direct Learning (DL) as the conventional learning activity. This study examined whether there was different effect of two learning model toward conceptual understanding and strategic competence of Junior High School Students. The data was analyzed by using Multivariate Analysis of Variance (MANOVA) and obtained a significant difference between experimental and control class when considered jointly on the mathematics conceptual understanding and strategic competence (shown by Wilk’s Λ = 0.84). Further, by independent t-test is known that there was significant difference between two classes both on mathematical conceptual understanding and strategic competence. By this result is known that Rigorous Mathematical Thinking (RMT) had positive impact toward Mathematics conceptual understanding and strategic competence.

The typological approach in child and family psychology: a review of theory, methods, and research.

PubMed

Mandara, Jelani

2003-06-01

The purpose of this paper was to review the theoretical underpinnings, major concepts, and methods of the typological approach. It was argued that the typological approach offers a systematic, empirically rigorous and reliable way to synthesize the nomothetic variable-centered approach with the idiographic case-centered approach. Recent advances in cluster analysis validation make it a promising method for uncovering natural typologies. This paper also reviewed findings from personality and family studies that have revealed 3 prototypical personalities and parenting styles: Adjusted/Authoritative, Overcontrolled/Authoritarian, and Undercontrolled/Permissive. These prototypes are theorized to be synonymous with attractor basins in psychological state space. The connection between family types and personality structure as well as future directions of typological research were also discussed.

The Uphill Battle of Performing Education Scholarship: Barriers Educators and Education Researchers Face.

PubMed

Jordan, Jaime; Coates, Wendy C; Clarke, Samuel; Runde, Daniel; Fowlkes, Emilie; Kurth, Jaqueline; Yarris, Lalena

2018-05-01

Educators and education researchers report that their scholarship is limited by lack of time, funding, mentorship, expertise, and reward. This study aims to evaluate these groups' perceptions regarding barriers to scholarship and potential strategies for success. Core emergency medicine (EM) educators and education researchers completed an online survey consisting of multiple-choice, 10-point Likert scale, and free-response items in 2015. Descriptive statistics were reported. We used qualitative analysis applying a thematic approach to free-response items. A total of 204 educators and 42 education researchers participated. Education researchers were highly productive: 19/42 reported more than 20 peer-reviewed education scholarship publications on their curricula vitae. In contrast, 68/197 educators reported no education publications within five years. Only a minority, 61/197 had formal research training compared to 25/42 education researchers. Barriers to performing research for both groups were lack of time, competing demands, lack of support, lack of funding, and challenges achieving scientifically rigorous methods and publication. The most common motivators identified were dissemination of knowledge, support of evidence-based practices, and promotion. Respondents advised those who seek greater education research involvement to pursue mentorship, formal research training, collaboration, and rigorous methodological standards. The most commonly cited barriers were lack of time and competing demands. Stakeholders were motivated by the desire to disseminate knowledge, support evidence-based practices, and achieve promotion. Suggested strategies for success included formal training, mentorship, and collaboration. This information may inform interventions to support educators in their scholarly pursuits and improve the overall quality of education research in EM.

Tackling complexities in understanding the social determinants of health: the contribution of ethnographic research.

PubMed

Bandyopadhyay, Mridula

2011-11-25

The complexities inherent in understanding the social determinants of health are often not well-served by quantitative approaches. My aim is to show that well-designed and well-conducted ethnographic studies have an important contribution to make in this regard. Ethnographic research designs are a difficult but rigorous approach to research questions that require us to understand the complexity of people's social and cultural lives. I draw on an ethnographic study to describe the complexities of studying maternal health in a rural area in India. I then show how the lessons learnt in that setting and context can be applied to studies done in very different settings. I show how ethnographic research depends for rigour on a theoretical framework for sample selection; why immersion in the community under study, and rapport building with research participants, is important to ensure rich and meaningful data; and how flexible approaches to data collection lead to the gradual emergence of an analysis based on intense cross-referencing with community views and thus a conclusion that explains the similarities and differences observed. When using ethnographic research design it can be difficult to specify in advance the exact details of the study design. Researchers can encounter issues in the field that require them to change what they planned on doing. In rigorous ethnographic studies, the researcher in the field is the research instrument and needs to be well trained in the method. Ethnographic research is challenging, but nevertheless provides a rewarding way of researching complex health problems that require an understanding of the social and cultural determinants of health.

Maelstrom Research guidelines for rigorous retrospective data harmonization

PubMed Central

Fortier, Isabel; Raina, Parminder; Van den Heuvel, Edwin R; Griffith, Lauren E; Craig, Camille; Saliba, Matilda; Doiron, Dany; Stolk, Ronald P; Knoppers, Bartha M; Ferretti, Vincent; Granda, Peter; Burton, Paul

2017-01-01

Abstract Background: It is widely accepted and acknowledged that data harmonization is crucial: in its absence, the co-analysis of major tranches of high quality extant data is liable to inefficiency or error. However, despite its widespread practice, no formalized/systematic guidelines exist to ensure high quality retrospective data harmonization. Methods: To better understand real-world harmonization practices and facilitate development of formal guidelines, three interrelated initiatives were undertaken between 2006 and 2015. They included a phone survey with 34 major international research initiatives, a series of workshops with experts, and case studies applying the proposed guidelines. Results: A wide range of projects use retrospective harmonization to support their research activities but even when appropriate approaches are used, the terminologies, procedures, technologies and methods adopted vary markedly. The generic guidelines outlined in this article delineate the essentials required and describe an interdependent step-by-step approach to harmonization: 0) define the research question, objectives and protocol; 1) assemble pre-existing knowledge and select studies; 2) define targeted variables and evaluate harmonization potential; 3) process data; 4) estimate quality of the harmonized dataset(s) generated; and 5) disseminate and preserve final harmonization products. Conclusions: This manuscript provides guidelines aiming to encourage rigorous and effective approaches to harmonization which are comprehensively and transparently documented and straightforward to interpret and implement. This can be seen as a key step towards implementing guiding principles analogous to those that are well recognised as being essential in securing the foundational underpinning of systematic reviews and the meta-analysis of clinical trials. PMID:27272186

A systematic review of controlled trials on visual stress using Intuitive Overlays or the Intuitive Colorimeter.

PubMed

Evans, Bruce J W; Allen, Peter M

2016-01-01

Claims that coloured filters aid reading date back 200 years and remain controversial. Some claims, for example, that more than 10% of the general population and 50% of people with dyslexia would benefit from coloured filters lack sound evidence and face validity. Publications with such claims typically cite research using methods that have not been described in the scientific literature and lack a sound aetiological framework. Notwithstanding these criticisms, some researchers have used more rigorous selection criteria and methods of prescribing coloured filters that were developed at a UK Medical Research Council unit and which have been fully described in the scientific literature. We review this research and disconfirm many of the more extreme claims surrounding this topic. This literature indicates that a minority subset of dyslexics (circa 20%) may have a condition described as visual stress which most likely results from a hyperexcitability of the visual cortex. Visual stress is characterised by symptoms of visual perceptual distortions, headaches, and eyestrain when viewing repetitive patterns, including lines of text. This review indicates that visual stress is distinct from, although sometimes co-occurs with, dyslexia. Individually prescribed coloured filters have been shown to improve reading performance in people with visual stress, but are unlikely to influence the phonological and memory deficits associated with dyslexia and therefore are not a treatment for dyslexia. This review concludes that larger and rigorous randomised controlled trials of interventions for visual stress are required. Improvements in the diagnosis of the condition are also a priority. Copyright © 2016. Published by Elsevier España, S.L.U.

A rigorous comparison of different planet detection algorithms

NASA Astrophysics Data System (ADS)

Tingley, B.

2003-05-01

The idea of finding extrasolar planets (ESPs) through observations of drops in stellar brightness due to transiting objects has been around for decades. It has only been in the last ten years, however, that any serious attempts to find ESPs became practical. The discovery of a transiting planet around the star HD 209458 (Charbonneau et al. \\cite{charbonneau}) has led to a veritable explosion of research, because the photometric method is the only way to search a large number of stars for ESPs simultaneously with current technology. To this point, however, there has been limited research into the various techniques used to extract the subtle transit signals from noise, mainly brief summaries in various papers focused on publishing transit-like signatures in observations. The scheduled launches over the next few years of satellites whose primary or secondary science missions will be ESP discovery motivates a review and a comparative study of the various algorithms used to perform the transit identification, to determine rigorously and fairly which one is the most sensitive under which circumstances, to maximize the results of past, current, and future observational campaigns.

What can comparative effectiveness research, propensity score and registry study bring to Chinese medicine?

PubMed

Liao, Xing; Xie, Yan-ming

2014-10-01

The impact of evidence-based medicine and clinical epidemiology on clinical research has contributed to the development of Chinese medicine in modern times over the past two decades. Many concepts and methods of modern science and technology are emerging in Chinese medicine research, resulting in constant progress. Systematic reviews, randomized controlled trials and other advanced mathematic approaches and statistical analysis methods have brought reform to Chinese medicine. In this new era, Chinese medicine researchers have many opportunities and challenges. On the one hand, Chinese medicine researchers need to dedicate themselves to providing enough evidence to the world through rigorous studies, whilst on the other hand, they also need to keep up with the speed of modern medicine research. For example, recently, real world study, comparative effectiveness research, propensity score techniques and registry study have emerged. This article aims to inspire Chinese medicine researchers to explore new areas by introducing these new ideas and new techniques.

Award for Distinguished Contributions to Research in Public Policy: Dorothy L. Espelage.

PubMed

2016-11-01

APA's Award for Distinguished Contributions to Research in Public Policy is given to a psychologist who has made a distinguished empirical and/or theoretical contribution to research in public policy, either through a single extraordinary achievement or a lifetime of work. Dorothy L. Espelage is the 2016 recipient of this award for her exceptional work on bullying, gender, and school violence. "She is an outstanding rigorous researcher who uses the most sophisticated methods in assessing the effects of interventions designed to improve the social and emotional lives of children both within and outside of school." Espelage's citation, biography, and selected bibliography are presented here. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Qualitative methods: what are they and why use them?

PubMed Central

Sofaer, S

1999-01-01

OBJECTIVE: To provide an overview of reasons why qualitative methods have been used and can be used in health services and health policy research, to describe a range of specific methods, and to give examples of their application. DATA SOURCES: Classic and contemporary descriptions of the underpinnings and applications of qualitative research methods and studies that have used such methods to examine important health services and health policy issues. PRINCIPAL FINDINGS: Qualitative research methods are valuable in providing rich descriptions of complex phenomena; tracking unique or unexpected events; illuminating the experience and interpretation of events by actors with widely differing stakes and roles; giving voice to those whose views are rarely heard; conducting initial explorations to develop theories and to generate and even test hypotheses; and moving toward explanations. Qualitative and quantitative methods can be complementary, used in sequence or in tandem. The best qualitative research is systematic and rigorous, and it seeks to reduce bias and error and to identify evidence that disconfirms initial or emergent hypotheses. CONCLUSIONS: Qualitative methods have much to contribute to health services and health policy research, especially as such research deals with rapid change and develops a more fully integrated theory base and research agenda. However, the field must build on the best traditions and techniques of qualitative methods and must recognize that special training and experience are essential to the application of these methods. PMID:10591275

Returning to Work after Cancer: Quantitative Studies and Prototypical Narratives

PubMed Central

Steiner, John F.; Nowels, Carolyn T.; Main, Deborah S.

2009-01-01

Objective A combination of quantitative data and illustrative narratives may allow cancer survivorship researchers to disseminate their research findings more broadly. We identified recent, methodologically rigorous quantitative studies on return to work after cancer, summarized the themes from these studies, and illustrated those themes with narratives of individual cancer survivors. Methods We reviewed English-language studies of return to work for adult cancer survivors through June, 2008, and identified 13 general themes from papers that met methodological criteria (population-based sampling, prospective and longitudinal assessment, detailed assessment of work, evaluation of economic impact, assessment of moderators of work return, and large sample size). We drew survivorship narratives from a prior qualitative research study to illustrate these themes. Results Nine quantitative studies met 4 or more of our 6 methodological criteria. These studies suggested that most cancer survivors could return to work without residual disabilities. Cancer site, clinical prognosis, treatment modalities, socioeconomic status, and attributes of the job itself influenced the likelihood of work return. Three narratives - a typical survivor who returned to work after treatment, an individual unable to return to work, and an inspiring survivor who returned to work despite substantial barriers - illustrated many of the themes from the quantitative literature while providing additional contextual details. Conclusion Illustrative narratives can complement the findings of cancer survivorship research if researchers are rigorous and transparent in the selection, analysis, and retelling of those stories. PMID:19507264

Seven perspectives on GPCR H/D-exchange proteomics methods

PubMed Central

Zhang, Xi

2017-01-01

Recent research shows surging interest to visualize human G protein-coupled receptor (GPCR) dynamic structures using the bottom-up H/D-exchange (HDX) proteomics technology. This opinion article clarifies critical technical nuances and logical thinking behind the GPCR HDX proteomics method, to help scientists overcome cross-discipline pitfalls, and understand and reproduce the protocol at high quality. The 2010 89% HDX structural coverage of GPCR was achieved with both structural and analytical rigor. This article emphasizes systematically considering membrane protein structure stability and compatibility with chromatography and mass spectrometry (MS) throughout the pipeline, including the effects of metal ions, zero-detergent shock, and freeze-thaws on HDX result rigor. This article proposes to view bottom-up HDX as two steps to guide choices of detergent buffers and chromatography settings: (I) protein HDX labeling in native buffers, and (II) peptide-centric analysis of HDX labels, which applies (a) bottom-up MS/MS to construct peptide matrix and (b) HDX MS to locate and quantify H/D labels. The detergent-low-TCEP digestion method demystified the challenge of HDX-grade GPCR digestion. GPCR HDX proteomics is a structural approach, thus its choice of experimental conditions should let structure lead and digestion follow, not the opposite. PMID:28529698

Rigorous Numerical Study of Low-Period Windows for the Quadratic Map

NASA Astrophysics Data System (ADS)

Galias, Zbigniew

An efficient method to find all low-period windows for the quadratic map is proposed. The method is used to obtain very accurate rigorous bounds of positions of all periodic windows with periods p ≤ 32. The contribution of period-doubling windows on the total width of periodic windows is discussed. Properties of periodic windows are studied numerically.

Benefits of peer support groups in the treatment of addiction

PubMed Central

Tracy, Kathlene; Wallace, Samantha P

2016-01-01

Objective Peer support can be defined as the process of giving and receiving nonprofessional, nonclinical assistance from individuals with similar conditions or circumstances to achieve long-term recovery from psychiatric, alcohol, and/or other drug-related problems. Recently, there has been a dramatic rise in the adoption of alternative forms of peer support services to assist recovery from substance use disorders; however, often peer support has not been separated out as a formalized intervention component and rigorously empirically tested, making it difficult to determine its effects. This article reports the results of a literature review that was undertaken to assess the effects of peer support groups, one aspect of peer support services, in the treatment of addiction. Methods The authors of this article searched electronic databases of relevant peer-reviewed research literature including PubMed and MedLINE. Results Ten studies met our minimum inclusion criteria, including randomized controlled trials or pre-/post-data studies, adult participants, inclusion of group format, substance use-related, and US-conducted studies published in 1999 or later. Studies demonstrated associated benefits in the following areas: 1) substance use, 2) treatment engagement, 3) human immunodeficiency virus/hepatitis C virus risk behaviors, and 4) secondary substance-related behaviors such as craving and self-efficacy. Limitations were noted on the relative lack of rigorously tested empirical studies within the literature and inability to disentangle the effects of the group treatment that is often included as a component of other services. Conclusion Peer support groups included in addiction treatment shows much promise; however, the limited data relevant to this topic diminish the ability to draw definitive conclusions. More rigorous research is needed in this area to further expand on this important line of research. PMID:27729825

Academic Rigor or Academic Rigor Mortis? Supervising Dissertations Is Serious Business

ERIC Educational Resources Information Center

Wright, Robin Redmon

2017-01-01

This reflection considers the importance of and responsibility to graduate research supervision through an examination of a published dissertation that has had significant influence on the country's current immigration debate. The author exhorts both graduate students and adult education faculty to insist on clearly stated theoretical and…

Mixed-methods research in nursing - a critical review.

PubMed

Bressan, Valentina; Bagnasco, Annamaria; Aleo, Giuseppe; Timmins, Fiona; Barisone, Michela; Bianchi, Monica; Pellegrini, Ramona; Sasso, Loredana

2017-10-01

To review the use of mixed-methods research in nursing with a particular focus on the extent to which current practice informs nurse researchers. It also aimed to highlight gaps in current knowledge, understanding and reporting of this type of research. Mixed-methods research is becoming increasingly popular among nurses and healthcare professionals. Emergent findings from this type of research are very useful for nurses in practice. The combination of both quantitative and qualitative methods provides a scientific base for practice but also richness from the qualitative enquiry. However, at the same time mixed-methods research is underdeveloped. This study identified mixed-methods research papers and critically evaluated their usefulness for research practice. To support the analysis, we performed a two-stage search using CINAHL to find papers with titles that included the key term 'mixed method'. An analysis of studies that used mixed-methods research revealed some inconsistencies in application and reporting. Attempts to use two distinct research methods in these studies often meant that one or both aspects had limitations. Overall methods were applied in a less rigorous way. This has implications for providing somewhat limited direction for novice researchers. There is also potential for application of evidence in healthcare practice that limited validity. This study highlights current gaps in knowledge, understanding and reporting of mixed-methods research. While these methods are useful to gain insight into clinical problems nurses lack guidance with this type of research. This study revealed that the guidance provided by current mixed-methods research is inconsistent and incomplete and this compounds the lack of available direction. There is an urgent need to develop robust guidelines for using mixed-methods research so that findings may be critically implemented in practice. © 2016 John Wiley & Sons Ltd.

"A Child Is Also a Teacher": Exploring the Potential for Children as Change Agents in the Context of a School-Based WASH Intervention in Rural Eastern Zambia

ERIC Educational Resources Information Center

Bresee, S.; Caruso, B. A.; Sales, J.; Lupele, J.; Freeman, M. C.

2016-01-01

As part of water, sanitation and hygiene interventions in low-income settings, it is frequently assumed that pupils can disseminate information and catalyze change at home, yet this assumption has not been rigorously assessed. We employed qualitative research methods in two phases to assess the potential for children to be change agents in five…

Novel Image Quality Control Systems(Add-On). Innovative Computational Methods for Inverse Problems in Optical and SAR Imaging

DTIC Science & Technology

2007-02-28

Iterative Ultrasonic Signal and Image Deconvolution for Estimation of the Complex Medium Response, International Journal of Imaging Systems and...1767-1782, 2006. 31. Z. Mu, R. Plemmons, and P. Santago. Iterative Ultrasonic Signal and Image Deconvolution for Estimation of the Complex...rigorous mathematical and computational research on inverse problems in optical imaging of direct interest to the Army and also the intelligence agencies

Quasi-experimental study designs series-paper 13: realizing the full potential of quasi-experiments for health research.

PubMed

Rockers, Peter C; Tugwell, Peter; Røttingen, John-Arne; Bärnighausen, Till

2017-09-01

Although the number of quasi-experiments conducted by health researchers has increased in recent years, there clearly remains unrealized potential for using these methods for causal evaluation of health policies and programs globally. This article proposes five prescriptions for capturing the full value of quasi-experiments for health research. First, new funding opportunities targeting proposals that use quasi-experimental methods should be made available to a broad pool of health researchers. Second, administrative data from health programs, often amenable to quasi-experimental analysis, should be made more accessible to researchers. Third, training in quasi-experimental methods should be integrated into existing health science graduate programs to increase global capacity to use these methods. Fourth, clear guidelines for primary research and synthesis of evidence from quasi-experiments should be developed. Fifth, strategic investments should be made to continue to develop new innovations in quasi-experimental methodologies. Tremendous opportunities exist to expand the use of quasi-experimental methods to increase our understanding of which health programs and policies work and which do not. Health researchers should continue to expand their commitment to rigorous causal evaluation with quasi-experimental methods, and international institutions should increase their support for these efforts. Copyright © 2017 Elsevier Inc. All rights reserved.

Qualitative research methods: key features and insights gained from use in infection prevention research.

PubMed

Forman, Jane; Creswell, John W; Damschroder, Laura; Kowalski, Christine P; Krein, Sarah L

2008-12-01

Infection control professionals and hospital epidemiologists are accustomed to using quantitative research. Although quantitative studies are extremely important in the field of infection control and prevention, often they cannot help us explain why certain factors affect the use of infection control practices and identify the underlying mechanisms through which they do so. Qualitative research methods, which use open-ended techniques, such as interviews, to collect data and nonstatistical techniques to analyze it, provide detailed, diverse insights of individuals, useful quotes that bring a realism to applied research, and information about how different health care settings operate. Qualitative research can illuminate the processes underlying statistical correlations, inform the development of interventions, and show how interventions work to produce observed outcomes. This article describes the key features of qualitative research and the advantages that such features add to existing quantitative research approaches in the study of infection control. We address the goal of qualitative research, the nature of the research process, sampling, data collection and analysis, validity, generalizability of findings, and presentation of findings. Health services researchers are increasingly using qualitative methods to address practical problems by uncovering interacting influences in complex health care environments. Qualitative research methods, applied with expertise and rigor, can contribute important insights to infection prevention efforts.

How to conduct a qualitative meta-analysis: Tailoring methods to enhance methodological integrity.

PubMed

Levitt, Heidi M

2018-05-01

Although qualitative research has long been of interest in the field of psychology, meta-analyses of qualitative literatures (sometimes called meta-syntheses) are still quite rare. Like quantitative meta-analyses, these methods function to aggregate findings and identify patterns across primary studies, but their aims, procedures, and methodological considerations may vary. This paper explains the function of qualitative meta-analyses and their methodological development. Recommendations have broad relevance but are framed with an eye toward their use in psychotherapy research. Rather than arguing for the adoption of any single meta-method, this paper advocates for considering how procedures can best be selected and adapted to enhance a meta-study's methodological integrity. Through the paper, recommendations are provided to help researchers identify procedures that can best serve their studies' specific goals. Meta-analysts are encouraged to consider the methodological integrity of their studies in relation to central research processes, including identifying a set of primary research studies, transforming primary findings into initial units of data for a meta-analysis, developing categories or themes, and communicating findings. The paper provides guidance for researchers who desire to tailor meta-analytic methods to meet their particular goals while enhancing the rigor of their research.

Mathematics interventions for children and adolescents with Down syndrome: a research synthesis.

PubMed

Lemons, C J; Powell, S R; King, S A; Davidson, K A

2015-08-01

Many children and adolescents with Down syndrome fail to achieve proficiency in mathematics. Researchers have suggested that tailoring interventions based on the behavioural phenotype may enhance efficacy. The research questions that guided this review were (1) what types of mathematics interventions have been empirically evaluated with children and adolescents with Down syndrome?; (2) do the studies demonstrate sufficient methodological rigor?; (3) is there evidence of efficacy for the evaluated mathematics interventions?; and (4) to what extent have researchers considered aspects of the behavioural phenotype in selecting, designing and/or implementing mathematics interventions for children and adolescents with Down syndrome? Nine studies published between 1989 and 2012 were identified for inclusion. Interventions predominantly focused on early mathematics skills and reported positive outcomes. However, no study met criteria for methodological rigor. Further, no authors explicitly considered the behavioural phenotype. Additional research using rigorous experimental designs is needed to evaluate the efficacy of mathematics interventions for children and adolescents with Down syndrome. Suggestions for considering the behavioural phenotype in future research are provided. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Assessing culture via the Internet: methods and techniques for psychological research.

PubMed

Barry, D T

2001-02-01

This study examines the acculturation experiences of Arabic immigrants and assesses the utility of the Internet as a data collection tool. Based on in-depth pilot interview data from 10 male Arabic immigrants and items selected from pre-existing measures, the Male Arabic Ethnic Identity Measure (MAEIM) was developed. Male Arab immigrants (115 males) were solicited through traditional methods in addition to the Internet. Satisfactory reliability and validity were reported for the MAEIM. No significant differences emerged between the Internet and Midwestern samples. The Internet proved to be an effective method for soliciting a relatively large, geographically dispersed sample of Arabic immigrants. The use of the Internet as a research tool is examined in the context of anonymity, networking, low-cost, perceived interactive control, methodological rigor, and external validity. The Internet was an effective vehicle for addressing concerns raised by prospective participants. It is suggested that the Internet may be an important method to assess culture-relevant variables in further research on Arab and other immigrant populations.

Translational educational research: a necessity for effective health-care improvement.

PubMed

McGaghie, William C; Issenberg, S Barry; Cohen, Elaine R; Barsuk, Jeffrey H; Wayne, Diane B

2012-11-01

Medical education research contributes to translational science (TS) when its outcomes not only impact educational settings, but also downstream results, including better patient-care practices and improved patient outcomes. Simulation-based medical education (SBME) has demonstrated its role in achieving such distal results. Effective TS also encompasses implementation science, the science of health-care delivery. Educational, clinical, quality, and safety goals can only be achieved by thematic, sustained, and cumulative research programs, not isolated studies. Components of an SBME TS research program include motivated learners, curriculum grounded in evidence-based learning theory, educational resources, evaluation of downstream results, a productive research team, rigorous research methods, research resources, and health-care system acceptance and implementation. National research priorities are served from translational educational research. National funding priorities should endorse the contribution and value of translational education research.

Recommendations for research design of telehealth studies.

PubMed

Chumbler, Neale R; Kobb, Rita; Brennan, David M; Rabinowitz, Terry

2008-11-01

Properly designed randomized controlled trials (RCTs) are the gold standard to use when examining the effectiveness of telehealth interventions on clinical outcomes. Some published telehealth studies have employed well-designed RCTs. However, such methods are not always feasible and practical in particular settings. This white paper addresses not only the need for properly designed RCTs, but also offers alternative research designs, such as quasi-experimental designs, and statistical techniques that can be employed to rigorously assess the effectiveness of telehealth studies. This paper further offers design and measurement recommendations aimed at and relevant to administrative decision-makers, policymakers, and practicing clinicians.

Dividing by Zero: Exploring Null Results in a Mathematics Professional Development Program

ERIC Educational Resources Information Center

Hill, Heather C.; Corey, Douglas Lyman; Jacob, Robin T.

2018-01-01

Background/Context: Since 2002, U.S. federal funding for educational research has favored the development and rigorous testing of interventions designed to improve student outcomes. However, recent reviews suggest that a large fraction of the programs developed and rigorously tested in the past decade have shown null results on student outcomes…

Assessing Sensitivity of Early Head Start Study Findings to Manipulated Randomization Threats

ERIC Educational Resources Information Center

Green, Sheridan

2013-01-01

Increasing demands for design rigor and an emphasis on evidence-based practice on a national level indicated a need for further guidance related to successful implementation of randomized studies in education. Rigorous and meaningful experimental research and its conclusions help establish a valid theoretical and evidence base for educational…

Importance of Grades and Placement for Math Attainment

ERIC Educational Resources Information Center

Tyson, Will; Roksa, Josipa

2017-01-01

Research on high school math course taking documents the advantages of starting high school at or beyond Algebra 1. Fewer studies examine differentiation into remedial, general, and honors Algebra 1 course types by course rigor. This study examines how course grades and course rigor are associated with math attainment among students with similar…

Machine intelligence applications to securities production

DOE Office of Scientific and Technical Information (OSTI.GOV)

Johnson, C.K.

1987-01-01

The production of security documents provides a cache of interesting problems ranging across a broad spectrum. Some of the problems do not have rigorous scientific solutions available at this time and provide opportunities for less structured approaches such as AI. AI methods can be used in conjunction with traditional scientific and computational methods. The most productive applications of AI occur when this marriage of methods can be carried out without motivation to prove that one method is better than the other. Fields such as ink chemistry and technology, and machine inspection of graphic arts printing offer interesting challenges which willmore » continue to intrigue current and future generations of researchers into the 21st century.« less

Trends in Mediation Analysis in Nursing Research: Improving Current Practice.

PubMed

Hertzog, Melody

2018-06-01

The purpose of this study was to describe common approaches used by nursing researchers to test mediation models and evaluate them within the context of current methodological advances. MEDLINE was used to locate studies testing a mediation model and published from 2004 to 2015 in nursing journals. Design (experimental/correlation, cross-sectional/longitudinal, model complexity) and analysis (method, inclusion of test of mediated effect, violations/discussion of assumptions, sample size/power) characteristics were coded for 456 studies. General trends were identified using descriptive statistics. Consistent with findings of reviews in other disciplines, evidence was found that nursing researchers may not be aware of the strong assumptions and serious limitations of their analyses. Suggestions for strengthening the rigor of such studies and an overview of current methods for testing more complex models, including longitudinal mediation processes, are presented.

Incorporating microbiota data into epidemiologic models: examples from vaginal microbiota research.

PubMed

van de Wijgert, Janneke H; Jespers, Vicky

2016-05-01

Next generation sequencing and quantitative polymerase chain reaction technologies are now widely available, and research incorporating these methods is growing exponentially. In the vaginal microbiota (VMB) field, most research to date has been descriptive. The purpose of this article is to provide an overview of different ways in which next generation sequencing and quantitative polymerase chain reaction data can be used to answer clinical epidemiologic research questions using examples from VMB research. We reviewed relevant methodological literature and VMB articles (published between 2008 and 2015) that incorporated these methodologies. VMB data have been analyzed using ecologic methods, methods that compare the presence or relative abundance of individual taxa or community compositions between different groups of women or sampling time points, and methods that first reduce the complexity of the data into a few variables followed by the incorporation of these variables into traditional biostatistical models. To make future VMB research more clinically relevant (such as studying associations between VMB compositions and clinical outcomes and the effects of interventions on the VMB), it is important that these methods are integrated with rigorous epidemiologic methods (such as appropriate study designs, sampling strategies, and adjustment for confounding). Crown Copyright © 2016. Published by Elsevier Inc. All rights reserved.

Developing methods for systematic reviewing in health services delivery and organization: an example from a review of access to health care for people with learning disabilities. Part 2. Evaluation of the literature--a practical guide.

PubMed

Alborz, Alison; McNally, Rosalind

2004-12-01

To develop methods to facilitate the 'systematic' review of evidence from a range of methodologies on diffuse or 'soft' topics, as exemplified by 'access to health care'. Twenty-eight bibliographic databases, research registers, organizational websites or library catalogues. Reference lists from identified studies. Contact with experts and service users. Current awareness and contents alerting services in the area of learning disabilities. Inclusion criteria were English language literature from 1980 onwards, relating to people with learning disabilities of any age and all study designs. The main criteria for assessment was relevance to Guillifords' model of access to health care which was adapted to the circumstances of people with learning disabilities. Selected studies were evaluated for scientific rigour then data was extracted and the results synthesized. Quality assessment was by an initial set of 'generic' quality indicators. This enabled further evidence selection before evaluation of findings according to specific criteria for qualitative, quantitative or mixed-method studies. Eighty-two studies were fully evaluated. Five studies were rated 'highly rigorous', 22 'rigorous', 46 'less rigorous' and nine 'poor' papers were retained as the sole evidence covering aspects of the guiding model. The majority of studies were quantitative but used only descriptive statistics. Most evidence lacked methodological detail, which often lowered final quality ratings. The application of a consistent structure to quality evaluation can facilitate data appraisal, extraction and synthesis across a range of methodologies in diffuse or 'soft' topics. Synthesis can be facilitated further by using software, such as the microsoft 'access' database, for managing information.

Atlantic salmon skin and fillet color changes effected by perimortem handling stress, rigor mortis, and ice storage.

PubMed

Erikson, U; Misimi, E

2008-03-01

The changes in skin and fillet color of anesthetized and exhausted Atlantic salmon were determined immediately after killing, during rigor mortis, and after ice storage for 7 d. Skin color (CIE L*, a*, b*, and related values) was determined by a Minolta Chroma Meter. Roche SalmoFan Lineal and Roche Color Card values were determined by a computer vision method and a sensory panel. Before color assessment, the stress levels of the 2 fish groups were characterized in terms of white muscle parameters (pH, rigor mortis, and core temperature). The results showed that perimortem handling stress initially significantly affected several color parameters of skin and fillets. Significant transient fillet color changes also occurred in the prerigor phase and during the development of rigor mortis. Our results suggested that fillet color was affected by postmortem glycolysis (pH drop, particularly in anesthetized fillets), then by onset and development of rigor mortis. The color change patterns during storage were different for the 2 groups of fish. The computer vision method was considered suitable for automated (online) quality control and grading of salmonid fillets according to color.

Reporting ethics committee approval in public administration research.

PubMed

Jordan, Sara R; Gray, Phillip W

2014-03-01

While public administration research is thriving because of increased attention to social scientific rigor, lingering problems of methods and ethics remain. This article investigates the reporting of ethics approval within public administration publications. Beginning with an overview of ethics requirements regarding research with human participants, I turn to an examination of human participants protections for public administration research. Next, I present the findings of my analysis of articles published in the top five public administration journals over the period from 2000 to 2012, noting the incidences of ethics approval reporting as well as funding reporting. In explicating the importance of ethics reporting for public administration research, as it relates to replication, reputation, and vulnerable populations, I conclude with recommendations for increasing ethics approval reporting in public administration research.

The ethics in qualitative health research: special considerations.

PubMed

Peter, Elizabeth

2015-09-01

A sound knowledge of the nature of qualitative research, along with an appreciation of some special ethical considerations, is needed for rigorous reviews to be conducted. The overall character of qualitative research is described with an emphasis on the tendency of qualitative researchers to explore sensitive topics using theoretically informed methods. A number of specific features of qualitative that require additional ethical attention and awareness are also examined including the following: 1) participants are frequently quite vulnerable and require protection because the data collection methods, such as in-depth interviews, can delve into personally and politically charged matters; 2) naturalistic observation can raise concerns regarding privacy and consent; 3) the potential for the identifiability of the results of this research may require extra efforts to maintain confidentiality. Ultimately, Reseach Ethics Committee members must be knowledgeable about qualitative approaches to be able to assess the potential harms and benefits in a protocol carefully. Without this knowledge gaining ethics approval can be overly difficult for researchers and the best practices for protecting human participants can be overlooked.

The state of rehabilitation research: art or science?

PubMed

Tate, Denise G

2006-02-01

Rehabilitation research has been criticized as not standing up enough to the rigors of scientific method to be called "science." The field has been portrayed as slow to promote its scientific achievements and to include them under the rubric of evidence-based rehabilitation. Following in the footsteps of psychology, rehabilitation as a broad-based discipline has faced many similar obstacles in achieving scientific status. Controversy exists about what exactly constitutes rehabilitation science versus its art and its respective multidisciplinary domains. The conception of these domains is directly related to current methods available to assess the state of the discipline and its research accomplishments. I used quantitative methods, such as randomized clinical and/or controlled trials (RCTs) and systematic reviews, to assess the status of rehabilitation research. Findings suggest that, as a field, rehabilitation makes significant contributions to science, measurable by the number and quality of RCTs and systematic reviews conducted so far on topics of critical importance for clinical care. In "artful" complement, qualitative approaches can be used as research tools to aid investigators in seeking knowledge beyond that obtained by quantitative methods, assessing many complexities associated with the various contexts of rehabilitation research. Other requirements to develop a common vision of rehabilitation science are also discussed.

An operations-partnered evaluation of care redesign for high-risk patients in the Veterans Health Administration (VHA): Study protocol for the PACT Intensive Management (PIM) randomized quality improvement evaluation.

PubMed

Chang, Evelyn T; Zulman, Donna M; Asch, Steven M; Stockdale, Susan E; Yoon, Jean; Ong, Michael K; Lee, Martin; Simon, Alissa; Atkins, David; Schectman, Gordon; Kirsh, Susan R; Rubenstein, Lisa V

2018-06-01

Patient-centered medical homes have made great strides providing comprehensive care for patients with chronic conditions, but may not provide sufficient support for patients at highest risk for acute care use. To address this, the Veterans Health Administration (VHA) initiated a five-site demonstration project to evaluate the effectiveness of augmenting the VA's Patient Aligned Care Team (PACT) medical home with PACT Intensive Management (PIM) teams for Veterans at highest risk for hospitalization. Researchers partnered with VHA leadership to design a mixed-methods prospective multi-site evaluation that met leadership's desire for a rigorous evaluation conducted as quality improvement rather than research. We conducted a randomized QI evaluation and assigned high-risk patients to participate in PIM and compared them with high-risk Veterans receiving usual care through PACT. The summative evaluation examines whether PIM: 1) decreases VHA emergency department and hospital use; 2) increases satisfaction with VHA care; 3) decreases provider burnout; and 4) generates positive returns on investment. The formative evaluation aims to support improved care for high-risk patients at demonstration sites and to inform future initiatives for high-risk patients. The evaluation was reviewed by representatives from the VHA Office of Research and Development and the Office of Research Oversight and met criteria for quality improvement. VHA aims to function as a learning organization by rapidly implementing and rigorously testing QI innovations prior to final program or policy development. We observed challenges and opportunities in designing an evaluation consistent with QI standards and operations priorities, while also maintaining scientific rigor. This trial was retrospectively registered at ClinicalTrials.gov on April 3, 2017: NCT03100526. Protocol v1, FY14-17. Copyright © 2018 Elsevier Inc. All rights reserved.

Nine Criteria for a Measure of Scientific Output

PubMed Central

Kreiman, Gabriel; Maunsell, John H. R.

2011-01-01

Scientific research produces new knowledge, technologies, and clinical treatments that can lead to enormous returns. Often, the path from basic research to new paradigms and direct impact on society takes time. Precise quantification of scientific output in the short-term is not an easy task but is critical for evaluating scientists, laboratories, departments, and institutions. While there have been attempts to quantifying scientific output, we argue that current methods are not ideal and suffer from solvable difficulties. Here we propose criteria that a metric should have to be considered a good index of scientific output. Specifically, we argue that such an index should be quantitative, based on robust data, rapidly updated and retrospective, presented with confidence intervals, normalized by number of contributors, career stage and discipline, impractical to manipulate, and focused on quality over quantity. Such an index should be validated through empirical testing. The purpose of quantitatively evaluating scientific output is not to replace careful, rigorous review by experts but rather to complement those efforts. Because it has the potential to greatly influence the efficiency of scientific research, we have a duty to reflect upon and implement novel and rigorous ways of evaluating scientific output. The criteria proposed here provide initial steps toward the systematic development and validation of a metric to evaluate scientific output. PMID:22102840

SPRUCE Advanced Molecular Techniques Provide a Rigorous Method for Characterizing Organic Matter Quality in Complex Systems: Supporting Data

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wilson, Rachel M; Tfaily, Malak M

These data are provided in support of the Commentary, Advanced molecular techniques provide a rigorous method for characterizing organic matter quality in complex systems, Wilson and Tfaily (2018). Measurement results demonstrate that optical characterization of peatland dissolved organic matter (DOM) may not fully capture classically identified chemical characteristics and may, therefore, not be the best measure of organic matter quality.

Tackling complexities in understanding the social determinants of health: the contribution of ethnographic research

PubMed Central

2011-01-01

Objective The complexities inherent in understanding the social determinants of health are often not well-served by quantitative approaches. My aim is to show that well-designed and well-conducted ethnographic studies have an important contribution to make in this regard. Ethnographic research designs are a difficult but rigorous approach to research questions that require us to understand the complexity of people’s social and cultural lives. Approach I draw on an ethnographic study to describe the complexities of studying maternal health in a rural area in India. I then show how the lessons learnt in that setting and context can be applied to studies done in very different settings. Results I show how ethnographic research depends for rigour on a theoretical framework for sample selection; why immersion in the community under study, and rapport building with research participants, is important to ensure rich and meaningful data; and how flexible approaches to data collection lead to the gradual emergence of an analysis based on intense cross-referencing with community views and thus a conclusion that explains the similarities and differences observed. Conclusion When using ethnographic research design it can be difficult to specify in advance the exact details of the study design. Researchers can encounter issues in the field that require them to change what they planned on doing. In rigorous ethnographic studies, the researcher in the field is the research instrument and needs to be well trained in the method. Implication Ethnographic research is challenging, but nevertheless provides a rewarding way of researching complex health problems that require an understanding of the social and cultural determinants of health. PMID:22168509

Translating the short version of the Perinatal Grief Scale: process and challenges.

PubMed

Capitulo, K L; Cornelio, M A; Lenz, E R

2001-08-01

Non-English-speaking populations may be excluded from rigorous clinical research because of the lack of reliable and valid instrumentation to measure psychosocial variables. The purpose of this article is to describe the process and challenges when translating a research instrument. The process will be illustrated in the project of translating into Spanish the Short Version of the Perinatal Grief Scale, extensively studied in English-speaking, primarily Caucasian populations. Translation methods, errors, and tips are included. Tools cannot be used in transcultural research and practice without careful and accurate translation and subsequent psychometric evaluation, which are essential to generate credible and valid findings. Copyright 2001 by W.B. Saunders Company

Observational Research Rigor Alone Does Not Justify Causal Inference

PubMed Central

Ejima, Keisuke; Li, Peng; Smith, Daniel L.; Nagy, Tim R.; Kadish, Inga; van Groen, Thomas; Dawson, John A.; Yang, Yongbin; Patki, Amit; Allison, David B.

2016-01-01

Background Differing opinions exist on whether associations obtained in observational studies can be reliable indicators of a causal effect if the observational study is sufficiently well controlled and executed. Materials and methods To test this, we conducted two animal observational studies that were rigorously controlled and executed beyond what is achieved in studies of humans. In study 1, we randomized 332 genetically identical C57BL/6J mice into three diet groups with differing food energy allotments and recorded individual self-selected daily energy intake and lifespan. In study 2, 60 male mice (CD1) were paired and divided into two groups for a 2-week feeding regimen. We evaluated the association between weight gain and food consumption. Within each pair, one animal was randomly assigned to an S group in which the animals had free access to food. The second paired animal (R group) was provided exactly the same diet that their S partner ate the day before. Results In study 1, across all three groups, we found a significant negative effect of energy intake on lifespan. However, we found a positive association between food intake and lifespan among the ad libitum feeding group: 29.99 (95% CI: 8.2 to 51.7) days per daily kcal. In study 2, we found a significant (P=0.003) group (randomized vs self-selected)-by-food consumption interaction effect on weight gain. Conclusions At least in nutrition research, associations derived from observational studies may not be reliable indicators of causal effects, even with the most rigorous study designs achievable. PMID:27711975

Paper 3: Content and Rigor of Algebra Credit Recovery Courses

ERIC Educational Resources Information Center

Walters, Kirk; Stachel, Suzanne

2014-01-01

This paper describes the content, organization and rigor of the f2f and online summer algebra courses that were delivered in summers 2011 and 2012. Examining the content of both types of courses is important because research suggests that algebra courses with certain features may be better than others in promoting success for struggling students.…

Making the Case for Laws That Improve Health: A Framework for Public Health Law Research

PubMed Central

Burris, Scott; Wagenaar, Alexander C; Swanson, Jeffrey; Ibrahim, Jennifer K; Wood, Jennifer; Mello, Michelle M

2010-01-01

Context: Public health law has received considerable attention in recent years and has become an essential field in public health. Public health law research, however, has received less attention. Methods: Expert commentary. Findings: This article explores public health law research, defined as the scientific study of the relation of law and legal practices to population health. The article offers a logic model of public health law research and a typology of approaches to studying the effects of law on public health. Research on the content and prevalence of public health laws, processes of adopting and implementing laws, and the extent to which and mechanisms through which law affects health outcomes can use methods drawn from epidemiology, economics, sociology, and other disciplines. The maturation of public health law research as a field depends on methodological rigor, adequate research funding, access to appropriate data sources, and policymakers’ use of research findings. Conclusions: Public health law research is a young field but holds great promise for supporting evidence-based policymaking that will improve population health. PMID:20579282

The Researchers' View of Scientific Rigor-Survey on the Conduct and Reporting of In Vivo Research.

PubMed

Reichlin, Thomas S; Vogt, Lucile; Würbel, Hanno

2016-01-01

Reproducibility in animal research is alarmingly low, and a lack of scientific rigor has been proposed as a major cause. Systematic reviews found low reporting rates of measures against risks of bias (e.g., randomization, blinding), and a correlation between low reporting rates and overstated treatment effects. Reporting rates of measures against bias are thus used as a proxy measure for scientific rigor, and reporting guidelines (e.g., ARRIVE) have become a major weapon in the fight against risks of bias in animal research. Surprisingly, animal scientists have never been asked about their use of measures against risks of bias and how they report these in publications. Whether poor reporting reflects poor use of such measures, and whether reporting guidelines may effectively reduce risks of bias has therefore remained elusive. To address these questions, we asked in vivo researchers about their use and reporting of measures against risks of bias and examined how self-reports relate to reporting rates obtained through systematic reviews. An online survey was sent out to all registered in vivo researchers in Switzerland (N = 1891) and was complemented by personal interviews with five representative in vivo researchers to facilitate interpretation of the survey results. Return rate was 28% (N = 530), of which 302 participants (16%) returned fully completed questionnaires that were used for further analysis. According to the researchers' self-report, they use measures against risks of bias to a much greater extent than suggested by reporting rates obtained through systematic reviews. However, the researchers' self-reports are likely biased to some extent. Thus, although they claimed to be reporting measures against risks of bias at much lower rates than they claimed to be using these measures, the self-reported reporting rates were considerably higher than reporting rates found by systematic reviews. Furthermore, participants performed rather poorly when asked to choose effective over ineffective measures against six different biases. Our results further indicate that knowledge of the ARRIVE guidelines had a positive effect on scientific rigor. However, the ARRIVE guidelines were known by less than half of the participants (43.7%); and among those whose latest paper was published in a journal that had endorsed the ARRIVE guidelines, more than half (51%) had never heard of these guidelines. Our results suggest that whereas reporting rates may underestimate the true use of measures against risks of bias, self-reports may overestimate it. To a large extent, this discrepancy can be explained by the researchers' ignorance and lack of knowledge of risks of bias and measures to prevent them. Our analysis thus adds significant new evidence to the assessment of research integrity in animal research. Our findings further question the confidence that the authorities have in scientific rigor, which is taken for granted in the harm-benefit analyses on which approval of animal experiments is based. Furthermore, they suggest that better education on scientific integrity and good research practice is needed. However, they also question reliance on reporting rates as indicators of scientific rigor and highlight a need for more reliable predictors.

Skin Bleaching and Dermatologic Health of African and Afro-Caribbean Populations in the US: New Directions for Methodologically Rigorous, Multidisciplinary, and Culturally Sensitive Research.

PubMed

Benn, Emma K T; Alexis, Andrew; Mohamed, Nihal; Wang, Yan-Hong; Khan, Ikhlas A; Liu, Bian

2016-12-01

Skin-bleaching practices, such as using skin creams and soaps to achieve a lighter skin tone, are common throughout the world and are triggered by cosmetic reasons that oftentimes have deep historical, economic, sociocultural, and psychosocial roots. Exposure to chemicals in the bleaching products, notably, mercury (Hg), hydroquinone, and steroids, has been associated with a variety of adverse health effects, such as Hg poisoning and exogenous ochronosis. In New York City (NYC), skin care product use has been identified as an important route of Hg exposure, especially among Caribbean-born blacks and Dominicans. However, surprisingly sparse information is available on the epidemiology of the health impacts of skin-bleaching practices among these populations. We highlight the dearth of large-scale, comprehensive, community-based, clinical, and translational research in this area, especially the limited skin-bleaching-related research among non-White populations in the US. We offer five new research directions, including investigating the known and under-studied health consequences among populations for which the skin bleach practice is newly emerging at an alarming rate using innovative laboratory and statistical methods. We call for conducting methodologically rigorous, multidisciplinary, and culturally sensitive research in order to provide insights into the root and the epidemiological status of the practice and provide evidence of exposure-outcome associations, with an ultimate goal of developing potential intervention strategies to reduce the health burdens of skin-bleaching practice.

Reflections on the added value of using mixed methods in the SCAPE study.

PubMed

Murphy, Kathy; Casey, Dympna; Devane, Declan; Meskell, Pauline; Higgins, Agnes; Elliot, Naomi; Lalor, Joan; Begley, Cecily

2014-03-01

To reflect on the added value that a mixed method design gave in a large national evaluation study of specialist and advanced practice (SCAPE), and to propose a reporting guide that could help make explicit the added value of mixed methods in other studies. Recently, researchers have focused on how to carry out mixed methods research (MMR) rigorously. The value-added claims for MMR include the capacity to exploit the strengths and compensate for weakness inherent in single designs, generate comprehensive description of phenomena, produce more convincing results for funders or policy-makers and build methodological expertise. Data illustrating value added claims were drawn from the SCAPE study. Studies about the purpose of mixed methods were identified from a search of literature. The authors explain why and how they undertook components of the study, and propose a guideline to facilitate such studies. If MMR is to become the third methodological paradigm, then articulation of what extra benefit MMR adds to a study is essential. The authors conclude that MMR has added value and found the guideline useful as a way of making value claims explicit. The clear articulation of the procedural aspects of mixed-methods research, and identification of a guideline to facilitate such research, will enable researchers to learn more effectively from each other.

Global research coaching in orthopedic surgery: seeding for an international network

PubMed Central

Ferreira, Ana Paula Bonilauri; Rajgor, Dimple; Shah, Jatin; Shah, Anand; Pietrobon, Ricardo

2012-01-01

Despite the importance of delivering evidence-based health care, orthopedic surgeons have directed fewer efforts towards the generation of such evidence. Even when present, published evidence lacks methodological rigor and is known to be inaccurate. One of the main reasons for the lack of generation of quality evidence, and the low involvement in research among orthopedic surgeons, is the lack of structured research coaching environments where they can learn concepts and hone their research skills. There is a palpable need for a pragmatic and outcome-oriented approach that can equip orthopedic surgeons with effective ways of communicating their research in writing. We describe a pragmatic research coaching program, designed and developed by the Research on Research group, which aims to build a global network of orthopedic researchers trained in streamlined and standardized research methods. We also provide a brief overview of the course principles and tools, and the platforms used in this program. PMID:24453591

On making cuts for magnetic scalar potentials in multiply connected regions

NASA Astrophysics Data System (ADS)

Kotiuga, P. R.

1987-04-01

The problem of making cuts is of importance to scalar potential formulations of three-dimensional eddy current problems. Its heuristic solution has been known for a century [J. C. Maxwell, A Treatise on Electricity and Magnetism, 3rd ed. (Clarendon, Oxford, 1981), Chap. 1, Article 20] and in the last decade, with the use of finite element methods, a restricted combinatorial variant has been proposed and solved [M. L. Brown, Int. J. Numer. Methods Eng. 20, 665 (1984)]. This problem, in its full generality, has never received a rigorous mathematical formulation. This paper presents such a formulation and outlines a rigorous proof of existence. The technique used in the proof expose the incredible intricacy of the general problem and the restrictive assumptions of Brown [Int. J. Numer. Methods Eng. 20, 665 (1984)]. Finally, the results make rigorous Kotiuga's (Ph. D. Thesis, McGill University, Montreal, 1984) heuristic interpretation of cuts and duality theorems via intersection matrices.

Toward a new methodological paradigm for testing theories of health behavior and health behavior change.

PubMed

Noar, Seth M; Mehrotra, Purnima

2011-03-01

Traditional theory testing commonly applies cross-sectional (and occasionally longitudinal) survey research to test health behavior theory. Since such correlational research cannot demonstrate causality, a number of researchers have called for the increased use of experimental methods for theory testing. We introduce the multi-methodological theory-testing (MMTT) framework for testing health behavior theory. The MMTT framework introduces a set of principles that broaden the perspective of how we view evidence for health behavior theory. It suggests that while correlational survey research designs represent one method of testing theory, the weaknesses of this approach demand that complementary approaches be applied. Such approaches include randomized lab and field experiments, mediation analysis of theory-based interventions, and meta-analysis. These alternative approaches to theory testing can demonstrate causality in a much more robust way than is possible with correlational survey research methods. Such approaches should thus be increasingly applied in order to more completely and rigorously test health behavior theory. Greater application of research derived from the MMTT may lead researchers to refine and modify theory and ultimately make theory more valuable to practitioners. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

A Generalized Method for the Comparable and Rigorous Calculation of the Polytropic Efficiencies of Turbocompressors

NASA Astrophysics Data System (ADS)

Dimitrakopoulos, Panagiotis

2018-03-01

The calculation of polytropic efficiencies is a very important task, especially during the development of new compression units, like compressor impellers, stages and stage groups. Such calculations are also crucial for the determination of the performance of a whole compressor. As processors and computational capacities have substantially been improved in the last years, the need for a new, rigorous, robust, accurate and at the same time standardized method merged, regarding the computation of the polytropic efficiencies, especially based on thermodynamics of real gases. The proposed method is based on the rigorous definition of the polytropic efficiency. The input consists of pressure and temperature values at the end points of the compression path (suction and discharge), for a given working fluid. The average relative error for the studied cases was 0.536 %. Thus, this high-accuracy method is proposed for efficiency calculations related with turbocompressors and their compression units, especially when they are operating at high power levels, for example in jet engines and high-power plants.

A demonstration of mixed-methods research in the health sciences.

PubMed

Katz, Janet; Vandermause, Roxanne; McPherson, Sterling; Barbosa-Leiker, Celestina

2016-11-18

Background The growth of patient, community and population-centred nursing research is a rationale for the use of research methods that can examine complex healthcare issues, not only from a biophysical perspective, but also from cultural, psychosocial and political viewpoints. This need for multiple perspectives requires mixed-methods research. Philosophy and practicality are needed to plan, conduct, and make mixed-methods research more broadly accessible to the health sciences research community. The traditions and dichotomy between qualitative and quantitative research makes the application of mixed methods a challenge. Aim To propose an integrated model for a research project containing steps from start to finish, and to use the unique strengths brought by each approach to meet the health needs of patients and communities. Discussion Mixed-methods research is a practical approach to inquiry, that focuses on asking questions and how best to answer them to improve the health of individuals, communities and populations. An integrated model of research begins with the research question(s) and moves in a continuum. The lines dividing methods do not dissolve, but become permeable boundaries where two or more methods can be used to answer research questions more completely. Rigorous and expert methodologists work together to solve common problems. Conclusion Mixed-methods research enables discussion among researchers from varied traditions. There is a plethora of methodological approaches available. Combining expertise by communicating across disciplines and professions is one way to tackle large and complex healthcare issues. Implications for practice The model presented in this paper exemplifies the integration of multiple approaches in a unified focus on identified phenomena. The dynamic nature of the model signals a need to be open to the data generated and the methodological directions implied by findings.

Directions in implementation research methods for behavioral and social science.

PubMed

Irwin, Molly; Supplee, Lauren H

2012-10-01

There is a growing interest, by researchers, policymakers, and practitioners, in evidence-based policy and practice. As a result, more dollars are being invested in program evaluation in order to establish "what works," and in some cases, funding is specifically tied to those programs found to be effective. However, reproducing positive effects found in research requires more than simply adopting an evidence-based program. Implementation research can provide guidance on which components of an intervention matter most for program impacts and how implementation components can best be implemented. However, while the body of rigorous research on effective practices continues to grow, research on implementation lags behind. To address these issues, the Administration for Children and Families and federal partners convened a roundtable meeting entitled, Improving Implementation Research Methods for Behavioral and Social Science, in the fall of 2010. This special section of the Journal of Behavioral Health Services & Research includes papers from the roundtable and highlights the role implementation science can play in shedding light on the difficult task of taking evidence-based practices to scale.

[I want to breastfeed my baby: Unvealing the experiences of women who lived process difficulties in their breastfeeding].

PubMed

Lucchini Raies, Camila; Márquez Doren, Francisca; Rivera Martínez, María Soledad

2017-01-01

Breastfeeding is the most beneficial feeding practice for infants. However, it is not always the first choice for mothers and their encouragement and support from health professionals is variable. To understand the experience of mothers who had difficulties with their breastfeeding process. A phenomenological study was conducted in a University Health center. Twelve breastfeeding women were included. Data collection technique was in depth interviews, taped recorded with participants’ consent. Phenomenological analysis of data followed Streubert´s method. The rigor of the study was guarded by criteria for qualitative research and the research process. Ethical aspects were sheltered through the informed consent process, confidentiality and methodological rigor. The experience of living difficulties in the breastfeeding process is revealed in five comprehensive categories: recognizing the difficulties with breastfeeding; emotional impact when unable to breastfeed; motivation to overcome the difficulty and ask for help; support for breastfeeding recovery; and transition process from stress and anxiety to peace, gratification and empowerment. The understanding of this experience is qualitative evidence that contributes to a comprehensive understanding of the situation of each mother and child, allowing to improve support care interventions in health.

Toward an applied technology for quality measurement in health care.

PubMed

Berwick, D M

1988-01-01

Cost containment, financial incentives to conserve resources, the growth of for-profit hospitals, an aggressive malpractice environment, and demands from purchasers are among the forces today increasing the need for improved methods that measure quality in health care. At the same time, increasingly sophisticated databases and the existence of managed care systems yield new opportunities to observe and correct quality problems. Research on targets of measurement (structure, process, and outcome) and methods of measurement (implicit, explicit, and sentinel methods) has not yet produced managerially useful applied technology for quality measurement in real-world settings. Such an applied technology would have to be cheaper, faster, more flexible, better reported, and more multidimensional than the majority of current research on quality assurance. In developing a new applied technology for the measurement of health care quality, quantitative disciplines have much to offer, such as decision support systems, criteria based on rigorous decision analyses, utility theory, tools for functional status measurement, and advances in operations research.

Systemic Planning: An Annotated Bibliography and Literature Guide. Exchange Bibliography No. 91.

ERIC Educational Resources Information Center

Catanese, Anthony James

Systemic planning is an operational approach to using scientific rigor and qualitative judgment in a complementary manner. It integrates rigorous techniques and methods from systems analysis, cybernetics, decision theory, and work programing. The annotated reference sources in this bibliography include those works that have been most influential…

Health promotion in small business: a systematic review of factors influencing adoption and effectiveness of worksite wellness programs.

PubMed

McCoy, Kira; Stinson, Kaylan; Scott, Kenneth; Tenney, Liliana; Newman, Lee S

2014-06-01

To assess the evidence regarding the adoption and efficacy of worksite health promotion programs (WHPPs) in small businesses. Peer-reviewed research articles were identified from a database search. Included articles were published before July 2013, described a study that used an experimental or quasiexperimental design and either assessed adoption of WHPPs or conducted interventions in businesses with fewer than 500 employees. A review team scored the study's rigor using the WHO-adapted GRADEprofiler "quality of evidence" criteria. Of the 84 retrieved articles, 19 met study inclusion criteria. Of these, only two met criteria for high rigor. Fewer small businesses adopt WHPPs compared with large businesses. Two high-rigor studies found that employees were healthier postintervention. Higher quality research is needed to better understand why small businesses rarely adopt wellness programs and to demonstrate the value of such programs.

Pressing Forward: Increasing and Expanding Rigor and Relevance in America's High Schools. Research on High School and Beyond

ERIC Educational Resources Information Center

Smerdon, Becky, Ed.; Borman, Kathryn M., Ed.

2012-01-01

Pressing Forward: Increasing and Expanding Rigor and Relevance in America's High Schools is organized to place secondary education, specifically the goals of preparing young adults to be college and career ready, in contemporary perspective, emphasizing the changing global economy and trends in policy and practice. High school students must be…

The Relationship between Student's Quantitative Skills, Application of Math, Science Courses, and Science Marks at Single-Sex Independent High Schools

ERIC Educational Resources Information Center

Cambridge, David

2012-01-01

For independent secondary schools who offer rigorous curriculum to attract students, integration of quantitative skills in the science courses has become an important definition of rigor. However, there is little research examining students' quantitative skills in relation to high school science performance within the single-sex independent school…

Scientific impact: opportunity and necessity.

PubMed

Cohen, Marlene Z; Alexander, Gregory L; Wyman, Jean F; Fahrenwald, Nancy L; Porock, Davina; Wurzbach, Mary E; Rawl, Susan M; Conn, Vicki S

2010-08-01

Recent National Institutes of Health changes have focused attention on the potential scientific impact of research projects. Research with the excellent potential to change subsequent science or health care practice may have high scientific impact. Only rigorous studies that address highly significant problems can generate change. Studies with high impact may stimulate new research approaches by changing understanding of a phenomenon, informing theory development, or creating new research methods that allow a field of science to move forward. Research with high impact can transition health care to more effective and efficient approaches. Studies with high impact may propel new policy developments. Research with high scientific impact typically has both immediate and sustained influence on the field of study. The article includes ideas to articulate potential scientific impact in grant applications as well as possible dissemination strategies to enlarge the impact of completed projects.

Total focusing method (TFM) robustness to material deviations

NASA Astrophysics Data System (ADS)

Painchaud-April, Guillaume; Badeau, Nicolas; Lepage, Benoit

2018-04-01

The total focusing method (TFM) is becoming an accepted nondestructive evaluation method for industrial inspection. What was a topic of discussion in the applied research community just a few years ago is now being deployed in critical industrial applications, such as inspecting welds in pipelines. However, the method's sensitivity to unexpected parametric changes (material and geometric) has not been rigorously assessed. In this article, we investigate the robustness of TFM in relation to unavoidable deviations from modeled nominal inspection component characteristics, such as sound velocities and uncertainties about the parts' internal and external diameters. We also review TFM's impact on the standard inspection modes often encountered in industrial inspections, and we present a theoretical model supported by empirical observations to illustrate the discussion.

Estimation of the breaking of rigor mortis by myotonometry.

PubMed

Vain, A; Kauppila, R; Vuori, E

1996-05-31

Myotonometry was used to detect breaking of rigor mortis. The myotonometer is a new instrument which measures the decaying oscillations of a muscle after a brief mechanical impact. The method gives two numerical parameters for rigor mortis, namely the period and decrement of the oscillations, both of which depend on the time period elapsed after death. In the case of breaking the rigor mortis by muscle lengthening, both the oscillation period and decrement decreased, whereas, shortening the muscle caused the opposite changes. Fourteen h after breaking the stiffness characteristics of the right and left m. biceps brachii, or oscillation periods, were assimilated. However, the values for decrement of the muscle, reflecting the dissipation of mechanical energy, maintained their differences.

Methodological considerations when translating “burnout”☆

PubMed Central

Squires, Allison; Finlayson, Catherine; Gerchow, Lauren; Cimiotti, Jeannie P.; Matthews, Anne; Schwendimann, Rene; Griffiths, Peter; Busse, Reinhard; Heinen, Maude; Brzostek, Tomasz; Moreno-Casbas, Maria Teresa; Aiken, Linda H.; Sermeus, Walter

2014-01-01

No study has systematically examined how researchers address cross-cultural adaptation of burnout. We conducted an integrative review to examine how researchers had adapted the instruments to the different contexts. We reviewed the Content Validity Indexing scores for the Maslach Burnout Inventory-Human Services Survey from the 12-country comparative nursing workforce study, RN4CAST. In the integrative review, multiple issues related to translation were found in existing studies. In the cross-cultural instrument analysis, 7 out of 22 items on the instrument received an extremely low kappa score. Investigators may need to employ more rigorous cross-cultural adaptation methods when attempting to measure burnout. PMID:25343131

Including mixed methods research in systematic reviews: examples from qualitative syntheses in TB and malaria control.

PubMed

Atkins, Salla; Launiala, Annika; Kagaha, Alexander; Smith, Helen

2012-04-30

Health policy makers now have access to a greater number and variety of systematic reviews to inform different stages in the policy making process, including reviews of qualitative research. The inclusion of mixed methods studies in systematic reviews is increasing, but these studies pose particular challenges to methods of review. This article examines the quality of the reporting of mixed methods and qualitative-only studies. We used two completed systematic reviews to generate a sample of qualitative studies and mixed method studies in order to make an assessment of how the quality of reporting and rigor of qualitative-only studies compares with that of mixed-methods studies. Overall, the reporting of qualitative studies in our sample was consistently better when compared with the reporting of mixed methods studies. We found that mixed methods studies are less likely to provide a description of the research conduct or qualitative data analysis procedures and less likely to be judged credible or provide rich data and thick description compared with standalone qualitative studies. Our time-related analysis shows that for both types of study, papers published since 2003 are more likely to report on the study context, describe analysis procedures, and be judged credible and provide rich data. However, the reporting of other aspects of research conduct (i.e. descriptions of the research question, the sampling strategy, and data collection methods) in mixed methods studies does not appear to have improved over time. Mixed methods research makes an important contribution to health research in general, and could make a more substantial contribution to systematic reviews. Through our careful analysis of the quality of reporting of mixed methods and qualitative-only research, we have identified areas that deserve more attention in the conduct and reporting of mixed methods research.

Study Design Rigor in Animal-Experimental Research Published in Anesthesia Journals.

PubMed

Hoerauf, Janine M; Moss, Angela F; Fernandez-Bustamante, Ana; Bartels, Karsten

2018-01-01

Lack of reproducibility of preclinical studies has been identified as an impediment for translation of basic mechanistic research into effective clinical therapies. Indeed, the National Institutes of Health has revised its grant application process to require more rigorous study design, including sample size calculations, blinding procedures, and randomization steps. We hypothesized that the reporting of such metrics of study design rigor has increased over time for animal-experimental research published in anesthesia journals. PubMed was searched for animal-experimental studies published in 2005, 2010, and 2015 in primarily English-language anesthesia journals. A total of 1466 publications were graded on the performance of sample size estimation, randomization, and blinding. Cochran-Armitage test was used to assess linear trends over time for the primary outcome of whether or not a metric was reported. Interrater agreement for each of the 3 metrics (power, randomization, and blinding) was assessed using the weighted κ coefficient in a 10% random sample of articles rerated by a second investigator blinded to the ratings of the first investigator. A total of 1466 manuscripts were analyzed. Reporting for all 3 metrics of experimental design rigor increased over time (2005 to 2010 to 2015): for power analysis, from 5% (27/516), to 12% (59/485), to 17% (77/465); for randomization, from 41% (213/516), to 50% (243/485), to 54% (253/465); and for blinding, from 26% (135/516), to 38% (186/485), to 47% (217/465). The weighted κ coefficients and 98.3% confidence interval indicate almost perfect agreement between the 2 raters beyond that which occurs by chance alone (power, 0.93 [0.85, 1.0], randomization, 0.91 [0.85, 0.98], and blinding, 0.90 [0.84, 0.96]). Our hypothesis that reported metrics of rigor in animal-experimental studies in anesthesia journals have increased during the past decade was confirmed. More consistent reporting, or explicit justification for absence, of sample size calculations, blinding techniques, and randomization procedures could better enable readers to evaluate potential sources of bias in animal-experimental research manuscripts. Future studies should assess whether such steps lead to improved translation of animal-experimental anesthesia research into successful clinical trials.

Using Colaizzi's method of data analysis to explore the experiences of nurse academics teaching on satellite campuses.

PubMed

Wirihana, Lisa; Welch, Anthony; Williamson, Moira; Christensen, Martin; Bakon, Shannon; Craft, Judy

2018-03-16

Phenomenology is a useful methodological approach in qualitative nursing research. It enables researchers to put aside their perceptions of a phenomenon and give meaning to a participant's experiences. Exploring the experiences of others enables previously unavailable insights to be discovered. To delineate the implementation of Colaizzi's ( 1978 ) method of data analysis in descriptive phenomenological nursing research. The use of Colaizzi's method of data analysis enabled new knowledge to be revealed and provided insights into the experiences of nurse academics teaching on satellite campuses. Local adaptation of the nursing curriculum and additional unnoticed responsibilities had not been identified previously and warrant further research. Colaizzi's ( 1978 ) method of data analysis is rigorous and robust, and therefore a qualitative method that ensures the credibility and reliability of its results. It allows researchers to reveal emergent themes and their interwoven relationships. Researchers using a descriptive phenomenological approach should consider using this method as a clear and logical process through which the fundamental structure of an experience can be explored. Colaizzi's phenomenological methodology can be used reliably to understand people's experiences. This may prove beneficial in the development of therapeutic policy and the provision of patient-centred care. ©2018 RCN Publishing Company Ltd. All rights reserved. Not to be copied, transmitted or recorded in any way, in whole or part, without prior permission of the publishers.

The difficulties of systematic reviews.

PubMed

Westgate, Martin J; Lindenmayer, David B

2017-10-01

The need for robust evidence to support conservation actions has driven the adoption of systematic approaches to research synthesis in ecology. However, applying systematic review to complex or open questions remains challenging, and this task is becoming more difficult as the quantity of scientific literature increases. We drew on the science of linguistics for guidance as to why the process of identifying and sorting information during systematic review remains so labor intensive, and to provide potential solutions. Several linguistic properties of peer-reviewed corpora-including nonrandom selection of review topics, small-world properties of semantic networks, and spatiotemporal variation in word meaning-greatly increase the effort needed to complete the systematic review process. Conversely, the resolution of these semantic complexities is a common motivation for narrative reviews, but this process is rarely enacted with the rigor applied during linguistic analysis. Therefore, linguistics provides a unifying framework for understanding some key challenges of systematic review and highlights 2 useful directions for future research. First, in cases where semantic complexity generates barriers to synthesis, ecologists should consider drawing on existing methods-such as natural language processing or the construction of research thesauri and ontologies-that provide tools for mapping and resolving that complexity. These tools could help individual researchers classify research material in a more robust manner and provide valuable guidance for future researchers on that topic. Second, a linguistic perspective highlights that scientific writing is a rich resource worthy of detailed study, an observation that can sometimes be lost during the search for data during systematic review or meta-analysis. For example, mapping semantic networks can reveal redundancy and complementarity among scientific concepts, leading to new insights and research questions. Consequently, wider adoption of linguistic approaches may facilitate improved rigor and richness in research synthesis. © 2017 Society for Conservation Biology.

Jim Starnes' Contributions to Residual Strength Analysis Methods for Metallic Structures

NASA Technical Reports Server (NTRS)

Young, Richard D.; Rose, Cheryl A.; Harris, Charles E.

2005-01-01

A summary of advances in residual strength analyses methods for metallic structures that were realized under the leadership of Dr. James H. Starnes, Jr., is presented. The majority of research led by Dr. Starnes in this area was conducted in the 1990's under the NASA Airframe Structural Integrity Program (NASIP). Dr. Starnes, respectfully referred to herein as Jim, had a passion for studying complex response phenomena and dedicated a significant amount of research effort toward advancing damage tolerance and residual strength analysis methods for metallic structures. Jim's efforts were focused on understanding damage propagation in built-up fuselage structure with widespread fatigue damage, with the goal of ensuring safety in the aging international commercial transport fleet. Jim's major contributions in this research area were in identifying the effects of combined internal pressure and mechanical loads, and geometric nonlinearity, on the response of built-up structures with damage. Analytical and experimental technical results are presented to demonstrate the breadth and rigor of the research conducted in this technical area. Technical results presented herein are drawn exclusively from papers where Jim was a co-author.

Job attitudes, job satisfaction, and job affect: A century of continuity and of change.

PubMed

Judge, Timothy A; Weiss, Howard M; Kammeyer-Mueller, John D; Hulin, Charles L

2017-03-01

Over the past 100 years, research on job attitudes has improved in the sophistication of methods and in the productive use of theory as a basis for fundamental research into questions of work psychology. Early research incorporated a diversity of methods for measuring potential predictors and outcomes of job attitudes. Over time, methods for statistically assessing these relationships became more rigorous, but the field also became narrower. In recent years, developments in theory and methodology have reinvigorated research, which now addresses a rich panoply of topics related to the daily flow of affect, the complexity of personal motives and dispositions, and the complex interplay of attitude objects and motivation in shaping behavior. Despite these apparent changes, a review of the concepts and substantive arguments that underpin this literature have remained remarkably consistent. We conclude by discussing how we expect that these major themes will be addressed in the future, emphasizing topics that have proven to be enduring guides for understanding the ways that people construe and react to their appraisals of their work. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Mathematical Rigor vs. Conceptual Change: Some Early Results

NASA Astrophysics Data System (ADS)

Alexander, W. R.

2003-05-01

Results from two different pedagogical approaches to teaching introductory astronomy at the college level will be presented. The first of these approaches is a descriptive, conceptually based approach that emphasizes conceptual change. This descriptive class is typically an elective for non-science majors. The other approach is a mathematically rigorous treatment that emphasizes problem solving and is designed to prepare students for further study in astronomy. The mathematically rigorous class is typically taken by science majors. It also fulfills an elective science requirement for these science majors. The Astronomy Diagnostic Test version 2 (ADT 2.0) was used as an assessment instrument since the validity and reliability have been investigated by previous researchers. The ADT 2.0 was administered as both a pre-test and post-test to both groups. Initial results show no significant difference between the two groups in the post-test. However, there is a slightly greater improvement for the descriptive class between the pre and post testing compared to the mathematically rigorous course. There was great care to account for variables. These variables included: selection of text, class format as well as instructor differences. Results indicate that the mathematically rigorous model, doesn't improve conceptual understanding any better than the conceptual change model. Additional results indicate that there is a similar gender bias in favor of males that has been measured by previous investigators. This research has been funded by the College of Science and Mathematics at James Madison University.

Rigorous evaluation of chemical measurement uncertainty: liquid chromatographic analysis methods using detector response factor calibration

NASA Astrophysics Data System (ADS)

Toman, Blaza; Nelson, Michael A.; Bedner, Mary

2017-06-01

Chemical measurement methods are designed to promote accurate knowledge of a measurand or system. As such, these methods often allow elicitation of latent sources of variability and correlation in experimental data. They typically implement measurement equations that support quantification of effects associated with calibration standards and other known or observed parametric variables. Additionally, multiple samples and calibrants are usually analyzed to assess accuracy of the measurement procedure and repeatability by the analyst. Thus, a realistic assessment of uncertainty for most chemical measurement methods is not purely bottom-up (based on the measurement equation) or top-down (based on the experimental design), but inherently contains elements of both. Confidence in results must be rigorously evaluated for the sources of variability in all of the bottom-up and top-down elements. This type of analysis presents unique challenges due to various statistical correlations among the outputs of measurement equations. One approach is to use a Bayesian hierarchical (BH) model which is intrinsically rigorous, thus making it a straightforward method for use with complex experimental designs, particularly when correlations among data are numerous and difficult to elucidate or explicitly quantify. In simpler cases, careful analysis using GUM Supplement 1 (MC) methods augmented with random effects meta analysis yields similar results to a full BH model analysis. In this article we describe both approaches to rigorous uncertainty evaluation using as examples measurements of 25-hydroxyvitamin D3 in solution reference materials via liquid chromatography with UV absorbance detection (LC-UV) and liquid chromatography mass spectrometric detection using isotope dilution (LC-IDMS).

Praxis-based research networks: An emerging paradigm for research that is rigorous, relevant, and inclusive.

PubMed

Werner, James J; Stange, Kurt C

2014-01-01

Practice-based research networks (PBRNs) have developed a grounded approach to conducting practice-relevant and translational research in community practice settings. Seismic shifts in the health care landscape are shaping PBRNs that work across organizational and institutional margins to address complex problems. Praxis-based research networks combine PBRN knowledge generation with multistakeholder learning, experimentation, and application of practical knowledge. The catalytic processes in praxis-based research networks are cycles of action and reflection based on experience, observation, conceptualization, and experimentation by network members and partners. To facilitate co-learning and solution-building, these networks have a flexible architecture that allows pragmatic inclusion of stakeholders based on the demands of the problem and the needs of the network. Praxis-based research networks represent an evolving trend that combines the core values of PBRNs with new opportunities for relevance, rigor, and broad participation. © Copyright 2014 by the American Board of Family Medicine.

Launching Effectiveness Research to Guide Practice in Neurosurgery: A National Institute Neurological Disorders and Stroke Workshop Report

PubMed Central

Walicke, Patricia; Abosch, Aviva; Asher, Anthony; Barker, Fred G.; Ghogawala, Zoher; Harbaugh, Robert; Jehi, Lara; Kestle, John; Koroshetz, Walter; Little, Roderick; Rubin, Donald; Valadka, Alex; Wisniewski, Stephen

2017-01-01

Abstract This workshop addressed challenges of clinical research in neurosurgery. Randomized controlled clinical trials (RCTs) have high internal validity, but often insufficiently generalize to real-world practice. Observational studies are inclusive but often lack sufficient rigor. The workshop considered possible solutions, such as (1) statistical methods for demonstrating causality using observational data; (2) characteristics required of a registry supporting effectiveness research; (3) trial designs combining advantages of observational studies and RCTs; and (4) equipoise, an identified challenge for RCTs. In the future, advances in information technology potentially could lead to creation of a massive database where clinical data from all neurosurgeons are integrated and analyzed, ending the separation of clinical research and practice and leading to a new “science of practice.” PMID:28362926

From Design to Dissemination: Implementing Community-Based Participatory Research in Postdisaster Communities

PubMed Central

Kennedy, Suzanne; Krouse, Rebecca Z.; Grimsley, Faye; El-Dahr, Jane; Bordelon, Keith; Sterling, Yvonne; White, LuAnn; Barlow, Natasha; DeGruy, Shannon; Paul, Dorothy; Denham, Stacey; Hayes, Claire; Sanders, Margaret; Mvula, Mosanda M.; Thornton, Eleanor; Chulada, Patricia; Mitchell, Herman; Martin, William J.; Stephens, Kevin U.; Cohn, Richard D.

2016-01-01

Objectives. To review how disasters introduce unique challenges to conducting population-based research and community-based participatory research (CBPR). Methods. From 2007–2009, we conducted the Head-off Environmental Asthma in Louisiana (HEAL) Study in the aftermath of Hurricane Katrina in a Gulf Coast community facing an unprecedented triple burden: Katrina’s and other disasters’ impact on the environment and health, historic health disparities, and persistent environmental health threats. Results. The unique triple burden influenced every research component; still, most existing CBPR principles were applicable, even though full adherence was not always feasible and additional tailored principles govern postdisaster settings. Conclusions. Even in the most challenging postdisaster conditions, CBPR can be successfully designed, implemented, and disseminated while adhering to scientific rigor. PMID:27196662

Conducting phenomenological research: Rationalizing the methods and rigour of the phenomenology of practice.

PubMed

Errasti-Ibarrondo, Begoña; Jordán, José Antonio; Díez-Del-Corral, Mercedes P; Arantzamendi, María

2018-07-01

To offer a complete outlook in a readable easy way of van Manen's hermeneutic-phenomenological method to nurses interested in undertaking phenomenological research. Phenomenology, as research methodology, involves a certain degree of complexity. It is difficult to identify a single article or author which sets out the didactic guidelines that specifically guide research of this kind. In this context, the theoretical-practical view of Max van Manen's Phenomenology of Practice may be seen as a rigorous guide and directive on which researchers may find support to undertake phenomenological research. Discussion paper. This discussion paper is based on our own experiences and supported by literature and theory. Our central sources of data have been the books and writings of Max van Manen and his website "Phenomenologyonline". The principal methods of the hermeneutic-phenomenological method are addressed and explained providing an enriching overview of phenomenology of practice. A proposal is made for the way the suggestions made by van Manen might be organized for use with the methods involved in Phenomenology of Practice: Social sciences, philosophical and philological methods. Thereby, nurse researchers interested in conducting phenomenological research may find a global outlook and support to understand and conduct this type of inquiry which draws on the art. The approach in this article may help nurse scholars and researchers reach an overall, encompassing perspective of the main methods and activities involved in doing phenomenological research. Nurses interested in doing phenomenology of practice are expected to commit with reflection and writing. © 2018 John Wiley & Sons Ltd.

Selection and authentication of botanical materials for the development of analytical methods.

PubMed

Applequist, Wendy L; Miller, James S

2013-05-01

Herbal products, for example botanical dietary supplements, are widely used. Analytical methods are needed to ensure that botanical ingredients used in commercial products are correctly identified and that research materials are of adequate quality and are sufficiently characterized to enable research to be interpreted and replicated. Adulteration of botanical material in commerce is common for some species. The development of analytical methods for specific botanicals, and accurate reporting of research results, depend critically on correct identification of test materials. Conscious efforts must therefore be made to ensure that the botanical identity of test materials is rigorously confirmed and documented through preservation of vouchers, and that their geographic origin and handling are appropriate. Use of material with an associated herbarium voucher that can be botanically identified is always ideal. Indirect methods of authenticating bulk material in commerce, for example use of organoleptic, anatomical, chemical, or molecular characteristics, are not always acceptable for the chemist's purposes. Familiarity with botanical and pharmacognostic literature is necessary to determine what potential adulterants exist and how they may be distinguished.

The Making of Psychological Methods

PubMed Central

Harlow, Lisa L.

2017-01-01

Psychological Methods celebrated its 20-year anniversary recently, having published its first quarterly issue in March 1996. It seemed time to provide a brief overview of the history, the highlights over the years, and the current state of the journal, along with tips for submissions. The article is organized to discuss: (1) the background and development of the journal, (2) the top articles, authors and topics over the years, (3) an overview of the journal today, and (4) a summary of the features of successful articles that usually entail rigorous and novel methodology described in clear and understandable writing and that can be applied in meaningful and relevant areas of psychological research. PMID:28252997

Dense module enumeration in biological networks

NASA Astrophysics Data System (ADS)

Tsuda, Koji; Georgii, Elisabeth

2009-12-01

Analysis of large networks is a central topic in various research fields including biology, sociology, and web mining. Detection of dense modules (a.k.a. clusters) is an important step to analyze the networks. Though numerous methods have been proposed to this aim, they often lack mathematical rigorousness. Namely, there is no guarantee that all dense modules are detected. Here, we present a novel reverse-search-based method for enumerating all dense modules. Furthermore, constraints from additional data sources such as gene expression profiles or customer profiles can be integrated, so that we can systematically detect dense modules with interesting profiles. We report successful applications in human protein interaction network analyses.

Numerical Simulation of Partially-Coherent Broadband Optical Imaging Using the FDTD Method

PubMed Central

Çapoğlu, İlker R.; White, Craig A.; Rogers, Jeremy D.; Subramanian, Hariharan; Taflove, Allen; Backman, Vadim

2012-01-01

Rigorous numerical modeling of optical systems has attracted interest in diverse research areas ranging from biophotonics to photolithography. We report the full-vector electromagnetic numerical simulation of a broadband optical imaging system with partially-coherent and unpolarized illumination. The scattering of light from the sample is calculated using the finite-difference time-domain (FDTD) numerical method. Geometrical optics principles are applied to the scattered light to obtain the intensity distribution at the image plane. Multilayered object spaces are also supported by our algorithm. For the first time, numerical FDTD calculations are directly compared to and shown to agree well with broadband experimental microscopy results. PMID:21540939

[Iridology: a systematic review].

PubMed

Salles, Léia Fortes; Silva, Maria Júlia Paes

2008-09-01

This study is a literature review about Iridology/Irisdiagnose in the period from 1970 to 2005. The objective was to identify the worldwide scientific publications (articles) in this field and the opinions about the method. Twenty-five articles were found, four of them from Brazilian authors. About the category, 1 was literature review, 12 research studies and 12 updates, historical reviews or editorials. The countries that have contributed more with the studies were Brazil and Russia. Fifteen of those are in favor of the method and 10 are against it. In conclusion, it is necessary to develop more studies inside the methodological rigor, once Iridology brings hope to preventive medicine.

Advancing the research agenda for diagnostic error reduction.

PubMed

Zwaan, Laura; Schiff, Gordon D; Singh, Hardeep

2013-10-01

Diagnostic errors remain an underemphasised and understudied area of patient safety research. We briefly summarise the methods that have been used to conduct research on epidemiology, contributing factors and interventions related to diagnostic error and outline directions for future research. Research methods that have studied epidemiology of diagnostic error provide some estimate on diagnostic error rates. However, there appears to be a large variability in the reported rates due to the heterogeneity of definitions and study methods used. Thus, future methods should focus on obtaining more precise estimates in different settings of care. This would lay the foundation for measuring error rates over time to evaluate improvements. Research methods have studied contributing factors for diagnostic error in both naturalistic and experimental settings. Both approaches have revealed important and complementary information. Newer conceptual models from outside healthcare are needed to advance the depth and rigour of analysis of systems and cognitive insights of causes of error. While the literature has suggested many potentially fruitful interventions for reducing diagnostic errors, most have not been systematically evaluated and/or widely implemented in practice. Research is needed to study promising intervention areas such as enhanced patient involvement in diagnosis, improving diagnosis through the use of electronic tools and identification and reduction of specific diagnostic process 'pitfalls' (eg, failure to conduct appropriate diagnostic evaluation of a breast lump after a 'normal' mammogram). The last decade of research on diagnostic error has made promising steps and laid a foundation for more rigorous methods to advance the field.

Clinical and translational scientist career success: metrics for evaluation.

PubMed

Lee, Linda S; Pusek, Susan N; McCormack, Wayne T; Helitzer, Deborah L; Martina, Camille A; Dozier, Ann M; Ahluwalia, Jasjit S; Schwartz, Lisa S; McManus, Linda M; Reynolds, Brian D; Haynes, Erin N; Rubio, Doris M

2012-10-01

Despite the increased emphasis on formal training in clinical and translational research and the growth in the number and scope of training programs over the past decade, the impact of training on research productivity and career success has yet to be fully evaluated at the institutional level. In this article, the Education Evaluation Working Group of the Clinical and Translational Science Award Consortium introduces selected metrics and methods associated with the assessment of key factors that affect research career success. The goals in providing this information are to encourage more consistent data collection across training sites, to foster more rigorous and systematic exploration of factors associated with career success, and to help address previously identified difficulties in program evaluation. © 2012 Wiley Periodicals, Inc.

Grounded theory in medical education research: AMEE Guide No. 70.

PubMed

Watling, Christopher J; Lingard, Lorelei

2012-01-01

Qualitative research in general and the grounded theory approach in particular, have become increasingly prominent in medical education research in recent years. In this Guide, we first provide a historical perspective on the origin and evolution of grounded theory. We then outline the principles underlying the grounded theory approach and the procedures for doing a grounded theory study, illustrating these elements with real examples. Next, we address key critiques of grounded theory, which continue to shape how the method is perceived and used. Finally, pitfalls and controversies in grounded theory research are examined to provide a balanced view of both the potential and the challenges of this approach. This Guide aims to assist researchers new to grounded theory to approach their studies in a disciplined and rigorous fashion, to challenge experienced researchers to reflect on their assumptions, and to arm readers of medical education research with an approach to critically appraising the quality of grounded theory studies.

Employing a Qualitative Description Approach in Health Care Research.

PubMed

Bradshaw, Carmel; Atkinson, Sandra; Doody, Owen

2017-01-01

A qualitative description design is particularly relevant where information is required directly from those experiencing the phenomenon under investigation and where time and resources are limited. Nurses and midwives often have clinical questions suitable to a qualitative approach but little time to develop an exhaustive comprehension of qualitative methodological approaches. Qualitative description research is sometimes considered a less sophisticated approach for epistemological reasons. Another challenge when considering qualitative description design is differentiating qualitative description from other qualitative approaches. This article provides a systematic and robust journey through the philosophical, ontological, and epistemological perspectives, which evidences the purpose of qualitative description research. Methods and rigor issues underpinning qualitative description research are also appraised to provide the researcher with a systematic approach to conduct research utilizing this approach. The key attributes and value of qualitative description research in the health care professions will be highlighted with the aim of extending its usage.

Employing a Qualitative Description Approach in Health Care Research

PubMed Central

Bradshaw, Carmel; Atkinson, Sandra; Doody, Owen

2017-01-01

A qualitative description design is particularly relevant where information is required directly from those experiencing the phenomenon under investigation and where time and resources are limited. Nurses and midwives often have clinical questions suitable to a qualitative approach but little time to develop an exhaustive comprehension of qualitative methodological approaches. Qualitative description research is sometimes considered a less sophisticated approach for epistemological reasons. Another challenge when considering qualitative description design is differentiating qualitative description from other qualitative approaches. This article provides a systematic and robust journey through the philosophical, ontological, and epistemological perspectives, which evidences the purpose of qualitative description research. Methods and rigor issues underpinning qualitative description research are also appraised to provide the researcher with a systematic approach to conduct research utilizing this approach. The key attributes and value of qualitative description research in the health care professions will be highlighted with the aim of extending its usage. PMID:29204457

The Challenge of Timely, Responsive and Rigorous Ethics Review of Disaster Research: Views of Research Ethics Committee Members.

PubMed

Hunt, Matthew; Tansey, Catherine M; Anderson, James; Boulanger, Renaud F; Eckenwiler, Lisa; Pringle, John; Schwartz, Lisa

2016-01-01

Research conducted following natural disasters such as earthquakes, floods or hurricanes is crucial for improving relief interventions. Such research, however, poses ethical, methodological and logistical challenges for researchers. Oversight of disaster research also poses challenges for research ethics committees (RECs), in part due to the rapid turnaround needed to initiate research after a disaster. Currently, there is limited knowledge available about how RECs respond to and appraise disaster research. To address this knowledge gap, we investigated the experiences of REC members who had reviewed disaster research conducted in low- or middle-income countries. We used interpretive description methodology and conducted in-depth interviews with 15 respondents. Respondents were chairs, members, advisors, or coordinators from 13 RECs, including RECs affiliated with universities, governments, international organizations, a for-profit REC, and an ad hoc committee established during a disaster. Interviews were analyzed inductively using constant comparative techniques. Through this process, three elements were identified as characterizing effective and high-quality review: timeliness, responsiveness and rigorousness. To ensure timeliness, many RECs rely on adaptations of review procedures for urgent protocols. Respondents emphasized that responsive review requires awareness of and sensitivity to the particularities of disaster settings and disaster research. Rigorous review was linked with providing careful assessment of ethical considerations related to the research, as well as ensuring independence of the review process. Both the frequency of disasters and the conduct of disaster research are on the rise. Ensuring effective and high quality review of disaster research is crucial, yet challenges, including time pressures for urgent protocols, exist for achieving this goal. Adapting standard REC procedures may be necessary. However, steps should be taken to ensure that ethics review of disaster research remains diligent and thorough.

A Rigorous Investigation on the Ground State of the Penson-Kolb Model

NASA Astrophysics Data System (ADS)

Yang, Kai-Hua; Tian, Guang-Shan; Han, Ru-Qi

2003-05-01

By using either numerical calculations or analytical methods, such as the bosonization technique, the ground state of the Penson-Kolb model has been previously studied by several groups. Some physicists argued that, as far as the existence of superconductivity in this model is concerned, it is canonically equivalent to the negative-U Hubbard model. However, others did not agree. In the present paper, we shall investigate this model by an independent and rigorous approach. We show that the ground state of the Penson-Kolb model is nondegenerate and has a nonvanishing overlap with the ground state of the negative-U Hubbard model. Furthermore, we also show that the ground states of both the models have the same good quantum numbers and may have superconducting long-range order at the same momentum q = 0. Our results support the equivalence between these models. The project partially supported by the Special Funds for Major State Basic Research Projects (G20000365) and National Natural Science Foundation of China under Grant No. 10174002

ASTM Committee C28: International Standards for Properties and Performance of Advanced Ceramics, Three Decades of High-quality, Technically-rigorous Normalization

NASA Technical Reports Server (NTRS)

Jenkins, Michael G.; Salem, Jonathan A.

2016-01-01

Physical and mechanical properties and performance of advanced ceramics and glasses are difficult to measure correctly without the proper techniques. For over three decades, ASTM Committee C28 on Advanced Ceramics, has developed high quality, rigorous, full-consensus standards (e.g., test methods, practices, guides, terminology) to measure properties and performance of monolithic and composite ceramics that may be applied to glasses in some cases. These standards testing particulars for many mechanical, physical, thermal, properties and performance of these materials. As a result these standards provide accurate, reliable, repeatable and complete data. Within Committee C28 users, producers, researchers, designers, academicians, etc. have written, continually updated, and validated through round-robin test programs, nearly 50 standards since the Committees founding in 1986. This paper provides a retrospective review of the 30 years of ASTM Committee C28 including a graphical pictogram listing of C28 standards along with examples of the tangible benefits of advanced ceramics standards to demonstrate their practical applications.

Rigorous numerical modeling of scattering-type scanning near-field optical microscopy and spectroscopy

NASA Astrophysics Data System (ADS)

Chen, Xinzhong; Lo, Chiu Fan Bowen; Zheng, William; Hu, Hai; Dai, Qing; Liu, Mengkun

2017-11-01

Over the last decade, scattering-type scanning near-field optical microscopy and spectroscopy have been widely used in nano-photonics and material research due to their fine spatial resolution and broad spectral range. A number of simplified analytical models have been proposed to quantitatively understand the tip-scattered near-field signal. However, a rigorous interpretation of the experimental results is still lacking at this stage. Numerical modelings, on the other hand, are mostly done by simulating the local electric field slightly above the sample surface, which only qualitatively represents the near-field signal rendered by the tip-sample interaction. In this work, we performed a more comprehensive numerical simulation which is based on realistic experimental parameters and signal extraction procedures. By directly comparing to the experiments as well as other simulation efforts, our methods offer a more accurate quantitative description of the near-field signal, paving the way for future studies of complex systems at the nanoscale.

Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation' in the Case of Climate Change Vulnerability Research.

PubMed

Delaney, Aogán; Tamás, Peter A; Crane, Todd A; Chesterman, Sabrina

2016-01-01

There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to facilitate synthesis of results and design of subsequent research a method, construct-centered methods aggregation, was designed to 1) provide a transparent, valid and reliable description of research methods, 2) support comparability of primary studies and 3) contribute to a shared empirical basis for improving research practice. Rather than taking research reports at face value, research designs are reviewed through inductive analysis. This involves bottom-up identification of constructs, definitions and operationalizations; assessment of concepts' commensurability through comparison of definitions; identification of theoretical frameworks through patterns of construct use; and integration of transparently reported and valid operationalizations into ideal-type research frameworks. Through the integration of reliable bottom-up inductive coding from operationalizations and top-down coding driven from stated theory with expert interpretation, construct-centered methods aggregation enabled both resolution of heterogeneity within identically named constructs and merging of differently labeled but identical constructs. These two processes allowed transparent, rigorous and contextually sensitive synthesis of the research presented in an uneven set of reports undertaken in a heterogenous field. If adopted more broadly, construct-centered methods aggregation may contribute to the emergence of a valid, empirically-grounded description of methods used in primary research. These descriptions may function as a set of expectations that improves the transparency of reporting and as an evolving comprehensive framework that supports both interpretation of existing and design of future research.

Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research

PubMed Central

Crane, Todd A.; Chesterman, Sabrina

2016-01-01

There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to facilitate synthesis of results and design of subsequent research a method, construct-centered methods aggregation, was designed to 1) provide a transparent, valid and reliable description of research methods, 2) support comparability of primary studies and 3) contribute to a shared empirical basis for improving research practice. Rather than taking research reports at face value, research designs are reviewed through inductive analysis. This involves bottom-up identification of constructs, definitions and operationalizations; assessment of concepts’ commensurability through comparison of definitions; identification of theoretical frameworks through patterns of construct use; and integration of transparently reported and valid operationalizations into ideal-type research frameworks. Through the integration of reliable bottom-up inductive coding from operationalizations and top-down coding driven from stated theory with expert interpretation, construct-centered methods aggregation enabled both resolution of heterogeneity within identically named constructs and merging of differently labeled but identical constructs. These two processes allowed transparent, rigorous and contextually sensitive synthesis of the research presented in an uneven set of reports undertaken in a heterogenous field. If adopted more broadly, construct-centered methods aggregation may contribute to the emergence of a valid, empirically-grounded description of methods used in primary research. These descriptions may function as a set of expectations that improves the transparency of reporting and as an evolving comprehensive framework that supports both interpretation of existing and design of future research. PMID:26901409

Involving service users in trials: developing a standard operating procedure

PubMed Central

2013-01-01

Background Many funding bodies require researchers to actively involve service users in research to improve relevance, accountability and quality. Current guidance to researchers mainly discusses general principles. Formal guidance about how to involve service users operationally in the conduct of trials is lacking. We aimed to develop a standard operating procedure (SOP) to support researchers to involve service users in trials and rigorous studies. Methods Researchers with experience of involving service users and service users who were contributing to trials collaborated with the West Wales Organisation for Rigorous Trials in Health, a registered clinical trials unit, to develop the SOP. Drafts were prepared in a Task and Finish Group, reviewed by all co-authors and amendments made. Results We articulated core principles, which defined equality of service users with all other research team members and collaborative processes underpinning the SOP, plus guidance on how to achieve these. We developed a framework for involving service users in research that defined minimum levels of collaboration plus additional consultation and decision-making opportunities. We recommended service users be involved throughout the life of a trial, including planning and development, data collection, analysis and dissemination, and listed tasks for collaboration. We listed people responsible for involving service users in studies and promoting an inclusive culture. We advocate actively involving service users as early as possible in the research process, with a minimum of two on all formal trial groups and committees. We propose that researchers protect at least 1% of their total research budget as a minimum resource to involve service users and allow enough time to facilitate active involvement. Conclusions This SOP provides guidance to researchers to involve service users successfully in developing and conducting clinical trials and creating a culture of actively involving service users in research at all stages. The UK Clinical Research Collaboration should encourage clinical trials units actively to involve service users and research funders should provide sufficient funds and time for this in research grants. PMID:23866730

Towards a framework for the elicitation of dilemmas.

PubMed

Burger, Marc J C

2008-08-01

This paper covers the main findings of the doctoral research that was concerned with seeking to extend aspects of dilemma theory. In professional practice, the Trompenaars Hampden-Turner Dilemma Reconciliation Process(TM) is a vehicle delivering dilemma theory in application. It informs a manager or leader on how to explore the dilemmas they face, how to reconcile the tensions that result, and how to structure the action steps for implementing the reconciled solutions. This vehicle forms the professional practice of the author who seeks to bring more rigor to consulting practice and thereby also contribute to theory development in the domain. The critical review of dilemma theory reveals that previous authors are inconsistent and variously invalid in their use of the terms 'dilemma theory,' 'dilemma methodology,' 'dilemma process,' 'dilemma reconciliation,' etc., and therefore an attempt is made to resolve these inconsistencies by considering whether 'dilemmaism' at the meta-level might be positioned as a new paradigm of inquiry for (management) research that embodies ontological, epistemological, and methodical premises that frame an approach to the resolution of real world business problems in (multi) disciplinary; (multi) functional and (multi) cultural business environments. This research offers contributions to knowledge, professional practice and theory development from the exploration of the SPID model as a way to make the elicitation of dilemmas more rigorous and structured and in the broader context of exploring 'dilemmaism' as a new paradigm of inquiry.

Qualitative Descriptive Methods in Health Science Research.

PubMed

Colorafi, Karen Jiggins; Evans, Bronwynne

2016-07-01

The purpose of this methodology paper is to describe an approach to qualitative design known as qualitative descriptive that is well suited to junior health sciences researchers because it can be used with a variety of theoretical approaches, sampling techniques, and data collection strategies. It is often difficult for junior qualitative researchers to pull together the tools and resources they need to embark on a high-quality qualitative research study and to manage the volumes of data they collect during qualitative studies. This paper seeks to pull together much needed resources and provide an overview of methods. A step-by-step guide to planning a qualitative descriptive study and analyzing the data is provided, utilizing exemplars from the authors' research. This paper presents steps to conducting a qualitative descriptive study under the following headings: describing the qualitative descriptive approach, designing a qualitative descriptive study, steps to data analysis, and ensuring rigor of findings. The qualitative descriptive approach results in a summary in everyday, factual language that facilitates understanding of a selected phenomenon across disciplines of health science researchers. © The Author(s) 2016.

Optical simulations of organic light-emitting diodes through a combination of rigorous electromagnetic solvers and Monte Carlo ray-tracing methods

NASA Astrophysics Data System (ADS)

Bahl, Mayank; Zhou, Gui-Rong; Heller, Evan; Cassarly, William; Jiang, Mingming; Scarmozzino, Rob; Gregory, G. Groot

2014-09-01

Over the last two decades there has been extensive research done to improve the design of Organic Light Emitting Diodes (OLEDs) so as to enhance light extraction efficiency, improve beam shaping, and allow color tuning through techniques such as the use of patterned substrates, photonic crystal (PCs) gratings, back reflectors, surface texture, and phosphor down-conversion. Computational simulation has been an important tool for examining these increasingly complex designs. It has provided insights for improving OLED performance as a result of its ability to explore limitations, predict solutions, and demonstrate theoretical results. Depending upon the focus of the design and scale of the problem, simulations are carried out using rigorous electromagnetic (EM) wave optics based techniques, such as finite-difference time-domain (FDTD) and rigorous coupled wave analysis (RCWA), or through ray optics based technique such as Monte Carlo ray-tracing. The former are typically used for modeling nanostructures on the OLED die, and the latter for modeling encapsulating structures, die placement, back-reflection, and phosphor down-conversion. This paper presents the use of a mixed-level simulation approach which unifies the use of EM wave-level and ray-level tools. This approach uses rigorous EM wave based tools to characterize the nanostructured die and generate both a Bidirectional Scattering Distribution function (BSDF) and a far-field angular intensity distribution. These characteristics are then incorporated into the ray-tracing simulator to obtain the overall performance. Such mixed-level approach allows for comprehensive modeling of the optical characteristic of OLEDs and can potentially lead to more accurate performance than that from individual modeling tools alone.

Balancing Methodological Rigor and the Needs of Research Participants: A Debate on Alternative Approaches to Sensitive Research.

PubMed

Chan, T M Simon; Teram, Eli; Shaw, Ian

2017-01-01

Despite growing consideration of the needs of research participants in studies related to sensitive issues, discussions of alternative ways to design sensitive research are scarce. Structured as an exchange between two researchers who used different approaches in their studies with childhood sexual abuse survivors, in this article, we seek to advance understanding of methodological and ethical issues in designing sensitive research. The first perspective, which is termed protective, promotes the gradual progression of participants from a treatment phase into a research phase, with the ongoing presence of a researcher and a social worker in both phases. In the second perspective, which is termed minimalist, we argue for clear boundaries between research and treatment processes, limiting the responsibility of researchers to ensuring that professional support is available to participants who experience emotional difficulties. Following rebuttals, lessons are drawn for ethical balancing between methodological rigor and the needs of participants. © The Author(s) 2015.

Methods Beyond Methods: A Model for Africana Graduate Methods Training.

PubMed

Best, Latrica E; Byrd, W Carson

2014-06-01

A holistic graduate education can impart not just tools and knowledge, but critical positioning to fulfill many of the original missions of Africana Studies programs set forth in the 1960s and 1970s. As an interdisciplinary field with many approaches to examining the African Diaspora, the methodological training of graduate students can vary across graduate programs. Although taking qualitative methods courses are often required of graduate students in Africana Studies programs, and these programs offer such courses, rarely if ever are graduate students in these programs required to take quantitative methods courses, let alone have these courses offered in-house. These courses can offer Africana Studies graduate students new tools for their own research, but more importantly, improve their knowledge of quantitative research of diasporic communities. These tools and knowledge can assist with identifying flawed arguments about African-descended communities and their members. This article explores the importance of requiring and offering critical quantitative methods courses in graduate programs in Africana Studies, and discusses the methods requirements of one graduate program in the field as an example of more rigorous training that other programs could offer graduate students.

Trafficking and Health: A Systematic Review of Research Methods.

PubMed

Cannon, Abby C; Arcara, Jennet; Graham, Laurie M; Macy, Rebecca J

2018-04-01

Trafficking in persons (TIP) is a human rights violation with serious public health consequences. Unfortunately, assessing TIP and its health sequelae rigorously and reliably is challenging due to TIP's clandestine nature, variation in definitions of TIP, and the need to use research methods that ensure studies are ethical and feasible. To help guide practice, policy, and research to assess TIP and health, we undertook a systematic literature review of 70 peer-reviewed, published articles to (a) identify TIP and health research methods being used, (b) determine what we can learn about TIP and health from these varied methodologies, and (c) determine the gaps that exist in health-focused TIP research. Results revealed that there are various quantitative and qualitative data collection and analysis methods being used to investigate TIP and health. Furthermore, findings show that the limitations of current methodologies affect what is known about TIP and health. In particular, varying definitions, participant recruitment strategies, ethical standards, and outcome measures all affect what is known about TIP and health. Moreover, findings demonstrate an urgent need for representative and nonpurposive recruitment strategies in future investigations of TIP and health as well as research on risk and protective factors related to TIP and health, intervention effectiveness, long-term health outcomes, and research on trafficked people beyond women trafficked for sex. We offer recommendations for research, policy, and practice based on review results.

Whole lot of parts: stress in extreme environments.

PubMed

Steel, G Daniel

2005-06-01

Stress has been a central interest for researchers of human behavior in extreme and unusual environments and also for those who are responsible for planning and carrying out expeditions involving such environments. This paper compares the actuarial and case study methods for predicting reactions to stress. Actuarial studies are useful, but do not tap enough variables to allow us to predict how a specific individual will cope with the rigors of an individual mission. Case histories provide a wealth of detail, but few investigators understand the challenges of properly applying this method. This study reviews some of the strengths and weaknesses of the actuarial and case history methods, and presents a four celled taxonomy of stress based on method (actuarial and case history) and effects (distress and eustress). For both research and operational purposes, the person, the setting, and time should not be considered independently; rather, it is an amalgam of these variables that provides the proper basis of analysis.

Image analysis of the blood cells for cytomorphodiagnostics and control of the effectiveness treatment

NASA Astrophysics Data System (ADS)

Zhukotsky, Alexander V.; Kogan, Emmanuil M.; Kopylov, Victor F.; Marchenko, Oleg V.; Lomakin, O. A.

1994-07-01

A new method for morphodensitometric analysis of blood cells was applied for medically screening some ecological influence and infection pathologies. A complex algorithm of computational image processing was created for supra molecular restructurings of interphase chromatin of lymphocytes research. It includes specific methods of staining and unifies different quantitative analysis methods. Our experience with the use of a television image analyzer in cytological and immunological studies made it possible to carry out some research in morphometric analysis of chromatin structure in interphase lymphocyte nuclei in genetic and virus pathologies. In our study to characterize lymphocytes as an image-forming system by a rigorous mathematical description we used an approach involving contaminant evaluation of the topography of chromatin network intact and victims' lymphocytes. It is also possible to digitize data, which revealed significant distinctions between control and experiment. The method allows us to observe the minute structural changes in chromatin, especially eu- and hetero-chromatin that were previously studied by genetics only in chromosomes.

A Review on the research and practice of city sustainable development indicators and indices

NASA Astrophysics Data System (ADS)

Xiang, Ning

2017-10-01

City sustainable development indicators and indices have become a hot issue in academic research and practical application, alongside the high-speed worldwide urbanization and driven by the actual managing demand. This article is aimed at a clear understanding of the progress in relevant research and practice. This is done by collecting common indicators and indices for city sustainable development and making comparison of the assessment process and contents, so as to find out main obstacles for the development of this research field and explore the direction for efforts to be made next step. The article divides these indicators and indices into two categories: ① indicators serving as single index which can provide an explicit description on the relationship between economic activities and environmental carrying capacity, but have a narrow scope of assessment and use complicated methods to collect and calculate data; ② indices based on indicator systems which can represent multiple processes, could reflect the view of strong sustainability and are easy to use, but can hardly depict the responding relationship between social, environmental and economic changes for city sustainable development or assure the scientific rigor of weight setting. Practices on indicators and indices for city sustainable development was summarized, and its problems were reviewed with China being representative of transitioning countries. According to the review, great progress has been achieved in the research and practice of indicators and indices for city sustainable development, but consistency of theories, rationality of indicators and scientific rigor of methodology are to be improved significantly.

Development of a software safety process and a case study of its use

NASA Technical Reports Server (NTRS)

Knight, John C.

1993-01-01

The goal of this research is to continue the development of a comprehensive approach to software safety and to evaluate the approach with a case study. The case study is a major part of the project, and it involves the analysis of a specific safety-critical system from the medical equipment domain. The particular application being used was selected because of the availability of a suitable candidate system. We consider the results to be generally applicable and in no way particularly limited by the domain. The research is concentrating on issues raised by the specification and verification phases of the software lifecycle since they are central to our previously-developed rigorous definitions of software safety. The theoretical research is based on our framework of definitions for software safety. In the area of specification, the main topics being investigated are the development of techniques for building system fault trees that correctly incorporate software issues and the development of rigorous techniques for the preparation of software safety specifications. The research results are documented. Another area of theoretical investigation is the development of verification methods tailored to the characteristics of safety requirements. Verification of the correct implementation of the safety specification is central to the goal of establishing safe software. The empirical component of this research is focusing on a case study in order to provide detailed characterizations of the issues as they appear in practice, and to provide a testbed for the evaluation of various existing and new theoretical results, tools, and techniques. The Magnetic Stereotaxis System is summarized.

Treetrimmer: a method for phylogenetic dataset size reduction.

PubMed

Maruyama, Shinichiro; Eveleigh, Robert J M; Archibald, John M

2013-04-12

With rapid advances in genome sequencing and bioinformatics, it is now possible to generate phylogenetic trees containing thousands of operational taxonomic units (OTUs) from a wide range of organisms. However, use of rigorous tree-building methods on such large datasets is prohibitive and manual 'pruning' of sequence alignments is time consuming and raises concerns over reproducibility. There is a need for bioinformatic tools with which to objectively carry out such pruning procedures. Here we present 'TreeTrimmer', a bioinformatics procedure that removes unnecessary redundancy in large phylogenetic datasets, alleviating the size effect on more rigorous downstream analyses. The method identifies and removes user-defined 'redundant' sequences, e.g., orthologous sequences from closely related organisms and 'recently' evolved lineage-specific paralogs. Representative OTUs are retained for more rigorous re-analysis. TreeTrimmer reduces the OTU density of phylogenetic trees without sacrificing taxonomic diversity while retaining the original tree topology, thereby speeding up downstream computer-intensive analyses, e.g., Bayesian and maximum likelihood tree reconstructions, in a reproducible fashion.

75 FR 34997 - National Institute on Disability and Rehabilitation Research (NIDRR)-Disability and...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-06-21

... trial research designs to evaluate the effectiveness of interventions or practices. NIDRR believes that randomized control trial research designs can be appropriate for research that involves evaluating specific interventions. However, in complex service delivery settings, other scientifically rigorous research designs may...

Bulk Enthalpy Calculations in the Arc Jet Facility at NASA ARC

NASA Technical Reports Server (NTRS)

Thompson, Corinna S.; Prabhu, Dinesh; Terrazas-Salinas, Imelda; Mach, Jeffrey J.

2011-01-01

The Arc Jet Facilities at NASA Ames Research Center generate test streams with enthalpies ranging from 5 MJ/kg to 25 MJ/kg. The present work describes a rigorous method, based on equilibrium thermodynamics, for calculating the bulk enthalpy of the flow produced in two of these facilities. The motivation for this work is to determine a dimensionally-correct formula for calculating the bulk enthalpy that is at least as accurate as the conventional formulas that are currently used. Unlike previous methods, the new method accounts for the amount of argon that is present in the flow. Comparisons are made with bulk enthalpies computed from an energy balance method. An analysis of primary facility operating parameters and their associated uncertainties is presented in order to further validate the enthalpy calculations reported herein.

Using qualitative methods to improve questionnaires for Spanish speakers: assessing face validity of a food behavior checklist.

PubMed

Banna, Jinan C; Vera Becerra, Luz E; Kaiser, Lucia L; Townsend, Marilyn S

2010-01-01

Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture's food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Using Qualitative Methods to Improve Questionnaires for Spanish Speakers: Assessing Face Validity of a Food Behavior Checklist

PubMed Central

BANNA, JINAN C.; VERA BECERRA, LUZ E.; KAISER, LUCIA L.; TOWNSEND, MARILYN S.

2015-01-01

Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture’s food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. PMID:20102831

Qualitative research within trials: developing a standard operating procedure for a clinical trials unit

PubMed Central

2013-01-01

Background Qualitative research methods are increasingly used within clinical trials to address broader research questions than can be addressed by quantitative methods alone. These methods enable health professionals, service users, and other stakeholders to contribute their views and experiences to evaluation of healthcare treatments, interventions, or policies, and influence the design of trials. Qualitative data often contribute information that is better able to reform policy or influence design. Methods Health services researchers, including trialists, clinicians, and qualitative researchers, worked collaboratively to develop a comprehensive portfolio of standard operating procedures (SOPs) for the West Wales Organisation for Rigorous Trials in Health (WWORTH), a clinical trials unit (CTU) at Swansea University, which has recently achieved registration with the UK Clinical Research Collaboration (UKCRC). Although the UKCRC requires a total of 25 SOPs from registered CTUs, WWORTH chose to add an additional qualitative-methods SOP (QM-SOP). Results The qualitative methods SOP (QM-SOP) defines good practice in designing and implementing qualitative components of trials, while allowing flexibility of approach and method. Its basic principles are that: qualitative researchers should be contributors from the start of trials with qualitative potential; the qualitative component should have clear aims; and the main study publication should report on the qualitative component. Conclusions We recommend that CTUs consider developing a QM-SOP to enhance the conduct of quantitative trials by adding qualitative data and analysis. We judge that this improves the value of quantitative trials, and contributes to the future development of multi-method trials. PMID:23433341

Assessing Consumer Responses to PREPs: A Review of Tobacco Industry and Independent Research Methods

PubMed Central

Rees, Vaughan W.; Kreslake, Jennifer M.; Cummings, K. Michael; O'Connor, Richard J.; Hatsukami, Dorothy K.; Parascandola, Mark; Shields, Peter G.; Connolly, Gregory N.

2009-01-01

Objective Internal tobacco industry documents and the mainstream literature are reviewed to identify methods and measures for evaluating tobacco consumer response. The review aims to outline areas in which established methods exist, identify gaps in current methods for assessing CR, and consider how these methods might be applied to evaluate PREPs and new products. Methods Internal industry research reviewed included published papers, manuscript drafts, presentations, protocols, and instruments relating to consumer response measures were identified and analyzed. Peer-reviewed research was identified using PubMed and Scopus. Results Industry research on consumer response focuses on product development and marketing. To develop and refine new products, the tobacco industry has developed notable strategies for assessing consumers' sensory and subjective responses to product design characteristics. Independent research is often conducted to gauge the likelihood of future product adoption by measuring consumers' risk perceptions, responses to product, and product acceptability. Conclusions A model which conceptualizes consumer response as comprising the separate, but interacting domains of product perceptions and response to product is outlined. Industry and independent research supports the dual domain model, and provides a wide range of methods for assessment of the construct components of consumer response. Further research is needed to validate consumer response constructs, determine the relationship between consumer response and tobacco user behavior, and improve reliability of consumer response measures. Scientifically rigorous consumer response assessment methods will provide a needed empirical basis for future regulation of PREPs and new products, to counteract tobacco industry influence on consumers, and enhance the public health. PMID:19959675

On decentralized design: Rationale, dynamics, and effects on decision-making

NASA Astrophysics Data System (ADS)

Chanron, Vincent

The focus of this dissertation is the design of complex systems, including engineering systems such as cars, airplanes, and satellites. Companies who design these systems are under constant pressure to design better products that meet customer expectations, and competition forces them to develop them faster. One of the responses of the industry to these conflicting challenges has been the decentralization of the design responsibilities. The current lack of understanding of the dynamics of decentralized design processes is the main motivation for this research, and places value on the descriptive base. It identifies the main reasons and the true benefits for companies to decentralize the design of their products. It also demonstrates the limitations of this approach by listing the relevant issues and problems created by the decentralization of decisions. Based on these observations, a game-theoretic approach to decentralized design is proposed to model the decisions made during the design process. The dynamics are modeled using mathematical formulations inspired from control theory. Building upon this formalism, the issue of convergence in decentralized design is analyzed: the equilibrium points of the design space are identified and convergent and divergent patterns are recognized. This rigorous investigation of the design process provides motivation and support for proposing new approaches to decentralized design problems. Two methods are developed, which aim at improving the design process in two ways: decreasing the product development time, and increasing the optimality of the final design. The frame of these methods are inspired by eigenstructure decomposition and set-based design, respectively. The value of the research detailed within this dissertation is in the proposed methods which are built upon the sound mathematical formalism developed. The contribution of this work is two fold: rigorous investigation of the design process, and practical support to decision-making in decentralized environments.

Parent Management Training-Oregon Model: Adapting Intervention with Rigorous Research.

PubMed

Forgatch, Marion S; Kjøbli, John

2016-09-01

Parent Management Training-Oregon Model (PMTO(®) ) is a set of theory-based parenting programs with status as evidence-based treatments. PMTO has been rigorously tested in efficacy and effectiveness trials in different contexts, cultures, and formats. Parents, the presumed agents of change, learn core parenting practices, specifically skill encouragement, limit setting, monitoring/supervision, interpersonal problem solving, and positive involvement. The intervention effectively prevents and ameliorates children's behavior problems by replacing coercive interactions with positive parenting practices. Delivery format includes sessions with individual families in agencies or families' homes, parent groups, and web-based and telehealth communication. Mediational models have tested parenting practices as mechanisms of change for children's behavior and found support for the theory underlying PMTO programs. Moderating effects include children's age, maternal depression, and social disadvantage. The Norwegian PMTO implementation is presented as an example of how PMTO has been tailored to reach diverse populations as delivered by multiple systems of care throughout the nation. An implementation and research center in Oslo provides infrastructure and promotes collaboration between practitioners and researchers to conduct rigorous intervention research. Although evidence-based and tested within a wide array of contexts and populations, PMTO must continue to adapt to an ever-changing world. © 2016 Family Process Institute.

Clinical relevance in anesthesia journals.

PubMed

Lauritsen, Jakob; Møller, Ann M

2006-04-01

The purpose of this review is to present the latest knowledge and research on the definition and distribution of clinically relevant articles in anesthesia journals. It will also discuss the importance of the chosen methodology and outcome of articles. In the last few years, more attention has been paid to evidence-based medicine in anesthesia. Several articles on the subject have focused on the need to base clinical decisions on sound research employing both methodological rigor and clinically relevant outcomes. The number of systematic reviews in anesthesia literature is increasing as well as the focus on diminishing the number of surrogate outcomes. It has been shown that the impact factor is not a valid measure of establishing the level of clinical relevance to a journal. This review presents definitions of clinically relevant anesthesia articles. A clinically relevant article employs both methodological rigor and a clinically relevant outcome. The terms methodological rigor and clinical outcomes are fully discussed in the review as well as problems with journal impact factors.

Direct-to-consumer advertising: developing evidence-based policy to improve retention and comprehension.

PubMed

Riggs, David L; Holdsworth, Stacy M; McAvoy, David R

2004-01-01

Pharmaceutical advertising was historically directed toward health care professionals and mainly communicated through medical journals. The arrival of direct-to-consumer advertising has sparked both praise and criticism. Although current Food and Drug Administration requirements for drug promotion were written from a health care professional perspective, the same regulations have been applied to advertising directed at consumers. This has led to questions regarding the appropriate method for communicating detailed medical information. Rigorous research is needed to evaluate and determine the most effective format for communicating benefit and risk information to consumers. New standards for drug advertising to consumers should be grounded in data derived from this type of research.

School Climate Research

ERIC Educational Resources Information Center

Thapa, Amrit

2013-01-01

School climate research is clearly evolving. The field demands rigorous and empirically sound research that focuses on relating specific aspects and activities of interventions to changes in specific components of school climate. We also need empirical evidence based on sound research techniques on how both interventions and climate affect…

Rigour in qualitative case-study research.

PubMed

Houghton, Catherine; Casey, Dympna; Shaw, David; Murphy, Kathy

2013-03-01

To provide examples of a qualitative multiple case study to illustrate the specific strategies that can be used to ensure the credibility, dependability, confirmability and transferability of a study. There is increasing recognition of the valuable contribution qualitative research can make to nursing knowledge. However, it is important that the research is conducted in a rigorous manner and that this is demonstrated in the final research report. A multiple case study that explored the role of the clinical skills laboratory in preparing students for the real world of practice. Multiple sources of evidence were collected: semi-structured interviews (n=58), non-participant observations at five sites and documentary sources. Strategies to ensure the rigour of this research were prolonged engagement and persistent observation, triangulation, peer debriefing, member checking, audit trail, reflexivity, and thick descriptions. Practical examples of how these strategies can be implemented are provided to guide researchers interested in conducting rigorous case study research. While the flexible nature of qualitative research should be embraced, strategies to ensure rigour must be in place.

Behavioral and Social Sciences at the National Institutes of Health: adoption of research findings in health research and practice as a scientific priority.

PubMed

Riley, William T

2017-06-01

The National Institutes of Health's Office of Behavioral and Social Sciences Research (OBSSR) recently released its Strategic Plan for 2017 to 2021. This plan highlights three scientific priorities: (1) improve the synergy of basic and applied behavioral and social sciences research, (2) enhance and promote the research infrastructure, methods, and measures needed to support a more cumulative and integrated approach to behavioral and social sciences research, and (3) facilitate the adoption of behavioral and social sciences research findings in health research and in practice. This commentary focuses on the challenges and opportunities to facilitate the adoption of research findings in health research and in practice. In addition to the ongoing NIH support for dissemination and implementation (D&I) research, we must address transformative challenges and opportunities such as better disseminating and implementing D&I research, merging research and practice, adopting more rigorous and diverse methods and measures for both D&I and clinical trials research, evaluating technological-based delivery of interventions, and transitioning from minimally adaptable intervention packages to planned adaptations rooted in behavior change principles. Beyond translation into practice and policy, the OBSSR Strategic Plan also highlights the need for translation of behavioral and social science findings into the broader biomedical research enterprise.

Cancer Imaging Phenomics Software Suite: Application to Brain and Breast Cancer | Informatics Technology for Cancer Research (ITCR)

Cancer.gov

The transition of oncologic imaging from its “industrial era” to it is “information era” demands analytical methods that 1) extract information from this data that is clinically and biologically relevant; 2) integrate imaging, clinical, and genomic data via rigorous statistical and computational methodologies in order to derive models valuable for understanding cancer mechanisms, diagnosis, prognostic assessment, response evaluation, and personalized treatment management; 3) are available to the biomedical community for easy use and application, with the aim of understanding, diagnosing, an

Emerging Action Research Traditions: Rigor in Practice

ERIC Educational Resources Information Center

Watkins, Karen E.; Nicolaides, Aliki; Marsick, Victoria J.

2016-01-01

The authors argue here that contemporary use of action research shares the exploratory, inductive nature of many qualitative research approaches--no matter the type of data collected--because the type of research problems studied are set in complex, dynamic, rapidly changing contexts and because action research is undertaken to support social and…

Stakeholder-focused evaluation of an online course for health care providers.

PubMed

Dunet, Diane O; Reyes, Michele

2006-01-01

Different people who have a stake or interest in a training course (stakeholders) may have markedly different definitions of what constitutes "training success" and how they will use evaluation results. Stakeholders at multiple levels within and outside of the organization guided the development of an evaluation plan for a Web-based training course on hemochromatosis. Stakeholder interests and values were reflected in the type, level, and rigor of evaluation methods selected. Our mixed-method evaluation design emphasized small sample sizes and repeated measures. Limited resources for evaluation were leveraged by focusing on the data needs of key stakeholders, understanding how they wanted to use evaluation results, and collecting data needed for stakeholder decision making. Regular feedback to key stakeholders provided opportunities for updating the course evaluation plan to meet emerging needs for new or different information. Early and repeated involvement of stakeholders in the evaluation process also helped build support for the final product. Involving patient advocacy groups, managers, and representative course participants improved the course and enhanced product dissemination. For training courses, evaluation planning is an opportunity to tailor methods and data collection to meet the information needs of particular stakeholders. Rigorous evaluation research of every training course may be infeasible or unwarranted; however, course evaluations can be improved by good planning. A stakeholder-focused approach can build a picture of the results and impact of training while fostering the practical use of evaluation data.

A Qualitative Assessment of the Content Validity of the ICECAP-A and EQ-5D-5L and Their Appropriateness for Use in Health Research

PubMed Central

Keeley, Thomas; Al-Janabi, Hareth; Lorgelly, Paula; Coast, Joanna

2013-01-01

Purpose The ICECAP-A and EQ-5D-5L are two index measures appropriate for use in health research. Assessment of content validity allows understanding of whether a measure captures the most relevant and important aspects of a concept. This paper reports a qualitative assessment of the content validity and appropriateness for use of the eq-5D-5L and ICECAP-A measures, using novel methodology. Methods In-depth semi-structured interviews were conducted with research professionals in the UK and Australia. Informants were purposively sampled based on their professional role. Data were analysed in an iterative, thematic and constant comparative manner. A two stage investigation - the comparative direct approach - was developed to address the methodological challenges of the content validity research and allow rigorous assessment. Results Informants viewed the ICECAP-A as an assessment of the broader determinants of quality of life, but lacking in assessment of health-related determinants. The eq-5D-5L was viewed as offering good coverage of health determinants, but as lacking in assessment of these broader determinants. Informants held some concerns about the content or wording of the Self-care, Pain/Discomfort and Anxiety/Depression items (EQ-5D-5L) and the Enjoyment, Achievement and attachment items (ICECAP-A). Conclusion Using rigorous qualitative methodology the results suggest that the ICECAP-A and EQ-5D-5L hold acceptable levels of content validity and are appropriate for use in health research. This work adds expert opinion to the emerging body of research using patients and public to validate these measures. PMID:24367708

Hypothesis testing in hydrology: Theory and practice

NASA Astrophysics Data System (ADS)

Kirchner, James; Pfister, Laurent

2017-04-01

Well-posed hypothesis tests have spurred major advances in hydrological theory. However, a random sample of recent research papers suggests that in hydrology, as in other fields, hypothesis formulation and testing rarely correspond to the idealized model of the scientific method. Practices such as "p-hacking" or "HARKing" (Hypothesizing After the Results are Known) are major obstacles to more rigorous hypothesis testing in hydrology, along with the well-known problem of confirmation bias - the tendency to value and trust confirmations more than refutations - among both researchers and reviewers. Hypothesis testing is not the only recipe for scientific progress, however: exploratory research, driven by innovations in measurement and observation, has also underlain many key advances. Further improvements in observation and measurement will be vital to both exploratory research and hypothesis testing, and thus to advancing the science of hydrology.

Student’s rigorous mathematical thinking based on cognitive style

NASA Astrophysics Data System (ADS)

Fitriyani, H.; Khasanah, U.

2017-12-01

The purpose of this research was to determine the rigorous mathematical thinking (RMT) of mathematics education students in solving math problems in terms of reflective and impulsive cognitive styles. The research used descriptive qualitative approach. Subjects in this research were 4 students of the reflective and impulsive cognitive style which was each consisting male and female subjects. Data collection techniques used problem-solving test and interview. Analysis of research data used Miles and Huberman model that was reduction of data, presentation of data, and conclusion. The results showed that impulsive male subjects used three levels of the cognitive function required for RMT that were qualitative thinking, quantitative thinking with precision, and relational thinking completely while the other three subjects were only able to use cognitive function at qualitative thinking level of RMT. Therefore the subject of impulsive male has a better RMT ability than the other three research subjects.

Perspective: Quantum mechanical methods in biochemistry and biophysics.

PubMed

Cui, Qiang

2016-10-14

In this perspective article, I discuss several research topics relevant to quantum mechanical (QM) methods in biophysical and biochemical applications. Due to the immense complexity of biological problems, the key is to develop methods that are able to strike the proper balance of computational efficiency and accuracy for the problem of interest. Therefore, in addition to the development of novel ab initio and density functional theory based QM methods for the study of reactive events that involve complex motifs such as transition metal clusters in metalloenzymes, it is equally important to develop inexpensive QM methods and advanced classical or quantal force fields to describe different physicochemical properties of biomolecules and their behaviors in complex environments. Maintaining a solid connection of these more approximate methods with rigorous QM methods is essential to their transferability and robustness. Comparison to diverse experimental observables helps validate computational models and mechanistic hypotheses as well as driving further development of computational methodologies.

Quantifying construction and demolition waste: an analytical review.

PubMed

Wu, Zezhou; Yu, Ann T W; Shen, Liyin; Liu, Guiwen

2014-09-01

Quantifying construction and demolition (C&D) waste generation is regarded as a prerequisite for the implementation of successful waste management. In literature, various methods have been employed to quantify the C&D waste generation at both regional and project levels. However, an integrated review that systemically describes and analyses all the existing methods has yet to be conducted. To bridge this research gap, an analytical review is conducted. Fifty-seven papers are retrieved based on a set of rigorous procedures. The characteristics of the selected papers are classified according to the following criteria - waste generation activity, estimation level and quantification methodology. Six categories of existing C&D waste quantification methodologies are identified, including site visit method, waste generation rate method, lifetime analysis method, classification system accumulation method, variables modelling method and other particular methods. A critical comparison of the identified methods is given according to their characteristics and implementation constraints. Moreover, a decision tree is proposed for aiding the selection of the most appropriate quantification method in different scenarios. Based on the analytical review, limitations of previous studies and recommendations of potential future research directions are further suggested. Copyright © 2014 Elsevier Ltd. All rights reserved.

Statistical comparison of a hybrid approach with approximate and exact inference models for Fusion 2+

NASA Astrophysics Data System (ADS)

Lee, K. David; Wiesenfeld, Eric; Gelfand, Andrew

2007-04-01

One of the greatest challenges in modern combat is maintaining a high level of timely Situational Awareness (SA). In many situations, computational complexity and accuracy considerations make the development and deployment of real-time, high-level inference tools very difficult. An innovative hybrid framework that combines Bayesian inference, in the form of Bayesian Networks, and Possibility Theory, in the form of Fuzzy Logic systems, has recently been introduced to provide a rigorous framework for high-level inference. In previous research, the theoretical basis and benefits of the hybrid approach have been developed. However, lacking is a concrete experimental comparison of the hybrid framework with traditional fusion methods, to demonstrate and quantify this benefit. The goal of this research, therefore, is to provide a statistical analysis on the comparison of the accuracy and performance of hybrid network theory, with pure Bayesian and Fuzzy systems and an inexact Bayesian system approximated using Particle Filtering. To accomplish this task, domain specific models will be developed under these different theoretical approaches and then evaluated, via Monte Carlo Simulation, in comparison to situational ground truth to measure accuracy and fidelity. Following this, a rigorous statistical analysis of the performance results will be performed, to quantify the benefit of hybrid inference to other fusion tools.

Computer vision-based evaluation of pre- and postrigor changes in size and shape of Atlantic cod (Gadus morhua) and Atlantic salmon (Salmo salar) fillets during rigor mortis and ice storage: effects of perimortem handling stress.

PubMed

Misimi, E; Erikson, U; Digre, H; Skavhaug, A; Mathiassen, J R

2008-03-01

The present study describes the possibilities for using computer vision-based methods for the detection and monitoring of transient 2D and 3D changes in the geometry of a given product. The rigor contractions of unstressed and stressed fillets of Atlantic salmon (Salmo salar) and Atlantic cod (Gadus morhua) were used as a model system. Gradual changes in fillet shape and size (area, length, width, and roundness) were recorded for 7 and 3 d, respectively. Also, changes in fillet area and height (cross-section profiles) were tracked using a laser beam and a 3D digital camera. Another goal was to compare rigor developments of the 2 species of farmed fish, and whether perimortem stress affected the appearance of the fillets. Some significant changes in fillet size and shape were found (length, width, area, roundness, height) between unstressed and stressed fish during the course of rigor mortis as well as after ice storage (postrigor). However, the observed irreversible stress-related changes were small and would hardly mean anything for postrigor fish processors or consumers. The cod were less stressed (as defined by muscle biochemistry) than the salmon after the 2 species had been subjected to similar stress bouts. Consequently, the difference between the rigor courses of unstressed and stressed fish was more extreme in the case of salmon. However, the maximal whole fish rigor strength was judged to be about the same for both species. Moreover, the reductions in fillet area and length, as well as the increases in width, were basically of similar magnitude for both species. In fact, the increases in fillet roundness and cross-section height were larger for the cod. We conclude that the computer vision method can be used effectively for automated monitoring of changes in 2D and 3D shape and size of fish fillets during rigor mortis and ice storage. In addition, it can be used for grading of fillets according to uniformity in size and shape, as well as measurement of fillet yield measured in thickness. The methods are accurate, rapid, nondestructive, and contact-free and can therefore be regarded as suitable for industrial purposes.

Social validity in single-case research: A systematic literature review of prevalence and application.

PubMed

Snodgrass, Melinda R; Chung, Moon Y; Meadan, Hedda; Halle, James W

2018-03-01

Single-case research (SCR) has been a valuable methodology in special education research. Montrose Wolf (1978), an early pioneer in single-case methodology, coined the term "social validity" to refer to the social importance of the goals selected, the acceptability of procedures employed, and the effectiveness of the outcomes produced in applied investigations. Since 1978, many contributors to SCR have included social validity as a feature of their articles and several authors have examined the prevalence and role of social validity in SCR. We systematically reviewed all SCR published in six highly-ranked special education journals from 2005 to 2016 to establish the prevalence of social validity assessments and to evaluate their scientific rigor. We found relatively low, but stable prevalence with only 28 publications addressing all three factors of the social validity construct (i.e., goals, procedures, outcomes). We conducted an in-depth analysis of the scientific rigor of these 28 publications. Social validity remains an understudied construct in SCR, and the scientific rigor of social validity assessments is often lacking. Implications and future directions are discussed. Copyright © 2018 Elsevier Ltd. All rights reserved.

Assessing the Rigor of HS Curriculum in Admissions Decisions: A Functional Method, Plus Practical Advising for Prospective Students and High School Counselors

ERIC Educational Resources Information Center

Micceri, Theodore; Brigman, Leellen; Spatig, Robert

2009-01-01

An extensive, internally cross-validated analytical study using nested (within academic disciplines) Multilevel Modeling (MLM) on 4,560 students identified functional criteria for defining high school curriculum rigor and further determined which measures could best be used to help guide decision making for marginal applicants. The key outcome…

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Rigorous coupled wave analysis of acousto-optics with relativistic considerations.

PubMed

Xia, Guoqiang; Zheng, Weijian; Lei, Zhenggang; Zhang, Ruolan

2015-09-01

A relativistic analysis of acousto-optics is presented, and a rigorous coupled wave analysis is generalized for the diffraction of the acousto-optical effect. An acoustic wave generates a grating with temporally and spatially modulated permittivity, hindering direct applications of the rigorous coupled wave analysis for the acousto-optical effect. In a reference frame which moves with the acoustic wave, the grating is static, the medium moves, and the coupled wave equations for the static grating may be derived. Floquet's theorem is then applied to cast these equations into an eigenproblem. Using a Lorentz transformation, the electromagnetic fields in the grating region are transformed to the lab frame where the medium is at rest, and relativistic Doppler frequency shifts are introduced into various diffraction orders. In the lab frame, the boundary conditions are considered and the diffraction efficiencies of various orders are determined. This method is rigorous and general, and the plane waves in the resulting expansion satisfy the dispersion relation of the medium and are propagation modes. Properties of various Bragg diffractions are results, rather than preconditions, of this method. Simulations of an acousto-optical tunable filter made by paratellurite, TeO(2), are given as examples.

Assessing consumer responses to potential reduced-exposure tobacco products: a review of tobacco industry and independent research methods.

PubMed

Rees, Vaughan W; Kreslake, Jennifer M; Cummings, K Michael; O'Connor, Richard J; Hatsukami, Dorothy K; Parascandola, Mark; Shields, Peter G; Connolly, Gregory N

2009-12-01

Internal tobacco industry documents and the mainstream literature are reviewed to identify methods and measures for evaluating tobacco consumer response. The review aims to outline areas in which established methods exist, identify gaps in current methods for assessing consumer response, and consider how these methods might be applied to evaluate potentially reduced exposure tobacco products and new products. Internal industry research reviewed included published articles, manuscript drafts, presentations, protocols, and instruments relating to consumer response measures were identified and analyzed. Peer-reviewed research was identified using PubMed and Scopus. Industry research on consumer response focuses on product development and marketing. To develop and refine new products, the tobacco industry has developed notable strategies for assessing consumers' sensory and subjective responses to product design characteristics. Independent research is often conducted to gauge the likelihood of future product adoption by measuring consumers' risk perceptions, responses to product, and product acceptability. A model that conceptualizes consumer response as comprising the separate, but interacting, domains of product perceptions and response to product is outlined. Industry and independent research supports the dual domain model and provides a wide range of methods for assessment of the construct components of consumer response. Further research is needed to validate consumer response constructs, determine the relationship between consumer response and tobacco user behavior, and improve reliability of consumer response measures. Scientifically rigorous consumer response assessment methods will provide a needed empirical basis for future regulation of potentially reduced-exposure tobacco products and new products, to counteract tobacco industry influence on consumers, and enhance the public health.

Partnerships for the Design, Conduct, and Analysis of Effectiveness, and Implementation Research: Experiences of the Prevention Science and Methodology Group

PubMed Central

Brown, C. Hendricks; Kellam, Sheppard G.; Kaupert, Sheila; Muthén, Bengt O.; Wang, Wei; Muthén, Linda K.; Chamberlain, Patricia; PoVey, Craig L.; Cady, Rick; Valente, Thomas W.; Ogihara, Mitsunori; Prado, Guillermo J.; Pantin, Hilda M.; Gallo, Carlos G.; Szapocznik, José; Czaja, Sara J.; McManus, John W.

2012-01-01

What progress prevention research has made comes through strategic partnerships with communities and institutions that host this research, as well as professional and practice networks that facilitate the diffusion of knowledge about prevention. We discuss partnership issues related to the design, analysis, and implementation of prevention research and especially how rigorous designs, including random assignment, get resolved through a partnership between community stakeholders, institutions, and researchers. These partnerships shape not only study design, but they determine the data that can be collected and how results and new methods are disseminated. We also examine a second type of partnership to improve the implementation of effective prevention programs into practice. We draw on social networks to studying partnership formation and function. The experience of the Prevention Science and Methodology Group, which itself is a networked partnership between scientists and methodologists, is highlighted. PMID:22160786

The case for integrating grounded theory and participatory action research: empowering clients to inform professional practice.

PubMed

Teram, Eli; Schachter, Candice L; Stalker, Carol A

2005-10-01

Grounded theory and participatory action research methods are distinct approaches to qualitative inquiry. Although grounded theory has been conceptualized in constructivist terms, it has elements of positivist thinking with an image of neutral search for objective truth through rigorous data collection and analysis. Participatory action research is based on a critique of this image and calls for more inclusive research processes. It questions the possibility of objective social sciences and aspires to engage people actively in all stages of generating knowledge. The authors applied both approaches in a project designed to explore the experiences of female survivors of childhood sexual abuse with physical therapy and subsequently develop a handbook on sensitive practice for clinicians that takes into consideration the needs and perspectives of these clients. Building on this experience, they argue that the integration of grounded theory and participatory action research can empower clients to inform professional practice.

Partnerships for the design, conduct, and analysis of effectiveness, and implementation research: experiences of the prevention science and methodology group.

PubMed

Brown, C Hendricks; Kellam, Sheppard G; Kaupert, Sheila; Muthén, Bengt O; Wang, Wei; Muthén, Linda K; Chamberlain, Patricia; PoVey, Craig L; Cady, Rick; Valente, Thomas W; Ogihara, Mitsunori; Prado, Guillermo J; Pantin, Hilda M; Gallo, Carlos G; Szapocznik, José; Czaja, Sara J; McManus, John W

2012-07-01

What progress prevention research has made comes through strategic partnerships with communities and institutions that host this research, as well as professional and practice networks that facilitate the diffusion of knowledge about prevention. We discuss partnership issues related to the design, analysis, and implementation of prevention research and especially how rigorous designs, including random assignment, get resolved through a partnership between community stakeholders, institutions, and researchers. These partnerships shape not only study design, but they determine the data that can be collected and how results and new methods are disseminated. We also examine a second type of partnership to improve the implementation of effective prevention programs into practice. We draw on social networks to studying partnership formation and function. The experience of the Prevention Science and Methodology Group, which itself is a networked partnership between scientists and methodologists, is highlighted.

Using research literature to develop a perceptual retraining treatment protocol.

PubMed

Neistadt, M E

1994-01-01

Treatment protocols derived from research literature can help therapists provide more rigorous treatment and more systematic assessment of client progress. This study applied research findings about the influence of task, subject, and feedback parameters on adult performance with block designs to an occupational therapy treatment protocol for parquetry block assembly--an activity occupational therapists use to remediate constructional deficits. Task parameter research suggests that parquetry tasks can be graded according to the features of the design cards, with cards having all block boundaries drawn in being easier than those with some block boundaries omitted. Subject parameter findings suggest that clients' lesions and initial constructional competence can influence their approaches to parquetry tasks. Feedback parameter research suggests that a combination of perceptual and planning cues is most effective for parquetry tasks. Methods to help clients transfer constructional skills from parquetry to functional tasks are also discussed.

[Preliminarily application of content analysis to qualitative nursing data].

PubMed

Liang, Shu-Yuan; Chuang, Yeu-Hui; Wu, Shu-Fang

2012-10-01

Content analysis is a methodology for objectively and systematically studying the content of communication in various formats. Content analysis in nursing research and nursing education is called qualitative content analysis. Qualitative content analysis is frequently applied to nursing research, as it allows researchers to determine categories inductively and deductively. This article examines qualitative content analysis in nursing research from theoretical and practical perspectives. We first describe how content analysis concepts such as unit of analysis, meaning unit, code, category, and theme are used. Next, we describe the basic steps involved in using content analysis, including data preparation, data familiarization, analysis unit identification, creating tentative coding categories, category refinement, and establishing category integrity. Finally, this paper introduces the concept of content analysis rigor, including dependability, confirmability, credibility, and transferability. This article elucidates the content analysis method in order to help professionals conduct systematic research that generates data that are informative and useful in practical application.

Clinical and Translational Scientist Career Success: Metrics for Evaluation

PubMed Central

Lee, Linda S.; Pusek, Susan N.; McCormack, Wayne T.; Helitzer, Deborah L.; Martina, Camille A.; Dozier, Ann M.; Ahluwalia, Jasjit S.; Schwartz, Lisa S.; McManus, Linda M.; Reynolds, Brian D.; Haynes, Erin N.; Rubio, Doris M.

2012-01-01

Abstract Despite the increased emphasis on formal training in clinical and translational research and the growth in the number and scope of training programs over the past decade, the impact of training on research productivity and career success has yet to be fully evaluated at the institutional level. In this article, the Education Evaluation Working Group of the Clinical and Translational Science Award Consortium introduces selected metrics and methods associated with the assessment of key factors that affect research career success. The goals in providing this information are to encourage more consistent data collection across training sites, to foster more rigorous and systematic exploration of factors associated with career success, and to help address previously identified difficulties in program evaluation. Clin Trans Sci 2012; Volume 5: 400–407 PMID:23067352

Estimation of the time since death--reconsidering the re-establishment of rigor mortis.

PubMed

Anders, Sven; Kunz, Michaela; Gehl, Axel; Sehner, Susanne; Raupach, Tobias; Beck-Bornholdt, Hans-Peter

2013-01-01

In forensic medicine, there is an undefined data background for the phenomenon of re-establishment of rigor mortis after mechanical loosening, a method used in establishing time since death in forensic casework that is thought to occur up to 8 h post-mortem. Nevertheless, the method is widely described in textbooks on forensic medicine. We examined 314 joints (elbow and knee) of 79 deceased at defined time points up to 21 h post-mortem (hpm). Data were analysed using a random intercept model. Here, we show that re-establishment occurred in 38.5% of joints at 7.5 to 19 hpm. Therefore, the maximum time span for the re-establishment of rigor mortis appears to be 2.5-fold longer than thought so far. These findings have major impact on the estimation of time since death in forensic casework.

Contributing Meaning to Research in Developmental Disabilities: Integrating Participatory Action and Methodological Rigor

ERIC Educational Resources Information Center

Powers, Laurie E.

2017-01-01

Action research approaches reflecting power sharing by academic and community researchers, full engagement of community partners across all study phases, and ongoing commitment to partnership and capacity building have been increasingly embraced, particularly in research affecting marginalized populations. Findings suggest action research…

Optimal correction and design parameter search by modern methods of rigorous global optimization

NASA Astrophysics Data System (ADS)

Makino, K.; Berz, M.

2011-07-01

Frequently the design of schemes for correction of aberrations or the determination of possible operating ranges for beamlines and cells in synchrotrons exhibit multitudes of possibilities for their correction, usually appearing in disconnected regions of parameter space which cannot be directly qualified by analytical means. In such cases, frequently an abundance of optimization runs are carried out, each of which determines a local minimum depending on the specific chosen initial conditions. Practical solutions are then obtained through an often extended interplay of experienced manual adjustment of certain suitable parameters and local searches by varying other parameters. However, in a formal sense this problem can be viewed as a global optimization problem, i.e. the determination of all solutions within a certain range of parameters that lead to a specific optimum. For example, it may be of interest to find all possible settings of multiple quadrupoles that can achieve imaging; or to find ahead of time all possible settings that achieve a particular tune; or to find all possible manners to adjust nonlinear parameters to achieve correction of high order aberrations. These tasks can easily be phrased in terms of such an optimization problem; but while mathematically this formulation is often straightforward, it has been common belief that it is of limited practical value since the resulting optimization problem cannot usually be solved. However, recent significant advances in modern methods of rigorous global optimization make these methods feasible for optics design for the first time. The key ideas of the method lie in an interplay of rigorous local underestimators of the objective functions, and by using the underestimators to rigorously iteratively eliminate regions that lie above already known upper bounds of the minima, in what is commonly known as a branch-and-bound approach. Recent enhancements of the Differential Algebraic methods used in particle optics for the computation of aberrations allow the determination of particularly sharp underestimators for large regions. As a consequence, the subsequent progressive pruning of the allowed search space as part of the optimization progresses is carried out particularly effectively. The end result is the rigorous determination of the single or multiple optimal solutions of the parameter optimization, regardless of their location, their number, and the starting values of optimization. The methods are particularly powerful if executed in interplay with genetic optimizers generating their new populations within the currently active unpruned space. Their current best guess provides rigorous upper bounds of the minima, which can then beneficially be used for better pruning. Examples of the method and its performance will be presented, including the determination of all operating points of desired tunes or chromaticities, etc. in storage ring lattices.

Including mixed methods research in systematic reviews: Examples from qualitative syntheses in TB and malaria control

PubMed Central

2012-01-01

Background Health policy makers now have access to a greater number and variety of systematic reviews to inform different stages in the policy making process, including reviews of qualitative research. The inclusion of mixed methods studies in systematic reviews is increasing, but these studies pose particular challenges to methods of review. This article examines the quality of the reporting of mixed methods and qualitative-only studies. Methods We used two completed systematic reviews to generate a sample of qualitative studies and mixed method studies in order to make an assessment of how the quality of reporting and rigor of qualitative-only studies compares with that of mixed-methods studies. Results Overall, the reporting of qualitative studies in our sample was consistently better when compared with the reporting of mixed methods studies. We found that mixed methods studies are less likely to provide a description of the research conduct or qualitative data analysis procedures and less likely to be judged credible or provide rich data and thick description compared with standalone qualitative studies. Our time-related analysis shows that for both types of study, papers published since 2003 are more likely to report on the study context, describe analysis procedures, and be judged credible and provide rich data. However, the reporting of other aspects of research conduct (i.e. descriptions of the research question, the sampling strategy, and data collection methods) in mixed methods studies does not appear to have improved over time. Conclusions Mixed methods research makes an important contribution to health research in general, and could make a more substantial contribution to systematic reviews. Through our careful analysis of the quality of reporting of mixed methods and qualitative-only research, we have identified areas that deserve more attention in the conduct and reporting of mixed methods research. PMID:22545681

[Adequate application of quantitative and qualitative statistic analytic methods in acupuncture clinical trials].

PubMed

Tan, Ming T; Liu, Jian-ping; Lao, Lixing

2012-08-01

Recently, proper use of the statistical methods in traditional Chinese medicine (TCM) randomized controlled trials (RCTs) has received increased attention. Statistical inference based on hypothesis testing is the foundation of clinical trials and evidence-based medicine. In this article, the authors described the methodological differences between literature published in Chinese and Western journals in the design and analysis of acupuncture RCTs and the application of basic statistical principles. In China, qualitative analysis method has been widely used in acupuncture and TCM clinical trials, while the between-group quantitative analysis methods on clinical symptom scores are commonly used in the West. The evidence for and against these analytical differences were discussed based on the data of RCTs assessing acupuncture for pain relief. The authors concluded that although both methods have their unique advantages, quantitative analysis should be used as the primary analysis while qualitative analysis can be a secondary criterion for analysis. The purpose of this paper is to inspire further discussion of such special issues in clinical research design and thus contribute to the increased scientific rigor of TCM research.

Advances in Families and Health Research in the 21st Century

ERIC Educational Resources Information Center

Carr, Deborah; Springer, Kristen W.

2010-01-01

We review research on families and health published between 2000 and 2009 and highlight key themes and findings from innovative, methodologically rigorous studies. Whereas research in prior decades focused primarily on whether family structure affects child and adult health, contemporary research examines the contextual and processual factors that…

Approaches to Cross-Cultural Research in Art Education.

ERIC Educational Resources Information Center

Anderson, Frances E.

1979-01-01

The author defines the aims of cross-cultural research in art education and examines the problems inherent in such research, using as an illustration a summary chart of Child's cross-cultural studies of esthetic sensitivity. Emphasis is placed on the need for rigor in research design and execution. (SJL)

Exploring Graduate Students' Understanding of Research: Links between Identity and Research Conceptions

ERIC Educational Resources Information Center

Ross, Karen; Dennis, Barbara; Zhao, Pengfei; Li, Peiwei

2017-01-01

We are in an era that calls for increasing "training" in educational research methodologies. When the National Research Council (2004) calls for training in educational research that is "rigorous" and "relevant," the focus strongly emphasizes WHAT should be taught instead of WHO is being engaged in the learning.…

Lasting Lessons: Following up with Recipients of the Forum's Undergraduate Research Award

ERIC Educational Resources Information Center

Forum on Education Abroad, 2012

2012-01-01

The annual Forum on Education Abroad Undergraduate Research Award showcases rigorous and significant undergraduate research that occurs as part of education abroad programs. Every year, the award recipients present their research at a plenary luncheon at the Forum's Annual Conference. The Forum granted the first Undergraduate Research Awards in…

Metamethod study of qualitative psychotherapy research on clients' experiences: Review and recommendations.

PubMed

Levitt, Heidi M; Pomerville, Andrew; Surace, Francisco I; Grabowski, Lauren M

2017-11-01

A metamethod study is a qualitative meta-analysis focused upon the methods and procedures used in a given research domain. These studies are rare in psychological research. They permit both the documentation of the informal standards within a field of research and recommendations for future work in that area. This paper presents a metamethod analysis of a substantial body of qualitative research that focused on clients' experiences in psychotherapy (109 studies). This review examined the ways that methodological integrity has been established across qualitative research methods. It identified the numbers of participants recruited and the form of data collection used (e.g., semistructured interviews, diaries). As well, it examined the types of checks employed to increase methodological integrity, such as participant counts, saturation, reflexivity techniques, participant feedback, or consensus and auditing processes. Central findings indicated that the researchers quite flexibly integrated procedures associated with one method into studies using other methods in order to strengthen their rigor. It appeared normative to adjust procedures to advance methodological integrity. These findings encourage manuscript reviewers to assess the function of procedures within a study rather than to require researchers to adhere to the set of procedures associated with a method. In addition, when epistemological approaches were mentioned they were overwhelmingly constructivist in nature, despite the increasing use of procedures traditionally associated with objectivist perspectives. It is recommended that future researchers do more to explicitly describe the functions of their procedures so that they are coherently situated within the epistemological approaches in use. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Research into Theory into Practice: An Overview of Family Based Interventions for Child Antisocial Behavior Developed at the Oregon Social Learning Center

PubMed Central

Fisher, Philip A.; Gilliam, Kathryn S.

2017-01-01

Although many psychotherapeutic approaches exist for treating troubled children and their families, not all have been evaluated to be effective through research. Moreover, among those that have been determined to be “evidence-based,” few have followed as coherent and rigorous a path of rigorous scientific investigation as the interventions that have been developed at the Oregon Social Learning Center. As such, these interventions serve as a model of “research to theory to practice” that may not only be employed to support families with children in need of treatment, but may also guide other programs of treatment development. This is the story of how this work has unfolded over the past four decades. PMID:29225459

How to Map Theory: Reliable Methods Are Fruitless Without Rigorous Theory.

PubMed

Gray, Kurt

2017-09-01

Good science requires both reliable methods and rigorous theory. Theory allows us to build a unified structure of knowledge, to connect the dots of individual studies and reveal the bigger picture. Some have criticized the proliferation of pet "Theories," but generic "theory" is essential to healthy science, because questions of theory are ultimately those of validity. Although reliable methods and rigorous theory are synergistic, Action Identification suggests psychological tension between them: The more we focus on methodological details, the less we notice the broader connections. Therefore, psychology needs to supplement training in methods (how to design studies and analyze data) with training in theory (how to connect studies and synthesize ideas). This article provides a technique for visually outlining theory: theory mapping. Theory mapping contains five elements, which are illustrated with moral judgment and with cars. Also included are 15 additional theory maps provided by experts in emotion, culture, priming, power, stress, ideology, morality, marketing, decision-making, and more (see all at theorymaps.org ). Theory mapping provides both precision and synthesis, which helps to resolve arguments, prevent redundancies, assess the theoretical contribution of papers, and evaluate the likelihood of surprising effects.

Methodological Issues in Trials of Complementary and Alternative Medicine Interventions

PubMed Central

Sikorskii, Alla; Wyatt, Gwen; Victorson, David; Faulkner, Gwen; Rahbar, Mohammad Hossein

2010-01-01

Background Complementary and alternative medicine (CAM) use is widespread among cancer patients. Information on safety and efficacy of CAM therapies is needed for both patients and health care providers. Well-designed randomized clinical trials (RCTs) of CAM therapy interventions can inform both clinical research and practice. Objectives To review important issues that affect the design of RCTs for CAM interventions. Methods Using the methods component of the Consolidated Standards for Reporting Trials (CONSORT) as a guiding framework, and a National Cancer Institute-funded reflexology study as an exemplar, methodological issues related to participants, intervention, objectives, outcomes, sample size, randomization, blinding, and statistical methods were reviewed. Discussion Trials of CAM interventions designed and implemented according to appropriate methodological standards will facilitate the needed scientific rigor in CAM research. Interventions in CAM can be tested using proposed methodology, and the results of testing will inform nursing practice in providing safe and effective supportive care and improving the well-being of patients. PMID:19918155

Engaging students in the sciences--the community college experience

NASA Astrophysics Data System (ADS)

Bushaw-Newton, K. L.

2015-12-01

In today's pedagogy, "STEM" is the four letter word and "STEAM" is the next big thing. How do we as professors translate our passion for our discipline and our research into practical, yet rigorous and applied, learning experiences for students? Foundation courses (e.g., 100 level) often have a mixture of majors and non-majors for any given discipline, thus confounding student engagement. Experiential learning provides students with opportunities to apply theory with application. In any given course, a suite of methods may need to be employed to attain the highest level of engagement. Northern Virginia Community College is a two-year institution with a strong commitment to the sciences. In this presentation, a variety of methods for student engagement will be discussed including: in-class assignments, modules in the laboratory as well as modules involving the campus, independent research experiences, and activities linking students with professionals in the area. Within the context of these methods, there will also be discussions on expectations, limitations, and successes as well as failures.

A Creative Approach to the Research Paper: Combining Creative Writing with Academic Research

ERIC Educational Resources Information Center

Blue, Tim

2006-01-01

This article describes a combination of a research essay and a creative writing assignment that encourages rigorous academic research while allowing students to get "outside the box" of traditional academic research papers. This assignment has five steps. The first two steps offer the chance to introduce academic research along with summary and…

Using Abductive Research Logic: "The Logic of Discovery", to Construct a Rigorous Explanation of Amorphous Evaluation Findings

ERIC Educational Resources Information Center

Levin-Rozalis, Miri

2010-01-01

Background: Two kinds of research logic prevail in scientific research: deductive research logic and inductive research logic. However, both fail in the field of evaluation, especially evaluation conducted in unfamiliar environments. Purpose: In this article I wish to suggest the application of a research logic--"abduction"--"the logic of…

The Black Hole of Education Research.

ERIC Educational Resources Information Center

Miller, D. W.

1999-01-01

Critics feel education scholarship lacks rigor and a practical focus on achievement, wasting substantial resources. Research on effectiveness of educational reforms is often weak, inconclusive, or simply inadequate, and good scholarship may have little influence on classroom practice. Popular policies often persist despite strong research evidence…

An evidence-based patient-centered method makes the biopsychosocial model scientific.

PubMed

Smith, Robert C; Fortin, Auguste H; Dwamena, Francesca; Frankel, Richard M

2013-06-01

To review the scientific status of the biopsychosocial (BPS) model and to propose a way to improve it. Engel's BPS model added patients' psychological and social health concerns to the highly successful biomedical model. He proposed that the BPS model could make medicine more scientific, but its use in education, clinical care, and, especially, research remains minimal. Many aver correctly that the present model cannot be defined in a consistent way for the individual patient, making it untestable and non-scientific. This stems from not obtaining relevant BPS data systematically, where one interviewer obtains the same information another would. Recent research by two of the authors has produced similar patient-centered interviewing methods that are repeatable and elicit just the relevant patient information needed to define the model at each visit. We propose that the field adopt these evidence-based methods as the standard for identifying the BPS model. Identifying a scientific BPS model in each patient with an agreed-upon, evidence-based patient-centered interviewing method can produce a quantum leap ahead in both research and teaching. A scientific BPS model can give us more confidence in being humanistic. In research, we can conduct more rigorous studies to inform better practices. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

MATHEMATICAL METHODS IN MEDICAL IMAGE PROCESSING

PubMed Central

ANGENENT, SIGURD; PICHON, ERIC; TANNENBAUM, ALLEN

2013-01-01

In this paper, we describe some central mathematical problems in medical imaging. The subject has been undergoing rapid changes driven by better hardware and software. Much of the software is based on novel methods utilizing geometric partial differential equations in conjunction with standard signal/image processing techniques as well as computer graphics facilitating man/machine interactions. As part of this enterprise, researchers have been trying to base biomedical engineering principles on rigorous mathematical foundations for the development of software methods to be integrated into complete therapy delivery systems. These systems support the more effective delivery of many image-guided procedures such as radiation therapy, biopsy, and minimally invasive surgery. We will show how mathematics may impact some of the main problems in this area, including image enhancement, registration, and segmentation. PMID:23645963

Aberrant Motor Development in Three Disabilities: Directions for Research and Practice.

ERIC Educational Resources Information Center

Stack, Dale M.; Minnes, Patricia M.

1989-01-01

Reviews literature concerning Down Syndrome, visual impairment, and cerebral palsy in children. Emphasizes the continued need for advances in intervention strategies and technology and the more general need for methodological rigor in research. (RJC)

Implementing systematic review techniques in chemical risk assessment: challenges, opportunities and recommendations

PubMed Central

Whaley, Paul; Halsall, Crispin; Ågerstrand, Marlene; Benford, Diane; Aiassa, Elisa; Bilotta, Gary; Coggon, David; Dempsey, Ciara; Duarte-Davidson, Raquel; FitzGerald, Rex; Gee, David; Hoffmann, Sebastian; Lam, Juleen; Lassersson, Toby; Levy, Len; Lipworth, Steven; Ross, Sarah Mackenzie; Martin, Olwenn; Meads, Catherine; Meyer-Baron, Monika; Miller, James; Pease, Camilla; Rooney, Andrew; Sapiets, Alison; Stewart, Gavin; Taylor, David

2016-01-01

Systematic review (SR) is a rigorous, protocol-driven approach designed to minimise error and bias when summarising the body of research evidence relevant to a specific scientific question. Taking as a comparator the use of SR in synthesising research in healthcare, we argue that SR methods could also pave the way for a “step change” in the transparency, objectivity and communication of chemical risk assessments (CRA) in Europe and elsewhere. We suggest that current controversies around the safety of certain chemicals are partly due to limitations in current CRA procedures which have contributed to ambiguity about the health risks posed by these substances. We present an overview of how SR methods can be applied to the assessment of risks from chemicals, and indicate how challenges in adapting SR methods from healthcare research to the CRA context might be overcome. Regarding the latter, we report the outcomes from a workshop exploring how to increase uptake of SR methods, attended by experts representing a wide range of fields related to chemical toxicology, risk analysis and SR. Priorities which were identified include: the conduct of CRA-focused prototype SRs; the development of a recognised standard of reporting and conduct for SRs in toxicology and CRA; and establishing a network to facilitate research, communication and training in SR methods. We see this paper as a milestone in the creation of a research climate that fosters communication between experts in CRA and SR and facilitates wider uptake of SR methods into CRA. PMID:26687863

Integrating qualitative research into evidence based practice.

PubMed

Greenhalgh, Trisha

2002-09-01

This article attempts to provide an overview of qualitative tools and methods using mainly examples from diabetes research. The other articles in this issue of the Endocrinology and Metabolism Clinics of North America have demonstrated the enormous contribution made in the past 15 years or so by rigorous quantitative studies of prevalence, diagnosis, prognosis, and therapy to clinical decision-making in endocrinology. In the early 21st century, the state of qualitative research into such topics as the illness experience of diabetes; the barriers to effective self care and positive health choices; the design of complex educational interventions; the design of appropriate, acceptable and responsive health services; and the decision-making behavior of health professionals, is such that there remain many more questions than answers. But qualitative research is increasingly recognized as an important, legitimate and expanding dimension of evidence-based health care (18;19). It is highly likely that the major landmark studies in diabetes care over the next decade will build on an exploratory qualitative study or incorporate an explanatory or evaluative dimension based on qualitative methods.

Light scattering and absorption by space weathered planetary bodies: Novel numerical solution

NASA Astrophysics Data System (ADS)

Markkanen, Johannes; Väisänen, Timo; Penttilä, Antti; Muinonen, Karri

2017-10-01

Airless planetary bodies are exposed to space weathering, i.e., energetic electromagnetic and particle radiation, implantation and sputtering from solar wind particles, and micrometeorite bombardment.Space weathering is known to alter the physical and chemical composition of the surface of an airless body (C. Pieters et al., J. Geophys. Res. Planets, 121, 2016). From the light scattering perspective, one of the key effects is the production of nanophase iron (npFe0) near the exposed surfaces (B. Hapke, J. Geophys. Res., 106, E5, 2001). At visible and ultraviolet wavelengths these particles have a strong electromagnetic response which has a major impact on scattering and absorption features. Thus, to interpret the spectroscopic observations of space-weathered asteroids, the model should treat the contributions of the npFe0 particles rigorously.Our numerical approach is based on the hierarchical geometric optics (GO) and radiative transfer (RT). The modelled asteroid is assumed to consist of densely packed silicate grains with npFe0 inclusions. We employ our recently developed RT method for dense random media (K. Muinonen, et al., Radio Science, submitted, 2017) to compute the contributions of the npFe0 particles embedded in silicate grains. The dense media RT method requires computing interactions of the npFe0 particles in the volume element for which we use the exact fast superposition T-matrix method (J. Markkanen, and A.J. Yuffa, JQSRT 189, 2017). Reflections and refractions on the grain surface and propagation in the grain are addressed by the GO. Finally, the standard RT is applied to compute scattering by the entire asteroid.Our numerical method allows for a quantitative interpretation of the spectroscopic observations of space-weathered asteroids. In addition, it may be an important step towards more rigorous a thermophysical model of asteroids when coupled with the radiative and conductive heat transfer techniques.Acknowledgments. Research supported by European Research Council with Advanced Grant No. 320773 SAEMPL. Computational resources provided by CSC- IT Centre for Science Ltd, Finland.

The Importance of Method Selection in Determining Product Integrity for Nutrition Research1234

PubMed Central

Mudge, Elizabeth M; Brown, Paula N

2016-01-01

The American Herbal Products Association estimates that there as many as 3000 plant species in commerce. The FDA estimates that there are about 85,000 dietary supplement products in the marketplace. The pace of product innovation far exceeds that of analytical methods development and validation, with new ingredients, matrixes, and combinations resulting in an analytical community that has been unable to keep up. This has led to a lack of validated analytical methods for dietary supplements and to inappropriate method selection where methods do exist. Only after rigorous validation procedures to ensure that methods are fit for purpose should they be used in a routine setting to verify product authenticity and quality. By following systematic procedures and establishing performance requirements for analytical methods before method development and validation, methods can be developed that are both valid and fit for purpose. This review summarizes advances in method selection, development, and validation regarding herbal supplement analysis and provides several documented examples of inappropriate method selection and application. PMID:26980823

The Importance of Method Selection in Determining Product Integrity for Nutrition Research.

PubMed

Mudge, Elizabeth M; Betz, Joseph M; Brown, Paula N

2016-03-01

The American Herbal Products Association estimates that there as many as 3000 plant species in commerce. The FDA estimates that there are about 85,000 dietary supplement products in the marketplace. The pace of product innovation far exceeds that of analytical methods development and validation, with new ingredients, matrixes, and combinations resulting in an analytical community that has been unable to keep up. This has led to a lack of validated analytical methods for dietary supplements and to inappropriate method selection where methods do exist. Only after rigorous validation procedures to ensure that methods are fit for purpose should they be used in a routine setting to verify product authenticity and quality. By following systematic procedures and establishing performance requirements for analytical methods before method development and validation, methods can be developed that are both valid and fit for purpose. This review summarizes advances in method selection, development, and validation regarding herbal supplement analysis and provides several documented examples of inappropriate method selection and application. © 2016 American Society for Nutrition.

Efficacy and enlightenment: LSD psychotherapy and the Drug Amendments of 1962.

PubMed

Oram, Matthew

2014-04-01

The decline in therapeutic research with lysergic acid diethylamide (LSD) in the United States over the course of the 1960s has commonly been attributed to the growing controversy surrounding its recreational use. However, research difficulties played an equal role in LSD psychotherapy's demise, as they frustrated researchers' efforts to clearly establish the efficacy of treatment. Once the Kefauver Harris Drug Amendments of 1962 introduced the requirement that proof of efficacy be established through controlled clinical trials before a drug could be approved to market, the value of clinical research became increasingly dependent on the scientific rigor of the trial's design. LSD psychotherapy's complex method of utilizing drug effects to catalyze a psychological treatment clashed with the controlled trial methodology on both theoretical and practical levels, making proof of efficacy difficult to obtain. Through a close examination of clinical trials performed after 1962, this article explores how the new emphasis on controlled clinical trials frustrated the progress of LSD psychotherapy research by focusing researchers' attention on trial design to the detriment of their therapeutic method. This analysis provides a new perspective on the death of LSD psychotherapy and explores the implications of the Drug Amendments of 1962.

Increasing value and reducing waste: addressing inaccessible research.

PubMed

Chan, An-Wen; Song, Fujian; Vickers, Andrew; Jefferson, Tom; Dickersin, Kay; Gøtzsche, Peter C; Krumholz, Harlan M; Ghersi, Davina; van der Worp, H Bart

2014-01-18

The methods and results of health research are documented in study protocols, full study reports (detailing all analyses), journal reports, and participant-level datasets. However, protocols, full study reports, and participant-level datasets are rarely available, and journal reports are available for only half of all studies and are plagued by selective reporting of methods and results. Furthermore, information provided in study protocols and reports varies in quality and is often incomplete. When full information about studies is inaccessible, billions of dollars in investment are wasted, bias is introduced, and research and care of patients are detrimentally affected. To help to improve this situation at a systemic level, three main actions are warranted. First, academic institutions and funders should reward investigators who fully disseminate their research protocols, reports, and participant-level datasets. Second, standards for the content of protocols and full study reports and for data sharing practices should be rigorously developed and adopted for all types of health research. Finally, journals, funders, sponsors, research ethics committees, regulators, and legislators should endorse and enforce policies supporting study registration and wide availability of journal reports, full study reports, and participant-level datasets. Copyright © 2014 Elsevier Ltd. All rights reserved.

Increasing value and reducing waste: addressing inaccessible research

PubMed Central

Chan, An-Wen; Song, Fujian; Vickers, Andrew; Jefferson, Tom; Dickersin, Kay; Gøtzsche, Peter C.; Krumholz, Harlan M.; Ghersi, Davina; van der Worp, H. Bart

2015-01-01

The study protocol, publications, full study report detailing all analyses, and participant-level dataset constitute the main documentation of methods and results for health research. However, journal publications are available for only half of all studies and are plagued by selective reporting of methods and results. The protocol, full study report, and participant-level dataset are rarely available. The quality of information provided in study protocols and reports is variable and often incomplete. Inaccessibility of full information for the vast majority of studies wastes billions of dollars, introduces bias, and has a detrimental impact on patient care and research. To help improve this situation at a systemic level, three main actions are warranted. Firstly, it is important that academic institutions and funders reward investigators who fully disseminate their research protocols, reports, and participant-level datasets. Secondly, standards for the content of protocols, full study reports, and data sharing practices should be rigorously developed and adopted for all types of health research. Finally, journals, funders, sponsors, research ethics committees, regulators, and legislators should implement and enforce policies supporting study registration and availability of journal publications, full study reports, and participant-level datasets. PMID:24411650

Guidelines for reporting methodological challenges and evaluating potential bias in dementia research

PubMed Central

Weuve, Jennifer; Proust-Lima, Cécile; Power, Melinda C.; Gross, Alden L.; Hofer, Scott M.; Thiébaut, Rodolphe; Chêne, Geneviève; Glymour, M. Maria; Dufouil, Carole

2015-01-01

Clinical and population research on dementia and related neurologic conditions, including Alzheimer’s disease, faces several unique methodological challenges. Progress to identify preventive and therapeutic strategies rests on valid and rigorous analytic approaches, but the research literature reflects little consensus on “best practices.” We present findings from a large scientific working group on research methods for clinical and population studies of dementia, which identified five categories of methodological challenges as follows: (1) attrition/sample selection, including selective survival; (2) measurement, including uncertainty in diagnostic criteria, measurement error in neuropsychological assessments, and practice or retest effects; (3) specification of longitudinal models when participants are followed for months, years, or even decades; (4) time-varying measurements; and (5) high-dimensional data. We explain why each challenge is important in dementia research and how it could compromise the translation of research findings into effective prevention or care strategies. We advance a checklist of potential sources of bias that should be routinely addressed when reporting dementia research. PMID:26397878

Adding to the Truth of the Matter: The Case for Qualitative Research.

PubMed

Florczak, Kristine L

2017-10-01

The purpose of this column is to discuss the impact that qualitative research has on translational research, whose aim is to improve the health and well-being of individuals. To that end, rigorous qualitative research is examined; translational research is entertained and the manner in which qualitative research can be a co-equal partner with quantitative research is proposed.

Methods Beyond Methods: A Model for Africana Graduate Methods Training

PubMed Central

Best, Latrica E.; Byrd, W. Carson

2018-01-01

A holistic graduate education can impart not just tools and knowledge, but critical positioning to fulfill many of the original missions of Africana Studies programs set forth in the 1960s and 1970s. As an interdisciplinary field with many approaches to examining the African Diaspora, the methodological training of graduate students can vary across graduate programs. Although taking qualitative methods courses are often required of graduate students in Africana Studies programs, and these programs offer such courses, rarely if ever are graduate students in these programs required to take quantitative methods courses, let alone have these courses offered in-house. These courses can offer Africana Studies graduate students new tools for their own research, but more importantly, improve their knowledge of quantitative research of diasporic communities. These tools and knowledge can assist with identifying flawed arguments about African-descended communities and their members. This article explores the importance of requiring and offering critical quantitative methods courses in graduate programs in Africana Studies, and discusses the methods requirements of one graduate program in the field as an example of more rigorous training that other programs could offer graduate students. PMID:29710883

What Is the Efficacy of Teaching Psychotherapy to Psychiatry Residents and Medical Students?

PubMed

Truong, Anh; Wu, Peter; Diez-Barroso, Ramon; Coverdale, John

2015-10-01

Because there are no formal reviews, the authors set out to identify and evaluate studies on teaching psychotherapy to psychiatry residents and medical students. PubMed, Embase, and PsycINFO were searched for papers with outcomes on teaching psychotherapy. Search terms included psychotherapy, teaching, residents, medical students, supportive, psychodynamic, cognitive, behavioral, learning, training, skills, competency, and mentalization. Nine studies were found that met inclusion criteria. There were seven studies of psychiatry residents and two of medical students. Only two of the research designs had comparison groups, and these were both randomized controlled trials, while seven of the other designs were pretest and posttest. Teaching methods, course content, and outcome measures varied widely across studies. Common methodological problems included a lack of control, low numbers of subjects as learners, and a lack of validity of the outcome measures. Only one of the studies was judged to be methodologically rigorous. These findings establish a priority for undertaking additional rigorously designed studies in evaluating the teaching of psychotherapy to psychiatry residents and medical students.

Perpetrator, worker and workplace characteristics associated with patient and visitor perpetrated violence (Type II) on hospital workers: a review of the literature and existing occupational injury data.

PubMed

Pompeii, Lisa; Dement, John; Schoenfisch, Ashley; Lavery, Amy; Souder, Megan; Smith, Claudia; Lipscomb, Hester

2013-02-01

Non-fatal type II violence experienced by hospital workers (patient/visitor-on-worker violence) is not well described. Hospital administration data (2004-2009) were examined for purposes of calculating rates of type II violent events experienced by workers. We also conducted a review of the hospital-based literature (2000-2010) and summarized findings associated with type II violence. 484 physical assaults were identified in the data, with a rate of 1.75 events/100 full-time equivalents. Only few details about events were captured, while non-physical events were not captured. The literature yielded 17 studies, with a range proportion of verbal abuse (22%-90%), physical threats (12%-64%) and assaults (2%-32%) reported. The literature lacked rigorous methods for examining incidence and circumstances surrounding events or rates of events over time. For purposes of examining the impact of type II violence on worker safety, satisfaction and retention, rigorous surveillance efforts by hospital employers and researchers are warranted. Copyright © 2013 National Safety Council and Elsevier Ltd. All rights reserved.

Uncertainty Analysis of Instrument Calibration and Application

NASA Technical Reports Server (NTRS)

Tripp, John S.; Tcheng, Ping

1999-01-01

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

ASTM Committee C28: International Standards for Properties and Performance of Advanced Ceramics-Three Decades of High-Quality, Technically-Rigorous Normalization

NASA Technical Reports Server (NTRS)

Jenkins, Michael G.; Salem, Jonathan A.

2016-01-01

Physical and mechanical properties and performance of advanced ceramics and glasses are difficult to measure correctly without the proper techniques. For over three decades, ASTM Committee C28 on Advanced Ceramics, has developed high-quality, technically-rigorous, full-consensus standards (e.g., test methods, practices, guides, terminology) to measure properties and performance of monolithic and composite ceramics that may be applied to glasses in some cases. These standards contain testing particulars for many mechanical, physical, thermal, properties and performance of these materials. As a result these standards are used to generate accurate, reliable, repeatable and complete data. Within Committee C28, users, producers, researchers, designers, academicians, etc. have written, continually updated, and validated through round-robin test programs, 50 standards since the Committee's founding in 1986. This paper provides a detailed retrospective of the 30 years of ASTM Committee C28 including a graphical pictogram listing of C28 standards along with examples of the tangible benefits of standards for advanced ceramics to demonstrate their practical applications.

Studying Sexual Aggression: A Review of the Evolution and Validity of Laboratory Paradigms

PubMed Central

Davis, Kelly Cue; George, William H.; Nagayama Hall, Gordon C.; Parrott, Dominic J.; Tharp, Andra Teten; Stappenbeck, Cynthia A.

2018-01-01

Objective Researchers have endeavored for decades to develop and implement experimental assessments of sexual aggression and its precursors to capitalize on the many scientific advantages offered by laboratory experiments, such as rigorous control of key variables and identification of causal relationships. The purpose of this review is to provide an overview of and commentary on the evolution of these laboratory-based methods. Conclusions To date, two primary types of sexual aggression laboratory studies have been developed: those that involve behavioral analogues of sexual aggression and those that assess postulated precursors to sexually aggressive behavior. Although the study of sexual aggression in the laboratory is fraught with methodological challenges, validity concerns, and ethical considerations, advances in the field have resulted in greater methodological rigor, more precise dependent measures, and improved experimental validity, reliability, and realism. Because highly effective sexual aggression prevention strategies remain elusive, continued laboratory-based investigation of sexual aggression coupled with translation of critical findings to the development and modification of sexual aggression prevention programs remains an important task for the field. PMID:29675289

IEEE/NASA Workshop on Leveraging Applications of Formal Methods, Verification, and Validation

NASA Technical Reports Server (NTRS)

Margaria, Tiziana (Editor); Steffen, Bernhard (Editor); Hichey, Michael G.

2005-01-01

This volume contains the Preliminary Proceedings of the 2005 IEEE ISoLA Workshop on Leveraging Applications of Formal Methods, Verification, and Validation, with a special track on the theme of Formal Methods in Human and Robotic Space Exploration. The workshop was held on 23-24 September 2005 at the Loyola College Graduate Center, Columbia, MD, USA. The idea behind the Workshop arose from the experience and feedback of ISoLA 2004, the 1st International Symposium on Leveraging Applications of Formal Methods held in Paphos (Cyprus) last October-November. ISoLA 2004 served the need of providing a forum for developers, users, and researchers to discuss issues related to the adoption and use of rigorous tools and methods for the specification, analysis, verification, certification, construction, test, and maintenance of systems from the point of view of their different application domains.

Reflections on experimental research in medical education.

PubMed

Cook, David A; Beckman, Thomas J

2010-08-01

As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders. Second, the posttest-only design is inherently stronger than the pretest-posttest design, provided the study is randomized and the sample is sufficiently large. Third, demonstrating the superiority of an educational intervention in comparison to no intervention does little to advance the art and science of education. Fourth, comparisons involving multifactorial interventions are hopelessly confounded, have limited application to new settings, and do little to advance our understanding of education. Fifth, single-group pretest-posttest studies are susceptible to numerous validity threats. Finally, educational interventions (including the comparison group) must be described in detail sufficient to allow replication.

Replication of Special Education Research: Necessary but Far Too Rare

ERIC Educational Resources Information Center

Makel, Matthew C.; Plucker, Jonathan A.; Freeman, Jennifer; Lombardi, Allison; Simonsen, Brandi; Coyne, Michael

2016-01-01

Increased calls for rigor in special education have often revolved around the use of experimental research design. However, the replicability of research results is also a central tenet to the scientific research process. To assess the prevalence, success rate, and authorship history of replications in special education, we investigated the…

A Case for Qualitative Research in the Social Studies.

ERIC Educational Resources Information Center

Parsons, Jim; And Others

As examples of the qualitative research attitude, six research papers, each of which addresses a serious educational question in a thoughtful and rigorous manner, are presented. The first paper argues for the advancement of a qualitative research attitude in social studies, for such an attitude is consonant with the purposes of a reflective,…

Shaping Social Work Science: What Should Quantitative Researchers Do?

ERIC Educational Resources Information Center

Guo, Shenyang

2015-01-01

Based on a review of economists' debates on mathematical economics, this article discusses a key issue for shaping the science of social work--research methodology. The article describes three important tasks quantitative researchers need to fulfill in order to enhance the scientific rigor of social work research. First, to test theories using…

The Similarities between Research in Education and Research in the Hard Sciences

ERIC Educational Resources Information Center

Wieman, Carl E.

2014-01-01

In this commentary, the author argues that there is a considerable degree of similarity between research in the hard sciences and education and that this provides a useful lens for thinking about what constitutes "rigorous" and "scientific" education research. He suggests that the fundamental property of hard science research…

International Service Learning: Conceptual Frameworks and Research. IUPUI Series on Service Learning Research 1

ERIC Educational Resources Information Center

Bringle, Robert G., Ed.; Hatcher, Julie A., Ed.; Jones, Steven G., Ed.

2010-01-01

This book focuses on conducting research on International Service Learning (ISL), which includes developing and evaluating hypotheses about ISL outcomes and measuring its impact on students, faculty, and communities. The book argues that rigorous research is essential to improving the quality of ISL's implementation and delivery, and providing the…

Theorizing a "Halfie" Researcher's Identity in Transnational Fieldwork

ERIC Educational Resources Information Center

Subedi, Binaya

2006-01-01

The topic of how reflexivity ought to be utilized in the global aspect of research is yet to be fully theorized in educational research. Through the use of rigorous reflexivity, this paper examines a "halfie" researcher's negotiation of insider and outsider identities within his transnational home/field site of Nepal. By examining how…

Enhancing Validity When Researching the "Other": Insights from Pierre Bourdieu's Theory of Social Science Research Practice

ERIC Educational Resources Information Center

Naidoo, Devika

2014-01-01

This article explores aspects of Pierre Bourdieu's theory of social science research practice and discusses their relevance for enhancing validity when researching the "other." Aspects such as: a relational way of thinking about concepts, epistemology and methodology; the rigorous construction of the object of research; and…

The Conservation Reserve Program: Planting for the future

USGS Publications Warehouse

Hyberg, Skip; Allen, Arthur

2006-01-01

Proceedings are now available from a scientific and technical forum held to review ongoing and planned research, identify lessons learned, and determine future research needs for the purpose of developing a rigorous scientific basis for future CRP policy discussions.

76 FR 7591 - Agency Information Collection Activities: Proposed Collection, Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-02-10

... investments in research, development, infrastructure, and capacity-building for science, technology... informal science community with new expectations for rigorous research on implementation and outcomes. The... NATIONAL SCIENCE FOUNDATION Agency Information Collection Activities: Proposed Collection, Comment...

Analytic Methods in Investigative Geometry.

ERIC Educational Resources Information Center

Dobbs, David E.

2001-01-01

Suggests an alternative proof by analytic methods, which is more accessible than rigorous proof based on Euclid's Elements, in which students need only apply standard methods of trigonometry to the data without introducing new points or lines. (KHR)

A Critical Review of Methods to Evaluate the Impact of FDA Regulatory Actions

PubMed Central

Briesacher, Becky A.; Soumerai, Stephen B.; Zhang, Fang; Toh, Sengwee; Andrade, Susan E.; Wagner, Joann L.; Shoaibi, Azadeh; Gurwitz, Jerry H.

2013-01-01

Purpose To conduct a synthesis of the literature on methods to evaluate the impacts of FDA regulatory actions, and identify best practices for future evaluations. Methods We searched MEDLINE for manuscripts published between January 1948 and August 2011 that included terms related to FDA, regulatory actions, and empirical evaluation; the review additionally included FDA-identified literature. We used a modified Delphi method to identify preferred methodologies. We included studies with explicit methods to address threats to validity, and identified designs and analytic methods with strong internal validity that have been applied to other policy evaluations. Results We included 18 studies out of 243 abstracts and papers screened. Overall, analytic rigor in prior evaluations of FDA regulatory actions varied considerably; less than a quarter of studies (22%) included control groups. Only 56% assessed changes in the use of substitute products/services, and 11% examined patient health outcomes. Among studies meeting minimal criteria of rigor, 50% found no impact or weak/modest impacts of FDA actions and 33% detected unintended consequences. Among those studies finding significant intended effects of FDA actions, all cited the importance of intensive communication efforts. There are preferred methods with strong internal validity that have yet to be applied to evaluations of FDA regulatory actions. Conclusions Rigorous evaluations of the impact of FDA regulatory actions have been limited and infrequent. Several methods with strong internal validity are available to improve trustworthiness of future evaluations of FDA policies. PMID:23847020

The Relevancy of Large-Scale, Quantitative Methodologies in Middle Grades Education Research

ERIC Educational Resources Information Center

Mertens, Steven B.

2006-01-01

This article examines the relevancy of large-scale, quantitative methodologies in middle grades education research. Based on recommendations from national advocacy organizations, the need for more large-scale, quantitative research, combined with the application of more rigorous methodologies, is presented. Subsequent sections describe and discuss…

Quantitative Approaches to Group Research: Suggestions for Best Practices

ERIC Educational Resources Information Center

McCarthy, Christopher J.; Whittaker, Tiffany A.; Boyle, Lauren H.; Eyal, Maytal

2017-01-01

Rigorous scholarship is essential to the continued growth of group work, yet the unique nature of this counseling specialty poses challenges for quantitative researchers. The purpose of this proposal is to overview unique challenges to quantitative research with groups in the counseling field, including difficulty in obtaining large sample sizes…

Identifying Evidence-Based Special Education Interventions from Single-Subject Research

ERIC Educational Resources Information Center

Freeman, Jennifer; Sugai, George

2013-01-01

Special educators are required to use evidence-based academic and behavioral interventions in their classrooms (U.S. Department of Education, 2010). No rigorous and comprehensive database currently exists to support educators. Within the field of special education, single-subject research is the primary research methodology (Horner, Carr, Halle,…

An Ethical Frame for Research with Immigrant Families

ERIC Educational Resources Information Center

Nguyen, Jacqueline; Hernández, María G.; Saetermoe, Carrie L.; Suárez-Orozco, Carola

2013-01-01

In this introduction, the editors give an overview of the ways the volume addresses the growing individual and institutional calls for increased clarity and rigor in methodological, ethical, and practical research policies and guidelines for conducting research with immigrant individuals, families, and communities. In addition to summarizing the…

Data Use and Inquiry in Research-Practice Partnerships: Four Case Examples

ERIC Educational Resources Information Center

Biag, Manuelito; Gerstein, Amy; Fehrer, Kendra; Sanchez, Monika; Sipes, Laurel

2016-01-01

The four case examples presented in this brief are drawn from the Gardner Center's substantial experience conducting rigorous research in research-practice partnerships. The first case describes a partnership approach that enhances a school district's capacity to use integrated longitudinal data to tackle persistent problems of practice and…

Rigged or rigorous? Partnerships for research and evaluation of complex social problems: Lessons from the field of violence against women and girls.

PubMed

Zimmerman, Cathy; Michau, Lori; Hossain, Mazeda; Kiss, Ligia; Borland, Rosilyne; Watts, Charlotte

2016-09-01

There is growing demand for robust evidence to address complex social phenomena such as violence against women and girls (VAWG). Research partnerships between scientists and non-governmental or international organizations (NGO/IO) are increasingly popular, but can pose challenges, including concerns about potential conflicts of interest. Drawing on our experience collaborating on VAWG research, we describe challenges and contributions that NGO/IO and academic partners can make at different stages of the research process and the effects that collaborations can have on scientific inquiry. Partners may struggle with differing priorities and misunderstandings about roles, limitations, and intentions. Benefits of partnerships include a shared vision of study goals, differing and complementary expertise, mutual respect, and a history of constructive collaboration. Our experience suggests that when investigating multi-faceted social problems, instead of 'rigging' study results, research collaborations can strengthen scientific rigor and offer the greatest potential for impact in the communities we seek to serve.

Does pretend play matter? Searching for evidence: comment on Lillard et al. (2013).

PubMed

Bergen, Doris

2013-01-01

Lillard et al. (2013) have done a thorough review of published pretend play research from the past 50 plus years. However, they did not thoroughly address the reasons why this body of research has such flaws as well as the contradictory or minimal findings that call into question strongly held views and published assertions regarding the importance of the role of pretend play in fostering children's developmental progress. This comment addresses 3 aspects of the problematic nature of play research: First, I suggest that the research methods in most of these studies were unable to capture genuine pretend play, instead measuring "playful work." Second, I encourage rigorous research designs to better capture genuine examples of the pretend play phenomenon in order to gain deeper insights into these relationships. Third, I speculate on why pretend play development, as a valued behavior independent of its influence on other areas of development, is rarely undertaken and provide suggestions regarding this research direction. (PsycINFO Database Record (c) 2013 APA, all rights reserved).

Geoscience Education Research Methods: Thinking About Sample Size

NASA Astrophysics Data System (ADS)

Slater, S. J.; Slater, T. F.; CenterAstronomy; Physics Education Research

2011-12-01

Geoscience education research is at a critical point in which conditions are sufficient to propel our field forward toward meaningful improvements in geosciences education practices. Our field has now reached a point where the outcomes of our research is deemed important to endusers and funding agencies, and where we now have a large number of scientists who are either formally trained in geosciences education research, or who have dedicated themselves to excellence in this domain. At this point we now must collectively work through our epistemology, our rules of what methodologies will be considered sufficiently rigorous, and what data and analysis techniques will be acceptable for constructing evidence. In particular, we have to work out our answer to that most difficult of research questions: "How big should my 'N' be??" This paper presents a very brief answer to that question, addressing both quantitative and qualitative methodologies. Research question/methodology alignment, effect size and statistical power will be discussed, in addition to a defense of the notion that bigger is not always better.

The Importance Of Integrating Narrative Into Health Care Decision Making.

PubMed

Dohan, Daniel; Garrett, Sarah B; Rendle, Katharine A; Halley, Meghan; Abramson, Corey

2016-04-01

When making health care decisions, patients and consumers use data but also gather stories from family and friends. When advising patients, clinicians consult the medical evidence but also use professional judgment. These stories and judgments, as well as other forms of narrative, shape decision making but remain poorly understood. Furthermore, qualitative research methods to examine narrative are rarely included in health science research. We illustrate how narratives shape decision making and explain why it is difficult but necessary to integrate qualitative research on narrative into the health sciences. We draw on social-scientific insights on rigorous qualitative research and our ongoing studies of decision making by patients with cancer, and we describe new tools and approaches that link qualitative research findings with the predominantly quantitative health science scholarship. Finally, we highlight the benefits of more fully integrating qualitative research and narrative analysis into the medical evidence base and into evidence-based medical practice. Project HOPE—The People-to-People Health Foundation, Inc.

Five-year review of an international clinical research-training program

PubMed Central

Suemoto, Claudia Kimie; Ismail, Sherine; Corrêa, Paulo César Rodrigues Pinto; Khawaja, Faiza; Jerves, Teodoro; Pesantez, Laura; Germani, Ana Claudia Camargo Gonçalves; Zaina, Fabio; dos Santos, Augusto Cesar Soares; de Oliveira Ferreira, Ricardo Jorge; Singh, Priyamvada; Paulo, Judy Vicente; Matsubayashi, Suely Reiko; Vidor, Liliane Pinto; Andretta, Guilherme; Tomás, Rita; Illigens, Ben MW; Fregni, Felipe

2015-01-01

The exponential increase in clinical research has profoundly changed medical sciences. Evidence that has accumulated in the past three decades from clinical trials has led to the proposal that clinical care should not be based solely on clinical expertise and patient values, and should integrate robust data from systematic research. As a consequence, clinical research has become more complex and methods have become more rigorous, and evidence is usually not easily translated into clinical practice. Therefore, the instruction of clinical research methods for scientists and clinicians must adapt to this new reality. To address this challenge, a global distance-learning clinical research-training program was developed, based on collaborative learning, the pedagogical goal of which was to develop critical thinking skills in clinical research. We describe and analyze the challenges and possible solutions of this course after 5 years of experience (2008–2012) with this program. Through evaluation by students and faculty, we identified and reviewed the following challenges of our program: 1) student engagement and motivation, 2) impact of heterogeneous audience on learning, 3) learning in large groups, 4) enhancing group learning, 5) enhancing social presence, 6) dropouts, 7) quality control, and 8) course management. We discuss these issues and potential alternatives with regard to our research and background. PMID:25878518

Five-year review of an international clinical research-training program.

PubMed

Suemoto, Claudia Kimie; Ismail, Sherine; Corrêa, Paulo César Rodrigues Pinto; Khawaja, Faiza; Jerves, Teodoro; Pesantez, Laura; Germani, Ana Claudia Camargo Gonçalves; Zaina, Fabio; Dos Santos, Augusto Cesar Soares; de Oliveira Ferreira, Ricardo Jorge; Singh, Priyamvada; Paulo, Judy Vicente; Matsubayashi, Suely Reiko; Vidor, Liliane Pinto; Andretta, Guilherme; Tomás, Rita; Illigens, Ben Mw; Fregni, Felipe

2015-01-01

The exponential increase in clinical research has profoundly changed medical sciences. Evidence that has accumulated in the past three decades from clinical trials has led to the proposal that clinical care should not be based solely on clinical expertise and patient values, and should integrate robust data from systematic research. As a consequence, clinical research has become more complex and methods have become more rigorous, and evidence is usually not easily translated into clinical practice. Therefore, the instruction of clinical research methods for scientists and clinicians must adapt to this new reality. To address this challenge, a global distance-learning clinical research-training program was developed, based on collaborative learning, the pedagogical goal of which was to develop critical thinking skills in clinical research. We describe and analyze the challenges and possible solutions of this course after 5 years of experience (2008-2012) with this program. Through evaluation by students and faculty, we identified and reviewed the following challenges of our program: 1) student engagement and motivation, 2) impact of heterogeneous audience on learning, 3) learning in large groups, 4) enhancing group learning, 5) enhancing social presence, 6) dropouts, 7) quality control, and 8) course management. We discuss these issues and potential alternatives with regard to our research and background.

From "our world" to the "real world": Exploring the views and behaviour of policy-influential Australian public health researchers.

PubMed

Haynes, Abby S; Derrick, Gjemma E; Chapman, Simon; Redman, Sally; Hall, Wayne D; Gillespie, James; Sturk, Heidi

2011-04-01

Research and researchers influence the genesis and development of public health policy in limited but essential ways. Surveys and interviews with 36 peer-nominated "highly influential" Australian public health researchers found they engaged in a breadth of strategies that included rigorous but targeted research design, multilateral collaboration, multiple methods of research dissemination and promotion (including tactical use of the media), and purposeful development of bridging relationships. Researchers' ability to understand the worlds of research, policy and the media and to speak their languages (or to work with others who fulfilled this role) was a key factor. Advocacy was seen as fundamental by some but was disparaged by others. Influential behaviours were guided by values and beliefs about the principles underlying traditional science and the contrasting ethos of contemporary research. This study may help researchers consider their own policy-related roles, strategies and relationships in the context of increasing calls for research that serves economic and/or social goals. Copyright © 2011 Elsevier Ltd. All rights reserved.

On the tsunami wave-submerged breakwater interaction

DOE Office of Scientific and Technical Information (OSTI.GOV)

Filianoti, P.; Piscopo, R.

The tsunami wave loads on a submerged rigid breakwater are inertial. It is the result arising from the simple calculation method here proposed, and it is confirmed by the comparison with results obtained by other researchers. The method is based on the estimate of the speed drop of the tsunami wave passing over the breakwater. The calculation is rigorous for a sinusoidal wave interacting with a rigid submerged obstacle, in the framework of the linear wave theory. This new approach gives a useful and simple tool for estimating tsunami loads on submerged breakwaters.An unexpected novelty come out from a workedmore » example: assuming the same wave height, storm waves are more dangerous than tsunami waves, for the safety against sliding of submerged breakwaters.« less

AgMIP's Transdisciplinary Agricultural Systems Approach to Regional Integrated Assessment of Climate Impacts, Vulnerability, and Adaptation

NASA Technical Reports Server (NTRS)

Antle, John M.; Valdivia, Roberto O.; Boote, Kenneth J.; Janssen, Sander; Jones, James W.; Porter, Cheryl H.; Rosenzweig, Cynthia; Ruane, Alexander C.; Thorburn, Peter J.

2015-01-01

This chapter describes methods developed by the Agricultural Model Intercomparison and Improvement Project (AgMIP) to implement a transdisciplinary, systems-based approach for regional-scale (local to national) integrated assessment of agricultural systems under future climate, biophysical, and socio-economic conditions. These methods were used by the AgMIP regional research teams in Sub-Saharan Africa and South Asia to implement the analyses reported in their respective chapters of this book. Additional technical details are provided in Appendix 1.The principal goal that motivates AgMIP's regional integrated assessment (RIA) methodology is to provide scientifically rigorous information needed to support improved decision-making by various stakeholders, ranging from local to national and international non-governmental and governmental organizations.

Rigorous high-precision enclosures of fixed points and their invariant manifolds

NASA Astrophysics Data System (ADS)

Wittig, Alexander N.

The well established concept of Taylor Models is introduced, which offer highly accurate C0 enclosures of functional dependencies, combining high-order polynomial approximation of functions and rigorous estimates of the truncation error, performed using verified arithmetic. The focus of this work is on the application of Taylor Models in algorithms for strongly non-linear dynamical systems. A method is proposed to extend the existing implementation of Taylor Models in COSY INFINITY from double precision coefficients to arbitrary precision coefficients. Great care is taken to maintain the highest efficiency possible by adaptively adjusting the precision of higher order coefficients in the polynomial expansion. High precision operations are based on clever combinations of elementary floating point operations yielding exact values for round-off errors. An experimental high precision interval data type is developed and implemented. Algorithms for the verified computation of intrinsic functions based on the High Precision Interval datatype are developed and described in detail. The application of these operations in the implementation of High Precision Taylor Models is discussed. An application of Taylor Model methods to the verification of fixed points is presented by verifying the existence of a period 15 fixed point in a near standard Henon map. Verification is performed using different verified methods such as double precision Taylor Models, High Precision intervals and High Precision Taylor Models. Results and performance of each method are compared. An automated rigorous fixed point finder is implemented, allowing the fully automated search for all fixed points of a function within a given domain. It returns a list of verified enclosures of each fixed point, optionally verifying uniqueness within these enclosures. An application of the fixed point finder to the rigorous analysis of beam transfer maps in accelerator physics is presented. Previous work done by Johannes Grote is extended to compute very accurate polynomial approximations to invariant manifolds of discrete maps of arbitrary dimension around hyperbolic fixed points. The algorithm presented allows for automatic removal of resonances occurring during construction. A method for the rigorous enclosure of invariant manifolds of continuous systems is introduced. Using methods developed for discrete maps, polynomial approximations of invariant manifolds of hyperbolic fixed points of ODEs are obtained. These approximations are outfit with a sharp error bound which is verified to rigorously contain the manifolds. While we focus on the three dimensional case, verification in higher dimensions is possible using similar techniques. Integrating the resulting enclosures using the verified COSY VI integrator, the initial manifold enclosures are expanded to yield sharp enclosures of large parts of the stable and unstable manifolds. To demonstrate the effectiveness of this method, we construct enclosures of the invariant manifolds of the Lorenz system and show pictures of the resulting manifold enclosures. To the best of our knowledge, these enclosures are the largest verified enclosures of manifolds in the Lorenz system in existence.

Sonoelasticity to monitor mechanical changes during rigor and ageing.

PubMed

Ayadi, A; Culioli, J; Abouelkaram, S

2007-06-01

We propose the use of sonoelasticity as a non-destructive method to monitor changes in the resistance of muscle fibres, unaffected by connective tissue. Vibrations were applied at low frequency to induce oscillations in soft tissues and an ultrasound transducer was used to detect the motions. The experiments were carried out on the M. biceps femoris muscles of three beef cattle. In addition to the sonoelasticity measurements, the changes in meat during rigor and ageing were followed by measurements of both the mechanical resistance of myofibres and pH. The variations of mechanical resistance and pH were compared to those of the sonoelastic variables (velocity and attenuation) at two frequencies. The relationships between pH and velocity or attenuation and between the velocity or attenuation and the stress at 20% deformation were highly correlated. We concluded that sonoelasticity is a non-destructive method that can be used to monitor mechanical changes in muscle fibers during rigor-mortis and ageing.

Improved key-rate bounds for practical decoy-state quantum-key-distribution systems

NASA Astrophysics Data System (ADS)

Zhang, Zhen; Zhao, Qi; Razavi, Mohsen; Ma, Xiongfeng

2017-01-01

The decoy-state scheme is the most widely implemented quantum-key-distribution protocol in practice. In order to account for the finite-size key effects on the achievable secret key generation rate, a rigorous statistical fluctuation analysis is required. Originally, a heuristic Gaussian-approximation technique was used for this purpose, which, despite its analytical convenience, was not sufficiently rigorous. The fluctuation analysis has recently been made rigorous by using the Chernoff bound. There is a considerable gap, however, between the key-rate bounds obtained from these techniques and that obtained from the Gaussian assumption. Here we develop a tighter bound for the decoy-state method, which yields a smaller failure probability. This improvement results in a higher key rate and increases the maximum distance over which secure key exchange is possible. By optimizing the system parameters, our simulation results show that our method almost closes the gap between the two previously proposed techniques and achieves a performance similar to that of conventional Gaussian approximations.

Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review.

PubMed

Eysenbach, Gunther; Powell, John; Kuss, Oliver; Sa, Eun-Ryoung

The quality of consumer health information on the World Wide Web is an important issue for medicine, but to date no systematic and comprehensive synthesis of the methods and evidence has been performed. To establish a methodological framework on how quality on the Web is evaluated in practice, to determine the heterogeneity of the results and conclusions, and to compare the methodological rigor of these studies, to determine to what extent the conclusions depend on the methodology used, and to suggest future directions for research. We searched MEDLINE and PREMEDLINE (1966 through September 2001), Science Citation Index (1997 through September 2001), Social Sciences Citation Index (1997 through September 2001), Arts and Humanities Citation Index (1997 through September 2001), LISA (1969 through July 2001), CINAHL (1982 through July 2001), PsychINFO (1988 through September 2001), EMBASE (1988 through June 2001), and SIGLE (1980 through June 2001). We also conducted hand searches, general Internet searches, and a personal bibliographic database search. We included published and unpublished empirical studies in any language in which investigators searched the Web systematically for specific health information, evaluated the quality of Web sites or pages, and reported quantitative results. We screened 7830 citations and retrieved 170 potentially eligible full articles. A total of 79 distinct studies met the inclusion criteria, evaluating 5941 health Web sites and 1329 Web pages, and reporting 408 evaluation results for 86 different quality criteria. Two reviewers independently extracted study characteristics, medical domains, search strategies used, methods and criteria of quality assessment, results (percentage of sites or pages rated as inadequate pertaining to a quality criterion), and quality and rigor of study methods and reporting. Most frequently used quality criteria used include accuracy, completeness, readability, design, disclosures, and references provided. Fifty-five studies (70%) concluded that quality is a problem on the Web, 17 (22%) remained neutral, and 7 studies (9%) came to a positive conclusion. Positive studies scored significantly lower in search (P =.02) and evaluation (P =.04) methods. Due to differences in study methods and rigor, quality criteria, study population, and topic chosen, study results and conclusions on health-related Web sites vary widely. Operational definitions of quality criteria are needed.

Advancing Methods for U.S. Transgender Health Research

PubMed Central

Reisner, Sari L.; Deutsch, Madeline B.; Bhasin, Shalender; Bockting, Walter; Brown, George R.; Feldman, Jamie; Garofalo, Rob; Kreukels, Baudewijntje; Radix, Asa; Safer, Joshua D.; Tangpricha, Vin; T’Sjoen, Guy; Goodman, Michael

2016-01-01

Purpose of Review To describe methodological challenges, gaps, and opportunities in U.S. transgender health research. Recent Findings Lack of large prospective observational studies and intervention trials, limited data on risks and benefits of gender affirmation (e.g., hormones and surgical interventions), and inconsistent use of definitions across studies hinder evidence-based care for transgender people. Systematic high-quality observational and intervention-testing studies may be carried out using several approaches, including general population-based, health systems-based, clinic-based, venue-based, and hybrid designs. Each of these approaches has its strength and limitations; however, harmonization of research efforts is needed. Ongoing development of evidence-based clinical recommendations will benefit from a series of observational and intervention studies aimed at identification, recruitment, and follow-up of transgender people of different ages, from different racial, ethnic, and socioeconomic backgrounds and with diverse gender identities. Summary Transgender health research faces challenges that include standardization of lexicon, agreed-upon population definitions, study design, sampling, measurement, outcome ascertainment, and sample size. Application of existing and new methods is needed to fill existing gaps, increase the scientific rigor and reach of transgender health research, and inform evidence-based prevention and care for this underserved population. PMID:26845331

How to do a grounded theory study: a worked example of a study of dental practices

PubMed Central

2011-01-01

Background Qualitative methodologies are increasingly popular in medical research. Grounded theory is the methodology most-often cited by authors of qualitative studies in medicine, but it has been suggested that many 'grounded theory' studies are not concordant with the methodology. In this paper we provide a worked example of a grounded theory project. Our aim is to provide a model for practice, to connect medical researchers with a useful methodology, and to increase the quality of 'grounded theory' research published in the medical literature. Methods We documented a worked example of using grounded theory methodology in practice. Results We describe our sampling, data collection, data analysis and interpretation. We explain how these steps were consistent with grounded theory methodology, and show how they related to one another. Grounded theory methodology assisted us to develop a detailed model of the process of adapting preventive protocols into dental practice, and to analyse variation in this process in different dental practices. Conclusions By employing grounded theory methodology rigorously, medical researchers can better design and justify their methods, and produce high-quality findings that will be more useful to patients, professionals and the research community. PMID:21902844

Methodology, Methods, and Metrics for Testing and Evaluating Augmented Cognition Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Greitzer, Frank L.

The augmented cognition research community seeks cognitive neuroscience-based solutions to improve warfighter performance by applying and managing mitigation strategies to reduce workload and improve the throughput and quality of decisions. The focus of augmented cognition mitigation research is to define, demonstrate, and exploit neuroscience and behavioral measures that support inferences about the warfighter’s cognitive state that prescribe the nature and timing of mitigation. A research challenge is to develop valid evaluation methodologies, metrics and measures to assess the impact of augmented cognition mitigations. Two considerations are external validity, which is the extent to which the results apply to operational contexts;more » and internal validity, which reflects the reliability of performance measures and the conclusions based on analysis of results. The scientific rigor of the research methodology employed in conducting empirical investigations largely affects the validity of the findings. External validity requirements also compel us to demonstrate operational significance of mitigations. Thus it is important to demonstrate effectiveness of mitigations under specific conditions. This chapter reviews some cognitive science and methodological considerations in designing augmented cognition research studies and associated human performance metrics and analysis methods to assess the impact of augmented cognition mitigations.« less

The CTSA Consortium's Catalog of Assets for Translational and Clinical Health Research (CATCHR)

PubMed Central

Mapes, Brandy; Basford, Melissa; Zufelt, Anneliese; Wehbe, Firas; Harris, Paul; Alcorn, Michael; Allen, David; Arnim, Margaret; Autry, Susan; Briggs, Michael S.; Carnegie, Andrea; Chavis‐Keeling, Deborah; De La Pena, Carlos; Dworschak, Doris; Earnest, Julie; Grieb, Terri; Guess, Marilyn; Hafer, Nathaniel; Johnson, Tesheia; Kasper, Amanda; Kopp, Janice; Lockie, Timothy; Lombardo, Vincetta; McHale, Leslie; Minogue, Andrea; Nunnally, Beth; O'Quinn, Deanna; Peck, Kelly; Pemberton, Kieran; Perry, Cheryl; Petrie, Ginny; Pontello, Andria; Posner, Rachel; Rehman, Bushra; Roth, Deborah; Sacksteder, Paulette; Scahill, Samantha; Schieri, Lorri; Simpson, Rosemary; Skinner, Anne; Toussant, Kim; Turner, Alicia; Van der Put, Elaine; Wasser, June; Webb, Chris D.; Williams, Maija; Wiseman, Lori; Yasko, Laurel; Pulley, Jill

2014-01-01

Abstract The 61 CTSA Consortium sites are home to valuable programs and infrastructure supporting translational science and all are charged with ensuring that such investments translate quickly to improved clinical care. Catalog of Assets for Translational and Clinical Health Research (CATCHR) is the Consortium's effort to collect and make available information on programs and resources to maximize efficiency and facilitate collaborations. By capturing information on a broad range of assets supporting the entire clinical and translational research spectrum, CATCHR aims to provide the necessary infrastructure and processes to establish and maintain an open‐access, searchable database of consortium resources to support multisite clinical and translational research studies. Data are collected using rigorous, defined methods, with the resulting information made visible through an integrated, searchable Web‐based tool. Additional easy‐to‐use Web tools assist resource owners in validating and updating resource information over time. In this paper, we discuss the design and scope of the project, data collection methods, current results, and future plans for development and sustainability. With increasing pressure on research programs to avoid redundancy, CATCHR aims to make available information on programs and core facilities to maximize efficient use of resources. PMID:24456567

Impact of cooking and home food preparation interventions among adults: outcomes and implications for future programs

PubMed Central

Reicks, Marla; Trofholz, Amanda C.; Stang, Jamie S; Laska, Melissa N.

2014-01-01

Objective Cooking programs are growing in popularity; however an extensive review has not examined overall impact. Therefore, this study reviewed previous research on cooking/home food preparation interventions and diet and health-related outcomes among adults and identified implications for practice and research. Design Literature review and descriptive summative method. Main outcome measures Dietary intake, knowledge/skills, cooking attitudes and self-efficacy/confidence, health outcomes. Analysis Articles evaluating effectiveness of interventions that included cooking/home food preparation as the primary aim (January 1980 through December 2011) were identified via OVID MEDLINE, Agricola and Web of Science databases. Studies grouped according to design and outcomes were reviewed for validity using an established coding system. Results were summarized for several outcome categories. Results Of 28 studies identified, 12 included a control group with six as non-randomized and six as randomized controlled trials. Evaluation was done post-intervention for five studies, pre- and post-intervention for 23 and beyond post-intervention for 15. Qualitative and quantitative measures suggested a positive influence on main outcomes. However, non-rigorous study designs, varying study populations, and use of non-validated assessment tools limited stronger conclusions. Conclusions and Implications Well-designed studies are needed that rigorously evaluate long-term impact on cooking behavior, dietary intake, obesity and other health outcomes. PMID:24703245

Making Sense of Studies That Claim Benefits of Frenotomy in the Absence of Classic Tongue-Tie.

PubMed

Douglas, Pamela

2017-08-01

By performing an in-depth analysis of one high profile example, this article aims to help breastfeeding support professionals understand the methodological flaws that characterize recent studies claiming to show the efficacy of frenotomy for the diagnoses of posterior tongue-tie and upper lip-tie. The example study does not address definitional confusion or control for the effects of the passage of time. It does not consider the effects of caring attention, validation, and lactation consultant support. It also does not consider the extensive research over the past three decades that has established that reflux in the first 6 months of life is benign, even though increased reflux frequency may correlate with unsettled infant behavior. The study authors relied on the hypothesis that reflux is caused by excessive air swallowing in infants with poor latch due to posterior tongue-tie and upper lip-tie, which lacks credible physiological mechanisms or supporting evidence. The authors' claim that conducting a randomized controlled trial to investigate the efficacy of frenotomy would be unethical contradicts the basic principles of good science. This article argues that our breastfeeding women and their babies deserve the most rigorous scientific methods available, and acknowledgment of the biases inherent in less rigorous research, if we are to make appropriate decisions concerning intervention with frenotomy and to prevent unnecessary oral surgery.

Methodological Rigor in Preclinical Cardiovascular Studies

PubMed Central

Ramirez, F. Daniel; Motazedian, Pouya; Jung, Richard G.; Di Santo, Pietro; MacDonald, Zachary D.; Moreland, Robert; Simard, Trevor; Clancy, Aisling A.; Russo, Juan J.; Welch, Vivian A.; Wells, George A.

2017-01-01

Rationale: Methodological sources of bias and suboptimal reporting contribute to irreproducibility in preclinical science and may negatively affect research translation. Randomization, blinding, sample size estimation, and considering sex as a biological variable are deemed crucial study design elements to maximize the quality and predictive value of preclinical experiments. Objective: To examine the prevalence and temporal patterns of recommended study design element implementation in preclinical cardiovascular research. Methods and Results: All articles published over a 10-year period in 5 leading cardiovascular journals were reviewed. Reports of in vivo experiments in nonhuman mammals describing pathophysiology, genetics, or therapeutic interventions relevant to specific cardiovascular disorders were identified. Data on study design and animal model use were collected. Citations at 60 months were additionally examined as a surrogate measure of research impact in a prespecified subset of studies, stratified by individual and cumulative study design elements. Of 28 636 articles screened, 3396 met inclusion criteria. Randomization was reported in 21.8%, blinding in 32.7%, and sample size estimation in 2.3%. Temporal and disease-specific analyses show that the implementation of these study design elements has overall not appreciably increased over the past decade, except in preclinical stroke research, which has uniquely demonstrated significant improvements in methodological rigor. In a subset of 1681 preclinical studies, randomization, blinding, sample size estimation, and inclusion of both sexes were not associated with increased citations at 60 months. Conclusions: Methodological shortcomings are prevalent in preclinical cardiovascular research, have not substantially improved over the past 10 years, and may be overlooked when basing subsequent studies. Resultant risks of bias and threats to study validity have the potential to hinder progress in cardiovascular medicine as preclinical research often precedes and informs clinical trials. Stroke research quality has uniquely improved in recent years, warranting a closer examination for interventions to model in other cardiovascular fields. PMID:28373349

A novel design process for selection of attributes for inclusion in discrete choice experiments: case study exploring variation in clinical decision-making about thrombolysis in the treatment of acute ischaemic stroke.

PubMed

De Brún, Aoife; Flynn, Darren; Ternent, Laura; Price, Christopher I; Rodgers, Helen; Ford, Gary A; Rudd, Matthew; Lancsar, Emily; Simpson, Stephen; Teah, John; Thomson, Richard G

2018-06-22

A discrete choice experiment (DCE) is a method used to elicit participants' preferences and the relative importance of different attributes and levels within a decision-making process. DCEs have become popular in healthcare; however, approaches to identify the attributes/levels influencing a decision of interest and to selection methods for their inclusion in a DCE are under-reported. Our objectives were: to explore the development process used to select/present attributes/levels from the identified range that may be influential; to describe a systematic and rigorous development process for design of a DCE in the context of thrombolytic therapy for acute stroke; and, to discuss the advantages of our five-stage approach to enhance current guidance for developing DCEs. A five-stage DCE development process was undertaken. Methods employed included literature review, qualitative analysis of interview and ethnographic data, expert panel discussions, a quantitative structured prioritisation (ranking) exercise and pilot testing of the DCE using a 'think aloud' approach. The five-stage process reported helped to reduce the list of 22 initial patient-related factors to a final set of nine variable factors and six fixed factors for inclusion in a testable DCE using a vignette model of presentation. In order for the data and conclusions generated by DCEs to be deemed valid, it is crucial that the methods of design and development are documented and reported. This paper has detailed a rigorous and systematic approach to DCE development which may be useful to researchers seeking to establish methods for reducing and prioritising attributes for inclusion in future DCEs.

Study design elements for rigorous quasi-experimental comparative effectiveness research.

PubMed

Maciejewski, Matthew L; Curtis, Lesley H; Dowd, Bryan

2013-03-01

Quasi-experiments are likely to be the workhorse study design used to generate evidence about the comparative effectiveness of alternative treatments, because of their feasibility, timeliness, affordability and external validity compared with randomized trials. In this review, we outline potential sources of discordance in results between quasi-experiments and experiments, review study design choices that can improve the internal validity of quasi-experiments, and outline innovative data linkage strategies that may be particularly useful in quasi-experimental comparative effectiveness research. There is an urgent need to resolve the debate about the evidentiary value of quasi-experiments since equal consideration of rigorous quasi-experiments will broaden the base of evidence that can be brought to bear in clinical decision-making and governmental policy-making.

Prejudice reduction: what works? A review and assessment of research and practice.

PubMed

Paluck, Elizabeth Levy; Green, Donald P

2009-01-01

This article reviews the observational, laboratory, and field experimental literatures on interventions for reducing prejudice. Our review places special emphasis on assessing the methodological rigor of existing research, calling attention to problems of design and measurement that threaten both internal and external validity. Of the hundreds of studies we examine, a small fraction speak convincingly to the questions of whether, why, and under what conditions a given type of intervention works. We conclude that the causal effects of many widespread prejudice-reduction interventions, such as workplace diversity training and media campaigns, remain unknown. Although some intergroup contact and cooperation interventions appear promising, a much more rigorous and broad-ranging empirical assessment of prejudice-reduction strategies is needed to determine what works.

Do we need methodological theory to do qualitative research?

PubMed

Avis, Mark

2003-09-01

Positivism is frequently used to stand for the epistemological assumption that empirical science based on principles of verificationism, objectivity, and reproducibility is the foundation of all genuine knowledge. Qualitative researchers sometimes feel obliged to provide methodological alternatives to positivism that recognize their different ethical, ontological, and epistemological commitments and have provided three theories: phenomenology, grounded theory, and ethnography. The author argues that positivism was a doomed attempt to define empirical foundations for knowledge through a rigorous separation of theory and evidence; offers a pragmatic, coherent view of knowledge; and suggests that rigorous, rational empirical investigation does not need methodological theory. Therefore, qualitative methodological theory is unnecessary and counterproductive because it hinders critical reflection on the relation between methodological theory and empirical evidence.

Collected notes from the Benchmarks and Metrics Workshop

NASA Technical Reports Server (NTRS)

Drummond, Mark E.; Kaelbling, Leslie P.; Rosenschein, Stanley J.

1991-01-01

In recent years there has been a proliferation of proposals in the artificial intelligence (AI) literature for integrated agent architectures. Each architecture offers an approach to the general problem of constructing an integrated agent. Unfortunately, the ways in which one architecture might be considered better than another are not always clear. There has been a growing realization that many of the positive and negative aspects of an architecture become apparent only when experimental evaluation is performed and that to progress as a discipline, we must develop rigorous experimental methods. In addition to the intrinsic intellectual interest of experimentation, rigorous performance evaluation of systems is also a crucial practical concern to our research sponsors. DARPA, NASA, and AFOSR (among others) are actively searching for better ways of experimentally evaluating alternative approaches to building intelligent agents. One tool for experimental evaluation involves testing systems on benchmark tasks in order to assess their relative performance. As part of a joint DARPA and NASA funded project, NASA-Ames and Teleos Research are carrying out a research effort to establish a set of benchmark tasks and evaluation metrics by which the performance of agent architectures may be determined. As part of this project, we held a workshop on Benchmarks and Metrics at the NASA Ames Research Center on June 25, 1990. The objective of the workshop was to foster early discussion on this important topic. We did not achieve a consensus, nor did we expect to. Collected here is some of the information that was exchanged at the workshop. Given here is an outline of the workshop, a list of the participants, notes taken on the white-board during open discussions, position papers/notes from some participants, and copies of slides used in the presentations.

Bringing scientific rigor to community-developed programs in Hong Kong.

PubMed

Fabrizio, Cecilia S; Hirschmann, Malia R; Lam, Tai Hing; Cheung, Teresa; Pang, Irene; Chan, Sophia; Stewart, Sunita M

2012-12-31

This paper describes efforts to generate evidence for community-developed programs to enhance family relationships in the Chinese culture of Hong Kong, within the framework of community-based participatory research (CBPR). The CBPR framework was applied to help maximize the development of the intervention and the public health impact of the studies, while enhancing the capabilities of the social service sector partners. Four academic-community research teams explored the process of designing and implementing randomized controlled trials in the community. In addition to the expected cultural barriers between teams of academics and community practitioners, with their different outlooks, concerns and languages, the team navigated issues in utilizing the principles of CBPR unique to this Chinese culture. Eventually the team developed tools for adaptation, such as an emphasis on building the relationship while respecting role delineation and an iterative process of defining the non-negotiable parameters of research design while maintaining scientific rigor. Lessons learned include the risk of underemphasizing the size of the operational and skills shift between usual agency practices and research studies, the importance of minimizing non-negotiable parameters in implementing rigorous research designs in the community, and the need to view community capacity enhancement as a long term process. The four pilot studies under the FAMILY Project demonstrated that nuanced design adaptations, such as wait list controls and shorter assessments, better served the needs of the community and led to the successful development and vigorous evaluation of a series of preventive, family-oriented interventions in the Chinese culture of Hong Kong.

Why so many "rigorous" evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute.

PubMed

Bamberger, Michael; Tarsilla, Michele; Hesse-Biber, Sharlene

2016-04-01

Many widely-used impact evaluation designs, including randomized control trials (RCTs) and quasi-experimental designs (QEDs), frequently fail to detect what are often quite serious unintended consequences of development programs. This seems surprising as experienced planners and evaluators are well aware that unintended consequences frequently occur. Most evaluation designs are intended to determine whether there is credible evidence (statistical, theory-based or narrative) that programs have achieved their intended objectives and the logic of many evaluation designs, even those that are considered the most "rigorous," does not permit the identification of outcomes that were not specified in the program design. We take the example of RCTs as they are considered by many to be the most rigorous evaluation designs. We present a numbers of cases to illustrate how infusing RCTs with a mixed-methods approach (sometimes called an "RCT+" design) can strengthen the credibility of these designs and can also capture important unintended consequences. We provide a Mixed Methods Evaluation Framework that identifies 9 ways in which UCs can occur, and we apply this framework to two of the case studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Rigors of Training Evaluation: A Discussion and Field Demonstration

ERIC Educational Resources Information Center

Bunker, Kerry A.; Cohen, Stephen L.

1977-01-01

The objectives of this research are to report an application of a complex evaluation design, the classic Solomon 4-group, to an organizational training program and to demonstrate the necessity and feasibility of conducting research of this type. (Author/RK)

Study Designs and Evaluation Models for Emergency Department Public Health Research

PubMed Central

Broderick, Kerry B.; Ranney, Megan L.; Vaca, Federico E.; D’Onofrio, Gail; Rothman, Richard E.; Rhodes, Karin V.; Becker, Bruce; Haukoos, Jason S.

2011-01-01

Public health research requires sound design and thoughtful consideration of potential biases that may influence the validity of results. It also requires careful implementation of protocols and procedures that are likely to translate from the research environment to actual clinical practice. This article is the product of a breakout session from the 2009 Academic Emergency Medicine consensus conference entitled “Public Health in the ED: Screening, Surveillance, and Intervention” and serves to describe in detail aspects of performing emergency department (ED)-based public health research, while serving as a resource for current and future researchers. In doing so, the authors describe methodologic features of study design, participant selection and retention, and measurements and analyses pertinent to public health research. In addition, a number of recommendations related to research methods and future investigations related to public health work in the ED are provided. Public health investigators are poised to make substantial contributions to this important area of research, but this will only be accomplished by employing sound research methodology in the context of rigorous program evaluation. PMID:20053232

Beyond the Quantitative and Qualitative Divide: Research in Art Education as Border Skirmish.

ERIC Educational Resources Information Center

Sullivan, Graeme

1996-01-01

Analyzes a research project that utilizes a coherent conceptual model of art education research incorporating the demand for empirical rigor and providing for diverse interpretive frameworks. Briefly profiles the NUD*IST (Non-numerical Unstructured Data Indexing Searching and Theorizing) software system that can organize and retrieve complex…

THE USE OF RESEARCH RESULTS IN TEACHING SOCIAL WORK PRACTICE.

ERIC Educational Resources Information Center

LAWRENCE, RICHARD G.

BECAUSE THE SUCCESS OF INTERVENTION DEPENDS UPON THE VALIDITY OF THE PROPOSITIONS EMPLOYED, AND BECAUSE SCIENTIFIC RESEARCH ASSURES VALIDITY BY PROVIDING THE MOST SYSTEMATIC AND RIGOROUS ATTENTION TO PROBLEMS, THE UTILIZATION OF RESEARCH IS IMPORTANT TO SOCIAL WORK PRACTICE. SEVERAL FACTORS LIMIT ITS USE--(1) ALTHOUGH CONCEPTS ARE CLEARLY DEFINED…

Research: The Trouble with Research, Part 3

ERIC Educational Resources Information Center

Bracey, Gerald W.

2004-01-01

Gerald Bracey thought that after devoting the March and April columns to various kinds of "trouble" with research, he was done with it. But he had yet to encounter a December 2003 publication from the U.S. Department of Education (ED) titled Identifying and Implementing Educational Practices Supported by Rigorous Evidence: A User Friendly Guide.…

Building a Foundation for Knowledge Management Research: Developing, Validating, and Applying the Knowledge Internalization Construct

ERIC Educational Resources Information Center

Wipawayangkool, Kamphol

2011-01-01

The notion of knowledge internalization (KI), albeit a critical link in Nonaka's (1994) organizational knowledge creation theory, has not been rigorously conceptualized and defined, let alone operationalized. To strengthen the foundation for knowledge management (KM) research, we attempt to fulfill the following research objectives in the three…

Methodological Issues and Practical Problems in Conducting Research on Abused Children.

ERIC Educational Resources Information Center

Kinard, E. Milling

In order to inform policy and programs, research on child abuse must be not only methodologically rigorous, but also practically feasible. However, practical problems make child abuse research difficult to conduct. Definitions of abuse must be explicit and different types of abuse must be assessed separately. Study samples should be as…

Redefining Authentic Research Experiences in Introductory Biology Laboratories and Barriers to Their Implementation

ERIC Educational Resources Information Center

Spell, Rachelle M.; Guinan, Judith A.; Miller, Kristen R.; Beck, Christopher W.

2014-01-01

Incorporating authentic research experiences in introductory biology laboratory classes would greatly expand the number of students exposed to the excitement of discovery and the rigor of the scientific process. However, the essential components of an authentic research experience and the barriers to their implementation in laboratory classes are…

Practice as Research: A Fine Art Contextual Study

ERIC Educational Resources Information Center

Adams, Suze

2014-01-01

This paper examines the dynamic interplay between practice and theory in practice-led research in the visual arts. Building on recent debate around the issue and following appropriately rigorous models, the importance of locating a suitable methodology to adequately reflect the integrated process of research practice in written as well as visual…

Dan Olweus: Award for Distinguished Contributions to Research in Public Policy

ERIC Educational Resources Information Center

American Psychologist, 2012

2012-01-01

Presents a short biography of the winner of the American Psychological Association's Award for Distinguished Contributions to Research in Public Policy. The 2012 winner is Dan Olweus for his rigorous scientific research on bullying among children and youth and his early and tireless attention to its public policy implications. Dan Olweus's…

Control group design: enhancing rigor in research of mind-body therapies for depression.

PubMed

Kinser, Patricia Anne; Robins, Jo Lynne

2013-01-01

Although a growing body of research suggests that mind-body therapies may be appropriate to integrate into the treatment of depression, studies consistently lack methodological sophistication particularly in the area of control groups. In order to better understand the relationship between control group selection and methodological rigor, we provide a brief review of the literature on control group design in yoga and tai chi studies for depression, and we discuss challenges we have faced in the design of control groups for our recent clinical trials of these mind-body complementary therapies for women with depression. To address the multiple challenges of research about mind-body therapies, we suggest that researchers should consider 4 key questions: whether the study design matches the research question; whether the control group addresses performance, expectation, and detection bias; whether the control group is ethical, feasible, and attractive; and whether the control group is designed to adequately control for nonspecific intervention effects. Based on these questions, we provide specific recommendations about control group design with the goal of minimizing bias and maximizing validity in future research.

Control Group Design: Enhancing Rigor in Research of Mind-Body Therapies for Depression

PubMed Central

Kinser, Patricia Anne; Robins, Jo Lynne

2013-01-01

Although a growing body of research suggests that mind-body therapies may be appropriate to integrate into the treatment of depression, studies consistently lack methodological sophistication particularly in the area of control groups. In order to better understand the relationship between control group selection and methodological rigor, we provide a brief review of the literature on control group design in yoga and tai chi studies for depression, and we discuss challenges we have faced in the design of control groups for our recent clinical trials of these mind-body complementary therapies for women with depression. To address the multiple challenges of research about mind-body therapies, we suggest that researchers should consider 4 key questions: whether the study design matches the research question; whether the control group addresses performance, expectation, and detection bias; whether the control group is ethical, feasible, and attractive; and whether the control group is designed to adequately control for nonspecific intervention effects. Based on these questions, we provide specific recommendations about control group design with the goal of minimizing bias and maximizing validity in future research. PMID:23662111

Measuring Sexual and Gender Minority Populations in Health Surveillance

PubMed Central

Jabson, Jennifer M.; Bowen, Deborah J.

2017-01-01

Abstract Purpose: Sexual and gender minorities (SGMs) are underrepresented and information about SGMs is difficult to locate in national health surveillance data, and this limits identification and resolution of SGM health disparities. It is also not known how measures of sexual orientation and transgender-inclusive gender identity in health surveillance compare with best practice recommendations. This article reviews and summarizes the publicly available, English language, large-scale, rigorously sampled, national, international, and regional data sources that include sexual orientation or transgender-inclusive gender identity and compares measures with best practice guidelines. Methods: A systematic review was undertaken of national, international, state, and regional health surveillance data sources. Data sources that measured sexual orientation or transgender-inclusive gender identity and met seven inclusion criteria were included. Results: Forty-three publicly accessible national, international, and regional data sources included measures of sexual orientation and transgender-inclusive gender identity and health. For each data source, sampling design, sample characteristics, study years, survey questions, contact persons, and data access links are provided. Few data sources met best practice recommendations for SGM measurement: 14% measured all three dimensions of sexual orientation (identity, behavior, attraction) as recommended by the Sexual Minority Assessment Research Team. No data sources measured transgender-inclusive gender identity according to the Gender Identity in U.S. Surveillance-recommended two-step method of measuring sex assigned at birth and current gender identity. Conclusions: This article provides a much needed detailed summary of extant health surveillance data sources that can be used to inform research about health risks and disparities among SGM populations. Future recommendations are for more rigorous measurement and oversampling to advance what is known about SGM health disparities and guide development of interventions to reduce disparities. PMID:28287877

Treatments of Missing Values in Large National Data Affect Conclusions: The Impact of Multiple Imputation on Arthroplasty Research.

PubMed

Ondeck, Nathaniel T; Fu, Michael C; Skrip, Laura A; McLynn, Ryan P; Su, Edwin P; Grauer, Jonathan N

2018-03-01

Despite the advantages of large, national datasets, one continuing concern is missing data values. Complete case analysis, where only cases with complete data are analyzed, is commonly used rather than more statistically rigorous approaches such as multiple imputation. This study characterizes the potential selection bias introduced using complete case analysis and compares the results of common regressions using both techniques following unicompartmental knee arthroplasty. Patients undergoing unicompartmental knee arthroplasty were extracted from the 2005 to 2015 National Surgical Quality Improvement Program. As examples, the demographics of patients with and without missing preoperative albumin and hematocrit values were compared. Missing data were then treated with both complete case analysis and multiple imputation (an approach that reproduces the variation and associations that would have been present in a full dataset) and the conclusions of common regressions for adverse outcomes were compared. A total of 6117 patients were included, of which 56.7% were missing at least one value. Younger, female, and healthier patients were more likely to have missing preoperative albumin and hematocrit values. The use of complete case analysis removed 3467 patients from the study in comparison with multiple imputation which included all 6117 patients. The 2 methods of handling missing values led to differing associations of low preoperative laboratory values with commonly studied adverse outcomes. The use of complete case analysis can introduce selection bias and may lead to different conclusions in comparison with the statistically rigorous multiple imputation approach. Joint surgeons should consider the methods of handling missing values when interpreting arthroplasty research. Copyright © 2017 Elsevier Inc. All rights reserved.

Cultural Competence in the Treatment of Addictions: Theory, Practice and Evidence.

PubMed

Gainsbury, Sally M

2017-07-01

Culturally and linguistically diverse (CALD) populations often have high rates of addictive disorders, but lower rates of treatment seeking and completion than the mainstream population. A significant barrier to treatment is the lack of culturally relevant and appropriate treatment. A literature review was conducted to identify relevant literature related to cultural competence in mental health services delivery and specifically treatment for addictive disorders. Several theoretical models of cultural competence in therapy have been developed, but the lack of rigorous research limits the empirical evidence available. Research indicates that culturally competent treatment practices including providing therapy and materials in the client's language, knowledge, understanding and appreciation for cultural perspectives and nuances, involving the wider family and community and training therapists can enhance client engagement, retention and treatment outcomes for substance use and gambling. Further methodologically rigorous research is needed to isolate the impact of cultural competence for the treatment of addictions and guide research to determine treatment efficacy within specific CALD populations. Training therapists and recruiting therapists and researchers from CALD communities is important to ensure an ongoing focus and improved outcomes for CALD populations due to the importance of engaging these populations with addiction treatment. Copyright © 2016 John Wiley & Sons, Ltd. Key Practitioner Message: The treatment needs of culturally diverse individuals with addictions are often not met. Theoretical models can guide therapists in incorporating cultural competence. Culturally targeted treatments increase recruitment, retention and treatment outcomes. Cultural competence includes matching clinicians and clients on linguistic and cultural backgrounds as well as being mindful of the impact of culture on client's experience of addiction problems. Few methodologically rigorous trials have been conducted to guide treatment practices and research needs to be incorporated into existing culturally relevant treatment services. Copyright © 2016 John Wiley & Sons, Ltd.

Evaluation of physical dimension changes as nondestructive measurements for monitoring rigor mortis development in broiler muscles.

PubMed

Cavitt, L C; Sams, A R

2003-07-01

Studies were conducted to develop a non-destructive method for monitoring the rate of rigor mortis development in poultry and to evaluate the effectiveness of electrical stimulation (ES). In the first study, 36 male broilers in each of two trials were processed at 7 wk of age. After being bled, half of the birds received electrical stimulation (400 to 450 V, 400 to 450 mA, for seven pulses of 2 s on and 1 s off), and the other half were designated as controls. At 0.25 and 1.5 h postmortem (PM), carcasses were evaluated for the angles of the shoulder, elbow, and wing tip and the distance between the elbows. Breast fillets were harvested at 1.5 h PM (after chilling) from all carcasses. Fillet samples were excised and frozen for later measurement of pH and R-value, and the remainder of each fillet was held on ice until 24 h postmortem. Shear value and pH means were significantly lower, but R-value means were higher (P < 0.05) for the ES fillets compared to the controls, suggesting acceleration of rigor mortis by ES. The physical dimensions of the shoulder and elbow changed (P < 0.05) during rigor mortis development and with ES. These results indicate that physical measurements of the wings maybe useful as a nondestructive indicator of rigor development and for monitoring the effectiveness of ES. In the second study, 60 male broilers in each of two trials were processed at 7 wk of age. At 0.25, 1.5, 3.0, and 6.0 h PM, carcasses were evaluated for the distance between the elbows. At each time point, breast fillets were harvested from each carcass. Fillet samples were excised and frozen for later measurement of pH and sacromere length, whereas the remainder of each fillet was held on ice until 24 h PM. Shear value and pH means (P < 0.05) decreased, whereas sarcomere length means (P < 0.05) increased over time, indicating rigor mortis development. Elbow distance decreased (P < 0.05) with rigor development and was correlated (P < 0.01) with shear value (r = 0.2581), sarcomere length (r = -0.3079), and pH (r = 0.6303). These results suggest that elbow distance could be used in conjunction with other detection methods for optically automating measurement of rigor mortis development in broiler carcasses.

Constrained Optimization Methods in Health Services Research-An Introduction: Report 1 of the ISPOR Optimization Methods Emerging Good Practices Task Force.

PubMed

Crown, William; Buyukkaramikli, Nasuh; Thokala, Praveen; Morton, Alec; Sir, Mustafa Y; Marshall, Deborah A; Tosh, Jon; Padula, William V; Ijzerman, Maarten J; Wong, Peter K; Pasupathy, Kalyan S

2017-03-01

Providing health services with the greatest possible value to patients and society given the constraints imposed by patient characteristics, health care system characteristics, budgets, and so forth relies heavily on the design of structures and processes. Such problems are complex and require a rigorous and systematic approach to identify the best solution. Constrained optimization is a set of methods designed to identify efficiently and systematically the best solution (the optimal solution) to a problem characterized by a number of potential solutions in the presence of identified constraints. This report identifies 1) key concepts and the main steps in building an optimization model; 2) the types of problems for which optimal solutions can be determined in real-world health applications; and 3) the appropriate optimization methods for these problems. We first present a simple graphical model based on the treatment of "regular" and "severe" patients, which maximizes the overall health benefit subject to time and budget constraints. We then relate it back to how optimization is relevant in health services research for addressing present day challenges. We also explain how these mathematical optimization methods relate to simulation methods, to standard health economic analysis techniques, and to the emergent fields of analytics and machine learning. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Implementing systematic review techniques in chemical risk assessment: Challenges, opportunities and recommendations.

PubMed

Whaley, Paul; Halsall, Crispin; Ågerstrand, Marlene; Aiassa, Elisa; Benford, Diane; Bilotta, Gary; Coggon, David; Collins, Chris; Dempsey, Ciara; Duarte-Davidson, Raquel; FitzGerald, Rex; Galay-Burgos, Malyka; Gee, David; Hoffmann, Sebastian; Lam, Juleen; Lasserson, Toby; Levy, Len; Lipworth, Steven; Ross, Sarah Mackenzie; Martin, Olwenn; Meads, Catherine; Meyer-Baron, Monika; Miller, James; Pease, Camilla; Rooney, Andrew; Sapiets, Alison; Stewart, Gavin; Taylor, David

2016-01-01

Systematic review (SR) is a rigorous, protocol-driven approach designed to minimise error and bias when summarising the body of research evidence relevant to a specific scientific question. Taking as a comparator the use of SR in synthesising research in healthcare, we argue that SR methods could also pave the way for a "step change" in the transparency, objectivity and communication of chemical risk assessments (CRA) in Europe and elsewhere. We suggest that current controversies around the safety of certain chemicals are partly due to limitations in current CRA procedures which have contributed to ambiguity about the health risks posed by these substances. We present an overview of how SR methods can be applied to the assessment of risks from chemicals, and indicate how challenges in adapting SR methods from healthcare research to the CRA context might be overcome. Regarding the latter, we report the outcomes from a workshop exploring how to increase uptake of SR methods, attended by experts representing a wide range of fields related to chemical toxicology, risk analysis and SR. Priorities which were identified include: the conduct of CRA-focused prototype SRs; the development of a recognised standard of reporting and conduct for SRs in toxicology and CRA; and establishing a network to facilitate research, communication and training in SR methods. We see this paper as a milestone in the creation of a research climate that fosters communication between experts in CRA and SR and facilitates wider uptake of SR methods into CRA. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

A rigorous and simpler method of image charges

NASA Astrophysics Data System (ADS)

Ladera, C. L.; Donoso, G.

2016-07-01

The method of image charges relies on the proven uniqueness of the solution of the Laplace differential equation for an electrostatic potential which satisfies some specified boundary conditions. Granted by that uniqueness, the method of images is rightly described as nothing but shrewdly guessing which and where image charges are to be placed to solve the given electrostatics problem. Here we present an alternative image charges method that is based not on guessing but on rigorous and simpler theoretical grounds, namely the constant potential inside any conductor and the application of powerful geometric symmetries. The aforementioned required uniqueness and, more importantly, guessing are therefore both altogether dispensed with. Our two new theoretical fundaments also allow the image charges method to be introduced in earlier physics courses for engineering and sciences students, instead of its present and usual introduction in electromagnetic theory courses that demand familiarity with the Laplace differential equation and its boundary conditions.

Improving estimates of the number of `fake' leptons and other mis-reconstructed objects in hadron collider events: BoB's your UNCLE

NASA Astrophysics Data System (ADS)

Gillam, Thomas P. S.; Lester, Christopher G.

2014-11-01

We consider current and alternative approaches to setting limits on new physics signals having backgrounds from misidentified objects; for example jets misidentified as leptons, b-jets or photons. Many ATLAS and CMS analyses have used a heuristic "matrix method" for estimating the background contribution from such sources. We demonstrate that the matrix method suffers from statistical shortcomings that can adversely affect its ability to set robust limits. A rigorous alternative method is discussed, and is seen to produce fake rate estimates and limits with better qualities, but is found to be too costly to use. Having investigated the nature of the approximations used to derive the matrix method, we propose a third strategy that is seen to marry the speed of the matrix method to the performance and physicality of the more rigorous approach.

Trends in Study Methods Used in Undergraduate Medical Education Research, 1969–2007

PubMed Central

Baernstein, Amy; Liss, Hillary K.; Carney, Patricia A.; Elmore, Joann G.

2011-01-01

Context Evidence-based medical education requires rigorous studies appraising educational efficacy. Objectives To assess trends over time in methods used to evaluate undergraduate medical education interventions and to identify whether participation of medical education departments or centers is associated with more rigorous methods. Data Sources The PubMed, Cochrane Controlled Trials Registry, Campbell Collaboration, and ERIC databases (January 1966–March 2007) were searched using terms equivalent to students, medical and education, medical crossed with all relevant study designs. Study Selection We selected publications in all languages from every fifth year, plus the most recent 12 months, that evaluated an educational intervention for undergraduate medical students. Four hundred seventy-two publications met criteria for review. Data Extraction Data were abstracted on number of participants; types of comparison groups; whether outcomes assessed were objective, subjective, and/or validated; timing of outcome assessments; funding; and participation of medical education departments and centers. Ten percent of publications were independently abstracted by 2 authors to assess validity of the data abstraction. Results The annual number of publications increased over time from 1 (1969–1970) to 147 (2006–2007). In the most recent year, there was a mean of 145 medical student participants; 9 (6%) recruited participants from multiple institutions; 80 (54%) used comparison groups; 37 (25%) used randomized control groups; 91 (62%) had objective outcomes; 23 (16%) had validated outcomes; 35 (24%) assessed an outcome more than 1 month later; 21 (14%) estimated statistical power; and 66 (45%) reported funding. In 2006–2007, medical education department or center participation, reported in 46 (31%) of the recent publications, was associated only with enrolling more medical student participants (P = .04); for all studies from 1969 to 2007, it was associated only with measuring an objective outcome (P = .048). Between 1969 and 2007, the percentage of publications reporting statistical power and funding increased; percentages did not change for other study features. Conclusions The annual number of published studies of undergraduate medical education interventions demonstrating methodological rigor has been increasing. However, considerable opportunities for improvement remain. PMID:17785648

B-ALL minimal residual disease flow cytometry: an application of a novel method for optimization of a single-tube model.

PubMed

Shaver, Aaron C; Greig, Bruce W; Mosse, Claudio A; Seegmiller, Adam C

2015-05-01

Optimizing a clinical flow cytometry panel can be a subjective process dependent on experience. We develop a quantitative method to make this process more rigorous and apply it to B lymphoblastic leukemia/lymphoma (B-ALL) minimal residual disease (MRD) testing. We retrospectively analyzed our existing three-tube, seven-color B-ALL MRD panel and used our novel method to develop an optimized one-tube, eight-color panel, which was tested prospectively. The optimized one-tube, eight-color panel resulted in greater efficiency of time and resources with no loss in diagnostic power. Constructing a flow cytometry panel using a rigorous, objective, quantitative method permits optimization and avoids problems of interdependence and redundancy in a large, multiantigen panel. Copyright© by the American Society for Clinical Pathology.

Psychiatric Brain Banking: Three Perspectives on Current Trends and Future Directions

PubMed Central

Deep-Soboslay, Amy; Benes, Francine M.; Haroutunian, Vahram; Ellis, Justin K.; Kleinman, Joel E.; Hyde, Thomas M.

2011-01-01

Introduction The study of postmortem human brain tissue is central to the advancement of the neurobiological studies of psychiatric illness, particularly for the study of brain-specific isoforms and molecules. Methods The state-of-the-art methods and recommendations for maintaining a successful brain bank for psychiatric disorders are discussed, using the convergence of viewpoints from three brain collections, the National Institute of Mental Health Brain Collection (NIMH), the Harvard Brain Tissue Resource Center (HBTRC), and the Mt. Sinai School of Medicine Brain Bank (MSSM-BB), with diverse research interests and divergent approaches to tissue acquisition. Results While the NIMH obtains donations from medical examiners for its collection, and places particular emphasis on clinical diagnosis, toxicology, and building lifespan control cohorts, the HBTRC is uniquely designed as a repository whose sole purpose is to collect large-volume, high quality brain tissue from community-based donors based on relationships across an expansive nationwide network, and places emphasis on the accessibility of its bank in disseminating tissue and related data to research groups worldwide. The MSSM-BB collection has shown that, with dedication, prospective recruitment is a successful approach to tissue donation, and places particular emphasis on rigorous clinical diagnosis through antemortem contact with donors. The MSSM-BB places great importance on stereological tissue sampling methods for neuroanatomical studies, and frozen tissue sampling approaches that enable multiple assessments (RNA, DNA, protein, enzyme activity, binding, etc.) of the same tissue block. Promising scientific approaches for elucidating the molecular and cellular pathways in brain that may contribute to schizophrenia and/or bipolar disorder, such as cell culture techniques and microarray-based gene expression and genotyping studies are briefly discussed. Conclusions Despite unique perspectives from three established brain collections, there is a consensus that (1) diverse strategies for tissue acquisition, (2) rigor in tissue and diagnostic characterization, (3) the importance of sample accessibility, and (4) continual application of innovative scientific approaches to the study of brain tissue are all integral to the success and future of psychiatric brain banking. The future of neuropsychiatric research depends upon in the availability of high quality brain specimens from large numbers of subjects, including non-psychiatric controls. PMID:20673875

The T-TEL Method for Assessing Water, Sediment, and Chemical Connectivity

NASA Astrophysics Data System (ADS)

Ali, Genevieve; Oswald, Claire; Spence, Christopher; Wellen, Christopher

2018-02-01

The concept of connectivity has been the subject of a great deal of recent research and provided new insights and breakthroughs on runoff generation processes and watershed biogeochemistry. However, a consensus definition and cohesive mathematical framework that would permit the consistent quantification of hydrologic connectivity, the examination of the interrelationships between water and material (e.g., sediment and chemicals) connectivity, or rigorous study intercomparison, have not been presented by the water resource community. Building on previous conceptualizations and site-specific or process-specific metrics, this paper aimed to review the current state of science on hydrologic connectivity and its role in water-mediated connectivity of material such as solutes and sediment before introducing a conceptual and a mathematical connectivity assessment framework. These frameworks rely on the quantification of Time scales, Thresholds, Excesses and Losses related to water and water-mediated material transport dynamics and are referred to as the T-TEL method. Through a small case study, we show how the T-TEL method allows a wide range of properties to be quantified, namely the occurrence, frequency, duration, magnitude, and spatial extent of water and water-mediated material connectivity. We also propose a research agenda to refine the T-TEL method and ensure its usefulness for facilitating the research and management of connectivity in pristine and human-impacted landscapes.

Yoga for Arthritis: A Scoping Review

PubMed Central

Haaz, Steffany; Bartlett, Susan J.

2010-01-01

Synopsis The aim of this article was to systematically review the existing literature on the use of yoga for persons with arthritis. We included peer-reviewed research from clinical trials (published from 1980-2010) that used yoga as an intervention for arthritis patients and reported quantitative findings. Eleven studies were identified, including four RCTs and four NRCTs. All trials were small and control groups varied. No adverse events were reported and attrition was comparable or better than typical for exercise interventions. Evidence was strongest for reduction in disease symptoms (tender/swollen joints, pain) and disability, as well as improved self-efficacy and mental health. Interventions, research methods and disease diagnoses were heterogeneous. Larger, rigorous RCTs are necessary to more effectively quantify the effects of yoga for arthritic populations PMID:21220084

The role and impact of nurses in American elementary schools: a systematic review of the research.

PubMed

Lineberry, Michelle J; Ickes, Melinda J

2015-02-01

School nurses are tasked with the critical job of keeping students safe and well. Due to competing demands for resources in schools, the impact of school nurses must be demonstrated to secure their jobs. A systematic review of the literature from 1937 to 2013 was conducted to show the efficacy of school nursing activities in American elementary schools. While some studies of immunization compliance, attendance rates, body mass index screening, vision screening, and follow-up are promising, results are mixed and additional evidence is needed. The impact of school nurses on educational and health outcomes must continue to be evaluated and more rigorous evaluation methods should be explored. Suggestions for future research and collaborations are discussed. © The Author(s) 2014.

Introductory Overview of the Natural Experiments for Translation in Diabetes 2.0 (NEXT-D2) Network: Examining the Impact of US Health Policies and Practices to Prevent Diabetes and Its Complications.

PubMed

Duru, O Kenrik; Mangione, Carol M; Rodriguez, Hector P; Ross-Degnan, Dennis; Wharam, J Frank; Black, Bernard; Kho, Abel; Huguet, Nathalie; Angier, Heather; Mayer, Victoria; Siscovick, David; Kraschnewski, Jennifer L; Shi, Lizheng; Nauman, Elizabeth; Gregg, Edward W; Ali, Mohammed K; Thornton, Pamela; Clauser, Steven

2018-02-05

Diabetes incidence is rising among vulnerable population subgroups including minorities and individuals with limited education. Many diabetes-related programs and public policies are unevaluated while others are analyzed with research designs highly susceptible to bias which can result in flawed conclusions. The Natural Experiments for Translation in Diabetes 2.0 (NEXT-D2) Network includes eight research centers and three funding agencies using rigorous methods to evaluate natural experiments in health policy and program delivery. NEXT-D2 research studies use quasi-experimental methods to assess three major areas as they relate to diabetes: health insurance expansion; healthcare financing and payment models; and innovations in care coordination. The studies will report on preventive processes, achievement of diabetes care goals, and incidence of complications. Some studies assess healthcare utilization while others focus on patient-reported outcomes. NEXT-D2 examines the effect of public and private policies on diabetes care and prevention at a critical time, given ongoing and rapid shifts in the US health policy landscape.

Developing Army Leaders through Increased Rigor in Professional Military Training and Education

DTIC Science & Technology

2017-06-09

leadership. Research Methodology An applied, exploratory, qualitative research methodology via a structured and focused case study comparison was...research methodology via a structured and focused case study comparison. Finally, it will discuss how the methodology will be conducted to make...development models; it serves as the base data for case study comparison. 48 Research Methodology and Data Analysis A qualitative research

Introduction to the special issue on recentering science: Replication, robustness, and reproducibility in psychophysiology.

PubMed

Kappenman, Emily S; Keil, Andreas

2017-01-01

In recent years, the psychological and behavioral sciences have increased efforts to strengthen methodological practices and publication standards, with the ultimate goal of enhancing the value and reproducibility of published reports. These issues are especially important in the multidisciplinary field of psychophysiology, which yields rich and complex data sets with a large number of observations. In addition, the technological tools and analysis methods available in the field of psychophysiology are continually evolving, widening the array of techniques and approaches available to researchers. This special issue presents articles detailing rigorous and systematic evaluations of tasks, measures, materials, analysis approaches, and statistical practices in a variety of subdisciplines of psychophysiology. These articles highlight challenges in conducting and interpreting psychophysiological research and provide data-driven, evidence-based recommendations for overcoming those challenges to produce robust, reproducible results in the field of psychophysiology. © 2016 Society for Psychophysiological Research.

The importance of early investigation and publishing in an emergent health and environment crisis.

PubMed

Murase, Kaori

2016-10-01

To minimize the damage resulting from a long-term environmental disaster such as the 2011 Fukushima nuclear accident in Japan, early disclosure of research data by scientists and prompt decision making by government authorities are required in place of careful, time-consuming research and deliberation about the consequences and cause of the accident. A Bayesian approach with flexible statistical modeling helps scientists and encourages government authorities to make decisions based on environmental data available in the early stages of a disaster. It is evident from Fukushima and similar accidents that classical research methods involving statistical methodologies that require rigorous experimental design and complex data sets are too cumbersome and delay important actions that may be critical in the early stages of an environmental disaster. Integr Environ Assess Manag 2016;12:680-682. © 2016 SETAC. © 2016 SETAC.

Recent Advances in Durability and Damage Tolerance Methodology at NASA Langley Research Center

NASA Technical Reports Server (NTRS)

Ransom, J. B.; Glaessgen, E. H.; Raju, I. S.; Harris, C. E.

2007-01-01

Durability and damage tolerance (D&DT) issues are critical to the development of lighter, safer and more efficient aerospace vehicles. Durability is largely an economic life-cycle design consideration whereas damage tolerance directly addresses the structural airworthiness (safety) of the vehicle. Both D&DT methodologies must address the deleterious effects of changes in material properties and the initiation and growth of damage that may occur during the vehicle s service lifetime. The result of unanticipated D&DT response is often manifested in the form of catastrophic and potentially fatal accidents. As such, durability and damage tolerance requirements must be rigorously addressed for commercial transport aircraft and NASA spacecraft systems. This paper presents an overview of the recent and planned future research in durability and damage tolerance analytical and experimental methods for both metallic and composite aerospace structures at NASA Langley Research Center (LaRC).

Pretesting Qualitative Data Collection Procedures to Facilitate Methodological Adherence and Team Building in Nigeria.

PubMed

Hurst, Samantha; Arulogun, Oyedunni S; Owolabi, Ayowa O; Akinyemi, Rufus; Uvere, Ezinne; Warth, Stephanie; Ovbiagele, Bruce

Qualitative methods are becoming widely used and increasingly accepted in biomedical research involving teams formed by experts from developing and developed practice environments. Resources are rare in offering guidance on how to surmount challenges of team integration and resolution of complicated logistical issues in a global setting. In this article we present a critical reflection of lessons learned and necessary steps taken to achieve methodological coherence and international team synergy. A series of 10 pretest interviews were conducted to assess instrumentation rigor and formulate measures to address any limitations or threats to bias and management procedures before carrying out the formal phase of qualitative research, contributing to an evidence-based stroke-preventive care clinical trial study. The experience of pretesting notably helped to identify obstacles and thus increase the methodological and social reliability central to conducting credible qualitative research, while also ensuring both personal and professional fulfillment of our team members.

The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit.

PubMed

Chan, Yu-Feng Yvonne; Wang, Pei; Rogers, Linda; Tignor, Nicole; Zweig, Micol; Hershman, Steven G; Genes, Nicholas; Scott, Erick R; Krock, Eric; Badgeley, Marcus; Edgar, Ron; Violante, Samantha; Wright, Rosalind; Powell, Charles A; Dudley, Joel T; Schadt, Eric E

2017-04-01

The feasibility of using mobile health applications to conduct observational clinical studies requires rigorous validation. Here, we report initial findings from the Asthma Mobile Health Study, a research study, including recruitment, consent, and enrollment, conducted entirely remotely by smartphone. We achieved secure bidirectional data flow between investigators and 7,593 participants from across the United States, including many with severe asthma. Our platform enabled prospective collection of longitudinal, multidimensional data (e.g., surveys, devices, geolocation, and air quality) in a subset of users over the 6-month study period. Consistent trending and correlation of interrelated variables support the quality of data obtained via this method. We detected increased reporting of asthma symptoms in regions affected by heat, pollen, and wildfires. Potential challenges with this technology include selection bias, low retention rates, reporting bias, and data security. These issues require attention to realize the full potential of mobile platforms in research and patient care.

Key considerations for the experimental training and evaluation of cancer odour detection dogs: lessons learnt from a double-blind, controlled trial of prostate cancer detection

PubMed Central

2014-01-01

Background Cancer detection using sniffer dogs is a potential technology for clinical use and research. Our study sought to determine whether dogs could be trained to discriminate the odour of urine from men with prostate cancer from controls, using rigorous testing procedures and well-defined samples from a major research hospital. Methods We attempted to train ten dogs by initially rewarding them for finding and indicating individual prostate cancer urine samples (Stage 1). If dogs were successful in Stage 1, we then attempted to train them to discriminate prostate cancer samples from controls (Stage 2). The number of samples used to train each dog varied depending on their individual progress. Overall, 50 unique prostate cancer and 67 controls were collected and used during training. Dogs that passed Stage 2 were tested for their ability to discriminate 15 (Test 1) or 16 (Tests 2 and 3) unfamiliar prostate cancer samples from 45 (Test 1) or 48 (Tests 2 and 3) unfamiliar controls under double-blind conditions. Results Three dogs reached training Stage 2 and two of these learnt to discriminate potentially familiar prostate cancer samples from controls. However, during double-blind tests using new samples the two dogs did not indicate prostate cancer samples more frequently than expected by chance (Dog A sensitivity 0.13, specificity 0.71, Dog B sensitivity 0.25, specificity 0.75). The other dogs did not progress past Stage 1 as they did not have optimal temperaments for the sensitive odour discrimination training. Conclusions Although two dogs appeared to have learnt to select prostate cancer samples during training, they did not generalise on a prostate cancer odour during robust double-blind tests involving new samples. Our study illustrates that these rigorous tests are vital to avoid drawing misleading conclusions about the abilities of dogs to indicate certain odours. Dogs may memorise the individual odours of large numbers of training samples rather than generalise on a common odour. The results do not exclude the possibility that dogs could be trained to detect prostate cancer. We recommend that canine olfactory memory is carefully considered in all future studies and rigorous double-blind methods used to avoid confounding effects. PMID:24575737

Using Research Evidence in Education: From the Schoolhouse Door to Capitol Hill. Policy Implications of Research in Education

ERIC Educational Resources Information Center

Finnigan, Kara S., Ed.; Daly, Alan J., Ed.

2014-01-01

This book includes a set of rigorous and accessible studies on the topic of "research evidence" from a variety of levels and educational vantage points. It also provides the reader with thoughtful commentaries from leading thinkers in the field. The complex process of acquiring, interpreting, and using research evidence makes for a rich…

Research Strategy 2002-5. Influencing the Future: Informing Policy and Improving Practice through Research.

ERIC Educational Resources Information Center

Dewsbury, Angela, Ed.

England's Learning and Skills Research Centre (LSRC) is working to build a strong body of evidence from rigorous research that is focused on critical and innovative thinking and models and solutions for the long-term development of post-16 learning. In 2002-2005, the LSRC will focus on the following activities and goals: identify key priorities;…

Determinants of the Rigor of State Protection Policies for Persons With Dementia in Assisted Living.

PubMed

Nattinger, Matthew C; Kaskie, Brian

2017-01-01

Continued growth in the number of individuals with dementia residing in assisted living (AL) facilities raises concerns about their safety and protection. However, unlike federally regulated nursing facilities, AL facilities are state-regulated and there is a high degree of variation among policies designed to protect persons with dementia. Despite the important role these protection policies have in shaping the quality of life of persons with dementia residing in AL facilities, little is known about their formation. In this research, we examined the adoption of AL protection policies pertaining to staffing, the physical environment, and the use of chemical restraints. For each protection policy type, we modeled policy rigor using an innovative point-in-time approach, incorporating variables associated with state contextual, institutional, political, and external factors. We found that the rate of state AL protection policy adoptions remained steady over the study period, with staffing policies becoming less rigorous over time. Variables reflecting institutional policy making, including legislative professionalism and bureaucratic oversight, were associated with the rigor of state AL dementia protection policies. As we continue to evaluate the mechanisms contributing to the rigor of AL protection policies, it seems that organized advocacy efforts might expand their role in educating state policy makers about the importance of protecting persons with dementia residing in AL facilities and moving to advance appropriate policies.

The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned.

PubMed

Joe, Jonathan; Chaudhuri, Shomir; Le, Thai; Thompson, Hilaire; Demiris, George

2015-08-01

While health information technologies have become increasingly popular, many have not been formally tested to ascertain their usability. Traditional rigorous methods take significant amounts of time and manpower to evaluate the usability of a system. In this paper, we evaluate the use of instant data analysis (IDA) as developed by Kjeldskov et al. to perform usability testing on a tool designed for older adults and caregivers. The IDA method is attractive because it takes significantly less time and manpower than the traditional usability testing methods. In this paper we demonstrate how IDA was used to evaluate usability of a multifunctional wellness tool, discuss study results and lessons learned while using this method. We also present findings from an extension of the method which allows the grouping of similar usability problems in an efficient manner. We found that the IDA method is a quick, relatively easy approach to identifying and ranking usability issues among health information technologies. Copyright © 2015 Elsevier Inc. All rights reserved.

Experience report: Using formal methods for requirements analysis of critical spacecraft software

NASA Technical Reports Server (NTRS)

Lutz, Robyn R.; Ampo, Yoko

1994-01-01

Formal specification and analysis of requirements continues to gain support as a method for producing more reliable software. However, the introduction of formal methods to a large software project is difficult, due in part to the unfamiliarity of the specification languages and the lack of graphics. This paper reports results of an investigation into the effectiveness of formal methods as an aid to the requirements analysis of critical, system-level fault-protection software on a spacecraft currently under development. Our experience indicates that formal specification and analysis can enhance the accuracy of the requirements and add assurance prior to design development in this domain. The work described here is part of a larger, NASA-funded research project whose purpose is to use formal-methods techniques to improve the quality of software in space applications. The demonstration project described here is part of the effort to evaluate experimentally the effectiveness of supplementing traditional engineering approaches to requirements specification with the more rigorous specification and analysis available with formal methods.

Content and bibliometric analyses of the Journal of Manual & Manipulative Therapy

PubMed Central

Simon, Corey B; Coronado, Rogelio A; Wurtzel, Wendy A; Riddle, Daniel L; George, Steven Z

2014-01-01

Background: Article characteristics and trends have been elucidated for other physical therapy-focused journals using content and bibliometric analysis. These findings are important for assessing the current state of a journal and for guiding future publication of research. To date, these analyses have not been performed for the Journal of Manual & Manipulative Therapy (JMMT). Objective: To describe content and trends for articles published in JMMT over a 20-year period (1993–2012). Methods: Journal articles were coded using previously-established domains (article type, participant type, research design, study purpose, and clinical condition). Total publications and proportion of publications based on domain were described. Articles specific to manual therapy intervention were examined and compared to data from other physical therapy-focused journals. Impact by citation and author was examined using bibliometric software. Results: Journal of Manual & Manipulative Therapy was found to have a recent acceleration in the number of articles published annually. Over time, topical reviews have decreased in favor of research reports. However, rigorous study designs have represented only a small portion of total journal content, and case reports have maintained a consistent publication presence. Manual therapy intervention articles in JMMT are predominantly case designs, however are similar in characteristics to manual therapy intervention articles published in other physical therapy-focused journals. For JMMT articles overall and manual therapy intervention articles across journals, young to middle-aged symptomatic adults with low back and/or neck pain were the most common study participants. Discussion: Increases in the number of papers and a move toward research reports were observed in JMMT over the 20-year period. Considerations for the future were outlined, including the publication of articles with more rigorous research designs. Manual therapy research for adolescents and older adults and for upper and lower extremity conditions should also be considered as priorities for the future. PMID:25395826

The Right Tools for the Job: The Challenges of Theory and Method in Geoscience Education Research

NASA Astrophysics Data System (ADS)

Riggs, E. M.

2011-12-01

As geoscience education has matured as a research field over the last decade, workers in this area have been challenged to adapt methodologies and theoretical approaches to study design and data collection. These techniques are as diverse as the earth sciences themselves, and researchers have drawn on established methods and traditions from science education research, social science research, and the cognitive and learning sciences. While the diversity of methodological and theoretical approaches is powerful, the challenge is to ground geoscience education research in rigorous methodologies that are appropriate for the epistemological and functional realities of the content area and the environment in which the research is conducted. The issue of theory is the first hurdle. After techniques are proven, earth scientists typically need not worry much about the theoretical value or theory-laden nature of measurements they make in the field or laboratory. As an example, a field geologist does not question the validity of the gravitational field that levels the spirit level within a Brunton compass. However, in earth science education research, these issues are magnified because a theoretical approach to a study affects what is admitted as data and the weight that can be given to conclusions. Not only must one be concerned about the validity of measurements and observations, but also the value of this information from an epistemological standpoint. The assigning of meaning to student gestures, utterances, writing and actions all carries theoretical implications. For example, working with geologists learning or working in the field, purely experimental research designs are very difficult, and the majority of the work must be conducted in a naturalistic environment. In fact dealing with time pressure, distractions, and complexity of a field environment is part of intellectual backdrop for field geology that separates experts from novices and advanced students from beginners. Thus researchers must embrace the uncontrolled nature of the setting, the qualitative nature of the data collected, and the researcher's role in interpreting geologically appropriate actions as evidence of successful problem solving and investigation. Working to understand the role of diversity and culture in the geosciences also involves a wide array of theory, from affective issues through culturally and linguistically-influenced cognition, through gender, self-efficacy, and many other areas of inquiry. Research in understanding spatial skills draws heavily on techniques from cognition research but also must involve the field-specific knowledge of geoscientists to infuse these techniques with exemplars, a catalog of meaningful actions by students, and an understanding of how to recognize success. These examples illustrate briefly the wide array of tools from other fields that is being brought to bear to advance rigorous geoscience education research. We will illustrate a few of these and the insights we have gained, and the power of theory and method from other fields to enlighten us as we attempt to educate a broader array of earth scientists.

Quality and rigor of the concept mapping methodology: a pooled study analysis.

PubMed

Rosas, Scott R; Kane, Mary

2012-05-01

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed. Copyright © 2011 Elsevier Ltd. All rights reserved.

Using Small-Scale Randomized Controlled Trials to Evaluate the Efficacy of New Curricular Materials

PubMed Central

Bass, Kristin M.; Stark, Louisa A.

2014-01-01

How can researchers in K–12 contexts stay true to the principles of rigorous evaluation designs within the constraints of classroom settings and limited funding? This paper explores this question by presenting a small-scale randomized controlled trial (RCT) designed to test the efficacy of curricular supplemental materials on epigenetics. The researchers asked whether the curricular materials improved students’ understanding of the content more than an alternative set of activities. The field test was conducted in a diverse public high school setting with 145 students who were randomly assigned to a treatment or comparison condition. Findings indicate that students in the treatment condition scored significantly higher on the posttest than did students in the comparison group (effect size: Cohen's d = 0.40). The paper discusses the strengths and limitations of the RCT, the contextual factors that influenced its enactment, and recommendations for others wishing to conduct small-scale rigorous evaluations in educational settings. Our intention is for this paper to serve as a case study for university science faculty members who wish to employ scientifically rigorous evaluations in K–12 settings while limiting the scope and budget of their work. PMID:25452482

A Research Agenda for Radiation Oncology: Results of the Radiation Oncology Institute's Comprehensive Research Needs Assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jagsi, Reshma, E-mail: rjagsi@med.umich.edu; Bekelman, Justin E.; Brawley, Otis W.

Purpose: To promote the rational use of scarce research funding, scholars have developed methods for the systematic identification and prioritization of health research needs. The Radiation Oncology Institute commissioned an independent, comprehensive assessment of research needs for the advancement of radiation oncology care. Methods and Materials: The research needs assessment used a mixed-method, qualitative and quantitative social scientific approach, including structured interviews with diverse stakeholders, focus groups, surveys of American Society for Radiation Oncology (ASTRO) members, and a prioritization exercise using a modified Delphi technique. Results: Six co-equal priorities were identified: (1) Identify and develop communication strategies to help patientsmore » and others better understand radiation therapy; (2) Establish a set of quality indicators for major radiation oncology procedures and evaluate their use in radiation oncology delivery; (3) Identify best practices for the management of radiation toxicity and issues in cancer survivorship; (4) Conduct comparative effectiveness studies related to radiation therapy that consider clinical benefit, toxicity (including quality of life), and other outcomes; (5) Assess the value of radiation therapy; and (6) Develop a radiation oncology registry. Conclusions: To our knowledge, this prioritization exercise is the only comprehensive and methodologically rigorous assessment of research needs in the field of radiation oncology. Broad dissemination of these findings is critical to maximally leverage the impact of this work, particularly because grant funding decisions are often made by committees on which highly specialized disciplines such as radiation oncology are not well represented.« less

Qualitative research: a review of methods with use of examples from the total knee replacement literature.

PubMed

Beaton, Dorcas E; Clark, Jocalyn P

2009-05-01

Qualitative research is a useful approach to explore perplexing or complicated clinical situations. Since 1996, at least fifteen qualitative studies in the area of total knee replacement alone were found. Qualitative studies overcome the limits of quantitative work because they can explicate deeper meaning and complexity associated with questions such as why patients decline joint replacement surgery, why they do not adhere to pain medication and exercise regimens, how they manage in the postoperative period, and why providers do not always provide evidence-based care. In this paper, we review the role of qualitative methods in orthopaedic research, using knee osteoarthritis as an illustrative example. Qualitative research questions tend to be inductive, and the stance of the investigator is relevant and explicitly acknowledged. Qualitative methodologies include grounded theory, phenomenology, and ethnography and involve gathering opinions and text from individuals or focus groups. The methods are rigorous and take training and time to apply. Analysis of the textual data typically proceeds with the identification, coding, and categorization of patterns in the data for the purpose of generating concepts from within the data. With use of analytic techniques, researchers strive to explain the findings; questions are asked to tease out different levels of meaning, identify new concepts and themes, and permit a deeper interpretation and understanding. Orthopaedic practitioners should consider the use of qualitative research as a tool for exploring the meaning and complexities behind some of the perplexing phenomena that they observe in research findings and clinical practice.

METHOD OF PREPARING UF$sub 6$

DOEpatents

Davidson, R.; Fried, S.

1959-10-27

A method is described of preparing uraniurn hexafluoride without the use of fluorine gas by reacting uraniurn tetrafluoride with oxygen gas under rigorously anhydrous conditions at 600 to 1300 deg K within a pre-fluorinated nickel vessel.

The Convoy Model: Explaining Social Relations From a Multidisciplinary Perspective

PubMed Central

Antonucci, Toni C.

2014-01-01

Purpose of the Study: Social relations are a key aspect of aging and the life course. In this paper, we trace the scientific origins of the study of social relations, focusing in particular on research grounded in the convoy model. Design and Methods: We first briefly review and critique influential historical studies to illustrate how the scientific study of social relations developed. Next, we highlight early and current findings grounded in the convoy model that have provided key insights into theory, method, policy, and practice in the study of aging. Results: Early social relations research, while influential, lacked the combined approach of theoretical grounding and methodological rigor. Nevertheless, previous research findings, especially from anthropology, suggested the importance of social relations in the achievement of positive outcomes. Considering both life span and life course perspectives and grounded in a multidisciplinary perspective, the convoy model was developed to unify and consolidate scattered evidence while at the same time directing future empirical and applied research. Early findings are summarized, current evidence presented, and future directions projected. Implications: The convoy model has provided a useful framework in the study of aging, especially for understanding predictors and consequences of social relations across the life course. PMID:24142914

Small sample mediation testing: misplaced confidence in bootstrapped confidence intervals.

PubMed

Koopman, Joel; Howe, Michael; Hollenbeck, John R; Sin, Hock-Peng

2015-01-01

Bootstrapping is an analytical tool commonly used in psychology to test the statistical significance of the indirect effect in mediation models. Bootstrapping proponents have particularly advocated for its use for samples of 20-80 cases. This advocacy has been heeded, especially in the Journal of Applied Psychology, as researchers are increasingly utilizing bootstrapping to test mediation with samples in this range. We discuss reasons to be concerned with this escalation, and in a simulation study focused specifically on this range of sample sizes, we demonstrate not only that bootstrapping has insufficient statistical power to provide a rigorous hypothesis test in most conditions but also that bootstrapping has a tendency to exhibit an inflated Type I error rate. We then extend our simulations to investigate an alternative empirical resampling method as well as a Bayesian approach and demonstrate that they exhibit comparable statistical power to bootstrapping in small samples without the associated inflated Type I error. Implications for researchers testing mediation hypotheses in small samples are presented. For researchers wishing to use these methods in their own research, we have provided R syntax in the online supplemental materials. (c) 2015 APA, all rights reserved.

Sexuality Research in Iran: A Focus on Methodological and Ethical Considerations.

PubMed

Rahmani, Azam; Merghati-Khoei, Effat; Moghaddam-Banaem, Lida; Zarei, Fatemeh; Montazeri, Ali; Hajizadeh, Ebrahim

2015-07-01

Research on sensitive topics, such as sexuality, could raise technical, methodological, ethical, political, and legal challenges. The aim of this paper was to draw the methodological challenges which the authors confronted during sexuality research with young population in the Iranian culture. This study was an exploratory mixed method one conducted in 2013-14. We interviewed 63 young women aged 18-34 yr in qualitative phase and 265 young women in quantitative phase in (university and non-university) dormitories and in an Adolescent Friendly Center. Data were collected using focus group discussions and individual interviews in the qualitative phase. We employed conventional content analysis to analyze the data. To enhance the rigor of the data, multiple data collection methods, maximum variation sampling, and peer checks were applied. Five main themes emerged from the data: interaction with opposite sex, sexual risk, sexual protective, sex education, and sexual vulnerability. Challenges while conducting sex research have been discussed. These challenges included assumption of promiscuity, language of silence and privacy concerns, and sex segregation policy. We described the strategies applied in our study and the rationales for each strategy. Strategies applied in the present study can be employed in contexts with the similar methodological and moral concerns.

77 FR 10752 - Proposed Information Collection Activity; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-23

... economic well-being of low-income individuals and families. The two primary research questions are: What is... material hardship? How do specific API project design features affect short- term participant outcomes? While some evaluations suggest that IDAs help low-income families save, rigorous experimental research...

What Districts Know--and Need to Know--about Their Principals

ERIC Educational Resources Information Center

George W. Bush Institute, Education Reform Initiative, 2016

2016-01-01

Research on school leadership has highlighted the impact principals have on student achievement through their influence on classroom instruction, organizational conditions, community support, and setting the teaching and learning conditions in schools. However, there is limited rigorous quantitative research on the best district policies and…

An Exemplar for Teaching and Learning Qualitative Research

ERIC Educational Resources Information Center

Onwuegbuzie, Anthony J.; Leech, Nancy L.; Slate, John R.; Stark, Marcella; Sharma, Bipin; Frels, Rebecca; Harris, Kristin; Combs, Julie P.

2012-01-01

In this article, we outline a course wherein the instructors teach students how to conduct rigorous qualitative research. We discuss the four major distinct, but overlapping, phases of the course: conceptual/theoretical, technical, applied, and emergent scholar. Students write several qualitative reports, called qualitative notebooks, which…

Improving Learning in Sub-Saharan Africa Using Rigorous Research Designs

ERIC Educational Resources Information Center

Piper, Benjamin

2017-01-01

Education researchers working in sub-Saharan Africa have recently and rapidly expanded the availability of evidence related to the impact of educational interventions on learning outcomes, particularly in preprimary and lower primary education (Ganimian & Murnane, 2016; McEwan, 2015; Popova, Evans, & Arancibia, 2016). Awareness that…

Evidence-Based Practice and Research: A Challenge to the Development of Adapted Physical Activity

ERIC Educational Resources Information Center

Hutzler, Yeshayahu Shayke

2011-01-01

Evidence-based practice (EBP) is a growing movement in the health and educational disciplines that recommends emphasis on research outcomes during decision making in practice. EBP is made possible through evidence based research (EBR), which attempts to synthesize the volume and scientific rigor of intervention effectiveness. With the purpose of…

Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools

ERIC Educational Resources Information Center

Wendt, Oliver; Miller, Bridget

2012-01-01

Critical appraisal of the research literature is an essential step in informing and implementing evidence-based practice. Quality appraisal tools that assess the methodological quality of experimental studies provide a means to identify the most rigorous research suitable for evidence-based decision-making. In single-subject experimental research,…

Economic analysis in support of broad scale land management strategies.

Treesearch

Richard Haynes

2003-01-01

The US has a century of experience with the development of forest policies that have benefited from or been influenced by economic research activities in the forest sector. At the same time, increasing rigor in policy debates stimulated economics research. During the past four decades economic research has evolved to include increased understanding of consumer demands...

A Meta-Analysis of Single-Subject Research on Behavioral Momentum to Enhance Success in Students with Autism

ERIC Educational Resources Information Center

Cowan, Richard J.; Abel, Leah; Candel, Lindsay

2017-01-01

We conducted a meta-analysis of single-subject research studies investigating the effectiveness of antecedent strategies grounded in behavioral momentum for improving compliance and on-task performance for students with autism. First, we assessed the research rigor of those studies meeting our inclusionary criteria. Next, in order to apply a…

Preschool Center Care Quality Effects on Academic Achievement: An Instrumental Variables Analysis

ERIC Educational Resources Information Center

Auger, Anamarie; Farkas, George; Burchinal, Margaret R.; Duncan, Greg J.; Vandell, Deborah Lowe

2014-01-01

Much of child care research has focused on the effects of the quality of care in early childhood settings on children's school readiness skills. Although researchers increased the statistical rigor of their approaches over the past 15 years, researchers' ability to draw causal inferences has been limited because the studies are based on…

2014 Wallace Foundation Distinguished Lecture--Rigor and Realism: Doing Educational Science in the Real World

ERIC Educational Resources Information Center

Snow, Catherine E.

2015-01-01

Transcending the low status of educational research will require demonstrating its relevance to improvements in practice. Educational progress is most likely to emerge from approaches to research that create an equal footing for practitioners and researchers, recognizing that though these groups accumulate and curate knowledge in different ways,…

Guidelines for reporting methodological challenges and evaluating potential bias in dementia research.

PubMed

Weuve, Jennifer; Proust-Lima, Cécile; Power, Melinda C; Gross, Alden L; Hofer, Scott M; Thiébaut, Rodolphe; Chêne, Geneviève; Glymour, M Maria; Dufouil, Carole

2015-09-01

Clinical and population research on dementia and related neurologic conditions, including Alzheimer's disease, faces several unique methodological challenges. Progress to identify preventive and therapeutic strategies rests on valid and rigorous analytic approaches, but the research literature reflects little consensus on "best practices." We present findings from a large scientific working group on research methods for clinical and population studies of dementia, which identified five categories of methodological challenges as follows: (1) attrition/sample selection, including selective survival; (2) measurement, including uncertainty in diagnostic criteria, measurement error in neuropsychological assessments, and practice or retest effects; (3) specification of longitudinal models when participants are followed for months, years, or even decades; (4) time-varying measurements; and (5) high-dimensional data. We explain why each challenge is important in dementia research and how it could compromise the translation of research findings into effective prevention or care strategies. We advance a checklist of potential sources of bias that should be routinely addressed when reporting dementia research. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

A Research Communication Brief: Gluten Analysis in Beef Samples Collected Using a Rigorous, Nationally Representative Sampling Protocol Confirms That Grain-Finished Beef Is Naturally Gluten-Free.

PubMed

McNeill, Shalene H; Cifelli, Amy M; Roseland, Janet M; Belk, Keith E; Woerner, Dale R; Gehring, Kerri B; Savell, Jeffrey W; Brooks, J Chance; Thompson, Leslie D

2017-08-25

Knowing whether or not a food contains gluten is vital for the growing number of individuals with celiac disease and non-celiac gluten sensitivity. Questions have recently been raised about whether beef from conventionally-raised, grain-finished cattle may contain gluten. To date, basic principles of ruminant digestion have been cited in support of the prevailing expert opinion that beef is inherently gluten-free. For this study, gluten analysis was conducted in beef samples collected using a rigorous nationally representative sampling protocol to determine whether gluten was present. The findings of our research uphold the understanding of the principles of gluten digestion in beef cattle and corroborate recommendations that recognize beef as a naturally gluten-free food.

Tutorial for writing systematic reviews for the Brazilian Journal of Physical Therapy (BJPT)

PubMed Central

Mancini, Marisa C.; Cardoso, Jefferson R.; Sampaio, Rosana F.; Costa, Lucíola C. M.; Cabral, Cristina M. N.; Costa, Leonardo O. P.

2014-01-01

Systematic reviews aim to summarize all evidence using very rigorous methods in order to address a specific research question with less bias as possible. Systematic reviews are widely used in the field of physical therapy, however not all reviews have good quality. This tutorial aims to guide authors of the Brazilian Journal of Physical Therapy on how systematic reviews should be conducted and reported in order to be accepted for publication. It is expected that this tutorial will help authors of systematic reviews as well as journal editors and reviewers on how to conduct, report, critically appraise and interpret this type of study design. PMID:25590440

Tutorial for writing systematic reviews for the Brazilian Journal of Physical Therapy (BJPT).

PubMed

Mancini, Marisa C; Cardoso, Jefferson R; Sampaio, Rosana F; Costa, Lucíola C M; Cabral, Cristina M N; Costa, Leonardo O P

2014-01-01

Systematic reviews aim to summarize all evidence using very rigorous methods in order to address a specific research question with less bias as possible. Systematic reviews are widely used in the field of physical therapy, however not all reviews have good quality. This tutorial aims to guide authors of the Brazilian Journal of Physical Therapy on how systematic reviews should be conducted and reported in order to be accepted for publication. It is expected that this tutorial will help authors of systematic reviews as well as journal editors and reviewers on how to conduct, report, critically appraise and interpret this type of study design.

Automatic Estimation of Verified Floating-Point Round-Off Errors via Static Analysis

NASA Technical Reports Server (NTRS)

Moscato, Mariano; Titolo, Laura; Dutle, Aaron; Munoz, Cesar A.

2017-01-01

This paper introduces a static analysis technique for computing formally verified round-off error bounds of floating-point functional expressions. The technique is based on a denotational semantics that computes a symbolic estimation of floating-point round-o errors along with a proof certificate that ensures its correctness. The symbolic estimation can be evaluated on concrete inputs using rigorous enclosure methods to produce formally verified numerical error bounds. The proposed technique is implemented in the prototype research tool PRECiSA (Program Round-o Error Certifier via Static Analysis) and used in the verification of floating-point programs of interest to NASA.

The Use of the Delphi and Other Consensus Group Methods in Medical Education Research: A Review.

PubMed

Humphrey-Murto, Susan; Varpio, Lara; Wood, Timothy J; Gonsalves, Carol; Ufholz, Lee-Anne; Mascioli, Kelly; Wang, Carol; Foth, Thomas

2017-10-01

Consensus group methods, such as the Delphi method and nominal group technique (NGT), are used to synthesize expert opinions when evidence is lacking. Despite their extensive use, these methods are inconsistently applied. Their use in medical education research has not been well studied. The authors set out to describe the use of consensus methods in medical education research and to assess the reporting quality of these methods and results. Using scoping review methods, the authors searched the Medline, Embase, PsycInfo, PubMed, Scopus, and ERIC databases for 2009-2016. Full-text articles that focused on medical education and the keywords Delphi, RAND, NGT, or other consensus group methods were included. A standardized extraction form was used to collect article demographic data and features reflecting methodological rigor. Of the articles reviewed, 257 met the inclusion criteria. The Modified Delphi (105/257; 40.8%), Delphi (91/257; 35.4%), and NGT (23/257; 8.9%) methods were most often used. The most common study purpose was curriculum development or reform (68/257; 26.5%), assessment tool development (55/257; 21.4%), and defining competencies (43/257; 16.7%). The reporting quality varied, with 70.0% (180/257) of articles reporting a literature review, 27.2% (70/257) reporting what background information was provided to participants, 66.1% (170/257) describing the number of participants, 40.1% (103/257) reporting if private decisions were collected, 37.7% (97/257) reporting if formal feedback of group ratings was shared, and 43.2% (111/257) defining consensus a priori. Consensus methods are poorly standardized and inconsistently used in medical education research. Improved criteria for reporting are needed.

Hybrid Theory of Electron-Hydrogenic Systems Elastic Scattering

NASA Technical Reports Server (NTRS)

Bhatia, A. K.

2007-01-01

Accurate electron-hydrogen and electron-hydrogenic cross sections are required to interpret fusion experiments, laboratory plasma physics and properties of the solar and astrophysical plasmas. We have developed a method in which the short-range and long-range correlations can be included at the same time in the scattering equations. The phase shifts have rigorous lower bounds and the scattering lengths have rigorous upper bounds. The phase shifts in the resonance region can be used to calculate very accurately the resonance parameters.

Reflections on Recent Research Into Animal-Assisted Interventions in the Military and Beyond.

PubMed

Rumayor, Christina B; Thrasher, Amy M

2017-11-25

The purpose of the present review was threefold: to address the current state of Animal-Assisted Interactions (AAI) within the military; to summarize recent literature (within the past three years) in the field of AAI; and to discuss trends in AAI research since 2014. With regard to AAI within the military, several canine interaction programs have been utilized to assist service members in coping with various issues. Therapy dogs have been deployed with Combat-Operational Stress Control units; they have been integrated into medical clinics and behavioral health treatment programs in garrison; and policy has been developed to address the use of therapy animals in military treatment facilities. General research in AAI has demonstrated efficacy for certain presenting issues (stress management, trauma, autism spectrum disorder) and specific populations (children, the elderly, acute care patients). Overall trends in research include calls for increased consideration for animal welfare in AAI and increased rigor in research methodology. Current research supports the structured use of therapy dogs in the treatment of various disorders and with specific populations, including military service members and veterans; however, the need for additional research with rigorous methodology remains.

A Rigorous Solution for Finite-State Inflow throughout the Flowfield

NASA Astrophysics Data System (ADS)

Fei, Zhongyang

In this research, the Hseih/Duffy model is extended to all three velocity components of inflow across the rotor disk in a mathematically rigorous way so that it can be used to calculate the inflow below the rotor disk plane. This establishes a complete dynamic inflow model for the entire flow field with finite state method. The derivation is for the case of general skewed angle. The cost of the new method is that one needs to compute the co-states of the inflow equations in the upper hemisphere along with the normal states. Numerical comparisons with exact solutions for the z-component of flow in axial and skewed angle flow demonstrate excellent correlation with closed-form solutions. The simulations also illustrate that the model is valid at both the frequency domain and the time domain. Meanwhile, in order to accelerate the convergence, an optimization of even terms is used to minimize the error in the axial component of the induced velocity in the on and on/off disk region. A novel method for calculating associate Legendre function of the second kind is also developed to solve the problem of divergence of Q¯mn (ieta) for large eta with the iterative method. An application of the new model is also conducted to compute inflow in the wake of a rotor with a finite number of blades. The velocities are plotted at different distances from the rotor disk and are compared with the Glauert prediction for axial flow and wake swirl. In the finite-state model, the angular momentum does not jump instantaneously across the disk, but it does transition rapidly across the disk to correct Glauert value.

A user-friendly tool to evaluate the effectiveness of no-take marine reserves.

PubMed

Villaseñor-Derbez, Juan Carlos; Faro, Caio; Wright, Melaina; Martínez, Jael; Fitzgerald, Sean; Fulton, Stuart; Mancha-Cisneros, Maria Del Mar; McDonald, Gavin; Micheli, Fiorenza; Suárez, Alvin; Torre, Jorge; Costello, Christopher

2018-01-01

Marine reserves are implemented to achieve a variety of objectives, but are seldom rigorously evaluated to determine whether those objectives are met. In the rare cases when evaluations do take place, they typically focus on ecological indicators and ignore other relevant objectives such as socioeconomics and governance. And regardless of the objectives, the diversity of locations, monitoring protocols, and analysis approaches hinder the ability to compare results across case studies. Moreover, analysis and evaluation of reserves is generally conducted by outside researchers, not the reserve managers or users, plausibly thereby hindering effective local management and rapid response to change. We present a framework and tool, called "MAREA", to overcome these challenges. Its purpose is to evaluate the extent to which any given reserve has achieved its stated objectives. MAREA provides specific guidance on data collection and formatting, and then conducts rigorous causal inference analysis based on data input by the user, providing real-time outputs about the effectiveness of the reserve. MAREA's ease of use, standardization of state-of-the-art inference methods, and ability to analyze marine reserve effectiveness across ecological, socioeconomic, and governance objectives could dramatically further our understanding and support of effective marine reserve management.

A user-friendly tool to evaluate the effectiveness of no-take marine reserves

PubMed Central

Fitzgerald, Sean; Fulton, Stuart; Mancha-Cisneros, Maria del Mar; McDonald, Gavin; Micheli, Fiorenza; Suárez, Alvin; Torre, Jorge

2018-01-01

Marine reserves are implemented to achieve a variety of objectives, but are seldom rigorously evaluated to determine whether those objectives are met. In the rare cases when evaluations do take place, they typically focus on ecological indicators and ignore other relevant objectives such as socioeconomics and governance. And regardless of the objectives, the diversity of locations, monitoring protocols, and analysis approaches hinder the ability to compare results across case studies. Moreover, analysis and evaluation of reserves is generally conducted by outside researchers, not the reserve managers or users, plausibly thereby hindering effective local management and rapid response to change. We present a framework and tool, called “MAREA”, to overcome these challenges. Its purpose is to evaluate the extent to which any given reserve has achieved its stated objectives. MAREA provides specific guidance on data collection and formatting, and then conducts rigorous causal inference analysis based on data input by the user, providing real-time outputs about the effectiveness of the reserve. MAREA’s ease of use, standardization of state-of-the-art inference methods, and ability to analyze marine reserve effectiveness across ecological, socioeconomic, and governance objectives could dramatically further our understanding and support of effective marine reserve management. PMID:29381762

TummyTrials: A Feasibility Study of Using Self-Experimentation to Detect Individualized Food Triggers.

PubMed

Karkar, Ravi; Schroeder, Jessica; Epstein, Daniel A; Pina, Laura R; Scofield, Jeffrey; Fogarty, James; Kientz, Julie A; Munson, Sean A; Vilardaga, Roger; Zia, Jasmine

2017-05-02

Diagnostic self-tracking, the recording of personal information to diagnose or manage a health condition, is a common practice, especially for people with chronic conditions. Unfortunately, many who attempt diagnostic self-tracking have trouble accomplishing their goals. People often lack knowledge and skills needed to design and conduct scientifically rigorous experiments, and current tools provide little support. To address these shortcomings and explore opportunities for diagnostic self-tracking, we designed, developed, and evaluated a mobile app that applies a self-experimentation framework to support patients suffering from irritable bowel syndrome (IBS) in identifying their personal food triggers. TummyTrials aids a person in designing, executing, and analyzing self-experiments to evaluate whether a specific food triggers their symptoms. We examined the feasibility of this approach in a field study with 15 IBS patients, finding that participants could use the tool to reliably undergo a self-experiment. However, we also discovered an underlying tension between scientific validity and the lived experience of self-experimentation. We discuss challenges of applying clinical research methods in everyday life, motivating a need for the design of self-experimentation systems to balance rigor with the uncertainties of everyday life.

Using microstructure observations to quantify fracture properties and improve reservoir simulations. Final report, September 1998

DOE Office of Scientific and Technical Information (OSTI.GOV)

Laubach, S.E.; Marrett, R.; Rossen, W.

The research for this project provides new technology to understand and successfully characterize, predict, and simulate reservoir-scale fractures. Such fractures have worldwide importance because of their influence on successful extraction of resources. The scope of this project includes creation and testing of new methods to measure, interpret, and simulate reservoir fractures that overcome the challenge of inadequate sampling. The key to these methods is the use of microstructures as guides to the attributes of the large fractures that control reservoir behavior. One accomplishment of the project research is a demonstration that these microstructures can be reliably and inexpensively sampled. Specificmore » goals of this project were to: create and test new methods of measuring attributes of reservoir-scale fractures, particularly as fluid conduits, and test the methods on samples from reservoirs; extrapolate structural attributes to the reservoir scale through rigorous mathematical techniques and help build accurate and useful 3-D models of the interwell region; and design new ways to incorporate geological and geophysical information into reservoir simulation and verify the accuracy by comparison with production data. New analytical methods developed in the project are leading to a more realistic characterization of fractured reservoir rocks. Testing diagnostic and predictive approaches was an integral part of the research, and several tests were successfully completed.« less